|Seraphim||06/11/2004 09:21 am|
|Hi, is there a way to download http://www.metal-archives.com/ . I think it`s protected by robots.txt file, even if I manage to download the site it never downloads all.
One more question, I`m a bit confused about disabling downloading the forum part about that site (I don`t need forum).
p.s. My apologies for my engRish
|Oleg Chernavin||06/11/2004 12:47 pm|
|It is easy to exclude all forum pages from the Project download. Select that Project, click Properties button on toolbar and go to URL Filters | Directory. Select Custom Configuration and add the following to the Excluded directory keywords list:
Regarding the full site download - please let me know which particular links cannot be loaded.