Metal-Archives

Author Message
Seraphim 06/11/2004 09:21 am
Hi, is there a way to download http://www.metal-archives.com/ . I think it`s protected by robots.txt file, even if I manage to download the site it never downloads all.

One more question, I`m a bit confused about disabling downloading the forum part about that site (I don`t need forum).

Than You

p.s. My apologies for my engRish
Oleg Chernavin 06/11/2004 12:47 pm
It is easy to exclude all forum pages from the Project download. Select that Project, click Properties button on toolbar and go to URL Filters | Directory. Select Custom Configuration and add the following to the Excluded directory keywords list:

/board/

Regarding the full site download - please let me know which particular links cannot be loaded.

Thank you!

Best regards,
Oleg Chernavin
MP Staff