Hi, is there a way to download http://www.metal-archives.com/ . I think it`s protected by robots.txt file, even if I manage to download the site it never downloads all.
One more question, I`m a bit confused about disabling downloading the forum part about that site (I don`t need forum).
Than You
p.s. My apologies for my engRish
It is easy to exclude all forum pages from the Project download. Select that Project, click Properties button on toolbar and go to URL Filters | Directory. Select Custom Configuration and add the following to the Excluded directory keywords list:
/board/
Regarding the full site download - please let me know which particular links cannot be loaded.
Thank you!
Best regards,
Oleg Chernavin
MP Staff