Does Offline Explorer supports (could obey) the Robot Exclusion Standard file (file set by webmasters to set where robots can explore and preventing robots to explore into off-limit areas)?
If it is supported, can you tell me which version of Offline Explorer supports this feature (Standard, Pro, or Enterprise)?
Thank you.
Anyway, each Offline Explorer edition contains very flexible and powerful URL Filters, which can help you to setup any type of exclusion you want.
Best regards,
Oleg Chernavin
MetaProducts corp.