Robot Exclusion Standard
|Ronald BG.||03/29/2006 07:01 am|
|I have a question regarding Offline Explorer`s feature:
Does Offline Explorer supports (could obey) the Robot Exclusion Standard file (file set by webmasters to set where robots can explore and preventing robots to explore into off-limit areas)?
If it is supported, can you tell me which version of Offline Explorer supports this feature (Standard, Pro, or Enterprise)?
|Oleg Chernavin||03/29/2006 07:01 am|
|I am sorry, but we only have this feature in our plans.
Anyway, each Offline Explorer edition contains very flexible and powerful URL Filters, which can help you to setup any type of exclusion you want.