How do I always block sites

GregF
03/29/2006 07:01 am
I`m a little confused-- how do I create a template that will always block certain urls? For example many sites have links to real and yahoo and quicktime. I`d like to always prevent my project from scanning those sites. Where in a template do I enter that, and I want to make sure I`ve got the url wording correct-- if I want to block all pages and links on real.com, how exactly do I enter that into the field? *real.com* ?
Oleg Chernavin
03/29/2006 07:01 am
Yes, you will have to enter the site names, like:

real.com
someothersite.com

into the Excluded server keywords list in the Custom Configuration of the URL Filters | Server. Keep Custom configuration selected there, so keywords take effect while downloading.

I hope this helps.

Best regards,
Oleg Chernavin
MetaProducts corp.
GregF
03/29/2006 07:01 am
Thanks Oleg, nice to have you back.

My next question then, what is the purpose for the big window under "URL Filters", the one that says "Skip the following url`s while downloading". What is the purpose of that window?

> Yes, you will have to enter the site names, like:
>
> real.com
> someothersite.com
>
> into the Excluded server keywords list in the Custom Configuration of the URL Filters | Server. Keep Custom configuration selected there, so keywords take effect while downloading.
>
> I hope this helps.
>
> Best regards,
> Oleg Chernavin
> MetaProducts corp.
Oleg Chernavin
03/29/2006 07:01 am
Thank you!

First, there was a feature to Disable some URL from loading in the Map. That file was added to URL Filters | Filename | Custom configuration section. It was unhandy to go there and see what URLs were disabled. So, that field added more visibility.

Second, URL Filters keywords slow down downloading when many of keywords are being used. That disabled URLs section was optimized greatly for the speed, so it operates much faster than URL Filters. However you can place only full URLs there, not keywords.

Oleg.
GregF
03/29/2006 07:01 am
If I put http://www.real.com would that stop http://www.real.com/freeplayer ? Just curious.

>However you can place only full URLs there, not keywords.
>
> Oleg.
Oleg Chernavin
03/29/2006 07:01 am
The code works this way - it a URL ends with /, then it means a restricted server or directory and all files on that server/directory will not be loaded. Without the ending slash, only exact URL will be excluded.

Oleg.
GregF
03/29/2006 07:01 am
> The code works this way - it a URL ends with /, then it means a restricted server or directory and all files on that server/directory will not be loaded. Without the ending slash, only exact URL will be excluded.
>
> Oleg.

Oh I`m glad I asked that`s important! Your application works so well, however there is a bit of a learning curve.
Oleg Chernavin
03/29/2006 07:01 am
Oh, yes!

Oleg.