Re: Using keyword to filter url

Author Message
James 07/23/2010 04:46 pm
Hi,
Can someone help me with this?

My starting url is http://www.site.com


I only want to download the urls that start with
http://www.site.com/product.asp?sub=


but they are
http://www.site.com/product.asp?sub=121&prod=124363
http://www.site.com/product.asp?sub=347&prod=02296A
http://www.site.com/product.asp?sub=21&prod=24326c
http://www.site.com/product.asp?sub=341&prod=56796g

Is there a way to do this because when I in url filter > keywords I add the product.asp?sub=
noting downloads...

Please explain how to do this as my knowledge is very basic

Thanks
James 07/23/2010 07:46 pm
I can't figure this I am sure there is a simple answer...

The main site is http://www.site.com

I only want to download the url that have

http://www.site.com/product.asp?sub=34&prod=4355
http://www.site.com/product.asp?sub=544&prod=9341
http://www.site.com/product.asp?sub=65&prod=7632

I don't want the url that have

http://www.site.com/category.asp?cat=
http://www.site.com/subcategory.asp?sub=
or any other varation


I have added url filters - filename (incuded files keyword)
product.asp?sub=*&prod=*

I have also tried it with and without load files only with the satrting filename

but it woun't work either way...

I must be doing something wrong here...
Oleg Chernavin 07/24/2010 03:52 am
Please create a new Project with the starting URL you need. Uncheck Level setting. Once it is created, select it in the Projects tree and click the Properties button on toolbar.

Go to URL Filters - Filename section and add:

product.asp?sub=

to the Included filename keywords list. Click the OK button to save the changed.

Best regards,
Oleg Chernavin
MP Staff
james 07/24/2010 12:13 pm
Hi,
Thank you for quick response.
I have done that but noting downloads...

The url: is lightbuolbdepot dot com

Oleg Chernavin 07/24/2010 01:41 pm
This is correct. Because the starting server page doesn't have such links to products. You need to add the following keywords to the same list:

category.asp
department.asp

Oleg.