Crawl links on page but don''t download page?
|Jeff||06/10/2008 04:32 pm|
|Is there a way to crawl a site four link levels deep but only download pages that match an file name pattern? When I added the filename in the filter it didn''t crawl the links that didn''t match the pattern.
|Oleg Chernavin||06/11/2008 06:23 am|
|Yes, you can use URL Filters - Filename section of the Project Properties dialog for that.
But if you need to get all Web pages, process and follow links in them, but save to the disk only the files that are allowed, you may use the following URLs field command:
Specify the mask, like: