Filter adjustments?

Karen
12/07/2005 05:21 pm
Hello Oleg,

We are trying to download and archive a large group of digital projects. In the past we would crash the computer trying to download everything in one go. Each project is located in its own separate directory, so we have been trying to use filters to narrow in on smaller chunks to download at a time.

We used the alphabetical list as our starting URL:
http://collections.gc.ca/E/Alphabet.asp

And we used directory filters such as
/a*
for the projects in directories that start with a.

This gave us _some_ but not all of the projects. We think we know what it did, but not how to solve the problem. We think it downloaded projects in folders such as
http://collections.gc.ca/afolder/
but not
http://collections.gc.ca/afolder
(the difference being the slash at the end)

Can you suggest a refinement to our filters?

Thanks!

--Karen
Oleg Chernavin
12/07/2005 05:29 pm
The solution would be to allow downloading from all directories and use Filename filter:

http://*/a*/*
a*

This will cover both cases.

Best regards,
Oleg Chernavin
MP Staff