How to dl these Urls?

Author Message
Hu 07/03/2015 12:21 pm
I'm downloading a website, which file structure is like this: http://domain/seq1/seq2, and seq1 and seq2 are corresponding.

e.g. while seq1=abc, seq2={1...1200}; while seq1=bcd, seq2={1...500}; while seq1=xyz, seq2={1...750} and so on.

That is I need to download the following files:

http://domain/abc/00001.jpg
...
http://domain/abc/01200.jpg
http://domain/bcd/00001.jpg
...
http://domain/bcd/00500.jpg
http://domain/xyz/00001.jpg
....
http://domain/xyz/00750.jpg

I made two files, one for seq1 name seq1.txt and the other for seq2 named seq2.txt, and try to use the following sytax

http://domain/{:file=d:\seq1.txt}/{:file=d:\seq2.txt}

However, that seems to be no good for my goal.

Would you please help me out?
Oleg Chernavin 07/04/2015 11:15 am
What about a different way:

http://domain/abc/0{:0001..01200}.jpg
http://domain/bcd/00{:001..500}.jpg
http://domain/xyz/00{:001..750}.jpg

You would write the seq1 in the URLs field itself. If this approach doesn't work, you may use:

http://domain/{:file=d:\seq1.txt}/0{:0001..01999}.jpg

It is not a big problem if Offline Explorer would try get more URLs - they will result in a 404 error and not be saved.

Best regards,
Oleg Chernavin
MP Staff
Hu 07/04/2015 12:46 pm
Thanks for your information.

http://domain/{:file=d:\seq1.txt}/0{:0001..01999}.jpg

That's what I'm doing now, but some websites may restrict the times of invaild accessing, how could I do with this situation?
Oleg Chernavin 07/04/2015 03:22 pm
If this happens, it is better to create separate Projects per sequence and set numbers exact to each one.

That's not very simple, but would work.

Oleg.