Is it possibe to add a new file filter of time

  • User Forums
  • Is it possibe to add a new file filter of time
wyf
03/29/2006 07:01 am
Some websites are daily renewed. And they have endless history files, so you cannot just retrieve all the history files and make OEP download only "new files". So I guess a file filter that can limit the upload date of files could help. Just like: only download files uploaded from 2003/02/10 to 2003/02/11. Is it possibe?
Thanks.

wyf.
Oleg Chernavin
03/29/2006 07:01 am
There is a way to do that. You can specify a special command ModifiedSince after the URL:

http://www.server.com/
ModifiedSince=Mon, 10 Feb 2003 19:51:50 GMT

Please use the above template exactly.

I hope this helps.

Best regards,
Oleg Chernavin
MetaProducts corp.
wyf
03/29/2006 07:01 am
Thx, I`m trying. Does it work on any page, any file?

wyf.
Oleg Chernavin
03/29/2006 07:01 am
Yes, but not all servers and not for all files support that file modification checks.

Oleg.
wyf
03/29/2006 07:01 am
In a website like this:
|----1.gif
|
|--Feb 11.html--|----2.gif
| |
| |----.....
main.html ----|
|
|--Feb 12.html---.........
|
|----......

I use this MODIFIEDSINCE method to retrieve all the new gif files.
Could you please tell me:
1, Can I uncheck "FILE FILTERS--TEXT" ?

2, Should I make "LEVEL LIMIT" 2 or 1?

3, Should I check "skip existing files on levels higher than" or "do not download existing file" in "file modification check"?

4, After download is finished everyday, what will happen if I move all the gif files into some other folder with EXPLORER ? will they be re-downloaded the next day? will they be re-parsed? (Suppose I don`t change MODIFIEDSINCE value the next day.)
wyf
03/29/2006 07:01 am
I don`t know why my last post is messy. Simply put, it`s a structure like:

mail.html------Feb11.html------1.gif
03/29/2006 07:01 am
1. Level should be 1 if image files are on the page (not as clickable links to images)
2. Unchecking Text will not make any sence.
3. Use the first (default) File modification check mode, otherwise images on Level 1 will be not checked for modifications at all.
4. If you move files, they will be redownloaded

Oleg.
wyf
03/29/2006 07:01 am
Thanks a million !
03/29/2006 07:01 am
You are welcome!

Oleg.