modifiedsince= and substitutions

coriolis
11/02/2005 09:29 am
Is it possible to use URL substitutions with the modifiedsince keyword? Or, ideally, is there a modifiedsince syntax that more easily supports time periods instead of specific dates?

Specifically, I`d like to download only pages modified in the last two days, even if copies of the older pages no longer exist on my machine.
Oleg Chernavin
11/02/2005 03:54 pm
Yes, you can use URL Macros with that command. To use a date two days before, use {:date-2} macro. You can read more about URL Macros in the Help file.

Best regards,
Oleg Chernavin
MP Sta
coriolis
11/02/2005 09:05 pm
I see, I needed to use {:shortmonth} instead of {:month}. Now that works!

Unfortunately, about half of the projects I add this line to stop working with the dreaded "Error reading from file / Error code=00000002 File not found" message. This is the same problem I described in the ".primary files in 3.9SR1" thread, which had already been fixed with a patch. I am currently running that patch. The error seems to randomly occur in projects that use URL substitution. Is there a fix for this? Thank you.
Oleg Chernavin
11/03/2005 09:48 am
Can you please send me the Project settings that reproduce this issue? Please select the Project, click the Copy button on toolbar and then paste it to the forum message. Also, does this error occur even on the first downloaded file?

Oleg.
coriolis
11/04/2005 12:25 am
Sure, here`s the project. It also gets the same error if I remove all the URL substitutions, so that doesn`t seem to be the problem. What appears to happen is that OEP checks the main URL, gets "304 Not Modified", and then attempts to parse the file it just didn`t download. In this case yes, the error is received on the first file, and nothing is downloaded.


[Object]
OEVersion=Pro 3.9.0.2124
Type=0
IID=7091
Caption=http://www.4chan.org/
URL=http://www.4chan.org/channelsperserver=2channels=8ModifiedSince={:SetDate=time-1140}{:Shortday}, {:0Day} {:ShortMonth} {:LongYear} {:0Hour}:{:0Minute}:{:0Second} GMT
Lev=1000001
When=5
Hour=2
Weekday=257
LimBTSize=True
LimBNumber=True
LimTSize=200000
LimNumber=5000
LimTime=100
SkipMedia=True
FTText.Exts=htmlhtmaspaspxjspstmstmlidcshtmlhtxxspxmlrxmlcfmwmlphpphp3 xxxxxxxxxxxxxxxxx
FTImages.Exts=gifjpgjpegtiftiffxbmfifbmppngipxjp2j2cj2kwbmplwf
FTVideo.Exts=mpgavianimpegmovfliflcvivrmramrvasfasxwmvm1vm2vvob
FTAudio.Exts=wavriffmp3midmp2m3uravocwmaape
FTArchive.Exts=ziparcgzzarjlhalayleirarcabtarpakacejar
FTUDef.Exts=jscssssivbsdtdxslswfexescr ooooooxoo
FTText.B=xoxooo
FTImages.B=ooxooo
FTVideo.B=ooxooo
FTAudio.B=ooxooo
FTArchive.B=ooxooo
FTUDef.B=ooxooo
FTOther.B=xoxooo
FTSizes=0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0
RSrvsBx=2
RSrvsIn=4chan.org4channel.org xx
RSrvsEx=not4chan.org x
RPathBx=2
RPathEx=/thumb//dis//sug//res//cm//b//g//ib//k//m//n//o//p//y//blog/ xxxoxxxxxxxxxxx
RFileBx=2
RFileEx=faq.phpfaq.htmlrid.phpgo.phpjapanese.phpjapanese.htmlrules.phptools.phpnews.phpadvertise.phprules.htmlframes=yesnews.htmlmailto:irc.phpmegaloop.php@:*.swf xxxxxxxxxxxxxxxxxxx
RProtBx=1
RProt=63
LastStart=175:135:48:251:127:224:226:64:
LastEnd=231:197:58:251:127:224:226:64:
S304=1
SPar=1
SLast=304
LFiles=1
Copies=10
CopiesFmt=1
CopiesDate=_(YYYYMMDDHHNN)
Substs=http://*.4chan.org/* http://*.4chan.org/ http://www.4chan.org/{:longyear}-{:0month}-{:longmonth}/ Xhttp://*.4channel.org/* http://*.4channel.org/ http://www.4chan.org/{:longyear}-{:0month}-{:longmonth}/ X*/src/* /src/ / X
ApplyAllSubsts=True
ImgDim=0,0,0,0
PrevURL=http://www.4chan.org/
SkipURLs=http://dis.4chan.org/http://sug.4chan.org/
Oleg Chernavin
11/08/2005 12:19 pm
Yes, this will happen if URL Substitutes place the file to some other directory. If the file was not updated on the server, it should actually exist on the hard disk to be parsed correctly. Unfortunately, URL Substitutes do not give good results when used with the site updates. It is better to redownload it.

Oleg.