offline links with Javascript don't work

Author Message
Udo 01/07/2011 01:52 pm
Dear Oleg,

I'm evaluating OE Pro and find it great. It allows Downloads with much less problems than other Offline Readers. However there still remain some problems.

In one project links aren't built correctly out of Javascript. The URL is http://www.motorsport.com/photos/.
OE Pro downloads all data but the links from the thumbnail pages to the fullsize picture Pages don't work in the download nor in its export.

For example the original link is:
http://www.motorsport.com/photos/popup.asp?N=0&I=lemans/2010/gen/lemans-2010-gen-tm-0431.jpg&FS=LEMANS&SN=1_188.174.71.131:58098&S=LEMANS

The export file of this page is:
popup.asp@n=0&i=lemans_2f2010_2fgen_2flemans-2010-gen-tm-0431.jpg&fs=lemans.htm
(the part '&SN=1_188.174.71.131:58098&S=LEMANS' was removed by URL Substitute)

But the link generated by the exported thumbnail page is:
.../www.motorsport.com/photos/popup.asp?N=0&I=lemans/2010/gen/lemans-2010-gen-tm-0431.jpg&FS=LEMANS&SN=1_188.174.71.131:59500&S=LEMANS

Obviously in this case the script calculation doesn't reflect
- the substitution of the ? to @
- the substitution of the / to _2f
- the URL Substitution of the session ID

Can you help getting these links to work?

For reproducing this case I attach my project setting below (with a lot of filters that avoid a huge download). For my example please browse to racing series LeMans, then
'12-10 Audi R18 TDI presentation: Studio shoot (19)'.

Thanks in advance,
Udo


[Object]
OEVersion=Pro 5.9.0.3284
Type=0
IID=7022
Caption=http://www.motorsport.com/photos/
URL=http://www.motorsport.com/photos/
MVer=5
Lev=1000000
Weekday=257
LimTSize=10000
LimNumber=5000
LimTime=100
FTText.Exts=htmlhtmaspaspxjspstmstmlidcshtmlhtxtxttextxspxmlrxmlcfmwmlphpphp3
FTImages.Exts=gifjpgjpegtiftiffxbmfifbmppngipxjp2j2cj2kwbmplwfwebp
FTVideo.Exts=mpgavianimpegmovflvfliflcvivrmramrvasfasxwmvm1vm2vvobsmilmp4m4v
FTAudio.Exts=wavriffmp3midmp2m3uravocwmaapeoggm4a
FTArchive.Exts=ziparcgzzarjlhalayleirarcabtarpakacejarpdftgzexe
FTUDef.Exts=jsaxdcssssivbsdtdxslswfclassent
FTText.B=ooxooo
FTImages.B=ooxooo
FTVideo.B=ooxooo
FTAudio.B=ooxooo
FTArchive.B=ooxooo
FTUDef.B=ooxooo
FTOther.B=ooxooo
FTSizes=0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,3,3,3,0,3,0
NotIgnoreLogout=False
RPathBx=1
RFileEx=beautiesdriverausv8ssphotographeralmsbtccdakardtmf1f2fia-gtgrandamindycarmiscmotogpnasanascarsupergtwrcwtccama-sbkarcaatlanticbf3enduranceeurof3gp2historyihraindylightskartlmsopenwheelprorallysccavintagewsbk1998199920002001200220032004200520062007200820092011 xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx
RProt=255
LastStart=168:77:195:58:191:204:227:64:
LastEnd=109:9:171:52:191:204:227:64:
LastStarted=06.01.2011 23:25:19
LastEnded=06.01.2011 23:24:15
S200=680
S400=105
SPar=456
SSav=680
SLast=200
SSiz=31968924
SMdf=680
SHTML=455
SSuccDowns=24
LFiles=785
LSize=31997597
SubstsB=d3d3Lm1vdG9yc3BvcnQuY29tLyoJJlNOPSoJDQo=
ApplyAllSubsts=True
ImgDim=0,0,0,0
PrevURL=http://www.motorsport.com/photos/
SkipURLs=http://a0.twimg.com/http://a1.twimg.com/http://a2.twimg.com/http://a3.twimg.com/http://ajax.googleapis.com/http://b.static.ak.fbcdn.net/http://bit.ly/http://dmoz.org/http://error.facebook.com/http://forums.motorsport.com/http://kona.kontera.com/http://l.addthiscdn.com/http://members.shaw.ca/http://photos-a.ak.fbcdn.net/http://photos-b.ak.fbcdn.net/http://photos-h.ak.fbcdn.net/http://profile.ak.fbcdn.net/http://s7.addthis.com/http://static.ak.fbcdn.net/http://twitter.com/http://www.addthis.com/http://www.facebook.com/http://www.google.com/http://www.google-analytics.com/http://www.motorsport.com/compete/http://www.motorsport.com/directory/http://www.motorsport.com/magazine/http://www.motorsport.com/news/http://www.motorsport.com/schedules/http://www.motorsport.com/stats/http://www.smartadserver.com/http://www3.smartadserver.com/
ParseComplexScripts=True
ConvertRSS=True
Exported=06.01.2011 23:27:47 - Y:\Websites Offline Explorer\Exporttest\
LIndexed=True
IndexFiles=True
Oleg Chernavin 01/07/2011 02:01 pm
I think you simply have to enable script calculations in the Project Properties dialog - Parsing section. This worked for me in a simple Project with the URL:

http://www.motorsport.com/photos/select.asp?Y=2010&S=LEMANS&E=Audi_R18_TDI_presentation/Studio_shoot

and Level=1. All other settings were by default.

Best regards,
Oleg Chernavin
MP Staff
Udo 01/07/2011 05:44 pm
Dear Oleg,

thanks for your quick answer. Your test works for me too, but unfortunately it doesn't really help me for two reasons.

The first is that it only works in the internal OE-Browser, but doesn't work in an export of the project. I need an export with added standard extensions because my full text search tool doesn't index files without known extension.

Secondly it doesn't work any more for some reason if I start one or two directories above. This is necessary for me because I want to download for example all 2010 Le Mans albums without making an own project for each album.

Script calculation was enabled in all of my tests.

Best regards,
Udo
Oleg Chernavin 01/08/2011 10:21 am
Yes, this is true. Export with standard extensions makes these links non-working. Unfortunately, nothing can be done with that. Sorry.

Oleg.