Javascript link question

Author Message
ssieloff 11/15/2005 04:02 pm
Oleg --

I am trying to get OE 4 beta to follow the Javascript navigation links (p1 - p5) to follow the 28 pages of 500 offender records ... but I continue to only get and parse the first 500 ... none of the next page links (javascript) are recognized and loaded ... can you tell me what I am doing wrong her?

This is the base URL for the search ... I enter %%% for the last name and 500 for the number of records per page then hit search:

http://www.esorn.ag.state.oh.us/Secured/p21_2.aspx

You will see 500 offender links that I want to follow and download as well as the navigational links at top (javascript:__doPostBack(`plOffenderSearch$btn2`,``)) for example) that I need OE Pro to load and parse in order to get all 13,000+ records.

Here is my current project settings:

[Object]
OEVersion=Pro 4.0.0.2232
Type=0
IID=7031
Caption=http://www.esorn.ag.state.oh.us/Secured/P22_2.aspx
URL=http://www.esorn.ag.state.oh.us/Secured/P22_2.aspxPOST=__EVENTTARGET=plOffenderSearch%3Abtn1&__EVENTARGUMENT=&__VIEWSTATE=dDwxMDA3NDYxMzg5O3Q8O2w8aTwzPjs%2BO2w8dDw7bDxpPDE%2BO2k8Mz47aTwxMj47PjtsPHQ8O2w8aTwwPjtpPDQ%2BO2k8OD47PjtsPHQ8cDxwPGw8VmlzaWJsZTs%2BO2w8bzx0Pjs%2BPjs%2BOzs%2BO3Q8cDxwPGw8VGV4dDtOYXZpZ2F0ZVVybDs%2BO2w8XDxpbWcgYWx0PSJlU09STiBIb21lIiBzcmM9Ii4uL21lZGlhL2JyYW5kL2VTT1JOX2xvZ29fbWFpbi5naWYiIGJvcmRlcj0iMCJcPjtwMS5hc3B4Oz4%2BOz47Oz47dDxwPHA8bDxWaXNpYmxlOz47bDxvPGY%2BOz4%2BOz47bDxpPDE%2BOz47bDx0PEAwPDtAMDxwPGw8Q29tcG9uZW50VGFyZ2V0O1hQU3BhY2VySW1hZ2U7WFBTcGFjZXJXaWR0aDs%2BO2w8SW5mcmFnaXN0aWNzLldlYlVJLlVsdHJhV2ViTmF2aWdhdG9yLkNvbXBvbmVudFRhcmdldCwgSW5mcmFnaXN0aWNzLldlYlVJLlVsdHJhV2ViTmF2aWdhdG9yLnYzLjEsIFZlcnNpb249My4xLjIwMDQxLjIwLCBDdWx0dXJlPW5ldXRyYWwsIFB1YmxpY0tleVRva2VuPTdkZDVjMzE2M2YyY2QwY2I8SG9yaXpvbnRhbE1lbnU%2BOy9pZ19jb21tb24vV2ViTmF2aWdhdG9yMzEvaWdfbWVudVhQU3BhY2VyMS5naWY7MTxcZT47Pj47OztsPHA8bDxDc3NDbGFzcztfIVNCOz47bDxUb3BDbGFzcztpPDI%2BOz4%2BO3A8bDxDc3NDbGFzcztfIVNCOz47bDxUb3BIb3ZlcjtpPDI%2BOz4%2BOz47O2w8QDA8cDxsPHRhcmdldFVybDt0ZXh0Oz47bDxBMS5hc3B4O0hvbWU7Pj47O3A8bDxXaWR0aDtGb250X0JvbGQ7Rm9udF9TaXplO0hlaWdodDtGb250X1VuZGVybGluZTtfIVNCO0JvcmRlcldpZHRoO0JvcmRlckNvbG9yO0JvcmRlclN0eWxlO0I7QztBO0ZvcmVDb2xvcjtGb250X0l0YWxpYztCYWNrQ29sb3I7Q3NzQ2xhc3M7Rm9udF9OYW1lczs%2BO2w8MTwyMHB4PjtvPGY%2BO1N5c3RlbS5XZWIuVUkuV2ViQ29udHJvbHMuRm9udFVuaXQsIFN5c3RlbS5XZWIsIFZlcnNpb249MS4wLjUwMDAuMCwgQ3VsdHVyZT1uZXV0cmFsLCBQdWJsaWNLZXlUb2tlbj1iMDNmNWY3ZjExZDUwYTNhPFxlPjsxPFxlPjtvPGY%2BO2k8MTYzODI%2BOzE8XGU%2BOzI8XGU%2BO1N5c3RlbS5XZWIuVUkuV2ViQ29udHJvbHMuQm9yZGVyU3R5bGUsIFN5c3RlbS5XZWIsIFZlcnNpb249MS4wLjUwMDAuMCwgQ3VsdHVyZT1uZXV0cmFsLCBQdWJsaWNLZXlUb2tlbj1iMDNmNWY3ZjExZDUwYTNhPE5vdFNldD47XGU7SW5mcmFnaXN0aWNzLldlYlVJLlNoYXJlZC5DdXJzb3JzLCBJbmZyYWdpc3RpY3MuV2ViVUkuU2hhcmVkLnYyLCBWZXJzaW9uPTIuMC4yMDA0MS4xMCwgQ3VsdHVyZT1uZXV0cmFsLCBQdWJsaWNLZXlUb2tlbj03ZGQ1YzMxNjNmMmNkMGNiPE5vdFNldD47XGU7MjxcZT47bzxmPjsyPFxlPjtcZTs7Pj47PjtAMDxwPGw8dGFyZ2V0VXJsO3RleHQ7PjtsPCM7QWRtaW5pc3RyYXRpb247Pj47bDxAMDxwPGw8dGFyZ2V0VXJsO3RleHQ7PjtsPEExMi5hc3B4O09SQyBNYW5hZ2VtZW50Oz4%2BOzs7PjtAMDxwPGw8dGFyZ2V0VXJsO3RleHQ7PjtsPEExMDEuYXNweDtTZWFyY2ggQXVkaXQgTG9nOz4%2BOzs7PjtAMDxwPGw8dGFyZ2V0VXJsO3RleHQ7PjtsPEE5LmFzcHg7QWdlbmN5IERldGFpbDs%2BPjs7Oz47QDA8cDxsPHRhcmdldFVybDt0ZXh0Oz47bDxBMTQuYXNweDtEYXRhIEV4cG9ydDs%2BPjs7Oz47PjtwPGw8V2lkdGg7Rm9udF9Cb2xkO0ZvbnRfU2l6ZTtIZWlnaHQ7Rm9udF9VbmRlcmxpbmU7XyFTQjtCb3JkZXJXaWR0aDtCb3JkZXJDb2xvcjtCb3JkZXJTdHlsZTtCO0M7QTtGb3JlQ29sb3I7Rm9udF9JdGFsaWM7QmFja0NvbG9yO0Nzc0NsYXNzO0ZvbnRfTmFtZXM7PjtsPDE8NTBweD47bzxmPjs1MTxcZT47MTxcZT47bzxmPjtpPDE2MzgyPjsxPFxlPjsyPFxlPjs1MjxOb3RTZXQ%2BO1xlOzUzPE5vdFNldD47XGU7MjxcZT47bzxmPjsyPFxlPjtcZTs7Pj47PjtAMDxwPGw8dGFyZ2V0VXJsO3RleHQ7PjtsPCM7T2ZmZW5kZXI7Pj47bDxAMDxwPGw8dGV4dDs%2BO2w8UHJlLVJlZ2lzdGVyOz4%2BOzs7PjtAMDxwPGw8dGV4dDs%2BO2w8SW5pdGlhbCBSZWdpc3Rlcjs%2BPjs7Oz47QDA8cDxsPHRhcmdldFVybDtoaWRkZW47dGV4dDs%2BO2w8TzE0LmFzcHg7bzx0PjtQZW5kaW5nIEluY2FyY2VyYXRpb247Pj47Ozs%2BO0AwPHA8bDx0YXJnZXRVcmw7dGV4dDs%2BO2w8TzExXzIuYXNweDtTZWFyY2g7Pj47Ozs%2BOz47cDxsPFdpZHRoO0ZvbnRfQm9sZDtGb250X1NpemU7SGVpZ2h0O0ZvbnRfVW5kZXJsaW5lO18h
Oleg Chernavin 11/16/2005 04:54 am
It was a little bit tricky to catch that search request. However after that everything worked well - it got the first page with 500 results and followed the other pages. The only problem could be with mixing states, so I would suggest you to use 1 connection at a time.

My settings (Excluding the URLs field) are:

[Object]
OEVersion=Pro 4.0.0.2261
Type=0
IID=62189
Caption=http://www.esorn.ag.state.oh.us/Secured/p21_2.aspx
Lev=10
Weekday=257
LimTSize=10000
LimNumber=5000
LimTime=100
FMGroup=2
FTText.Exts=htmlhtmaspaspxjspstmstmlidcshtmlhtxtxttextxspxmlrxmlcfmwmlphpphp3
FTImages.Exts=gifjpgjpegtiftiffxbmfifbmppngipxjp2j2cj2kwbmplwf
FTVideo.Exts=mpgavianimpegmovfliflcvivrmramrvasfasxwmvm1vm2vvob
FTAudio.Exts=wavriffmp3midmp2m3uravocwmaape
FTArchive.Exts=ziparcgzzarjlhalayleirarcabtarpakacejar
FTUDef.Exts=jscssssivbsdtdxslswf
FTText.B=ooxooo
FTImages.B=xoxooo
FTVideo.B=ooxooo
FTAudio.B=ooxooo
FTArchive.B=ooxooo
FTUDef.B=ooxooo
FTOther.B=ooxooo
FTSizes=0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,3,3,3,0,3,0
RSrvsBx=1
RPathBx=1
RProt=127
LastStart=0:0:0:0:0:0:0:0:
LastEnd=0:0:0:0:0:0:0:0:
ImgDim=0,0,0,0

Best regards,
Oleg Chernavin
MP Staff