Can`t seem to follow links

Author Message
ssieloff 11/03/2003 12:34 am
Hi Oleg --

I am trying to donwload this web site and I cannot get Oep 2.9 v 1330 to follow the additional numbered page links at the bottom to retrieve all the search result pages:

http://www.watsonrealtycorp.com/content/PropertySearch.asp

I select Residential, No Minimum, No Minimum, 25,000 and 50,000 for step 1 of 2 on search page.

I select Jacksonville Area and All Jacksonville Area in step 2 of 2 on search page and click search.

I then active Add the next clicked link as project button and click on the number 2 at bottom of page. I then modify the URL as follows:

http://www.watsonrealtycorp.com/content/PropertySearch.asp

POST=propertyType=1&priceLow={:10..1000#1}&priceHigh={:#1+1}&bedrooms=0&bathrooms=0&streetAddress=&waterfrontOrWaterview=&golfCourse=&subdivision=&masterOnMain=&basement=&parkingSpots=&agentNumber=&officeNumber=&selectedVersion=1033%2C1002%2C1032%2C1006%2C1011%2C1007%2C1008%2C1009%2C1003%2C1005%2C1010%2C1035%2C1012&propertySearchType=0&numberToReturn=400&sortField=brokerListing&startingIndex=0&listingNumberOrStreetAddress=&listingNumberPartial=&additionalInformation1=&city=&zipCode=&county=&schoolDistrict=&elementarySchool=&middleSchool=&highSchool=&lotSize=&squareFootage=&yearBuilt=&thumbnails=true

IgnoreLogOutLinks

Referer=http://www.watsonrealtycorp.com/content/PropertySearch.asp
SetCookie=KID=3B115DFD775A40FA82A00E9F84004379; ASPSESSIONIDSSRRBRCT=ENAGHNECLBFNILNLPFLOEFGG

I have level limit off, URL Filters/Filename included PropertySearch.asp. I also have File Copies/Keep old copies = 9999.

OEP doesn`t link the javascript:turnPage(`10`) navigation I guess!

Can you help?

Thanks in advance!

Steve
Oleg Chernavin 11/03/2003 03:27 am
I would suggest you to use URL Macros to load all pages at once:

http://www.watsonrealtycorp.com/content/PropertySearch.asp?propertyType=1&priceLow=25&priceHigh=50&bedrooms=0&bathrooms=0&streetAddress=&waterfrontOrWaterview=&golfCourse=&subdivision=&masterOnMain=&basement=&parkingSpots=&agentNumber=&officeNumber=&selectedVersion=1033%2C1002%2C1032%2C1006%2C1011%2C1007%2C1008%2C1009%2C1003%2C1005%2C1010%2C1035%2C1012&propertySearchType=0&numberToReturn=10&sortField=brokerListing&startingIndex={:0..150|10}&listingNumberOrStreetAddress=&listingNumberPartial=&additionalInformation1=&city=&zipCode=&county=&schoolDistrict=&elementarySchool=&middleSchool=&highSchool=&lotSize=&squareFootage=&yearBuilt=&thumbnails=true

Best regards,
Oleg Chernavin
MP Staff
ssieloff 11/03/2003 07:28 am
Oleg --

I should have added that I need to vary the prices up to 2000 (,000) -- I get varying numbers of return pages up to 40 (the limit on a search is 400 records). If I vary low/high price by just 1 (,000) I still get several search results that span multiple pages ... and they are not a constant number making a tyr of {:0..400|10} very slow as it attempts to load/fetch pages not existing in the actual results! So to recap, I need to vary the low/high prices {:10..1000#1} and {:#1+1} yet still process ALL the returned pages -- but not {:0..400|10} as this results in a "hard" 20,000 pages to load when the actual retuned pages is something way less. I had hoped that turning the level limit off and including only pages with the filter PropertySearch/asp would do the trick.

Any other ideas?

Thanks!

Steve


> I would suggest you to use URL Macros to load all pages at once:
>
> http://www.watsonrealtycorp.com/content/PropertySearch.asp?propertyType=1&priceLow=25&priceHigh=50&bedrooms=0&bathrooms=0&streetAddress=&waterfrontOrWaterview=&golfCourse=&subdivision=&masterOnMain=&basement=&parkingSpots=&agentNumber=&officeNumber=&selectedVersion=1033%2C1002%2C1032%2C1006%2C1011%2C1007%2C1008%2C1009%2C1003%2C1005%2C1010%2C1035%2C1012&propertySearchType=0&numberToReturn=10&sortField=brokerListing&startingIndex={:0..150|10}&listingNumberOrStreetAddress=&listingNumberPartial=&additionalInformation1=&city=&zipCode=&county=&schoolDistrict=&elementarySchool=&middleSchool=&highSchool=&lotSize=&squareFootage=&yearBuilt=&thumbnails=true
>
> Best regards,
> Oleg Chernavin
> MP Staff
Oleg Chernavin 11/03/2003 11:21 am
Sorry, but there are no other ways. The links to 1 | 2 | ... pages are Java scripts that change one of the search form parameters and resubmit it. So far, Offline Explorer cannot handle that.

Oleg.