Trying to crawl search results, how...

Author Message
Len Lydik 11/03/2004 12:47 pm
Trying to crawl all the possible search results at this page:

http://gravelocator.cem.va.gov/j2ee/servlet/NGL_v1

How would I go about doing this? If necessary, I can get a text file with all possible surnames.

Many Thanks!
Oleg Chernavin 11/04/2004 05:16 am
You can use Ctrl+Alt keys while submitting the form in the Internal browser and then use the {:file=c:\file.txt} URL Macro to change the POST request of the recorded form to download all names.

Best regards,
Oleg Chernavin
MP Staff
Len Lydik 11/08/2004 06:47 pm
This is a little over my head. Could you elaborate please?
Oleg Chernavin 11/09/2004 05:15 am
Browse to the search page in the Internal browser and submit it with Ctrl + Alt keys pressed down on the keyboard. You will get a newly created Project. Find in the POST=... line of the URLs field the parameter you need to change and replace it with {:file=c:\file.txt}. Place all possible names to the c:\file.txt file.

Oleg.
Len Lydik 11/09/2004 12:01 pm
I haven`t run the project yet, but see how this can work. Love OEP.
Oleg Chernavin 11/09/2004 12:04 pm
OK. Let me know if you need more help.

Oleg.