Downloading info under a second tab

Author Message
Cheryl McMahan 07/18/2007 09:49 am
Hello. I have a question. I am attempting to download sex offender record information from the Pennsylvania State Police site (http://www.pameganslaw.state.pa.us) by county. I can devise a script to download the name and address information, but am attempting to also download the arrest information which appears under a different tab. The script that I am using for the first county (Adams) is the following:

http://www.pameganslaw.state.pa.us/SearchCounty.aspx?dt=JCFMCFDDK4EFNEINEF4da
POST=__VIEWSTATE=dDwyNzg1MjEzOTt0PDtsPGk8MT47PjtsPHQ8O2w8aTwyPjs%2BO2w8dDx0PDtwPGw8aTwwPjtpPDE%2BO2k8Mj47aTwzPjtpPDQ%2BO2k8NT47aTw2PjtpPDc%2BO2k8OD47aTw5PjtpPDEwPjtpPDExPjtpPDEyPjtpPDEzPjtpPDE0PjtpPDE1PjtpPDE2PjtpPDE3PjtpPDE4PjtpPDE5PjtpPDIwPjtpPDIxPjtpPDIyPjtpPDIzPjtpPDI0PjtpPDI1PjtpPDI2PjtpPDI3PjtpPDI4PjtpPDI5PjtpPDMwPjtpPDMxPjtpPDMyPjtpPDMzPjtpPDM0PjtpPDM1PjtpPDM2PjtpPDM3PjtpPDM4PjtpPDM5PjtpPDQwPjtpPDQxPjtpPDQyPjtpPDQzPjtpPDQ0PjtpPDQ1PjtpPDQ2PjtpPDQ3PjtpPDQ4PjtpPDQ5PjtpPDUwPjtpPDUxPjtpPDUyPjtpPDUzPjtpPDU0PjtpPDU1PjtpPDU2PjtpPDU3PjtpPDU4PjtpPDU5PjtpPDYwPjtpPDYxPjtpPDYyPjtpPDYzPjtpPDY0PjtpPDY1PjtpPDY2PjtpPDY3PjtpPDY4Pjs%2BO2w8cDxBZGFtczsxfEFkYW1zPjtwPEFsbGVnaGVueTsyfEFsbGVnaGVueT47cDxBcm1zdHJvbmc7M3xBcm1zdHJvbmc%2BO3A8QmVhdmVyOzR8QmVhdmVyPjtwPEJlZGZvcmQ7NXxCZWRmb3JkPjtwPEJlcmtzOzZ8QmVya3M%2BO3A8QmxhaXI7N3xCbGFpcj47cDxCcmFkZm9yZDs4fEJyYWRmb3JkPjtwPEJ1Y2tzOzl8QnVja3M%2BO3A8QnV0bGVyOzEwfEJ1dGxlcj47cDxDYW1icmlhOzExfENhbWJyaWE%2BO3A8Q2FtZXJvbjsxMnxDYW1lcm9uPjtwPENhcmJvbjsxM3xDYXJib24%2BO3A8Q2VudHJlOzE0fENlbnRyZT47cDxDaGVzdGVyOzE1fENoZXN0ZXI%2BO3A8Q2xhcmlvbjsxNnxDbGFyaW9uPjtwPENsZWFyZmllbGQ7MTd8Q2xlYXJmaWVsZD47cDxDbGludG9uOzE4fENsaW50b24%2BO3A8Q29sdW1iaWE7MTl8Q29sdW1iaWE%2BO3A8Q3Jhd2ZvcmQ7MjB8Q3Jhd2ZvcmQ%2BO3A8Q3VtYmVybGFuZDsyMXxDdW1iZXJsYW5kPjtwPERhdXBoaW47MjJ8RGF1cGhpbj47cDxEZWxhd2FyZTsyM3xEZWxhd2FyZT47cDxFbGs7MjR8RWxrPjtwPEVyaWU7MjV8RXJpZT47cDxGYXlldHRlOzI2fEZheWV0dGU%2BO3A8Rm9yZXN0OzI3fEZvcmVzdD47cDxGcmFua2xpbjsyOHxGcmFua2xpbj47cDxGdWx0b247Mjl8RnVsdG9uPjtwPEdyZWVuZTszMHxHcmVlbmU%2BO3A8SHVudGluZ2RvbjszMXxIdW50aW5nZG9uPjtwPEluZGlhbmE7MzJ8SW5kaWFuYT47cDxKZWZmZXJzb247MzN8SmVmZmVyc29uPjtwPEp1bmlhdGE7MzR8SnVuaWF0YT47cDxMYWNrYXdhbm5hOzM1fExhY2thd2FubmE%2BO3A8TGFuY2FzdGVyOzM2fExhbmNhc3Rlcj47cDxMYXdyZW5jZTszN3xMYXdyZW5jZT47cDxMZWJhbm9uOzM4fExlYmFub24%2BO3A8TGVoaWdoOzM5fExlaGlnaD47cDxMdXplcm5lOzQwfEx1emVybmU%2BO3A8THljb21pbmc7NDF8THljb21pbmc%2BO3A8TWNLZWFuOzQyfE1jS2Vhbj47cDxNZXJjZXI7NDN8TWVyY2VyPjtwPE1pZmZsaW47NDR8TWlmZmxpbj47cDxNb25yb2U7NDV8TW9ucm9lPjtwPE1vbnRnb21lcnk7NDZ8TW9udGdvbWVyeT47cDxNb250b3VyOzQ3fE1vbnRvdXI%2BO3A8Tm9ydGhhbXB0b247NDh8Tm9ydGhhbXB0b24%2BO3A8Tm9ydGh1bWJlcmxhbmQ7NDl8Tm9ydGh1bWJlcmxhbmQ%2BO3A8UGVycnk7NTB8UGVycnk%2BO3A8UGhpbGFkZWxwaGlhOzUxfFBoaWxhZGVscGhpYT47cDxQaWtlOzUyfFBpa2U%2BO3A8UG90dGVyOzUzfFBvdHRlcj47cDxTY2h1eWxraWxsOzU0fFNjaHV5bGtpbGw%2BO3A8U255ZGVyOzU1fFNueWRlcj47cDxTb21lcnNldDs1NnxTb21lcnNldD47cDxTdWxsaXZhbjs1N3xTdWxsaXZhbj47cDxTdXNxdWVoYW5uYTs1OHxTdXNxdWVoYW5uYT47cDxUaW9nYTs1OXxUaW9nYT47cDxVbmlvbjs2MHxVbmlvbj47cDxWZW5hbmdvOzYxfFZlbmFuZ28%2BO3A8V2FycmVuOzYyfFdhcnJlbj47cDxXYXNoaW5ndG9uOzYzfFdhc2hpbmd0b24%2BO3A8V2F5bmU7NjR8V2F5bmU%2BO3A8V2VzdG1vcmVsYW5kOzY1fFdlc3Rtb3JlbGFuZD47cDxXeW9taW5nOzY2fFd5b21pbmc%2BO3A8WW9yazs2N3xZb3JrPjtwPFVua25vd247OTd8VW5rbm93bj47cDwqT3V0IG9mIFN0YXRlOzk5fCpPdXQgb2YgU3RhdGU%2BOz4%2BOz47Oz47Pj47Pj47Pg3IHfONG22PKaYKgqY9iLLyP4Vh&drpCounty=1%7CAdams&txtPostBack=True&txtParm=JCFMCFDDK4EFNEINEH4da
IgnoreLogOutLinks
Additional=ConvertPOSTToFileName
Referer=http://www.pameganslaw.state.pa.us/SearchCounty.aspx?dt=JCFMCFDDK4EFNEINEF4da

I have tried one level deep and I can download the name and address information only. I try two levels deep and I get a lot of more information that I don't need, but no arrest information. I have checked "Load files only within starting server" and "Load only files within starting directory" under the URL filters. Any suggestions?

Thanks.

Cheryl
Oleg Chernavin 07/19/2007 08:56 am
Well, I cannot find the arrests tab. I make a search and get the page:

http://www.pameganslaw.state.pa.us/SearchResults.aspx?Search=County&CountyCode=1&CountyName=Adams&dt=KCEMCFDDK4LNIENEL4Ua

Then I click on a name, like
http://www.pameganslaw.state.pa.us/OffenderDetail.aspx?text=bcjcfchb&dt=KCEMCFDDK4LNIENFE4Ua
but I do not see the arrests info.

Best regards,
Oleg Chernavin
MP Staff
Cheryl McMahan 07/19/2007 10:07 am
Oleg,

Thanks for looking at this for me. When you click on an individual's name, a screen comes up with the individual's picture, name and other information. However, along the top of the individual's screen (and under the banner "Megan's Law Website"), there are a series of tabs: Address Info (which you are already on), Physical Desc, Vehicle Info, Arrest Info, and Alias Info. I have been unable to figure out how to download any of these other tabs, of which the Arrest Info is the one I'm most interested in, but if you can figure out how to download both that and the Alias Info, that would be great.

Thanks!

Cheryl

Oleg Chernavin 07/20/2007 11:01 am
I looked at the page source and I see that these are not links, but these are buttons that show/hide certain text on the page. So, if you load the page with the person details, these links should show. Perhaps, you may browse the downloaded site using an external MS Internet Explorer - would this show the tabs?

Oleg.
Cheryl McMahan 07/20/2007 11:57 am
Oleg,

When I look at an individual's record in Internet Explorer, I can see the tabs (address, physical description, vehicle info, arrest info and alias info). However, when OE downloads the "offender detail" page, it only shows the information that appears under the Address Info tab. The downloaded page doesn't even show the tabs at the top except for the Address Info tab. I don't know how to get to the Arrest Info in order to download it.

Cheryl
Oleg Chernavin 07/20/2007 12:06 pm
I was able to load and see this info. For example, I browse to one of the offenders online and used this page address as a starting URL for a new Project. I made a Project with level=0 and loaded it. The tabs info was viewable when I was clicking them.

Oleg.