Difficult download, forms, coockies and dynamic account

Author Message
John 05/30/2007 03:16 am
I have encountered a site that I would like to spider for zip files (small game downloads for a Commodore 64). I just can't seem to get this to work. The site uses a (custom build?) downloading scheme with iterative numbered url's combined with forms, cookies etc.

The url of the site is this: http://www.planetemu.net/index.php?section=roms&dat=576

I have tried to "add next clicked link as project" by clicking the forum button one gets after clicking a link to a game. I get the following info in return:

http://www.planetemu.net/php/roms/download.php
POST=id=705770
IgnoreLogOutLinks
Additional=ConvertPOSTToFileName
Referer=http://www.planetemu.net/index.php?section=roms&dat=576&action=showrom&id=705770
SetCookie=h2=o; he=llo

The post id seems to correspond to the game id which is then (server side?) translated to the game name after which the game is downloaded by ftp. I already tried sniffing the user + pass for the ftp but it seems that the game is only available for download after the translation from id to game name.

Can this be done?

Oleg Chernavin 05/30/2007 04:20 am
What about trying to allow forms processing in the Properties - Advanced to follow such links automatically? Offline Explorer Pro supports downloading links from FTP, so it should work.

Best regards,
Oleg Chernavin
MP Staff