Incomplete download on autopaging site

Author Message
Red 05/19/2015 11:24 am
I am trying to download the site: http://www.superheroinehq.com/

This site recently required a user account to access, which I do have.

User: redarrow9th@gmail.com Pass: temppass4

I generated the link by entering the user and password and hold Alt + Ctrl:

http://www.superheroinehq.com/sign-in
POST=redirect=%2F&email=redarrow9th@gmail.com&password=temppass4
Additional=ConvertPOSTToFileName
Referer=http://www.superheroinehq.com/
SetCookie=__utma=185223855.1948486508.1432004594.1432038305.1432048356.4; __utmz=185223855.1432004594.1.1.utmcsr=(direct)|utmccn=(direct)|utmcmd=(none); __utmb=185223855.2.9.1432048356; __utmt_b=1; __utmc=185223855

It is able to start downloading. I'm primarily aiming for images.

When it seems to complete downloading, the total downloaded files seem incomplete.

I know this because prior to the the site requiring user accounts, I did a site download and the image total was over 3000.

Now when it completes the first time, its only 500. It adds a little more if I download missing a 2nd time but nowhere near the complete total.

This site uses the social engine for its posts and does have autopaging on.

What settings should I use to make sure I scour the entire site? Feel free to use my account to test it.

Thanks
Oleg Chernavin 05/20/2015 03:35 pm
The problem here is that the page contains a limited number of images. You have to scroll it down to load another part, then scroll again to load more. This has to be done manually, while Offline Explorer loads pages automatically.

This is why only a small part of the pages/images were downloaded.

Best regards,
Oleg Chernavin
MP Staff
Red 05/21/2015 08:22 pm
1. Since I have to use the Ctrl + Alt submit at the user login screen to acquire the link, how would I then manually scroll down? The URL is exactly the same as the login page. I've also tried entering the login into the Advanced\Passwords\"Use this username and password" screen but that doesn't seem to work for this site. Should it work?

2. Prior to the site requiring a login, it always had the autopaging and I was able to download everything, not just the first page it could find. This was just using the url. I didn't have to scroll manually for it. So the difference now being the user login, why would it stop finding more pages? Thanks
Oleg Chernavin 05/26/2015 06:45 pm
What about logging on the site in the Internal browser before downloading it?

There would be another way to download such sites in 7.0 version - you would be able to browse a web page, load all its elements, scroll it down and then save with all links - exactly what you see online in the Internal browser.

Oleg.