Downloading successive pages by following a "Next" link on each page

  • User Forums
  • Downloading successive pages by following a "Next" link on each page
Ben
07/03/2017 11:31 pm
Hi Oleg!

Each of the pages on my targeted site (which contains many individual blog posts) includes a "Previous" link and a "Next" link, as seen on this page:

https://dna-explained.com/2012/07/13/ive-never-met-a-dna-test-i-wouldnt-take/

Within OEP, I'd like to download the above page, and then have OEP "click" or follow the Next link to bring up the next blog post, download that page, "click" or follow the Next link to bring up the next blog post, and continue this way until all the Next pages have been individually downloaded and saved by OEP.

Even though the directory structure (which follows the /YYYY/MM/DD/ format) could be automated for downloading, I do need the actual title of each blog post in each download URL (in the above example, that would be the trailing "ive-never-met-a-dna-test-i-wouldnt-take/" text).

Is this something I can automate using OEP?
Oleg Chernavin
07/04/2017 12:15 am
You don't need to do anything specific to allow such links. Simply allow downloading from the starting server and uinlimited level.

Offline Explorer would follow and download all these links automatically.

Best regards,
Oleg Chernavin
MP Staff