how to download a subforum and spoilers

Author Message
mikel 10/13/2009 07:12 pm
Hi!

I'm currently trying to download a subforum, and only a subforum, but I'm having some troubles.

the subforum is: http://torrents.ru/forum/viewforum.php?f=1929



I want to get all threads on that subforum (all the threads in the 3 pages), and everything contained there. But I don't care about other subforums.

I couldn't limit to that subforum, so I created 3 projects. Each project starts on one of the pages of the subforum, and it's limited to 1 level.
I guess there can be any other better way, but this is not the main problem.

The main problem is that I can't get to see any of the images hosted on external pages (ipictures, etc). They are downloaded (I can see them in my c:/download), but they don't show up.

Also, Offline Explorer doesn't seem able to download the "spoilers" correctly. For example: http://torrents.ru/forum/viewtopic.php?t=1625170
There's an spoiler with more images; the images are downloaded to c:/download, but the "spoiler" thing doesn't open
Oleg Chernavin 10/14/2009 05:55 am
I fixed the spoilers problem. Regarding limiting the download - please add

viewtopic

to the URL Filters - Filename - Included list to allow loading only within the topic.

Best regards,
Oleg Chernavin
MP Staff
mikel 10/14/2009 07:23 am
sorry, I don't understand.

what does mean that "I fixed the spoilers problem"?
does it mean that there's a program update that fixes it?
Oleg Chernavin 10/14/2009 09:45 am
You may get the updated oe.exe file here:

http://www.metaproducts.com/download/betas/OEP3120.ZIP

Oleg.
mikel 10/14/2009 11:20 am
great!

it works perfectly now.

by the way, I realized that I could download all three pages in one project. I just had to add a filename limit: viewforum.php?f=1929


thanks a lot
Oleg Chernavin 10/14/2009 03:17 pm
Yes, this filtering will work as well.

Oleg.
Rio 11/15/2009 08:18 pm
is it difficult to get threads topics and followed page?
i.e. page: http://www.forexfactory.com/showthread.php?t=139450

how?
its only load the first page??!!

i'd try to use filtering.. manual (:page..page) starting address option..
unsucceed yet...
Tom 11/15/2009 11:11 pm
Project URL
http://www.forexfactory.com/showthread.php?t=139450

File Filters | Text
Location: Load using URL filter settings

Images
Load from any site

User Defined
Load only from the starting server

URL Filters | Filename
View included files keywords:
&page={:1..1000}$

To get rid of the Session-ID:
Advanced | Parsing | URL Substitutes

URL:
http://*

Replace:
?s=*&

With:
?

Check that item: [x]


And if you want to add the htm extension without the need of export add the following rule:

URL:
http://*

Replace:
.php*

With:
.php*.htm

But uncheck this item after adding! [ ]

Check this item:
[x] Apply all matching rules
Oleg Chernavin 11/16/2009 02:26 am
I am afraid that

View included files keywords:
&page={:1..1000}$

will not work. Please use instead:

&page=1*

Oleg.
Tom 11/16/2009 11:09 am
Hi Oleg,

Yes it looks surprising that it should work, but it does!

I made a test because of this statement in the Help file:
Advanced features | Fine-tuning downloads using Project URL filters
"You can also use URL Macros in the URL Filters keywords. For example:
filename{:0day}.htm"

I thought &page={:1..1000}$ could be a short substitute of something like this in the included files keywords:
&page=[0-9]$
&page=[0-9][0-9]$
&page=[0-9][0-9][0-9]$

The project works fine, even if you try &page={:1..4}$ the project would download only the first 4 pages of the thread.

BTW:
Your suggestion &page=1* would'nt download page 2, 3, 4, ... of the thread, shurely the "1" was just a typo. ;)
Oleg Chernavin 11/17/2009 06:59 am
This is true! The keyword should be &page=[0-9]*

And you are correct about using {:1..1000} macros - I forgot that I implemented it. However it is not recommended to use, because it takes much more time to process actually 1000 keywords than one single, like &page=[0-9]*

Oleg.