How to download only posts from forum and nothing else

Author Message
Mit Johnson 01/01/2012 02:44 am
Hi there.
Could you tell me how to download vbulletin forum without downloading sitemaps,inages and so forth. The post content is all I am interested in?
Happy New Year to you all.

Mitty.
Oleg Chernavin 01/01/2012 05:10 am
I think, I need to make a special Wizard for forum sites. Can you please let me know a URL of a similar forum and explain better what links do you want to follow and which - to skip? I will make an advice and I will work on the corresponding feature.

Thank you!

Best regards,
Oleg Chernavin
MP Staff
Mit Johnson 01/01/2012 10:49 am
Hi Oleg.

What I have is a vbulletin forum. I would like to find a way to download every topic and every post from that topicof that forum. Topics sometimes have a download links in them which I also want to download meaning I would like to have a link in the message) but not trying to download the content of that link.

Example of such forum would be http://forums.digitalpoint.com/
Another example of such forum would be http://www.blackhatteam.com/

Thank you for quick reply.

M. Johnson
Mit Johnson 01/01/2012 04:43 pm
I haven't added. I would like to download all the posts in all the sections but I don't want to download any content from the included in the links posts. For example if post refers to some software and have a link for that software I would like to only download that link and not the software itself. Also if possible Id like to exclude filesharing services such as hotfile,rapidshare and such.

Thank you for quick reply Oleg.

Oleg Chernavin 01/04/2012 06:58 am
I think, you need to create a new Project with the starting URL you need from this forum. Then in the Project Properties dialog - URL Filters - Filename section add to the Included keywords list:

forumdisplay.php
showthread.php

This should be enough to limit the download only to the forum information.

Oleg.