downloading all messages from a google group?

Author Message
john 07/23/2009 02:48 pm
Has anyone found a way to successfully download all messages from a google group that is password protected? When I run the offline explorer, it will find many messages but will not browse through all message threads. I am not trying to download the files or any other section, just all messages in the discussions. any ideas?
Oleg Chernavin 07/23/2009 03:08 pm
I think, you need to logon the site in the Internal browser first, before the download. Also, use URL Filters - Filename section - Included keywords list to filter only the pages that you want.

Best regards,
Oleg Chernavin
MP Staff
John 07/23/2009 04:39 pm
Thanks Oleg, it seems to be going along better so far, is there a way to tell offline explorer to only follow the topic threads,
ie: http://groups.google.com/group/alt.sport.lasertag/browse_thread/thread/38e21bed6e74a09d#
is the first topic thread..and there is a link to go to the next thread at the bottom.
Can we configure the app to follow only that link until it reaches the end?

-john
John 07/23/2009 04:42 pm
For some reason it seems to only download the first topic and then stops.
Im trying to archive all messages from one of my groups.
Oleg Chernavin 07/23/2009 04:52 pm
What about creating a Project with URL:
http://groups.google.com/group/alt.sport.lasertag/topics
Allow to download from the starting directory only in URL Filters - Directory section. URL Filters - Filename - add the following to Excluded list:

^post

to prevent following links to reply.

Oleg.

John 07/23/2009 05:56 pm
Ive tried that, still doesn''t seem to follow the topics in the group.
currently im set to:

starting url:
http://groups.google.com/group/alt.sport.lasertag/topics
no limit

load only within starting directory
excluded filename : ^post

it will download about 50 files and then tells me it is done.

I have set the number of connections to 2 to avoid google lockout but am very confused as to why i cant retrieve all topics or messages

John 07/23/2009 11:48 pm
using a macro value i was able to get offline explorer to browse through all topic pages
http://groups.google.com/group/alt.sport.lasertag/topics?start={:1..24987}&sa=N
This may be a dumb question (please excuse my ignorance) ..but is there a way to have oe increment by 30 to avoid duplicates.

It also seems to be ignoring the actual threads from the topic pages, is there something i need to do to make oe follow the threads and download the messages as well?

john
Oleg Chernavin 07/24/2009 07:10 am
http://groups.google.com/group/alt.sport.lasertag/topics?start={:0..24987|30}&sa=N

Use Level=1 to get the threads. If it doesn''t help, send me your Project settings (select it, use Export - Project Settings - Copy and then paste to the forum message.

Oleg.
Joe Winograd 04/12/2013 12:28 pm
Oleg,
I realize this thread is nearly four years old, but I'm trying to do exactly the same thing - download all messages from a Google Group. I just installed Offline Explorer 6.5.3903 (SR1) but I cannot get it to download messages from the group. I'd appreciate any advice on getting this to work. Thanks, Joe
Oleg Chernavin 04/12/2013 12:29 pm
I looked at HTML code of the page and unfortunately they started using AJAX, which is not yet supported by Offline Explorer. Sorry!

Oleg.
Joe Winograd 04/12/2013 12:48 pm
Oleg,
Thanks for the quick reply - much appreciated! You said, "not yet supported", so does that mean a future version of Offline Explorer WILL support it? Google Groups has grown in popularity in the past few years. My gut says there's a market out there for a version of Offline Explorer that supports Google Groups. Regards, Joe
Oleg Chernavin 04/12/2013 12:58 pm
Yes, we will work to provide support for such sites. Another example that we are aiming to support is Facebook. It is totally scripts-driven and cannot be downloaded by a typical offline browser.

However I can't tell the timeframe for such version yet.

Oleg.
Joe Winograd 04/12/2013 01:05 pm
OK, would you please post back here when a version is available that supports Google Groups ? Thanks, Joe
Oleg Chernavin 04/12/2013 01:07 pm
OK. I will try!

Oleg.
Joe Winograd 04/12/2013 01:13 pm
Thanks!