OEP used with google.com

Author Message
Pablo 07/30/2007 06:19 pm
Hello;
I?m trying to use OEP in conjunction with Google?s search capacity, in this way:
I create a project with a "search sentence" like this (and search level=1):
http://www.google.com/search?as_q=Thing_To_Search+&hl=es&num=50&lr=lang_es&as_qdr=m3
When OEP executes, downloads only the links retrieved by Google?s search capacity.

The question is this:
After OEP?s execution, every downloaded link is located under one or several directories below, following the original file?s location, generating results like:
/www.google.com/
/www.site1.com/ and several folders below, and finally...one file
/www.site2.com/ and several folders below, and finally...one file
/www.site3.com/ and several folders below, and finally...one file
/www.siteN.com/ and several folders below, and finally...one file


Is it possible to download all the links below just ONE level below www.google.com, not generating "n" folders for each site/file? Perhaps with Link Conversion, or URL substitutes...?

thank you
Oleg Chernavin 07/31/2007 05:06 am
One easy way is to use Export after the download completes (File - Export menu) and to copy the downloaded site to another directory with no subdirectories option.

Best regards,
Oleg Chernavin
MP Staff
Bob 08/02/2007 09:52 am
Here is a related task I am working on with a Google search.

Let's say I want to pull in all the pages from site somedomain.com.
And let's say for one reason or another, there are no accessible links from the home page of the site, but Google can find plenty of pages.

I would like to point OE to the google search page as suggested above, and pull in only those pages from somedomain.com and not spider everything from Google in the process.

I thought maybe custom settings for Properties/Server would work but I'm not having any luck so far.
Any suggestions?


> One easy way is to use Export after the download completes (File - Export menu) and to copy the downloaded site to another directory with no subdirectories option.
>
> Best regards,
> Oleg Chernavin
> MP Staff
Oleg Chernavin 08/02/2007 11:49 am
This is easy. Specify the Google search page results URL as the starting address and in the URL Filters - Server section select Custom... and add the desired domain name to the included keywords list.

Oleg.