This is a filtered search from a forum.
I wish to only check out the links in the main section.. from my testing.. it appears they all being with
http://18.104.22.168/showthread.php*... (* for wildcard)
I wish to only investigate these links at level 0.. then within these links look for references to movie files (.avi .mov) etc. I guess this would be @ level 1?
Level 0 would be the starting page.
>.. then within these links look for references to movie files (.avi .mov) etc.
> I guess this would be @ level 1?
There are only links to the movies at level 1.
(The movies are at level 2)
But you need at least level 3. (You have more than one searchresult page).
Load using URL Filters settings
Load from any site:
View *included* files keywords:
Unfortunately.. it doesnt seem to work for me.. even more interesting is that the search page seems to time out or something.. after I try the search in the browser.. when I try it in OE, it says search does not exist.. it seems that that is the first hurdle to overcome.
> Unfortunately.. it doesnt seem to work for me..
> even more interesting is that the search page seems to time out or something..
Yes. Of course they are not storing the search result for all time! But you should have enough time when you try to start a new search.
Then you have to adjust the Start-URL and the searchid in the filename URL Filters:
You can find the searchid in the link to the other searchresult pages. (Page 2 of 2)
("&t=*&highlight=reel" should be unchanged if you are searching for the same keyword)
If this still wouldn`t work, you could try to first downloadload only the text files (disable the Video - File Filter). Then enable the Video - File Filter and load the missing files.
My question is can I specify rules for certain levels of the search only??
For example.. from the main page (which I now found is http://22.214.171.124/search.php?s=f6c39605c0230880c8ee64f77afdaec0&searchid=546656) I wish to ONLY explore the links that start with -->
and to ignore ALL other links.. but once inside the showthread.php pages.. I wish to d/l MOVIE files from any source.
I hope this is clear.
and also allow downloading from any site of the File Filters | Video
> > showthread.php?*
> > and also allow downloading from any site of the File Filters | Video
> > Oleg.
Thanks Oleg. But what if showthread* is at level 0.. leading to a page that has a movie in the URL
If I just use the inclusive keyword.. will it miss out the actual final URL that I seek?
> > Oleg.
Well. Thanks Oleg. But I`m afraid this is doing what I feared.. perhaps I am not being clear enough (very likely) =)
Your solution DOES indeed limit the searches to urls with showthread* but like I said.. the final .mov that I am looking for could be on a URL @ www.yahoo.com/test.mov for example..
Your setting completely misses it.
Here is my last try @ explaining it. =)
this is the base page which I call level 0
from the basepage.. all the URLs that I want to spider into have the prefix http://126.96.36.199/showthread.php?*
all the other small links I wish to filter out.
after I get into the http://188.8.131.52/showthread.php?* pages... I wish to look out for ANY url with a .mov or .avi etc... it could be from an external domain/server.
eg. one of the showthread pages leads me to a page with http://www.yahoo.com/test.mov ... I want to download THIS movie. (final objective)
I hope this is clear.
Thanks for the time.