How may I download the pictures in this website... ?

Author Message
Xavier 01/22/2009 07:12 pm
Hi,

I would like to use Mass Downloader to download all the pictures stored in this place...

Are wallpapers...

The pictures begin in this link...

http://www.deskcity.com/details/show/2027/43230.html

And they end in this link...

http://www.deskcity.com/details/show/2592/54661.html

So what I need Mass Downloader do for me is going from the...

43230.html ... until the ... 54661.html page downloading the big picture in everypage (the wallpaper)

If you look to the page...

http://www.deskcity.com/details/show/2027/43230.html

The link of the wallpaper picture is...

http://www.deskcity.com/picture/image_url/43230/MHTN_1001.jpg?1212282084

So in fact what we have to download is the file: MHTN_1001.jpg

But I think they add as a security measure with the ---> ?1212282084

To avoid mass downloading...

So my question is, could be possible for Mass Dowloader to download all these wallpapers?

From the page...
http://www.deskcity.com/details/show/2027/43230.html

Until the page...
http://www.deskcity.com/details/show/2592/54661.html

Thanks
Oleg Chernavin 01/23/2009 09:18 am
I think, the only way would be to use Offline Explorer:

http://www.metaproducts.com/download/opsetup.exe

and to download this URL with unlimited level and the following Included keyword in the Project Properties dialog - URL Filters - Directory:

/details/show/

Best regards,
Oleg Chernavin
MP Staff
Xavier 01/24/2009 11:38 pm
> I think, the only way would be to use Offline Explorer:
>
> http://www.metaproducts.com/download/opsetup.exe
>
> and to download this URL with unlimited level and the following Included keyword in the Project Properties dialog - URL Filters - Directory:
>
> /details/show/
>
> Best regards,
> Oleg Chernavin
> MP Staff


Ups... also I forgot to mention this sorry.

The urls /details/show I think there are a kind of "mask" that are hidding the real location of the pictures.

But the real links were the pictures are stored are these ones...

FOR FIRST WALLPAPER...
-----------------------------
http://www.deskcity.com/picture/image_url/43230/MHTN_1001.jpg?1212282084

FOR THE LAST WALLPAPER...
---------------------------------
http://www.deskcity.com/picture/image_url/54661/XCMDMS_4020.jpg?1232634767

So in fact, the real url to download all the levels is...

http://www.deskcity.com/picture/image_url/

Is that?

But how I do that with offline explorer?

Cos the idea is after this level...
http://www.deskcity.com/picture/image_url/

You enter in the folder...
/43230/
And begin to download files and files and files

And the program continue doing that until reaching the final folder...

/54661/

Also a good thing could be two filters

One filter to download just JPG FILES
The second filter just to download files of certain size (so we avoid the icons, little pictures that are not wallpapers, and everything...)

Could you tell me how to do that more accurately please?

Thanks a lot !!
Oleg Chernavin 01/25/2009 08:20 am
I described the Project settings above. You may also go to File Filters section - Images and set Minimum size to 50 KB. This will filter out smaller pictures.

Oleg.
Xavier 01/26/2009 07:02 am
> I described the Project settings above. You may also go to File Filters section - Images and set Minimum size to 50 KB. This will filter out smaller pictures.
>
> Oleg.

Hi Oleg

Is not working... :(

I describe you the details of the project...

The folder in which I want to begin to download pictures is...

http://www.deskcity.com/picture/image_url/43230/

Inside that url there are several pictures...

So the description of the project is as follows:

In the windows Project Properties... I have the following

In URL I''ve entered this...

http://www.deskcity.com/picture/image_url/43230/

The box levels limit is unchecked so I assume it has unlimited levels

In filters of files, I''ve unchecked all the boxes except the one for pictures...

Don''t work, says

403 FORBIDDEN

When I press F5 to download I get that message.

Please, could you try to download some pictures from this website, to tell me exactly if this works or not? perhaps I''m doing something wrong or we are missing something?

Thanks

Oleg Chernavin 01/26/2009 11:44 am
Accessing the folder like http://www.deskcity.com/picture/image_url/43230/ is not allowed by the server. The only way would be to start with a real Web page (http://www.deskcity.com/details/show/2027/43230.html) and use the filtering rules I described above.

Oleg.
Xavier 01/28/2009 07:04 am
> Accessing the folder like http://www.deskcity.com/picture/image_url/43230/ is not allowed by the server. The only way would be to start with a real Web page (http://www.deskcity.com/details/show/2027/43230.html) and use the filtering rules I described above.
>
> Oleg.

Hi Oleg

Still having problems to download. Yes, now it''s downloading... but it''s doing something weird cos is also downloading from other websites and don''t stay in the same website...

I think I did not understand very well how to put the project settings you told me...

Could you be more specific?

I did some screenshots that shows you an idea of what is happening...

This screenshot shows how is going the download... as you can see... it''s also downloading from other websites... but the wallpapers I want to download are just in this place www.deskcity.com so I want that OfflineExplorer stay just in that place, and not explore others...

http://s303.photobucket.com/albums/nn135/konemichi/?action=view&current=descarga-004.jpg

PROJECT SETTINGS
-----------------------

Here are my project settings... perhaps I did not understand something... and I just confused things... please, could you look to my settings checking out these pictures, just to tell me if I am doing the things ok... or if I am wrong?

http://s303.photobucket.com/albums/nn135/konemichi/?action=view&current=descarga-001.jpg

http://s303.photobucket.com/albums/nn135/konemichi/?action=view&current=descarga-002.jpg

http://s303.photobucket.com/albums/nn135/konemichi/?action=view&current=descarga-003.jpg


Thanks
Oleg Chernavin 01/28/2009 04:16 pm
Please select the project and use Export - Project Settings - Copy on toolbar. Then paste it to the forum message.

Oleg.
Xavier 01/28/2009 07:19 pm
> Please select the project and use Export - Project Settings - Copy on toolbar. Then paste it to the forum message.
>
> Oleg.

Hi Oleg

Here is the information you asked me for:

------------------------------

[Object]
OEVersion=Enterprise 5.3.0.2908
Type=0
IID=7010
Caption=http://www.deskcity.com/details/show/2027/43230.html
URL=http://www.deskcity.com/details/show/2027/43230.html
MVer=5
Lev=1000001
Weekday=257
LimTSize=10000
LimNumber=5000
LimTime=100
FTText.Exts=htmlhtmaspaspxjspstmstmlidcshtmlhtxtxttextxspxmlrxmlcfmwmlphpphp3
FTImages.Exts=bmpfifgifipxj2cj2kjp2jpegjpglwfpngtiftiffwbmpxbm xoooooxxxooxxoo
FTVideo.Exts=mpgavianimpegmovflvfliflcvivrmramrvasfasxwmvm1vm2vvobsmil
FTAudio.Exts=wavriffmp3midmp2m3uravocwmaape
FTArchive.Exts=ziparcgzzarjlhalayleirarcabtarpakacejarpdftgz
FTUDef.Exts=jscssssivbsdtdxslswfclassent
FTText.B=xoxooo
FTImages.B=ooxxoo
FTVideo.B=xoxooo
FTAudio.B=xoxooo
FTArchive.B=xoxooo
FTUDef.B=xoxooo
FTOther.B=xoxooo
FTSizes=0,0,0,100,0,0,0,0,0,0,0,0,0,0,0,0,3,3,0,3,0
RPathEx=/details/show/ x
RProt=255
LastStart=30:130:189:132:43:116:227:64:
LastEnd=169:173:116:152:44:116:227:64:
LastStarted=28/01/2009 8:38:19
LastEnded=28/01/2009 9:26:47
S200=4266
S400=109
SAbr=63090
SPar=4211
SSav=55
SLast=200
SSiz=16779860
SMdf=53
LFiles=4371
LSize=127137556
Stopped=True
ImgDim=0,0,0,0
PrevURL=http://www.deskcity.com/details/show/2027/43230.html
LIndexed=False
IndexFiles=False


------------------------------------

Please, could you take a look to this, and do some tests with that website, to reach what I am doing wrong?

Thanks a lot
Oleg Chernavin 01/29/2009 09:28 am
Please go to URL Filters - Server in the Project Properties dialog and check the "Load only from the starting" box. URL Filters - Directory - add the following to the Included directory keywords list:

/details/show/
/picture/

This should be enough. Click the OK button to save changes.

Oleg.
Xavier 01/29/2009 07:00 pm
> Please go to URL Filters - Server in the Project Properties dialog and check the "Load only from the starting" box. URL Filters - Directory - add the following to the Included directory keywords list:
>
> /details/show/
> /picture/
>
> This should be enough. Click the OK button to save changes.
>
> Oleg.

Oleg... did exactly what you told me.

:(

Don''t work. Just begin to browse a bit the place, and stop without downloading.

:(

It''s weird cos Offline Explorer should be able to download the whole website... or perhaps there are websites that are impossible to download?

Please, could you do some tests in your computer, to reach what parameters are needed exactly for this particular case so so complex?

Is not necessary you downoad all the wallpapers there, just 10 or 20... and when you see it is working, just stop the download and tell me the project settings. Could you do that please?

Thanks a lot

Oleg Chernavin 01/30/2009 06:41 am
OK. I see. Please remove all keywords from Directory - Excluded list. And keep the 2 keywords I suggested in the Included list.

If it also fails, please check File Filters - Text and Other categories. I know, you don''t want to load web pages, but if it fails without them, this will be the only way.

Oleg.