1000 URL limit

Author Message
Costache Citronoveanu 03/06/2005 04:02 am
Currently I`m evaluating Offline Explorer Enterprise, and one of the jobs was downloading 1500 HTML pages (and nothing more) from one site. I pasted all the URLs into the Addresses (URLs) box, and started the download.
The URLs are quite long, someting like:

http://www.bvb.ro/cgi-bin/bse_compinfo.cgi?select_leng=ENG&select_usertype=basic&select_usercode=basic&select_symbol=RRC&select_opt=financial&select_per=2003-12-31

I noticed that after exactly 1000 saved links, the project continues to download files but none is saved anylonger in the download directory (default c:\download\)

Is this a limitation of the trial version or a bug ?

I`m using OEE 3.6.1950 SR-1 on a WinXP SP1 box
Oleg Chernavin 03/07/2005 05:23 am
Can you please try to check the "Prevent directories from overloading" box in the Options dialog | File Locations section, click the OK button and try to download the site again? Would this solve the problem?

Best regards,
Oleg Chernavin
MP Staff
Costache Citronoveanu 03/07/2005 10:31 am
> Can you please try to check the "Prevent directories from overloading" box in the Options dialog
>
> Oleg Chernavin
> MP Staff

Yes, I tried that also. It creates a file named %&ovr, 4 characters in length, with binary data.
Oleg Chernavin 03/07/2005 11:22 am
This is fine. The other 500 downloaded files are in the %&ovr0 directory.

Oleg.
Andrew 03/20/2005 11:41 am
I have exact the same problem. Files are downloaded, but not saved. I use {:1..3000} macros, tried to check "prevent dir overloading", timeout. Nothing helped. Only first 1000 files are saved.
Oleg Chernavin 03/21/2005 08:28 am
Did you see the %&ovr0 directory in the place where 1000 files are stored - the rest files are in that subdirectory.

Oleg.
AndrewhA 03/21/2005 08:46 am
Sure, i saw it. And there are no more files.
i start project with
http://someurl.com/page.asp?file={:1..10000}
and when it is finished i see only first 1000 files in that dir!

I fix url for
http://someurl.com/page.asp?file={:1001..10000}
and restart. So there appears %&ovr0 dir with 1001..2000 files!

And it`s true for any project i start (all with macro in url).

PS. I have Win 2000 Server And OE build 1950.


> Did you see the %&ovr0 directory in the place where 1000 files are stored - the rest files are in that subdirectory.
>
> Oleg.
Oleg Chernavin 03/21/2005 10:42 am
Can you please try the latest version:

http://www.metaproducts.com/download/betas/oep1974.zip

It works well on my computer.

Oleg.
Costache Citronoveanu 05/22/2005 04:46 pm
> Can you please try the latest version:
> http://www.metaproducts.com/download/betas/oep1974.zip
> It works well on my computer.
> Oleg.

Now I`m using 3.7.2008 Service Release 1
Same problem: after downloading 1000 files, no aditional files are saved (although they keep downloading)
Oleg Chernavin 05/23/2005 04:54 am
Do you have the "Prevent directories from overloading" box checked in the Options dialog | File Locations? If yes, then the files are actually saved in a subdirectory named %&Ovr0.

Oleg.