OE overloaded by huge parsing queues

Author Message
QuantumShadow 06/06/2004 05:51 pm
Oleg, today is the posting day so bare with me please I have several more posts in my queue ;)

Ok here it is:
when the parsing queue becomes too large OE can slow down all the system.
The other drawback of large parsing queue is that if I need to restart the comp I should wait for the entire queue to clear otherwise I wouldn`t be able to save project.

I was thinking that there is no reason to continue downloading more files than OE can swallow,
So what about a little check box that says:
Stop downloading if Parsing queue reaches X files, or keep parsing queue below X files...
where X is a parameter which every user chooses for himself.

Regards
QuantumShadow
Oleg Chernavin 06/07/2004 10:41 am
Can you tell me, after what parsing queue size, the slowdown becomes noticable? Is it 500, 1000, 10000 files?

Best regards,
Oleg Chernavin
MP Staff
QuantumShadow 06/12/2004 10:55 am
> Can you tell me, after what parsing queue size, the slowdown becomes noticable? Is it 500, 1000, 10000 files?

It depends pretty much on the website,
some projects don`t slow down even with 200,000 queue (but still a problem remains when i need to restart the computer)
Other can start slow down already above 30,000 files.

Thats why I think a variable X is the best solution.

Thanks


Oleg Chernavin 06/14/2004 04:22 am
Frankly, I am not sure that this should be added to the Options dialog. I can add it easily to be setup either in Registry or command-line. What do you think?

Oleg.
QuantumShadow 06/14/2004 04:05 pm
Command-line or Registry is fine with me, Thanks!


> Frankly, I am not sure that this should be added to the Options dialog. I can add it easily to be setup either in Registry or command-line. What do you think?
>
> Oleg.
Oleg Chernavin 06/15/2004 06:15 am
OK. I added the ParsingMax parameter to the Registry. Just set it to a value over 0 to suspend the download when parsing queue is over that amount of files.

The updated oe.exe file is here:

http://www.metaproducts.com/download/betas/oep1724.zip

Oleg.
QuantumShadow 06/16/2004 04:41 am
> OK. I added the ParsingMax parameter to the Registry. Just set it to a value over 0 to suspend the download when parsing queue is over that amount of files.
>
> The updated oe.exe file is here:
>
> http://www.metaproducts.com/download/betas/oep1724.zip
>
> Oleg.

Thanks a lot!
It`s a pleasure to work with u Oleg, you make the requested changes in a matter of days (unlike some other products developers that i work with).

Oleg Chernavin 06/16/2004 04:51 am
I am trying to make a difference! :-)

Oleg.
QuantumShadow 06/16/2004 04:26 pm
Oleg, I checked the beta version, unfortunately i have to disappoint u the ParsingMax key doesn`t work.
I put it in:

HKEY_CURRENT_USER\Software\MetaProducts\Offline Explorer Pro\Parameters

ParsingMax REG_DWORD 10

The parsing queue increases indefinitely.

Moreover the latest beta very unstable, it stacks almost immediately. U can try it on any site with a lot of links, and small files. I tried it on www.ebay.com and after downloading 103 files it stacked. I will send u my sample project and registry settings, maybe I am doing something wrong, although before everything worked fine. (btw I tried the www.ebay.com with and without the new registry key)
Oleg Chernavin 06/17/2004 07:47 am
I cannot reproduce the problem. I will now upload the current version I tested your Project with. I will write you directly.

Oleg.