OE overloaded by huge parsing queues
|QuantumShadow||06/06/2004 05:51 pm|
|Oleg, today is the posting day so bare with me please I have several more posts in my queue ;)
Ok here it is:
when the parsing queue becomes too large OE can slow down all the system.
The other drawback of large parsing queue is that if I need to restart the comp I should wait for the entire queue to clear otherwise I wouldn`t be able to save project.
I was thinking that there is no reason to continue downloading more files than OE can swallow,
So what about a little check box that says:
Stop downloading if Parsing queue reaches X files, or keep parsing queue below X files...
where X is a parameter which every user chooses for himself.
|Oleg Chernavin||06/07/2004 10:41 am|
|Can you tell me, after what parsing queue size, the slowdown becomes noticable? Is it 500, 1000, 10000 files?
|QuantumShadow||06/12/2004 10:55 am|
|> Can you tell me, after what parsing queue size, the slowdown becomes noticable? Is it 500, 1000, 10000 files?
It depends pretty much on the website,
some projects don`t slow down even with 200,000 queue (but still a problem remains when i need to restart the computer)
Other can start slow down already above 30,000 files.
Thats why I think a variable X is the best solution.
|Oleg Chernavin||06/14/2004 04:22 am|
|Frankly, I am not sure that this should be added to the Options dialog. I can add it easily to be setup either in Registry or command-line. What do you think?
|QuantumShadow||06/14/2004 04:05 pm|
|Command-line or Registry is fine with me, Thanks!
> Frankly, I am not sure that this should be added to the Options dialog. I can add it easily to be setup either in Registry or command-line. What do you think?
|Oleg Chernavin||06/15/2004 06:15 am|
|OK. I added the ParsingMax parameter to the Registry. Just set it to a value over 0 to suspend the download when parsing queue is over that amount of files.
The updated oe.exe file is here:
|QuantumShadow||06/16/2004 04:41 am|
|> OK. I added the ParsingMax parameter to the Registry. Just set it to a value over 0 to suspend the download when parsing queue is over that amount of files.
> The updated oe.exe file is here:
Thanks a lot!
It`s a pleasure to work with u Oleg, you make the requested changes in a matter of days (unlike some other products developers that i work with).
|Oleg Chernavin||06/16/2004 04:51 am|
|I am trying to make a difference! :-)
|QuantumShadow||06/16/2004 04:26 pm|
|Oleg, I checked the beta version, unfortunately i have to disappoint u the ParsingMax key doesn`t work.
I put it in:
HKEY_CURRENT_USER\Software\MetaProducts\Offline Explorer Pro\Parameters
ParsingMax REG_DWORD 10
The parsing queue increases indefinitely.
Moreover the latest beta very unstable, it stacks almost immediately. U can try it on any site with a lot of links, and small files. I tried it on www.ebay.com and after downloading 103 files it stacked. I will send u my sample project and registry settings, maybe I am doing something wrong, although before everything worked fine. (btw I tried the www.ebay.com with and without the new registry key)
|Oleg Chernavin||06/17/2004 07:47 am|
|I cannot reproduce the problem. I will now upload the current version I tested your Project with. I will write you directly.