OE Stack after some time

Qshadow
12/25/2007 04:26 am
Hi Oleg,
Long time no see.
I was using OE 3.0 three years ago and posted a lot on the forums, maybe you remember me as QuantumShadow,
Recently I purchased & Installed the Latest OE Pro 4.9 hoping that the main problem that plagued the previous release was solved in these years...
Unfortunately OE is still stack after 12 hours of downloading from big site,
I used /NoMap /NoDB falgs that I remember you told me to use in OE 3.0, it didn't help.
OE uses 99% of CPU, however memory consumption is very low, so it is not memory that is the problem.
Do you have any ideas how to debug this? What additional Info can I provide you?
I want to solve this issue once and for all.
You can try and download the site by yourself if you want:
www.kolyan.net


Regards,
Qshadow.
Oleg Chernavin
12/25/2007 08:16 am
The first question is if OE is parsing all the time or not. It is what takes CPU - please see in the Status Bar if there is a Parsing (XX) message or not?

Best regards,
Oleg Chernavin
MP Staff
Qshadow
12/25/2007 08:42 am
> The first question is if OE is parsing all the time or not. It is what takes CPU - please see in the Status Bar if there is a Parsing (XX) message or not?
>


Well, since OE is stack I may not be able to see it, but I will try to run logs,
is it still something like:
/log=c:\oe.log /LogFilter=1011111

at the command line?

So in the log i think we may see what is OE doing.
Oleg Chernavin
12/25/2007 10:51 am
Yes, it will work. The most useful thing here is Queue messages. You may make the filter to show only them.

Oleg.
qshadow
12/25/2007 03:42 pm
> Yes, it will work. The most useful thing here is Queue messages. You may make the filter to show only them.
>
> Oleg.

Well, I do not now how to modify the Filter masks to show only queue, is there any readme about it?

Anyway, OE stack again, there was no parsing going on until 5 min before the crash/stack, after this I do not know since the GUI became inaccessible and I had to kill the process.
The queue depth was about 55,000
I have the log file of the last moments, but i do not see there anything unusual, how do I send it to you?

Regards,
QShadow.
Oleg Chernavin
12/25/2007 03:57 pm
Yes, please send it (zipped).

Oleg.
qshadow
12/25/2007 04:01 pm
> Yes, please send it (zipped).
>
> Oleg.

I do not remember your email,
should I just send it to
support@metaproducts.com
?

Oleg Chernavin
12/26/2007 01:29 am
I sent you an E-mail myself. If you do not receive it soon, please post here again.

Oleg.
Oleg Chernavin
12/26/2007 08:36 am
Yes, the last file:
http://kolyan.net/index.php?cstart=700&go=News&in=view&id=8557
takes 2 minutes to parse according to the log. However when I tried to load and parse it, it took just milliseconds. And this is with all possible parsing options enabled.

Can you please post your Project settings here? Please select it, use Edit - Copy and paste to the forum message.

Oleg.
qshadow
12/26/2007 02:32 pm
Here it is:


[Object]
OEVersion=Pro 4.9.0.2670
Type=0
IID=2
Caption=http://www.kolyan.net
URL=http://www.kolyan.net/
Lev=1000001
Weekday=257
LimTSize=10000
LimNumber=5000
LimTime=100
FTText.Exts=htmlhtmaspaspxjspstmstmlidcshtmlhtxtxttextxspxmlrxmlcfmwmlphpphp3
FTImages.Exts=gifjpgjpegtiftiffxbmfifbmppngipxjp2j2cj2kwbmplwf
FTVideo.Exts=mpgavianimpegmovflvfliflcvivrmramrvasfasxwmvm1vm2vvob
FTAudio.Exts=wavriffmp3midmp2m3uravocwmaape
FTArchive.Exts=ziparcgzzarjlhalayleirarcabtarpakacejarpdftgz
FTUDef.Exts=jscssssivbsdtdxslswfclass
FTText.B=xoxooo
FTImages.B=ooxooo
FTVideo.B=xoxooo
FTAudio.B=xoxooo
FTArchive.B=xoxooo
FTUDef.B=xoxooo
FTOther.B=xoxooo
FTSizes=0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,3,3,0,3,0
RSrvsBx=2
RSrvsIn=kolyan.net x
RPathBx=2
RPathEx=forumvideo xx
RFileBx=2
RFileEx=videoforum xx
RProt=127
LastStart=217:70:159:168:92:66:227:64:
LastEnd=0:0:0:0:0:0:0:0:
LastStarted=26-Dec-07 21:29:38
S200=238
S304=145
S400=1
SPar=126
SSav=39
SLast=200
SSiz=6093087
SMdf=39
LFiles=384
LSize=3150896
Substs=www.kolyan.net www.kolyan.net kolyan.net
ImgDim=0,0,0,0
PrevURL=http://kolyan.net/
IPAddr=-2041777577
Qshadow
12/27/2007 09:13 am
Hi Oleg, I restarted the Download from the beginning (with "do not download existing files" of course.
It stack again, if you want I will send you the new log.
I didn't look at it yet but I have the feeling that this time it passed over the problematic file without problems and stack on another one.
so it is not just file contents that kill OE, but maybe the previous parsed file database + new file combinaton.
Oleg Chernavin
12/29/2007 07:12 pm
I made a lengthy download, but didn't find the parsing hangup. Can you please try to allow Directory Overload Protection in the Options dialog - File Locations section and remove the site from the download directory (to start from the scratch) and start download again?

Oleg.
QShadow
12/29/2007 07:21 pm
> I made a lengthy download, but didn't find the parsing hangup. Can you please try to allow Directory Overload Protection in the Options dialog - File Locations section and remove the site from the download directory (to start from the scratch) and start download again?
>
> Oleg.

How Long was your download?

I have the "prevent directories from overloading" set,
but what I noticed few days ago that my
Local Settings\Temp
directory was full of *.tmp files that probably where created by OE.
It had 35,000 of them, so my application couldn't even start.

I will try do download again, and let you know.
Qshadow.