latest updates have slowed oe

Author Message
03/29/2006 07:00 am
I?m not shure if this is correct but i have the impression that OE has slowed down with the latest updates. Some projects take now a lot longer to complete, at least i think so.
Has someone else this impression?
Oleg Chernavin 03/29/2006 07:00 am
Which version do you mean? Also, if you have "Prevent directories from overloading" checked in the Options dialog | Advanced | Directories, then OE will really work a bit slower, because it will check if there are over 1000 files in each directory it adds files to.

Best regards,
Oleg Chernavin
MetaProducts corp.
03/29/2006 07:00 am
i?m using the 990 beta.
i have not "Prevent directories from overloading" enabled but still i noticed that the parsing of projects takes now much longer then some weeks ago.
i?m not shure that the new updates are the reason for this but i think i haven?t changed anything else.
Oleg Chernavin 03/29/2006 07:00 am
I just found one possible reason for that - Offline Explorer kept unused temporary files in Windows Temp directory. I just fixed that. I am releasing the updated 2.6 version now. Please check our site a bit later. Thank you!

Oleg.
03/29/2006 07:00 am
Ok!
thank you, i will try it as soon as it is out.
Another thing i noticed is that the two projects which are especially slow have a lot of keywords in the "URL Filters" which i have imported from an .txt file.
Could these be a reason too?
Oleg Chernavin 03/29/2006 07:00 am
The new version was just uploaded. Please load it here:
http://www.metaproducts.com/download/opsetup.exe

Large number of URL Filters keywords definitely makes parsing files slower.

Oleg.
03/29/2006 07:00 am
thanks,
this helped !
overall performance has increased now to "normal" level :-)
now i only have one very complex project which is very slow but this is related to the many keywords i think.

thanks again!
Oleg Chernavin 03/29/2006 07:00 am
Good.

Regarding number of keywords - are they just links that begin with http://.... that you excluded from the Map? I have plans to add a new URL Filters category where simple links will be placed (no keywords, masks, etc.) Processing these URLs will be very simple and fast.

Oleg.
03/29/2006 07:00 am
the keywords are mixed but the largest part are complete urls to files (which i wanted to remove from my hard-drive) so an speed up for this would be great.

i also wanted to ask weather you can make it possible to save the filters to an text-file? (like loading from text-file is already possible).
if i could save them to disk i could edit the txt-file with notepad (or excel) and then reload the manipulated file back into OE. this would make it much easier to edit then in the small window inside OE.
Oleg Chernavin 03/29/2006 07:00 am
Would copy to clipboard satisfy you?

Oleg.
03/29/2006 07:00 am
shure :-)
this would have the same effect.
Oleg Chernavin 03/29/2006 07:00 am
OK. Here it is:
http://www.metaproducts.com/download/betas/oep1012.zip

Ctrl-C will copy keywords to clipboard there.

Oleg.
03/29/2006 07:00 am
thank you very much!



ps: i?m looking forward to the "new URL Filters category where simple links will be placed ..."
Jen 03/29/2006 07:00 am
Yes this sounds good !
I have noticed too an slowdown in projects with many filters. Please do this update also for the enterprise edition.

thanks in advance, Jen
03/29/2006 07:00 am
Yes, sure. This will be in all editions of Offline Explorer. I plan this for 2.6 Service Release 1 version.

Oleg.
Jen 03/29/2006 07:00 am
that?s good to hear :-)
i?m looking forward to this !

thanks,
jen
Daniel 03/29/2006 07:00 am
will "Service Release 1" be an update i get without additional payment if i buy oep now?

this update sounds good(i have some very slow projects too with many urls in the filters) so i would like to know if i should wait some time for this update before buying oep.

also i would like to know how long will the ti,me be till this update will be released?

regards,
daniel
Oleg Chernavin 03/29/2006 07:00 am
Daniel,

All upgrades will be free until 3.0 version. So, you can safely buy the 2.6 version now and then you will simply download and install any update (up to 2.9 version) and it will automatically accept the current registration key.

For every major upgrade we decide if we charge an upgrade price and how much. It highly depends if the new version contains many new features or not.

Regarding upgrade times. We release new versions monthly, so you can expect it by mid-November.

Oleg.
Daniel 03/29/2006 07:00 am
this sounds fair :-)
i?m looking forward to this update than.

i also think i might have found an bug related to projects with many keywords.
i have noticed that i have often corrupt html-files (no other file-types (at least i haven?t found any)) within complex projects (simpler ones are working smooth as ever).

these broken html-files are always too small and are always ending with:
A HREF="

this happens to appear mostly on the starting page html
Daniel 03/29/2006 07:00 am
i forgot:
the option "Check HTML files integrity" is enabled but isn?t working (?)
Oleg Chernavin 03/29/2006 07:00 am
Can you try to do the following - in the Projet Properties dialog | Advanced page check "Keep .primary files" box. Click OK and try to redownload it. If you notice any broken page of that redownloaded Project, please try to look at its .primary copy - if it is complete or not? .Primary files are original ones before parsing occurs. If they are complete, then it is a bug in the parsing code, otherwise - downloading. I will know where to look for the problem then.

Oleg.
Daniel 03/29/2006 07:00 am
false alert (i think):
i?ve noticed that the files weren?t corrupt but only displayed wrong within the internal browser.
i could see the file correctly when i opened it in the internet explorer.
(the file is shown now correctly in the internal browser aswell so perhaps it was(is) an problem with an cache?)
Oleg Chernavin 03/29/2006 07:00 am
Yes, it looks like that. Please let me know if you will face such broken files ever.

Oleg.
Jen 03/29/2006 07:00 am
hi i?ve just installed the SR 1 and couldn?t find the "new URL Filters category where simple links will be placed" ?
is it not in this update or have i just overseen it?

looking forward to this
regards,
Jen
Oleg Chernavin 03/29/2006 07:00 am
Sorry, I haven`t done it yet. I was pushed to make the new version faster than usually.

Oleg.
03/29/2006 07:00 am
is this update coming soon?
i think i have slowdowns because of the same reasons = very many keywords.
Oleg Chernavin 03/29/2006 07:00 am
I just made it. Please try the updated version. You can download it here:

http://www.metaproducts.com/download/betas/oep1049.zip

Replace the old oe.exe file with the new one. You will find the new list in the URL Filters section. You need to place exact URLs there to be excluded or exclude them from the Project Map using "Disable from loading". Please remove your older URL Filters keywords if they don`t contain any special symbols, like * ^ $, etc.

Please let me know how it works.

Best regards,
Oleg Chernavin.
03/29/2006 07:00 am
is this update availabele for enterprise already? (or can i use this update for the enterprise edition too?)

as i only use enterprise i cann?t tell you yet how it works.

thanks already !
Oleg Chernavin 03/29/2006 07:00 am
I just uploaded it here:

http://www.metaproducts.com/download/betas/oee1052.zip

I also added Disabled URLs panel below the Project Map for convenient use.

Oleg.
03/29/2006 07:00 am
Hi!
i?ve just installed and looked at the update.
i cann?t say much to the speed yet as i have to copy the urls first from the previous filter section to the new one.

but i have noticed that the new section has no sidebars (neither left-right nor top-down) which makes it look a little bit confusing if you have many (or very long) URL?s.

can you add these bars in the next update please?

greets
Oleg Chernavin 03/29/2006 07:00 am
Thank you for noticing this! I just added them. Please also try to work with the same Excluded URLs list in the Map tab. It supports drag-and-drop as well. Is it convinient to use?

Oleg.
03/29/2006 07:00 am
great!
i just had the first test run with the new settings and its running enormous much faster now!!!
the excluded URLs list in the map tab is working fine too. (hadn?t even discovered the drag`n`drop feature yet).

another improvement i?d like to suggest is that you can choose in the map tab how the files can be sorted. for example: sort by extension or sort by filename.

for sites like this:
1001.htm
1001.zip
1002.htm
1002.zip
1003.htm
1003.zip
1004.htm
1004.zip
1005.htm
1005.zip
1006.htm
1006.zip
1007.htm
1007.zip
1008.htm
1008.zip
1009.htm
1009.zip
...
it is difficult if you want to select all zip files(but not the .htm files) because you have to click them all manually as selecting with SHIFT would select the .htm files aswell).
Oleg Chernavin 03/29/2006 07:00 am
I looked there. It will take time to do that. Do you face this problem often? If it is not an important issue, I would put it to my long-range plans.

Oleg.
03/29/2006 07:00 am
> I looked there. It will take time to do that. Do you face this problem often? If it is not an important issue, I would put it to my long-range plans.
>
> Oleg.

well i have come about this several times already (at least since you added the multiselect feature) the problem is that even if you don?t have these very often they consume very much time.

but i think it wouldn?t be that important for now (at least not for me).
Oleg Chernavin 03/29/2006 07:00 am
OK. I just added that feature. You will find the switch in the Options dialog | Advanced. It appeared to require less time than I thought initially. :-)

The updated version is here:

http://www.metaproducts.com/download/betas/oep1058.zip

Let me know if you have any issues with it (or any other problems).

Oleg.
03/29/2006 07:00 am
thanks thats great!
Oleg Chernavin 03/29/2006 07:00 am
Good!

Oleg.