Missing Feature(s) ? (Skip existing Media files when redownloading a site)

Author Message
Uwe Haeusler 03/29/2006 07:00 am
Hi Oleg!
i have two features which i would think would be an nice addition to your program:

1. an option to never check mediafiles for updates.

for me i have an website where are ~5000 images and ~50 html files. now if i want to check for updates OE is checking every file weather it was update although i know that only new images will appear (listed in the htmls) but never older images will be changed. so OE is checking 5000 files more then would be necessary. this is of course taking much more time to complete then to only check the ~50 htmls.


2. an possibility to remove files from the project folder and prevent OE from downloading these files again.

for bigger websites i would like to burn cd?s with files from the projects folder and then remove these files from my disk to save the space. unfortunately when i would run the project the next time, OE would download the burned files again because it thinks these files are new as they are not in the project folder anymore.
so it would be great to give OE an option to remember which files were already downloaded and to not reload these files (update checks should be still possible of course).

perhaps even better would be the possibility to import an filelist from the disk/CD with files which should not be downloaded.
(for example i say import "c:\downloads\images\" and OE will create an filelist/database which includes all files from this directory with filename and -size. then OE can check if files which are to be downloaded are already in the database, and if they are OE can skip the download.)

this would save a lot of bandwidth and time, at least for me (and perhaps for others too)

i think point 1 should be quite easy(?) to implement, while point 2 looks more like an major update ;-).

greets,
Uwe
Uwe Haeusler 03/29/2006 07:00 am
i forgot:
for my website in point 1.
i can not use the option "skip existing files on higher levels than x" because all files from the site are in the same directory
Oleg Chernavin 03/29/2006 07:00 am
Thank you for your ideas.

1. I will look at this. It is easy to implement, but the biggest problem is that any new setting I add makes the Project Properties dialog more complex. This is what we try to avoid as much as possible, because the software should be powerful but still easy in use. This is hard to balance.

2. This is already done in Offline Explorer. You can go to the Project Map tab and right-click on the desired file, directory or server. There will be an item "Disable from loading" in the popup menu. It will add the selected item to the corresponding URL Filters section. Then you can delete it.

I hope this helps.

Best regards,
Oleg Chernavin
MetaProducts corp.
Uwe Haeusler 03/29/2006 07:00 am
1. I see the problem. Perhaps you could add an option(checkbox) to every of the "File Filters" (Text, Images, Videos, ...) which simply says "check for updates".
If you set this to enabled by default there would be no changes for users who don?t need this feature. But users who want to use it just need to uncheck the option for the "File Filters" they don?t need to recheck.

I have tested this for my project (by completely disableing the image download for the test) and found this:
running time with image download: ~25minutes
running time without image download: ~15seconds
So an option for disableing the update check for some "File Filters" would be an good idea (at least for complexer projects).

2. I didn?t knew this option yet, guess i should read the manual some more :-).
But unfortunately this isn?t solving my problem because you cann?t select more than one file at once. So i can also not disable more than one file at once and doing 5000 files manually would take some time. Perhaps you can update your program to change this (enable multiple file selection).

greetings and thanks,
Uwe Haeusler
Oleg Chernavin 03/29/2006 07:00 am
> 1. I see the problem. Perhaps you could add an option(checkbox) to every of the "File Filters" (Text, Images, Videos, ...) which simply says "check for updates".
> If you set this to enabled by default there would be no changes for users who don?t need this feature. But users who want to use it just need to uncheck the option for the "File Filters" they don?t need to recheck.
>
> I have tested this for my project (by completely disableing the image download for the test) and found this:
> running time with image download: ~25minutes
> running time without image download: ~15seconds
> So an option for disableing the update check for some "File Filters" would be an good idea (at least for complexer projects).

Well, but what if you simply uncheck Images - it will be almost the same like if you will not update them?

> 2. I didn?t knew this option yet, guess i should read the manual some more :-).
> But unfortunately this isn?t solving my problem because you cann?t select more than one file at once. So i can also not disable more than one file at once and doing 5000 files manually would take some time. Perhaps you can update your program to change this (enable multiple file selection).

If these files are in one directory, you can disable the whole directory. Or this doesn`t work in your case?

Oleg.
Uwe Haeusler 03/29/2006 07:00 am
1.
> Well, but what if you simply uncheck Images - it will be almost the same like if you will not update them?

This is how i do it atm, the problem is that if i disable them new files won?t be downloaded either. So i have to run it once with disabled images to update the html files and after this i have to run it an second time with images enabled AND the option "do not download existing files" to download the new images. This is of course working but i cann?t schedule this for automatic updates, as i have to run the project twice with different settings.

2.
> If these files are in one directory, you can disable the whole directory. Or this doesn`t work in your case?

The problem is that disabling the whole directory will prevent OE from downloading new files from this directory. So the project won?t be updated anymore. (biggest part of whole site is in the same directory which is constantly updated)

greets,
Uwe
Oleg Chernavin 03/29/2006 07:00 am
> 1.
> > Well, but what if you simply uncheck Images - it will be almost the same like if you will not update them?
>
> This is how i do it atm, the problem is that if i disable them new files won?t be downloaded either. So i have to run it once with disabled images to update the html files and after this i have to run it an second time with images enabled AND the option "do not download existing files" to download the new images. This is of course working but i cann?t schedule this for automatic updates, as i have to run the project twice with different settings.

OK. You convienced me. :-) I added the "Skip existing Media files" checkbox to the Properties dialog.

Please download the updated version here:
http://www.metaproducts.com/download/betas/oep959.zip

Please unzip it and replace the old oe.exe file with the new one.

> 2.
> > If these files are in one directory, you can disable the whole directory. Or this doesn`t work in your case?
>
> The problem is that disabling the whole directory will prevent OE from downloading new files from this directory. So the project won?t be updated anymore. (biggest part of whole site is in the same directory which is constantly updated)

OK. This is harder that the first item and I will work in future versions on it - multiselect in the Project Map.

Best regards,
Oleg Chernavin.
Uwe Haeusler 03/29/2006 07:00 am
> OK. You convienced me. :-) I added the "Skip existing Media files" checkbox to the Properties dialog.

GREAT! thank you very much!!!
only one more question: i?m using the enterprise edition of OE atm: is it safe to continue my projects with this Offline Explorer Pro Beta?


> OK. This is harder that the first item and I will work in future versions on it - multiselect in the Project Map.

I feared that you would say this :-).
Anyway thanks for your support! It?s really outstanding and i can only recommend (and i am doing already) your program! (i think it has grown to the best of its kind. (i?ll never go back to teleport :-) ))
Uwe Haeusler 03/29/2006 07:00 am
just have seen that there is an extra forum for Offline Explorer Enterprise Edition.

i must have overseen it because its not near the other two OE-forums.

sorry! my fault
Oleg Chernavin 03/29/2006 07:00 am
> just have seen that there is an extra forum for Offline Explorer Enterprise Edition.
>
> i must have overseen it because its not near the other two OE-forums.

No problem here. I think that this discussion might be interested to Offline Explorer Pro users also.

Oleg.
Oleg Chernavin 03/29/2006 07:00 am
> > OK. You convienced me. :-) I added the "Skip existing Media files" checkbox to the Properties dialog.
>
> GREAT! thank you very much!!!
> only one more question: i?m using the enterprise edition of OE atm: is it safe to continue my projects with this Offline Explorer Pro Beta?

No. I just release 2.5 version. Please download it here:
http://www.metaproducts.com/download/eesetup.exe

>
> > OK. This is harder that the first item and I will work in future versions on it - multiselect in the Project Map.
>
> I feared that you would say this :-).
> Anyway thanks for your support! It?s really outstanding and i can only recommend (and i am doing already) your program! (i think it has grown to the best of its kind. (i?ll never go back to teleport :-) ))

Thank you!

Best regards,
Oleg Chernavin.
03/29/2006 07:00 am
OK, thanks for the update and thanks in advance for the multiselect!!!

greets,
Uwe Haeusler
Oleg Chernavin 03/29/2006 07:00 am
> OK, thanks for the update and thanks in advance for the multiselect!!!

You are welcome!

Oleg.