I need to stop files (attachments) with the same name from overwriting themselves.

Author Message
Logan9773 01/04/2010 03:07 pm
Hi Oleg,

as per the subject, I need to keep attachments I am downloading that have the same name from overwriting themselves. i.e. 01.jpg and then I download another file named 01.jpg in the same forum, it overwrites the first one. I've tried to set this under properties:file copies but that seems to only work on duplicate files ( i.e. same byte length). Different files with the same name just overwrite each other. I'd like it to just add a (1) or (2) etc. to the end of the filename if it downloads a duplicate name instead of overwriting the file. Is there allready a way to do this?

Thanks.
Oleg Chernavin 01/04/2010 08:05 pm
Yes, please add the following line to the Project's URLs field:

Additional=SkipDisposition

Best regards,
Oleg Chernavin
MP Staff
Logan9773 01/10/2010 12:14 am
Thanks Oleg.

That works to a point, but what I really wanted to do is save the AUXILLARY or Secondary name that is sent, which is the filename. Like file1.jpg . SkipDisposition drops that filename and saves just the .php filename. It works but I loose the file name. What I want it to do is if file.jpg already exists, then it should make a new file called file(2).jpg instead of overwriting the other one. I really want to save the .jpg and .zip filenames since I'm downloading pics and manga.

Maybe additional=DoNotOverWrite .

Would be much appreciated, because a lot of times there will be multiple files in a forum with the same name, like 1.jpg, 2.jpg, etc.

Could you please implement this?

Thanks.
Oleg Chernavin 01/11/2010 05:48 am
OK. I added code that should overcome this issue automatically. Here is the updated oe.exe version:

http://www.metaproducts.com/download/betas/OEP3153.ZIP

It will add not 1, 2, etc. numbers, but a code that depends on the original URL. Please test it and let me know how it works. Thank you!

Oleg.
Logan9773 01/13/2010 12:27 am
Thanks Oleg. Unfortunately, for some weird reason I can't get Offline Explorer Pro to work on the site I'm trying to download. I tried the trial version of it on two different computers, and all the files (attachments) that came down had only the .php file name and were exactly 36K in length. It just downloaded garbage for some reason. I even tried it on a fresh XP and Win7 clean install. No go. Offline Explorer Enterprise trial seems to work fine though (what I'm using right now). So, I can't try out your program. If you could put the change into Offline Explorer Enterprise, I think I could try it.


Thanks again.

Oleg Chernavin 01/13/2010 06:21 am
Sure. Please try this version:

http://www.metaproducts.com/download/betas/OEE3154.ZIP

Oleg.
Logan9773 01/14/2010 01:47 am
Hey Oleg, I got Enterprise Edition 5.8 to work and it downloaded all the files I specified, but they are still overwriting each other. I tested it with the attachment on this forum, all pics. A few of the files are a short manga. I notice that a couple of pages are missing because they were overwritten by later downloads of files with the same file name. I looked through all the pics, thinking they must be under some other file name, but I can't find them. Any thoughts?

Here are my project settings:

Stream 1.2 File
[Object]
OEVersion=Enterprise 5.8.0.3154
Type=0
IID=7010
Caption=http://forum.hentaipalm.com/showthread.php?t=9228
URL=http://forum.hentaipalm.com/showthread.php?t=9228http://forum.hentaipalm.com/showthread.php?t=9228&page={:2..3}
MVer=5
Lev=1
Weekday=257
LimTSize=10000
LimNumber=5000
LimTime=100
FMGroup=1
FTText.Exts=htmlhtmaspaspxjspstmstmlidcshtmlhtxtxttextxspxmlrxmlcfmwmlphpphp3
FTImages.Exts=gifjpgjpegtiftiffxbmfifbmppngipxjp2j2cj2kwbmplwf
FTVideo.Exts=mpgavianimpegmovflvfliflcvivrmramrvasfasxwmvm1vm2vvobsmilmp4
FTAudio.Exts=wavriffmp3midmp2m3uravocwmaape
FTArchive.Exts=ziparcgzzarjlhalayleirarcabtarpakacejarpdftgzexe
FTUDef.Exts=jscssssivbsdtdxslswfclassent
FTText.B=ooxooo
FTImages.B=ooxooo
FTVideo.B=ooxooo
FTAudio.B=xoxooo
FTArchive.B=ooxooo
FTUDef.B=xoxooo
FTOther.B=xoxooo
FTSizes=0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,3,3,3,0,3,0
NotIgnoreLogout=False
RSrvsBx=1
RFileIn=attachment x
RProt=255
LastStart=228:78:233:72:241:159:227:64:
LastEnd=124:164:253:110:241:159:227:64:
LastStarted=1/13/2010 12:57:48 PM
LastEnded=1/13/2010 1:04:30 PM
S200=1119
S400=10
SPar=3
SSav=1119
SLast=200
SSiz=160354216
SMdf=1119
LFiles=1129
LSize=159066984
Flags=1
ImgDim=0,0,0,0
PrevURL=http://forum.hentaipalm.com/showthread.php?t=9228
LIndexed=False
IndexFiles=False

Oh, and something is wrong with your captcha software, I have a really hard time getting through the verification. It almost alway rejects me even though the numbers are right.
Logan9773 01/14/2010 01:47 am
I sent you an earlier message, but it says it has to be checked by a moderator before it will be posted.

Just wanted to say, that I now installed 5.8 on my Windows 7 computer and I get the opposite behavior.
The first file to come down is saved, and the one downloaded later is never saved.

Just an FYI.
Oleg Chernavin 01/14/2010 02:50 am
Please give me few links to the files that have the same name.

I just don't see them - it looks like all links have different names.

Regarding captcha - yes, we will work to fix this. Thank you!

Oleg.
Logan9773 01/15/2010 06:16 am
Here's the first page

URL=http://forum.hentaipalm.com/showthread.php?t=9228

On it are a few attachments that form a manga. One of the files is 06.jpg, kind of near the top of the page. On the third page

URL=http://forum.hentaipalm.com/showthread.php?t=9228&page={:2..3}

is another 06.jpg, its near the bottom of the page. There are a few other files as well I think, like 05.jpg, because I noticed I was missing a few pages from the manga when I ran it first on XP. This was the first test when it download the last files and overwrote the first files. On Win7, it did the opposite and kept the first files, but did not download the last files from the third page.

What would a diverted file name look like? Could you give me an example of what 06.jpg should look like when it was diverted from overwriting? Maybe I'm missing something.

What I always get in the end are the .php files that are 1K and then the actual pics which have the attachment file name. I keep the .php files so that OE knows what has already been downloaded.
Logan9773 01/15/2010 06:16 am
Oh, and here are the links to the first and last 06.jpg

http://forum.hentaipalm.com/attachment.php?attachmentid=250625&d=1155102214 (first)

http://forum.hentaipalm.com/attachment.php?attachmentid=548843&d=1171667695 (last)
Logan9773 01/15/2010 06:16 am
Hey Oleg,

I just did a experiment with the two 06.jpg files where I put both of their links only in a project and download them. Here is the project file:

Stream 1.2 File
[Object]
OEVersion=Enterprise 5.8.0.3154
Type=0
IID=7010
Caption=06.jpg
URL=http://forum.hentaipalm.com/attachment.php?attachmentid=250625&d=1155102214http://forum.hentaipalm.com/attachment.php?attachmentid=548843&d=1171667695
Lev=1
Weekday=257
LimTSize=10000
LimNumber=5000
LimTime=100
FMGroup=1
FTText.Exts=htmlhtmaspaspxjspstmstmlidcshtmlhtxtxttextxspxmlrxmlcfmwmlphpphp3
FTImages.Exts=gifjpgjpegtiftiffxbmfifbmppngipxjp2j2cj2kwbmplwf
FTVideo.Exts=mpgavianimpegmovflvfliflcvivrmramrvasfasxwmvm1vm2vvobsmilmp4
FTAudio.Exts=wavriffmp3midmp2m3uravocwmaape
FTArchive.Exts=ziparcgzzarjlhalayleirarcabtarpakacejarpdftgzexe
FTUDef.Exts=jscssssivbsdtdxslswfclassent
FTText.B=ooxooo
FTImages.B=ooxooo
FTVideo.B=ooxooo
FTAudio.B=ooxooo
FTArchive.B=ooxooo
FTUDef.B=ooxooo
FTOther.B=ooxooo
FTSizes=0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,3,3,3,0,3,0
NotIgnoreLogout=False
RProt=255
LastStart=162:53:5:253:16:160:227:64:
LastEnd=234:50:133:253:16:160:227:64:
LastStarted=1/14/2010 12:44:28 PM
LastEnded=1/14/2010 12:44:33 PM
S200=2
SSav=2
SLast=200
SSiz=349669
SMdf=2
LFiles=2
LSize=349669
Flags=1
ImgDim=0,0,0,0
PrevURL=http://forum.hentaipalm.com/attachment.php?attachmentid=250625&d=1155102214
ConvertRSS=True
LIndexed=False
IndexFiles=False

I get both of the .php attachment files, but I get only one 06.jpg file. One 06.jpg still overwrites the other one.
Oleg Chernavin 01/15/2010 07:21 am
Yes, my mistake. I fixed it. I plan to release the new version today or tomorrow.

Oleg.
Logan9773 01/15/2010 11:30 am
Thanks Oleg.

Please leave me a link.
Oleg Chernavin 01/15/2010 02:16 pm
Just download the new 5.8 version from our site.

Oleg.
Logan9773 01/18/2010 01:07 am
Thanks Oleg,

I've been trying it out on a mass download, and it looks like its working.

Much better!
Oleg Chernavin 01/18/2010 03:23 am
Great!

Oleg.