endlessly downloads content

Author Message
brian 03/18/2012 07:00 pm
hello, excellent software. however when I try to download this site http://thewelltemperedcomputer.com/KB/1_intro.htm with level limit as two and download from any location radio button checked, the project reaches a place where it downloads content from teener.com endelessly. here is the exported project property

[Object]
OEVersion=Enterprise 6.2.0.3734
Type=0
IID=7020
Caption=Audio
URL=http://thewelltemperedcomputer.com/KB/1_intro.htm
Lev=2
LimTSize=10000
LimNumber=5000
LimTime=100
FTText.Exts=htmlhtmaspaspxjspstmstmlidcshtmlhtxtxttextxspxmlrxmlcfmwmlphpphp3
FTImages.Exts=gifjpgjpegtiftiffxbmfifbmppngipxjp2j2cj2kwbmplwfwebp
FTVideo.Exts=mpgavianimpegmovflvfliflcvivrmramrvasfasxwmvm1vm2vvobsmilmp4m4v
FTAudio.Exts=wavriffmp3midmp2m3uravocwmaapeoggm4aaif
FTArchive.Exts=7zziparcgzzarjlhalayleirarcabtarpakacejarpdftgzexeiso
FTUDef.Exts=jsaxdcssssivbsdtdxslswfclassent
FTText.B=ooxooo
FTImages.B=ooxooo
FTVideo.B=ooxooo
FTAudio.B=ooxooo
FTArchive.B=ooxooo
FTUDef.B=ooxooo
FTOther.B=ooxooo
FTSizes=0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,3,3,3,0,3,0,0,0,0,0,0,0,0
NotIgnoreLogout=False
RSrvsBx=1
RPathBx=1
RProt=-1
LastStart=125:194:157:12:98:3:228:64:
LastEnd=137:68:220:14:98:3:228:64:
PrjStart=104:204:154:12:98:3:228:64:
LastStarted=19/03/2012 01:32:13
LastEnded=19/03/2012 01:32:36
S200=216
S400=26
SPar=79
SSav=216
SLast=200
SSiz=6407305
SMdf=216
SHTML=77
SSuccDowns=1
LFiles=217
LSize=6415480
ImgDim=0,0,0,0
PrevURL=http://thewelltemperedcomputer.com/KB/1_intro.htm
ExploreDirs=True
ConvertRSS=True
LIndexed=False
IndexFiles=False
TPRunEvery=1000

hope this is not a major problem and it can be fixed
Oleg Chernavin 03/20/2012 04:48 am
One suggestion is to limit the number of retries in th Internet tab of the Ribbon - set it to 5, which should be enough.

Best regards,
Oleg Chernavin
MP Staff
brian 03/22/2012 08:05 am
hello, thank you for the suggestion. can confirm that it does not help, oe is still stuck trying to download some content from teener.com
Oleg Chernavin 03/22/2012 10:10 am
What kind of "stuck" happens? I downloaded your project in a minute - 216 files, 6 megabytes and it finished successfully.

Oleg.
brian 03/24/2012 06:28 am
is this with the levels limit set at two and the "Load from any location" option on the "Download location(to get files from)" page selected ? i am using the new project wizard. with those settings the projects downloads files normally until it reaches content from teener.com where it downloads the content abnotmally an example url

http://www.teener.com/firewire_FAQ/rw_common/themes/hv_out_of_the_box/images/rw_common/themes/hv_out_of_the_box/images/rw_common/themes/hv_out_of_the_box/images/rw_common/themes/hv_out_of_the_box/images/rw_common/themes/hv_out_of_the_box/rw_common/themes/hv_out_of_the_box/rw_common/themes/hv_out_of_the_box/rw_common/themes/hv_out_of_the_box/rw_common/themes/hv_out_of_the_box/rw_common/themes/hv_out_of_the_box/images/rw_common/themes/hv_out_of_the_box/rw_common/themes/hv_out_of_the_box/scripts/jquerycssmenu.js
Oleg Chernavin 03/26/2012 06:00 am
Can you try to open the Project Properties dialog - Parsing section and uncheck the "Ignore server errors" box?

Oleg.
brian 03/27/2012 10:40 am
thank you for that suggestion it seems to have solved the issue with teener.com but now another issue has been exposed with www.cadenzarecording.com here is a sample file name

@epl=-enpppBQXb2NIrxn_VMMmTMLN9uQUDhFchd_NPPhTRUBkdwIc-Z184piSJkZUUZ4oKG5WCsctPIpVp-RKTF795j38DsXQGlzEjIsJ0F0ACC16AD

now imagine 1000+ of such files each 1.38 KB in size. the project finishes eventually though
Oleg Chernavin 03/28/2012 09:20 am
Maybe add a filename filter to exclude:

?epl=

This would skip from downloading such URLs.

Oleg.
brian 03/28/2012 06:39 pm
thank you for the suggestion. that fixed that issue but now this

http://gizmodo.com/5305109/4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///4///2011///11///bigpic_ced2398a3dfd4c0f760013c681cd309b.jpg

the project still finishes eventually but the folder structure "\4\2011\11" is repeated all those times and in the folder named "11" we have 6 files. so my question would be is it something in my settings that causes the same folder and its contents to be downloaded over and over ?
Oleg Chernavin 03/29/2012 05:17 am
Can you please post exact Project settings that causes these links here?

Oleg.
brian 03/31/2012 07:08 am
here they are


[Object]
OEVersion=Enterprise 6.2.0.3750
Type=0
IID=7020
Caption=thewelltemperedcomputer.com/KB/1_intro.htm
URL=http://thewelltemperedcomputer.com/KB/1_intro.htm
Lev=2
LimTSize=10000
LimNumber=5000
LimTime=100
FTText.Exts=htmlhtmaspaspxjspstmstmlidcshtmlhtxtxttextxspxmlrxmlcfmwmlphpphp3
FTImages.Exts=gifjpgjpegtiftiffxbmfifbmppngipxjp2j2cj2kwbmplwfwebp
FTVideo.Exts=mpgavianimpegmovflvfliflcvivrmramrvasfasxwmvm1vm2vvobsmilmp4m4v
FTAudio.Exts=wavriffmp3midmp2m3uravocwmaapeoggm4aaif
FTArchive.Exts=7zziparcgzzarjlhalayleirarcabtarpakacejarpdftgzexeiso
FTUDef.Exts=jsaxdcssssivbsdtdxslswfclassent
FTText.B=ooxooo
FTImages.B=ooxooo
FTVideo.B=ooxooo
FTAudio.B=ooxooo
FTArchive.B=ooxooo
FTUDef.B=ooxooo
FTOther.B=ooxooo
FTSizes=0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,3,3,3,0,3,0,0,0,0,0,0,0,0
NotIgnoreLogout=False
RProt=-1
LastStart=0:0:0:0:0:0:0:0:
LastEnd=0:0:0:0:0:0:0:0:
PrjStart=33:78:255:210:242:4:228:64:
ImgDim=0,0,0,0
ExploreDirs=True
ConvertRSS=True
LIndexed=False
IndexFiles=False
TPRunEvery=1000
Oleg Chernavin 04/02/2012 12:02 pm
Thank you! I fixed that. Now such links will obey Level limit and will not load endlessly.

Oleg.
brian 04/04/2012 03:13 pm
thanks for looking at this, hope to be able to test it soon