|francis||08/05/2011 12:03 am|
|how do i get oe just to download part of a site using filters
the website says you cant use robots and i have tried to download the site but they block you if you do it to long I have a fixed ip address and cant change it.
the site is very big I would like to break it up into categories
website www.conceptcarz.com what filters do I use and what will be loaded when i use them
also in the queue will it show total of files that are to be downloaded
|Oleg Chernavin||08/08/2011 07:13 am|
|I think, you should limit the speed of downloading. The site becomes overloaded and it negatively affects its performance. To lower the load, you may set 1 connection and specify random delay between downloads: