Since the project is so huge, it takes atleast 4-5 months to download the entire project.
In the mean while, I would like to download a url (of the same domain) and all links that are associated with that first. Is it possible?
This will make the download the way you need.
However this may eat too much memory when downloading huge Web sites.