Web Download Automation

[charlie]

Hi folks ,

I was trying to automate web downloading .
ie Everyday i've to download and install so many applications by visiting so many websites (like toolbars, browsers etc ). What i basically want to do is given the URL the program should go and download all the installers(like MSI, NSIS, exe's,zips) from the website .
I was thinking of using a crawler and then download the files.

Has anyone else done this before or have any better ideas of doing this or know of any tool which already do this. If my approach is correct can you please suggest the best crawler to use for the purpose.

All the suggestions are much appreciated.

thanks in advance

Charlie

[is_numeric]

You would have to know how each download is delivered

You could store every path to each exe / zip in a database then write a smal script which loops through the data picking each one up as a download prompt