PDA

View Full Version : Web Download Automation



charlie
23 Apr 2010, 01:27 PM
Hi folks ,

I was trying to automate web downloading .
ie Everyday i've to download and install so many applications by visiting so many websites (like toolbars, browsers etc ). What i basically want to do is given the URL the program should go and download all the installers(like MSI, NSIS, exe's,zips) from the website .
I was thinking of using a crawler and then download the files.

Has anyone else done this before or have any better ideas of doing this or know of any tool which already do this. If my approach is correct can you please suggest the best crawler to use for the purpose.

All the suggestions are much appreciated.

thanks in advance

Charlie

is_numeric
26 Apr 2010, 08:18 AM
You would have to know how each download is delivered

You could store every path to each exe / zip in a database then write a smal script which loops through the data picking each one up as a download prompt