[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Condor-users] wget-friendly download links?

I faced a similar problem due to non-availability of download links. My download via proxy used to fail frequently midway and I had to retry so many times. So, after reading man pages of wget the following solution using --post-data and --referer arguments of wget worked for me.

wget --post-data="email=<youremail@xxxxxxxxxxxxxx>&name=<yourname>&org=<yourorg>" --referer=http://www.cs.wisc.edu/condor/cgi-bin/downloads/download.pl/v6.7 http://www.cs.wisc.edu/condor/cgi-bin/downloads/sendfile.pl//v6.7/condor-6.7.20-linux-x86-glibc23-dynamic-1.i386.rpm

If the transfer fails, I use "-c" option and wget continues downloading the partially-downloaded file.

The reason why I wanted to use wget instead of browsers is it can continue failed downloads and is better with flaky Internet connections.

I have accepted the license agreement several times during my failed download attempts and I am providing my email and other details while downloading with wget, so I don't think there is any violation. I am not sure if this causes any bandwidth issues. So, I request people to use the above solution only for flaky Internet connections and not to stress the site. I had to look for this workaround as my downloads via my proxy failed so many times. One particular download failed at 99% :-(


Matt England wrote on 02/18/2006 09:17 PM:
Do any Condor-software download sites provide wget-friendly (see link below) download links? The http://www.cs.wisc.edu/condor/ download mechanism I see only provides some sort of embedded download link, possibly a Javacript thing, that I can't extract into an iternal link and feed to all my machine for which I want to download Condor to (which may be distributed across my geographically-dispersed grid).

Maybe this is on purpose...to save the Condor site's bandwidth, perhaps?


In the meantime I'll just scp around the files.


Condor-users mailing list

The information contained in this electronic message and any attachments to this message are intended for the exclusive use of the addressee(s) and may contain proprietary, confidential or privileged information. If you are not the intended recipient, you should not disseminate, distribute or copy this e-mail. Please notify the sender immediately and destroy all copies of this message and any attachments.
WARNING: Computer viruses can be transmitted via email. The recipient should check this email and any attachments for the presence of viruses. The company accepts no liability for any damage caused by any virus transmitted by this email.