Consider using aria2 as a replacement to wget
Posted: 13.08.2013, 22:09
Hiya,
I've often noted that the bottleneck for WOU is wget. I have a 120mbit/s connection and most of the time wget will only download @ ~1-2MiB/s (8-16mbit/s).
I did a bit of tinkering with DownloadUpdates.cmd and replaced all references to wget with aria2 and I now download at 15MiB/s on almost all files!
This is due to aria2 splitting downloads into chunks and downloading them in parallel. It will also download multiple files when presented with a file containing multiple urls (as happens quite often in DownloadUpdates.cmd).
Seeing as I can't seem to attach .txt or .cmd files I have uploaded my version of DownloadUpdates.cmd to: http://pastebin.com/NZAw2M95
aria2 can be downloaded from http://aria2.sourceforge.net/
I would love to hear your feedback on this mod!
Thanks,
Alex
I've often noted that the bottleneck for WOU is wget. I have a 120mbit/s connection and most of the time wget will only download @ ~1-2MiB/s (8-16mbit/s).
I did a bit of tinkering with DownloadUpdates.cmd and replaced all references to wget with aria2 and I now download at 15MiB/s on almost all files!
This is due to aria2 splitting downloads into chunks and downloading them in parallel. It will also download multiple files when presented with a file containing multiple urls (as happens quite often in DownloadUpdates.cmd).
Seeing as I can't seem to attach .txt or .cmd files I have uploaded my version of DownloadUpdates.cmd to: http://pastebin.com/NZAw2M95
aria2 can be downloaded from http://aria2.sourceforge.net/
I would love to hear your feedback on this mod!
Thanks,
Alex