Speed up downloads of fast connections
Currently we are using a very small buffer size when downloading files. This does not effect throughput on slow connections but should have detrimental effect on fat pipes with high latency. We should increase the read buffer size for these connections.
I got a max of ~18MB/s downloading a 2GB file on the Hutch wired network.
Larsson: Xa is out next week. Would you please find a different validator?
Hey, don't make fun of my small buffer size!
Agree that this should increase, especially for large files. Changing the buffer size also affects progress bars. Progress is reported once per buffer. It might be nice to report progress adaptively based on the size of the file to avoid millions of progress updates on large files while remaining responsive on smaller files.