[Go-essp-tech] CORRECTION: Fwd: Re: download rates
Karl Taylor
taylor13 at llnl.gov
Thu Mar 3 09:26:04 MST 2011
Dear all,
I must apologize that I lost a decimal place in reporting the download
rates yesterday (trying to do too many things at the same time).
We're in much better shape than I reported: download rates of about
*10* MB/min (not 1 MB/min), with a TB taking perhaps 70 days in 1 stream.
What Estani reported (2 TB in 14 hours in 7 parallel streams) is about
35 times faster per stream.
It would be nice to close this gap across the Atlantic.
Best regards,
Karl
On 3/2/11 4:43 PM, Karl Taylor wrote:
> Hi all,
>
> When I download a 25 MB CMIP5 file from BADC using the wget method:
> * it took 35 sec to get started
> * then it downloaded at an average rate of 1.1 MB/min
>
> When I download the same file using the point and click method:
> * it took 20 sec to get started
> * then it downloaded at an average rate of 1.4 MB/min
>
> When I download 4 files simultaneously (in parallel) using the click
> method, I get somewhat slower download rate per file, so somewhat less
> than 4 times the data transfer rate I would have gotten downloading
> them in series.
>
> Note that at 1 MB/min, I could download 1 GB in about 17 hours or 1 TB
> (i.e., about 1/1000 of the entire archive) in about 2 years.
>
> Any way to speed this up some? (A colleague here downloads files at
> about 10 times this rate from ECMWF.)
>
> Note that I haven't checked how fast download rates are from nodes
> published to our (PCMDI's) gateway (since they are not yet publicly
> available).
>
> Best regards,
> Karl
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.ucar.edu/pipermail/go-essp-tech/attachments/20110303/ff5b4682/attachment.html
More information about the GO-ESSP-TECH
mailing list