[Go-essp-tech] CORRECTION: Fwd: Re: download rates

[Karl Taylor]

Dear all,

I must apologize that I lost a decimal place in reporting the download 
rates yesterday (trying to do too many things at the same time).

We're in much better shape than I reported:  download rates of about 
*10* MB/min (not 1 MB/min), with a TB taking perhaps 70 days in 1 stream.

What Estani reported (2 TB in 14 hours in 7 parallel streams) is about 
35 times faster per stream.

  It would be nice to close this gap across the Atlantic.

Best regards,
Karl




On 3/2/11 4:43 PM, Karl Taylor wrote:
> Hi all,
>
> When I download a 25 MB CMIP5 file from BADC using the wget method:
> * it took 35 sec to get started
> * then it downloaded at an average rate of 1.1 MB/min
>
> When I download the same file using the point and click method:
> * it took 20 sec to get started
> * then it downloaded at an average rate of 1.4 MB/min
>
> When I download 4 files simultaneously (in parallel) using the click 
> method, I get somewhat slower download rate per file, so somewhat less 
> than 4 times the data transfer rate I would have gotten downloading 
> them in series.
>
> Note that at 1 MB/min, I could download 1 GB in about 17 hours or 1 TB 
> (i.e., about 1/1000 of the entire archive) in about 2 years.
>
> Any way to speed this up some?  (A colleague here downloads files at 
> about 10 times this rate from ECMWF.)
>
> Note that I haven't checked how fast download rates are from nodes 
> published to our (PCMDI's) gateway (since they are not yet publicly 
> available).
>
> Best regards,
> Karl
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.ucar.edu/pipermail/go-essp-tech/attachments/20110303/ff5b4682/attachment.html