[Go-essp-tech] download rates

[Karl Taylor]

this should have been sent to go-essp-tech at ucar.edu

sorry about that.

Karl

-------- Original Message --------
Subject: 	download rates
Date: 	Wed, 2 Mar 2011 16:43:42 -0800
From: 	Karl Taylor <taylor13 at llnl.gov>
To: 	esg-support at earthsystemgrid.org Grid <esg-support at earthsystemgrid.org>



Hi all,

When I download a 25 MB CMIP5 file from BADC using the wget method:
* it took 35 sec to get started
* then it downloaded at an average rate of 1.1 MB/min

When I download the same file using the point and click method:
* it took 20 sec to get started
* then it downloaded at an average rate of 1.4 MB/min

When I download 4 files simultaneously (in parallel) using the click 
method, I get somewhat slower download rate per file, so somewhat less 
than 4 times the data transfer rate I would have gotten downloading them 
in series.

Note that at 1 MB/min, I could download 1 GB in about 17 hours or 1 TB 
(i.e., about 1/1000 of the entire archive) in about 2 years.

Any way to speed this up some?  (A colleague here downloads files at 
about 10 times this rate from ECMWF.)

Note that I haven't checked how fast download rates are from nodes 
published to our (PCMDI's) gateway (since they are not yet publicly 
available).

Best regards,
Karl


-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.ucar.edu/pipermail/go-essp-tech/attachments/20110302/ca37adce/attachment.html