<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
<html>
<head>
<meta content="text/html; charset=ISO-8859-1"
http-equiv="Content-Type">
</head>
<body bgcolor="#ffffff" text="#000000">
<br>
<br>
<meta content="text/html; charset=ISO-8859-1"
http-equiv="Content-Type">
Dear all,<br>
<br>
<font face="Times New Roman">I must apologize that I lost a decimal
place in reporting the download rates yesterday (trying to do too
many things at the same time). <br>
<br>
We're in much better shape than I reported: download rates of
about *10* MB/min (not 1 MB/min), with a TB taking perhaps 70 days
in 1 stream.<br>
<br>
What Estani reported (2 TB in 14 hours in 7 parallel streams) is
about 35 times faster per stream. <br>
<br>
It would be nice to close this gap across the Atlantic. <br>
<br>
Best regards,<br>
Karl<br>
<br>
<br>
<br>
<br>
</font> On 3/2/11 4:43 PM, Karl Taylor wrote:
<blockquote cite="mid:4D6EE43E.3090200@llnl.gov" type="cite">
<meta http-equiv="content-type" content="text/html;
charset=ISO-8859-1">
<font face="Times New Roman">Hi all,</font><font face="Times New
Roman"><br>
<br>
When I download a 25 MB CMIP5 file from BADC using the wget
method:<br>
* it took 35 sec to get started<br>
* then it downloaded at an average rate of 1.1 MB/min<br>
<br>
When I download the same file using the point and click method:<br>
* it took 20 sec to get started<br>
* then it downloaded at an average rate of 1.4 MB/min<br>
<br>
When I download 4 files simultaneously (in parallel) using the
click method, I get somewhat slower download rate per file, so
somewhat less than 4 times the data transfer rate I would have
gotten downloading them in series.<br>
<br>
Note that at 1 MB/min, I could download 1 GB in about 17 hours
or 1 TB (i.e., about 1/1000 of the entire archive) in about 2
years. <br>
<br>
Any way to speed this up some? (A colleague here downloads
files at about 10 times this rate from ECMWF.)<br>
<br>
</font><font face="Times New Roman">Note that I haven't checked
how fast download rates are from nodes published to our
(PCMDI's) gateway (since they are not yet publicly available).</font><br>
<font face="Times New Roman"><br>
Best regards,<br>
Karl<br>
<br>
<br>
</font> </blockquote>
</body>
</html>