<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
<html>
  <head>
    <meta content="text/html; charset=ISO-8859-1"
      http-equiv="Content-Type">
  </head>
  <body bgcolor="#ffffff" text="#000000">
    Hi Mehmet,<br>
    <br>
    as of yesterday some datasets (being rcp85's some of them) were
    still not published to the gateway, that's why you can't download
    them.<br>
    <br>
    What cmip3 data has NERSC? In which structure (i.e. original,
    cmor-DRS or new DRS)?<br>
    <br>
    We replicated everything BADC has which is 90% of the PCMDI's cmip3
    archive in cmor-DRS structure. I don't want to publish it until I
    know what BADC is going to do regarding this. I hope they will be
    employing the drslib util to rearrange the files in the new DRS
    structure and replubish them (is this feasible?). So that I'll do
    the same here at DKRZ and we could use the replication tool to
    publish a "real" replica and allow users to easily choose among
    them.<br>
    <br>
    I think, related to everything I was telling before on replicas,
    that we are still missing the functionality for the end user to
    download from multiple replicas at the same time. This will speed up
    transfers considerably. I don't think this will be difficult to
    accomplish, but I'm not sure. And again, I'm thinking plainly on a
    queue of files and one consumer per replica-gateway, nothing finer
    than that.<br>
    <br>
    <br>
    Thanks,<br>
    Estani<br>
    <br>
    Am 03.03.2011 23:25, schrieb Mehmet Balman:
    <blockquote cite="mid:4D701547.8040607@lbl.gov" type="cite">
      <meta content="text/html; charset=ISO-8859-1"
        http-equiv="Content-Type">
      Hi Estani, <br>
      <br>
      I also see some problems while trying to replicate cmip5 data from
      BADC. Some files gave authorization problems (403), some are
      listed in thredds but they do not exist. <br>
      <br>
      For example, can you access this file?<br>
      <font face="Courier New, Courier, monospace"><a
          moz-do-not-send="true" class="moz-txt-link-freetext"
href="http://cmip-dn.badc.rl.ac.uk/thredds/fileServer/esg_dataroot/cmip5/output1/MOHC/HadGEM2-ES/rcp85/day/atmos/day/r1i1p1/v20110127/prc/prc_day_HadGEM2-ES_rcp85_r1i1p1_20301201-20351130.nc">http://cmip-dn.badc.rl.ac.uk/thredds/fileServer/esg_dataroot/cmip5/output1/MOHC/HadGEM2-ES/rcp85/day/atmos/day/r1i1p1/v20110127/prc/prc_day_HadGEM2-ES_rcp85_r1i1p1_20301201-20351130.nc</a></font><br>
      <br>
      I just parse everything from the thredds catalog. Here is how I am
      getting files (see the script below for 12 streams). How do you
      use wget?<br>
      <br>
      If anybody wants to try gridftp downloads, nersc has cmip3 data
      published with gridftp and http urls.<br>
      <br>
      <br>
      <font face="Courier New, Courier, monospace">wget -nv <a
          moz-do-not-send="true" class="moz-txt-link-freetext"
          href="http://cmip-dn.badc.rl.ac.uk/thredds/esgcet/catalog.html">http://cmip-dn.badc.rl.ac.uk/thredds/esgcet/catalog.html</a>
        -O- | grep output1 | awk 'BEGIN{FS="="}{print $4}'| sed&nbsp; "s/'/
        /g"|awk '{print <a moz-do-not-send="true"
          class="moz-txt-link-rfc2396E"
          href="http://cmip-dn.badc.rl.ac.uk/thredds/esgcet/">"http://cmip-dn.badc.rl.ac.uk/thredds/esgcet/"</a>
        $1}'| xargs -P 12 -r -n 1 wget -nv -r --level 2
        --certificate=/tmp/x509up_u48731
        --private-key=/tmp/x509up_u48731
        --ca-directory=~/.globus/certificates --save-cookies=cookie
        --load-cookies=cookie</font><br>
      <br>
      <br>
      &nbsp;<br>
      <br>
      <br>
      <br>
      On 03/03/2011 09:38 AM, Estanislao Gonzalez wrote:
      <blockquote cite="mid:4D6FD21C.1020808@zmaw.de" type="cite">
        <meta content="text/html; charset=ISO-8859-1"
          http-equiv="Content-Type">
        Indeed it will Rachana.<br>
        <br>
        I'm just performing a test (or was, as it's not working anymore
        after 3TB... because of some technical difficulties :-) to see
        how good/bad this is. And it was not bad at all (while it
        worked).<br>
        <br>
        I had quite some problems with guc too, so I'm just trying
        different possibilities out.<br>
        <br>
        And I see the SSL double redirection now, nice :-)<br>
        <br>
        I think Stephen is already at that anyway, there were some
        minimal problems with the publication.<br>
        <br>
        And a single wget connection is now running at 12MB/s.<br>
        <br>
        Thanks,<br>
        Estani<br>
        <br>
        Am 03.03.2011 18:26, schrieb Rachana Ananthakrishnan:
        <blockquote
          cite="mid:4D504901-4980-4472-87E9-1C09FCCBDA48@mcs.anl.gov"
          type="cite"><br>
          <div>
            <div>On Mar 3, 2011, at 11:23 AM, Estanislao Gonzalez wrote:</div>
            <br class="Apple-interchange-newline">
            <blockquote type="cite">
              <div bgcolor="#ffffff" text="#000000"> Hi Rachana,<br>
                <br>
                yes the the only data that can be downloaded at the
                moment is the one published at BADC and is http only...
                <br>
                well actually that I think it again, if the user sends a
                certificate it means it got redirected to an SSL end
                point, right? Is he then redirected back to the original
                or is the connection being made via SSL? I'm not sure
                now...<br>
                <br>
              </div>
            </blockquote>
            <div><br>
            </div>
            Data is download via HTTP, the redirection to SSL is to
            verify identity of the user with certificates.&nbsp;</div>
          <div><br>
          </div>
          <div>I am reaching out to the various site administrators to
            understand barriers for providing a GridFTP servers for
            this. It appears to me that your experiment of replicating
            TBs of data would benefit from a system that is built with
            such use cases as focus.&nbsp;</div>
          <div><br>
          </div>
          <div>Thanks,</div>
          <div>Rachana</div>
          <div><br>
          </div>
          <div>
            <blockquote type="cite">
              <div bgcolor="#ffffff" text="#000000"> Thanks,<br>
                Estani<br>
                <br>
                Am 03.03.2011 17:52, schrieb Rachana Ananthakrishnan:
                <blockquote
                  cite="mid:0153FEE9-2276-4047-A134-9FFCF7C6723F@mcs.anl.gov"
                  type="cite">Estani,
                  <div><br>
                  </div>
                  <div>Are all these numbers using a HTTP based
                    download?</div>
                  <div><br>
                  </div>
                  <div>Rachana</div>
                  <div><br>
                  </div>
                  <div>
                    <div>
                      <div>On Mar 3, 2011, at 5:13 AM, Estanislao
                        Gonzalez wrote:</div>
                      <br class="Apple-interchange-newline">
                      <blockquote type="cite">
                        <div bgcolor="#ffffff" text="#000000"> Hi,<br>
                          <br>
                          by Michael suggestion I started a page in the
                          <a moz-do-not-send="true"
                            href="http://esgf.org/">esgf.org</a> wiki
                          were we could write our measurement regarding
                          CMIP5 federation.<br>
                          It is not intended for the technical staff, so
                          don't complain about it being too simplified
                          :-)<br>
                          On the contrary, it is intended to be a very
                          first and rough approximation to what's
                          happening in the cloud by allowing everyone in
                          5 sec to write a measurement down.<br>
                          <br>
                          Everyone has write access to this and if we
                          see the necessity we could evolve it into
                          something more detailed, but which will
                          certainly leave the lay users outside.<br>
                          <br>
                          And the link:<br>
                          <a moz-do-not-send="true"
                            class="moz-txt-link-freetext"
                            href="http://esgf.org/wiki/Cmip5Status/Datarates">http://esgf.org/wiki/Cmip5Status/Datarates</a><br>
                          <br>
                          Does someone else find this useful? Any
                          comments?<br>
                          <br>
                          Thanks,<br>
                          Estani<br>
                          <br>
                          Am 03.03.2011 09:04, schrieb Estanislao
                          Gonzalez:
                          <blockquote
                            cite="mid:4D6F4B8A.4080509@zmaw.de"
                            type="cite"> Hi Karl,<br>
                            <br>
                            I'm currently testing the replication via
                            wget and got an average of 350 Mbps (around
                            40MB/s) with 7 parallel streams in the last
                            14 hours. I've already downloaded 2TB.<br>
                            <br>
                            So I guess the problem is across the
                            Atlantic. I'd suggest to start many more
                            parallel streams.<br>
                            <br>
                            In any case I think this might be caused by
                            some problems/congestion in intermediate
                            networks. The network throughput to ECMWF
                            *might* not be comparable because of the
                            network architecture, e.g. intermediate
                            proxies, firewalls, etc. But a 10x speed up
                            might be of no use anyway as downloading 1TB
                            in 2 Months seems hardly to be an option...<br>
                            <br>
                            When we all have the data replicated
                            worldwide though, it will be possible to
                            download from all 3 servers at the same
                            time, which will more than double the speed
                            from this side of the ocean, and will be a
                            considerable speed up from yours, although
                            probably not as much (don't nail me on this,
                            I'll deny it vehemently &lt;- this is not my
                            writing :-)<br>
                            <br>
                            Anyway, this being said, the rest should be
                            answered by BADC directly.<br>
                            <br>
                            Thanks,<br>
                            Estani<br>
                            <br>
                            Am 03.03.2011 02:26, schrieb Karl Taylor:<br>
                            <span style="white-space: pre;">&gt; this<br>
                              should<br>
                              <br>
                              have<br>
                              <br>
                              <br>
                              <br>
                              been sent to<br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <a moz-do-not-send="true"
                                class="moz-txt-link-abbreviated"
                                href="mailto:go-essp-tech@ucar.edu">go-essp-tech@ucar.edu</a><br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              &gt; <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              &gt; sorry about that.<br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              &gt; <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              &gt; Karl<br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              &gt; <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              &gt; -------- Original Message --------<br>
                              <br>
                              Subject:<br>
                              <br>
                              <br>
                              <br>
                              download rates<br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              Date:<br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              &gt; Wed, 2 Mar 2011 16:43:42 -0800 From:<br>
                              Karl<br>
                              <br>
                              Taylor<br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              &gt; <a moz-do-not-send="true"
                                class="moz-txt-link-rfc2396E"
                                href="mailto:taylor13@llnl.gov">&lt;taylor13@llnl.gov&gt;</a><br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              To: <a moz-do-not-send="true"
                                class="moz-txt-link-abbreviated"
                                href="mailto:esg-support@earthsystemgrid.org">esg-support@earthsystemgrid.org</a><br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              Grid<br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              &gt; <a moz-do-not-send="true"
                                class="moz-txt-link-rfc2396E"
                                href="mailto:esg-support@earthsystemgrid.org">&lt;esg-support@earthsystemgrid.org&gt;</a><br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              &gt; <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              &gt; <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              &gt; <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              &gt; Hi all,<br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              &gt; <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              &gt; When I download a 25 MB CMIP5 file
                              from<br>
                              <br>
                              BADC<br>
                              <br>
                              <br>
                              <br>
                              using the wget<br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              method: *<br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              &gt; it took 35 sec to get started * then
                              it<br>
                              <br>
                              <br>
                              <br>
                              downloaded at an<br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              average rate<br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              &gt; of 1.1 MB/min<br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              &gt; <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              &gt; When I download the same file using
                              the<br>
                              <br>
                              point and<br>
                              <br>
                              <br>
                              <br>
                              click<br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              method: * it<br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              &gt; took 20 sec to get started * then it<br>
                              <br>
                              downloaded<br>
                              <br>
                              <br>
                              <br>
                              at an<br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              average<br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              rate of<br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              &gt; 1.4 MB/min<br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              &gt; <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              &gt; When I download 4 files
                              simultaneously<br>
                              <br>
                              (in<br>
                              <br>
                              <br>
                              <br>
                              parallel) using<br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              the click<br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              &gt; method, I get somewhat slower
                              download<br>
                              <br>
                              rate per<br>
                              <br>
                              <br>
                              <br>
                              file, so<br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              somewhat<br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              &gt; less than 4 times the data transfer<br>
                              rate<br>
                              <br>
                              I would<br>
                              <br>
                              <br>
                              <br>
                              have<br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              gotten<br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              &gt; downloading them in series.<br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              &gt; <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              &gt; Note that at 1 MB/min, I could
                              download<br>
                              1<br>
                              <br>
                              GB in<br>
                              <br>
                              <br>
                              <br>
                              about 17<br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              hours or 1<br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              &gt; TB (i.e., about 1/1000 of the entire<br>
                              <br>
                              archive) in<br>
                              <br>
                              <br>
                              <br>
                              about 2<br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              years.<br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              &gt; <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              &gt; Any way to speed this up some? (A<br>
                              <br>
                              colleague here<br>
                              <br>
                              <br>
                              <br>
                              downloads<br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              files at<br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              &gt; about 10 times this rate from ECMWF.)<br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              &gt; <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              &gt; Note that I haven't checked how fast<br>
                              <br>
                              download<br>
                              <br>
                              <br>
                              <br>
                              rates are<br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              from<br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              nodes<br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              &gt; published to our (PCMDI's) gateway<br>
                              (since<br>
                              <br>
                              they<br>
                              <br>
                              <br>
                              <br>
                              are not yet<br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              publicly<br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              &gt; available).<br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              &gt; <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              &gt; Best regards, Karl<br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              &gt; <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              &gt; <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              &gt; <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              &gt; <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              &gt;<br>
                              <br>
_______________________________________________<br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              GO-ESSP-TECH<br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              mailing<br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              &gt; list <a moz-do-not-send="true"
                                class="moz-txt-link-abbreviated"
                                href="mailto:GO-ESSP-TECH@ucar.edu">GO-ESSP-TECH@ucar.edu</a><br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              <br>
                              &gt; <a moz-do-not-send="true"
                                class="moz-txt-link-freetext"
                                href="http://mailman.ucar.edu/mailman/listinfo/go-essp-tech">http://mailman.ucar.edu/mailman/listinfo/go-essp-tech</a></span><br>
                            <br>
                            <br>
                            -- <br>
                            Estanislao Gonzalez<br>
                            <br>
                            Max-Planck-Institut f&uuml;r Meteorologie (MPI-M)<br>
                            Deutsches Klimarechenzentrum (DKRZ) - German
                            Climate Computing Centre<br>
                            Room 108 - Bundesstrasse 45a, D-20146
                            Hamburg, Germany<br>
                            <br>
                            Phone:&nbsp;&nbsp; +49 (40) 46 00 94-126<br>
                            E-Mail:&nbsp; <a moz-do-not-send="true"
                              class="moz-txt-link-abbreviated"
                              href="mailto:estanislao.gonzalez@zmaw.de">estanislao.gonzalez@zmaw.de</a>
                            <br>
                          </blockquote>
                          <br>
                          <br>
                          <pre class="moz-signature" cols="72">-- 
Estanislao Gonzalez

Max-Planck-Institut f&uuml;r Meteorologie (MPI-M)
Deutsches Klimarechenzentrum (DKRZ) - German Climate Computing Centre
Room 108 - Bundesstrasse 45a, D-20146 Hamburg, Germany

Phone:   +49 (40) 46 00 94-126
E-Mail:  <a moz-do-not-send="true" class="moz-txt-link-abbreviated" href="mailto:estanislao.gonzalez@zmaw.de">estanislao.gonzalez@zmaw.de</a> </pre>
                        </div>
                        _______________________________________________<br>
                        GO-ESSP-TECH mailing list<br>
                        <a moz-do-not-send="true"
                          href="mailto:GO-ESSP-TECH@ucar.edu">GO-ESSP-TECH@ucar.edu</a><br>
                        <a moz-do-not-send="true"
                          class="moz-txt-link-freetext"
                          href="http://mailman.ucar.edu/mailman/listinfo/go-essp-tech">http://mailman.ucar.edu/mailman/listinfo/go-essp-tech</a><br>
                      </blockquote>
                    </div>
                    <br>
                    <div> <span class="Apple-style-span"
                        style="border-collapse: separate; font-family:
                        Helvetica; font-style: normal; font-variant:
                        normal; font-weight: normal; letter-spacing:
                        normal; line-height: normal; orphans: 2;
                        text-indent: 0px; text-transform: none;
                        white-space: normal; widows: 2; word-spacing:
                        0px; font-size: medium;"><span
                          class="Apple-style-span"
                          style="border-collapse: separate; font-family:
                          Helvetica; font-style: normal; font-variant:
                          normal; font-weight: normal; letter-spacing:
                          normal; line-height: normal; orphans: 2;
                          text-indent: 0px; text-transform: none;
                          white-space: normal; widows: 2; word-spacing:
                          0px; font-size: medium;">
                          <div style="word-wrap: break-word;"><span
                              class="Apple-style-span"
                              style="border-collapse: separate;
                              font-family: Helvetica; font-style:
                              normal; font-variant: normal; font-weight:
                              normal; letter-spacing: normal;
                              line-height: normal; orphans: 2;
                              text-indent: 0px; text-transform: none;
                              white-space: normal; widows: 2;
                              word-spacing: 0px; font-size: medium;">
                              <div style="word-wrap: break-word;"><span
                                  class="Apple-style-span"
                                  style="border-collapse: separate;
                                  font-family: Helvetica; font-size:
                                  medium; font-style: normal;
                                  font-variant: normal; font-weight:
                                  normal; letter-spacing: normal;
                                  line-height: normal; orphans: 2;
                                  text-indent: 0px; text-transform:
                                  none; white-space: normal; widows: 2;
                                  word-spacing: 0px;">
                                  <div style="word-wrap: break-word;">
                                    <div>Rachana Ananthakrishnan</div>
                                    <div>Argonne National Lab |
                                      University of Chicago</div>
                                  </div>
                                </span></div>
                            </span></div>
                        </span></span> </div>
                    <br>
                  </div>
                </blockquote>
                <br>
                <br>
                <pre class="moz-signature" cols="72">-- 
Estanislao Gonzalez

Max-Planck-Institut f&uuml;r Meteorologie (MPI-M)
Deutsches Klimarechenzentrum (DKRZ) - German Climate Computing Centre
Room 108 - Bundesstrasse 45a, D-20146 Hamburg, Germany

Phone:   +49 (40) 46 00 94-126
E-Mail:  <a moz-do-not-send="true" class="moz-txt-link-abbreviated" href="mailto:estanislao.gonzalez@zmaw.de">estanislao.gonzalez@zmaw.de</a> </pre>
              </div>
            </blockquote>
          </div>
          <br>
          <div> <span class="Apple-style-span" style="border-collapse:
              separate; color: rgb(0, 0, 0); font-family: Helvetica;
              font-style: normal; font-variant: normal; font-weight:
              normal; letter-spacing: normal; line-height: normal;
              orphans: 2; text-indent: 0px; text-transform: none;
              white-space: normal; widows: 2; word-spacing: 0px;
              font-size: medium;"><span class="Apple-style-span"
                style="border-collapse: separate; color: rgb(0, 0, 0);
                font-family: Helvetica; font-style: normal;
                font-variant: normal; font-weight: normal;
                letter-spacing: normal; line-height: normal; orphans: 2;
                text-indent: 0px; text-transform: none; white-space:
                normal; widows: 2; word-spacing: 0px; font-size:
                medium;">
                <div style="word-wrap: break-word;"><span
                    class="Apple-style-span" style="border-collapse:
                    separate; color: rgb(0, 0, 0); font-family:
                    Helvetica; font-style: normal; font-variant: normal;
                    font-weight: normal; letter-spacing: normal;
                    line-height: normal; orphans: 2; text-indent: 0px;
                    text-transform: none; white-space: normal; widows:
                    2; word-spacing: 0px; font-size: medium;">
                    <div style="word-wrap: break-word;"><span
                        class="Apple-style-span" style="border-collapse:
                        separate; color: rgb(0, 0, 0); font-family:
                        Helvetica; font-size: medium; font-style:
                        normal; font-variant: normal; font-weight:
                        normal; letter-spacing: normal; line-height:
                        normal; orphans: 2; text-indent: 0px;
                        text-transform: none; white-space: normal;
                        widows: 2; word-spacing: 0px;">
                        <div style="word-wrap: break-word;">
                          <div>Rachana Ananthakrishnan</div>
                          <div>Argonne National Lab | University of
                            Chicago</div>
                        </div>
                      </span></div>
                  </span></div>
              </span></span> </div>
          <br>
        </blockquote>
        <br>
        <br>
        <pre class="moz-signature" cols="72">-- 
Estanislao Gonzalez

Max-Planck-Institut f&uuml;r Meteorologie (MPI-M)
Deutsches Klimarechenzentrum (DKRZ) - German Climate Computing Centre
Room 108 - Bundesstrasse 45a, D-20146 Hamburg, Germany

Phone:   +49 (40) 46 00 94-126
E-Mail:  <a moz-do-not-send="true" class="moz-txt-link-abbreviated" href="mailto:estanislao.gonzalez@zmaw.de">estanislao.gonzalez@zmaw.de</a> </pre>
        <pre wrap=""><fieldset class="mimeAttachmentHeader"></fieldset>
_______________________________________________
GO-ESSP-TECH mailing list
<a moz-do-not-send="true" class="moz-txt-link-abbreviated" href="mailto:GO-ESSP-TECH@ucar.edu">GO-ESSP-TECH@ucar.edu</a>
<a moz-do-not-send="true" class="moz-txt-link-freetext" href="http://mailman.ucar.edu/mailman/listinfo/go-essp-tech">http://mailman.ucar.edu/mailman/listinfo/go-essp-tech</a>
</pre>
      </blockquote>
      <br>
    </blockquote>
    <br>
    <br>
    <pre class="moz-signature" cols="72">-- 
Estanislao Gonzalez

Max-Planck-Institut f&uuml;r Meteorologie (MPI-M)
Deutsches Klimarechenzentrum (DKRZ) - German Climate Computing Centre
Room 108 - Bundesstrasse 45a, D-20146 Hamburg, Germany

Phone:   +49 (40) 46 00 94-126
E-Mail:  <a class="moz-txt-link-abbreviated" href="mailto:estanislao.gonzalez@zmaw.de">estanislao.gonzalez@zmaw.de</a> </pre>
  </body>
</html>