<html>
<head>
<meta content="text/html; charset=windows-1252"
http-equiv="Content-Type">
</head>
<body bgcolor="#FFFFFF" text="#000000">
<font face="Times New Roman">Dear Jennifer,<br>
<br>
Thank you for your valuable input on how to improve the search and
scripting capabilities of both the ESG Gateway 2.0 and the ESGF
P2P system. <br>
<br>
Before you spend too much time attempting to optimize your
download of CMIP5 data, you should know that we are very unlikely
to actually make Gateway 2.0 operational for CMIP5 model output.
Instead we will move directly to P2P. We believe that with
currently available resources PCMDI and the ESG federation cannot
support two new systems. Instead we will keep our current
operational system running and bring on line the P2P. The testing
phase of this should happen by the end of the month. At some
point the currently operational system will be turned off and the
P2P will become operational. Therefore, if as a CMIP5 user you
plan to further explore the new systems, I suggest your time might
be best spent focusing on P2P.<br>
<br>
P2P and Gateway 2.0 may have similar capabilities at this time,
and both are substantially improved over previous versions of the
Gateway, but we're convinced that P2P provides a more robust and
flexible framework for adding future improvements. By going
directly to P2P, we'll also minimize the inconvenience for users
already on the system.<br>
<br>
Please let me know if you have any concerns about our plans. We
realize the current system continues to be more difficult to use
than it should be, so your feedback and suggestions are
invaluable. Our focus is on getting the improvements offered by
P2P in place as soon as possible. I will let you know if our
planned path to a better ESGF delivery system for CMIP5 data
changes. Please feel free to write me directly at
<a class="moz-txt-link-abbreviated" href="mailto:taylor13@llnl.gov">taylor13@llnl.gov</a><br>
<br>
best regards,<br>
Karl<br>
</font><br>
On 12/7/11 6:14 AM, Jennifer Adams wrote:
<blockquote
cite="mid:7C04F525-7B38-4C29-B3DF-4B843DEFA993@cola.iges.org"
type="cite">
<div>Dear Colleagues,</div>
<div>Here is more feedback on the prototype of Gateway 2.0. My
current use case is searching with a fixed experiment, realm,
frequency, and a selected subset of variables. I'm delighted
that you can select more than one variable and it will keep
adding them to the list of selected results. THANK YOU for
listing the variables alphabetically by short name ("Variable
Name"); the listing by long name ("CF Variable") is not useful
to me, it is not alphabetized, and some names are so long they
wrap so it looks like there are three variables called "Flux in
the Atmosphere", "Due to Natural", and "Sources". Oops, my bad,
it's actually "Surface Carbon Mass Flux into the Atmosphere Due
to Natural Sources". Heh. QED. </div>
<div><br>
</div>
<div>When I'm done clicking on all my desired constraints, I get a
URL that looks like this :</div>
<div><a moz-do-not-send="true"
href="http://search-esg.prototype.ucar.edu/search?Type=Dataset&Experiment=decadal1960&Frequency=mon&Realm=atmos&Variable+Name=clt&Variable+Name=prw">http://search-esg.prototype.ucar.edu/search?Type=Dataset&Experiment=decadal1960&Frequency=mon&Realm=atmos&Variable+Name=clt&Variable+Name=prw</a></div>
<div>That is great, because it means I can take a short cut from
all the mouse clicking by building a URL that will create my
desired collection. </div>
<div><br>
</div>
<div>I am happy with the search results, so I click on the
"Download Selected" button, and get a wget script called
"script.wget". </div>
<div><br>
</div>
<div>1. It would be great if you could give the script a name that
reflects the search constraints used to build that script --
something like</div>
<div> wget.cmip5.decadal1960.mon.atmos.clt+prw.sh</div>
<div>Every time I download a new wget script, I have to rename it
to something meaningful (such as the above) because the very
next search result will overwrite script.wget, or give me
"script(1).wget" instead, and I'll have no simple way to know
what data set that wget script is configured to bring back. Can
you PLEASE give the wget script a relevant name for me so I can
skip this time-consuming step?</div>
<div><br>
</div>
<div>2. Is there a way to use our favorite tool (wget) or curl to
download the wget script so I can bypass the Gateway 2.0 browser
interface altogether? My guess is the answer is no, because of
the elaborate login process with OpenID and username/password,
but it's worth asking… </div>
<div><br>
</div>
<div>-----------</div>
<div><br>
</div>
<div>As an alternative, I have looked carefully at the wiki page
(and its embedded links) on automated generation of wget
scripts, <a moz-do-not-send="true"
href="http://www.esgf.org/wiki/ESGF_scripting">http://www.esgf.org/wiki/ESGF_scripting</a>.
This is very promising, and Luca assures me that the P2P service
will be working in a matter of weeks. </div>
<div><br>
</div>
<div>I think the syntax of the URL for the same search as my
example above would be:</div>
<div><a moz-do-not-send="true"
href="http://esg-datanode.jpl.nasa.gov/esg-search/wget?experiment=decadal1960&realm=atmos&time_frequency=month&variable=clt,prw">http://esg-datanode.jpl.nasa.gov/esg-search/wget?experiment=decadal1960&realm=atmos&time_frequency=month&variable=clt,prw</a></div>
<div><br>
</div>
<div>1. Is the comma-delimited list of desired variables
legitimate syntax? </div>
<div>2. Will it work the way the Gateway 2.0 does to deliver my
subset of variables? </div>
<div>3. Will "<a moz-do-not-send="true"
href="http://esg-datanode.jpl.nasa.gov">http://esg-datanode.jpl.nasa.gov</a>"
be the only location providing this service? </div>
<div>4. Will the delivered wget script use certificates and
checksums?</div>
<div><br>
</div>
<div>Since this isn't fully operational at the moment, I can't say
for sure whether this will be the better route for reaching my
goal of acquiring CMIP5 data using only scripts and no browser. </div>
<div><br>
</div>
<div>Respectfully submitted,</div>
<div>Jennifer</div>
<div><br>
</div>
<div><br>
</div>
<div><br>
</div>
<div><br>
<div apple-content-edited="true">
<div style="font-size: 12px; ">--</div>
<div style="font-size: 12px; ">Jennifer M. Adams</div>
<div style="font-size: 12px; ">IGES/COLA</div>
<div style="font-size: 12px; ">4041 Powder Mill Road, Suite
302</div>
<div style="font-size: 12px; ">Calverton, MD 20705</div>
<div style="font-size: 12px; "><a moz-do-not-send="true"
href="mailto:jma@cola.iges.org">jma@cola.iges.org</a></div>
<div style="font-size: 12px; "><br
class="khtml-block-placeholder">
</div>
<span class="Apple-style-span" style="font-size: 12px; "><br
class="Apple-interchange-newline">
</span>
</div>
<br>
</div>
</blockquote>
</body>
</html>