<html>
<head>
<meta content="text/html; charset=windows-1252"
http-equiv="Content-Type">
</head>
<body bgcolor="#FFFFFF" text="#000000">
<font face="Times New Roman">Dear Jennifer and Jean-Yves,<br>
<br>
</font><font face="Times New Roman"> I apologize that there has been
some confusion perpetrated concerning the planned paths for ESG
improvement. For CMIP5 we expect to clear this up by the end of
next week when we will post a clear statement outlining our
plans. </font><br>
<br>
Thanks again for providing feedback that will improve the system.<br>
<br>
Best regards,<br>
Karl<br>
<br>
On 12/7/11 9:10 AM, Jennifer Adams wrote:
<blockquote
cite="mid:96CBED54-9903-467F-8B87-88FBA5B8FD0A@cola.iges.org"
type="cite">Thank you, Karl, for a very helpful straight answer.
One thing I don't understand: Eric Neinhouse's statement that
'getting Gateway 2.0 in production at NCAR is a top priority'
seems to be in direct conflict with what you wrote. Will Gateway
2.0 be for non-CMIP5 ESG datasets, or are NCAR and PCMDI taking
different approaches?
<div>--Jennifer<br>
<div><br>
<div>
<div>On Dec 7, 2011, at 11:29 AM, Karl Taylor wrote:</div>
<br class="Apple-interchange-newline">
<blockquote type="cite">
<meta content="text/html; charset=windows-1252"
http-equiv="Content-Type">
<div bgcolor="#FFFFFF" text="#000000"> <font face="Times
New Roman">Dear Jennifer,<br>
<br>
Thank you for your valuable input on how to improve
the search and scripting capabilities of both the ESG
Gateway 2.0 and the ESGF P2P system. <br>
<br>
Before you spend too much time attempting to optimize
your download of CMIP5 data, you should know that we
are very unlikely to actually make Gateway 2.0
operational for CMIP5 model output. Instead we will
move directly to P2P. We believe that with currently
available resources PCMDI and the ESG federation
cannot support two new systems. Instead we will keep
our current operational system running and bring on
line the P2P. The testing phase of this should happen
by the end of the month. At some point the currently
operational system will be turned off and the P2P will
become operational. Therefore, if as a CMIP5 user you
plan to further explore the new systems, I suggest
your time might be best spent focusing on P2P.<br>
<br>
P2P and Gateway 2.0 may have similar capabilities at
this time, and both are substantially improved over
previous versions of the Gateway, but we're convinced
that P2P provides a more robust and flexible framework
for adding future improvements. By going directly to
P2P, we'll also minimize the inconvenience for users
already on the system.<br>
<br>
Please let me know if you have any concerns about our
plans. We realize the current system continues to be
more difficult to use than it should be, so your
feedback and suggestions are invaluable. Our focus
is on getting the improvements offered by P2P in place
as soon as possible. I will let you know if our
planned path to a better ESGF delivery system for
CMIP5 data changes. Please feel free to write me
directly at <a moz-do-not-send="true"
class="moz-txt-link-abbreviated"
href="mailto:taylor13@llnl.gov">taylor13@llnl.gov</a><br>
<br>
best regards,<br>
Karl<br>
</font><br>
On 12/7/11 6:14 AM, Jennifer Adams wrote:
<blockquote
cite="mid:7C04F525-7B38-4C29-B3DF-4B843DEFA993@cola.iges.org"
type="cite">
<div>Dear Colleagues,</div>
<div>Here is more feedback on the prototype of Gateway
2.0. My current use case is searching with a fixed
experiment, realm, frequency, and a selected subset
of variables. I'm delighted that you can select more
than one variable and it will keep adding them to
the list of selected results. THANK YOU for listing
the variables alphabetically by short name
("Variable Name"); the listing by long name ("CF
Variable") is not useful to me, it is not
alphabetized, and some names are so long they wrap
so it looks like there are three variables called
"Flux in the Atmosphere", "Due to Natural", and
"Sources". Oops, my bad, it's actually "Surface
Carbon Mass Flux into the Atmosphere Due to Natural
Sources". Heh. QED. </div>
<div><br>
</div>
<div>When I'm done clicking on all my desired
constraints, I get a URL that looks like this :</div>
<div><a moz-do-not-send="true"
href="http://search-esg.prototype.ucar.edu/search?Type=Dataset&Experiment=decadal1960&Frequency=mon&Realm=atmos&Variable+Name=clt&Variable+Name=prw">http://search-esg.prototype.ucar.edu/search?Type=Dataset&Experiment=decadal1960&Frequency=mon&Realm=atmos&Variable+Name=clt&Variable+Name=prw</a></div>
<div>That is great, because it means I can take a
short cut from all the mouse clicking by building a
URL that will create my desired collection. </div>
<div><br>
</div>
<div>I am happy with the search results, so I click on
the "Download Selected" button, and get a wget
script called "script.wget". </div>
<div><br>
</div>
<div>1. It would be great if you could give the script
a name that reflects the search constraints used to
build that script -- something like</div>
<div> wget.cmip5.decadal1960.mon.atmos.clt+prw.sh</div>
<div>Every time I download a new wget script, I have
to rename it to something meaningful (such as the
above) because the very next search result will
overwrite script.wget, or give me "script(1).wget"
instead, and I'll have no simple way to know what
data set that wget script is configured to bring
back. Can you PLEASE give the wget script a relevant
name for me so I can skip this time-consuming step?</div>
<div><br>
</div>
<div>2. Is there a way to use our favorite tool (wget)
or curl to download the wget script so I can bypass
the Gateway 2.0 browser interface altogether? My
guess is the answer is no, because of the elaborate
login process with OpenID and username/password, but
it's worth asking… </div>
<div><br>
</div>
<div>-----------</div>
<div><br>
</div>
<div>As an alternative, I have looked carefully at the
wiki page (and its embedded links) on automated
generation of wget scripts, <a
moz-do-not-send="true"
href="http://www.esgf.org/wiki/ESGF_scripting">http://www.esgf.org/wiki/ESGF_scripting</a>.
This is very promising, and Luca assures me that the
P2P service will be working in a matter of weeks. </div>
<div><br>
</div>
<div>I think the syntax of the URL for the same search
as my example above would be:</div>
<div><a moz-do-not-send="true"
href="http://esg-datanode.jpl.nasa.gov/esg-search/wget?experiment=decadal1960&realm=atmos&time_frequency=month&variable=clt,prw">http://esg-datanode.jpl.nasa.gov/esg-search/wget?experiment=decadal1960&realm=atmos&time_frequency=month&variable=clt,prw</a></div>
<div><br>
</div>
<div>1. Is the comma-delimited list of desired
variables legitimate syntax? </div>
<div>2. Will it work the way the Gateway 2.0 does to
deliver my subset of variables? </div>
<div>3. Will "<a moz-do-not-send="true"
href="http://esg-datanode.jpl.nasa.gov/">http://esg-datanode.jpl.nasa.gov</a>"
be the only location providing this service? </div>
<div>4. Will the delivered wget script use
certificates and checksums?</div>
<div><br>
</div>
<div>Since this isn't fully operational at the moment,
I can't say for sure whether this will be the better
route for reaching my goal of acquiring CMIP5 data
using only scripts and no browser. </div>
<div><br>
</div>
<div>Respectfully submitted,</div>
<div>Jennifer</div>
<div><br>
</div>
<div><br>
</div>
<div><br>
</div>
<div><br>
<div apple-content-edited="true">
<div style="font-size: 12px; ">--</div>
<div style="font-size: 12px; ">Jennifer M. Adams</div>
<div style="font-size: 12px; ">IGES/COLA</div>
<div style="font-size: 12px; ">4041 Powder Mill
Road, Suite 302</div>
<div style="font-size: 12px; ">Calverton, MD 20705</div>
<div style="font-size: 12px; "><a
moz-do-not-send="true"
href="mailto:jma@cola.iges.org">jma@cola.iges.org</a></div>
<div style="font-size: 12px; "><br
class="khtml-block-placeholder">
</div>
<span class="Apple-style-span" style="font-size:
12px; "><br class="Apple-interchange-newline">
</span> </div>
<br>
</div>
</blockquote>
</div>
</blockquote>
</div>
<br>
<div apple-content-edited="true">
<span class="Apple-style-span" style="border-collapse:
separate; border-spacing: 0px 0px; color: rgb(0, 0, 0);
font-family: Helvetica; font-size: 12px; font-style:
normal; font-variant: normal; font-weight: normal;
letter-spacing: normal; line-height: normal; text-align:
auto; -khtml-text-decorations-in-effect: none;
text-indent: 0px; -apple-text-size-adjust: auto;
text-transform: none; orphans: 2; white-space: normal;
widows: 2; word-spacing: 0px; "><span
class="Apple-style-span" style="border-collapse:
separate; border-spacing: 0px 0px; color: rgb(0, 0, 0);
font-family: Helvetica; font-size: 12px; font-style:
normal; font-variant: normal; font-weight: normal;
letter-spacing: normal; line-height: normal; text-align:
auto; -khtml-text-decorations-in-effect: none;
text-indent: 0px; -apple-text-size-adjust: auto;
text-transform: none; orphans: 2; white-space: normal;
widows: 2; word-spacing: 0px; "><span
class="Apple-style-span" style="border-collapse:
separate; border-spacing: 0px 0px; color: rgb(0, 0,
0); font-family: Helvetica; font-size: 12px;
font-style: normal; font-variant: normal; font-weight:
normal; letter-spacing: normal; line-height: normal;
text-align: auto; -khtml-text-decorations-in-effect:
none; text-indent: 0px; -apple-text-size-adjust: auto;
text-transform: none; orphans: 2; white-space: normal;
widows: 2; word-spacing: 0px; ">
<div>--</div>
<div>Jennifer M. Adams</div>
<div>IGES/COLA</div>
<div>4041 Powder Mill Road, Suite 302</div>
<div>Calverton, MD 20705</div>
<div><a moz-do-not-send="true"
href="mailto:jma@cola.iges.org">jma@cola.iges.org</a></div>
<div><br class="khtml-block-placeholder">
</div>
<br class="Apple-interchange-newline">
</span></span></span>
</div>
<br>
</div>
</div>
</blockquote>
</body>
</html>