<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 12 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
@font-face
{font-family:Consolas;
panose-1:2 11 6 9 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";
color:black;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
pre
{mso-style-priority:99;
mso-style-link:"HTML Preformatted Char";
margin:0cm;
margin-bottom:.0001pt;
font-size:10.0pt;
font-family:"Courier New";
color:black;}
span.HTMLPreformattedChar
{mso-style-name:"HTML Preformatted Char";
mso-style-priority:99;
mso-style-link:"HTML Preformatted";
font-family:Consolas;
color:black;}
span.EmailStyle19
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 72.0pt 72.0pt 72.0pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body bgcolor="white" lang="EN-GB" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Hello Karl,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Some test output from CORDEX was published to demonstrate the functionality and the way in which the additional attributes needed to describe CORDEX data (region,
RCM, etc) are (or are not) propagated through the system – removing it from the BADC gateway is probably a task for Stephen, who is now on leave for Xmas. The data appears under “project=CORDEX” in our gateway. Real data from CORDEX has been imminent for some
time. March/April now looks like a plausible time frame for first deliveries, <o:p>
</o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Cheers,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Martin
<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<div style="border:none;border-left:solid blue 1.5pt;padding:0cm 0cm 0cm 4.0pt">
<div>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0cm 0cm 0cm">
<p class="MsoNormal"><b><span lang="EN-US" style="font-size:10.0pt;font-family:"Tahoma","sans-serif";color:windowtext">From:</span></b><span lang="EN-US" style="font-size:10.0pt;font-family:"Tahoma","sans-serif";color:windowtext"> go-essp-tech-bounces@ucar.edu
[mailto:go-essp-tech-bounces@ucar.edu] <b>On Behalf Of </b>Karl Taylor<br>
<b>Sent:</b> 20 December 2011 00:16<br>
<b>To:</b> go-essp-tech@ucar.edu<br>
<b>Subject:</b> Re: [Go-essp-tech] verification of datanode status<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Hi All,<br>
<br>
No matter what, it seems that published datasets that are not available should be "unpublished" (unless this is a temporary situation). In the case under discussion, could someone tell me whom to contact at DMI to ask them to do this (or better yet, write
them yourself, if that will work). <br>
<br>
I'm curious ... what model output looks like it is currently available from DMI but really isn't?<br>
<br>
thanks,<br>
Karl<br>
<br>
On 12/19/11 2:02 PM, Eric Nienhouse wrote: <o:p></o:p></p>
<pre>Hi All,<o:p></o:p></pre>
<pre><o:p> </o:p></pre>
<pre>A long standing Gateway requirement is to provide search and discovery <o:p></o:p></pre>
<pre>of datasets (and other metadata) regardless of the state of remote <o:p></o:p></pre>
<pre>services. In the event that a data node service is unavailable, users <o:p></o:p></pre>
<pre>should still be able to identify datasets, determine what has been <o:p></o:p></pre>
<pre>published and generate download scripts.<o:p></o:p></pre>
<pre><o:p> </o:p></pre>
<pre>This guiding requirement was discussed at great length by the ESG-CET <o:p></o:p></pre>
<pre>project group and was accepted as a key element in support of the <o:p></o:p></pre>
<pre>community's best interest for data discovery. Identifying "what has <o:p></o:p></pre>
<pre>been published" was a key use case driving this need. This advantage of <o:p></o:p></pre>
<pre>this approach is that it allows users to find out "what exists" during <o:p></o:p></pre>
<pre>periods of unexpected downtime or other service unavailability.<o:p></o:p></pre>
<pre><o:p> </o:p></pre>
<pre>Henrik noted that the DMI data node is no longer serving datasets <o:p></o:p></pre>
<pre>publishing into ESG. In this case these datasets can be discovered at <o:p></o:p></pre>
<pre>the Gateway, however, they are inaccessible and out of sync. If these <o:p></o:p></pre>
<pre>data are no longer meant to be accessed, I'd suggest they be "retracted" <o:p></o:p></pre>
<pre>from the gateway and they will no longer appear in the search results.<o:p></o:p></pre>
<pre><o:p> </o:p></pre>
<pre>Thanks,<o:p></o:p></pre>
<pre><o:p> </o:p></pre>
<pre>-Eric<o:p></o:p></pre>
<pre><o:p> </o:p></pre>
<pre>Estanislao Gonzalez wrote:<o:p></o:p></pre>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<pre>T(sorry the message got cut)<o:p></o:p></pre>
<pre>...it's up to the publisher to define when data shouldn't be accessible <o:p></o:p></pre>
<pre>anymore.<o:p></o:p></pre>
<pre><o:p> </o:p></pre>
<pre>There are some improvements that can be doen, but most I can think of <o:p></o:p></pre>
<pre>will make the understanding of the system more complex to the end user.<o:p></o:p></pre>
<pre><o:p> </o:p></pre>
<pre>Datanode admin should rely on tools that help them get their nodes up <o:p></o:p></pre>
<pre>for as long as possible (nagios & Co).<o:p></o:p></pre>
<pre><o:p> </o:p></pre>
<pre>My 2c,<o:p></o:p></pre>
<pre>Estani<o:p></o:p></pre>
<pre>On 19.12.2011 08:04, Estanislao Gonzalez wrote:<o:p></o:p></pre>
<pre> <o:p></o:p></pre>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<pre>Hi Luca,<o:p></o:p></pre>
<pre><o:p> </o:p></pre>
<pre>That's not what Henrik meant. Neither the architecture retains a <o:p></o:p></pre>
<pre>living<o:p></o:p></pre>
<pre>link to a data nose (not an index one, as you've pointed out)<o:p></o:p></pre>
<pre><o:p> </o:p></pre>
<pre>This is a feature IMO as the search engine is detached from the<o:p></o:p></pre>
<pre>dataone. The index might indeed "prune" the data nodes down, but <o:p></o:p></pre>
<pre>unless<o:p></o:p></pre>
<pre>this is done synchroneusly it would difficult the federation<o:p></o:p></pre>
<pre>interaction.<o:p></o:p></pre>
<pre>Or to say it differently: Is up to the data node to assure data is<o:p></o:p></pre>
<pre>available, and if that's not desired anymore, On 19.12.2011 07:15,<o:p></o:p></pre>
<pre>Cinquini, Luca (3880) wrote:<o:p></o:p></pre>
<pre> <o:p></o:p></pre>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<pre>Hi Henirik,<o:p></o:p></pre>
<pre> not sure about the gateway, but this is a feature the P2P system<o:p></o:p></pre>
<pre>does have: has soon as a datanode is inaccessible, the search<o:p></o:p></pre>
<pre>automatically prunes that node away, so the search results never<o:p></o:p></pre>
<pre>contain dead links.<o:p></o:p></pre>
<pre>thanks, Luca<o:p></o:p></pre>
<pre><o:p> </o:p></pre>
<pre>On Dec 19, 2011, at 3:58 AM, Henrik Wiberg wrote:<o:p></o:p></pre>
<pre><o:p> </o:p></pre>
<pre> <o:p></o:p></pre>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<pre>Does the gateway somehow 'ping' its registered datanodes to verify<o:p></o:p></pre>
<pre>that<o:p></o:p></pre>
<pre>they are accessible? The datanode at dmi has not been running for 5<o:p></o:p></pre>
<pre>mounts still the datanodes published datasets are searchable and<o:p></o:p></pre>
<pre>displayed at the gateway cmip-gw-badc. Should not inaccessible<o:p></o:p></pre>
<pre>datasets<o:p></o:p></pre>
<pre>be removed from the search result?<o:p></o:p></pre>
<pre><o:p> </o:p></pre>
<pre>_______________________________________________<o:p></o:p></pre>
<pre>GO-ESSP-TECH mailing list<o:p></o:p></pre>
<pre><a href="mailto:GO-ESSP-TECH@ucar.edu">GO-ESSP-TECH@ucar.edu</a><o:p></o:p></pre>
<pre><a href="http://mailman.ucar.edu/mailman/listinfo/go-essp-tech">http://mailman.ucar.edu/mailman/listinfo/go-essp-tech</a><o:p></o:p></pre>
<pre> <o:p></o:p></pre>
</blockquote>
<pre>_______________________________________________<o:p></o:p></pre>
<pre>GO-ESSP-TECH mailing list<o:p></o:p></pre>
<pre><a href="mailto:GO-ESSP-TECH@ucar.edu">GO-ESSP-TECH@ucar.edu</a><o:p></o:p></pre>
<pre><a href="http://mailman.ucar.edu/mailman/listinfo/go-essp-tech">http://mailman.ucar.edu/mailman/listinfo/go-essp-tech</a><o:p></o:p></pre>
<pre> <o:p></o:p></pre>
</blockquote>
</blockquote>
<pre><o:p> </o:p></pre>
<pre> <o:p></o:p></pre>
</blockquote>
<pre><o:p> </o:p></pre>
<pre>_______________________________________________<o:p></o:p></pre>
<pre>GO-ESSP-TECH mailing list<o:p></o:p></pre>
<pre><a href="mailto:GO-ESSP-TECH@ucar.edu">GO-ESSP-TECH@ucar.edu</a><o:p></o:p></pre>
<pre><a href="http://mailman.ucar.edu/mailman/listinfo/go-essp-tech">http://mailman.ucar.edu/mailman/listinfo/go-essp-tech</a><o:p></o:p></pre>
</div>
</div>
<br><p>--
<BR>Scanned by iCritical.
</p>
<br></body>
</html>