<html><head></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; ">Bob / Bryan<div><br></div><div>Ontop of the possibilty of the DataNode exposing <u>ESG-Publisher AtomPub</u> HTTP endpoints, may I also add to the mix the possibility of <u>ESG-Publisher search web services</u>. Such web services would in turn permit the development of a <u>ESG distributed search broker</u>, i.e. an aggregator of search results pulled from multiple data nodes. </div><div><br></div><div>At IPSL we have developed a portal that launches an overnight batch job to harvest & aggregate meta-data derived from the THREDDS catalogs published at each of our data nodes. We could certainly use the ESG-Publisher AtomPub feeds to optimise the synchronisation of the aggregated meta-data.</div><div><br></div><div>However ultimately all paths lead to distributed search as in a few years we will have several millions of files/variables to search against and there are limits to what can be acheived with a solution based upon aggregation. Hence the ESG-Publisher search web services and associated distributed search broker are of real interest.</div><div><br></div><div>Regards</div><div><br></div><div>Mark</div><div><br></div><div><br><div><div>On 27 Apr 2011, at 23:54, Drach, Bob wrote:</div><br class="Apple-interchange-newline"><blockquote type="cite"><div>Hi Brian,<br><br>Excellent suggestion. Anyone familiar with setting up an RSS feed?<br><br>--Bob<br><br><br>On 4/27/11 12:58 PM, "Bryan Lawrence" <<a href="mailto:bryan.lawrence@stfc.ac.uk">bryan.lawrence@stfc.ac.uk</a>> wrote:<br><br><blockquote type="cite">hi Bob<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">I wonder how hard it would be to produce a data node feed (or a TDS<br></blockquote><blockquote type="cite">feed) of datasets published/revised as part of the publication step?<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">It'd then be relatively easy to parse that for a "new items" page ...<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Cheers<br></blockquote><blockquote type="cite">Bryan<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><blockquote type="cite">I'm happy to post a list of publication events if that would be<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">useful. But like you I would see this as a temporary solution until<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">some sort of registry solution could be devised (famous last words<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">...). Also I can't really commit to keeping such a list up-to-date<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">when vacation etc. intervenes.<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">I'd be curious to hear if others think this is a good idea as well.<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">--Bob<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">On 4/27/11 3:30 AM, "Estanislao Gonzalez"<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><<a href="mailto:estanislao.gonzalez@zmaw.de">estanislao.gonzalez@zmaw.de</a>><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">wrote:<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite">Hi Sébastien,<br></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite"><br></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite">indeed this is a great idea, but changing this manually on every<br></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite">gateway is not practical at all.<br></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite"><br></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite">I've already proposed moving this to a central registry of some<br></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite">kind, but considering that the current registry, which is<br></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite">essential, is not ready I'd suggest a quick and dirty procedure:<br></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite"><br></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite">* Bob (I know you love this :-), could you put this info in a file<br></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite">publicly accessible at pcmdi3? (plain txt file, no headers,<br></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite">nothing) * Gateway team: could you give us a one line ajax command<br></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite">(or anything similar, preferably from the client side) depending<br></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite">on the current js libraries to insert this text where it should?<br></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite"><br></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite">I think that'll do.<br></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite"><br></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite">Thanks,<br></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite">Estani<br></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite"><br></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite">Am 27.04.2011 11:53, schrieb Sébastien Denvil:<br></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite"><blockquote type="cite"> Hi Bob, Stephen, Estanislao<br></blockquote></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite"><blockquote type="cite"><br></blockquote></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite"><blockquote type="cite">I noticed that pcmdi gateway have a notice on the homepage listing<br></blockquote></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite"><blockquote type="cite">new available datasets.<br></blockquote></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite"><blockquote type="cite"><br></blockquote></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite"><blockquote type="cite">Latest notice being : "BCC datasets will be available at the end<br></blockquote></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite"><blockquote type="cite">of April."<br></blockquote></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite"><blockquote type="cite"><br></blockquote></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite"><blockquote type="cite">Bob, could add this to your list:<br></blockquote></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite"><blockquote type="cite">"IPSL-CM5A-LR piControl and historical datasets available"<br></blockquote></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite"><blockquote type="cite">They are open to CMIP5-research role since 20th of April.<br></blockquote></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite"><blockquote type="cite"><br></blockquote></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite"><blockquote type="cite">Stephen, Estanislao I think it could be a good idea to duplicate<br></blockquote></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite"><blockquote type="cite">this notice on the other gateway to help people identifying which<br></blockquote></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite"><blockquote type="cite">datasets are accessible.<br></blockquote></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite"><blockquote type="cite"><br></blockquote></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite"><blockquote type="cite">Cheers.<br></blockquote></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite"><blockquote type="cite">Sébastien<br></blockquote></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">_______________________________________________<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">GO-ESSP-TECH mailing list<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><a href="mailto:GO-ESSP-TECH@ucar.edu">GO-ESSP-TECH@ucar.edu</a><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><a href="http://mailman.ucar.edu/mailman/listinfo/go-essp-tech">http://mailman.ucar.edu/mailman/listinfo/go-essp-tech</a><br></blockquote></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">--<br></blockquote><blockquote type="cite">Bryan Lawrence<br></blockquote><blockquote type="cite">Director of Environmental Archival and Associated Research<br></blockquote><blockquote type="cite">(NCAS/British Atmospheric Data Centre and NCEO/NERC NEODC)<br></blockquote><blockquote type="cite">STFC, Rutherford Appleton Laboratory<br></blockquote><blockquote type="cite">Phone +44 1235 445012; Fax ... 5848;<br></blockquote><blockquote type="cite">Web: home.badc.rl.ac.uk/lawrence<br></blockquote><br>_______________________________________________<br>GO-ESSP-TECH mailing list<br><a href="mailto:GO-ESSP-TECH@ucar.edu">GO-ESSP-TECH@ucar.edu</a><br>http://mailman.ucar.edu/mailman/listinfo/go-essp-tech<br><br></div></blockquote></div><br><div>
<span class="Apple-style-span" style="border-collapse: separate; color: rgb(0, 0, 0); font-family: Helvetica; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-align: auto; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; font-size: medium; "><div>---------------------------------------------------</div><div><span class="Apple-style-span" style="color: rgb(84, 0, 0); ">Mark Morgan</span></div><div><span class="Apple-style-span" style="color: rgb(84, 0, 0); "></span><span class="Apple-style-span" style="color: rgb(84, 0, 0); ">Software Architect / Engineer</span></div><div><span class="Apple-style-span" style="color: rgb(84, 0, 0); "></span><span class="Apple-style-span" style="color: rgb(84, 0, 0); ">Institut Pierre Simon Laplace (IPSL),</span></div><div><span class="Apple-style-span" style="color: rgb(84, 0, 0); "></span><span class="Apple-style-span" style="color: rgb(84, 0, 0); ">Université Pierre Marie Curie,</span></div><div><span class="Apple-style-span" style="color: rgb(84, 0, 0); "></span><span class="Apple-style-span" style="color: rgb(84, 0, 0); ">4 Place Jussieu,</span></div><div><span class="Apple-style-span" style="color: rgb(84, 0, 0); "></span><span class="Apple-style-span" style="color: rgb(84, 0, 0); ">Tour 45-55, Salle #207,</span></div><div><span class="Apple-style-span" style="color: rgb(84, 0, 0); "></span><span class="Apple-style-span" style="color: rgb(84, 0, 0); ">Paris 75005</span></div><div><span class="Apple-style-span" style="color: rgb(84, 0, 0); "></span><span class="Apple-style-span" style="color: rgb(84, 0, 0); ">France.</span></div><div><span class="Apple-style-span" style="color: rgb(84, 0, 0); "></span><span class="Apple-style-span" style="color: rgb(84, 0, 0); ">Tel : +33 (0) 1 44 27 49 10</span></div><div><span class="Apple-style-span" style="color: rgb(84, 0, 0); "></span><span class="Apple-style-span" style="color: rgb(84, 0, 0); ">Email: <a href="mailto:momipsl@ipsl.jussieu.fr">momipsl@ipsl.jussieu.fr</a></span></div><div>---------------------------------------------------</div><div><br></div></span><br class="Apple-interchange-newline">
</div>
<br></div></body></html>