<html>
<head>
<meta content="text/html; charset=ISO-8859-1"
http-equiv="Content-Type">
</head>
<body bgcolor="#FFFFFF" text="#000000">
Hi all,<br>
<br>
I think we are drifting from the main point, which was to define a
subset of the catalog schema tailored for ESG, so we can now what to
expect.<br>
<br>
The TDS is much more complex that what we use, and the inheritance
forces to store state while going down the tree, which we don't use
at all (nor probably want)<br>
We should think already that we will have much more datasets in the
future, I'm already promoting going to the atomic dataset level for
CORDEX, which will simplify data management, but will bloat the
number of datasets (40x).<br>
Displaying a list of ~6000 datasets, what we now have, takes some
time, and at this time much memory from TDS side. So we might want
to add an intermediate level to address this (assume this solves
anything...)<br>
<br>
But besides this, I don't think we have any compelling reason for
supporting the whole TDS schema.<br>
IMHO we should define what we now have in a xsd as a subset of what
it's allowed (but considering the previous point regarding
scalability).<br>
<br>
Furthermore, because the TDS is a metadata "producer" for the ESG,
we could add some "general" catalogs with other metadata in the same
structure. This could be the modification time of the catalogs or
other data not handle directly by the catalogs (i.e. controlled
vocabulary services endpoints). Just to depict what I mean (I'm not
"proposing" anything, just presenting some possibilities):<br>
<br>
Root/<br>
|-MPI <all MPI catalogs><br>
| |-metadata<br>
| |- last_mod_time<br>
|-MOHC <all MOHC catalogs, for us, replicas><br>
| |-metadata<br>
| |- last_mod_time<br>
|-metadata<br>
|- controlled vocabularies referenced <br>
<br>
Though I'd prefer to rely on a standard (ISO?), or a subset of it,
instead of the TDS own metadata format.<br>
<br>
Just my 2c,<br>
Estani<br>
<br>
Am 23.02.2012 18:28, schrieb <a class="moz-txt-link-abbreviated" href="mailto:martin.juckes@stfc.ac.uk:">martin.juckes@stfc.ac.uk:</a>
<blockquote
cite="mid:E21FBC3F00D7304687CB46529F9676D7265E0391@EXCHMBX01.fed.cclrc.ac.uk"
type="cite">
<meta http-equiv="Content-Type" content="text/html;
charset=ISO-8859-1">
<meta name="Generator" content="Microsoft Word 12 (filtered
medium)">
<base href="x-msg://5/">
<style><!--
/* Font Definitions */
@font-face
{font-family:Helvetica;
panose-1:2 11 6 4 2 2 2 2 2 4;}
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
@font-face
{font-family:Consolas;
panose-1:2 11 6 9 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p
{mso-style-priority:99;
mso-margin-top-alt:auto;
margin-right:0cm;
mso-margin-bottom-alt:auto;
margin-left:0cm;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
span.apple-style-span
{mso-style-name:apple-style-span;}
span.apple-converted-space
{mso-style-name:apple-converted-space;}
span.apple-tab-span
{mso-style-name:apple-tab-span;}
span.EmailStyle21
{mso-style-type:personal;
font-family:"Calibri","sans-serif";
color:#1F497D;}
span.EmailStyle22
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 72.0pt 72.0pt 72.0pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
<div class="WordSection1">
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">There
is a page on the schema here:
<a moz-do-not-send="true"
href="http://www.unidata.ucar.edu/projects/THREDDS/tech/catalog/InvCatalogSpec.html#catalog">http://www.unidata.ucar.edu/projects/THREDDS/tech/catalog/InvCatalogSpec.html#catalog</a><o:p></o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">They
state pretty clearly that datasets at the top level are
allowed .....,<o:p></o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Cheers,<o:p></o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Martin<o:p></o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<div style="border:none;border-left:solid blue 1.5pt;padding:0cm
0cm 0cm 4.0pt">
<div>
<div style="border:none;border-top:solid #B5C4DF
1.0pt;padding:3.0pt 0cm 0cm 0cm">
<p class="MsoNormal"><b><span
style="font-size:10.0pt;font-family:"Tahoma","sans-serif""
lang="EN-US">From:</span></b><span
style="font-size:10.0pt;font-family:"Tahoma","sans-serif""
lang="EN-US"> Pascoe, Stephen (STFC,RAL,RALSP)
<br>
<b>Sent:</b> 23 February 2012 17:19<br>
<b>To:</b> 'Cinquini, Luca (3880)'<br>
<b>Cc:</b> Juckes, Martin (STFC,RAL,RALSP);
<a class="moz-txt-link-abbreviated" href="mailto:go-essp-tech@ucar.edu">go-essp-tech@ucar.edu</a><br>
<b>Subject:</b> RE: [Go-essp-tech] Corrected THREDDS
group wiki page link<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Hi
Luca,<o:p></o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">This
is what I found googling "THREDDS Schema":<o:p></o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">
<!--
xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx
--><o:p></o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">
<!-- Catalog element --><o:p></o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">
<xsd:element name="catalog"><o:p></o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">
<xsd:complexType><o:p></o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">
<xsd:sequence><o:p></o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">
<xsd:element ref="service" minOccurs="0"
maxOccurs="unbounded"/><o:p></o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">
<xsd:element ref="datasetRoot" minOccurs="0"
maxOccurs="unbounded"/><o:p></o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">
<xsd:element ref="property" minOccurs="0"
maxOccurs="unbounded"/><o:p></o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">
<xsd:element ref="dataset" minOccurs="1"
<b>maxOccurs="unbounded"</b> /><o:p></o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">
</xsd:sequence><o:p></o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">
<xsd:attribute name="base" type="xsd:anyURI" /><o:p></o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">
<xsd:attribute name="name" type="xsd:string"/><o:p></o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">
<xsd:attribute name="expires" type="dateType"/><o:p></o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">
<xsd:attribute name="version" type="xsd:token"
default="1.0.2"/><o:p></o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">
</xsd:complexType><o:p></o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">So
that says you can have 1..* dataset elements but we know
that real THREDDS catalogs can have no dataset elements,
just catalogRef elements, so it looks like we should treat
the schema with a pinch of salt.<o:p></o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">I
agree ignoring mid-level properties is probably the right
thing to do.<o:p></o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Cheers,<o:p></o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Stephen.<o:p></o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<div>
<p class="MsoNormal"><span
style="font-size:10.5pt;font-family:Consolas;color:#1F497D">---<o:p></o:p></span></p>
<p class="MsoNormal"><span
style="font-size:10.5pt;font-family:Consolas;color:#1F497D">Stephen
Pascoe +44 (0)1235 445980<o:p></o:p></span></p>
<p class="MsoNormal"><span
style="font-size:10.5pt;font-family:Consolas;color:#1F497D">Centre
of Environmental Data Archival<o:p></o:p></span></p>
<p class="MsoNormal"><span
style="font-size:10.5pt;font-family:Consolas;color:#1F497D">STFC
Rutherford Appleton Laboratory, Harwell Oxford, Didcot
OX11 0QX, UK<o:p></o:p></span></p>
</div>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<div>
<div style="border:none;border-top:solid #B5C4DF
1.0pt;padding:3.0pt 0cm 0cm 0cm">
<p class="MsoNormal"><b><span
style="font-size:10.0pt;font-family:"Tahoma","sans-serif""
lang="EN-US">From:</span></b><span
style="font-size:10.0pt;font-family:"Tahoma","sans-serif""
lang="EN-US"> Cinquini, Luca (3880)
[<a class="moz-txt-link-freetext" href="mailto:Luca.Cinquini@jpl.nasa.gov">mailto:Luca.Cinquini@jpl.nasa.gov</a>]
<br>
<b>Sent:</b> 23 February 2012 16:46<br>
<b>To:</b> Pascoe, Stephen (STFC,RAL,RALSP)<br>
<b>Cc:</b> Juckes, Martin (STFC,RAL,RALSP);
<a class="moz-txt-link-abbreviated" href="mailto:go-essp-tech@ucar.edu">go-essp-tech@ucar.edu</a><br>
<b>Subject:</b> Re: [Go-essp-tech] Corrected THREDDS
group wiki page link<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Hi Stephen:<o:p></o:p></p>
<div>
<div>
<p class="MsoNormal">On Feb 23, 2012, at 8:54 AM, <<a
moz-do-not-send="true"
href="mailto:stephen.pascoe@stfc.ac.uk">stephen.pascoe@stfc.ac.uk</a>>
wrote:<o:p></o:p></p>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><o:p> </o:p></p>
<div>
<div>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Hi
Luca,</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">> o Each catalog is harvested as
a single discoverable dataset - the reason being that
hopefully the data provider thought about how to
generate<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">> the catalogs, and decided on
what should be the single unit of discovery<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">> o For each catalog, all files
are assigned to the top-level dataset container - so
if there were many nested datasets with files, it
still would result<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">> in a single discoverable
dataset with as many files<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Does
this mean that each catalog should contain 0 or 1
top-level datasets and any further nesting below
that is collapsed down? That sounds quite
sensible. What happens to any properties in any
dataset below the top-level one?</span><o:p></o:p></p>
</div>
</div>
<p class="MsoNormal">I may be mistaken, but at a thredds
catalog always only contains one top-level dataset ? At
least that used to be the case, I believe. At the very
least, I don't know of any catalog that has many top-level
datasets.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">As for the properties - if they are
associated with mid-level datasets, they would currently
be ignored. This could change, if we had examples to work
with.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">thanks, L<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><o:p> </o:p></p>
<div>
<div>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Cheers,</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Stephen.</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
</div>
<div>
<div>
<p class="MsoNormal"><span
style="font-size:10.5pt;font-family:Consolas;color:#1F497D">---</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span
style="font-size:10.5pt;font-family:Consolas;color:#1F497D">Stephen
Pascoe +44 (0)1235 445980</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span
style="font-size:10.5pt;font-family:Consolas;color:#1F497D">Centre
of Environmental Data Archival</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span
style="font-size:10.5pt;font-family:Consolas;color:#1F497D">STFC
Rutherford Appleton Laboratory, Harwell Oxford,
Didcot OX11 0QX, UK</span><o:p></o:p></p>
</div>
</div>
<div>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
</div>
<div>
<div style="border:none;border-top:solid #B5C4DF
1.0pt;padding:3.0pt 0cm 0cm
0cm;border-width:initial;border-color:initial">
<div>
<p class="MsoNormal"><b><span
style="font-size:10.0pt;font-family:"Tahoma","sans-serif""
lang="EN-US">From:</span></b><span
class="apple-converted-space"><span
style="font-size:10.0pt;font-family:"Tahoma","sans-serif""
lang="EN-US"> </span></span><span
style="font-size:10.0pt;font-family:"Tahoma","sans-serif""
lang="EN-US">Cinquini, Luca (3880)
[<a class="moz-txt-link-freetext" href="mailto:Luca.Cinquini@jpl.nasa.gov">mailto:Luca.Cinquini@jpl.nasa.gov</a>]<span
class="apple-converted-space"> </span><br>
<b>Sent:</b><span class="apple-converted-space"> </span>23
February 2012 15:02<br>
<b>To:</b><span class="apple-converted-space"> </span>Pascoe,
Stephen (STFC,RAL,RALSP)<br>
<b>Cc:</b><span class="apple-converted-space"> </span>Juckes,
Martin (STFC,RAL,RALSP);<span
class="apple-converted-space"> </span><a
moz-do-not-send="true"
href="mailto:go-essp-tech@ucar.edu">go-essp-tech@ucar.edu</a><br>
<b>Subject:</b><span
class="apple-converted-space"> </span>Re:
[Go-essp-tech] Corrected THREDDS group wiki page
link</span><o:p></o:p></p>
</div>
</div>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">Hi Stephen and Martin,<o:p></o:p></p>
</div>
<div>
<div>
<p class="MsoNormal"><span class="apple-tab-span"> </span><span
class="apple-converted-space"> </span>just for
clarification, this is what the P2P harvesting
software currently does - this doesn't mean that it
cannot be changed if desired:<o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal">o Each catalog can contain an
arbitrary hierarchy of datasets and catalogRefs<o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal">o Each catalog is harvested as a
single discoverable dataset - the reason being that
hopefully the data provider thought about how to
generate the catalogs, and decided on what should be
the single unit of discovery<o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal">o For each catalog, all files are
assigned to the top-level dataset container - so if
there were many nested datasets with files, it still
would result in a single discoverable dataset with
as many files<o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal">o And obviously, all catalogRef
are followed in harvesting, and generate separate
discoverable datasets.<o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal">thanks, Luca<o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<div>
<div>
<p class="MsoNormal">On Feb 23, 2012, at 7:33 AM,
<<a moz-do-not-send="true"
href="mailto:stephen.pascoe@stfc.ac.uk">stephen.pascoe@stfc.ac.uk</a>>
<<a moz-do-not-send="true"
href="mailto:stephen.pascoe@stfc.ac.uk">stephen.pascoe@stfc.ac.uk</a>>
wrote:<o:p></o:p></p>
</div>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><br>
<br>
<o:p></o:p></p>
</div>
<div>
<div>
<div>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Thanks
Martin. There is a catalog_version
attribute already, although I don't think
there is any documentation on what it means.</span><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">On
the hierarchy, I personally believe we could
allow any number of intermediate catalogues
containing <catalogRef> elements in
the spec. Datanodes currently only produce
2 levels .../thredds/catalog.xml and
.../thredds/esgcet/catalog.xml, but there
would be no harm in having deeper nesting.
What I think is less flexible is the
constraint that "leaf-catalogs" contain a
single container <dataset> element and
a set of child <dataset> elements
representing files and aggregations. This
design is what LAS and other bits of ESGF
rely on. General THREDDS allows you to mix
catalogRef, container datasets and "real"
datasets throughout the hierarchy.</span><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Anyone,
please chip in if you dissagree.</span><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Cheers,</span><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Stephen.</span><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal"><span
style="font-size:10.5pt;font-family:Consolas;color:#1F497D">---</span><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span
style="font-size:10.5pt;font-family:Consolas;color:#1F497D">Stephen
Pascoe +44 (0)1235 445980</span><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span
style="font-size:10.5pt;font-family:Consolas;color:#1F497D">Centre
of Environmental Data Archival</span><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span
style="font-size:10.5pt;font-family:Consolas;color:#1F497D">STFC
Rutherford Appleton Laboratory, Harwell
Oxford, Didcot OX11 0QX, UK</span><o:p></o:p></p>
</div>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
</div>
</div>
<div>
<div style="border:none;border-top:solid
windowtext 3.0pt;padding:3.0pt 0cm 0cm
0cm;border-width:initial;border-color:initial;border-width:initial;border-color:initial">
<div>
<div>
<p class="MsoNormal"><b><span
style="font-size:10.0pt;font-family:"Tahoma","sans-serif""
lang="EN-US">From:</span></b><span
class="apple-converted-space"><span
style="font-size:10.0pt;font-family:"Tahoma","sans-serif""
lang="EN-US"> </span></span><span
style="font-size:10.0pt;font-family:"Tahoma","sans-serif""
lang="EN-US">Juckes, Martin
(STFC,RAL,RALSP)<span
class="apple-converted-space"> </span><br>
<b>Sent:</b><span
class="apple-converted-space"> </span>23
February 2012 12:11<br>
<b>To:</b><span
class="apple-converted-space"> </span>Pascoe,
Stephen (STFC,RAL,RALSP);<span
class="apple-converted-space"> </span><a
moz-do-not-send="true"
href="mailto:go-essp-tech@ucar.edu">go-essp-tech@ucar.edu</a><br>
<b>Subject:</b><span
class="apple-converted-space"> </span>RE:
Corrected THREDDS group wiki page link</span><o:p></o:p></p>
</div>
</div>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif""> </span><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Hello
All,</span><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Sorry
I had to leave the telco early – but it was
a useful discussion.</span><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">After
leaving, I had a couple of thoughts:</span><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
</div>
</div>
<div style="margin-left:36.0pt">
<div>
<p class="MsoNormal" style="text-indent:-18.0pt"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">(1)</span><span
style="font-size:7.0pt;color:#1F497D"> <span
class="apple-converted-space"> </span></span><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">There
syntax should be versioned , and the version
should be indicated in the catalogue
somewhere – whatever we agree on, there is
bound to be need to change in the future,
and changes will be much easier to manage if
we have the version in the catalogue. There
could be independent syntax versions for the
top level catalogue and the “publication
unit” catalogue. The cleanest way to do this
would be with an xsd document referenced in
the schemaLocation attribute. We could set
this up initially with a “permissive” xsd
schema imposing necessary constraints, but
not all the required constraints.</span><o:p></o:p></p>
</div>
</div>
<div style="margin-left:36.0pt">
<div>
<p class="MsoNormal" style="text-indent:-18.0pt"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">(2)</span><span
style="font-size:7.0pt;color:#1F497D"> <span
class="apple-converted-space"> </span></span><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">The
decision to stick to a 2-level hierarchy of
THREDDS documents (a top-level catalogue
with a list of “catalogRef”s and a
sub-catalogue for each publication unit) is
certainly right for now, but may be too
restrictive in the medium term. The
specification of “catalogRef” means that
very little information is in the top level,
and at the next level you have to fetch
everything. Having an 3<sup>rd</sup><span
class="apple-converted-space"> </span>level
– e.g. for each simulation – would allow
more flexibility in recording changes and
pointing to documentation.</span><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Cheers,</span><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Martin</span><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
</div>
</div>
<div style="border:none;border-left:solid windowtext
3.0pt;padding:0cm 0cm 0cm
4.0pt;border-width:initial;border-color:initial;border-width:initial;border-color:initial">
<div>
<div style="border:none;border-top:solid
windowtext 3.0pt;padding:3.0pt 0cm 0cm
0cm;border-width:initial;border-color:initial;border-width:initial;border-color:initial">
<div>
<div>
<p class="MsoNormal"><b><span
style="font-size:10.0pt;font-family:"Tahoma","sans-serif""
lang="EN-US">From:</span></b><span
class="apple-converted-space"><span
style="font-size:10.0pt;font-family:"Tahoma","sans-serif""
lang="EN-US"> </span></span><span
style="font-size:10.0pt;font-family:"Tahoma","sans-serif""
lang="EN-US"><a moz-do-not-send="true"
href="mailto:go-essp-tech-bounces@ucar.edu">go-essp-tech-bounces@ucar.edu</a><span
class="apple-converted-space"> </span>[<a class="moz-txt-link-freetext" href="mailto:go-essp-tech-bounces@ucar.edu">mailto:go-essp-tech-bounces@ucar.edu</a>]<span
class="apple-converted-space"> </span><b>On
Behalf Of<span
class="apple-converted-space"> </span></b><a
moz-do-not-send="true"
href="mailto:stephen.pascoe@stfc.ac.uk">stephen.pascoe@stfc.ac.uk</a><br>
<b>Sent:</b><span
class="apple-converted-space"> </span>21
February 2012 16:14<br>
<b>To:</b><span
class="apple-converted-space"> </span><a
moz-do-not-send="true"
href="mailto:go-essp-tech@ucar.edu">go-essp-tech@ucar.edu</a><br>
<b>Subject:</b><span
class="apple-converted-space"> </span>[Go-essp-tech]
Corrected THREDDS group wiki page link</span><o:p></o:p></p>
</div>
</div>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif""> </span><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif""> </span><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif""><a
moz-do-not-send="true"
href="http://esgf.org/wiki/ESGFInterfaceGroups/ThreddsGroup">http://esgf.org/wiki/ESGFInterfaceGroups/ThreddsGroup</a></span><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif""> </span><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span
style="font-size:10.5pt;font-family:Consolas">---</span><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span
style="font-size:10.5pt;font-family:Consolas">Stephen
Pascoe +44 (0)1235 445980</span><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span
style="font-size:10.5pt;font-family:Consolas">Centre
of Environmental Data Archival</span><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span
style="font-size:10.5pt;font-family:Consolas">STFC
Rutherford Appleton Laboratory, Harwell
Oxford, Didcot OX11 0QX, UK</span><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif""> </span><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
</div>
<p>--<span class="apple-converted-space"> </span><br>
Scanned by iCritical.<o:p></o:p></p>
<div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
</div>
</div>
<div>
<p class="MsoNormal"><span
style="font-size:13.5pt;font-family:"Helvetica","sans-serif""> </span><o:p></o:p></p>
</div>
<p>--<span class="apple-converted-space"> </span><br>
Scanned by iCritical.<o:p></o:p></p>
<div>
<p class="MsoNormal"><span
style="font-size:13.5pt;font-family:"Helvetica","sans-serif""><br>
_______________________________________________<br>
GO-ESSP-TECH mailing list<br>
<a moz-do-not-send="true"
href="mailto:GO-ESSP-TECH@ucar.edu">GO-ESSP-TECH@ucar.edu</a><br>
<a moz-do-not-send="true"
href="http://mailman.ucar.edu/mailman/listinfo/go-essp-tech">http://mailman.ucar.edu/mailman/listinfo/go-essp-tech</a></span><o:p></o:p></p>
</div>
</div>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
</div>
<p class="MsoNormal"><span
style="font-size:13.5pt;font-family:"Helvetica","sans-serif""><o:p> </o:p></span></p>
<p>--<span class="apple-converted-space"> </span><br>
Scanned by iCritical.<o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:13.5pt;font-family:"Helvetica","sans-serif""><o:p> </o:p></span></p>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</div>
<br>
<p>-- <br>
Scanned by iCritical.
</p>
<br>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<br>
<pre wrap="">_______________________________________________
GO-ESSP-TECH mailing list
<a class="moz-txt-link-abbreviated" href="mailto:GO-ESSP-TECH@ucar.edu">GO-ESSP-TECH@ucar.edu</a>
<a class="moz-txt-link-freetext" href="http://mailman.ucar.edu/mailman/listinfo/go-essp-tech">http://mailman.ucar.edu/mailman/listinfo/go-essp-tech</a>
</pre>
</blockquote>
<br>
<br>
<pre class="moz-signature" cols="72">--
Estanislao Gonzalez
Max-Planck-Institut für Meteorologie (MPI-M)
Deutsches Klimarechenzentrum (DKRZ) - German Climate Computing Centre
Room 108 - Bundesstrasse 45a, D-20146 Hamburg, Germany
Phone: +49 (40) 46 00 94-126
E-Mail: <a class="moz-txt-link-abbreviated" href="mailto:gonzalez@dkrz.de">gonzalez@dkrz.de</a> </pre>
</body>
</html>