<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
<html>
<head>
<meta content="text/html; charset=ISO-8859-1"
http-equiv="Content-Type">
</head>
<body bgcolor="#ffffff" text="#000000">
Hi,<br>
<br>
I read the magic word 'philosophical', so here's my 2c:<br>
<br>
we shouldn't forget the users don't care about files... they care
only about data. <br>
For some (maybe even most) of our <b>present </b>users the files
we provide are perfect, for others it's a nightmare they have to
cope with (because of the file format, etc). <br>
So, the bottom line should be, again, users want to search for data,
not files. And worse yet, they don't want to search the way we like
to think about data but <b>theirs</b>. A dataset might sound great
to us, but try to explain to somebody who wants to get the mean
global temperature for all models how <b>we </b>think he/she
should do it... at the end one <b>double </b>value per model,
right? :-)<br>
<br>
In my opinion OpenDAP (or something similar) is the only way to
go... it would be great if it could act on an <b>archive </b>wide
aggregation without any performance hit. Maybe some day...<br>
<br>
Thanks,<br>
Estani<br>
<br>
Am 01.06.2011 17:55, schrieb Cinquini, Luca (3880):
<blockquote
cite="mid:D5BB1011-213E-42A2-AB8A-23E3E23A3D39@jpl.nasa.gov"
type="cite"><base href="x-msg://39/">Hi Stephen:
<div><br>
<div>
<div>On Jun 1, 2011, at 9:33 AM, <<a moz-do-not-send="true"
href="mailto:stephen.pascoe@stfc.ac.uk">stephen.pascoe@stfc.ac.uk</a>>
wrote:</div>
<br class="Apple-interchange-newline">
<blockquote type="cite"><span class="Apple-style-span"
style="border-collapse: separate; font-family: Helvetica;
font-style: normal; font-variant: normal; font-weight:
normal; letter-spacing: normal; line-height: normal;
orphans: 2; text-indent: 0px; text-transform: none;
white-space: normal; widows: 2; word-spacing: 0px;
font-size: medium;">
<div link="blue" vlink="purple" style="word-wrap:
break-word;" lang="EN-GB">
<div class="WordSection1" style="page: WordSection1;">
<div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt;
font-family: 'Times New Roman',serif;"><span
style="font-size: 11pt; font-family:
Calibri,sans-serif; color: rgb(31, 73, 125);">Hi
Luca,<o:p></o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt;
font-family: 'Times New Roman',serif;"><span
style="font-size: 11pt; font-family:
Calibri,sans-serif; color: rgb(31, 73, 125);"><o:p> </o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt;
font-family: 'Times New Roman',serif;"><span
style="font-size: 11pt; font-family:
Calibri,sans-serif; color: rgb(31, 73, 125);">I
don't think we should rush to implement before we
understand what's being suggested. </span></div>
</div>
</div>
</span></blockquote>
<div>Well that is how the system already works: index all
metadata found in the catalogs. I didn't mean to rush
anything :).</div>
<br>
<blockquote type="cite"><span class="Apple-style-span"
style="border-collapse: separate; font-family: Helvetica;
font-style: normal; font-variant: normal; font-weight:
normal; letter-spacing: normal; line-height: normal;
orphans: 2; text-indent: 0px; text-transform: none;
white-space: normal; widows: 2; word-spacing: 0px;
font-size: medium;">
<div link="blue" vlink="purple" style="word-wrap:
break-word;" lang="EN-GB">
<div class="WordSection1" style="page: WordSection1;">
<div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt;
font-family: 'Times New Roman',serif;"><span
style="font-size: 11pt; font-family:
Calibri,sans-serif; color: rgb(31, 73, 125);">
From my first reading of your email you seem to
contradict yourself: p2p search doesn't index
files but Charles wants you to enhance the "search
for files". I clearly don't understand what is
being indexed. From what you say I am guessing
that the indexer grabs all <property>
elements whether they are parents of a top-level
<dataset> element, a file-level
<dataset> element or a <metadata>
element.</span></div>
</div>
</div>
</span></blockquote>
<div><br>
</div>
Sorry for being confusing: the system already indexes the full
content of THREDDS catalogs into records of type Dataset and
File. Right now, the information is NOT propagated from
Dataset to Files. We could do so to make the search more Files
more powerful: this will allow you to search for Files by
employing metadata that is defined at the Dataset level.<br>
<blockquote type="cite"><span class="Apple-style-span"
style="border-collapse: separate; font-family: Helvetica;
font-style: normal; font-variant: normal; font-weight:
normal; letter-spacing: normal; line-height: normal;
orphans: 2; text-indent: 0px; text-transform: none;
white-space: normal; widows: 2; word-spacing: 0px;
font-size: medium;">
<div link="blue" vlink="purple" style="word-wrap:
break-word;" lang="EN-GB">
<div class="WordSection1" style="page: WordSection1;">
<div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt;
font-family: 'Times New Roman',serif;"><span
style="font-size: 11pt; font-family:
Calibri,sans-serif; color: rgb(31, 73, 125);"><o:p></o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt;
font-family: 'Times New Roman',serif;"><span
style="font-size: 11pt; font-family:
Calibri,sans-serif; color: rgb(31, 73, 125);"><o:p> </o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt;
font-family: 'Times New Roman',serif;"><span
style="font-size: 11pt; font-family:
Calibri,sans-serif; color: rgb(31, 73, 125);">I'm
wary of the approach of propagating all metadata
to all levels of the system. My instinct is we
should decide what belongs at the dataset level
and stick with it.</span></div>
</div>
</div>
</span></blockquote>
That's why we haven't done it so far.... It's a philosophical
decision...</div>
<div><br>
</div>
<div>thanks, Luca</div>
<div><br>
<blockquote type="cite"><span class="Apple-style-span"
style="border-collapse: separate; font-family: Helvetica;
font-style: normal; font-variant: normal; font-weight:
normal; letter-spacing: normal; line-height: normal;
orphans: 2; text-indent: 0px; text-transform: none;
white-space: normal; widows: 2; word-spacing: 0px;
font-size: medium;">
<div link="blue" vlink="purple" style="word-wrap:
break-word;" lang="EN-GB">
<div class="WordSection1" style="page: WordSection1;">
<div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt;
font-family: 'Times New Roman',serif;"><span
style="font-size: 11pt; font-family:
Calibri,sans-serif; color: rgb(31, 73, 125);"><o:p></o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt;
font-family: 'Times New Roman',serif;"><span
style="font-size: 11pt; font-family:
Calibri,sans-serif; color: rgb(31, 73, 125);"><o:p> </o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt;
font-family: 'Times New Roman',serif;"><span
style="font-size: 11pt; font-family:
Calibri,sans-serif; color: rgb(31, 73, 125);">Cheers,<o:p></o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt;
font-family: 'Times New Roman',serif;"><span
style="font-size: 11pt; font-family:
Calibri,sans-serif; color: rgb(31, 73, 125);">Stephen.<o:p></o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt;
font-family: 'Times New Roman',serif;"><span
style="font-size: 11pt; font-family:
Calibri,sans-serif; color: rgb(31, 73, 125);"><o:p> </o:p></span></div>
<div>
<div style="margin: 0cm 0cm 0.0001pt; font-size:
12pt; font-family: 'Times New Roman',serif;"><span
style="font-size: 10.5pt; font-family: Consolas;
color: rgb(31, 73, 125);">---<o:p></o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size:
12pt; font-family: 'Times New Roman',serif;"><span
style="font-size: 10.5pt; font-family: Consolas;
color: rgb(31, 73, 125);">Stephen Pascoe +44
(0)1235 445980<o:p></o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size:
12pt; font-family: 'Times New Roman',serif;"><span
style="font-size: 10.5pt; font-family: Consolas;
color: rgb(31, 73, 125);">Centre of
Environmental Data Archival<o:p></o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size:
12pt; font-family: 'Times New Roman',serif;"><span
style="font-size: 10.5pt; font-family: Consolas;
color: rgb(31, 73, 125);">STFC Rutherford
Appleton Laboratory, Harwell Oxford, Didcot OX11
0QX, UK<o:p></o:p></span></div>
</div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt;
font-family: 'Times New Roman',serif;"><span
style="font-size: 11pt; font-family:
Calibri,sans-serif; color: rgb(31, 73, 125);"><o:p> </o:p></span></div>
<div>
<div style="border-style: solid none none;
border-top: 1pt solid rgb(181, 196, 223); padding:
3pt 0cm 0cm;">
<div style="margin: 0cm 0cm 0.0001pt; font-size:
12pt; font-family: 'Times New Roman',serif;"><b><span
style="font-size: 10pt; font-family:
Tahoma,sans-serif;" lang="EN-US">From:</span></b><span
style="font-size: 10pt; font-family:
Tahoma,sans-serif;" lang="EN-US"><span
class="Apple-converted-space"> </span>Cinquini,
Luca (3880)
[<a class="moz-txt-link-freetext" href="mailto:Luca.Cinquini@jpl.nasa.gov">mailto:Luca.Cinquini@jpl.nasa.gov</a>]<span
class="Apple-converted-space"> </span><br>
<b>Sent:</b><span
class="Apple-converted-space"> </span>01
June 2011 16:18<br>
<b>To:</b><span class="Apple-converted-space"> </span>Pascoe,
Stephen (STFC,RAL,RALSP)<br>
<b>Cc:</b><span class="Apple-converted-space"> </span><a
moz-do-not-send="true"
href="mailto:Roland.Schweitzer@noaa.gov"
style="color: blue; text-decoration:
underline;">Roland.Schweitzer@noaa.gov</a>;<span
class="Apple-converted-space"> </span><a
moz-do-not-send="true"
href="mailto:esg-node-dev@lists.llnl.gov"
style="color: blue; text-decoration:
underline;">esg-node-dev@lists.llnl.gov</a>;<span
class="Apple-converted-space"> </span><a
moz-do-not-send="true"
href="mailto:go-essp-tech@ucar.edu"
style="color: blue; text-decoration:
underline;">go-essp-tech@ucar.edu</a><br>
<b>Subject:</b><span
class="Apple-converted-space"> </span>Re:
[esg-node-dev] Use of <metadata> element
in THREDDS catalogs<o:p></o:p></span></div>
</div>
</div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt;
font-family: 'Times New Roman',serif;"><o:p> </o:p></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt;
font-family: 'Times New Roman',serif;">Hi Stephen,<o:p></o:p></div>
<div>
<div style="margin: 0cm 0cm 0.0001pt; font-size:
12pt; font-family: 'Times New Roman',serif;"><span
class="apple-tab-span"> <span
class="Apple-converted-space"> </span></span>to
answer some of your questions...<o:p></o:p></div>
</div>
<div>
<div style="margin: 0cm 0cm 0.0001pt; font-size:
12pt; font-family: 'Times New Roman',serif;"><o:p> </o:p></div>
</div>
<div>
<div style="margin: 0cm 0cm 0.0001pt; font-size:
12pt; font-family: 'Times New Roman',serif;">o The
p2p index will harvest all properties in the
THREDDS catalogs. Infact, I was able to run a
quick job and ingest that catalog in our prototype
system - you can search for "cordex" at this URL:<o:p></o:p></div>
</div>
<div>
<div style="margin: 0cm 0cm 0.0001pt; font-size:
12pt; font-family: 'Times New Roman',serif;"><o:p> </o:p></div>
</div>
<div>
<div style="margin: 0cm 0cm 0.0001pt; font-size:
12pt; font-family: 'Times New Roman',serif;"><a
moz-do-not-send="true"
href="http://esg-datanode.jpl.nasa.gov/esgf-web-fe/"
style="color: blue; text-decoration: underline;">http://esg-datanode.jpl.nasa.gov/esgf-web-fe/</a><o:p></o:p></div>
</div>
<div>
<div style="margin: 0cm 0cm 0.0001pt; font-size:
12pt; font-family: 'Times New Roman',serif;"><o:p> </o:p></div>
</div>
<div>
<div style="margin: 0cm 0cm 0.0001pt; font-size:
12pt; font-family: 'Times New Roman',serif;">As
you can see, I have defined two facets:
"CORDEX_domain" and "Frequency" (upper case!) that
relate to the metadata in that catalog. As I was
mentioning, the metadata just flows through.<o:p></o:p></div>
</div>
<div>
<div style="margin: 0cm 0cm 0.0001pt; font-size:
12pt; font-family: 'Times New Roman',serif;"><o:p> </o:p></div>
</div>
<div>
<div style="margin: 0cm 0cm 0.0001pt; font-size:
12pt; font-family: 'Times New Roman',serif;">o
Note that I think some of the metadata property
names should really be lower case, instead of
upper case.... at least that's the CMIP5
convention. Off course we could change the case
while parsing the catalogs<o:p></o:p></div>
</div>
<div>
<div style="margin: 0cm 0cm 0.0001pt; font-size:
12pt; font-family: 'Times New Roman',serif;"><o:p> </o:p></div>
</div>
<div>
<div style="margin: 0cm 0cm 0.0001pt; font-size:
12pt; font-family: 'Times New Roman',serif;">o
Your last point about inheriting metadata is
exactly what we were discussing with Charles and
others in previous days. Charles asked that, in
order to make the search for files more powerful,
we tag all files that belong to a dataset with the
properties that belong to the dataset: this way,
you could make a search for files subject to the
constraints experiment=X, frequency=Y and model=Z.
This is something that is not difficult to do, but
we haven't done yet because it means
"interpreting" the catalogs as opposed to just
"parsing" them. But it looks like there is enough
momentum behind this requirement that we should go
ahead and do it...<o:p></o:p></div>
</div>
<div>
<div style="margin: 0cm 0cm 0.0001pt; font-size:
12pt; font-family: 'Times New Roman',serif;"><o:p> </o:p></div>
</div>
<div>
<div style="margin: 0cm 0cm 0.0001pt; font-size:
12pt; font-family: 'Times New Roman',serif;">o
Finally, note that so far the p2p search only
looks for Datasets - this is to limit the number
of results. We could as well look for Files, if we
wanted, from the web interface.<o:p></o:p></div>
</div>
<div>
<div style="margin: 0cm 0cm 0.0001pt; font-size:
12pt; font-family: 'Times New Roman',serif;"><o:p> </o:p></div>
</div>
<div>
<div style="margin: 0cm 0cm 0.0001pt; font-size:
12pt; font-family: 'Times New Roman',serif;">thanks,
Luca<o:p></o:p></div>
</div>
<div>
<div style="margin: 0cm 0cm 0.0001pt; font-size:
12pt; font-family: 'Times New Roman',serif;"><o:p> </o:p></div>
</div>
<div>
<div style="margin: 0cm 0cm 0.0001pt; font-size:
12pt; font-family: 'Times New Roman',serif;"><o:p> </o:p></div>
<div>
<div>
<div style="margin: 0cm 0cm 0.0001pt; font-size:
12pt; font-family: 'Times New Roman',serif;">On
Jun 1, 2011, at 7:59 AM, <<a
moz-do-not-send="true"
href="mailto:stephen.pascoe@stfc.ac.uk"
style="color: blue; text-decoration:
underline;">stephen.pascoe@stfc.ac.uk</a>>
wrote:<o:p></o:p></div>
</div>
<div style="margin: 0cm 0cm 0.0001pt; font-size:
12pt; font-family: 'Times New Roman',serif;"><br>
<br>
<o:p></o:p></div>
<div>
<div>
<div style="margin: 0cm 0cm 0.0001pt;
font-size: 12pt; font-family: 'Times New
Roman',serif;"><span style="font-size: 11pt;
font-family: Calibri,sans-serif; color:
rgb(31, 73, 125);">(note I CC'd<span
class="apple-converted-space"> </span><a
moz-do-not-send="true"
href="mailto:gonzalez@dkrz.de"
style="color: blue; text-decoration:
underline;">gonzalez@dkrz.de</a><span
class="apple-converted-space"> </span>by
mistake -- I meant go-essp)</span><span
style="font-size: 11pt; font-family:
Calibri,sans-serif; color: black;"><o:p></o:p></span></div>
</div>
<div>
<div style="margin: 0cm 0cm 0.0001pt;
font-size: 12pt; font-family: 'Times New
Roman',serif;"><span style="font-size: 11pt;
font-family: Calibri,sans-serif; color:
rgb(31, 73, 125);"> </span><span
style="font-size: 11pt; font-family:
Calibri,sans-serif; color: black;"><o:p></o:p></span></div>
</div>
<div>
<div style="margin: 0cm 0cm 0.0001pt;
font-size: 12pt; font-family: 'Times New
Roman',serif;"><span style="font-size: 11pt;
font-family: Calibri,sans-serif; color:
rgb(31, 73, 125);">Hi Roland,</span><span
style="font-size: 11pt; font-family:
Calibri,sans-serif; color: black;"><o:p></o:p></span></div>
</div>
<div>
<div style="margin: 0cm 0cm 0.0001pt;
font-size: 12pt; font-family: 'Times New
Roman',serif;"><span style="font-size: 11pt;
font-family: Calibri,sans-serif; color:
rgb(31, 73, 125);"> </span><span
style="font-size: 11pt; font-family:
Calibri,sans-serif; color: black;"><o:p></o:p></span></div>
</div>
<div>
<div style="margin: 0cm 0cm 0.0001pt;
font-size: 12pt; font-family: 'Times New
Roman',serif;"><span style="font-size: 11pt;
font-family: Calibri,sans-serif; color:
rgb(31, 73, 125);">I suppose what I'm
getting at is would the Gateway detect
driving_model_id=ERAINT should result in a
facet value for that dataset or just
ignore it. Also I think the P2P index
node will index files and datasets
separately. In theory it should therefore
include this facet to both the dataset and
all files it contains but will it now and
should it in the future?</span><span
style="font-size: 11pt; font-family:
Calibri,sans-serif; color: black;"><o:p></o:p></span></div>
</div>
<div>
<div style="margin: 0cm 0cm 0.0001pt;
font-size: 12pt; font-family: 'Times New
Roman',serif;"><span style="font-size: 11pt;
font-family: Calibri,sans-serif; color:
rgb(31, 73, 125);"> </span><span
style="font-size: 11pt; font-family:
Calibri,sans-serif; color: black;"><o:p></o:p></span></div>
</div>
<div>
<div style="margin: 0cm 0cm 0.0001pt;
font-size: 12pt; font-family: 'Times New
Roman',serif;"><span style="font-size: 11pt;
font-family: Calibri,sans-serif; color:
rgb(31, 73, 125);">More generally, do we
want to use this inheritance feature for
key/value pairs that result in facets in
our user interfaces and search APIs? This
gets to an underlying design decision
about what information we expose at the
file level and what at the dataset level.
It is the case that each CMIP5 file has a
model_id but this property isn't exposed
in the THREDDS as file properties, only
dataset properties.</span><span
style="font-size: 11pt; font-family:
Calibri,sans-serif; color: black;"><o:p></o:p></span></div>
</div>
<div>
<div style="margin: 0cm 0cm 0.0001pt;
font-size: 12pt; font-family: 'Times New
Roman',serif;"><span style="font-size: 11pt;
font-family: Calibri,sans-serif; color:
rgb(31, 73, 125);"> </span><span
style="font-size: 11pt; font-family:
Calibri,sans-serif; color: black;"><o:p></o:p></span></div>
</div>
<div>
<div style="margin: 0cm 0cm 0.0001pt;
font-size: 12pt; font-family: 'Times New
Roman',serif;"><span style="font-size: 11pt;
font-family: Calibri,sans-serif; color:
rgb(31, 73, 125);">Cheers,</span><span
style="font-size: 11pt; font-family:
Calibri,sans-serif; color: black;"><o:p></o:p></span></div>
</div>
<div>
<div style="margin: 0cm 0cm 0.0001pt;
font-size: 12pt; font-family: 'Times New
Roman',serif;"><span style="font-size: 11pt;
font-family: Calibri,sans-serif; color:
rgb(31, 73, 125);">Stephen.</span><span
style="font-size: 11pt; font-family:
Calibri,sans-serif; color: black;"><o:p></o:p></span></div>
</div>
<div>
<div style="margin: 0cm 0cm 0.0001pt;
font-size: 12pt; font-family: 'Times New
Roman',serif;"><span style="font-size: 11pt;
font-family: Calibri,sans-serif; color:
rgb(31, 73, 125);"> </span><span
style="font-size: 11pt; font-family:
Calibri,sans-serif; color: black;"><o:p></o:p></span></div>
</div>
<div>
<div>
<div style="margin: 0cm 0cm 0.0001pt;
font-size: 12pt; font-family: 'Times New
Roman',serif;"><span style="font-size:
10.5pt; font-family: Consolas; color:
rgb(31, 73, 125);">---</span><span
style="font-size: 11pt; font-family:
Calibri,sans-serif; color: black;"><o:p></o:p></span></div>
</div>
<div>
<div style="margin: 0cm 0cm 0.0001pt;
font-size: 12pt; font-family: 'Times New
Roman',serif;"><span style="font-size:
10.5pt; font-family: Consolas; color:
rgb(31, 73, 125);">Stephen Pascoe +44
(0)1235 445980</span><span
style="font-size: 11pt; font-family:
Calibri,sans-serif; color: black;"><o:p></o:p></span></div>
</div>
<div>
<div style="margin: 0cm 0cm 0.0001pt;
font-size: 12pt; font-family: 'Times New
Roman',serif;"><span style="font-size:
10.5pt; font-family: Consolas; color:
rgb(31, 73, 125);">Centre of
Environmental Data Archival</span><span
style="font-size: 11pt; font-family:
Calibri,sans-serif; color: black;"><o:p></o:p></span></div>
</div>
<div>
<div style="margin: 0cm 0cm 0.0001pt;
font-size: 12pt; font-family: 'Times New
Roman',serif;"><span style="font-size:
10.5pt; font-family: Consolas; color:
rgb(31, 73, 125);">STFC Rutherford
Appleton Laboratory, Harwell Oxford,
Didcot OX11 0QX, UK</span><span
style="font-size: 11pt; font-family:
Calibri,sans-serif; color: black;"><o:p></o:p></span></div>
</div>
</div>
<div>
<div style="margin: 0cm 0cm 0.0001pt;
font-size: 12pt; font-family: 'Times New
Roman',serif;"><span style="font-size: 11pt;
font-family: Calibri,sans-serif; color:
rgb(31, 73, 125);"> </span><span
style="font-size: 11pt; font-family:
Calibri,sans-serif; color: black;"><o:p></o:p></span></div>
</div>
<div>
<div style="border-style: solid none none;
padding: 3pt 0cm 0cm;">
<div>
<div style="margin: 0cm 0cm 0.0001pt;
font-size: 12pt; font-family: 'Times New
Roman',serif;"><b><span
style="font-size: 10pt; font-family:
Tahoma,sans-serif;" lang="EN-US">From:</span></b><span
class="apple-converted-space"><span
style="font-size: 10pt; font-family:
Tahoma,sans-serif;" lang="EN-US"> </span></span><span
style="font-size: 10pt; font-family:
Tahoma,sans-serif;" lang="EN-US">Roland
Schweitzer
[<a class="moz-txt-link-freetext" href="mailto:Roland.Schweitzer@noaa.gov">mailto:Roland.Schweitzer@noaa.gov</a>]<span
class="apple-converted-space"> </span><br>
<b>Sent:</b><span
class="apple-converted-space"> </span>01
June 2011 14:49<br>
<b>To:</b><span
class="apple-converted-space"> </span>Pascoe,
Stephen (STFC,RAL,RALSP)<br>
<b>Cc:</b><span
class="apple-converted-space"> </span><a
moz-do-not-send="true"
href="mailto:esg-node-dev@lists.llnl.gov"
style="color: blue; text-decoration:
underline;">esg-node-dev@lists.llnl.gov</a>;<span
class="apple-converted-space"> </span><a
moz-do-not-send="true"
href="mailto:gonzalez@dkrz.de"
style="color: blue; text-decoration:
underline;">gonzalez@dkrz.de</a><br>
<b>Subject:</b><span
class="apple-converted-space"> </span>Re:
[esg-node-dev] Use of <metadata>
element in THREDDS catalogs</span><span
style="font-size: 11pt; font-family:
Calibri,sans-serif; color: black;"><o:p></o:p></span></div>
</div>
</div>
</div>
<div>
<div style="margin: 0cm 0cm 0.0001pt;
font-size: 12pt; font-family: 'Times New
Roman',serif;"><span style="font-size: 11pt;
font-family: Calibri,sans-serif; color:
black;"> <o:p></o:p></span></div>
</div>
<div>
<div style="margin: 0cm 0cm 0.0001pt;
font-size: 12pt; font-family: 'Times New
Roman',serif;"><span style="font-size: 11pt;
font-family: Calibri,sans-serif; color:
black;">Hi All,<br>
<br>
I agree that we need to formalize an ESG
profile.<span
class="apple-converted-space"> </span><br>
<br>
To that end, the THREDDS XML schema allows
for the inheritance of metadata to be
controlled by an attribute. And the
schema allows for more than one
<metadata> element with different
inheritance in a particular
<dataset>. Perhaps all that is
needed is to get the inheritance right.<br>
<br>
But, isn't it the case in the example you
sent that the inheritance is in fact
correct. A variable in this data set has
the property driving_model_id=ERAINT, for
example. What are the properties that
were added that should not be inherited? <span
class="apple-converted-space"> </span><br>
<br>
Roland<br>
<br>
On 06/01/2011 04:18 AM,<span
class="apple-converted-space"> </span><a
moz-do-not-send="true"
href="mailto:stephen.pascoe@stfc.ac.uk"
style="color: blue; text-decoration:
underline;">stephen.pascoe@stfc.ac.uk</a><span
class="apple-converted-space"> </span>wrote:<o:p></o:p></span></div>
</div>
<div>
<div style="margin: 0cm 0cm 0.0001pt;
font-size: 12pt; font-family: 'Times New
Roman',serif;"><span style="font-size: 11pt;
font-family: Calibri,sans-serif; color:
black;">Hi all,<o:p></o:p></span></div>
</div>
<div>
<div style="margin: 0cm 0cm 0.0001pt;
font-size: 12pt; font-family: 'Times New
Roman',serif;"><span style="font-size: 11pt;
font-family: Calibri,sans-serif; color:
black;"> <o:p></o:p></span></div>
</div>
<div>
<div style="margin: 0cm 0cm 0.0001pt;
font-size: 12pt; font-family: 'Times New
Roman',serif;"><span style="font-size: 11pt;
font-family: Calibri,sans-serif; color:
black;">I've just received an excellent
example of why we need to formalise an ESG
profile for THREDDS catalogs. Henrik
Wiberg has added some extra THREDDS
properties to support the CORDEX project
(see the attached email for links). He's
put these properties in a <metadata>
element within the top-level dataset
element. This is valid THREDDS but I'm
not sure what ESG would do with it.<o:p></o:p></span></div>
</div>
<div>
<div style="margin: 0cm 0cm 0.0001pt;
font-size: 12pt; font-family: 'Times New
Roman',serif;"><span style="font-size: 11pt;
font-family: Calibri,sans-serif; color:
black;"> <o:p></o:p></span></div>
</div>
<div>
<div style="margin: 0cm 0cm 0.0001pt;
font-size: 12pt; font-family: 'Times New
Roman',serif;"><span style="font-size: 11pt;
font-family: Calibri,sans-serif; color:
black;">Properties in <metadata>
elements implies they apply to all dataset
elements contained within the current
one. Now the new search engine will index
properties in files as well as datasets we
need to decide whether we are going to
support this feature of THREDDS. My guess
is that the Gateway and P2P index wouldn't
process this right.<o:p></o:p></span></div>
</div>
<div>
<div style="margin: 0cm 0cm 0.0001pt;
font-size: 12pt; font-family: 'Times New
Roman',serif;"><span style="font-size: 11pt;
font-family: Calibri,sans-serif; color:
black;"> <o:p></o:p></span></div>
</div>
<div>
<div style="margin: 0cm 0cm 0.0001pt;
font-size: 12pt; font-family: 'Times New
Roman',serif;"><span style="font-size: 11pt;
font-family: Calibri,sans-serif; color:
black;">My instinct is that there should
be a clear distinction between properties
associated with a dataset and those
associated with the files it contains --
therefore in this case we'd need to move
the properties out of the metadata
section.<o:p></o:p></span></div>
</div>
<div>
<div style="margin: 0cm 0cm 0.0001pt;
font-size: 12pt; font-family: 'Times New
Roman',serif;"><span style="font-size: 11pt;
font-family: Calibri,sans-serif; color:
black;"> <o:p></o:p></span></div>
</div>
<div>
<div style="margin: 0cm 0cm 0.0001pt;
font-size: 12pt; font-family: 'Times New
Roman',serif;"><span style="font-size: 11pt;
font-family: Calibri,sans-serif; color:
black;">Cheers,<o:p></o:p></span></div>
</div>
<div>
<div style="margin: 0cm 0cm 0.0001pt;
font-size: 12pt; font-family: 'Times New
Roman',serif;"><span style="font-size: 11pt;
font-family: Calibri,sans-serif; color:
black;">Stephen.<o:p></o:p></span></div>
</div>
<div>
<div style="margin: 0cm 0cm 0.0001pt;
font-size: 12pt; font-family: 'Times New
Roman',serif;"><span style="font-size: 11pt;
font-family: Calibri,sans-serif; color:
black;"> <o:p></o:p></span></div>
</div>
<div>
<div style="margin: 0cm 0cm 0.0001pt;
font-size: 12pt; font-family: 'Times New
Roman',serif;"><span style="font-size:
10.5pt; font-family: Consolas; color:
black;">---</span><span style="font-size:
11pt; font-family: Calibri,sans-serif;
color: black;"><o:p></o:p></span></div>
</div>
<div>
<div style="margin: 0cm 0cm 0.0001pt;
font-size: 12pt; font-family: 'Times New
Roman',serif;"><span style="font-size:
10.5pt; font-family: Consolas; color:
black;">Stephen Pascoe +44 (0)1235 445980</span><span
style="font-size: 11pt; font-family:
Calibri,sans-serif; color: black;"><o:p></o:p></span></div>
</div>
<div>
<div style="margin: 0cm 0cm 0.0001pt;
font-size: 12pt; font-family: 'Times New
Roman',serif;"><span style="font-size:
10.5pt; font-family: Consolas; color:
black;">Centre of Environmental Data
Archival</span><span style="font-size:
11pt; font-family: Calibri,sans-serif;
color: black;"><o:p></o:p></span></div>
</div>
<div>
<div style="margin: 0cm 0cm 0.0001pt;
font-size: 12pt; font-family: 'Times New
Roman',serif;"><span style="font-size:
10.5pt; font-family: Consolas; color:
black;">STFC Rutherford Appleton
Laboratory, Harwell Oxford, Didcot OX11
0QX, UK</span><span style="font-size:
11pt; font-family: Calibri,sans-serif;
color: black;"><o:p></o:p></span></div>
</div>
<div>
<div style="margin: 0cm 0cm 0.0001pt;
font-size: 12pt; font-family: 'Times New
Roman',serif;"><span style="font-size: 11pt;
font-family: Calibri,sans-serif; color:
black;"> <o:p></o:p></span></div>
</div>
<div>
<div style="margin: 0cm 0cm 0.0001pt;
font-size: 12pt; font-family: 'Times New
Roman',serif;"><span style="color: black;"> </span><span
style="font-size: 11pt; font-family:
Calibri,sans-serif; color: black;"><o:p></o:p></span></div>
</div>
<p style="margin-right: 0cm; margin-left: 0cm;
font-size: 12pt; font-family: 'Times New
Roman',serif;"><span style="color: black;">--<span
class="apple-converted-space"> </span><br>
Scanned by iCritical.<o:p></o:p></span></p>
<div>
<div style="margin: 0cm 0cm 0.0001pt;
font-size: 12pt; font-family: 'Times New
Roman',serif;"><span style="color: black;"> </span><span
style="font-size: 11pt; font-family:
Calibri,sans-serif; color: black;"><o:p></o:p></span></div>
</div>
<div>
<div style="margin: 0cm 0cm 0.0001pt;
font-size: 12pt; font-family: 'Times New
Roman',serif;"><span style="color: black;"> </span><span
style="font-size: 11pt; font-family:
Calibri,sans-serif; color: black;"><o:p></o:p></span></div>
</div>
<div style="margin: 0cm 0cm 0.0001pt; font-size:
12pt; font-family: 'Times New Roman',serif;"><o:p> </o:p></div>
<p style="margin-right: 0cm; margin-left: 0cm;
font-size: 12pt; font-family: 'Times New
Roman',serif;"><span style="color: black;">--<span
class="apple-converted-space"> </span><br>
Scanned by iCritical.<o:p></o:p></span></p>
<div style="margin: 0cm 0cm 0.0001pt; font-size:
12pt; font-family: 'Times New Roman',serif;"><o:p> </o:p></div>
</div>
<div style="margin: 0cm 0cm 0.0001pt; font-size:
12pt; font-family: 'Times New Roman',serif;"><o:p> </o:p></div>
</div>
<div style="margin: 0cm 0cm 0.0001pt; font-size:
12pt; font-family: 'Times New Roman',serif;"><o:p> </o:p></div>
</div>
</div>
<br>
<p style="margin-right: 0cm; margin-left: 0cm;
font-size: 12pt; font-family: 'Times New
Roman',serif;">--<span class="Apple-converted-space"> </span><br>
Scanned by iCritical.</p>
<br>
</div>
</span><br class="Apple-interchange-newline">
</blockquote>
</div>
<br>
</div>
<pre wrap="">
<fieldset class="mimeAttachmentHeader"></fieldset>
_______________________________________________
GO-ESSP-TECH mailing list
<a class="moz-txt-link-abbreviated" href="mailto:GO-ESSP-TECH@ucar.edu">GO-ESSP-TECH@ucar.edu</a>
<a class="moz-txt-link-freetext" href="http://mailman.ucar.edu/mailman/listinfo/go-essp-tech">http://mailman.ucar.edu/mailman/listinfo/go-essp-tech</a>
</pre>
</blockquote>
<br>
<br>
<pre class="moz-signature" cols="72">--
Estanislao Gonzalez
Max-Planck-Institut für Meteorologie (MPI-M)
Deutsches Klimarechenzentrum (DKRZ) - German Climate Computing Centre
Room 108 - Bundesstrasse 45a, D-20146 Hamburg, Germany
Phone: +49 (40) 46 00 94-126
E-Mail: <a class="moz-txt-link-abbreviated" href="mailto:gonzalez@dkrz.de">gonzalez@dkrz.de</a> </pre>
</body>
</html>