<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv=Content-Type content="text/html; charset=us-ascii">
<meta name=Generator content="Microsoft Word 12 (filtered medium)">
<style>
<!--
/* Font Definitions */
@font-face
{font-family:Helvetica;
panose-1:2 11 6 4 2 2 2 2 2 4;}
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p
{mso-style-priority:99;
mso-margin-top-alt:auto;
margin-right:0in;
mso-margin-bottom-alt:auto;
margin-left:0in;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
p.MsoListParagraph, li.MsoListParagraph, div.MsoListParagraph
{mso-style-priority:34;
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:.5in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
span.apple-style-span
{mso-style-name:apple-style-span;}
span.apple-tab-span
{mso-style-name:apple-tab-span;}
span.EmailStyle19
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
/* List Definitions */
@list l0
{mso-list-id:1884167606;
mso-list-type:hybrid;
mso-list-template-ids:-500555600 -659909588 67698713 67698715 67698703 67698713 67698715 67698703 67698713 67698715;}
@list l0:level1
{mso-level-text:"\(%1\)";
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:20.25pt;
text-indent:-.25in;
font-family:"Times New Roman","serif";
color:#333333;}
ol
{margin-bottom:0in;}
ul
{margin-bottom:0in;}
-->
</style>
<!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang=EN-US link=blue vlink=purple style='word-wrap: break-word;
-webkit-nbsp-mode: space;-webkit-line-break: after-white-space'>
<div class=WordSection1>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Hi Luca…<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'><o:p> </o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Some of us from ORNL with the help of Renata have defined the
naming and file name structure for the ARM CMBE files, following the draft suggestions
in Data and Metadata Requirements for CMIP5 Observational Datasets (http://oodt.jpl.nasa.gov/wiki/display/CLIMATE/Data+and+Metadata+Requirements+for+CMIP5+Observational+Datasets).
Please see the details below. We would like to have the group review this
structure and provide us feedback. We highlight two particular questions
after the details are shown.<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'><o:p> </o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>For the directory structure:<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'> cmip5/observations/DOE/ARM/CMBE/1hr/atmos/ps/c1p1/v1/<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'> <i>We used this directory structure naming convention:<o:p></o:p></i></span></p>
<p class=MsoNormal><em><b><span style='font-size:10.0pt'><activity>: </span></b></em><span
style='font-size:10.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>cmip5</span><em><b><span
style='font-size:10.0pt'><o:p></o:p></span></b></em></p>
<p class=MsoNormal><em><b><span style='font-size:10.0pt'><product>: </span></b></em><i><span
style='font-size:10.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>observations
</span></i><em><b><span style='font-size:10.0pt'><o:p></o:p></span></b></em></p>
<p class=MsoNormal><em><b><span style='font-size:10.0pt'><agency>: </span></b></em><span
style='font-size:10.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>DOE</span><em><b><span
style='font-size:10.0pt'><o:p></o:p></span></b></em></p>
<p class=MsoNormal><em><b><span style='font-size:10.0pt'><mission or
project>: </span></b></em><i><span style='font-size:10.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>ARM</span></i><em><b><span style='font-size:10.0pt'><o:p></o:p></span></b></em></p>
<p class=MsoNormal><em><b><span style='font-size:10.0pt'><instrument>: </span></b></em><span
style='font-size:10.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>CMBE</span><em><b><span
style='font-size:10.0pt'><o:p></o:p></span></b></em></p>
<p class=MsoNormal><em><b><span style='font-size:10.0pt'><frequency>:</span></b></em><i><span
style='font-size:10.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>1hr</span></i><em><b><span
style='font-size:10.0pt'><o:p></o:p></span></b></em></p>
<p class=MsoNormal><em><b><span style='font-size:10.0pt'><observational
realm>: </span></b></em><span style='font-size:10.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>atmos</span><em><b><span style='font-size:10.0pt'><o:p></o:p></span></b></em></p>
<p class=MsoNormal><em><b><span style='font-size:10.0pt'><variable name>:
</span></b></em><i><span style='font-size:10.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>ps</span></i><em><b><span style='font-size:10.0pt'><o:p></o:p></span></b></em></p>
<p class=MsoNormal><em><b><span style='font-size:10.0pt'><processing level
and product version>: </span></b></em><span style='font-size:10.0pt;
font-family:"Calibri","sans-serif";color:#1F497D'>c1p1</span><em><b><span
style='font-size:10.0pt'><o:p></o:p></span></b></em></p>
<p class=MsoNormal><em><b><span style='font-size:10.0pt'><dataset version
number>: </span></b></em><i><span style='font-size:10.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>v1</span></i><span style='font-size:10.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'><o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'><o:p> </o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>for file naming:<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'> ps_cfSites_arm-barrow_cmbe_c1p1_2001010100-2010010100.nc<o:p></o:p></span></p>
<p class=MsoNormal><em><span style='color:#333333;font-style:normal'><o:p> </o:p></span></em></p>
<p class=MsoNormal><em><b><span style='font-size:10.0pt;color:#333333'>we used
the following file naming convention:<o:p></o:p></span></b></em></p>
<p class=MsoNormal><em><b><span style='font-size:10.0pt;color:#333333'><variable
name></span></b></em><b><span style='font-size:10.0pt;color:#333333'>_<<em>variable
table</em></span></b><span style='font-size:10.0pt;color:#333333'>>_<em><</em>mission
or project><em>_<</em>instrument><em>_<<b>processing level and
product version</b>>_</em><<em>temporal subset</em>>.nc<o:p></o:p></span></p>
<p class=MsoNormal><b><span style='font-size:10.0pt;color:#333333'><o:p> </o:p></span></b></p>
<p class=MsoNormal><span style='font-size:10.0pt;color:#333333'>Two questions:<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:10.0pt;color:#333333'><o:p> </o:p></span></p>
<p class=MsoListParagraph style='margin-left:20.25pt;text-indent:-.25in;
mso-list:l0 level1 lfo1'><![if !supportLists]><span style='font-size:10.0pt;
color:#333333'><span style='mso-list:Ignore'>(1)<span style='font:7.0pt "Times New Roman"'>
</span></span></span><![endif]><span style='font-size:10.0pt;color:#333333'>For
the <mission or project> field, we are using<b> <</b></span><i><span
style='font-size:10.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>ARM</span></i><span
style='font-size:10.0pt;color:#333333'>> in the directory structure, but for
this field in the file name structure, we are using <b><</b></span><span
style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'> arm-barrow>.
T</span><span style='font-size:10.0pt;color:#333333'>his is mainly to
consolidate the files from various ARM locations in one final directory (one
place). Do you think this will cause any issues in the publishing script,
in the discovery process, or in CMIP5 tools using the data once they are found?</span><span
style='font-size:10.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p></o:p></span></p>
<p class=MsoListParagraph style='margin-left:20.25pt;text-indent:-.25in;
mso-list:l0 level1 lfo1'><![if !supportLists]><span style='font-size:10.0pt;
color:#333333'><span style='mso-list:Ignore'>(2)<span style='font:7.0pt "Times New Roman"'>
</span></span></span><![endif]><span style='font-size:10.0pt;color:#333333'>We sometimes
use upper case where it seemed appropriate. Is there a standard for case,
especially as it applies to major projects, programs, etc.? </span><span
style='font-size:10.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'><o:p> </o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'><o:p> </o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Thanks!<o:p></o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'><o:p> </o:p></span></p>
<p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";
color:#1F497D'>Giri<o:p></o:p></span></p>
<div>
<div style='border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in'>
<p class=MsoNormal><b><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'>From:</span></b><span
style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'> Renata McCoy
[mailto:mccoy20@llnl.gov] <br>
<b>Sent:</b> Wednesday, January 26, 2011 6:51 PM<br>
<b>To:</b> Cinquini, Luca (3880)<br>
<b>Cc:</b> Renata McCoy; climate-obs; go-essp-tech@ucar.edu; Bob Drach; Dean
Williams; Karl Taylor<br>
<b>Subject:</b> Re: Extending the DRS syntax to observations<o:p></o:p></span></p>
</div>
</div>
<p class=MsoNormal><o:p> </o:p></p>
<div>
<p class=MsoNormal>Hi Luca,<o:p></o:p></p>
</div>
<div>
<p class=MsoNormal><o:p> </o:p></p>
</div>
<div>
<p class=MsoNormal>I was experimenting with setting up a publishing script for
the ARM cmbe observational data following the proposal below. I see few issues:<o:p></o:p></p>
</div>
<div>
<p class=MsoNormal>I understand (I am cc-ing Bob Drach to check on that) the
publisher needs at least those 3 fields for the "CMIP5' project:<o:p></o:p></p>
</div>
<div>
<p class=MsoNormal>project (which is 'CMIP5'), experiment (that could be
specified as 'none' in command options, but maybe should be 'observations' ?),
and model <o:p></o:p></p>
</div>
<div>
<p class=MsoNormal>A 'model' is an important field and I was trying to set it
up so as 'cmbe' would be my 'model', which seems to be equivalent to 'airs' for
NASA AIRS data<o:p></o:p></p>
</div>
<div>
<p class=MsoNormal><o:p> </o:p></p>
</div>
<div>
<p class=MsoNormal>The other problem is that we need a specific table (CMOR
table) to establish the controlled variable list and data frequency that is obs
specific.<o:p></o:p></p>
</div>
<div>
<p class=MsoNormal>We (with ORNL team) are trying to create an obsCfSites
table, that would be mostly a copy of cfSites table with obs specific time
definition (for cmbe it's 1 hour average, for CDIAC data - 30 min average, and
for 3D data with vertical axis - we would like to specify that any pressure
level could be reported). I think it would be good if we could encompass all
the observational data needs in one observational table. <o:p></o:p></p>
</div>
<div>
<p class=MsoNormal> <o:p></o:p></p>
</div>
<div>
<p class=MsoNormal>I did not try to test publish the data yet, I am working on
rewriting the data with the appropriate metadata first, so I am not sure what
other problems may pop up.<o:p></o:p></p>
</div>
<div>
<p class=MsoNormal><o:p> </o:p></p>
</div>
<div>
<p class=MsoNormal>Greetings,<o:p></o:p></p>
</div>
<div>
<p class=MsoNormal>Renata<o:p></o:p></p>
</div>
<div>
<p class=MsoNormal><o:p> </o:p></p>
</div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<p class=MsoNormal><span style='font-size:13.5pt;font-family:"Helvetica","sans-serif";
color:black'>------------------------------------------------------------<br>
Renata B. McCoy, Ph.D<br>
Program for Climate Model Diagnosis and Intercomparison(L-103)<br>
Lawrence Livermore National Laboratory<br>
P.O. Box 808<br>
Livermore, CA 94551<br>
<br>
(925) 424-5237 (voice)<br>
(925) 422-7675 (fax)<br>
<a href="mailto:mccoy20@llnl.gov">mccoy20@llnl.gov</a><br>
------------------------------------------------------------<o:p></o:p></span></p>
</div>
<div>
<p class=MsoNormal><span style='font-size:13.5pt;font-family:"Helvetica","sans-serif";
color:black'><o:p> </o:p></span></p>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
<p class=MsoNormal><o:p> </o:p></p>
<div>
<div>
<p class=MsoNormal>On Jan 26, 2011, at 2:50 PM, Cinquini, Luca (3880) wrote:<o:p></o:p></p>
</div>
<p class=MsoNormal><br>
<br>
<o:p></o:p></p>
<div>
<p class=MsoNormal>Hi all,<o:p></o:p></p>
<div>
<p class=MsoNormal><span class=apple-tab-span> </span>apologies
for cross-posting...<o:p></o:p></p>
</div>
<div>
<p class=MsoNormal><br>
I'd like to start a discussion on how the DRS specification for CMIP5
model output (<a
href="http://cmip-pcmdi.llnl.gov/cmip5/docs/cmip5_data_reference_syntax.pdf">http://cmip-pcmdi.llnl.gov/cmip5/docs/cmip5_data_reference_syntax.pdf</a>)<br>
can be applied to observational datasets that will be made part of the
same archive. A proposal based on recent workshops with PCMDI is
detailed on this wiki page:<br>
<br>
<u><span style='color:#144FAE'><a
href="http://oodt.jpl.nasa.gov/wiki/display/CLIMATE/Data+and+Metadata+Requirements+for+CMIP5+Observational+Datasets">http://oodt.jpl.nasa.gov/wiki/display/CLIMATE/Data+and+Metadata+Requirements+for+CMIP5+Observational+Datasets</a></span></u><o:p></o:p></p>
</div>
<div>
<p class=MsoNormal><u><span style='color:#144FAE'><br>
</span></u>As an example, the directory structure for the NASA AIRS dataset
would look like this:<br>
<br>
<root directory>/cmip5/observations/nasa/aqua/airs/mon/atmos/ta/l3/vYYYYMMDD/<files><br>
<br>
where:<br>
<br>
"observations"=<product>, same as DRS "output1" or
"output2"<br>
"nasa"=<agency>, same as DRS "institute"<br>
"aqua"=<mission>, replaces DRS "model"<br>
"airs"=<instrument>, replaces DRS "experiment"<br>
"l3"=<processing level>, replaces DRS "ensemble
member"<br>
vYYYYMMDD=the dated version, same as specified by the DRS<br>
<br>
The values for the various fields <agency>, <mission>,
<instrument> and <processing level> would need to be selected
from a controlled vocabulary similar to the one established for models.<br>
<br>
Any comment or insight on the matter is appreciated.... The idea is to try
to finalize the specification relatively quickly, let's say a couple of
weeks, so that we can start preparing<br>
and publishing these observations into the CMIP5 archive.<br>
<br>
thanks in advance,<br>
<br>
Luca<o:p></o:p></p>
<div>
<p class=MsoNormal><o:p> </o:p></p>
</div>
</div>
</div>
</div>
<p class=MsoNormal><o:p> </o:p></p>
</div>
</body>
</html>