<html>
<head>
<meta content="text/html; charset=windows-1252"
http-equiv="Content-Type">
</head>
<body bgcolor="#FFFFFF" text="#000000">
Martin,<br>
<br>
I got the impression of two control runs because different
experiments or different physics versions of one experiment "are
meant to be compared with" different disjoint segments of the
piControl files. Indeed other interpretations are possible; I could
be wrong. Moreover, I would not expect to see a substantive
difference between two control runs with the same physics, and two
widely separated segments of one control run. But there are two
bottom lines: (1) Jennifer's original issue was really whether the
time gap meant there was misssing data. Not in this case. (2) In
practice what matters is, as you say, that one should use the
:branch_time attribute (of the branching experiment, not the control
run).<br>
<br>
There is a related issue. Several modeling centers provide only a
year for the :branch_time. The specification which Jamie refers to,
says that the :branch_time should be a time in the units of the
parent experiment, not a year. I have been helping a scientist with
calculations that involve three experiments which branch from one
another. The compliant data, where the branch time is more
precisely specified, has been easier to deal with.<br>
<br>
- Jeff<br>
<br>
<br>
On 3/21/12 8:48 AM, <a class="moz-txt-link-abbreviated" href="mailto:martin.juckes@stfc.ac.uk">martin.juckes@stfc.ac.uk</a> wrote:
<blockquote
cite="mid:E21FBC3F00D7304687CB46529F9676D7265EA16C@EXCHMBX01.fed.cclrc.ac.uk"
type="cite">
<meta http-equiv="Content-Type" content="text/html;
charset=windows-1252">
<meta name="Generator" content="Microsoft Word 12 (filtered
medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]-->
<style><!--
/* Font Definitions */
@font-face
{font-family:Helvetica;
panose-1:2 11 6 4 2 2 2 2 2 4;}
@font-face
{font-family:Courier;
panose-1:2 7 4 9 2 2 5 2 4 4;}
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
span.apple-style-span
{mso-style-name:apple-style-span;}
span.EmailStyle18
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 72.0pt 72.0pt 72.0pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
<div class="WordSection1">
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">Hi
Jeff,<o:p></o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif""><o:p> </o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">Where
do you get the information that there are two control runs,
as opposed to a single run for which two segments are
archived? Ken appears to suggest that it is a single run for
which two segments have been saved. <o:p></o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif""><o:p> </o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">As
Jamie suggests, it is the “branch_time” attribute in the
branching experiment that you need to look at – it is only
relevant here because it enters into the specification of
the data requested. I.e. people are asked to provide data
for periods matching those in the branched historical
experiments. In the present instance that request appears to
result in disjoint segments of data being archived,<o:p></o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif""><o:p> </o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">Cheers,<o:p></o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">Martin<o:p></o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<div style="border:none;border-left:solid blue 1.5pt;padding:0cm
0cm 0cm 4.0pt">
<div>
<div style="border:none;border-top:solid #B5C4DF
1.0pt;padding:3.0pt 0cm 0cm 0cm">
<p class="MsoNormal"><b><span
style="font-size:10.0pt;font-family:"Tahoma","sans-serif""
lang="EN-US">From:</span></b><span
style="font-size:10.0pt;font-family:"Tahoma","sans-serif""
lang="EN-US"> <a class="moz-txt-link-abbreviated" href="mailto:go-essp-tech-bounces@ucar.edu">go-essp-tech-bounces@ucar.edu</a>
[<a class="moz-txt-link-freetext" href="mailto:go-essp-tech-bounces@ucar.edu">mailto:go-essp-tech-bounces@ucar.edu</a>]
<b>On Behalf Of </b>Kettleborough, Jamie<br>
<b>Sent:</b> 21 March 2012 14:51<br>
<b>To:</b> Jennifer Adams; <a class="moz-txt-link-abbreviated" href="mailto:go-essp-tech@ucar.edu">go-essp-tech@ucar.edu</a><br>
<b>Subject:</b> Re: [Go-essp-tech] Data file gaps<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><span
style="font-size:10.0pt;font-family:"Arial","sans-serif";color:blue">Hello
Jennifer,</span><o:p></o:p></p>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:10.0pt;font-family:"Arial","sans-serif";color:blue">did
you check the branch_time of the piControl sections or the
historicalMisc (p1) and historical etc that Ken mentions -
I think its the historical runs that Ken mentions that
should have the correct branch times, with the
parent_experiment_id pointing to piControl. The branch
time is described in one of Karl's documents...
<a moz-do-not-send="true"
href="http://cmip-pcmdi.llnl.gov/cmip5/docs/CMIP5_output_metadata_requirements.pdf">http://cmip-pcmdi.llnl.gov/cmip5/docs/CMIP5_output_metadata_requirements.pdf</a> -
though the most obvious route to this document I know is
through the 'data providers' item on the CMIP5 web page.
Karl - is it worth makeing this more obviously relevant to
data users too?</span><o:p></o:p></p>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:10.0pt;font-family:"Arial","sans-serif";color:blue">I
don't know whether its worth trying to capture an expanded
version of Kens explanation somewhere for all data users
to see. If it is then where?</span><o:p></o:p></p>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:10.0pt;font-family:"Arial","sans-serif";color:blue">For
what its worth branch_time is one of those things that we
found fairly hard to get right when we were producing
data.</span><o:p></o:p></p>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:10.0pt;font-family:"Arial","sans-serif";color:blue">Jamie</span><o:p></o:p></p>
<blockquote style="border:none;border-left:solid blue
1.5pt;padding:0cm 0cm 0cm
4.0pt;margin-left:3.75pt;margin-top:5.0pt;margin-right:0cm;margin-bottom:5.0pt">
<p class="MsoNormal"><o:p> </o:p></p>
<div class="MsoNormal" style="text-align:center"
align="center"><span lang="EN-US">
<hr align="center" size="2" width="100%">
</span></div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><b><span
style="font-size:10.0pt;font-family:"Tahoma","sans-serif""
lang="EN-US">From:</span></b><span
style="font-size:10.0pt;font-family:"Tahoma","sans-serif""
lang="EN-US"> <a class="moz-txt-link-abbreviated" href="mailto:go-essp-tech-bounces@ucar.edu">go-essp-tech-bounces@ucar.edu</a>
[<a class="moz-txt-link-freetext" href="mailto:go-essp-tech-bounces@ucar.edu">mailto:go-essp-tech-bounces@ucar.edu</a>]
<b>On Behalf Of </b>Jennifer Adams<br>
<b>Sent:</b> 21 March 2012 14:04<br>
<b>To:</b> <a class="moz-txt-link-abbreviated" href="mailto:go-essp-tech@ucar.edu">go-essp-tech@ucar.edu</a><br>
<b>Subject:</b> Re: [Go-essp-tech] Data file gaps</span><span
lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal">Ken Lo's explanation makes me want to
laugh and cry at the same time. I see a global attribute
called "branch_time", but for the handful of random files
from I checked from both periods it is set to "0."
--Jennifer
<o:p></o:p></p>
<div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div>
<p class="MsoNormal">On Mar 20, 2012, at 7:13 PM,
Jeffrey F. Painter wrote:<o:p></o:p></p>
</div>
<p class="MsoNormal"><br>
<br>
<o:p></o:p></p>
<div>
<p class="MsoNormal">I can shed some light on one
of the gaps: the GISS-E2-R piControl files
actually contain TWO control runs! One side of
the gap is one control run, and the other side
of the gap is the other control run. I
cut-and-pasted a message from Ken Lo about this,
at the bottom of this message.<br>
<br>
- Jeff<br>
<br>
On 3/20/12 11:55 AM, Karl Taylor wrote: <o:p></o:p></p>
<p class="MsoNormal">database problem??<br>
<br>
-------- Original Message -------- <o:p></o:p></p>
<table class="MsoNormalTable" border="0"
cellpadding="0" cellspacing="0">
<tbody>
<tr>
<td style="padding:0cm 0cm 0cm 0cm"
nowrap="nowrap" valign="top">
<p class="MsoNormal"
style="text-align:right" align="right"><b>Subject:
<o:p></o:p></b></p>
</td>
<td style="padding:0cm 0cm 0cm 0cm">
<p class="MsoNormal">[Go-essp-tech] Data
file gaps<o:p></o:p></p>
</td>
</tr>
<tr>
<td style="padding:0cm 0cm 0cm 0cm"
nowrap="nowrap" valign="top">
<p class="MsoNormal"
style="text-align:right" align="right"><b>Date:
<o:p></o:p></b></p>
</td>
<td style="padding:0cm 0cm 0cm 0cm">
<p class="MsoNormal">Tue, 20 Mar 2012
11:50:07 -0700<o:p></o:p></p>
</td>
</tr>
<tr>
<td style="padding:0cm 0cm 0cm 0cm"
nowrap="nowrap" valign="top">
<p class="MsoNormal"
style="text-align:right" align="right"><b>From:
<o:p></o:p></b></p>
</td>
<td style="padding:0cm 0cm 0cm 0cm">
<p class="MsoNormal">Jennifer Adams <a
moz-do-not-send="true"
href="mailto:jma@cola.iges.org"><jma@cola.iges.org></a><o:p></o:p></p>
</td>
</tr>
<tr>
<td style="padding:0cm 0cm 0cm 0cm"
nowrap="nowrap" valign="top">
<p class="MsoNormal"
style="text-align:right" align="right"><b>To:
<o:p></o:p></b></p>
</td>
<td style="padding:0cm 0cm 0cm 0cm">
<p class="MsoNormal"><a
moz-do-not-send="true"
href="mailto:go-essp-tech@ucar.edu">go-essp-tech@ucar.edu</a>
<a moz-do-not-send="true"
href="mailto:go-essp-tech@ucar.edu"><go-essp-tech@ucar.edu></a><o:p></o:p></p>
</td>
</tr>
</tbody>
</table>
<p class="MsoNormal" style="margin-bottom:12.0pt"><o:p> </o:p></p>
<div>
<p class="MsoNormal"><span
class="apple-style-span"><span
style="font-size:10.5pt">Dear All,</span></span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span
class="apple-style-span"><span
style="font-size:10.5pt">I have a GrADS
script that creates descriptor files for
CMIP5 data, and it has uncovered some gaps
in the date strings of files that belong
to an atomic data set. I have checked the
ESGF gateways for all the datasets listed
below and I can confirm that these files
are missing for some variables. I haven't
given the variable names, because I have
only checked the subset of variables that
are of interest to me and that may not be
a complete list. If the specific var names
that I checked would be useful, I can
provide them. While checking on these
gaps, I noticed that not all variables in
an atomic dataset span the same time range
… an inconsistency that doesn't quite make
sense to me. I also noticed that in some
cases, data files that I had grabbed are
no longer listed on the gateway, even
though the version number is the same. An
example is
</span></span><span class="apple-style-span"><span
style="font-size:10.5pt;font-family:Courier">cmip5.output1.NCC.NorESM1-M.piControl.day.land.day.r1i1p1.v20110901,
mrsos, date range 11000101-12001231. </span></span><span
class="apple-style-span"><span
style="font-size:10.5pt">What does that
mean? </span></span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"><span
class="apple-style-span"><span
style="font-size:10.5pt">The gaps put
these data into the "not quite usable"
category. I wasn't sure whether to send
this to the helpdesk or the forum or both;
in the end I am just posting here.</span></span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span
class="apple-style-span"><span
style="font-size:10.5pt">--Jennifer</span></span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"><span
class="apple-style-span"><span
style="font-size:10.5pt;font-family:Courier"> 11880
times missing in
cmip5.output1.NASA-GISS.GISS-E2-H.piControl.mon.atmos.Amon.r1i1p1
between 141912 and 241001</span></span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span
class="apple-style-span"><span
style="font-size:10.5pt;font-family:Courier"> 11880
times missing in
cmip5.output1.NASA-GISS.GISS-E2-H.piControl.mon.land.Lmon.r1i1p1
between 141912 and 241001</span></span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span
class="apple-style-span"><span
style="font-size:10.5pt;font-family:Courier">
4200 times missing in
cmip5.output1.NASA-GISS.GISS-E2-R.piControl.mon.land.Lmon.r1i1p1
between 363012 and 398101 </span></span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span
class="apple-style-span"><span
style="font-size:10.5pt;font-family:Courier"> 11880
times missing in
cmip5.output1.NASA-GISS.GISS-E2-H.piControl.mon.ocean.Omon.r1i1p1
between 141912 and 241001</span></span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span
class="apple-style-span"><span
style="font-size:10.5pt;font-family:Courier">
4200 times missing in
cmip5.output1.NASA-GISS.GISS-E2-R.piControl.mon.ocean.Omon.r1i1p1
between 363012 and 398101 </span></span><o:p></o:p></p>
</div>
<div>
<div>
<p class="MsoNormal"><span
class="apple-style-span"><span
style="font-size:10.5pt;font-family:Courier">
1 times missing in
cmip5.output1.MOHC.HadGEM2-CC.historical.mon.ocean.Omon.r3i1p1
between 200110 and 200112</span></span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span
class="apple-style-span"><span
style="font-size:10.5pt;font-family:Courier">
60 times missing in
cmip5.output1.NOAA-GFDL.GFDL-ESM2M.piControl.mon.land.Lmon.r1i1p1
between 017012 and 017601</span></span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span
class="apple-style-span"><span
style="font-size:10.5pt;font-family:Courier">
60 times missing in
cmip5.output1.NOAA-GFDL.GFDL-ESM2M.piControl.mon.land.Lmon.r1i1p1
between 003012 and 003601</span></span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span
class="apple-style-span"><span
style="font-size:10.5pt;font-family:Courier">
3650 times missing in
cmip5.output1.NOAA-GFDL.GFDL-CM3.piControl.day.atmos.day.r1i1p1
between 00101231 and 00210101</span></span><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span
class="apple-style-span"><span
style="font-size:10.5pt;font-family:Courier">
1825 times missing in
cmip5.output1.NOAA-GFDL.GFDL-CM3.piControl.day.atmos.day.r1i1p1
between 00401231 and 00460101</span></span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span
class="apple-style-span"><span
style="font-size:10.5pt;font-family:Courier">
7300 times missing in
cmip5.output1.NOAA-GFDL.GFDL-CM3.piControl.day.atmos.day.r1i1p1
between 00751231 and 00960101</span></span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span
class="apple-style-span"><span
style="font-size:10.5pt;font-family:Courier">142350
times missing in
cmip5.output1.NOAA-GFDL.GFDL-CM3.piControl.day.atmos.day.r1i1p1
between 01001231 and 04910101</span></span><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span
style="font-size:10.5pt;font-family:Courier"> 73000
times missing in
cmip5.output1.NCC.NorESM1-M.piControl.day.land.day.r1i1p1
between 08991231 and 11000101<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span
style="font-size:10.5pt;font-family:Courier"> 29220
times missing in
cmip5.output1.MPI-M.MPI-ESM-LR.rcp85.day.atmos.day.r1i1p1
between 22001231 and 22810101 <o:p></o:p></span></p>
</div>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<div>
<p class="MsoNormal"><span
style="font-size:9.0pt">--<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span
style="font-size:9.0pt">Jennifer M. Adams<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span
style="font-size:9.0pt">IGES/COLA<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span
style="font-size:9.0pt">4041 Powder Mill
Road, Suite 302<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span
style="font-size:9.0pt">Calverton, MD
20705<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span
style="font-size:9.0pt"><a
moz-do-not-send="true"
href="mailto:jma@cola.iges.org">jma@cola.iges.org</a><o:p></o:p></span></p>
</div>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<p class="MsoNormal">On 11/4/11 6:07 AM, Ken Lo
wrote: <br>
Dear Jeff Painter, <br>
<br>
Years 3331 to 3630 of the control run are meant
to be compared with <br>
historicalMisc (p1), while years 3981 to 4530
are meant to be compared <br>
with historical, historicalMisc (p109),
historicalGHG, historicalNat <br>
and rcp runs (all p1 except indicated
otherwise). The appropriate years <br>
for comparison are written in the branch time of
the metadata of each <br>
file. <o:p></o:p></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div>
<p class="MsoNormal"><span
style="font-size:9.0pt;font-family:"Helvetica","sans-serif";color:black">--<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span
style="font-size:9.0pt;font-family:"Helvetica","sans-serif";color:black">Jennifer
M. Adams<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span
style="font-size:9.0pt;font-family:"Helvetica","sans-serif";color:black">IGES/COLA<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span
style="font-size:9.0pt;font-family:"Helvetica","sans-serif";color:black">4041
Powder Mill Road, Suite 302<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span
style="font-size:9.0pt;font-family:"Helvetica","sans-serif";color:black">Calverton,
MD 20705<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span
style="font-size:9.0pt;font-family:"Helvetica","sans-serif";color:black"><a
moz-do-not-send="true"
href="mailto:jma@cola.iges.org">jma@cola.iges.org</a><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span
style="font-size:9.0pt;font-family:"Helvetica","sans-serif";color:black"><o:p> </o:p></span></p>
</div>
<p class="MsoNormal"><span
style="font-size:9.0pt;font-family:"Helvetica","sans-serif";color:black"><br>
<br>
</span><o:p></o:p></p>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</div>
</div>
</blockquote>
</div>
</div>
<br>
<p>-- <br>
Scanned by iCritical.
</p>
<br>
</blockquote>
</body>
</html>