<html><head></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; ">I checked the branch_time from a file in this dataset, <span class="Apple-style-span" style="color: rgb(105, 7, 5); font-family: Courier; font-size: 14px; ">cmip5.output1.NASA-GISS.GISS-E2-R.historical.mon.land.Lmon.r1i1p1</span>, and it was 3981. So I guess I understand this one example, but not without help from Ken Lo and the gentle guidance from others here in the forum. I'd say the risk of users mis-understanding the subtleties of how to use this data is pretty high. <div><br></div><div>Any ideas about the other data gaps I found and the files that went AWOL without a version number change? If I have data that has been de-published, should I assume it shouldn't be used and toss it ? </div><div>--Jennifer</div><div><br><div><div><br class="Apple-interchange-newline"><blockquote type="cite">
<meta content="text/html; charset=windows-1252" http-equiv="Content-Type">
<div bgcolor="#FFFFFF" text="#000000">
<font face="Times New Roman">Hi Jennifer and all,<br>
<br>
Data writers were instructed to set "branch_time=0." if a run was
*not* initialized from another run (or in cases when this was
irrelevant ... e.g., some control runs). Perhaps this accounts
for the cases you examined?<br>
<br>
regards,<br>
Karl<br>
</font><br>
On 3/21/12 7:03 AM, Jennifer Adams wrote:
<blockquote cite="mid:D1309082-D8C8-4AAA-91AC-620307B3812E@cola.iges.org" type="cite">Ken Lo's explanation makes me want to laugh and cry at
the same time. I see a global attribute called "branch_time", but
for the handful of random files from I checked from both periods
it is set to "0." --Jennifer
<div>
<div><br>
<div><br>
<div>
<div>On Mar 20, 2012, at 7:13 PM, Jeffrey F. Painter
wrote:</div>
<br class="Apple-interchange-newline">
<blockquote type="cite">
<meta content="text/html; charset=windows-1252" http-equiv="Content-Type">
<div bgcolor="#FFFFFF" text="#000000"> I can shed some
light on one of the gaps: the GISS-E2-R piControl
files actually contain TWO control runs! One side of
the gap is one control run, and the other side of the
gap is the other control run. I cut-and-pasted a
message from Ken Lo about this, at the bottom of this
message.<br>
<br>
- Jeff<br>
<br>
On 3/20/12 11:55 AM, Karl Taylor wrote:
<blockquote cite="mid:4F68D2BF.9050004@llnl.gov" type="cite">
<meta http-equiv="content-type" content="text/html;
charset=windows-1252">
database problem??<br>
<br>
-------- Original Message --------
<table class="moz-email-headers-table" border="0" cellpadding="0" cellspacing="0">
<tbody>
<tr>
<th align="RIGHT" nowrap="nowrap" valign="BASELINE">Subject: </th>
<td>[Go-essp-tech] Data file gaps</td>
</tr>
<tr>
<th align="RIGHT" nowrap="nowrap" valign="BASELINE">Date: </th>
<td>Tue, 20 Mar 2012 11:50:07 -0700</td>
</tr>
<tr>
<th align="RIGHT" nowrap="nowrap" valign="BASELINE">From: </th>
<td>Jennifer Adams <a moz-do-not-send="true" class="moz-txt-link-rfc2396E" href="mailto:jma@cola.iges.org"><jma@cola.iges.org></a></td>
</tr>
<tr>
<th align="RIGHT" nowrap="nowrap" valign="BASELINE">To: </th>
<td><a moz-do-not-send="true" class="moz-txt-link-abbreviated" href="mailto:go-essp-tech@ucar.edu">go-essp-tech@ucar.edu</a>
<a moz-do-not-send="true" class="moz-txt-link-rfc2396E" href="mailto:go-essp-tech@ucar.edu"><go-essp-tech@ucar.edu></a></td>
</tr>
</tbody>
</table>
<br>
<br>
<div><span class="Apple-style-span" style="font-size: 14px;">Dear All,</span></div>
<div><span class="Apple-style-span" style="font-size: 14px;">I have a GrADS script
that creates descriptor files for CMIP5 data,
and it has uncovered some gaps in the date
strings of files that belong to an atomic data
set. I have checked the ESGF gateways for all
the datasets listed below and I can confirm that
these files are missing for some variables. I
haven't given the variable names, because I have
only checked the subset of variables that are of
interest to me and that may not be a complete
list. If the specific var names that I checked
would be useful, I can provide them. While
checking on these gaps, I noticed that not all
variables in an atomic dataset span the same
time range … an inconsistency that doesn't quite
make sense to me. I also noticed that in some
cases, d</span><span class="Apple-style-span" style="font-size: 14px; ">ata files that I had
grabbed are no longer listed on the gateway,
even though the version number is the same. An
example is </span><span class="Apple-style-span" style="font-size: 14px;
"><span class="Apple-style-span" style="font-family: Courier; font-size: 14px;
">cmip5.output1.NCC.NorESM1-M.piControl.day.land.day.r1i1p1.v20110901,
mrsos, date range 11000101-12001231. </span></span><span class="Apple-style-span" style="font-size: 14px;
">What does that mean?</span><span class="Apple-style-span" style="font-size: 14px;
"> </span></div>
<div><span class="Apple-style-span" style="font-size: 14px;"><br>
</span></div>
<div><span class="Apple-style-span" style="font-size: 14px;">The gaps put these data
into the "not quite usable" category. I wasn't
sure whether to send this to the helpdesk or the
forum or both; in the end I am just posting
here.</span></div>
<div><span class="Apple-style-span" style="font-size: 14px;">--Jennifer</span></div>
<div><span class="Apple-style-span" style="font-size: 14px;"><br>
</span></div>
<div><font class="Apple-style-span" face="Courier"><span class="Apple-style-span" style="font-size:
14px;"> 11880 times missing in
cmip5.output1.NASA-GISS.GISS-E2-H.piControl.mon.atmos.Amon.r1i1p1
between 141912 and 241001</span></font></div>
<div><font class="Apple-style-span" face="Courier"><span class="Apple-style-span" style="font-size:
14px;"> 11880 times missing in
cmip5.output1.NASA-GISS.GISS-E2-H.piControl.mon.land.Lmon.r1i1p1
between 141912 and 241001</span></font></div>
<div><font class="Apple-style-span" face="Courier"><span class="Apple-style-span" style="font-size:
14px;"> 4200 times missing in
cmip5.output1.NASA-GISS.GISS-E2-R.piControl.mon.land.Lmon.r1i1p1
between 363012 and 398101 </span></font></div>
<div><font class="Apple-style-span" face="Courier"><span class="Apple-style-span" style="font-size:
14px;"> 11880 times missing in
cmip5.output1.NASA-GISS.GISS-E2-H.piControl.mon.ocean.Omon.r1i1p1
between 141912 and 241001</span></font></div>
<div><span class="Apple-style-span" style="font-family: Courier; font-size: 14px; ">
4200 times missing in
cmip5.output1.NASA-GISS.GISS-E2-R.piControl.mon.ocean.Omon.r1i1p1
between 363012 and 398101 </span></div>
<div>
<div><span class="Apple-style-span" style="font-family: Courier; font-size: 14px;
"> 1 times missing in
cmip5.output1.MOHC.HadGEM2-CC.historical.mon.ocean.Omon.r3i1p1
between 200110 and 200112</span></div>
<div><span class="Apple-style-span" style="font-family: Courier; font-size: 14px;
"> 60 times missing in
cmip5.output1.NOAA-GFDL.GFDL-ESM2M.piControl.mon.land.Lmon.r1i1p1
between 017012 and 017601</span></div>
<div><font class="Apple-style-span" face="Courier"><span class="Apple-style-span" style="font-size:
14px; "> 60 times missing in
cmip5.output1.NOAA-GFDL.GFDL-ESM2M.piControl.mon.land.Lmon.r1i1p1
between 003012 and 003601</span></font></div>
<div><span class="Apple-style-span" style="font-family: Courier; font-size: 14px;
"> 3650 times missing in
cmip5.output1.NOAA-GFDL.GFDL-CM3.piControl.day.atmos.day.r1i1p1
between 00101231 and 00210101</span></div>
</div>
<div>
<div><font class="Apple-style-span" face="Courier"><span class="Apple-style-span" style="font-size:
14px;"> 1825 times missing in
cmip5.output1.NOAA-GFDL.GFDL-CM3.piControl.day.atmos.day.r1i1p1
between 00401231 and 00460101</span></font></div>
<div><font class="Apple-style-span" face="Courier"><span class="Apple-style-span" style="font-size:
14px;"> 7300 times missing in
cmip5.output1.NOAA-GFDL.GFDL-CM3.piControl.day.atmos.day.r1i1p1
between 00751231 and 00960101</span></font></div>
<div><font class="Apple-style-span" face="Courier"><span class="Apple-style-span" style="font-size:
14px;">142350 times missing in
cmip5.output1.NOAA-GFDL.GFDL-CM3.piControl.day.atmos.day.r1i1p1
between 01001231 and 04910101</span></font></div>
</div>
<div><font class="Apple-style-span" face="Courier"><span class="Apple-style-span" style="font-size:
14px;">
<div> 73000 times missing in
cmip5.output1.NCC.NorESM1-M.piControl.day.land.day.r1i1p1
between 08991231 and 11000101</div>
<div> 29220 times missing in
cmip5.output1.MPI-M.MPI-ESM-LR.rcp85.day.atmos.day.r1i1p1
between 22001231 and 22810101 </div>
</span></font></div>
<div><br>
</div>
<div>
<div style="font-size: 12px; ">--</div>
<div style="font-size: 12px; ">Jennifer M. Adams</div>
<div style="font-size: 12px; ">IGES/COLA</div>
<div style="font-size: 12px; ">4041 Powder Mill
Road, Suite 302</div>
<div style="font-size: 12px; ">Calverton, MD 20705</div>
<div style="font-size: 12px; "><a moz-do-not-send="true" href="mailto:jma@cola.iges.org">jma@cola.iges.org</a></div>
</div>
<div><br>
</div>
<div><br>
</div>
<div><br>
</div>
<div><br>
</div>
</blockquote>
On 11/4/11 6:07 AM, Ken Lo wrote: <br>
Dear Jeff Painter, <br>
<br>
Years 3331 to 3630 of the control run are meant to be
compared with <br>
historicalMisc (p1), while years 3981 to 4530 are
meant to be compared <br>
with historical, historicalMisc (p109), historicalGHG,
historicalNat <br>
and rcp runs (all p1 except indicated otherwise). The
appropriate years <br>
for comparison are written in the branch time of the
metadata of each <br>
file. </div>
</blockquote>
</div>
<br>
<div apple-content-edited="true">
<span class="Apple-style-span" style="border-collapse: separate; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; -webkit-text-decorations-in-effect: none; text-indent: 0px; -webkit-text-size-adjust: auto; text-transform: none; orphans: 2; white-space: normal; widows: 2; word-spacing: 0px; "><span class="Apple-style-span" style="border-collapse: separate; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; -webkit-text-decorations-in-effect: none; text-indent: 0px; -webkit-text-size-adjust: auto; text-transform: none; orphans: 2; white-space: normal; widows: 2; word-spacing: 0px; "><span class="Apple-style-span" style="border-collapse: separate; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; -webkit-text-decorations-in-effect: none; text-indent: 0px; -webkit-text-size-adjust: auto; text-transform: none; orphans: 2; white-space: normal; widows: 2; word-spacing: 0px; ">
<div>--</div>
<div>Jennifer M. Adams</div>
<div>IGES/COLA</div>
<div>4041 Powder Mill Road, Suite 302</div>
<div>Calverton, MD 20705</div>
<div><a moz-do-not-send="true" href="mailto:jma@cola.iges.org">jma@cola.iges.org</a></div>
<div><br class="khtml-block-placeholder">
</div>
<br class="Apple-interchange-newline">
</span></span></span>
</div>
<br>
</div>
</div>
</div>
</blockquote>
</div>
_______________________________________________<br>GO-ESSP-TECH mailing list<br><a href="mailto:GO-ESSP-TECH@ucar.edu">GO-ESSP-TECH@ucar.edu</a><br>http://mailman.ucar.edu/mailman/listinfo/go-essp-tech<br></blockquote></div><br><div apple-content-edited="true">
<span class="Apple-style-span" style="border-collapse: separate; border-spacing: 0px 0px; color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; text-align: auto; -khtml-text-decorations-in-effect: none; text-indent: 0px; -apple-text-size-adjust: auto; text-transform: none; orphans: 2; white-space: normal; widows: 2; word-spacing: 0px; "><span class="Apple-style-span" style="border-collapse: separate; border-spacing: 0px 0px; color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; text-align: auto; -khtml-text-decorations-in-effect: none; text-indent: 0px; -apple-text-size-adjust: auto; text-transform: none; orphans: 2; white-space: normal; widows: 2; word-spacing: 0px; "><span class="Apple-style-span" style="border-collapse: separate; border-spacing: 0px 0px; color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; text-align: auto; -khtml-text-decorations-in-effect: none; text-indent: 0px; -apple-text-size-adjust: auto; text-transform: none; orphans: 2; white-space: normal; widows: 2; word-spacing: 0px; "><div>--</div><div>Jennifer M. Adams</div><div>IGES/COLA</div><div>4041 Powder Mill Road, Suite 302</div><div>Calverton, MD 20705</div><div><a href="mailto:jma@cola.iges.org">jma@cola.iges.org</a></div><div><br class="khtml-block-placeholder"></div><br class="Apple-interchange-newline"></span></span></span>
</div>
<br></div></div></body></html>