<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN">
<HTML><HEAD>
<META content="text/html; charset=koi8-r" http-equiv=Content-Type>
<META name=GENERATOR content="MSHTML 8.00.6001.19170"></HEAD>
<BODY bgColor=#ffffff text=#000000>
<DIV dir=ltr align=left><SPAN lang=EN-AU>
<P><FONT face=Arial><FONT color=#0000ff><FONT size=2><SPAN
class=385512503-18042012>Hi,</SPAN></FONT></FONT></FONT></P>
<P><SPAN class=385512503-18042012></SPAN><FONT face=Arial><FONT
color=#0000ff><FONT size=2><SPAN class=385512503-18042012>The CSIRO Mk3.6 CMIP5
datasets included five </SPAN>additional historicalMisc experiments which
were named historicalAnt, historicalNoOz, historicalNoAA, historicalAA,
historicalAntNoAA.<SPAN class=385512503-18042012> </SPAN>We have since renamed
those experiments to historicalMisc<SPAN class=385512503-18042012> for
consistency with other groups</SPAN>. <SPAN
class=385512503-18042012>The </SPAN><SPAN
class=385512503-18042012>historicalXXX experiments have been renamed as
follows:</SPAN></FONT></FONT></FONT></P>
<P><FONT face=Arial><FONT color=#0000ff><FONT size=2><SPAN
class=385512503-18042012>historicalMisc r#i1p1 was previously
historicalAnt (anthropogenic-only)<BR>historicalMisc
r#i1p2 was previously historicalNoOz (all forcings except
ozone)<BR>historicalMisc r#i1p3 was previously historicalNoAA
(all forcings except anthropogenic aerosols)<BR>historicalMisc r#i1p4 was
previously historicalAA (anthropogenic aerosols
only)<BR>historicalMisc r#i1p5 was previously historicalAntNoAA (all forcings
except anthropogenic aerosols outside the Asian
region)</SPAN></FONT></FONT></FONT></P>
<P><FONT face=Arial><FONT color=#0000ff><FONT size=2><SPAN
class=385512503-18042012>The data within the files have not been changed, but
the metadata has changed. </SPAN></FONT></FONT></FONT><FONT color=#0000ff size=2
face=Arial>Our ESG is currently being rescanned to publish the data under the
new names - this usually takes several days.</FONT></P>
<P><SPAN class=385512503-18042012><FONT color=#0000ff size=2
face=Arial>cheers</FONT></SPAN></P><SPAN class=385512503-18042012>
<DIV align=left>
<P style="MARGIN: 0cm 0cm 0pt" class=MsoNormal align=left><FONT size=2><FONT
face=Arial>Stephen Jeffrey <?xml:namespace prefix = o ns =
"urn:schemas-microsoft-com:office:office" /><o:p></o:p></FONT></FONT></P>
<P style="MARGIN: 0cm 0cm 0pt" class=MsoNormal><FONT size=2><FONT
face=Arial><?xml:namespace prefix = st1 ns =
"urn:schemas-microsoft-com:office:smarttags" /><st1:State w:st="on"><st1:place
w:st="on">Queensland</st1:place></st1:State> Climate Change Centre of Excellence
<o:p></o:p></FONT></FONT></P>
<P style="MARGIN: 0cm 0cm 0pt" class=MsoNormal><FONT size=2
face=Arial>Department of Environment and Heritage Protection</FONT></P>
<P style="MARGIN: 0cm 0cm 0pt" class=MsoNormal><FONT size=2><FONT face=Arial>GPO
<st1:address w:st="on"><st1:Street w:st="on">Box</st1:Street>
2454</st1:address><o:p></o:p></FONT></FONT></P>
<P style="MARGIN: 0cm 0cm 0pt" class=MsoNormal><FONT size=2><FONT
face=Arial><st1:place w:st="on"><st1:City w:st="on">Brisbane</st1:City><SPAN
style="mso-spacerun: yes"> </SPAN><st1:State
w:st="on">Queensland</st1:State></st1:place> <SPAN
style="mso-spacerun: yes"> </SPAN>4001<o:p></o:p></FONT></FONT></P>
<P style="MARGIN: 0cm 0cm 0pt" class=MsoNormal><o:p><FONT size=2
face=Arial> </FONT></o:p></P>
<P style="MARGIN: 0cm 0cm 0pt" class=MsoNormal><FONT size=2><FONT
face=Arial>Telephone +61 (0)7 3170 5519 <SPAN
style="mso-spacerun: yes"> </SPAN>Fax +61 (0)7 3170
5802<o:p></o:p></FONT></FONT></P>
<P style="MARGIN: 0cm 0cm 0pt" class=MsoNormal><FONT size=2><FONT
face=Arial>Email:<SPAN style="mso-spacerun: yes">
</SPAN>stephen.jeffrey@qld.gov.au<o:p></o:p></FONT></FONT></P>
<P style="MARGIN: 0cm 0cm 0pt" class=MsoNormal><FONT size=2><FONT
face=Arial>www.climatechange.qld.gov.au<o:p></o:p></FONT></FONT></P></DIV></SPAN>
<P><SPAN class=385512503-18042012><FONT color=#0000ff size=2
face=Arial></FONT></SPAN> </P>
<P><SPAN class=385512503-18042012><FONT color=#0000ff size=2
face=Arial></FONT></SPAN> </P>
<P><SPAN class=385512503-18042012><FONT color=#0000ff size=2
face=Arial></FONT></SPAN> </P></SPAN></DIV>
<BLOCKQUOTE
style="BORDER-LEFT: #0000ff 2px solid; PADDING-LEFT: 5px; MARGIN-LEFT: 5px; MARGIN-RIGHT: 0px"
dir=ltr>
<BLOCKQUOTE
cite=mid:A196E27BFCD53648B78FA5AAE6BA205505B264B9@MINMAIL6.lands.resnet.qg
type="cite">
<BLOCKQUOTE
style="BORDER-LEFT: rgb(0,0,255) 2px solid; PADDING-LEFT: 5px; MARGIN-LEFT: 5px; MARGIN-RIGHT: 0px"
dir=ltr><BR>-------- Original Message --------
<TABLE class=moz-email-headers-table border=0 cellSpacing=0
cellPadding=0><TBODY>
<TR>
<TH vAlign=baseline noWrap align=right>Subject: </TH>
<TD>Re: [Go-essp-tech] Forcings on Historical</TD></TR>
<TR>
<TH vAlign=baseline noWrap align=right>Date: </TH>
<TD>Sat, 31 Mar 2012 10:09:47 -0700</TD></TR>
<TR>
<TH vAlign=baseline noWrap align=right>From: </TH>
<TD>Karl Taylor <A class=moz-txt-link-rfc2396E
href="mailto:taylor13@llnl.gov"
moz-do-not-send="true"><taylor13@llnl.gov></A></TD></TR>
<TR>
<TH vAlign=baseline noWrap align=right>To: </TH>
<TD>Muhammad Atif <A class=moz-txt-link-rfc2396E
href="mailto:muhammad.atif@anu.edu.au"
moz-do-not-send="true"><muhammad.atif@anu.edu.au></A></TD></TR>
<TR>
<TH vAlign=baseline noWrap align=right>CC: </TH>
<TD>Bryan Lawrence <A class=moz-txt-link-rfc2396E
href="mailto:bryan.lawrence@ncas.ac.uk"
moz-do-not-send="true"><bryan.lawrence@ncas.ac.uk></A>, <A
class=moz-txt-link-rfc2396E href="mailto:go-essp-tech@ucar.edu"
moz-do-not-send="true">"go-essp-tech@ucar.edu"</A> <A
class=moz-txt-link-rfc2396E href="mailto:go-essp-tech@ucar.edu"
moz-do-not-send="true"><go-essp-tech@ucar.edu></A>, Ben Evans
<A class=moz-txt-link-rfc2396E href="mailto:Ben.Evans@anu.edu.au"
moz-do-not-send="true"><Ben.Evans@anu.edu.au></A></TD></TR></TBODY></TABLE><BR><BR><FONT
face="Times New Roman">Dear Muhammad,<BR><BR>Thanks very much for
volunteering to help clean this up. As Bryan says, this will be a
huge help to users and will save countless hours of effort for folks
involved with ESGF development and those processing data.
There will be benefits for years to come.<BR><BR>I hope others copied will
read this and make sure I haven't forgotten anything.<BR><BR>There are
various degrees of conformance you might attempt, but I think renaming the
files and republishing are both essential. In the filenames,
please<BR><BR>1. Replace "historicalXXXX" with "historicalMisc" (for
the expts. listed in a previous email.)<BR>2. Replace "p1" with "pX",
where the integer X should take on a different value for each of the
different forcing runs (see 3 below for more info.)<BR><BR>You should send
Gavin Schmidt a table indicating which "p" value corresponds to which
forcing, as was requested in an email about a week ago. (If you
didn't get that email, please let me know.)<BR><BR>It would be desirable
(and perhaps essential -- others might chip in here) also to correct the
global attributes in the netCDF files themselves:<BR><BR>1. Set
experiment_id = 'historicalMisc'<BR>2. Set experiment = 'other historical
forcing'<BR>3. Replace physics_version with "p" value consistent with the
filename.<BR>physics_version = an integer (™1) referring to the physics
version used by the model If there is only one physics version of the
model, then this argument should be normally given the value 1. Note that
model versions that are substantially different should be given a
different “model_id”; assigning a different “physics_version” should be
reserved for closely-related model versions (e.g., as in a “perturbed
physics” ensemble) or for the same model, but with different forcing or
feedbacks active. In CMIP5, one would distinguish, for example, among runs
forced by different combinations of “forcing” agents (as called for under
the “historicalMisc” experiment – experiment 7.3) by assigning different
values to physics_version. For fields appearing in table “fx” in the CMIP5
Requested Output, set physics_version=0 (violating the general rule that
it should be a positive definite integer). Note that the physics_version
is used in constructing the “ensemble member” called for by the DRS
document; it is the value of L in r<N>i<M>p<L>.<BR>4.
Generate a new tracking_id which is "a string that is almost certainly
unique to this file and must be generated using the OSSP utility which
supports a number of different DCE 1.1 variant UUID options. For CMIP5
version 4 (random number based) is required. Download the software from <A
class=moz-txt-link-freetext href="http://www.ossp.org/pkg/lib/uuid/"
moz-do-not-send="true">http://www.ossp.org/pkg/lib/uuid/</A>. The
tracking_id might look something like:
02d9e6d5-9467-382e-8f9b-9300a64ac3cd."<BR>5. Also check that the "forcing"
attribute has the correct forcing identifier(s) (see <A
class=moz-txt-link-freetext
href="http://cmip-pcmdi.llnl.gov/cmip5/docs/cmip5_data_reference_Appendix1-2.doc"
moz-do-not-send="true">http://cmip-pcmdi.llnl.gov/cmip5/docs/cmip5_data_reference_Appendix1-2.doc</A>
)<BR><BR>I think this could be fairly easily scripted, but what sounds
easy often is not. If you are unfamiliar with netCDF Operators
(NCO), they can be used to rewrite attributes in netCDF
files.<BR><BR>After correcting the files and filenames, I think you will
have to republish. I hope others will provide guidance on
this.<BR><BR>Please include anyone you think is interested in these
emails.<BR><BR>Thanks again for helping clean things up. It is much
appreciated. <BR>And don't hesitate to write with any
questions.<BR><BR>Best regards,<BR>Karl<BR><BR></FONT><BR>On 3/30/12 10:58
PM, Muhammad Atif wrote:
<BLOCKQUOTE cite=mid:FEFFC6E5-40A4-4A33-8400-A7BBD9CE262C@anu.edu.au
type="cite"><PRE wrap="">Just to update; I had an email conversation with Estani when he first realised of the problem. We are prepared to do whatever might be required at the publishing end.
He suggested to wait for a nice solution.
btw, should I bring the modellers (CSIRO-QCCCE team) into the email loop as well?
Regards
On 31/03/2012, at 4:46 PM, Bryan Lawrence wrote:
</PRE>
<BLOCKQUOTE type="cite"><PRE wrap="">I think it'd be better to fix this at source, otherwise these problems will lurk for ever not only in ESGF, but on the hard drives of everyone who downloads the data - causing a potential problem for the actual science because everyone will have to have their own hacks to deal with it.
I realise this may be a bit unfair on folks who wrote their data in advance, but the flip-side is that not doing so is unfair on everyone who uses that data ...
Cheers
Bryan
</PRE>
<BLOCKQUOTE type="cite"><PRE wrap="">Hi Estani,
Yes, the official name for all of these is historicalMisc, and the
different runs should have been identified by a different "p" value in
the "rip", which distinguishes among members of an ensemble. The DRS
document describes this in more detail.
I *think* these datasets may have been generated prior to the DRS
controlled vocabulary being fully settled, so I haven't raised a stink
about this. I note that they show up in the old gateway1.3.4 search,
but not in the new p2p search.
Is there some way that the non-conforming experiment names could be
changed, so that users can find these experiments under historicalMisc?
Best regards,
Karl
On 3/30/12 3:19 AM, Estanislao Gonzalez wrote:
</PRE>
<BLOCKQUOTE type="cite"><PRE wrap="">Hi,
I'm trying to replicate data from CSIRO-QCCCE and I see the following
experiments names:
historicalNoOz
historicalNoAA
historicalAntNoAA
historicalAnt
historicalAA
These are used as the dataset id, e.g.
cmip5.output1.CSIRO-QCCCE.CSIRO-Mk3-6-0.historicalAA.fx.atmos.fx.r0i0p0
Shouldn't those be historicalMisc and the forcings detailed within the
global attributes?
By the way, we are also missing the contact data for CSIRO data node in
the CMIP5 Status Page.
Thanks,
Estani
</PRE></BLOCKQUOTE></BLOCKQUOTE><PRE wrap="">--
Bryan Lawrence
University of Reading: Professor of Weather and Climate Computing.
National Centre for Atmospheric Science: Director of Models and Data.
STFC: Director of the Centre for Environmental Data Archival.
Ph: +44 118 3786507 or 1235 445012; Web:home.badc.rl.ac.uk/lawrence
_______________________________________________
GO-ESSP-TECH mailing list
<A class=moz-txt-link-abbreviated href="mailto:GO-ESSP-TECH@ucar.edu" moz-do-not-send="true">GO-ESSP-TECH@ucar.edu</A>
<A class=moz-txt-link-freetext href="http://mailman.ucar.edu/mailman/listinfo/go-essp-tech" moz-do-not-send="true">http://mailman.ucar.edu/mailman/listinfo/go-essp-tech</A>
</PRE></BLOCKQUOTE><PRE wrap="">_______________________________________________
GO-ESSP-TECH mailing list
<A class=moz-txt-link-abbreviated href="mailto:GO-ESSP-TECH@ucar.edu" moz-do-not-send="true">GO-ESSP-TECH@ucar.edu</A>
<A class=moz-txt-link-freetext href="http://mailman.ucar.edu/mailman/listinfo/go-essp-tech" moz-do-not-send="true">http://mailman.ucar.edu/mailman/listinfo/go-essp-tech</A>
</PRE></BLOCKQUOTE></BLOCKQUOTE>
<P><SPAN
style="FONT-FAMILY: 'Courier New'; COLOR: rgb(0,0,0); FONT-SIZE: 9pt"></SPAN> </P>
<P><SPAN
style="FONT-FAMILY: 'Courier New'; COLOR: rgb(0,0,0); FONT-SIZE: 9pt">------------------------------</SPAN></P>
<P><SPAN
style="FONT-FAMILY: 'Courier New'; COLOR: rgb(0,0,0); FONT-SIZE: 9pt">The
information in this email together with any attachments is intended only for
the person or entity to which it is addressed and may contain confidential
and/or privileged material. There is no waiver of any
confidentiality/privilege by your inadvertent receipt of this material.
</SPAN></P>
<P><SPAN
style="FONT-FAMILY: 'Courier New'; COLOR: rgb(0,0,0); FONT-SIZE: 9pt">Any
form of review, disclosure, modification, distribution and/or publication of
this email message is prohibited, unless as a necessary part of Departmental
business.</SPAN></P>
<P><SPAN
style="FONT-FAMILY: 'Courier New'; COLOR: rgb(0,0,0); FONT-SIZE: 9pt">If you
have received this message in error, you are asked to inform the sender as
quickly as possible and delete this message and any copies of this message
from your computer and/or your computer system network.</SPAN></P>
<P><SPAN
style="FONT-FAMILY: 'Courier New'; COLOR: rgb(0,0,0); FONT-SIZE: 9pt">------------------------------</SPAN></P>
<P><SPAN
style="FONT-FAMILY: 'Courier New'; COLOR: rgb(0,0,0); FONT-SIZE: 9pt"></SPAN> </P></BLOCKQUOTE><BR><BR><PRE class=moz-signature cols="72">--
Muhammad Atif
ANU Supercomputer Facility NCI National Facility
Leonard Huxley, Mills Road Room 318, Bldg # 56
Australian National University Ph: +61 2 6125 5031
Canberra, ACT 0200, Australia M: 0430 393863
CRICOS Provider #00120C <A class=moz-txt-link-freetext href="http://anusf.anu.edu.au">http://anusf.anu.edu.au</A></PRE></BLOCKQUOTE></BODY></HTML>