<html><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><font class="Apple-style-span" size="4"><span class="Apple-style-span" style="font-size: 14px;">Hi Stephen,</span></font><div><font class="Apple-style-span" size="4"><span class="Apple-style-span" style="font-size: 14px;"><br></span></font></div><div><font class="Apple-style-span" size="4"><span class="Apple-style-span" style="font-size: 14px;">Let me clarify a few points in the description of ESG Publisher:</span></font></div><div><font class="Apple-style-span" size="4"><span class="Apple-style-span" style="font-size: 14px;"><br></span></font></div><div><div><p style="margin: 0.0px 0.0px 6.0px 0.0px; font: 12.0px Times"><font class="Apple-style-span" size="4"><span class="Apple-style-span" style="font-size: 14px;">The document states: "ESG Publisher version system is built around mutable datasets. It does not attempt to maintain references to previous data and the dataset version number is not part of the dataset id unless the publisher is configured to include it from the dataset metadata. This means that it is not straight forward at this time to publish multiple versions of an atomic dataset unless each version is published as a separate dataset. This approach would effectively ignore ESG Publisher's version system and manage all versions independently."</span></font></p><p style="margin: 0.0px 0.0px 6.0px 0.0px; font: 12.0px Times"><font class="Apple-style-span" size="4"><span class="Apple-style-span" style="font-size: 14px;"><font class="Apple-style-span" face="Helvetica">- As of Version 2 the unit of publication is in fact a 'dataset version', terminology that came out of the December meeting in Boulder. A dataset version is an immutable object which can represent a 'DRS dataset including version number'. The published 'dataset version' itself has an identifier which typically consists of dataset_id+version number; this appears in the THREDDS catalog. As you stated in the document, whether or not the published dataset corresponds to a DRS dataset is a matter of publisher configuration, not an inherent property of the publisher.</font></span></font></p><p style="margin: 0.0px 0.0px 6.0px 0.0px; font: 12.0px Times"><font class="Apple-style-span" size="4"><span class="Apple-style-span" style="font-size: 14px;"><font class="Apple-style-span" face="Helvetica">- The node database does in fact maintain references to the composition of previous dataset versions. It is possible to have multiple versions published simultaneously, to list all published versions of a dataset, and for any given dataset version the files contained in that version can be listed.</font></span></font></p><p style="margin: 0.0px 0.0px 6.0px 0.0px; font: 12.0px Times"><font class="Apple-style-span" size="4"><span class="Apple-style-span" style="font-size: 14px;"><font class="Apple-style-span" face="Helvetica">- The intention of the publisher design is to automate versioning as much as possible. A 'dataset' is considered to be a collection of dataset versions. Consequently, 'publishing a dataset' really means 'publishing a dataset version where the version number is incremented relative to the previous version.' Similarly, 'unpublishing' a dataset by default unpublishes all versions of a dataset. The terminology dataset_id#n can be used to refer to a specific version.</font></span></font></p><p style="margin: 0.0px 0.0px 6.0px 0.0px; font: 12.0px Times"><font class="Apple-style-span" face="Helvetica" size="4"><span class="Apple-style-span" style="font-size: 14px;"><br></span></font></p><p style="margin: 0.0px 0.0px 6.0px 0.0px; font: 12.0px Times"><font class="Apple-style-span" face="Helvetica" size="4"><span class="Apple-style-span" style="font-size: 14px;">In short, there is no fundamental mismatch between the DRS model and the ESG publisher.</span></font></p><p style="margin: 0.0px 0.0px 6.0px 0.0px; font: 12.0px Times"><font class="Apple-style-span" face="Helvetica" size="4"><span class="Apple-style-span" style="font-size: 14px;"><br></span></font></p><p style="margin: 0.0px 0.0px 6.0px 0.0px; font: 12.0px Times"><font class="Apple-style-span" face="Helvetica" size="4"><span class="Apple-style-span" style="font-size: 14px;">Best regards,</span></font></p><p style="margin: 0.0px 0.0px 6.0px 0.0px; font: 12.0px Times"><font class="Apple-style-span" face="Helvetica" size="4"><span class="Apple-style-span" style="font-size: 14px;"><br></span></font></p><p style="margin: 0.0px 0.0px 6.0px 0.0px; font: 12.0px Times"><font class="Apple-style-span" face="Helvetica" size="4"><span class="Apple-style-span" style="font-size: 14px;">Bob</span></font></p><p style="margin: 0.0px 0.0px 6.0px 0.0px; font: 12.0px Times"><font class="Apple-style-span" size="4"><span class="Apple-style-span" style="font-size: 14px;"><br></span></font></p><div><font class="Apple-style-span" size="4"><span class="Apple-style-span" style="font-size: 14px;"><br></span></font></div><div><font class="Apple-style-span" size="4"><span class="Apple-style-span" style="font-size: 14px;"><br></span></font></div><div><font class="Apple-style-span" size="4"><span class="Apple-style-span" style="font-size: 14px;">On Apr 15, 2010, at 3:24 AM, <<a href="mailto:stephen.pascoe@stfc.ac.uk">stephen.pascoe@stfc.ac.uk</a>> wrote:</span></font></div><font class="Apple-style-span" size="4"><span class="Apple-style-span" style="font-size: 14px;"><br class="Apple-interchange-newline"></span></font><blockquote type="cite"> <div> <div><span class="723111410-15042010"><font face="Arial"><font class="Apple-style-span" size="4"><span class="Apple-style-span" style="font-size: 14px;">Hi everyone,</span></font></font></span></div> <div><span class="723111410-15042010"><font class="Apple-style-span" size="4"><span class="Apple-style-span" style="font-size: 14px;"><font face="Arial"></font></span></font></span><font class="Apple-style-span" size="4"><span class="Apple-style-span" style="font-size: 14px;"> </span></font></div> <div><span class="723111410-15042010"><font face="Arial"><font class="Apple-style-span" size="4"><span class="Apple-style-span" style="font-size: 14px;">Attached is my view on how we should structure the archive to support multiple versions. It divides into 2 main sections, the first is a fairly lengthy summary of why this problem isn't solved yet in terms of the differences between the ESG datanode software and the DRS document. The second section lays out the proposed structure and how we would manage symbolic links and moving from one version to another. I restrict myself to directories below the atomic dataset level. </span></font></font></span></div> <div><span class="723111410-15042010"><font class="Apple-style-span" size="4"><span class="Apple-style-span" style="font-size: 14px;"><font face="Arial"></font></span></font></span><font class="Apple-style-span" size="4"><span class="Apple-style-span" style="font-size: 14px;"> </span></font></div> <div><span class="723111410-15042010"><font face="Arial"><font class="Apple-style-span" size="4"><span class="Apple-style-span" style="font-size: 14px;">Lots of issues are left to resolve, in particular how we ESG publisher can make use of this structure. I'll try and draw attention to these points in the agenda for Tuesday's telco which will follow later today.</span></font></font></span></div> <div><font class="Apple-style-span" size="4"><span class="Apple-style-span" style="font-size: 14px;"><font face="Arial"></font> </span></font></div> <div><span class="723111410-15042010"><font face="Arial"><font class="Apple-style-span" size="4"><span class="Apple-style-span" style="font-size: 14px;">Cheers,</span></font></font></span></div> <div><span class="723111410-15042010"><font face="Arial"><font class="Apple-style-span" size="4"><span class="Apple-style-span" style="font-size: 14px;">Stephen.</span></font></font></span></div> <div><span class="723111410-15042010"><font class="Apple-style-span" size="4"><span class="Apple-style-span" style="font-size: 14px;"><font face="Arial"></font></span></font></span><font class="Apple-style-span" size="4"><span class="Apple-style-span" style="font-size: 14px;"> </span></font></div> <div align="left"><font face="Arial"><font class="Apple-style-span" size="4"><span class="Apple-style-span" style="font-size: 14px;">---</span></font></font></div> <div align="left"><font face="Arial"><font class="Apple-style-span" size="4"><span class="Apple-style-span" style="font-size: 14px;">Stephen Pascoe +44 (0)1235 445980</span></font></font></div> <div align="left"><font face="Arial"><font class="Apple-style-span" size="4"><span class="Apple-style-span" style="font-size: 14px;">British Atmospheric Data Centre</span></font></font></div> <div align="left"><font face="Arial"><font class="Apple-style-span" size="4"><span class="Apple-style-span" style="font-size: 14px;">Rutherford Appleton Laboratory</span></font></font></div> <div><font class="Apple-style-span" size="4"><span class="Apple-style-span" style="font-size: 14px;"> </span></font></div> <font class="Apple-style-span" size="4"><span class="Apple-style-span" style="font-size: 14px;"><br></span></font><p><font class="Apple-style-span" size="4"><span class="Apple-style-span" style="font-size: 14px;">-- <br>Scanned by iCritical. </span></font></p> <font class="Apple-style-span" size="4"><span class="Apple-style-span" style="font-size: 14px;"><br></span></font></div> <span><font class="Apple-style-span" size="4"><span class="Apple-style-span" style="font-size: 14px;"><ESGF_version_structure.odt></span></font></span><font class="Apple-style-span" size="4"><span class="Apple-style-span" style="font-size: 14px;">_______________________________________________<br>GO-ESSP-TECH mailing list<br><a href="mailto:GO-ESSP-TECH@ucar.edu">GO-ESSP-TECH@ucar.edu</a><br>http://*mailman.ucar.edu/mailman/listinfo/go-essp-tech<br></span></font></blockquote></div><br></div></body></html>