<html><head></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><div class="ace-line" id="magicdomid113"><span class="author-g-xwhvryte8gpg5h0z122z">Hi Everyone,</span></div><div class="ace-line" id="magicdomid115"><br></div><div class="ace-line" id="magicdomid2874"><span class="author-g-xwhvryte8gpg5h0z122z">On
Tuesday 15 June the go-essp-tech call will cover metadata. Below is
the metadata pipeline as I understand it. Given the fact that we only
have an hour, I have listed the items in order of priority. I have
placed content of this email on etherpad (</span><span class="author-g-xwhvryte8gpg5h0z122z url"><a href="http://openetherpad.org/L8xHFG9ywd%29">http://openetherpad.org/L8xHFG9ywd)</a></span><span class="author-g-xwhvryte8gpg5h0z122z">. I will be taking live notes at this URL during the call. Participants are welcome join me as I do this.</span></div><div class="ace-line" id="magicdomid163"><br></div><div class="ace-line" id="magicdomid2984"><span class="author-g-xwhvryte8gpg5h0z122z">Since
I last sent out this email, both the ESG's and METAFOR's questionnaire
schedules have shifted significantly. I have adjusted the target due
dates accordingly. </span></div><div class="ace-line" id="magicdomid416"><br></div><div class="ace-line" id="magicdomid2871"><span class="author-g-xwhvryte8gpg5h0z122z">SCHEDULES:</span></div><div class="ace-line" id="magicdomid9"><br></div><div class="ace-line" id="magicdomid452"><span class="author-g-xwhvryte8gpg5h0z122z">Please
note that Curator's timelines are synced with those of ESG. Below is
ESG's current release schedule, which can also be viewed at </span><span class="author-g-xwhvryte8gpg5h0z122z url"><a href="https://wiki.ucar.edu/display/esgcet/ESG+Gateway+Release+Roadmap">https://wiki.ucar.edu/display/esgcet/ESG+Gateway+Release+Roadmap</a></span><span class="author-g-xwhvryte8gpg5h0z122z">.</span></div><div class="ace-line" id="magicdomid454"><br></div><div class="ace-line" id="magicdomid2933"><span class="author-g-xwhvryte8gpg5h0z122z">Please
note that code freezes occur TWO WEEKS before these dates. Only bug
fixes are allowed after a freeze. Also note that new features should
be demonstrated </span><span class="author-g-x7tu98lffwvcz122zm6q">AT LEAST </span><span class="author-g-xwhvryte8gpg5h0z122z">THREE</span><span class="author-g-x7tu98lffwvcz122zm6q"> </span><span class="author-g-xwhvryte8gpg5h0z122z">WEEKS before any release so that changes can be made before the freeze. I have put these dates into the list below. </span></div><div class="ace-line" id="magicdomid11"><br></div><div class="ace-line" id="magicdomid870"><span class="author-g-xwhvryte8gpg5h0z122z">1.1 July 15th (Freeze: July 1st, Demontration Deadline: June 24th)</span></div><div class="ace-line" id="magicdomid1365"><span class="author-g-xwhvryte8gpg5h0z122z">1.2 August 15th (Freeze: August 2nd, Demonstration Deadline: July 26th)</span></div><div class="" id="magicdomid957"><span class="author-g-xwhvryte8gpg5h0z122z">1.3 September 16th (Freeze: September 2nd, Demonstration Deadline: August 26th)</span></div><div class="ace-line" id="magicdomid959"><br></div><div class="ace-line" id="magicdomid984"><span class="author-g-xwhvryte8gpg5h0z122z">Resource Constraints: </span></div><div class="ace-line" id="magicdomid987"><span class="author-g-xwhvryte8gpg5h0z122z"> </span></div><div class="ace-line" id="magicdomid2863"><span class="author-g-xwhvryte8gpg5h0z122z">*
Curator's developer Julien will be on travel starting 21 August. He
will be gone one month. His last days to get anything done will be
August 19th, 20th, and 23rd. Because of this, Curator's primary
contributions to CMIP need to be finalized by ESG's 1.2 release (Freeze
2 August). </span></div><div class="ace-line" id="magicdomid961"><br></div><div class="ace-line" id="magicdomid16"><span class="author-g-xwhvryte8gpg5h0z122z">At the bottom of the email there is a draft outline of capabilities by release.</span></div><div class="ace-line" id="magicdomid17"><br></div><div class="ace-line" id="magicdomid1203"><span class="author-g-xwhvryte8gpg5h0z122z">Curator
also syncs its efforts to those of METAFOR. Below I am quoting
Charlotte's latest questionnaire release schedule (dated 3 June).</span></div><div class="ace-line" id="magicdomid1206"><br></div><div class="ace-line" id="magicdomid1207"><span class="author-g-xwhvryte8gpg5h0z122z">"Here is the release schedule showing just the current version of the timeline – to avoid confusion.</span></div><div class="ace-line" id="magicdomid1194"><span class="author-g-xwhvryte8gpg5h0z122z">14th June – Beta testing starts</span></div><div class="ace-line" id="magicdomid1213"><span class="author-g-xwhvryte8gpg5h0z122z">13th-20th July – Release of the questionnaire."</span></div><div class="ace-line" id="magicdomid1238"><span class="author-g-xwhvryte8gpg5h0z122z">*Middle of August: First CMIP5 files received from METAFOR (Target based upon conversations with METAFOR)</span></div><div class="ace-line" id="magicdomid25"><br></div><div class="ace-line" id="magicdomid1444"><span class="author-g-xwhvryte8gpg5h0z122z">Demonstration Schedule:</span></div><div class="ace-line" id="magicdomid27"><br></div><div class="" id="magicdomid1380"><span class="author-g-xwhvryte8gpg5h0z122z">a)
XML Harvest demonstration. XML Harvest demonstrations have been
occurring on a regular basis. They are primarily for the METAFOR and
go-essp-tech communities. They show a sample questionnaire output
(given to us by METAFOR) and are meant to primarily QC the harvesting
process but also give folks an idea of what the questionnaire output
looks like so that changes in the questionnaire and/or the ESG display
can be identified. The next demonstration is targeted for the week of
28 June. This date is dependent upon receipt of an updated XML file
from Gerry and upon Julien who will need to add code to harvest the
improved inputs and conformances. See 4) below.</span></div><div class="ace-line" id="magicdomid29"><br></div><div class="ace-line" id="magicdomid2942"><span class="author-g-xwhvryte8gpg5h0z122z">b)
Scientist demonstration. To my knowledge, the ESG has been primarily
demonstrated to technical personnel. The entire gateway (data browse,
data search, model search, metadata content) needs to be demonstrated
to scientists. Curator/ESG would like to conduct this joint
demonstration the week of 19 July in order to make any</span><span class="author-g-x7tu98lffwvcz122zm6q"> </span><span class="author-g-xwhvryte8gpg5h0z122z">recommended changes in time for ESG 1.2 release, which is frozen on 2 August. </span></div><div class="ace-line" id="magicdomid899"><br></div><div class="ace-line" id="magicdomid2943"><span class="author-g-xwhvryte8gpg5h0z122z">METADATA PATHS:</span></div><div class="ace-line" id="magicdomid902"><br></div><div class="ace-line" id="magicdomid2944"><span class="author-g-xwhvryte8gpg5h0z122z">There
are three primary paths: the gridspec path, the netCDF path, and the
questionnaire path. Tasks to be completed are embedded under the
specific metadata pathway step they refer to. This is a summary that
includes portions of the ESG/CMIP5 effort outside of the Curator
project scope and may have gaps and errors. </span></div><div class="ace-line" id="magicdomid2892"><br></div><div class="ace-line" id="magicdomid2893"><span class="author-g-xwhvryte8gpg5h0z122z">Gridspec Path:</span></div><div class="ace-line" id="magicdomid2894"><span class="author-g-xwhvryte8gpg5h0z122z"> * What is the status of Gridspec command line program?</span></div><div class="ace-line" id="magicdomid2895"><span class="author-g-xwhvryte8gpg5h0z122z"> * Do we anticipate getting gridspec files now?</span></div><div class="ace-line" id="magicdomid2945"><span class="author-g-xwhvryte8gpg5h0z122z"> * How do we balence gridspec metadata from the new grid info coming from the Questionnaire?</span></div><div class="ace-line" id="magicdomid2898"><br></div><div class="ace-line" id="magicdomid2899"><span class="author-g-xwhvryte8gpg5h0z122z">netCDF Path: </span></div><div class="ace-line" id="magicdomid2900"><span class="author-g-xwhvryte8gpg5h0z122z">* Is the DRS final?</span></div><div class="ace-line" id="magicdomid2901"><span class="author-g-xwhvryte8gpg5h0z122z">* What is the status of CMOR2?</span></div><div class="ace-line" id="magicdomid2902"><span class="author-g-xwhvryte8gpg5h0z122z">* What is the status of the netCDF harvesting software?</span></div><div class="ace-line" id="magicdomid2903"><span class="author-g-xwhvryte8gpg5h0z122z">* Are there any missing pieces with respect to netCDF metadata harvesting to ESG display?</span></div><div class="ace-line" id="magicdomid2946"><br></div><div class="ace-line" id="magicdomid33"><span class="author-g-xwhvryte8gpg5h0z122z">Questionnaire Path: </span></div><div class="ace-line" id="magicdomid34"><br></div><div class="ace-line" id="magicdomid1478"><span class="author-g-xwhvryte8gpg5h0z122z">1) Modelling centers fill out online questionnaire (being developed by METAFOR for 12 July release).</span></div><div class="ace-line" id="magicdomid36"><br></div><div class="ace-line" id="magicdomid37"><span class="author-g-xwhvryte8gpg5h0z122z">2) METAFOR converts output from the questionnaire into a CIM compliant XML file.</span></div><div class="ace-line" id="magicdomid38"><br></div><div class="ace-line" id="magicdomid39"><span class="author-g-xwhvryte8gpg5h0z122z">3) METAFOR sends the XML output from the modelling centers to ESG via Atom.</span></div><div class="ace-line" id="magicdomid1503"><span class="author-g-xwhvryte8gpg5h0z122z">
*In Progress: ESG to write software to periodically query METAFOR's
Atom server for new files and to download those files (Target: 1 July)</span></div><div class="ace-line" id="magicdomid41"><br></div><div class="ace-line" id="magicdomid42"><span class="author-g-xwhvryte8gpg5h0z122z">4) ESG uses software (to be developed by ESG) to convert the XML into an OWL file for ingestation into the Sesame Triple Store.</span></div><div class="ace-line" id="magicdomid43"><span class="author-g-xwhvryte8gpg5h0z122z"> * Needed: </span></div><div class="ace-line" id="magicdomid2948"><span class="author-g-xwhvryte8gpg5h0z122z"> a) Better sample XML file from METAFOR: Required from METAFOR (Target: 1</span><span class="author-g-x7tu98lffwvcz122zm6q">7 </span><span class="author-g-xwhvryte8gpg5h0z122z">June).
METAFOR has been sending us periodic XML updates. We need a sample
that uses the current version of the mindmaps in order to finish the
ingestion of the scientific properties </span></div><div class="ace-line" id="magicdomid2952"><span class="author-g-xwhvryte8gpg5h0z122z">
b) Conformance, ensembles, numerical requirements, genealogy, and
inputs finalized in both the CIM and XML output (Target: 17 June) so
ESG can write harvesting code for those pieces. Conformance and inputs
are partially complete in the output and we have code to harvest those
pieces</span></div><div class="ace-line" id="magicdomid2980"><span class="author-g-xwhvryte8gpg5h0z122z"> c) C</span><span class="author-g-x7tu98lffwvcz122zm6q">OMPLETE</span><span class="author-g-xwhvryte8gpg5h0z122z"> </span><span class="author-g-x7tu98lffwvcz122zm6q">SAMPLE</span><span class="author-g-xwhvryte8gpg5h0z122z"> XML from METAFOR (Target: 23 June) </span></div><div class="ace-line" id="magicdomid1745"><span class="author-g-xwhvryte8gpg5h0z122z"> d) Curator/ESG to complete the XML to OWL software (Target: 14 July) </span></div><div class="ace-line" id="magicdomid1747"><span class="author-g-xwhvryte8gpg5h0z122z"> e) ESG to create a means of automatically running Julien's harvesting code in an operational manner (Target: 14 July)</span></div><div class="ace-line" id="magicdomid49"><br></div><div class="ace-line" id="magicdomid50"><span class="author-g-xwhvryte8gpg5h0z122z">5) ESG continuity of operations</span></div><div class="ace-line" id="magicdomid1581"><span class="author-g-xwhvryte8gpg5h0z122z">
* Don identified the need to develop a plan to reinitialize the sesame
triple store with the CMIP5 metadata given a catastrophic failure
(Target: 12 July)</span></div><div class="ace-line" id="magicdomid52"><span class="author-g-xwhvryte8gpg5h0z122z"> </span></div><div class="ace-line" id="magicdomid53"><span class="author-g-xwhvryte8gpg5h0z122z">6)
The XML instance is displayed on the web. The XML instances will
contain all the information about each CMIP5 model and simulation.
This will include information about the platform the simulation was run
on, the descriptive scientific properties of each component, etc. </span></div><div class="" id="magicdomid1599"><span class="author-g-xwhvryte8gpg5h0z122z"> * Needed: Next XML Harvesting demo (Target: week of 28 June)</span></div><div class="ace-line" id="magicdomid1735"><span class="author-g-xwhvryte8gpg5h0z122z">
* Needed: All of the CMIP5 experiment information needs to be
represented in the system. A separate XML conversion program needs to
be written to convert METAFOR's experiment XML files to OWL. (Target:
14 July)</span></div><div class="ace-line" id="magicdomid1743"><span class="author-g-xwhvryte8gpg5h0z122z">
* Needed: Formal demonstration to scientists of a complete
questionnaire XML file to determine needed changes to the display
(Target: week of 19 July)</span></div><div class="ace-line" id="magicdomid59"><br></div><div class="ace-line" id="magicdomid1921"><span class="author-g-xwhvryte8gpg5h0z122z">7)
Users can use the ESG search page to find model metadata. My last
converstation with Don indicated that ESG was scheduling this task for
September. Is that too late?</span></div><div class="ace-line" id="magicdomid1922"><span class="author-g-xwhvryte8gpg5h0z122z"> * Needed: Community-wide consensus on the facets displayed for the search</span></div><div class="ace-line" id="magicdomid1898"><span class="author-g-xwhvryte8gpg5h0z122z"> * Needed: ESG modify the search pages to conform to community desires </span></div><div class="ace-line" id="magicdomid2982"><span class="author-g-xwhvryte8gpg5h0z122z"> * Needed: ESG finalize the look and feel of the search page and fix any identified bugs</span></div><div class="ace-line" id="magicdomid79"><span class="author-g-xwhvryte8gpg5h0z122z"> </span></div><div class="ace-line" id="magicdomid80"><span class="author-g-xwhvryte8gpg5h0z122z">SUMMARY OF METADATA-RELATED CAPABILITIES BY ESG RELEASE</span></div><div class="ace-line" id="magicdomid81"><br></div><div class="ace-line" id="magicdomid82"><span class="author-g-xwhvryte8gpg5h0z122z">Note:
Here is a current list of baseline model metadata capabilities. Only
future capabilities are listed under the releases. Please assume that
the baseline carries forward:</span></div><div class="ace-line" id="magicdomid83"><br></div><div class="ace-line" id="magicdomid84"><span class="author-g-xwhvryte8gpg5h0z122z">Baseline capabilities: </span></div><div class="ace-line" id="magicdomid85"><span class="author-g-xwhvryte8gpg5h0z122z">* Component navigation</span></div><div class="ace-line" id="magicdomid86"><span class="author-g-xwhvryte8gpg5h0z122z">* Technical properties displayed</span></div><div class="ace-line" id="magicdomid87"><span class="author-g-xwhvryte8gpg5h0z122z">* Basic properties (e.g. institution, contacts etc) displayed</span></div><div class="ace-line" id="magicdomid88"><span class="author-g-xwhvryte8gpg5h0z122z">* Pop-up definitions of attributes</span></div><div class="ace-line" id="magicdomid89"><span class="author-g-xwhvryte8gpg5h0z122z">* Associated grids displayed</span></div><div class="ace-line" id="magicdomid90"><span class="author-g-xwhvryte8gpg5h0z122z">* Datahook</span></div><div class="ace-line" id="magicdomid91"><span class="author-g-xwhvryte8gpg5h0z122z">* Initial conditions/boundary conditions displayed</span></div><div class="ace-line" id="magicdomid92"><span class="author-g-xwhvryte8gpg5h0z122z">* Conformance displayed</span></div><div class="ace-line" id="magicdomid93"><span class="author-g-xwhvryte8gpg5h0z122z">* Scientific properties displayed</span></div><div class="ace-line" id="magicdomid2983"><span class="author-g-xwhvryte8gpg5h0z122z">* Experiment information displayed</span></div><div class="ace-line" id="magicdomid106"><br></div><div class="ace-line" id="magicdomid2215"><span class="author-g-xwhvryte8gpg5h0z122z">ESG Release 1.2 (Freeze: 2 August)</span></div><div class="ace-line" id="magicdomid2127"><span class="author-g-xwhvryte8gpg5h0z122z">* XML Harvest complete software complete and made operational</span></div><div class="ace-line" id="magicdomid2131"><span class="author-g-xwhvryte8gpg5h0z122z">* Experiment information harvested and host files reconciled</span></div><div class="ace-line" id="magicdomid2217"><span class="author-g-xwhvryte8gpg5h0z122z">* Trackback page display adjusted for users coming via the data browse</span></div><div class="ace-line" id="magicdomid2219"><span class="author-g-xwhvryte8gpg5h0z122z">* Citation formatting improved</span></div><div class="ace-line" id="magicdomid2220"><span class="author-g-xwhvryte8gpg5h0z122z">* Genealogy displayed</span></div><div class="ace-line" id="magicdomid2221"><span class="author-g-xwhvryte8gpg5h0z122z">* Simulation to data connection and publishing process made more robust</span></div><div class="ace-line" id="magicdomid2222"><span class="author-g-xwhvryte8gpg5h0z122z">* Ensemble information displayed</span></div><div class="ace-line" id="magicdomid109"><br></div><div class="ace-line" id="magicdomid2865"><span class="author-g-xwhvryte8gpg5h0z122z">ESG Release 1.3 (Freeze: 2 September)</span></div><div class="ace-line" id="magicdomid2119"><span class="author-g-xwhvryte8gpg5h0z122z">* Finalize search interface</span></div><div class="ace-line" id="magicdomid2123"><span class="author-g-xwhvryte8gpg5h0z122z">* User's changes to the component navigation retained in the session</span></div><div class="ace-line" id="magicdomid2135"><span class="author-g-xwhvryte8gpg5h0z122z">* Link behavior throughout the site made more consistent</span></div><div class="ace-line" id="magicdomid2137"><span class="author-g-xwhvryte8gpg5h0z122z">* Loading of the component tree made more efficient</span></div><div class="ace-line" id="magicdomid112"><br></div><div>
<span class="Apple-style-span" style="font-family: Helvetica; "><div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><span class="Apple-style-span" style="border-collapse: separate; color: rgb(0, 0, 0); font-family: Helvetica; font-size: medium; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; "><div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><div><div>***********************************</div><div>Sylvia Murphy</div><div>NESII/CIRES/NOAA Earth System Research Laboratory<br>325 Broadway, Boulder CO 80305</div><div>Email: <a href="mailto:sylvia.murphy@noaa.gov">sylvia.murphy@noaa.gov</a></div><div>Phone: 303-497-7753</div></div><div><br></div></div></span><br class="Apple-interchange-newline"></div></span><br class="Apple-interchange-newline"><br class="Apple-interchange-newline">
</div>
<br></body></html>