[Go-essp-tech] CMIP5 Version directory structure update

[stephen.pascoe at stfc.ac.uk]

Martina,

I haven't been thinking about DOI's so I don't have many answers but
this is my first impression.  I've also cross-posted to metafor as I
believe DOI's are closely related to how we use the Metafor CIM.

> Would a DOI on an experiment be another version tree on the experiment
level with links to the associated 
> model_realm versions?
>
> How do we publish an assigned DOI among ESGF? Via the ESG publisher in
a metadata publishing mode or via > the CIM repository?

My understanding is that DOIs will be associated with Metafor CIM
documents that will reference DRS dataset version ids.  So it should be
the Metafor services job to maintain the link between DOIs and datasets.

I believe the datanodes should be kept away from CIM and DOIs entirely.
Metafor services can harvest file-level metadata from the datanode or
gateway, combine it with CIM from metafor questionnaire to produce
complete CIM that can then be published with a DOI.

Cheers,
Stephen.

---
Stephen Pascoe  +44 (0)1235 445980
British Atmospheric Data Centre
Rutherford Appleton Laboratory

-----Original Message-----
From: Martina Stockhause [mailto:martina.stockhause at zmaw.de] 
Sent: 07 June 2010 14:07
To: Pascoe, Stephen (STFC,RAL,SSTD)
Cc: go-essp-tech at ucar.edu
Subject: Re: [Go-essp-tech] CMIP5 Version directory structure update

Hi Stephen,

It's good that you push the version control ahead.

I'd like to bring the version control on the DOI level into the
discussion. We plan to assign DOIs on experiments and on models or
institutes. I think we should use a similar mechanism for that as for
the version management for the portal (on the model_realm level). I see
only one difference: We do not publish data but only add to the
metadata, which makes it simpler.

Would a DOI on an experiment be another version tree on the experiment
level with links to the associated model_realm versions?

How do we publish an assigned DOI among ESGF? Via the ESG publisher in a
metadata publishing mode or via the CIM repository?
For the first we could use a lot of the version control mechanism of the
model_realms, maybe even the tool you develop. And for the latter we
would need another version management, e.g. in CERA, to store the links
to the associated model_realm or file versions and to resolve them. User
questions might be: Which DOI do I cite for the downloaded data I used
for my analyses? Which data is associated with the DOI cited in a
publication?

So, is it preferable to follow a similar solution for DOI versions as
for the model_realm version management or are the differences so large
that we need a different solution?

Best wishes,
Martina


stephen.pascoe at stfc.ac.uk wrote:
> Hi All,
>  
> Attached is a new version of the version directory structure document 
> that reflects our decision to publish at the realm level and therefore

> manage versions of realm-datasets rather than atomic datasets.  Of 
> particular interest should be Section 2 which suggests how a version 
> management tool would transform the CMOR directory structure into a 
> version-controlled structure.  Also note I'm suggesting the DRS 
> version directory is moved to just below realm.
>  
> Comments are still welcome but I am now going to push ahead at turning

> this plan into code.  I intend a tool that can be run each time more 
> data arrives at the datanode, before esgpublish is executed.  This 
> could be merged into esgpublish if we wish.  I hope to have something 
> testable by the end of the week.
>  
> Cheers,
> Stephen.
>  
> ---
> Stephen Pascoe  +44 (0)1235 445980
> British Atmospheric Data Centre
> Rutherford Appleton Laboratory
>  
>
>   
> ----------------------------------------------------------------------
> --
>
> _______________________________________________
> GO-ESSP-TECH mailing list
> GO-ESSP-TECH at ucar.edu
> http://mailman.ucar.edu/mailman/listinfo/go-essp-tech

-- 
Scanned by iCritical.