[Go-essp-tech] Incorrect dataset names

Bryan Lawrence bryan.lawrence at ncas.ac.uk
Wed Oct 5 06:36:25 MDT 2011


oh, yes, I agree, but it should be on the list ... and it needs revision before folks start writing papers and casting this in stone ... as happened last time, to the detriment of anyone having any clue which data folks used ....

.. and it may be one more straw for some republishing camels.

Cheers
Bryan

> Hello Bryan,
> 
> Yep I appreciate its different.  I just wonder of all the issues CMIP5
> has to deal with how high up the priority list this one should be - it
> feels (to me - based on the knowledge I have, which is incomplete) like
> a problem you can try to manage with a very low cost solution - at least
> for a while.
> 
> Jamie
>  
> 
> 
> 
> > -----Original Message-----
> > From: Bryan Lawrence [mailto:bryan.lawrence at ncas.ac.uk] 
> > Sent: 05 October 2011 12:19
> > To: go-essp-tech at ucar.edu
> > Cc: Kettleborough, Jamie; martin.juckes at stfc.ac.uk; 
> > stephen.pascoe at stfc.ac.uk
> > Subject: Re: [Go-essp-tech] Incorrect dataset names
> > 
> > 
> > Hi Jamie
> > 
> > CMIP5 is different from IPCC!  
> > 
> > Data in the cmip5 archive will arrive after the ipcc cut-off 
> > etc ... and we will tag specific version of data that were 
> > present in time as IPCC later ...
> > 
> > Cheers
> > Bryan
> > 
> > > Hello,
> > > 
> > > I may be missing something here (either political or 
> > technical that I 
> > > don't know about) but this feels like a problem you can 
> > live with.  So 
> > > what about:
> > > 
> > > Method C:
> > > 
> > > Don't fix anything for these old data sets.
> > > Start a **single** errata page that all the gateways point 
> > to.  Item 1 
> > > on on the errata page says something like:
> > > 
> > > 'Some early datasets have been assigned an incorrect Project in the 
> > > xxx database which affect the yyy view on the data.  For 
> > datasets with 
> > > Project = CMIP5 / IPCC Fifth Assessment Report, please read 
> > Project = 
> > > CMIP5'
> > > 
> > > Jamie
> > >  
> > > > -----Original Message-----
> > > > From: go-essp-tech-bounces at ucar.edu 
> > > > [mailto:go-essp-tech-bounces at ucar.edu] On Behalf Of 
> > > > martin.juckes at stfc.ac.uk
> > > > Sent: 05 October 2011 10:17
> > > > To: stephen.pascoe at stfc.ac.uk; go-essp-tech at ucar.edu
> > > > Subject: Re: [Go-essp-tech] Incorrect dataset names
> > > > 
> > > > Hello Stephen,
> > > > 
> > > > yes, it should be "project=CMIP5, model=....".
> > > > 
> > > > On A vs. B I don't have a strong preference. I suppose A 
> > would make 
> > > > sense if there were other issues which could be addressed in the 
> > > > same republishing exercise -- so it may be worth waiting 
> > for a few 
> > > > more opinions. The problem I can see with B is ensuring that all 
> > > > gateway databases are updated -- but maybe I'm imagining more 
> > > > difficulty here than there is,
> > > > 
> > > > cheers,
> > > > Martin
> > > > ________________________________________
> > > > From: Pascoe, Stephen (STFC,RAL,RALSP)
> > > > Sent: 05 October 2011 09:50
> > > > To: Juckes, Martin (STFC,RAL,RALSP); go-essp-tech at ucar.edu
> > > > Subject: RE: Incorrect dataset names
> > > > 
> > > > Hi Martin,
> > > > 
> > > > Sorry, that's an old configuration setting.  To confirm should it 
> > > > just say "project=CMIP5, model=..."?  There are several 
> > ways to fix 
> > > > this problem, some quicker than others.
> > > > I would suggest:
> > > > 
> > > > Method A (slower, more correct):
> > > > 
> > > >  1. Change the ESG Publisher configuration  2. Regenerate THREDDS 
> > > > catalogs with ESG Publisher  3. Republish to Gateway with ESG 
> > > > Publisher
> > > > 
> > > > Method B (quick-and-dirty, once you've scripted it):
> > > > 
> > > >  1. Change the ESG Publisher configuration  2. Patch THREDDS 
> > > > catalogs  3. Patch the Gateway database
> > > > 
> > > > I'm happy to use Method B and contribute the necessary scripts.
> > > > 
> > > > Stephen.
> > > > 
> > > > ---
> > > > Stephen Pascoe  +44 (0)1235 445980
> > > > Centre of Environmental Data Archival STFC Rutherford Appleton 
> > > > Laboratory, Harwell Oxford, Didcot
> > > > OX11 0QX, UK
> > > > 
> > > > 
> > > > -----Original Message-----
> > > > From: go-essp-tech-bounces at ucar.edu 
> > > > [mailto:go-essp-tech-bounces at ucar.edu] On Behalf Of 
> > > > martin.juckes at stfc.ac.uk
> > > > Sent: 05 October 2011 09:23
> > > > To: go-essp-tech at ucar.edu
> > > > Subject: [Go-essp-tech] Incorrect dataset names
> > > > 
> > > > Hello,
> > > > 
> > > > A number of datasets, including some at BADC, have been published 
> > > > with "project=CMIP5 / IPCC Fifth Assessment Report, .... " in the 
> > > > dataset name. A search for "IPCC Fifth"
> > > > suggests we have 4021 datasets with this error, from CCCMA, 
> > > > CNRM-CERFACS, CSIRO-QCCCE, IPSL, MOHC, and NOAA-GFDL. We should 
> > > > develop a plan to correct this -- I guess this means republishing 
> > > > the affected datasets,
> > > > 
> > > > cheers,
> > > > Martin--
> > > > Scanned by iCritical.
> > > > _______________________________________________
> > > > GO-ESSP-TECH mailing list
> > > > GO-ESSP-TECH at ucar.edu
> > > > http://mailman.ucar.edu/mailman/listinfo/go-essp-tech
> > > > --
> > > > Scanned by iCritical.
> > > > _______________________________________________
> > > > GO-ESSP-TECH mailing list
> > > > GO-ESSP-TECH at ucar.edu
> > > > http://mailman.ucar.edu/mailman/listinfo/go-essp-tech
> > > > 
> > > _______________________________________________
> > > GO-ESSP-TECH mailing list
> > > GO-ESSP-TECH at ucar.edu
> > > http://mailman.ucar.edu/mailman/listinfo/go-essp-tech
> > > 
> > 
> > --
> > Bryan Lawrence
> > University of Reading:  Professor of Weather and Climate Computing.
> > National Centre for Atmospheric Science: Director of Models and Data. 
> > STFC: Director of the Centre for Environmental Data Archival.
> > Ph: +44 118 3786507 or 1235 445012; Web:home.badc.rl.ac.uk/lawrence
> > 
> 

--
Bryan Lawrence
University of Reading:  Professor of Weather and Climate Computing.
National Centre for Atmospheric Science: Director of Models and Data. 
STFC: Director of the Centre for Environmental Data Archival.
Ph: +44 118 3786507 or 1235 445012; Web:home.badc.rl.ac.uk/lawrence


More information about the GO-ESSP-TECH mailing list