[Go-essp-tech] Non-DRS File structure at data nodes

[Jerome Raciazek]

Hi Jamie,


Here is the procedure to install the CMIP5 data download program
developed at IPSL:
http://dods.ipsl.jussieu.fr/jripsl/synchro_data/README

The program have the following features:
* support for myproxy-logon and myproxyclient
* simple data selection with model,experiment,realm and variable

It has been tested with the following models: HadGEM2-ES, HadGEM2-A,
CanESM2, CNRM-CM5, NorESM1-M, CanCM4, CSIRO-Mk3-6-0

If you have any questions or comments, please let us know.


> Do you see the problem of data sets appearing on the catalogues, but
> not being published very often?
>  
I have errors concerning permission and missing data in log file, but I
didn't investigate it yet. Time permitting we will try to attribute
those errors to major cause. 


Regards
Jerome


Le vendredi 02 septembre 2011 à 17:05 +0100, Kettleborough, Jamie a
écrit : 
> Thanks Sebastien,
>  
> it'll be interesting to see what elements/attributes in the catalogues
> you have used.
>  
> Do you see the problem of data sets appearing on the catalogues, but
> not being published very often?
>  
> Jamie
> 
>         
>         ______________________________________________________________
>         
>         From: Sébastien Denvil
>         [mailto:sebastien.denvil at ipsl.jussieu.fr] 
>         Sent: 02 September 2011 16:08
>         To: Kettleborough, Jamie
>         Cc: stephen.pascoe at stfc.ac.uk; martin.juckes at stfc.ac.uk;
>         gonzalez at dkrz.de; taylor13 at llnl.gov; go-essp-tech at ucar.edu
>         Subject: Re: [Go-essp-tech] Non-DRS File structure at data
>         nodes
>         
>         
>         
>         Hi Jamie,
>         
>         as we discussed by email a couple of weeks ago we use a tool
>         that perform more or less what you describe
>         - parsing all datanode catalogues
>         - downloading files according to a selection
>         - storing it according to the datanode drs structure
>         
>         The code was not quiet ready so that other can put their eyes
>         on it.
>         
>         Now it's ok, and next week a colleague of mine will point you
>         the code and a small how-to use it.
>         
>         Hope this will help.
>         
>         On 02/09/2011 16:27, Kettleborough, Jamie wrote: 
>         > 1. I can cope with failed attempts to get data better than I can cope with data I never knew about.  I *think* the gateways still don't have a full picture of all published data do they?  (e.g. I can't see IPSL from PCMDI, as far as I can tell).  
>         
>         Regarding that specific point, I would love to see IPSL under
>         the institute facet. I know that my funding agency want to see
>         that as well. But no surprise here.
>         
>         Still you can see IPSL-CM5A-LR under the model facet....
>         
>         Regards.
>         Sébastien
>         
>         -- 
>         Sébastien Denvil
>         IPSL, Pôle de modélisation du climat
>         UPMC, Case 101, 4 place Jussieu,
>         75252 Paris Cedex 5
>         
>         Tour 45-55 2ème étage Bureau 209
>         Tel: 33 1 44 27 21 10
>         Fax: 33 1 44 27 39 02
> _______________________________________________
> GO-ESSP-TECH mailing list
> GO-ESSP-TECH at ucar.edu
> http://mailman.ucar.edu/mailman/listinfo/go-essp-tech
-- 
Jérôme Raciazek
IPSL, Pôle de modélisation du climat
UPMC, Case 101, 4 place Jussieu,
75252 Paris Cedex 5

Tour 45-55 2ème étage Bureau 209
Tel: 33 1 44 27 21 10
Fax: 33 1 44 27 39 02