[Go-essp-tech] Synchro-data-2.9 released

[Jerome Raciazek]

Hi All,

I am very pleased to announce the release of Synchro-data-2.9. 
Synchro-data is a python based command line tool designed to mirror a 
relatively large subset of ESGF data on a local cluster (or a local 
machine) and to keep datasets versions up-to-date.

It has been deeply redesigned and now also includes an 'apt-get' like 
command called 'synda', which is intended to install ESGF dataset in an 
easy way. All Search-API parameters are now supported thus supporting 
virtually all ESGF hosted projects (CMIP5, ISI-MIP, Obs4MIPs, CORDEX, 
LUCID, EUCLIPSE, ....). Support is granted for netcdf files (".nc") when 
dataset name begins by project name and ends with a version.

New features are:

* Replica support
* Nearest replica selection for download
* Per project default values
* Facets can be read from CLI argument, file or stdin
* Different list mode: dataset, variable and file
* Searchable parameter list

Basic usage:

synda search FACET ..
synda install FACET ..
synda remove FACET ..

To search for monthly and atmos in CMIP5 project
synda search project=CMIP5 realm=atmos time_frequency=mon

Query can also be written without specifying facet name
synda search CMIP5 atmos mon

See more examples at the bottom.

'synda' command documentation:
http://dods.ipsl.jussieu.fr/jripsl/synchro_data/user_guide.html

Installation and configuration guide:
http://dods.ipsl.jussieu.fr/jripsl/synchro_data/README

Upgrade:
http://dods.ipsl.jussieu.fr/jripsl/synchro_data/update_guide.html

Acknowledgment:
This work has been undertaken by IPSL and has been funded by IPSL, 
IS-ENES and France-Grilles.

Feel free to ask us if you have any questions, difficulties or 
suggestions to improve the program. Code and documentation will be made 
available through GitHub soon.

Regards
Jerome and Sebastien


More examples:

Search for ISI-MIP files
synda search project=ISI-MIP%20Fasttrack searchapi_host=esg.pik-potsdam.de

List all replicas
synda search 
cmip5.output1.CNRM-CERFACS.CNRM-CM5.rcp85.fx.atmos.fx.r0i0p0.v20130826.sftlf_fx_CNRM-CM5_rcp85_r0i0p0.nc 
-r

Install using a specific replica
synda install 
cmip5.output1.CNRM-CERFACS.CNRM-CM5.rcp85.fx.atmos.fx.r0i0p0.v20130826.sftlf_fx_CNRM-CM5_rcp85_r0i0p0.nc 
wdcc-esgf.dkrz.de

Display obs4MIPs files using stdin
echo obs4MIPs | synda search

List all projects
synda param project

List all projects with MIP in their names
synda param project MIP

List all facets
synda param

List CMIP5 data using file list mode
synda search CMIP5 -f

List CMIP5 data using variable/aggregation list mode
synda search CMIP5 -v
synda search CMIP5 -a

List CMIP5 data using dataset list mode (default)
synda search CMIP5 -d


-- 
Jérôme Raciazek
IPSL, Pôle de modélisation du climat
UPMC, Case 101, 4 place Jussieu,
75252 Paris Cedex 5

Tour 45-55 2ème étage Bureau 209
Tel: 33 1 44 27 21 10
Fax: 33 1 44 27 39 02