[Go-essp-tech] [esg-node-dev] CMIP5 Datanode : data access services.

[Estanislao Gonzalez]

Hi All,

this is great, thanks Luca for putting this together.

The OpenDAP access works correctly, but the tools packed within the TDS 
(or linked, to be more precise) do not.
Is there any effort going on to upgrade IDV so that it can be used in 
CMIP5? (i.e. linked to the latest NetCDF library and provide some means 
to select the certificate and ca directory to be used for the connection)

If not, I think we should remove them from the TDS, it makes little 
sense to have something there the user cannot use.

Thanks,
Estani

Am 03.05.2011 13:44, schrieb Cinquini, Luca (3880):
> Hi Sebastian,
> 	I have written instructions on how to enable OpenDAP access with ESGF security on a Data Node:
>
> http://www.esgf.org/wiki/opendap
>
> Please let me know how it goes - it seems to be working just fine at JPL.
>
> Gavin, I think the only action to take for the node installation script is to make sure that the Authentication Filter is configured with the opendap extensions: .das, .dds, .ascii, .dods.
>
> thanks, Luca
>
> On May 3, 2011, at 3:32 AM,<stephen.pascoe at stfc.ac.uk>  <stephen.pascoe at stfc.ac.uk>  wrote:
>
>> Hi Sebastien,
>>
>> As I hope others have explained, the ESGF software can support gridFTP and OPeNDAP access at this time, however each node and gateway are moving at different paces on configuring and testing these features.  At BADC we are at full stretch keeping up with CMIP5 publishing and I regret the timescale for these features keep slipping.  It is invaluable for us to hear what the user's immediate needs are; thanks.
>>
>> So, what is your first priority?  Configuring the IPSL datanode to support gridFTP and/or OPeNDAP or having gridFTP/OPeNDAP enabled on other datanodes?
>>
>> If you enable gridFTP on your datanode the BADC gateway can publish gridFTP download links today with very little effort.  Similarly Phil and I have experience of the security-enabled netCDF client library and can help there.  I hope others can help with configuring OPeNDAP and LAS on the datanode (particularly LAS) as I haven't got there yet.
>>
>> At BADC we have 90% of the gridFTP setup in place but I will need to republish all our THREDDS catalogs to fix a small metadata inconsistency.  I intend to do this once we've deployed a fresh datanode version.  Similarly I'd rather fix OPeNDAP once a new datanode version is in place.  If this is a real priority for you I can work out a firm deadline.
>>
>> Cheers,
>> Stephen.
>>
>> ---
>> Stephen Pascoe  +44 (0)1235 445980
>> Centre of Environmental Data Archival
>> STFC Rutherford Appleton Laboratory, Harwell Oxford, Didcot OX11 0QX, UK
>>
>>
>> -----Original Message-----
>> From: owner-esg-node-dev at lists.llnl.gov [mailto:owner-esg-node-dev at lists.llnl.gov] On Behalf Of Sébastien Denvil
>> Sent: 02 May 2011 14:32
>> To: esg-node-dev at lists.llnl.gov; go-essp-tech at ucar.edu
>> Subject: [esg-node-dev] CMIP5 Datanode : data access services.
>>
>>   Dear all,
>>
>> we received increasing demand asking for regional model boundary
>> conditions from CMIP5 simulations. Those datasets are heavy and
>> therefore "wget" is not my favourite answer. I would like this answer to
>> be base on a ESG-F solution and not a home made one.
>>
>> In order to build a meaningful response I would like to know what are
>> the plan regarding the datanode to have :
>> - openDAP enable with CMIP5 filters.
>> - netCDF subsets enable with CMIP5 filters.
>>      * openDAP and/or netCDF subsets will be very useful for those
>> focusing on a specific region (Africa OR Asia for example). They could
>> then extract only the area of interest.
>>
>> - gridFTP enable with CMIP5 filters.
>>      *gridFTP will be very useful for those focusing on many regions
>> and/or doing the CORDEX exercise but without a limited area model. It's
>> very likely that they will download the whole datasets.
>>
>> My understanding is that gridFTP is not fully functional at this point
>> of time and that openDAP and netCDF subsets are not yet secure by the
>> ESG-F security layer.
>>
>> A corollary coming from those questions : Is there a documentation we
>> could refer to if we want to update a production data node?
>>
>> Please refine my understanding.
>>
>> Thanks.
>> Sébastien
>>
>> -- 
>> Sébastien Denvil
>> IPSL, Pôle de modélisation du climat
>> UPMC, Case 101, 4 place Jussieu,
>> 75252 Paris Cedex 5
>>
>> Tour 45-55 2ème étage Bureau 209
>> Tel: 33 1 44 27 21 10
>> Fax: 33 1 44 27 39 02
>>
>>
>> -- 
>> Scanned by iCritical.
>>
>


-- 
Estanislao Gonzalez

Max-Planck-Institut für Meteorologie (MPI-M)
Deutsches Klimarechenzentrum (DKRZ) - German Climate Computing Centre
Room 108 - Bundesstrasse 45a, D-20146 Hamburg, Germany

Phone:   +49 (40) 46 00 94-126
E-Mail:  gonzalez at dkrz.de