[Go-essp-tech] [esg-node-dev] Re: CMIP5 Datanode : data access services.

[Sébastien Denvil]

  Hello,

as it seems that lights turn green gridFTP is back on our list. Still I 
would need you to suggest an installer version to be in sync with the 
Neill's documentation v1.0.3-14-g485f969 or a later one?

Last time we tried issues was coming from the chroot procedure. The 
chroot procedure is still in use? Reading the Neill's documentation it 
doesn't look like.

Also national and DEISA/PRACE computing centre in France will 
install/upgrade data node. They use this link to review the software 
they will install. We want data node just next to the data production site.
http://esgf.org/releases/#Release_Version

Please, could you tick the tested box for gridFTP (at least end-user for 
now) if it is the case? We had very hard time to convince them to open 
the gridFTP port for every user (the world). If they notice it's not 
tested I'm afraid all this hard work will be gone...
http://esgf.org/releases/#Release_Version

We will test it again, but openDAP comes first.

Regards and thanks for the prompt answers.
Sébastien

On 02/05/2011 21:11, Gavin M. Bell wrote:
> Hello,
>
> Rachana is correct, the installer will install and configure GridFTP 
> to work with the ESGF security mechanisms.  There are two 
> configurations of GridFTP that are installed one is labeled "bdm" and 
> one is labeled "end-user".  The former is most like the vanilla 
> gridftp installation.  The latter has additional authentication 
> configuration to support clients like DML.    By default the script 
> will install both configurations, bdm running on 2812, and end-user 
> running on the gridftp 2811.
>
> Neill has more information on these configurations...
> He posted some information on the esgf.org wiki:
> http://esgf.org/wiki/Cmip5DataNode/EnhancedEndUserDownloadGridFTPModule
>
>
>
> On 5/2/11 11:54 AM, Rachana Ananthakrishnan wrote:
>> Hi,
>>
>> On GridFTP, the work to add this to a data node, and accept ESGF security has been completed. Gavin can correct me, but any data node install, will have GridFTP with it, configured to accept ESG credentials.
>>
>> The bit that was missing is the publishing of the data with both HTTP and GSIFTP URLs, so they can be accessed by both. Last time I discussed this with site owners, they had prioritized HTTP and hadn't found resources to get to the GridFTP bits. This is an option in the publisher that can be used, I am not certain what the efforts are for updating the existing sites.
>>
>> Estani also raised similar questions about enabling GridFTP access, I don't know of any blockers, other than sites investing resource to update it. Please let us know if you see other constraints with the existing GridFTP access.
>>
>> Thanks,
>> Rachana
>>
>> On May 2, 2011, at 8:32 AM, Sébastien Denvil wrote:
>>
>>> Dear all,
>>>
>>> we received increasing demand asking for regional model boundary conditions from CMIP5 simulations. Those datasets are heavy and therefore "wget" is not my favourite answer. I would like this answer to be base on a ESG-F solution and not a home made one.
>>>
>>> In order to build a meaningful response I would like to know what are the plan regarding the datanode to have :
>>> - openDAP enable with CMIP5 filters.
>>> - netCDF subsets enable with CMIP5 filters.
>>>     * openDAP and/or netCDF subsets will be very useful for those focusing on a specific region (Africa OR Asia for example). They could then extract only the area of interest.
>>>
>>> - gridFTP enable with CMIP5 filters.
>>>     *gridFTP will be very useful for those focusing on many regions and/or doing the CORDEX exercise but without a limited area model. It's very likely that they will download the whole datasets.
>>>
>>> My understanding is that gridFTP is not fully functional at this point of time and that openDAP and netCDF subsets are not yet secure by the ESG-F security layer.
>>>
>>> A corollary coming from those questions : Is there a documentation we could refer to if we want to update a production data node?
>>>
>>> Please refine my understanding.
>>>
>>> Thanks.
>>> Sébastien
>>>
>>> -- 
>>> Sébastien Denvil
>>> IPSL, Pôle de modélisation du climat
>>> UPMC, Case 101, 4 place Jussieu,
>>> 75252 Paris Cedex 5
>>>
>>> Tour 45-55 2ème étage Bureau 209
>>> Tel: 33 1 44 27 21 10
>>> Fax: 33 1 44 27 39 02
>>>
>>>
>>> _______________________________________________
>>> GO-ESSP-TECH mailing list
>>> GO-ESSP-TECH at ucar.edu
>>> http://mailman.ucar.edu/mailman/listinfo/go-essp-tech
>> Rachana Ananthakrishnan
>> Argonne National Lab | University of Chicago
>>
>> _______________________________________________
>> GO-ESSP-TECH mailing list
>> GO-ESSP-TECH at ucar.edu
>> http://mailman.ucar.edu/mailman/listinfo/go-essp-tech
>
> -- 
> Gavin M. Bell
> Lawrence Livermore National Labs
> --
>
>   "Never mistake a clear view for a short distance."
>         	       -Paul Saffo
>
> (GPG Key -http://rainbow.llnl.gov/dist/keys/gavin.asc)
>
>   A796 CE39 9C31 68A4 52A7  1F6B 66B7 B250 21D5 6D3E


-- 
Sébastien Denvil
IPSL, Pôle de modélisation du climat
UPMC, Case 101, 4 place Jussieu,
75252 Paris Cedex 5

Tour 45-55 2ème étage Bureau 209
Tel: 33 1 44 27 21 10
Fax: 33 1 44 27 39 02

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.ucar.edu/pipermail/go-essp-tech/attachments/20110502/891d35db/attachment.html 
-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/pkcs7-signature
Size: 4172 bytes
Desc: S/MIME Cryptographic Signature
Url : http://mailman.ucar.edu/pipermail/go-essp-tech/attachments/20110502/891d35db/attachment.bin