[Go-essp-tech] Update Nodes & Gateways Web Page

Thu Jul 14 04:08:41 MDT 2011

The short answer is: Yes and No :-)

The long one:
We can add a new table regarding observations (and indeed that would be 
a great idea), but it's not that easy...
...And good that you were scared, that was the idea ;-) Indeed the page 
represents a (pretty) accurate view of the Archive at any time... if you 
go to info, you can even compare versions and thus see how the Archive 
grew from day to day. (Not much interesting now, as most of the older 
versions where just tests of mine...). Because I'm generating that data 
automatically, parsing observations might not be a trivial task... 
haven't tried, though I already have problems with sites not conforming 
to DRS.
The code used for this is already available on the esgf-contrib repo 
(cmip5_status.py). It's all python though. I'll be glad to help, but as 
I'm leaving on vacations tomorrow, well have to put it back two weeks.

Adding information manually has already proved to be a short-term 
solution only. On the other hand, we seem to avoid committing ourselves 
to standards, so there I foresee the dilemma for the years to come :-)

Thanks,
Estani

Am 13.07.2011 18:29, schrieb Cinquini, Luca (3880):
> Hi Estani,
> is it ok to include in that table information about the observations 
> that will be part of the CMIP archive ? If the answer is yes, do I 
> insert the information manually in the page ?
> There is a scary line there that says "/This page gets automatically 
> generated. All changes will get lost after next update."/
> /
> /
> /thanks, Luca/
> /
> /
> On Jul 13, 2011, at 8:42 AM, Estanislao Gonzalez wrote:
>
>> Hi Sebastien,
>>
>> I still can't understand why there are data nodes not accepting PKI 
>> access. I've asked around but never got any answer.
>>
>> What we can do is mark the data node we know has no PKI in place in 
>> the list as such. Non marked one are supposed to be working.
>>
>> Furthermore I'm not sure if it's really the data node not accepting 
>> PKI access or the gateways not configured to provide them while 
>> generating the wget script.
>>
>> By the way, I'm still not sure which version is around... The latest 
>> I've built used the checksums to assure the files were downloaded 
>> correctly, are all Gateways using that one?
>>
>> Now regarding http://esgf.org/wiki/Cmip5Status/ArchiveView I've 
>> created that page just recently (glad you've found it out ;-). It's a 
>> prototype so I might have to tune it a little bit.
>> The main idea is to harvest known Gateways/top level collections for 
>> new datasets and building that summary you see (plus the DB we have).
>> Sadly the Gateway API prior to 1.3.1 together with the non 
>> conformance to DRS structures make it "unstable" so there are some 
>> data nodes that I just can't get information from.
>>
>> I'll try to keep evolving it as time permits.
>>
>> Thanks,
>> Estani
>>
>>
>> Am 13.07.2011 16:32, schrieb Sébastien Denvil:
>>> Dear all,
>>>
>>> from this page http://esgf.org/wiki/Cmip5Status the 
>>> http://esgf.org/wiki/Cmip5Status/ArchiveView page is very useful. 
>>> Thanks.
>>>
>>> I'm sure it's in the pipeline and I mention it in case it's not:
>>> - it would be great if we can have for each datanode a PKI access 
>>> (yes/no) flag we could refer to.
>>>
>>> All the best.
>>> Sébastien
>>>
>>> On 12/07/2011 21:35, Williams, Dean N. wrote:
>>>> Thanks Bob, Eric, and everyone else for updating the information on 
>>>> the website. We will have network connectivity listed on this site 
>>>> soon.
>>>>
>>>> Best regards,
>>>>     Dean
>>>>
>>>>
>>>> Bob Drach On 7/12/11 11:55 AM, "Bob Drach" <drach1 at llnl.gov 
>>>> <x-msg://6/drach1@llnl.gov>> wrote:
>>>>
>>>>     OK, done for the PCMDI nodes. --Bob
>>>>
>>>>
>>>>     On 7/12/11 6:45 AM, "Williams, Dean N." <williams13 at llnl.gov
>>>>     <x-msg://6/williams13@llnl.gov>> wrote:
>>>>
>>>>         Dear Administrators,
>>>>
>>>>             Please update the Nodes & Gateways web page found at:
>>>>         _http://esgf.org/wiki/Cmip5Status_. For example, if you
>>>>         have updated your test gateway to 1.3.0, please indicate it.
>>>>
>>>>
>>>>         Thanks,
>>>>             Dean
>>>>
>>>>
>>>>
>>>> _______________________________________________
>>>> GO-ESSP-TECH mailing list
>>>> GO-ESSP-TECH at ucar.edu
>>>> http://mailman.ucar.edu/mailman/listinfo/go-essp-tech
>>>
>>>
>>> -- 
>>> Sébastien Denvil
>>> IPSL, Pôle de modélisation du climat
>>> UPMC, Case 101, 4 place Jussieu,
>>> 75252 Paris Cedex 5
>>>
>>> Tour 45-55 2ème étage Bureau 209
>>> Tel: 33 1 44 27 21 10
>>> Fax: 33 1 44 27 39 02
>>>
>>>
>>> _______________________________________________
>>> GO-ESSP-TECH mailing list
>>> GO-ESSP-TECH at ucar.edu
>>> http://mailman.ucar.edu/mailman/listinfo/go-essp-tech
>>
>>
>> -- 
>> Estanislao Gonzalez
>>
>> Max-Planck-Institut für Meteorologie (MPI-M)
>> Deutsches Klimarechenzentrum (DKRZ) - German Climate Computing Centre
>> Room 108 - Bundesstrasse 45a, D-20146 Hamburg, Germany
>>
>> Phone:   +49 (40) 46 00 94-126
>> E-Mail:gonzalez at dkrz.de  
>> _______________________________________________
>> GO-ESSP-TECH mailing list
>> GO-ESSP-TECH at ucar.edu <mailto:GO-ESSP-TECH at ucar.edu>
>> http://mailman.ucar.edu/mailman/listinfo/go-essp-tech
>

-- 
Estanislao Gonzalez

Max-Planck-Institut für Meteorologie (MPI-M)
Deutsches Klimarechenzentrum (DKRZ) - German Climate Computing Centre
Room 108 - Bundesstrasse 45a, D-20146 Hamburg, Germany

Phone:   +49 (40) 46 00 94-126
E-Mail:  gonzalez at dkrz.de

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.ucar.edu/pipermail/go-essp-tech/attachments/20110714/4f1137e8/attachment.html 