[Go-essp-tech] Update Nodes & Gateways Web Page

Tue Jul 19 04:17:29 MDT 2011

When I look at our gateway database there are 375 datasets.  When I view the CMIP5_ipsl collection directly it contains 375 datasets.  When I view the facetted search I see 375.  I expect this is a triple-store problem.  There is probably a single ensemble, variable or realm that isn't in the facetted search.

Sébastien or Ashish, can you tell which datasets are missing when you view the BADC facets?

Estani, where did your figure of 345 come from?

Thanks,
Stephen.

---
Stephen Pascoe  +44 (0)1235 445980
Centre of Environmental Data Archival
STFC Rutherford Appleton Laboratory, Harwell Oxford, Didcot OX11 0QX, UK

-----Original Message-----
From: go-essp-tech-bounces at ucar.edu [mailto:go-essp-tech-bounces at ucar.edu] On Behalf Of Estanislao Gonzalez
Sent: 18 July 2011 21:33
To: Ashish Bhardwaj
Cc: go-essp-tech at ucar.edu; Sébastien Denvil
Subject: Re: [Go-essp-tech] Update Nodes & Gateways Web Page

Hi Ashish,

... well, AFAIK it should...

But indeed the number I get are 375 if I count the datasets from the 
data nodes directly, 370 from the 3store and 345 from BADC's gateway. 
I'll see if I find the difference when I get back from my vacations.

In any case you should have the correct data. How many datasets where 
meant to be published?

Thanks,
Estani
On Fri, 15 Jul 2011 12:37:14 +0200, Ashish Bhardwaj wrote:
> Hi Estani,
>
> Archive view page ( http://esgf.org/wiki/Cmip5Status/ArchiveView )
> mentions that information is harvested from some Gateways (at the
> moment PCMDI and BADC). But number of IPSL datasets (model:
> IPSL-CM5A-LR) does not  match with the number shown at gateways
> (neither PCMDI nor BADC).
>
> Regards,
> Ashish
>
> Estanislao Gonzalez wrote:
>> Hi Sebastien,
>>
>> I still can't understand why there are data nodes not accepting PKI 
>> access. I've asked around but never got any answer.
>>
>> What we can do is mark the data node we know has no PKI in place in 
>> the list as such. Non marked one are supposed to be working.
>>
>> Furthermore I'm not sure if it's really the data node not accepting 
>> PKI access or the gateways not configured to provide them while 
>> generating the wget script.
>>
>> By the way, I'm still not sure which version is around... The latest 
>> I've built used the checksums to assure the files were downloaded 
>> correctly, are all Gateways using that one?
>>
>> Now regarding http://esgf.org/wiki/Cmip5Status/ArchiveView I've 
>> created that page just recently (glad you've found it out ;-). It's a 
>> prototype so I might have to tune it a little bit.
>> The main idea is to harvest known Gateways/top level collections for 
>> new datasets and building that summary you see (plus the DB we have).
>> Sadly the Gateway API prior to 1.3.1 together with the non 
>> conformance to DRS structures make it "unstable" so there are some 
>> data nodes that I just can't get information from.
>>
>> I'll try to keep evolving it as time permits.
>>
>> Thanks,
>> Estani
>>
>>
>> Am 13.07.2011 16:32, schrieb Sébastien Denvil:
>>> Dear all,
>>>
>>> from this page http://esgf.org/wiki/Cmip5Status the 
>>> http://esgf.org/wiki/Cmip5Status/ArchiveView page is very useful. 
>>> Thanks.
>>>
>>> I'm sure it's in the pipeline and I mention it in case it's not:
>>> - it would be great if we can have for each datanode a PKI access 
>>> (yes/no) flag we could refer to.
>>>
>>> All the best.
>>> Sébastien
>>>
>>> On 12/07/2011 21:35, Williams, Dean N. wrote:
>>>> Thanks Bob, Eric, and everyone else for updating the information 
>>>> on the website. We will have network connectivity listed on this 
>>>> site soon.
>>>>
>>>> Best regards,
>>>>     Dean
>>>>
>>>>
>>>> Bob Drach On 7/12/11 11:55 AM, "Bob Drach" <drach1 at llnl.gov> 
>>>> wrote:
>>>>
>>>>     OK, done for the PCMDI nodes. --Bob
>>>>
>>>>
>>>>     On 7/12/11 6:45 AM, "Williams, Dean N." <williams13 at llnl.gov> 
>>>> wrote:
>>>>
>>>>         Dear Administrators,
>>>>
>>>>             Please update the Nodes & Gateways web page found at:
>>>>         _http://esgf.org/wiki/Cmip5Status_ . For example, if you
>>>>         have updated your test gateway to 1.3.0, please indicate 
>>>> it.
>>>>
>>>>
>>>>         Thanks,
>>>>             Dean
>>>>
>>>>
>>>>
>>>> _______________________________________________
>>>> GO-ESSP-TECH mailing list
>>>> GO-ESSP-TECH at ucar.edu
>>>> http://mailman.ucar.edu/mailman/listinfo/go-essp-tech
>>>>
>>>
>>>
>>> -- Sébastien Denvil
>>> IPSL, Pôle de modélisation du climat
>>> UPMC, Case 101, 4 place Jussieu,
>>> 75252 Paris Cedex 5
>>>
>>> Tour 45-55 2ème étage Bureau 209
>>> Tel: 33 1 44 27 21 10
>>> Fax: 33 1 44 27 39 02
>>>
>>>
>>>
>>> _______________________________________________
>>> GO-ESSP-TECH mailing list
>>> GO-ESSP-TECH at ucar.edu
>>> http://mailman.ucar.edu/mailman/listinfo/go-essp-tech
>>>
>>
>>
>> -- Estanislao Gonzalez
>>
>> Max-Planck-Institut für Meteorologie (MPI-M)
>> Deutsches Klimarechenzentrum (DKRZ) - German Climate Computing 
>> Centre
>> Room 108 - Bundesstrasse 45a, D-20146 Hamburg, Germany
>>
>> Phone:   +49 (40) 46 00 94-126
>> E-Mail:  gonzalez at dkrz.de 
>> ------------------------------------------------------------------------
>>
>> _______________________________________________
>> GO-ESSP-TECH mailing list
>> GO-ESSP-TECH at ucar.edu
>> http://mailman.ucar.edu/mailman/listinfo/go-essp-tech
>>

-- 
Estanislao Gonzalez

Max-Planck-Institut für Meteorologie (MPI-M)
Deutsches Klimarechenzentrum (DKRZ) - German Climate Computing Centre
Room 108 - Bundesstrasse 45a, D-20146 Hamburg, Germany

Phone:   +49 (40) 46 00 94-126
E-Mail:  gonzalez at dkrz.de
_______________________________________________
GO-ESSP-TECH mailing list
GO-ESSP-TECH at ucar.edu
http://mailman.ucar.edu/mailman/listinfo/go-essp-tech