[Go-essp-tech] Update Nodes & Gateways Web Page
Ashish Bhardwaj
abhipsl at ipsl.jussieu.fr
Tue Jul 19 05:01:07 MDT 2011
Hi Stephen,
By a quick look, missing 5 datasets are from:
Experiment | No. of datasets at IPSL Datanode | No. of datasets
at BADC facets
-----------------------------------------------------------------------------------------------------------------
historical | 115
| 111
1pctCO2 | 26
| 25
----------------------------------------------------------------------------------------------------------------
Ashish
stephen.pascoe at stfc.ac.uk wrote:
> When I look at our gateway database there are 375 datasets. When I view the CMIP5_ipsl collection directly it contains 375 datasets. When I view the facetted search I see 375. I expect this is a triple-store problem. There is probably a single ensemble, variable or realm that isn't in the facetted search.
>
> Sébastien or Ashish, can you tell which datasets are missing when you view the BADC facets?
>
> Estani, where did your figure of 345 come from?
>
> Thanks,
> Stephen.
>
> ---
> Stephen Pascoe +44 (0)1235 445980
> Centre of Environmental Data Archival
> STFC Rutherford Appleton Laboratory, Harwell Oxford, Didcot OX11 0QX, UK
>
>
> -----Original Message-----
> From: go-essp-tech-bounces at ucar.edu [mailto:go-essp-tech-bounces at ucar.edu] On Behalf Of Estanislao Gonzalez
> Sent: 18 July 2011 21:33
> To: Ashish Bhardwaj
> Cc: go-essp-tech at ucar.edu; Sébastien Denvil
> Subject: Re: [Go-essp-tech] Update Nodes & Gateways Web Page
>
> Hi Ashish,
>
> ... well, AFAIK it should...
>
> But indeed the number I get are 375 if I count the datasets from the
> data nodes directly, 370 from the 3store and 345 from BADC's gateway.
> I'll see if I find the difference when I get back from my vacations.
>
> In any case you should have the correct data. How many datasets where
> meant to be published?
>
> Thanks,
> Estani
> On Fri, 15 Jul 2011 12:37:14 +0200, Ashish Bhardwaj wrote:
>
>> Hi Estani,
>>
>> Archive view page ( http://esgf.org/wiki/Cmip5Status/ArchiveView )
>> mentions that information is harvested from some Gateways (at the
>> moment PCMDI and BADC). But number of IPSL datasets (model:
>> IPSL-CM5A-LR) does not match with the number shown at gateways
>> (neither PCMDI nor BADC).
>>
>> Regards,
>> Ashish
>>
>> Estanislao Gonzalez wrote:
>>
>>> Hi Sebastien,
>>>
>>> I still can't understand why there are data nodes not accepting PKI
>>> access. I've asked around but never got any answer.
>>>
>>> What we can do is mark the data node we know has no PKI in place in
>>> the list as such. Non marked one are supposed to be working.
>>>
>>> Furthermore I'm not sure if it's really the data node not accepting
>>> PKI access or the gateways not configured to provide them while
>>> generating the wget script.
>>>
>>> By the way, I'm still not sure which version is around... The latest
>>> I've built used the checksums to assure the files were downloaded
>>> correctly, are all Gateways using that one?
>>>
>>> Now regarding http://esgf.org/wiki/Cmip5Status/ArchiveView I've
>>> created that page just recently (glad you've found it out ;-). It's a
>>> prototype so I might have to tune it a little bit.
>>> The main idea is to harvest known Gateways/top level collections for
>>> new datasets and building that summary you see (plus the DB we have).
>>> Sadly the Gateway API prior to 1.3.1 together with the non
>>> conformance to DRS structures make it "unstable" so there are some
>>> data nodes that I just can't get information from.
>>>
>>> I'll try to keep evolving it as time permits.
>>>
>>> Thanks,
>>> Estani
>>>
>>>
>>> Am 13.07.2011 16:32, schrieb Sébastien Denvil:
>>>
>>>> Dear all,
>>>>
>>>> from this page http://esgf.org/wiki/Cmip5Status the
>>>> http://esgf.org/wiki/Cmip5Status/ArchiveView page is very useful.
>>>> Thanks.
>>>>
>>>> I'm sure it's in the pipeline and I mention it in case it's not:
>>>> - it would be great if we can have for each datanode a PKI access
>>>> (yes/no) flag we could refer to.
>>>>
>>>> All the best.
>>>> Sébastien
>>>>
>>>> On 12/07/2011 21:35, Williams, Dean N. wrote:
>>>>
>>>>> Thanks Bob, Eric, and everyone else for updating the information
>>>>> on the website. We will have network connectivity listed on this
>>>>> site soon.
>>>>>
>>>>> Best regards,
>>>>> Dean
>>>>>
>>>>>
>>>>> Bob Drach On 7/12/11 11:55 AM, "Bob Drach" <drach1 at llnl.gov>
>>>>> wrote:
>>>>>
>>>>> OK, done for the PCMDI nodes. --Bob
>>>>>
>>>>>
>>>>> On 7/12/11 6:45 AM, "Williams, Dean N." <williams13 at llnl.gov>
>>>>> wrote:
>>>>>
>>>>> Dear Administrators,
>>>>>
>>>>> Please update the Nodes & Gateways web page found at:
>>>>> _http://esgf.org/wiki/Cmip5Status_ . For example, if you
>>>>> have updated your test gateway to 1.3.0, please indicate
>>>>> it.
>>>>>
>>>>>
>>>>> Thanks,
>>>>> Dean
>>>>>
>>>>>
>>>>>
>>>>> _______________________________________________
>>>>> GO-ESSP-TECH mailing list
>>>>> GO-ESSP-TECH at ucar.edu
>>>>> http://mailman.ucar.edu/mailman/listinfo/go-essp-tech
>>>>>
>>>>>
>>>> -- Sébastien Denvil
>>>> IPSL, Pôle de modélisation du climat
>>>> UPMC, Case 101, 4 place Jussieu,
>>>> 75252 Paris Cedex 5
>>>>
>>>> Tour 45-55 2ème étage Bureau 209
>>>> Tel: 33 1 44 27 21 10
>>>> Fax: 33 1 44 27 39 02
>>>>
>>>>
>>>>
>>>> _______________________________________________
>>>> GO-ESSP-TECH mailing list
>>>> GO-ESSP-TECH at ucar.edu
>>>> http://mailman.ucar.edu/mailman/listinfo/go-essp-tech
>>>>
>>>>
>>> -- Estanislao Gonzalez
>>>
>>> Max-Planck-Institut für Meteorologie (MPI-M)
>>> Deutsches Klimarechenzentrum (DKRZ) - German Climate Computing
>>> Centre
>>> Room 108 - Bundesstrasse 45a, D-20146 Hamburg, Germany
>>>
>>> Phone: +49 (40) 46 00 94-126
>>> E-Mail: gonzalez at dkrz.de
>>> ------------------------------------------------------------------------
>>>
>>> _______________________________________________
>>> GO-ESSP-TECH mailing list
>>> GO-ESSP-TECH at ucar.edu
>>> http://mailman.ucar.edu/mailman/listinfo/go-essp-tech
>>>
>>>
>
>
--
Ashish Bhardwaj
Software Engineer
Institut Pierre Simon Laplace
UPMC, Case 101, 4 place Jussieu,
75252 Paris Cedex 5
Tour 45-55 2ème étage Bureau 207
Tel: 33 1 44 27 49 10
More information about the GO-ESSP-TECH
mailing list