[Go-essp-tech] verification of datanode status

[Estanislao Gonzalez]

T(sorry the message got cut)
...it's up to the publisher to define when data shouldn't be accessible 
anymore.

There are some improvements that can be doen, but most I can think of 
will make the understanding of the system more complex to the end user.

Datanode admin should rely on tools that help them get their nodes up 
for as long as possible (nagios & Co).

My 2c,
Estani
On 19.12.2011 08:04, Estanislao Gonzalez wrote:
> Hi Luca,
>
> That's not what Henrik meant. Neither the architecture retains a 
> living
> link to a data nose (not an index one, as you've pointed out)
>
> This is a feature IMO as the search engine is detached from the
> dataone. The index might indeed "prune" the data nodes down, but 
> unless
> this is done synchroneusly it would difficult the federation
> interaction.
> Or to say it differently: Is up to the data node to assure data is
> available, and if that's not desired anymore, On 19.12.2011 07:15,
> Cinquini, Luca (3880) wrote:
>> Hi Henirik,
>> 	not sure about the gateway, but this is a feature the P2P system
>> does have: has soon as a datanode is inaccessible, the search
>> automatically prunes that node away, so the search results never
>> contain dead links.
>> thanks, Luca
>>
>> On Dec 19, 2011, at 3:58 AM, Henrik Wiberg wrote:
>>
>>> Does the gateway somehow 'ping' its registered datanodes to verify
>>> that
>>> they are accessible? The datanode at dmi has not been running for 5
>>> mounts still the datanodes published datasets are searchable and
>>> displayed at the gateway cmip-gw-badc. Should not inaccessible
>>> datasets
>>> be removed from the search result?
>>>
>>> _______________________________________________
>>> GO-ESSP-TECH mailing list
>>> GO-ESSP-TECH at ucar.edu
>>> http://mailman.ucar.edu/mailman/listinfo/go-essp-tech
>>
>> _______________________________________________
>> GO-ESSP-TECH mailing list
>> GO-ESSP-TECH at ucar.edu
>> http://mailman.ucar.edu/mailman/listinfo/go-essp-tech

-- 
Estanislao Gonzalez

Max-Planck-Institut für Meteorologie (MPI-M)
Deutsches Klimarechenzentrum (DKRZ) - German Climate Computing Centre
Room 108 - Bundesstrasse 45a, D-20146 Hamburg, Germany

Phone:   +49 (40) 46 00 94-126
E-Mail:  gonzalez at dkrz.de