[Go-essp-tech] [esg-gateway-dev] [esg-node-dev] Re: Upcoming gateway/datanode coordination points
Don Middleton
don at ucar.edu
Fri Mar 18 12:25:09 MDT 2011
Thanks for the response on the registry topic, Gavin. Can you also respond to Nate's metrics question at the beginning of the thread? There has been a desire and intent to get metrics support into 1.3, but we're just about out of time on it. There needs to be a viable service up such that development and integration testing can be done. Otherwise, this may have to be pushed out to a later release.
thanks - don
On Mar 18, 2011, at 11:53 AM, Gavin M. Bell wrote:
> Hello Team,
>
> So indeed you guys are all correct, thanks for responding to Bryan giving him a good context in which to think about the registry service. Nathan, indeed as you indicated there are points of integration that we need to touch base on. I think next week would be a good time to do so. It would be good to get on the same page with the xsd. I am not sure which version you are using and I discovered a few more modifications that had to be made, which also simplifies things as well. We have to make sure we capture all the information and agree on the xsd organization.
>
> Indeed the registration information will be able to be easily aggregated and disseminated and as you and Estani mentioned, cached.
>
> On 3/18/11 7:13 AM, Nathan Wilhelmi wrote:
>>
>> Hi Estani,
>>
>> The caching you describe is implemented in the gateway now. All the
>> registry information is persisted in the database and the code that
>> synchronizes with the registry is decoupled from the parts that use the
>> registry information. As such if worst came to worst one could directly
>> modify the database if a change was needed and the service is down.
>>
>> -Nate
>>
>> On 03/18/2011 04:21 AM, Estanislao Gonzalez wrote:
>>> Hi Bryan,
>>>
>>> I don't think it is important to be available 24x7. I hope (probably is
>>> not developed, but will be pretty simple to do) that the Gateway caches
>>> the last registry document found, so that it can be still restarted
>>> without problem if precisely at that moment PCMDI's central registry is
>>> not available.
>>>
>>> The worst case scenario would be if someone wants to install a Gateway
>>> anew and at precisely that moment the registry is down. this could be
>>> solved by packing a "pre-cached" version of the registry with it (not
>>> that I think this will be that important, as adding this new Gateway to
>>> the federation will take time).
>>>
>>> So while the server is down, no new Gateway can be added to the
>>> federation, nor any other changes be done. But the federation itself
>>> should work without a hitch.
>>>
>>> But perhaps I'm missing something here...
>>>
>>> Thanks,
>>> Estani
>>>
>>>
>>> Am 18.03.2011 10:15, schrieb Bryan Lawrence:
>>>> Hi Gavin
>>>>
>>>> What will the API be to this registry?
>>>> What service level with PCMDI provide for it (since it's going to have
>>>> to work 24x7 globally)?
>>>>
>>>> Thanks
>>>> Bryan
>>>>
>>>>
>>>>> We will have a single registry, it should be served from PCMDI on
>>>>> pcmdi3. The esgf nodes will all be coded to set pcmdi3 as the
>>>>> default location for this registry. Indeed coordination with Nate
>>>>> and Neill and Rachana will have to take place. I suspect that early
>>>>> next week will be that time. Stay tuned, we'll make this happen.
>>>>> ;-)
>>>>>
>>>>> On 3/17/11 8:32 AM, philip.kershaw at stfc.ac.uk wrote:
>>>>>> So long as we are co-ordinated on this. Will we have a single
>>>>>> registry for the federation or many? I'm opening that question
>>>>>> more widely to all …
>>>> --
>>>> Bryan Lawrence
>>>> Director of Environmental Archival and Associated Research
>>>> (NCAS/British Atmospheric Data Centre and NCEO/NERC NEODC)
>>>> STFC, Rutherford Appleton Laboratory
>>>> Phone +44 1235 445012; Fax ... 5848;
>>>> Web: home.badc.rl.ac.uk/lawrence
>>>>
>>>
>> _______________________________________________
>> esg-gateway-dev mailing list
>> esg-gateway-dev at mailman.earthsystemgrid.org
>> http://mailman.earthsystemgrid.org/mailman/listinfo/esg-gateway-dev
>
> --
> Gavin M. Bell
> --
>
> "Never mistake a clear view for a short distance."
> -Paul Saffo
>
> _______________________________________________
> GO-ESSP-TECH mailing list
> GO-ESSP-TECH at ucar.edu
> http://mailman.ucar.edu/mailman/listinfo/go-essp-tech
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.ucar.edu/pipermail/go-essp-tech/attachments/20110318/95b8a422/attachment.html
More information about the GO-ESSP-TECH
mailing list