[Go-essp-tech] [metafor] Minutes: 1/6/10 Output Variable Telecon

[Hans Ramthun]

Hallo Bob,

Thanks for your offer to help us. I think we'll come back to you later
during the development.

My colleague Stephan Kindermann told told me about changes in the
database structure of the ESG Publisher database.

What I want to do is to develop the program frame:
- connect the database,
- understand how SQLAlchemy works on database tables
- create an appropriate output: a (hopefully) valid CIM XML dataObject
(e.g. with the python lxml library).

Cheers
Hans


Bob Drach wrote:
> Hans, Mark,
>
> I'll be happy to help out if you have questions about understanding or
> accessing the node database. Be aware that the node database schema is
> evolving somewhat to handle addition of dataset and file versions.
> Don't hardwire anything to the existing schema quite yet.
>
> Bob
>
> On Jan 7, 2010, at 7:08 AM, Hans Ramthun wrote:
>
>> Hallo Mark,
>>
>> Yes of course there are several points of collaboration. I'm happy not
>> to dig alone through the mountain...
>>
>> I published my very first steps in the Metafor svn:
>> http://*metaforclimate.eu/trac/browser/cimTOOLS/branches/ESG-DB-access-TEST
>>
>> The first test was with the python library 'psycopg2'.
>>
>> Cheers
>> Hans
>>
>>
>> Mark Morgan wrote:
>>> Hans
>>>
>>> Here at IPSL we are in the process of beginning to do exactly the same
>>> thing: coding a python library to interface with the ESG publisher
>>> postgres database in order to act as a prelimnary step in the Metafor
>>> CIM publishing process.
>>>
>>> Perhaps this can be a point of collaboration either in the development
>>> or testing (or both)?
>>>
>>> Regards
>>>
>>> Mark
>>>
>>> Hans Ramthun wrote:
>>>> Hallo,
>>>>
>>>> Bryan Lawrence wrote:
>>>>
>>>>> ...
>>>>>
>>>>>> Right now, we would have to parse the thredds catalog as you say to
>>>>>> get the list of variables.  No code exists to convert the data
>>>>>> collection names into a list of variable names.  Code does exist to
>>>>>> create the list of data collections.
>>>>>>
>>>>> I think we all need a bit of code for that. We should write it
>>>>> standalone so we can all use the logic if not the code ...
>>>>> hopefully this is on the agenda for Hans and/or Stephen.
>>>>>
>>>> On my agenda is to access the ESG publisher postgres database with
>>>> SQLAlchemy and to retrieve the appropriate data to create CIMRecords
>>>> (dataObject). This should led to a stand alone python program. I think
>>>> Stephen wants to go the same way.
>>>>
>>>>
>>>>> Cheers
>>>>> Bryan
>>>>>
>>>> Cheers
>>>> Hans
>>>>
>>>>
>>>
>>
>>
>> -- 
>> Hans Ramthun
>> Tel.: +49.40.460.094.112
>> Email: hans.ramthun at zmaw.de
>>
>> DKRZ-Hamburg / Max-Planck-Institut fuer Meteorologie
>> Abteilung Modelle und Daten     http://*www.*mad.zmaw.de/
>> Bundesstr. 45a
>> D-20146 Hamburg                 Germany
>>
>> _______________________________________________
>> GO-ESSP-TECH mailing list
>> GO-ESSP-TECH at ucar.edu
>> http://*mailman.ucar.edu/mailman/listinfo/go-essp-tech
>>
>


-- 
Hans Ramthun
Tel.: +49.40.460.094.112
Email: hans.ramthun at zmaw.de

DKRZ-Hamburg / Max-Planck-Institut fuer Meteorologie
Abteilung Modelle und Daten     http://www.mad.zmaw.de/
Bundesstr. 45a
D-20146 Hamburg                 Germany