[Go-essp-tech] esg publisher, thredds and netcdf attributes
Bob Drach
drach at llnl.gov
Wed Jun 9 12:12:55 MDT 2010
Hi Bryan,
As you point out the dataset properties don't carry along information
about their origin, although I imagine they could if necessary. In the
context of CMIP5 we could probably stipulate in advance which is
which, but more generally the source of a property could be from a
data file / database, directory structure, interactively from the data
curator / publisher, or from a data handler. For example, if a CMIP5
datafile was not generated through CMOR, and did not have the required
properties defined, it could still be published by specifying those
properties as command line arguments.
If this is an important issue it might be possible to group property
elements within 'metadata' tags, based on their origin. See
http://www.unidata.ucar.edu/projects/THREDDS/tech/catalog/v1.0.2/InvCatalogSpec.html#metadataElement
for the gory schema details. Also be aware that in THREDDS there is a
distinction between the configuration catalog - which the publisher
generates - and the catalog as served by the TDS. For property
elements they should be the same, but for some elements they will
differ.
Best regards,
Bob
On Jun 9, 2010, at 2:13 AM, Bryan Lawrence wrote:
> Hi Bob
>
> As you know, we're in the process of building a tool to parse the
> thredds catalogs produced by esg-publisher.
>
> We're sitting in a meeting looking at the Thredds XML.
>
> At the moment there are dataset properties which reflect attributes
> from
> the files, and some which come from esg-publisher. From the point of
> view
> of automatically consuming these catalogs, we can't tell the
> difference
> between these attributes.
>
> For example, the checksum information we presume comes from esg-
> publisher, and the tracking-id from internal attributes file.
>
> Is it possible in Thredds to distinguish between these things? It's
> pretty important for unpicking the origin of the information which
> appears in the catalog.
>
> Thanks
> Bryan
>
> --
> Bryan Lawrence
> Director of Environmental Archival and Associated Research
> (NCAS/British Atmospheric Data Centre and NCEO/NERC NEODC)
> STFC, Rutherford Appleton Laboratory
> Phone +44 1235 445012; Fax ... 5848;
> Web: home.badc.rl.ac.uk/lawrence
More information about the GO-ESSP-TECH
mailing list