[Go-essp-tech] [is-enes-sa2-jra4] Example of configuring a datanode to serve CMIP3-DRS

Bryan Lawrence bryan.lawrence at stfc.ac.uk
Thu Jul 1 04:55:34 MDT 2010


sorry.

the first sentence should have read

Just to note that *our* approach to the local versus replication issue 
will be ...

Cheers
Bryan

On Thursday 01 Jul 2010 11:25:37 Bryan Lawrence wrote:
> Hi Estani
> 
> Just to note that your approach to the local versus replication will
>  be to run two different ESG nodes ... which is in fact the desired
>  outcome so as to get the right things in the catalogues at the right
>  time (vis- a-viz qc etc).
> 
> The issue with respect to cache, I'm not so sure about, in what way
>  do you want to expose that into ESG?
> 
> Bryan
> 
> On Wednesday 30 Jun 2010 17:05:57 Estanislao Gonzalez wrote:
> > Hi Stephen,
> >
> > the page contains really helpful information, thanks a lot!
> >
> > I'm also interested in some variables of the DEFAULT section from
> > the esg.ini configuration file. More specifically:
> > thredds_dataset_roots (and maybe thredds_aggregation_services or
> > any other which was changed or you think it might be important)
> >
> > The main question here is: how can different local directory
> >  structures be published to the same DRS structure?
> > The example scenario in our case will be:
> > /replicated/<DRS structure> - for replicated data
> > /local/<DRS structure> - for non replicated data hold on disk
> > /cache/<DRS structure> - for data staged from a HPSS system
> >
> > The only solution I can think of is to extend the URL before the
> > DRS structure starts (the URL won't be 100% DRS conform anyway). So
> >     http://server/thredds/fileserver/<DRS structure>
> > will turn into
> >     http://server/thredds/fileserver/replicated/<DRS structure>
> >     http://server/thredds/fileserver/local/<DRS structure>
> >     http://server/thredds/fileserver/cache/<DRS structure>
> >
> > Is that viable? Are there any other options?
> >
> > Thanks,
> > Estani
> >
> > stephen.pascoe at stfc.ac.uk wrote:
> > > To illustrate how the ESG datanode can be configured to serve
> > > data for CMIP5 we have deployed a datanode containing a subset of
> > > CMIP3 in the Data Reference Syntax. Some key features of this
> > > deployment are:
> > >
> > >     * The underlying directory structure is based on the Data
> > >       Reference Syntax.
> > >     * Datasets published at the realm level.
> > >     * The token-based security filter is replaced by the
> > >       OpenidRelyingParty security filter.
> > >
> > > Further notes can be found at
> > > http://proj.badc.rl.ac.uk/go-essp/wiki/CMIP3_Datanode
> > >
> > > This test deployment should be of interest to anyone wanting to
> > > know how DRS identifiers could be exposed in THREDDS catalogues
> > > and the TDS HTML interface.  You can also try downloading files
> > > with OpenID authentication or via wget with SSL-client
> > > certificate authentication.  See the link above for details.
> > >
> > > Cheers,
> > > Stephen.
> > >
> > >
> > > ---
> > > Stephen Pascoe  +44 (0)1235 445980
> > > British Atmospheric Data Centre
> > > Rutherford Appleton Laboratory
> > >
> > >
> > >
> > >
> > > -----------------------------------------------------------------
> > >-- -----
> > >
> > > _______________________________________________
> > > GO-ESSP-TECH mailing list
> > > GO-ESSP-TECH at ucar.edu
> > > http://mailman.ucar.edu/mailman/listinfo/go-essp-tech
> 

-- 
Bryan Lawrence
Director of Environmental Archival and Associated Research
(NCAS/British Atmospheric Data Centre and NCEO/NERC NEODC)
STFC, Rutherford Appleton Laboratory
Phone +44 1235 445012; Fax ... 5848; 
Web: home.badc.rl.ac.uk/lawrence


More information about the GO-ESSP-TECH mailing list