[Go-essp-tech] Fwd: [Curator] Tasks left for the metadata pipeline

[Sylvia Murphy]

HI Everyone,
I wrote up the summary below for the Curators, but several people have mentioned its usefulness, so I am forwarding it to this list for your reading pleasure. 
Cheers,
Sylvia

Begin forwarded message:

> From: Sylvia Murphy <Sylvia.Murphy at noaa.gov>
> Date: September 16, 2010 4:31:56 PM MDT
> To: curator at list.woc.noaa.gov
> Subject: [Curator] Tasks left for the metadata pipeline
> 
> Hi Everyone,
> 
> Here is an update on the metadata pipeline.  First let me review what steps are involved in the pipeline...
> 
> 1) Software periodically queries the feed for new files and send them to the harvester [Status: software written, not on ESG's trunk]
> 2) The harvester translates the harvested items and injects them directly into sesame triple store [Status: software written and working]
> 3) The gateway periodically (every five minutes or so) updates the search facets available in the search [Status: software written and working]
> 
> 
> It is step 1 that is currently missing.  Luca has written the code, it just needs to be integrated into ESG.  On 12 August the following tasks were identified to complete this step:
> 
>     **Have Luca fill out the CLA form and submit it  [Status: Luca has CLA.  Caltech wants to review]
>     **Create a development branch and give Luca access
>     **Have Luca upload his Feed query software piece to the branch
>     **Hannah or Nate can integrate this code into the pipeline. 
> 
> Just as a reminder, the harvester currently can handle:
> 
> * The model component tree
> * Model descriptions
> * Citations/References
> * Responsible parties
> * Scientific properties
> * Platforms
> * Inputs
> * Misc basic properties like SimualtionDuration
> 
> We anticipate some changes to the conformance section which may require some tweaking of the harvester to get it right.  There may also be a few miscellaneous properties that are new that will need to be added to the software.  The software has been able to handle the bulk of the information in the sample XML files sent to us by METAFOR.  
> 
> You are welcome to peruse the online version of the latest XML sample at: http://curator.ucar.edu/trackback/query.htm?id=esg:model_higem
> 
> Cheers,
> 
> Sylvia
> 
> ***********************************
> Sylvia Murphy
> NESII/CIRES/NOAA Earth System Research Laboratory
> 325 Broadway, Boulder CO 80305
> Email: sylvia.murphy at noaa.gov
> Phone: 303-497-7753
> Fax: 303-497-7649
> 
> 
> 
> 
> 
> 
> 
> _______________________________________________
> Curator mailing list
> Curator at list.woc.noaa.gov
> https://list.woc.noaa.gov/cgi-bin/mailman/listinfo/curator

***********************************
Sylvia Murphy
NESII/CIRES/NOAA Earth System Research Laboratory
325 Broadway, Boulder CO 80305
Email: sylvia.murphy at noaa.gov
Phone: 303-497-7753
Fax: 303-497-7649







-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.ucar.edu/pipermail/go-essp-tech/attachments/20100917/5bd6fdf9/attachment.html