[Cosmic_announce] CDAAC new data fetching commands

[Maggie Sleziak-Sallee]

   Dear CDAAC Data Users:

   Many of you probably have WGET commands in a crontab to fetch data 
daily/constantly from us. - i.e:
    wget -e robots=off -nd -np -r -l 10 -w 2 --http-user=xxxx  
--http-passwd=xxxx 
http://cosmic-io.cosmic.ucar.edu/cdaac/login/cosmicrt/level2/atmPrf/YYYY.DDD/* 


   These type of WGET commands will be phased out mission by mission 
starting with mission GRACE in December - We will send an email closer 
to the time.


   If you are using WGET commands please change to the following:

    1.- To get a daily tar file for a given data type:
    wget -q --http-user=xxxx 
--http-passwd=xxxxhttp://cdaac-www.cosmic.ucar.edu/cdaac/rest/tarservice/data/MISSION/dataType/YYYY.DDD  
-O fileOutput.tar

    examples:
    a) Data tarball for mission: cosmic, data type: atmPrf, and date: 
2013.304:
    wget -q --http-user=xxxx 
--http-passwd=xxxxhttp://cdaac-www.cosmic.ucar.edu/cdaac/rest/tarservice/data/cosmic/atmPrf/2012.304  
-O cosmic_atmPrf_2012.304.tar

    b) Data cosmic, data type: wetPrf, and date: 2013.301:
    wget -q --http-user=xxxx 
--http-passwd=xxxxhttp://cdaac-www.cosmic.ucar.edu/cdaac/rest/tarservice/data/cosmic/wetPrf/2012.301  
-O cosmic_wetPrf_2012.301.tar

   The output of this wget command is a tar file - when you untar the 
.tar file, you will find the following directory structure:
   - The mission directory (i.e. cosmic),  inside this directory:
      - The data type directory (i.e. atmPrf) , inside this:
           - The date directory (i.e. 2012.301), and inside this directory:
               - The files.

(You will also get the same directory structure if you get data using 
our Batch Delivery system. )


    2.- To get a single data file:
    wget -q --http-user=xxxx 
--http-passwd=xxxxhttp://cdaac-www.cosmic.ucar.edu/cdaac/rest/tarservice/file/MISSION/YYYY.DDD/FILENAME

    examples:
    File from mission cosmic, date 2013.092, file name 
atmPrf_C001.2013.092.00.01.G22_2010.2640_nc
    wget -q --http-user=xxxx 
--http-passwd=xxxxhttp://cdaac-www.cosmic.ucar.edu/cdaac/rest/tarservice/file/cosmic/2013.092/atmPrf_C001.2013.092.00.01.G22_2010.2640_nc


    We would like to encourage trying these commands by hand first to 
see how the output might affect your existing data ingestion scripts.

    The object of these changes are to eventually switch from providing 
single data files to daily tarballs, helping us to manage our growing 
data inventory better.
    Cheers,
    The CDAAC Team

-- 
Maggie Sleziak-Sallee
Software Engineer II
COSMIC - UCAR
Phone: 303-497-8020
Email: maggie at ucar.edu
http://www.cosmic.ucar.edu/