[Dart-dev] DART/branches Revision: 12570

[dart at ucar.edu]

nancy at ucar.edu
2018-05-03 09:11:57 -0600 (Thu, 03 May 2018)
176
added the contents of the README file here.  it could use
more formatting, but the information is accurate. 
will change the README contents to point to the html.
thanks tim.




Modified: DART/branches/rma_trunk/observations/obs_converters/gps/gps.html
===================================================================
--- DART/branches/rma_trunk/observations/obs_converters/gps/gps.html	2018-04-30 21:03:23 UTC (rev 12569)
+++ DART/branches/rma_trunk/observations/obs_converters/gps/gps.html	2018-05-03 15:11:57 UTC (rev 12570)
@@ -27,8 +27,9 @@
 
 <A HREF="#DataSources">DATA SOURCES</A> /
 <A HREF="#Programs">PROGRAMS</A> / 
+<A HREF="#Namelist">NAMELIST</A> /
+<A HREF="#Workflow">WORKFLOW</A> / 
 <A HREF="#Modules">MODULES</A> /
-<A HREF="#Namelist">NAMELIST</A> /
 <A HREF="#Errors">ERRORS</A> /
 <A HREF="#FuturePlans">FUTURE PLANS</A> /
 <A HREF="#Legalese">TERMS OF USE</A>
@@ -93,18 +94,20 @@
 the string 'atmPrf').
 <br />
 <br />
-Currently each vertical profile is stored in a separate file,
+Each vertical profile is stored in a separate netCDF file,
 and there are between 1000-3000 profiles/day, so converting a day's
-worth of observations involves downloading many individual files.
-There are plans in place by the data providers to bundle these 
-profiles together in a tar file to make it simpler to download the raw data.
+worth of observations used to involve downloading many individual files.
+There are now daily tar files available which makes it simpler
+to download the raw data all in a single file and then untar it to
+get the individual profiles.
 <br />
 <br />
-The scripts in the <em class=file>shell_scripts</em> directory now
-by default try to download profiles from any of the available
+The scripts in the <em class=file>shell_scripts</em> directory can
+now download profiles from any of the available
 satellites that return GPS RO data to the CDAAC web site.  See the
-<em class=file>do_convert.csh</em> script for a list of what 
-satellites are checked by default.
+<em class=file>gpsro_to_obsseq.csh</em> or
+<em class=file>convert_many_gpsro.csh</em> script for where to 
+specify the satellites to be included.
 </P>
 
 <H3>Electron Density</H3>
@@ -115,8 +118,9 @@
 <br />
 The file naming convention and file format are described by COSMIC 
 <a href=' http://cdaac-www.cosmic.ucar.edu/cdaac/cgi_bin/fileFormats.cgi?type=ionPrf'>here</a> 
-and there can be more than 1000 profiles/day, so converting a day's
-worth of observations involves downloading many individual files.
+and there can be more than 1000 profiles/day. Like the GPS radio
+occultation data, the profiles are now available in a single daily
+tar file which can be downloaded then be unpacked into the individual files.
 COSMIC has instructions on ways to download the data at<br />
 <a href='http://cdaac-www.cosmic.ucar.edu/cdaac/tar/rest.html'
 >http://cdaac-www.cosmic.ucar.edu/cdaac/tar/rest.html</a>
@@ -545,6 +549,116 @@
 
 <!--==================================================================-->
 
+<A NAME="Workflow"></A>
+<div class="top">[<a href="#">top</a>]</div><hr />
+<H2>WORKFLOW FOR BATCH CONVERSIONS</H2>
+
+<!-- THIS NEEDS MORE WORK.  IT'S BASICALLY THE CONTENTS OF
+     THE README DROPPED IN HERE WITH A </pre> PREPENDED.  
+     BUT IT'S BETTER THAN NOTHING.  -->
+
+<P>
+If you are converting only a day or two of observations
+you can download the files by hand and call the converter 
+programs from the command line.  However if you are going
+convert many days/months/years of data you need an automated
+script, possibly submitted to a batch queue on a large machine.
+The following instructions describe shell scripts we provide
+as a guide in the <em class=file>shell_scripts</em> directory.
+You will have to adapt them for your own system
+unless you are running on an NCAR superscomputer.
+</P>
+
+<P>
+<pre>
+<b>Making DART Observations from Radio Occultation atmPrf Profiles:</b>
+
+Description of the scripts provided to process the COSMIC and 
+CHAMP GPS radio occultation data.
+
+Summary of workflow:  
+1) cd to the ../work directory and run ./quickbuild.csh to compile everything.  
+2) Edit ./gpsro_to_obsseq.csh once to set the directory where the DART
+    code is installed, and your CDAAC web site user name and password.
+3) Edit ./convert_many_gpsro.csh to set the days of data to download/convert/remove.
+4) Run ./convert_many_gpsro.csh either on the command line or submit to a batch system.
+
+
+More details:
+
+1) quickbuild.csh:
+
+Make sure your $DART/mkmf/mkmf.template is one that matches the
+platform and compiler for your system.  It should be the same as