[Dart-dev] svn:mime-type/ Revision: 12676

[dart at ucar.edu]

raeder at ucar.edu
2018-06-18 11:26:33 -0600 (Mon, 18 Jun 2018)
4137
Based on the code reviews of setup_hybrid, setup_advanced,
DART_config.template (new name), and [no_]assimilate.csh.template
(new names), this commitment encodes clarification of the roles
and use of setup_hybrid and setup_advanced.  It also includes
many small improvements and simplifications.

Setup_hybrid is now a purely CAM oriented script.
DART_config must be run separately, in the $CASEROOT,
to enable assimilation.  DART_config is no longer created
by setup_hybrid, since DART_config gets all of its input
from the user and from the copy of setup_hybrid in $CASEROOT.

Setup_advanced is designed to be used when the user is
confident in the ability to define and build an assimilation
without intermediate checking and testing.  It runs DART_config
by default, which turns on the assimilation in CESM.
It still provides access to specialized capabilities,
such as high resolution sea surface temperatures and WACCM(-X).

The notable changes to the scripts include the following.

All
> Instructions and internal documentation have been updated.
> Defining standard system commands (rm, cp, ...) has been made
  simpler, but less automatic.
> New variables have been introduced to deal with some *nix
  systems not supporting the -v option to some variables.
  These variables are used to control echoing of commands.
> Removed code that dealt with CISM, glacier, and land ice,
  since that component cannot work with DART due to a calendar
  conflict.  The exception is code that sets CISM_RESTART to FALSE,
  which was (is?) necessary even when the stub version is used.
> Adopted the strategy of keeping
  DART_config.template in shell_scripts/cesm2_0, instead of
  DART_config          in shell_scripts.
  Then sed (or cp + editing) converts it into a usable DART_config
  in $CASEROOT.
> Similarly for [no_]assimilate.csh; add .template to names and put in cesm2_0.

setup_hybrid
> Running it on 2 tasks speeds up the build by ~30%.
> Environment variables have been removed,
  since setup_hybrid no longer calls DART_config.
  - dartroot
  - baseobsdir
  - save_every_Mth_restart_set
  - CAM_DYCORE
  - CLM_CONFIG_OPTS
  - ptile replaced by use_tasks_per_node
> DART_config and `xmlchange DATA_ASSIMILATION_*` are no longer called.
> Removed code which assisted with setting up WACCM.
  That code is still in setup_advanced.
> Removed duplicated modification of case.st_archive header.
> The CAM forecast job QUEUE and WALLCLOCK_TIME are now set
  by arguments to create_newcase, instead of xmlchange commands.
> Simplify the flag to turn on CLM's interpolation of initial restart files.
  Default is now 'true'.
> Removed vestiges of using non-default forcing files (GHG, aerosols, ...)
  until we figure out suitable options.

stage_cesm_files
> Replaced outdated cpl.r references with drv_####.r,
  since the multi-driver mode is the default for CAM+DART.
> Use num_drivers to control the CESM file name formats used
  to fill rpointer files.

setup_advanced
> Most changes to setup_hybrid also appear in setup_advanced.

DART_config.template
> Added a section of environment variables, which will be filled by
  the user after running setup_hybrid (and checking the CAM forecasts),
  or be filled by setup_advanced.
> Imported the xmlchange DATA_ASSIMILATION* commands from setup_*.
> Num_instances is harvested from the setup script, since it cannot come
  from CESM when the multi-driver mode is used; each driver has 1 instance,
  and the total instances is not in the xml files.
> Updated location of sampling error correction file.

assimilate.csh.template
> Making $archive/esp/hist is now done by DART_config.
> Moved sampling error correction file acquisition to DART_config.
> Removed the inflation cookie mechanism in favor of using fill_inflation_restart.
> Require that output_file_list = input_file_list.

no_assimilate.csh.template
> Removed variables that are unneeded because of how no_assimilate.csh
  is created by DART_config.
> Removed unnecessary purging of unneeded restart sets.
  No_assimilation runs will either have large ensemble restart sets and be short,
  or small sets and may be long.




Added: DART/branches/recam/models/cam-fv/README
===================================================================
--- DART/branches/recam/models/cam-fv/README	                        (rev 0)
+++ DART/branches/recam/models/cam-fv/README	2018-06-18 17:26:33 UTC (rev 12676)
@@ -0,0 +1 @@
+Please see ./doc/README_cam-fv.


Property changes on: DART/branches/recam/models/cam-fv/README
___________________________________________________________________
Added: svn:eol-style
## -0,0 +1 ##
+native
\ No newline at end of property
Added: svn:keywords
## -0,0 +1 ##
+Date Rev Author HeadURL Id
\ No newline at end of property
Added: svn:mime-type
## -0,0 +1 ##
+text/plain
\ No newline at end of property
Added: DART/branches/recam/models/cam-fv/doc/README_cam-fv
===================================================================
--- DART/branches/recam/models/cam-fv/doc/README_cam-fv	                        (rev 0)
+++ DART/branches/recam/models/cam-fv/doc/README_cam-fv	2018-06-18 17:26:33 UTC (rev 12676)
@@ -0,0 +1,33 @@
+We recommend that, before using the cam-fv interface,
+you become familiar with DART by working through 
+the core parts of the tutorial or getting instruction 
+from someone knowledgable about DART.
+
+The scripts which set up CAM and/or assimilations are in
+shell_scripts/cesm2_0 (as of 2018-6). 
+Work through setup_hybrid, which will guide you 
+through setting up the multi-instance CAM-FV environment 
+which DART requires.
+That script includes instructions for activating the 
+assimilation using DART_config.template.
+Do check the output of the forecasts and assimilations 
+carefully, to catch errors earlier in the development process.
+We highly recommend using observation space diagnostics.
+
+Once you are comfortable with those procedures,
+you may find it more efficient to use setup_advanced,
+which combines the setup of CAM and the activation of
+the assimilation.  It also provides more advanced mechanisms
+for setting up the best assimilation for your research.
+
+The CESM environment, which DART requires, is now included
+in CESM's "pre-beta" tests.  So you should be able to use
+any beta, or higher, release of CESM (after 2.0) with DART.
+We recommend that you set up a new shell_scripts/cesm#_#
+directory, modeled on the cesm2_0, in order to maximize
+the clarity in the scripting environment. 
+If you discover that CESM is not playing well with DART,
+and you have tried the simple fixes (increasing nodes/member,
+decreasing ensemble size, removing your SourceMods, ...)
+please contact us.
+


Property changes on: DART/branches/recam/models/cam-fv/doc/README_cam-fv
___________________________________________________________________
Added: svn:eol-style
## -0,0 +1 ##
+native
\ No newline at end of property
Added: svn:keywords
## -0,0 +1 ##
+Date Rev Author HeadURL Id
\ No newline at end of property
Added: svn:mime-type
## -0,0 +1 ##
+text/plain
\ No newline at end of property