[Met_help] [rt.rap.ucar.edu #89063] History for CCPA file name format for METplus
George McCabe via RT
met_help at ucar.edu
Wed May 29 12:34:28 MDT 2019
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Hello. I see that
https://github.com/NCAR/METplus/blob/master/parm/use_cases/grid_to_grid/examples/precip.conf
has
OBS_GRID_STAT_INPUT_TEMPLATE = ccpa_conus_1.0d_{valid?fmt=%Y%m%d}
CCPA output on wcoss has file names like
/com2/ccpa/prod/ccpa.20190224/06/ccpa.t03z.03h.hrap.conus.gb2
which is 3h accumulation valid at 03Z 2019/02/24
and ccpa.t06z.06h.hrap.conus.gb2
which is 6h accumulation valid at 06Z 2019/02/24
Does METplus already have the capability to handle the CCPA in its
'native' directory/name format, as in the /com2/* directory above? In
my verif scripts I do
cp $COMCCPA.$vday/06/ccpa.t03z.03h.hrap.conus.gb2 ccpa.${vday}03.03h.gb2
If METplus can already handle this bit of pre-processing, or if this can
be added to the wish list, that'll be great. Thanks!
Ying
--
Ying Lin
NCEP/EMC/Verification, Post-processing and Product Generation Branch
NCWCP Cubicle No. 2015
Ying.Lin at noaa.gov
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: CCPA file name format for METplus
From: George McCabe
Time: Wed Mar 06 08:29:36 2019
Hi Ying Lin,
You should be able to use a template that looks something like this:
"ccpa.{valid?fmt=%Y%m%d}/06/ccpa.t{valid?fmt=%H}z.{level?fmt=%.2H}h.hrap.conus.gb2"
The 'level' item corresponds to the accumulation amount. %.2H
specifies
that the filename has 2 digits of precision for that value. I wasn't
sure
what the '06' subdirectory corresponds to, but if necessary you can
substitute that with formatting so that it will be dynamic. Let me
know if
that doesn't work and I can help figure out what will.
Thanks,
George
On Mon, Feb 25, 2019 at 11:09 AM Ying Lin via RT <met_help at ucar.edu>
wrote:
>
> Mon Feb 25 11:08:35 2019: Request 89063 was acted upon.
> Transaction: Ticket created by ying.lin at noaa.gov
> Queue: met_help
> Subject: CCPA file name format for METplus
> Owner: Nobody
> Requestors: ying.lin at noaa.gov
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=89063 >
>
>
> Hello. I see that
>
>
https://github.com/NCAR/METplus/blob/master/parm/use_cases/grid_to_grid/examples/precip.conf
> has
> OBS_GRID_STAT_INPUT_TEMPLATE = ccpa_conus_1.0d_{valid?fmt=%Y%m%d}
>
> CCPA output on wcoss has file names like
> /com2/ccpa/prod/ccpa.20190224/06/ccpa.t03z.03h.hrap.conus.gb2
> which is 3h accumulation valid at 03Z 2019/02/24
> and ccpa.t06z.06h.hrap.conus.gb2
> which is 6h accumulation valid at 06Z 2019/02/24
>
> Does METplus already have the capability to handle the CCPA in its
> 'native' directory/name format, as in the /com2/* directory above?
In
> my verif scripts I do
> cp $COMCCPA.$vday/06/ccpa.t03z.03h.hrap.conus.gb2
ccpa.${vday}03.03h.gb2
>
> If METplus can already handle this bit of pre-processing, or if this
can
> be added to the wish list, that'll be great. Thanks!
>
> Ying
>
> --
> Ying Lin
> NCEP/EMC/Verification, Post-processing and Product Generation Branch
> NCWCP Cubicle No. 2015
> Ying.Lin at noaa.gov
>
>
>
>
------------------------------------------------
Subject: CCPA file name format for METplus
From: Ying Lin
Time: Thu Mar 07 13:32:50 2019
Hi George,
Thanks! That makes sense, though it didn't quite work out for
me.
In the attached fv3gfs_24h_by_valid_time.conf, I have
OBS_PCP_COMBINE_INPUT_DIR = /com2/ccpa/prod
then
OBS_PCP_COMBINE_INPUT_TEMPLATE =
ccpa.{valid?fmt=%Y%m%d}/{valid?fmt=%H}/ccpa.t{valid?fmt=%H}z.{level?fmt=%.2H}h.hrap.conus.gb2
thinking that it would tell pcp_combine to look for e,g,
/com2/ccpa/prod/ccpa.20190305/06/ccpa.t06z.06h.hrap.conus.gb2
Instead I'm getting "WARNING: pcp_combine: Could not find files to
compute accumulation in /com2/ccpa/prod" (in the attached test.out and
master_metplus.log.20190307).
Could you tell what I'm doing wrong in the config?
I'm doing the above in Tide:/meso/save/Ying.Lin/metplus/test/.
Also two related questions:
1) In the METplus model config files I've seen (like in the attached
config), the VALID_BEG and VALID_END are set in the config file. Is
there an easy way to set and export the VALID_* variable from a
script?
For example I've tried "export vday=20190305" in the
test_fv3gfs_24h.ksh
and in the config file set
VALID_BEG = "${vday}"12 (same for VALID_END)
and
VALID_BEG = ${vday}12
and
VALID_BEG = {vday}12
none of the above worked. What's the right way to do this?
2) In the CCPA directory of /com2/ccpa/prod/ccpa.20190305/06/, the
'06'
subdir seems to contain all CCPA analysis files with valid times from
01Z-06Z. So for 6h analysis, the '06' in the subdir is just the valid
hour. But if I do 3-hourly verification using the 3-hourly CCPA files,
the above directory also contains ccpa.t03z.03h.hrap.conus.gb2 (valid
at
03Z) and ccpa.t06z.03h.hrap.conus.gb2 (valid at 06Z). In that case i
don't think the
ccpa.{valid?fmt=%Y%m%d}/{valid?fmt=%H}/ccpa.t{valid?fmt=%H}z.{level?fmt=%.2H}h.hrap.conus.gb2
would work, would it?
Thanks again,
Ying
On 3/6/19 10:29 AM, George McCabe via RT wrote:
> Hi Ying Lin,
>
> You should be able to use a template that looks something like this:
>
>
"ccpa.{valid?fmt=%Y%m%d}/06/ccpa.t{valid?fmt=%H}z.{level?fmt=%.2H}h.hrap.conus.gb2"
>
> The 'level' item corresponds to the accumulation amount. %.2H
specifies
> that the filename has 2 digits of precision for that value. I wasn't
sure
> what the '06' subdirectory corresponds to, but if necessary you can
> substitute that with formatting so that it will be dynamic. Let me
know if
> that doesn't work and I can help figure out what will.
>
> Thanks,
> George
>
> On Mon, Feb 25, 2019 at 11:09 AM Ying Lin via RT <met_help at ucar.edu>
wrote:
>
>> Mon Feb 25 11:08:35 2019: Request 89063 was acted upon.
>> Transaction: Ticket created by ying.lin at noaa.gov
>> Queue: met_help
>> Subject: CCPA file name format for METplus
>> Owner: Nobody
>> Requestors: ying.lin at noaa.gov
>> Status: new
>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=89063 >
>>
>>
>> Hello. I see that
>>
>>
https://github.com/NCAR/METplus/blob/master/parm/use_cases/grid_to_grid/examples/precip.conf
>> has
>> OBS_GRID_STAT_INPUT_TEMPLATE =
ccpa_conus_1.0d_{valid?fmt=%Y%m%d}
>>
>> CCPA output on wcoss has file names like
>> /com2/ccpa/prod/ccpa.20190224/06/ccpa.t03z.03h.hrap.conus.gb2
>> which is 3h accumulation valid at 03Z 2019/02/24
>> and ccpa.t06z.06h.hrap.conus.gb2
>> which is 6h accumulation valid at 06Z 2019/02/24
>>
>> Does METplus already have the capability to handle the CCPA in its
>> 'native' directory/name format, as in the /com2/* directory above?
In
>> my verif scripts I do
>> cp $COMCCPA.$vday/06/ccpa.t03z.03h.hrap.conus.gb2
ccpa.${vday}03.03h.gb2
>>
>> If METplus can already handle this bit of pre-processing, or if
this can
>> be added to the wish list, that'll be great. Thanks!
>>
>> Ying
>>
>> --
>> Ying Lin
>> NCEP/EMC/Verification, Post-processing and Product Generation
Branch
>> NCWCP Cubicle No. 2015
>> Ying.Lin at noaa.gov
>>
>>
>>
>>
--
Ying Lin
NCEP/EMC/Verification, Post-processing and Product Generation Branch
NCWCP Cubicle No. 2015
Ying.Lin at noaa.gov
------------------------------------------------
Subject: CCPA file name format for METplus
From: Ying Lin
Time: Thu Mar 07 13:32:50 2019
# FV3GFS vs CCPA 24h FHO verif:
[config]
LOOP_BY_INIT = false
# Format of VALID_BEG and VALID_END
VALID_TIME_FMT = %Y%m%d%H
# the above VALID_TIME_FMT did not work when I set
# VALID_BEG=2019020112
# VALIC_END=2019020612
# Start time for MET+ run
#VALID_BEG=20190210_12
VALID_BEG=2019030512
# End time for MET+ run
#VALID_END=20190206_12
VALID_END=2019030512
# Increment between MET+ runs in seconds. Must be >= 60
# YL: 86400sec=24h
VALID_INCREMENT=86400
# List of forecast leads to process
#LEAD_SEQ = 24, 36, 48, 60, 72, 84
LEAD_SEQ = 24
# List of variables to compare
FCST_VAR1_NAME = APCP
FCST_VAR1_LEVELS = A24
FCST_VAR1_THRESH = 0.254,2.54,6.35,12.7,19.05,25.4,38.1,50.8,101.6
# Name to identify model data in output
MODEL_TYPE = FV3GFS
# Name to identify observation data in output
OB_TYPE = QPE
# Accumulation interval to compare
# Type of level to be used (GRIB only)
#LEVEL_TYPE=A
# Options are times, processes
# times = run all items in the PROCESS_LIST for a single
initialization
# time, then repeat until all times have been evaluated.
# processes = run each item in the PROCESS_LIST for all times
# specified, then repeat for the next item in the PROCESS_LIST.
LOOP_METHOD = times
# List of applications to run
PROCESS_LIST = PcpCombine, RegridDataPlane, GridStat
#FCST_PCP_COMBINE_RUN = False
OBS_PCP_COMBINE_RUN = True
OBS_REGRID_DATA_PLANE_RUN = True
# Used by regrid_data_plane to remap data
VERIFICATION_GRID={INPUT_BASE}/sample_fcst/2005080700/wrfprs_ruc13_12.tm00_G212
# Location of grid_stat config file
# GRID_STAT_CONFIG = {CONFIG_DIR}/GridStatConfig_MEAN
GRID_STAT_CONFIG = {METPLUS_BASE}/parm/ylin.GridStatConfig.CTC
# QPF Model Options:
# Accumulation available in forecast files
FCST_LEVEL = 1
# Descriptions of forecast data -- These will not change between runs
# Forecast hours that are available
FCST_MAX_FORECAST = 84
# Interval (in hours) between initialization times of data
FCST_INIT_INTERVAL = 12
# Set to true if evaluating probability
FCST_IS_PROB = false
# Set to true if data is only available once per day
FCST_IS_DAILY_FILE = false
# File format. Options are GRIB or NETCDF
FCST_NATIVE_DATA_TYPE = GRIB
# QPE Grib Observation Data Parameters
# File format. Options are GRIB or NETCDF
OBS_NATIVE_DATA_TYPE = GRIB
# Set to true if data is only available once per day
OBS_IS_DAILY_FILE = false
# Accumulation interval available in observation data
OBS_LEVEL = 01
[dir]
CONFIG_DIR={PARM_BASE}/use_cases/qpf/met_config
#FCST_GRID_STAT_INPUT_DIR = {INPUT_BASE}/sample_fcst
FCST_GRID_STAT_INPUT_DIR = /gpfs/dell1/nco/ops/com/gfs/para
OBS_PCP_COMBINE_INPUT_DIR = /com2/ccpa/prod
OBS_PCP_COMBINE_OUTPUT_DIR = {OUTPUT_BASE}/qpe_grib/bucket
OBS_REGRID_DATA_PLANE_INPUT_DIR = {OUTPUT_BASE}/qpe_grib/bucket
OBS_REGRID_DATA_PLANE_OUTPUT_DIR = {OUTPUT_BASE}/qpe_grib/regrid
OBS_GRID_STAT_INPUT_DIR = {OUTPUT_BASE}/qpe_grib/regrid
GRID_STAT_OUT_DIR = {OUTPUT_BASE}/met_out/{MODEL_TYPE}
[filename_templates]
# QPF (Forecast)
FCST_GRID_STAT_INPUT_TEMPLATE =
gfs.{init?fmt=%Y%m%d}/{init?fmt=%H}/gfs.t{init?fmt=%H}z.pgrb2.0p25.f{lead?fmt=%HHH}
# QPE (Observation)
OBS_PCP_COMBINE_INPUT_TEMPLATE =
ccpa.{valid?fmt=%Y%m%d}/{valid?fmt=%H}/ccpa.t{valid?fmt=%H}z.{level?fmt=%.2H}h.hrap.conus.gb2
OBS_PCP_COMBINE_OUTPUT_TEMPLATE =
{valid?fmt=%Y%m%d}/ccpa.{valid?fmt=%Y%m%d%H}_A{level?fmt=%HH}h
OBS_REGRID_DATA_PLANE_TEMPLATE =
{valid?fmt=%Y%m%d}/ccpa.{valid?fmt=%Y%m%d%H}_A{level?fmt=%HH}h.g212
OBS_GRID_STAT_INPUT_TEMPLATE =
{valid?fmt=%Y%m%d}/ccpa.{valid?fmt=%Y%m%d%H}_A{level?fmt=%HH}h.g212
------------------------------------------------
Subject: CCPA file name format for METplus
From: Ying Lin
Time: Thu Mar 07 13:32:50 2019
03/07 19:55:06.464 metplus.GridStat (master_metplus.py:142) INFO:
****************************************
03/07 19:55:06.464 metplus.GridStat (master_metplus.py:143) INFO: *
RUNNING MET+
03/07 19:55:06.464 metplus.GridStat (master_metplus.py:147) INFO: *
at valid time: 201903051200
03/07 19:55:06.465 metplus.GridStat (master_metplus.py:148) INFO:
****************************************
03/07 19:55:06.485 metplus.PcpCombine (pcp_combine_wrapper.py:597)
WARNING: pcp_combine: Could not find files to compute accumulation in
/com2/ccpa/prod
03/07 19:55:06.485 metplus.PcpCombine (pcp_combine_wrapper.py:442)
INFO:
03/07 19:55:06.485 metplus.PcpCombine (pcp_combine_wrapper.py:382)
ERROR: No input filenames specified
03/07 19:55:06.488 metplus.RegridDataPlane
(regrid_data_plane_wrapper.py:89) INFO:
03/07 19:55:06.488 metplus.RegridDataPlane (command_runner.py:220)
DEBUG: LOG_MET_OUTPUT_TO_METPLUS log file is True
03/07 19:55:06.489 metplus.RegridDataPlane (command_runner.py:119)
INFO: app_name is: regrid_data_plane, output sent to:
/meso/noscrub/Ying.Lin/metplus.out/logs/master_metplus.log.20190307
03/07 19:55:06.865 metplus.RegridDataPlane (command_runner.py:155)
INFO: RUNNING:
/global/noscrub/Julie.Prestopnik/met/8.0/bin/regrid_data_plane -v 5
-field "name=\"APCP_24\"; level=\"(*,*)\";" -method BUDGET -width 2
-name APCP_24
/meso/noscrub/Ying.Lin/metplus.out/qpe_grib/bucket/20190305/ccpa.2019030512_A24h.g212
/global/noscrub/Julie.Prestopnik/METplus/METplus-
2.0_sample_data/sample_fcst/2005080700/wrfprs_ruc13_12.tm00_G212
/meso/noscrub/Ying.Lin/metplus.out/qpe_grib/regrid/20190305/ccpa.2019030512_A24h.g212
>> /meso/noscrub/Ying.Lin/metplus.out/logs/master_metplus.log.20190307
2>&1
03/07 19:55:06.865 metplus.RegridDataPlane (command_runner.py:156)
DEBUG: RUNNING
exe('/global/noscrub/Julie.Prestopnik/met/8.0/bin/regrid_data_plane')['-
v','5','-field','name="APCP_24"; level="(*,*)";','-method','BUDGET','-
width','2','-
name','APCP_24','/meso/noscrub/Ying.Lin/metplus.out/qpe_grib/bucket/20190305/ccpa.2019030512_A24h.g212','/global/noscrub/Julie.Prestopnik/METplus/METplus-
2.0_sample_data/sample_fcst/2005080700/wrfprs_ruc13_12.tm00_G212','/meso/noscrub/Ying.Lin/metplus.out/qpe_grib/regrid/20190305/ccpa.2019030512_A24h.g212'].out('/meso/noscrub/Ying.Lin/metplus.out/logs/master_metplus.log.20190307',append=True).err2out()
DEBUG 1: Reading data file:
/meso/noscrub/Ying.Lin/metplus.out/qpe_grib/bucket/20190305/ccpa.2019030512_A24h.g212
ERROR :
ERROR : grd_file_type() -> file does not exist
"/meso/noscrub/Ying.Lin/metplus.out/qpe_grib/bucket/20190305/ccpa.2019030512_A24h.g212"
ERROR :
03/07 19:55:08.146 metplus.GridStat (compare_gridded_wrapper.py:344)
DEBUG:
03/07 19:55:08.146 metplus.GridStat (compare_gridded_wrapper.py:345)
DEBUG: ENVIRONMENT FOR NEXT COMMAND:
03/07 19:55:08.146 metplus.GridStat (command_builder.py:146) DEBUG:
MODEL=FV3GFS
03/07 19:55:08.146 metplus.GridStat (command_builder.py:146) DEBUG:
FCST_VAR=APCP
03/07 19:55:08.146 metplus.GridStat (command_builder.py:146) DEBUG:
OBS_VAR=APCP
03/07 19:55:08.146 metplus.GridStat (command_builder.py:146) DEBUG:
LEVEL=A24
03/07 19:55:08.147 metplus.GridStat (command_builder.py:146) DEBUG:
OBTYPE=QPE
03/07 19:55:08.147 metplus.GridStat (command_builder.py:146) DEBUG:
CONFIG_DIR=/meso/save/Ying.Lin/metplus//parm/use_cases/qpf/met_config
03/07 19:55:08.147 metplus.GridStat (command_builder.py:146) DEBUG:
FCST_FIELD={ name="APCP"; level="[A24]"; cat_thresh=[ gt0.254, gt2.54,
gt6.35, gt12.7, gt19.05, gt25.4, gt38.1, gt50.8, gt101.6 ]; }
03/07 19:55:08.147 metplus.GridStat (command_builder.py:146) DEBUG:
OBS_FIELD={ name="APCP"; level="[A24]"; cat_thresh=[ gt0.254, gt2.54,
gt6.35, gt12.7, gt19.05, gt25.4, gt38.1, gt50.8, gt101.6 ]; }
03/07 19:55:08.147 metplus.GridStat (command_builder.py:146) DEBUG:
INPUT_BASE=/global/noscrub/Julie.Prestopnik/METplus/METplus-
2.0_sample_data
03/07 19:55:08.147 metplus.GridStat (command_builder.py:146) DEBUG:
MET_VALID_HHMM=0305
03/07 19:55:08.147 metplus.GridStat (compare_gridded_wrapper.py:356)
DEBUG:
03/07 19:55:08.147 metplus.GridStat (compare_gridded_wrapper.py:357)
DEBUG: COPYABLE ENVIRONMENT FOR NEXT COMMAND:
03/07 19:55:08.148 metplus.GridStat (command_builder.py:141) DEBUG:
export MODEL=FV3GFS; export FCST_VAR=APCP; export OBS_VAR=APCP; export
LEVEL=A24; export OBTYPE=QPE; export
CONFIG_DIR=/meso/save/Ying.Lin/metplus//parm/use_cases/qpf/met_config;
export FCST_FIELD="{ name=\"APCP\"; level=\"[A24]\"; cat_thresh=[
gt0.254, gt2.54, gt6.35, gt12.7, gt19.05, gt25.4, gt38.1, gt50.8,
gt101.6 ]; }"; export OBS_FIELD="{ name=\"APCP\"; level=\"[A24]\";
cat_thresh=[ gt0.254, gt2.54, gt6.35, gt12.7, gt19.05, gt25.4, gt38.1,
gt50.8, gt101.6 ]; }"; export
INPUT_BASE=/global/noscrub/Julie.Prestopnik/METplus/METplus-
2.0_sample_data; export MET_VALID_HHMM=0305;
03/07 19:55:08.148 metplus.GridStat (compare_gridded_wrapper.py:363)
DEBUG:
03/07 19:55:08.148 metplus.GridStat (compare_gridded_wrapper.py:369)
INFO:
03/07 19:55:08.148 metplus.GridStat (command_runner.py:220) DEBUG:
LOG_MET_OUTPUT_TO_METPLUS log file is True
03/07 19:55:08.149 metplus.GridStat (command_runner.py:119) INFO:
app_name is: grid_stat, output sent to:
/meso/noscrub/Ying.Lin/metplus.out/logs/master_metplus.log.20190307
03/07 19:55:08.150 metplus.GridStat (command_runner.py:155) INFO:
RUNNING: /global/noscrub/Julie.Prestopnik/met/8.0/bin/grid_stat
/gpfs/dell1/nco/ops/com/gfs/para/gfs.20190304/12/gfs.t12z.pgrb2.0p25.f024
/meso/noscrub/Ying.Lin/metplus.out/qpe_grib/regrid/20190305/ccpa.2019030512_A24h.g212
/meso/save/Ying.Lin/metplus//parm/ylin.GridStatConfig.CTC -outdir
/meso/noscrub/Ying.Lin/metplus.out/met_out/FV3GFS/201903051200/grid_stat
>> /meso/noscrub/Ying.Lin/metplus.out/logs/master_metplus.log.20190307
2>&1
03/07 19:55:08.150 metplus.GridStat (command_runner.py:156) DEBUG:
RUNNING
exe('/global/noscrub/Julie.Prestopnik/met/8.0/bin/grid_stat')['/gpfs/dell1/nco/ops/com/gfs/para/gfs.20190304/12/gfs.t12z.pgrb2.0p25.f024','/meso/noscrub/Ying.Lin/metplus.out/qpe_grib/regrid/20190305/ccpa.2019030512_A24h.g212','/meso/save/Ying.Lin/metplus//parm/ylin.GridStatConfig.CTC','-
outdir','/meso/noscrub/Ying.Lin/metplus.out/met_out/FV3GFS/201903051200/grid_stat'].out('/meso/noscrub/Ying.Lin/metplus.out/logs/master_metplus.log.20190307',append=True).err2out()
DEBUG 1: Default Config File:
/global/noscrub/Julie.Prestopnik/met/8.0/share/met/config/GridStatConfig_default
DEBUG 1: User Config File:
/meso/save/Ying.Lin/metplus//parm/ylin.GridStatConfig.CTC
ERROR :
ERROR : grd_file_type() -> file does not exist
"/meso/noscrub/Ying.Lin/metplus.out/qpe_grib/regrid/20190305/ccpa.2019030512_A24h.g212"
ERROR :
------------------------------------------------
Subject: CCPA file name format for METplus
From: Ying Lin
Time: Thu Mar 07 13:32:50 2019
+ . /u/Ying.Lin/dot.for.metplus
+ . /usrx/local/Modules/default/init/ksh
+ [ 3.2.10 '=' '' ]
+ MODULE_VERSION_STACK=3.2.10
+ export MODULE_VERSION_STACK
+ MODULESHOME=/usrx/local/Modules/3.2.10
+ export MODULESHOME
+ [
EnvVars/1.0.1:ibmpe/1.3.0.12:lsf/9.1:ics/12.1:anaconda2/latest:hpss/4.0.1.2:GrADS/2.0.2:HDF5/1.8.9/serial:NetCDF/4.2/serial
'=' '' ]
+ [
'/usrx/local/Modules/versions:/usrx/local/Modules/$MODULE_VERSION/modulefiles:/usrx/local/modulefiles:/nwprod2/modulefiles:/nwprod2/lib/modulefiles:/nwprod/lib/modulefiles:/u/Benjamin.Blake/modulefiles'
'=' '' ]
+ module purge
+ /usrx/local/Modules/3.2.10/bin/modulecmd ksh purge
+ eval MANPATH=/usr/share/man ';export'
'MANPATH;PATH=.:/nwprod/gempak/nawips/os/linux2.6.32_x86_64/bin:/usr/lib64/qt-
3.3/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/opt/ibutils/bin:/nwprod/util/exec::/nwprod/util/ush::/u/Wesley.Ebisuzaki/bin:/u/Ying.Lin/bin:/nwprod/gempak/nawips/bin:/nwprod/gempak/nawips/scripts/ez:/nwprod/gempak/nawips/scripts/nawips:/nwprod/gempak/nawips/scripts/prnt:/nwprod/gempak/nawips/scripts/decoder:/sss/emc/meso/shared/Eric.Rogers/ddapp/exe_lnx6:/sss/emc/meso/shared/Eric.Rogers/vsdb/scripts'
';export' 'PATH;unset' 'CLASSPATH;unset' 'CPATH;unset'
'CPRO_PATH;unset' 'FPATH;unset' 'GADDIR;unset' 'GrADS_ROOT;unset'
'HDF5;unset' 'HDF5_CFLAGS;unset' 'HDF5_CXXFLAGS;unset'
'HDF5_FFLAGS;unset' 'HDF5_INCLUDE;unset' 'HDF5_LDFLAGS;unset'
'HDF5_LDFLAGS_C;unset' 'HDF5_LDFLAGS_CXX;unset' 'HDF5_LDFLAGS_F;unset'
'IDB_HOME;unset' 'INCLUDE;unset' 'INSTALL_DIR;unset'
'INTEL_LICENSE_FILE;unset' 'IPPROOT;unset' 'I_MPI_INC;unset'
'I_MPI_ROOT;unset' 'LANG;unset' 'LAUNCH;unset' 'LD_LIBRARY_PATH;unset'
'LIBRARY_PATH;unset' 'LOADEDMODULES;unset' 'LSF_BINDIR;unset'
'LSF_ENVDIR;unset' 'LSF_LIBDIR;unset' 'LSF_SERVERDIR;unset'
'MKLROOT;unset' 'MKL_TARGET_ARCH;unset' 'MP_CLOCK_SOURCE;unset'
'MP_COMPILER;unset' 'MP_CONFIG;unset' 'MP_EUILIB;unset'
'MP_MPILIB;unset' 'NETCDF;unset' 'NETCDF_CFLAGS;unset'
'NETCDF_CXXFLAGS;unset' 'NETCDF_FFLAGS;unset' 'NETCDF_INCLUDE;unset'
'NETCDF_LDFLAGS;unset' 'NETCDF_LDFLAGS_C;unset'
'NETCDF_LDFLAGS_CXX;unset' 'NETCDF_LDFLAGS_F;unset' 'NLSPATH;unset'
'OMP_NUM_THREADS;unset' 'PROD_DIR;unset' 'PYTHONPATH;unset'
'SITE;unset' 'TBBROOT;unset' 'VT_LIB_DIR;unset' 'VT_ROOT;unset'
'VT_SLIB_DIR;unset' 'XLSF_UIDDIR;unset' '_LMFILES_;'
+ MANPATH=/usr/share/man
+ export MANPATH
+
PATH=.:/nwprod/gempak/nawips/os/linux2.6.32_x86_64/bin:/usr/lib64/qt-
3.3/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/opt/ibutils/bin:/nwprod/util/exec::/nwprod/util/ush::/u/Wesley.Ebisuzaki/bin:/u/Ying.Lin/bin:/nwprod/gempak/nawips/bin:/nwprod/gempak/nawips/scripts/ez:/nwprod/gempak/nawips/scripts/nawips:/nwprod/gempak/nawips/scripts/prnt:/nwprod/gempak/nawips/scripts/decoder:/sss/emc/meso/shared/Eric.Rogers/ddapp/exe_lnx6:/sss/emc/meso/shared/Eric.Rogers/vsdb/scripts
+ export PATH
+ unset CLASSPATH
+ unset CPATH
+ unset CPRO_PATH
+ unset FPATH
+ unset GADDIR
+ unset GrADS_ROOT
+ unset HDF5
+ unset HDF5_CFLAGS
+ unset HDF5_CXXFLAGS
+ unset HDF5_FFLAGS
+ unset HDF5_INCLUDE
+ unset HDF5_LDFLAGS
+ unset HDF5_LDFLAGS_C
+ unset HDF5_LDFLAGS_CXX
+ unset HDF5_LDFLAGS_F
+ unset IDB_HOME
+ unset INCLUDE
+ unset INSTALL_DIR
+ unset INTEL_LICENSE_FILE
+ unset IPPROOT
+ unset I_MPI_INC
+ unset I_MPI_ROOT
+ unset LANG
+ unset LAUNCH
+ unset LD_LIBRARY_PATH
+ unset LIBRARY_PATH
+ unset LOADEDMODULES
+ unset LSF_BINDIR
+ unset LSF_ENVDIR
+ unset LSF_LIBDIR
+ unset LSF_SERVERDIR
+ unset MKLROOT
+ unset MKL_TARGET_ARCH
+ unset MP_CLOCK_SOURCE
+ unset MP_COMPILER
+ unset MP_CONFIG
+ unset MP_EUILIB
+ unset MP_MPILIB
+ unset NETCDF
+ unset NETCDF_CFLAGS
+ unset NETCDF_CXXFLAGS
+ unset NETCDF_FFLAGS
+ unset NETCDF_INCLUDE
+ unset NETCDF_LDFLAGS
+ unset NETCDF_LDFLAGS_C
+ unset NETCDF_LDFLAGS_CXX
+ unset NETCDF_LDFLAGS_F
+ unset NLSPATH
+ unset OMP_NUM_THREADS
+ unset PROD_DIR
+ unset PYTHONPATH
+ unset SITE
+ unset TBBROOT
+ unset VT_LIB_DIR
+ unset VT_ROOT
+ unset VT_SLIB_DIR
+ unset XLSF_UIDDIR
+ unset _LMFILES_
+ module use /global/noscrub/Julie.Prestopnik/modulefiles
+ /usrx/local/Modules/3.2.10/bin/modulecmd ksh use
/global/noscrub/Julie.Prestopnik/modulefiles
+ eval
MODULEPATH='/global/noscrub/Julie.Prestopnik/modulefiles:/usrx/local/Modules/versions:/usrx/local/Modules/\$MODULE_VERSION/modulefiles:/usrx/local/modulefiles:/nwprod2/modulefiles:/nwprod2/lib/modulefiles:/nwprod/lib/modulefiles:/u/Benjamin.Blake/modulefiles'
';export' 'MODULEPATH;'
+
MODULEPATH='/global/noscrub/Julie.Prestopnik/modulefiles:/usrx/local/Modules/versions:/usrx/local/Modules/$MODULE_VERSION/modulefiles:/usrx/local/modulefiles:/nwprod2/modulefiles:/nwprod2/lib/modulefiles:/nwprod/lib/modulefiles:/u/Benjamin.Blake/modulefiles'
+ export MODULEPATH
+ module load met/8.0
+ /usrx/local/Modules/3.2.10/bin/modulecmd ksh load met/8.0
+ eval ADVISOR_XE_2015_DIR=/usrx/local/intel/2015/advisor_xe_2015
';export' 'ADVISOR_XE_2015_DIR;BIN_DIR=bin64' ';export'
'BIN_DIR;CLASSPATH=/usrx/local/intel/2015/itac_latest/lib' ';export'
'CLASSPATH;CPATH=/usrx/local/intel/2015/ipp/include:/usrx/local/intel/2015/mkl/include:/usrx/local/intel/2015/tbb/include'
';export'
'CPATH;CPRO_PATH=/usrx/local/intel/2015/composer_xe_2015.3.187'
';export'
'CPRO_PATH;GDBSERVER_MIC=/usrx/local/intel/2015/composerxe/debugger/gdb/target/mic/bin/gdbserver'
';export'
'GDBSERVER_MIC;GDB_CROSS=/usrx/local/intel/2015/composerxe/debugger/gdb/intel64_mic/bin/gdb-
mic' ';export' 'GDB_CROSS;INCLUDE=/usrx/local/intel/2015/mkl/include'
';export'
'INCLUDE;INFOPATH=/usrx/local/intel/2015/composerxe/debugger/gdb/intel64/share/info:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64_mic/share/info'
';export'
'INFOPATH;INSPECTOR_2015_DIR=/usrx/local/intel/2015/inspector_xe_2015'
';export'
'INSPECTOR_2015_DIR;INTEL_LICENSE_FILE=/usrx/local/intel/licenses'
';export'
'INTEL_LICENSE_FILE;INTEL_PYTHONHOME=/usrx/local/intel/2015/composerxe/debugger/python/intel64'
';export' 'INTEL_PYTHONHOME;IPPROOT=/usrx/local/intel/2015/ipp'
';export' 'IPPROOT;I_MPI_HYDRA_IFACE=ib0' ';export'
'I_MPI_HYDRA_IFACE;I_MPI_INC=/usrx/local/intel/2015/impi_latest/include64'
';export' 'I_MPI_INC;I_MPI_ROOT=/usrx/local/intel/2015/impi_latest'
';export' 'I_MPI_ROOT;LANGUAGE_TERRITORY=en_US' ';export'
'LANGUAGE_TERRITORY;LD_LIBRARY_PATH=/global/noscrub/Julie.Prestopnik/met/8.0/external_libs/lib:/usrx/local/dev/python/2.7.14/lib:/usrx/local/intel/2015/impi_latest/intel64/lib:/usrx/local/intel/2015/itac_latest/mic/slib:/usrx/local/intel/2015/itac_latest/intel64/slib:/usrx/local/intel/2015/composerxe/lib/intel64:/usrx/local/intel/2015/mpirt/lib/intel64:/usrx/local/intel/2015/ipp/lib/intel64:/usrx/local/intel/2015/mkl/lib/intel64:/usrx/local/intel/2015/tbb/lib/intel64/gcc4.4'
';export'
'LD_LIBRARY_PATH;LIBRARY_PATH=/usrx/local/intel/2015/composerxe/lib/intel64:/usrx/local/intel/2015/ipp/lib/intel64:/usrx/local/intel/2015/mkl/lib/intel64:/usrx/local/intel/2015/tbb/lib/intel64/gcc4.4'
';export'
'LIBRARY_PATH;LOADEDMODULES=ics/15.0.3:python/2.7.14:met/8.0'
';export'
'LOADEDMODULES;MANPATH=/usrx/local/dev/python/2.7.14/share/man:/usrx/local/intel/2015/impi_latest/man:/usrx/local/intel/2015/itac_latest/man:/usrx/local/intel/2015/composerxe/man/en_US:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64/share/man:/usr/share/man:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64_mic/share/man:/usrx/local/intel/2015/inspector_xe_2015/man:/usrx/local/intel/2015/vtune_amplifier_xe_2015/man:/usrx/local/intel/2015/advisor_xe_2015/man'
';export'
'MANPATH;MIC_LD_LIBRARY_PATH=/usrx/local/intel/2015/composerxe/lib/mic:/usrx/local/intel/2015/mpirt/lib/mic:/usrx/local/intel/2015/mkl/lib/mic:/usrx/local/intel/2015/tbb/lib/mic'
';export'
'MIC_LD_LIBRARY_PATH;MIC_LIBRARY_PATH=/usrx/local/intel/2015/composerxe/lib/mic:/usrx/local/intel/2015/mpirt/lib/mic:/usrx/local/intel/2015/tbb/lib/mic'
';export' 'MIC_LIBRARY_PATH;MKLROOT=/usrx/local/intel/2015/mkl'
';export'
'MKLROOT;MODULEPATH=/usrx/local/dev/modulefiles:/global/noscrub/Julie.Prestopnik/modulefiles:/usrx/local/Modules/versions:/usrx/local/Modules/\$MODULE_VERSION/modulefiles:/usrx/local/modulefiles:/nwprod2/modulefiles:/nwprod2/lib/modulefiles:/nwprod/lib/modulefiles:/u/Benjamin.Blake/modulefiles'
';export'
'MODULEPATH;MPM_LAUNCHER=/usrx/local/intel/2015/composerxe/debugger/mpm/bin/start_mpm.sh'
';export'
'MPM_LAUNCHER;NLSPATH=/usrx/local/intel/2015/composerxe/lib/intel64/locale/%l_%t/%N:/usrx/local/intel/2015/ipp/lib/intel64/locale/%l_%t/%N:/usrx/local/intel/2015/mkl/lib/intel64/locale/%l_%t/%N:/usrx/local/intel/2015/composer_xe_2015.3.187/debugger/gdb/intel64_mic/share/locale/%l_%t/%N:/usrx/local/intel/2015/composer_xe_2015.3.187/debugger/gdb/intel64/share/locale/%l_%t/%N'
';export'
'NLSPATH;PATH=/global/noscrub/Julie.Prestopnik/met/8.0//bin:/global/noscrub/Julie.Prestopnik/met/8.0/external_libs/bin:/usrx/local/dev/python/2.7.14/bin:/usrx/local/intel/2015/advisor_xe_2015/bin64:/usrx/local/intel/2015/vtune_amplifier_xe_2015/bin64:/usrx/local/intel/2015/inspector_xe_2015/bin64:/usrx/local/intel/2015/impi_latest/intel64/bin:/usrx/local/intel/2015/itac_latest/intel64/bin:/usrx/local/intel/2015/composer_xe_2015.3.187/bin/intel64:/usrx/local/intel/2015/mpirt/bin/intel64:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64_mic/bin:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64/bin:.:/nwprod/gempak/nawips/os/linux2.6.32_x86_64/bin:/usr/lib64/qt-
3.3/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/opt/ibutils/bin:/nwprod/util/exec::/nwprod/util/ush::/u/Wesley.Ebisuzaki/bin:/u/Ying.Lin/bin:/nwprod/gempak/nawips/bin:/nwprod/gempak/nawips/scripts/ez:/nwprod/gempak/nawips/scripts/nawips:/nwprod/gempak/nawips/scripts/prnt:/nwprod/gempak/nawips/scripts/decoder:/sss/emc/meso/shared/Eric.Rogers/ddapp/exe_lnx6:/sss/emc/meso/shared/Eric.Rogers/vsdb/scripts'
';export' 'PATH;PROD_DIR=/usrx/local/intel/2015/composerxe' ';export'
'PROD_DIR;ROOTPATH=/usrx/local/intel/2015' ';export'
'ROOTPATH;SCRIPTPATH=/usrx/local/intel/2015' ';export'
'SCRIPTPATH;TBBROOT=/usrx/local/intel/2015/tbb' ';export'
'TBBROOT;VTUNE_AMPLIFIER_XE_2015_DIR=/usrx/local/intel/2015/vtune_amplifier_xe_2015'
';export' 'VTUNE_AMPLIFIER_XE_2015_DIR;VT_ADD_LIBS=-ldwarf\' '-lelf\'
'-lvtunwind\' '-lnsl\' '-lm\' '-ldl\' -lpthread ';export'
'VT_ADD_LIBS;VT_ARCH=intel64' ';export'
'VT_ARCH;VT_LIB_DIR=/usrx/local/intel/2015/itac_latest/lib' ';export'
'VT_LIB_DIR;VT_MIC_SLIB_DIR=/usrx/local/intel/2015/itac_latest/mic/slib'
';export' 'VT_MIC_SLIB_DIR;VT_MPI=impi4' ';export'
'VT_MPI;VT_ROOT=/usrx/local/intel/2015/itac_latest' ';export'
'VT_ROOT;VT_SLIB_DIR=/usrx/local/intel/2015/itac_latest/intel64/slib'
';export'
'VT_SLIB_DIR;_LMFILES_=/usrx/local/modulefiles/ics/15.0.3:/usrx/local/dev/modulefiles/python/2.7.14:/global/noscrub/Julie.Prestopnik/modulefiles/met/8.0'
';export' '_LMFILES_;'
+ ADVISOR_XE_2015_DIR=/usrx/local/intel/2015/advisor_xe_2015
+ export ADVISOR_XE_2015_DIR
+ BIN_DIR=bin64
+ export BIN_DIR
+ CLASSPATH=/usrx/local/intel/2015/itac_latest/lib
+ export CLASSPATH
+
CPATH=/usrx/local/intel/2015/ipp/include:/usrx/local/intel/2015/mkl/include:/usrx/local/intel/2015/tbb/include
+ export CPATH
+ CPRO_PATH=/usrx/local/intel/2015/composer_xe_2015.3.187
+ export CPRO_PATH
+
GDBSERVER_MIC=/usrx/local/intel/2015/composerxe/debugger/gdb/target/mic/bin/gdbserver
+ export GDBSERVER_MIC
+
GDB_CROSS=/usrx/local/intel/2015/composerxe/debugger/gdb/intel64_mic/bin/gdb-
mic
+ export GDB_CROSS
+ INCLUDE=/usrx/local/intel/2015/mkl/include
+ export INCLUDE
+
INFOPATH=/usrx/local/intel/2015/composerxe/debugger/gdb/intel64/share/info:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64_mic/share/info
+ export INFOPATH
+ INSPECTOR_2015_DIR=/usrx/local/intel/2015/inspector_xe_2015
+ export INSPECTOR_2015_DIR
+ INTEL_LICENSE_FILE=/usrx/local/intel/licenses
+ export INTEL_LICENSE_FILE
+
INTEL_PYTHONHOME=/usrx/local/intel/2015/composerxe/debugger/python/intel64
+ export INTEL_PYTHONHOME
+ IPPROOT=/usrx/local/intel/2015/ipp
+ export IPPROOT
+ I_MPI_HYDRA_IFACE=ib0
+ export I_MPI_HYDRA_IFACE
+ I_MPI_INC=/usrx/local/intel/2015/impi_latest/include64
+ export I_MPI_INC
+ I_MPI_ROOT=/usrx/local/intel/2015/impi_latest
+ export I_MPI_ROOT
+ LANGUAGE_TERRITORY=en_US
+ export LANGUAGE_TERRITORY
+
LD_LIBRARY_PATH=/global/noscrub/Julie.Prestopnik/met/8.0/external_libs/lib:/usrx/local/dev/python/2.7.14/lib:/usrx/local/intel/2015/impi_latest/intel64/lib:/usrx/local/intel/2015/itac_latest/mic/slib:/usrx/local/intel/2015/itac_latest/intel64/slib:/usrx/local/intel/2015/composerxe/lib/intel64:/usrx/local/intel/2015/mpirt/lib/intel64:/usrx/local/intel/2015/ipp/lib/intel64:/usrx/local/intel/2015/mkl/lib/intel64:/usrx/local/intel/2015/tbb/lib/intel64/gcc4.4
+ export LD_LIBRARY_PATH
+
LIBRARY_PATH=/usrx/local/intel/2015/composerxe/lib/intel64:/usrx/local/intel/2015/ipp/lib/intel64:/usrx/local/intel/2015/mkl/lib/intel64:/usrx/local/intel/2015/tbb/lib/intel64/gcc4.4
+ export LIBRARY_PATH
+ LOADEDMODULES=ics/15.0.3:python/2.7.14:met/8.0
+ export LOADEDMODULES
+
MANPATH=/usrx/local/dev/python/2.7.14/share/man:/usrx/local/intel/2015/impi_latest/man:/usrx/local/intel/2015/itac_latest/man:/usrx/local/intel/2015/composerxe/man/en_US:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64/share/man:/usr/share/man:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64_mic/share/man:/usrx/local/intel/2015/inspector_xe_2015/man:/usrx/local/intel/2015/vtune_amplifier_xe_2015/man:/usrx/local/intel/2015/advisor_xe_2015/man
+ export MANPATH
+
MIC_LD_LIBRARY_PATH=/usrx/local/intel/2015/composerxe/lib/mic:/usrx/local/intel/2015/mpirt/lib/mic:/usrx/local/intel/2015/mkl/lib/mic:/usrx/local/intel/2015/tbb/lib/mic
+ export MIC_LD_LIBRARY_PATH
+
MIC_LIBRARY_PATH=/usrx/local/intel/2015/composerxe/lib/mic:/usrx/local/intel/2015/mpirt/lib/mic:/usrx/local/intel/2015/tbb/lib/mic
+ export MIC_LIBRARY_PATH
+ MKLROOT=/usrx/local/intel/2015/mkl
+ export MKLROOT
+
MODULEPATH='/usrx/local/dev/modulefiles:/global/noscrub/Julie.Prestopnik/modulefiles:/usrx/local/Modules/versions:/usrx/local/Modules/$MODULE_VERSION/modulefiles:/usrx/local/modulefiles:/nwprod2/modulefiles:/nwprod2/lib/modulefiles:/nwprod/lib/modulefiles:/u/Benjamin.Blake/modulefiles'
+ export MODULEPATH
+
MPM_LAUNCHER=/usrx/local/intel/2015/composerxe/debugger/mpm/bin/start_mpm.sh
+ export MPM_LAUNCHER
+
NLSPATH=/usrx/local/intel/2015/composerxe/lib/intel64/locale/%l_%t/%N:/usrx/local/intel/2015/ipp/lib/intel64/locale/%l_%t/%N:/usrx/local/intel/2015/mkl/lib/intel64/locale/%l_%t/%N:/usrx/local/intel/2015/composer_xe_2015.3.187/debugger/gdb/intel64_mic/share/locale/%l_%t/%N:/usrx/local/intel/2015/composer_xe_2015.3.187/debugger/gdb/intel64/share/locale/%l_%t/%N
+ export NLSPATH
+
PATH=/global/noscrub/Julie.Prestopnik/met/8.0//bin:/global/noscrub/Julie.Prestopnik/met/8.0/external_libs/bin:/usrx/local/dev/python/2.7.14/bin:/usrx/local/intel/2015/advisor_xe_2015/bin64:/usrx/local/intel/2015/vtune_amplifier_xe_2015/bin64:/usrx/local/intel/2015/inspector_xe_2015/bin64:/usrx/local/intel/2015/impi_latest/intel64/bin:/usrx/local/intel/2015/itac_latest/intel64/bin:/usrx/local/intel/2015/composer_xe_2015.3.187/bin/intel64:/usrx/local/intel/2015/mpirt/bin/intel64:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64_mic/bin:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64/bin:.:/nwprod/gempak/nawips/os/linux2.6.32_x86_64/bin:/usr/lib64/qt-
3.3/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/opt/ibutils/bin:/nwprod/util/exec::/nwprod/util/ush::/u/Wesley.Ebisuzaki/bin:/u/Ying.Lin/bin:/nwprod/gempak/nawips/bin:/nwprod/gempak/nawips/scripts/ez:/nwprod/gempak/nawips/scripts/nawips:/nwprod/gempak/nawips/scripts/prnt:/nwprod/gempak/nawips/scripts/decoder:/sss/emc/meso/shared/Eric.Rogers/ddapp/exe_lnx6:/sss/emc/meso/shared/Eric.Rogers/vsdb/scripts
+ export PATH
+ PROD_DIR=/usrx/local/intel/2015/composerxe
+ export PROD_DIR
+ ROOTPATH=/usrx/local/intel/2015
+ export ROOTPATH
+ SCRIPTPATH=/usrx/local/intel/2015
+ export SCRIPTPATH
+ TBBROOT=/usrx/local/intel/2015/tbb
+ export TBBROOT
+
VTUNE_AMPLIFIER_XE_2015_DIR=/usrx/local/intel/2015/vtune_amplifier_xe_2015
+ export VTUNE_AMPLIFIER_XE_2015_DIR
+ VT_ADD_LIBS='-ldwarf -lelf -lvtunwind -lnsl -lm -ldl -lpthread'
+ export VT_ADD_LIBS
+ VT_ARCH=intel64
+ export VT_ARCH
+ VT_LIB_DIR=/usrx/local/intel/2015/itac_latest/lib
+ export VT_LIB_DIR
+ VT_MIC_SLIB_DIR=/usrx/local/intel/2015/itac_latest/mic/slib
+ export VT_MIC_SLIB_DIR
+ VT_MPI=impi4
+ export VT_MPI
+ VT_ROOT=/usrx/local/intel/2015/itac_latest
+ export VT_ROOT
+ VT_SLIB_DIR=/usrx/local/intel/2015/itac_latest/intel64/slib
+ export VT_SLIB_DIR
+
_LMFILES_=/usrx/local/modulefiles/ics/15.0.3:/usrx/local/dev/modulefiles/python/2.7.14:/global/noscrub/Julie.Prestopnik/modulefiles/met/8.0
+ export _LMFILES_
+ module load nco
+ /usrx/local/Modules/3.2.10/bin/modulecmd ksh load nco
+ eval LOADEDMODULES=ics/15.0.3:python/2.7.14:met/8.0:nco/4.2.4
';export'
'LOADEDMODULES;MANPATH=/usrx/local/nco/4.2.4/share/man:/usrx/local/dev/python/2.7.14/share/man:/usrx/local/intel/2015/impi_latest/man:/usrx/local/intel/2015/itac_latest/man:/usrx/local/intel/2015/composerxe/man/en_US:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64/share/man:/usr/share/man:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64_mic/share/man:/usrx/local/intel/2015/inspector_xe_2015/man:/usrx/local/intel/2015/vtune_amplifier_xe_2015/man:/usrx/local/intel/2015/advisor_xe_2015/man'
';export' 'MANPATH;NCO_INCLUDE=-I/usrx/local/nco/4.2.4/include'
';export' 'NCO_INCLUDE;NCO_LDFLAGS_C=-L/usrx/local/nco/4.2.4/lib'
';export' 'NCO_LDFLAGS_C;NCO_LDFLAGS_CXX=-L/usrx/local/nco/4.2.4/lib'
';export'
'NCO_LDFLAGS_CXX;PATH=/usrx/local/nco/4.2.4/bin:/global/noscrub/Julie.Prestopnik/met/8.0//bin:/global/noscrub/Julie.Prestopnik/met/8.0/external_libs/bin:/usrx/local/dev/python/2.7.14/bin:/usrx/local/intel/2015/advisor_xe_2015/bin64:/usrx/local/intel/2015/vtune_amplifier_xe_2015/bin64:/usrx/local/intel/2015/inspector_xe_2015/bin64:/usrx/local/intel/2015/impi_latest/intel64/bin:/usrx/local/intel/2015/itac_latest/intel64/bin:/usrx/local/intel/2015/composer_xe_2015.3.187/bin/intel64:/usrx/local/intel/2015/mpirt/bin/intel64:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64_mic/bin:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64/bin:.:/nwprod/gempak/nawips/os/linux2.6.32_x86_64/bin:/usr/lib64/qt-
3.3/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/opt/ibutils/bin:/nwprod/util/exec::/nwprod/util/ush::/u/Wesley.Ebisuzaki/bin:/u/Ying.Lin/bin:/nwprod/gempak/nawips/bin:/nwprod/gempak/nawips/scripts/ez:/nwprod/gempak/nawips/scripts/nawips:/nwprod/gempak/nawips/scripts/prnt:/nwprod/gempak/nawips/scripts/decoder:/sss/emc/meso/shared/Eric.Rogers/ddapp/exe_lnx6:/sss/emc/meso/shared/Eric.Rogers/vsdb/scripts'
';export'
'PATH;_LMFILES_=/usrx/local/modulefiles/ics/15.0.3:/usrx/local/dev/modulefiles/python/2.7.14:/global/noscrub/Julie.Prestopnik/modulefiles/met/8.0:/usrx/local/modulefiles/nco/4.2.4'
';export' '_LMFILES_;'
+ LOADEDMODULES=ics/15.0.3:python/2.7.14:met/8.0:nco/4.2.4
+ export LOADEDMODULES
+
MANPATH=/usrx/local/nco/4.2.4/share/man:/usrx/local/dev/python/2.7.14/share/man:/usrx/local/intel/2015/impi_latest/man:/usrx/local/intel/2015/itac_latest/man:/usrx/local/intel/2015/composerxe/man/en_US:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64/share/man:/usr/share/man:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64_mic/share/man:/usrx/local/intel/2015/inspector_xe_2015/man:/usrx/local/intel/2015/vtune_amplifier_xe_2015/man:/usrx/local/intel/2015/advisor_xe_2015/man
+ export MANPATH
+ NCO_INCLUDE=-I/usrx/local/nco/4.2.4/include
+ export NCO_INCLUDE
+ NCO_LDFLAGS_C=-L/usrx/local/nco/4.2.4/lib
+ export NCO_LDFLAGS_C
+ NCO_LDFLAGS_CXX=-L/usrx/local/nco/4.2.4/lib
+ export NCO_LDFLAGS_CXX
+
PATH=/usrx/local/nco/4.2.4/bin:/global/noscrub/Julie.Prestopnik/met/8.0//bin:/global/noscrub/Julie.Prestopnik/met/8.0/external_libs/bin:/usrx/local/dev/python/2.7.14/bin:/usrx/local/intel/2015/advisor_xe_2015/bin64:/usrx/local/intel/2015/vtune_amplifier_xe_2015/bin64:/usrx/local/intel/2015/inspector_xe_2015/bin64:/usrx/local/intel/2015/impi_latest/intel64/bin:/usrx/local/intel/2015/itac_latest/intel64/bin:/usrx/local/intel/2015/composer_xe_2015.3.187/bin/intel64:/usrx/local/intel/2015/mpirt/bin/intel64:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64_mic/bin:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64/bin:.:/nwprod/gempak/nawips/os/linux2.6.32_x86_64/bin:/usr/lib64/qt-
3.3/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/opt/ibutils/bin:/nwprod/util/exec::/nwprod/util/ush::/u/Wesley.Ebisuzaki/bin:/u/Ying.Lin/bin:/nwprod/gempak/nawips/bin:/nwprod/gempak/nawips/scripts/ez:/nwprod/gempak/nawips/scripts/nawips:/nwprod/gempak/nawips/scripts/prnt:/nwprod/gempak/nawips/scripts/decoder:/sss/emc/meso/shared/Eric.Rogers/ddapp/exe_lnx6:/sss/emc/meso/shared/Eric.Rogers/vsdb/scripts
+ export PATH
+
_LMFILES_=/usrx/local/modulefiles/ics/15.0.3:/usrx/local/dev/modulefiles/python/2.7.14:/global/noscrub/Julie.Prestopnik/modulefiles/met/8.0:/usrx/local/modulefiles/nco/4.2.4
+ export _LMFILES_
+ module load grib_util
+ /usrx/local/Modules/3.2.10/bin/modulecmd ksh load grib_util
+ eval CNVGRIB=/nwprod2/grib_util.v1.0.0/exec/cnvgrib ';export'
'CNVGRIB;COPYGB=/nwprod2/grib_util.v1.0.0/exec/copygb' ';export'
'COPYGB;COPYGB2=/nwprod2/grib_util.v1.0.0/exec/copygb2' ';export'
'COPYGB2;DEGRIB2=/nwprod2/grib_util.v1.0.0/exec/degrib2' ';export'
'DEGRIB2;GRB2INDEX=/nwprod2/grib_util.v1.0.0/exec/grb2index' ';export'
'GRB2INDEX;GRBINDEX=/nwprod2/grib_util.v1.0.0/exec/grbindex' ';export'
'GRBINDEX;GRIB2GRIB=/nwprod2/grib_util.v1.0.0/exec/grib2grib'
';export'
'GRIB2GRIB;LOADEDMODULES=ics/15.0.3:python/2.7.14:met/8.0:nco/4.2.4:grib_util/v1.0.0'
';export'
'LOADEDMODULES;TOCGRIB=/nwprod2/grib_util.v1.0.0/exec/tocgrib'
';export' 'TOCGRIB;TOCGRIB2=/nwprod2/grib_util.v1.0.0/exec/tocgrib2'
';export'
'TOCGRIB2;TOCGRIB2SUPER=/nwprod2/grib_util.v1.0.0/exec/tocgrib2super'
';export' 'TOCGRIB2SUPER;WGRIB=/nwprod2/grib_util.v1.0.0/exec/wgrib'
';export' 'WGRIB;WGRIB2=/nwprod2/grib_util.v1.0.0/exec/wgrib2'
';export'
'WGRIB2;_LMFILES_=/usrx/local/modulefiles/ics/15.0.3:/usrx/local/dev/modulefiles/python/2.7.14:/global/noscrub/Julie.Prestopnik/modulefiles/met/8.0:/usrx/local/modulefiles/nco/4.2.4:/nwprod2/modulefiles/grib_util/v1.0.0'
';export' '_LMFILES_;'
+ CNVGRIB=/nwprod2/grib_util.v1.0.0/exec/cnvgrib
+ export CNVGRIB
+ COPYGB=/nwprod2/grib_util.v1.0.0/exec/copygb
+ export COPYGB
+ COPYGB2=/nwprod2/grib_util.v1.0.0/exec/copygb2
+ export COPYGB2
+ DEGRIB2=/nwprod2/grib_util.v1.0.0/exec/degrib2
+ export DEGRIB2
+ GRB2INDEX=/nwprod2/grib_util.v1.0.0/exec/grb2index
+ export GRB2INDEX
+ GRBINDEX=/nwprod2/grib_util.v1.0.0/exec/grbindex
+ export GRBINDEX
+ GRIB2GRIB=/nwprod2/grib_util.v1.0.0/exec/grib2grib
+ export GRIB2GRIB
+
LOADEDMODULES=ics/15.0.3:python/2.7.14:met/8.0:nco/4.2.4:grib_util/v1.0.0
+ export LOADEDMODULES
+ TOCGRIB=/nwprod2/grib_util.v1.0.0/exec/tocgrib
+ export TOCGRIB
+ TOCGRIB2=/nwprod2/grib_util.v1.0.0/exec/tocgrib2
+ export TOCGRIB2
+ TOCGRIB2SUPER=/nwprod2/grib_util.v1.0.0/exec/tocgrib2super
+ export TOCGRIB2SUPER
+ WGRIB=/nwprod2/grib_util.v1.0.0/exec/wgrib
+ export WGRIB
+ WGRIB2=/nwprod2/grib_util.v1.0.0/exec/wgrib2
+ export WGRIB2
+
_LMFILES_=/usrx/local/modulefiles/ics/15.0.3:/usrx/local/dev/modulefiles/python/2.7.14:/global/noscrub/Julie.Prestopnik/modulefiles/met/8.0:/usrx/local/modulefiles/nco/4.2.4:/nwprod2/modulefiles/grib_util/v1.0.0
+ export _LMFILES_
+ METPLUS_PATH=/meso/save/Ying.Lin/metplus
+ export METPLUS_PATH
+ MET_PATH=/global/noscrub/Julie.Prestopnik/met/8.0
+ export MET_PATH
+ JLOGFILE=/meso/save/Ying.Lin/metplus/logs/metplus_jlogfile
+ export JLOGFILE
+
PYTHONPATH=/meso/save/Ying.Lin/metplus/ush:/meso/save/Ying.Lin/metplus/parm
+ export PYTHONPATH
+
PATH=/usrx/local/nco/4.2.4/bin:/global/noscrub/Julie.Prestopnik/met/8.0//bin:/global/noscrub/Julie.Prestopnik/met/8.0/external_libs/bin:/usrx/local/dev/python/2.7.14/bin:/usrx/local/intel/2015/advisor_xe_2015/bin64:/usrx/local/intel/2015/vtune_amplifier_xe_2015/bin64:/usrx/local/intel/2015/inspector_xe_2015/bin64:/usrx/local/intel/2015/impi_latest/intel64/bin:/usrx/local/intel/2015/itac_latest/intel64/bin:/usrx/local/intel/2015/composer_xe_2015.3.187/bin/intel64:/usrx/local/intel/2015/mpirt/bin/intel64:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64_mic/bin:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64/bin:.:/nwprod/gempak/nawips/os/linux2.6.32_x86_64/bin:/usr/lib64/qt-
3.3/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/opt/ibutils/bin:/nwprod/util/exec::/nwprod/util/ush::/u/Wesley.Ebisuzaki/bin:/u/Ying.Lin/bin:/nwprod/gempak/nawips/bin:/nwprod/gempak/nawips/scripts/ez:/nwprod/gempak/nawips/scripts/nawips:/nwprod/gempak/nawips/scripts/prnt:/nwprod/gempak/nawips/scripts/decoder:/sss/emc/meso/shared/Eric.Rogers/ddapp/exe_lnx6:/sss/emc/meso/shared/Eric.Rogers/vsdb/scripts:/meso/save/Ying.Lin/metplus/ush:.
+ export PATH
+ master_metplus.py -c
/meso/save/Ying.Lin/metplus/parm/models_conf/fv3gfs_24h_by_valid_time.conf
-c /meso/save/Ying.Lin/metplus/parm/ylin.system.conf.wcoss
03/07 19:55:06.324 jlog (log.py:66) INFO: master_metplus is starting
03/07 19:55:06.334 jlog (master_metplus.py:55) INFO: Top of
master_metplus
03/07 19:55:06.335 master_metplus (master_metplus.py:64) INFO: logger
Top of master_metplus.
03/07 19:55:06.335 metplus (config_metplus.py:76) INFO: Starting
METplus configuration setup.
03/07 19:55:06.335 metplus (config_metplus.py:99) INFO: All OPTS and
ARGS: [('-c',
'/meso/save/Ying.Lin/metplus/parm/models_conf/fv3gfs_24h_by_valid_time.conf'),
('-c', '/meso/save/Ying.Lin/metplus/parm/ylin.system.conf.wcoss')] []
03/07 19:55:06.335 metplus (config_launcher.py:160) INFO:
/meso/save/Ying.Lin/metplus/parm/models_conf/fv3gfs_24h_by_valid_time.conf
03/07 19:55:06.337 metplus (config_launcher.py:171) INFO:
/meso/save/Ying.Lin/metplus/parm/models_conf/fv3gfs_24h_by_valid_time.conf:
Plan to parse this conf file
03/07 19:55:06.337 metplus (config_launcher.py:160) INFO:
/meso/save/Ying.Lin/metplus/parm/ylin.system.conf.wcoss
03/07 19:55:06.344 metplus (config_launcher.py:171) INFO:
/meso/save/Ying.Lin/metplus/parm/ylin.system.conf.wcoss: Plan to parse
this conf file
03/07 19:55:06.357 metplus (config_launcher.py:195) INFO: Conf input:
'/gpfs/td1/emc/meso/save/Ying.Lin/metplus/parm/metplus_config/metplus_system.conf'
03/07 19:55:06.368 metplus (config_launcher.py:195) INFO: Conf input:
'/gpfs/td1/emc/meso/save/Ying.Lin/metplus/parm/metplus_config/metplus_data.conf'
03/07 19:55:06.374 metplus (config_launcher.py:195) INFO: Conf input:
'/gpfs/td1/emc/meso/save/Ying.Lin/metplus/parm/metplus_config/metplus_runtime.conf'
03/07 19:55:06.375 metplus (config_launcher.py:195) INFO: Conf input:
'/gpfs/td1/emc/meso/save/Ying.Lin/metplus/parm/metplus_config/metplus_logging.conf'
03/07 19:55:06.375 metplus (config_launcher.py:195) INFO: Conf input:
'/meso/save/Ying.Lin/metplus/parm/models_conf/fv3gfs_24h_by_valid_time.conf'
03/07 19:55:06.375 metplus (config_launcher.py:195) INFO: Conf input:
'/meso/save/Ying.Lin/metplus/parm/ylin.system.conf.wcoss'
03/07 19:55:06.387 metplus (config_launcher.py:218) INFO:
/gpfs/td1/emc/meso/save/Ying.Lin/metplus/parm/metplus_config/metplus_system.conf:
Parsed this file
03/07 19:55:06.398 metplus (config_launcher.py:218) INFO:
/gpfs/td1/emc/meso/save/Ying.Lin/metplus/parm/metplus_config/metplus_data.conf:
Parsed this file
03/07 19:55:06.406 metplus (config_launcher.py:218) INFO:
/gpfs/td1/emc/meso/save/Ying.Lin/metplus/parm/metplus_config/metplus_runtime.conf:
Parsed this file
03/07 19:55:06.417 metplus (config_launcher.py:218) INFO:
/gpfs/td1/emc/meso/save/Ying.Lin/metplus/parm/metplus_config/metplus_logging.conf:
Parsed this file
03/07 19:55:06.418 metplus (config_launcher.py:218) INFO:
/meso/save/Ying.Lin/metplus/parm/models_conf/fv3gfs_24h_by_valid_time.conf:
Parsed this file
03/07 19:55:06.430 metplus (config_launcher.py:218) INFO:
/meso/save/Ying.Lin/metplus/parm/ylin.system.conf.wcoss: Parsed this
file
03/07 19:55:06.431 metplus (met_util.py:216) INFO: Adding:
config.LOG_TIMESTAMP='20190307'
03/07 19:55:06.431 metplus (met_util.py:222) INFO: Replace [config]
LOG_METPLUS with
'/meso/noscrub/Ying.Lin/metplus.out/logs/master_metplus.log.20190307'
03/07 19:55:06.434 metplus (config_launcher.py:289) INFO: Replace
[dir] OUTPUT_BASE with /meso/noscrub/Ying.Lin/metplus.out
03/07 19:55:06.434 metplus (config_launcher.py:289) INFO: Replace
[dir] METPLUS_BASE with /meso/save/Ying.Lin/metplus/
03/07 19:55:06.434 metplus (config_launcher.py:300) INFO:
METPLUS_CONF: /meso/noscrub/Ying.Lin/metplus.out/metplus_final.conf
written here.
03/07 19:55:06.437 metplus (config_metplus.py:148) INFO: Completed
METplus configuration setup.
03/07 19:55:06.464 metplus.GridStat (master_metplus.py:142) INFO:
****************************************
03/07 19:55:06.464 metplus.GridStat (master_metplus.py:143) INFO: *
RUNNING MET+
03/07 19:55:06.464 metplus.GridStat (master_metplus.py:147) INFO: *
at valid time: 201903051200
03/07 19:55:06.465 metplus.GridStat (master_metplus.py:148) INFO:
****************************************
03/07 19:55:06.485 metplus.PcpCombine (pcp_combine_wrapper.py:597)
WARNING: pcp_combine: Could not find files to compute accumulation in
/com2/ccpa/prod
03/07 19:55:06.485 metplus.PcpCombine (pcp_combine_wrapper.py:442)
INFO:
03/07 19:55:06.485 metplus.PcpCombine (pcp_combine_wrapper.py:382)
ERROR: No input filenames specified
03/07 19:55:06.488 metplus.RegridDataPlane
(regrid_data_plane_wrapper.py:89) INFO:
03/07 19:55:06.488 metplus.RegridDataPlane (command_runner.py:220)
DEBUG: LOG_MET_OUTPUT_TO_METPLUS log file is True
03/07 19:55:06.489 metplus.RegridDataPlane (command_runner.py:119)
INFO: app_name is: regrid_data_plane, output sent to:
/meso/noscrub/Ying.Lin/metplus.out/logs/master_metplus.log.20190307
03/07 19:55:06.543 mpi_impl (__init__.py:331) INFO: inside_aprun: not
detected: INSIDE_APRUN is not set or is 0
03/07 19:55:06.562 mpi_impl (__init__.py:331) INFO: lsf_cray_intel:
not detected: aprun: cannot find executable
03/07 19:55:06.563 mpi_impl (__init__.py:331) INFO: mpirun_lsf: not
detected: mpirun.lsf: cannot find executable
03/07 19:55:06.860 mpi_impl (__init__.py:331) INFO: impi: not
detected: 'TOTAL_TASKS'
03/07 19:55:06.861 mpi_impl (__init__.py:331) INFO: mpiexec_mpt: not
detected: mpiexec_mpt: cannot find executable
03/07 19:55:06.862 mpi_impl (__init__.py:331) INFO: srun: not
detected: srun: cannot find executable
03/07 19:55:06.864 mpi_impl (__init__.py:331) INFO: mpiexec: not
detected: 'TOTAL_TASKS'
03/07 19:55:06.865 metplus.RegridDataPlane (command_runner.py:155)
INFO: RUNNING:
/global/noscrub/Julie.Prestopnik/met/8.0/bin/regrid_data_plane -v 5
-field "name=\"APCP_24\"; level=\"(*,*)\";" -method BUDGET -width 2
-name APCP_24
/meso/noscrub/Ying.Lin/metplus.out/qpe_grib/bucket/20190305/ccpa.2019030512_A24h.g212
/global/noscrub/Julie.Prestopnik/METplus/METplus-
2.0_sample_data/sample_fcst/2005080700/wrfprs_ruc13_12.tm00_G212
/meso/noscrub/Ying.Lin/metplus.out/qpe_grib/regrid/20190305/ccpa.2019030512_A24h.g212
>> /meso/noscrub/Ying.Lin/metplus.out/logs/master_metplus.log.20190307
2>&1
03/07 19:55:06.865 metplus.RegridDataPlane (command_runner.py:156)
DEBUG: RUNNING
exe('/global/noscrub/Julie.Prestopnik/met/8.0/bin/regrid_data_plane')['-
v','5','-field','name="APCP_24"; level="(*,*)";','-method','BUDGET','-
width','2','-
name','APCP_24','/meso/noscrub/Ying.Lin/metplus.out/qpe_grib/bucket/20190305/ccpa.2019030512_A24h.g212','/global/noscrub/Julie.Prestopnik/METplus/METplus-
2.0_sample_data/sample_fcst/2005080700/wrfprs_ruc13_12.tm00_G212','/meso/noscrub/Ying.Lin/metplus.out/qpe_grib/regrid/20190305/ccpa.2019030512_A24h.g212'].out('/meso/noscrub/Ying.Lin/metplus.out/logs/master_metplus.log.20190307',append=True).err2out()
03/07 19:55:08.146 metplus.GridStat (compare_gridded_wrapper.py:344)
DEBUG:
03/07 19:55:08.146 metplus.GridStat (compare_gridded_wrapper.py:345)
DEBUG: ENVIRONMENT FOR NEXT COMMAND:
03/07 19:55:08.146 metplus.GridStat (command_builder.py:146) DEBUG:
MODEL=FV3GFS
03/07 19:55:08.146 metplus.GridStat (command_builder.py:146) DEBUG:
FCST_VAR=APCP
03/07 19:55:08.146 metplus.GridStat (command_builder.py:146) DEBUG:
OBS_VAR=APCP
03/07 19:55:08.146 metplus.GridStat (command_builder.py:146) DEBUG:
LEVEL=A24
03/07 19:55:08.147 metplus.GridStat (command_builder.py:146) DEBUG:
OBTYPE=QPE
03/07 19:55:08.147 metplus.GridStat (command_builder.py:146) DEBUG:
CONFIG_DIR=/meso/save/Ying.Lin/metplus//parm/use_cases/qpf/met_config
03/07 19:55:08.147 metplus.GridStat (command_builder.py:146) DEBUG:
FCST_FIELD={ name="APCP"; level="[A24]"; cat_thresh=[ gt0.254, gt2.54,
gt6.35, gt12.7, gt19.05, gt25.4, gt38.1, gt50.8, gt101.6 ]; }
03/07 19:55:08.147 metplus.GridStat (command_builder.py:146) DEBUG:
OBS_FIELD={ name="APCP"; level="[A24]"; cat_thresh=[ gt0.254, gt2.54,
gt6.35, gt12.7, gt19.05, gt25.4, gt38.1, gt50.8, gt101.6 ]; }
03/07 19:55:08.147 metplus.GridStat (command_builder.py:146) DEBUG:
INPUT_BASE=/global/noscrub/Julie.Prestopnik/METplus/METplus-
2.0_sample_data
03/07 19:55:08.147 metplus.GridStat (command_builder.py:146) DEBUG:
MET_VALID_HHMM=0305
03/07 19:55:08.147 metplus.GridStat (compare_gridded_wrapper.py:356)
DEBUG:
03/07 19:55:08.147 metplus.GridStat (compare_gridded_wrapper.py:357)
DEBUG: COPYABLE ENVIRONMENT FOR NEXT COMMAND:
03/07 19:55:08.148 metplus.GridStat (command_builder.py:141) DEBUG:
export MODEL=FV3GFS; export FCST_VAR=APCP; export OBS_VAR=APCP; export
LEVEL=A24; export OBTYPE=QPE; export
CONFIG_DIR=/meso/save/Ying.Lin/metplus//parm/use_cases/qpf/met_config;
export FCST_FIELD="{ name=\"APCP\"; level=\"[A24]\"; cat_thresh=[
gt0.254, gt2.54, gt6.35, gt12.7, gt19.05, gt25.4, gt38.1, gt50.8,
gt101.6 ]; }"; export OBS_FIELD="{ name=\"APCP\"; level=\"[A24]\";
cat_thresh=[ gt0.254, gt2.54, gt6.35, gt12.7, gt19.05, gt25.4, gt38.1,
gt50.8, gt101.6 ]; }"; export
INPUT_BASE=/global/noscrub/Julie.Prestopnik/METplus/METplus-
2.0_sample_data; export MET_VALID_HHMM=0305;
03/07 19:55:08.148 metplus.GridStat (compare_gridded_wrapper.py:363)
DEBUG:
03/07 19:55:08.148 metplus.GridStat (compare_gridded_wrapper.py:369)
INFO:
03/07 19:55:08.148 metplus.GridStat (command_runner.py:220) DEBUG:
LOG_MET_OUTPUT_TO_METPLUS log file is True
03/07 19:55:08.149 metplus.GridStat (command_runner.py:119) INFO:
app_name is: grid_stat, output sent to:
/meso/noscrub/Ying.Lin/metplus.out/logs/master_metplus.log.20190307
03/07 19:55:08.150 metplus.GridStat (command_runner.py:155) INFO:
RUNNING: /global/noscrub/Julie.Prestopnik/met/8.0/bin/grid_stat
/gpfs/dell1/nco/ops/com/gfs/para/gfs.20190304/12/gfs.t12z.pgrb2.0p25.f024
/meso/noscrub/Ying.Lin/metplus.out/qpe_grib/regrid/20190305/ccpa.2019030512_A24h.g212
/meso/save/Ying.Lin/metplus//parm/ylin.GridStatConfig.CTC -outdir
/meso/noscrub/Ying.Lin/metplus.out/met_out/FV3GFS/201903051200/grid_stat
>> /meso/noscrub/Ying.Lin/metplus.out/logs/master_metplus.log.20190307
2>&1
03/07 19:55:08.150 metplus.GridStat (command_runner.py:156) DEBUG:
RUNNING
exe('/global/noscrub/Julie.Prestopnik/met/8.0/bin/grid_stat')['/gpfs/dell1/nco/ops/com/gfs/para/gfs.20190304/12/gfs.t12z.pgrb2.0p25.f024','/meso/noscrub/Ying.Lin/metplus.out/qpe_grib/regrid/20190305/ccpa.2019030512_A24h.g212','/meso/save/Ying.Lin/metplus//parm/ylin.GridStatConfig.CTC','-
outdir','/meso/noscrub/Ying.Lin/metplus.out/met_out/FV3GFS/201903051200/grid_stat'].out('/meso/noscrub/Ying.Lin/metplus.out/logs/master_metplus.log.20190307',append=True).err2out()
------------------------------------------------
Subject: CCPA file name format for METplus
From: Ying Lin
Time: Thu Mar 07 13:32:50 2019
#!/bin/ksh
set -x
. ~/dot.for.metplus
#export MODEL=FV3GFS
#export vday=20190305
master_metplus.py \
-c ${METPLUS_PATH}/parm/models_conf/fv3gfs_24h_by_valid_time.conf \
-c ${METPLUS_PATH}/parm/ylin.system.conf.wcoss
------------------------------------------------
Subject: CCPA file name format for METplus
From: George McCabe
Time: Mon Mar 11 08:30:33 2019
Hi Ying,
You may need to change %H to %.2H in the template to tell it that
there
will always be 2 digit precision. If that doesn't work, could you send
me
the directory listing so I can see what files are available?
To pass in environment variables, use the following notation:
{ENV[vday]}.
You are correct that using valid hour for the directory name will not
work,
as it will change the value to 03. If this value is going to change
between
runs and doesn't directly correspond to the valid time, you may have
to
trick it with environment variables to get it to work correctly.
On Thu, Mar 7, 2019 at 1:33 PM Ying Lin via RT <met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=89063 >
>
> Hi George,
>
> Thanks! That makes sense, though it didn't quite work out for
me.
> In the attached fv3gfs_24h_by_valid_time.conf, I have
> OBS_PCP_COMBINE_INPUT_DIR = /com2/ccpa/prod
> then
> OBS_PCP_COMBINE_INPUT_TEMPLATE =
>
>
ccpa.{valid?fmt=%Y%m%d}/{valid?fmt=%H}/ccpa.t{valid?fmt=%H}z.{level?fmt=%.2H}h.hrap.conus.gb2
>
> thinking that it would tell pcp_combine to look for e,g,
> /com2/ccpa/prod/ccpa.20190305/06/ccpa.t06z.06h.hrap.conus.gb2
>
> Instead I'm getting "WARNING: pcp_combine: Could not find files to
> compute accumulation in /com2/ccpa/prod" (in the attached test.out
and
> master_metplus.log.20190307).
>
> Could you tell what I'm doing wrong in the config?
>
> I'm doing the above in Tide:/meso/save/Ying.Lin/metplus/test/.
>
> Also two related questions:
> 1) In the METplus model config files I've seen (like in the attached
> config), the VALID_BEG and VALID_END are set in the config file. Is
> there an easy way to set and export the VALID_* variable from a
script?
> For example I've tried "export vday=20190305" in the
test_fv3gfs_24h.ksh
> and in the config file set
> VALID_BEG = "${vday}"12 (same for VALID_END)
> and
> VALID_BEG = ${vday}12
> and
> VALID_BEG = {vday}12
> none of the above worked. What's the right way to do this?
>
> 2) In the CCPA directory of /com2/ccpa/prod/ccpa.20190305/06/, the
'06'
> subdir seems to contain all CCPA analysis files with valid times
from
> 01Z-06Z. So for 6h analysis, the '06' in the subdir is just the
valid
> hour. But if I do 3-hourly verification using the 3-hourly CCPA
files,
> the above directory also contains ccpa.t03z.03h.hrap.conus.gb2
(valid at
> 03Z) and ccpa.t06z.03h.hrap.conus.gb2 (valid at 06Z). In that case i
> don't think the
>
>
ccpa.{valid?fmt=%Y%m%d}/{valid?fmt=%H}/ccpa.t{valid?fmt=%H}z.{level?fmt=%.2H}h.hrap.conus.gb2
> would work, would it?
>
> Thanks again,
>
> Ying
>
>
> On 3/6/19 10:29 AM, George McCabe via RT wrote:
> > Hi Ying Lin,
> >
> > You should be able to use a template that looks something like
this:
> >
> >
>
"ccpa.{valid?fmt=%Y%m%d}/06/ccpa.t{valid?fmt=%H}z.{level?fmt=%.2H}h.hrap.conus.gb2"
> >
> > The 'level' item corresponds to the accumulation amount. %.2H
specifies
> > that the filename has 2 digits of precision for that value. I
wasn't sure
> > what the '06' subdirectory corresponds to, but if necessary you
can
> > substitute that with formatting so that it will be dynamic. Let me
know
> if
> > that doesn't work and I can help figure out what will.
> >
> > Thanks,
> > George
> >
> > On Mon, Feb 25, 2019 at 11:09 AM Ying Lin via RT
<met_help at ucar.edu>
> wrote:
> >
> >> Mon Feb 25 11:08:35 2019: Request 89063 was acted upon.
> >> Transaction: Ticket created by ying.lin at noaa.gov
> >> Queue: met_help
> >> Subject: CCPA file name format for METplus
> >> Owner: Nobody
> >> Requestors: ying.lin at noaa.gov
> >> Status: new
> >> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=89063
> >
> >>
> >>
> >> Hello. I see that
> >>
> >>
>
https://github.com/NCAR/METplus/blob/master/parm/use_cases/grid_to_grid/examples/precip.conf
> >> has
> >> OBS_GRID_STAT_INPUT_TEMPLATE =
ccpa_conus_1.0d_{valid?fmt=%Y%m%d}
> >>
> >> CCPA output on wcoss has file names like
> >> /com2/ccpa/prod/ccpa.20190224/06/ccpa.t03z.03h.hrap.conus.gb2
> >> which is 3h accumulation valid at 03Z 2019/02/24
> >> and ccpa.t06z.06h.hrap.conus.gb2
> >> which is 6h accumulation valid at 06Z 2019/02/24
> >>
> >> Does METplus already have the capability to handle the CCPA in
its
> >> 'native' directory/name format, as in the /com2/* directory
above? In
> >> my verif scripts I do
> >> cp $COMCCPA.$vday/06/ccpa.t03z.03h.hrap.conus.gb2
> ccpa.${vday}03.03h.gb2
> >>
> >> If METplus can already handle this bit of pre-processing, or if
this can
> >> be added to the wish list, that'll be great. Thanks!
> >>
> >> Ying
> >>
> >> --
> >> Ying Lin
> >> NCEP/EMC/Verification, Post-processing and Product Generation
Branch
> >> NCWCP Cubicle No. 2015
> >> Ying.Lin at noaa.gov
> >>
> >>
> >>
> >>
>
> --
> Ying Lin
> NCEP/EMC/Verification, Post-processing and Product Generation Branch
> NCWCP Cubicle No. 2015
> Ying.Lin at noaa.gov
>
>
>
>
------------------------------------------------
Subject: CCPA file name format for METplus
From: George McCabe
Time: Mon Mar 11 08:47:20 2019
Hi Ying,
I was incorrect that you need to change the precision. %H should find
the
time the way it is formatted. I think you will need to remove
OBS_LEVEL = 1
from your config. This variable tells METplus to only look for 1 hr
accumulation files to use in pcp_combine. If you remove this variable,
it
should look for a 24 hr accumulation file and reduce the hour by 1
until it
finds a file that it can use. If you want to force METplus to use 6
hour
files to build the 24 hr accumulation, you should set OBS_LEVEL = 6.
Let me
know if that helps.
Thanks,
George
On Mon, Mar 11, 2019 at 8:30 AM George McCabe <mccabe at ucar.edu> wrote:
> Hi Ying,
>
> You may need to change %H to %.2H in the template to tell it that
there
> will always be 2 digit precision. If that doesn't work, could you
send me
> the directory listing so I can see what files are available?
>
> To pass in environment variables, use the following notation:
{ENV[vday]}.
>
> You are correct that using valid hour for the directory name will
not
> work, as it will change the value to 03. If this value is going to
change
> between runs and doesn't directly correspond to the valid time, you
may
> have to trick it with environment variables to get it to work
correctly.
>
> On Thu, Mar 7, 2019 at 1:33 PM Ying Lin via RT <met_help at ucar.edu>
wrote:
>
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=89063 >
>>
>> Hi George,
>>
>> Thanks! That makes sense, though it didn't quite work out for
me.
>> In the attached fv3gfs_24h_by_valid_time.conf, I have
>> OBS_PCP_COMBINE_INPUT_DIR = /com2/ccpa/prod
>> then
>> OBS_PCP_COMBINE_INPUT_TEMPLATE =
>>
>>
ccpa.{valid?fmt=%Y%m%d}/{valid?fmt=%H}/ccpa.t{valid?fmt=%H}z.{level?fmt=%.2H}h.hrap.conus.gb2
>>
>> thinking that it would tell pcp_combine to look for e,g,
>> /com2/ccpa/prod/ccpa.20190305/06/ccpa.t06z.06h.hrap.conus.gb2
>>
>> Instead I'm getting "WARNING: pcp_combine: Could not find files to
>> compute accumulation in /com2/ccpa/prod" (in the attached test.out
and
>> master_metplus.log.20190307).
>>
>> Could you tell what I'm doing wrong in the config?
>>
>> I'm doing the above in Tide:/meso/save/Ying.Lin/metplus/test/.
>>
>> Also two related questions:
>> 1) In the METplus model config files I've seen (like in the
attached
>> config), the VALID_BEG and VALID_END are set in the config file.
Is
>> there an easy way to set and export the VALID_* variable from a
script?
>> For example I've tried "export vday=20190305" in the
test_fv3gfs_24h.ksh
>> and in the config file set
>> VALID_BEG = "${vday}"12 (same for VALID_END)
>> and
>> VALID_BEG = ${vday}12
>> and
>> VALID_BEG = {vday}12
>> none of the above worked. What's the right way to do this?
>>
>> 2) In the CCPA directory of /com2/ccpa/prod/ccpa.20190305/06/, the
'06'
>> subdir seems to contain all CCPA analysis files with valid times
from
>> 01Z-06Z. So for 6h analysis, the '06' in the subdir is just the
valid
>> hour. But if I do 3-hourly verification using the 3-hourly CCPA
files,
>> the above directory also contains ccpa.t03z.03h.hrap.conus.gb2
(valid at
>> 03Z) and ccpa.t06z.03h.hrap.conus.gb2 (valid at 06Z). In that case
i
>> don't think the
>>
>>
ccpa.{valid?fmt=%Y%m%d}/{valid?fmt=%H}/ccpa.t{valid?fmt=%H}z.{level?fmt=%.2H}h.hrap.conus.gb2
>> would work, would it?
>>
>> Thanks again,
>>
>> Ying
>>
>>
>> On 3/6/19 10:29 AM, George McCabe via RT wrote:
>> > Hi Ying Lin,
>> >
>> > You should be able to use a template that looks something like
this:
>> >
>> >
>>
"ccpa.{valid?fmt=%Y%m%d}/06/ccpa.t{valid?fmt=%H}z.{level?fmt=%.2H}h.hrap.conus.gb2"
>> >
>> > The 'level' item corresponds to the accumulation amount. %.2H
specifies
>> > that the filename has 2 digits of precision for that value. I
wasn't
>> sure
>> > what the '06' subdirectory corresponds to, but if necessary you
can
>> > substitute that with formatting so that it will be dynamic. Let
me know
>> if
>> > that doesn't work and I can help figure out what will.
>> >
>> > Thanks,
>> > George
>> >
>> > On Mon, Feb 25, 2019 at 11:09 AM Ying Lin via RT
<met_help at ucar.edu>
>> wrote:
>> >
>> >> Mon Feb 25 11:08:35 2019: Request 89063 was acted upon.
>> >> Transaction: Ticket created by ying.lin at noaa.gov
>> >> Queue: met_help
>> >> Subject: CCPA file name format for METplus
>> >> Owner: Nobody
>> >> Requestors: ying.lin at noaa.gov
>> >> Status: new
>> >> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=89063
>> >
>> >>
>> >>
>> >> Hello. I see that
>> >>
>> >>
>>
https://github.com/NCAR/METplus/blob/master/parm/use_cases/grid_to_grid/examples/precip.conf
>> >> has
>> >> OBS_GRID_STAT_INPUT_TEMPLATE =
ccpa_conus_1.0d_{valid?fmt=%Y%m%d}
>> >>
>> >> CCPA output on wcoss has file names like
>> >>
/com2/ccpa/prod/ccpa.20190224/06/ccpa.t03z.03h.hrap.conus.gb2
>> >> which is 3h accumulation valid at 03Z 2019/02/24
>> >> and ccpa.t06z.06h.hrap.conus.gb2
>> >> which is 6h accumulation valid at 06Z 2019/02/24
>> >>
>> >> Does METplus already have the capability to handle the CCPA in
its
>> >> 'native' directory/name format, as in the /com2/* directory
above? In
>> >> my verif scripts I do
>> >> cp $COMCCPA.$vday/06/ccpa.t03z.03h.hrap.conus.gb2
>> ccpa.${vday}03.03h.gb2
>> >>
>> >> If METplus can already handle this bit of pre-processing, or if
this
>> can
>> >> be added to the wish list, that'll be great. Thanks!
>> >>
>> >> Ying
>> >>
>> >> --
>> >> Ying Lin
>> >> NCEP/EMC/Verification, Post-processing and Product Generation
Branch
>> >> NCWCP Cubicle No. 2015
>> >> Ying.Lin at noaa.gov
>> >>
>> >>
>> >>
>> >>
>>
>> --
>> Ying Lin
>> NCEP/EMC/Verification, Post-processing and Product Generation
Branch
>> NCWCP Cubicle No. 2015
>> Ying.Lin at noaa.gov
>>
>>
>>
>>
------------------------------------------------
Subject: CCPA file name format for METplus
From: Ying Lin
Time: Mon Mar 11 09:48:08 2019
Hi George,
First of all, thank you for telling me about passing the envir
variable using {ENV[vday]}, that was really useful!
Still have trouble "finding" the CCPA files. I've first changed
the OBS_LEVEL=6, when that didn't work, I explicitly specified the
'06h'
in the file name in the config, e.g.
OBS_PCP_COMBINE_INPUT_TEMPLATE =
ccpa.{valid?fmt=%Y%m%d}/{valid?fmt=%H}/ccpa.t{valid?fmt=%H}z.06h.hrap.conus.gb2
Still getting the "WARNING: pcp_combine: Could not find files to
compute
accumulation in /com2/ccpa/prod" in the job output and the log file
(both attached to this email, as well as the config file). Also
attached are the four 6h CCPA files with their full paths, e.g.
t10a1 $ tar cvfz /stmpp1/Ying.Lin/ccpa.tar.gz
/com2/ccpa/prod/ccpa.20190309/18/ccpa.*06h.hrap.conus.gb2
/com2/ccpa/prod/ccpa.20190310/*/ccpa.*06h.hrap.conus.gb2
tar: Removing leading `/' from member names
/com2/ccpa/prod/ccpa.20190309/18/ccpa.t18z.06h.hrap.conus.gb2
/com2/ccpa/prod/ccpa.20190310/00/ccpa.t00z.06h.hrap.conus.gb2
/com2/ccpa/prod/ccpa.20190310/06/ccpa.t06z.06h.hrap.conus.gb2
/com2/ccpa/prod/ccpa.20190310/12/ccpa.t12z.06h.hrap.conus.gb2
Thanks again -
Ying
On 3/11/19 10:47 AM, George McCabe via RT wrote:
> Hi Ying,
>
> I was incorrect that you need to change the precision. %H should
find the
> time the way it is formatted. I think you will need to remove
OBS_LEVEL = 1
> from your config. This variable tells METplus to only look for 1 hr
> accumulation files to use in pcp_combine. If you remove this
variable, it
> should look for a 24 hr accumulation file and reduce the hour by 1
until it
> finds a file that it can use. If you want to force METplus to use 6
hour
> files to build the 24 hr accumulation, you should set OBS_LEVEL = 6.
Let me
> know if that helps.
>
> Thanks,
> George
>
> On Mon, Mar 11, 2019 at 8:30 AM George McCabe <mccabe at ucar.edu>
wrote:
>
>> Hi Ying,
>>
>> You may need to change %H to %.2H in the template to tell it that
there
>> will always be 2 digit precision. If that doesn't work, could you
send me
>> the directory listing so I can see what files are available?
>>
>> To pass in environment variables, use the following notation:
{ENV[vday]}.
>>
>> You are correct that using valid hour for the directory name will
not
>> work, as it will change the value to 03. If this value is going to
change
>> between runs and doesn't directly correspond to the valid time, you
may
>> have to trick it with environment variables to get it to work
correctly.
>>
>> On Thu, Mar 7, 2019 at 1:33 PM Ying Lin via RT <met_help at ucar.edu>
wrote:
>>
>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=89063 >
>>>
>>> Hi George,
>>>
>>> Thanks! That makes sense, though it didn't quite work out
for me.
>>> In the attached fv3gfs_24h_by_valid_time.conf, I have
>>> OBS_PCP_COMBINE_INPUT_DIR = /com2/ccpa/prod
>>> then
>>> OBS_PCP_COMBINE_INPUT_TEMPLATE =
>>>
>>>
ccpa.{valid?fmt=%Y%m%d}/{valid?fmt=%H}/ccpa.t{valid?fmt=%H}z.{level?fmt=%.2H}h.hrap.conus.gb2
>>>
>>> thinking that it would tell pcp_combine to look for e,g,
>>> /com2/ccpa/prod/ccpa.20190305/06/ccpa.t06z.06h.hrap.conus.gb2
>>>
>>> Instead I'm getting "WARNING: pcp_combine: Could not find files to
>>> compute accumulation in /com2/ccpa/prod" (in the attached test.out
and
>>> master_metplus.log.20190307).
>>>
>>> Could you tell what I'm doing wrong in the config?
>>>
>>> I'm doing the above in
Tide:/meso/save/Ying.Lin/metplus/test/.
>>>
>>> Also two related questions:
>>> 1) In the METplus model config files I've seen (like in the
attached
>>> config), the VALID_BEG and VALID_END are set in the config file.
Is
>>> there an easy way to set and export the VALID_* variable from a
script?
>>> For example I've tried "export vday=20190305" in the
test_fv3gfs_24h.ksh
>>> and in the config file set
>>> VALID_BEG = "${vday}"12 (same for VALID_END)
>>> and
>>> VALID_BEG = ${vday}12
>>> and
>>> VALID_BEG = {vday}12
>>> none of the above worked. What's the right way to do this?
>>>
>>> 2) In the CCPA directory of /com2/ccpa/prod/ccpa.20190305/06/, the
'06'
>>> subdir seems to contain all CCPA analysis files with valid times
from
>>> 01Z-06Z. So for 6h analysis, the '06' in the subdir is just the
valid
>>> hour. But if I do 3-hourly verification using the 3-hourly CCPA
files,
>>> the above directory also contains ccpa.t03z.03h.hrap.conus.gb2
(valid at
>>> 03Z) and ccpa.t06z.03h.hrap.conus.gb2 (valid at 06Z). In that case
i
>>> don't think the
>>>
>>>
ccpa.{valid?fmt=%Y%m%d}/{valid?fmt=%H}/ccpa.t{valid?fmt=%H}z.{level?fmt=%.2H}h.hrap.conus.gb2
>>> would work, would it?
>>>
>>> Thanks again,
>>>
>>> Ying
>>>
>>>
>>> On 3/6/19 10:29 AM, George McCabe via RT wrote:
>>>> Hi Ying Lin,
>>>>
>>>> You should be able to use a template that looks something like
this:
>>>>
>>>>
>>>
"ccpa.{valid?fmt=%Y%m%d}/06/ccpa.t{valid?fmt=%H}z.{level?fmt=%.2H}h.hrap.conus.gb2"
>>>> The 'level' item corresponds to the accumulation amount. %.2H
specifies
>>>> that the filename has 2 digits of precision for that value. I
wasn't
>>> sure
>>>> what the '06' subdirectory corresponds to, but if necessary you
can
>>>> substitute that with formatting so that it will be dynamic. Let
me know
>>> if
>>>> that doesn't work and I can help figure out what will.
>>>>
>>>> Thanks,
>>>> George
>>>>
>>>> On Mon, Feb 25, 2019 at 11:09 AM Ying Lin via RT
<met_help at ucar.edu>
>>> wrote:
>>>>> Mon Feb 25 11:08:35 2019: Request 89063 was acted upon.
>>>>> Transaction: Ticket created by ying.lin at noaa.gov
>>>>> Queue: met_help
>>>>> Subject: CCPA file name format for METplus
>>>>> Owner: Nobody
>>>>> Requestors: ying.lin at noaa.gov
>>>>> Status: new
>>>>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=89063
>>>>>
>>>>> Hello. I see that
>>>>>
>>>>>
>>>
https://github.com/NCAR/METplus/blob/master/parm/use_cases/grid_to_grid/examples/precip.conf
>>>>> has
>>>>> OBS_GRID_STAT_INPUT_TEMPLATE =
ccpa_conus_1.0d_{valid?fmt=%Y%m%d}
>>>>>
>>>>> CCPA output on wcoss has file names like
>>>>>
/com2/ccpa/prod/ccpa.20190224/06/ccpa.t03z.03h.hrap.conus.gb2
>>>>> which is 3h accumulation valid at 03Z 2019/02/24
>>>>> and ccpa.t06z.06h.hrap.conus.gb2
>>>>> which is 6h accumulation valid at 06Z 2019/02/24
>>>>>
>>>>> Does METplus already have the capability to handle the CCPA in
its
>>>>> 'native' directory/name format, as in the /com2/* directory
above? In
>>>>> my verif scripts I do
>>>>> cp $COMCCPA.$vday/06/ccpa.t03z.03h.hrap.conus.gb2
>>> ccpa.${vday}03.03h.gb2
>>>>> If METplus can already handle this bit of pre-processing, or if
this
>>> can
>>>>> be added to the wish list, that'll be great. Thanks!
>>>>>
>>>>> Ying
>>>>>
>>>>> --
>>>>> Ying Lin
>>>>> NCEP/EMC/Verification, Post-processing and Product Generation
Branch
>>>>> NCWCP Cubicle No. 2015
>>>>> Ying.Lin at noaa.gov
>>>>>
>>>>>
>>>>>
>>>>>
>>> --
>>> Ying Lin
>>> NCEP/EMC/Verification, Post-processing and Product Generation
Branch
>>> NCWCP Cubicle No. 2015
>>> Ying.Lin at noaa.gov
>>>
>>>
>>>
>>>
--
Ying Lin
NCEP/EMC/Verification, Post-processing and Product Generation Branch
NCWCP Cubicle No. 2015
Ying.Lin at noaa.gov
------------------------------------------------
Subject: CCPA file name format for METplus
From: Ying Lin
Time: Mon Mar 11 09:48:08 2019
# FV3GFS vs CCPA 24h FHO verif:
[config]
LOOP_BY_INIT = false
# Format of VALID_BEG and VALID_END
VALID_TIME_FMT = %Y%m%d%H
# the above VALID_TIME_FMT did not work when I set
# VALID_BEG=2019020112
# VALIC_END=2019020612
# Start time for MET+ run
VALID_BEG={ENV[vday]}12
# End time for MET+ run
VALID_END={ENV[vday]}12
# Increment between MET+ runs in seconds. Must be >= 60
# YL: 86400sec=24h
VALID_INCREMENT=86400
# List of forecast leads to process
#LEAD_SEQ = 24, 36, 48, 60, 72, 84
LEAD_SEQ = 24
# List of variables to compare
FCST_VAR1_NAME = APCP
FCST_VAR1_LEVELS = A24
FCST_VAR1_THRESH = 0.254,2.54,6.35,12.7,19.05,25.4,38.1,50.8,101.6
# Name to identify model data in output
MODEL_TYPE = FV3GFS
# Name to identify observation data in output
OB_TYPE = QPE
# Accumulation interval to compare
# Type of level to be used (GRIB only)
#LEVEL_TYPE=A
# Options are times, processes
# times = run all items in the PROCESS_LIST for a single
initialization
# time, then repeat until all times have been evaluated.
# processes = run each item in the PROCESS_LIST for all times
# specified, then repeat for the next item in the PROCESS_LIST.
LOOP_METHOD = times
# List of applications to run
PROCESS_LIST = PcpCombine, RegridDataPlane, GridStat
#FCST_PCP_COMBINE_RUN = False
OBS_PCP_COMBINE_RUN = True
OBS_REGRID_DATA_PLANE_RUN = True
# Used by regrid_data_plane to remap data
VERIFICATION_GRID={INPUT_BASE}/sample_fcst/2005080700/wrfprs_ruc13_12.tm00_G212
# Location of grid_stat config file
# GRID_STAT_CONFIG = {CONFIG_DIR}/GridStatConfig_MEAN
GRID_STAT_CONFIG = {METPLUS_BASE}/parm/ylin.GridStatConfig.CTC
# QPF Model Options:
# Accumulation available in forecast files
FCST_LEVEL = 1
# Descriptions of forecast data -- These will not change between runs
# Forecast hours that are available
FCST_MAX_FORECAST = 84
# Interval (in hours) between initialization times of data
FCST_INIT_INTERVAL = 12
# Set to true if evaluating probability
FCST_IS_PROB = false
# Set to true if data is only available once per day
FCST_IS_DAILY_FILE = false
# File format. Options are GRIB or NETCDF
FCST_NATIVE_DATA_TYPE = GRIB
# QPE Grib Observation Data Parameters
# File format. Options are GRIB or NETCDF
OBS_NATIVE_DATA_TYPE = GRIB
# Set to true if data is only available once per day
OBS_IS_DAILY_FILE = false
# Accumulation interval available in observation data
OBS_LEVEL = 6
[dir]
CONFIG_DIR={PARM_BASE}/use_cases/qpf/met_config
#FCST_GRID_STAT_INPUT_DIR = {INPUT_BASE}/sample_fcst
FCST_GRID_STAT_INPUT_DIR = /gpfs/dell1/nco/ops/com/gfs/para
OBS_PCP_COMBINE_INPUT_DIR = /com2/ccpa/prod
OBS_PCP_COMBINE_OUTPUT_DIR = {OUTPUT_BASE}/qpe_grib/bucket
OBS_REGRID_DATA_PLANE_INPUT_DIR = {OUTPUT_BASE}/qpe_grib/bucket
OBS_REGRID_DATA_PLANE_OUTPUT_DIR = {OUTPUT_BASE}/qpe_grib/regrid
OBS_GRID_STAT_INPUT_DIR = {OUTPUT_BASE}/qpe_grib/regrid
GRID_STAT_OUT_DIR = {OUTPUT_BASE}/met_out/{MODEL_TYPE}
[filename_templates]
# QPF (Forecast)
FCST_GRID_STAT_INPUT_TEMPLATE =
gfs.{init?fmt=%Y%m%d}/{init?fmt=%H}/gfs.t{init?fmt=%H}z.pgrb2.0p25.f{lead?fmt=%HHH}
# QPE (Observation)
#OBS_PCP_COMBINE_INPUT_TEMPLATE =
ccpa.{valid?fmt=%Y%m%d}/{valid?fmt=%H}/ccpa.t{valid?fmt=%H}z.{level?fmt=%.2H}h.hrap.conus.gb2
OBS_PCP_COMBINE_INPUT_TEMPLATE =
ccpa.{valid?fmt=%Y%m%d}/{valid?fmt=%H}/ccpa.t{valid?fmt=%H}z.06h.hrap.conus.gb2
OBS_PCP_COMBINE_OUTPUT_TEMPLATE =
{valid?fmt=%Y%m%d}/ccpa.{valid?fmt=%Y%m%d%H}_A{level?fmt=%HH}h
OBS_REGRID_DATA_PLANE_TEMPLATE =
{valid?fmt=%Y%m%d}/ccpa.{valid?fmt=%Y%m%d%H}_A{level?fmt=%HH}h.g212
OBS_GRID_STAT_INPUT_TEMPLATE =
{valid?fmt=%Y%m%d}/ccpa.{valid?fmt=%Y%m%d%H}_A{level?fmt=%HH}h.g212
------------------------------------------------
Subject: CCPA file name format for METplus
From: Ying Lin
Time: Mon Mar 11 09:48:08 2019
03/11 15:31:43.679 metplus.GridStat (master_metplus.py:142) INFO:
****************************************
03/11 15:31:43.679 metplus.GridStat (master_metplus.py:143) INFO: *
RUNNING MET+
03/11 15:31:43.679 metplus.GridStat (master_metplus.py:147) INFO: *
at valid time: 201903101200
03/11 15:31:43.679 metplus.GridStat (master_metplus.py:148) INFO:
****************************************
03/11 15:31:43.687 metplus.PcpCombine (pcp_combine_wrapper.py:597)
WARNING: pcp_combine: Could not find files to compute accumulation in
/com2/ccpa/prod
03/11 15:31:43.688 metplus.PcpCombine (pcp_combine_wrapper.py:442)
INFO:
03/11 15:31:43.688 metplus.PcpCombine (pcp_combine_wrapper.py:382)
ERROR: No input filenames specified
03/11 15:31:43.690 metplus.RegridDataPlane
(regrid_data_plane_wrapper.py:89) INFO:
03/11 15:31:43.690 metplus.RegridDataPlane (command_runner.py:220)
DEBUG: LOG_MET_OUTPUT_TO_METPLUS log file is True
03/11 15:31:43.692 metplus.RegridDataPlane (command_runner.py:119)
INFO: app_name is: regrid_data_plane, output sent to:
/meso/noscrub/Ying.Lin/metplus.out/logs/master_metplus.log.20190311
03/11 15:31:43.879 metplus.RegridDataPlane (command_runner.py:155)
INFO: RUNNING:
/global/noscrub/Julie.Prestopnik/met/8.0/bin/regrid_data_plane -v 5
-field "name=\"APCP_24\"; level=\"(*,*)\";" -method BUDGET -width 2
-name APCP_24
/meso/noscrub/Ying.Lin/metplus.out/qpe_grib/bucket/20190310/ccpa.2019031012_A24h.g212
/global/noscrub/Julie.Prestopnik/METplus/METplus-
2.0_sample_data/sample_fcst/2005080700/wrfprs_ruc13_12.tm00_G212
/meso/noscrub/Ying.Lin/metplus.out/qpe_grib/regrid/20190310/ccpa.2019031012_A24h.g212
>> /meso/noscrub/Ying.Lin/metplus.out/logs/master_metplus.log.20190311
2>&1
03/11 15:31:43.879 metplus.RegridDataPlane (command_runner.py:156)
DEBUG: RUNNING
exe('/global/noscrub/Julie.Prestopnik/met/8.0/bin/regrid_data_plane')['-
v','5','-field','name="APCP_24"; level="(*,*)";','-method','BUDGET','-
width','2','-
name','APCP_24','/meso/noscrub/Ying.Lin/metplus.out/qpe_grib/bucket/20190310/ccpa.2019031012_A24h.g212','/global/noscrub/Julie.Prestopnik/METplus/METplus-
2.0_sample_data/sample_fcst/2005080700/wrfprs_ruc13_12.tm00_G212','/meso/noscrub/Ying.Lin/metplus.out/qpe_grib/regrid/20190310/ccpa.2019031012_A24h.g212'].out('/meso/noscrub/Ying.Lin/metplus.out/logs/master_metplus.log.20190311',append=True).err2out()
DEBUG 1: Reading data file:
/meso/noscrub/Ying.Lin/metplus.out/qpe_grib/bucket/20190310/ccpa.2019031012_A24h.g212
ERROR :
ERROR : grd_file_type() -> file does not exist
"/meso/noscrub/Ying.Lin/metplus.out/qpe_grib/bucket/20190310/ccpa.2019031012_A24h.g212"
ERROR :
03/11 15:31:44.799 metplus.GridStat (compare_gridded_wrapper.py:344)
DEBUG:
03/11 15:31:44.799 metplus.GridStat (compare_gridded_wrapper.py:345)
DEBUG: ENVIRONMENT FOR NEXT COMMAND:
03/11 15:31:44.799 metplus.GridStat (command_builder.py:146) DEBUG:
MODEL=FV3GFS
03/11 15:31:44.799 metplus.GridStat (command_builder.py:146) DEBUG:
FCST_VAR=APCP
03/11 15:31:44.799 metplus.GridStat (command_builder.py:146) DEBUG:
OBS_VAR=APCP
03/11 15:31:44.800 metplus.GridStat (command_builder.py:146) DEBUG:
LEVEL=A24
03/11 15:31:44.800 metplus.GridStat (command_builder.py:146) DEBUG:
OBTYPE=QPE
03/11 15:31:44.800 metplus.GridStat (command_builder.py:146) DEBUG:
CONFIG_DIR=/meso/save/Ying.Lin/metplus//parm/use_cases/qpf/met_config
03/11 15:31:44.800 metplus.GridStat (command_builder.py:146) DEBUG:
FCST_FIELD={ name="APCP"; level="[A24]"; cat_thresh=[ gt0.254, gt2.54,
gt6.35, gt12.7, gt19.05, gt25.4, gt38.1, gt50.8, gt101.6 ]; }
03/11 15:31:44.800 metplus.GridStat (command_builder.py:146) DEBUG:
OBS_FIELD={ name="APCP"; level="[A24]"; cat_thresh=[ gt0.254, gt2.54,
gt6.35, gt12.7, gt19.05, gt25.4, gt38.1, gt50.8, gt101.6 ]; }
03/11 15:31:44.800 metplus.GridStat (command_builder.py:146) DEBUG:
INPUT_BASE=/global/noscrub/Julie.Prestopnik/METplus/METplus-
2.0_sample_data
03/11 15:31:44.800 metplus.GridStat (command_builder.py:146) DEBUG:
MET_VALID_HHMM=0310
03/11 15:31:44.800 metplus.GridStat (compare_gridded_wrapper.py:356)
DEBUG:
03/11 15:31:44.801 metplus.GridStat (compare_gridded_wrapper.py:357)
DEBUG: COPYABLE ENVIRONMENT FOR NEXT COMMAND:
03/11 15:31:44.801 metplus.GridStat (command_builder.py:141) DEBUG:
export MODEL=FV3GFS; export FCST_VAR=APCP; export OBS_VAR=APCP; export
LEVEL=A24; export OBTYPE=QPE; export
CONFIG_DIR=/meso/save/Ying.Lin/metplus//parm/use_cases/qpf/met_config;
export FCST_FIELD="{ name=\"APCP\"; level=\"[A24]\"; cat_thresh=[
gt0.254, gt2.54, gt6.35, gt12.7, gt19.05, gt25.4, gt38.1, gt50.8,
gt101.6 ]; }"; export OBS_FIELD="{ name=\"APCP\"; level=\"[A24]\";
cat_thresh=[ gt0.254, gt2.54, gt6.35, gt12.7, gt19.05, gt25.4, gt38.1,
gt50.8, gt101.6 ]; }"; export
INPUT_BASE=/global/noscrub/Julie.Prestopnik/METplus/METplus-
2.0_sample_data; export MET_VALID_HHMM=0310;
03/11 15:31:44.801 metplus.GridStat (compare_gridded_wrapper.py:363)
DEBUG:
03/11 15:31:44.801 metplus.GridStat (compare_gridded_wrapper.py:369)
INFO:
03/11 15:31:44.801 metplus.GridStat (command_runner.py:220) DEBUG:
LOG_MET_OUTPUT_TO_METPLUS log file is True
03/11 15:31:44.802 metplus.GridStat (command_runner.py:119) INFO:
app_name is: grid_stat, output sent to:
/meso/noscrub/Ying.Lin/metplus.out/logs/master_metplus.log.20190311
03/11 15:31:44.803 metplus.GridStat (command_runner.py:155) INFO:
RUNNING: /global/noscrub/Julie.Prestopnik/met/8.0/bin/grid_stat
/gpfs/dell1/nco/ops/com/gfs/para/gfs.20190309/12/gfs.t12z.pgrb2.0p25.f024
/meso/noscrub/Ying.Lin/metplus.out/qpe_grib/regrid/20190310/ccpa.2019031012_A24h.g212
/meso/save/Ying.Lin/metplus//parm/ylin.GridStatConfig.CTC -outdir
/meso/noscrub/Ying.Lin/metplus.out/met_out/FV3GFS/201903101200/grid_stat
>> /meso/noscrub/Ying.Lin/metplus.out/logs/master_metplus.log.20190311
2>&1
03/11 15:31:44.803 metplus.GridStat (command_runner.py:156) DEBUG:
RUNNING
exe('/global/noscrub/Julie.Prestopnik/met/8.0/bin/grid_stat')['/gpfs/dell1/nco/ops/com/gfs/para/gfs.20190309/12/gfs.t12z.pgrb2.0p25.f024','/meso/noscrub/Ying.Lin/metplus.out/qpe_grib/regrid/20190310/ccpa.2019031012_A24h.g212','/meso/save/Ying.Lin/metplus//parm/ylin.GridStatConfig.CTC','-
outdir','/meso/noscrub/Ying.Lin/metplus.out/met_out/FV3GFS/201903101200/grid_stat'].out('/meso/noscrub/Ying.Lin/metplus.out/logs/master_metplus.log.20190311',append=True).err2out()
DEBUG 1: Default Config File:
/global/noscrub/Julie.Prestopnik/met/8.0/share/met/config/GridStatConfig_default
DEBUG 1: User Config File:
/meso/save/Ying.Lin/metplus//parm/ylin.GridStatConfig.CTC
ERROR :
ERROR : grd_file_type() -> file does not exist
"/meso/noscrub/Ying.Lin/metplus.out/qpe_grib/regrid/20190310/ccpa.2019031012_A24h.g212"
ERROR :
------------------------------------------------
Subject: CCPA file name format for METplus
From: Ying Lin
Time: Mon Mar 11 09:48:08 2019
+ . /u/Ying.Lin/dot.for.metplus
+ . /usrx/local/Modules/default/init/ksh
+ [ 3.2.10 '=' '' ]
+ MODULE_VERSION_STACK=3.2.10
+ export MODULE_VERSION_STACK
+ MODULESHOME=/usrx/local/Modules/3.2.10
+ export MODULESHOME
+ [
EnvVars/1.0.1:ibmpe/1.3.0.12:lsf/9.1:ics/12.1:anaconda2/latest:hpss/4.0.1.2:GrADS/2.0.2:HDF5/1.8.9/serial:NetCDF/4.2/serial
'=' '' ]
+ [
'/usrx/local/Modules/versions:/usrx/local/Modules/$MODULE_VERSION/modulefiles:/usrx/local/modulefiles:/nwprod2/modulefiles:/nwprod2/lib/modulefiles:/nwprod/lib/modulefiles:/u/Benjamin.Blake/modulefiles'
'=' '' ]
+ module purge
+ /usrx/local/Modules/3.2.10/bin/modulecmd ksh purge
+ eval MANPATH=/usr/share/man ';export'
'MANPATH;PATH=.:/nwprod/gempak/nawips/os/linux2.6.32_x86_64/bin:/usr/lib64/qt-
3.3/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/opt/ibutils/bin:/nwprod/util/exec::/nwprod/util/ush::/u/Wesley.Ebisuzaki/bin:/u/Ying.Lin/bin:/nwprod/gempak/nawips/bin:/nwprod/gempak/nawips/scripts/ez:/nwprod/gempak/nawips/scripts/nawips:/nwprod/gempak/nawips/scripts/prnt:/nwprod/gempak/nawips/scripts/decoder:/sss/emc/meso/shared/Eric.Rogers/ddapp/exe_lnx6:/sss/emc/meso/shared/Eric.Rogers/vsdb/scripts'
';export' 'PATH;unset' 'CLASSPATH;unset' 'CPATH;unset'
'CPRO_PATH;unset' 'FPATH;unset' 'GADDIR;unset' 'GrADS_ROOT;unset'
'HDF5;unset' 'HDF5_CFLAGS;unset' 'HDF5_CXXFLAGS;unset'
'HDF5_FFLAGS;unset' 'HDF5_INCLUDE;unset' 'HDF5_LDFLAGS;unset'
'HDF5_LDFLAGS_C;unset' 'HDF5_LDFLAGS_CXX;unset' 'HDF5_LDFLAGS_F;unset'
'IDB_HOME;unset' 'INCLUDE;unset' 'INSTALL_DIR;unset'
'INTEL_LICENSE_FILE;unset' 'IPPROOT;unset' 'I_MPI_INC;unset'
'I_MPI_ROOT;unset' 'LANG;unset' 'LAUNCH;unset' 'LD_LIBRARY_PATH;unset'
'LIBRARY_PATH;unset' 'LOADEDMODULES;unset' 'LSF_BINDIR;unset'
'LSF_ENVDIR;unset' 'LSF_LIBDIR;unset' 'LSF_SERVERDIR;unset'
'MKLROOT;unset' 'MKL_TARGET_ARCH;unset' 'MP_CLOCK_SOURCE;unset'
'MP_COMPILER;unset' 'MP_CONFIG;unset' 'MP_EUILIB;unset'
'MP_MPILIB;unset' 'NETCDF;unset' 'NETCDF_CFLAGS;unset'
'NETCDF_CXXFLAGS;unset' 'NETCDF_FFLAGS;unset' 'NETCDF_INCLUDE;unset'
'NETCDF_LDFLAGS;unset' 'NETCDF_LDFLAGS_C;unset'
'NETCDF_LDFLAGS_CXX;unset' 'NETCDF_LDFLAGS_F;unset' 'NLSPATH;unset'
'OMP_NUM_THREADS;unset' 'PROD_DIR;unset' 'PYTHONPATH;unset'
'SITE;unset' 'TBBROOT;unset' 'VT_LIB_DIR;unset' 'VT_ROOT;unset'
'VT_SLIB_DIR;unset' 'XLSF_UIDDIR;unset' '_LMFILES_;'
+ MANPATH=/usr/share/man
+ export MANPATH
+
PATH=.:/nwprod/gempak/nawips/os/linux2.6.32_x86_64/bin:/usr/lib64/qt-
3.3/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/opt/ibutils/bin:/nwprod/util/exec::/nwprod/util/ush::/u/Wesley.Ebisuzaki/bin:/u/Ying.Lin/bin:/nwprod/gempak/nawips/bin:/nwprod/gempak/nawips/scripts/ez:/nwprod/gempak/nawips/scripts/nawips:/nwprod/gempak/nawips/scripts/prnt:/nwprod/gempak/nawips/scripts/decoder:/sss/emc/meso/shared/Eric.Rogers/ddapp/exe_lnx6:/sss/emc/meso/shared/Eric.Rogers/vsdb/scripts
+ export PATH
+ unset CLASSPATH
+ unset CPATH
+ unset CPRO_PATH
+ unset FPATH
+ unset GADDIR
+ unset GrADS_ROOT
+ unset HDF5
+ unset HDF5_CFLAGS
+ unset HDF5_CXXFLAGS
+ unset HDF5_FFLAGS
+ unset HDF5_INCLUDE
+ unset HDF5_LDFLAGS
+ unset HDF5_LDFLAGS_C
+ unset HDF5_LDFLAGS_CXX
+ unset HDF5_LDFLAGS_F
+ unset IDB_HOME
+ unset INCLUDE
+ unset INSTALL_DIR
+ unset INTEL_LICENSE_FILE
+ unset IPPROOT
+ unset I_MPI_INC
+ unset I_MPI_ROOT
+ unset LANG
+ unset LAUNCH
+ unset LD_LIBRARY_PATH
+ unset LIBRARY_PATH
+ unset LOADEDMODULES
+ unset LSF_BINDIR
+ unset LSF_ENVDIR
+ unset LSF_LIBDIR
+ unset LSF_SERVERDIR
+ unset MKLROOT
+ unset MKL_TARGET_ARCH
+ unset MP_CLOCK_SOURCE
+ unset MP_COMPILER
+ unset MP_CONFIG
+ unset MP_EUILIB
+ unset MP_MPILIB
+ unset NETCDF
+ unset NETCDF_CFLAGS
+ unset NETCDF_CXXFLAGS
+ unset NETCDF_FFLAGS
+ unset NETCDF_INCLUDE
+ unset NETCDF_LDFLAGS
+ unset NETCDF_LDFLAGS_C
+ unset NETCDF_LDFLAGS_CXX
+ unset NETCDF_LDFLAGS_F
+ unset NLSPATH
+ unset OMP_NUM_THREADS
+ unset PROD_DIR
+ unset PYTHONPATH
+ unset SITE
+ unset TBBROOT
+ unset VT_LIB_DIR
+ unset VT_ROOT
+ unset VT_SLIB_DIR
+ unset XLSF_UIDDIR
+ unset _LMFILES_
+ module use /global/noscrub/Julie.Prestopnik/modulefiles
+ /usrx/local/Modules/3.2.10/bin/modulecmd ksh use
/global/noscrub/Julie.Prestopnik/modulefiles
+ eval
MODULEPATH='/global/noscrub/Julie.Prestopnik/modulefiles:/usrx/local/Modules/versions:/usrx/local/Modules/\$MODULE_VERSION/modulefiles:/usrx/local/modulefiles:/nwprod2/modulefiles:/nwprod2/lib/modulefiles:/nwprod/lib/modulefiles:/u/Benjamin.Blake/modulefiles'
';export' 'MODULEPATH;'
+
MODULEPATH='/global/noscrub/Julie.Prestopnik/modulefiles:/usrx/local/Modules/versions:/usrx/local/Modules/$MODULE_VERSION/modulefiles:/usrx/local/modulefiles:/nwprod2/modulefiles:/nwprod2/lib/modulefiles:/nwprod/lib/modulefiles:/u/Benjamin.Blake/modulefiles'
+ export MODULEPATH
+ module load met/8.0
+ /usrx/local/Modules/3.2.10/bin/modulecmd ksh load met/8.0
+ eval ADVISOR_XE_2015_DIR=/usrx/local/intel/2015/advisor_xe_2015
';export' 'ADVISOR_XE_2015_DIR;BIN_DIR=bin64' ';export'
'BIN_DIR;CLASSPATH=/usrx/local/intel/2015/itac_latest/lib' ';export'
'CLASSPATH;CPATH=/usrx/local/intel/2015/ipp/include:/usrx/local/intel/2015/mkl/include:/usrx/local/intel/2015/tbb/include'
';export'
'CPATH;CPRO_PATH=/usrx/local/intel/2015/composer_xe_2015.3.187'
';export'
'CPRO_PATH;GDBSERVER_MIC=/usrx/local/intel/2015/composerxe/debugger/gdb/target/mic/bin/gdbserver'
';export'
'GDBSERVER_MIC;GDB_CROSS=/usrx/local/intel/2015/composerxe/debugger/gdb/intel64_mic/bin/gdb-
mic' ';export' 'GDB_CROSS;INCLUDE=/usrx/local/intel/2015/mkl/include'
';export'
'INCLUDE;INFOPATH=/usrx/local/intel/2015/composerxe/debugger/gdb/intel64/share/info:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64_mic/share/info'
';export'
'INFOPATH;INSPECTOR_2015_DIR=/usrx/local/intel/2015/inspector_xe_2015'
';export'
'INSPECTOR_2015_DIR;INTEL_LICENSE_FILE=/usrx/local/intel/licenses'
';export'
'INTEL_LICENSE_FILE;INTEL_PYTHONHOME=/usrx/local/intel/2015/composerxe/debugger/python/intel64'
';export' 'INTEL_PYTHONHOME;IPPROOT=/usrx/local/intel/2015/ipp'
';export' 'IPPROOT;I_MPI_HYDRA_IFACE=ib0' ';export'
'I_MPI_HYDRA_IFACE;I_MPI_INC=/usrx/local/intel/2015/impi_latest/include64'
';export' 'I_MPI_INC;I_MPI_ROOT=/usrx/local/intel/2015/impi_latest'
';export' 'I_MPI_ROOT;LANGUAGE_TERRITORY=en_US' ';export'
'LANGUAGE_TERRITORY;LD_LIBRARY_PATH=/global/noscrub/Julie.Prestopnik/met/8.0/external_libs/lib:/usrx/local/dev/python/2.7.14/lib:/usrx/local/intel/2015/impi_latest/intel64/lib:/usrx/local/intel/2015/itac_latest/mic/slib:/usrx/local/intel/2015/itac_latest/intel64/slib:/usrx/local/intel/2015/composerxe/lib/intel64:/usrx/local/intel/2015/mpirt/lib/intel64:/usrx/local/intel/2015/ipp/lib/intel64:/usrx/local/intel/2015/mkl/lib/intel64:/usrx/local/intel/2015/tbb/lib/intel64/gcc4.4'
';export'
'LD_LIBRARY_PATH;LIBRARY_PATH=/usrx/local/intel/2015/composerxe/lib/intel64:/usrx/local/intel/2015/ipp/lib/intel64:/usrx/local/intel/2015/mkl/lib/intel64:/usrx/local/intel/2015/tbb/lib/intel64/gcc4.4'
';export'
'LIBRARY_PATH;LOADEDMODULES=ics/15.0.3:python/2.7.14:met/8.0'
';export'
'LOADEDMODULES;MANPATH=/usrx/local/dev/python/2.7.14/share/man:/usrx/local/intel/2015/impi_latest/man:/usrx/local/intel/2015/itac_latest/man:/usrx/local/intel/2015/composerxe/man/en_US:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64/share/man:/usr/share/man:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64_mic/share/man:/usrx/local/intel/2015/inspector_xe_2015/man:/usrx/local/intel/2015/vtune_amplifier_xe_2015/man:/usrx/local/intel/2015/advisor_xe_2015/man'
';export'
'MANPATH;MIC_LD_LIBRARY_PATH=/usrx/local/intel/2015/composerxe/lib/mic:/usrx/local/intel/2015/mpirt/lib/mic:/usrx/local/intel/2015/mkl/lib/mic:/usrx/local/intel/2015/tbb/lib/mic'
';export'
'MIC_LD_LIBRARY_PATH;MIC_LIBRARY_PATH=/usrx/local/intel/2015/composerxe/lib/mic:/usrx/local/intel/2015/mpirt/lib/mic:/usrx/local/intel/2015/tbb/lib/mic'
';export' 'MIC_LIBRARY_PATH;MKLROOT=/usrx/local/intel/2015/mkl'
';export'
'MKLROOT;MODULEPATH=/usrx/local/dev/modulefiles:/global/noscrub/Julie.Prestopnik/modulefiles:/usrx/local/Modules/versions:/usrx/local/Modules/\$MODULE_VERSION/modulefiles:/usrx/local/modulefiles:/nwprod2/modulefiles:/nwprod2/lib/modulefiles:/nwprod/lib/modulefiles:/u/Benjamin.Blake/modulefiles'
';export'
'MODULEPATH;MPM_LAUNCHER=/usrx/local/intel/2015/composerxe/debugger/mpm/bin/start_mpm.sh'
';export'
'MPM_LAUNCHER;NLSPATH=/usrx/local/intel/2015/composerxe/lib/intel64/locale/%l_%t/%N:/usrx/local/intel/2015/ipp/lib/intel64/locale/%l_%t/%N:/usrx/local/intel/2015/mkl/lib/intel64/locale/%l_%t/%N:/usrx/local/intel/2015/composer_xe_2015.3.187/debugger/gdb/intel64_mic/share/locale/%l_%t/%N:/usrx/local/intel/2015/composer_xe_2015.3.187/debugger/gdb/intel64/share/locale/%l_%t/%N'
';export'
'NLSPATH;PATH=/global/noscrub/Julie.Prestopnik/met/8.0//bin:/global/noscrub/Julie.Prestopnik/met/8.0/external_libs/bin:/usrx/local/dev/python/2.7.14/bin:/usrx/local/intel/2015/advisor_xe_2015/bin64:/usrx/local/intel/2015/vtune_amplifier_xe_2015/bin64:/usrx/local/intel/2015/inspector_xe_2015/bin64:/usrx/local/intel/2015/impi_latest/intel64/bin:/usrx/local/intel/2015/itac_latest/intel64/bin:/usrx/local/intel/2015/composer_xe_2015.3.187/bin/intel64:/usrx/local/intel/2015/mpirt/bin/intel64:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64_mic/bin:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64/bin:.:/nwprod/gempak/nawips/os/linux2.6.32_x86_64/bin:/usr/lib64/qt-
3.3/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/opt/ibutils/bin:/nwprod/util/exec::/nwprod/util/ush::/u/Wesley.Ebisuzaki/bin:/u/Ying.Lin/bin:/nwprod/gempak/nawips/bin:/nwprod/gempak/nawips/scripts/ez:/nwprod/gempak/nawips/scripts/nawips:/nwprod/gempak/nawips/scripts/prnt:/nwprod/gempak/nawips/scripts/decoder:/sss/emc/meso/shared/Eric.Rogers/ddapp/exe_lnx6:/sss/emc/meso/shared/Eric.Rogers/vsdb/scripts'
';export' 'PATH;PROD_DIR=/usrx/local/intel/2015/composerxe' ';export'
'PROD_DIR;ROOTPATH=/usrx/local/intel/2015' ';export'
'ROOTPATH;SCRIPTPATH=/usrx/local/intel/2015' ';export'
'SCRIPTPATH;TBBROOT=/usrx/local/intel/2015/tbb' ';export'
'TBBROOT;VTUNE_AMPLIFIER_XE_2015_DIR=/usrx/local/intel/2015/vtune_amplifier_xe_2015'
';export' 'VTUNE_AMPLIFIER_XE_2015_DIR;VT_ADD_LIBS=-ldwarf\' '-lelf\'
'-lvtunwind\' '-lnsl\' '-lm\' '-ldl\' -lpthread ';export'
'VT_ADD_LIBS;VT_ARCH=intel64' ';export'
'VT_ARCH;VT_LIB_DIR=/usrx/local/intel/2015/itac_latest/lib' ';export'
'VT_LIB_DIR;VT_MIC_SLIB_DIR=/usrx/local/intel/2015/itac_latest/mic/slib'
';export' 'VT_MIC_SLIB_DIR;VT_MPI=impi4' ';export'
'VT_MPI;VT_ROOT=/usrx/local/intel/2015/itac_latest' ';export'
'VT_ROOT;VT_SLIB_DIR=/usrx/local/intel/2015/itac_latest/intel64/slib'
';export'
'VT_SLIB_DIR;_LMFILES_=/usrx/local/modulefiles/ics/15.0.3:/usrx/local/dev/modulefiles/python/2.7.14:/global/noscrub/Julie.Prestopnik/modulefiles/met/8.0'
';export' '_LMFILES_;'
+ ADVISOR_XE_2015_DIR=/usrx/local/intel/2015/advisor_xe_2015
+ export ADVISOR_XE_2015_DIR
+ BIN_DIR=bin64
+ export BIN_DIR
+ CLASSPATH=/usrx/local/intel/2015/itac_latest/lib
+ export CLASSPATH
+
CPATH=/usrx/local/intel/2015/ipp/include:/usrx/local/intel/2015/mkl/include:/usrx/local/intel/2015/tbb/include
+ export CPATH
+ CPRO_PATH=/usrx/local/intel/2015/composer_xe_2015.3.187
+ export CPRO_PATH
+
GDBSERVER_MIC=/usrx/local/intel/2015/composerxe/debugger/gdb/target/mic/bin/gdbserver
+ export GDBSERVER_MIC
+
GDB_CROSS=/usrx/local/intel/2015/composerxe/debugger/gdb/intel64_mic/bin/gdb-
mic
+ export GDB_CROSS
+ INCLUDE=/usrx/local/intel/2015/mkl/include
+ export INCLUDE
+
INFOPATH=/usrx/local/intel/2015/composerxe/debugger/gdb/intel64/share/info:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64_mic/share/info
+ export INFOPATH
+ INSPECTOR_2015_DIR=/usrx/local/intel/2015/inspector_xe_2015
+ export INSPECTOR_2015_DIR
+ INTEL_LICENSE_FILE=/usrx/local/intel/licenses
+ export INTEL_LICENSE_FILE
+
INTEL_PYTHONHOME=/usrx/local/intel/2015/composerxe/debugger/python/intel64
+ export INTEL_PYTHONHOME
+ IPPROOT=/usrx/local/intel/2015/ipp
+ export IPPROOT
+ I_MPI_HYDRA_IFACE=ib0
+ export I_MPI_HYDRA_IFACE
+ I_MPI_INC=/usrx/local/intel/2015/impi_latest/include64
+ export I_MPI_INC
+ I_MPI_ROOT=/usrx/local/intel/2015/impi_latest
+ export I_MPI_ROOT
+ LANGUAGE_TERRITORY=en_US
+ export LANGUAGE_TERRITORY
+
LD_LIBRARY_PATH=/global/noscrub/Julie.Prestopnik/met/8.0/external_libs/lib:/usrx/local/dev/python/2.7.14/lib:/usrx/local/intel/2015/impi_latest/intel64/lib:/usrx/local/intel/2015/itac_latest/mic/slib:/usrx/local/intel/2015/itac_latest/intel64/slib:/usrx/local/intel/2015/composerxe/lib/intel64:/usrx/local/intel/2015/mpirt/lib/intel64:/usrx/local/intel/2015/ipp/lib/intel64:/usrx/local/intel/2015/mkl/lib/intel64:/usrx/local/intel/2015/tbb/lib/intel64/gcc4.4
+ export LD_LIBRARY_PATH
+
LIBRARY_PATH=/usrx/local/intel/2015/composerxe/lib/intel64:/usrx/local/intel/2015/ipp/lib/intel64:/usrx/local/intel/2015/mkl/lib/intel64:/usrx/local/intel/2015/tbb/lib/intel64/gcc4.4
+ export LIBRARY_PATH
+ LOADEDMODULES=ics/15.0.3:python/2.7.14:met/8.0
+ export LOADEDMODULES
+
MANPATH=/usrx/local/dev/python/2.7.14/share/man:/usrx/local/intel/2015/impi_latest/man:/usrx/local/intel/2015/itac_latest/man:/usrx/local/intel/2015/composerxe/man/en_US:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64/share/man:/usr/share/man:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64_mic/share/man:/usrx/local/intel/2015/inspector_xe_2015/man:/usrx/local/intel/2015/vtune_amplifier_xe_2015/man:/usrx/local/intel/2015/advisor_xe_2015/man
+ export MANPATH
+
MIC_LD_LIBRARY_PATH=/usrx/local/intel/2015/composerxe/lib/mic:/usrx/local/intel/2015/mpirt/lib/mic:/usrx/local/intel/2015/mkl/lib/mic:/usrx/local/intel/2015/tbb/lib/mic
+ export MIC_LD_LIBRARY_PATH
+
MIC_LIBRARY_PATH=/usrx/local/intel/2015/composerxe/lib/mic:/usrx/local/intel/2015/mpirt/lib/mic:/usrx/local/intel/2015/tbb/lib/mic
+ export MIC_LIBRARY_PATH
+ MKLROOT=/usrx/local/intel/2015/mkl
+ export MKLROOT
+
MODULEPATH='/usrx/local/dev/modulefiles:/global/noscrub/Julie.Prestopnik/modulefiles:/usrx/local/Modules/versions:/usrx/local/Modules/$MODULE_VERSION/modulefiles:/usrx/local/modulefiles:/nwprod2/modulefiles:/nwprod2/lib/modulefiles:/nwprod/lib/modulefiles:/u/Benjamin.Blake/modulefiles'
+ export MODULEPATH
+
MPM_LAUNCHER=/usrx/local/intel/2015/composerxe/debugger/mpm/bin/start_mpm.sh
+ export MPM_LAUNCHER
+
NLSPATH=/usrx/local/intel/2015/composerxe/lib/intel64/locale/%l_%t/%N:/usrx/local/intel/2015/ipp/lib/intel64/locale/%l_%t/%N:/usrx/local/intel/2015/mkl/lib/intel64/locale/%l_%t/%N:/usrx/local/intel/2015/composer_xe_2015.3.187/debugger/gdb/intel64_mic/share/locale/%l_%t/%N:/usrx/local/intel/2015/composer_xe_2015.3.187/debugger/gdb/intel64/share/locale/%l_%t/%N
+ export NLSPATH
+
PATH=/global/noscrub/Julie.Prestopnik/met/8.0//bin:/global/noscrub/Julie.Prestopnik/met/8.0/external_libs/bin:/usrx/local/dev/python/2.7.14/bin:/usrx/local/intel/2015/advisor_xe_2015/bin64:/usrx/local/intel/2015/vtune_amplifier_xe_2015/bin64:/usrx/local/intel/2015/inspector_xe_2015/bin64:/usrx/local/intel/2015/impi_latest/intel64/bin:/usrx/local/intel/2015/itac_latest/intel64/bin:/usrx/local/intel/2015/composer_xe_2015.3.187/bin/intel64:/usrx/local/intel/2015/mpirt/bin/intel64:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64_mic/bin:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64/bin:.:/nwprod/gempak/nawips/os/linux2.6.32_x86_64/bin:/usr/lib64/qt-
3.3/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/opt/ibutils/bin:/nwprod/util/exec::/nwprod/util/ush::/u/Wesley.Ebisuzaki/bin:/u/Ying.Lin/bin:/nwprod/gempak/nawips/bin:/nwprod/gempak/nawips/scripts/ez:/nwprod/gempak/nawips/scripts/nawips:/nwprod/gempak/nawips/scripts/prnt:/nwprod/gempak/nawips/scripts/decoder:/sss/emc/meso/shared/Eric.Rogers/ddapp/exe_lnx6:/sss/emc/meso/shared/Eric.Rogers/vsdb/scripts
+ export PATH
+ PROD_DIR=/usrx/local/intel/2015/composerxe
+ export PROD_DIR
+ ROOTPATH=/usrx/local/intel/2015
+ export ROOTPATH
+ SCRIPTPATH=/usrx/local/intel/2015
+ export SCRIPTPATH
+ TBBROOT=/usrx/local/intel/2015/tbb
+ export TBBROOT
+
VTUNE_AMPLIFIER_XE_2015_DIR=/usrx/local/intel/2015/vtune_amplifier_xe_2015
+ export VTUNE_AMPLIFIER_XE_2015_DIR
+ VT_ADD_LIBS='-ldwarf -lelf -lvtunwind -lnsl -lm -ldl -lpthread'
+ export VT_ADD_LIBS
+ VT_ARCH=intel64
+ export VT_ARCH
+ VT_LIB_DIR=/usrx/local/intel/2015/itac_latest/lib
+ export VT_LIB_DIR
+ VT_MIC_SLIB_DIR=/usrx/local/intel/2015/itac_latest/mic/slib
+ export VT_MIC_SLIB_DIR
+ VT_MPI=impi4
+ export VT_MPI
+ VT_ROOT=/usrx/local/intel/2015/itac_latest
+ export VT_ROOT
+ VT_SLIB_DIR=/usrx/local/intel/2015/itac_latest/intel64/slib
+ export VT_SLIB_DIR
+
_LMFILES_=/usrx/local/modulefiles/ics/15.0.3:/usrx/local/dev/modulefiles/python/2.7.14:/global/noscrub/Julie.Prestopnik/modulefiles/met/8.0
+ export _LMFILES_
+ module load nco
+ /usrx/local/Modules/3.2.10/bin/modulecmd ksh load nco
+ eval LOADEDMODULES=ics/15.0.3:python/2.7.14:met/8.0:nco/4.2.4
';export'
'LOADEDMODULES;MANPATH=/usrx/local/nco/4.2.4/share/man:/usrx/local/dev/python/2.7.14/share/man:/usrx/local/intel/2015/impi_latest/man:/usrx/local/intel/2015/itac_latest/man:/usrx/local/intel/2015/composerxe/man/en_US:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64/share/man:/usr/share/man:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64_mic/share/man:/usrx/local/intel/2015/inspector_xe_2015/man:/usrx/local/intel/2015/vtune_amplifier_xe_2015/man:/usrx/local/intel/2015/advisor_xe_2015/man'
';export' 'MANPATH;NCO_INCLUDE=-I/usrx/local/nco/4.2.4/include'
';export' 'NCO_INCLUDE;NCO_LDFLAGS_C=-L/usrx/local/nco/4.2.4/lib'
';export' 'NCO_LDFLAGS_C;NCO_LDFLAGS_CXX=-L/usrx/local/nco/4.2.4/lib'
';export'
'NCO_LDFLAGS_CXX;PATH=/usrx/local/nco/4.2.4/bin:/global/noscrub/Julie.Prestopnik/met/8.0//bin:/global/noscrub/Julie.Prestopnik/met/8.0/external_libs/bin:/usrx/local/dev/python/2.7.14/bin:/usrx/local/intel/2015/advisor_xe_2015/bin64:/usrx/local/intel/2015/vtune_amplifier_xe_2015/bin64:/usrx/local/intel/2015/inspector_xe_2015/bin64:/usrx/local/intel/2015/impi_latest/intel64/bin:/usrx/local/intel/2015/itac_latest/intel64/bin:/usrx/local/intel/2015/composer_xe_2015.3.187/bin/intel64:/usrx/local/intel/2015/mpirt/bin/intel64:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64_mic/bin:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64/bin:.:/nwprod/gempak/nawips/os/linux2.6.32_x86_64/bin:/usr/lib64/qt-
3.3/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/opt/ibutils/bin:/nwprod/util/exec::/nwprod/util/ush::/u/Wesley.Ebisuzaki/bin:/u/Ying.Lin/bin:/nwprod/gempak/nawips/bin:/nwprod/gempak/nawips/scripts/ez:/nwprod/gempak/nawips/scripts/nawips:/nwprod/gempak/nawips/scripts/prnt:/nwprod/gempak/nawips/scripts/decoder:/sss/emc/meso/shared/Eric.Rogers/ddapp/exe_lnx6:/sss/emc/meso/shared/Eric.Rogers/vsdb/scripts'
';export'
'PATH;_LMFILES_=/usrx/local/modulefiles/ics/15.0.3:/usrx/local/dev/modulefiles/python/2.7.14:/global/noscrub/Julie.Prestopnik/modulefiles/met/8.0:/usrx/local/modulefiles/nco/4.2.4'
';export' '_LMFILES_;'
+ LOADEDMODULES=ics/15.0.3:python/2.7.14:met/8.0:nco/4.2.4
+ export LOADEDMODULES
+
MANPATH=/usrx/local/nco/4.2.4/share/man:/usrx/local/dev/python/2.7.14/share/man:/usrx/local/intel/2015/impi_latest/man:/usrx/local/intel/2015/itac_latest/man:/usrx/local/intel/2015/composerxe/man/en_US:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64/share/man:/usr/share/man:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64_mic/share/man:/usrx/local/intel/2015/inspector_xe_2015/man:/usrx/local/intel/2015/vtune_amplifier_xe_2015/man:/usrx/local/intel/2015/advisor_xe_2015/man
+ export MANPATH
+ NCO_INCLUDE=-I/usrx/local/nco/4.2.4/include
+ export NCO_INCLUDE
+ NCO_LDFLAGS_C=-L/usrx/local/nco/4.2.4/lib
+ export NCO_LDFLAGS_C
+ NCO_LDFLAGS_CXX=-L/usrx/local/nco/4.2.4/lib
+ export NCO_LDFLAGS_CXX
+
PATH=/usrx/local/nco/4.2.4/bin:/global/noscrub/Julie.Prestopnik/met/8.0//bin:/global/noscrub/Julie.Prestopnik/met/8.0/external_libs/bin:/usrx/local/dev/python/2.7.14/bin:/usrx/local/intel/2015/advisor_xe_2015/bin64:/usrx/local/intel/2015/vtune_amplifier_xe_2015/bin64:/usrx/local/intel/2015/inspector_xe_2015/bin64:/usrx/local/intel/2015/impi_latest/intel64/bin:/usrx/local/intel/2015/itac_latest/intel64/bin:/usrx/local/intel/2015/composer_xe_2015.3.187/bin/intel64:/usrx/local/intel/2015/mpirt/bin/intel64:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64_mic/bin:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64/bin:.:/nwprod/gempak/nawips/os/linux2.6.32_x86_64/bin:/usr/lib64/qt-
3.3/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/opt/ibutils/bin:/nwprod/util/exec::/nwprod/util/ush::/u/Wesley.Ebisuzaki/bin:/u/Ying.Lin/bin:/nwprod/gempak/nawips/bin:/nwprod/gempak/nawips/scripts/ez:/nwprod/gempak/nawips/scripts/nawips:/nwprod/gempak/nawips/scripts/prnt:/nwprod/gempak/nawips/scripts/decoder:/sss/emc/meso/shared/Eric.Rogers/ddapp/exe_lnx6:/sss/emc/meso/shared/Eric.Rogers/vsdb/scripts
+ export PATH
+
_LMFILES_=/usrx/local/modulefiles/ics/15.0.3:/usrx/local/dev/modulefiles/python/2.7.14:/global/noscrub/Julie.Prestopnik/modulefiles/met/8.0:/usrx/local/modulefiles/nco/4.2.4
+ export _LMFILES_
+ module load grib_util
+ /usrx/local/Modules/3.2.10/bin/modulecmd ksh load grib_util
+ eval CNVGRIB=/nwprod2/grib_util.v1.0.0/exec/cnvgrib ';export'
'CNVGRIB;COPYGB=/nwprod2/grib_util.v1.0.0/exec/copygb' ';export'
'COPYGB;COPYGB2=/nwprod2/grib_util.v1.0.0/exec/copygb2' ';export'
'COPYGB2;DEGRIB2=/nwprod2/grib_util.v1.0.0/exec/degrib2' ';export'
'DEGRIB2;GRB2INDEX=/nwprod2/grib_util.v1.0.0/exec/grb2index' ';export'
'GRB2INDEX;GRBINDEX=/nwprod2/grib_util.v1.0.0/exec/grbindex' ';export'
'GRBINDEX;GRIB2GRIB=/nwprod2/grib_util.v1.0.0/exec/grib2grib'
';export'
'GRIB2GRIB;LOADEDMODULES=ics/15.0.3:python/2.7.14:met/8.0:nco/4.2.4:grib_util/v1.0.0'
';export'
'LOADEDMODULES;TOCGRIB=/nwprod2/grib_util.v1.0.0/exec/tocgrib'
';export' 'TOCGRIB;TOCGRIB2=/nwprod2/grib_util.v1.0.0/exec/tocgrib2'
';export'
'TOCGRIB2;TOCGRIB2SUPER=/nwprod2/grib_util.v1.0.0/exec/tocgrib2super'
';export' 'TOCGRIB2SUPER;WGRIB=/nwprod2/grib_util.v1.0.0/exec/wgrib'
';export' 'WGRIB;WGRIB2=/nwprod2/grib_util.v1.0.0/exec/wgrib2'
';export'
'WGRIB2;_LMFILES_=/usrx/local/modulefiles/ics/15.0.3:/usrx/local/dev/modulefiles/python/2.7.14:/global/noscrub/Julie.Prestopnik/modulefiles/met/8.0:/usrx/local/modulefiles/nco/4.2.4:/nwprod2/modulefiles/grib_util/v1.0.0'
';export' '_LMFILES_;'
+ CNVGRIB=/nwprod2/grib_util.v1.0.0/exec/cnvgrib
+ export CNVGRIB
+ COPYGB=/nwprod2/grib_util.v1.0.0/exec/copygb
+ export COPYGB
+ COPYGB2=/nwprod2/grib_util.v1.0.0/exec/copygb2
+ export COPYGB2
+ DEGRIB2=/nwprod2/grib_util.v1.0.0/exec/degrib2
+ export DEGRIB2
+ GRB2INDEX=/nwprod2/grib_util.v1.0.0/exec/grb2index
+ export GRB2INDEX
+ GRBINDEX=/nwprod2/grib_util.v1.0.0/exec/grbindex
+ export GRBINDEX
+ GRIB2GRIB=/nwprod2/grib_util.v1.0.0/exec/grib2grib
+ export GRIB2GRIB
+
LOADEDMODULES=ics/15.0.3:python/2.7.14:met/8.0:nco/4.2.4:grib_util/v1.0.0
+ export LOADEDMODULES
+ TOCGRIB=/nwprod2/grib_util.v1.0.0/exec/tocgrib
+ export TOCGRIB
+ TOCGRIB2=/nwprod2/grib_util.v1.0.0/exec/tocgrib2
+ export TOCGRIB2
+ TOCGRIB2SUPER=/nwprod2/grib_util.v1.0.0/exec/tocgrib2super
+ export TOCGRIB2SUPER
+ WGRIB=/nwprod2/grib_util.v1.0.0/exec/wgrib
+ export WGRIB
+ WGRIB2=/nwprod2/grib_util.v1.0.0/exec/wgrib2
+ export WGRIB2
+
_LMFILES_=/usrx/local/modulefiles/ics/15.0.3:/usrx/local/dev/modulefiles/python/2.7.14:/global/noscrub/Julie.Prestopnik/modulefiles/met/8.0:/usrx/local/modulefiles/nco/4.2.4:/nwprod2/modulefiles/grib_util/v1.0.0
+ export _LMFILES_
+ METPLUS_PATH=/meso/save/Ying.Lin/metplus
+ export METPLUS_PATH
+ MET_PATH=/global/noscrub/Julie.Prestopnik/met/8.0
+ export MET_PATH
+ JLOGFILE=/meso/save/Ying.Lin/metplus/logs/metplus_jlogfile
+ export JLOGFILE
+
PYTHONPATH=/meso/save/Ying.Lin/metplus/ush:/meso/save/Ying.Lin/metplus/parm
+ export PYTHONPATH
+
PATH=/usrx/local/nco/4.2.4/bin:/global/noscrub/Julie.Prestopnik/met/8.0//bin:/global/noscrub/Julie.Prestopnik/met/8.0/external_libs/bin:/usrx/local/dev/python/2.7.14/bin:/usrx/local/intel/2015/advisor_xe_2015/bin64:/usrx/local/intel/2015/vtune_amplifier_xe_2015/bin64:/usrx/local/intel/2015/inspector_xe_2015/bin64:/usrx/local/intel/2015/impi_latest/intel64/bin:/usrx/local/intel/2015/itac_latest/intel64/bin:/usrx/local/intel/2015/composer_xe_2015.3.187/bin/intel64:/usrx/local/intel/2015/mpirt/bin/intel64:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64_mic/bin:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64/bin:.:/nwprod/gempak/nawips/os/linux2.6.32_x86_64/bin:/usr/lib64/qt-
3.3/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/opt/ibutils/bin:/nwprod/util/exec::/nwprod/util/ush::/u/Wesley.Ebisuzaki/bin:/u/Ying.Lin/bin:/nwprod/gempak/nawips/bin:/nwprod/gempak/nawips/scripts/ez:/nwprod/gempak/nawips/scripts/nawips:/nwprod/gempak/nawips/scripts/prnt:/nwprod/gempak/nawips/scripts/decoder:/sss/emc/meso/shared/Eric.Rogers/ddapp/exe_lnx6:/sss/emc/meso/shared/Eric.Rogers/vsdb/scripts:/meso/save/Ying.Lin/metplus/ush:.
+ export PATH
+ vday=20190310
+ export vday
+ master_metplus.py -c
/meso/save/Ying.Lin/metplus/parm/models_conf/fv3gfs_24h_by_valid_time.conf
-c /meso/save/Ying.Lin/metplus/parm/ylin.system.conf.wcoss
03/11 15:31:43.548 jlog (log.py:66) INFO: master_metplus is starting
03/11 15:31:43.562 jlog (master_metplus.py:55) INFO: Top of
master_metplus
03/11 15:31:43.562 master_metplus (master_metplus.py:64) INFO: logger
Top of master_metplus.
03/11 15:31:43.562 metplus (config_metplus.py:76) INFO: Starting
METplus configuration setup.
03/11 15:31:43.562 metplus (config_metplus.py:99) INFO: All OPTS and
ARGS: [('-c',
'/meso/save/Ying.Lin/metplus/parm/models_conf/fv3gfs_24h_by_valid_time.conf'),
('-c', '/meso/save/Ying.Lin/metplus/parm/ylin.system.conf.wcoss')] []
03/11 15:31:43.563 metplus (config_launcher.py:160) INFO:
/meso/save/Ying.Lin/metplus/parm/models_conf/fv3gfs_24h_by_valid_time.conf
03/11 15:31:43.564 metplus (config_launcher.py:171) INFO:
/meso/save/Ying.Lin/metplus/parm/models_conf/fv3gfs_24h_by_valid_time.conf:
Plan to parse this conf file
03/11 15:31:43.564 metplus (config_launcher.py:160) INFO:
/meso/save/Ying.Lin/metplus/parm/ylin.system.conf.wcoss
03/11 15:31:43.565 metplus (config_launcher.py:171) INFO:
/meso/save/Ying.Lin/metplus/parm/ylin.system.conf.wcoss: Plan to parse
this conf file
03/11 15:31:43.575 metplus (config_launcher.py:195) INFO: Conf input:
'/gpfs/td1/emc/meso/save/Ying.Lin/metplus/parm/metplus_config/metplus_system.conf'
03/11 15:31:43.576 metplus (config_launcher.py:195) INFO: Conf input:
'/gpfs/td1/emc/meso/save/Ying.Lin/metplus/parm/metplus_config/metplus_data.conf'
03/11 15:31:43.576 metplus (config_launcher.py:195) INFO: Conf input:
'/gpfs/td1/emc/meso/save/Ying.Lin/metplus/parm/metplus_config/metplus_runtime.conf'
03/11 15:31:43.577 metplus (config_launcher.py:195) INFO: Conf input:
'/gpfs/td1/emc/meso/save/Ying.Lin/metplus/parm/metplus_config/metplus_logging.conf'
03/11 15:31:43.577 metplus (config_launcher.py:195) INFO: Conf input:
'/meso/save/Ying.Lin/metplus/parm/models_conf/fv3gfs_24h_by_valid_time.conf'
03/11 15:31:43.577 metplus (config_launcher.py:195) INFO: Conf input:
'/meso/save/Ying.Lin/metplus/parm/ylin.system.conf.wcoss'
03/11 15:31:43.593 metplus (config_launcher.py:218) INFO:
/gpfs/td1/emc/meso/save/Ying.Lin/metplus/parm/metplus_config/metplus_system.conf:
Parsed this file
03/11 15:31:43.602 metplus (config_launcher.py:218) INFO:
/gpfs/td1/emc/meso/save/Ying.Lin/metplus/parm/metplus_config/metplus_data.conf:
Parsed this file
03/11 15:31:43.614 metplus (config_launcher.py:218) INFO:
/gpfs/td1/emc/meso/save/Ying.Lin/metplus/parm/metplus_config/metplus_runtime.conf:
Parsed this file
03/11 15:31:43.628 metplus (config_launcher.py:218) INFO:
/gpfs/td1/emc/meso/save/Ying.Lin/metplus/parm/metplus_config/metplus_logging.conf:
Parsed this file
03/11 15:31:43.629 metplus (config_launcher.py:218) INFO:
/meso/save/Ying.Lin/metplus/parm/models_conf/fv3gfs_24h_by_valid_time.conf:
Parsed this file
03/11 15:31:43.639 metplus (config_launcher.py:218) INFO:
/meso/save/Ying.Lin/metplus/parm/ylin.system.conf.wcoss: Parsed this
file
03/11 15:31:43.640 metplus (met_util.py:216) INFO: Adding:
config.LOG_TIMESTAMP='20190311'
03/11 15:31:43.640 metplus (met_util.py:222) INFO: Replace [config]
LOG_METPLUS with
'/meso/noscrub/Ying.Lin/metplus.out/logs/master_metplus.log.20190311'
03/11 15:31:43.651 metplus (config_launcher.py:289) INFO: Replace
[dir] OUTPUT_BASE with /meso/noscrub/Ying.Lin/metplus.out
03/11 15:31:43.651 metplus (config_launcher.py:289) INFO: Replace
[dir] METPLUS_BASE with /meso/save/Ying.Lin/metplus/
03/11 15:31:43.651 metplus (config_launcher.py:300) INFO:
METPLUS_CONF: /meso/noscrub/Ying.Lin/metplus.out/metplus_final.conf
written here.
03/11 15:31:43.656 metplus (config_metplus.py:148) INFO: Completed
METplus configuration setup.
03/11 15:31:43.679 metplus.GridStat (master_metplus.py:142) INFO:
****************************************
03/11 15:31:43.679 metplus.GridStat (master_metplus.py:143) INFO: *
RUNNING MET+
03/11 15:31:43.679 metplus.GridStat (master_metplus.py:147) INFO: *
at valid time: 201903101200
03/11 15:31:43.679 metplus.GridStat (master_metplus.py:148) INFO:
****************************************
03/11 15:31:43.687 metplus.PcpCombine (pcp_combine_wrapper.py:597)
WARNING: pcp_combine: Could not find files to compute accumulation in
/com2/ccpa/prod
03/11 15:31:43.688 metplus.PcpCombine (pcp_combine_wrapper.py:442)
INFO:
03/11 15:31:43.688 metplus.PcpCombine (pcp_combine_wrapper.py:382)
ERROR: No input filenames specified
03/11 15:31:43.690 metplus.RegridDataPlane
(regrid_data_plane_wrapper.py:89) INFO:
03/11 15:31:43.690 metplus.RegridDataPlane (command_runner.py:220)
DEBUG: LOG_MET_OUTPUT_TO_METPLUS log file is True
03/11 15:31:43.692 metplus.RegridDataPlane (command_runner.py:119)
INFO: app_name is: regrid_data_plane, output sent to:
/meso/noscrub/Ying.Lin/metplus.out/logs/master_metplus.log.20190311
03/11 15:31:43.779 mpi_impl (__init__.py:331) INFO: inside_aprun: not
detected: INSIDE_APRUN is not set or is 0
03/11 15:31:43.781 mpi_impl (__init__.py:331) INFO: lsf_cray_intel:
not detected: aprun: cannot find executable
03/11 15:31:43.782 mpi_impl (__init__.py:331) INFO: mpirun_lsf: not
detected: mpirun.lsf: cannot find executable
03/11 15:31:43.865 mpi_impl (__init__.py:331) INFO: impi: not
detected: 'TOTAL_TASKS'
03/11 15:31:43.867 mpi_impl (__init__.py:331) INFO: mpiexec_mpt: not
detected: mpiexec_mpt: cannot find executable
03/11 15:31:43.868 mpi_impl (__init__.py:331) INFO: srun: not
detected: srun: cannot find executable
03/11 15:31:43.878 mpi_impl (__init__.py:331) INFO: mpiexec: not
detected: 'TOTAL_TASKS'
03/11 15:31:43.879 metplus.RegridDataPlane (command_runner.py:155)
INFO: RUNNING:
/global/noscrub/Julie.Prestopnik/met/8.0/bin/regrid_data_plane -v 5
-field "name=\"APCP_24\"; level=\"(*,*)\";" -method BUDGET -width 2
-name APCP_24
/meso/noscrub/Ying.Lin/metplus.out/qpe_grib/bucket/20190310/ccpa.2019031012_A24h.g212
/global/noscrub/Julie.Prestopnik/METplus/METplus-
2.0_sample_data/sample_fcst/2005080700/wrfprs_ruc13_12.tm00_G212
/meso/noscrub/Ying.Lin/metplus.out/qpe_grib/regrid/20190310/ccpa.2019031012_A24h.g212
>> /meso/noscrub/Ying.Lin/metplus.out/logs/master_metplus.log.20190311
2>&1
03/11 15:31:43.879 metplus.RegridDataPlane (command_runner.py:156)
DEBUG: RUNNING
exe('/global/noscrub/Julie.Prestopnik/met/8.0/bin/regrid_data_plane')['-
v','5','-field','name="APCP_24"; level="(*,*)";','-method','BUDGET','-
width','2','-
name','APCP_24','/meso/noscrub/Ying.Lin/metplus.out/qpe_grib/bucket/20190310/ccpa.2019031012_A24h.g212','/global/noscrub/Julie.Prestopnik/METplus/METplus-
2.0_sample_data/sample_fcst/2005080700/wrfprs_ruc13_12.tm00_G212','/meso/noscrub/Ying.Lin/metplus.out/qpe_grib/regrid/20190310/ccpa.2019031012_A24h.g212'].out('/meso/noscrub/Ying.Lin/metplus.out/logs/master_metplus.log.20190311',append=True).err2out()
03/11 15:31:44.799 metplus.GridStat (compare_gridded_wrapper.py:344)
DEBUG:
03/11 15:31:44.799 metplus.GridStat (compare_gridded_wrapper.py:345)
DEBUG: ENVIRONMENT FOR NEXT COMMAND:
03/11 15:31:44.799 metplus.GridStat (command_builder.py:146) DEBUG:
MODEL=FV3GFS
03/11 15:31:44.799 metplus.GridStat (command_builder.py:146) DEBUG:
FCST_VAR=APCP
03/11 15:31:44.799 metplus.GridStat (command_builder.py:146) DEBUG:
OBS_VAR=APCP
03/11 15:31:44.800 metplus.GridStat (command_builder.py:146) DEBUG:
LEVEL=A24
03/11 15:31:44.800 metplus.GridStat (command_builder.py:146) DEBUG:
OBTYPE=QPE
03/11 15:31:44.800 metplus.GridStat (command_builder.py:146) DEBUG:
CONFIG_DIR=/meso/save/Ying.Lin/metplus//parm/use_cases/qpf/met_config
03/11 15:31:44.800 metplus.GridStat (command_builder.py:146) DEBUG:
FCST_FIELD={ name="APCP"; level="[A24]"; cat_thresh=[ gt0.254, gt2.54,
gt6.35, gt12.7, gt19.05, gt25.4, gt38.1, gt50.8, gt101.6 ]; }
03/11 15:31:44.800 metplus.GridStat (command_builder.py:146) DEBUG:
OBS_FIELD={ name="APCP"; level="[A24]"; cat_thresh=[ gt0.254, gt2.54,
gt6.35, gt12.7, gt19.05, gt25.4, gt38.1, gt50.8, gt101.6 ]; }
03/11 15:31:44.800 metplus.GridStat (command_builder.py:146) DEBUG:
INPUT_BASE=/global/noscrub/Julie.Prestopnik/METplus/METplus-
2.0_sample_data
03/11 15:31:44.800 metplus.GridStat (command_builder.py:146) DEBUG:
MET_VALID_HHMM=0310
03/11 15:31:44.800 metplus.GridStat (compare_gridded_wrapper.py:356)
DEBUG:
03/11 15:31:44.801 metplus.GridStat (compare_gridded_wrapper.py:357)
DEBUG: COPYABLE ENVIRONMENT FOR NEXT COMMAND:
03/11 15:31:44.801 metplus.GridStat (command_builder.py:141) DEBUG:
export MODEL=FV3GFS; export FCST_VAR=APCP; export OBS_VAR=APCP; export
LEVEL=A24; export OBTYPE=QPE; export
CONFIG_DIR=/meso/save/Ying.Lin/metplus//parm/use_cases/qpf/met_config;
export FCST_FIELD="{ name=\"APCP\"; level=\"[A24]\"; cat_thresh=[
gt0.254, gt2.54, gt6.35, gt12.7, gt19.05, gt25.4, gt38.1, gt50.8,
gt101.6 ]; }"; export OBS_FIELD="{ name=\"APCP\"; level=\"[A24]\";
cat_thresh=[ gt0.254, gt2.54, gt6.35, gt12.7, gt19.05, gt25.4, gt38.1,
gt50.8, gt101.6 ]; }"; export
INPUT_BASE=/global/noscrub/Julie.Prestopnik/METplus/METplus-
2.0_sample_data; export MET_VALID_HHMM=0310;
03/11 15:31:44.801 metplus.GridStat (compare_gridded_wrapper.py:363)
DEBUG:
03/11 15:31:44.801 metplus.GridStat (compare_gridded_wrapper.py:369)
INFO:
03/11 15:31:44.801 metplus.GridStat (command_runner.py:220) DEBUG:
LOG_MET_OUTPUT_TO_METPLUS log file is True
03/11 15:31:44.802 metplus.GridStat (command_runner.py:119) INFO:
app_name is: grid_stat, output sent to:
/meso/noscrub/Ying.Lin/metplus.out/logs/master_metplus.log.20190311
03/11 15:31:44.803 metplus.GridStat (command_runner.py:155) INFO:
RUNNING: /global/noscrub/Julie.Prestopnik/met/8.0/bin/grid_stat
/gpfs/dell1/nco/ops/com/gfs/para/gfs.20190309/12/gfs.t12z.pgrb2.0p25.f024
/meso/noscrub/Ying.Lin/metplus.out/qpe_grib/regrid/20190310/ccpa.2019031012_A24h.g212
/meso/save/Ying.Lin/metplus//parm/ylin.GridStatConfig.CTC -outdir
/meso/noscrub/Ying.Lin/metplus.out/met_out/FV3GFS/201903101200/grid_stat
>> /meso/noscrub/Ying.Lin/metplus.out/logs/master_metplus.log.20190311
2>&1
03/11 15:31:44.803 metplus.GridStat (command_runner.py:156) DEBUG:
RUNNING
exe('/global/noscrub/Julie.Prestopnik/met/8.0/bin/grid_stat')['/gpfs/dell1/nco/ops/com/gfs/para/gfs.20190309/12/gfs.t12z.pgrb2.0p25.f024','/meso/noscrub/Ying.Lin/metplus.out/qpe_grib/regrid/20190310/ccpa.2019031012_A24h.g212','/meso/save/Ying.Lin/metplus//parm/ylin.GridStatConfig.CTC','-
outdir','/meso/noscrub/Ying.Lin/metplus.out/met_out/FV3GFS/201903101200/grid_stat'].out('/meso/noscrub/Ying.Lin/metplus.out/logs/master_metplus.log.20190311',append=True).err2out()
------------------------------------------------
Subject: CCPA file name format for METplus
From: George McCabe
Time: Mon Mar 11 10:23:34 2019
Hi Ying,
Using the new version of METplus, you will see the following error:
ERROR: Threshold values must start with
>,>=,==,!=,<,<=,gt,ge,eq,ne,lt, or
le
If you add a comparison operator to each item of your FCST_VAR1_THRESH
list, this error will go away. The old default operator was >=, so
adding
that would preserve the old behavior if that is what you want.
You will also see some warnings of METplus variables being deprecated.
You
can change the name of these variables to get rid of those warnings.
The
warning description should be clear.
When I ran your config file, METplus built the following command:
/usr/local/met-8.0/bin/pcp_combine -name APCP_24 -add
/d1/mccabe/ying_data/com2/ccpa/prod/ccpa.20190310/12/ccpa.t12z.06h.hrap.conus.gb2
6
/d1/mccabe/ying_data/com2/ccpa/prod/ccpa.20190310/06/ccpa.t06z.06h.hrap.conus.gb2
6
/d1/mccabe/ying_data/com2/ccpa/prod/ccpa.20190310/00/ccpa.t00z.06h.hrap.conus.gb2
6
/d1/mccabe/ying_data/com2/ccpa/prod/ccpa.20190309/18/ccpa.t18z.06h.hrap.conus.gb2
6
/d1/mccabe/ying_data/out/qpe_grib/bucket/20190310/ccpa.2019031012_A24h
-v
2
Let me know if you have any other issues.
Thanks,
George
On Mon, Mar 11, 2019 at 9:48 AM Ying Lin via RT <met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=89063 >
>
> Hi George,
>
> First of all, thank you for telling me about passing the envir
> variable using {ENV[vday]}, that was really useful!
>
> Still have trouble "finding" the CCPA files. I've first
changed
> the OBS_LEVEL=6, when that didn't work, I explicitly specified the
'06h'
> in the file name in the config, e.g.
>
> OBS_PCP_COMBINE_INPUT_TEMPLATE =
>
>
ccpa.{valid?fmt=%Y%m%d}/{valid?fmt=%H}/ccpa.t{valid?fmt=%H}z.06h.hrap.conus.gb2
>
> Still getting the "WARNING: pcp_combine: Could not find files to
compute
> accumulation in /com2/ccpa/prod" in the job output and the log file
> (both attached to this email, as well as the config file). Also
> attached are the four 6h CCPA files with their full paths, e.g.
> t10a1 $ tar cvfz /stmpp1/Ying.Lin/ccpa.tar.gz
> /com2/ccpa/prod/ccpa.20190309/18/ccpa.*06h.hrap.conus.gb2
> /com2/ccpa/prod/ccpa.20190310/*/ccpa.*06h.hrap.conus.gb2
> tar: Removing leading `/' from member names
> /com2/ccpa/prod/ccpa.20190309/18/ccpa.t18z.06h.hrap.conus.gb2
> /com2/ccpa/prod/ccpa.20190310/00/ccpa.t00z.06h.hrap.conus.gb2
> /com2/ccpa/prod/ccpa.20190310/06/ccpa.t06z.06h.hrap.conus.gb2
> /com2/ccpa/prod/ccpa.20190310/12/ccpa.t12z.06h.hrap.conus.gb2
>
> Thanks again -
>
> Ying
>
> On 3/11/19 10:47 AM, George McCabe via RT wrote:
> > Hi Ying,
> >
> > I was incorrect that you need to change the precision. %H should
find the
> > time the way it is formatted. I think you will need to remove
OBS_LEVEL
> = 1
> > from your config. This variable tells METplus to only look for 1
hr
> > accumulation files to use in pcp_combine. If you remove this
variable, it
> > should look for a 24 hr accumulation file and reduce the hour by 1
until
> it
> > finds a file that it can use. If you want to force METplus to use
6 hour
> > files to build the 24 hr accumulation, you should set OBS_LEVEL =
6. Let
> me
> > know if that helps.
> >
> > Thanks,
> > George
> >
> > On Mon, Mar 11, 2019 at 8:30 AM George McCabe <mccabe at ucar.edu>
wrote:
> >
> >> Hi Ying,
> >>
> >> You may need to change %H to %.2H in the template to tell it that
there
> >> will always be 2 digit precision. If that doesn't work, could you
send
> me
> >> the directory listing so I can see what files are available?
> >>
> >> To pass in environment variables, use the following notation:
> {ENV[vday]}.
> >>
> >> You are correct that using valid hour for the directory name will
not
> >> work, as it will change the value to 03. If this value is going
to
> change
> >> between runs and doesn't directly correspond to the valid time,
you may
> >> have to trick it with environment variables to get it to work
correctly.
> >>
> >> On Thu, Mar 7, 2019 at 1:33 PM Ying Lin via RT
<met_help at ucar.edu>
> wrote:
> >>
> >>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=89063 >
> >>>
> >>> Hi George,
> >>>
> >>> Thanks! That makes sense, though it didn't quite work out
for
> me.
> >>> In the attached fv3gfs_24h_by_valid_time.conf, I have
> >>> OBS_PCP_COMBINE_INPUT_DIR = /com2/ccpa/prod
> >>> then
> >>> OBS_PCP_COMBINE_INPUT_TEMPLATE =
> >>>
> >>>
>
ccpa.{valid?fmt=%Y%m%d}/{valid?fmt=%H}/ccpa.t{valid?fmt=%H}z.{level?fmt=%.2H}h.hrap.conus.gb2
> >>>
> >>> thinking that it would tell pcp_combine to look for e,g,
> >>> /com2/ccpa/prod/ccpa.20190305/06/ccpa.t06z.06h.hrap.conus.gb2
> >>>
> >>> Instead I'm getting "WARNING: pcp_combine: Could not find files
to
> >>> compute accumulation in /com2/ccpa/prod" (in the attached
test.out and
> >>> master_metplus.log.20190307).
> >>>
> >>> Could you tell what I'm doing wrong in the config?
> >>>
> >>> I'm doing the above in
Tide:/meso/save/Ying.Lin/metplus/test/.
> >>>
> >>> Also two related questions:
> >>> 1) In the METplus model config files I've seen (like in the
attached
> >>> config), the VALID_BEG and VALID_END are set in the config file.
Is
> >>> there an easy way to set and export the VALID_* variable from a
script?
> >>> For example I've tried "export vday=20190305" in the
> test_fv3gfs_24h.ksh
> >>> and in the config file set
> >>> VALID_BEG = "${vday}"12 (same for VALID_END)
> >>> and
> >>> VALID_BEG = ${vday}12
> >>> and
> >>> VALID_BEG = {vday}12
> >>> none of the above worked. What's the right way to do this?
> >>>
> >>> 2) In the CCPA directory of /com2/ccpa/prod/ccpa.20190305/06/,
the '06'
> >>> subdir seems to contain all CCPA analysis files with valid times
from
> >>> 01Z-06Z. So for 6h analysis, the '06' in the subdir is just the
valid
> >>> hour. But if I do 3-hourly verification using the 3-hourly CCPA
files,
> >>> the above directory also contains ccpa.t03z.03h.hrap.conus.gb2
(valid
> at
> >>> 03Z) and ccpa.t06z.03h.hrap.conus.gb2 (valid at 06Z). In that
case i
> >>> don't think the
> >>>
> >>>
>
ccpa.{valid?fmt=%Y%m%d}/{valid?fmt=%H}/ccpa.t{valid?fmt=%H}z.{level?fmt=%.2H}h.hrap.conus.gb2
> >>> would work, would it?
> >>>
> >>> Thanks again,
> >>>
> >>> Ying
> >>>
> >>>
> >>> On 3/6/19 10:29 AM, George McCabe via RT wrote:
> >>>> Hi Ying Lin,
> >>>>
> >>>> You should be able to use a template that looks something like
this:
> >>>>
> >>>>
> >>>
>
"ccpa.{valid?fmt=%Y%m%d}/06/ccpa.t{valid?fmt=%H}z.{level?fmt=%.2H}h.hrap.conus.gb2"
> >>>> The 'level' item corresponds to the accumulation amount. %.2H
> specifies
> >>>> that the filename has 2 digits of precision for that value. I
wasn't
> >>> sure
> >>>> what the '06' subdirectory corresponds to, but if necessary you
can
> >>>> substitute that with formatting so that it will be dynamic. Let
me
> know
> >>> if
> >>>> that doesn't work and I can help figure out what will.
> >>>>
> >>>> Thanks,
> >>>> George
> >>>>
> >>>> On Mon, Feb 25, 2019 at 11:09 AM Ying Lin via RT
<met_help at ucar.edu>
> >>> wrote:
> >>>>> Mon Feb 25 11:08:35 2019: Request 89063 was acted upon.
> >>>>> Transaction: Ticket created by ying.lin at noaa.gov
> >>>>> Queue: met_help
> >>>>> Subject: CCPA file name format for METplus
> >>>>> Owner: Nobody
> >>>>> Requestors: ying.lin at noaa.gov
> >>>>> Status: new
> >>>>> Ticket <URL:
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=89063
> >>>>>
> >>>>> Hello. I see that
> >>>>>
> >>>>>
> >>>
>
https://github.com/NCAR/METplus/blob/master/parm/use_cases/grid_to_grid/examples/precip.conf
> >>>>> has
> >>>>> OBS_GRID_STAT_INPUT_TEMPLATE =
> ccpa_conus_1.0d_{valid?fmt=%Y%m%d}
> >>>>>
> >>>>> CCPA output on wcoss has file names like
> >>>>>
/com2/ccpa/prod/ccpa.20190224/06/ccpa.t03z.03h.hrap.conus.gb2
> >>>>> which is 3h accumulation valid at 03Z 2019/02/24
> >>>>> and ccpa.t06z.06h.hrap.conus.gb2
> >>>>> which is 6h accumulation valid at 06Z 2019/02/24
> >>>>>
> >>>>> Does METplus already have the capability to handle the CCPA in
its
> >>>>> 'native' directory/name format, as in the /com2/* directory
above?
> In
> >>>>> my verif scripts I do
> >>>>> cp $COMCCPA.$vday/06/ccpa.t03z.03h.hrap.conus.gb2
> >>> ccpa.${vday}03.03h.gb2
> >>>>> If METplus can already handle this bit of pre-processing, or
if this
> >>> can
> >>>>> be added to the wish list, that'll be great. Thanks!
> >>>>>
> >>>>> Ying
> >>>>>
> >>>>> --
> >>>>> Ying Lin
> >>>>> NCEP/EMC/Verification, Post-processing and Product Generation
Branch
> >>>>> NCWCP Cubicle No. 2015
> >>>>> Ying.Lin at noaa.gov
> >>>>>
> >>>>>
> >>>>>
> >>>>>
> >>> --
> >>> Ying Lin
> >>> NCEP/EMC/Verification, Post-processing and Product Generation
Branch
> >>> NCWCP Cubicle No. 2015
> >>> Ying.Lin at noaa.gov
> >>>
> >>>
> >>>
> >>>
>
> --
> Ying Lin
> NCEP/EMC/Verification, Post-processing and Product Generation Branch
> NCWCP Cubicle No. 2015
> Ying.Lin at noaa.gov
>
>
>
>
------------------------------------------------
Subject: CCPA file name format for METplus
From: Ying Lin
Time: Tue Mar 12 14:19:38 2019
Thanks very much George.
Moving the METplus.v2.0.4, the pcp_combine step did work easily,
but now I'm having trouble with the regrid_data_plane step. Running
the
METplus script (test_fv3gfs_24h.ksh, attached), I'm seeing in the job
out (fv3gfs.out) that
03/12 19:45:18.029 metplus.RegridDataPlane
(reformat_gridded_wrapper.py:75) INFO: PROCESSING OBS DATA
03/12 19:45:18.029 metplus.RegridDataPlane
(reformat_gridded_wrapper.py:78) INFO: PROCESSING FORECAST LEAD 24
With no further info about the RegridDataPlane step, it moves on to
metplus.GridStat, and (unsurprisingly) cannot find the verifying
analysis in the qpe_grib/regrid/.
I tried the two use cases in
/global/noscrub/Julie.Prestopnik/METplus/METplus-
2.0.4/parm/use_cases/qpf/examples,
phpt-vs-s4grib.conf and ruc-vs-s2grib.conf, they both do work (though
the latter was re-gridding from G212 to the same G212), e.g. in the
attached phpt.out (successful RegridDataPlane), it's got
03/12 18:01:11.883 metplus.RegridDataPlane
(reformat_gridded_wrapper.py:75) INFO: PROCESSING OBS DATA
03/12 18:01:11.883 metplus.RegridDataPlane
(reformat_gridded_wrapper.py:78) INFO: PROCESSING FORECAST LEAD 3
03/12 18:01:11.885 metplus.RegridDataPlane (command_runner.py:222)
DEBUG: LOG_MET_OUTPUT_TO_METPLUS log file is True ...
So there is something in my fv3gfs test setup that prevented it from
moving on to the "command_runner.py:222" step. I tried comparing my
fv3gfs_24h.conf with the use case samples phpt-vs-s4grib.conf and
ruc-vs-s2grib.conf, and couldn't see what I did wrong. I'm running
out
of ideas. Would you mind taking a look at this?
I tried running the MET regrid_data_plane manually (regridit.ksh)
using
the metplus.PcpCombine output, and it worked fine.
Thank you -
Ying
On 3/11/19 12:23 PM, George McCabe via RT wrote:
> Hi Ying,
>
> Using the new version of METplus, you will see the following error:
>
> ERROR: Threshold values must start with
>,>=,==,!=,<,<=,gt,ge,eq,ne,lt, or
> le
>
> If you add a comparison operator to each item of your
FCST_VAR1_THRESH
> list, this error will go away. The old default operator was >=, so
adding
> that would preserve the old behavior if that is what you want.
>
> You will also see some warnings of METplus variables being
deprecated. You
> can change the name of these variables to get rid of those warnings.
The
> warning description should be clear.
>
> When I ran your config file, METplus built the following command:
>
> /usr/local/met-8.0/bin/pcp_combine -name APCP_24 -add
>
/d1/mccabe/ying_data/com2/ccpa/prod/ccpa.20190310/12/ccpa.t12z.06h.hrap.conus.gb2
> 6
>
/d1/mccabe/ying_data/com2/ccpa/prod/ccpa.20190310/06/ccpa.t06z.06h.hrap.conus.gb2
> 6
>
/d1/mccabe/ying_data/com2/ccpa/prod/ccpa.20190310/00/ccpa.t00z.06h.hrap.conus.gb2
> 6
>
/d1/mccabe/ying_data/com2/ccpa/prod/ccpa.20190309/18/ccpa.t18z.06h.hrap.conus.gb2
> 6
/d1/mccabe/ying_data/out/qpe_grib/bucket/20190310/ccpa.2019031012_A24h
-v
> 2
>
> Let me know if you have any other issues.
>
> Thanks,
> George
>
> On Mon, Mar 11, 2019 at 9:48 AM Ying Lin via RT <met_help at ucar.edu>
wrote:
>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=89063 >
>>
>> Hi George,
>>
>> First of all, thank you for telling me about passing the
envir
>> variable using {ENV[vday]}, that was really useful!
>>
>> Still have trouble "finding" the CCPA files. I've first
changed
>> the OBS_LEVEL=6, when that didn't work, I explicitly specified the
'06h'
>> in the file name in the config, e.g.
>>
>> OBS_PCP_COMBINE_INPUT_TEMPLATE =
>>
>>
ccpa.{valid?fmt=%Y%m%d}/{valid?fmt=%H}/ccpa.t{valid?fmt=%H}z.06h.hrap.conus.gb2
>>
>> Still getting the "WARNING: pcp_combine: Could not find files to
compute
>> accumulation in /com2/ccpa/prod" in the job output and the log file
>> (both attached to this email, as well as the config file). Also
>> attached are the four 6h CCPA files with their full paths, e.g.
>> t10a1 $ tar cvfz /stmpp1/Ying.Lin/ccpa.tar.gz
>> /com2/ccpa/prod/ccpa.20190309/18/ccpa.*06h.hrap.conus.gb2
>> /com2/ccpa/prod/ccpa.20190310/*/ccpa.*06h.hrap.conus.gb2
>> tar: Removing leading `/' from member names
>> /com2/ccpa/prod/ccpa.20190309/18/ccpa.t18z.06h.hrap.conus.gb2
>> /com2/ccpa/prod/ccpa.20190310/00/ccpa.t00z.06h.hrap.conus.gb2
>> /com2/ccpa/prod/ccpa.20190310/06/ccpa.t06z.06h.hrap.conus.gb2
>> /com2/ccpa/prod/ccpa.20190310/12/ccpa.t12z.06h.hrap.conus.gb2
>>
>> Thanks again -
>>
>> Ying
>>
>> On 3/11/19 10:47 AM, George McCabe via RT wrote:
>>> Hi Ying,
>>>
>>> I was incorrect that you need to change the precision. %H should
find the
>>> time the way it is formatted. I think you will need to remove
OBS_LEVEL
>> = 1
>>> from your config. This variable tells METplus to only look for 1
hr
>>> accumulation files to use in pcp_combine. If you remove this
variable, it
>>> should look for a 24 hr accumulation file and reduce the hour by 1
until
>> it
>>> finds a file that it can use. If you want to force METplus to use
6 hour
>>> files to build the 24 hr accumulation, you should set OBS_LEVEL =
6. Let
>> me
>>> know if that helps.
>>>
>>> Thanks,
>>> George
>>>
>>> On Mon, Mar 11, 2019 at 8:30 AM George McCabe <mccabe at ucar.edu>
wrote:
>>>
>>>> Hi Ying,
>>>>
>>>> You may need to change %H to %.2H in the template to tell it that
there
>>>> will always be 2 digit precision. If that doesn't work, could you
send
>> me
>>>> the directory listing so I can see what files are available?
>>>>
>>>> To pass in environment variables, use the following notation:
>> {ENV[vday]}.
>>>> You are correct that using valid hour for the directory name will
not
>>>> work, as it will change the value to 03. If this value is going
to
>> change
>>>> between runs and doesn't directly correspond to the valid time,
you may
>>>> have to trick it with environment variables to get it to work
correctly.
>>>>
>>>> On Thu, Mar 7, 2019 at 1:33 PM Ying Lin via RT
<met_help at ucar.edu>
>> wrote:
>>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=89063 >
>>>>>
>>>>> Hi George,
>>>>>
>>>>> Thanks! That makes sense, though it didn't quite work
out for
>> me.
>>>>> In the attached fv3gfs_24h_by_valid_time.conf, I have
>>>>> OBS_PCP_COMBINE_INPUT_DIR = /com2/ccpa/prod
>>>>> then
>>>>> OBS_PCP_COMBINE_INPUT_TEMPLATE =
>>>>>
>>>>>
>>
ccpa.{valid?fmt=%Y%m%d}/{valid?fmt=%H}/ccpa.t{valid?fmt=%H}z.{level?fmt=%.2H}h.hrap.conus.gb2
>>>>> thinking that it would tell pcp_combine to look for e,g,
>>>>> /com2/ccpa/prod/ccpa.20190305/06/ccpa.t06z.06h.hrap.conus.gb2
>>>>>
>>>>> Instead I'm getting "WARNING: pcp_combine: Could not find files
to
>>>>> compute accumulation in /com2/ccpa/prod" (in the attached
test.out and
>>>>> master_metplus.log.20190307).
>>>>>
>>>>> Could you tell what I'm doing wrong in the config?
>>>>>
>>>>> I'm doing the above in
Tide:/meso/save/Ying.Lin/metplus/test/.
>>>>>
>>>>> Also two related questions:
>>>>> 1) In the METplus model config files I've seen (like in the
attached
>>>>> config), the VALID_BEG and VALID_END are set in the config file.
Is
>>>>> there an easy way to set and export the VALID_* variable from a
script?
>>>>> For example I've tried "export vday=20190305" in the
>> test_fv3gfs_24h.ksh
>>>>> and in the config file set
>>>>> VALID_BEG = "${vday}"12 (same for VALID_END)
>>>>> and
>>>>> VALID_BEG = ${vday}12
>>>>> and
>>>>> VALID_BEG = {vday}12
>>>>> none of the above worked. What's the right way to do this?
>>>>>
>>>>> 2) In the CCPA directory of /com2/ccpa/prod/ccpa.20190305/06/,
the '06'
>>>>> subdir seems to contain all CCPA analysis files with valid times
from
>>>>> 01Z-06Z. So for 6h analysis, the '06' in the subdir is just the
valid
>>>>> hour. But if I do 3-hourly verification using the 3-hourly CCPA
files,
>>>>> the above directory also contains ccpa.t03z.03h.hrap.conus.gb2
(valid
>> at
>>>>> 03Z) and ccpa.t06z.03h.hrap.conus.gb2 (valid at 06Z). In that
case i
>>>>> don't think the
>>>>>
>>>>>
>>
ccpa.{valid?fmt=%Y%m%d}/{valid?fmt=%H}/ccpa.t{valid?fmt=%H}z.{level?fmt=%.2H}h.hrap.conus.gb2
>>>>> would work, would it?
>>>>>
>>>>> Thanks again,
>>>>>
>>>>> Ying
>>>>>
>>>>>
>>>>> On 3/6/19 10:29 AM, George McCabe via RT wrote:
>>>>>> Hi Ying Lin,
>>>>>>
>>>>>> You should be able to use a template that looks something like
this:
>>>>>>
>>>>>>
>>
"ccpa.{valid?fmt=%Y%m%d}/06/ccpa.t{valid?fmt=%H}z.{level?fmt=%.2H}h.hrap.conus.gb2"
>>>>>> The 'level' item corresponds to the accumulation amount. %.2H
>> specifies
>>>>>> that the filename has 2 digits of precision for that value. I
wasn't
>>>>> sure
>>>>>> what the '06' subdirectory corresponds to, but if necessary you
can
>>>>>> substitute that with formatting so that it will be dynamic. Let
me
>> know
>>>>> if
>>>>>> that doesn't work and I can help figure out what will.
>>>>>>
>>>>>> Thanks,
>>>>>> George
>>>>>>
>>>>>> On Mon, Feb 25, 2019 at 11:09 AM Ying Lin via RT
<met_help at ucar.edu>
>>>>> wrote:
>>>>>>> Mon Feb 25 11:08:35 2019: Request 89063 was acted upon.
>>>>>>> Transaction: Ticket created by ying.lin at noaa.gov
>>>>>>> Queue: met_help
>>>>>>> Subject: CCPA file name format for METplus
>>>>>>> Owner: Nobody
>>>>>>> Requestors: ying.lin at noaa.gov
>>>>>>> Status: new
>>>>>>> Ticket <URL:
>> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=89063
>>>>>>> Hello. I see that
>>>>>>>
>>>>>>>
>>
https://github.com/NCAR/METplus/blob/master/parm/use_cases/grid_to_grid/examples/precip.conf
>>>>>>> has
>>>>>>> OBS_GRID_STAT_INPUT_TEMPLATE =
>> ccpa_conus_1.0d_{valid?fmt=%Y%m%d}
>>>>>>> CCPA output on wcoss has file names like
>>>>>>>
/com2/ccpa/prod/ccpa.20190224/06/ccpa.t03z.03h.hrap.conus.gb2
>>>>>>> which is 3h accumulation valid at 03Z 2019/02/24
>>>>>>> and ccpa.t06z.06h.hrap.conus.gb2
>>>>>>> which is 6h accumulation valid at 06Z 2019/02/24
>>>>>>>
>>>>>>> Does METplus already have the capability to handle the CCPA in
its
>>>>>>> 'native' directory/name format, as in the /com2/* directory
above?
>> In
>>>>>>> my verif scripts I do
>>>>>>> cp $COMCCPA.$vday/06/ccpa.t03z.03h.hrap.conus.gb2
>>>>> ccpa.${vday}03.03h.gb2
>>>>>>> If METplus can already handle this bit of pre-processing, or
if this
>>>>> can
>>>>>>> be added to the wish list, that'll be great. Thanks!
>>>>>>>
>>>>>>> Ying
>>>>>>>
>>>>>>> --
>>>>>>> Ying Lin
>>>>>>> NCEP/EMC/Verification, Post-processing and Product Generation
Branch
>>>>>>> NCWCP Cubicle No. 2015
>>>>>>> Ying.Lin at noaa.gov
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>> --
>>>>> Ying Lin
>>>>> NCEP/EMC/Verification, Post-processing and Product Generation
Branch
>>>>> NCWCP Cubicle No. 2015
>>>>> Ying.Lin at noaa.gov
>>>>>
>>>>>
>>>>>
>>>>>
>> --
>> Ying Lin
>> NCEP/EMC/Verification, Post-processing and Product Generation
Branch
>> NCWCP Cubicle No. 2015
>> Ying.Lin at noaa.gov
>>
>>
>>
>>
--
Ying Lin
NCEP/EMC/Verification, Post-processing and Product Generation Branch
NCWCP Cubicle No. 2015
Ying.Lin at noaa.gov
------------------------------------------------
Subject: CCPA file name format for METplus
From: Ying Lin
Time: Tue Mar 12 14:19:38 2019
+ . /u/Ying.Lin/dot.for.metplus
+ . /usrx/local/Modules/default/init/ksh
+ [ 3.2.10 '=' '' ]
+ MODULE_VERSION_STACK=3.2.10
+ export MODULE_VERSION_STACK
+ MODULESHOME=/usrx/local/Modules/3.2.10
+ export MODULESHOME
+ [
EnvVars/1.0.1:ibmpe/1.3.0.12:lsf/9.1:ics/12.1:anaconda2/latest:hpss/4.0.1.2:GrADS/2.0.2:HDF5/1.8.9/serial:NetCDF/4.2/serial
'=' '' ]
+ [
'/usrx/local/Modules/versions:/usrx/local/Modules/$MODULE_VERSION/modulefiles:/usrx/local/modulefiles:/nwprod2/modulefiles:/nwprod2/lib/modulefiles:/nwprod/lib/modulefiles:/u/Benjamin.Blake/modulefiles'
'=' '' ]
+ module purge
+ /usrx/local/Modules/3.2.10/bin/modulecmd ksh purge
+ eval MANPATH=/usr/share/man ';export'
'MANPATH;PATH=.:/nwprod/gempak/nawips/os/linux2.6.32_x86_64/bin:/usr/lib64/qt-
3.3/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/opt/ibutils/bin:/nwprod/util/exec::/nwprod/util/ush::/u/Wesley.Ebisuzaki/bin:/u/Ying.Lin/bin:/nwprod/gempak/nawips/bin:/nwprod/gempak/nawips/scripts/ez:/nwprod/gempak/nawips/scripts/nawips:/nwprod/gempak/nawips/scripts/prnt:/nwprod/gempak/nawips/scripts/decoder:/sss/emc/meso/shared/Eric.Rogers/ddapp/exe_lnx6:/sss/emc/meso/shared/Eric.Rogers/vsdb/scripts'
';export' 'PATH;unset' 'CLASSPATH;unset' 'CPATH;unset'
'CPRO_PATH;unset' 'FPATH;unset' 'GADDIR;unset' 'GrADS_ROOT;unset'
'HDF5;unset' 'HDF5_CFLAGS;unset' 'HDF5_CXXFLAGS;unset'
'HDF5_FFLAGS;unset' 'HDF5_INCLUDE;unset' 'HDF5_LDFLAGS;unset'
'HDF5_LDFLAGS_C;unset' 'HDF5_LDFLAGS_CXX;unset' 'HDF5_LDFLAGS_F;unset'
'IDB_HOME;unset' 'INCLUDE;unset' 'INSTALL_DIR;unset'
'INTEL_LICENSE_FILE;unset' 'IPPROOT;unset' 'I_MPI_INC;unset'
'I_MPI_ROOT;unset' 'LANG;unset' 'LAUNCH;unset' 'LD_LIBRARY_PATH;unset'
'LIBRARY_PATH;unset' 'LOADEDMODULES;unset' 'LSF_BINDIR;unset'
'LSF_ENVDIR;unset' 'LSF_LIBDIR;unset' 'LSF_SERVERDIR;unset'
'MKLROOT;unset' 'MKL_TARGET_ARCH;unset' 'MP_CLOCK_SOURCE;unset'
'MP_COMPILER;unset' 'MP_CONFIG;unset' 'MP_EUILIB;unset'
'MP_MPILIB;unset' 'NETCDF;unset' 'NETCDF_CFLAGS;unset'
'NETCDF_CXXFLAGS;unset' 'NETCDF_FFLAGS;unset' 'NETCDF_INCLUDE;unset'
'NETCDF_LDFLAGS;unset' 'NETCDF_LDFLAGS_C;unset'
'NETCDF_LDFLAGS_CXX;unset' 'NETCDF_LDFLAGS_F;unset' 'NLSPATH;unset'
'OMP_NUM_THREADS;unset' 'PROD_DIR;unset' 'PYTHONPATH;unset'
'SITE;unset' 'TBBROOT;unset' 'VT_LIB_DIR;unset' 'VT_ROOT;unset'
'VT_SLIB_DIR;unset' 'XLSF_UIDDIR;unset' '_LMFILES_;'
+ MANPATH=/usr/share/man
+ export MANPATH
+
PATH=.:/nwprod/gempak/nawips/os/linux2.6.32_x86_64/bin:/usr/lib64/qt-
3.3/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/opt/ibutils/bin:/nwprod/util/exec::/nwprod/util/ush::/u/Wesley.Ebisuzaki/bin:/u/Ying.Lin/bin:/nwprod/gempak/nawips/bin:/nwprod/gempak/nawips/scripts/ez:/nwprod/gempak/nawips/scripts/nawips:/nwprod/gempak/nawips/scripts/prnt:/nwprod/gempak/nawips/scripts/decoder:/sss/emc/meso/shared/Eric.Rogers/ddapp/exe_lnx6:/sss/emc/meso/shared/Eric.Rogers/vsdb/scripts
+ export PATH
+ unset CLASSPATH
+ unset CPATH
+ unset CPRO_PATH
+ unset FPATH
+ unset GADDIR
+ unset GrADS_ROOT
+ unset HDF5
+ unset HDF5_CFLAGS
+ unset HDF5_CXXFLAGS
+ unset HDF5_FFLAGS
+ unset HDF5_INCLUDE
+ unset HDF5_LDFLAGS
+ unset HDF5_LDFLAGS_C
+ unset HDF5_LDFLAGS_CXX
+ unset HDF5_LDFLAGS_F
+ unset IDB_HOME
+ unset INCLUDE
+ unset INSTALL_DIR
+ unset INTEL_LICENSE_FILE
+ unset IPPROOT
+ unset I_MPI_INC
+ unset I_MPI_ROOT
+ unset LANG
+ unset LAUNCH
+ unset LD_LIBRARY_PATH
+ unset LIBRARY_PATH
+ unset LOADEDMODULES
+ unset LSF_BINDIR
+ unset LSF_ENVDIR
+ unset LSF_LIBDIR
+ unset LSF_SERVERDIR
+ unset MKLROOT
+ unset MKL_TARGET_ARCH
+ unset MP_CLOCK_SOURCE
+ unset MP_COMPILER
+ unset MP_CONFIG
+ unset MP_EUILIB
+ unset MP_MPILIB
+ unset NETCDF
+ unset NETCDF_CFLAGS
+ unset NETCDF_CXXFLAGS
+ unset NETCDF_FFLAGS
+ unset NETCDF_INCLUDE
+ unset NETCDF_LDFLAGS
+ unset NETCDF_LDFLAGS_C
+ unset NETCDF_LDFLAGS_CXX
+ unset NETCDF_LDFLAGS_F
+ unset NLSPATH
+ unset OMP_NUM_THREADS
+ unset PROD_DIR
+ unset PYTHONPATH
+ unset SITE
+ unset TBBROOT
+ unset VT_LIB_DIR
+ unset VT_ROOT
+ unset VT_SLIB_DIR
+ unset XLSF_UIDDIR
+ unset _LMFILES_
+ module use /global/noscrub/Julie.Prestopnik/modulefiles
+ /usrx/local/Modules/3.2.10/bin/modulecmd ksh use
/global/noscrub/Julie.Prestopnik/modulefiles
+ eval
MODULEPATH='/global/noscrub/Julie.Prestopnik/modulefiles:/usrx/local/Modules/versions:/usrx/local/Modules/\$MODULE_VERSION/modulefiles:/usrx/local/modulefiles:/nwprod2/modulefiles:/nwprod2/lib/modulefiles:/nwprod/lib/modulefiles:/u/Benjamin.Blake/modulefiles'
';export' 'MODULEPATH;'
+
MODULEPATH='/global/noscrub/Julie.Prestopnik/modulefiles:/usrx/local/Modules/versions:/usrx/local/Modules/$MODULE_VERSION/modulefiles:/usrx/local/modulefiles:/nwprod2/modulefiles:/nwprod2/lib/modulefiles:/nwprod/lib/modulefiles:/u/Benjamin.Blake/modulefiles'
+ export MODULEPATH
+ module load met/8.0
+ /usrx/local/Modules/3.2.10/bin/modulecmd ksh load met/8.0
+ eval ADVISOR_XE_2015_DIR=/usrx/local/intel/2015/advisor_xe_2015
';export' 'ADVISOR_XE_2015_DIR;BIN_DIR=bin64' ';export'
'BIN_DIR;CLASSPATH=/usrx/local/intel/2015/itac_latest/lib' ';export'
'CLASSPATH;CPATH=/usrx/local/intel/2015/ipp/include:/usrx/local/intel/2015/mkl/include:/usrx/local/intel/2015/tbb/include'
';export'
'CPATH;CPRO_PATH=/usrx/local/intel/2015/composer_xe_2015.3.187'
';export'
'CPRO_PATH;GDBSERVER_MIC=/usrx/local/intel/2015/composerxe/debugger/gdb/target/mic/bin/gdbserver'
';export'
'GDBSERVER_MIC;GDB_CROSS=/usrx/local/intel/2015/composerxe/debugger/gdb/intel64_mic/bin/gdb-
mic' ';export' 'GDB_CROSS;INCLUDE=/usrx/local/intel/2015/mkl/include'
';export'
'INCLUDE;INFOPATH=/usrx/local/intel/2015/composerxe/debugger/gdb/intel64/share/info:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64_mic/share/info'
';export'
'INFOPATH;INSPECTOR_2015_DIR=/usrx/local/intel/2015/inspector_xe_2015'
';export'
'INSPECTOR_2015_DIR;INTEL_LICENSE_FILE=/usrx/local/intel/licenses'
';export'
'INTEL_LICENSE_FILE;INTEL_PYTHONHOME=/usrx/local/intel/2015/composerxe/debugger/python/intel64'
';export' 'INTEL_PYTHONHOME;IPPROOT=/usrx/local/intel/2015/ipp'
';export' 'IPPROOT;I_MPI_HYDRA_IFACE=ib0' ';export'
'I_MPI_HYDRA_IFACE;I_MPI_INC=/usrx/local/intel/2015/impi_latest/include64'
';export' 'I_MPI_INC;I_MPI_ROOT=/usrx/local/intel/2015/impi_latest'
';export' 'I_MPI_ROOT;LANGUAGE_TERRITORY=en_US' ';export'
'LANGUAGE_TERRITORY;LD_LIBRARY_PATH=/global/noscrub/Julie.Prestopnik/met/8.0/external_libs/lib:/usrx/local/dev/python/2.7.14/lib:/usrx/local/intel/2015/impi_latest/intel64/lib:/usrx/local/intel/2015/itac_latest/mic/slib:/usrx/local/intel/2015/itac_latest/intel64/slib:/usrx/local/intel/2015/composerxe/lib/intel64:/usrx/local/intel/2015/mpirt/lib/intel64:/usrx/local/intel/2015/ipp/lib/intel64:/usrx/local/intel/2015/mkl/lib/intel64:/usrx/local/intel/2015/tbb/lib/intel64/gcc4.4'
';export'
'LD_LIBRARY_PATH;LIBRARY_PATH=/usrx/local/intel/2015/composerxe/lib/intel64:/usrx/local/intel/2015/ipp/lib/intel64:/usrx/local/intel/2015/mkl/lib/intel64:/usrx/local/intel/2015/tbb/lib/intel64/gcc4.4'
';export'
'LIBRARY_PATH;LOADEDMODULES=ics/15.0.3:python/2.7.14:met/8.0'
';export'
'LOADEDMODULES;MANPATH=/usrx/local/dev/python/2.7.14/share/man:/usrx/local/intel/2015/impi_latest/man:/usrx/local/intel/2015/itac_latest/man:/usrx/local/intel/2015/composerxe/man/en_US:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64/share/man:/usr/share/man:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64_mic/share/man:/usrx/local/intel/2015/inspector_xe_2015/man:/usrx/local/intel/2015/vtune_amplifier_xe_2015/man:/usrx/local/intel/2015/advisor_xe_2015/man'
';export'
'MANPATH;MIC_LD_LIBRARY_PATH=/usrx/local/intel/2015/composerxe/lib/mic:/usrx/local/intel/2015/mpirt/lib/mic:/usrx/local/intel/2015/mkl/lib/mic:/usrx/local/intel/2015/tbb/lib/mic'
';export'
'MIC_LD_LIBRARY_PATH;MIC_LIBRARY_PATH=/usrx/local/intel/2015/composerxe/lib/mic:/usrx/local/intel/2015/mpirt/lib/mic:/usrx/local/intel/2015/tbb/lib/mic'
';export' 'MIC_LIBRARY_PATH;MKLROOT=/usrx/local/intel/2015/mkl'
';export'
'MKLROOT;MODULEPATH=/usrx/local/dev/modulefiles:/global/noscrub/Julie.Prestopnik/modulefiles:/usrx/local/Modules/versions:/usrx/local/Modules/\$MODULE_VERSION/modulefiles:/usrx/local/modulefiles:/nwprod2/modulefiles:/nwprod2/lib/modulefiles:/nwprod/lib/modulefiles:/u/Benjamin.Blake/modulefiles'
';export'
'MODULEPATH;MPM_LAUNCHER=/usrx/local/intel/2015/composerxe/debugger/mpm/bin/start_mpm.sh'
';export'
'MPM_LAUNCHER;NLSPATH=/usrx/local/intel/2015/composerxe/lib/intel64/locale/%l_%t/%N:/usrx/local/intel/2015/ipp/lib/intel64/locale/%l_%t/%N:/usrx/local/intel/2015/mkl/lib/intel64/locale/%l_%t/%N:/usrx/local/intel/2015/composer_xe_2015.3.187/debugger/gdb/intel64_mic/share/locale/%l_%t/%N:/usrx/local/intel/2015/composer_xe_2015.3.187/debugger/gdb/intel64/share/locale/%l_%t/%N'
';export'
'NLSPATH;PATH=/global/noscrub/Julie.Prestopnik/met/8.0//bin:/global/noscrub/Julie.Prestopnik/met/8.0/external_libs/bin:/usrx/local/dev/python/2.7.14/bin:/usrx/local/intel/2015/advisor_xe_2015/bin64:/usrx/local/intel/2015/vtune_amplifier_xe_2015/bin64:/usrx/local/intel/2015/inspector_xe_2015/bin64:/usrx/local/intel/2015/impi_latest/intel64/bin:/usrx/local/intel/2015/itac_latest/intel64/bin:/usrx/local/intel/2015/composer_xe_2015.3.187/bin/intel64:/usrx/local/intel/2015/mpirt/bin/intel64:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64_mic/bin:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64/bin:.:/nwprod/gempak/nawips/os/linux2.6.32_x86_64/bin:/usr/lib64/qt-
3.3/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/opt/ibutils/bin:/nwprod/util/exec::/nwprod/util/ush::/u/Wesley.Ebisuzaki/bin:/u/Ying.Lin/bin:/nwprod/gempak/nawips/bin:/nwprod/gempak/nawips/scripts/ez:/nwprod/gempak/nawips/scripts/nawips:/nwprod/gempak/nawips/scripts/prnt:/nwprod/gempak/nawips/scripts/decoder:/sss/emc/meso/shared/Eric.Rogers/ddapp/exe_lnx6:/sss/emc/meso/shared/Eric.Rogers/vsdb/scripts'
';export' 'PATH;PROD_DIR=/usrx/local/intel/2015/composerxe' ';export'
'PROD_DIR;ROOTPATH=/usrx/local/intel/2015' ';export'
'ROOTPATH;SCRIPTPATH=/usrx/local/intel/2015' ';export'
'SCRIPTPATH;TBBROOT=/usrx/local/intel/2015/tbb' ';export'
'TBBROOT;VTUNE_AMPLIFIER_XE_2015_DIR=/usrx/local/intel/2015/vtune_amplifier_xe_2015'
';export' 'VTUNE_AMPLIFIER_XE_2015_DIR;VT_ADD_LIBS=-ldwarf\' '-lelf\'
'-lvtunwind\' '-lnsl\' '-lm\' '-ldl\' -lpthread ';export'
'VT_ADD_LIBS;VT_ARCH=intel64' ';export'
'VT_ARCH;VT_LIB_DIR=/usrx/local/intel/2015/itac_latest/lib' ';export'
'VT_LIB_DIR;VT_MIC_SLIB_DIR=/usrx/local/intel/2015/itac_latest/mic/slib'
';export' 'VT_MIC_SLIB_DIR;VT_MPI=impi4' ';export'
'VT_MPI;VT_ROOT=/usrx/local/intel/2015/itac_latest' ';export'
'VT_ROOT;VT_SLIB_DIR=/usrx/local/intel/2015/itac_latest/intel64/slib'
';export'
'VT_SLIB_DIR;_LMFILES_=/usrx/local/modulefiles/ics/15.0.3:/usrx/local/dev/modulefiles/python/2.7.14:/global/noscrub/Julie.Prestopnik/modulefiles/met/8.0'
';export' '_LMFILES_;'
+ ADVISOR_XE_2015_DIR=/usrx/local/intel/2015/advisor_xe_2015
+ export ADVISOR_XE_2015_DIR
+ BIN_DIR=bin64
+ export BIN_DIR
+ CLASSPATH=/usrx/local/intel/2015/itac_latest/lib
+ export CLASSPATH
+
CPATH=/usrx/local/intel/2015/ipp/include:/usrx/local/intel/2015/mkl/include:/usrx/local/intel/2015/tbb/include
+ export CPATH
+ CPRO_PATH=/usrx/local/intel/2015/composer_xe_2015.3.187
+ export CPRO_PATH
+
GDBSERVER_MIC=/usrx/local/intel/2015/composerxe/debugger/gdb/target/mic/bin/gdbserver
+ export GDBSERVER_MIC
+
GDB_CROSS=/usrx/local/intel/2015/composerxe/debugger/gdb/intel64_mic/bin/gdb-
mic
+ export GDB_CROSS
+ INCLUDE=/usrx/local/intel/2015/mkl/include
+ export INCLUDE
+
INFOPATH=/usrx/local/intel/2015/composerxe/debugger/gdb/intel64/share/info:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64_mic/share/info
+ export INFOPATH
+ INSPECTOR_2015_DIR=/usrx/local/intel/2015/inspector_xe_2015
+ export INSPECTOR_2015_DIR
+ INTEL_LICENSE_FILE=/usrx/local/intel/licenses
+ export INTEL_LICENSE_FILE
+
INTEL_PYTHONHOME=/usrx/local/intel/2015/composerxe/debugger/python/intel64
+ export INTEL_PYTHONHOME
+ IPPROOT=/usrx/local/intel/2015/ipp
+ export IPPROOT
+ I_MPI_HYDRA_IFACE=ib0
+ export I_MPI_HYDRA_IFACE
+ I_MPI_INC=/usrx/local/intel/2015/impi_latest/include64
+ export I_MPI_INC
+ I_MPI_ROOT=/usrx/local/intel/2015/impi_latest
+ export I_MPI_ROOT
+ LANGUAGE_TERRITORY=en_US
+ export LANGUAGE_TERRITORY
+
LD_LIBRARY_PATH=/global/noscrub/Julie.Prestopnik/met/8.0/external_libs/lib:/usrx/local/dev/python/2.7.14/lib:/usrx/local/intel/2015/impi_latest/intel64/lib:/usrx/local/intel/2015/itac_latest/mic/slib:/usrx/local/intel/2015/itac_latest/intel64/slib:/usrx/local/intel/2015/composerxe/lib/intel64:/usrx/local/intel/2015/mpirt/lib/intel64:/usrx/local/intel/2015/ipp/lib/intel64:/usrx/local/intel/2015/mkl/lib/intel64:/usrx/local/intel/2015/tbb/lib/intel64/gcc4.4
+ export LD_LIBRARY_PATH
+
LIBRARY_PATH=/usrx/local/intel/2015/composerxe/lib/intel64:/usrx/local/intel/2015/ipp/lib/intel64:/usrx/local/intel/2015/mkl/lib/intel64:/usrx/local/intel/2015/tbb/lib/intel64/gcc4.4
+ export LIBRARY_PATH
+ LOADEDMODULES=ics/15.0.3:python/2.7.14:met/8.0
+ export LOADEDMODULES
+
MANPATH=/usrx/local/dev/python/2.7.14/share/man:/usrx/local/intel/2015/impi_latest/man:/usrx/local/intel/2015/itac_latest/man:/usrx/local/intel/2015/composerxe/man/en_US:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64/share/man:/usr/share/man:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64_mic/share/man:/usrx/local/intel/2015/inspector_xe_2015/man:/usrx/local/intel/2015/vtune_amplifier_xe_2015/man:/usrx/local/intel/2015/advisor_xe_2015/man
+ export MANPATH
+
MIC_LD_LIBRARY_PATH=/usrx/local/intel/2015/composerxe/lib/mic:/usrx/local/intel/2015/mpirt/lib/mic:/usrx/local/intel/2015/mkl/lib/mic:/usrx/local/intel/2015/tbb/lib/mic
+ export MIC_LD_LIBRARY_PATH
+
MIC_LIBRARY_PATH=/usrx/local/intel/2015/composerxe/lib/mic:/usrx/local/intel/2015/mpirt/lib/mic:/usrx/local/intel/2015/tbb/lib/mic
+ export MIC_LIBRARY_PATH
+ MKLROOT=/usrx/local/intel/2015/mkl
+ export MKLROOT
+
MODULEPATH='/usrx/local/dev/modulefiles:/global/noscrub/Julie.Prestopnik/modulefiles:/usrx/local/Modules/versions:/usrx/local/Modules/$MODULE_VERSION/modulefiles:/usrx/local/modulefiles:/nwprod2/modulefiles:/nwprod2/lib/modulefiles:/nwprod/lib/modulefiles:/u/Benjamin.Blake/modulefiles'
+ export MODULEPATH
+
MPM_LAUNCHER=/usrx/local/intel/2015/composerxe/debugger/mpm/bin/start_mpm.sh
+ export MPM_LAUNCHER
+
NLSPATH=/usrx/local/intel/2015/composerxe/lib/intel64/locale/%l_%t/%N:/usrx/local/intel/2015/ipp/lib/intel64/locale/%l_%t/%N:/usrx/local/intel/2015/mkl/lib/intel64/locale/%l_%t/%N:/usrx/local/intel/2015/composer_xe_2015.3.187/debugger/gdb/intel64_mic/share/locale/%l_%t/%N:/usrx/local/intel/2015/composer_xe_2015.3.187/debugger/gdb/intel64/share/locale/%l_%t/%N
+ export NLSPATH
+
PATH=/global/noscrub/Julie.Prestopnik/met/8.0//bin:/global/noscrub/Julie.Prestopnik/met/8.0/external_libs/bin:/usrx/local/dev/python/2.7.14/bin:/usrx/local/intel/2015/advisor_xe_2015/bin64:/usrx/local/intel/2015/vtune_amplifier_xe_2015/bin64:/usrx/local/intel/2015/inspector_xe_2015/bin64:/usrx/local/intel/2015/impi_latest/intel64/bin:/usrx/local/intel/2015/itac_latest/intel64/bin:/usrx/local/intel/2015/composer_xe_2015.3.187/bin/intel64:/usrx/local/intel/2015/mpirt/bin/intel64:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64_mic/bin:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64/bin:.:/nwprod/gempak/nawips/os/linux2.6.32_x86_64/bin:/usr/lib64/qt-
3.3/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/opt/ibutils/bin:/nwprod/util/exec::/nwprod/util/ush::/u/Wesley.Ebisuzaki/bin:/u/Ying.Lin/bin:/nwprod/gempak/nawips/bin:/nwprod/gempak/nawips/scripts/ez:/nwprod/gempak/nawips/scripts/nawips:/nwprod/gempak/nawips/scripts/prnt:/nwprod/gempak/nawips/scripts/decoder:/sss/emc/meso/shared/Eric.Rogers/ddapp/exe_lnx6:/sss/emc/meso/shared/Eric.Rogers/vsdb/scripts
+ export PATH
+ PROD_DIR=/usrx/local/intel/2015/composerxe
+ export PROD_DIR
+ ROOTPATH=/usrx/local/intel/2015
+ export ROOTPATH
+ SCRIPTPATH=/usrx/local/intel/2015
+ export SCRIPTPATH
+ TBBROOT=/usrx/local/intel/2015/tbb
+ export TBBROOT
+
VTUNE_AMPLIFIER_XE_2015_DIR=/usrx/local/intel/2015/vtune_amplifier_xe_2015
+ export VTUNE_AMPLIFIER_XE_2015_DIR
+ VT_ADD_LIBS='-ldwarf -lelf -lvtunwind -lnsl -lm -ldl -lpthread'
+ export VT_ADD_LIBS
+ VT_ARCH=intel64
+ export VT_ARCH
+ VT_LIB_DIR=/usrx/local/intel/2015/itac_latest/lib
+ export VT_LIB_DIR
+ VT_MIC_SLIB_DIR=/usrx/local/intel/2015/itac_latest/mic/slib
+ export VT_MIC_SLIB_DIR
+ VT_MPI=impi4
+ export VT_MPI
+ VT_ROOT=/usrx/local/intel/2015/itac_latest
+ export VT_ROOT
+ VT_SLIB_DIR=/usrx/local/intel/2015/itac_latest/intel64/slib
+ export VT_SLIB_DIR
+
_LMFILES_=/usrx/local/modulefiles/ics/15.0.3:/usrx/local/dev/modulefiles/python/2.7.14:/global/noscrub/Julie.Prestopnik/modulefiles/met/8.0
+ export _LMFILES_
+ module load nco
+ /usrx/local/Modules/3.2.10/bin/modulecmd ksh load nco
+ eval LOADEDMODULES=ics/15.0.3:python/2.7.14:met/8.0:nco/4.2.4
';export'
'LOADEDMODULES;MANPATH=/usrx/local/nco/4.2.4/share/man:/usrx/local/dev/python/2.7.14/share/man:/usrx/local/intel/2015/impi_latest/man:/usrx/local/intel/2015/itac_latest/man:/usrx/local/intel/2015/composerxe/man/en_US:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64/share/man:/usr/share/man:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64_mic/share/man:/usrx/local/intel/2015/inspector_xe_2015/man:/usrx/local/intel/2015/vtune_amplifier_xe_2015/man:/usrx/local/intel/2015/advisor_xe_2015/man'
';export' 'MANPATH;NCO_INCLUDE=-I/usrx/local/nco/4.2.4/include'
';export' 'NCO_INCLUDE;NCO_LDFLAGS_C=-L/usrx/local/nco/4.2.4/lib'
';export' 'NCO_LDFLAGS_C;NCO_LDFLAGS_CXX=-L/usrx/local/nco/4.2.4/lib'
';export'
'NCO_LDFLAGS_CXX;PATH=/usrx/local/nco/4.2.4/bin:/global/noscrub/Julie.Prestopnik/met/8.0//bin:/global/noscrub/Julie.Prestopnik/met/8.0/external_libs/bin:/usrx/local/dev/python/2.7.14/bin:/usrx/local/intel/2015/advisor_xe_2015/bin64:/usrx/local/intel/2015/vtune_amplifier_xe_2015/bin64:/usrx/local/intel/2015/inspector_xe_2015/bin64:/usrx/local/intel/2015/impi_latest/intel64/bin:/usrx/local/intel/2015/itac_latest/intel64/bin:/usrx/local/intel/2015/composer_xe_2015.3.187/bin/intel64:/usrx/local/intel/2015/mpirt/bin/intel64:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64_mic/bin:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64/bin:.:/nwprod/gempak/nawips/os/linux2.6.32_x86_64/bin:/usr/lib64/qt-
3.3/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/opt/ibutils/bin:/nwprod/util/exec::/nwprod/util/ush::/u/Wesley.Ebisuzaki/bin:/u/Ying.Lin/bin:/nwprod/gempak/nawips/bin:/nwprod/gempak/nawips/scripts/ez:/nwprod/gempak/nawips/scripts/nawips:/nwprod/gempak/nawips/scripts/prnt:/nwprod/gempak/nawips/scripts/decoder:/sss/emc/meso/shared/Eric.Rogers/ddapp/exe_lnx6:/sss/emc/meso/shared/Eric.Rogers/vsdb/scripts'
';export'
'PATH;_LMFILES_=/usrx/local/modulefiles/ics/15.0.3:/usrx/local/dev/modulefiles/python/2.7.14:/global/noscrub/Julie.Prestopnik/modulefiles/met/8.0:/usrx/local/modulefiles/nco/4.2.4'
';export' '_LMFILES_;'
+ LOADEDMODULES=ics/15.0.3:python/2.7.14:met/8.0:nco/4.2.4
+ export LOADEDMODULES
+
MANPATH=/usrx/local/nco/4.2.4/share/man:/usrx/local/dev/python/2.7.14/share/man:/usrx/local/intel/2015/impi_latest/man:/usrx/local/intel/2015/itac_latest/man:/usrx/local/intel/2015/composerxe/man/en_US:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64/share/man:/usr/share/man:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64_mic/share/man:/usrx/local/intel/2015/inspector_xe_2015/man:/usrx/local/intel/2015/vtune_amplifier_xe_2015/man:/usrx/local/intel/2015/advisor_xe_2015/man
+ export MANPATH
+ NCO_INCLUDE=-I/usrx/local/nco/4.2.4/include
+ export NCO_INCLUDE
+ NCO_LDFLAGS_C=-L/usrx/local/nco/4.2.4/lib
+ export NCO_LDFLAGS_C
+ NCO_LDFLAGS_CXX=-L/usrx/local/nco/4.2.4/lib
+ export NCO_LDFLAGS_CXX
+
PATH=/usrx/local/nco/4.2.4/bin:/global/noscrub/Julie.Prestopnik/met/8.0//bin:/global/noscrub/Julie.Prestopnik/met/8.0/external_libs/bin:/usrx/local/dev/python/2.7.14/bin:/usrx/local/intel/2015/advisor_xe_2015/bin64:/usrx/local/intel/2015/vtune_amplifier_xe_2015/bin64:/usrx/local/intel/2015/inspector_xe_2015/bin64:/usrx/local/intel/2015/impi_latest/intel64/bin:/usrx/local/intel/2015/itac_latest/intel64/bin:/usrx/local/intel/2015/composer_xe_2015.3.187/bin/intel64:/usrx/local/intel/2015/mpirt/bin/intel64:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64_mic/bin:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64/bin:.:/nwprod/gempak/nawips/os/linux2.6.32_x86_64/bin:/usr/lib64/qt-
3.3/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/opt/ibutils/bin:/nwprod/util/exec::/nwprod/util/ush::/u/Wesley.Ebisuzaki/bin:/u/Ying.Lin/bin:/nwprod/gempak/nawips/bin:/nwprod/gempak/nawips/scripts/ez:/nwprod/gempak/nawips/scripts/nawips:/nwprod/gempak/nawips/scripts/prnt:/nwprod/gempak/nawips/scripts/decoder:/sss/emc/meso/shared/Eric.Rogers/ddapp/exe_lnx6:/sss/emc/meso/shared/Eric.Rogers/vsdb/scripts
+ export PATH
+
_LMFILES_=/usrx/local/modulefiles/ics/15.0.3:/usrx/local/dev/modulefiles/python/2.7.14:/global/noscrub/Julie.Prestopnik/modulefiles/met/8.0:/usrx/local/modulefiles/nco/4.2.4
+ export _LMFILES_
+ module load grib_util
+ /usrx/local/Modules/3.2.10/bin/modulecmd ksh load grib_util
+ eval CNVGRIB=/nwprod2/grib_util.v1.0.0/exec/cnvgrib ';export'
'CNVGRIB;COPYGB=/nwprod2/grib_util.v1.0.0/exec/copygb' ';export'
'COPYGB;COPYGB2=/nwprod2/grib_util.v1.0.0/exec/copygb2' ';export'
'COPYGB2;DEGRIB2=/nwprod2/grib_util.v1.0.0/exec/degrib2' ';export'
'DEGRIB2;GRB2INDEX=/nwprod2/grib_util.v1.0.0/exec/grb2index' ';export'
'GRB2INDEX;GRBINDEX=/nwprod2/grib_util.v1.0.0/exec/grbindex' ';export'
'GRBINDEX;GRIB2GRIB=/nwprod2/grib_util.v1.0.0/exec/grib2grib'
';export'
'GRIB2GRIB;LOADEDMODULES=ics/15.0.3:python/2.7.14:met/8.0:nco/4.2.4:grib_util/v1.0.0'
';export'
'LOADEDMODULES;TOCGRIB=/nwprod2/grib_util.v1.0.0/exec/tocgrib'
';export' 'TOCGRIB;TOCGRIB2=/nwprod2/grib_util.v1.0.0/exec/tocgrib2'
';export'
'TOCGRIB2;TOCGRIB2SUPER=/nwprod2/grib_util.v1.0.0/exec/tocgrib2super'
';export' 'TOCGRIB2SUPER;WGRIB=/nwprod2/grib_util.v1.0.0/exec/wgrib'
';export' 'WGRIB;WGRIB2=/nwprod2/grib_util.v1.0.0/exec/wgrib2'
';export'
'WGRIB2;_LMFILES_=/usrx/local/modulefiles/ics/15.0.3:/usrx/local/dev/modulefiles/python/2.7.14:/global/noscrub/Julie.Prestopnik/modulefiles/met/8.0:/usrx/local/modulefiles/nco/4.2.4:/nwprod2/modulefiles/grib_util/v1.0.0'
';export' '_LMFILES_;'
+ CNVGRIB=/nwprod2/grib_util.v1.0.0/exec/cnvgrib
+ export CNVGRIB
+ COPYGB=/nwprod2/grib_util.v1.0.0/exec/copygb
+ export COPYGB
+ COPYGB2=/nwprod2/grib_util.v1.0.0/exec/copygb2
+ export COPYGB2
+ DEGRIB2=/nwprod2/grib_util.v1.0.0/exec/degrib2
+ export DEGRIB2
+ GRB2INDEX=/nwprod2/grib_util.v1.0.0/exec/grb2index
+ export GRB2INDEX
+ GRBINDEX=/nwprod2/grib_util.v1.0.0/exec/grbindex
+ export GRBINDEX
+ GRIB2GRIB=/nwprod2/grib_util.v1.0.0/exec/grib2grib
+ export GRIB2GRIB
+
LOADEDMODULES=ics/15.0.3:python/2.7.14:met/8.0:nco/4.2.4:grib_util/v1.0.0
+ export LOADEDMODULES
+ TOCGRIB=/nwprod2/grib_util.v1.0.0/exec/tocgrib
+ export TOCGRIB
+ TOCGRIB2=/nwprod2/grib_util.v1.0.0/exec/tocgrib2
+ export TOCGRIB2
+ TOCGRIB2SUPER=/nwprod2/grib_util.v1.0.0/exec/tocgrib2super
+ export TOCGRIB2SUPER
+ WGRIB=/nwprod2/grib_util.v1.0.0/exec/wgrib
+ export WGRIB
+ WGRIB2=/nwprod2/grib_util.v1.0.0/exec/wgrib2
+ export WGRIB2
+
_LMFILES_=/usrx/local/modulefiles/ics/15.0.3:/usrx/local/dev/modulefiles/python/2.7.14:/global/noscrub/Julie.Prestopnik/modulefiles/met/8.0:/usrx/local/modulefiles/nco/4.2.4:/nwprod2/modulefiles/grib_util/v1.0.0
+ export _LMFILES_
+ METPLUS_PATH=/meso/save/Ying.Lin/metplus
+ export METPLUS_PATH
+ MET_PATH=/global/noscrub/Julie.Prestopnik/met/8.0
+ export MET_PATH
+ JLOGFILE=/meso/save/Ying.Lin/metplus/logs/metplus_jlogfile
+ export JLOGFILE
+
PYTHONPATH=/meso/save/Ying.Lin/metplus/ush:/meso/save/Ying.Lin/metplus/parm
+ export PYTHONPATH
+
PATH=/usrx/local/nco/4.2.4/bin:/global/noscrub/Julie.Prestopnik/met/8.0//bin:/global/noscrub/Julie.Prestopnik/met/8.0/external_libs/bin:/usrx/local/dev/python/2.7.14/bin:/usrx/local/intel/2015/advisor_xe_2015/bin64:/usrx/local/intel/2015/vtune_amplifier_xe_2015/bin64:/usrx/local/intel/2015/inspector_xe_2015/bin64:/usrx/local/intel/2015/impi_latest/intel64/bin:/usrx/local/intel/2015/itac_latest/intel64/bin:/usrx/local/intel/2015/composer_xe_2015.3.187/bin/intel64:/usrx/local/intel/2015/mpirt/bin/intel64:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64_mic/bin:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64/bin:.:/nwprod/gempak/nawips/os/linux2.6.32_x86_64/bin:/usr/lib64/qt-
3.3/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/opt/ibutils/bin:/nwprod/util/exec::/nwprod/util/ush::/u/Wesley.Ebisuzaki/bin:/u/Ying.Lin/bin:/nwprod/gempak/nawips/bin:/nwprod/gempak/nawips/scripts/ez:/nwprod/gempak/nawips/scripts/nawips:/nwprod/gempak/nawips/scripts/prnt:/nwprod/gempak/nawips/scripts/decoder:/sss/emc/meso/shared/Eric.Rogers/ddapp/exe_lnx6:/sss/emc/meso/shared/Eric.Rogers/vsdb/scripts:/meso/save/Ying.Lin/metplus/ush:.
+ export PATH
+ vday=20190310
+ export vday
+ echo 'Actual output starts here:'
Actual output starts here:
+ master_metplus.py -c
/meso/save/Ying.Lin/metplus/parm/model_config/fv3gfs_24h.conf -c
/meso/save/Ying.Lin/metplus/parm/ylin_config/system.conf.wcoss
03/12 19:45:14.951 jlog (log.py:66) INFO: master_metplus is starting
03/12 19:45:14.963 jlog (master_metplus.py:58) INFO: Top of
master_metplus
03/12 19:45:14.963 master_metplus (master_metplus.py:67) INFO: logger
Top of master_metplus.
03/12 19:45:14.963 metplus (config_metplus.py:76) INFO: Starting
METplus configuration setup.
03/12 19:45:14.963 metplus (config_metplus.py:99) INFO: All OPTS and
ARGS: [('-c',
'/meso/save/Ying.Lin/metplus/parm/model_config/fv3gfs_24h.conf'), ('-
c', '/meso/save/Ying.Lin/metplus/parm/ylin_config/system.conf.wcoss')]
[]
03/12 19:45:14.963 metplus (config_launcher.py:157) INFO:
/meso/save/Ying.Lin/metplus/parm/model_config/fv3gfs_24h.conf
03/12 19:45:14.964 metplus (config_launcher.py:168) INFO:
/meso/save/Ying.Lin/metplus/parm/model_config/fv3gfs_24h.conf: Plan to
parse this conf file
03/12 19:45:14.964 metplus (config_launcher.py:157) INFO:
/meso/save/Ying.Lin/metplus/parm/ylin_config/system.conf.wcoss
03/12 19:45:14.965 metplus (config_launcher.py:168) INFO:
/meso/save/Ying.Lin/metplus/parm/ylin_config/system.conf.wcoss: Plan
to parse this conf file
03/12 19:45:14.975 metplus (config_launcher.py:192) INFO: Conf input:
'/gpfs/td1/emc/meso/save/Ying.Lin/metplus/parm/metplus_config/metplus_system.conf'
03/12 19:45:14.975 metplus (config_launcher.py:192) INFO: Conf input:
'/gpfs/td1/emc/meso/save/Ying.Lin/metplus/parm/metplus_config/metplus_data.conf'
03/12 19:45:14.976 metplus (config_launcher.py:192) INFO: Conf input:
'/gpfs/td1/emc/meso/save/Ying.Lin/metplus/parm/metplus_config/metplus_runtime.conf'
03/12 19:45:14.977 metplus (config_launcher.py:192) INFO: Conf input:
'/gpfs/td1/emc/meso/save/Ying.Lin/metplus/parm/metplus_config/metplus_logging.conf'
03/12 19:45:14.977 metplus (config_launcher.py:192) INFO: Conf input:
'/meso/save/Ying.Lin/metplus/parm/model_config/fv3gfs_24h.conf'
03/12 19:45:14.977 metplus (config_launcher.py:192) INFO: Conf input:
'/meso/save/Ying.Lin/metplus/parm/ylin_config/system.conf.wcoss'
03/12 19:45:14.985 metplus (config_launcher.py:218) INFO:
/gpfs/td1/emc/meso/save/Ying.Lin/metplus/parm/metplus_config/metplus_system.conf:
Parsed this file
03/12 19:45:15.002 metplus (config_launcher.py:218) INFO:
/gpfs/td1/emc/meso/save/Ying.Lin/metplus/parm/metplus_config/metplus_data.conf:
Parsed this file
03/12 19:45:15.026 metplus (config_launcher.py:218) INFO:
/gpfs/td1/emc/meso/save/Ying.Lin/metplus/parm/metplus_config/metplus_runtime.conf:
Parsed this file
03/12 19:45:15.052 metplus (config_launcher.py:218) INFO:
/gpfs/td1/emc/meso/save/Ying.Lin/metplus/parm/metplus_config/metplus_logging.conf:
Parsed this file
03/12 19:45:15.053 metplus (config_launcher.py:218) INFO:
/meso/save/Ying.Lin/metplus/parm/model_config/fv3gfs_24h.conf: Parsed
this file
03/12 19:45:15.062 metplus (config_launcher.py:218) INFO:
/meso/save/Ying.Lin/metplus/parm/ylin_config/system.conf.wcoss: Parsed
this file
03/12 19:45:15.063 metplus (met_util.py:238) INFO: Adding:
config.LOG_TIMESTAMP='20190312'
03/12 19:45:15.063 metplus (met_util.py:244) INFO: Replace [config]
LOG_METPLUS with
'/meso/noscrub/Ying.Lin/metplus.out/logs/master_metplus.log.20190312'
03/12 19:45:15.066 metplus (config_launcher.py:288) WARNING:
METPLUS_BASE from the conf files has no effect. Overriding to
/gpfs/td1/emc/meso/save/Ying.Lin/metplus
03/12 19:45:15.084 metplus (config_launcher.py:300) INFO: Replace
[dir] OUTPUT_BASE with /meso/noscrub/Ying.Lin/metplus.out
03/12 19:45:15.084 metplus (config_launcher.py:300) INFO: Replace
[dir] METPLUS_BASE with /gpfs/td1/emc/meso/save/Ying.Lin/metplus
03/12 19:45:15.084 metplus (config_launcher.py:310) INFO:
METPLUS_CONF: /meso/noscrub/Ying.Lin/metplus.out/metplus_final.conf
written here.
03/12 19:45:15.087 metplus (config_metplus.py:148) INFO: Completed
METplus configuration setup.
03/12 19:45:15.088 metplus (master_metplus.py:93) INFO: Running
METplus v2.0.4 called with command:
/meso/save/Ying.Lin/metplus/ush/master_metplus.py -c
/meso/save/Ying.Lin/metplus/parm/model_config/fv3gfs_24h.conf -c
/meso/save/Ying.Lin/metplus/parm/ylin_config/system.conf.wcoss
03/12 19:45:15.137 metplus.GridStat (master_metplus.py:158) INFO:
****************************************
03/12 19:45:15.138 metplus.GridStat (master_metplus.py:159) INFO: *
RUNNING METplus
03/12 19:45:15.138 metplus.GridStat (master_metplus.py:163) INFO: *
at valid time: 201903101200
03/12 19:45:15.138 metplus.GridStat (master_metplus.py:164) INFO:
****************************************
03/12 19:45:15.140 metplus.PcpCombine (reformat_gridded_wrapper.py:75)
INFO: PROCESSING OBS DATA
03/12 19:45:15.140 metplus.PcpCombine (reformat_gridded_wrapper.py:78)
INFO: PROCESSING FORECAST LEAD 24
03/12 19:45:15.197 metplus.PcpCombine (command_runner.py:222) DEBUG:
LOG_MET_OUTPUT_TO_METPLUS log file is True
03/12 19:45:15.199 metplus.PcpCombine (command_runner.py:119) INFO:
app_name is: pcp_combine, output sent to:
/meso/noscrub/Ying.Lin/metplus.out/logs/master_metplus.log.20190312
03/12 19:45:15.316 mpi_impl (__init__.py:331) INFO: inside_aprun: not
detected: INSIDE_APRUN is not set or is 0
03/12 19:45:15.317 mpi_impl (__init__.py:331) INFO: lsf_cray_intel:
not detected: aprun: cannot find executable
03/12 19:45:15.318 mpi_impl (__init__.py:331) INFO: mpirun_lsf: not
detected: mpirun.lsf: cannot find executable
03/12 19:45:15.397 mpi_impl (__init__.py:331) INFO: impi: not
detected: 'TOTAL_TASKS'
03/12 19:45:15.398 mpi_impl (__init__.py:331) INFO: mpiexec_mpt: not
detected: mpiexec_mpt: cannot find executable
03/12 19:45:15.399 mpi_impl (__init__.py:331) INFO: srun: not
detected: srun: cannot find executable
03/12 19:45:15.422 mpi_impl (__init__.py:331) INFO: mpiexec: not
detected: 'TOTAL_TASKS'
03/12 19:45:15.423 metplus.PcpCombine (command_runner.py:155) INFO:
RUNNING: /global/noscrub/Julie.Prestopnik/met/8.0/bin/pcp_combine
-name APCP_24 -add
/com2/ccpa/prod/ccpa.20190310/12/ccpa.t12z.06h.hrap.conus.gb2 6
/com2/ccpa/prod/ccpa.20190310/06/ccpa.t06z.06h.hrap.conus.gb2 6
/com2/ccpa/prod/ccpa.20190310/00/ccpa.t00z.06h.hrap.conus.gb2 6
/com2/ccpa/prod/ccpa.20190309/18/ccpa.t18z.06h.hrap.conus.gb2 6
/meso/noscrub/Ying.Lin/metplus.out/qpe_grib/bucket/20190310/ccpa.2019031012_A24h
-v 5 >>
/meso/noscrub/Ying.Lin/metplus.out/logs/master_metplus.log.20190312
2>&1
03/12 19:45:18.029 metplus.RegridDataPlane
(reformat_gridded_wrapper.py:75) INFO: PROCESSING OBS DATA
03/12 19:45:18.029 metplus.RegridDataPlane
(reformat_gridded_wrapper.py:78) INFO: PROCESSING FORECAST LEAD 24
03/12 19:45:18.032 metplus.GridStat (compare_gridded_wrapper.py:258)
INFO: PROCESSING FORECAST LEAD 24
03/12 19:45:18.048 metplus.GridStat (compare_gridded_wrapper.py:278)
ERROR: COULD NOT FIND FILE IN
/meso/noscrub/Ying.Lin/metplus.out/qpe_grib/regrid FOR INIT
201903091200 f24
------------------------------------------------
Subject: CCPA file name format for METplus
From: Ying Lin
Time: Tue Mar 12 14:19:38 2019
# FV3GFS vs CCPA 24h FHO verif:
[config]
# if false, loop by VALID time
LOOP_BY_INIT = false
# Format of VALID_BEG and VALID_END
VALID_TIME_FMT = %Y%m%d%H
# Start time for MET+ run
VALID_BEG={ENV[vday]}12
# End time for MET+ run
VALID_END={ENV[vday]}12
# Increment between MET+ runs in seconds. Must be >= 60
# YL: 86400sec=24h
VALID_INCREMENT=86400
# List of forecast leads to process
#LEAD_SEQ = 24, 36, 48, 60, 72, 84
LEAD_SEQ = 24
# Options are times, processes
# times = run all items in the PROCESS_LIST for a single
initialization
# time, then repeat until all times have been evaluated.
# processes = run each item in the PROCESS_LIST for all times
# specified, then repeat for the next item in the PROCESS_LIST.
LOOP_METHOD = times
# List of applications to run
PROCESS_LIST = PcpCombine, RegridDataPlane, GridStat
# run pcp_combine on observation data
OBS_PCP_COMBINE_RUN = True
# run regrid_data_plane on observation data
OBS_REGRID_DATA_PLANE_RUN = True
# List of variables to compare
FCST_VAR1_NAME = APCP
FCST_VAR1_LEVELS = A24
FCST_VAR1_THRESH =
gt0.254,gt2.54,gt6.35,gt12.7,gt19.05,gt25.4,gt38.1,gt50.8,gt76.2,gt101.6
# Name to identify model data in output
MODEL_TYPE = FV3GFS
# Name to identify observation data in output
OB_TYPE = QPE
# Used by regrid_data_plane to remap data
VERIFICATION_GRID={INPUT_BASE}/qpf/sample_fcst/2005080700/wrfprs_ruc13_12.tm00_G212
#FCST_PCP_COMBINE_RUN = False
# Location of grid_stat config file
# GRID_STAT_CONFIG = {CONFIG_DIR}/GridStatConfig_MEAN
GRID_STAT_CONFIG =
{METPLUS_BASE}/parm/ylin_config/GridStatConfig_ctc_sl1l2
# QPF Model Options:
# Descriptions of forecast data -- These will not change between runs
# Set to true if forecast data is probabilistic
FCST_IS_PROB = false
# Set to true if data is only available once per day
FCST_IS_DAILY_FILE = false
# GRIB Observation Data Parameters
# File format. Options are GRIB, NETCDF, or GEMPAK
OBS_PCP_COMBINE_INPUT_DATATYPE = GRIB
# Set to true if data is only available once per day
OBS_IS_DAILY_FILE = false
# Accumulation interval available in observation data
OBS_LEVEL = 06
[dir]
# location of configuration files used by MET applications
CONFIG_DIR={PARM_BASE}/use_cases/qpf/met_config
# input and output data directories for each application in
PROCESS_LIST
FCST_GRID_STAT_INPUT_DIR = /gpfs/dell1/nco/ops/com/gfs/para
OBS_PCP_COMBINE_INPUT_DIR = /com2/ccpa/prod
OBS_PCP_COMBINE_OUTPUT_DIR = {OUTPUT_BASE}/qpe_grib/bucket
OBS_REGRID_DATA_PLANE_INPUT_DIR = {OUTPUT_BASE}/qpe_grib/bucket
OBS_REGRID_DATA_PLANE_OUTPUT_DIR = {OUTPUT_BASE}/qpe_grib/regrid
OBS_GRID_STAT_INPUT_DIR = {OUTPUT_BASE}/qpe_grib/regrid
GRID_STAT_OUT_DIR = {OUTPUT_BASE}/met_out/{MODEL_TYPE}
[filename_templates]
# format of filenames
# QPF (Forecast)
FCST_GRID_STAT_INPUT_TEMPLATE =
gfs.{init?fmt=%Y%m%d}/{init?fmt=%H}/gfs.t{init?fmt=%H}z.pgrb2.0p25.f{lead?fmt=%HHH}
# QPE (Observation)
OBS_PCP_COMBINE_INPUT_TEMPLATE =
ccpa.{valid?fmt=%Y%m%d}/{valid?fmt=%H}/ccpa.t{valid?fmt=%H}z.06h.hrap.conus.gb2
OBS_PCP_COMBINE_OUTPUT_TEMPLATE =
{valid?fmt=%Y%m%d}/ccpa.{valid?fmt=%Y%m%d%H}_A{level?fmt=%HH}h
OBS_REGRID_DATA_PLANE_TEMPLATE =
{valid?fmt=%Y%m%d}/ccpa.{valid?fmt=%Y%m%d%H}_A{level?fmt=%HH}h.g212
OBS_GRID_STAT_INPUT_TEMPLATE =
{valid?fmt=%Y%m%d}/ccpa.{valid?fmt=%Y%m%d%H}_A{level?fmt=%HH}h.g212
------------------------------------------------
Subject: CCPA file name format for METplus
From: Ying Lin
Time: Tue Mar 12 14:19:38 2019
#!/bin/ksh
. ~/dot.for.metplus
COMBDIR=/meso/noscrub/Ying.Lin/metplus.out/fv3gfs.dir/qpe_grib/bucket/20190310
SAMPDIR=/global/noscrub/Julie.Prestopnik/METplus/METplus-
2.0.4_sample_data/qpf/sample_fcst/2005080700/
/global/noscrub/Julie.Prestopnik/met/8.0/bin/regrid_data_plane -v 5 \
-field "name=\"APCP_24\"; level=\"(*,*)\";" -method BUDGET \
-width 2 -name APCP_24 \
$COMBDIR/ccpa.2019031012_A24h \
$SAMPDIR/wrfprs_ruc13_12.tm00_G212 \
ccpa.2019031012_A24h.g212 > regrib.out
------------------------------------------------
Subject: CCPA file name format for METplus
From: Ying Lin
Time: Tue Mar 12 14:19:38 2019
#!/bin/ksh
set -x
. ~/dot.for.metplus
#export MODEL=FV3GFS
export vday=20190310
echo 'Actual output starts here:'
master_metplus.py \
-c ${METPLUS_PATH}/parm/model_config/fv3gfs_24h.conf \
-c ${METPLUS_PATH}/parm/ylin_config/system.conf.wcoss
------------------------------------------------
Subject: CCPA file name format for METplus
From: Ying Lin
Time: Tue Mar 12 14:19:38 2019
+ . /u/Ying.Lin/dot.for.metplus
+ . /usrx/local/Modules/default/init/ksh
+ [ 3.2.10 '=' '' ]
+ MODULE_VERSION_STACK=3.2.10
+ export MODULE_VERSION_STACK
+ MODULESHOME=/usrx/local/Modules/3.2.10
+ export MODULESHOME
+ [
EnvVars/1.0.1:ibmpe/1.3.0.12:lsf/9.1:ics/12.1:anaconda2/latest:hpss/4.0.1.2:GrADS/2.0.2:HDF5/1.8.9/serial:NetCDF/4.2/serial
'=' '' ]
+ [
'/usrx/local/Modules/versions:/usrx/local/Modules/$MODULE_VERSION/modulefiles:/usrx/local/modulefiles:/nwprod2/modulefiles:/nwprod2/lib/modulefiles:/nwprod/lib/modulefiles:/u/Benjamin.Blake/modulefiles'
'=' '' ]
+ module purge
+ /usrx/local/Modules/3.2.10/bin/modulecmd ksh purge
+ eval MANPATH=/usr/share/man ';export'
'MANPATH;PATH=.:/nwprod/gempak/nawips/os/linux2.6.32_x86_64/bin:/usr/lib64/qt-
3.3/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/opt/ibutils/bin:/nwprod/util/exec::/nwprod/util/ush::/u/Wesley.Ebisuzaki/bin:/u/Ying.Lin/bin:/nwprod/gempak/nawips/bin:/nwprod/gempak/nawips/scripts/ez:/nwprod/gempak/nawips/scripts/nawips:/nwprod/gempak/nawips/scripts/prnt:/nwprod/gempak/nawips/scripts/decoder:/sss/emc/meso/shared/Eric.Rogers/ddapp/exe_lnx6:/sss/emc/meso/shared/Eric.Rogers/vsdb/scripts'
';export' 'PATH;unset' 'CLASSPATH;unset' 'CPATH;unset'
'CPRO_PATH;unset' 'FPATH;unset' 'GADDIR;unset' 'GrADS_ROOT;unset'
'HDF5;unset' 'HDF5_CFLAGS;unset' 'HDF5_CXXFLAGS;unset'
'HDF5_FFLAGS;unset' 'HDF5_INCLUDE;unset' 'HDF5_LDFLAGS;unset'
'HDF5_LDFLAGS_C;unset' 'HDF5_LDFLAGS_CXX;unset' 'HDF5_LDFLAGS_F;unset'
'IDB_HOME;unset' 'INCLUDE;unset' 'INSTALL_DIR;unset'
'INTEL_LICENSE_FILE;unset' 'IPPROOT;unset' 'I_MPI_INC;unset'
'I_MPI_ROOT;unset' 'LANG;unset' 'LAUNCH;unset' 'LD_LIBRARY_PATH;unset'
'LIBRARY_PATH;unset' 'LOADEDMODULES;unset' 'LSF_BINDIR;unset'
'LSF_ENVDIR;unset' 'LSF_LIBDIR;unset' 'LSF_SERVERDIR;unset'
'MKLROOT;unset' 'MKL_TARGET_ARCH;unset' 'MP_CLOCK_SOURCE;unset'
'MP_COMPILER;unset' 'MP_CONFIG;unset' 'MP_EUILIB;unset'
'MP_MPILIB;unset' 'NETCDF;unset' 'NETCDF_CFLAGS;unset'
'NETCDF_CXXFLAGS;unset' 'NETCDF_FFLAGS;unset' 'NETCDF_INCLUDE;unset'
'NETCDF_LDFLAGS;unset' 'NETCDF_LDFLAGS_C;unset'
'NETCDF_LDFLAGS_CXX;unset' 'NETCDF_LDFLAGS_F;unset' 'NLSPATH;unset'
'OMP_NUM_THREADS;unset' 'PROD_DIR;unset' 'PYTHONPATH;unset'
'SITE;unset' 'TBBROOT;unset' 'VT_LIB_DIR;unset' 'VT_ROOT;unset'
'VT_SLIB_DIR;unset' 'XLSF_UIDDIR;unset' '_LMFILES_;'
+ MANPATH=/usr/share/man
+ export MANPATH
+
PATH=.:/nwprod/gempak/nawips/os/linux2.6.32_x86_64/bin:/usr/lib64/qt-
3.3/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/opt/ibutils/bin:/nwprod/util/exec::/nwprod/util/ush::/u/Wesley.Ebisuzaki/bin:/u/Ying.Lin/bin:/nwprod/gempak/nawips/bin:/nwprod/gempak/nawips/scripts/ez:/nwprod/gempak/nawips/scripts/nawips:/nwprod/gempak/nawips/scripts/prnt:/nwprod/gempak/nawips/scripts/decoder:/sss/emc/meso/shared/Eric.Rogers/ddapp/exe_lnx6:/sss/emc/meso/shared/Eric.Rogers/vsdb/scripts
+ export PATH
+ unset CLASSPATH
+ unset CPATH
+ unset CPRO_PATH
+ unset FPATH
+ unset GADDIR
+ unset GrADS_ROOT
+ unset HDF5
+ unset HDF5_CFLAGS
+ unset HDF5_CXXFLAGS
+ unset HDF5_FFLAGS
+ unset HDF5_INCLUDE
+ unset HDF5_LDFLAGS
+ unset HDF5_LDFLAGS_C
+ unset HDF5_LDFLAGS_CXX
+ unset HDF5_LDFLAGS_F
+ unset IDB_HOME
+ unset INCLUDE
+ unset INSTALL_DIR
+ unset INTEL_LICENSE_FILE
+ unset IPPROOT
+ unset I_MPI_INC
+ unset I_MPI_ROOT
+ unset LANG
+ unset LAUNCH
+ unset LD_LIBRARY_PATH
+ unset LIBRARY_PATH
+ unset LOADEDMODULES
+ unset LSF_BINDIR
+ unset LSF_ENVDIR
+ unset LSF_LIBDIR
+ unset LSF_SERVERDIR
+ unset MKLROOT
+ unset MKL_TARGET_ARCH
+ unset MP_CLOCK_SOURCE
+ unset MP_COMPILER
+ unset MP_CONFIG
+ unset MP_EUILIB
+ unset MP_MPILIB
+ unset NETCDF
+ unset NETCDF_CFLAGS
+ unset NETCDF_CXXFLAGS
+ unset NETCDF_FFLAGS
+ unset NETCDF_INCLUDE
+ unset NETCDF_LDFLAGS
+ unset NETCDF_LDFLAGS_C
+ unset NETCDF_LDFLAGS_CXX
+ unset NETCDF_LDFLAGS_F
+ unset NLSPATH
+ unset OMP_NUM_THREADS
+ unset PROD_DIR
+ unset PYTHONPATH
+ unset SITE
+ unset TBBROOT
+ unset VT_LIB_DIR
+ unset VT_ROOT
+ unset VT_SLIB_DIR
+ unset XLSF_UIDDIR
+ unset _LMFILES_
+ module use /global/noscrub/Julie.Prestopnik/modulefiles
+ /usrx/local/Modules/3.2.10/bin/modulecmd ksh use
/global/noscrub/Julie.Prestopnik/modulefiles
+ eval
MODULEPATH='/global/noscrub/Julie.Prestopnik/modulefiles:/usrx/local/Modules/versions:/usrx/local/Modules/\$MODULE_VERSION/modulefiles:/usrx/local/modulefiles:/nwprod2/modulefiles:/nwprod2/lib/modulefiles:/nwprod/lib/modulefiles:/u/Benjamin.Blake/modulefiles'
';export' 'MODULEPATH;'
+
MODULEPATH='/global/noscrub/Julie.Prestopnik/modulefiles:/usrx/local/Modules/versions:/usrx/local/Modules/$MODULE_VERSION/modulefiles:/usrx/local/modulefiles:/nwprod2/modulefiles:/nwprod2/lib/modulefiles:/nwprod/lib/modulefiles:/u/Benjamin.Blake/modulefiles'
+ export MODULEPATH
+ module load met/8.0
+ /usrx/local/Modules/3.2.10/bin/modulecmd ksh load met/8.0
+ eval ADVISOR_XE_2015_DIR=/usrx/local/intel/2015/advisor_xe_2015
';export' 'ADVISOR_XE_2015_DIR;BIN_DIR=bin64' ';export'
'BIN_DIR;CLASSPATH=/usrx/local/intel/2015/itac_latest/lib' ';export'
'CLASSPATH;CPATH=/usrx/local/intel/2015/ipp/include:/usrx/local/intel/2015/mkl/include:/usrx/local/intel/2015/tbb/include'
';export'
'CPATH;CPRO_PATH=/usrx/local/intel/2015/composer_xe_2015.3.187'
';export'
'CPRO_PATH;GDBSERVER_MIC=/usrx/local/intel/2015/composerxe/debugger/gdb/target/mic/bin/gdbserver'
';export'
'GDBSERVER_MIC;GDB_CROSS=/usrx/local/intel/2015/composerxe/debugger/gdb/intel64_mic/bin/gdb-
mic' ';export' 'GDB_CROSS;INCLUDE=/usrx/local/intel/2015/mkl/include'
';export'
'INCLUDE;INFOPATH=/usrx/local/intel/2015/composerxe/debugger/gdb/intel64/share/info:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64_mic/share/info'
';export'
'INFOPATH;INSPECTOR_2015_DIR=/usrx/local/intel/2015/inspector_xe_2015'
';export'
'INSPECTOR_2015_DIR;INTEL_LICENSE_FILE=/usrx/local/intel/licenses'
';export'
'INTEL_LICENSE_FILE;INTEL_PYTHONHOME=/usrx/local/intel/2015/composerxe/debugger/python/intel64'
';export' 'INTEL_PYTHONHOME;IPPROOT=/usrx/local/intel/2015/ipp'
';export' 'IPPROOT;I_MPI_HYDRA_IFACE=ib0' ';export'
'I_MPI_HYDRA_IFACE;I_MPI_INC=/usrx/local/intel/2015/impi_latest/include64'
';export' 'I_MPI_INC;I_MPI_ROOT=/usrx/local/intel/2015/impi_latest'
';export' 'I_MPI_ROOT;LANGUAGE_TERRITORY=en_US' ';export'
'LANGUAGE_TERRITORY;LD_LIBRARY_PATH=/global/noscrub/Julie.Prestopnik/met/8.0/external_libs/lib:/usrx/local/dev/python/2.7.14/lib:/usrx/local/intel/2015/impi_latest/intel64/lib:/usrx/local/intel/2015/itac_latest/mic/slib:/usrx/local/intel/2015/itac_latest/intel64/slib:/usrx/local/intel/2015/composerxe/lib/intel64:/usrx/local/intel/2015/mpirt/lib/intel64:/usrx/local/intel/2015/ipp/lib/intel64:/usrx/local/intel/2015/mkl/lib/intel64:/usrx/local/intel/2015/tbb/lib/intel64/gcc4.4'
';export'
'LD_LIBRARY_PATH;LIBRARY_PATH=/usrx/local/intel/2015/composerxe/lib/intel64:/usrx/local/intel/2015/ipp/lib/intel64:/usrx/local/intel/2015/mkl/lib/intel64:/usrx/local/intel/2015/tbb/lib/intel64/gcc4.4'
';export'
'LIBRARY_PATH;LOADEDMODULES=ics/15.0.3:python/2.7.14:met/8.0'
';export'
'LOADEDMODULES;MANPATH=/usrx/local/dev/python/2.7.14/share/man:/usrx/local/intel/2015/impi_latest/man:/usrx/local/intel/2015/itac_latest/man:/usrx/local/intel/2015/composerxe/man/en_US:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64/share/man:/usr/share/man:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64_mic/share/man:/usrx/local/intel/2015/inspector_xe_2015/man:/usrx/local/intel/2015/vtune_amplifier_xe_2015/man:/usrx/local/intel/2015/advisor_xe_2015/man'
';export'
'MANPATH;MIC_LD_LIBRARY_PATH=/usrx/local/intel/2015/composerxe/lib/mic:/usrx/local/intel/2015/mpirt/lib/mic:/usrx/local/intel/2015/mkl/lib/mic:/usrx/local/intel/2015/tbb/lib/mic'
';export'
'MIC_LD_LIBRARY_PATH;MIC_LIBRARY_PATH=/usrx/local/intel/2015/composerxe/lib/mic:/usrx/local/intel/2015/mpirt/lib/mic:/usrx/local/intel/2015/tbb/lib/mic'
';export' 'MIC_LIBRARY_PATH;MKLROOT=/usrx/local/intel/2015/mkl'
';export'
'MKLROOT;MODULEPATH=/usrx/local/dev/modulefiles:/global/noscrub/Julie.Prestopnik/modulefiles:/usrx/local/Modules/versions:/usrx/local/Modules/\$MODULE_VERSION/modulefiles:/usrx/local/modulefiles:/nwprod2/modulefiles:/nwprod2/lib/modulefiles:/nwprod/lib/modulefiles:/u/Benjamin.Blake/modulefiles'
';export'
'MODULEPATH;MPM_LAUNCHER=/usrx/local/intel/2015/composerxe/debugger/mpm/bin/start_mpm.sh'
';export'
'MPM_LAUNCHER;NLSPATH=/usrx/local/intel/2015/composerxe/lib/intel64/locale/%l_%t/%N:/usrx/local/intel/2015/ipp/lib/intel64/locale/%l_%t/%N:/usrx/local/intel/2015/mkl/lib/intel64/locale/%l_%t/%N:/usrx/local/intel/2015/composer_xe_2015.3.187/debugger/gdb/intel64_mic/share/locale/%l_%t/%N:/usrx/local/intel/2015/composer_xe_2015.3.187/debugger/gdb/intel64/share/locale/%l_%t/%N'
';export'
'NLSPATH;PATH=/global/noscrub/Julie.Prestopnik/met/8.0//bin:/global/noscrub/Julie.Prestopnik/met/8.0/external_libs/bin:/usrx/local/dev/python/2.7.14/bin:/usrx/local/intel/2015/advisor_xe_2015/bin64:/usrx/local/intel/2015/vtune_amplifier_xe_2015/bin64:/usrx/local/intel/2015/inspector_xe_2015/bin64:/usrx/local/intel/2015/impi_latest/intel64/bin:/usrx/local/intel/2015/itac_latest/intel64/bin:/usrx/local/intel/2015/composer_xe_2015.3.187/bin/intel64:/usrx/local/intel/2015/mpirt/bin/intel64:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64_mic/bin:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64/bin:.:/nwprod/gempak/nawips/os/linux2.6.32_x86_64/bin:/usr/lib64/qt-
3.3/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/opt/ibutils/bin:/nwprod/util/exec::/nwprod/util/ush::/u/Wesley.Ebisuzaki/bin:/u/Ying.Lin/bin:/nwprod/gempak/nawips/bin:/nwprod/gempak/nawips/scripts/ez:/nwprod/gempak/nawips/scripts/nawips:/nwprod/gempak/nawips/scripts/prnt:/nwprod/gempak/nawips/scripts/decoder:/sss/emc/meso/shared/Eric.Rogers/ddapp/exe_lnx6:/sss/emc/meso/shared/Eric.Rogers/vsdb/scripts'
';export' 'PATH;PROD_DIR=/usrx/local/intel/2015/composerxe' ';export'
'PROD_DIR;ROOTPATH=/usrx/local/intel/2015' ';export'
'ROOTPATH;SCRIPTPATH=/usrx/local/intel/2015' ';export'
'SCRIPTPATH;TBBROOT=/usrx/local/intel/2015/tbb' ';export'
'TBBROOT;VTUNE_AMPLIFIER_XE_2015_DIR=/usrx/local/intel/2015/vtune_amplifier_xe_2015'
';export' 'VTUNE_AMPLIFIER_XE_2015_DIR;VT_ADD_LIBS=-ldwarf\' '-lelf\'
'-lvtunwind\' '-lnsl\' '-lm\' '-ldl\' -lpthread ';export'
'VT_ADD_LIBS;VT_ARCH=intel64' ';export'
'VT_ARCH;VT_LIB_DIR=/usrx/local/intel/2015/itac_latest/lib' ';export'
'VT_LIB_DIR;VT_MIC_SLIB_DIR=/usrx/local/intel/2015/itac_latest/mic/slib'
';export' 'VT_MIC_SLIB_DIR;VT_MPI=impi4' ';export'
'VT_MPI;VT_ROOT=/usrx/local/intel/2015/itac_latest' ';export'
'VT_ROOT;VT_SLIB_DIR=/usrx/local/intel/2015/itac_latest/intel64/slib'
';export'
'VT_SLIB_DIR;_LMFILES_=/usrx/local/modulefiles/ics/15.0.3:/usrx/local/dev/modulefiles/python/2.7.14:/global/noscrub/Julie.Prestopnik/modulefiles/met/8.0'
';export' '_LMFILES_;'
+ ADVISOR_XE_2015_DIR=/usrx/local/intel/2015/advisor_xe_2015
+ export ADVISOR_XE_2015_DIR
+ BIN_DIR=bin64
+ export BIN_DIR
+ CLASSPATH=/usrx/local/intel/2015/itac_latest/lib
+ export CLASSPATH
+
CPATH=/usrx/local/intel/2015/ipp/include:/usrx/local/intel/2015/mkl/include:/usrx/local/intel/2015/tbb/include
+ export CPATH
+ CPRO_PATH=/usrx/local/intel/2015/composer_xe_2015.3.187
+ export CPRO_PATH
+
GDBSERVER_MIC=/usrx/local/intel/2015/composerxe/debugger/gdb/target/mic/bin/gdbserver
+ export GDBSERVER_MIC
+
GDB_CROSS=/usrx/local/intel/2015/composerxe/debugger/gdb/intel64_mic/bin/gdb-
mic
+ export GDB_CROSS
+ INCLUDE=/usrx/local/intel/2015/mkl/include
+ export INCLUDE
+
INFOPATH=/usrx/local/intel/2015/composerxe/debugger/gdb/intel64/share/info:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64_mic/share/info
+ export INFOPATH
+ INSPECTOR_2015_DIR=/usrx/local/intel/2015/inspector_xe_2015
+ export INSPECTOR_2015_DIR
+ INTEL_LICENSE_FILE=/usrx/local/intel/licenses
+ export INTEL_LICENSE_FILE
+
INTEL_PYTHONHOME=/usrx/local/intel/2015/composerxe/debugger/python/intel64
+ export INTEL_PYTHONHOME
+ IPPROOT=/usrx/local/intel/2015/ipp
+ export IPPROOT
+ I_MPI_HYDRA_IFACE=ib0
+ export I_MPI_HYDRA_IFACE
+ I_MPI_INC=/usrx/local/intel/2015/impi_latest/include64
+ export I_MPI_INC
+ I_MPI_ROOT=/usrx/local/intel/2015/impi_latest
+ export I_MPI_ROOT
+ LANGUAGE_TERRITORY=en_US
+ export LANGUAGE_TERRITORY
+
LD_LIBRARY_PATH=/global/noscrub/Julie.Prestopnik/met/8.0/external_libs/lib:/usrx/local/dev/python/2.7.14/lib:/usrx/local/intel/2015/impi_latest/intel64/lib:/usrx/local/intel/2015/itac_latest/mic/slib:/usrx/local/intel/2015/itac_latest/intel64/slib:/usrx/local/intel/2015/composerxe/lib/intel64:/usrx/local/intel/2015/mpirt/lib/intel64:/usrx/local/intel/2015/ipp/lib/intel64:/usrx/local/intel/2015/mkl/lib/intel64:/usrx/local/intel/2015/tbb/lib/intel64/gcc4.4
+ export LD_LIBRARY_PATH
+
LIBRARY_PATH=/usrx/local/intel/2015/composerxe/lib/intel64:/usrx/local/intel/2015/ipp/lib/intel64:/usrx/local/intel/2015/mkl/lib/intel64:/usrx/local/intel/2015/tbb/lib/intel64/gcc4.4
+ export LIBRARY_PATH
+ LOADEDMODULES=ics/15.0.3:python/2.7.14:met/8.0
+ export LOADEDMODULES
+
MANPATH=/usrx/local/dev/python/2.7.14/share/man:/usrx/local/intel/2015/impi_latest/man:/usrx/local/intel/2015/itac_latest/man:/usrx/local/intel/2015/composerxe/man/en_US:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64/share/man:/usr/share/man:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64_mic/share/man:/usrx/local/intel/2015/inspector_xe_2015/man:/usrx/local/intel/2015/vtune_amplifier_xe_2015/man:/usrx/local/intel/2015/advisor_xe_2015/man
+ export MANPATH
+
MIC_LD_LIBRARY_PATH=/usrx/local/intel/2015/composerxe/lib/mic:/usrx/local/intel/2015/mpirt/lib/mic:/usrx/local/intel/2015/mkl/lib/mic:/usrx/local/intel/2015/tbb/lib/mic
+ export MIC_LD_LIBRARY_PATH
+
MIC_LIBRARY_PATH=/usrx/local/intel/2015/composerxe/lib/mic:/usrx/local/intel/2015/mpirt/lib/mic:/usrx/local/intel/2015/tbb/lib/mic
+ export MIC_LIBRARY_PATH
+ MKLROOT=/usrx/local/intel/2015/mkl
+ export MKLROOT
+
MODULEPATH='/usrx/local/dev/modulefiles:/global/noscrub/Julie.Prestopnik/modulefiles:/usrx/local/Modules/versions:/usrx/local/Modules/$MODULE_VERSION/modulefiles:/usrx/local/modulefiles:/nwprod2/modulefiles:/nwprod2/lib/modulefiles:/nwprod/lib/modulefiles:/u/Benjamin.Blake/modulefiles'
+ export MODULEPATH
+
MPM_LAUNCHER=/usrx/local/intel/2015/composerxe/debugger/mpm/bin/start_mpm.sh
+ export MPM_LAUNCHER
+
NLSPATH=/usrx/local/intel/2015/composerxe/lib/intel64/locale/%l_%t/%N:/usrx/local/intel/2015/ipp/lib/intel64/locale/%l_%t/%N:/usrx/local/intel/2015/mkl/lib/intel64/locale/%l_%t/%N:/usrx/local/intel/2015/composer_xe_2015.3.187/debugger/gdb/intel64_mic/share/locale/%l_%t/%N:/usrx/local/intel/2015/composer_xe_2015.3.187/debugger/gdb/intel64/share/locale/%l_%t/%N
+ export NLSPATH
+
PATH=/global/noscrub/Julie.Prestopnik/met/8.0//bin:/global/noscrub/Julie.Prestopnik/met/8.0/external_libs/bin:/usrx/local/dev/python/2.7.14/bin:/usrx/local/intel/2015/advisor_xe_2015/bin64:/usrx/local/intel/2015/vtune_amplifier_xe_2015/bin64:/usrx/local/intel/2015/inspector_xe_2015/bin64:/usrx/local/intel/2015/impi_latest/intel64/bin:/usrx/local/intel/2015/itac_latest/intel64/bin:/usrx/local/intel/2015/composer_xe_2015.3.187/bin/intel64:/usrx/local/intel/2015/mpirt/bin/intel64:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64_mic/bin:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64/bin:.:/nwprod/gempak/nawips/os/linux2.6.32_x86_64/bin:/usr/lib64/qt-
3.3/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/opt/ibutils/bin:/nwprod/util/exec::/nwprod/util/ush::/u/Wesley.Ebisuzaki/bin:/u/Ying.Lin/bin:/nwprod/gempak/nawips/bin:/nwprod/gempak/nawips/scripts/ez:/nwprod/gempak/nawips/scripts/nawips:/nwprod/gempak/nawips/scripts/prnt:/nwprod/gempak/nawips/scripts/decoder:/sss/emc/meso/shared/Eric.Rogers/ddapp/exe_lnx6:/sss/emc/meso/shared/Eric.Rogers/vsdb/scripts
+ export PATH
+ PROD_DIR=/usrx/local/intel/2015/composerxe
+ export PROD_DIR
+ ROOTPATH=/usrx/local/intel/2015
+ export ROOTPATH
+ SCRIPTPATH=/usrx/local/intel/2015
+ export SCRIPTPATH
+ TBBROOT=/usrx/local/intel/2015/tbb
+ export TBBROOT
+
VTUNE_AMPLIFIER_XE_2015_DIR=/usrx/local/intel/2015/vtune_amplifier_xe_2015
+ export VTUNE_AMPLIFIER_XE_2015_DIR
+ VT_ADD_LIBS='-ldwarf -lelf -lvtunwind -lnsl -lm -ldl -lpthread'
+ export VT_ADD_LIBS
+ VT_ARCH=intel64
+ export VT_ARCH
+ VT_LIB_DIR=/usrx/local/intel/2015/itac_latest/lib
+ export VT_LIB_DIR
+ VT_MIC_SLIB_DIR=/usrx/local/intel/2015/itac_latest/mic/slib
+ export VT_MIC_SLIB_DIR
+ VT_MPI=impi4
+ export VT_MPI
+ VT_ROOT=/usrx/local/intel/2015/itac_latest
+ export VT_ROOT
+ VT_SLIB_DIR=/usrx/local/intel/2015/itac_latest/intel64/slib
+ export VT_SLIB_DIR
+
_LMFILES_=/usrx/local/modulefiles/ics/15.0.3:/usrx/local/dev/modulefiles/python/2.7.14:/global/noscrub/Julie.Prestopnik/modulefiles/met/8.0
+ export _LMFILES_
+ module load nco
+ /usrx/local/Modules/3.2.10/bin/modulecmd ksh load nco
+ eval LOADEDMODULES=ics/15.0.3:python/2.7.14:met/8.0:nco/4.2.4
';export'
'LOADEDMODULES;MANPATH=/usrx/local/nco/4.2.4/share/man:/usrx/local/dev/python/2.7.14/share/man:/usrx/local/intel/2015/impi_latest/man:/usrx/local/intel/2015/itac_latest/man:/usrx/local/intel/2015/composerxe/man/en_US:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64/share/man:/usr/share/man:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64_mic/share/man:/usrx/local/intel/2015/inspector_xe_2015/man:/usrx/local/intel/2015/vtune_amplifier_xe_2015/man:/usrx/local/intel/2015/advisor_xe_2015/man'
';export' 'MANPATH;NCO_INCLUDE=-I/usrx/local/nco/4.2.4/include'
';export' 'NCO_INCLUDE;NCO_LDFLAGS_C=-L/usrx/local/nco/4.2.4/lib'
';export' 'NCO_LDFLAGS_C;NCO_LDFLAGS_CXX=-L/usrx/local/nco/4.2.4/lib'
';export'
'NCO_LDFLAGS_CXX;PATH=/usrx/local/nco/4.2.4/bin:/global/noscrub/Julie.Prestopnik/met/8.0//bin:/global/noscrub/Julie.Prestopnik/met/8.0/external_libs/bin:/usrx/local/dev/python/2.7.14/bin:/usrx/local/intel/2015/advisor_xe_2015/bin64:/usrx/local/intel/2015/vtune_amplifier_xe_2015/bin64:/usrx/local/intel/2015/inspector_xe_2015/bin64:/usrx/local/intel/2015/impi_latest/intel64/bin:/usrx/local/intel/2015/itac_latest/intel64/bin:/usrx/local/intel/2015/composer_xe_2015.3.187/bin/intel64:/usrx/local/intel/2015/mpirt/bin/intel64:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64_mic/bin:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64/bin:.:/nwprod/gempak/nawips/os/linux2.6.32_x86_64/bin:/usr/lib64/qt-
3.3/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/opt/ibutils/bin:/nwprod/util/exec::/nwprod/util/ush::/u/Wesley.Ebisuzaki/bin:/u/Ying.Lin/bin:/nwprod/gempak/nawips/bin:/nwprod/gempak/nawips/scripts/ez:/nwprod/gempak/nawips/scripts/nawips:/nwprod/gempak/nawips/scripts/prnt:/nwprod/gempak/nawips/scripts/decoder:/sss/emc/meso/shared/Eric.Rogers/ddapp/exe_lnx6:/sss/emc/meso/shared/Eric.Rogers/vsdb/scripts'
';export'
'PATH;_LMFILES_=/usrx/local/modulefiles/ics/15.0.3:/usrx/local/dev/modulefiles/python/2.7.14:/global/noscrub/Julie.Prestopnik/modulefiles/met/8.0:/usrx/local/modulefiles/nco/4.2.4'
';export' '_LMFILES_;'
+ LOADEDMODULES=ics/15.0.3:python/2.7.14:met/8.0:nco/4.2.4
+ export LOADEDMODULES
+
MANPATH=/usrx/local/nco/4.2.4/share/man:/usrx/local/dev/python/2.7.14/share/man:/usrx/local/intel/2015/impi_latest/man:/usrx/local/intel/2015/itac_latest/man:/usrx/local/intel/2015/composerxe/man/en_US:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64/share/man:/usr/share/man:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64_mic/share/man:/usrx/local/intel/2015/inspector_xe_2015/man:/usrx/local/intel/2015/vtune_amplifier_xe_2015/man:/usrx/local/intel/2015/advisor_xe_2015/man
+ export MANPATH
+ NCO_INCLUDE=-I/usrx/local/nco/4.2.4/include
+ export NCO_INCLUDE
+ NCO_LDFLAGS_C=-L/usrx/local/nco/4.2.4/lib
+ export NCO_LDFLAGS_C
+ NCO_LDFLAGS_CXX=-L/usrx/local/nco/4.2.4/lib
+ export NCO_LDFLAGS_CXX
+
PATH=/usrx/local/nco/4.2.4/bin:/global/noscrub/Julie.Prestopnik/met/8.0//bin:/global/noscrub/Julie.Prestopnik/met/8.0/external_libs/bin:/usrx/local/dev/python/2.7.14/bin:/usrx/local/intel/2015/advisor_xe_2015/bin64:/usrx/local/intel/2015/vtune_amplifier_xe_2015/bin64:/usrx/local/intel/2015/inspector_xe_2015/bin64:/usrx/local/intel/2015/impi_latest/intel64/bin:/usrx/local/intel/2015/itac_latest/intel64/bin:/usrx/local/intel/2015/composer_xe_2015.3.187/bin/intel64:/usrx/local/intel/2015/mpirt/bin/intel64:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64_mic/bin:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64/bin:.:/nwprod/gempak/nawips/os/linux2.6.32_x86_64/bin:/usr/lib64/qt-
3.3/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/opt/ibutils/bin:/nwprod/util/exec::/nwprod/util/ush::/u/Wesley.Ebisuzaki/bin:/u/Ying.Lin/bin:/nwprod/gempak/nawips/bin:/nwprod/gempak/nawips/scripts/ez:/nwprod/gempak/nawips/scripts/nawips:/nwprod/gempak/nawips/scripts/prnt:/nwprod/gempak/nawips/scripts/decoder:/sss/emc/meso/shared/Eric.Rogers/ddapp/exe_lnx6:/sss/emc/meso/shared/Eric.Rogers/vsdb/scripts
+ export PATH
+
_LMFILES_=/usrx/local/modulefiles/ics/15.0.3:/usrx/local/dev/modulefiles/python/2.7.14:/global/noscrub/Julie.Prestopnik/modulefiles/met/8.0:/usrx/local/modulefiles/nco/4.2.4
+ export _LMFILES_
+ module load grib_util
+ /usrx/local/Modules/3.2.10/bin/modulecmd ksh load grib_util
+ eval CNVGRIB=/nwprod2/grib_util.v1.0.0/exec/cnvgrib ';export'
'CNVGRIB;COPYGB=/nwprod2/grib_util.v1.0.0/exec/copygb' ';export'
'COPYGB;COPYGB2=/nwprod2/grib_util.v1.0.0/exec/copygb2' ';export'
'COPYGB2;DEGRIB2=/nwprod2/grib_util.v1.0.0/exec/degrib2' ';export'
'DEGRIB2;GRB2INDEX=/nwprod2/grib_util.v1.0.0/exec/grb2index' ';export'
'GRB2INDEX;GRBINDEX=/nwprod2/grib_util.v1.0.0/exec/grbindex' ';export'
'GRBINDEX;GRIB2GRIB=/nwprod2/grib_util.v1.0.0/exec/grib2grib'
';export'
'GRIB2GRIB;LOADEDMODULES=ics/15.0.3:python/2.7.14:met/8.0:nco/4.2.4:grib_util/v1.0.0'
';export'
'LOADEDMODULES;TOCGRIB=/nwprod2/grib_util.v1.0.0/exec/tocgrib'
';export' 'TOCGRIB;TOCGRIB2=/nwprod2/grib_util.v1.0.0/exec/tocgrib2'
';export'
'TOCGRIB2;TOCGRIB2SUPER=/nwprod2/grib_util.v1.0.0/exec/tocgrib2super'
';export' 'TOCGRIB2SUPER;WGRIB=/nwprod2/grib_util.v1.0.0/exec/wgrib'
';export' 'WGRIB;WGRIB2=/nwprod2/grib_util.v1.0.0/exec/wgrib2'
';export'
'WGRIB2;_LMFILES_=/usrx/local/modulefiles/ics/15.0.3:/usrx/local/dev/modulefiles/python/2.7.14:/global/noscrub/Julie.Prestopnik/modulefiles/met/8.0:/usrx/local/modulefiles/nco/4.2.4:/nwprod2/modulefiles/grib_util/v1.0.0'
';export' '_LMFILES_;'
+ CNVGRIB=/nwprod2/grib_util.v1.0.0/exec/cnvgrib
+ export CNVGRIB
+ COPYGB=/nwprod2/grib_util.v1.0.0/exec/copygb
+ export COPYGB
+ COPYGB2=/nwprod2/grib_util.v1.0.0/exec/copygb2
+ export COPYGB2
+ DEGRIB2=/nwprod2/grib_util.v1.0.0/exec/degrib2
+ export DEGRIB2
+ GRB2INDEX=/nwprod2/grib_util.v1.0.0/exec/grb2index
+ export GRB2INDEX
+ GRBINDEX=/nwprod2/grib_util.v1.0.0/exec/grbindex
+ export GRBINDEX
+ GRIB2GRIB=/nwprod2/grib_util.v1.0.0/exec/grib2grib
+ export GRIB2GRIB
+
LOADEDMODULES=ics/15.0.3:python/2.7.14:met/8.0:nco/4.2.4:grib_util/v1.0.0
+ export LOADEDMODULES
+ TOCGRIB=/nwprod2/grib_util.v1.0.0/exec/tocgrib
+ export TOCGRIB
+ TOCGRIB2=/nwprod2/grib_util.v1.0.0/exec/tocgrib2
+ export TOCGRIB2
+ TOCGRIB2SUPER=/nwprod2/grib_util.v1.0.0/exec/tocgrib2super
+ export TOCGRIB2SUPER
+ WGRIB=/nwprod2/grib_util.v1.0.0/exec/wgrib
+ export WGRIB
+ WGRIB2=/nwprod2/grib_util.v1.0.0/exec/wgrib2
+ export WGRIB2
+
_LMFILES_=/usrx/local/modulefiles/ics/15.0.3:/usrx/local/dev/modulefiles/python/2.7.14:/global/noscrub/Julie.Prestopnik/modulefiles/met/8.0:/usrx/local/modulefiles/nco/4.2.4:/nwprod2/modulefiles/grib_util/v1.0.0
+ export _LMFILES_
+ METPLUS_PATH=/meso/save/Ying.Lin/metplus
+ export METPLUS_PATH
+ MET_PATH=/global/noscrub/Julie.Prestopnik/met/8.0
+ export MET_PATH
+ JLOGFILE=/meso/save/Ying.Lin/metplus/logs/metplus_jlogfile
+ export JLOGFILE
+
PYTHONPATH=/meso/save/Ying.Lin/metplus/ush:/meso/save/Ying.Lin/metplus/parm
+ export PYTHONPATH
+
PATH=/usrx/local/nco/4.2.4/bin:/global/noscrub/Julie.Prestopnik/met/8.0//bin:/global/noscrub/Julie.Prestopnik/met/8.0/external_libs/bin:/usrx/local/dev/python/2.7.14/bin:/usrx/local/intel/2015/advisor_xe_2015/bin64:/usrx/local/intel/2015/vtune_amplifier_xe_2015/bin64:/usrx/local/intel/2015/inspector_xe_2015/bin64:/usrx/local/intel/2015/impi_latest/intel64/bin:/usrx/local/intel/2015/itac_latest/intel64/bin:/usrx/local/intel/2015/composer_xe_2015.3.187/bin/intel64:/usrx/local/intel/2015/mpirt/bin/intel64:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64_mic/bin:/usrx/local/intel/2015/composerxe/debugger/gdb/intel64/bin:.:/nwprod/gempak/nawips/os/linux2.6.32_x86_64/bin:/usr/lib64/qt-
3.3/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/opt/ibutils/bin:/nwprod/util/exec::/nwprod/util/ush::/u/Wesley.Ebisuzaki/bin:/u/Ying.Lin/bin:/nwprod/gempak/nawips/bin:/nwprod/gempak/nawips/scripts/ez:/nwprod/gempak/nawips/scripts/nawips:/nwprod/gempak/nawips/scripts/prnt:/nwprod/gempak/nawips/scripts/decoder:/sss/emc/meso/shared/Eric.Rogers/ddapp/exe_lnx6:/sss/emc/meso/shared/Eric.Rogers/vsdb/scripts:/meso/save/Ying.Lin/metplus/ush:.
+ export PATH
+ echo 'Actual output starts here:'
Actual output starts here:
+ master_metplus.py -c
/meso/save/Ying.Lin/metplus/parm/use_cases/qpf/examples/phpt-vs-
s4grib.conf -c
/meso/save/Ying.Lin/metplus/parm/ylin_config/system.conf.wcoss
03/12 19:02:48.199 jlog (log.py:66) INFO: master_metplus is starting
03/12 19:02:48.215 jlog (master_metplus.py:58) INFO: Top of
master_metplus
03/12 19:02:48.215 master_metplus (master_metplus.py:67) INFO: logger
Top of master_metplus.
03/12 19:02:48.215 metplus (config_metplus.py:76) INFO: Starting
METplus configuration setup.
03/12 19:02:48.215 metplus (config_metplus.py:99) INFO: All OPTS and
ARGS: [('-c',
'/meso/save/Ying.Lin/metplus/parm/use_cases/qpf/examples/phpt-vs-
s4grib.conf'), ('-c',
'/meso/save/Ying.Lin/metplus/parm/ylin_config/system.conf.wcoss')] []
03/12 19:02:48.216 metplus (config_launcher.py:157) INFO:
/meso/save/Ying.Lin/metplus/parm/use_cases/qpf/examples/phpt-vs-
s4grib.conf
03/12 19:02:48.219 metplus (config_launcher.py:168) INFO:
/meso/save/Ying.Lin/metplus/parm/use_cases/qpf/examples/phpt-vs-
s4grib.conf: Plan to parse this conf file
03/12 19:02:48.219 metplus (config_launcher.py:157) INFO:
/meso/save/Ying.Lin/metplus/parm/ylin_config/system.conf.wcoss
03/12 19:02:48.219 metplus (config_launcher.py:168) INFO:
/meso/save/Ying.Lin/metplus/parm/ylin_config/system.conf.wcoss: Plan
to parse this conf file
03/12 19:02:48.220 metplus (config_launcher.py:192) INFO: Conf input:
'/gpfs/td1/emc/meso/save/Ying.Lin/metplus/parm/metplus_config/metplus_system.conf'
03/12 19:02:48.221 metplus (config_launcher.py:192) INFO: Conf input:
'/gpfs/td1/emc/meso/save/Ying.Lin/metplus/parm/metplus_config/metplus_data.conf'
03/12 19:02:48.221 metplus (config_launcher.py:192) INFO: Conf input:
'/gpfs/td1/emc/meso/save/Ying.Lin/metplus/parm/metplus_config/metplus_runtime.conf'
03/12 19:02:48.222 metplus (config_launcher.py:192) INFO: Conf input:
'/gpfs/td1/emc/meso/save/Ying.Lin/metplus/parm/metplus_config/metplus_logging.conf'
03/12 19:02:48.222 metplus (config_launcher.py:192) INFO: Conf input:
'/meso/save/Ying.Lin/metplus/parm/use_cases/qpf/examples/phpt-vs-
s4grib.conf'
03/12 19:02:48.222 metplus (config_launcher.py:192) INFO: Conf input:
'/meso/save/Ying.Lin/metplus/parm/ylin_config/system.conf.wcoss'
03/12 19:02:48.228 metplus (config_launcher.py:218) INFO:
/gpfs/td1/emc/meso/save/Ying.Lin/metplus/parm/metplus_config/metplus_system.conf:
Parsed this file
03/12 19:02:48.243 metplus (config_launcher.py:218) INFO:
/gpfs/td1/emc/meso/save/Ying.Lin/metplus/parm/metplus_config/metplus_data.conf:
Parsed this file
03/12 19:02:48.261 metplus (config_launcher.py:218) INFO:
/gpfs/td1/emc/meso/save/Ying.Lin/metplus/parm/metplus_config/metplus_runtime.conf:
Parsed this file
03/12 19:02:48.277 metplus (config_launcher.py:218) INFO:
/gpfs/td1/emc/meso/save/Ying.Lin/metplus/parm/metplus_config/metplus_logging.conf:
Parsed this file
03/12 19:02:48.295 metplus (config_launcher.py:218) INFO:
/meso/save/Ying.Lin/metplus/parm/use_cases/qpf/examples/phpt-vs-
s4grib.conf: Parsed this file
03/12 19:02:48.325 metplus (config_launcher.py:218) INFO:
/meso/save/Ying.Lin/metplus/parm/ylin_config/system.conf.wcoss: Parsed
this file
03/12 19:02:48.326 metplus (met_util.py:238) INFO: Adding:
config.LOG_TIMESTAMP='20190312'
03/12 19:02:48.326 metplus (met_util.py:244) INFO: Replace [config]
LOG_METPLUS with
'/meso/noscrub/Ying.Lin/metplus.out/logs/master_metplus.log.20190312'
03/12 19:02:48.335 metplus (config_launcher.py:288) WARNING:
METPLUS_BASE from the conf files has no effect. Overriding to
/gpfs/td1/emc/meso/save/Ying.Lin/metplus
03/12 19:02:48.345 metplus (config_launcher.py:300) INFO: Replace
[dir] OUTPUT_BASE with /meso/noscrub/Ying.Lin/metplus.out
03/12 19:02:48.346 metplus (config_launcher.py:300) INFO: Replace
[dir] METPLUS_BASE with /gpfs/td1/emc/meso/save/Ying.Lin/metplus
03/12 19:02:48.346 metplus (config_launcher.py:310) INFO:
METPLUS_CONF: /meso/noscrub/Ying.Lin/metplus.out/metplus_final.conf
written here.
03/12 19:02:48.349 metplus (config_metplus.py:148) INFO: Completed
METplus configuration setup.
03/12 19:02:48.350 metplus (master_metplus.py:93) INFO: Running
METplus v2.0.4 called with command:
/meso/save/Ying.Lin/metplus/ush/master_metplus.py -c
/meso/save/Ying.Lin/metplus/parm/use_cases/qpf/examples/phpt-vs-
s4grib.conf -c
/meso/save/Ying.Lin/metplus/parm/ylin_config/system.conf.wcoss
03/12 19:02:48.374 metplus.GridStat (master_metplus.py:158) INFO:
****************************************
03/12 19:02:48.375 metplus.GridStat (master_metplus.py:159) INFO: *
RUNNING METplus
03/12 19:02:48.375 metplus.GridStat (master_metplus.py:161) INFO: *
at init time: 201609041200
03/12 19:02:48.375 metplus.GridStat (master_metplus.py:164) INFO:
****************************************
03/12 19:02:48.377 metplus.PcpCombine (reformat_gridded_wrapper.py:75)
INFO: PROCESSING OBS DATA
03/12 19:02:48.377 metplus.PcpCombine (reformat_gridded_wrapper.py:78)
INFO: PROCESSING FORECAST LEAD 6
03/12 19:02:48.405 metplus.PcpCombine (command_runner.py:222) DEBUG:
LOG_MET_OUTPUT_TO_METPLUS log file is True
03/12 19:02:48.406 metplus.PcpCombine (command_runner.py:119) INFO:
app_name is: pcp_combine, output sent to:
/meso/noscrub/Ying.Lin/metplus.out/logs/master_metplus.log.20190312
03/12 19:02:48.578 mpi_impl (__init__.py:331) INFO: inside_aprun: not
detected: INSIDE_APRUN is not set or is 0
03/12 19:02:48.579 mpi_impl (__init__.py:331) INFO: lsf_cray_intel:
not detected: aprun: cannot find executable
03/12 19:02:48.580 mpi_impl (__init__.py:331) INFO: mpirun_lsf: not
detected: mpirun.lsf: cannot find executable
03/12 19:02:48.676 mpi_impl (__init__.py:331) INFO: impi: not
detected: 'TOTAL_TASKS'
03/12 19:02:48.677 mpi_impl (__init__.py:331) INFO: mpiexec_mpt: not
detected: mpiexec_mpt: cannot find executable
03/12 19:02:48.678 mpi_impl (__init__.py:331) INFO: srun: not
detected: srun: cannot find executable
03/12 19:02:48.683 mpi_impl (__init__.py:331) INFO: mpiexec: not
detected: 'TOTAL_TASKS'
03/12 19:02:48.684 metplus.PcpCombine (command_runner.py:155) INFO:
RUNNING: /global/noscrub/Julie.Prestopnik/met/8.0/bin/pcp_combine
-name APCP_06 -add /global/noscrub/Julie.Prestopnik/METplus/METplus-
2.0.4_sample_data/qpf/uswrp/StageIV/20160904/ST4.2016090418.06h 6
/meso/noscrub/Ying.Lin/metplus.out/uswrp/StageIV_grib/bucket/20160904/ST4.2016090418_A06h
-v 5 >>
/meso/noscrub/Ying.Lin/metplus.out/logs/master_metplus.log.20190312
2>&1
03/12 19:02:50.287 metplus.PcpCombine (reformat_gridded_wrapper.py:78)
INFO: PROCESSING FORECAST LEAD 7
03/12 19:02:50.307 metplus.PcpCombine (command_runner.py:222) DEBUG:
LOG_MET_OUTPUT_TO_METPLUS log file is True
03/12 19:02:50.310 metplus.PcpCombine (command_runner.py:119) INFO:
app_name is: pcp_combine, output sent to:
/meso/noscrub/Ying.Lin/metplus.out/logs/master_metplus.log.20190312
03/12 19:02:50.310 metplus.PcpCombine (command_runner.py:155) INFO:
RUNNING: /global/noscrub/Julie.Prestopnik/met/8.0/bin/pcp_combine
-name APCP_06 -add /global/noscrub/Julie.Prestopnik/METplus/METplus-
2.0.4_sample_data/qpf/uswrp/StageIV/20160904/ST4.2016090419.01h 1
/global/noscrub/Julie.Prestopnik/METplus/METplus-
2.0.4_sample_data/qpf/uswrp/StageIV/20160904/ST4.2016090418.01h 1
/global/noscrub/Julie.Prestopnik/METplus/METplus-
2.0.4_sample_data/qpf/uswrp/StageIV/20160904/ST4.2016090417.01h 1
/global/noscrub/Julie.Prestopnik/METplus/METplus-
2.0.4_sample_data/qpf/uswrp/StageIV/20160904/ST4.2016090416.01h 1
/global/noscrub/Julie.Prestopnik/METplus/METplus-
2.0.4_sample_data/qpf/uswrp/StageIV/20160904/ST4.2016090415.01h 1
/global/noscrub/Julie.Prestopnik/METplus/METplus-
2.0.4_sample_data/qpf/uswrp/StageIV/20160904/ST4.2016090414.01h 1
/meso/noscrub/Ying.Lin/metplus.out/uswrp/StageIV_grib/bucket/20160904/ST4.2016090419_A06h
-v 5 >>
/meso/noscrub/Ying.Lin/metplus.out/logs/master_metplus.log.20190312
2>&1
03/12 19:02:52.315 metplus.RegridDataPlane
(reformat_gridded_wrapper.py:75) INFO: PROCESSING OBS DATA
03/12 19:02:52.316 metplus.RegridDataPlane
(reformat_gridded_wrapper.py:78) INFO: PROCESSING FORECAST LEAD 6
03/12 19:02:52.317 metplus.RegridDataPlane (command_runner.py:222)
DEBUG: LOG_MET_OUTPUT_TO_METPLUS log file is True
03/12 19:02:52.319 metplus.RegridDataPlane (command_runner.py:119)
INFO: app_name is: regrid_data_plane, output sent to:
/meso/noscrub/Ying.Lin/metplus.out/logs/master_metplus.log.20190312
03/12 19:02:52.319 metplus.RegridDataPlane (command_runner.py:155)
INFO: RUNNING:
/global/noscrub/Julie.Prestopnik/met/8.0/bin/regrid_data_plane -v 5
-field "name=\"APCP_06\"; level=\"(*,*)\";" -method BUDGET -width 2
-name APCP_06
/meso/noscrub/Ying.Lin/metplus.out/uswrp/StageIV_grib/bucket/20160904/ST4.2016090418_A06h
/global/noscrub/Julie.Prestopnik/METplus/METplus-
2.0.4_sample_data/qpf/mask/CONUS_HRRRTLE.nc
/meso/noscrub/Ying.Lin/metplus.out/uswrp/StageIV_grib/regrid/20160904/ST4.2016090418_A06h
>> /meso/noscrub/Ying.Lin/metplus.out/logs/master_metplus.log.20190312
2>&1
03/12 19:03:14.947 metplus.RegridDataPlane
(reformat_gridded_wrapper.py:78) INFO: PROCESSING FORECAST LEAD 7
03/12 19:03:14.949 metplus.RegridDataPlane (command_runner.py:222)
DEBUG: LOG_MET_OUTPUT_TO_METPLUS log file is True
03/12 19:03:14.951 metplus.RegridDataPlane (command_runner.py:119)
INFO: app_name is: regrid_data_plane, output sent to:
/meso/noscrub/Ying.Lin/metplus.out/logs/master_metplus.log.20190312
03/12 19:03:14.951 metplus.RegridDataPlane (command_runner.py:155)
INFO: RUNNING:
/global/noscrub/Julie.Prestopnik/met/8.0/bin/regrid_data_plane -v 5
-field "name=\"APCP_06\"; level=\"(*,*)\";" -method BUDGET -width 2
-name APCP_06
/meso/noscrub/Ying.Lin/metplus.out/uswrp/StageIV_grib/bucket/20160904/ST4.2016090419_A06h
/global/noscrub/Julie.Prestopnik/METplus/METplus-
2.0.4_sample_data/qpf/mask/CONUS_HRRRTLE.nc
/meso/noscrub/Ying.Lin/metplus.out/uswrp/StageIV_grib/regrid/20160904/ST4.2016090419_A06h
>> /meso/noscrub/Ying.Lin/metplus.out/logs/master_metplus.log.20190312
2>&1
03/12 19:03:36.978 metplus.GridStat (compare_gridded_wrapper.py:258)
INFO: PROCESSING FORECAST LEAD 6
03/12 19:03:36.988 metplus.GridStat (compare_gridded_wrapper.py:339)
DEBUG: ENVIRONMENT FOR NEXT COMMAND:
03/12 19:03:36.988 metplus.GridStat (command_builder.py:158) DEBUG:
MODEL=PHPT
03/12 19:03:36.988 metplus.GridStat (command_builder.py:158) DEBUG:
FCST_VAR=APCP
03/12 19:03:36.988 metplus.GridStat (command_builder.py:158) DEBUG:
OBS_VAR=APCP
03/12 19:03:36.989 metplus.GridStat (command_builder.py:158) DEBUG:
LEVEL=A06
03/12 19:03:36.989 metplus.GridStat (command_builder.py:158) DEBUG:
OBTYPE=STAGE4_GRIB
03/12 19:03:36.989 metplus.GridStat (command_builder.py:158) DEBUG:
CONFIG_DIR=/gpfs/td1/emc/meso/save/Ying.Lin/metplus/parm/use_cases/qpf/met_config
03/12 19:03:36.989 metplus.GridStat (command_builder.py:158) DEBUG:
FCST_FIELD={ name="PROB"; level="A06"; prob={ name="APCP";
thresh_lo=12.7; } cat_thresh=[==0.1];},{ name="PROB"; level="A06";
prob={ name="APCP"; thresh_lo=25.4; } cat_thresh=[==0.1];},{
name="PROB"; level="A06"; prob={ name="APCP"; thresh_lo=50.8; }
cat_thresh=[==0.1];},{ name="PROB"; level="A06"; prob={ name="APCP";
thresh_lo=76.2; } cat_thresh=[==0.1];},{ name="PROB"; level="A06";
prob={ name="APCP"; thresh_lo=152.4; } cat_thresh=[==0.1];}
03/12 19:03:36.989 metplus.GridStat (command_builder.py:158) DEBUG:
OBS_FIELD={ name="APCP_06"; level="(*,*)"; cat_thresh=[ gt12.7 ]; },{
name="APCP_06"; level="(*,*)"; cat_thresh=[ gt25.4 ]; },{
name="APCP_06"; level="(*,*)"; cat_thresh=[ gt50.8 ]; },{
name="APCP_06"; level="(*,*)"; cat_thresh=[ gt76.2 ]; },{
name="APCP_06"; level="(*,*)"; cat_thresh=[ gt152.4 ]; }
03/12 19:03:36.989 metplus.GridStat (command_builder.py:158) DEBUG:
INPUT_BASE=/global/noscrub/Julie.Prestopnik/METplus/METplus-
2.0.4_sample_data
03/12 19:03:36.989 metplus.GridStat (command_builder.py:158) DEBUG:
MET_VALID_HHMM=0904
03/12 19:03:36.989 metplus.GridStat (command_builder.py:158) DEBUG:
FCST_TIME=006
03/12 19:03:36.990 metplus.GridStat (compare_gridded_wrapper.py:343)
DEBUG: COPYABLE ENVIRONMENT FOR NEXT COMMAND:
03/12 19:03:36.990 metplus.GridStat (command_builder.py:153) DEBUG:
export MODEL="PHPT"; export FCST_VAR="APCP"; export OBS_VAR="APCP";
export LEVEL="A06"; export OBTYPE="STAGE4_GRIB"; export
CONFIG_DIR="/gpfs/td1/emc/meso/save/Ying.Lin/metplus/parm/use_cases/qpf/met_config";
export FCST_FIELD="{ name=\"PROB\"; level=\"A06\"; prob={
name=\"APCP\"; thresh_lo=12.7; } cat_thresh=[==0.1];},{ name=\"PROB\";
level=\"A06\"; prob={ name=\"APCP\"; thresh_lo=25.4; }
cat_thresh=[==0.1];},{ name=\"PROB\"; level=\"A06\"; prob={
name=\"APCP\"; thresh_lo=50.8; } cat_thresh=[==0.1];},{ name=\"PROB\";
level=\"A06\"; prob={ name=\"APCP\"; thresh_lo=76.2; }
cat_thresh=[==0.1];},{ name=\"PROB\"; level=\"A06\"; prob={
name=\"APCP\"; thresh_lo=152.4; } cat_thresh=[==0.1];}"; export
OBS_FIELD="{ name=\"APCP_06\"; level=\"(*,*)\"; cat_thresh=[ gt12.7 ];
},{ name=\"APCP_06\"; level=\"(*,*)\"; cat_thresh=[ gt25.4 ]; },{
name=\"APCP_06\"; level=\"(*,*)\"; cat_thresh=[ gt50.8 ]; },{
name=\"APCP_06\"; level=\"(*,*)\"; cat_thresh=[ gt76.2 ]; },{
name=\"APCP_06\"; level=\"(*,*)\"; cat_thresh=[ gt152.4 ]; }"; export
INPUT_BASE="/global/noscrub/Julie.Prestopnik/METplus/METplus-
2.0.4_sample_data"; export MET_VALID_HHMM="0904"; export
FCST_TIME="006";
03/12 19:03:36.990 metplus.GridStat (command_runner.py:222) DEBUG:
LOG_MET_OUTPUT_TO_METPLUS log file is True
03/12 19:03:36.991 metplus.GridStat (command_runner.py:119) INFO:
app_name is: grid_stat, output sent to:
/meso/noscrub/Ying.Lin/metplus.out/logs/master_metplus.log.20190312
03/12 19:03:36.992 metplus.GridStat (command_runner.py:155) INFO:
RUNNING: /global/noscrub/Julie.Prestopnik/met/8.0/bin/grid_stat
/global/noscrub/Julie.Prestopnik/METplus/METplus-
2.0.4_sample_data/qpf/PHPT/20160904/20160904_i12_f006_HRRRTLE_PHPT.grb2
/meso/noscrub/Ying.Lin/metplus.out/uswrp/StageIV_grib/regrid/20160904/ST4.2016090418_A06h
/gpfs/td1/emc/meso/save/Ying.Lin/metplus/parm/use_cases/qpf/met_config/GridStatConfig_PROB
-outdir
/meso/noscrub/Ying.Lin/metplus.out/uswrp/met_out/PHPT/201609041200/grid_stat
>> /meso/noscrub/Ying.Lin/metplus.out/logs/master_metplus.log.20190312
2>&1
03/12 19:03:47.606 metplus.GridStat (compare_gridded_wrapper.py:258)
INFO: PROCESSING FORECAST LEAD 7
03/12 19:03:47.616 metplus.GridStat (compare_gridded_wrapper.py:339)
DEBUG: ENVIRONMENT FOR NEXT COMMAND:
03/12 19:03:47.616 metplus.GridStat (command_builder.py:158) DEBUG:
MODEL=PHPT
03/12 19:03:47.616 metplus.GridStat (command_builder.py:158) DEBUG:
FCST_VAR=APCP
03/12 19:03:47.616 metplus.GridStat (command_builder.py:158) DEBUG:
OBS_VAR=APCP
03/12 19:03:47.616 metplus.GridStat (command_builder.py:158) DEBUG:
LEVEL=A06
03/12 19:03:47.616 metplus.GridStat (command_builder.py:158) DEBUG:
OBTYPE=STAGE4_GRIB
03/12 19:03:47.616 metplus.GridStat (command_builder.py:158) DEBUG:
CONFIG_DIR=/gpfs/td1/emc/meso/save/Ying.Lin/metplus/parm/use_cases/qpf/met_config
03/12 19:03:47.617 metplus.GridStat (command_builder.py:158) DEBUG:
FCST_FIELD={ name="PROB"; level="A06"; prob={ name="APCP";
thresh_lo=12.7; } cat_thresh=[==0.1];},{ name="PROB"; level="A06";
prob={ name="APCP"; thresh_lo=25.4; } cat_thresh=[==0.1];},{
name="PROB"; level="A06"; prob={ name="APCP"; thresh_lo=50.8; }
cat_thresh=[==0.1];},{ name="PROB"; level="A06"; prob={ name="APCP";
thresh_lo=76.2; } cat_thresh=[==0.1];},{ name="PROB"; level="A06";
prob={ name="APCP"; thresh_lo=152.4; } cat_thresh=[==0.1];}
03/12 19:03:47.617 metplus.GridStat (command_builder.py:158) DEBUG:
OBS_FIELD={ name="APCP_06"; level="(*,*)"; cat_thresh=[ gt12.7 ]; },{
name="APCP_06"; level="(*,*)"; cat_thresh=[ gt25.4 ]; },{
name="APCP_06"; level="(*,*)"; cat_thresh=[ gt50.8 ]; },{
name="APCP_06"; level="(*,*)"; cat_thresh=[ gt76.2 ]; },{
name="APCP_06"; level="(*,*)"; cat_thresh=[ gt152.4 ]; }
03/12 19:03:47.617 metplus.GridStat (command_builder.py:158) DEBUG:
INPUT_BASE=/global/noscrub/Julie.Prestopnik/METplus/METplus-
2.0.4_sample_data
03/12 19:03:47.617 metplus.GridStat (command_builder.py:158) DEBUG:
MET_VALID_HHMM=0904
03/12 19:03:47.617 metplus.GridStat (command_builder.py:158) DEBUG:
FCST_TIME=007
03/12 19:03:47.617 metplus.GridStat (compare_gridded_wrapper.py:343)
DEBUG: COPYABLE ENVIRONMENT FOR NEXT COMMAND:
03/12 19:03:47.617 metplus.GridStat (command_builder.py:153) DEBUG:
export MODEL="PHPT"; export FCST_VAR="APCP"; export OBS_VAR="APCP";
export LEVEL="A06"; export OBTYPE="STAGE4_GRIB"; export
CONFIG_DIR="/gpfs/td1/emc/meso/save/Ying.Lin/metplus/parm/use_cases/qpf/met_config";
export FCST_FIELD="{ name=\"PROB\"; level=\"A06\"; prob={
name=\"APCP\"; thresh_lo=12.7; } cat_thresh=[==0.1];},{ name=\"PROB\";
level=\"A06\"; prob={ name=\"APCP\"; thresh_lo=25.4; }
cat_thresh=[==0.1];},{ name=\"PROB\"; level=\"A06\"; prob={
name=\"APCP\"; thresh_lo=50.8; } cat_thresh=[==0.1];},{ name=\"PROB\";
level=\"A06\"; prob={ name=\"APCP\"; thresh_lo=76.2; }
cat_thresh=[==0.1];},{ name=\"PROB\"; level=\"A06\"; prob={
name=\"APCP\"; thresh_lo=152.4; } cat_thresh=[==0.1];}"; export
OBS_FIELD="{ name=\"APCP_06\"; level=\"(*,*)\"; cat_thresh=[ gt12.7 ];
},{ name=\"APCP_06\"; level=\"(*,*)\"; cat_thresh=[ gt25.4 ]; },{
name=\"APCP_06\"; level=\"(*,*)\"; cat_thresh=[ gt50.8 ]; },{
name=\"APCP_06\"; level=\"(*,*)\"; cat_thresh=[ gt76.2 ]; },{
name=\"APCP_06\"; level=\"(*,*)\"; cat_thresh=[ gt152.4 ]; }"; export
INPUT_BASE="/global/noscrub/Julie.Prestopnik/METplus/METplus-
2.0.4_sample_data"; export MET_VALID_HHMM="0904"; export
FCST_TIME="007";
03/12 19:03:47.618 metplus.GridStat (command_runner.py:222) DEBUG:
LOG_MET_OUTPUT_TO_METPLUS log file is True
03/12 19:03:47.619 metplus.GridStat (command_runner.py:119) INFO:
app_name is: grid_stat, output sent to:
/meso/noscrub/Ying.Lin/metplus.out/logs/master_metplus.log.20190312
03/12 19:03:47.619 metplus.GridStat (command_runner.py:155) INFO:
RUNNING: /global/noscrub/Julie.Prestopnik/met/8.0/bin/grid_stat
/global/noscrub/Julie.Prestopnik/METplus/METplus-
2.0.4_sample_data/qpf/PHPT/20160904/20160904_i12_f007_HRRRTLE_PHPT.grb2
/meso/noscrub/Ying.Lin/metplus.out/uswrp/StageIV_grib/regrid/20160904/ST4.2016090419_A06h
/gpfs/td1/emc/meso/save/Ying.Lin/metplus/parm/use_cases/qpf/met_config/GridStatConfig_PROB
-outdir
/meso/noscrub/Ying.Lin/metplus.out/uswrp/met_out/PHPT/201609041200/grid_stat
>> /meso/noscrub/Ying.Lin/metplus.out/logs/master_metplus.log.20190312
2>&1
------------------------------------------------
Subject: CCPA file name format for METplus
From: George McCabe
Time: Tue Mar 12 15:11:19 2019
Hi Ying,
Glad to hear that you were able to run pcp_combine viaMETplus.
Could you send me this file?
/meso/noscrub/Ying.Lin/metplus.out/metplus_final.conf
It looks like there is a loop over all of the field variables to
process
after the log PROCESSING FORECAST LEAD 24, so perhaps that has been
overwritten so be empty.
On Tue, Mar 12, 2019 at 8:19 PM Ying Lin via RT <met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=89063 >
>
> Thanks very much George.
>
> Moving the METplus.v2.0.4, the pcp_combine step did work
easily,
> but now I'm having trouble with the regrid_data_plane step. Running
the
> METplus script (test_fv3gfs_24h.ksh, attached), I'm seeing in the
job
> out (fv3gfs.out) that
> 03/12 19:45:18.029 metplus.RegridDataPlane
> (reformat_gridded_wrapper.py:75) INFO: PROCESSING OBS DATA
> 03/12 19:45:18.029 metplus.RegridDataPlane
> (reformat_gridded_wrapper.py:78) INFO: PROCESSING FORECAST LEAD 24
>
> With no further info about the RegridDataPlane step, it moves on to
> metplus.GridStat, and (unsurprisingly) cannot find the verifying
> analysis in the qpe_grib/regrid/.
>
> I tried the two use cases in
> /global/noscrub/Julie.Prestopnik/METplus/METplus-
2.0.4/parm/use_cases/qpf/examples,
>
> phpt-vs-s4grib.conf and ruc-vs-s2grib.conf, they both do work
(though
> the latter was re-gridding from G212 to the same G212), e.g. in the
> attached phpt.out (successful RegridDataPlane), it's got
>
> 03/12 18:01:11.883 metplus.RegridDataPlane
> (reformat_gridded_wrapper.py:75) INFO: PROCESSING OBS DATA
> 03/12 18:01:11.883 metplus.RegridDataPlane
> (reformat_gridded_wrapper.py:78) INFO: PROCESSING FORECAST LEAD 3
> 03/12 18:01:11.885 metplus.RegridDataPlane (command_runner.py:222)
> DEBUG: LOG_MET_OUTPUT_TO_METPLUS log file is True ...
>
> So there is something in my fv3gfs test setup that prevented it from
> moving on to the "command_runner.py:222" step. I tried comparing my
> fv3gfs_24h.conf with the use case samples phpt-vs-s4grib.conf and
> ruc-vs-s2grib.conf, and couldn't see what I did wrong. I'm running
out
> of ideas. Would you mind taking a look at this?
>
> I tried running the MET regrid_data_plane manually (regridit.ksh)
using
> the metplus.PcpCombine output, and it worked fine.
>
> Thank you -
>
> Ying
>
> On 3/11/19 12:23 PM, George McCabe via RT wrote:
> > Hi Ying,
> >
> > Using the new version of METplus, you will see the following
error:
> >
> > ERROR: Threshold values must start with
>,>=,==,!=,<,<=,gt,ge,eq,ne,lt,
> or
> > le
> >
> > If you add a comparison operator to each item of your
FCST_VAR1_THRESH
> > list, this error will go away. The old default operator was >=, so
adding
> > that would preserve the old behavior if that is what you want.
> >
> > You will also see some warnings of METplus variables being
deprecated.
> You
> > can change the name of these variables to get rid of those
warnings. The
> > warning description should be clear.
> >
> > When I ran your config file, METplus built the following command:
> >
> > /usr/local/met-8.0/bin/pcp_combine -name APCP_24 -add
> >
>
/d1/mccabe/ying_data/com2/ccpa/prod/ccpa.20190310/12/ccpa.t12z.06h.hrap.conus.gb2
> > 6
> >
>
/d1/mccabe/ying_data/com2/ccpa/prod/ccpa.20190310/06/ccpa.t06z.06h.hrap.conus.gb2
> > 6
> >
>
/d1/mccabe/ying_data/com2/ccpa/prod/ccpa.20190310/00/ccpa.t00z.06h.hrap.conus.gb2
> > 6
> >
>
/d1/mccabe/ying_data/com2/ccpa/prod/ccpa.20190309/18/ccpa.t18z.06h.hrap.conus.gb2
> > 6
/d1/mccabe/ying_data/out/qpe_grib/bucket/20190310/ccpa.2019031012_A24h
> -v
> > 2
> >
> > Let me know if you have any other issues.
> >
> > Thanks,
> > George
> >
> > On Mon, Mar 11, 2019 at 9:48 AM Ying Lin via RT
<met_help at ucar.edu>
> wrote:
> >
> >> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=89063 >
> >>
> >> Hi George,
> >>
> >> First of all, thank you for telling me about passing the
envir
> >> variable using {ENV[vday]}, that was really useful!
> >>
> >> Still have trouble "finding" the CCPA files. I've first
changed
> >> the OBS_LEVEL=6, when that didn't work, I explicitly specified
the '06h'
> >> in the file name in the config, e.g.
> >>
> >> OBS_PCP_COMBINE_INPUT_TEMPLATE =
> >>
> >>
>
ccpa.{valid?fmt=%Y%m%d}/{valid?fmt=%H}/ccpa.t{valid?fmt=%H}z.06h.hrap.conus.gb2
> >>
> >> Still getting the "WARNING: pcp_combine: Could not find files to
compute
> >> accumulation in /com2/ccpa/prod" in the job output and the log
file
> >> (both attached to this email, as well as the config file). Also
> >> attached are the four 6h CCPA files with their full paths, e.g.
> >> t10a1 $ tar cvfz /stmpp1/Ying.Lin/ccpa.tar.gz
> >> /com2/ccpa/prod/ccpa.20190309/18/ccpa.*06h.hrap.conus.gb2
> >> /com2/ccpa/prod/ccpa.20190310/*/ccpa.*06h.hrap.conus.gb2
> >> tar: Removing leading `/' from member names
> >> /com2/ccpa/prod/ccpa.20190309/18/ccpa.t18z.06h.hrap.conus.gb2
> >> /com2/ccpa/prod/ccpa.20190310/00/ccpa.t00z.06h.hrap.conus.gb2
> >> /com2/ccpa/prod/ccpa.20190310/06/ccpa.t06z.06h.hrap.conus.gb2
> >> /com2/ccpa/prod/ccpa.20190310/12/ccpa.t12z.06h.hrap.conus.gb2
> >>
> >> Thanks again -
> >>
> >> Ying
> >>
> >> On 3/11/19 10:47 AM, George McCabe via RT wrote:
> >>> Hi Ying,
> >>>
> >>> I was incorrect that you need to change the precision. %H should
find
> the
> >>> time the way it is formatted. I think you will need to remove
OBS_LEVEL
> >> = 1
> >>> from your config. This variable tells METplus to only look for 1
hr
> >>> accumulation files to use in pcp_combine. If you remove this
variable,
> it
> >>> should look for a 24 hr accumulation file and reduce the hour by
1
> until
> >> it
> >>> finds a file that it can use. If you want to force METplus to
use 6
> hour
> >>> files to build the 24 hr accumulation, you should set OBS_LEVEL
= 6.
> Let
> >> me
> >>> know if that helps.
> >>>
> >>> Thanks,
> >>> George
> >>>
> >>> On Mon, Mar 11, 2019 at 8:30 AM George McCabe <mccabe at ucar.edu>
wrote:
> >>>
> >>>> Hi Ying,
> >>>>
> >>>> You may need to change %H to %.2H in the template to tell it
that
> there
> >>>> will always be 2 digit precision. If that doesn't work, could
you send
> >> me
> >>>> the directory listing so I can see what files are available?
> >>>>
> >>>> To pass in environment variables, use the following notation:
> >> {ENV[vday]}.
> >>>> You are correct that using valid hour for the directory name
will not
> >>>> work, as it will change the value to 03. If this value is going
to
> >> change
> >>>> between runs and doesn't directly correspond to the valid time,
you
> may
> >>>> have to trick it with environment variables to get it to work
> correctly.
> >>>>
> >>>> On Thu, Mar 7, 2019 at 1:33 PM Ying Lin via RT
<met_help at ucar.edu>
> >> wrote:
> >>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=89063
>
> >>>>>
> >>>>> Hi George,
> >>>>>
> >>>>> Thanks! That makes sense, though it didn't quite work
out for
> >> me.
> >>>>> In the attached fv3gfs_24h_by_valid_time.conf, I have
> >>>>> OBS_PCP_COMBINE_INPUT_DIR = /com2/ccpa/prod
> >>>>> then
> >>>>> OBS_PCP_COMBINE_INPUT_TEMPLATE =
> >>>>>
> >>>>>
> >>
>
ccpa.{valid?fmt=%Y%m%d}/{valid?fmt=%H}/ccpa.t{valid?fmt=%H}z.{level?fmt=%.2H}h.hrap.conus.gb2
> >>>>> thinking that it would tell pcp_combine to look for e,g,
> >>>>> /com2/ccpa/prod/ccpa.20190305/06/ccpa.t06z.06h.hrap.conus.gb2
> >>>>>
> >>>>> Instead I'm getting "WARNING: pcp_combine: Could not find
files to
> >>>>> compute accumulation in /com2/ccpa/prod" (in the attached
test.out
> and
> >>>>> master_metplus.log.20190307).
> >>>>>
> >>>>> Could you tell what I'm doing wrong in the config?
> >>>>>
> >>>>> I'm doing the above in
Tide:/meso/save/Ying.Lin/metplus/test/.
> >>>>>
> >>>>> Also two related questions:
> >>>>> 1) In the METplus model config files I've seen (like in the
attached
> >>>>> config), the VALID_BEG and VALID_END are set in the config
file. Is
> >>>>> there an easy way to set and export the VALID_* variable from
a
> script?
> >>>>> For example I've tried "export vday=20190305" in the
> >> test_fv3gfs_24h.ksh
> >>>>> and in the config file set
> >>>>> VALID_BEG = "${vday}"12 (same for VALID_END)
> >>>>> and
> >>>>> VALID_BEG = ${vday}12
> >>>>> and
> >>>>> VALID_BEG = {vday}12
> >>>>> none of the above worked. What's the right way to do this?
> >>>>>
> >>>>> 2) In the CCPA directory of /com2/ccpa/prod/ccpa.20190305/06/,
the
> '06'
> >>>>> subdir seems to contain all CCPA analysis files with valid
times from
> >>>>> 01Z-06Z. So for 6h analysis, the '06' in the subdir is just
the
> valid
> >>>>> hour. But if I do 3-hourly verification using the 3-hourly
CCPA
> files,
> >>>>> the above directory also contains ccpa.t03z.03h.hrap.conus.gb2
(valid
> >> at
> >>>>> 03Z) and ccpa.t06z.03h.hrap.conus.gb2 (valid at 06Z). In that
case i
> >>>>> don't think the
> >>>>>
> >>>>>
> >>
>
ccpa.{valid?fmt=%Y%m%d}/{valid?fmt=%H}/ccpa.t{valid?fmt=%H}z.{level?fmt=%.2H}h.hrap.conus.gb2
> >>>>> would work, would it?
> >>>>>
> >>>>> Thanks again,
> >>>>>
> >>>>> Ying
> >>>>>
> >>>>>
> >>>>> On 3/6/19 10:29 AM, George McCabe via RT wrote:
> >>>>>> Hi Ying Lin,
> >>>>>>
> >>>>>> You should be able to use a template that looks something
like this:
> >>>>>>
> >>>>>>
> >>
>
"ccpa.{valid?fmt=%Y%m%d}/06/ccpa.t{valid?fmt=%H}z.{level?fmt=%.2H}h.hrap.conus.gb2"
> >>>>>> The 'level' item corresponds to the accumulation amount. %.2H
> >> specifies
> >>>>>> that the filename has 2 digits of precision for that value. I
wasn't
> >>>>> sure
> >>>>>> what the '06' subdirectory corresponds to, but if necessary
you can
> >>>>>> substitute that with formatting so that it will be dynamic.
Let me
> >> know
> >>>>> if
> >>>>>> that doesn't work and I can help figure out what will.
> >>>>>>
> >>>>>> Thanks,
> >>>>>> George
> >>>>>>
> >>>>>> On Mon, Feb 25, 2019 at 11:09 AM Ying Lin via RT
<met_help at ucar.edu
> >
> >>>>> wrote:
> >>>>>>> Mon Feb 25 11:08:35 2019: Request 89063 was acted upon.
> >>>>>>> Transaction: Ticket created by ying.lin at noaa.gov
> >>>>>>> Queue: met_help
> >>>>>>> Subject: CCPA file name format for METplus
> >>>>>>> Owner: Nobody
> >>>>>>> Requestors: ying.lin at noaa.gov
> >>>>>>> Status: new
> >>>>>>> Ticket <URL:
> >> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=89063
> >>>>>>> Hello. I see that
> >>>>>>>
> >>>>>>>
> >>
>
https://github.com/NCAR/METplus/blob/master/parm/use_cases/grid_to_grid/examples/precip.conf
> >>>>>>> has
> >>>>>>> OBS_GRID_STAT_INPUT_TEMPLATE =
> >> ccpa_conus_1.0d_{valid?fmt=%Y%m%d}
> >>>>>>> CCPA output on wcoss has file names like
> >>>>>>>
/com2/ccpa/prod/ccpa.20190224/06/ccpa.t03z.03h.hrap.conus.gb2
> >>>>>>> which is 3h accumulation valid at 03Z 2019/02/24
> >>>>>>> and ccpa.t06z.06h.hrap.conus.gb2
> >>>>>>> which is 6h accumulation valid at 06Z 2019/02/24
> >>>>>>>
> >>>>>>> Does METplus already have the capability to handle the CCPA
in its
> >>>>>>> 'native' directory/name format, as in the /com2/* directory
above?
> >> In
> >>>>>>> my verif scripts I do
> >>>>>>> cp $COMCCPA.$vday/06/ccpa.t03z.03h.hrap.conus.gb2
> >>>>> ccpa.${vday}03.03h.gb2
> >>>>>>> If METplus can already handle this bit of pre-processing, or
if
> this
> >>>>> can
> >>>>>>> be added to the wish list, that'll be great. Thanks!
> >>>>>>>
> >>>>>>> Ying
> >>>>>>>
> >>>>>>> --
> >>>>>>> Ying Lin
> >>>>>>> NCEP/EMC/Verification, Post-processing and Product
Generation
> Branch
> >>>>>>> NCWCP Cubicle No. 2015
> >>>>>>> Ying.Lin at noaa.gov
> >>>>>>>
> >>>>>>>
> >>>>>>>
> >>>>>>>
> >>>>> --
> >>>>> Ying Lin
> >>>>> NCEP/EMC/Verification, Post-processing and Product Generation
Branch
> >>>>> NCWCP Cubicle No. 2015
> >>>>> Ying.Lin at noaa.gov
> >>>>>
> >>>>>
> >>>>>
> >>>>>
> >> --
> >> Ying Lin
> >> NCEP/EMC/Verification, Post-processing and Product Generation
Branch
> >> NCWCP Cubicle No. 2015
> >> Ying.Lin at noaa.gov
> >>
> >>
> >>
> >>
>
> --
> Ying Lin
> NCEP/EMC/Verification, Post-processing and Product Generation Branch
> NCWCP Cubicle No. 2015
> Ying.Lin at noaa.gov
>
>
>
>
------------------------------------------------
Subject: CCPA file name format for METplus
From: George McCabe
Time: Tue Mar 12 15:14:34 2019
Nevermind, I found the issue. Take a look at your filename templates.
The
output from PCP_COMBINE should match the input for REGRID_DATA_PLANE.
I can
see that they are different. Thank you for pointing this out, as
METplus
should report an error when this happens instead of just failing
quietly.
On Tue, Mar 12, 2019 at 9:11 PM George McCabe <mccabe at ucar.edu> wrote:
> Hi Ying,
>
> Glad to hear that you were able to run pcp_combine viaMETplus.
>
> Could you send me this file?
> /meso/noscrub/Ying.Lin/metplus.out/metplus_final.conf
>
> It looks like there is a loop over all of the field variables to
process
> after the log PROCESSING FORECAST LEAD 24, so perhaps that has been
> overwritten so be empty.
>
> On Tue, Mar 12, 2019 at 8:19 PM Ying Lin via RT <met_help at ucar.edu>
wrote:
>
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=89063 >
>>
>> Thanks very much George.
>>
>> Moving the METplus.v2.0.4, the pcp_combine step did work
easily,
>> but now I'm having trouble with the regrid_data_plane step.
Running the
>> METplus script (test_fv3gfs_24h.ksh, attached), I'm seeing in the
job
>> out (fv3gfs.out) that
>> 03/12 19:45:18.029 metplus.RegridDataPlane
>> (reformat_gridded_wrapper.py:75) INFO: PROCESSING OBS DATA
>> 03/12 19:45:18.029 metplus.RegridDataPlane
>> (reformat_gridded_wrapper.py:78) INFO: PROCESSING FORECAST LEAD 24
>>
>> With no further info about the RegridDataPlane step, it moves on to
>> metplus.GridStat, and (unsurprisingly) cannot find the verifying
>> analysis in the qpe_grib/regrid/.
>>
>> I tried the two use cases in
>> /global/noscrub/Julie.Prestopnik/METplus/METplus-
2.0.4/parm/use_cases/qpf/examples,
>>
>> phpt-vs-s4grib.conf and ruc-vs-s2grib.conf, they both do work
(though
>> the latter was re-gridding from G212 to the same G212), e.g. in the
>> attached phpt.out (successful RegridDataPlane), it's got
>>
>> 03/12 18:01:11.883 metplus.RegridDataPlane
>> (reformat_gridded_wrapper.py:75) INFO: PROCESSING OBS DATA
>> 03/12 18:01:11.883 metplus.RegridDataPlane
>> (reformat_gridded_wrapper.py:78) INFO: PROCESSING FORECAST LEAD 3
>> 03/12 18:01:11.885 metplus.RegridDataPlane (command_runner.py:222)
>> DEBUG: LOG_MET_OUTPUT_TO_METPLUS log file is True ...
>>
>> So there is something in my fv3gfs test setup that prevented it
from
>> moving on to the "command_runner.py:222" step. I tried comparing
my
>> fv3gfs_24h.conf with the use case samples phpt-vs-s4grib.conf and
>> ruc-vs-s2grib.conf, and couldn't see what I did wrong. I'm running
out
>> of ideas. Would you mind taking a look at this?
>>
>> I tried running the MET regrid_data_plane manually (regridit.ksh)
using
>> the metplus.PcpCombine output, and it worked fine.
>>
>> Thank you -
>>
>> Ying
>>
>> On 3/11/19 12:23 PM, George McCabe via RT wrote:
>> > Hi Ying,
>> >
>> > Using the new version of METplus, you will see the following
error:
>> >
>> > ERROR: Threshold values must start with
>,>=,==,!=,<,<=,gt,ge,eq,ne,lt,
>> or
>> > le
>> >
>> > If you add a comparison operator to each item of your
FCST_VAR1_THRESH
>> > list, this error will go away. The old default operator was >=,
so
>> adding
>> > that would preserve the old behavior if that is what you want.
>> >
>> > You will also see some warnings of METplus variables being
deprecated.
>> You
>> > can change the name of these variables to get rid of those
warnings. The
>> > warning description should be clear.
>> >
>> > When I ran your config file, METplus built the following command:
>> >
>> > /usr/local/met-8.0/bin/pcp_combine -name APCP_24 -add
>> >
>>
/d1/mccabe/ying_data/com2/ccpa/prod/ccpa.20190310/12/ccpa.t12z.06h.hrap.conus.gb2
>> > 6
>> >
>>
/d1/mccabe/ying_data/com2/ccpa/prod/ccpa.20190310/06/ccpa.t06z.06h.hrap.conus.gb2
>> > 6
>> >
>>
/d1/mccabe/ying_data/com2/ccpa/prod/ccpa.20190310/00/ccpa.t00z.06h.hrap.conus.gb2
>> > 6
>> >
>>
/d1/mccabe/ying_data/com2/ccpa/prod/ccpa.20190309/18/ccpa.t18z.06h.hrap.conus.gb2
>> > 6
>>
/d1/mccabe/ying_data/out/qpe_grib/bucket/20190310/ccpa.2019031012_A24h
-v
>> > 2
>> >
>> > Let me know if you have any other issues.
>> >
>> > Thanks,
>> > George
>> >
>> > On Mon, Mar 11, 2019 at 9:48 AM Ying Lin via RT
<met_help at ucar.edu>
>> wrote:
>> >
>> >> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=89063 >
>> >>
>> >> Hi George,
>> >>
>> >> First of all, thank you for telling me about passing the
envir
>> >> variable using {ENV[vday]}, that was really useful!
>> >>
>> >> Still have trouble "finding" the CCPA files. I've first
changed
>> >> the OBS_LEVEL=6, when that didn't work, I explicitly specified
the
>> '06h'
>> >> in the file name in the config, e.g.
>> >>
>> >> OBS_PCP_COMBINE_INPUT_TEMPLATE =
>> >>
>> >>
>>
ccpa.{valid?fmt=%Y%m%d}/{valid?fmt=%H}/ccpa.t{valid?fmt=%H}z.06h.hrap.conus.gb2
>> >>
>> >> Still getting the "WARNING: pcp_combine: Could not find files to
>> compute
>> >> accumulation in /com2/ccpa/prod" in the job output and the log
file
>> >> (both attached to this email, as well as the config file). Also
>> >> attached are the four 6h CCPA files with their full paths, e.g.
>> >> t10a1 $ tar cvfz /stmpp1/Ying.Lin/ccpa.tar.gz
>> >> /com2/ccpa/prod/ccpa.20190309/18/ccpa.*06h.hrap.conus.gb2
>> >> /com2/ccpa/prod/ccpa.20190310/*/ccpa.*06h.hrap.conus.gb2
>> >> tar: Removing leading `/' from member names
>> >> /com2/ccpa/prod/ccpa.20190309/18/ccpa.t18z.06h.hrap.conus.gb2
>> >> /com2/ccpa/prod/ccpa.20190310/00/ccpa.t00z.06h.hrap.conus.gb2
>> >> /com2/ccpa/prod/ccpa.20190310/06/ccpa.t06z.06h.hrap.conus.gb2
>> >> /com2/ccpa/prod/ccpa.20190310/12/ccpa.t12z.06h.hrap.conus.gb2
>> >>
>> >> Thanks again -
>> >>
>> >> Ying
>> >>
>> >> On 3/11/19 10:47 AM, George McCabe via RT wrote:
>> >>> Hi Ying,
>> >>>
>> >>> I was incorrect that you need to change the precision. %H
should find
>> the
>> >>> time the way it is formatted. I think you will need to remove
>> OBS_LEVEL
>> >> = 1
>> >>> from your config. This variable tells METplus to only look for
1 hr
>> >>> accumulation files to use in pcp_combine. If you remove this
>> variable, it
>> >>> should look for a 24 hr accumulation file and reduce the hour
by 1
>> until
>> >> it
>> >>> finds a file that it can use. If you want to force METplus to
use 6
>> hour
>> >>> files to build the 24 hr accumulation, you should set OBS_LEVEL
= 6.
>> Let
>> >> me
>> >>> know if that helps.
>> >>>
>> >>> Thanks,
>> >>> George
>> >>>
>> >>> On Mon, Mar 11, 2019 at 8:30 AM George McCabe <mccabe at ucar.edu>
>> wrote:
>> >>>
>> >>>> Hi Ying,
>> >>>>
>> >>>> You may need to change %H to %.2H in the template to tell it
that
>> there
>> >>>> will always be 2 digit precision. If that doesn't work, could
you
>> send
>> >> me
>> >>>> the directory listing so I can see what files are available?
>> >>>>
>> >>>> To pass in environment variables, use the following notation:
>> >> {ENV[vday]}.
>> >>>> You are correct that using valid hour for the directory name
will not
>> >>>> work, as it will change the value to 03. If this value is
going to
>> >> change
>> >>>> between runs and doesn't directly correspond to the valid
time, you
>> may
>> >>>> have to trick it with environment variables to get it to work
>> correctly.
>> >>>>
>> >>>> On Thu, Mar 7, 2019 at 1:33 PM Ying Lin via RT
<met_help at ucar.edu>
>> >> wrote:
>> >>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=89063
>
>> >>>>>
>> >>>>> Hi George,
>> >>>>>
>> >>>>> Thanks! That makes sense, though it didn't quite work
out
>> for
>> >> me.
>> >>>>> In the attached fv3gfs_24h_by_valid_time.conf, I have
>> >>>>> OBS_PCP_COMBINE_INPUT_DIR = /com2/ccpa/prod
>> >>>>> then
>> >>>>> OBS_PCP_COMBINE_INPUT_TEMPLATE =
>> >>>>>
>> >>>>>
>> >>
>>
ccpa.{valid?fmt=%Y%m%d}/{valid?fmt=%H}/ccpa.t{valid?fmt=%H}z.{level?fmt=%.2H}h.hrap.conus.gb2
>> >>>>> thinking that it would tell pcp_combine to look for e,g,
>> >>>>> /com2/ccpa/prod/ccpa.20190305/06/ccpa.t06z.06h.hrap.conus.gb2
>> >>>>>
>> >>>>> Instead I'm getting "WARNING: pcp_combine: Could not find
files to
>> >>>>> compute accumulation in /com2/ccpa/prod" (in the attached
test.out
>> and
>> >>>>> master_metplus.log.20190307).
>> >>>>>
>> >>>>> Could you tell what I'm doing wrong in the config?
>> >>>>>
>> >>>>> I'm doing the above in
>> Tide:/meso/save/Ying.Lin/metplus/test/.
>> >>>>>
>> >>>>> Also two related questions:
>> >>>>> 1) In the METplus model config files I've seen (like in the
attached
>> >>>>> config), the VALID_BEG and VALID_END are set in the config
file. Is
>> >>>>> there an easy way to set and export the VALID_* variable from
a
>> script?
>> >>>>> For example I've tried "export vday=20190305" in the
>> >> test_fv3gfs_24h.ksh
>> >>>>> and in the config file set
>> >>>>> VALID_BEG = "${vday}"12 (same for VALID_END)
>> >>>>> and
>> >>>>> VALID_BEG = ${vday}12
>> >>>>> and
>> >>>>> VALID_BEG = {vday}12
>> >>>>> none of the above worked. What's the right way to do this?
>> >>>>>
>> >>>>> 2) In the CCPA directory of
/com2/ccpa/prod/ccpa.20190305/06/, the
>> '06'
>> >>>>> subdir seems to contain all CCPA analysis files with valid
times
>> from
>> >>>>> 01Z-06Z. So for 6h analysis, the '06' in the subdir is just
the
>> valid
>> >>>>> hour. But if I do 3-hourly verification using the 3-hourly
CCPA
>> files,
>> >>>>> the above directory also contains
ccpa.t03z.03h.hrap.conus.gb2
>> (valid
>> >> at
>> >>>>> 03Z) and ccpa.t06z.03h.hrap.conus.gb2 (valid at 06Z). In that
case i
>> >>>>> don't think the
>> >>>>>
>> >>>>>
>> >>
>>
ccpa.{valid?fmt=%Y%m%d}/{valid?fmt=%H}/ccpa.t{valid?fmt=%H}z.{level?fmt=%.2H}h.hrap.conus.gb2
>> >>>>> would work, would it?
>> >>>>>
>> >>>>> Thanks again,
>> >>>>>
>> >>>>> Ying
>> >>>>>
>> >>>>>
>> >>>>> On 3/6/19 10:29 AM, George McCabe via RT wrote:
>> >>>>>> Hi Ying Lin,
>> >>>>>>
>> >>>>>> You should be able to use a template that looks something
like
>> this:
>> >>>>>>
>> >>>>>>
>> >>
>>
"ccpa.{valid?fmt=%Y%m%d}/06/ccpa.t{valid?fmt=%H}z.{level?fmt=%.2H}h.hrap.conus.gb2"
>> >>>>>> The 'level' item corresponds to the accumulation amount.
%.2H
>> >> specifies
>> >>>>>> that the filename has 2 digits of precision for that value.
I
>> wasn't
>> >>>>> sure
>> >>>>>> what the '06' subdirectory corresponds to, but if necessary
you can
>> >>>>>> substitute that with formatting so that it will be dynamic.
Let me
>> >> know
>> >>>>> if
>> >>>>>> that doesn't work and I can help figure out what will.
>> >>>>>>
>> >>>>>> Thanks,
>> >>>>>> George
>> >>>>>>
>> >>>>>> On Mon, Feb 25, 2019 at 11:09 AM Ying Lin via RT <
>> met_help at ucar.edu>
>> >>>>> wrote:
>> >>>>>>> Mon Feb 25 11:08:35 2019: Request 89063 was acted upon.
>> >>>>>>> Transaction: Ticket created by ying.lin at noaa.gov
>> >>>>>>> Queue: met_help
>> >>>>>>> Subject: CCPA file name format for METplus
>> >>>>>>> Owner: Nobody
>> >>>>>>> Requestors: ying.lin at noaa.gov
>> >>>>>>> Status: new
>> >>>>>>> Ticket <URL:
>> >> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=89063
>> >>>>>>> Hello. I see that
>> >>>>>>>
>> >>>>>>>
>> >>
>>
https://github.com/NCAR/METplus/blob/master/parm/use_cases/grid_to_grid/examples/precip.conf
>> >>>>>>> has
>> >>>>>>> OBS_GRID_STAT_INPUT_TEMPLATE =
>> >> ccpa_conus_1.0d_{valid?fmt=%Y%m%d}
>> >>>>>>> CCPA output on wcoss has file names like
>> >>>>>>>
>> /com2/ccpa/prod/ccpa.20190224/06/ccpa.t03z.03h.hrap.conus.gb2
>> >>>>>>> which is 3h accumulation valid at 03Z 2019/02/24
>> >>>>>>> and ccpa.t06z.06h.hrap.conus.gb2
>> >>>>>>> which is 6h accumulation valid at 06Z 2019/02/24
>> >>>>>>>
>> >>>>>>> Does METplus already have the capability to handle the CCPA
in its
>> >>>>>>> 'native' directory/name format, as in the /com2/* directory
above?
>> >> In
>> >>>>>>> my verif scripts I do
>> >>>>>>> cp $COMCCPA.$vday/06/ccpa.t03z.03h.hrap.conus.gb2
>> >>>>> ccpa.${vday}03.03h.gb2
>> >>>>>>> If METplus can already handle this bit of pre-processing,
or if
>> this
>> >>>>> can
>> >>>>>>> be added to the wish list, that'll be great. Thanks!
>> >>>>>>>
>> >>>>>>> Ying
>> >>>>>>>
>> >>>>>>> --
>> >>>>>>> Ying Lin
>> >>>>>>> NCEP/EMC/Verification, Post-processing and Product
Generation
>> Branch
>> >>>>>>> NCWCP Cubicle No. 2015
>> >>>>>>> Ying.Lin at noaa.gov
>> >>>>>>>
>> >>>>>>>
>> >>>>>>>
>> >>>>>>>
>> >>>>> --
>> >>>>> Ying Lin
>> >>>>> NCEP/EMC/Verification, Post-processing and Product Generation
Branch
>> >>>>> NCWCP Cubicle No. 2015
>> >>>>> Ying.Lin at noaa.gov
>> >>>>>
>> >>>>>
>> >>>>>
>> >>>>>
>> >> --
>> >> Ying Lin
>> >> NCEP/EMC/Verification, Post-processing and Product Generation
Branch
>> >> NCWCP Cubicle No. 2015
>> >> Ying.Lin at noaa.gov
>> >>
>> >>
>> >>
>> >>
>>
>> --
>> Ying Lin
>> NCEP/EMC/Verification, Post-processing and Product Generation
Branch
>> NCWCP Cubicle No. 2015
>> Ying.Lin at noaa.gov
>>
>>
>>
>>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #89063] CCPA file name format for METplus
From: Ying Lin
Time: Tue Mar 12 16:39:16 2019
Hi George,
Ah, I see! Somehow I thought OBS_REGRID_DATA_PLANE_TEMPLATE would be
the
output file name for REGRID_DATA_PLAN. I wondered earlier why the
"phpt" and the "ruc" example had the same file names under subdirs
bucket/ and regrid/, and thought I'd tag on the ".g212" to
differentiate
them. What I should have done was to hew as close as possible to
the
examples in the use case to start with. The "FV3GFS" test does run to
completion now. Many thanks for your help and your patience. Please
close this ticket at your convenience.
Ying
On 3/12/19 5:14 PM, George McCabe via RT wrote:
> Nevermind, I found the issue. Take a look at your filename
templates. The
> output from PCP_COMBINE should match the input for
REGRID_DATA_PLANE. I can
> see that they are different. Thank you for pointing this out, as
METplus
> should report an error when this happens instead of just failing
quietly.
>
> On Tue, Mar 12, 2019 at 9:11 PM George McCabe <mccabe at ucar.edu>
wrote:
>
>> Hi Ying,
>>
>> Glad to hear that you were able to run pcp_combine viaMETplus.
>>
>> Could you send me this file?
>> /meso/noscrub/Ying.Lin/metplus.out/metplus_final.conf
>>
>> It looks like there is a loop over all of the field variables to
process
>> after the log PROCESSING FORECAST LEAD 24, so perhaps that has been
>> overwritten so be empty.
>>
>> On Tue, Mar 12, 2019 at 8:19 PM Ying Lin via RT <met_help at ucar.edu>
wrote:
>>
>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=89063 >
>>>
>>> Thanks very much George.
>>>
>>> Moving the METplus.v2.0.4, the pcp_combine step did work
easily,
>>> but now I'm having trouble with the regrid_data_plane step.
Running the
>>> METplus script (test_fv3gfs_24h.ksh, attached), I'm seeing in the
job
>>> out (fv3gfs.out) that
>>> 03/12 19:45:18.029 metplus.RegridDataPlane
>>> (reformat_gridded_wrapper.py:75) INFO: PROCESSING OBS DATA
>>> 03/12 19:45:18.029 metplus.RegridDataPlane
>>> (reformat_gridded_wrapper.py:78) INFO: PROCESSING FORECAST LEAD 24
>>>
>>> With no further info about the RegridDataPlane step, it moves on
to
>>> metplus.GridStat, and (unsurprisingly) cannot find the verifying
>>> analysis in the qpe_grib/regrid/.
>>>
>>> I tried the two use cases in
>>> /global/noscrub/Julie.Prestopnik/METplus/METplus-
2.0.4/parm/use_cases/qpf/examples,
>>>
>>> phpt-vs-s4grib.conf and ruc-vs-s2grib.conf, they both do work
(though
>>> the latter was re-gridding from G212 to the same G212), e.g. in
the
>>> attached phpt.out (successful RegridDataPlane), it's got
>>>
>>> 03/12 18:01:11.883 metplus.RegridDataPlane
>>> (reformat_gridded_wrapper.py:75) INFO: PROCESSING OBS DATA
>>> 03/12 18:01:11.883 metplus.RegridDataPlane
>>> (reformat_gridded_wrapper.py:78) INFO: PROCESSING FORECAST LEAD 3
>>> 03/12 18:01:11.885 metplus.RegridDataPlane (command_runner.py:222)
>>> DEBUG: LOG_MET_OUTPUT_TO_METPLUS log file is True ...
>>>
>>> So there is something in my fv3gfs test setup that prevented it
from
>>> moving on to the "command_runner.py:222" step. I tried comparing
my
>>> fv3gfs_24h.conf with the use case samples phpt-vs-s4grib.conf and
>>> ruc-vs-s2grib.conf, and couldn't see what I did wrong. I'm
running out
>>> of ideas. Would you mind taking a look at this?
>>>
>>> I tried running the MET regrid_data_plane manually (regridit.ksh)
using
>>> the metplus.PcpCombine output, and it worked fine.
>>>
>>> Thank you -
>>>
>>> Ying
>>>
>>> On 3/11/19 12:23 PM, George McCabe via RT wrote:
>>>> Hi Ying,
>>>>
>>>> Using the new version of METplus, you will see the following
error:
>>>>
>>>> ERROR: Threshold values must start with
>,>=,==,!=,<,<=,gt,ge,eq,ne,lt,
>>> or
>>>> le
>>>>
>>>> If you add a comparison operator to each item of your
FCST_VAR1_THRESH
>>>> list, this error will go away. The old default operator was >=,
so
>>> adding
>>>> that would preserve the old behavior if that is what you want.
>>>>
>>>> You will also see some warnings of METplus variables being
deprecated.
>>> You
>>>> can change the name of these variables to get rid of those
warnings. The
>>>> warning description should be clear.
>>>>
>>>> When I ran your config file, METplus built the following command:
>>>>
>>>> /usr/local/met-8.0/bin/pcp_combine -name APCP_24 -add
>>>>
>>>
/d1/mccabe/ying_data/com2/ccpa/prod/ccpa.20190310/12/ccpa.t12z.06h.hrap.conus.gb2
>>>> 6
>>>>
>>>
/d1/mccabe/ying_data/com2/ccpa/prod/ccpa.20190310/06/ccpa.t06z.06h.hrap.conus.gb2
>>>> 6
>>>>
>>>
/d1/mccabe/ying_data/com2/ccpa/prod/ccpa.20190310/00/ccpa.t00z.06h.hrap.conus.gb2
>>>> 6
>>>>
>>>
/d1/mccabe/ying_data/com2/ccpa/prod/ccpa.20190309/18/ccpa.t18z.06h.hrap.conus.gb2
>>>> 6
>>>
/d1/mccabe/ying_data/out/qpe_grib/bucket/20190310/ccpa.2019031012_A24h
-v
>>>> 2
>>>>
>>>> Let me know if you have any other issues.
>>>>
>>>> Thanks,
>>>> George
>>>>
>>>> On Mon, Mar 11, 2019 at 9:48 AM Ying Lin via RT
<met_help at ucar.edu>
>>> wrote:
>>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=89063 >
>>>>>
>>>>> Hi George,
>>>>>
>>>>> First of all, thank you for telling me about passing the
envir
>>>>> variable using {ENV[vday]}, that was really useful!
>>>>>
>>>>> Still have trouble "finding" the CCPA files. I've first
changed
>>>>> the OBS_LEVEL=6, when that didn't work, I explicitly specified
the
>>> '06h'
>>>>> in the file name in the config, e.g.
>>>>>
>>>>> OBS_PCP_COMBINE_INPUT_TEMPLATE =
>>>>>
>>>>>
>>>
ccpa.{valid?fmt=%Y%m%d}/{valid?fmt=%H}/ccpa.t{valid?fmt=%H}z.06h.hrap.conus.gb2
>>>>> Still getting the "WARNING: pcp_combine: Could not find files to
>>> compute
>>>>> accumulation in /com2/ccpa/prod" in the job output and the log
file
>>>>> (both attached to this email, as well as the config file). Also
>>>>> attached are the four 6h CCPA files with their full paths, e.g.
>>>>> t10a1 $ tar cvfz /stmpp1/Ying.Lin/ccpa.tar.gz
>>>>> /com2/ccpa/prod/ccpa.20190309/18/ccpa.*06h.hrap.conus.gb2
>>>>> /com2/ccpa/prod/ccpa.20190310/*/ccpa.*06h.hrap.conus.gb2
>>>>> tar: Removing leading `/' from member names
>>>>> /com2/ccpa/prod/ccpa.20190309/18/ccpa.t18z.06h.hrap.conus.gb2
>>>>> /com2/ccpa/prod/ccpa.20190310/00/ccpa.t00z.06h.hrap.conus.gb2
>>>>> /com2/ccpa/prod/ccpa.20190310/06/ccpa.t06z.06h.hrap.conus.gb2
>>>>> /com2/ccpa/prod/ccpa.20190310/12/ccpa.t12z.06h.hrap.conus.gb2
>>>>>
>>>>> Thanks again -
>>>>>
>>>>> Ying
>>>>>
>>>>> On 3/11/19 10:47 AM, George McCabe via RT wrote:
>>>>>> Hi Ying,
>>>>>>
>>>>>> I was incorrect that you need to change the precision. %H
should find
>>> the
>>>>>> time the way it is formatted. I think you will need to remove
>>> OBS_LEVEL
>>>>> = 1
>>>>>> from your config. This variable tells METplus to only look for
1 hr
>>>>>> accumulation files to use in pcp_combine. If you remove this
>>> variable, it
>>>>>> should look for a 24 hr accumulation file and reduce the hour
by 1
>>> until
>>>>> it
>>>>>> finds a file that it can use. If you want to force METplus to
use 6
>>> hour
>>>>>> files to build the 24 hr accumulation, you should set OBS_LEVEL
= 6.
>>> Let
>>>>> me
>>>>>> know if that helps.
>>>>>>
>>>>>> Thanks,
>>>>>> George
>>>>>>
>>>>>> On Mon, Mar 11, 2019 at 8:30 AM George McCabe <mccabe at ucar.edu>
>>> wrote:
>>>>>>> Hi Ying,
>>>>>>>
>>>>>>> You may need to change %H to %.2H in the template to tell it
that
>>> there
>>>>>>> will always be 2 digit precision. If that doesn't work, could
you
>>> send
>>>>> me
>>>>>>> the directory listing so I can see what files are available?
>>>>>>>
>>>>>>> To pass in environment variables, use the following notation:
>>>>> {ENV[vday]}.
>>>>>>> You are correct that using valid hour for the directory name
will not
>>>>>>> work, as it will change the value to 03. If this value is
going to
>>>>> change
>>>>>>> between runs and doesn't directly correspond to the valid
time, you
>>> may
>>>>>>> have to trick it with environment variables to get it to work
>>> correctly.
>>>>>>> On Thu, Mar 7, 2019 at 1:33 PM Ying Lin via RT
<met_help at ucar.edu>
>>>>> wrote:
>>>>>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=89063
>
>>>>>>>>
>>>>>>>> Hi George,
>>>>>>>>
>>>>>>>> Thanks! That makes sense, though it didn't quite
work out
>>> for
>>>>> me.
>>>>>>>> In the attached fv3gfs_24h_by_valid_time.conf, I have
>>>>>>>> OBS_PCP_COMBINE_INPUT_DIR = /com2/ccpa/prod
>>>>>>>> then
>>>>>>>> OBS_PCP_COMBINE_INPUT_TEMPLATE =
>>>>>>>>
>>>>>>>>
>>>
ccpa.{valid?fmt=%Y%m%d}/{valid?fmt=%H}/ccpa.t{valid?fmt=%H}z.{level?fmt=%.2H}h.hrap.conus.gb2
>>>>>>>> thinking that it would tell pcp_combine to look for e,g,
>>>>>>>> /com2/ccpa/prod/ccpa.20190305/06/ccpa.t06z.06h.hrap.conus.gb2
>>>>>>>>
>>>>>>>> Instead I'm getting "WARNING: pcp_combine: Could not find
files to
>>>>>>>> compute accumulation in /com2/ccpa/prod" (in the attached
test.out
>>> and
>>>>>>>> master_metplus.log.20190307).
>>>>>>>>
>>>>>>>> Could you tell what I'm doing wrong in the config?
>>>>>>>>
>>>>>>>> I'm doing the above in
>>> Tide:/meso/save/Ying.Lin/metplus/test/.
>>>>>>>> Also two related questions:
>>>>>>>> 1) In the METplus model config files I've seen (like in the
attached
>>>>>>>> config), the VALID_BEG and VALID_END are set in the config
file. Is
>>>>>>>> there an easy way to set and export the VALID_* variable from
a
>>> script?
>>>>>>>> For example I've tried "export vday=20190305" in the
>>>>> test_fv3gfs_24h.ksh
>>>>>>>> and in the config file set
>>>>>>>> VALID_BEG = "${vday}"12 (same for VALID_END)
>>>>>>>> and
>>>>>>>> VALID_BEG = ${vday}12
>>>>>>>> and
>>>>>>>> VALID_BEG = {vday}12
>>>>>>>> none of the above worked. What's the right way to do this?
>>>>>>>>
>>>>>>>> 2) In the CCPA directory of
/com2/ccpa/prod/ccpa.20190305/06/, the
>>> '06'
>>>>>>>> subdir seems to contain all CCPA analysis files with valid
times
>>> from
>>>>>>>> 01Z-06Z. So for 6h analysis, the '06' in the subdir is just
the
>>> valid
>>>>>>>> hour. But if I do 3-hourly verification using the 3-hourly
CCPA
>>> files,
>>>>>>>> the above directory also contains
ccpa.t03z.03h.hrap.conus.gb2
>>> (valid
>>>>> at
>>>>>>>> 03Z) and ccpa.t06z.03h.hrap.conus.gb2 (valid at 06Z). In that
case i
>>>>>>>> don't think the
>>>>>>>>
>>>>>>>>
>>>
ccpa.{valid?fmt=%Y%m%d}/{valid?fmt=%H}/ccpa.t{valid?fmt=%H}z.{level?fmt=%.2H}h.hrap.conus.gb2
>>>>>>>> would work, would it?
>>>>>>>>
>>>>>>>> Thanks again,
>>>>>>>>
>>>>>>>> Ying
>>>>>>>>
>>>>>>>>
>>>>>>>> On 3/6/19 10:29 AM, George McCabe via RT wrote:
>>>>>>>>> Hi Ying Lin,
>>>>>>>>>
>>>>>>>>> You should be able to use a template that looks something
like
>>> this:
>>>>>>>>>
>>>
"ccpa.{valid?fmt=%Y%m%d}/06/ccpa.t{valid?fmt=%H}z.{level?fmt=%.2H}h.hrap.conus.gb2"
>>>>>>>>> The 'level' item corresponds to the accumulation amount.
%.2H
>>>>> specifies
>>>>>>>>> that the filename has 2 digits of precision for that value.
I
>>> wasn't
>>>>>>>> sure
>>>>>>>>> what the '06' subdirectory corresponds to, but if necessary
you can
>>>>>>>>> substitute that with formatting so that it will be dynamic.
Let me
>>>>> know
>>>>>>>> if
>>>>>>>>> that doesn't work and I can help figure out what will.
>>>>>>>>>
>>>>>>>>> Thanks,
>>>>>>>>> George
>>>>>>>>>
>>>>>>>>> On Mon, Feb 25, 2019 at 11:09 AM Ying Lin via RT <
>>> met_help at ucar.edu>
>>>>>>>> wrote:
>>>>>>>>>> Mon Feb 25 11:08:35 2019: Request 89063 was acted upon.
>>>>>>>>>> Transaction: Ticket created by ying.lin at noaa.gov
>>>>>>>>>> Queue: met_help
>>>>>>>>>> Subject: CCPA file name format for METplus
>>>>>>>>>> Owner: Nobody
>>>>>>>>>> Requestors: ying.lin at noaa.gov
>>>>>>>>>> Status: new
>>>>>>>>>> Ticket <URL:
>>>>> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=89063
>>>>>>>>>> Hello. I see that
>>>>>>>>>>
>>>>>>>>>>
>>>
https://github.com/NCAR/METplus/blob/master/parm/use_cases/grid_to_grid/examples/precip.conf
>>>>>>>>>> has
>>>>>>>>>> OBS_GRID_STAT_INPUT_TEMPLATE =
>>>>> ccpa_conus_1.0d_{valid?fmt=%Y%m%d}
>>>>>>>>>> CCPA output on wcoss has file names like
>>>>>>>>>>
>>> /com2/ccpa/prod/ccpa.20190224/06/ccpa.t03z.03h.hrap.conus.gb2
>>>>>>>>>> which is 3h accumulation valid at 03Z 2019/02/24
>>>>>>>>>> and ccpa.t06z.06h.hrap.conus.gb2
>>>>>>>>>> which is 6h accumulation valid at 06Z 2019/02/24
>>>>>>>>>>
>>>>>>>>>> Does METplus already have the capability to handle the CCPA
in its
>>>>>>>>>> 'native' directory/name format, as in the /com2/* directory
above?
>>>>> In
>>>>>>>>>> my verif scripts I do
>>>>>>>>>> cp $COMCCPA.$vday/06/ccpa.t03z.03h.hrap.conus.gb2
>>>>>>>> ccpa.${vday}03.03h.gb2
>>>>>>>>>> If METplus can already handle this bit of pre-processing,
or if
>>> this
>>>>>>>> can
>>>>>>>>>> be added to the wish list, that'll be great. Thanks!
>>>>>>>>>>
>>>>>>>>>> Ying
>>>>>>>>>>
>>>>>>>>>> --
>>>>>>>>>> Ying Lin
>>>>>>>>>> NCEP/EMC/Verification, Post-processing and Product
Generation
>>> Branch
>>>>>>>>>> NCWCP Cubicle No. 2015
>>>>>>>>>> Ying.Lin at noaa.gov
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>> --
>>>>>>>> Ying Lin
>>>>>>>> NCEP/EMC/Verification, Post-processing and Product Generation
Branch
>>>>>>>> NCWCP Cubicle No. 2015
>>>>>>>> Ying.Lin at noaa.gov
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>> --
>>>>> Ying Lin
>>>>> NCEP/EMC/Verification, Post-processing and Product Generation
Branch
>>>>> NCWCP Cubicle No. 2015
>>>>> Ying.Lin at noaa.gov
>>>>>
>>>>>
>>>>>
>>>>>
>>> --
>>> Ying Lin
>>> NCEP/EMC/Verification, Post-processing and Product Generation
Branch
>>> NCWCP Cubicle No. 2015
>>> Ying.Lin at noaa.gov
>>>
>>>
>>>
>>>
--
Ying Lin
NCEP/EMC/Verification, Post-processing and Product Generation Branch
NCWCP Cubicle No. 2015
Ying.Lin at noaa.gov
------------------------------------------------
Subject: CCPA file name format for METplus
From: George McCabe
Time: Tue Mar 12 16:56:24 2019
Hi Ying,
I know that OBS_REGRID_DATA_PLANE_TEMPLATE is confusing. Because of
this,
we have added the ability to specify the input and output templates
for
regrid_data_plane. You can use:
OBS_REGRID_DATA_PLANE_INPUT_TEMPLATE
and
OBS_REGRID_DATA_PLANE_OUTPUT_TEMPLATE
We still allow the generic one for backwards compatibility.
On Tue, Mar 12, 2019 at 10:39 PM Ying Lin via RT <met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=89063 >
>
> Hi George,
>
> Ah, I see! Somehow I thought OBS_REGRID_DATA_PLANE_TEMPLATE would be
the
> output file name for REGRID_DATA_PLAN. I wondered earlier why the
> "phpt" and the "ruc" example had the same file names under subdirs
> bucket/ and regrid/, and thought I'd tag on the ".g212" to
differentiate
> them. What I should have done was to hew as close as possible to
the
> examples in the use case to start with. The "FV3GFS" test does run
to
> completion now. Many thanks for your help and your patience.
Please
> close this ticket at your convenience.
>
> Ying
>
> On 3/12/19 5:14 PM, George McCabe via RT wrote:
> > Nevermind, I found the issue. Take a look at your filename
templates. The
> > output from PCP_COMBINE should match the input for
REGRID_DATA_PLANE. I
> can
> > see that they are different. Thank you for pointing this out, as
METplus
> > should report an error when this happens instead of just failing
quietly.
> >
> > On Tue, Mar 12, 2019 at 9:11 PM George McCabe <mccabe at ucar.edu>
wrote:
> >
> >> Hi Ying,
> >>
> >> Glad to hear that you were able to run pcp_combine viaMETplus.
> >>
> >> Could you send me this file?
> >> /meso/noscrub/Ying.Lin/metplus.out/metplus_final.conf
> >>
> >> It looks like there is a loop over all of the field variables to
process
> >> after the log PROCESSING FORECAST LEAD 24, so perhaps that has
been
> >> overwritten so be empty.
> >>
> >> On Tue, Mar 12, 2019 at 8:19 PM Ying Lin via RT
<met_help at ucar.edu>
> wrote:
> >>
> >>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=89063 >
> >>>
> >>> Thanks very much George.
> >>>
> >>> Moving the METplus.v2.0.4, the pcp_combine step did work
easily,
> >>> but now I'm having trouble with the regrid_data_plane step.
Running
> the
> >>> METplus script (test_fv3gfs_24h.ksh, attached), I'm seeing in
the job
> >>> out (fv3gfs.out) that
> >>> 03/12 19:45:18.029 metplus.RegridDataPlane
> >>> (reformat_gridded_wrapper.py:75) INFO: PROCESSING OBS DATA
> >>> 03/12 19:45:18.029 metplus.RegridDataPlane
> >>> (reformat_gridded_wrapper.py:78) INFO: PROCESSING FORECAST LEAD
24
> >>>
> >>> With no further info about the RegridDataPlane step, it moves on
to
> >>> metplus.GridStat, and (unsurprisingly) cannot find the verifying
> >>> analysis in the qpe_grib/regrid/.
> >>>
> >>> I tried the two use cases in
> >>>
> /global/noscrub/Julie.Prestopnik/METplus/METplus-
2.0.4/parm/use_cases/qpf/examples,
> >>>
> >>> phpt-vs-s4grib.conf and ruc-vs-s2grib.conf, they both do work
(though
> >>> the latter was re-gridding from G212 to the same G212), e.g. in
the
> >>> attached phpt.out (successful RegridDataPlane), it's got
> >>>
> >>> 03/12 18:01:11.883 metplus.RegridDataPlane
> >>> (reformat_gridded_wrapper.py:75) INFO: PROCESSING OBS DATA
> >>> 03/12 18:01:11.883 metplus.RegridDataPlane
> >>> (reformat_gridded_wrapper.py:78) INFO: PROCESSING FORECAST LEAD
3
> >>> 03/12 18:01:11.885 metplus.RegridDataPlane
(command_runner.py:222)
> >>> DEBUG: LOG_MET_OUTPUT_TO_METPLUS log file is True ...
> >>>
> >>> So there is something in my fv3gfs test setup that prevented it
from
> >>> moving on to the "command_runner.py:222" step. I tried
comparing my
> >>> fv3gfs_24h.conf with the use case samples phpt-vs-s4grib.conf
and
> >>> ruc-vs-s2grib.conf, and couldn't see what I did wrong. I'm
running out
> >>> of ideas. Would you mind taking a look at this?
> >>>
> >>> I tried running the MET regrid_data_plane manually
(regridit.ksh) using
> >>> the metplus.PcpCombine output, and it worked fine.
> >>>
> >>> Thank you -
> >>>
> >>> Ying
> >>>
> >>> On 3/11/19 12:23 PM, George McCabe via RT wrote:
> >>>> Hi Ying,
> >>>>
> >>>> Using the new version of METplus, you will see the following
error:
> >>>>
> >>>> ERROR: Threshold values must start with
> >,>=,==,!=,<,<=,gt,ge,eq,ne,lt,
> >>> or
> >>>> le
> >>>>
> >>>> If you add a comparison operator to each item of your
FCST_VAR1_THRESH
> >>>> list, this error will go away. The old default operator was >=,
so
> >>> adding
> >>>> that would preserve the old behavior if that is what you want.
> >>>>
> >>>> You will also see some warnings of METplus variables being
deprecated.
> >>> You
> >>>> can change the name of these variables to get rid of those
warnings.
> The
> >>>> warning description should be clear.
> >>>>
> >>>> When I ran your config file, METplus built the following
command:
> >>>>
> >>>> /usr/local/met-8.0/bin/pcp_combine -name APCP_24 -add
> >>>>
> >>>
>
/d1/mccabe/ying_data/com2/ccpa/prod/ccpa.20190310/12/ccpa.t12z.06h.hrap.conus.gb2
> >>>> 6
> >>>>
> >>>
>
/d1/mccabe/ying_data/com2/ccpa/prod/ccpa.20190310/06/ccpa.t06z.06h.hrap.conus.gb2
> >>>> 6
> >>>>
> >>>
>
/d1/mccabe/ying_data/com2/ccpa/prod/ccpa.20190310/00/ccpa.t00z.06h.hrap.conus.gb2
> >>>> 6
> >>>>
> >>>
>
/d1/mccabe/ying_data/com2/ccpa/prod/ccpa.20190309/18/ccpa.t18z.06h.hrap.conus.gb2
> >>>> 6
> >>>
/d1/mccabe/ying_data/out/qpe_grib/bucket/20190310/ccpa.2019031012_A24h
> -v
> >>>> 2
> >>>>
> >>>> Let me know if you have any other issues.
> >>>>
> >>>> Thanks,
> >>>> George
> >>>>
> >>>> On Mon, Mar 11, 2019 at 9:48 AM Ying Lin via RT
<met_help at ucar.edu>
> >>> wrote:
> >>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=89063
>
> >>>>>
> >>>>> Hi George,
> >>>>>
> >>>>> First of all, thank you for telling me about passing
the envir
> >>>>> variable using {ENV[vday]}, that was really useful!
> >>>>>
> >>>>> Still have trouble "finding" the CCPA files. I've
first
> changed
> >>>>> the OBS_LEVEL=6, when that didn't work, I explicitly specified
the
> >>> '06h'
> >>>>> in the file name in the config, e.g.
> >>>>>
> >>>>> OBS_PCP_COMBINE_INPUT_TEMPLATE =
> >>>>>
> >>>>>
> >>>
>
ccpa.{valid?fmt=%Y%m%d}/{valid?fmt=%H}/ccpa.t{valid?fmt=%H}z.06h.hrap.conus.gb2
> >>>>> Still getting the "WARNING: pcp_combine: Could not find files
to
> >>> compute
> >>>>> accumulation in /com2/ccpa/prod" in the job output and the log
file
> >>>>> (both attached to this email, as well as the config file).
Also
> >>>>> attached are the four 6h CCPA files with their full paths,
e.g.
> >>>>> t10a1 $ tar cvfz /stmpp1/Ying.Lin/ccpa.tar.gz
> >>>>> /com2/ccpa/prod/ccpa.20190309/18/ccpa.*06h.hrap.conus.gb2
> >>>>> /com2/ccpa/prod/ccpa.20190310/*/ccpa.*06h.hrap.conus.gb2
> >>>>> tar: Removing leading `/' from member names
> >>>>> /com2/ccpa/prod/ccpa.20190309/18/ccpa.t18z.06h.hrap.conus.gb2
> >>>>> /com2/ccpa/prod/ccpa.20190310/00/ccpa.t00z.06h.hrap.conus.gb2
> >>>>> /com2/ccpa/prod/ccpa.20190310/06/ccpa.t06z.06h.hrap.conus.gb2
> >>>>> /com2/ccpa/prod/ccpa.20190310/12/ccpa.t12z.06h.hrap.conus.gb2
> >>>>>
> >>>>> Thanks again -
> >>>>>
> >>>>> Ying
> >>>>>
> >>>>> On 3/11/19 10:47 AM, George McCabe via RT wrote:
> >>>>>> Hi Ying,
> >>>>>>
> >>>>>> I was incorrect that you need to change the precision. %H
should
> find
> >>> the
> >>>>>> time the way it is formatted. I think you will need to remove
> >>> OBS_LEVEL
> >>>>> = 1
> >>>>>> from your config. This variable tells METplus to only look
for 1 hr
> >>>>>> accumulation files to use in pcp_combine. If you remove this
> >>> variable, it
> >>>>>> should look for a 24 hr accumulation file and reduce the hour
by 1
> >>> until
> >>>>> it
> >>>>>> finds a file that it can use. If you want to force METplus to
use 6
> >>> hour
> >>>>>> files to build the 24 hr accumulation, you should set
OBS_LEVEL = 6.
> >>> Let
> >>>>> me
> >>>>>> know if that helps.
> >>>>>>
> >>>>>> Thanks,
> >>>>>> George
> >>>>>>
> >>>>>> On Mon, Mar 11, 2019 at 8:30 AM George McCabe
<mccabe at ucar.edu>
> >>> wrote:
> >>>>>>> Hi Ying,
> >>>>>>>
> >>>>>>> You may need to change %H to %.2H in the template to tell it
that
> >>> there
> >>>>>>> will always be 2 digit precision. If that doesn't work,
could you
> >>> send
> >>>>> me
> >>>>>>> the directory listing so I can see what files are available?
> >>>>>>>
> >>>>>>> To pass in environment variables, use the following
notation:
> >>>>> {ENV[vday]}.
> >>>>>>> You are correct that using valid hour for the directory name
will
> not
> >>>>>>> work, as it will change the value to 03. If this value is
going to
> >>>>> change
> >>>>>>> between runs and doesn't directly correspond to the valid
time, you
> >>> may
> >>>>>>> have to trick it with environment variables to get it to
work
> >>> correctly.
> >>>>>>> On Thu, Mar 7, 2019 at 1:33 PM Ying Lin via RT
<met_help at ucar.edu>
> >>>>> wrote:
> >>>>>>>> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=89063 >
> >>>>>>>>
> >>>>>>>> Hi George,
> >>>>>>>>
> >>>>>>>> Thanks! That makes sense, though it didn't quite
work out
> >>> for
> >>>>> me.
> >>>>>>>> In the attached fv3gfs_24h_by_valid_time.conf, I have
> >>>>>>>> OBS_PCP_COMBINE_INPUT_DIR = /com2/ccpa/prod
> >>>>>>>> then
> >>>>>>>> OBS_PCP_COMBINE_INPUT_TEMPLATE =
> >>>>>>>>
> >>>>>>>>
> >>>
>
ccpa.{valid?fmt=%Y%m%d}/{valid?fmt=%H}/ccpa.t{valid?fmt=%H}z.{level?fmt=%.2H}h.hrap.conus.gb2
> >>>>>>>> thinking that it would tell pcp_combine to look for e,g,
> >>>>>>>>
/com2/ccpa/prod/ccpa.20190305/06/ccpa.t06z.06h.hrap.conus.gb2
> >>>>>>>>
> >>>>>>>> Instead I'm getting "WARNING: pcp_combine: Could not find
files to
> >>>>>>>> compute accumulation in /com2/ccpa/prod" (in the attached
test.out
> >>> and
> >>>>>>>> master_metplus.log.20190307).
> >>>>>>>>
> >>>>>>>> Could you tell what I'm doing wrong in the config?
> >>>>>>>>
> >>>>>>>> I'm doing the above in
> >>> Tide:/meso/save/Ying.Lin/metplus/test/.
> >>>>>>>> Also two related questions:
> >>>>>>>> 1) In the METplus model config files I've seen (like in the
> attached
> >>>>>>>> config), the VALID_BEG and VALID_END are set in the config
file.
> Is
> >>>>>>>> there an easy way to set and export the VALID_* variable
from a
> >>> script?
> >>>>>>>> For example I've tried "export vday=20190305" in the
> >>>>> test_fv3gfs_24h.ksh
> >>>>>>>> and in the config file set
> >>>>>>>> VALID_BEG = "${vday}"12 (same for VALID_END)
> >>>>>>>> and
> >>>>>>>> VALID_BEG = ${vday}12
> >>>>>>>> and
> >>>>>>>> VALID_BEG = {vday}12
> >>>>>>>> none of the above worked. What's the right way to do this?
> >>>>>>>>
> >>>>>>>> 2) In the CCPA directory of
/com2/ccpa/prod/ccpa.20190305/06/, the
> >>> '06'
> >>>>>>>> subdir seems to contain all CCPA analysis files with valid
times
> >>> from
> >>>>>>>> 01Z-06Z. So for 6h analysis, the '06' in the subdir is
just the
> >>> valid
> >>>>>>>> hour. But if I do 3-hourly verification using the 3-hourly
CCPA
> >>> files,
> >>>>>>>> the above directory also contains
ccpa.t03z.03h.hrap.conus.gb2
> >>> (valid
> >>>>> at
> >>>>>>>> 03Z) and ccpa.t06z.03h.hrap.conus.gb2 (valid at 06Z). In
that
> case i
> >>>>>>>> don't think the
> >>>>>>>>
> >>>>>>>>
> >>>
>
ccpa.{valid?fmt=%Y%m%d}/{valid?fmt=%H}/ccpa.t{valid?fmt=%H}z.{level?fmt=%.2H}h.hrap.conus.gb2
> >>>>>>>> would work, would it?
> >>>>>>>>
> >>>>>>>> Thanks again,
> >>>>>>>>
> >>>>>>>> Ying
> >>>>>>>>
> >>>>>>>>
> >>>>>>>> On 3/6/19 10:29 AM, George McCabe via RT wrote:
> >>>>>>>>> Hi Ying Lin,
> >>>>>>>>>
> >>>>>>>>> You should be able to use a template that looks something
like
> >>> this:
> >>>>>>>>>
> >>>
>
"ccpa.{valid?fmt=%Y%m%d}/06/ccpa.t{valid?fmt=%H}z.{level?fmt=%.2H}h.hrap.conus.gb2"
> >>>>>>>>> The 'level' item corresponds to the accumulation amount.
%.2H
> >>>>> specifies
> >>>>>>>>> that the filename has 2 digits of precision for that
value. I
> >>> wasn't
> >>>>>>>> sure
> >>>>>>>>> what the '06' subdirectory corresponds to, but if
necessary you
> can
> >>>>>>>>> substitute that with formatting so that it will be
dynamic. Let
> me
> >>>>> know
> >>>>>>>> if
> >>>>>>>>> that doesn't work and I can help figure out what will.
> >>>>>>>>>
> >>>>>>>>> Thanks,
> >>>>>>>>> George
> >>>>>>>>>
> >>>>>>>>> On Mon, Feb 25, 2019 at 11:09 AM Ying Lin via RT <
> >>> met_help at ucar.edu>
> >>>>>>>> wrote:
> >>>>>>>>>> Mon Feb 25 11:08:35 2019: Request 89063 was acted upon.
> >>>>>>>>>> Transaction: Ticket created by ying.lin at noaa.gov
> >>>>>>>>>> Queue: met_help
> >>>>>>>>>> Subject: CCPA file name format for METplus
> >>>>>>>>>> Owner: Nobody
> >>>>>>>>>> Requestors: ying.lin at noaa.gov
> >>>>>>>>>> Status: new
> >>>>>>>>>> Ticket <URL:
> >>>>> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=89063
> >>>>>>>>>> Hello. I see that
> >>>>>>>>>>
> >>>>>>>>>>
> >>>
>
https://github.com/NCAR/METplus/blob/master/parm/use_cases/grid_to_grid/examples/precip.conf
> >>>>>>>>>> has
> >>>>>>>>>> OBS_GRID_STAT_INPUT_TEMPLATE =
> >>>>> ccpa_conus_1.0d_{valid?fmt=%Y%m%d}
> >>>>>>>>>> CCPA output on wcoss has file names like
> >>>>>>>>>>
> >>> /com2/ccpa/prod/ccpa.20190224/06/ccpa.t03z.03h.hrap.conus.gb2
> >>>>>>>>>> which is 3h accumulation valid at 03Z 2019/02/24
> >>>>>>>>>> and ccpa.t06z.06h.hrap.conus.gb2
> >>>>>>>>>> which is 6h accumulation valid at 06Z 2019/02/24
> >>>>>>>>>>
> >>>>>>>>>> Does METplus already have the capability to handle the
CCPA in
> its
> >>>>>>>>>> 'native' directory/name format, as in the /com2/*
directory
> above?
> >>>>> In
> >>>>>>>>>> my verif scripts I do
> >>>>>>>>>> cp $COMCCPA.$vday/06/ccpa.t03z.03h.hrap.conus.gb2
> >>>>>>>> ccpa.${vday}03.03h.gb2
> >>>>>>>>>> If METplus can already handle this bit of pre-processing,
or if
> >>> this
> >>>>>>>> can
> >>>>>>>>>> be added to the wish list, that'll be great. Thanks!
> >>>>>>>>>>
> >>>>>>>>>> Ying
> >>>>>>>>>>
> >>>>>>>>>> --
> >>>>>>>>>> Ying Lin
> >>>>>>>>>> NCEP/EMC/Verification, Post-processing and Product
Generation
> >>> Branch
> >>>>>>>>>> NCWCP Cubicle No. 2015
> >>>>>>>>>> Ying.Lin at noaa.gov
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>> --
> >>>>>>>> Ying Lin
> >>>>>>>> NCEP/EMC/Verification, Post-processing and Product
Generation
> Branch
> >>>>>>>> NCWCP Cubicle No. 2015
> >>>>>>>> Ying.Lin at noaa.gov
> >>>>>>>>
> >>>>>>>>
> >>>>>>>>
> >>>>>>>>
> >>>>> --
> >>>>> Ying Lin
> >>>>> NCEP/EMC/Verification, Post-processing and Product Generation
Branch
> >>>>> NCWCP Cubicle No. 2015
> >>>>> Ying.Lin at noaa.gov
> >>>>>
> >>>>>
> >>>>>
> >>>>>
> >>> --
> >>> Ying Lin
> >>> NCEP/EMC/Verification, Post-processing and Product Generation
Branch
> >>> NCWCP Cubicle No. 2015
> >>> Ying.Lin at noaa.gov
> >>>
> >>>
> >>>
> >>>
>
> --
> Ying Lin
> NCEP/EMC/Verification, Post-processing and Product Generation Branch
> NCWCP Cubicle No. 2015
> Ying.Lin at noaa.gov
>
>
>
>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #89063] CCPA file name format for METplus
From: Ying Lin
Time: Tue Mar 12 17:04:45 2019
Hi George,
The separate
OBS_REGRID_DATA_PLANE_INPUT_TEMPLATE
and
OBS_REGRID_DATA_PLANE_OUTPUT_TEMPLATE
does work! This is wonderful. Thank you again!
Ying
On 3/12/19 6:56 PM, George McCabe via RT wrote:
> Hi Ying,
>
> I know that OBS_REGRID_DATA_PLANE_TEMPLATE is confusing. Because of
this,
> we have added the ability to specify the input and output templates
for
> regrid_data_plane. You can use:
>
> OBS_REGRID_DATA_PLANE_INPUT_TEMPLATE
> and
> OBS_REGRID_DATA_PLANE_OUTPUT_TEMPLATE
>
> We still allow the generic one for backwards compatibility.
>
> On Tue, Mar 12, 2019 at 10:39 PM Ying Lin via RT <met_help at ucar.edu>
wrote:
>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=89063 >
>>
>> Hi George,
>>
>> Ah, I see! Somehow I thought OBS_REGRID_DATA_PLANE_TEMPLATE would
be the
>> output file name for REGRID_DATA_PLAN. I wondered earlier why the
>> "phpt" and the "ruc" example had the same file names under subdirs
>> bucket/ and regrid/, and thought I'd tag on the ".g212" to
differentiate
>> them. What I should have done was to hew as close as possible to
the
>> examples in the use case to start with. The "FV3GFS" test does run
to
>> completion now. Many thanks for your help and your patience.
Please
>> close this ticket at your convenience.
>>
>> Ying
>>
>> On 3/12/19 5:14 PM, George McCabe via RT wrote:
>>> Nevermind, I found the issue. Take a look at your filename
templates. The
>>> output from PCP_COMBINE should match the input for
REGRID_DATA_PLANE. I
>> can
>>> see that they are different. Thank you for pointing this out, as
METplus
>>> should report an error when this happens instead of just failing
quietly.
>>>
>>> On Tue, Mar 12, 2019 at 9:11 PM George McCabe <mccabe at ucar.edu>
wrote:
>>>
>>>> Hi Ying,
>>>>
>>>> Glad to hear that you were able to run pcp_combine viaMETplus.
>>>>
>>>> Could you send me this file?
>>>> /meso/noscrub/Ying.Lin/metplus.out/metplus_final.conf
>>>>
>>>> It looks like there is a loop over all of the field variables to
process
>>>> after the log PROCESSING FORECAST LEAD 24, so perhaps that has
been
>>>> overwritten so be empty.
>>>>
>>>> On Tue, Mar 12, 2019 at 8:19 PM Ying Lin via RT
<met_help at ucar.edu>
>> wrote:
>>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=89063 >
>>>>>
>>>>> Thanks very much George.
>>>>>
>>>>> Moving the METplus.v2.0.4, the pcp_combine step did work
easily,
>>>>> but now I'm having trouble with the regrid_data_plane step.
Running
>> the
>>>>> METplus script (test_fv3gfs_24h.ksh, attached), I'm seeing in
the job
>>>>> out (fv3gfs.out) that
>>>>> 03/12 19:45:18.029 metplus.RegridDataPlane
>>>>> (reformat_gridded_wrapper.py:75) INFO: PROCESSING OBS DATA
>>>>> 03/12 19:45:18.029 metplus.RegridDataPlane
>>>>> (reformat_gridded_wrapper.py:78) INFO: PROCESSING FORECAST LEAD
24
>>>>>
>>>>> With no further info about the RegridDataPlane step, it moves on
to
>>>>> metplus.GridStat, and (unsurprisingly) cannot find the verifying
>>>>> analysis in the qpe_grib/regrid/.
>>>>>
>>>>> I tried the two use cases in
>>>>>
>> /global/noscrub/Julie.Prestopnik/METplus/METplus-
2.0.4/parm/use_cases/qpf/examples,
>>>>> phpt-vs-s4grib.conf and ruc-vs-s2grib.conf, they both do work
(though
>>>>> the latter was re-gridding from G212 to the same G212), e.g. in
the
>>>>> attached phpt.out (successful RegridDataPlane), it's got
>>>>>
>>>>> 03/12 18:01:11.883 metplus.RegridDataPlane
>>>>> (reformat_gridded_wrapper.py:75) INFO: PROCESSING OBS DATA
>>>>> 03/12 18:01:11.883 metplus.RegridDataPlane
>>>>> (reformat_gridded_wrapper.py:78) INFO: PROCESSING FORECAST LEAD
3
>>>>> 03/12 18:01:11.885 metplus.RegridDataPlane
(command_runner.py:222)
>>>>> DEBUG: LOG_MET_OUTPUT_TO_METPLUS log file is True ...
>>>>>
>>>>> So there is something in my fv3gfs test setup that prevented it
from
>>>>> moving on to the "command_runner.py:222" step. I tried
comparing my
>>>>> fv3gfs_24h.conf with the use case samples phpt-vs-s4grib.conf
and
>>>>> ruc-vs-s2grib.conf, and couldn't see what I did wrong. I'm
running out
>>>>> of ideas. Would you mind taking a look at this?
>>>>>
>>>>> I tried running the MET regrid_data_plane manually
(regridit.ksh) using
>>>>> the metplus.PcpCombine output, and it worked fine.
>>>>>
>>>>> Thank you -
>>>>>
>>>>> Ying
>>>>>
>>>>> On 3/11/19 12:23 PM, George McCabe via RT wrote:
>>>>>> Hi Ying,
>>>>>>
>>>>>> Using the new version of METplus, you will see the following
error:
>>>>>>
>>>>>> ERROR: Threshold values must start with
>>> ,>=,==,!=,<,<=,gt,ge,eq,ne,lt,
>>>>> or
>>>>>> le
>>>>>>
>>>>>> If you add a comparison operator to each item of your
FCST_VAR1_THRESH
>>>>>> list, this error will go away. The old default operator was >=,
so
>>>>> adding
>>>>>> that would preserve the old behavior if that is what you want.
>>>>>>
>>>>>> You will also see some warnings of METplus variables being
deprecated.
>>>>> You
>>>>>> can change the name of these variables to get rid of those
warnings.
>> The
>>>>>> warning description should be clear.
>>>>>>
>>>>>> When I ran your config file, METplus built the following
command:
>>>>>>
>>>>>> /usr/local/met-8.0/bin/pcp_combine -name APCP_24 -add
>>>>>>
>>
/d1/mccabe/ying_data/com2/ccpa/prod/ccpa.20190310/12/ccpa.t12z.06h.hrap.conus.gb2
>>>>>> 6
>>>>>>
>>
/d1/mccabe/ying_data/com2/ccpa/prod/ccpa.20190310/06/ccpa.t06z.06h.hrap.conus.gb2
>>>>>> 6
>>>>>>
>>
/d1/mccabe/ying_data/com2/ccpa/prod/ccpa.20190310/00/ccpa.t00z.06h.hrap.conus.gb2
>>>>>> 6
>>>>>>
>>
/d1/mccabe/ying_data/com2/ccpa/prod/ccpa.20190309/18/ccpa.t18z.06h.hrap.conus.gb2
>>>>>> 6
>>>>>
/d1/mccabe/ying_data/out/qpe_grib/bucket/20190310/ccpa.2019031012_A24h
>> -v
>>>>>> 2
>>>>>>
>>>>>> Let me know if you have any other issues.
>>>>>>
>>>>>> Thanks,
>>>>>> George
>>>>>>
>>>>>> On Mon, Mar 11, 2019 at 9:48 AM Ying Lin via RT
<met_help at ucar.edu>
>>>>> wrote:
>>>>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=89063
>
>>>>>>>
>>>>>>> Hi George,
>>>>>>>
>>>>>>> First of all, thank you for telling me about passing
the envir
>>>>>>> variable using {ENV[vday]}, that was really useful!
>>>>>>>
>>>>>>> Still have trouble "finding" the CCPA files. I've
first
>> changed
>>>>>>> the OBS_LEVEL=6, when that didn't work, I explicitly specified
the
>>>>> '06h'
>>>>>>> in the file name in the config, e.g.
>>>>>>>
>>>>>>> OBS_PCP_COMBINE_INPUT_TEMPLATE =
>>>>>>>
>>>>>>>
>>
ccpa.{valid?fmt=%Y%m%d}/{valid?fmt=%H}/ccpa.t{valid?fmt=%H}z.06h.hrap.conus.gb2
>>>>>>> Still getting the "WARNING: pcp_combine: Could not find files
to
>>>>> compute
>>>>>>> accumulation in /com2/ccpa/prod" in the job output and the log
file
>>>>>>> (both attached to this email, as well as the config file).
Also
>>>>>>> attached are the four 6h CCPA files with their full paths,
e.g.
>>>>>>> t10a1 $ tar cvfz /stmpp1/Ying.Lin/ccpa.tar.gz
>>>>>>> /com2/ccpa/prod/ccpa.20190309/18/ccpa.*06h.hrap.conus.gb2
>>>>>>> /com2/ccpa/prod/ccpa.20190310/*/ccpa.*06h.hrap.conus.gb2
>>>>>>> tar: Removing leading `/' from member names
>>>>>>> /com2/ccpa/prod/ccpa.20190309/18/ccpa.t18z.06h.hrap.conus.gb2
>>>>>>> /com2/ccpa/prod/ccpa.20190310/00/ccpa.t00z.06h.hrap.conus.gb2
>>>>>>> /com2/ccpa/prod/ccpa.20190310/06/ccpa.t06z.06h.hrap.conus.gb2
>>>>>>> /com2/ccpa/prod/ccpa.20190310/12/ccpa.t12z.06h.hrap.conus.gb2
>>>>>>>
>>>>>>> Thanks again -
>>>>>>>
>>>>>>> Ying
>>>>>>>
>>>>>>> On 3/11/19 10:47 AM, George McCabe via RT wrote:
>>>>>>>> Hi Ying,
>>>>>>>>
>>>>>>>> I was incorrect that you need to change the precision. %H
should
>> find
>>>>> the
>>>>>>>> time the way it is formatted. I think you will need to remove
>>>>> OBS_LEVEL
>>>>>>> = 1
>>>>>>>> from your config. This variable tells METplus to only look
for 1 hr
>>>>>>>> accumulation files to use in pcp_combine. If you remove this
>>>>> variable, it
>>>>>>>> should look for a 24 hr accumulation file and reduce the hour
by 1
>>>>> until
>>>>>>> it
>>>>>>>> finds a file that it can use. If you want to force METplus to
use 6
>>>>> hour
>>>>>>>> files to build the 24 hr accumulation, you should set
OBS_LEVEL = 6.
>>>>> Let
>>>>>>> me
>>>>>>>> know if that helps.
>>>>>>>>
>>>>>>>> Thanks,
>>>>>>>> George
>>>>>>>>
>>>>>>>> On Mon, Mar 11, 2019 at 8:30 AM George McCabe
<mccabe at ucar.edu>
>>>>> wrote:
>>>>>>>>> Hi Ying,
>>>>>>>>>
>>>>>>>>> You may need to change %H to %.2H in the template to tell it
that
>>>>> there
>>>>>>>>> will always be 2 digit precision. If that doesn't work,
could you
>>>>> send
>>>>>>> me
>>>>>>>>> the directory listing so I can see what files are available?
>>>>>>>>>
>>>>>>>>> To pass in environment variables, use the following
notation:
>>>>>>> {ENV[vday]}.
>>>>>>>>> You are correct that using valid hour for the directory name
will
>> not
>>>>>>>>> work, as it will change the value to 03. If this value is
going to
>>>>>>> change
>>>>>>>>> between runs and doesn't directly correspond to the valid
time, you
>>>>> may
>>>>>>>>> have to trick it with environment variables to get it to
work
>>>>> correctly.
>>>>>>>>> On Thu, Mar 7, 2019 at 1:33 PM Ying Lin via RT
<met_help at ucar.edu>
>>>>>>> wrote:
>>>>>>>>>> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=89063 >
>>>>>>>>>>
>>>>>>>>>> Hi George,
>>>>>>>>>>
>>>>>>>>>> Thanks! That makes sense, though it didn't quite
work out
>>>>> for
>>>>>>> me.
>>>>>>>>>> In the attached fv3gfs_24h_by_valid_time.conf, I have
>>>>>>>>>> OBS_PCP_COMBINE_INPUT_DIR = /com2/ccpa/prod
>>>>>>>>>> then
>>>>>>>>>> OBS_PCP_COMBINE_INPUT_TEMPLATE =
>>>>>>>>>>
>>>>>>>>>>
>>
ccpa.{valid?fmt=%Y%m%d}/{valid?fmt=%H}/ccpa.t{valid?fmt=%H}z.{level?fmt=%.2H}h.hrap.conus.gb2
>>>>>>>>>> thinking that it would tell pcp_combine to look for e,g,
>>>>>>>>>>
/com2/ccpa/prod/ccpa.20190305/06/ccpa.t06z.06h.hrap.conus.gb2
>>>>>>>>>>
>>>>>>>>>> Instead I'm getting "WARNING: pcp_combine: Could not find
files to
>>>>>>>>>> compute accumulation in /com2/ccpa/prod" (in the attached
test.out
>>>>> and
>>>>>>>>>> master_metplus.log.20190307).
>>>>>>>>>>
>>>>>>>>>> Could you tell what I'm doing wrong in the config?
>>>>>>>>>>
>>>>>>>>>> I'm doing the above in
>>>>> Tide:/meso/save/Ying.Lin/metplus/test/.
>>>>>>>>>> Also two related questions:
>>>>>>>>>> 1) In the METplus model config files I've seen (like in the
>> attached
>>>>>>>>>> config), the VALID_BEG and VALID_END are set in the config
file.
>> Is
>>>>>>>>>> there an easy way to set and export the VALID_* variable
from a
>>>>> script?
>>>>>>>>>> For example I've tried "export vday=20190305" in the
>>>>>>> test_fv3gfs_24h.ksh
>>>>>>>>>> and in the config file set
>>>>>>>>>> VALID_BEG = "${vday}"12 (same for VALID_END)
>>>>>>>>>> and
>>>>>>>>>> VALID_BEG = ${vday}12
>>>>>>>>>> and
>>>>>>>>>> VALID_BEG = {vday}12
>>>>>>>>>> none of the above worked. What's the right way to do this?
>>>>>>>>>>
>>>>>>>>>> 2) In the CCPA directory of
/com2/ccpa/prod/ccpa.20190305/06/, the
>>>>> '06'
>>>>>>>>>> subdir seems to contain all CCPA analysis files with valid
times
>>>>> from
>>>>>>>>>> 01Z-06Z. So for 6h analysis, the '06' in the subdir is
just the
>>>>> valid
>>>>>>>>>> hour. But if I do 3-hourly verification using the 3-hourly
CCPA
>>>>> files,
>>>>>>>>>> the above directory also contains
ccpa.t03z.03h.hrap.conus.gb2
>>>>> (valid
>>>>>>> at
>>>>>>>>>> 03Z) and ccpa.t06z.03h.hrap.conus.gb2 (valid at 06Z). In
that
>> case i
>>>>>>>>>> don't think the
>>>>>>>>>>
>>>>>>>>>>
>>
ccpa.{valid?fmt=%Y%m%d}/{valid?fmt=%H}/ccpa.t{valid?fmt=%H}z.{level?fmt=%.2H}h.hrap.conus.gb2
>>>>>>>>>> would work, would it?
>>>>>>>>>>
>>>>>>>>>> Thanks again,
>>>>>>>>>>
>>>>>>>>>> Ying
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> On 3/6/19 10:29 AM, George McCabe via RT wrote:
>>>>>>>>>>> Hi Ying Lin,
>>>>>>>>>>>
>>>>>>>>>>> You should be able to use a template that looks something
like
>>>>> this:
>>
"ccpa.{valid?fmt=%Y%m%d}/06/ccpa.t{valid?fmt=%H}z.{level?fmt=%.2H}h.hrap.conus.gb2"
>>>>>>>>>>> The 'level' item corresponds to the accumulation amount.
%.2H
>>>>>>> specifies
>>>>>>>>>>> that the filename has 2 digits of precision for that
value. I
>>>>> wasn't
>>>>>>>>>> sure
>>>>>>>>>>> what the '06' subdirectory corresponds to, but if
necessary you
>> can
>>>>>>>>>>> substitute that with formatting so that it will be
dynamic. Let
>> me
>>>>>>> know
>>>>>>>>>> if
>>>>>>>>>>> that doesn't work and I can help figure out what will.
>>>>>>>>>>>
>>>>>>>>>>> Thanks,
>>>>>>>>>>> George
>>>>>>>>>>>
>>>>>>>>>>> On Mon, Feb 25, 2019 at 11:09 AM Ying Lin via RT <
>>>>> met_help at ucar.edu>
>>>>>>>>>> wrote:
>>>>>>>>>>>> Mon Feb 25 11:08:35 2019: Request 89063 was acted upon.
>>>>>>>>>>>> Transaction: Ticket created by ying.lin at noaa.gov
>>>>>>>>>>>> Queue: met_help
>>>>>>>>>>>> Subject: CCPA file name format for METplus
>>>>>>>>>>>> Owner: Nobody
>>>>>>>>>>>> Requestors: ying.lin at noaa.gov
>>>>>>>>>>>> Status: new
>>>>>>>>>>>> Ticket <URL:
>>>>>>> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=89063
>>>>>>>>>>>> Hello. I see that
>>>>>>>>>>>>
>>>>>>>>>>>>
>>
https://github.com/NCAR/METplus/blob/master/parm/use_cases/grid_to_grid/examples/precip.conf
>>>>>>>>>>>> has
>>>>>>>>>>>> OBS_GRID_STAT_INPUT_TEMPLATE =
>>>>>>> ccpa_conus_1.0d_{valid?fmt=%Y%m%d}
>>>>>>>>>>>> CCPA output on wcoss has file names like
>>>>>>>>>>>>
>>>>> /com2/ccpa/prod/ccpa.20190224/06/ccpa.t03z.03h.hrap.conus.gb2
>>>>>>>>>>>> which is 3h accumulation valid at 03Z 2019/02/24
>>>>>>>>>>>> and ccpa.t06z.06h.hrap.conus.gb2
>>>>>>>>>>>> which is 6h accumulation valid at 06Z 2019/02/24
>>>>>>>>>>>>
>>>>>>>>>>>> Does METplus already have the capability to handle the
CCPA in
>> its
>>>>>>>>>>>> 'native' directory/name format, as in the /com2/*
directory
>> above?
>>>>>>> In
>>>>>>>>>>>> my verif scripts I do
>>>>>>>>>>>> cp $COMCCPA.$vday/06/ccpa.t03z.03h.hrap.conus.gb2
>>>>>>>>>> ccpa.${vday}03.03h.gb2
>>>>>>>>>>>> If METplus can already handle this bit of pre-processing,
or if
>>>>> this
>>>>>>>>>> can
>>>>>>>>>>>> be added to the wish list, that'll be great. Thanks!
>>>>>>>>>>>>
>>>>>>>>>>>> Ying
>>>>>>>>>>>>
>>>>>>>>>>>> --
>>>>>>>>>>>> Ying Lin
>>>>>>>>>>>> NCEP/EMC/Verification, Post-processing and Product
Generation
>>>>> Branch
>>>>>>>>>>>> NCWCP Cubicle No. 2015
>>>>>>>>>>>> Ying.Lin at noaa.gov
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>> --
>>>>>>>>>> Ying Lin
>>>>>>>>>> NCEP/EMC/Verification, Post-processing and Product
Generation
>> Branch
>>>>>>>>>> NCWCP Cubicle No. 2015
>>>>>>>>>> Ying.Lin at noaa.gov
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>> --
>>>>>>> Ying Lin
>>>>>>> NCEP/EMC/Verification, Post-processing and Product Generation
Branch
>>>>>>> NCWCP Cubicle No. 2015
>>>>>>> Ying.Lin at noaa.gov
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>> --
>>>>> Ying Lin
>>>>> NCEP/EMC/Verification, Post-processing and Product Generation
Branch
>>>>> NCWCP Cubicle No. 2015
>>>>> Ying.Lin at noaa.gov
>>>>>
>>>>>
>>>>>
>>>>>
>> --
>> Ying Lin
>> NCEP/EMC/Verification, Post-processing and Product Generation
Branch
>> NCWCP Cubicle No. 2015
>> Ying.Lin at noaa.gov
>>
>>
>>
>>
--
Ying Lin
NCEP/EMC/Verification, Post-processing and Product Generation Branch
NCWCP Cubicle No. 2015
Ying.Lin at noaa.gov
------------------------------------------------
Subject: CCPA file name format for METplus
From: George McCabe
Time: Wed May 29 12:34:15 2019
Hi Ying,
Do you need any additional help regarding this ticket? I am going to
close it now but please let me know if you need any more assistance.
Thanks,
George
On Tue Mar 12 17:04:45 2019, ying.lin at noaa.gov wrote:
> Hi George,
>
> The separate
>
> OBS_REGRID_DATA_PLANE_INPUT_TEMPLATE
> and
> OBS_REGRID_DATA_PLANE_OUTPUT_TEMPLATE
>
> does work! This is wonderful. Thank you again!
>
> Ying
>
> On 3/12/19 6:56 PM, George McCabe via RT wrote:
> > Hi Ying,
> >
> > I know that OBS_REGRID_DATA_PLANE_TEMPLATE is confusing. Because
of
> > this,
> > we have added the ability to specify the input and output
templates
> > for
> > regrid_data_plane. You can use:
> >
> > OBS_REGRID_DATA_PLANE_INPUT_TEMPLATE
> > and
> > OBS_REGRID_DATA_PLANE_OUTPUT_TEMPLATE
> >
> > We still allow the generic one for backwards compatibility.
> >
> > On Tue, Mar 12, 2019 at 10:39 PM Ying Lin via RT
<met_help at ucar.edu>
> > wrote:
> >
> >> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=89063 >
> >>
> >> Hi George,
> >>
> >> Ah, I see! Somehow I thought OBS_REGRID_DATA_PLANE_TEMPLATE would
be
> >> the
> >> output file name for REGRID_DATA_PLAN. I wondered earlier why
the
> >> "phpt" and the "ruc" example had the same file names under
subdirs
> >> bucket/ and regrid/, and thought I'd tag on the ".g212" to
> >> differentiate
> >> them. What I should have done was to hew as close as possible
to
> >> the
> >> examples in the use case to start with. The "FV3GFS" test does
run
> >> to
> >> completion now. Many thanks for your help and your patience.
> >> Please
> >> close this ticket at your convenience.
> >>
> >> Ying
> >>
> >> On 3/12/19 5:14 PM, George McCabe via RT wrote:
> >>> Nevermind, I found the issue. Take a look at your filename
> >>> templates. The
> >>> output from PCP_COMBINE should match the input for
> >>> REGRID_DATA_PLANE. I
> >> can
> >>> see that they are different. Thank you for pointing this out, as
> >>> METplus
> >>> should report an error when this happens instead of just failing
> >>> quietly.
> >>>
> >>> On Tue, Mar 12, 2019 at 9:11 PM George McCabe <mccabe at ucar.edu>
> >>> wrote:
> >>>
> >>>> Hi Ying,
> >>>>
> >>>> Glad to hear that you were able to run pcp_combine viaMETplus.
> >>>>
> >>>> Could you send me this file?
> >>>> /meso/noscrub/Ying.Lin/metplus.out/metplus_final.conf
> >>>>
> >>>> It looks like there is a loop over all of the field variables
to
> >>>> process
> >>>> after the log PROCESSING FORECAST LEAD 24, so perhaps that has
> >>>> been
> >>>> overwritten so be empty.
> >>>>
> >>>> On Tue, Mar 12, 2019 at 8:19 PM Ying Lin via RT
> >>>> <met_help at ucar.edu>
> >> wrote:
> >>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=89063
>
> >>>>>
> >>>>> Thanks very much George.
> >>>>>
> >>>>> Moving the METplus.v2.0.4, the pcp_combine step did work
easily,
> >>>>> but now I'm having trouble with the regrid_data_plane step.
> >>>>> Running
> >> the
> >>>>> METplus script (test_fv3gfs_24h.ksh, attached), I'm seeing in
the
> >>>>> job
> >>>>> out (fv3gfs.out) that
> >>>>> 03/12 19:45:18.029 metplus.RegridDataPlane
> >>>>> (reformat_gridded_wrapper.py:75) INFO: PROCESSING OBS DATA
> >>>>> 03/12 19:45:18.029 metplus.RegridDataPlane
> >>>>> (reformat_gridded_wrapper.py:78) INFO: PROCESSING FORECAST
LEAD
> >>>>> 24
> >>>>>
> >>>>> With no further info about the RegridDataPlane step, it moves
on
> >>>>> to
> >>>>> metplus.GridStat, and (unsurprisingly) cannot find the
verifying
> >>>>> analysis in the qpe_grib/regrid/.
> >>>>>
> >>>>> I tried the two use cases in
> >>>>>
> >> /global/noscrub/Julie.Prestopnik/METplus/METplus-
> >> 2.0.4/parm/use_cases/qpf/examples,
> >>>>> phpt-vs-s4grib.conf and ruc-vs-s2grib.conf, they both do work
> >>>>> (though
> >>>>> the latter was re-gridding from G212 to the same G212), e.g.
in
> >>>>> the
> >>>>> attached phpt.out (successful RegridDataPlane), it's got
> >>>>>
> >>>>> 03/12 18:01:11.883 metplus.RegridDataPlane
> >>>>> (reformat_gridded_wrapper.py:75) INFO: PROCESSING OBS DATA
> >>>>> 03/12 18:01:11.883 metplus.RegridDataPlane
> >>>>> (reformat_gridded_wrapper.py:78) INFO: PROCESSING FORECAST
LEAD 3
> >>>>> 03/12 18:01:11.885 metplus.RegridDataPlane
> >>>>> (command_runner.py:222)
> >>>>> DEBUG: LOG_MET_OUTPUT_TO_METPLUS log file is True ...
> >>>>>
> >>>>> So there is something in my fv3gfs test setup that prevented
it
> >>>>> from
> >>>>> moving on to the "command_runner.py:222" step. I tried
comparing
> >>>>> my
> >>>>> fv3gfs_24h.conf with the use case samples phpt-vs-s4grib.conf
and
> >>>>> ruc-vs-s2grib.conf, and couldn't see what I did wrong. I'm
> >>>>> running out
> >>>>> of ideas. Would you mind taking a look at this?
> >>>>>
> >>>>> I tried running the MET regrid_data_plane manually
(regridit.ksh)
> >>>>> using
> >>>>> the metplus.PcpCombine output, and it worked fine.
> >>>>>
> >>>>> Thank you -
> >>>>>
> >>>>> Ying
> >>>>>
> >>>>> On 3/11/19 12:23 PM, George McCabe via RT wrote:
> >>>>>> Hi Ying,
> >>>>>>
> >>>>>> Using the new version of METplus, you will see the following
> >>>>>> error:
> >>>>>>
> >>>>>> ERROR: Threshold values must start with
> >>> ,>=,==,!=,<,<=,gt,ge,eq,ne,lt,
> >>>>> or
> >>>>>> le
> >>>>>>
> >>>>>> If you add a comparison operator to each item of your
> >>>>>> FCST_VAR1_THRESH
> >>>>>> list, this error will go away. The old default operator was
>=,
> >>>>>> so
> >>>>> adding
> >>>>>> that would preserve the old behavior if that is what you
want.
> >>>>>>
> >>>>>> You will also see some warnings of METplus variables being
> >>>>>> deprecated.
> >>>>> You
> >>>>>> can change the name of these variables to get rid of those
> >>>>>> warnings.
> >> The
> >>>>>> warning description should be clear.
> >>>>>>
> >>>>>> When I ran your config file, METplus built the following
> >>>>>> command:
> >>>>>>
> >>>>>> /usr/local/met-8.0/bin/pcp_combine -name APCP_24 -add
> >>>>>>
> >>
/d1/mccabe/ying_data/com2/ccpa/prod/ccpa.20190310/12/ccpa.t12z.06h.hrap.conus.gb2
> >>>>>> 6
> >>>>>>
> >>
/d1/mccabe/ying_data/com2/ccpa/prod/ccpa.20190310/06/ccpa.t06z.06h.hrap.conus.gb2
> >>>>>> 6
> >>>>>>
> >>
/d1/mccabe/ying_data/com2/ccpa/prod/ccpa.20190310/00/ccpa.t00z.06h.hrap.conus.gb2
> >>>>>> 6
> >>>>>>
> >>
/d1/mccabe/ying_data/com2/ccpa/prod/ccpa.20190309/18/ccpa.t18z.06h.hrap.conus.gb2
> >>>>>> 6
> >>>>>
/d1/mccabe/ying_data/out/qpe_grib/bucket/20190310/ccpa.2019031012_A24h
> >> -v
> >>>>>> 2
> >>>>>>
> >>>>>> Let me know if you have any other issues.
> >>>>>>
> >>>>>> Thanks,
> >>>>>> George
> >>>>>>
> >>>>>> On Mon, Mar 11, 2019 at 9:48 AM Ying Lin via RT
> >>>>>> <met_help at ucar.edu>
> >>>>> wrote:
> >>>>>>> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=89063 >
> >>>>>>>
> >>>>>>> Hi George,
> >>>>>>>
> >>>>>>> First of all, thank you for telling me about passing the
envir
> >>>>>>> variable using {ENV[vday]}, that was really useful!
> >>>>>>>
> >>>>>>> Still have trouble "finding" the CCPA files. I've first
> >> changed
> >>>>>>> the OBS_LEVEL=6, when that didn't work, I explicitly
specified
> >>>>>>> the
> >>>>> '06h'
> >>>>>>> in the file name in the config, e.g.
> >>>>>>>
> >>>>>>> OBS_PCP_COMBINE_INPUT_TEMPLATE =
> >>>>>>>
> >>>>>>>
> >>
ccpa.{valid?fmt=%Y%m%d}/{valid?fmt=%H}/ccpa.t{valid?fmt=%H}z.06h.hrap.conus.gb2
> >>>>>>> Still getting the "WARNING: pcp_combine: Could not find
files
> >>>>>>> to
> >>>>> compute
> >>>>>>> accumulation in /com2/ccpa/prod" in the job output and the
log
> >>>>>>> file
> >>>>>>> (both attached to this email, as well as the config file).
> >>>>>>> Also
> >>>>>>> attached are the four 6h CCPA files with their full paths,
e.g.
> >>>>>>> t10a1 $ tar cvfz /stmpp1/Ying.Lin/ccpa.tar.gz
> >>>>>>> /com2/ccpa/prod/ccpa.20190309/18/ccpa.*06h.hrap.conus.gb2
> >>>>>>> /com2/ccpa/prod/ccpa.20190310/*/ccpa.*06h.hrap.conus.gb2
> >>>>>>> tar: Removing leading `/' from member names
> >>>>>>>
/com2/ccpa/prod/ccpa.20190309/18/ccpa.t18z.06h.hrap.conus.gb2
> >>>>>>>
/com2/ccpa/prod/ccpa.20190310/00/ccpa.t00z.06h.hrap.conus.gb2
> >>>>>>>
/com2/ccpa/prod/ccpa.20190310/06/ccpa.t06z.06h.hrap.conus.gb2
> >>>>>>>
/com2/ccpa/prod/ccpa.20190310/12/ccpa.t12z.06h.hrap.conus.gb2
> >>>>>>>
> >>>>>>> Thanks again -
> >>>>>>>
> >>>>>>> Ying
> >>>>>>>
> >>>>>>> On 3/11/19 10:47 AM, George McCabe via RT wrote:
> >>>>>>>> Hi Ying,
> >>>>>>>>
> >>>>>>>> I was incorrect that you need to change the precision. %H
> >>>>>>>> should
> >> find
> >>>>> the
> >>>>>>>> time the way it is formatted. I think you will need to
remove
> >>>>> OBS_LEVEL
> >>>>>>> = 1
> >>>>>>>> from your config. This variable tells METplus to only look
for
> >>>>>>>> 1 hr
> >>>>>>>> accumulation files to use in pcp_combine. If you remove
this
> >>>>> variable, it
> >>>>>>>> should look for a 24 hr accumulation file and reduce the
hour
> >>>>>>>> by 1
> >>>>> until
> >>>>>>> it
> >>>>>>>> finds a file that it can use. If you want to force METplus
to
> >>>>>>>> use 6
> >>>>> hour
> >>>>>>>> files to build the 24 hr accumulation, you should set
> >>>>>>>> OBS_LEVEL = 6.
> >>>>> Let
> >>>>>>> me
> >>>>>>>> know if that helps.
> >>>>>>>>
> >>>>>>>> Thanks,
> >>>>>>>> George
> >>>>>>>>
> >>>>>>>> On Mon, Mar 11, 2019 at 8:30 AM George McCabe
> >>>>>>>> <mccabe at ucar.edu>
> >>>>> wrote:
> >>>>>>>>> Hi Ying,
> >>>>>>>>>
> >>>>>>>>> You may need to change %H to %.2H in the template to tell
it
> >>>>>>>>> that
> >>>>> there
> >>>>>>>>> will always be 2 digit precision. If that doesn't work,
could
> >>>>>>>>> you
> >>>>> send
> >>>>>>> me
> >>>>>>>>> the directory listing so I can see what files are
available?
> >>>>>>>>>
> >>>>>>>>> To pass in environment variables, use the following
notation:
> >>>>>>> {ENV[vday]}.
> >>>>>>>>> You are correct that using valid hour for the directory
name
> >>>>>>>>> will
> >> not
> >>>>>>>>> work, as it will change the value to 03. If this value is
> >>>>>>>>> going to
> >>>>>>> change
> >>>>>>>>> between runs and doesn't directly correspond to the valid
> >>>>>>>>> time, you
> >>>>> may
> >>>>>>>>> have to trick it with environment variables to get it to
work
> >>>>> correctly.
> >>>>>>>>> On Thu, Mar 7, 2019 at 1:33 PM Ying Lin via RT
> >>>>>>>>> <met_help at ucar.edu>
> >>>>>>> wrote:
> >>>>>>>>>> <URL:
> >>>>>>>>>> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=89063 >
> >>>>>>>>>>
> >>>>>>>>>> Hi George,
> >>>>>>>>>>
> >>>>>>>>>> Thanks! That makes sense, though it didn't quite work
out
> >>>>> for
> >>>>>>> me.
> >>>>>>>>>> In the attached fv3gfs_24h_by_valid_time.conf, I have
> >>>>>>>>>> OBS_PCP_COMBINE_INPUT_DIR = /com2/ccpa/prod
> >>>>>>>>>> then
> >>>>>>>>>> OBS_PCP_COMBINE_INPUT_TEMPLATE =
> >>>>>>>>>>
> >>>>>>>>>>
> >>
ccpa.{valid?fmt=%Y%m%d}/{valid?fmt=%H}/ccpa.t{valid?fmt=%H}z.{level?fmt=%.2H}h.hrap.conus.gb2
> >>>>>>>>>> thinking that it would tell pcp_combine to look for e,g,
> >>>>>>>>>>
/com2/ccpa/prod/ccpa.20190305/06/ccpa.t06z.06h.hrap.conus.gb2
> >>>>>>>>>>
> >>>>>>>>>> Instead I'm getting "WARNING: pcp_combine: Could not find
> >>>>>>>>>> files to
> >>>>>>>>>> compute accumulation in /com2/ccpa/prod" (in the attached
> >>>>>>>>>> test.out
> >>>>> and
> >>>>>>>>>> master_metplus.log.20190307).
> >>>>>>>>>>
> >>>>>>>>>> Could you tell what I'm doing wrong in the config?
> >>>>>>>>>>
> >>>>>>>>>> I'm doing the above in
> >>>>> Tide:/meso/save/Ying.Lin/metplus/test/.
> >>>>>>>>>> Also two related questions:
> >>>>>>>>>> 1) In the METplus model config files I've seen (like in
the
> >> attached
> >>>>>>>>>> config), the VALID_BEG and VALID_END are set in the
config
> >>>>>>>>>> file.
> >> Is
> >>>>>>>>>> there an easy way to set and export the VALID_* variable
> >>>>>>>>>> from a
> >>>>> script?
> >>>>>>>>>> For example I've tried "export vday=20190305" in the
> >>>>>>> test_fv3gfs_24h.ksh
> >>>>>>>>>> and in the config file set
> >>>>>>>>>> VALID_BEG = "${vday}"12 (same for VALID_END)
> >>>>>>>>>> and
> >>>>>>>>>> VALID_BEG = ${vday}12
> >>>>>>>>>> and
> >>>>>>>>>> VALID_BEG = {vday}12
> >>>>>>>>>> none of the above worked. What's the right way to do
this?
> >>>>>>>>>>
> >>>>>>>>>> 2) In the CCPA directory of
> >>>>>>>>>> /com2/ccpa/prod/ccpa.20190305/06/, the
> >>>>> '06'
> >>>>>>>>>> subdir seems to contain all CCPA analysis files with
valid
> >>>>>>>>>> times
> >>>>> from
> >>>>>>>>>> 01Z-06Z. So for 6h analysis, the '06' in the subdir is
just
> >>>>>>>>>> the
> >>>>> valid
> >>>>>>>>>> hour. But if I do 3-hourly verification using the 3-
hourly
> >>>>>>>>>> CCPA
> >>>>> files,
> >>>>>>>>>> the above directory also contains
> >>>>>>>>>> ccpa.t03z.03h.hrap.conus.gb2
> >>>>> (valid
> >>>>>>> at
> >>>>>>>>>> 03Z) and ccpa.t06z.03h.hrap.conus.gb2 (valid at 06Z). In
> >>>>>>>>>> that
> >> case i
> >>>>>>>>>> don't think the
> >>>>>>>>>>
> >>>>>>>>>>
> >>
ccpa.{valid?fmt=%Y%m%d}/{valid?fmt=%H}/ccpa.t{valid?fmt=%H}z.{level?fmt=%.2H}h.hrap.conus.gb2
> >>>>>>>>>> would work, would it?
> >>>>>>>>>>
> >>>>>>>>>> Thanks again,
> >>>>>>>>>>
> >>>>>>>>>> Ying
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>> On 3/6/19 10:29 AM, George McCabe via RT wrote:
> >>>>>>>>>>> Hi Ying Lin,
> >>>>>>>>>>>
> >>>>>>>>>>> You should be able to use a template that looks
something
> >>>>>>>>>>> like
> >>>>> this:
> >>
"ccpa.{valid?fmt=%Y%m%d}/06/ccpa.t{valid?fmt=%H}z.{level?fmt=%.2H}h.hrap.conus.gb2"
> >>>>>>>>>>> The 'level' item corresponds to the accumulation amount.
> >>>>>>>>>>> %.2H
> >>>>>>> specifies
> >>>>>>>>>>> that the filename has 2 digits of precision for that
value.
> >>>>>>>>>>> I
> >>>>> wasn't
> >>>>>>>>>> sure
> >>>>>>>>>>> what the '06' subdirectory corresponds to, but if
necessary
> >>>>>>>>>>> you
> >> can
> >>>>>>>>>>> substitute that with formatting so that it will be
dynamic.
> >>>>>>>>>>> Let
> >> me
> >>>>>>> know
> >>>>>>>>>> if
> >>>>>>>>>>> that doesn't work and I can help figure out what will.
> >>>>>>>>>>>
> >>>>>>>>>>> Thanks,
> >>>>>>>>>>> George
> >>>>>>>>>>>
> >>>>>>>>>>> On Mon, Feb 25, 2019 at 11:09 AM Ying Lin via RT <
> >>>>> met_help at ucar.edu>
> >>>>>>>>>> wrote:
> >>>>>>>>>>>> Mon Feb 25 11:08:35 2019: Request 89063 was acted upon.
> >>>>>>>>>>>> Transaction: Ticket created by ying.lin at noaa.gov
> >>>>>>>>>>>> Queue: met_help
> >>>>>>>>>>>> Subject: CCPA file name format for METplus
> >>>>>>>>>>>> Owner: Nobody
> >>>>>>>>>>>> Requestors: ying.lin at noaa.gov
> >>>>>>>>>>>> Status: new
> >>>>>>>>>>>> Ticket <URL:
> >>>>>>> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=89063
> >>>>>>>>>>>> Hello. I see that
> >>>>>>>>>>>>
> >>>>>>>>>>>>
> >>
https://github.com/NCAR/METplus/blob/master/parm/use_cases/grid_to_grid/examples/precip.conf
> >>>>>>>>>>>> has
> >>>>>>>>>>>> OBS_GRID_STAT_INPUT_TEMPLATE =
> >>>>>>> ccpa_conus_1.0d_{valid?fmt=%Y%m%d}
> >>>>>>>>>>>> CCPA output on wcoss has file names like
> >>>>>>>>>>>>
> >>>>> /com2/ccpa/prod/ccpa.20190224/06/ccpa.t03z.03h.hrap.conus.gb2
> >>>>>>>>>>>> which is 3h accumulation valid at 03Z 2019/02/24
> >>>>>>>>>>>> and ccpa.t06z.06h.hrap.conus.gb2
> >>>>>>>>>>>> which is 6h accumulation valid at 06Z 2019/02/24
> >>>>>>>>>>>>
> >>>>>>>>>>>> Does METplus already have the capability to handle the
> >>>>>>>>>>>> CCPA in
> >> its
> >>>>>>>>>>>> 'native' directory/name format, as in the /com2/*
> >>>>>>>>>>>> directory
> >> above?
> >>>>>>> In
> >>>>>>>>>>>> my verif scripts I do
> >>>>>>>>>>>> cp
$COMCCPA.$vday/06/ccpa.t03z.03h.hrap.conus.gb2
> >>>>>>>>>> ccpa.${vday}03.03h.gb2
> >>>>>>>>>>>> If METplus can already handle this bit of pre-
processing,
> >>>>>>>>>>>> or if
> >>>>> this
> >>>>>>>>>> can
> >>>>>>>>>>>> be added to the wish list, that'll be great. Thanks!
> >>>>>>>>>>>>
> >>>>>>>>>>>> Ying
> >>>>>>>>>>>>
> >>>>>>>>>>>> --
> >>>>>>>>>>>> Ying Lin
> >>>>>>>>>>>> NCEP/EMC/Verification, Post-processing and Product
> >>>>>>>>>>>> Generation
> >>>>> Branch
> >>>>>>>>>>>> NCWCP Cubicle No. 2015
> >>>>>>>>>>>> Ying.Lin at noaa.gov
> >>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>> --
> >>>>>>>>>> Ying Lin
> >>>>>>>>>> NCEP/EMC/Verification, Post-processing and Product
> >>>>>>>>>> Generation
> >> Branch
> >>>>>>>>>> NCWCP Cubicle No. 2015
> >>>>>>>>>> Ying.Lin at noaa.gov
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>> --
> >>>>>>> Ying Lin
> >>>>>>> NCEP/EMC/Verification, Post-processing and Product
Generation
> >>>>>>> Branch
> >>>>>>> NCWCP Cubicle No. 2015
> >>>>>>> Ying.Lin at noaa.gov
> >>>>>>>
> >>>>>>>
> >>>>>>>
> >>>>>>>
> >>>>> --
> >>>>> Ying Lin
> >>>>> NCEP/EMC/Verification, Post-processing and Product Generation
> >>>>> Branch
> >>>>> NCWCP Cubicle No. 2015
> >>>>> Ying.Lin at noaa.gov
> >>>>>
> >>>>>
> >>>>>
> >>>>>
> >> --
> >> Ying Lin
> >> NCEP/EMC/Verification, Post-processing and Product Generation
Branch
> >> NCWCP Cubicle No. 2015
> >> Ying.Lin at noaa.gov
> >>
> >>
> >>
> >>
------------------------------------------------
More information about the Met_help
mailing list