[Met_help] [rt.rap.ucar.edu #99708] History for Help with running TC Pairs with METplus wrappers on Jet
John Halley Gotway via RT
met_help at ucar.edu
Tue Apr 27 11:43:40 MDT 2021
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
I need to run TC Pairs with a-decks, b-decks, and e-decks so that I get
both TCMPR and PROBRIRW line types. I am able to run and get TCMPR line
types, but not TCMPR.
I am getting b-decks and e-decks from NHC off of our /public drive. I am
getting a-decks from Judy Henderson, which have been run through the GFDL
tracker and are in ATCF format.
I can run TC Pairs with a-decks and b-decks and get TCMPR data. I added an
e-deck, and got errors and no PROBRIRW output. I don't know if I can run
all 3 types of decks at once, or if this needs to be two separate jobs. I
think I have matching dates. I may have something set wrong in the config
files.
*** My loads:
module purge
module load intel
module load intelpython/3.6.5
module load netcdf/4.6.1
module load hdf5/1.10.4
module load nco/4.9.1
module load wgrib/1.8.1.0b
module load wgrib2/2.0.8
module load R/3.6.1
module load contrib
module use /contrib/met/modulefiles
module load met/9.1
module use /contrib/met/METplus/modulefiles
module load metplus/3.1.1
*** my_user_config.conf:
# This is a comment, comments are defined with a # at the beginning of the
line
# Set the MET_INSTALL_DIR to the location of the MET install
[dir]
MET_INSTALL_DIR = /contrib/met/9.1/met-9.1.1
MET_BIN_DIR = /contrib/met/9.1/met-9.1.1/src/tools/tc_utils/tc_pairs
# Set INPUT_BASE to the directory containing sample input data if running
use cases in the repository
# Otherwise set INPUT_BASE to any path that does not contain /path/to.
INPUT_BASE = /lfs1/BMC/amb-verif/vhtest
# Set OUTPUT_BASE to a directory where you have permission to write output
files
# It will be created if it does not exist
OUTPUT_BASE = /lfs1/BMC/amb-verif/vhtest/output
*** TCPairs_jet.conf:
#
# CONFIGURATION
#
[config]
# Looping by times: steps through each 'task' in the PROCESS_LIST for each
# defined time, and repeats until all times have been evaluated.
LOOP_ORDER = times
# Configuration files
TC_PAIRS_CONFIG_FILE = {PARM_BASE}/met_config/TCPairsConfig_wrapped
# 'Tasks' to be run
PROCESS_LIST = TCPairs
LOOP_BY = INIT
# The init time begin and end times, increment, and last init hour.
INIT_TIME_FMT = %Y%m%d%H
INIT_BEG = 2020072100
INIT_END = 2020072418
# This is the step-size. Increment in seconds from the begin time to the
end time
# set to 6 hours = 21600 seconds
INIT_INCREMENT = 21600
# A list of times to include, in format YYYYMMDD_hh
INIT_INCLUDE =
# A list of times to exclude, in format YYYYMMDD_hh
INIT_EXCLUDE =
#
# Specify model valid time window in format YYYYMM[DD[_hh]]. Only tracks
that fall within the valid time window will
# be used.
#
VALID_BEG =
VALID_END =
#
# Run MET tc_pairs by indicating the top-level directories for the A-deck
and B-deck files. Set to 'yes' to
# run using top-level directories, 'no' if you want to run tc_pairs on
files paired by the wrapper.
TC_PAIRS_READ_ALL_FILES = no
# set to true or yes to reformat track data into ATCF format expected by
tc_pairs
TC_PAIRS_REFORMAT_DECK = no
# OVERWRITE OPTIONS
# Don't overwrite filter files if they already exist.
# Set to yes if you do NOT want to override existing files
# Set to no if you do want to override existing files
TC_PAIRS_SKIP_IF_OUTPUT_EXISTS = no
#
# MET TC-Pairs
#
# List of models to be used (white space or comma separated) eg: DSHP,
LGEM, HWRF
# If no models are listed, then process all models in the input file(s).
MODEL =
# List of storm ids of interest (space or comma separated) e.g.: AL112012,
AL122012
# If no storm ids are listed, then process all storm ids in the input
file(s).
#TC_PAIRS_STORM_ID = ML2092014
#TC_PAIRS_STORM_ID = al062018, al092018, al132018, al142018
# Basins (of origin/region). Indicate with space or comma-separated list
of regions, eg. AL: for North Atlantic,
# WP: Western North Pacific, CP: Central North Pacific, SH: Southern
Hemisphere, IO: North Indian Ocean, LS: Southern
# Hemisphere
#TC_PAIRS_BASIN = AL
TC_PAIRS_BASIN =
# Cyclone, a space or comma-separated list of cyclone numbers. If left
empty, all cyclones will be used.
TC_PAIRS_CYCLONE =
#TC_PAIRS_CYCLONE = 06
# Storm name, a space or comma-separated list of storm names to evaluate. If
left empty, all storms will be used.
TC_PAIRS_STORM_NAME =
# DLAND file, the full path of the file that contains the gridded
representation of the
# minimum distance from land.
TC_PAIRS_DLAND_FILE = MET_BASE/tc_data/dland_global_tenth_degree.nc
#
# DIRECTORIES
#
[dir]
# Location of input track data directory
# for ADECK and BDECK data
TC_PAIRS_ADECK_INPUT_DIR = /lfs1/BMC/amb-verif/vhtest/adeck
TC_PAIRS_EDECK_INPUT_DIR = /lfs1/BMC/amb-verif/vhtest/edeck
TC_PAIRS_BDECK_INPUT_DIR = /lfs1/BMC/amb-verif/vhtest/bdeck
TC_PAIRS_OUTPUT_DIR = {OUTPUT_BASE}/tc_pairs
[filename_templates]
TC_PAIRS_ADECK_TEMPLATE = tctrk.atcf.{date?fmt=%Y%m%d%H}.gcp1.txt
TC_PAIRS_EDECK_TEMPLATE =
{date?fmt=%Y%m%d%H}.b{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
TC_PAIRS_BDECK_TEMPLATE =
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
TC_PAIRS_OUTPUT_TEMPLATE = tc_pairs_{basin?fmt=%s}{date?fmt=%Y%m%d%H}.dat
*** my input files:
adeck:
total 96
-rw-r--r-- 1 amb-verif amb-verif 20560 Apr 12 19:33
tctrk.atcf.2020072100.gcp1.txt
-rw-r--r-- 1 amb-verif amb-verif 39578 Apr 14 15:57
tctrk.atcf.2020072300.gcp1.txt
-rw-r--r-- 1 amb-verif amb-verif 30326 Apr 14 15:57
tctrk.atcf.2020072400.gcp1.txt
bdeck:
total 224
-rw-r--r-- 1 amb-verif amb-verif 997 Apr 12 19:32 2020051418.bal902020.dat
-rw-r--r-- 1 amb-verif amb-verif 1547 Apr 12 19:32 2020072100.bal902020.dat
-rw-r--r-- 1 amb-verif amb-verif 1547 Apr 12 19:32 2020072100.bal992020.dat
-rw-r--r-- 1 amb-verif amb-verif 3165 Apr 12 19:32 2020072100.bep072020.dat
-rw-r--r-- 1 amb-verif amb-verif 2447 Apr 12 19:32 2020072100.bep082020.dat
-rw-r--r-- 1 amb-verif amb-verif 1763 Apr 12 19:32 2020072106.bal992020.dat
-rw-r--r-- 1 amb-verif amb-verif 3381 Apr 12 19:32 2020072106.bep072020.dat
-rw-r--r-- 1 amb-verif amb-verif 2879 Apr 12 19:32 2020072106.bep082020.dat
-rw-r--r-- 1 amb-verif amb-verif 1979 Apr 12 19:32 2020072112.bal992020.dat
-rw-r--r-- 1 amb-verif amb-verif 3597 Apr 12 19:32 2020072112.bep072020.dat
-rw-r--r-- 1 amb-verif amb-verif 1980 Apr 12 19:32 2020072112.bep082020.dat
-rw-r--r-- 1 amb-verif amb-verif 2231 Apr 12 19:32 2020072118.bal072020.dat
-rw-r--r-- 1 amb-verif amb-verif 1115 Apr 12 19:32 2020072118.bal912020.dat
-rw-r--r-- 1 amb-verif amb-verif 2195 Apr 12 19:32 2020072118.bal992020.dat
-rw-r--r-- 1 amb-verif amb-verif 2412 Apr 12 19:32 2020072118.bep082020.dat
-rw-r--r-- 1 amb-verif amb-verif 2663 Jul 23 2020 2020072300.bal072020.dat
-rw-r--r-- 1 amb-verif amb-verif 2231 Jul 23 2020 2020072300.bal082020.dat
-rw-r--r-- 1 amb-verif amb-verif 2195 Jul 23 2020 2020072300.bal912020.dat
-rw-r--r-- 1 amb-verif amb-verif 5004 Jul 23 2020 2020072300.bep082020.dat
-rw-r--r-- 1 amb-verif amb-verif 3095 Jul 23 2020 2020072306.bal072020.dat
-rw-r--r-- 1 amb-verif amb-verif 2447 Jul 23 2020 2020072306.bal082020.dat
-rw-r--r-- 1 amb-verif amb-verif 5652 Jul 23 2020 2020072306.bep082020.dat
-rw-r--r-- 1 amb-verif amb-verif 3527 Jul 23 2020 2020072312.bal072020.dat
-rw-r--r-- 1 amb-verif amb-verif 2663 Jul 23 2020 2020072312.bal082020.dat
-rw-r--r-- 1 amb-verif amb-verif 6300 Jul 23 2020 2020072312.bep082020.dat
-rw-r--r-- 1 amb-verif amb-verif 3959 Jul 23 2020 2020072318.bal072020.dat
-rw-r--r-- 1 amb-verif amb-verif 2879 Jul 23 2020 2020072318.bal082020.dat
-rw-r--r-- 1 amb-verif amb-verif 6948 Jul 23 2020 2020072318.bep082020.dat
-rw-r--r-- 1 amb-verif amb-verif 4391 Jul 24 2020 2020072400.bal072020.dat
-rw-r--r-- 1 amb-verif amb-verif 3095 Jul 24 2020 2020072400.bal082020.dat
-rw-r--r-- 1 amb-verif amb-verif 7596 Jul 24 2020 2020072400.bep082020.dat
-rw-r--r-- 1 amb-verif amb-verif 4823 Jul 24 2020 2020072406.bal072020.dat
-rw-r--r-- 1 amb-verif amb-verif 3311 Jul 24 2020 2020072406.bal082020.dat
-rw-r--r-- 1 amb-verif amb-verif 8244 Jul 24 2020 2020072406.bep082020.dat
-rw-r--r-- 1 amb-verif amb-verif 5039 Jul 24 2020 2020072412.bal072020.dat
-rw-r--r-- 1 amb-verif amb-verif 2412 Jul 24 2020 2020072412.bal082020.dat
-rw-r--r-- 1 amb-verif amb-verif 8892 Jul 24 2020 2020072412.bep082020.dat
-rw-r--r-- 1 amb-verif amb-verif 5255 Jul 24 2020 2020072418.bal072020.dat
-rw-r--r-- 1 amb-verif amb-verif 2628 Jul 24 2020 2020072418.bal082020.dat
-rw-r--r-- 1 amb-verif amb-verif 1115 Jul 24 2020 2020072418.bal922020.dat
-rw-r--r-- 1 amb-verif amb-verif 9540 Jul 24 2020 2020072418.bep082020.dat
edeck:
total 124
-rw-r--r-- 1 amb-verif amb-verif 121621 Apr 23 20:44
2020072112.eep072020.dat
some of the data:
head -3 adeck/tctrk.atcf.2020072100.gcp1.txt
AL, 99, 2020072100, 03, GCP1, 000, 89N, 381W, 22, 1010, XX, 34, NEQ,
0000, 0000, 0000, 0000, -99, -99, 34, 0, 0, , 0, , 0, 0,
, , , , 0, 0, 0, 0, THERMO PARAMS,
-12, 225,
-30, N, 10, DT, -999
AL, 90, 2020072100, 03, GCP1, 000, 275N, 954W, 22, 1008, XX, 34, NEQ,
0000, 0000, 0000, 0000, -99, -99, 117, 0, 0, , 0, , 0, 0,
, , , , 0, 0, 0, 0, THERMO PARAMS, -31,
326, -226, N, 10, DT, -999
EP, 07, 2020072100, 03, GCP1, 000, 193N, 1318W, 38, 1007, XX, 34, NEQ,
0032, 0000, 0000, 0029, 1011, 52, 25, 0, 0, , 0, , 0, 0,
, , , , 0, 0, 0, 0, THERMO PARAMS,
34, 274,
378, Y, 10, DT, -999
head -3 bdeck/2020072112.bep082020.dat
EP, 08, 2020072000, , BEST, 0, 148N, 1188W, 25, 1008, LO, 0, ,
0, 0, 0, 0, 1011, 100, 40, 0, 0, E, 0, , 0, 0,
INVEST, S, 0, , 0, 0, 0, 0, genesis-num, 014,
EP, 08, 2020072006, , BEST, 0, 143N, 1192W, 25, 1008, LO, 0, ,
0, 0, 0, 0, 1011, 100, 30, 35, 0, E, 0, , 0, 0,
INVEST, M, 0, , 0, 0, 0, 0, genesis-num, 014,
EP, 08, 2020072012, , BEST, 0, 139N, 1194W, 30, 1008, TD, 0, ,
0, 0, 0, 0, 1011, 100, 30, 40, 0, E, 0, , 0, 0,
INVEST, M, 0, , 0, 0, 0, 0, genesis-num, 014,
TRANSITIONED, epB02020 to ep082020,
head -3 edeck/2020072112.eep072020.dat
EP, 07, 2020071206, GN, OFCL, 48, , , 0, 48, ESB, genFcst, , ,
0, 013,
EP, 07, 2020071206, GN, OFCL, 120, , , 0, 120, ESB, genFcst, , ,
0, 013,
EP, 07, 2020071206, GN, OFCL, 168, , , 10, 168, ESB, genFcst, , ,
0, 013,
*** metplus_final.conf:
[config]
CLOCK_TIME = 20210423205222
LOOP_ORDER = times
PROCESS_LIST = TCPairs
METPLUS_CONF = {OUTPUT_BASE}/metplus_final.conf
LOG_METPLUS =
/lfs1/BMC/amb-verif/vhtest/output/logs/master_metplus.log.20210423205222
LOG_TIMESTAMP_TEMPLATE = %Y%m%d%H%M%S
LOG_LINE_FORMAT = %(asctime)s.%(msecs)03d %(name)s
(%(filename)s:%(lineno)d) %(levelname)s: %(message)s
LOG_ERR_LINE_FORMAT = {LOG_LINE_FORMAT}
LOG_DEBUG_LINE_FORMAT = {LOG_LINE_FORMAT}
LOG_INFO_LINE_FORMAT = %(asctime)s.%(msecs)03d %(name)s %(levelname)s:
%(message)s
LOG_LINE_DATE_FORMAT = %m/%d %H:%M:%S
LOG_TIMESTAMP_USE_DATATIME = no
LOG_MET_OUTPUT_TO_METPLUS = yes
LOG_MET_VERBOSITY = 2
LOG_LEVEL = INFO
TC_PAIRS_CONFIG_FILE = {PARM_BASE}/met_config/TCPairsConfig_wrapped
LOOP_BY = INIT
INIT_TIME_FMT = %Y%m%d%H
INIT_BEG = 2020072100
INIT_END = 2020072418
INIT_INCREMENT = 21600
INIT_INCLUDE =
INIT_EXCLUDE =
VALID_BEG =
VALID_END =
TC_PAIRS_READ_ALL_FILES = no
TC_PAIRS_REFORMAT_DECK = no
TC_PAIRS_SKIP_IF_OUTPUT_EXISTS = no
MODEL =
TC_PAIRS_BASIN =
TC_PAIRS_CYCLONE =
TC_PAIRS_STORM_NAME =
TC_PAIRS_DLAND_FILE = MET_BASE/tc_data/dland_global_tenth_degree.nc
LOG_TIMESTAMP = 20210423205222
METPLUS_CONFIG_FILES = ./my_user_config.conf,./TCPairs_jet.conf
METPLUS_VERSION = 3.1.1
CURRENT_FCST_NAME =
CURRENT_OBS_NAME =
CURRENT_FCST_LEVEL =
CURRENT_OBS_LEVEL =
USER_SHELL = bash
DO_NOT_RUN_EXE = False
TC_PAIRS_SKIP_TIMES =
SKIP_TIMES =
USE_EXPLICIT_NAME_AND_LEVEL = False
LOG_TC_PAIRS_VERBOSITY = 2
TC_PAIRS_MISSING_VAL_TO_REPLACE = -99
TC_PAIRS_MISSING_VAL = -9999
TC_PAIRS_STORM_ID =
TC_PAIRS_SKIP_IF_REFORMAT_EXISTS = False
TC_PAIRS_REFORMAT_TYPE = SBU
SCRUB_STAGING_DIR = False
[dir]
OUTPUT_BASE = /lfs1/BMC/amb-verif/vhtest/output
STAGING_DIR = {OUTPUT_BASE}/stage
MET_INSTALL_DIR = /contrib/met/9.1/met-9.1.1
MET_BIN_DIR = /contrib/met/9.1/met-9.1.1/src/tools/tc_utils/tc_pairs
LOG_DIR = {OUTPUT_BASE}/logs
TMP_DIR = {OUTPUT_BASE}/tmp
INPUT_BASE = /lfs1/BMC/amb-verif/vhtest
TC_PAIRS_ADECK_INPUT_DIR = /lfs1/BMC/amb-verif/vhtest/adeck
TC_PAIRS_EDECK_INPUT_DIR = /lfs1/BMC/amb-verif/vhtest/edeck
TC_PAIRS_BDECK_INPUT_DIR = /lfs1/BMC/amb-verif/vhtest/bdeck
TC_PAIRS_OUTPUT_DIR = {OUTPUT_BASE}/tc_pairs
METPLUS_BASE = /contrib/met/METplus/METplus-3.1.1
PARM_BASE = /contrib/met/METplus/METplus-3.1.1/parm
TC_PAIRS_REFORMAT_DIR = /lfs1/BMC/amb-verif/vhtest/output/track_data_atcf
[exe]
RM = rm
CUT = cut
TR = tr
NCAP2 = ncap2
CONVERT = convert
NCDUMP = ncdump
[filename_templates]
TC_PAIRS_ADECK_TEMPLATE = tctrk.atcf.{date?fmt=%Y%m%d%H}.gcp1.txt
TC_PAIRS_EDECK_TEMPLATE =
{date?fmt=%Y%m%d%H}.b{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
TC_PAIRS_BDECK_TEMPLATE =
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
TC_PAIRS_OUTPUT_TEMPLATE = tc_pairs_{basin?fmt=%s}{date?fmt=%Y%m%d%H}.dat
[user_env_vars]
*** My Log:
04/23 20:52:22.576 metplus INFO: Running METplus v3.1.1 called with
command: /contrib/met/METplus/METplus-3.1.1/ush/master_metplus.py -c
./my_user_config.conf -c ./TCPairs_jet.conf
04/23 20:52:22.577 metplus INFO: Log file:
/lfs1/BMC/amb-verif/vhtest/output/logs/master_metplus.log.20210423205222
04/23 20:52:26.077 metplus INFO: ****************************************
04/23 20:52:26.077 metplus INFO: * Running METplus
04/23 20:52:26.077 metplus INFO: * at init time: 202007210000
04/23 20:52:26.077 metplus INFO: ****************************************
04/23 20:52:26.178 metplus.TCPairs (command_builder.py:122) ERROR:
(tc_pairs_wrapper.py:489) No BDECK files found searching for basin ?? and
cyclone * using template
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
04/23 20:52:26.179 metplus INFO: ****************************************
04/23 20:52:26.179 metplus INFO: * Running METplus
04/23 20:52:26.179 metplus INFO: * at init time: 202007210600
04/23 20:52:26.179 metplus INFO: ****************************************
04/23 20:52:26.181 metplus.TCPairs (command_builder.py:122) ERROR:
(tc_pairs_wrapper.py:489) No BDECK files found searching for basin ?? and
cyclone * using template
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
04/23 20:52:26.181 metplus INFO: ****************************************
04/23 20:52:26.181 metplus INFO: * Running METplus
04/23 20:52:26.181 metplus INFO: * at init time: 202007211200
04/23 20:52:26.181 metplus INFO: ****************************************
04/23 20:52:26.183 metplus.TCPairs (command_builder.py:122) ERROR:
(tc_pairs_wrapper.py:489) No BDECK files found searching for basin ?? and
cyclone * using template
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
04/23 20:52:26.183 metplus INFO: ****************************************
04/23 20:52:26.183 metplus INFO: * Running METplus
04/23 20:52:26.184 metplus INFO: * at init time: 202007211800
04/23 20:52:26.184 metplus INFO: ****************************************
04/23 20:52:26.185 metplus.TCPairs (command_builder.py:122) ERROR:
(tc_pairs_wrapper.py:489) No BDECK files found searching for basin ?? and
cyclone * using template
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
04/23 20:52:26.185 metplus INFO: ****************************************
04/23 20:52:26.186 metplus INFO: * Running METplus
04/23 20:52:26.186 metplus INFO: * at init time: 202007220000
04/23 20:52:26.186 metplus INFO: ****************************************
04/23 20:52:26.187 metplus.TCPairs (command_builder.py:122) ERROR:
(tc_pairs_wrapper.py:489) No BDECK files found searching for basin ?? and
cyclone * using template
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
04/23 20:52:26.188 metplus INFO: ****************************************
04/23 20:52:26.188 metplus INFO: * Running METplus
04/23 20:52:26.188 metplus INFO: * at init time: 202007220600
04/23 20:52:26.188 metplus INFO: ****************************************
04/23 20:52:26.190 metplus.TCPairs (command_builder.py:122) ERROR:
(tc_pairs_wrapper.py:489) No BDECK files found searching for basin ?? and
cyclone * using template
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
04/23 20:52:26.190 metplus INFO: ****************************************
04/23 20:52:26.190 metplus INFO: * Running METplus
04/23 20:52:26.190 metplus INFO: * at init time: 202007221200
04/23 20:52:26.190 metplus INFO: ****************************************
04/23 20:52:26.192 metplus.TCPairs (command_builder.py:122) ERROR:
(tc_pairs_wrapper.py:489) No BDECK files found searching for basin ?? and
cyclone * using template
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
04/23 20:52:26.192 metplus INFO: ****************************************
04/23 20:52:26.192 metplus INFO: * Running METplus
04/23 20:52:26.192 metplus INFO: * at init time: 202007221800
04/23 20:52:26.192 metplus INFO: ****************************************
04/23 20:52:26.194 metplus.TCPairs (command_builder.py:122) ERROR:
(tc_pairs_wrapper.py:489) No BDECK files found searching for basin ?? and
cyclone * using template
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
04/23 20:52:26.194 metplus INFO: ****************************************
04/23 20:52:26.194 metplus INFO: * Running METplus
04/23 20:52:26.194 metplus INFO: * at init time: 202007230000
04/23 20:52:26.194 metplus INFO: ****************************************
04/23 20:52:26.196 metplus.TCPairs (command_builder.py:122) ERROR:
(tc_pairs_wrapper.py:489) No BDECK files found searching for basin ?? and
cyclone * using template
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
04/23 20:52:26.196 metplus INFO: ****************************************
04/23 20:52:26.196 metplus INFO: * Running METplus
04/23 20:52:26.197 metplus INFO: * at init time: 202007230600
04/23 20:52:26.197 metplus INFO: ****************************************
04/23 20:52:26.198 metplus.TCPairs (command_builder.py:122) ERROR:
(tc_pairs_wrapper.py:489) No BDECK files found searching for basin ?? and
cyclone * using template
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
04/23 20:52:26.199 metplus INFO: ****************************************
04/23 20:52:26.199 metplus INFO: * Running METplus
04/23 20:52:26.199 metplus INFO: * at init time: 202007231200
04/23 20:52:26.199 metplus INFO: ****************************************
04/23 20:52:26.200 metplus.TCPairs (command_builder.py:122) ERROR:
(tc_pairs_wrapper.py:489) No BDECK files found searching for basin ?? and
cyclone * using template
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
04/23 20:52:26.201 metplus INFO: ****************************************
04/23 20:52:26.201 metplus INFO: * Running METplus
04/23 20:52:26.201 metplus INFO: * at init time: 202007231800
04/23 20:52:26.201 metplus INFO: ****************************************
04/23 20:52:26.203 metplus.TCPairs (command_builder.py:122) ERROR:
(tc_pairs_wrapper.py:489) No BDECK files found searching for basin ?? and
cyclone * using template
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
04/23 20:52:26.203 metplus INFO: ****************************************
04/23 20:52:26.203 metplus INFO: * Running METplus
04/23 20:52:26.203 metplus INFO: * at init time: 202007240000
04/23 20:52:26.203 metplus INFO: ****************************************
04/23 20:52:26.205 metplus.TCPairs (command_builder.py:122) ERROR:
(tc_pairs_wrapper.py:489) No BDECK files found searching for basin ?? and
cyclone * using template
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
04/23 20:52:26.205 metplus INFO: ****************************************
04/23 20:52:26.205 metplus INFO: * Running METplus
04/23 20:52:26.205 metplus INFO: * at init time: 202007240600
04/23 20:52:26.205 metplus INFO: ****************************************
04/23 20:52:26.207 metplus.TCPairs (command_builder.py:122) ERROR:
(tc_pairs_wrapper.py:489) No BDECK files found searching for basin ?? and
cyclone * using template
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
04/23 20:52:26.207 metplus INFO: ****************************************
04/23 20:52:26.207 metplus INFO: * Running METplus
04/23 20:52:26.207 metplus INFO: * at init time: 202007241200
04/23 20:52:26.208 metplus INFO: ****************************************
04/23 20:52:26.209 metplus.TCPairs (command_builder.py:122) ERROR:
(tc_pairs_wrapper.py:489) No BDECK files found searching for basin ?? and
cyclone * using template
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
04/23 20:52:26.209 metplus INFO: ****************************************
04/23 20:52:26.210 metplus INFO: * Running METplus
04/23 20:52:26.210 metplus INFO: * at init time: 202007241800
04/23 20:52:26.210 metplus INFO: ****************************************
04/23 20:52:26.211 metplus.TCPairs (command_builder.py:122) ERROR:
(tc_pairs_wrapper.py:489) No BDECK files found searching for basin ?? and
cyclone * using template
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
04/23 20:52:26.212 metplus.TCPairs (met_util.py:210) ERROR: TCPairs had 16
errors.
04/23 20:52:26.212 metplus INFO:
/lfs1/BMC/amb-verif/vhtest/output/metplus_final.conf: write metplus.conf
here
04/23 20:52:26.216 metplus (met_util.py:246) ERROR: METplus has finished
running but had 16 errors.
04/23 20:52:26.216 metplus INFO: Check the log file for more information:
/lfs1/BMC/amb-verif/vhtest/output/logs/master_metplus.log.20210423205222
Please let me know if you need additional information.
Thank you,
Venita
--
Venita Hagerty, PhD
Research Associate
CIRA at NOAA, GSL/AVID
2B152, x6098
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: Help with running TC Pairs with METplus wrappers on Jet
From: John Halley Gotway
Time: Mon Apr 26 09:36:19 2021
Hi Venita,
This is John HG... I'm on met-help desk on Mondays.
I see you're having trouble getting PROBRIRW output from TC-Pairs.
Thanks
for sending all the details about your runtime environment. There's
nothing
obvious off the bat that strikes me as a reason for not getting paired
output. If I have access to the machine on which you're running, I'll
just
log on and take a closer look. Ideally, I'd like to boil this down
to...
here's a single call to TC-Pairs that yields no PROBRIRW output lines
and
we think it should. And hopefully then we can figure out why it is
not!
I see all the path info, but don't actually see the machine name. I'm
guessing it's either Hera or Jet. Can you please confirm which?
FYI, I'm working on the beta5 release for MET today but should be able
to
look at this as well.
Thanks,
John
On Mon, Apr 26, 2021 at 8:44 AM venita.hagerty at noaa.gov via RT <
met_help at ucar.edu> wrote:
>
> Mon Apr 26 08:44:39 2021: Request 99708 was acted upon.
> Transaction: Ticket created by venita.hagerty at noaa.gov
> Queue: met_help
> Subject: Help with running TC Pairs with METplus wrappers on
Jet
> Owner: Nobody
> Requestors: venita.hagerty at noaa.gov
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99708 >
>
>
> I need to run TC Pairs with a-decks, b-decks, and e-decks so that I
get
> both TCMPR and PROBRIRW line types. I am able to run and get TCMPR
line
> types, but not TCMPR.
>
> I am getting b-decks and e-decks from NHC off of our /public drive.
I am
> getting a-decks from Judy Henderson, which have been run through the
GFDL
> tracker and are in ATCF format.
>
> I can run TC Pairs with a-decks and b-decks and get TCMPR data. I
added an
> e-deck, and got errors and no PROBRIRW output. I don't know if I can
run
> all 3 types of decks at once, or if this needs to be two separate
jobs. I
> think I have matching dates. I may have something set wrong in the
config
> files.
>
> *** My loads:
>
> module purge
>
> module load intel
>
> module load intelpython/3.6.5
>
> module load netcdf/4.6.1
>
> module load hdf5/1.10.4
>
> module load nco/4.9.1
>
> module load wgrib/1.8.1.0b
>
> module load wgrib2/2.0.8
>
> module load R/3.6.1
>
> module load contrib
>
> module use /contrib/met/modulefiles
>
> module load met/9.1
>
> module use /contrib/met/METplus/modulefiles
>
> module load metplus/3.1.1
>
>
> *** my_user_config.conf:
>
>
> # This is a comment, comments are defined with a # at the beginning
of the
> line
>
>
> # Set the MET_INSTALL_DIR to the location of the MET install
>
> [dir]
>
> MET_INSTALL_DIR = /contrib/met/9.1/met-9.1.1
>
> MET_BIN_DIR = /contrib/met/9.1/met-9.1.1/src/tools/tc_utils/tc_pairs
>
>
> # Set INPUT_BASE to the directory containing sample input data if
running
> use cases in the repository
>
> # Otherwise set INPUT_BASE to any path that does not contain
/path/to.
>
> INPUT_BASE = /lfs1/BMC/amb-verif/vhtest
>
>
> # Set OUTPUT_BASE to a directory where you have permission to write
output
> files
>
> # It will be created if it does not exist
>
> OUTPUT_BASE = /lfs1/BMC/amb-verif/vhtest/output
>
>
> *** TCPairs_jet.conf:
>
>
> #
>
> # CONFIGURATION
>
> #
>
> [config]
>
>
> # Looping by times: steps through each 'task' in the PROCESS_LIST
for each
>
> # defined time, and repeats until all times have been evaluated.
>
> LOOP_ORDER = times
>
>
> # Configuration files
>
> TC_PAIRS_CONFIG_FILE = {PARM_BASE}/met_config/TCPairsConfig_wrapped
>
>
> # 'Tasks' to be run
>
> PROCESS_LIST = TCPairs
>
>
> LOOP_BY = INIT
>
>
> # The init time begin and end times, increment, and last init hour.
>
> INIT_TIME_FMT = %Y%m%d%H
>
> INIT_BEG = 2020072100
>
> INIT_END = 2020072418
>
>
> # This is the step-size. Increment in seconds from the begin time to
the
> end time
>
> # set to 6 hours = 21600 seconds
>
> INIT_INCREMENT = 21600
>
>
> # A list of times to include, in format YYYYMMDD_hh
>
> INIT_INCLUDE =
>
>
> # A list of times to exclude, in format YYYYMMDD_hh
>
> INIT_EXCLUDE =
>
>
> #
>
> # Specify model valid time window in format YYYYMM[DD[_hh]]. Only
tracks
> that fall within the valid time window will
>
> # be used.
>
> #
>
> VALID_BEG =
>
> VALID_END =
>
>
> #
>
> # Run MET tc_pairs by indicating the top-level directories for the
A-deck
> and B-deck files. Set to 'yes' to
>
> # run using top-level directories, 'no' if you want to run tc_pairs
on
> files paired by the wrapper.
>
> TC_PAIRS_READ_ALL_FILES = no
>
>
> # set to true or yes to reformat track data into ATCF format
expected by
> tc_pairs
>
> TC_PAIRS_REFORMAT_DECK = no
>
>
> # OVERWRITE OPTIONS
>
> # Don't overwrite filter files if they already exist.
>
> # Set to yes if you do NOT want to override existing files
>
> # Set to no if you do want to override existing files
>
> TC_PAIRS_SKIP_IF_OUTPUT_EXISTS = no
>
>
> #
>
> # MET TC-Pairs
>
> #
>
> # List of models to be used (white space or comma separated) eg:
DSHP,
> LGEM, HWRF
>
> # If no models are listed, then process all models in the input
file(s).
>
> MODEL =
>
>
> # List of storm ids of interest (space or comma separated) e.g.:
AL112012,
> AL122012
>
> # If no storm ids are listed, then process all storm ids in the
input
> file(s).
>
> #TC_PAIRS_STORM_ID = ML2092014
>
> #TC_PAIRS_STORM_ID = al062018, al092018, al132018, al142018
>
>
> # Basins (of origin/region). Indicate with space or comma-separated
list
> of regions, eg. AL: for North Atlantic,
>
> # WP: Western North Pacific, CP: Central North Pacific, SH: Southern
> Hemisphere, IO: North Indian Ocean, LS: Southern
>
> # Hemisphere
>
> #TC_PAIRS_BASIN = AL
>
> TC_PAIRS_BASIN =
>
>
> # Cyclone, a space or comma-separated list of cyclone numbers. If
left
> empty, all cyclones will be used.
>
> TC_PAIRS_CYCLONE =
>
> #TC_PAIRS_CYCLONE = 06
>
>
> # Storm name, a space or comma-separated list of storm names to
evaluate.
> If
> left empty, all storms will be used.
>
> TC_PAIRS_STORM_NAME =
>
>
> # DLAND file, the full path of the file that contains the gridded
> representation of the
>
> # minimum distance from land.
>
> TC_PAIRS_DLAND_FILE = MET_BASE/tc_data/dland_global_tenth_degree.nc
>
>
>
> #
>
> # DIRECTORIES
>
> #
>
> [dir]
>
> # Location of input track data directory
>
> # for ADECK and BDECK data
>
> TC_PAIRS_ADECK_INPUT_DIR = /lfs1/BMC/amb-verif/vhtest/adeck
>
> TC_PAIRS_EDECK_INPUT_DIR = /lfs1/BMC/amb-verif/vhtest/edeck
>
> TC_PAIRS_BDECK_INPUT_DIR = /lfs1/BMC/amb-verif/vhtest/bdeck
>
>
> TC_PAIRS_OUTPUT_DIR = {OUTPUT_BASE}/tc_pairs
>
>
> [filename_templates]
>
> TC_PAIRS_ADECK_TEMPLATE = tctrk.atcf.{date?fmt=%Y%m%d%H}.gcp1.txt
>
> TC_PAIRS_EDECK_TEMPLATE =
> {date?fmt=%Y%m%d%H}.b{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
>
> TC_PAIRS_BDECK_TEMPLATE =
> {date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
>
> TC_PAIRS_OUTPUT_TEMPLATE =
tc_pairs_{basin?fmt=%s}{date?fmt=%Y%m%d%H}.dat
>
>
> *** my input files:
>
>
> adeck:
>
> total 96
>
> -rw-r--r-- 1 amb-verif amb-verif 20560 Apr 12 19:33
> tctrk.atcf.2020072100.gcp1.txt
>
> -rw-r--r-- 1 amb-verif amb-verif 39578 Apr 14 15:57
> tctrk.atcf.2020072300.gcp1.txt
>
> -rw-r--r-- 1 amb-verif amb-verif 30326 Apr 14 15:57
> tctrk.atcf.2020072400.gcp1.txt
>
>
> bdeck:
>
> total 224
>
> -rw-r--r-- 1 amb-verif amb-verif 997 Apr 12 19:32
2020051418.bal902020.dat
>
> -rw-r--r-- 1 amb-verif amb-verif 1547 Apr 12 19:32
2020072100.bal902020.dat
>
> -rw-r--r-- 1 amb-verif amb-verif 1547 Apr 12 19:32
2020072100.bal992020.dat
>
> -rw-r--r-- 1 amb-verif amb-verif 3165 Apr 12 19:32
2020072100.bep072020.dat
>
> -rw-r--r-- 1 amb-verif amb-verif 2447 Apr 12 19:32
2020072100.bep082020.dat
>
> -rw-r--r-- 1 amb-verif amb-verif 1763 Apr 12 19:32
2020072106.bal992020.dat
>
> -rw-r--r-- 1 amb-verif amb-verif 3381 Apr 12 19:32
2020072106.bep072020.dat
>
> -rw-r--r-- 1 amb-verif amb-verif 2879 Apr 12 19:32
2020072106.bep082020.dat
>
> -rw-r--r-- 1 amb-verif amb-verif 1979 Apr 12 19:32
2020072112.bal992020.dat
>
> -rw-r--r-- 1 amb-verif amb-verif 3597 Apr 12 19:32
2020072112.bep072020.dat
>
> -rw-r--r-- 1 amb-verif amb-verif 1980 Apr 12 19:32
2020072112.bep082020.dat
>
> -rw-r--r-- 1 amb-verif amb-verif 2231 Apr 12 19:32
2020072118.bal072020.dat
>
> -rw-r--r-- 1 amb-verif amb-verif 1115 Apr 12 19:32
2020072118.bal912020.dat
>
> -rw-r--r-- 1 amb-verif amb-verif 2195 Apr 12 19:32
2020072118.bal992020.dat
>
> -rw-r--r-- 1 amb-verif amb-verif 2412 Apr 12 19:32
2020072118.bep082020.dat
>
> -rw-r--r-- 1 amb-verif amb-verif 2663 Jul 23 2020
2020072300.bal072020.dat
>
> -rw-r--r-- 1 amb-verif amb-verif 2231 Jul 23 2020
2020072300.bal082020.dat
>
> -rw-r--r-- 1 amb-verif amb-verif 2195 Jul 23 2020
2020072300.bal912020.dat
>
> -rw-r--r-- 1 amb-verif amb-verif 5004 Jul 23 2020
2020072300.bep082020.dat
>
> -rw-r--r-- 1 amb-verif amb-verif 3095 Jul 23 2020
2020072306.bal072020.dat
>
> -rw-r--r-- 1 amb-verif amb-verif 2447 Jul 23 2020
2020072306.bal082020.dat
>
> -rw-r--r-- 1 amb-verif amb-verif 5652 Jul 23 2020
2020072306.bep082020.dat
>
> -rw-r--r-- 1 amb-verif amb-verif 3527 Jul 23 2020
2020072312.bal072020.dat
>
> -rw-r--r-- 1 amb-verif amb-verif 2663 Jul 23 2020
2020072312.bal082020.dat
>
> -rw-r--r-- 1 amb-verif amb-verif 6300 Jul 23 2020
2020072312.bep082020.dat
>
> -rw-r--r-- 1 amb-verif amb-verif 3959 Jul 23 2020
2020072318.bal072020.dat
>
> -rw-r--r-- 1 amb-verif amb-verif 2879 Jul 23 2020
2020072318.bal082020.dat
>
> -rw-r--r-- 1 amb-verif amb-verif 6948 Jul 23 2020
2020072318.bep082020.dat
>
> -rw-r--r-- 1 amb-verif amb-verif 4391 Jul 24 2020
2020072400.bal072020.dat
>
> -rw-r--r-- 1 amb-verif amb-verif 3095 Jul 24 2020
2020072400.bal082020.dat
>
> -rw-r--r-- 1 amb-verif amb-verif 7596 Jul 24 2020
2020072400.bep082020.dat
>
> -rw-r--r-- 1 amb-verif amb-verif 4823 Jul 24 2020
2020072406.bal072020.dat
>
> -rw-r--r-- 1 amb-verif amb-verif 3311 Jul 24 2020
2020072406.bal082020.dat
>
> -rw-r--r-- 1 amb-verif amb-verif 8244 Jul 24 2020
2020072406.bep082020.dat
>
> -rw-r--r-- 1 amb-verif amb-verif 5039 Jul 24 2020
2020072412.bal072020.dat
>
> -rw-r--r-- 1 amb-verif amb-verif 2412 Jul 24 2020
2020072412.bal082020.dat
>
> -rw-r--r-- 1 amb-verif amb-verif 8892 Jul 24 2020
2020072412.bep082020.dat
>
> -rw-r--r-- 1 amb-verif amb-verif 5255 Jul 24 2020
2020072418.bal072020.dat
>
> -rw-r--r-- 1 amb-verif amb-verif 2628 Jul 24 2020
2020072418.bal082020.dat
>
> -rw-r--r-- 1 amb-verif amb-verif 1115 Jul 24 2020
2020072418.bal922020.dat
>
> -rw-r--r-- 1 amb-verif amb-verif 9540 Jul 24 2020
2020072418.bep082020.dat
>
>
> edeck:
>
> total 124
>
> -rw-r--r-- 1 amb-verif amb-verif 121621 Apr 23 20:44
> 2020072112.eep072020.dat
>
>
> some of the data:
>
>
> head -3 adeck/tctrk.atcf.2020072100.gcp1.txt
>
> AL, 99, 2020072100, 03, GCP1, 000, 89N, 381W, 22, 1010, XX, 34,
NEQ,
> 0000, 0000, 0000, 0000, -99, -99, 34, 0, 0, , 0, ,
0, 0,
> , , , , 0, 0, 0, 0, THERMO PARAMS,
> -12, 225,
> -30, N, 10, DT, -999
>
> AL, 90, 2020072100, 03, GCP1, 000, 275N, 954W, 22, 1008, XX, 34,
NEQ,
> 0000, 0000, 0000, 0000, -99, -99, 117, 0, 0, , 0, ,
0, 0,
> , , , , 0, 0, 0, 0, THERMO PARAMS,
-31,
> 326, -226, N, 10, DT, -999
>
> EP, 07, 2020072100, 03, GCP1, 000, 193N, 1318W, 38, 1007, XX, 34,
NEQ,
> 0032, 0000, 0000, 0029, 1011, 52, 25, 0, 0, , 0, ,
0, 0,
> , , , , 0, 0, 0, 0, THERMO PARAMS,
> 34, 274,
> 378, Y, 10, DT, -999
>
>
> head -3 bdeck/2020072112.bep082020.dat
>
> EP, 08, 2020072000, , BEST, 0, 148N, 1188W, 25, 1008, LO, 0,
,
> 0, 0, 0, 0, 1011, 100, 40, 0, 0, E, 0, , 0,
0,
> INVEST, S, 0, , 0, 0, 0, 0, genesis-num, 014,
>
> EP, 08, 2020072006, , BEST, 0, 143N, 1192W, 25, 1008, LO, 0,
,
> 0, 0, 0, 0, 1011, 100, 30, 35, 0, E, 0, , 0,
0,
> INVEST, M, 0, , 0, 0, 0, 0, genesis-num, 014,
>
> EP, 08, 2020072012, , BEST, 0, 139N, 1194W, 30, 1008, TD, 0,
,
> 0, 0, 0, 0, 1011, 100, 30, 40, 0, E, 0, , 0,
0,
> INVEST, M, 0, , 0, 0, 0, 0, genesis-num, 014,
> TRANSITIONED, epB02020 to ep082020,
>
>
> head -3 edeck/2020072112.eep072020.dat
>
> EP, 07, 2020071206, GN, OFCL, 48, , , 0, 48, ESB,
genFcst, ,
> ,
> 0, 013,
>
> EP, 07, 2020071206, GN, OFCL, 120, , , 0, 120, ESB,
genFcst, ,
> ,
> 0, 013,
>
> EP, 07, 2020071206, GN, OFCL, 168, , , 10, 168, ESB,
genFcst, ,
> ,
> 0, 013,
>
>
> *** metplus_final.conf:
>
>
> [config]
>
> CLOCK_TIME = 20210423205222
>
> LOOP_ORDER = times
>
> PROCESS_LIST = TCPairs
>
> METPLUS_CONF = {OUTPUT_BASE}/metplus_final.conf
>
> LOG_METPLUS =
> /lfs1/BMC/amb-
verif/vhtest/output/logs/master_metplus.log.20210423205222
>
> LOG_TIMESTAMP_TEMPLATE = %Y%m%d%H%M%S
>
> LOG_LINE_FORMAT = %(asctime)s.%(msecs)03d %(name)s
> (%(filename)s:%(lineno)d) %(levelname)s: %(message)s
>
> LOG_ERR_LINE_FORMAT = {LOG_LINE_FORMAT}
>
> LOG_DEBUG_LINE_FORMAT = {LOG_LINE_FORMAT}
>
> LOG_INFO_LINE_FORMAT = %(asctime)s.%(msecs)03d %(name)s
%(levelname)s:
> %(message)s
>
> LOG_LINE_DATE_FORMAT = %m/%d %H:%M:%S
>
> LOG_TIMESTAMP_USE_DATATIME = no
>
> LOG_MET_OUTPUT_TO_METPLUS = yes
>
> LOG_MET_VERBOSITY = 2
>
> LOG_LEVEL = INFO
>
> TC_PAIRS_CONFIG_FILE = {PARM_BASE}/met_config/TCPairsConfig_wrapped
>
> LOOP_BY = INIT
>
> INIT_TIME_FMT = %Y%m%d%H
>
> INIT_BEG = 2020072100
>
> INIT_END = 2020072418
>
> INIT_INCREMENT = 21600
>
> INIT_INCLUDE =
>
> INIT_EXCLUDE =
>
> VALID_BEG =
>
> VALID_END =
>
> TC_PAIRS_READ_ALL_FILES = no
>
> TC_PAIRS_REFORMAT_DECK = no
>
> TC_PAIRS_SKIP_IF_OUTPUT_EXISTS = no
>
> MODEL =
>
> TC_PAIRS_BASIN =
>
> TC_PAIRS_CYCLONE =
>
> TC_PAIRS_STORM_NAME =
>
> TC_PAIRS_DLAND_FILE = MET_BASE/tc_data/dland_global_tenth_degree.nc
>
> LOG_TIMESTAMP = 20210423205222
>
> METPLUS_CONFIG_FILES = ./my_user_config.conf,./TCPairs_jet.conf
>
> METPLUS_VERSION = 3.1.1
>
> CURRENT_FCST_NAME =
>
> CURRENT_OBS_NAME =
>
> CURRENT_FCST_LEVEL =
>
> CURRENT_OBS_LEVEL =
>
> USER_SHELL = bash
>
> DO_NOT_RUN_EXE = False
>
> TC_PAIRS_SKIP_TIMES =
>
> SKIP_TIMES =
>
> USE_EXPLICIT_NAME_AND_LEVEL = False
>
> LOG_TC_PAIRS_VERBOSITY = 2
>
> TC_PAIRS_MISSING_VAL_TO_REPLACE = -99
>
> TC_PAIRS_MISSING_VAL = -9999
>
> TC_PAIRS_STORM_ID =
>
> TC_PAIRS_SKIP_IF_REFORMAT_EXISTS = False
>
> TC_PAIRS_REFORMAT_TYPE = SBU
>
> SCRUB_STAGING_DIR = False
>
>
> [dir]
>
> OUTPUT_BASE = /lfs1/BMC/amb-verif/vhtest/output
>
> STAGING_DIR = {OUTPUT_BASE}/stage
>
> MET_INSTALL_DIR = /contrib/met/9.1/met-9.1.1
>
> MET_BIN_DIR = /contrib/met/9.1/met-9.1.1/src/tools/tc_utils/tc_pairs
>
> LOG_DIR = {OUTPUT_BASE}/logs
>
> TMP_DIR = {OUTPUT_BASE}/tmp
>
> INPUT_BASE = /lfs1/BMC/amb-verif/vhtest
>
> TC_PAIRS_ADECK_INPUT_DIR = /lfs1/BMC/amb-verif/vhtest/adeck
>
> TC_PAIRS_EDECK_INPUT_DIR = /lfs1/BMC/amb-verif/vhtest/edeck
>
> TC_PAIRS_BDECK_INPUT_DIR = /lfs1/BMC/amb-verif/vhtest/bdeck
>
> TC_PAIRS_OUTPUT_DIR = {OUTPUT_BASE}/tc_pairs
>
> METPLUS_BASE = /contrib/met/METplus/METplus-3.1.1
>
> PARM_BASE = /contrib/met/METplus/METplus-3.1.1/parm
>
> TC_PAIRS_REFORMAT_DIR = /lfs1/BMC/amb-
verif/vhtest/output/track_data_atcf
>
>
> [exe]
>
> RM = rm
>
> CUT = cut
>
> TR = tr
>
> NCAP2 = ncap2
>
> CONVERT = convert
>
> NCDUMP = ncdump
>
>
> [filename_templates]
>
> TC_PAIRS_ADECK_TEMPLATE = tctrk.atcf.{date?fmt=%Y%m%d%H}.gcp1.txt
>
> TC_PAIRS_EDECK_TEMPLATE =
> {date?fmt=%Y%m%d%H}.b{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
>
> TC_PAIRS_BDECK_TEMPLATE =
> {date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
>
> TC_PAIRS_OUTPUT_TEMPLATE =
tc_pairs_{basin?fmt=%s}{date?fmt=%Y%m%d%H}.dat
>
>
> [user_env_vars]
>
>
> *** My Log:
>
>
> 04/23 20:52:22.576 metplus INFO: Running METplus v3.1.1 called with
> command: /contrib/met/METplus/METplus-3.1.1/ush/master_metplus.py -c
> ./my_user_config.conf -c ./TCPairs_jet.conf
>
> 04/23 20:52:22.577 metplus INFO: Log file:
> /lfs1/BMC/amb-
verif/vhtest/output/logs/master_metplus.log.20210423205222
>
> 04/23 20:52:26.077 metplus INFO:
****************************************
>
> 04/23 20:52:26.077 metplus INFO: * Running METplus
>
> 04/23 20:52:26.077 metplus INFO: * at init time: 202007210000
>
> 04/23 20:52:26.077 metplus INFO:
****************************************
>
> 04/23 20:52:26.178 metplus.TCPairs (command_builder.py:122) ERROR:
> (tc_pairs_wrapper.py:489) No BDECK files found searching for basin
?? and
> cyclone * using template
> {date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
>
> 04/23 20:52:26.179 metplus INFO:
****************************************
>
> 04/23 20:52:26.179 metplus INFO: * Running METplus
>
> 04/23 20:52:26.179 metplus INFO: * at init time: 202007210600
>
> 04/23 20:52:26.179 metplus INFO:
****************************************
>
> 04/23 20:52:26.181 metplus.TCPairs (command_builder.py:122) ERROR:
> (tc_pairs_wrapper.py:489) No BDECK files found searching for basin
?? and
> cyclone * using template
> {date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
>
> 04/23 20:52:26.181 metplus INFO:
****************************************
>
> 04/23 20:52:26.181 metplus INFO: * Running METplus
>
> 04/23 20:52:26.181 metplus INFO: * at init time: 202007211200
>
> 04/23 20:52:26.181 metplus INFO:
****************************************
>
> 04/23 20:52:26.183 metplus.TCPairs (command_builder.py:122) ERROR:
> (tc_pairs_wrapper.py:489) No BDECK files found searching for basin
?? and
> cyclone * using template
> {date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
>
> 04/23 20:52:26.183 metplus INFO:
****************************************
>
> 04/23 20:52:26.183 metplus INFO: * Running METplus
>
> 04/23 20:52:26.184 metplus INFO: * at init time: 202007211800
>
> 04/23 20:52:26.184 metplus INFO:
****************************************
>
> 04/23 20:52:26.185 metplus.TCPairs (command_builder.py:122) ERROR:
> (tc_pairs_wrapper.py:489) No BDECK files found searching for basin
?? and
> cyclone * using template
> {date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
>
> 04/23 20:52:26.185 metplus INFO:
****************************************
>
> 04/23 20:52:26.186 metplus INFO: * Running METplus
>
> 04/23 20:52:26.186 metplus INFO: * at init time: 202007220000
>
> 04/23 20:52:26.186 metplus INFO:
****************************************
>
> 04/23 20:52:26.187 metplus.TCPairs (command_builder.py:122) ERROR:
> (tc_pairs_wrapper.py:489) No BDECK files found searching for basin
?? and
> cyclone * using template
> {date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
>
> 04/23 20:52:26.188 metplus INFO:
****************************************
>
> 04/23 20:52:26.188 metplus INFO: * Running METplus
>
> 04/23 20:52:26.188 metplus INFO: * at init time: 202007220600
>
> 04/23 20:52:26.188 metplus INFO:
****************************************
>
> 04/23 20:52:26.190 metplus.TCPairs (command_builder.py:122) ERROR:
> (tc_pairs_wrapper.py:489) No BDECK files found searching for basin
?? and
> cyclone * using template
> {date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
>
> 04/23 20:52:26.190 metplus INFO:
****************************************
>
> 04/23 20:52:26.190 metplus INFO: * Running METplus
>
> 04/23 20:52:26.190 metplus INFO: * at init time: 202007221200
>
> 04/23 20:52:26.190 metplus INFO:
****************************************
>
> 04/23 20:52:26.192 metplus.TCPairs (command_builder.py:122) ERROR:
> (tc_pairs_wrapper.py:489) No BDECK files found searching for basin
?? and
> cyclone * using template
> {date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
>
> 04/23 20:52:26.192 metplus INFO:
****************************************
>
> 04/23 20:52:26.192 metplus INFO: * Running METplus
>
> 04/23 20:52:26.192 metplus INFO: * at init time: 202007221800
>
> 04/23 20:52:26.192 metplus INFO:
****************************************
>
> 04/23 20:52:26.194 metplus.TCPairs (command_builder.py:122) ERROR:
> (tc_pairs_wrapper.py:489) No BDECK files found searching for basin
?? and
> cyclone * using template
> {date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
>
> 04/23 20:52:26.194 metplus INFO:
****************************************
>
> 04/23 20:52:26.194 metplus INFO: * Running METplus
>
> 04/23 20:52:26.194 metplus INFO: * at init time: 202007230000
>
> 04/23 20:52:26.194 metplus INFO:
****************************************
>
> 04/23 20:52:26.196 metplus.TCPairs (command_builder.py:122) ERROR:
> (tc_pairs_wrapper.py:489) No BDECK files found searching for basin
?? and
> cyclone * using template
> {date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
>
> 04/23 20:52:26.196 metplus INFO:
****************************************
>
> 04/23 20:52:26.196 metplus INFO: * Running METplus
>
> 04/23 20:52:26.197 metplus INFO: * at init time: 202007230600
>
> 04/23 20:52:26.197 metplus INFO:
****************************************
>
> 04/23 20:52:26.198 metplus.TCPairs (command_builder.py:122) ERROR:
> (tc_pairs_wrapper.py:489) No BDECK files found searching for basin
?? and
> cyclone * using template
> {date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
>
> 04/23 20:52:26.199 metplus INFO:
****************************************
>
> 04/23 20:52:26.199 metplus INFO: * Running METplus
>
> 04/23 20:52:26.199 metplus INFO: * at init time: 202007231200
>
> 04/23 20:52:26.199 metplus INFO:
****************************************
>
> 04/23 20:52:26.200 metplus.TCPairs (command_builder.py:122) ERROR:
> (tc_pairs_wrapper.py:489) No BDECK files found searching for basin
?? and
> cyclone * using template
> {date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
>
> 04/23 20:52:26.201 metplus INFO:
****************************************
>
> 04/23 20:52:26.201 metplus INFO: * Running METplus
>
> 04/23 20:52:26.201 metplus INFO: * at init time: 202007231800
>
> 04/23 20:52:26.201 metplus INFO:
****************************************
>
> 04/23 20:52:26.203 metplus.TCPairs (command_builder.py:122) ERROR:
> (tc_pairs_wrapper.py:489) No BDECK files found searching for basin
?? and
> cyclone * using template
> {date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
>
> 04/23 20:52:26.203 metplus INFO:
****************************************
>
> 04/23 20:52:26.203 metplus INFO: * Running METplus
>
> 04/23 20:52:26.203 metplus INFO: * at init time: 202007240000
>
> 04/23 20:52:26.203 metplus INFO:
****************************************
>
> 04/23 20:52:26.205 metplus.TCPairs (command_builder.py:122) ERROR:
> (tc_pairs_wrapper.py:489) No BDECK files found searching for basin
?? and
> cyclone * using template
> {date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
>
> 04/23 20:52:26.205 metplus INFO:
****************************************
>
> 04/23 20:52:26.205 metplus INFO: * Running METplus
>
> 04/23 20:52:26.205 metplus INFO: * at init time: 202007240600
>
> 04/23 20:52:26.205 metplus INFO:
****************************************
>
> 04/23 20:52:26.207 metplus.TCPairs (command_builder.py:122) ERROR:
> (tc_pairs_wrapper.py:489) No BDECK files found searching for basin
?? and
> cyclone * using template
> {date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
>
> 04/23 20:52:26.207 metplus INFO:
****************************************
>
> 04/23 20:52:26.207 metplus INFO: * Running METplus
>
> 04/23 20:52:26.207 metplus INFO: * at init time: 202007241200
>
> 04/23 20:52:26.208 metplus INFO:
****************************************
>
> 04/23 20:52:26.209 metplus.TCPairs (command_builder.py:122) ERROR:
> (tc_pairs_wrapper.py:489) No BDECK files found searching for basin
?? and
> cyclone * using template
> {date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
>
> 04/23 20:52:26.209 metplus INFO:
****************************************
>
> 04/23 20:52:26.210 metplus INFO: * Running METplus
>
> 04/23 20:52:26.210 metplus INFO: * at init time: 202007241800
>
> 04/23 20:52:26.210 metplus INFO:
****************************************
>
> 04/23 20:52:26.211 metplus.TCPairs (command_builder.py:122) ERROR:
> (tc_pairs_wrapper.py:489) No BDECK files found searching for basin
?? and
> cyclone * using template
> {date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
>
> 04/23 20:52:26.212 metplus.TCPairs (met_util.py:210) ERROR: TCPairs
had 16
> errors.
>
> 04/23 20:52:26.212 metplus INFO:
> /lfs1/BMC/amb-verif/vhtest/output/metplus_final.conf: write
metplus.conf
> here
>
> 04/23 20:52:26.216 metplus (met_util.py:246) ERROR: METplus has
finished
> running but had 16 errors.
>
> 04/23 20:52:26.216 metplus INFO: Check the log file for more
information:
> /lfs1/BMC/amb-
verif/vhtest/output/logs/master_metplus.log.20210423205222
>
>
>
> Please let me know if you need additional information.
>
> Thank you,
> Venita
>
> --
> Venita Hagerty, PhD
> Research Associate
> CIRA at NOAA, GSL/AVID
> 2B152, x6098
>
>
------------------------------------------------
Subject: Help with running TC Pairs with METplus wrappers on Jet
From: venita.hagerty at noaa.gov
Time: Mon Apr 26 09:38:36 2021
I am working on Jet.
Venita
On Mon, Apr 26, 2021 at 9:36 AM John Halley Gotway via RT
<met_help at ucar.edu>
wrote:
> Hi Venita,
>
> This is John HG... I'm on met-help desk on Mondays.
>
> I see you're having trouble getting PROBRIRW output from TC-Pairs.
Thanks
> for sending all the details about your runtime environment. There's
nothing
> obvious off the bat that strikes me as a reason for not getting
paired
> output. If I have access to the machine on which you're running,
I'll just
> log on and take a closer look. Ideally, I'd like to boil this down
to...
> here's a single call to TC-Pairs that yields no PROBRIRW output
lines and
> we think it should. And hopefully then we can figure out why it is
not!
>
> I see all the path info, but don't actually see the machine name.
I'm
> guessing it's either Hera or Jet. Can you please confirm which?
>
> FYI, I'm working on the beta5 release for MET today but should be
able to
> look at this as well.
>
> Thanks,
> John
>
> On Mon, Apr 26, 2021 at 8:44 AM venita.hagerty at noaa.gov via RT <
> met_help at ucar.edu> wrote:
>
> >
> > Mon Apr 26 08:44:39 2021: Request 99708 was acted upon.
> > Transaction: Ticket created by venita.hagerty at noaa.gov
> > Queue: met_help
> > Subject: Help with running TC Pairs with METplus wrappers on
Jet
> > Owner: Nobody
> > Requestors: venita.hagerty at noaa.gov
> > Status: new
> > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99708 >
> >
> >
> > I need to run TC Pairs with a-decks, b-decks, and e-decks so that
I get
> > both TCMPR and PROBRIRW line types. I am able to run and get TCMPR
line
> > types, but not TCMPR.
> >
> > I am getting b-decks and e-decks from NHC off of our /public
drive. I am
> > getting a-decks from Judy Henderson, which have been run through
the GFDL
> > tracker and are in ATCF format.
> >
> > I can run TC Pairs with a-decks and b-decks and get TCMPR data. I
added
> an
> > e-deck, and got errors and no PROBRIRW output. I don't know if I
can run
> > all 3 types of decks at once, or if this needs to be two separate
jobs. I
> > think I have matching dates. I may have something set wrong in the
config
> > files.
> >
> > *** My loads:
> >
> > module purge
> >
> > module load intel
> >
> > module load intelpython/3.6.5
> >
> > module load netcdf/4.6.1
> >
> > module load hdf5/1.10.4
> >
> > module load nco/4.9.1
> >
> > module load wgrib/1.8.1.0b
> >
> > module load wgrib2/2.0.8
> >
> > module load R/3.6.1
> >
> > module load contrib
> >
> > module use /contrib/met/modulefiles
> >
> > module load met/9.1
> >
> > module use /contrib/met/METplus/modulefiles
> >
> > module load metplus/3.1.1
> >
> >
> > *** my_user_config.conf:
> >
> >
> > # This is a comment, comments are defined with a # at the
beginning of
> the
> > line
> >
> >
> > # Set the MET_INSTALL_DIR to the location of the MET install
> >
> > [dir]
> >
> > MET_INSTALL_DIR = /contrib/met/9.1/met-9.1.1
> >
> > MET_BIN_DIR = /contrib/met/9.1/met-
9.1.1/src/tools/tc_utils/tc_pairs
> >
> >
> > # Set INPUT_BASE to the directory containing sample input data if
running
> > use cases in the repository
> >
> > # Otherwise set INPUT_BASE to any path that does not contain
/path/to.
> >
> > INPUT_BASE = /lfs1/BMC/amb-verif/vhtest
> >
> >
> > # Set OUTPUT_BASE to a directory where you have permission to
write
> output
> > files
> >
> > # It will be created if it does not exist
> >
> > OUTPUT_BASE = /lfs1/BMC/amb-verif/vhtest/output
> >
> >
> > *** TCPairs_jet.conf:
> >
> >
> > #
> >
> > # CONFIGURATION
> >
> > #
> >
> > [config]
> >
> >
> > # Looping by times: steps through each 'task' in the PROCESS_LIST
for
> each
> >
> > # defined time, and repeats until all times have been evaluated.
> >
> > LOOP_ORDER = times
> >
> >
> > # Configuration files
> >
> > TC_PAIRS_CONFIG_FILE =
{PARM_BASE}/met_config/TCPairsConfig_wrapped
> >
> >
> > # 'Tasks' to be run
> >
> > PROCESS_LIST = TCPairs
> >
> >
> > LOOP_BY = INIT
> >
> >
> > # The init time begin and end times, increment, and last init
hour.
> >
> > INIT_TIME_FMT = %Y%m%d%H
> >
> > INIT_BEG = 2020072100
> >
> > INIT_END = 2020072418
> >
> >
> > # This is the step-size. Increment in seconds from the begin time
to the
> > end time
> >
> > # set to 6 hours = 21600 seconds
> >
> > INIT_INCREMENT = 21600
> >
> >
> > # A list of times to include, in format YYYYMMDD_hh
> >
> > INIT_INCLUDE =
> >
> >
> > # A list of times to exclude, in format YYYYMMDD_hh
> >
> > INIT_EXCLUDE =
> >
> >
> > #
> >
> > # Specify model valid time window in format YYYYMM[DD[_hh]]. Only
tracks
> > that fall within the valid time window will
> >
> > # be used.
> >
> > #
> >
> > VALID_BEG =
> >
> > VALID_END =
> >
> >
> > #
> >
> > # Run MET tc_pairs by indicating the top-level directories for the
A-deck
> > and B-deck files. Set to 'yes' to
> >
> > # run using top-level directories, 'no' if you want to run
tc_pairs on
> > files paired by the wrapper.
> >
> > TC_PAIRS_READ_ALL_FILES = no
> >
> >
> > # set to true or yes to reformat track data into ATCF format
expected by
> > tc_pairs
> >
> > TC_PAIRS_REFORMAT_DECK = no
> >
> >
> > # OVERWRITE OPTIONS
> >
> > # Don't overwrite filter files if they already exist.
> >
> > # Set to yes if you do NOT want to override existing files
> >
> > # Set to no if you do want to override existing files
> >
> > TC_PAIRS_SKIP_IF_OUTPUT_EXISTS = no
> >
> >
> > #
> >
> > # MET TC-Pairs
> >
> > #
> >
> > # List of models to be used (white space or comma separated) eg:
DSHP,
> > LGEM, HWRF
> >
> > # If no models are listed, then process all models in the input
file(s).
> >
> > MODEL =
> >
> >
> > # List of storm ids of interest (space or comma separated) e.g.:
> AL112012,
> > AL122012
> >
> > # If no storm ids are listed, then process all storm ids in the
input
> > file(s).
> >
> > #TC_PAIRS_STORM_ID = ML2092014
> >
> > #TC_PAIRS_STORM_ID = al062018, al092018, al132018, al142018
> >
> >
> > # Basins (of origin/region). Indicate with space or comma-
separated list
> > of regions, eg. AL: for North Atlantic,
> >
> > # WP: Western North Pacific, CP: Central North Pacific, SH:
Southern
> > Hemisphere, IO: North Indian Ocean, LS: Southern
> >
> > # Hemisphere
> >
> > #TC_PAIRS_BASIN = AL
> >
> > TC_PAIRS_BASIN =
> >
> >
> > # Cyclone, a space or comma-separated list of cyclone numbers. If
left
> > empty, all cyclones will be used.
> >
> > TC_PAIRS_CYCLONE =
> >
> > #TC_PAIRS_CYCLONE = 06
> >
> >
> > # Storm name, a space or comma-separated list of storm names to
evaluate.
> > If
> > left empty, all storms will be used.
> >
> > TC_PAIRS_STORM_NAME =
> >
> >
> > # DLAND file, the full path of the file that contains the gridded
> > representation of the
> >
> > # minimum distance from land.
> >
> > TC_PAIRS_DLAND_FILE =
MET_BASE/tc_data/dland_global_tenth_degree.nc
> >
> >
> >
> > #
> >
> > # DIRECTORIES
> >
> > #
> >
> > [dir]
> >
> > # Location of input track data directory
> >
> > # for ADECK and BDECK data
> >
> > TC_PAIRS_ADECK_INPUT_DIR = /lfs1/BMC/amb-verif/vhtest/adeck
> >
> > TC_PAIRS_EDECK_INPUT_DIR = /lfs1/BMC/amb-verif/vhtest/edeck
> >
> > TC_PAIRS_BDECK_INPUT_DIR = /lfs1/BMC/amb-verif/vhtest/bdeck
> >
> >
> > TC_PAIRS_OUTPUT_DIR = {OUTPUT_BASE}/tc_pairs
> >
> >
> > [filename_templates]
> >
> > TC_PAIRS_ADECK_TEMPLATE = tctrk.atcf.{date?fmt=%Y%m%d%H}.gcp1.txt
> >
> > TC_PAIRS_EDECK_TEMPLATE =
> >
{date?fmt=%Y%m%d%H}.b{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> >
> > TC_PAIRS_BDECK_TEMPLATE =
> >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> >
> > TC_PAIRS_OUTPUT_TEMPLATE =
tc_pairs_{basin?fmt=%s}{date?fmt=%Y%m%d%H}.dat
> >
> >
> > *** my input files:
> >
> >
> > adeck:
> >
> > total 96
> >
> > -rw-r--r-- 1 amb-verif amb-verif 20560 Apr 12 19:33
> > tctrk.atcf.2020072100.gcp1.txt
> >
> > -rw-r--r-- 1 amb-verif amb-verif 39578 Apr 14 15:57
> > tctrk.atcf.2020072300.gcp1.txt
> >
> > -rw-r--r-- 1 amb-verif amb-verif 30326 Apr 14 15:57
> > tctrk.atcf.2020072400.gcp1.txt
> >
> >
> > bdeck:
> >
> > total 224
> >
> > -rw-r--r-- 1 amb-verif amb-verif 997 Apr 12 19:32
> 2020051418.bal902020.dat
> >
> > -rw-r--r-- 1 amb-verif amb-verif 1547 Apr 12 19:32
> 2020072100.bal902020.dat
> >
> > -rw-r--r-- 1 amb-verif amb-verif 1547 Apr 12 19:32
> 2020072100.bal992020.dat
> >
> > -rw-r--r-- 1 amb-verif amb-verif 3165 Apr 12 19:32
> 2020072100.bep072020.dat
> >
> > -rw-r--r-- 1 amb-verif amb-verif 2447 Apr 12 19:32
> 2020072100.bep082020.dat
> >
> > -rw-r--r-- 1 amb-verif amb-verif 1763 Apr 12 19:32
> 2020072106.bal992020.dat
> >
> > -rw-r--r-- 1 amb-verif amb-verif 3381 Apr 12 19:32
> 2020072106.bep072020.dat
> >
> > -rw-r--r-- 1 amb-verif amb-verif 2879 Apr 12 19:32
> 2020072106.bep082020.dat
> >
> > -rw-r--r-- 1 amb-verif amb-verif 1979 Apr 12 19:32
> 2020072112.bal992020.dat
> >
> > -rw-r--r-- 1 amb-verif amb-verif 3597 Apr 12 19:32
> 2020072112.bep072020.dat
> >
> > -rw-r--r-- 1 amb-verif amb-verif 1980 Apr 12 19:32
> 2020072112.bep082020.dat
> >
> > -rw-r--r-- 1 amb-verif amb-verif 2231 Apr 12 19:32
> 2020072118.bal072020.dat
> >
> > -rw-r--r-- 1 amb-verif amb-verif 1115 Apr 12 19:32
> 2020072118.bal912020.dat
> >
> > -rw-r--r-- 1 amb-verif amb-verif 2195 Apr 12 19:32
> 2020072118.bal992020.dat
> >
> > -rw-r--r-- 1 amb-verif amb-verif 2412 Apr 12 19:32
> 2020072118.bep082020.dat
> >
> > -rw-r--r-- 1 amb-verif amb-verif 2663 Jul 23 2020
> 2020072300.bal072020.dat
> >
> > -rw-r--r-- 1 amb-verif amb-verif 2231 Jul 23 2020
> 2020072300.bal082020.dat
> >
> > -rw-r--r-- 1 amb-verif amb-verif 2195 Jul 23 2020
> 2020072300.bal912020.dat
> >
> > -rw-r--r-- 1 amb-verif amb-verif 5004 Jul 23 2020
> 2020072300.bep082020.dat
> >
> > -rw-r--r-- 1 amb-verif amb-verif 3095 Jul 23 2020
> 2020072306.bal072020.dat
> >
> > -rw-r--r-- 1 amb-verif amb-verif 2447 Jul 23 2020
> 2020072306.bal082020.dat
> >
> > -rw-r--r-- 1 amb-verif amb-verif 5652 Jul 23 2020
> 2020072306.bep082020.dat
> >
> > -rw-r--r-- 1 amb-verif amb-verif 3527 Jul 23 2020
> 2020072312.bal072020.dat
> >
> > -rw-r--r-- 1 amb-verif amb-verif 2663 Jul 23 2020
> 2020072312.bal082020.dat
> >
> > -rw-r--r-- 1 amb-verif amb-verif 6300 Jul 23 2020
> 2020072312.bep082020.dat
> >
> > -rw-r--r-- 1 amb-verif amb-verif 3959 Jul 23 2020
> 2020072318.bal072020.dat
> >
> > -rw-r--r-- 1 amb-verif amb-verif 2879 Jul 23 2020
> 2020072318.bal082020.dat
> >
> > -rw-r--r-- 1 amb-verif amb-verif 6948 Jul 23 2020
> 2020072318.bep082020.dat
> >
> > -rw-r--r-- 1 amb-verif amb-verif 4391 Jul 24 2020
> 2020072400.bal072020.dat
> >
> > -rw-r--r-- 1 amb-verif amb-verif 3095 Jul 24 2020
> 2020072400.bal082020.dat
> >
> > -rw-r--r-- 1 amb-verif amb-verif 7596 Jul 24 2020
> 2020072400.bep082020.dat
> >
> > -rw-r--r-- 1 amb-verif amb-verif 4823 Jul 24 2020
> 2020072406.bal072020.dat
> >
> > -rw-r--r-- 1 amb-verif amb-verif 3311 Jul 24 2020
> 2020072406.bal082020.dat
> >
> > -rw-r--r-- 1 amb-verif amb-verif 8244 Jul 24 2020
> 2020072406.bep082020.dat
> >
> > -rw-r--r-- 1 amb-verif amb-verif 5039 Jul 24 2020
> 2020072412.bal072020.dat
> >
> > -rw-r--r-- 1 amb-verif amb-verif 2412 Jul 24 2020
> 2020072412.bal082020.dat
> >
> > -rw-r--r-- 1 amb-verif amb-verif 8892 Jul 24 2020
> 2020072412.bep082020.dat
> >
> > -rw-r--r-- 1 amb-verif amb-verif 5255 Jul 24 2020
> 2020072418.bal072020.dat
> >
> > -rw-r--r-- 1 amb-verif amb-verif 2628 Jul 24 2020
> 2020072418.bal082020.dat
> >
> > -rw-r--r-- 1 amb-verif amb-verif 1115 Jul 24 2020
> 2020072418.bal922020.dat
> >
> > -rw-r--r-- 1 amb-verif amb-verif 9540 Jul 24 2020
> 2020072418.bep082020.dat
> >
> >
> > edeck:
> >
> > total 124
> >
> > -rw-r--r-- 1 amb-verif amb-verif 121621 Apr 23 20:44
> > 2020072112.eep072020.dat
> >
> >
> > some of the data:
> >
> >
> > head -3 adeck/tctrk.atcf.2020072100.gcp1.txt
> >
> > AL, 99, 2020072100, 03, GCP1, 000, 89N, 381W, 22, 1010, XX,
34, NEQ,
> > 0000, 0000, 0000, 0000, -99, -99, 34, 0, 0, , 0, ,
0,
> 0,
> > , , , , 0, 0, 0, 0, THERMO PARAMS,
> > -12, 225,
> > -30, N, 10, DT, -999
> >
> > AL, 90, 2020072100, 03, GCP1, 000, 275N, 954W, 22, 1008, XX,
34, NEQ,
> > 0000, 0000, 0000, 0000, -99, -99, 117, 0, 0, , 0, ,
0,
> 0,
> > , , , , 0, 0, 0, 0, THERMO PARAMS,
-31,
> > 326, -226, N, 10, DT, -999
> >
> > EP, 07, 2020072100, 03, GCP1, 000, 193N, 1318W, 38, 1007, XX,
34, NEQ,
> > 0032, 0000, 0000, 0029, 1011, 52, 25, 0, 0, , 0, ,
0,
> 0,
> > , , , , 0, 0, 0, 0, THERMO PARAMS,
> > 34, 274,
> > 378, Y, 10, DT, -999
> >
> >
> > head -3 bdeck/2020072112.bep082020.dat
> >
> > EP, 08, 2020072000, , BEST, 0, 148N, 1188W, 25, 1008, LO,
0, ,
> > 0, 0, 0, 0, 1011, 100, 40, 0, 0, E, 0, ,
0, 0,
> > INVEST, S, 0, , 0, 0, 0, 0, genesis-num, 014,
> >
> > EP, 08, 2020072006, , BEST, 0, 143N, 1192W, 25, 1008, LO,
0, ,
> > 0, 0, 0, 0, 1011, 100, 30, 35, 0, E, 0, ,
0, 0,
> > INVEST, M, 0, , 0, 0, 0, 0, genesis-num, 014,
> >
> > EP, 08, 2020072012, , BEST, 0, 139N, 1194W, 30, 1008, TD,
0, ,
> > 0, 0, 0, 0, 1011, 100, 30, 40, 0, E, 0, ,
0, 0,
> > INVEST, M, 0, , 0, 0, 0, 0, genesis-num, 014,
> > TRANSITIONED, epB02020 to ep082020,
> >
> >
> > head -3 edeck/2020072112.eep072020.dat
> >
> > EP, 07, 2020071206, GN, OFCL, 48, , , 0, 48, ESB,
genFcst,
> ,
> > ,
> > 0, 013,
> >
> > EP, 07, 2020071206, GN, OFCL, 120, , , 0, 120, ESB,
genFcst,
> ,
> > ,
> > 0, 013,
> >
> > EP, 07, 2020071206, GN, OFCL, 168, , , 10, 168, ESB,
genFcst,
> ,
> > ,
> > 0, 013,
> >
> >
> > *** metplus_final.conf:
> >
> >
> > [config]
> >
> > CLOCK_TIME = 20210423205222
> >
> > LOOP_ORDER = times
> >
> > PROCESS_LIST = TCPairs
> >
> > METPLUS_CONF = {OUTPUT_BASE}/metplus_final.conf
> >
> > LOG_METPLUS =
> > /lfs1/BMC/amb-
verif/vhtest/output/logs/master_metplus.log.20210423205222
> >
> > LOG_TIMESTAMP_TEMPLATE = %Y%m%d%H%M%S
> >
> > LOG_LINE_FORMAT = %(asctime)s.%(msecs)03d %(name)s
> > (%(filename)s:%(lineno)d) %(levelname)s: %(message)s
> >
> > LOG_ERR_LINE_FORMAT = {LOG_LINE_FORMAT}
> >
> > LOG_DEBUG_LINE_FORMAT = {LOG_LINE_FORMAT}
> >
> > LOG_INFO_LINE_FORMAT = %(asctime)s.%(msecs)03d %(name)s
%(levelname)s:
> > %(message)s
> >
> > LOG_LINE_DATE_FORMAT = %m/%d %H:%M:%S
> >
> > LOG_TIMESTAMP_USE_DATATIME = no
> >
> > LOG_MET_OUTPUT_TO_METPLUS = yes
> >
> > LOG_MET_VERBOSITY = 2
> >
> > LOG_LEVEL = INFO
> >
> > TC_PAIRS_CONFIG_FILE =
{PARM_BASE}/met_config/TCPairsConfig_wrapped
> >
> > LOOP_BY = INIT
> >
> > INIT_TIME_FMT = %Y%m%d%H
> >
> > INIT_BEG = 2020072100
> >
> > INIT_END = 2020072418
> >
> > INIT_INCREMENT = 21600
> >
> > INIT_INCLUDE =
> >
> > INIT_EXCLUDE =
> >
> > VALID_BEG =
> >
> > VALID_END =
> >
> > TC_PAIRS_READ_ALL_FILES = no
> >
> > TC_PAIRS_REFORMAT_DECK = no
> >
> > TC_PAIRS_SKIP_IF_OUTPUT_EXISTS = no
> >
> > MODEL =
> >
> > TC_PAIRS_BASIN =
> >
> > TC_PAIRS_CYCLONE =
> >
> > TC_PAIRS_STORM_NAME =
> >
> > TC_PAIRS_DLAND_FILE =
MET_BASE/tc_data/dland_global_tenth_degree.nc
> >
> > LOG_TIMESTAMP = 20210423205222
> >
> > METPLUS_CONFIG_FILES = ./my_user_config.conf,./TCPairs_jet.conf
> >
> > METPLUS_VERSION = 3.1.1
> >
> > CURRENT_FCST_NAME =
> >
> > CURRENT_OBS_NAME =
> >
> > CURRENT_FCST_LEVEL =
> >
> > CURRENT_OBS_LEVEL =
> >
> > USER_SHELL = bash
> >
> > DO_NOT_RUN_EXE = False
> >
> > TC_PAIRS_SKIP_TIMES =
> >
> > SKIP_TIMES =
> >
> > USE_EXPLICIT_NAME_AND_LEVEL = False
> >
> > LOG_TC_PAIRS_VERBOSITY = 2
> >
> > TC_PAIRS_MISSING_VAL_TO_REPLACE = -99
> >
> > TC_PAIRS_MISSING_VAL = -9999
> >
> > TC_PAIRS_STORM_ID =
> >
> > TC_PAIRS_SKIP_IF_REFORMAT_EXISTS = False
> >
> > TC_PAIRS_REFORMAT_TYPE = SBU
> >
> > SCRUB_STAGING_DIR = False
> >
> >
> > [dir]
> >
> > OUTPUT_BASE = /lfs1/BMC/amb-verif/vhtest/output
> >
> > STAGING_DIR = {OUTPUT_BASE}/stage
> >
> > MET_INSTALL_DIR = /contrib/met/9.1/met-9.1.1
> >
> > MET_BIN_DIR = /contrib/met/9.1/met-
9.1.1/src/tools/tc_utils/tc_pairs
> >
> > LOG_DIR = {OUTPUT_BASE}/logs
> >
> > TMP_DIR = {OUTPUT_BASE}/tmp
> >
> > INPUT_BASE = /lfs1/BMC/amb-verif/vhtest
> >
> > TC_PAIRS_ADECK_INPUT_DIR = /lfs1/BMC/amb-verif/vhtest/adeck
> >
> > TC_PAIRS_EDECK_INPUT_DIR = /lfs1/BMC/amb-verif/vhtest/edeck
> >
> > TC_PAIRS_BDECK_INPUT_DIR = /lfs1/BMC/amb-verif/vhtest/bdeck
> >
> > TC_PAIRS_OUTPUT_DIR = {OUTPUT_BASE}/tc_pairs
> >
> > METPLUS_BASE = /contrib/met/METplus/METplus-3.1.1
> >
> > PARM_BASE = /contrib/met/METplus/METplus-3.1.1/parm
> >
> > TC_PAIRS_REFORMAT_DIR = /lfs1/BMC/amb-
verif/vhtest/output/track_data_atcf
> >
> >
> > [exe]
> >
> > RM = rm
> >
> > CUT = cut
> >
> > TR = tr
> >
> > NCAP2 = ncap2
> >
> > CONVERT = convert
> >
> > NCDUMP = ncdump
> >
> >
> > [filename_templates]
> >
> > TC_PAIRS_ADECK_TEMPLATE = tctrk.atcf.{date?fmt=%Y%m%d%H}.gcp1.txt
> >
> > TC_PAIRS_EDECK_TEMPLATE =
> >
{date?fmt=%Y%m%d%H}.b{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> >
> > TC_PAIRS_BDECK_TEMPLATE =
> >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> >
> > TC_PAIRS_OUTPUT_TEMPLATE =
tc_pairs_{basin?fmt=%s}{date?fmt=%Y%m%d%H}.dat
> >
> >
> > [user_env_vars]
> >
> >
> > *** My Log:
> >
> >
> > 04/23 20:52:22.576 metplus INFO: Running METplus v3.1.1 called
with
> > command: /contrib/met/METplus/METplus-3.1.1/ush/master_metplus.py
-c
> > ./my_user_config.conf -c ./TCPairs_jet.conf
> >
> > 04/23 20:52:22.577 metplus INFO: Log file:
> > /lfs1/BMC/amb-
verif/vhtest/output/logs/master_metplus.log.20210423205222
> >
> > 04/23 20:52:26.077 metplus INFO:
****************************************
> >
> > 04/23 20:52:26.077 metplus INFO: * Running METplus
> >
> > 04/23 20:52:26.077 metplus INFO: * at init time: 202007210000
> >
> > 04/23 20:52:26.077 metplus INFO:
****************************************
> >
> > 04/23 20:52:26.178 metplus.TCPairs (command_builder.py:122) ERROR:
> > (tc_pairs_wrapper.py:489) No BDECK files found searching for basin
?? and
> > cyclone * using template
> >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> >
> > 04/23 20:52:26.179 metplus INFO:
****************************************
> >
> > 04/23 20:52:26.179 metplus INFO: * Running METplus
> >
> > 04/23 20:52:26.179 metplus INFO: * at init time: 202007210600
> >
> > 04/23 20:52:26.179 metplus INFO:
****************************************
> >
> > 04/23 20:52:26.181 metplus.TCPairs (command_builder.py:122) ERROR:
> > (tc_pairs_wrapper.py:489) No BDECK files found searching for basin
?? and
> > cyclone * using template
> >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> >
> > 04/23 20:52:26.181 metplus INFO:
****************************************
> >
> > 04/23 20:52:26.181 metplus INFO: * Running METplus
> >
> > 04/23 20:52:26.181 metplus INFO: * at init time: 202007211200
> >
> > 04/23 20:52:26.181 metplus INFO:
****************************************
> >
> > 04/23 20:52:26.183 metplus.TCPairs (command_builder.py:122) ERROR:
> > (tc_pairs_wrapper.py:489) No BDECK files found searching for basin
?? and
> > cyclone * using template
> >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> >
> > 04/23 20:52:26.183 metplus INFO:
****************************************
> >
> > 04/23 20:52:26.183 metplus INFO: * Running METplus
> >
> > 04/23 20:52:26.184 metplus INFO: * at init time: 202007211800
> >
> > 04/23 20:52:26.184 metplus INFO:
****************************************
> >
> > 04/23 20:52:26.185 metplus.TCPairs (command_builder.py:122) ERROR:
> > (tc_pairs_wrapper.py:489) No BDECK files found searching for basin
?? and
> > cyclone * using template
> >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> >
> > 04/23 20:52:26.185 metplus INFO:
****************************************
> >
> > 04/23 20:52:26.186 metplus INFO: * Running METplus
> >
> > 04/23 20:52:26.186 metplus INFO: * at init time: 202007220000
> >
> > 04/23 20:52:26.186 metplus INFO:
****************************************
> >
> > 04/23 20:52:26.187 metplus.TCPairs (command_builder.py:122) ERROR:
> > (tc_pairs_wrapper.py:489) No BDECK files found searching for basin
?? and
> > cyclone * using template
> >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> >
> > 04/23 20:52:26.188 metplus INFO:
****************************************
> >
> > 04/23 20:52:26.188 metplus INFO: * Running METplus
> >
> > 04/23 20:52:26.188 metplus INFO: * at init time: 202007220600
> >
> > 04/23 20:52:26.188 metplus INFO:
****************************************
> >
> > 04/23 20:52:26.190 metplus.TCPairs (command_builder.py:122) ERROR:
> > (tc_pairs_wrapper.py:489) No BDECK files found searching for basin
?? and
> > cyclone * using template
> >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> >
> > 04/23 20:52:26.190 metplus INFO:
****************************************
> >
> > 04/23 20:52:26.190 metplus INFO: * Running METplus
> >
> > 04/23 20:52:26.190 metplus INFO: * at init time: 202007221200
> >
> > 04/23 20:52:26.190 metplus INFO:
****************************************
> >
> > 04/23 20:52:26.192 metplus.TCPairs (command_builder.py:122) ERROR:
> > (tc_pairs_wrapper.py:489) No BDECK files found searching for basin
?? and
> > cyclone * using template
> >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> >
> > 04/23 20:52:26.192 metplus INFO:
****************************************
> >
> > 04/23 20:52:26.192 metplus INFO: * Running METplus
> >
> > 04/23 20:52:26.192 metplus INFO: * at init time: 202007221800
> >
> > 04/23 20:52:26.192 metplus INFO:
****************************************
> >
> > 04/23 20:52:26.194 metplus.TCPairs (command_builder.py:122) ERROR:
> > (tc_pairs_wrapper.py:489) No BDECK files found searching for basin
?? and
> > cyclone * using template
> >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> >
> > 04/23 20:52:26.194 metplus INFO:
****************************************
> >
> > 04/23 20:52:26.194 metplus INFO: * Running METplus
> >
> > 04/23 20:52:26.194 metplus INFO: * at init time: 202007230000
> >
> > 04/23 20:52:26.194 metplus INFO:
****************************************
> >
> > 04/23 20:52:26.196 metplus.TCPairs (command_builder.py:122) ERROR:
> > (tc_pairs_wrapper.py:489) No BDECK files found searching for basin
?? and
> > cyclone * using template
> >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> >
> > 04/23 20:52:26.196 metplus INFO:
****************************************
> >
> > 04/23 20:52:26.196 metplus INFO: * Running METplus
> >
> > 04/23 20:52:26.197 metplus INFO: * at init time: 202007230600
> >
> > 04/23 20:52:26.197 metplus INFO:
****************************************
> >
> > 04/23 20:52:26.198 metplus.TCPairs (command_builder.py:122) ERROR:
> > (tc_pairs_wrapper.py:489) No BDECK files found searching for basin
?? and
> > cyclone * using template
> >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> >
> > 04/23 20:52:26.199 metplus INFO:
****************************************
> >
> > 04/23 20:52:26.199 metplus INFO: * Running METplus
> >
> > 04/23 20:52:26.199 metplus INFO: * at init time: 202007231200
> >
> > 04/23 20:52:26.199 metplus INFO:
****************************************
> >
> > 04/23 20:52:26.200 metplus.TCPairs (command_builder.py:122) ERROR:
> > (tc_pairs_wrapper.py:489) No BDECK files found searching for basin
?? and
> > cyclone * using template
> >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> >
> > 04/23 20:52:26.201 metplus INFO:
****************************************
> >
> > 04/23 20:52:26.201 metplus INFO: * Running METplus
> >
> > 04/23 20:52:26.201 metplus INFO: * at init time: 202007231800
> >
> > 04/23 20:52:26.201 metplus INFO:
****************************************
> >
> > 04/23 20:52:26.203 metplus.TCPairs (command_builder.py:122) ERROR:
> > (tc_pairs_wrapper.py:489) No BDECK files found searching for basin
?? and
> > cyclone * using template
> >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> >
> > 04/23 20:52:26.203 metplus INFO:
****************************************
> >
> > 04/23 20:52:26.203 metplus INFO: * Running METplus
> >
> > 04/23 20:52:26.203 metplus INFO: * at init time: 202007240000
> >
> > 04/23 20:52:26.203 metplus INFO:
****************************************
> >
> > 04/23 20:52:26.205 metplus.TCPairs (command_builder.py:122) ERROR:
> > (tc_pairs_wrapper.py:489) No BDECK files found searching for basin
?? and
> > cyclone * using template
> >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> >
> > 04/23 20:52:26.205 metplus INFO:
****************************************
> >
> > 04/23 20:52:26.205 metplus INFO: * Running METplus
> >
> > 04/23 20:52:26.205 metplus INFO: * at init time: 202007240600
> >
> > 04/23 20:52:26.205 metplus INFO:
****************************************
> >
> > 04/23 20:52:26.207 metplus.TCPairs (command_builder.py:122) ERROR:
> > (tc_pairs_wrapper.py:489) No BDECK files found searching for basin
?? and
> > cyclone * using template
> >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> >
> > 04/23 20:52:26.207 metplus INFO:
****************************************
> >
> > 04/23 20:52:26.207 metplus INFO: * Running METplus
> >
> > 04/23 20:52:26.207 metplus INFO: * at init time: 202007241200
> >
> > 04/23 20:52:26.208 metplus INFO:
****************************************
> >
> > 04/23 20:52:26.209 metplus.TCPairs (command_builder.py:122) ERROR:
> > (tc_pairs_wrapper.py:489) No BDECK files found searching for basin
?? and
> > cyclone * using template
> >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> >
> > 04/23 20:52:26.209 metplus INFO:
****************************************
> >
> > 04/23 20:52:26.210 metplus INFO: * Running METplus
> >
> > 04/23 20:52:26.210 metplus INFO: * at init time: 202007241800
> >
> > 04/23 20:52:26.210 metplus INFO:
****************************************
> >
> > 04/23 20:52:26.211 metplus.TCPairs (command_builder.py:122) ERROR:
> > (tc_pairs_wrapper.py:489) No BDECK files found searching for basin
?? and
> > cyclone * using template
> >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> >
> > 04/23 20:52:26.212 metplus.TCPairs (met_util.py:210) ERROR:
TCPairs had
> 16
> > errors.
> >
> > 04/23 20:52:26.212 metplus INFO:
> > /lfs1/BMC/amb-verif/vhtest/output/metplus_final.conf: write
metplus.conf
> > here
> >
> > 04/23 20:52:26.216 metplus (met_util.py:246) ERROR: METplus has
finished
> > running but had 16 errors.
> >
> > 04/23 20:52:26.216 metplus INFO: Check the log file for more
information:
> > /lfs1/BMC/amb-
verif/vhtest/output/logs/master_metplus.log.20210423205222
> >
> >
> >
> > Please let me know if you need additional information.
> >
> > Thank you,
> > Venita
> >
> > --
> > Venita Hagerty, PhD
> > Research Associate
> > CIRA at NOAA, GSL/AVID
> > 2B152, x6098
> >
> >
>
>
--
Venita Hagerty, PhD
Research Associate
CIRA at NOAA, GSL/AVID
2B152, x6098
------------------------------------------------
Subject: Help with running TC Pairs with METplus wrappers on Jet
From: John Halley Gotway
Time: Mon Apr 26 14:55:45 2021
Venita,
I'm looking in your METplus log file:
/lfs1/BMC/amb-
verif/vhtest/output/logs/master_metplus.log.20210423205222
And I see 18 attempted calls to the tc_pairs wrapper along with 18
error
messages:
*ERROR: (tc_pairs_wrapper.py:489) No BDECK files found searching for
basin
?? and cyclone * using template
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat*
So I suspect you really have 2 questions here.
(1) How can I run tc_pairs with -adeck, -edeck, and -bdeck inputs and
get
both TCMPR and PROBRIRW output?
(2) The TC-Pairs wrapper in METplus isn't working with my data. Why
not?
For (1), yes, that should work. But when I run tc_pairs manually with
the
edeck data, I see some telling log messages:
*cd /misc/whome/John.H.Gotway/MET_Help/hagerty_data_20210426/tc_pairs*
*/contrib/met/9.1/bin/tc_pairs -edeck edeck/2020072112.eep072020.dat
-bdeck
bdeck/ -config TCPairsConfig -v 3*
*DEBUG 2: Processing 1 EDECK file(s).WARNING: WARNING: int
ATCFProbLine::read_line(LineDataFile * ldf) -> unexpected ATCF line
type
(ProbGN)WARNING: DEBUG 3: Used 0 of 0 lines read from 1 file(s).*
And that WARNING message triggers it to stop reading data from that
file.
So really I need to fix logic to just ignore those unsupported
probability
line types. As a temporary workaround, I just grepped out the "RI"
line
types.
grep RI edeck/2020072112.eep072020.dat > 2020072112.eep072020_RI.dat
And then I do get PROBRIRW lines in the output:
cat
/misc/whome/John.H.Gotway/MET_Help/hagerty_data_20210426/tc_pairs/tc_pairs_PROBRIRW.tcst
I'll write up a GitHub issue to make tc_pairs just ignore those
unsupported
line types.
For (2), it looks like you have an 'e' and 'b' transposed in your
settings.
grep DECK_TEMPLATE /lfs1/BMC/amb-
verif/vhtest/output/metplus_final.conf
TC_PAIRS_ADECK_TEMPLATE = tctrk.atcf.{date?fmt=%Y%m%d%H}.gcp1.txt
TC_PAIRS_EDECK_TEMPLATE =
{date?fmt=%Y%m%d%H}.b{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
TC_PAIRS_BDECK_TEMPLATE =
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
I suspect that's not the only problem but it certainly is one of them.
I'd recommend configuring METplus using:
LOG_LEVEL = DEBUG
To print more log messages... until you're satisfied it's doing
exactly
what you want.
Thanks,
John
On Mon, Apr 26, 2021 at 9:39 AM venita.hagerty at noaa.gov via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99708 >
>
> I am working on Jet.
>
> Venita
>
> On Mon, Apr 26, 2021 at 9:36 AM John Halley Gotway via RT <
> met_help at ucar.edu>
> wrote:
>
> > Hi Venita,
> >
> > This is John HG... I'm on met-help desk on Mondays.
> >
> > I see you're having trouble getting PROBRIRW output from TC-Pairs.
Thanks
> > for sending all the details about your runtime environment.
There's
> nothing
> > obvious off the bat that strikes me as a reason for not getting
paired
> > output. If I have access to the machine on which you're running,
I'll
> just
> > log on and take a closer look. Ideally, I'd like to boil this down
to...
> > here's a single call to TC-Pairs that yields no PROBRIRW output
lines and
> > we think it should. And hopefully then we can figure out why it is
not!
> >
> > I see all the path info, but don't actually see the machine name.
I'm
> > guessing it's either Hera or Jet. Can you please confirm which?
> >
> > FYI, I'm working on the beta5 release for MET today but should be
able to
> > look at this as well.
> >
> > Thanks,
> > John
> >
> > On Mon, Apr 26, 2021 at 8:44 AM venita.hagerty at noaa.gov via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > Mon Apr 26 08:44:39 2021: Request 99708 was acted upon.
> > > Transaction: Ticket created by venita.hagerty at noaa.gov
> > > Queue: met_help
> > > Subject: Help with running TC Pairs with METplus wrappers
on Jet
> > > Owner: Nobody
> > > Requestors: venita.hagerty at noaa.gov
> > > Status: new
> > > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99708
> >
> > >
> > >
> > > I need to run TC Pairs with a-decks, b-decks, and e-decks so
that I get
> > > both TCMPR and PROBRIRW line types. I am able to run and get
TCMPR line
> > > types, but not TCMPR.
> > >
> > > I am getting b-decks and e-decks from NHC off of our /public
drive. I
> am
> > > getting a-decks from Judy Henderson, which have been run through
the
> GFDL
> > > tracker and are in ATCF format.
> > >
> > > I can run TC Pairs with a-decks and b-decks and get TCMPR data.
I added
> > an
> > > e-deck, and got errors and no PROBRIRW output. I don't know if I
can
> run
> > > all 3 types of decks at once, or if this needs to be two
separate
> jobs. I
> > > think I have matching dates. I may have something set wrong in
the
> config
> > > files.
> > >
> > > *** My loads:
> > >
> > > module purge
> > >
> > > module load intel
> > >
> > > module load intelpython/3.6.5
> > >
> > > module load netcdf/4.6.1
> > >
> > > module load hdf5/1.10.4
> > >
> > > module load nco/4.9.1
> > >
> > > module load wgrib/1.8.1.0b
> > >
> > > module load wgrib2/2.0.8
> > >
> > > module load R/3.6.1
> > >
> > > module load contrib
> > >
> > > module use /contrib/met/modulefiles
> > >
> > > module load met/9.1
> > >
> > > module use /contrib/met/METplus/modulefiles
> > >
> > > module load metplus/3.1.1
> > >
> > >
> > > *** my_user_config.conf:
> > >
> > >
> > > # This is a comment, comments are defined with a # at the
beginning of
> > the
> > > line
> > >
> > >
> > > # Set the MET_INSTALL_DIR to the location of the MET install
> > >
> > > [dir]
> > >
> > > MET_INSTALL_DIR = /contrib/met/9.1/met-9.1.1
> > >
> > > MET_BIN_DIR = /contrib/met/9.1/met-
9.1.1/src/tools/tc_utils/tc_pairs
> > >
> > >
> > > # Set INPUT_BASE to the directory containing sample input data
if
> running
> > > use cases in the repository
> > >
> > > # Otherwise set INPUT_BASE to any path that does not contain
/path/to.
> > >
> > > INPUT_BASE = /lfs1/BMC/amb-verif/vhtest
> > >
> > >
> > > # Set OUTPUT_BASE to a directory where you have permission to
write
> > output
> > > files
> > >
> > > # It will be created if it does not exist
> > >
> > > OUTPUT_BASE = /lfs1/BMC/amb-verif/vhtest/output
> > >
> > >
> > > *** TCPairs_jet.conf:
> > >
> > >
> > > #
> > >
> > > # CONFIGURATION
> > >
> > > #
> > >
> > > [config]
> > >
> > >
> > > # Looping by times: steps through each 'task' in the
PROCESS_LIST for
> > each
> > >
> > > # defined time, and repeats until all times have been evaluated.
> > >
> > > LOOP_ORDER = times
> > >
> > >
> > > # Configuration files
> > >
> > > TC_PAIRS_CONFIG_FILE =
{PARM_BASE}/met_config/TCPairsConfig_wrapped
> > >
> > >
> > > # 'Tasks' to be run
> > >
> > > PROCESS_LIST = TCPairs
> > >
> > >
> > > LOOP_BY = INIT
> > >
> > >
> > > # The init time begin and end times, increment, and last init
hour.
> > >
> > > INIT_TIME_FMT = %Y%m%d%H
> > >
> > > INIT_BEG = 2020072100
> > >
> > > INIT_END = 2020072418
> > >
> > >
> > > # This is the step-size. Increment in seconds from the begin
time to
> the
> > > end time
> > >
> > > # set to 6 hours = 21600 seconds
> > >
> > > INIT_INCREMENT = 21600
> > >
> > >
> > > # A list of times to include, in format YYYYMMDD_hh
> > >
> > > INIT_INCLUDE =
> > >
> > >
> > > # A list of times to exclude, in format YYYYMMDD_hh
> > >
> > > INIT_EXCLUDE =
> > >
> > >
> > > #
> > >
> > > # Specify model valid time window in format YYYYMM[DD[_hh]].
Only
> tracks
> > > that fall within the valid time window will
> > >
> > > # be used.
> > >
> > > #
> > >
> > > VALID_BEG =
> > >
> > > VALID_END =
> > >
> > >
> > > #
> > >
> > > # Run MET tc_pairs by indicating the top-level directories for
the
> A-deck
> > > and B-deck files. Set to 'yes' to
> > >
> > > # run using top-level directories, 'no' if you want to run
tc_pairs on
> > > files paired by the wrapper.
> > >
> > > TC_PAIRS_READ_ALL_FILES = no
> > >
> > >
> > > # set to true or yes to reformat track data into ATCF format
expected
> by
> > > tc_pairs
> > >
> > > TC_PAIRS_REFORMAT_DECK = no
> > >
> > >
> > > # OVERWRITE OPTIONS
> > >
> > > # Don't overwrite filter files if they already exist.
> > >
> > > # Set to yes if you do NOT want to override existing files
> > >
> > > # Set to no if you do want to override existing files
> > >
> > > TC_PAIRS_SKIP_IF_OUTPUT_EXISTS = no
> > >
> > >
> > > #
> > >
> > > # MET TC-Pairs
> > >
> > > #
> > >
> > > # List of models to be used (white space or comma separated) eg:
DSHP,
> > > LGEM, HWRF
> > >
> > > # If no models are listed, then process all models in the input
> file(s).
> > >
> > > MODEL =
> > >
> > >
> > > # List of storm ids of interest (space or comma separated) e.g.:
> > AL112012,
> > > AL122012
> > >
> > > # If no storm ids are listed, then process all storm ids in the
input
> > > file(s).
> > >
> > > #TC_PAIRS_STORM_ID = ML2092014
> > >
> > > #TC_PAIRS_STORM_ID = al062018, al092018, al132018, al142018
> > >
> > >
> > > # Basins (of origin/region). Indicate with space or comma-
separated
> list
> > > of regions, eg. AL: for North Atlantic,
> > >
> > > # WP: Western North Pacific, CP: Central North Pacific, SH:
Southern
> > > Hemisphere, IO: North Indian Ocean, LS: Southern
> > >
> > > # Hemisphere
> > >
> > > #TC_PAIRS_BASIN = AL
> > >
> > > TC_PAIRS_BASIN =
> > >
> > >
> > > # Cyclone, a space or comma-separated list of cyclone numbers.
If left
> > > empty, all cyclones will be used.
> > >
> > > TC_PAIRS_CYCLONE =
> > >
> > > #TC_PAIRS_CYCLONE = 06
> > >
> > >
> > > # Storm name, a space or comma-separated list of storm names to
> evaluate.
> > > If
> > > left empty, all storms will be used.
> > >
> > > TC_PAIRS_STORM_NAME =
> > >
> > >
> > > # DLAND file, the full path of the file that contains the
gridded
> > > representation of the
> > >
> > > # minimum distance from land.
> > >
> > > TC_PAIRS_DLAND_FILE =
MET_BASE/tc_data/dland_global_tenth_degree.nc
> > >
> > >
> > >
> > > #
> > >
> > > # DIRECTORIES
> > >
> > > #
> > >
> > > [dir]
> > >
> > > # Location of input track data directory
> > >
> > > # for ADECK and BDECK data
> > >
> > > TC_PAIRS_ADECK_INPUT_DIR = /lfs1/BMC/amb-verif/vhtest/adeck
> > >
> > > TC_PAIRS_EDECK_INPUT_DIR = /lfs1/BMC/amb-verif/vhtest/edeck
> > >
> > > TC_PAIRS_BDECK_INPUT_DIR = /lfs1/BMC/amb-verif/vhtest/bdeck
> > >
> > >
> > > TC_PAIRS_OUTPUT_DIR = {OUTPUT_BASE}/tc_pairs
> > >
> > >
> > > [filename_templates]
> > >
> > > TC_PAIRS_ADECK_TEMPLATE =
tctrk.atcf.{date?fmt=%Y%m%d%H}.gcp1.txt
> > >
> > > TC_PAIRS_EDECK_TEMPLATE =
> > >
{date?fmt=%Y%m%d%H}.b{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> > >
> > > TC_PAIRS_BDECK_TEMPLATE =
> > >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> > >
> > > TC_PAIRS_OUTPUT_TEMPLATE =
> tc_pairs_{basin?fmt=%s}{date?fmt=%Y%m%d%H}.dat
> > >
> > >
> > > *** my input files:
> > >
> > >
> > > adeck:
> > >
> > > total 96
> > >
> > > -rw-r--r-- 1 amb-verif amb-verif 20560 Apr 12 19:33
> > > tctrk.atcf.2020072100.gcp1.txt
> > >
> > > -rw-r--r-- 1 amb-verif amb-verif 39578 Apr 14 15:57
> > > tctrk.atcf.2020072300.gcp1.txt
> > >
> > > -rw-r--r-- 1 amb-verif amb-verif 30326 Apr 14 15:57
> > > tctrk.atcf.2020072400.gcp1.txt
> > >
> > >
> > > bdeck:
> > >
> > > total 224
> > >
> > > -rw-r--r-- 1 amb-verif amb-verif 997 Apr 12 19:32
> > 2020051418.bal902020.dat
> > >
> > > -rw-r--r-- 1 amb-verif amb-verif 1547 Apr 12 19:32
> > 2020072100.bal902020.dat
> > >
> > > -rw-r--r-- 1 amb-verif amb-verif 1547 Apr 12 19:32
> > 2020072100.bal992020.dat
> > >
> > > -rw-r--r-- 1 amb-verif amb-verif 3165 Apr 12 19:32
> > 2020072100.bep072020.dat
> > >
> > > -rw-r--r-- 1 amb-verif amb-verif 2447 Apr 12 19:32
> > 2020072100.bep082020.dat
> > >
> > > -rw-r--r-- 1 amb-verif amb-verif 1763 Apr 12 19:32
> > 2020072106.bal992020.dat
> > >
> > > -rw-r--r-- 1 amb-verif amb-verif 3381 Apr 12 19:32
> > 2020072106.bep072020.dat
> > >
> > > -rw-r--r-- 1 amb-verif amb-verif 2879 Apr 12 19:32
> > 2020072106.bep082020.dat
> > >
> > > -rw-r--r-- 1 amb-verif amb-verif 1979 Apr 12 19:32
> > 2020072112.bal992020.dat
> > >
> > > -rw-r--r-- 1 amb-verif amb-verif 3597 Apr 12 19:32
> > 2020072112.bep072020.dat
> > >
> > > -rw-r--r-- 1 amb-verif amb-verif 1980 Apr 12 19:32
> > 2020072112.bep082020.dat
> > >
> > > -rw-r--r-- 1 amb-verif amb-verif 2231 Apr 12 19:32
> > 2020072118.bal072020.dat
> > >
> > > -rw-r--r-- 1 amb-verif amb-verif 1115 Apr 12 19:32
> > 2020072118.bal912020.dat
> > >
> > > -rw-r--r-- 1 amb-verif amb-verif 2195 Apr 12 19:32
> > 2020072118.bal992020.dat
> > >
> > > -rw-r--r-- 1 amb-verif amb-verif 2412 Apr 12 19:32
> > 2020072118.bep082020.dat
> > >
> > > -rw-r--r-- 1 amb-verif amb-verif 2663 Jul 23 2020
> > 2020072300.bal072020.dat
> > >
> > > -rw-r--r-- 1 amb-verif amb-verif 2231 Jul 23 2020
> > 2020072300.bal082020.dat
> > >
> > > -rw-r--r-- 1 amb-verif amb-verif 2195 Jul 23 2020
> > 2020072300.bal912020.dat
> > >
> > > -rw-r--r-- 1 amb-verif amb-verif 5004 Jul 23 2020
> > 2020072300.bep082020.dat
> > >
> > > -rw-r--r-- 1 amb-verif amb-verif 3095 Jul 23 2020
> > 2020072306.bal072020.dat
> > >
> > > -rw-r--r-- 1 amb-verif amb-verif 2447 Jul 23 2020
> > 2020072306.bal082020.dat
> > >
> > > -rw-r--r-- 1 amb-verif amb-verif 5652 Jul 23 2020
> > 2020072306.bep082020.dat
> > >
> > > -rw-r--r-- 1 amb-verif amb-verif 3527 Jul 23 2020
> > 2020072312.bal072020.dat
> > >
> > > -rw-r--r-- 1 amb-verif amb-verif 2663 Jul 23 2020
> > 2020072312.bal082020.dat
> > >
> > > -rw-r--r-- 1 amb-verif amb-verif 6300 Jul 23 2020
> > 2020072312.bep082020.dat
> > >
> > > -rw-r--r-- 1 amb-verif amb-verif 3959 Jul 23 2020
> > 2020072318.bal072020.dat
> > >
> > > -rw-r--r-- 1 amb-verif amb-verif 2879 Jul 23 2020
> > 2020072318.bal082020.dat
> > >
> > > -rw-r--r-- 1 amb-verif amb-verif 6948 Jul 23 2020
> > 2020072318.bep082020.dat
> > >
> > > -rw-r--r-- 1 amb-verif amb-verif 4391 Jul 24 2020
> > 2020072400.bal072020.dat
> > >
> > > -rw-r--r-- 1 amb-verif amb-verif 3095 Jul 24 2020
> > 2020072400.bal082020.dat
> > >
> > > -rw-r--r-- 1 amb-verif amb-verif 7596 Jul 24 2020
> > 2020072400.bep082020.dat
> > >
> > > -rw-r--r-- 1 amb-verif amb-verif 4823 Jul 24 2020
> > 2020072406.bal072020.dat
> > >
> > > -rw-r--r-- 1 amb-verif amb-verif 3311 Jul 24 2020
> > 2020072406.bal082020.dat
> > >
> > > -rw-r--r-- 1 amb-verif amb-verif 8244 Jul 24 2020
> > 2020072406.bep082020.dat
> > >
> > > -rw-r--r-- 1 amb-verif amb-verif 5039 Jul 24 2020
> > 2020072412.bal072020.dat
> > >
> > > -rw-r--r-- 1 amb-verif amb-verif 2412 Jul 24 2020
> > 2020072412.bal082020.dat
> > >
> > > -rw-r--r-- 1 amb-verif amb-verif 8892 Jul 24 2020
> > 2020072412.bep082020.dat
> > >
> > > -rw-r--r-- 1 amb-verif amb-verif 5255 Jul 24 2020
> > 2020072418.bal072020.dat
> > >
> > > -rw-r--r-- 1 amb-verif amb-verif 2628 Jul 24 2020
> > 2020072418.bal082020.dat
> > >
> > > -rw-r--r-- 1 amb-verif amb-verif 1115 Jul 24 2020
> > 2020072418.bal922020.dat
> > >
> > > -rw-r--r-- 1 amb-verif amb-verif 9540 Jul 24 2020
> > 2020072418.bep082020.dat
> > >
> > >
> > > edeck:
> > >
> > > total 124
> > >
> > > -rw-r--r-- 1 amb-verif amb-verif 121621 Apr 23 20:44
> > > 2020072112.eep072020.dat
> > >
> > >
> > > some of the data:
> > >
> > >
> > > head -3 adeck/tctrk.atcf.2020072100.gcp1.txt
> > >
> > > AL, 99, 2020072100, 03, GCP1, 000, 89N, 381W, 22, 1010, XX,
34,
> NEQ,
> > > 0000, 0000, 0000, 0000, -99, -99, 34, 0, 0, , 0,
, 0,
> > 0,
> > > , , , , 0, 0, 0, 0, THERMO PARAMS,
> > > -12, 225,
> > > -30, N, 10, DT, -999
> > >
> > > AL, 90, 2020072100, 03, GCP1, 000, 275N, 954W, 22, 1008, XX,
34,
> NEQ,
> > > 0000, 0000, 0000, 0000, -99, -99, 117, 0, 0, , 0,
, 0,
> > 0,
> > > , , , , 0, 0, 0, 0, THERMO PARAMS,
-31,
> > > 326, -226, N, 10, DT, -999
> > >
> > > EP, 07, 2020072100, 03, GCP1, 000, 193N, 1318W, 38, 1007, XX,
34,
> NEQ,
> > > 0032, 0000, 0000, 0029, 1011, 52, 25, 0, 0, , 0,
, 0,
> > 0,
> > > , , , , 0, 0, 0, 0, THERMO PARAMS,
> > > 34, 274,
> > > 378, Y, 10, DT, -999
> > >
> > >
> > > head -3 bdeck/2020072112.bep082020.dat
> > >
> > > EP, 08, 2020072000, , BEST, 0, 148N, 1188W, 25, 1008, LO,
0,
> ,
> > > 0, 0, 0, 0, 1011, 100, 40, 0, 0, E, 0, ,
0,
> 0,
> > > INVEST, S, 0, , 0, 0, 0, 0, genesis-num, 014,
> > >
> > > EP, 08, 2020072006, , BEST, 0, 143N, 1192W, 25, 1008, LO,
0,
> ,
> > > 0, 0, 0, 0, 1011, 100, 30, 35, 0, E, 0, ,
0,
> 0,
> > > INVEST, M, 0, , 0, 0, 0, 0, genesis-num, 014,
> > >
> > > EP, 08, 2020072012, , BEST, 0, 139N, 1194W, 30, 1008, TD,
0,
> ,
> > > 0, 0, 0, 0, 1011, 100, 30, 40, 0, E, 0, ,
0,
> 0,
> > > INVEST, M, 0, , 0, 0, 0, 0, genesis-num, 014,
> > > TRANSITIONED, epB02020 to ep082020,
> > >
> > >
> > > head -3 edeck/2020072112.eep072020.dat
> > >
> > > EP, 07, 2020071206, GN, OFCL, 48, , , 0, 48, ESB,
> genFcst,
> > ,
> > > ,
> > > 0, 013,
> > >
> > > EP, 07, 2020071206, GN, OFCL, 120, , , 0, 120, ESB,
> genFcst,
> > ,
> > > ,
> > > 0, 013,
> > >
> > > EP, 07, 2020071206, GN, OFCL, 168, , , 10, 168, ESB,
> genFcst,
> > ,
> > > ,
> > > 0, 013,
> > >
> > >
> > > *** metplus_final.conf:
> > >
> > >
> > > [config]
> > >
> > > CLOCK_TIME = 20210423205222
> > >
> > > LOOP_ORDER = times
> > >
> > > PROCESS_LIST = TCPairs
> > >
> > > METPLUS_CONF = {OUTPUT_BASE}/metplus_final.conf
> > >
> > > LOG_METPLUS =
> > >
> /lfs1/BMC/amb-
verif/vhtest/output/logs/master_metplus.log.20210423205222
> > >
> > > LOG_TIMESTAMP_TEMPLATE = %Y%m%d%H%M%S
> > >
> > > LOG_LINE_FORMAT = %(asctime)s.%(msecs)03d %(name)s
> > > (%(filename)s:%(lineno)d) %(levelname)s: %(message)s
> > >
> > > LOG_ERR_LINE_FORMAT = {LOG_LINE_FORMAT}
> > >
> > > LOG_DEBUG_LINE_FORMAT = {LOG_LINE_FORMAT}
> > >
> > > LOG_INFO_LINE_FORMAT = %(asctime)s.%(msecs)03d %(name)s
%(levelname)s:
> > > %(message)s
> > >
> > > LOG_LINE_DATE_FORMAT = %m/%d %H:%M:%S
> > >
> > > LOG_TIMESTAMP_USE_DATATIME = no
> > >
> > > LOG_MET_OUTPUT_TO_METPLUS = yes
> > >
> > > LOG_MET_VERBOSITY = 2
> > >
> > > LOG_LEVEL = INFO
> > >
> > > TC_PAIRS_CONFIG_FILE =
{PARM_BASE}/met_config/TCPairsConfig_wrapped
> > >
> > > LOOP_BY = INIT
> > >
> > > INIT_TIME_FMT = %Y%m%d%H
> > >
> > > INIT_BEG = 2020072100
> > >
> > > INIT_END = 2020072418
> > >
> > > INIT_INCREMENT = 21600
> > >
> > > INIT_INCLUDE =
> > >
> > > INIT_EXCLUDE =
> > >
> > > VALID_BEG =
> > >
> > > VALID_END =
> > >
> > > TC_PAIRS_READ_ALL_FILES = no
> > >
> > > TC_PAIRS_REFORMAT_DECK = no
> > >
> > > TC_PAIRS_SKIP_IF_OUTPUT_EXISTS = no
> > >
> > > MODEL =
> > >
> > > TC_PAIRS_BASIN =
> > >
> > > TC_PAIRS_CYCLONE =
> > >
> > > TC_PAIRS_STORM_NAME =
> > >
> > > TC_PAIRS_DLAND_FILE =
MET_BASE/tc_data/dland_global_tenth_degree.nc
> > >
> > > LOG_TIMESTAMP = 20210423205222
> > >
> > > METPLUS_CONFIG_FILES = ./my_user_config.conf,./TCPairs_jet.conf
> > >
> > > METPLUS_VERSION = 3.1.1
> > >
> > > CURRENT_FCST_NAME =
> > >
> > > CURRENT_OBS_NAME =
> > >
> > > CURRENT_FCST_LEVEL =
> > >
> > > CURRENT_OBS_LEVEL =
> > >
> > > USER_SHELL = bash
> > >
> > > DO_NOT_RUN_EXE = False
> > >
> > > TC_PAIRS_SKIP_TIMES =
> > >
> > > SKIP_TIMES =
> > >
> > > USE_EXPLICIT_NAME_AND_LEVEL = False
> > >
> > > LOG_TC_PAIRS_VERBOSITY = 2
> > >
> > > TC_PAIRS_MISSING_VAL_TO_REPLACE = -99
> > >
> > > TC_PAIRS_MISSING_VAL = -9999
> > >
> > > TC_PAIRS_STORM_ID =
> > >
> > > TC_PAIRS_SKIP_IF_REFORMAT_EXISTS = False
> > >
> > > TC_PAIRS_REFORMAT_TYPE = SBU
> > >
> > > SCRUB_STAGING_DIR = False
> > >
> > >
> > > [dir]
> > >
> > > OUTPUT_BASE = /lfs1/BMC/amb-verif/vhtest/output
> > >
> > > STAGING_DIR = {OUTPUT_BASE}/stage
> > >
> > > MET_INSTALL_DIR = /contrib/met/9.1/met-9.1.1
> > >
> > > MET_BIN_DIR = /contrib/met/9.1/met-
9.1.1/src/tools/tc_utils/tc_pairs
> > >
> > > LOG_DIR = {OUTPUT_BASE}/logs
> > >
> > > TMP_DIR = {OUTPUT_BASE}/tmp
> > >
> > > INPUT_BASE = /lfs1/BMC/amb-verif/vhtest
> > >
> > > TC_PAIRS_ADECK_INPUT_DIR = /lfs1/BMC/amb-verif/vhtest/adeck
> > >
> > > TC_PAIRS_EDECK_INPUT_DIR = /lfs1/BMC/amb-verif/vhtest/edeck
> > >
> > > TC_PAIRS_BDECK_INPUT_DIR = /lfs1/BMC/amb-verif/vhtest/bdeck
> > >
> > > TC_PAIRS_OUTPUT_DIR = {OUTPUT_BASE}/tc_pairs
> > >
> > > METPLUS_BASE = /contrib/met/METplus/METplus-3.1.1
> > >
> > > PARM_BASE = /contrib/met/METplus/METplus-3.1.1/parm
> > >
> > > TC_PAIRS_REFORMAT_DIR =
> /lfs1/BMC/amb-verif/vhtest/output/track_data_atcf
> > >
> > >
> > > [exe]
> > >
> > > RM = rm
> > >
> > > CUT = cut
> > >
> > > TR = tr
> > >
> > > NCAP2 = ncap2
> > >
> > > CONVERT = convert
> > >
> > > NCDUMP = ncdump
> > >
> > >
> > > [filename_templates]
> > >
> > > TC_PAIRS_ADECK_TEMPLATE =
tctrk.atcf.{date?fmt=%Y%m%d%H}.gcp1.txt
> > >
> > > TC_PAIRS_EDECK_TEMPLATE =
> > >
{date?fmt=%Y%m%d%H}.b{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> > >
> > > TC_PAIRS_BDECK_TEMPLATE =
> > >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> > >
> > > TC_PAIRS_OUTPUT_TEMPLATE =
> tc_pairs_{basin?fmt=%s}{date?fmt=%Y%m%d%H}.dat
> > >
> > >
> > > [user_env_vars]
> > >
> > >
> > > *** My Log:
> > >
> > >
> > > 04/23 20:52:22.576 metplus INFO: Running METplus v3.1.1 called
with
> > > command: /contrib/met/METplus/METplus-
3.1.1/ush/master_metplus.py -c
> > > ./my_user_config.conf -c ./TCPairs_jet.conf
> > >
> > > 04/23 20:52:22.577 metplus INFO: Log file:
> > >
> /lfs1/BMC/amb-
verif/vhtest/output/logs/master_metplus.log.20210423205222
> > >
> > > 04/23 20:52:26.077 metplus INFO:
> ****************************************
> > >
> > > 04/23 20:52:26.077 metplus INFO: * Running METplus
> > >
> > > 04/23 20:52:26.077 metplus INFO: * at init time: 202007210000
> > >
> > > 04/23 20:52:26.077 metplus INFO:
> ****************************************
> > >
> > > 04/23 20:52:26.178 metplus.TCPairs (command_builder.py:122)
ERROR:
> > > (tc_pairs_wrapper.py:489) No BDECK files found searching for
basin ??
> and
> > > cyclone * using template
> > >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> > >
> > > 04/23 20:52:26.179 metplus INFO:
> ****************************************
> > >
> > > 04/23 20:52:26.179 metplus INFO: * Running METplus
> > >
> > > 04/23 20:52:26.179 metplus INFO: * at init time: 202007210600
> > >
> > > 04/23 20:52:26.179 metplus INFO:
> ****************************************
> > >
> > > 04/23 20:52:26.181 metplus.TCPairs (command_builder.py:122)
ERROR:
> > > (tc_pairs_wrapper.py:489) No BDECK files found searching for
basin ??
> and
> > > cyclone * using template
> > >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> > >
> > > 04/23 20:52:26.181 metplus INFO:
> ****************************************
> > >
> > > 04/23 20:52:26.181 metplus INFO: * Running METplus
> > >
> > > 04/23 20:52:26.181 metplus INFO: * at init time: 202007211200
> > >
> > > 04/23 20:52:26.181 metplus INFO:
> ****************************************
> > >
> > > 04/23 20:52:26.183 metplus.TCPairs (command_builder.py:122)
ERROR:
> > > (tc_pairs_wrapper.py:489) No BDECK files found searching for
basin ??
> and
> > > cyclone * using template
> > >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> > >
> > > 04/23 20:52:26.183 metplus INFO:
> ****************************************
> > >
> > > 04/23 20:52:26.183 metplus INFO: * Running METplus
> > >
> > > 04/23 20:52:26.184 metplus INFO: * at init time: 202007211800
> > >
> > > 04/23 20:52:26.184 metplus INFO:
> ****************************************
> > >
> > > 04/23 20:52:26.185 metplus.TCPairs (command_builder.py:122)
ERROR:
> > > (tc_pairs_wrapper.py:489) No BDECK files found searching for
basin ??
> and
> > > cyclone * using template
> > >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> > >
> > > 04/23 20:52:26.185 metplus INFO:
> ****************************************
> > >
> > > 04/23 20:52:26.186 metplus INFO: * Running METplus
> > >
> > > 04/23 20:52:26.186 metplus INFO: * at init time: 202007220000
> > >
> > > 04/23 20:52:26.186 metplus INFO:
> ****************************************
> > >
> > > 04/23 20:52:26.187 metplus.TCPairs (command_builder.py:122)
ERROR:
> > > (tc_pairs_wrapper.py:489) No BDECK files found searching for
basin ??
> and
> > > cyclone * using template
> > >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> > >
> > > 04/23 20:52:26.188 metplus INFO:
> ****************************************
> > >
> > > 04/23 20:52:26.188 metplus INFO: * Running METplus
> > >
> > > 04/23 20:52:26.188 metplus INFO: * at init time: 202007220600
> > >
> > > 04/23 20:52:26.188 metplus INFO:
> ****************************************
> > >
> > > 04/23 20:52:26.190 metplus.TCPairs (command_builder.py:122)
ERROR:
> > > (tc_pairs_wrapper.py:489) No BDECK files found searching for
basin ??
> and
> > > cyclone * using template
> > >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> > >
> > > 04/23 20:52:26.190 metplus INFO:
> ****************************************
> > >
> > > 04/23 20:52:26.190 metplus INFO: * Running METplus
> > >
> > > 04/23 20:52:26.190 metplus INFO: * at init time: 202007221200
> > >
> > > 04/23 20:52:26.190 metplus INFO:
> ****************************************
> > >
> > > 04/23 20:52:26.192 metplus.TCPairs (command_builder.py:122)
ERROR:
> > > (tc_pairs_wrapper.py:489) No BDECK files found searching for
basin ??
> and
> > > cyclone * using template
> > >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> > >
> > > 04/23 20:52:26.192 metplus INFO:
> ****************************************
> > >
> > > 04/23 20:52:26.192 metplus INFO: * Running METplus
> > >
> > > 04/23 20:52:26.192 metplus INFO: * at init time: 202007221800
> > >
> > > 04/23 20:52:26.192 metplus INFO:
> ****************************************
> > >
> > > 04/23 20:52:26.194 metplus.TCPairs (command_builder.py:122)
ERROR:
> > > (tc_pairs_wrapper.py:489) No BDECK files found searching for
basin ??
> and
> > > cyclone * using template
> > >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> > >
> > > 04/23 20:52:26.194 metplus INFO:
> ****************************************
> > >
> > > 04/23 20:52:26.194 metplus INFO: * Running METplus
> > >
> > > 04/23 20:52:26.194 metplus INFO: * at init time: 202007230000
> > >
> > > 04/23 20:52:26.194 metplus INFO:
> ****************************************
> > >
> > > 04/23 20:52:26.196 metplus.TCPairs (command_builder.py:122)
ERROR:
> > > (tc_pairs_wrapper.py:489) No BDECK files found searching for
basin ??
> and
> > > cyclone * using template
> > >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> > >
> > > 04/23 20:52:26.196 metplus INFO:
> ****************************************
> > >
> > > 04/23 20:52:26.196 metplus INFO: * Running METplus
> > >
> > > 04/23 20:52:26.197 metplus INFO: * at init time: 202007230600
> > >
> > > 04/23 20:52:26.197 metplus INFO:
> ****************************************
> > >
> > > 04/23 20:52:26.198 metplus.TCPairs (command_builder.py:122)
ERROR:
> > > (tc_pairs_wrapper.py:489) No BDECK files found searching for
basin ??
> and
> > > cyclone * using template
> > >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> > >
> > > 04/23 20:52:26.199 metplus INFO:
> ****************************************
> > >
> > > 04/23 20:52:26.199 metplus INFO: * Running METplus
> > >
> > > 04/23 20:52:26.199 metplus INFO: * at init time: 202007231200
> > >
> > > 04/23 20:52:26.199 metplus INFO:
> ****************************************
> > >
> > > 04/23 20:52:26.200 metplus.TCPairs (command_builder.py:122)
ERROR:
> > > (tc_pairs_wrapper.py:489) No BDECK files found searching for
basin ??
> and
> > > cyclone * using template
> > >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> > >
> > > 04/23 20:52:26.201 metplus INFO:
> ****************************************
> > >
> > > 04/23 20:52:26.201 metplus INFO: * Running METplus
> > >
> > > 04/23 20:52:26.201 metplus INFO: * at init time: 202007231800
> > >
> > > 04/23 20:52:26.201 metplus INFO:
> ****************************************
> > >
> > > 04/23 20:52:26.203 metplus.TCPairs (command_builder.py:122)
ERROR:
> > > (tc_pairs_wrapper.py:489) No BDECK files found searching for
basin ??
> and
> > > cyclone * using template
> > >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> > >
> > > 04/23 20:52:26.203 metplus INFO:
> ****************************************
> > >
> > > 04/23 20:52:26.203 metplus INFO: * Running METplus
> > >
> > > 04/23 20:52:26.203 metplus INFO: * at init time: 202007240000
> > >
> > > 04/23 20:52:26.203 metplus INFO:
> ****************************************
> > >
> > > 04/23 20:52:26.205 metplus.TCPairs (command_builder.py:122)
ERROR:
> > > (tc_pairs_wrapper.py:489) No BDECK files found searching for
basin ??
> and
> > > cyclone * using template
> > >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> > >
> > > 04/23 20:52:26.205 metplus INFO:
> ****************************************
> > >
> > > 04/23 20:52:26.205 metplus INFO: * Running METplus
> > >
> > > 04/23 20:52:26.205 metplus INFO: * at init time: 202007240600
> > >
> > > 04/23 20:52:26.205 metplus INFO:
> ****************************************
> > >
> > > 04/23 20:52:26.207 metplus.TCPairs (command_builder.py:122)
ERROR:
> > > (tc_pairs_wrapper.py:489) No BDECK files found searching for
basin ??
> and
> > > cyclone * using template
> > >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> > >
> > > 04/23 20:52:26.207 metplus INFO:
> ****************************************
> > >
> > > 04/23 20:52:26.207 metplus INFO: * Running METplus
> > >
> > > 04/23 20:52:26.207 metplus INFO: * at init time: 202007241200
> > >
> > > 04/23 20:52:26.208 metplus INFO:
> ****************************************
> > >
> > > 04/23 20:52:26.209 metplus.TCPairs (command_builder.py:122)
ERROR:
> > > (tc_pairs_wrapper.py:489) No BDECK files found searching for
basin ??
> and
> > > cyclone * using template
> > >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> > >
> > > 04/23 20:52:26.209 metplus INFO:
> ****************************************
> > >
> > > 04/23 20:52:26.210 metplus INFO: * Running METplus
> > >
> > > 04/23 20:52:26.210 metplus INFO: * at init time: 202007241800
> > >
> > > 04/23 20:52:26.210 metplus INFO:
> ****************************************
> > >
> > > 04/23 20:52:26.211 metplus.TCPairs (command_builder.py:122)
ERROR:
> > > (tc_pairs_wrapper.py:489) No BDECK files found searching for
basin ??
> and
> > > cyclone * using template
> > >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> > >
> > > 04/23 20:52:26.212 metplus.TCPairs (met_util.py:210) ERROR:
TCPairs had
> > 16
> > > errors.
> > >
> > > 04/23 20:52:26.212 metplus INFO:
> > > /lfs1/BMC/amb-verif/vhtest/output/metplus_final.conf: write
> metplus.conf
> > > here
> > >
> > > 04/23 20:52:26.216 metplus (met_util.py:246) ERROR: METplus has
> finished
> > > running but had 16 errors.
> > >
> > > 04/23 20:52:26.216 metplus INFO: Check the log file for more
> information:
> > >
> /lfs1/BMC/amb-
verif/vhtest/output/logs/master_metplus.log.20210423205222
> > >
> > >
> > >
> > > Please let me know if you need additional information.
> > >
> > > Thank you,
> > > Venita
> > >
> > > --
> > > Venita Hagerty, PhD
> > > Research Associate
> > > CIRA at NOAA, GSL/AVID
> > > 2B152, x6098
> > >
> > >
> >
> >
>
> --
> Venita Hagerty, PhD
> Research Associate
> CIRA at NOAA, GSL/AVID
> 2B152, x6098
>
>
------------------------------------------------
Subject: Help with running TC Pairs with METplus wrappers on Jet
From: John Halley Gotway
Time: Mon Apr 26 16:18:22 2021
Venita,
FYI, here's the GitHub issue describing the edeck parsing logic issue:
https://github.com/dtcenter/MET/issues/1768
I actually have a fix ready for it. So as long as I call it a bug, I
should
be able to commit it in the RC1 release.
Thanks,
John
On Mon, Apr 26, 2021 at 2:55 PM John Halley Gotway <johnhg at ucar.edu>
wrote:
> Venita,
>
> I'm looking in your METplus log file:
> /lfs1/BMC/amb-
verif/vhtest/output/logs/master_metplus.log.20210423205222
>
> And I see 18 attempted calls to the tc_pairs wrapper along with 18
error
> messages:
>
> *ERROR: (tc_pairs_wrapper.py:489) No BDECK files found searching for
basin
> ?? and cyclone * using template
>
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat*
>
> So I suspect you really have 2 questions here.
> (1) How can I run tc_pairs with -adeck, -edeck, and -bdeck inputs
and get
> both TCMPR and PROBRIRW output?
> (2) The TC-Pairs wrapper in METplus isn't working with my data. Why
not?
>
> For (1), yes, that should work. But when I run tc_pairs manually
with the
> edeck data, I see some telling log messages:
>
> *cd
/misc/whome/John.H.Gotway/MET_Help/hagerty_data_20210426/tc_pairs*
>
> */contrib/met/9.1/bin/tc_pairs -edeck edeck/2020072112.eep072020.dat
> -bdeck bdeck/ -config TCPairsConfig -v 3*
>
>
>
>
> *DEBUG 2: Processing 1 EDECK file(s).WARNING: WARNING: int
> ATCFProbLine::read_line(LineDataFile * ldf) -> unexpected ATCF line
type
> (ProbGN)WARNING: DEBUG 3: Used 0 of 0 lines read from 1 file(s).*
>
> And that WARNING message triggers it to stop reading data from that
file.
> So really I need to fix logic to just ignore those unsupported
probability
> line types. As a temporary workaround, I just grepped out the "RI"
line
> types.
>
> grep RI edeck/2020072112.eep072020.dat > 2020072112.eep072020_RI.dat
>
> And then I do get PROBRIRW lines in the output:
>
> cat
/misc/whome/John.H.Gotway/MET_Help/hagerty_data_20210426/tc_pairs/tc_pairs_PROBRIRW.tcst
>
> I'll write up a GitHub issue to make tc_pairs just ignore those
> unsupported line types.
>
> For (2), it looks like you have an 'e' and 'b' transposed in your
settings.
>
> grep DECK_TEMPLATE /lfs1/BMC/amb-
verif/vhtest/output/metplus_final.conf
> TC_PAIRS_ADECK_TEMPLATE = tctrk.atcf.{date?fmt=%Y%m%d%H}.gcp1.txt
> TC_PAIRS_EDECK_TEMPLATE =
> {date?fmt=%Y%m%d%H}.b{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> TC_PAIRS_BDECK_TEMPLATE =
> {date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
>
> I suspect that's not the only problem but it certainly is one of
them.
>
> I'd recommend configuring METplus using:
> LOG_LEVEL = DEBUG
> To print more log messages... until you're satisfied it's doing
exactly
> what you want.
>
> Thanks,
> John
>
> On Mon, Apr 26, 2021 at 9:39 AM venita.hagerty at noaa.gov via RT <
> met_help at ucar.edu> wrote:
>
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99708 >
>>
>> I am working on Jet.
>>
>> Venita
>>
>> On Mon, Apr 26, 2021 at 9:36 AM John Halley Gotway via RT <
>> met_help at ucar.edu>
>> wrote:
>>
>> > Hi Venita,
>> >
>> > This is John HG... I'm on met-help desk on Mondays.
>> >
>> > I see you're having trouble getting PROBRIRW output from TC-
Pairs.
>> Thanks
>> > for sending all the details about your runtime environment.
There's
>> nothing
>> > obvious off the bat that strikes me as a reason for not getting
paired
>> > output. If I have access to the machine on which you're running,
I'll
>> just
>> > log on and take a closer look. Ideally, I'd like to boil this
down to...
>> > here's a single call to TC-Pairs that yields no PROBRIRW output
lines
>> and
>> > we think it should. And hopefully then we can figure out why it
is not!
>> >
>> > I see all the path info, but don't actually see the machine name.
I'm
>> > guessing it's either Hera or Jet. Can you please confirm which?
>> >
>> > FYI, I'm working on the beta5 release for MET today but should be
able
>> to
>> > look at this as well.
>> >
>> > Thanks,
>> > John
>> >
>> > On Mon, Apr 26, 2021 at 8:44 AM venita.hagerty at noaa.gov via RT <
>> > met_help at ucar.edu> wrote:
>> >
>> > >
>> > > Mon Apr 26 08:44:39 2021: Request 99708 was acted upon.
>> > > Transaction: Ticket created by venita.hagerty at noaa.gov
>> > > Queue: met_help
>> > > Subject: Help with running TC Pairs with METplus wrappers
on Jet
>> > > Owner: Nobody
>> > > Requestors: venita.hagerty at noaa.gov
>> > > Status: new
>> > > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99708
>> >
>> > >
>> > >
>> > > I need to run TC Pairs with a-decks, b-decks, and e-decks so
that I
>> get
>> > > both TCMPR and PROBRIRW line types. I am able to run and get
TCMPR
>> line
>> > > types, but not TCMPR.
>> > >
>> > > I am getting b-decks and e-decks from NHC off of our /public
drive. I
>> am
>> > > getting a-decks from Judy Henderson, which have been run
through the
>> GFDL
>> > > tracker and are in ATCF format.
>> > >
>> > > I can run TC Pairs with a-decks and b-decks and get TCMPR data.
I
>> added
>> > an
>> > > e-deck, and got errors and no PROBRIRW output. I don't know if
I can
>> run
>> > > all 3 types of decks at once, or if this needs to be two
separate
>> jobs. I
>> > > think I have matching dates. I may have something set wrong in
the
>> config
>> > > files.
>> > >
>> > > *** My loads:
>> > >
>> > > module purge
>> > >
>> > > module load intel
>> > >
>> > > module load intelpython/3.6.5
>> > >
>> > > module load netcdf/4.6.1
>> > >
>> > > module load hdf5/1.10.4
>> > >
>> > > module load nco/4.9.1
>> > >
>> > > module load wgrib/1.8.1.0b
>> > >
>> > > module load wgrib2/2.0.8
>> > >
>> > > module load R/3.6.1
>> > >
>> > > module load contrib
>> > >
>> > > module use /contrib/met/modulefiles
>> > >
>> > > module load met/9.1
>> > >
>> > > module use /contrib/met/METplus/modulefiles
>> > >
>> > > module load metplus/3.1.1
>> > >
>> > >
>> > > *** my_user_config.conf:
>> > >
>> > >
>> > > # This is a comment, comments are defined with a # at the
beginning of
>> > the
>> > > line
>> > >
>> > >
>> > > # Set the MET_INSTALL_DIR to the location of the MET install
>> > >
>> > > [dir]
>> > >
>> > > MET_INSTALL_DIR = /contrib/met/9.1/met-9.1.1
>> > >
>> > > MET_BIN_DIR = /contrib/met/9.1/met-
9.1.1/src/tools/tc_utils/tc_pairs
>> > >
>> > >
>> > > # Set INPUT_BASE to the directory containing sample input data
if
>> running
>> > > use cases in the repository
>> > >
>> > > # Otherwise set INPUT_BASE to any path that does not contain
/path/to.
>> > >
>> > > INPUT_BASE = /lfs1/BMC/amb-verif/vhtest
>> > >
>> > >
>> > > # Set OUTPUT_BASE to a directory where you have permission to
write
>> > output
>> > > files
>> > >
>> > > # It will be created if it does not exist
>> > >
>> > > OUTPUT_BASE = /lfs1/BMC/amb-verif/vhtest/output
>> > >
>> > >
>> > > *** TCPairs_jet.conf:
>> > >
>> > >
>> > > #
>> > >
>> > > # CONFIGURATION
>> > >
>> > > #
>> > >
>> > > [config]
>> > >
>> > >
>> > > # Looping by times: steps through each 'task' in the
PROCESS_LIST for
>> > each
>> > >
>> > > # defined time, and repeats until all times have been
evaluated.
>> > >
>> > > LOOP_ORDER = times
>> > >
>> > >
>> > > # Configuration files
>> > >
>> > > TC_PAIRS_CONFIG_FILE =
{PARM_BASE}/met_config/TCPairsConfig_wrapped
>> > >
>> > >
>> > > # 'Tasks' to be run
>> > >
>> > > PROCESS_LIST = TCPairs
>> > >
>> > >
>> > > LOOP_BY = INIT
>> > >
>> > >
>> > > # The init time begin and end times, increment, and last init
hour.
>> > >
>> > > INIT_TIME_FMT = %Y%m%d%H
>> > >
>> > > INIT_BEG = 2020072100
>> > >
>> > > INIT_END = 2020072418
>> > >
>> > >
>> > > # This is the step-size. Increment in seconds from the begin
time to
>> the
>> > > end time
>> > >
>> > > # set to 6 hours = 21600 seconds
>> > >
>> > > INIT_INCREMENT = 21600
>> > >
>> > >
>> > > # A list of times to include, in format YYYYMMDD_hh
>> > >
>> > > INIT_INCLUDE =
>> > >
>> > >
>> > > # A list of times to exclude, in format YYYYMMDD_hh
>> > >
>> > > INIT_EXCLUDE =
>> > >
>> > >
>> > > #
>> > >
>> > > # Specify model valid time window in format YYYYMM[DD[_hh]].
Only
>> tracks
>> > > that fall within the valid time window will
>> > >
>> > > # be used.
>> > >
>> > > #
>> > >
>> > > VALID_BEG =
>> > >
>> > > VALID_END =
>> > >
>> > >
>> > > #
>> > >
>> > > # Run MET tc_pairs by indicating the top-level directories for
the
>> A-deck
>> > > and B-deck files. Set to 'yes' to
>> > >
>> > > # run using top-level directories, 'no' if you want to run
tc_pairs on
>> > > files paired by the wrapper.
>> > >
>> > > TC_PAIRS_READ_ALL_FILES = no
>> > >
>> > >
>> > > # set to true or yes to reformat track data into ATCF format
expected
>> by
>> > > tc_pairs
>> > >
>> > > TC_PAIRS_REFORMAT_DECK = no
>> > >
>> > >
>> > > # OVERWRITE OPTIONS
>> > >
>> > > # Don't overwrite filter files if they already exist.
>> > >
>> > > # Set to yes if you do NOT want to override existing files
>> > >
>> > > # Set to no if you do want to override existing files
>> > >
>> > > TC_PAIRS_SKIP_IF_OUTPUT_EXISTS = no
>> > >
>> > >
>> > > #
>> > >
>> > > # MET TC-Pairs
>> > >
>> > > #
>> > >
>> > > # List of models to be used (white space or comma separated)
eg: DSHP,
>> > > LGEM, HWRF
>> > >
>> > > # If no models are listed, then process all models in the input
>> file(s).
>> > >
>> > > MODEL =
>> > >
>> > >
>> > > # List of storm ids of interest (space or comma separated)
e.g.:
>> > AL112012,
>> > > AL122012
>> > >
>> > > # If no storm ids are listed, then process all storm ids in the
input
>> > > file(s).
>> > >
>> > > #TC_PAIRS_STORM_ID = ML2092014
>> > >
>> > > #TC_PAIRS_STORM_ID = al062018, al092018, al132018, al142018
>> > >
>> > >
>> > > # Basins (of origin/region). Indicate with space or comma-
separated
>> list
>> > > of regions, eg. AL: for North Atlantic,
>> > >
>> > > # WP: Western North Pacific, CP: Central North Pacific, SH:
Southern
>> > > Hemisphere, IO: North Indian Ocean, LS: Southern
>> > >
>> > > # Hemisphere
>> > >
>> > > #TC_PAIRS_BASIN = AL
>> > >
>> > > TC_PAIRS_BASIN =
>> > >
>> > >
>> > > # Cyclone, a space or comma-separated list of cyclone numbers.
If left
>> > > empty, all cyclones will be used.
>> > >
>> > > TC_PAIRS_CYCLONE =
>> > >
>> > > #TC_PAIRS_CYCLONE = 06
>> > >
>> > >
>> > > # Storm name, a space or comma-separated list of storm names to
>> evaluate.
>> > > If
>> > > left empty, all storms will be used.
>> > >
>> > > TC_PAIRS_STORM_NAME =
>> > >
>> > >
>> > > # DLAND file, the full path of the file that contains the
gridded
>> > > representation of the
>> > >
>> > > # minimum distance from land.
>> > >
>> > > TC_PAIRS_DLAND_FILE =
MET_BASE/tc_data/dland_global_tenth_degree.nc
>> > >
>> > >
>> > >
>> > > #
>> > >
>> > > # DIRECTORIES
>> > >
>> > > #
>> > >
>> > > [dir]
>> > >
>> > > # Location of input track data directory
>> > >
>> > > # for ADECK and BDECK data
>> > >
>> > > TC_PAIRS_ADECK_INPUT_DIR = /lfs1/BMC/amb-verif/vhtest/adeck
>> > >
>> > > TC_PAIRS_EDECK_INPUT_DIR = /lfs1/BMC/amb-verif/vhtest/edeck
>> > >
>> > > TC_PAIRS_BDECK_INPUT_DIR = /lfs1/BMC/amb-verif/vhtest/bdeck
>> > >
>> > >
>> > > TC_PAIRS_OUTPUT_DIR = {OUTPUT_BASE}/tc_pairs
>> > >
>> > >
>> > > [filename_templates]
>> > >
>> > > TC_PAIRS_ADECK_TEMPLATE =
tctrk.atcf.{date?fmt=%Y%m%d%H}.gcp1.txt
>> > >
>> > > TC_PAIRS_EDECK_TEMPLATE =
>> > >
{date?fmt=%Y%m%d%H}.b{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
>> > >
>> > > TC_PAIRS_BDECK_TEMPLATE =
>> > >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
>> > >
>> > > TC_PAIRS_OUTPUT_TEMPLATE =
>> tc_pairs_{basin?fmt=%s}{date?fmt=%Y%m%d%H}.dat
>> > >
>> > >
>> > > *** my input files:
>> > >
>> > >
>> > > adeck:
>> > >
>> > > total 96
>> > >
>> > > -rw-r--r-- 1 amb-verif amb-verif 20560 Apr 12 19:33
>> > > tctrk.atcf.2020072100.gcp1.txt
>> > >
>> > > -rw-r--r-- 1 amb-verif amb-verif 39578 Apr 14 15:57
>> > > tctrk.atcf.2020072300.gcp1.txt
>> > >
>> > > -rw-r--r-- 1 amb-verif amb-verif 30326 Apr 14 15:57
>> > > tctrk.atcf.2020072400.gcp1.txt
>> > >
>> > >
>> > > bdeck:
>> > >
>> > > total 224
>> > >
>> > > -rw-r--r-- 1 amb-verif amb-verif 997 Apr 12 19:32
>> > 2020051418.bal902020.dat
>> > >
>> > > -rw-r--r-- 1 amb-verif amb-verif 1547 Apr 12 19:32
>> > 2020072100.bal902020.dat
>> > >
>> > > -rw-r--r-- 1 amb-verif amb-verif 1547 Apr 12 19:32
>> > 2020072100.bal992020.dat
>> > >
>> > > -rw-r--r-- 1 amb-verif amb-verif 3165 Apr 12 19:32
>> > 2020072100.bep072020.dat
>> > >
>> > > -rw-r--r-- 1 amb-verif amb-verif 2447 Apr 12 19:32
>> > 2020072100.bep082020.dat
>> > >
>> > > -rw-r--r-- 1 amb-verif amb-verif 1763 Apr 12 19:32
>> > 2020072106.bal992020.dat
>> > >
>> > > -rw-r--r-- 1 amb-verif amb-verif 3381 Apr 12 19:32
>> > 2020072106.bep072020.dat
>> > >
>> > > -rw-r--r-- 1 amb-verif amb-verif 2879 Apr 12 19:32
>> > 2020072106.bep082020.dat
>> > >
>> > > -rw-r--r-- 1 amb-verif amb-verif 1979 Apr 12 19:32
>> > 2020072112.bal992020.dat
>> > >
>> > > -rw-r--r-- 1 amb-verif amb-verif 3597 Apr 12 19:32
>> > 2020072112.bep072020.dat
>> > >
>> > > -rw-r--r-- 1 amb-verif amb-verif 1980 Apr 12 19:32
>> > 2020072112.bep082020.dat
>> > >
>> > > -rw-r--r-- 1 amb-verif amb-verif 2231 Apr 12 19:32
>> > 2020072118.bal072020.dat
>> > >
>> > > -rw-r--r-- 1 amb-verif amb-verif 1115 Apr 12 19:32
>> > 2020072118.bal912020.dat
>> > >
>> > > -rw-r--r-- 1 amb-verif amb-verif 2195 Apr 12 19:32
>> > 2020072118.bal992020.dat
>> > >
>> > > -rw-r--r-- 1 amb-verif amb-verif 2412 Apr 12 19:32
>> > 2020072118.bep082020.dat
>> > >
>> > > -rw-r--r-- 1 amb-verif amb-verif 2663 Jul 23 2020
>> > 2020072300.bal072020.dat
>> > >
>> > > -rw-r--r-- 1 amb-verif amb-verif 2231 Jul 23 2020
>> > 2020072300.bal082020.dat
>> > >
>> > > -rw-r--r-- 1 amb-verif amb-verif 2195 Jul 23 2020
>> > 2020072300.bal912020.dat
>> > >
>> > > -rw-r--r-- 1 amb-verif amb-verif 5004 Jul 23 2020
>> > 2020072300.bep082020.dat
>> > >
>> > > -rw-r--r-- 1 amb-verif amb-verif 3095 Jul 23 2020
>> > 2020072306.bal072020.dat
>> > >
>> > > -rw-r--r-- 1 amb-verif amb-verif 2447 Jul 23 2020
>> > 2020072306.bal082020.dat
>> > >
>> > > -rw-r--r-- 1 amb-verif amb-verif 5652 Jul 23 2020
>> > 2020072306.bep082020.dat
>> > >
>> > > -rw-r--r-- 1 amb-verif amb-verif 3527 Jul 23 2020
>> > 2020072312.bal072020.dat
>> > >
>> > > -rw-r--r-- 1 amb-verif amb-verif 2663 Jul 23 2020
>> > 2020072312.bal082020.dat
>> > >
>> > > -rw-r--r-- 1 amb-verif amb-verif 6300 Jul 23 2020
>> > 2020072312.bep082020.dat
>> > >
>> > > -rw-r--r-- 1 amb-verif amb-verif 3959 Jul 23 2020
>> > 2020072318.bal072020.dat
>> > >
>> > > -rw-r--r-- 1 amb-verif amb-verif 2879 Jul 23 2020
>> > 2020072318.bal082020.dat
>> > >
>> > > -rw-r--r-- 1 amb-verif amb-verif 6948 Jul 23 2020
>> > 2020072318.bep082020.dat
>> > >
>> > > -rw-r--r-- 1 amb-verif amb-verif 4391 Jul 24 2020
>> > 2020072400.bal072020.dat
>> > >
>> > > -rw-r--r-- 1 amb-verif amb-verif 3095 Jul 24 2020
>> > 2020072400.bal082020.dat
>> > >
>> > > -rw-r--r-- 1 amb-verif amb-verif 7596 Jul 24 2020
>> > 2020072400.bep082020.dat
>> > >
>> > > -rw-r--r-- 1 amb-verif amb-verif 4823 Jul 24 2020
>> > 2020072406.bal072020.dat
>> > >
>> > > -rw-r--r-- 1 amb-verif amb-verif 3311 Jul 24 2020
>> > 2020072406.bal082020.dat
>> > >
>> > > -rw-r--r-- 1 amb-verif amb-verif 8244 Jul 24 2020
>> > 2020072406.bep082020.dat
>> > >
>> > > -rw-r--r-- 1 amb-verif amb-verif 5039 Jul 24 2020
>> > 2020072412.bal072020.dat
>> > >
>> > > -rw-r--r-- 1 amb-verif amb-verif 2412 Jul 24 2020
>> > 2020072412.bal082020.dat
>> > >
>> > > -rw-r--r-- 1 amb-verif amb-verif 8892 Jul 24 2020
>> > 2020072412.bep082020.dat
>> > >
>> > > -rw-r--r-- 1 amb-verif amb-verif 5255 Jul 24 2020
>> > 2020072418.bal072020.dat
>> > >
>> > > -rw-r--r-- 1 amb-verif amb-verif 2628 Jul 24 2020
>> > 2020072418.bal082020.dat
>> > >
>> > > -rw-r--r-- 1 amb-verif amb-verif 1115 Jul 24 2020
>> > 2020072418.bal922020.dat
>> > >
>> > > -rw-r--r-- 1 amb-verif amb-verif 9540 Jul 24 2020
>> > 2020072418.bep082020.dat
>> > >
>> > >
>> > > edeck:
>> > >
>> > > total 124
>> > >
>> > > -rw-r--r-- 1 amb-verif amb-verif 121621 Apr 23 20:44
>> > > 2020072112.eep072020.dat
>> > >
>> > >
>> > > some of the data:
>> > >
>> > >
>> > > head -3 adeck/tctrk.atcf.2020072100.gcp1.txt
>> > >
>> > > AL, 99, 2020072100, 03, GCP1, 000, 89N, 381W, 22, 1010, XX,
34,
>> NEQ,
>> > > 0000, 0000, 0000, 0000, -99, -99, 34, 0, 0, , 0,
, 0,
>> > 0,
>> > > , , , , 0, 0, 0, 0, THERMO PARAMS,
>> > > -12, 225,
>> > > -30, N, 10, DT, -999
>> > >
>> > > AL, 90, 2020072100, 03, GCP1, 000, 275N, 954W, 22, 1008, XX,
34,
>> NEQ,
>> > > 0000, 0000, 0000, 0000, -99, -99, 117, 0, 0, , 0,
, 0,
>> > 0,
>> > > , , , , 0, 0, 0, 0, THERMO PARAMS,
>> -31,
>> > > 326, -226, N, 10, DT, -999
>> > >
>> > > EP, 07, 2020072100, 03, GCP1, 000, 193N, 1318W, 38, 1007, XX,
34,
>> NEQ,
>> > > 0032, 0000, 0000, 0029, 1011, 52, 25, 0, 0, , 0,
, 0,
>> > 0,
>> > > , , , , 0, 0, 0, 0, THERMO PARAMS,
>> > > 34, 274,
>> > > 378, Y, 10, DT, -999
>> > >
>> > >
>> > > head -3 bdeck/2020072112.bep082020.dat
>> > >
>> > > EP, 08, 2020072000, , BEST, 0, 148N, 1188W, 25, 1008, LO,
0,
>> ,
>> > > 0, 0, 0, 0, 1011, 100, 40, 0, 0, E, 0, ,
0,
>> 0,
>> > > INVEST, S, 0, , 0, 0, 0, 0, genesis-num, 014,
>> > >
>> > > EP, 08, 2020072006, , BEST, 0, 143N, 1192W, 25, 1008, LO,
0,
>> ,
>> > > 0, 0, 0, 0, 1011, 100, 30, 35, 0, E, 0, ,
0,
>> 0,
>> > > INVEST, M, 0, , 0, 0, 0, 0, genesis-num, 014,
>> > >
>> > > EP, 08, 2020072012, , BEST, 0, 139N, 1194W, 30, 1008, TD,
0,
>> ,
>> > > 0, 0, 0, 0, 1011, 100, 30, 40, 0, E, 0, ,
0,
>> 0,
>> > > INVEST, M, 0, , 0, 0, 0, 0, genesis-num, 014,
>> > > TRANSITIONED, epB02020 to ep082020,
>> > >
>> > >
>> > > head -3 edeck/2020072112.eep072020.dat
>> > >
>> > > EP, 07, 2020071206, GN, OFCL, 48, , , 0, 48, ESB,
>> genFcst,
>> > ,
>> > > ,
>> > > 0, 013,
>> > >
>> > > EP, 07, 2020071206, GN, OFCL, 120, , , 0, 120, ESB,
>> genFcst,
>> > ,
>> > > ,
>> > > 0, 013,
>> > >
>> > > EP, 07, 2020071206, GN, OFCL, 168, , , 10, 168, ESB,
>> genFcst,
>> > ,
>> > > ,
>> > > 0, 013,
>> > >
>> > >
>> > > *** metplus_final.conf:
>> > >
>> > >
>> > > [config]
>> > >
>> > > CLOCK_TIME = 20210423205222
>> > >
>> > > LOOP_ORDER = times
>> > >
>> > > PROCESS_LIST = TCPairs
>> > >
>> > > METPLUS_CONF = {OUTPUT_BASE}/metplus_final.conf
>> > >
>> > > LOG_METPLUS =
>> > >
>> /lfs1/BMC/amb-
verif/vhtest/output/logs/master_metplus.log.20210423205222
>> > >
>> > > LOG_TIMESTAMP_TEMPLATE = %Y%m%d%H%M%S
>> > >
>> > > LOG_LINE_FORMAT = %(asctime)s.%(msecs)03d %(name)s
>> > > (%(filename)s:%(lineno)d) %(levelname)s: %(message)s
>> > >
>> > > LOG_ERR_LINE_FORMAT = {LOG_LINE_FORMAT}
>> > >
>> > > LOG_DEBUG_LINE_FORMAT = {LOG_LINE_FORMAT}
>> > >
>> > > LOG_INFO_LINE_FORMAT = %(asctime)s.%(msecs)03d %(name)s
%(levelname)s:
>> > > %(message)s
>> > >
>> > > LOG_LINE_DATE_FORMAT = %m/%d %H:%M:%S
>> > >
>> > > LOG_TIMESTAMP_USE_DATATIME = no
>> > >
>> > > LOG_MET_OUTPUT_TO_METPLUS = yes
>> > >
>> > > LOG_MET_VERBOSITY = 2
>> > >
>> > > LOG_LEVEL = INFO
>> > >
>> > > TC_PAIRS_CONFIG_FILE =
{PARM_BASE}/met_config/TCPairsConfig_wrapped
>> > >
>> > > LOOP_BY = INIT
>> > >
>> > > INIT_TIME_FMT = %Y%m%d%H
>> > >
>> > > INIT_BEG = 2020072100
>> > >
>> > > INIT_END = 2020072418
>> > >
>> > > INIT_INCREMENT = 21600
>> > >
>> > > INIT_INCLUDE =
>> > >
>> > > INIT_EXCLUDE =
>> > >
>> > > VALID_BEG =
>> > >
>> > > VALID_END =
>> > >
>> > > TC_PAIRS_READ_ALL_FILES = no
>> > >
>> > > TC_PAIRS_REFORMAT_DECK = no
>> > >
>> > > TC_PAIRS_SKIP_IF_OUTPUT_EXISTS = no
>> > >
>> > > MODEL =
>> > >
>> > > TC_PAIRS_BASIN =
>> > >
>> > > TC_PAIRS_CYCLONE =
>> > >
>> > > TC_PAIRS_STORM_NAME =
>> > >
>> > > TC_PAIRS_DLAND_FILE =
MET_BASE/tc_data/dland_global_tenth_degree.nc
>> > >
>> > > LOG_TIMESTAMP = 20210423205222
>> > >
>> > > METPLUS_CONFIG_FILES = ./my_user_config.conf,./TCPairs_jet.conf
>> > >
>> > > METPLUS_VERSION = 3.1.1
>> > >
>> > > CURRENT_FCST_NAME =
>> > >
>> > > CURRENT_OBS_NAME =
>> > >
>> > > CURRENT_FCST_LEVEL =
>> > >
>> > > CURRENT_OBS_LEVEL =
>> > >
>> > > USER_SHELL = bash
>> > >
>> > > DO_NOT_RUN_EXE = False
>> > >
>> > > TC_PAIRS_SKIP_TIMES =
>> > >
>> > > SKIP_TIMES =
>> > >
>> > > USE_EXPLICIT_NAME_AND_LEVEL = False
>> > >
>> > > LOG_TC_PAIRS_VERBOSITY = 2
>> > >
>> > > TC_PAIRS_MISSING_VAL_TO_REPLACE = -99
>> > >
>> > > TC_PAIRS_MISSING_VAL = -9999
>> > >
>> > > TC_PAIRS_STORM_ID =
>> > >
>> > > TC_PAIRS_SKIP_IF_REFORMAT_EXISTS = False
>> > >
>> > > TC_PAIRS_REFORMAT_TYPE = SBU
>> > >
>> > > SCRUB_STAGING_DIR = False
>> > >
>> > >
>> > > [dir]
>> > >
>> > > OUTPUT_BASE = /lfs1/BMC/amb-verif/vhtest/output
>> > >
>> > > STAGING_DIR = {OUTPUT_BASE}/stage
>> > >
>> > > MET_INSTALL_DIR = /contrib/met/9.1/met-9.1.1
>> > >
>> > > MET_BIN_DIR = /contrib/met/9.1/met-
9.1.1/src/tools/tc_utils/tc_pairs
>> > >
>> > > LOG_DIR = {OUTPUT_BASE}/logs
>> > >
>> > > TMP_DIR = {OUTPUT_BASE}/tmp
>> > >
>> > > INPUT_BASE = /lfs1/BMC/amb-verif/vhtest
>> > >
>> > > TC_PAIRS_ADECK_INPUT_DIR = /lfs1/BMC/amb-verif/vhtest/adeck
>> > >
>> > > TC_PAIRS_EDECK_INPUT_DIR = /lfs1/BMC/amb-verif/vhtest/edeck
>> > >
>> > > TC_PAIRS_BDECK_INPUT_DIR = /lfs1/BMC/amb-verif/vhtest/bdeck
>> > >
>> > > TC_PAIRS_OUTPUT_DIR = {OUTPUT_BASE}/tc_pairs
>> > >
>> > > METPLUS_BASE = /contrib/met/METplus/METplus-3.1.1
>> > >
>> > > PARM_BASE = /contrib/met/METplus/METplus-3.1.1/parm
>> > >
>> > > TC_PAIRS_REFORMAT_DIR =
>> /lfs1/BMC/amb-verif/vhtest/output/track_data_atcf
>> > >
>> > >
>> > > [exe]
>> > >
>> > > RM = rm
>> > >
>> > > CUT = cut
>> > >
>> > > TR = tr
>> > >
>> > > NCAP2 = ncap2
>> > >
>> > > CONVERT = convert
>> > >
>> > > NCDUMP = ncdump
>> > >
>> > >
>> > > [filename_templates]
>> > >
>> > > TC_PAIRS_ADECK_TEMPLATE =
tctrk.atcf.{date?fmt=%Y%m%d%H}.gcp1.txt
>> > >
>> > > TC_PAIRS_EDECK_TEMPLATE =
>> > >
{date?fmt=%Y%m%d%H}.b{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
>> > >
>> > > TC_PAIRS_BDECK_TEMPLATE =
>> > >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
>> > >
>> > > TC_PAIRS_OUTPUT_TEMPLATE =
>> tc_pairs_{basin?fmt=%s}{date?fmt=%Y%m%d%H}.dat
>> > >
>> > >
>> > > [user_env_vars]
>> > >
>> > >
>> > > *** My Log:
>> > >
>> > >
>> > > 04/23 20:52:22.576 metplus INFO: Running METplus v3.1.1 called
with
>> > > command: /contrib/met/METplus/METplus-
3.1.1/ush/master_metplus.py -c
>> > > ./my_user_config.conf -c ./TCPairs_jet.conf
>> > >
>> > > 04/23 20:52:22.577 metplus INFO: Log file:
>> > >
>> /lfs1/BMC/amb-
verif/vhtest/output/logs/master_metplus.log.20210423205222
>> > >
>> > > 04/23 20:52:26.077 metplus INFO:
>> ****************************************
>> > >
>> > > 04/23 20:52:26.077 metplus INFO: * Running METplus
>> > >
>> > > 04/23 20:52:26.077 metplus INFO: * at init time: 202007210000
>> > >
>> > > 04/23 20:52:26.077 metplus INFO:
>> ****************************************
>> > >
>> > > 04/23 20:52:26.178 metplus.TCPairs (command_builder.py:122)
ERROR:
>> > > (tc_pairs_wrapper.py:489) No BDECK files found searching for
basin ??
>> and
>> > > cyclone * using template
>> > >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
>> > >
>> > > 04/23 20:52:26.179 metplus INFO:
>> ****************************************
>> > >
>> > > 04/23 20:52:26.179 metplus INFO: * Running METplus
>> > >
>> > > 04/23 20:52:26.179 metplus INFO: * at init time: 202007210600
>> > >
>> > > 04/23 20:52:26.179 metplus INFO:
>> ****************************************
>> > >
>> > > 04/23 20:52:26.181 metplus.TCPairs (command_builder.py:122)
ERROR:
>> > > (tc_pairs_wrapper.py:489) No BDECK files found searching for
basin ??
>> and
>> > > cyclone * using template
>> > >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
>> > >
>> > > 04/23 20:52:26.181 metplus INFO:
>> ****************************************
>> > >
>> > > 04/23 20:52:26.181 metplus INFO: * Running METplus
>> > >
>> > > 04/23 20:52:26.181 metplus INFO: * at init time: 202007211200
>> > >
>> > > 04/23 20:52:26.181 metplus INFO:
>> ****************************************
>> > >
>> > > 04/23 20:52:26.183 metplus.TCPairs (command_builder.py:122)
ERROR:
>> > > (tc_pairs_wrapper.py:489) No BDECK files found searching for
basin ??
>> and
>> > > cyclone * using template
>> > >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
>> > >
>> > > 04/23 20:52:26.183 metplus INFO:
>> ****************************************
>> > >
>> > > 04/23 20:52:26.183 metplus INFO: * Running METplus
>> > >
>> > > 04/23 20:52:26.184 metplus INFO: * at init time: 202007211800
>> > >
>> > > 04/23 20:52:26.184 metplus INFO:
>> ****************************************
>> > >
>> > > 04/23 20:52:26.185 metplus.TCPairs (command_builder.py:122)
ERROR:
>> > > (tc_pairs_wrapper.py:489) No BDECK files found searching for
basin ??
>> and
>> > > cyclone * using template
>> > >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
>> > >
>> > > 04/23 20:52:26.185 metplus INFO:
>> ****************************************
>> > >
>> > > 04/23 20:52:26.186 metplus INFO: * Running METplus
>> > >
>> > > 04/23 20:52:26.186 metplus INFO: * at init time: 202007220000
>> > >
>> > > 04/23 20:52:26.186 metplus INFO:
>> ****************************************
>> > >
>> > > 04/23 20:52:26.187 metplus.TCPairs (command_builder.py:122)
ERROR:
>> > > (tc_pairs_wrapper.py:489) No BDECK files found searching for
basin ??
>> and
>> > > cyclone * using template
>> > >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
>> > >
>> > > 04/23 20:52:26.188 metplus INFO:
>> ****************************************
>> > >
>> > > 04/23 20:52:26.188 metplus INFO: * Running METplus
>> > >
>> > > 04/23 20:52:26.188 metplus INFO: * at init time: 202007220600
>> > >
>> > > 04/23 20:52:26.188 metplus INFO:
>> ****************************************
>> > >
>> > > 04/23 20:52:26.190 metplus.TCPairs (command_builder.py:122)
ERROR:
>> > > (tc_pairs_wrapper.py:489) No BDECK files found searching for
basin ??
>> and
>> > > cyclone * using template
>> > >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
>> > >
>> > > 04/23 20:52:26.190 metplus INFO:
>> ****************************************
>> > >
>> > > 04/23 20:52:26.190 metplus INFO: * Running METplus
>> > >
>> > > 04/23 20:52:26.190 metplus INFO: * at init time: 202007221200
>> > >
>> > > 04/23 20:52:26.190 metplus INFO:
>> ****************************************
>> > >
>> > > 04/23 20:52:26.192 metplus.TCPairs (command_builder.py:122)
ERROR:
>> > > (tc_pairs_wrapper.py:489) No BDECK files found searching for
basin ??
>> and
>> > > cyclone * using template
>> > >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
>> > >
>> > > 04/23 20:52:26.192 metplus INFO:
>> ****************************************
>> > >
>> > > 04/23 20:52:26.192 metplus INFO: * Running METplus
>> > >
>> > > 04/23 20:52:26.192 metplus INFO: * at init time: 202007221800
>> > >
>> > > 04/23 20:52:26.192 metplus INFO:
>> ****************************************
>> > >
>> > > 04/23 20:52:26.194 metplus.TCPairs (command_builder.py:122)
ERROR:
>> > > (tc_pairs_wrapper.py:489) No BDECK files found searching for
basin ??
>> and
>> > > cyclone * using template
>> > >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
>> > >
>> > > 04/23 20:52:26.194 metplus INFO:
>> ****************************************
>> > >
>> > > 04/23 20:52:26.194 metplus INFO: * Running METplus
>> > >
>> > > 04/23 20:52:26.194 metplus INFO: * at init time: 202007230000
>> > >
>> > > 04/23 20:52:26.194 metplus INFO:
>> ****************************************
>> > >
>> > > 04/23 20:52:26.196 metplus.TCPairs (command_builder.py:122)
ERROR:
>> > > (tc_pairs_wrapper.py:489) No BDECK files found searching for
basin ??
>> and
>> > > cyclone * using template
>> > >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
>> > >
>> > > 04/23 20:52:26.196 metplus INFO:
>> ****************************************
>> > >
>> > > 04/23 20:52:26.196 metplus INFO: * Running METplus
>> > >
>> > > 04/23 20:52:26.197 metplus INFO: * at init time: 202007230600
>> > >
>> > > 04/23 20:52:26.197 metplus INFO:
>> ****************************************
>> > >
>> > > 04/23 20:52:26.198 metplus.TCPairs (command_builder.py:122)
ERROR:
>> > > (tc_pairs_wrapper.py:489) No BDECK files found searching for
basin ??
>> and
>> > > cyclone * using template
>> > >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
>> > >
>> > > 04/23 20:52:26.199 metplus INFO:
>> ****************************************
>> > >
>> > > 04/23 20:52:26.199 metplus INFO: * Running METplus
>> > >
>> > > 04/23 20:52:26.199 metplus INFO: * at init time: 202007231200
>> > >
>> > > 04/23 20:52:26.199 metplus INFO:
>> ****************************************
>> > >
>> > > 04/23 20:52:26.200 metplus.TCPairs (command_builder.py:122)
ERROR:
>> > > (tc_pairs_wrapper.py:489) No BDECK files found searching for
basin ??
>> and
>> > > cyclone * using template
>> > >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
>> > >
>> > > 04/23 20:52:26.201 metplus INFO:
>> ****************************************
>> > >
>> > > 04/23 20:52:26.201 metplus INFO: * Running METplus
>> > >
>> > > 04/23 20:52:26.201 metplus INFO: * at init time: 202007231800
>> > >
>> > > 04/23 20:52:26.201 metplus INFO:
>> ****************************************
>> > >
>> > > 04/23 20:52:26.203 metplus.TCPairs (command_builder.py:122)
ERROR:
>> > > (tc_pairs_wrapper.py:489) No BDECK files found searching for
basin ??
>> and
>> > > cyclone * using template
>> > >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
>> > >
>> > > 04/23 20:52:26.203 metplus INFO:
>> ****************************************
>> > >
>> > > 04/23 20:52:26.203 metplus INFO: * Running METplus
>> > >
>> > > 04/23 20:52:26.203 metplus INFO: * at init time: 202007240000
>> > >
>> > > 04/23 20:52:26.203 metplus INFO:
>> ****************************************
>> > >
>> > > 04/23 20:52:26.205 metplus.TCPairs (command_builder.py:122)
ERROR:
>> > > (tc_pairs_wrapper.py:489) No BDECK files found searching for
basin ??
>> and
>> > > cyclone * using template
>> > >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
>> > >
>> > > 04/23 20:52:26.205 metplus INFO:
>> ****************************************
>> > >
>> > > 04/23 20:52:26.205 metplus INFO: * Running METplus
>> > >
>> > > 04/23 20:52:26.205 metplus INFO: * at init time: 202007240600
>> > >
>> > > 04/23 20:52:26.205 metplus INFO:
>> ****************************************
>> > >
>> > > 04/23 20:52:26.207 metplus.TCPairs (command_builder.py:122)
ERROR:
>> > > (tc_pairs_wrapper.py:489) No BDECK files found searching for
basin ??
>> and
>> > > cyclone * using template
>> > >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
>> > >
>> > > 04/23 20:52:26.207 metplus INFO:
>> ****************************************
>> > >
>> > > 04/23 20:52:26.207 metplus INFO: * Running METplus
>> > >
>> > > 04/23 20:52:26.207 metplus INFO: * at init time: 202007241200
>> > >
>> > > 04/23 20:52:26.208 metplus INFO:
>> ****************************************
>> > >
>> > > 04/23 20:52:26.209 metplus.TCPairs (command_builder.py:122)
ERROR:
>> > > (tc_pairs_wrapper.py:489) No BDECK files found searching for
basin ??
>> and
>> > > cyclone * using template
>> > >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
>> > >
>> > > 04/23 20:52:26.209 metplus INFO:
>> ****************************************
>> > >
>> > > 04/23 20:52:26.210 metplus INFO: * Running METplus
>> > >
>> > > 04/23 20:52:26.210 metplus INFO: * at init time: 202007241800
>> > >
>> > > 04/23 20:52:26.210 metplus INFO:
>> ****************************************
>> > >
>> > > 04/23 20:52:26.211 metplus.TCPairs (command_builder.py:122)
ERROR:
>> > > (tc_pairs_wrapper.py:489) No BDECK files found searching for
basin ??
>> and
>> > > cyclone * using template
>> > >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
>> > >
>> > > 04/23 20:52:26.212 metplus.TCPairs (met_util.py:210) ERROR:
TCPairs
>> had
>> > 16
>> > > errors.
>> > >
>> > > 04/23 20:52:26.212 metplus INFO:
>> > > /lfs1/BMC/amb-verif/vhtest/output/metplus_final.conf: write
>> metplus.conf
>> > > here
>> > >
>> > > 04/23 20:52:26.216 metplus (met_util.py:246) ERROR: METplus has
>> finished
>> > > running but had 16 errors.
>> > >
>> > > 04/23 20:52:26.216 metplus INFO: Check the log file for more
>> information:
>> > >
>> /lfs1/BMC/amb-
verif/vhtest/output/logs/master_metplus.log.20210423205222
>> > >
>> > >
>> > >
>> > > Please let me know if you need additional information.
>> > >
>> > > Thank you,
>> > > Venita
>> > >
>> > > --
>> > > Venita Hagerty, PhD
>> > > Research Associate
>> > > CIRA at NOAA, GSL/AVID
>> > > 2B152, x6098
>> > >
>> > >
>> >
>> >
>>
>> --
>> Venita Hagerty, PhD
>> Research Associate
>> CIRA at NOAA, GSL/AVID
>> 2B152, x6098
>>
>>
------------------------------------------------
Subject: Help with running TC Pairs with METplus wrappers on Jet
From: venita.hagerty at noaa.gov
Time: Tue Apr 27 08:22:25 2021
Thank you John!
I'm embarrassed about not finding that typo - transposing the e and
the b.
Thank you for spotting that.
Thank you for putting in a bug fix to not stop when finding
unsupported
e-deck line types. I did the grep you recommended for now, and I have
PROBRIRW output!
It's not the season yet, so I am testing with some 2020 data. I don't
have
matches with all of the files, so I'm not concerned about all of the
error
messages. It is handy to set the LOG_LEVEL to DEBUG.
Thank you,
Venita
On Mon, Apr 26, 2021 at 2:55 PM John Halley Gotway via RT
<met_help at ucar.edu>
wrote:
> Venita,
>
> I'm looking in your METplus log file:
> /lfs1/BMC/amb-
verif/vhtest/output/logs/master_metplus.log.20210423205222
>
> And I see 18 attempted calls to the tc_pairs wrapper along with 18
error
> messages:
>
> *ERROR: (tc_pairs_wrapper.py:489) No BDECK files found searching for
basin
> ?? and cyclone * using template
>
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat*
>
> So I suspect you really have 2 questions here.
> (1) How can I run tc_pairs with -adeck, -edeck, and -bdeck inputs
and get
> both TCMPR and PROBRIRW output?
> (2) The TC-Pairs wrapper in METplus isn't working with my data. Why
not?
>
> For (1), yes, that should work. But when I run tc_pairs manually
with the
> edeck data, I see some telling log messages:
>
> *cd
/misc/whome/John.H.Gotway/MET_Help/hagerty_data_20210426/tc_pairs*
>
> */contrib/met/9.1/bin/tc_pairs -edeck edeck/2020072112.eep072020.dat
-bdeck
> bdeck/ -config TCPairsConfig -v 3*
>
>
>
>
> *DEBUG 2: Processing 1 EDECK file(s).WARNING: WARNING: int
> ATCFProbLine::read_line(LineDataFile * ldf) -> unexpected ATCF line
type
> (ProbGN)WARNING: DEBUG 3: Used 0 of 0 lines read from 1 file(s).*
>
> And that WARNING message triggers it to stop reading data from that
file.
> So really I need to fix logic to just ignore those unsupported
probability
> line types. As a temporary workaround, I just grepped out the "RI"
line
> types.
>
> grep RI edeck/2020072112.eep072020.dat > 2020072112.eep072020_RI.dat
>
> And then I do get PROBRIRW lines in the output:
> cat
>
/misc/whome/John.H.Gotway/MET_Help/hagerty_data_20210426/tc_pairs/tc_pairs_PROBRIRW.tcst
>
> I'll write up a GitHub issue to make tc_pairs just ignore those
unsupported
> line types.
>
> For (2), it looks like you have an 'e' and 'b' transposed in your
settings.
>
> grep DECK_TEMPLATE /lfs1/BMC/amb-
verif/vhtest/output/metplus_final.conf
> TC_PAIRS_ADECK_TEMPLATE = tctrk.atcf.{date?fmt=%Y%m%d%H}.gcp1.txt
> TC_PAIRS_EDECK_TEMPLATE =
> {date?fmt=%Y%m%d%H}.b{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> TC_PAIRS_BDECK_TEMPLATE =
> {date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
>
> I suspect that's not the only problem but it certainly is one of
them.
>
> I'd recommend configuring METplus using:
> LOG_LEVEL = DEBUG
> To print more log messages... until you're satisfied it's doing
exactly
> what you want.
>
> Thanks,
> John
>
> On Mon, Apr 26, 2021 at 9:39 AM venita.hagerty at noaa.gov via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99708 >
> >
> > I am working on Jet.
> >
> > Venita
> >
> > On Mon, Apr 26, 2021 at 9:36 AM John Halley Gotway via RT <
> > met_help at ucar.edu>
> > wrote:
> >
> > > Hi Venita,
> > >
> > > This is John HG... I'm on met-help desk on Mondays.
> > >
> > > I see you're having trouble getting PROBRIRW output from TC-
Pairs.
> Thanks
> > > for sending all the details about your runtime environment.
There's
> > nothing
> > > obvious off the bat that strikes me as a reason for not getting
paired
> > > output. If I have access to the machine on which you're running,
I'll
> > just
> > > log on and take a closer look. Ideally, I'd like to boil this
down
> to...
> > > here's a single call to TC-Pairs that yields no PROBRIRW output
lines
> and
> > > we think it should. And hopefully then we can figure out why it
is not!
> > >
> > > I see all the path info, but don't actually see the machine
name. I'm
> > > guessing it's either Hera or Jet. Can you please confirm which?
> > >
> > > FYI, I'm working on the beta5 release for MET today but should
be able
> to
> > > look at this as well.
> > >
> > > Thanks,
> > > John
> > >
> > > On Mon, Apr 26, 2021 at 8:44 AM venita.hagerty at noaa.gov via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > Mon Apr 26 08:44:39 2021: Request 99708 was acted upon.
> > > > Transaction: Ticket created by venita.hagerty at noaa.gov
> > > > Queue: met_help
> > > > Subject: Help with running TC Pairs with METplus wrappers
on Jet
> > > > Owner: Nobody
> > > > Requestors: venita.hagerty at noaa.gov
> > > > Status: new
> > > > Ticket <URL:
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99708
> > >
> > > >
> > > >
> > > > I need to run TC Pairs with a-decks, b-decks, and e-decks so
that I
> get
> > > > both TCMPR and PROBRIRW line types. I am able to run and get
TCMPR
> line
> > > > types, but not TCMPR.
> > > >
> > > > I am getting b-decks and e-decks from NHC off of our /public
drive. I
> > am
> > > > getting a-decks from Judy Henderson, which have been run
through the
> > GFDL
> > > > tracker and are in ATCF format.
> > > >
> > > > I can run TC Pairs with a-decks and b-decks and get TCMPR
data. I
> added
> > > an
> > > > e-deck, and got errors and no PROBRIRW output. I don't know if
I can
> > run
> > > > all 3 types of decks at once, or if this needs to be two
separate
> > jobs. I
> > > > think I have matching dates. I may have something set wrong in
the
> > config
> > > > files.
> > > >
> > > > *** My loads:
> > > >
> > > > module purge
> > > >
> > > > module load intel
> > > >
> > > > module load intelpython/3.6.5
> > > >
> > > > module load netcdf/4.6.1
> > > >
> > > > module load hdf5/1.10.4
> > > >
> > > > module load nco/4.9.1
> > > >
> > > > module load wgrib/1.8.1.0b
> > > >
> > > > module load wgrib2/2.0.8
> > > >
> > > > module load R/3.6.1
> > > >
> > > > module load contrib
> > > >
> > > > module use /contrib/met/modulefiles
> > > >
> > > > module load met/9.1
> > > >
> > > > module use /contrib/met/METplus/modulefiles
> > > >
> > > > module load metplus/3.1.1
> > > >
> > > >
> > > > *** my_user_config.conf:
> > > >
> > > >
> > > > # This is a comment, comments are defined with a # at the
beginning
> of
> > > the
> > > > line
> > > >
> > > >
> > > > # Set the MET_INSTALL_DIR to the location of the MET install
> > > >
> > > > [dir]
> > > >
> > > > MET_INSTALL_DIR = /contrib/met/9.1/met-9.1.1
> > > >
> > > > MET_BIN_DIR = /contrib/met/9.1/met-
9.1.1/src/tools/tc_utils/tc_pairs
> > > >
> > > >
> > > > # Set INPUT_BASE to the directory containing sample input data
if
> > running
> > > > use cases in the repository
> > > >
> > > > # Otherwise set INPUT_BASE to any path that does not contain
> /path/to.
> > > >
> > > > INPUT_BASE = /lfs1/BMC/amb-verif/vhtest
> > > >
> > > >
> > > > # Set OUTPUT_BASE to a directory where you have permission to
write
> > > output
> > > > files
> > > >
> > > > # It will be created if it does not exist
> > > >
> > > > OUTPUT_BASE = /lfs1/BMC/amb-verif/vhtest/output
> > > >
> > > >
> > > > *** TCPairs_jet.conf:
> > > >
> > > >
> > > > #
> > > >
> > > > # CONFIGURATION
> > > >
> > > > #
> > > >
> > > > [config]
> > > >
> > > >
> > > > # Looping by times: steps through each 'task' in the
PROCESS_LIST for
> > > each
> > > >
> > > > # defined time, and repeats until all times have been
evaluated.
> > > >
> > > > LOOP_ORDER = times
> > > >
> > > >
> > > > # Configuration files
> > > >
> > > > TC_PAIRS_CONFIG_FILE =
{PARM_BASE}/met_config/TCPairsConfig_wrapped
> > > >
> > > >
> > > > # 'Tasks' to be run
> > > >
> > > > PROCESS_LIST = TCPairs
> > > >
> > > >
> > > > LOOP_BY = INIT
> > > >
> > > >
> > > > # The init time begin and end times, increment, and last init
hour.
> > > >
> > > > INIT_TIME_FMT = %Y%m%d%H
> > > >
> > > > INIT_BEG = 2020072100
> > > >
> > > > INIT_END = 2020072418
> > > >
> > > >
> > > > # This is the step-size. Increment in seconds from the begin
time to
> > the
> > > > end time
> > > >
> > > > # set to 6 hours = 21600 seconds
> > > >
> > > > INIT_INCREMENT = 21600
> > > >
> > > >
> > > > # A list of times to include, in format YYYYMMDD_hh
> > > >
> > > > INIT_INCLUDE =
> > > >
> > > >
> > > > # A list of times to exclude, in format YYYYMMDD_hh
> > > >
> > > > INIT_EXCLUDE =
> > > >
> > > >
> > > > #
> > > >
> > > > # Specify model valid time window in format YYYYMM[DD[_hh]].
Only
> > tracks
> > > > that fall within the valid time window will
> > > >
> > > > # be used.
> > > >
> > > > #
> > > >
> > > > VALID_BEG =
> > > >
> > > > VALID_END =
> > > >
> > > >
> > > > #
> > > >
> > > > # Run MET tc_pairs by indicating the top-level directories for
the
> > A-deck
> > > > and B-deck files. Set to 'yes' to
> > > >
> > > > # run using top-level directories, 'no' if you want to run
tc_pairs
> on
> > > > files paired by the wrapper.
> > > >
> > > > TC_PAIRS_READ_ALL_FILES = no
> > > >
> > > >
> > > > # set to true or yes to reformat track data into ATCF format
expected
> > by
> > > > tc_pairs
> > > >
> > > > TC_PAIRS_REFORMAT_DECK = no
> > > >
> > > >
> > > > # OVERWRITE OPTIONS
> > > >
> > > > # Don't overwrite filter files if they already exist.
> > > >
> > > > # Set to yes if you do NOT want to override existing files
> > > >
> > > > # Set to no if you do want to override existing files
> > > >
> > > > TC_PAIRS_SKIP_IF_OUTPUT_EXISTS = no
> > > >
> > > >
> > > > #
> > > >
> > > > # MET TC-Pairs
> > > >
> > > > #
> > > >
> > > > # List of models to be used (white space or comma separated)
eg:
> DSHP,
> > > > LGEM, HWRF
> > > >
> > > > # If no models are listed, then process all models in the
input
> > file(s).
> > > >
> > > > MODEL =
> > > >
> > > >
> > > > # List of storm ids of interest (space or comma separated)
e.g.:
> > > AL112012,
> > > > AL122012
> > > >
> > > > # If no storm ids are listed, then process all storm ids in
the input
> > > > file(s).
> > > >
> > > > #TC_PAIRS_STORM_ID = ML2092014
> > > >
> > > > #TC_PAIRS_STORM_ID = al062018, al092018, al132018, al142018
> > > >
> > > >
> > > > # Basins (of origin/region). Indicate with space or comma-
separated
> > list
> > > > of regions, eg. AL: for North Atlantic,
> > > >
> > > > # WP: Western North Pacific, CP: Central North Pacific, SH:
Southern
> > > > Hemisphere, IO: North Indian Ocean, LS: Southern
> > > >
> > > > # Hemisphere
> > > >
> > > > #TC_PAIRS_BASIN = AL
> > > >
> > > > TC_PAIRS_BASIN =
> > > >
> > > >
> > > > # Cyclone, a space or comma-separated list of cyclone numbers.
If
> left
> > > > empty, all cyclones will be used.
> > > >
> > > > TC_PAIRS_CYCLONE =
> > > >
> > > > #TC_PAIRS_CYCLONE = 06
> > > >
> > > >
> > > > # Storm name, a space or comma-separated list of storm names
to
> > evaluate.
> > > > If
> > > > left empty, all storms will be used.
> > > >
> > > > TC_PAIRS_STORM_NAME =
> > > >
> > > >
> > > > # DLAND file, the full path of the file that contains the
gridded
> > > > representation of the
> > > >
> > > > # minimum distance from land.
> > > >
> > > > TC_PAIRS_DLAND_FILE =
MET_BASE/tc_data/dland_global_tenth_degree.nc
> > > >
> > > >
> > > >
> > > > #
> > > >
> > > > # DIRECTORIES
> > > >
> > > > #
> > > >
> > > > [dir]
> > > >
> > > > # Location of input track data directory
> > > >
> > > > # for ADECK and BDECK data
> > > >
> > > > TC_PAIRS_ADECK_INPUT_DIR = /lfs1/BMC/amb-verif/vhtest/adeck
> > > >
> > > > TC_PAIRS_EDECK_INPUT_DIR = /lfs1/BMC/amb-verif/vhtest/edeck
> > > >
> > > > TC_PAIRS_BDECK_INPUT_DIR = /lfs1/BMC/amb-verif/vhtest/bdeck
> > > >
> > > >
> > > > TC_PAIRS_OUTPUT_DIR = {OUTPUT_BASE}/tc_pairs
> > > >
> > > >
> > > > [filename_templates]
> > > >
> > > > TC_PAIRS_ADECK_TEMPLATE =
tctrk.atcf.{date?fmt=%Y%m%d%H}.gcp1.txt
> > > >
> > > > TC_PAIRS_EDECK_TEMPLATE =
> > > >
{date?fmt=%Y%m%d%H}.b{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> > > >
> > > > TC_PAIRS_BDECK_TEMPLATE =
> > > >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> > > >
> > > > TC_PAIRS_OUTPUT_TEMPLATE =
> > tc_pairs_{basin?fmt=%s}{date?fmt=%Y%m%d%H}.dat
> > > >
> > > >
> > > > *** my input files:
> > > >
> > > >
> > > > adeck:
> > > >
> > > > total 96
> > > >
> > > > -rw-r--r-- 1 amb-verif amb-verif 20560 Apr 12 19:33
> > > > tctrk.atcf.2020072100.gcp1.txt
> > > >
> > > > -rw-r--r-- 1 amb-verif amb-verif 39578 Apr 14 15:57
> > > > tctrk.atcf.2020072300.gcp1.txt
> > > >
> > > > -rw-r--r-- 1 amb-verif amb-verif 30326 Apr 14 15:57
> > > > tctrk.atcf.2020072400.gcp1.txt
> > > >
> > > >
> > > > bdeck:
> > > >
> > > > total 224
> > > >
> > > > -rw-r--r-- 1 amb-verif amb-verif 997 Apr 12 19:32
> > > 2020051418.bal902020.dat
> > > >
> > > > -rw-r--r-- 1 amb-verif amb-verif 1547 Apr 12 19:32
> > > 2020072100.bal902020.dat
> > > >
> > > > -rw-r--r-- 1 amb-verif amb-verif 1547 Apr 12 19:32
> > > 2020072100.bal992020.dat
> > > >
> > > > -rw-r--r-- 1 amb-verif amb-verif 3165 Apr 12 19:32
> > > 2020072100.bep072020.dat
> > > >
> > > > -rw-r--r-- 1 amb-verif amb-verif 2447 Apr 12 19:32
> > > 2020072100.bep082020.dat
> > > >
> > > > -rw-r--r-- 1 amb-verif amb-verif 1763 Apr 12 19:32
> > > 2020072106.bal992020.dat
> > > >
> > > > -rw-r--r-- 1 amb-verif amb-verif 3381 Apr 12 19:32
> > > 2020072106.bep072020.dat
> > > >
> > > > -rw-r--r-- 1 amb-verif amb-verif 2879 Apr 12 19:32
> > > 2020072106.bep082020.dat
> > > >
> > > > -rw-r--r-- 1 amb-verif amb-verif 1979 Apr 12 19:32
> > > 2020072112.bal992020.dat
> > > >
> > > > -rw-r--r-- 1 amb-verif amb-verif 3597 Apr 12 19:32
> > > 2020072112.bep072020.dat
> > > >
> > > > -rw-r--r-- 1 amb-verif amb-verif 1980 Apr 12 19:32
> > > 2020072112.bep082020.dat
> > > >
> > > > -rw-r--r-- 1 amb-verif amb-verif 2231 Apr 12 19:32
> > > 2020072118.bal072020.dat
> > > >
> > > > -rw-r--r-- 1 amb-verif amb-verif 1115 Apr 12 19:32
> > > 2020072118.bal912020.dat
> > > >
> > > > -rw-r--r-- 1 amb-verif amb-verif 2195 Apr 12 19:32
> > > 2020072118.bal992020.dat
> > > >
> > > > -rw-r--r-- 1 amb-verif amb-verif 2412 Apr 12 19:32
> > > 2020072118.bep082020.dat
> > > >
> > > > -rw-r--r-- 1 amb-verif amb-verif 2663 Jul 23 2020
> > > 2020072300.bal072020.dat
> > > >
> > > > -rw-r--r-- 1 amb-verif amb-verif 2231 Jul 23 2020
> > > 2020072300.bal082020.dat
> > > >
> > > > -rw-r--r-- 1 amb-verif amb-verif 2195 Jul 23 2020
> > > 2020072300.bal912020.dat
> > > >
> > > > -rw-r--r-- 1 amb-verif amb-verif 5004 Jul 23 2020
> > > 2020072300.bep082020.dat
> > > >
> > > > -rw-r--r-- 1 amb-verif amb-verif 3095 Jul 23 2020
> > > 2020072306.bal072020.dat
> > > >
> > > > -rw-r--r-- 1 amb-verif amb-verif 2447 Jul 23 2020
> > > 2020072306.bal082020.dat
> > > >
> > > > -rw-r--r-- 1 amb-verif amb-verif 5652 Jul 23 2020
> > > 2020072306.bep082020.dat
> > > >
> > > > -rw-r--r-- 1 amb-verif amb-verif 3527 Jul 23 2020
> > > 2020072312.bal072020.dat
> > > >
> > > > -rw-r--r-- 1 amb-verif amb-verif 2663 Jul 23 2020
> > > 2020072312.bal082020.dat
> > > >
> > > > -rw-r--r-- 1 amb-verif amb-verif 6300 Jul 23 2020
> > > 2020072312.bep082020.dat
> > > >
> > > > -rw-r--r-- 1 amb-verif amb-verif 3959 Jul 23 2020
> > > 2020072318.bal072020.dat
> > > >
> > > > -rw-r--r-- 1 amb-verif amb-verif 2879 Jul 23 2020
> > > 2020072318.bal082020.dat
> > > >
> > > > -rw-r--r-- 1 amb-verif amb-verif 6948 Jul 23 2020
> > > 2020072318.bep082020.dat
> > > >
> > > > -rw-r--r-- 1 amb-verif amb-verif 4391 Jul 24 2020
> > > 2020072400.bal072020.dat
> > > >
> > > > -rw-r--r-- 1 amb-verif amb-verif 3095 Jul 24 2020
> > > 2020072400.bal082020.dat
> > > >
> > > > -rw-r--r-- 1 amb-verif amb-verif 7596 Jul 24 2020
> > > 2020072400.bep082020.dat
> > > >
> > > > -rw-r--r-- 1 amb-verif amb-verif 4823 Jul 24 2020
> > > 2020072406.bal072020.dat
> > > >
> > > > -rw-r--r-- 1 amb-verif amb-verif 3311 Jul 24 2020
> > > 2020072406.bal082020.dat
> > > >
> > > > -rw-r--r-- 1 amb-verif amb-verif 8244 Jul 24 2020
> > > 2020072406.bep082020.dat
> > > >
> > > > -rw-r--r-- 1 amb-verif amb-verif 5039 Jul 24 2020
> > > 2020072412.bal072020.dat
> > > >
> > > > -rw-r--r-- 1 amb-verif amb-verif 2412 Jul 24 2020
> > > 2020072412.bal082020.dat
> > > >
> > > > -rw-r--r-- 1 amb-verif amb-verif 8892 Jul 24 2020
> > > 2020072412.bep082020.dat
> > > >
> > > > -rw-r--r-- 1 amb-verif amb-verif 5255 Jul 24 2020
> > > 2020072418.bal072020.dat
> > > >
> > > > -rw-r--r-- 1 amb-verif amb-verif 2628 Jul 24 2020
> > > 2020072418.bal082020.dat
> > > >
> > > > -rw-r--r-- 1 amb-verif amb-verif 1115 Jul 24 2020
> > > 2020072418.bal922020.dat
> > > >
> > > > -rw-r--r-- 1 amb-verif amb-verif 9540 Jul 24 2020
> > > 2020072418.bep082020.dat
> > > >
> > > >
> > > > edeck:
> > > >
> > > > total 124
> > > >
> > > > -rw-r--r-- 1 amb-verif amb-verif 121621 Apr 23 20:44
> > > > 2020072112.eep072020.dat
> > > >
> > > >
> > > > some of the data:
> > > >
> > > >
> > > > head -3 adeck/tctrk.atcf.2020072100.gcp1.txt
> > > >
> > > > AL, 99, 2020072100, 03, GCP1, 000, 89N, 381W, 22, 1010, XX,
34,
> > NEQ,
> > > > 0000, 0000, 0000, 0000, -99, -99, 34, 0, 0, , 0,
,
> 0,
> > > 0,
> > > > , , , , 0, 0, 0, 0, THERMO PARAMS,
> > > > -12, 225,
> > > > -30, N, 10, DT, -999
> > > >
> > > > AL, 90, 2020072100, 03, GCP1, 000, 275N, 954W, 22, 1008, XX,
34,
> > NEQ,
> > > > 0000, 0000, 0000, 0000, -99, -99, 117, 0, 0, , 0,
,
> 0,
> > > 0,
> > > > , , , , 0, 0, 0, 0, THERMO PARAMS,
> -31,
> > > > 326, -226, N, 10, DT, -999
> > > >
> > > > EP, 07, 2020072100, 03, GCP1, 000, 193N, 1318W, 38, 1007, XX,
34,
> > NEQ,
> > > > 0032, 0000, 0000, 0029, 1011, 52, 25, 0, 0, , 0,
,
> 0,
> > > 0,
> > > > , , , , 0, 0, 0, 0, THERMO PARAMS,
> > > > 34, 274,
> > > > 378, Y, 10, DT, -999
> > > >
> > > >
> > > > head -3 bdeck/2020072112.bep082020.dat
> > > >
> > > > EP, 08, 2020072000, , BEST, 0, 148N, 1188W, 25, 1008, LO,
0,
> > ,
> > > > 0, 0, 0, 0, 1011, 100, 40, 0, 0, E, 0, ,
0,
> > 0,
> > > > INVEST, S, 0, , 0, 0, 0, 0, genesis-num,
014,
> > > >
> > > > EP, 08, 2020072006, , BEST, 0, 143N, 1192W, 25, 1008, LO,
0,
> > ,
> > > > 0, 0, 0, 0, 1011, 100, 30, 35, 0, E, 0, ,
0,
> > 0,
> > > > INVEST, M, 0, , 0, 0, 0, 0, genesis-num,
014,
> > > >
> > > > EP, 08, 2020072012, , BEST, 0, 139N, 1194W, 30, 1008, TD,
0,
> > ,
> > > > 0, 0, 0, 0, 1011, 100, 30, 40, 0, E, 0, ,
0,
> > 0,
> > > > INVEST, M, 0, , 0, 0, 0, 0, genesis-num,
014,
> > > > TRANSITIONED, epB02020 to ep082020,
> > > >
> > > >
> > > > head -3 edeck/2020072112.eep072020.dat
> > > >
> > > > EP, 07, 2020071206, GN, OFCL, 48, , , 0, 48,
ESB,
> > genFcst,
> > > ,
> > > > ,
> > > > 0, 013,
> > > >
> > > > EP, 07, 2020071206, GN, OFCL, 120, , , 0, 120,
ESB,
> > genFcst,
> > > ,
> > > > ,
> > > > 0, 013,
> > > >
> > > > EP, 07, 2020071206, GN, OFCL, 168, , , 10, 168,
ESB,
> > genFcst,
> > > ,
> > > > ,
> > > > 0, 013,
> > > >
> > > >
> > > > *** metplus_final.conf:
> > > >
> > > >
> > > > [config]
> > > >
> > > > CLOCK_TIME = 20210423205222
> > > >
> > > > LOOP_ORDER = times
> > > >
> > > > PROCESS_LIST = TCPairs
> > > >
> > > > METPLUS_CONF = {OUTPUT_BASE}/metplus_final.conf
> > > >
> > > > LOG_METPLUS =
> > > >
> > /lfs1/BMC/amb-
verif/vhtest/output/logs/master_metplus.log.20210423205222
> > > >
> > > > LOG_TIMESTAMP_TEMPLATE = %Y%m%d%H%M%S
> > > >
> > > > LOG_LINE_FORMAT = %(asctime)s.%(msecs)03d %(name)s
> > > > (%(filename)s:%(lineno)d) %(levelname)s: %(message)s
> > > >
> > > > LOG_ERR_LINE_FORMAT = {LOG_LINE_FORMAT}
> > > >
> > > > LOG_DEBUG_LINE_FORMAT = {LOG_LINE_FORMAT}
> > > >
> > > > LOG_INFO_LINE_FORMAT = %(asctime)s.%(msecs)03d %(name)s
> %(levelname)s:
> > > > %(message)s
> > > >
> > > > LOG_LINE_DATE_FORMAT = %m/%d %H:%M:%S
> > > >
> > > > LOG_TIMESTAMP_USE_DATATIME = no
> > > >
> > > > LOG_MET_OUTPUT_TO_METPLUS = yes
> > > >
> > > > LOG_MET_VERBOSITY = 2
> > > >
> > > > LOG_LEVEL = INFO
> > > >
> > > > TC_PAIRS_CONFIG_FILE =
{PARM_BASE}/met_config/TCPairsConfig_wrapped
> > > >
> > > > LOOP_BY = INIT
> > > >
> > > > INIT_TIME_FMT = %Y%m%d%H
> > > >
> > > > INIT_BEG = 2020072100
> > > >
> > > > INIT_END = 2020072418
> > > >
> > > > INIT_INCREMENT = 21600
> > > >
> > > > INIT_INCLUDE =
> > > >
> > > > INIT_EXCLUDE =
> > > >
> > > > VALID_BEG =
> > > >
> > > > VALID_END =
> > > >
> > > > TC_PAIRS_READ_ALL_FILES = no
> > > >
> > > > TC_PAIRS_REFORMAT_DECK = no
> > > >
> > > > TC_PAIRS_SKIP_IF_OUTPUT_EXISTS = no
> > > >
> > > > MODEL =
> > > >
> > > > TC_PAIRS_BASIN =
> > > >
> > > > TC_PAIRS_CYCLONE =
> > > >
> > > > TC_PAIRS_STORM_NAME =
> > > >
> > > > TC_PAIRS_DLAND_FILE =
MET_BASE/tc_data/dland_global_tenth_degree.nc
> > > >
> > > > LOG_TIMESTAMP = 20210423205222
> > > >
> > > > METPLUS_CONFIG_FILES =
./my_user_config.conf,./TCPairs_jet.conf
> > > >
> > > > METPLUS_VERSION = 3.1.1
> > > >
> > > > CURRENT_FCST_NAME =
> > > >
> > > > CURRENT_OBS_NAME =
> > > >
> > > > CURRENT_FCST_LEVEL =
> > > >
> > > > CURRENT_OBS_LEVEL =
> > > >
> > > > USER_SHELL = bash
> > > >
> > > > DO_NOT_RUN_EXE = False
> > > >
> > > > TC_PAIRS_SKIP_TIMES =
> > > >
> > > > SKIP_TIMES =
> > > >
> > > > USE_EXPLICIT_NAME_AND_LEVEL = False
> > > >
> > > > LOG_TC_PAIRS_VERBOSITY = 2
> > > >
> > > > TC_PAIRS_MISSING_VAL_TO_REPLACE = -99
> > > >
> > > > TC_PAIRS_MISSING_VAL = -9999
> > > >
> > > > TC_PAIRS_STORM_ID =
> > > >
> > > > TC_PAIRS_SKIP_IF_REFORMAT_EXISTS = False
> > > >
> > > > TC_PAIRS_REFORMAT_TYPE = SBU
> > > >
> > > > SCRUB_STAGING_DIR = False
> > > >
> > > >
> > > > [dir]
> > > >
> > > > OUTPUT_BASE = /lfs1/BMC/amb-verif/vhtest/output
> > > >
> > > > STAGING_DIR = {OUTPUT_BASE}/stage
> > > >
> > > > MET_INSTALL_DIR = /contrib/met/9.1/met-9.1.1
> > > >
> > > > MET_BIN_DIR = /contrib/met/9.1/met-
9.1.1/src/tools/tc_utils/tc_pairs
> > > >
> > > > LOG_DIR = {OUTPUT_BASE}/logs
> > > >
> > > > TMP_DIR = {OUTPUT_BASE}/tmp
> > > >
> > > > INPUT_BASE = /lfs1/BMC/amb-verif/vhtest
> > > >
> > > > TC_PAIRS_ADECK_INPUT_DIR = /lfs1/BMC/amb-verif/vhtest/adeck
> > > >
> > > > TC_PAIRS_EDECK_INPUT_DIR = /lfs1/BMC/amb-verif/vhtest/edeck
> > > >
> > > > TC_PAIRS_BDECK_INPUT_DIR = /lfs1/BMC/amb-verif/vhtest/bdeck
> > > >
> > > > TC_PAIRS_OUTPUT_DIR = {OUTPUT_BASE}/tc_pairs
> > > >
> > > > METPLUS_BASE = /contrib/met/METplus/METplus-3.1.1
> > > >
> > > > PARM_BASE = /contrib/met/METplus/METplus-3.1.1/parm
> > > >
> > > > TC_PAIRS_REFORMAT_DIR =
> > /lfs1/BMC/amb-verif/vhtest/output/track_data_atcf
> > > >
> > > >
> > > > [exe]
> > > >
> > > > RM = rm
> > > >
> > > > CUT = cut
> > > >
> > > > TR = tr
> > > >
> > > > NCAP2 = ncap2
> > > >
> > > > CONVERT = convert
> > > >
> > > > NCDUMP = ncdump
> > > >
> > > >
> > > > [filename_templates]
> > > >
> > > > TC_PAIRS_ADECK_TEMPLATE =
tctrk.atcf.{date?fmt=%Y%m%d%H}.gcp1.txt
> > > >
> > > > TC_PAIRS_EDECK_TEMPLATE =
> > > >
{date?fmt=%Y%m%d%H}.b{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> > > >
> > > > TC_PAIRS_BDECK_TEMPLATE =
> > > >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> > > >
> > > > TC_PAIRS_OUTPUT_TEMPLATE =
> > tc_pairs_{basin?fmt=%s}{date?fmt=%Y%m%d%H}.dat
> > > >
> > > >
> > > > [user_env_vars]
> > > >
> > > >
> > > > *** My Log:
> > > >
> > > >
> > > > 04/23 20:52:22.576 metplus INFO: Running METplus v3.1.1 called
with
> > > > command: /contrib/met/METplus/METplus-
3.1.1/ush/master_metplus.py -c
> > > > ./my_user_config.conf -c ./TCPairs_jet.conf
> > > >
> > > > 04/23 20:52:22.577 metplus INFO: Log file:
> > > >
> > /lfs1/BMC/amb-
verif/vhtest/output/logs/master_metplus.log.20210423205222
> > > >
> > > > 04/23 20:52:26.077 metplus INFO:
> > ****************************************
> > > >
> > > > 04/23 20:52:26.077 metplus INFO: * Running METplus
> > > >
> > > > 04/23 20:52:26.077 metplus INFO: * at init time: 202007210000
> > > >
> > > > 04/23 20:52:26.077 metplus INFO:
> > ****************************************
> > > >
> > > > 04/23 20:52:26.178 metplus.TCPairs (command_builder.py:122)
ERROR:
> > > > (tc_pairs_wrapper.py:489) No BDECK files found searching for
basin ??
> > and
> > > > cyclone * using template
> > > >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> > > >
> > > > 04/23 20:52:26.179 metplus INFO:
> > ****************************************
> > > >
> > > > 04/23 20:52:26.179 metplus INFO: * Running METplus
> > > >
> > > > 04/23 20:52:26.179 metplus INFO: * at init time: 202007210600
> > > >
> > > > 04/23 20:52:26.179 metplus INFO:
> > ****************************************
> > > >
> > > > 04/23 20:52:26.181 metplus.TCPairs (command_builder.py:122)
ERROR:
> > > > (tc_pairs_wrapper.py:489) No BDECK files found searching for
basin ??
> > and
> > > > cyclone * using template
> > > >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> > > >
> > > > 04/23 20:52:26.181 metplus INFO:
> > ****************************************
> > > >
> > > > 04/23 20:52:26.181 metplus INFO: * Running METplus
> > > >
> > > > 04/23 20:52:26.181 metplus INFO: * at init time: 202007211200
> > > >
> > > > 04/23 20:52:26.181 metplus INFO:
> > ****************************************
> > > >
> > > > 04/23 20:52:26.183 metplus.TCPairs (command_builder.py:122)
ERROR:
> > > > (tc_pairs_wrapper.py:489) No BDECK files found searching for
basin ??
> > and
> > > > cyclone * using template
> > > >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> > > >
> > > > 04/23 20:52:26.183 metplus INFO:
> > ****************************************
> > > >
> > > > 04/23 20:52:26.183 metplus INFO: * Running METplus
> > > >
> > > > 04/23 20:52:26.184 metplus INFO: * at init time: 202007211800
> > > >
> > > > 04/23 20:52:26.184 metplus INFO:
> > ****************************************
> > > >
> > > > 04/23 20:52:26.185 metplus.TCPairs (command_builder.py:122)
ERROR:
> > > > (tc_pairs_wrapper.py:489) No BDECK files found searching for
basin ??
> > and
> > > > cyclone * using template
> > > >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> > > >
> > > > 04/23 20:52:26.185 metplus INFO:
> > ****************************************
> > > >
> > > > 04/23 20:52:26.186 metplus INFO: * Running METplus
> > > >
> > > > 04/23 20:52:26.186 metplus INFO: * at init time: 202007220000
> > > >
> > > > 04/23 20:52:26.186 metplus INFO:
> > ****************************************
> > > >
> > > > 04/23 20:52:26.187 metplus.TCPairs (command_builder.py:122)
ERROR:
> > > > (tc_pairs_wrapper.py:489) No BDECK files found searching for
basin ??
> > and
> > > > cyclone * using template
> > > >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> > > >
> > > > 04/23 20:52:26.188 metplus INFO:
> > ****************************************
> > > >
> > > > 04/23 20:52:26.188 metplus INFO: * Running METplus
> > > >
> > > > 04/23 20:52:26.188 metplus INFO: * at init time: 202007220600
> > > >
> > > > 04/23 20:52:26.188 metplus INFO:
> > ****************************************
> > > >
> > > > 04/23 20:52:26.190 metplus.TCPairs (command_builder.py:122)
ERROR:
> > > > (tc_pairs_wrapper.py:489) No BDECK files found searching for
basin ??
> > and
> > > > cyclone * using template
> > > >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> > > >
> > > > 04/23 20:52:26.190 metplus INFO:
> > ****************************************
> > > >
> > > > 04/23 20:52:26.190 metplus INFO: * Running METplus
> > > >
> > > > 04/23 20:52:26.190 metplus INFO: * at init time: 202007221200
> > > >
> > > > 04/23 20:52:26.190 metplus INFO:
> > ****************************************
> > > >
> > > > 04/23 20:52:26.192 metplus.TCPairs (command_builder.py:122)
ERROR:
> > > > (tc_pairs_wrapper.py:489) No BDECK files found searching for
basin ??
> > and
> > > > cyclone * using template
> > > >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> > > >
> > > > 04/23 20:52:26.192 metplus INFO:
> > ****************************************
> > > >
> > > > 04/23 20:52:26.192 metplus INFO: * Running METplus
> > > >
> > > > 04/23 20:52:26.192 metplus INFO: * at init time: 202007221800
> > > >
> > > > 04/23 20:52:26.192 metplus INFO:
> > ****************************************
> > > >
> > > > 04/23 20:52:26.194 metplus.TCPairs (command_builder.py:122)
ERROR:
> > > > (tc_pairs_wrapper.py:489) No BDECK files found searching for
basin ??
> > and
> > > > cyclone * using template
> > > >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> > > >
> > > > 04/23 20:52:26.194 metplus INFO:
> > ****************************************
> > > >
> > > > 04/23 20:52:26.194 metplus INFO: * Running METplus
> > > >
> > > > 04/23 20:52:26.194 metplus INFO: * at init time: 202007230000
> > > >
> > > > 04/23 20:52:26.194 metplus INFO:
> > ****************************************
> > > >
> > > > 04/23 20:52:26.196 metplus.TCPairs (command_builder.py:122)
ERROR:
> > > > (tc_pairs_wrapper.py:489) No BDECK files found searching for
basin ??
> > and
> > > > cyclone * using template
> > > >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> > > >
> > > > 04/23 20:52:26.196 metplus INFO:
> > ****************************************
> > > >
> > > > 04/23 20:52:26.196 metplus INFO: * Running METplus
> > > >
> > > > 04/23 20:52:26.197 metplus INFO: * at init time: 202007230600
> > > >
> > > > 04/23 20:52:26.197 metplus INFO:
> > ****************************************
> > > >
> > > > 04/23 20:52:26.198 metplus.TCPairs (command_builder.py:122)
ERROR:
> > > > (tc_pairs_wrapper.py:489) No BDECK files found searching for
basin ??
> > and
> > > > cyclone * using template
> > > >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> > > >
> > > > 04/23 20:52:26.199 metplus INFO:
> > ****************************************
> > > >
> > > > 04/23 20:52:26.199 metplus INFO: * Running METplus
> > > >
> > > > 04/23 20:52:26.199 metplus INFO: * at init time: 202007231200
> > > >
> > > > 04/23 20:52:26.199 metplus INFO:
> > ****************************************
> > > >
> > > > 04/23 20:52:26.200 metplus.TCPairs (command_builder.py:122)
ERROR:
> > > > (tc_pairs_wrapper.py:489) No BDECK files found searching for
basin ??
> > and
> > > > cyclone * using template
> > > >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> > > >
> > > > 04/23 20:52:26.201 metplus INFO:
> > ****************************************
> > > >
> > > > 04/23 20:52:26.201 metplus INFO: * Running METplus
> > > >
> > > > 04/23 20:52:26.201 metplus INFO: * at init time: 202007231800
> > > >
> > > > 04/23 20:52:26.201 metplus INFO:
> > ****************************************
> > > >
> > > > 04/23 20:52:26.203 metplus.TCPairs (command_builder.py:122)
ERROR:
> > > > (tc_pairs_wrapper.py:489) No BDECK files found searching for
basin ??
> > and
> > > > cyclone * using template
> > > >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> > > >
> > > > 04/23 20:52:26.203 metplus INFO:
> > ****************************************
> > > >
> > > > 04/23 20:52:26.203 metplus INFO: * Running METplus
> > > >
> > > > 04/23 20:52:26.203 metplus INFO: * at init time: 202007240000
> > > >
> > > > 04/23 20:52:26.203 metplus INFO:
> > ****************************************
> > > >
> > > > 04/23 20:52:26.205 metplus.TCPairs (command_builder.py:122)
ERROR:
> > > > (tc_pairs_wrapper.py:489) No BDECK files found searching for
basin ??
> > and
> > > > cyclone * using template
> > > >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> > > >
> > > > 04/23 20:52:26.205 metplus INFO:
> > ****************************************
> > > >
> > > > 04/23 20:52:26.205 metplus INFO: * Running METplus
> > > >
> > > > 04/23 20:52:26.205 metplus INFO: * at init time: 202007240600
> > > >
> > > > 04/23 20:52:26.205 metplus INFO:
> > ****************************************
> > > >
> > > > 04/23 20:52:26.207 metplus.TCPairs (command_builder.py:122)
ERROR:
> > > > (tc_pairs_wrapper.py:489) No BDECK files found searching for
basin ??
> > and
> > > > cyclone * using template
> > > >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> > > >
> > > > 04/23 20:52:26.207 metplus INFO:
> > ****************************************
> > > >
> > > > 04/23 20:52:26.207 metplus INFO: * Running METplus
> > > >
> > > > 04/23 20:52:26.207 metplus INFO: * at init time: 202007241200
> > > >
> > > > 04/23 20:52:26.208 metplus INFO:
> > ****************************************
> > > >
> > > > 04/23 20:52:26.209 metplus.TCPairs (command_builder.py:122)
ERROR:
> > > > (tc_pairs_wrapper.py:489) No BDECK files found searching for
basin ??
> > and
> > > > cyclone * using template
> > > >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> > > >
> > > > 04/23 20:52:26.209 metplus INFO:
> > ****************************************
> > > >
> > > > 04/23 20:52:26.210 metplus INFO: * Running METplus
> > > >
> > > > 04/23 20:52:26.210 metplus INFO: * at init time: 202007241800
> > > >
> > > > 04/23 20:52:26.210 metplus INFO:
> > ****************************************
> > > >
> > > > 04/23 20:52:26.211 metplus.TCPairs (command_builder.py:122)
ERROR:
> > > > (tc_pairs_wrapper.py:489) No BDECK files found searching for
basin ??
> > and
> > > > cyclone * using template
> > > >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> > > >
> > > > 04/23 20:52:26.212 metplus.TCPairs (met_util.py:210) ERROR:
TCPairs
> had
> > > 16
> > > > errors.
> > > >
> > > > 04/23 20:52:26.212 metplus INFO:
> > > > /lfs1/BMC/amb-verif/vhtest/output/metplus_final.conf: write
> > metplus.conf
> > > > here
> > > >
> > > > 04/23 20:52:26.216 metplus (met_util.py:246) ERROR: METplus
has
> > finished
> > > > running but had 16 errors.
> > > >
> > > > 04/23 20:52:26.216 metplus INFO: Check the log file for more
> > information:
> > > >
> > /lfs1/BMC/amb-
verif/vhtest/output/logs/master_metplus.log.20210423205222
> > > >
> > > >
> > > >
> > > > Please let me know if you need additional information.
> > > >
> > > > Thank you,
> > > > Venita
> > > >
> > > > --
> > > > Venita Hagerty, PhD
> > > > Research Associate
> > > > CIRA at NOAA, GSL/AVID
> > > > 2B152, x6098
> > > >
> > > >
> > >
> > >
> >
> > --
> > Venita Hagerty, PhD
> > Research Associate
> > CIRA at NOAA, GSL/AVID
> > 2B152, x6098
> >
> >
>
>
--
Venita Hagerty, PhD
Research Associate
CIRA at NOAA, GSL/AVID
2B152, x6098
------------------------------------------------
Subject: Help with running TC Pairs with METplus wrappers on Jet
From: John Halley Gotway
Time: Tue Apr 27 08:57:36 2021
Venita,
Thanks for letting me know about your progress. Glad you did get some
paired output.
In the test I ran, that's all I was looking for as well. However, when
running tc_pairs at verbosity level 3 (-v 3), I did notice some
forecast
tracks matching multiple Best tracks I believe. I'd recommend looking
more
closely at the details of the matches. And please let me know if any
more
questions come up when you do.
Thanks,
John
On Tue, Apr 27, 2021 at 8:22 AM venita.hagerty at noaa.gov via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99708 >
>
> Thank you John!
>
> I'm embarrassed about not finding that typo - transposing the e and
the b.
> Thank you for spotting that.
>
> Thank you for putting in a bug fix to not stop when finding
unsupported
> e-deck line types. I did the grep you recommended for now, and I
have
> PROBRIRW output!
>
> It's not the season yet, so I am testing with some 2020 data. I
don't have
> matches with all of the files, so I'm not concerned about all of the
error
> messages. It is handy to set the LOG_LEVEL to DEBUG.
>
> Thank you,
> Venita
>
> On Mon, Apr 26, 2021 at 2:55 PM John Halley Gotway via RT <
> met_help at ucar.edu>
> wrote:
>
> > Venita,
> >
> > I'm looking in your METplus log file:
> > /lfs1/BMC/amb-
verif/vhtest/output/logs/master_metplus.log.20210423205222
> >
> > And I see 18 attempted calls to the tc_pairs wrapper along with 18
error
> > messages:
> >
> > *ERROR: (tc_pairs_wrapper.py:489) No BDECK files found searching
for
> basin
> > ?? and cyclone * using template
> >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat*
> >
> > So I suspect you really have 2 questions here.
> > (1) How can I run tc_pairs with -adeck, -edeck, and -bdeck inputs
and get
> > both TCMPR and PROBRIRW output?
> > (2) The TC-Pairs wrapper in METplus isn't working with my data.
Why not?
> >
> > For (1), yes, that should work. But when I run tc_pairs manually
with the
> > edeck data, I see some telling log messages:
> >
> > *cd
/misc/whome/John.H.Gotway/MET_Help/hagerty_data_20210426/tc_pairs*
> >
> > */contrib/met/9.1/bin/tc_pairs -edeck
edeck/2020072112.eep072020.dat
> -bdeck
> > bdeck/ -config TCPairsConfig -v 3*
> >
> >
> >
> >
> > *DEBUG 2: Processing 1 EDECK file(s).WARNING: WARNING: int
> > ATCFProbLine::read_line(LineDataFile * ldf) -> unexpected ATCF
line type
> > (ProbGN)WARNING: DEBUG 3: Used 0 of 0 lines read from 1 file(s).*
> >
> > And that WARNING message triggers it to stop reading data from
that file.
> > So really I need to fix logic to just ignore those unsupported
> probability
> > line types. As a temporary workaround, I just grepped out the "RI"
line
> > types.
> >
> > grep RI edeck/2020072112.eep072020.dat >
2020072112.eep072020_RI.dat
> >
> > And then I do get PROBRIRW lines in the output:
> > cat
> >
>
/misc/whome/John.H.Gotway/MET_Help/hagerty_data_20210426/tc_pairs/tc_pairs_PROBRIRW.tcst
> >
> > I'll write up a GitHub issue to make tc_pairs just ignore those
> unsupported
> > line types.
> >
> > For (2), it looks like you have an 'e' and 'b' transposed in your
> settings.
> >
> > grep DECK_TEMPLATE /lfs1/BMC/amb-
verif/vhtest/output/metplus_final.conf
> > TC_PAIRS_ADECK_TEMPLATE = tctrk.atcf.{date?fmt=%Y%m%d%H}.gcp1.txt
> > TC_PAIRS_EDECK_TEMPLATE =
> >
{date?fmt=%Y%m%d%H}.b{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> > TC_PAIRS_BDECK_TEMPLATE =
> >
{date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> >
> > I suspect that's not the only problem but it certainly is one of
them.
> >
> > I'd recommend configuring METplus using:
> > LOG_LEVEL = DEBUG
> > To print more log messages... until you're satisfied it's doing
exactly
> > what you want.
> >
> > Thanks,
> > John
> >
> > On Mon, Apr 26, 2021 at 9:39 AM venita.hagerty at noaa.gov via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99708 >
> > >
> > > I am working on Jet.
> > >
> > > Venita
> > >
> > > On Mon, Apr 26, 2021 at 9:36 AM John Halley Gotway via RT <
> > > met_help at ucar.edu>
> > > wrote:
> > >
> > > > Hi Venita,
> > > >
> > > > This is John HG... I'm on met-help desk on Mondays.
> > > >
> > > > I see you're having trouble getting PROBRIRW output from TC-
Pairs.
> > Thanks
> > > > for sending all the details about your runtime environment.
There's
> > > nothing
> > > > obvious off the bat that strikes me as a reason for not
getting
> paired
> > > > output. If I have access to the machine on which you're
running, I'll
> > > just
> > > > log on and take a closer look. Ideally, I'd like to boil this
down
> > to...
> > > > here's a single call to TC-Pairs that yields no PROBRIRW
output lines
> > and
> > > > we think it should. And hopefully then we can figure out why
it is
> not!
> > > >
> > > > I see all the path info, but don't actually see the machine
name. I'm
> > > > guessing it's either Hera or Jet. Can you please confirm
which?
> > > >
> > > > FYI, I'm working on the beta5 release for MET today but should
be
> able
> > to
> > > > look at this as well.
> > > >
> > > > Thanks,
> > > > John
> > > >
> > > > On Mon, Apr 26, 2021 at 8:44 AM venita.hagerty at noaa.gov via RT
<
> > > > met_help at ucar.edu> wrote:
> > > >
> > > > >
> > > > > Mon Apr 26 08:44:39 2021: Request 99708 was acted upon.
> > > > > Transaction: Ticket created by venita.hagerty at noaa.gov
> > > > > Queue: met_help
> > > > > Subject: Help with running TC Pairs with METplus
wrappers on
> Jet
> > > > > Owner: Nobody
> > > > > Requestors: venita.hagerty at noaa.gov
> > > > > Status: new
> > > > > Ticket <URL:
> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99708
> > > >
> > > > >
> > > > >
> > > > > I need to run TC Pairs with a-decks, b-decks, and e-decks so
that I
> > get
> > > > > both TCMPR and PROBRIRW line types. I am able to run and get
TCMPR
> > line
> > > > > types, but not TCMPR.
> > > > >
> > > > > I am getting b-decks and e-decks from NHC off of our /public
> drive. I
> > > am
> > > > > getting a-decks from Judy Henderson, which have been run
through
> the
> > > GFDL
> > > > > tracker and are in ATCF format.
> > > > >
> > > > > I can run TC Pairs with a-decks and b-decks and get TCMPR
data. I
> > added
> > > > an
> > > > > e-deck, and got errors and no PROBRIRW output. I don't know
if I
> can
> > > run
> > > > > all 3 types of decks at once, or if this needs to be two
separate
> > > jobs. I
> > > > > think I have matching dates. I may have something set wrong
in the
> > > config
> > > > > files.
> > > > >
> > > > > *** My loads:
> > > > >
> > > > > module purge
> > > > >
> > > > > module load intel
> > > > >
> > > > > module load intelpython/3.6.5
> > > > >
> > > > > module load netcdf/4.6.1
> > > > >
> > > > > module load hdf5/1.10.4
> > > > >
> > > > > module load nco/4.9.1
> > > > >
> > > > > module load wgrib/1.8.1.0b
> > > > >
> > > > > module load wgrib2/2.0.8
> > > > >
> > > > > module load R/3.6.1
> > > > >
> > > > > module load contrib
> > > > >
> > > > > module use /contrib/met/modulefiles
> > > > >
> > > > > module load met/9.1
> > > > >
> > > > > module use /contrib/met/METplus/modulefiles
> > > > >
> > > > > module load metplus/3.1.1
> > > > >
> > > > >
> > > > > *** my_user_config.conf:
> > > > >
> > > > >
> > > > > # This is a comment, comments are defined with a # at the
beginning
> > of
> > > > the
> > > > > line
> > > > >
> > > > >
> > > > > # Set the MET_INSTALL_DIR to the location of the MET install
> > > > >
> > > > > [dir]
> > > > >
> > > > > MET_INSTALL_DIR = /contrib/met/9.1/met-9.1.1
> > > > >
> > > > > MET_BIN_DIR =
> /contrib/met/9.1/met-9.1.1/src/tools/tc_utils/tc_pairs
> > > > >
> > > > >
> > > > > # Set INPUT_BASE to the directory containing sample input
data if
> > > running
> > > > > use cases in the repository
> > > > >
> > > > > # Otherwise set INPUT_BASE to any path that does not contain
> > /path/to.
> > > > >
> > > > > INPUT_BASE = /lfs1/BMC/amb-verif/vhtest
> > > > >
> > > > >
> > > > > # Set OUTPUT_BASE to a directory where you have permission
to write
> > > > output
> > > > > files
> > > > >
> > > > > # It will be created if it does not exist
> > > > >
> > > > > OUTPUT_BASE = /lfs1/BMC/amb-verif/vhtest/output
> > > > >
> > > > >
> > > > > *** TCPairs_jet.conf:
> > > > >
> > > > >
> > > > > #
> > > > >
> > > > > # CONFIGURATION
> > > > >
> > > > > #
> > > > >
> > > > > [config]
> > > > >
> > > > >
> > > > > # Looping by times: steps through each 'task' in the
PROCESS_LIST
> for
> > > > each
> > > > >
> > > > > # defined time, and repeats until all times have been
evaluated.
> > > > >
> > > > > LOOP_ORDER = times
> > > > >
> > > > >
> > > > > # Configuration files
> > > > >
> > > > > TC_PAIRS_CONFIG_FILE =
{PARM_BASE}/met_config/TCPairsConfig_wrapped
> > > > >
> > > > >
> > > > > # 'Tasks' to be run
> > > > >
> > > > > PROCESS_LIST = TCPairs
> > > > >
> > > > >
> > > > > LOOP_BY = INIT
> > > > >
> > > > >
> > > > > # The init time begin and end times, increment, and last
init hour.
> > > > >
> > > > > INIT_TIME_FMT = %Y%m%d%H
> > > > >
> > > > > INIT_BEG = 2020072100
> > > > >
> > > > > INIT_END = 2020072418
> > > > >
> > > > >
> > > > > # This is the step-size. Increment in seconds from the begin
time
> to
> > > the
> > > > > end time
> > > > >
> > > > > # set to 6 hours = 21600 seconds
> > > > >
> > > > > INIT_INCREMENT = 21600
> > > > >
> > > > >
> > > > > # A list of times to include, in format YYYYMMDD_hh
> > > > >
> > > > > INIT_INCLUDE =
> > > > >
> > > > >
> > > > > # A list of times to exclude, in format YYYYMMDD_hh
> > > > >
> > > > > INIT_EXCLUDE =
> > > > >
> > > > >
> > > > > #
> > > > >
> > > > > # Specify model valid time window in format YYYYMM[DD[_hh]].
Only
> > > tracks
> > > > > that fall within the valid time window will
> > > > >
> > > > > # be used.
> > > > >
> > > > > #
> > > > >
> > > > > VALID_BEG =
> > > > >
> > > > > VALID_END =
> > > > >
> > > > >
> > > > > #
> > > > >
> > > > > # Run MET tc_pairs by indicating the top-level directories
for the
> > > A-deck
> > > > > and B-deck files. Set to 'yes' to
> > > > >
> > > > > # run using top-level directories, 'no' if you want to run
tc_pairs
> > on
> > > > > files paired by the wrapper.
> > > > >
> > > > > TC_PAIRS_READ_ALL_FILES = no
> > > > >
> > > > >
> > > > > # set to true or yes to reformat track data into ATCF format
> expected
> > > by
> > > > > tc_pairs
> > > > >
> > > > > TC_PAIRS_REFORMAT_DECK = no
> > > > >
> > > > >
> > > > > # OVERWRITE OPTIONS
> > > > >
> > > > > # Don't overwrite filter files if they already exist.
> > > > >
> > > > > # Set to yes if you do NOT want to override existing files
> > > > >
> > > > > # Set to no if you do want to override existing files
> > > > >
> > > > > TC_PAIRS_SKIP_IF_OUTPUT_EXISTS = no
> > > > >
> > > > >
> > > > > #
> > > > >
> > > > > # MET TC-Pairs
> > > > >
> > > > > #
> > > > >
> > > > > # List of models to be used (white space or comma separated)
eg:
> > DSHP,
> > > > > LGEM, HWRF
> > > > >
> > > > > # If no models are listed, then process all models in the
input
> > > file(s).
> > > > >
> > > > > MODEL =
> > > > >
> > > > >
> > > > > # List of storm ids of interest (space or comma separated)
e.g.:
> > > > AL112012,
> > > > > AL122012
> > > > >
> > > > > # If no storm ids are listed, then process all storm ids in
the
> input
> > > > > file(s).
> > > > >
> > > > > #TC_PAIRS_STORM_ID = ML2092014
> > > > >
> > > > > #TC_PAIRS_STORM_ID = al062018, al092018, al132018, al142018
> > > > >
> > > > >
> > > > > # Basins (of origin/region). Indicate with space or
> comma-separated
> > > list
> > > > > of regions, eg. AL: for North Atlantic,
> > > > >
> > > > > # WP: Western North Pacific, CP: Central North Pacific, SH:
> Southern
> > > > > Hemisphere, IO: North Indian Ocean, LS: Southern
> > > > >
> > > > > # Hemisphere
> > > > >
> > > > > #TC_PAIRS_BASIN = AL
> > > > >
> > > > > TC_PAIRS_BASIN =
> > > > >
> > > > >
> > > > > # Cyclone, a space or comma-separated list of cyclone
numbers. If
> > left
> > > > > empty, all cyclones will be used.
> > > > >
> > > > > TC_PAIRS_CYCLONE =
> > > > >
> > > > > #TC_PAIRS_CYCLONE = 06
> > > > >
> > > > >
> > > > > # Storm name, a space or comma-separated list of storm names
to
> > > evaluate.
> > > > > If
> > > > > left empty, all storms will be used.
> > > > >
> > > > > TC_PAIRS_STORM_NAME =
> > > > >
> > > > >
> > > > > # DLAND file, the full path of the file that contains the
gridded
> > > > > representation of the
> > > > >
> > > > > # minimum distance from land.
> > > > >
> > > > > TC_PAIRS_DLAND_FILE = MET_BASE/tc_data/
> dland_global_tenth_degree.nc
> > > > >
> > > > >
> > > > >
> > > > > #
> > > > >
> > > > > # DIRECTORIES
> > > > >
> > > > > #
> > > > >
> > > > > [dir]
> > > > >
> > > > > # Location of input track data directory
> > > > >
> > > > > # for ADECK and BDECK data
> > > > >
> > > > > TC_PAIRS_ADECK_INPUT_DIR = /lfs1/BMC/amb-verif/vhtest/adeck
> > > > >
> > > > > TC_PAIRS_EDECK_INPUT_DIR = /lfs1/BMC/amb-verif/vhtest/edeck
> > > > >
> > > > > TC_PAIRS_BDECK_INPUT_DIR = /lfs1/BMC/amb-verif/vhtest/bdeck
> > > > >
> > > > >
> > > > > TC_PAIRS_OUTPUT_DIR = {OUTPUT_BASE}/tc_pairs
> > > > >
> > > > >
> > > > > [filename_templates]
> > > > >
> > > > > TC_PAIRS_ADECK_TEMPLATE =
tctrk.atcf.{date?fmt=%Y%m%d%H}.gcp1.txt
> > > > >
> > > > > TC_PAIRS_EDECK_TEMPLATE =
> > > > >
> {date?fmt=%Y%m%d%H}.b{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> > > > >
> > > > > TC_PAIRS_BDECK_TEMPLATE =
> > > > >
> {date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> > > > >
> > > > > TC_PAIRS_OUTPUT_TEMPLATE =
> > > tc_pairs_{basin?fmt=%s}{date?fmt=%Y%m%d%H}.dat
> > > > >
> > > > >
> > > > > *** my input files:
> > > > >
> > > > >
> > > > > adeck:
> > > > >
> > > > > total 96
> > > > >
> > > > > -rw-r--r-- 1 amb-verif amb-verif 20560 Apr 12 19:33
> > > > > tctrk.atcf.2020072100.gcp1.txt
> > > > >
> > > > > -rw-r--r-- 1 amb-verif amb-verif 39578 Apr 14 15:57
> > > > > tctrk.atcf.2020072300.gcp1.txt
> > > > >
> > > > > -rw-r--r-- 1 amb-verif amb-verif 30326 Apr 14 15:57
> > > > > tctrk.atcf.2020072400.gcp1.txt
> > > > >
> > > > >
> > > > > bdeck:
> > > > >
> > > > > total 224
> > > > >
> > > > > -rw-r--r-- 1 amb-verif amb-verif 997 Apr 12 19:32
> > > > 2020051418.bal902020.dat
> > > > >
> > > > > -rw-r--r-- 1 amb-verif amb-verif 1547 Apr 12 19:32
> > > > 2020072100.bal902020.dat
> > > > >
> > > > > -rw-r--r-- 1 amb-verif amb-verif 1547 Apr 12 19:32
> > > > 2020072100.bal992020.dat
> > > > >
> > > > > -rw-r--r-- 1 amb-verif amb-verif 3165 Apr 12 19:32
> > > > 2020072100.bep072020.dat
> > > > >
> > > > > -rw-r--r-- 1 amb-verif amb-verif 2447 Apr 12 19:32
> > > > 2020072100.bep082020.dat
> > > > >
> > > > > -rw-r--r-- 1 amb-verif amb-verif 1763 Apr 12 19:32
> > > > 2020072106.bal992020.dat
> > > > >
> > > > > -rw-r--r-- 1 amb-verif amb-verif 3381 Apr 12 19:32
> > > > 2020072106.bep072020.dat
> > > > >
> > > > > -rw-r--r-- 1 amb-verif amb-verif 2879 Apr 12 19:32
> > > > 2020072106.bep082020.dat
> > > > >
> > > > > -rw-r--r-- 1 amb-verif amb-verif 1979 Apr 12 19:32
> > > > 2020072112.bal992020.dat
> > > > >
> > > > > -rw-r--r-- 1 amb-verif amb-verif 3597 Apr 12 19:32
> > > > 2020072112.bep072020.dat
> > > > >
> > > > > -rw-r--r-- 1 amb-verif amb-verif 1980 Apr 12 19:32
> > > > 2020072112.bep082020.dat
> > > > >
> > > > > -rw-r--r-- 1 amb-verif amb-verif 2231 Apr 12 19:32
> > > > 2020072118.bal072020.dat
> > > > >
> > > > > -rw-r--r-- 1 amb-verif amb-verif 1115 Apr 12 19:32
> > > > 2020072118.bal912020.dat
> > > > >
> > > > > -rw-r--r-- 1 amb-verif amb-verif 2195 Apr 12 19:32
> > > > 2020072118.bal992020.dat
> > > > >
> > > > > -rw-r--r-- 1 amb-verif amb-verif 2412 Apr 12 19:32
> > > > 2020072118.bep082020.dat
> > > > >
> > > > > -rw-r--r-- 1 amb-verif amb-verif 2663 Jul 23 2020
> > > > 2020072300.bal072020.dat
> > > > >
> > > > > -rw-r--r-- 1 amb-verif amb-verif 2231 Jul 23 2020
> > > > 2020072300.bal082020.dat
> > > > >
> > > > > -rw-r--r-- 1 amb-verif amb-verif 2195 Jul 23 2020
> > > > 2020072300.bal912020.dat
> > > > >
> > > > > -rw-r--r-- 1 amb-verif amb-verif 5004 Jul 23 2020
> > > > 2020072300.bep082020.dat
> > > > >
> > > > > -rw-r--r-- 1 amb-verif amb-verif 3095 Jul 23 2020
> > > > 2020072306.bal072020.dat
> > > > >
> > > > > -rw-r--r-- 1 amb-verif amb-verif 2447 Jul 23 2020
> > > > 2020072306.bal082020.dat
> > > > >
> > > > > -rw-r--r-- 1 amb-verif amb-verif 5652 Jul 23 2020
> > > > 2020072306.bep082020.dat
> > > > >
> > > > > -rw-r--r-- 1 amb-verif amb-verif 3527 Jul 23 2020
> > > > 2020072312.bal072020.dat
> > > > >
> > > > > -rw-r--r-- 1 amb-verif amb-verif 2663 Jul 23 2020
> > > > 2020072312.bal082020.dat
> > > > >
> > > > > -rw-r--r-- 1 amb-verif amb-verif 6300 Jul 23 2020
> > > > 2020072312.bep082020.dat
> > > > >
> > > > > -rw-r--r-- 1 amb-verif amb-verif 3959 Jul 23 2020
> > > > 2020072318.bal072020.dat
> > > > >
> > > > > -rw-r--r-- 1 amb-verif amb-verif 2879 Jul 23 2020
> > > > 2020072318.bal082020.dat
> > > > >
> > > > > -rw-r--r-- 1 amb-verif amb-verif 6948 Jul 23 2020
> > > > 2020072318.bep082020.dat
> > > > >
> > > > > -rw-r--r-- 1 amb-verif amb-verif 4391 Jul 24 2020
> > > > 2020072400.bal072020.dat
> > > > >
> > > > > -rw-r--r-- 1 amb-verif amb-verif 3095 Jul 24 2020
> > > > 2020072400.bal082020.dat
> > > > >
> > > > > -rw-r--r-- 1 amb-verif amb-verif 7596 Jul 24 2020
> > > > 2020072400.bep082020.dat
> > > > >
> > > > > -rw-r--r-- 1 amb-verif amb-verif 4823 Jul 24 2020
> > > > 2020072406.bal072020.dat
> > > > >
> > > > > -rw-r--r-- 1 amb-verif amb-verif 3311 Jul 24 2020
> > > > 2020072406.bal082020.dat
> > > > >
> > > > > -rw-r--r-- 1 amb-verif amb-verif 8244 Jul 24 2020
> > > > 2020072406.bep082020.dat
> > > > >
> > > > > -rw-r--r-- 1 amb-verif amb-verif 5039 Jul 24 2020
> > > > 2020072412.bal072020.dat
> > > > >
> > > > > -rw-r--r-- 1 amb-verif amb-verif 2412 Jul 24 2020
> > > > 2020072412.bal082020.dat
> > > > >
> > > > > -rw-r--r-- 1 amb-verif amb-verif 8892 Jul 24 2020
> > > > 2020072412.bep082020.dat
> > > > >
> > > > > -rw-r--r-- 1 amb-verif amb-verif 5255 Jul 24 2020
> > > > 2020072418.bal072020.dat
> > > > >
> > > > > -rw-r--r-- 1 amb-verif amb-verif 2628 Jul 24 2020
> > > > 2020072418.bal082020.dat
> > > > >
> > > > > -rw-r--r-- 1 amb-verif amb-verif 1115 Jul 24 2020
> > > > 2020072418.bal922020.dat
> > > > >
> > > > > -rw-r--r-- 1 amb-verif amb-verif 9540 Jul 24 2020
> > > > 2020072418.bep082020.dat
> > > > >
> > > > >
> > > > > edeck:
> > > > >
> > > > > total 124
> > > > >
> > > > > -rw-r--r-- 1 amb-verif amb-verif 121621 Apr 23 20:44
> > > > > 2020072112.eep072020.dat
> > > > >
> > > > >
> > > > > some of the data:
> > > > >
> > > > >
> > > > > head -3 adeck/tctrk.atcf.2020072100.gcp1.txt
> > > > >
> > > > > AL, 99, 2020072100, 03, GCP1, 000, 89N, 381W, 22, 1010,
XX, 34,
> > > NEQ,
> > > > > 0000, 0000, 0000, 0000, -99, -99, 34, 0, 0, , 0,
,
> > 0,
> > > > 0,
> > > > > , , , , 0, 0, 0, 0, THERMO
PARAMS,
> > > > > -12, 225,
> > > > > -30, N, 10, DT, -999
> > > > >
> > > > > AL, 90, 2020072100, 03, GCP1, 000, 275N, 954W, 22, 1008,
XX, 34,
> > > NEQ,
> > > > > 0000, 0000, 0000, 0000, -99, -99, 117, 0, 0, , 0,
,
> > 0,
> > > > 0,
> > > > > , , , , 0, 0, 0, 0, THERMO
PARAMS,
> > -31,
> > > > > 326, -226, N, 10, DT, -999
> > > > >
> > > > > EP, 07, 2020072100, 03, GCP1, 000, 193N, 1318W, 38, 1007,
XX, 34,
> > > NEQ,
> > > > > 0032, 0000, 0000, 0029, 1011, 52, 25, 0, 0, , 0,
,
> > 0,
> > > > 0,
> > > > > , , , , 0, 0, 0, 0, THERMO
PARAMS,
> > > > > 34, 274,
> > > > > 378, Y, 10, DT, -999
> > > > >
> > > > >
> > > > > head -3 bdeck/2020072112.bep082020.dat
> > > > >
> > > > > EP, 08, 2020072000, , BEST, 0, 148N, 1188W, 25, 1008,
LO, 0,
> > > ,
> > > > > 0, 0, 0, 0, 1011, 100, 40, 0, 0, E, 0,
, 0,
> > > 0,
> > > > > INVEST, S, 0, , 0, 0, 0, 0, genesis-num,
014,
> > > > >
> > > > > EP, 08, 2020072006, , BEST, 0, 143N, 1192W, 25, 1008,
LO, 0,
> > > ,
> > > > > 0, 0, 0, 0, 1011, 100, 30, 35, 0, E, 0,
, 0,
> > > 0,
> > > > > INVEST, M, 0, , 0, 0, 0, 0, genesis-num,
014,
> > > > >
> > > > > EP, 08, 2020072012, , BEST, 0, 139N, 1194W, 30, 1008,
TD, 0,
> > > ,
> > > > > 0, 0, 0, 0, 1011, 100, 30, 40, 0, E, 0,
, 0,
> > > 0,
> > > > > INVEST, M, 0, , 0, 0, 0, 0, genesis-num,
014,
> > > > > TRANSITIONED, epB02020 to ep082020,
> > > > >
> > > > >
> > > > > head -3 edeck/2020072112.eep072020.dat
> > > > >
> > > > > EP, 07, 2020071206, GN, OFCL, 48, , , 0, 48,
ESB,
> > > genFcst,
> > > > ,
> > > > > ,
> > > > > 0, 013,
> > > > >
> > > > > EP, 07, 2020071206, GN, OFCL, 120, , , 0, 120,
ESB,
> > > genFcst,
> > > > ,
> > > > > ,
> > > > > 0, 013,
> > > > >
> > > > > EP, 07, 2020071206, GN, OFCL, 168, , , 10, 168,
ESB,
> > > genFcst,
> > > > ,
> > > > > ,
> > > > > 0, 013,
> > > > >
> > > > >
> > > > > *** metplus_final.conf:
> > > > >
> > > > >
> > > > > [config]
> > > > >
> > > > > CLOCK_TIME = 20210423205222
> > > > >
> > > > > LOOP_ORDER = times
> > > > >
> > > > > PROCESS_LIST = TCPairs
> > > > >
> > > > > METPLUS_CONF = {OUTPUT_BASE}/metplus_final.conf
> > > > >
> > > > > LOG_METPLUS =
> > > > >
> > >
> /lfs1/BMC/amb-
verif/vhtest/output/logs/master_metplus.log.20210423205222
> > > > >
> > > > > LOG_TIMESTAMP_TEMPLATE = %Y%m%d%H%M%S
> > > > >
> > > > > LOG_LINE_FORMAT = %(asctime)s.%(msecs)03d %(name)s
> > > > > (%(filename)s:%(lineno)d) %(levelname)s: %(message)s
> > > > >
> > > > > LOG_ERR_LINE_FORMAT = {LOG_LINE_FORMAT}
> > > > >
> > > > > LOG_DEBUG_LINE_FORMAT = {LOG_LINE_FORMAT}
> > > > >
> > > > > LOG_INFO_LINE_FORMAT = %(asctime)s.%(msecs)03d %(name)s
> > %(levelname)s:
> > > > > %(message)s
> > > > >
> > > > > LOG_LINE_DATE_FORMAT = %m/%d %H:%M:%S
> > > > >
> > > > > LOG_TIMESTAMP_USE_DATATIME = no
> > > > >
> > > > > LOG_MET_OUTPUT_TO_METPLUS = yes
> > > > >
> > > > > LOG_MET_VERBOSITY = 2
> > > > >
> > > > > LOG_LEVEL = INFO
> > > > >
> > > > > TC_PAIRS_CONFIG_FILE =
{PARM_BASE}/met_config/TCPairsConfig_wrapped
> > > > >
> > > > > LOOP_BY = INIT
> > > > >
> > > > > INIT_TIME_FMT = %Y%m%d%H
> > > > >
> > > > > INIT_BEG = 2020072100
> > > > >
> > > > > INIT_END = 2020072418
> > > > >
> > > > > INIT_INCREMENT = 21600
> > > > >
> > > > > INIT_INCLUDE =
> > > > >
> > > > > INIT_EXCLUDE =
> > > > >
> > > > > VALID_BEG =
> > > > >
> > > > > VALID_END =
> > > > >
> > > > > TC_PAIRS_READ_ALL_FILES = no
> > > > >
> > > > > TC_PAIRS_REFORMAT_DECK = no
> > > > >
> > > > > TC_PAIRS_SKIP_IF_OUTPUT_EXISTS = no
> > > > >
> > > > > MODEL =
> > > > >
> > > > > TC_PAIRS_BASIN =
> > > > >
> > > > > TC_PAIRS_CYCLONE =
> > > > >
> > > > > TC_PAIRS_STORM_NAME =
> > > > >
> > > > > TC_PAIRS_DLAND_FILE = MET_BASE/tc_data/
> dland_global_tenth_degree.nc
> > > > >
> > > > > LOG_TIMESTAMP = 20210423205222
> > > > >
> > > > > METPLUS_CONFIG_FILES =
./my_user_config.conf,./TCPairs_jet.conf
> > > > >
> > > > > METPLUS_VERSION = 3.1.1
> > > > >
> > > > > CURRENT_FCST_NAME =
> > > > >
> > > > > CURRENT_OBS_NAME =
> > > > >
> > > > > CURRENT_FCST_LEVEL =
> > > > >
> > > > > CURRENT_OBS_LEVEL =
> > > > >
> > > > > USER_SHELL = bash
> > > > >
> > > > > DO_NOT_RUN_EXE = False
> > > > >
> > > > > TC_PAIRS_SKIP_TIMES =
> > > > >
> > > > > SKIP_TIMES =
> > > > >
> > > > > USE_EXPLICIT_NAME_AND_LEVEL = False
> > > > >
> > > > > LOG_TC_PAIRS_VERBOSITY = 2
> > > > >
> > > > > TC_PAIRS_MISSING_VAL_TO_REPLACE = -99
> > > > >
> > > > > TC_PAIRS_MISSING_VAL = -9999
> > > > >
> > > > > TC_PAIRS_STORM_ID =
> > > > >
> > > > > TC_PAIRS_SKIP_IF_REFORMAT_EXISTS = False
> > > > >
> > > > > TC_PAIRS_REFORMAT_TYPE = SBU
> > > > >
> > > > > SCRUB_STAGING_DIR = False
> > > > >
> > > > >
> > > > > [dir]
> > > > >
> > > > > OUTPUT_BASE = /lfs1/BMC/amb-verif/vhtest/output
> > > > >
> > > > > STAGING_DIR = {OUTPUT_BASE}/stage
> > > > >
> > > > > MET_INSTALL_DIR = /contrib/met/9.1/met-9.1.1
> > > > >
> > > > > MET_BIN_DIR =
> /contrib/met/9.1/met-9.1.1/src/tools/tc_utils/tc_pairs
> > > > >
> > > > > LOG_DIR = {OUTPUT_BASE}/logs
> > > > >
> > > > > TMP_DIR = {OUTPUT_BASE}/tmp
> > > > >
> > > > > INPUT_BASE = /lfs1/BMC/amb-verif/vhtest
> > > > >
> > > > > TC_PAIRS_ADECK_INPUT_DIR = /lfs1/BMC/amb-verif/vhtest/adeck
> > > > >
> > > > > TC_PAIRS_EDECK_INPUT_DIR = /lfs1/BMC/amb-verif/vhtest/edeck
> > > > >
> > > > > TC_PAIRS_BDECK_INPUT_DIR = /lfs1/BMC/amb-verif/vhtest/bdeck
> > > > >
> > > > > TC_PAIRS_OUTPUT_DIR = {OUTPUT_BASE}/tc_pairs
> > > > >
> > > > > METPLUS_BASE = /contrib/met/METplus/METplus-3.1.1
> > > > >
> > > > > PARM_BASE = /contrib/met/METplus/METplus-3.1.1/parm
> > > > >
> > > > > TC_PAIRS_REFORMAT_DIR =
> > > /lfs1/BMC/amb-verif/vhtest/output/track_data_atcf
> > > > >
> > > > >
> > > > > [exe]
> > > > >
> > > > > RM = rm
> > > > >
> > > > > CUT = cut
> > > > >
> > > > > TR = tr
> > > > >
> > > > > NCAP2 = ncap2
> > > > >
> > > > > CONVERT = convert
> > > > >
> > > > > NCDUMP = ncdump
> > > > >
> > > > >
> > > > > [filename_templates]
> > > > >
> > > > > TC_PAIRS_ADECK_TEMPLATE =
tctrk.atcf.{date?fmt=%Y%m%d%H}.gcp1.txt
> > > > >
> > > > > TC_PAIRS_EDECK_TEMPLATE =
> > > > >
> {date?fmt=%Y%m%d%H}.b{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> > > > >
> > > > > TC_PAIRS_BDECK_TEMPLATE =
> > > > >
> {date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> > > > >
> > > > > TC_PAIRS_OUTPUT_TEMPLATE =
> > > tc_pairs_{basin?fmt=%s}{date?fmt=%Y%m%d%H}.dat
> > > > >
> > > > >
> > > > > [user_env_vars]
> > > > >
> > > > >
> > > > > *** My Log:
> > > > >
> > > > >
> > > > > 04/23 20:52:22.576 metplus INFO: Running METplus v3.1.1
called with
> > > > > command: /contrib/met/METplus/METplus-
3.1.1/ush/master_metplus.py
> -c
> > > > > ./my_user_config.conf -c ./TCPairs_jet.conf
> > > > >
> > > > > 04/23 20:52:22.577 metplus INFO: Log file:
> > > > >
> > >
> /lfs1/BMC/amb-
verif/vhtest/output/logs/master_metplus.log.20210423205222
> > > > >
> > > > > 04/23 20:52:26.077 metplus INFO:
> > > ****************************************
> > > > >
> > > > > 04/23 20:52:26.077 metplus INFO: * Running METplus
> > > > >
> > > > > 04/23 20:52:26.077 metplus INFO: * at init time:
202007210000
> > > > >
> > > > > 04/23 20:52:26.077 metplus INFO:
> > > ****************************************
> > > > >
> > > > > 04/23 20:52:26.178 metplus.TCPairs (command_builder.py:122)
ERROR:
> > > > > (tc_pairs_wrapper.py:489) No BDECK files found searching for
basin
> ??
> > > and
> > > > > cyclone * using template
> > > > >
> {date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> > > > >
> > > > > 04/23 20:52:26.179 metplus INFO:
> > > ****************************************
> > > > >
> > > > > 04/23 20:52:26.179 metplus INFO: * Running METplus
> > > > >
> > > > > 04/23 20:52:26.179 metplus INFO: * at init time:
202007210600
> > > > >
> > > > > 04/23 20:52:26.179 metplus INFO:
> > > ****************************************
> > > > >
> > > > > 04/23 20:52:26.181 metplus.TCPairs (command_builder.py:122)
ERROR:
> > > > > (tc_pairs_wrapper.py:489) No BDECK files found searching for
basin
> ??
> > > and
> > > > > cyclone * using template
> > > > >
> {date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> > > > >
> > > > > 04/23 20:52:26.181 metplus INFO:
> > > ****************************************
> > > > >
> > > > > 04/23 20:52:26.181 metplus INFO: * Running METplus
> > > > >
> > > > > 04/23 20:52:26.181 metplus INFO: * at init time:
202007211200
> > > > >
> > > > > 04/23 20:52:26.181 metplus INFO:
> > > ****************************************
> > > > >
> > > > > 04/23 20:52:26.183 metplus.TCPairs (command_builder.py:122)
ERROR:
> > > > > (tc_pairs_wrapper.py:489) No BDECK files found searching for
basin
> ??
> > > and
> > > > > cyclone * using template
> > > > >
> {date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> > > > >
> > > > > 04/23 20:52:26.183 metplus INFO:
> > > ****************************************
> > > > >
> > > > > 04/23 20:52:26.183 metplus INFO: * Running METplus
> > > > >
> > > > > 04/23 20:52:26.184 metplus INFO: * at init time:
202007211800
> > > > >
> > > > > 04/23 20:52:26.184 metplus INFO:
> > > ****************************************
> > > > >
> > > > > 04/23 20:52:26.185 metplus.TCPairs (command_builder.py:122)
ERROR:
> > > > > (tc_pairs_wrapper.py:489) No BDECK files found searching for
basin
> ??
> > > and
> > > > > cyclone * using template
> > > > >
> {date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> > > > >
> > > > > 04/23 20:52:26.185 metplus INFO:
> > > ****************************************
> > > > >
> > > > > 04/23 20:52:26.186 metplus INFO: * Running METplus
> > > > >
> > > > > 04/23 20:52:26.186 metplus INFO: * at init time:
202007220000
> > > > >
> > > > > 04/23 20:52:26.186 metplus INFO:
> > > ****************************************
> > > > >
> > > > > 04/23 20:52:26.187 metplus.TCPairs (command_builder.py:122)
ERROR:
> > > > > (tc_pairs_wrapper.py:489) No BDECK files found searching for
basin
> ??
> > > and
> > > > > cyclone * using template
> > > > >
> {date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> > > > >
> > > > > 04/23 20:52:26.188 metplus INFO:
> > > ****************************************
> > > > >
> > > > > 04/23 20:52:26.188 metplus INFO: * Running METplus
> > > > >
> > > > > 04/23 20:52:26.188 metplus INFO: * at init time:
202007220600
> > > > >
> > > > > 04/23 20:52:26.188 metplus INFO:
> > > ****************************************
> > > > >
> > > > > 04/23 20:52:26.190 metplus.TCPairs (command_builder.py:122)
ERROR:
> > > > > (tc_pairs_wrapper.py:489) No BDECK files found searching for
basin
> ??
> > > and
> > > > > cyclone * using template
> > > > >
> {date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> > > > >
> > > > > 04/23 20:52:26.190 metplus INFO:
> > > ****************************************
> > > > >
> > > > > 04/23 20:52:26.190 metplus INFO: * Running METplus
> > > > >
> > > > > 04/23 20:52:26.190 metplus INFO: * at init time:
202007221200
> > > > >
> > > > > 04/23 20:52:26.190 metplus INFO:
> > > ****************************************
> > > > >
> > > > > 04/23 20:52:26.192 metplus.TCPairs (command_builder.py:122)
ERROR:
> > > > > (tc_pairs_wrapper.py:489) No BDECK files found searching for
basin
> ??
> > > and
> > > > > cyclone * using template
> > > > >
> {date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> > > > >
> > > > > 04/23 20:52:26.192 metplus INFO:
> > > ****************************************
> > > > >
> > > > > 04/23 20:52:26.192 metplus INFO: * Running METplus
> > > > >
> > > > > 04/23 20:52:26.192 metplus INFO: * at init time:
202007221800
> > > > >
> > > > > 04/23 20:52:26.192 metplus INFO:
> > > ****************************************
> > > > >
> > > > > 04/23 20:52:26.194 metplus.TCPairs (command_builder.py:122)
ERROR:
> > > > > (tc_pairs_wrapper.py:489) No BDECK files found searching for
basin
> ??
> > > and
> > > > > cyclone * using template
> > > > >
> {date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> > > > >
> > > > > 04/23 20:52:26.194 metplus INFO:
> > > ****************************************
> > > > >
> > > > > 04/23 20:52:26.194 metplus INFO: * Running METplus
> > > > >
> > > > > 04/23 20:52:26.194 metplus INFO: * at init time:
202007230000
> > > > >
> > > > > 04/23 20:52:26.194 metplus INFO:
> > > ****************************************
> > > > >
> > > > > 04/23 20:52:26.196 metplus.TCPairs (command_builder.py:122)
ERROR:
> > > > > (tc_pairs_wrapper.py:489) No BDECK files found searching for
basin
> ??
> > > and
> > > > > cyclone * using template
> > > > >
> {date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> > > > >
> > > > > 04/23 20:52:26.196 metplus INFO:
> > > ****************************************
> > > > >
> > > > > 04/23 20:52:26.196 metplus INFO: * Running METplus
> > > > >
> > > > > 04/23 20:52:26.197 metplus INFO: * at init time:
202007230600
> > > > >
> > > > > 04/23 20:52:26.197 metplus INFO:
> > > ****************************************
> > > > >
> > > > > 04/23 20:52:26.198 metplus.TCPairs (command_builder.py:122)
ERROR:
> > > > > (tc_pairs_wrapper.py:489) No BDECK files found searching for
basin
> ??
> > > and
> > > > > cyclone * using template
> > > > >
> {date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> > > > >
> > > > > 04/23 20:52:26.199 metplus INFO:
> > > ****************************************
> > > > >
> > > > > 04/23 20:52:26.199 metplus INFO: * Running METplus
> > > > >
> > > > > 04/23 20:52:26.199 metplus INFO: * at init time:
202007231200
> > > > >
> > > > > 04/23 20:52:26.199 metplus INFO:
> > > ****************************************
> > > > >
> > > > > 04/23 20:52:26.200 metplus.TCPairs (command_builder.py:122)
ERROR:
> > > > > (tc_pairs_wrapper.py:489) No BDECK files found searching for
basin
> ??
> > > and
> > > > > cyclone * using template
> > > > >
> {date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> > > > >
> > > > > 04/23 20:52:26.201 metplus INFO:
> > > ****************************************
> > > > >
> > > > > 04/23 20:52:26.201 metplus INFO: * Running METplus
> > > > >
> > > > > 04/23 20:52:26.201 metplus INFO: * at init time:
202007231800
> > > > >
> > > > > 04/23 20:52:26.201 metplus INFO:
> > > ****************************************
> > > > >
> > > > > 04/23 20:52:26.203 metplus.TCPairs (command_builder.py:122)
ERROR:
> > > > > (tc_pairs_wrapper.py:489) No BDECK files found searching for
basin
> ??
> > > and
> > > > > cyclone * using template
> > > > >
> {date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> > > > >
> > > > > 04/23 20:52:26.203 metplus INFO:
> > > ****************************************
> > > > >
> > > > > 04/23 20:52:26.203 metplus INFO: * Running METplus
> > > > >
> > > > > 04/23 20:52:26.203 metplus INFO: * at init time:
202007240000
> > > > >
> > > > > 04/23 20:52:26.203 metplus INFO:
> > > ****************************************
> > > > >
> > > > > 04/23 20:52:26.205 metplus.TCPairs (command_builder.py:122)
ERROR:
> > > > > (tc_pairs_wrapper.py:489) No BDECK files found searching for
basin
> ??
> > > and
> > > > > cyclone * using template
> > > > >
> {date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> > > > >
> > > > > 04/23 20:52:26.205 metplus INFO:
> > > ****************************************
> > > > >
> > > > > 04/23 20:52:26.205 metplus INFO: * Running METplus
> > > > >
> > > > > 04/23 20:52:26.205 metplus INFO: * at init time:
202007240600
> > > > >
> > > > > 04/23 20:52:26.205 metplus INFO:
> > > ****************************************
> > > > >
> > > > > 04/23 20:52:26.207 metplus.TCPairs (command_builder.py:122)
ERROR:
> > > > > (tc_pairs_wrapper.py:489) No BDECK files found searching for
basin
> ??
> > > and
> > > > > cyclone * using template
> > > > >
> {date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> > > > >
> > > > > 04/23 20:52:26.207 metplus INFO:
> > > ****************************************
> > > > >
> > > > > 04/23 20:52:26.207 metplus INFO: * Running METplus
> > > > >
> > > > > 04/23 20:52:26.207 metplus INFO: * at init time:
202007241200
> > > > >
> > > > > 04/23 20:52:26.208 metplus INFO:
> > > ****************************************
> > > > >
> > > > > 04/23 20:52:26.209 metplus.TCPairs (command_builder.py:122)
ERROR:
> > > > > (tc_pairs_wrapper.py:489) No BDECK files found searching for
basin
> ??
> > > and
> > > > > cyclone * using template
> > > > >
> {date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> > > > >
> > > > > 04/23 20:52:26.209 metplus INFO:
> > > ****************************************
> > > > >
> > > > > 04/23 20:52:26.210 metplus INFO: * Running METplus
> > > > >
> > > > > 04/23 20:52:26.210 metplus INFO: * at init time:
202007241800
> > > > >
> > > > > 04/23 20:52:26.210 metplus INFO:
> > > ****************************************
> > > > >
> > > > > 04/23 20:52:26.211 metplus.TCPairs (command_builder.py:122)
ERROR:
> > > > > (tc_pairs_wrapper.py:489) No BDECK files found searching for
basin
> ??
> > > and
> > > > > cyclone * using template
> > > > >
> {date?fmt=%Y%m%d%H}.e{basin?fmt=%s}{cyclone?fmt=%s}{date?fmt=%Y}.dat
> > > > >
> > > > > 04/23 20:52:26.212 metplus.TCPairs (met_util.py:210) ERROR:
TCPairs
> > had
> > > > 16
> > > > > errors.
> > > > >
> > > > > 04/23 20:52:26.212 metplus INFO:
> > > > > /lfs1/BMC/amb-verif/vhtest/output/metplus_final.conf: write
> > > metplus.conf
> > > > > here
> > > > >
> > > > > 04/23 20:52:26.216 metplus (met_util.py:246) ERROR: METplus
has
> > > finished
> > > > > running but had 16 errors.
> > > > >
> > > > > 04/23 20:52:26.216 metplus INFO: Check the log file for more
> > > information:
> > > > >
> > >
> /lfs1/BMC/amb-
verif/vhtest/output/logs/master_metplus.log.20210423205222
> > > > >
> > > > >
> > > > >
> > > > > Please let me know if you need additional information.
> > > > >
> > > > > Thank you,
> > > > > Venita
> > > > >
> > > > > --
> > > > > Venita Hagerty, PhD
> > > > > Research Associate
> > > > > CIRA at NOAA, GSL/AVID
> > > > > 2B152, x6098
> > > > >
> > > > >
> > > >
> > > >
> > >
> > > --
> > > Venita Hagerty, PhD
> > > Research Associate
> > > CIRA at NOAA, GSL/AVID
> > > 2B152, x6098
> > >
> > >
> >
> >
>
> --
> Venita Hagerty, PhD
> Research Associate
> CIRA at NOAA, GSL/AVID
> 2B152, x6098
>
>
------------------------------------------------
More information about the Met_help
mailing list