[Met_help] [rt.rap.ucar.edu #97897] History for Problems with METplus "grid_stat_custom_loop_list"
George McCabe via RT
met_help at ucar.edu
Tue Dec 22 12:35:40 MST 2020
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Hi MET Help Desk,
I am trying to run grid_stat over each individual member (18 in total) in my use case. It will process member 1 with no issues, however I do get the following error printout with any succeeding member:
12/14 14:54:05.639 metplus (met_util.py:920) INFO: ****************************************
12/14 14:54:05.640 metplus (met_util.py:921) INFO: * Running METplus
12/14 14:54:05.640 metplus (met_util.py:923) INFO: * at init time: 202006151700
12/14 14:54:05.640 metplus (met_util.py:926) INFO: ****************************************
12/14 14:54:05.640 metplus.GridStat (compare_gridded_wrapper.py:176) INFO: Processing forecast lead 1 hour
12/14 14:54:05.640 metplus.GridStat (compare_gridded_wrapper.py:184) INFO: Processing custom string: 01
12/14 14:54:05.643 metplus.GridStat (command_runner.py:89) INFO: COMMAND: /home/brian.matilla/WoFS_2020/MET_scripts/met9/bin/grid_stat -v 3 /work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/WOFS/pcp_combine/20200615/1700/ENS_MEM_01/wofs01_PCP_20200615_1700_1800_A1.nc /work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/OBS/pcp_combine/20200615/1700/mrms_PCP_20200615_1700_1800_A1_wofs.nc /home/brian.matilla/WoFS_2020/MET_scripts/MET_configs/GridStatConfig_WOFS_PCP_1H -outdir /work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/WOFS/grid_stat/20200615/1700/
12/14 14:54:11.874 metplus.GridStat (compare_gridded_wrapper.py:184) INFO: Processing custom string: 02
12/14 14:54:11.876 metplus.GridStat (met_util.py:215) ERROR: Fatal error occurred
Traceback (most recent call last):
File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-3.1/metplus/util/met_util.py", line 195, in run_metplus
loop_over_times_and_call(config, processes)
File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-3.1/metplus/util/met_util.py", line 939, in loop_over_times_and_call
process.run_at_time(input_dict)
File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-3.1/metplus/wrappers/compare_gridded_wrapper.py", line 189, in run_at_time
self.run_at_time_once(time_info)
File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-3.1/metplus/wrappers/compare_gridded_wrapper.py", line 224, in run_at_time_once
self.run_at_time_all_fields(time_info)
File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-3.1/metplus/wrappers/compare_gridded_wrapper.py", line 288, in run_at_time_all_fields
return_list=True)
File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-3.1/metplus/wrappers/command_builder.py", line 357, in find_model
return_list=return_list)
File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-3.1/metplus/wrappers/command_builder.py", line 468, in find_data
return self.find_exact_file(**arg_dict, allow_dir=allow_dir)
File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-3.1/metplus/wrappers/command_builder.py", line 495, in find_exact_file
**time_info)
File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-3.1/metplus/util/config/string_template_substitution.py", line 399, in do_string_sub
return find_and_replace_tags_in_template(match_list, tmpl, kwargs, skip_missing_tags)
File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-3.1/metplus/util/config/string_template_substitution.py", line 431, in find_and_replace_tags_in_template
" for template: " + tmpl)
TypeError: The key valid was not passed to do_string_sub for template: /work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/WOFS/pcp_combine/{init?fmt=%Y%m%d?shift=-44100}/{init?fmt=%H%M}/ENS_MEM_{custom?fmt=%s}/wofs{custom?fmt=%s}_PCP_{init?fmt=%Y%m%d}_{init?fmt=%H%M}_{valid?fmt=%H%M}_A1.nc
12/14 14:54:11Z run-METplus-metplus.GridStat: ERROR: Fatal error occurred
12/14 14:54:11.879 metplus.GridStat (met_util.py:216) INFO: Check the log file for more information: /work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/logs/master_metplus.log.20201214145404
12/14 14:54:11.879 metplus (met_util.py:812) INFO: /work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/metplus_final.conf: write metplus.conf here
12/14 14:54:11.880 metplus (met_util.py:245) ERROR: METplus has finished running but had 1 error.
12/14 14:54:11Z run-METplus-metplus: ERROR: METplus has finished running but had 1 error.
I am not entirely sure if MET 9.x or the latest versions of METplus have support to do ensemble-based percentile verification so I decided to try and run through each of the model members via grid_stat to generate the individual probability fields which I would then process through ensemble_stat and then finally back through grid_stat to generate the ensemble-based probabilities. Is there a way to work around this particular issue to be able to process each member in the “grid_stat_custom_loop_list”?
Many thanks!
-Brian
—————————————————————
Brian Matilla
Research Associate— Warn-on-Forecast Team
Cooperative Institute for Mesoscale Meteorological Studies — The University of Oklahoma
NOAA National Severe Storms Laboratory
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: Problems with METplus "grid_stat_custom_loop_list"
From: John Halley Gotway
Time: Mon Dec 14 15:43:28 2020
Hi Brian,
I'm assigning this ticket to George. Please give him a couple of days
to
respond.
Thanks,
John
On Mon, Dec 14, 2020 at 2:17 PM Brian Matilla - NOAA Affiliate via RT
<
met_help at ucar.edu> wrote:
>
> Mon Dec 14 14:16:34 2020: Request 97897 was acted upon.
> Transaction: Ticket created by brian.matilla at noaa.gov
> Queue: met_help
> Subject: Problems with METplus "grid_stat_custom_loop_list"
> Owner: Nobody
> Requestors: brian.matilla at noaa.gov
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97897 >
>
>
> Hi MET Help Desk,
>
> I am trying to run grid_stat over each individual member (18 in
total) in
> my use case. It will process member 1 with no issues, however I do
get the
> following error printout with any succeeding member:
>
> 12/14 14:54:05.639 metplus (met_util.py:920) INFO:
> ****************************************
> 12/14 14:54:05.640 metplus (met_util.py:921) INFO: * Running METplus
> 12/14 14:54:05.640 metplus (met_util.py:923) INFO: * at init time:
> 202006151700
> 12/14 14:54:05.640 metplus (met_util.py:926) INFO:
> ****************************************
> 12/14 14:54:05.640 metplus.GridStat (compare_gridded_wrapper.py:176)
INFO:
> Processing forecast lead 1 hour
> 12/14 14:54:05.640 metplus.GridStat (compare_gridded_wrapper.py:184)
INFO:
> Processing custom string: 01
> 12/14 14:54:05.643 metplus.GridStat (command_runner.py:89) INFO:
COMMAND:
> /home/brian.matilla/WoFS_2020/MET_scripts/met9/bin/grid_stat -v 3
>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/WOFS/pcp_combine/20200615/1700/ENS_MEM_01/wofs01_PCP_20200615_1700_1800_A1.nc
>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/OBS/pcp_combine/20200615/1700/mrms_PCP_20200615_1700_1800_A1_
> wofs.nc
>
/home/brian.matilla/WoFS_2020/MET_scripts/MET_configs/GridStatConfig_WOFS_PCP_1H
> -outdir
>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/WOFS/grid_stat/20200615/1700/
> 12/14 14:54:11.874 metplus.GridStat (compare_gridded_wrapper.py:184)
INFO:
> Processing custom string: 02
> 12/14 14:54:11.876 metplus.GridStat (met_util.py:215) ERROR: Fatal
error
> occurred
> Traceback (most recent call last):
> File
> "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
3.1/metplus/util/met_util.py",
> line 195, in run_metplus
> loop_over_times_and_call(config, processes)
> File
> "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
3.1/metplus/util/met_util.py",
> line 939, in loop_over_times_and_call
> process.run_at_time(input_dict)
> File
> "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
3.1/metplus/wrappers/compare_gridded_wrapper.py",
> line 189, in run_at_time
> self.run_at_time_once(time_info)
> File
> "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
3.1/metplus/wrappers/compare_gridded_wrapper.py",
> line 224, in run_at_time_once
> self.run_at_time_all_fields(time_info)
> File
> "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
3.1/metplus/wrappers/compare_gridded_wrapper.py",
> line 288, in run_at_time_all_fields
> return_list=True)
> File
> "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
3.1/metplus/wrappers/command_builder.py",
> line 357, in find_model
> return_list=return_list)
> File
> "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
3.1/metplus/wrappers/command_builder.py",
> line 468, in find_data
> return self.find_exact_file(**arg_dict, allow_dir=allow_dir)
> File
> "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
3.1/metplus/wrappers/command_builder.py",
> line 495, in find_exact_file
> **time_info)
> File
> "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
3.1/metplus/util/config/string_template_substitution.py",
> line 399, in do_string_sub
> return find_and_replace_tags_in_template(match_list, tmpl,
kwargs,
> skip_missing_tags)
> File
> "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
3.1/metplus/util/config/string_template_substitution.py",
> line 431, in find_and_replace_tags_in_template
> " for template: " + tmpl)
> TypeError: The key valid was not passed to do_string_sub for
template:
>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/WOFS/pcp_combine/{init?fmt=%Y%m%d?shift=-
44100}/{init?fmt=%H%M}/ENS_MEM_{custom?fmt=%s}/wofs{custom?fmt=%s}_PCP_{init?fmt=%Y%m%d}_{init?fmt=%H%M}_{valid?fmt=%H%M}_A1.nc
> 12/14 14:54:11Z run-METplus-metplus.GridStat: ERROR: Fatal error
occurred
> 12/14 14:54:11.879 metplus.GridStat (met_util.py:216) INFO: Check
the log
> file for more information:
>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/logs/master_metplus.log.20201214145404
> 12/14 14:54:11.879 metplus (met_util.py:812) INFO:
> /work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/metplus_final.conf:
write
> metplus.conf here
> 12/14 14:54:11.880 metplus (met_util.py:245) ERROR: METplus has
finished
> running but had 1 error.
> 12/14 14:54:11Z run-METplus-metplus: ERROR: METplus has finished
running
> but had 1 error.
>
> I am not entirely sure if MET 9.x or the latest versions of METplus
have
> support to do ensemble-based percentile verification so I decided to
try
> and run through each of the model members via grid_stat to generate
the
> individual probability fields which I would then process through
> ensemble_stat and then finally back through grid_stat to generate
the
> ensemble-based probabilities. Is there a way to work around this
particular
> issue to be able to process each member in the
“grid_stat_custom_loop_list”?
>
> Many thanks!
>
> -Brian
> —————————————————————
> Brian Matilla
> Research Associate— Warn-on-Forecast Team
> Cooperative Institute for Mesoscale Meteorological Studies — The
> University of Oklahoma
> NOAA National Severe Storms Laboratory
>
>
>
------------------------------------------------
Subject: Problems with METplus "grid_stat_custom_loop_list"
From: George McCabe
Time: Mon Dec 14 15:46:16 2020
Hi Brian,
I'm not sure why that error is occurring. You should be able to run
the way you described. I was not able to replicate the error on my
end. Could you please set LOG_LEVEL=DEBUG, rerun the use case, then
send me the full log file and the metplus_final.conf file?
Thanks,
George
On Mon Dec 14 14:16:34 2020, brian.matilla at noaa.gov wrote:
> Hi MET Help Desk,
>
> I am trying to run grid_stat over each individual member (18 in
total)
> in my use case. It will process member 1 with no issues, however I
do
> get the following error printout with any succeeding member:
>
> 12/14 14:54:05.639 metplus (met_util.py:920) INFO:
> ****************************************
> 12/14 14:54:05.640 metplus (met_util.py:921) INFO: * Running METplus
> 12/14 14:54:05.640 metplus (met_util.py:923) INFO: * at init time:
> 202006151700
> 12/14 14:54:05.640 metplus (met_util.py:926) INFO:
> ****************************************
> 12/14 14:54:05.640 metplus.GridStat (compare_gridded_wrapper.py:176)
> INFO: Processing forecast lead 1 hour
> 12/14 14:54:05.640 metplus.GridStat (compare_gridded_wrapper.py:184)
> INFO: Processing custom string: 01
> 12/14 14:54:05.643 metplus.GridStat (command_runner.py:89) INFO:
> COMMAND:
/home/brian.matilla/WoFS_2020/MET_scripts/met9/bin/grid_stat
> -v 3
>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/WOFS/pcp_combine/20200615/1700/ENS_MEM_01/wofs01_PCP_20200615_1700_1800_A1.nc
>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/OBS/pcp_combine/20200615/1700/mrms_PCP_20200615_1700_1800_A1_wofs.nc
>
/home/brian.matilla/WoFS_2020/MET_scripts/MET_configs/GridStatConfig_WOFS_PCP_1H
> -outdir
>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/WOFS/grid_stat/20200615/1700/
> 12/14 14:54:11.874 metplus.GridStat (compare_gridded_wrapper.py:184)
> INFO: Processing custom string: 02
> 12/14 14:54:11.876 metplus.GridStat (met_util.py:215) ERROR: Fatal
> error occurred
> Traceback (most recent call last):
> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> 3.1/metplus/util/met_util.py", line 195, in run_metplus
> loop_over_times_and_call(config, processes)
> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> 3.1/metplus/util/met_util.py", line 939, in loop_over_times_and_call
> process.run_at_time(input_dict)
> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 189, in
> run_at_time
> self.run_at_time_once(time_info)
> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 224, in
> run_at_time_once
> self.run_at_time_all_fields(time_info)
> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 288, in
> run_at_time_all_fields
> return_list=True)
> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> 3.1/metplus/wrappers/command_builder.py", line 357, in find_model
> return_list=return_list)
> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> 3.1/metplus/wrappers/command_builder.py", line 468, in find_data
> return self.find_exact_file(**arg_dict, allow_dir=allow_dir)
> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> 3.1/metplus/wrappers/command_builder.py", line 495, in
find_exact_file
> **time_info)
> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> 3.1/metplus/util/config/string_template_substitution.py", line 399,
in
> do_string_sub
> return find_and_replace_tags_in_template(match_list, tmpl,
kwargs,
> skip_missing_tags)
> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> 3.1/metplus/util/config/string_template_substitution.py", line 431,
in
> find_and_replace_tags_in_template
> " for template: " + tmpl)
> TypeError: The key valid was not passed to do_string_sub for
> template:
>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/WOFS/pcp_combine/{init?fmt=%Y%m%d?shift=-
>
44100}/{init?fmt=%H%M}/ENS_MEM_{custom?fmt=%s}/wofs{custom?fmt=%s}_PCP_{init?fmt=%Y%m%d}_{init?fmt=%H%M}_{valid?fmt=%H%M}_A1.nc
> 12/14 14:54:11Z run-METplus-metplus.GridStat: ERROR: Fatal error
> occurred
> 12/14 14:54:11.879 metplus.GridStat (met_util.py:216) INFO: Check
the
> log file for more information:
>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/logs/master_metplus.log.20201214145404
> 12/14 14:54:11.879 metplus (met_util.py:812) INFO:
> /work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/metplus_final.conf:
> write metplus.conf here
> 12/14 14:54:11.880 metplus (met_util.py:245) ERROR: METplus has
> finished running but had 1 error.
> 12/14 14:54:11Z run-METplus-metplus: ERROR: METplus has finished
> running but had 1 error.
>
> I am not entirely sure if MET 9.x or the latest versions of METplus
> have support to do ensemble-based percentile verification so I
decided
> to try and run through each of the model members via grid_stat to
> generate the individual probability fields which I would then
process
> through ensemble_stat and then finally back through grid_stat to
> generate the ensemble-based probabilities. Is there a way to work
> around this particular issue to be able to process each member in
the
> “grid_stat_custom_loop_list”?
>
> Many thanks!
>
> -Brian
> —————————————————————
> Brian Matilla
> Research Associate— Warn-on-Forecast Team
> Cooperative Institute for Mesoscale Meteorological Studies — The
> University of Oklahoma
> NOAA National Severe Storms Laboratory
------------------------------------------------
Subject: Problems with METplus "grid_stat_custom_loop_list"
From: John Halley Gotway
Time: Mon Dec 14 16:13:26 2020
Hi Brian,
This is John. George is taking a look at the METplus issues. But I am
wondering what you mean by...
"ensemble-based percentile verification"?
Does this mean, for example, that you want to run Ensemble-Stat to
compute
the probability of exceeding some forecast percentile value?
So you might setup an Ensemble-Stat config file using:
ens = {
field = [ { name="REFC"; level="L0"; cat_thresh = >=SFP90; } ];
}
This would compute the probability of exceeding the 90-th percentile
of
"sample forecast" values.
But the real question here is what is meant by "sample forecast"
values?
Would the 90-th percentile be defined over ALL of the input ensemble
member
fields... or compute the 90-th percentile separately for each input
ensemble member?
For what it's worth, when I run Ensemble-Stat like that, I get the
following error message:
ERROR :
ERROR : Simple_Node::check(double, double, double) const ->
percentile
threshold ">=SFP90" used before it was set.
ERROR :
So it is not currently supported. But am I describing the
functionality
you're looking for? Or is it something else?
Thanks,
John Halley Gotway
On Mon, Dec 14, 2020 at 3:43 PM The RT System itself via RT <
met_help at ucar.edu> wrote:
>
> Mon Dec 14 15:43:28 2020: Request 97897 was acted upon.
> Transaction: Given to johnhg (John Halley Gotway) by RT_System
> Queue: met_help
> Subject: Problems with METplus "grid_stat_custom_loop_list"
> Owner: johnhg
> Requestors: brian.matilla at noaa.gov
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97897 >
>
>
> This transaction appears to have no content
>
------------------------------------------------
Subject: Problems with METplus "grid_stat_custom_loop_list"
From: John Halley Gotway
Time: Mon Dec 14 16:16:15 2020
Brian,
Listed at the bottom is what I found in the documentation about it:
https://dtcenter.github.io/MET/develop/Users_Guide/config_options.html
So my question is basically, are you requesting the percentile
thresholds
be supported in Ensemble-Stat when setting the "cat_thresh" options in
the
"ens" dictionary?
Percentile Thresholds:
-
Thresholds may be defined as percentiles of the data being
processed in
several places:
-
In Point-Stat and Grid-Stat when setting “cat_thresh”,
“wind_thresh”
and “cnt_thresh”.
-
In Wavelet-Stat when setting “cat_thresh”.
-
In MODE when setting “conv_thresh” and “merge_thresh”.
-
In Ensemble-Stat when setting “obs_thresh”.
-
When using the “censor_thresh” config option.
-
In the Stat-Analysis “-out_fcst_thresh” and “-out_obs_thresh”
job
command options.
-
In the Gen-Vx-Mask “-thresh” command line option.
On Mon, Dec 14, 2020 at 4:13 PM John Halley Gotway <johnhg at ucar.edu>
wrote:
> Hi Brian,
>
> This is John. George is taking a look at the METplus issues. But I
am
> wondering what you mean by...
> "ensemble-based percentile verification"?
>
> Does this mean, for example, that you want to run Ensemble-Stat to
compute
> the probability of exceeding some forecast percentile value?
>
> So you might setup an Ensemble-Stat config file using:
>
> ens = {
> field = [ { name="REFC"; level="L0"; cat_thresh = >=SFP90; } ];
> }
>
> This would compute the probability of exceeding the 90-th percentile
of
> "sample forecast" values.
> But the real question here is what is meant by "sample forecast"
values?
> Would the 90-th percentile be defined over ALL of the input ensemble
member
> fields... or compute the 90-th percentile separately for each input
> ensemble member?
>
> For what it's worth, when I run Ensemble-Stat like that, I get the
> following error message:
> ERROR :
> ERROR : Simple_Node::check(double, double, double) const ->
percentile
> threshold ">=SFP90" used before it was set.
> ERROR :
>
> So it is not currently supported. But am I describing the
functionality
> you're looking for? Or is it something else?
>
> Thanks,
> John Halley Gotway
>
>
> On Mon, Dec 14, 2020 at 3:43 PM The RT System itself via RT <
> met_help at ucar.edu> wrote:
>
>>
>> Mon Dec 14 15:43:28 2020: Request 97897 was acted upon.
>> Transaction: Given to johnhg (John Halley Gotway) by RT_System
>> Queue: met_help
>> Subject: Problems with METplus "grid_stat_custom_loop_list"
>> Owner: johnhg
>> Requestors: brian.matilla at noaa.gov
>> Status: new
>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97897 >
>>
>>
>> This transaction appears to have no content
>>
>
------------------------------------------------
Subject: Problems with METplus "grid_stat_custom_loop_list"
From: Brian Matilla - NOAA Affiliate
Time: Fri Dec 18 11:48:18 2020
Hi John,
So to your question, yes that is what I was going towards. I recall
vaguely discussing this as a possibility quite a while ago but I
haven’t kept up much with the open issues on Github to see if that had
been implemented yet. I figured in the meantime, I could probably work
around that by reading in each of the model’s ensemble members
individually into “grid_stat” and processing both the percentiles and
the neighborhood searching/smoothing, then specifying into METplus’
“FCST_ENSEMBLE_STAT_INPUT_TEMPLATE” the output grid_stat files into
ensemble_stat, and then one more pass through grid_stat to output the
ensemble statistics. That way, it can keep everything inside METplus’
functionality.
-Brian
—————————————————————
Brian Matilla
Research Associate— Warn-on-Forecast Team
Cooperative Institute for Mesoscale Meteorological Studies — The
University of Oklahoma
NOAA National Severe Storms Laboratory
> On Dec 14, 2020, at 5:16 PM, John Halley Gotway via RT
<met_help at ucar.edu> wrote:
>
> Brian,
>
> Listed at the bottom is what I found in the documentation about it:
>
https://dtcenter.github.io/MET/develop/Users_Guide/config_options.html
>
> So my question is basically, are you requesting the percentile
thresholds
> be supported in Ensemble-Stat when setting the "cat_thresh" options
in the
> "ens" dictionary?
>
> Percentile Thresholds:
>
> -
>
> Thresholds may be defined as percentiles of the data being
processed in
> several places:
> -
>
> In Point-Stat and Grid-Stat when setting “cat_thresh”,
“wind_thresh”
> and “cnt_thresh”.
> -
>
> In Wavelet-Stat when setting “cat_thresh”.
> -
>
> In MODE when setting “conv_thresh” and “merge_thresh”.
> -
>
> In Ensemble-Stat when setting “obs_thresh”.
> -
>
> When using the “censor_thresh” config option.
> -
>
> In the Stat-Analysis “-out_fcst_thresh” and “-out_obs_thresh”
job
> command options.
> -
>
> In the Gen-Vx-Mask “-thresh” command line option.
>
>
> On Mon, Dec 14, 2020 at 4:13 PM John Halley Gotway <johnhg at ucar.edu>
wrote:
>
>> Hi Brian,
>>
>> This is John. George is taking a look at the METplus issues. But I
am
>> wondering what you mean by...
>> "ensemble-based percentile verification"?
>>
>> Does this mean, for example, that you want to run Ensemble-Stat to
compute
>> the probability of exceeding some forecast percentile value?
>>
>> So you might setup an Ensemble-Stat config file using:
>>
>> ens = {
>> field = [ { name="REFC"; level="L0"; cat_thresh = >=SFP90; } ];
>> }
>>
>> This would compute the probability of exceeding the 90-th
percentile of
>> "sample forecast" values.
>> But the real question here is what is meant by "sample forecast"
values?
>> Would the 90-th percentile be defined over ALL of the input
ensemble member
>> fields... or compute the 90-th percentile separately for each input
>> ensemble member?
>>
>> For what it's worth, when I run Ensemble-Stat like that, I get the
>> following error message:
>> ERROR :
>> ERROR : Simple_Node::check(double, double, double) const ->
percentile
>> threshold ">=SFP90" used before it was set.
>> ERROR :
>>
>> So it is not currently supported. But am I describing the
functionality
>> you're looking for? Or is it something else?
>>
>> Thanks,
>> John Halley Gotway
>>
>>
>> On Mon, Dec 14, 2020 at 3:43 PM The RT System itself via RT <
>> met_help at ucar.edu> wrote:
>>
>>>
>>> Mon Dec 14 15:43:28 2020: Request 97897 was acted upon.
>>> Transaction: Given to johnhg (John Halley Gotway) by RT_System
>>> Queue: met_help
>>> Subject: Problems with METplus "grid_stat_custom_loop_list"
>>> Owner: johnhg
>>> Requestors: brian.matilla at noaa.gov
>>> Status: new
>>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97897 >
>>>
>>>
>>> This transaction appears to have no content
>>>
>>
>
------------------------------------------------
Subject: Problems with METplus "grid_stat_custom_loop_list"
From: Brian Matilla - NOAA Affiliate
Time: Fri Dec 18 13:21:11 2020
Hi George,
I have gone ahead and rerun METplus with the log level set to DEBUG.
Attached is the metplus_final.conf as well as the log file. I should
note here that the input expected into grid_stat is the output file
from “pcp_combine” so that the percentiles can be calculated.
Thanks,
-Brian
—————————————————————
Brian Matilla
Research Associate— Warn-on-Forecast Team
Cooperative Institute for Mesoscale Meteorological Studies — The
University of Oklahoma
NOAA National Severe Storms Laboratory
> On Dec 14, 2020, at 4:46 PM, George McCabe via RT
<met_help at ucar.edu> wrote:
>
> Hi Brian,
>
> I'm not sure why that error is occurring. You should be able to run
the way you described. I was not able to replicate the error on my
end. Could you please set LOG_LEVEL=DEBUG, rerun the use case, then
send me the full log file and the metplus_final.conf file?
>
> Thanks,
> George
>
> On Mon Dec 14 14:16:34 2020, brian.matilla at noaa.gov wrote:
>> Hi MET Help Desk,
>>
>> I am trying to run grid_stat over each individual member (18 in
total)
>> in my use case. It will process member 1 with no issues, however I
do
>> get the following error printout with any succeeding member:
>>
>> 12/14 14:54:05.639 metplus (met_util.py:920) INFO:
>> ****************************************
>> 12/14 14:54:05.640 metplus (met_util.py:921) INFO: * Running
METplus
>> 12/14 14:54:05.640 metplus (met_util.py:923) INFO: * at init time:
>> 202006151700
>> 12/14 14:54:05.640 metplus (met_util.py:926) INFO:
>> ****************************************
>> 12/14 14:54:05.640 metplus.GridStat
(compare_gridded_wrapper.py:176)
>> INFO: Processing forecast lead 1 hour
>> 12/14 14:54:05.640 metplus.GridStat
(compare_gridded_wrapper.py:184)
>> INFO: Processing custom string: 01
>> 12/14 14:54:05.643 metplus.GridStat (command_runner.py:89) INFO:
>> COMMAND:
/home/brian.matilla/WoFS_2020/MET_scripts/met9/bin/grid_stat
>> -v 3
>>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/WOFS/pcp_combine/20200615/1700/ENS_MEM_01/wofs01_PCP_20200615_1700_1800_A1.nc
>>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/OBS/pcp_combine/20200615/1700/mrms_PCP_20200615_1700_1800_A1_wofs.nc
>>
/home/brian.matilla/WoFS_2020/MET_scripts/MET_configs/GridStatConfig_WOFS_PCP_1H
>> -outdir
>>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/WOFS/grid_stat/20200615/1700/
>> 12/14 14:54:11.874 metplus.GridStat
(compare_gridded_wrapper.py:184)
>> INFO: Processing custom string: 02
>> 12/14 14:54:11.876 metplus.GridStat (met_util.py:215) ERROR: Fatal
>> error occurred
>> Traceback (most recent call last):
>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>> 3.1/metplus/util/met_util.py", line 195, in run_metplus
>> loop_over_times_and_call(config, processes)
>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>> 3.1/metplus/util/met_util.py", line 939, in
loop_over_times_and_call
>> process.run_at_time(input_dict)
>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 189, in
>> run_at_time
>> self.run_at_time_once(time_info)
>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 224, in
>> run_at_time_once
>> self.run_at_time_all_fields(time_info)
>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 288, in
>> run_at_time_all_fields
>> return_list=True)
>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>> 3.1/metplus/wrappers/command_builder.py", line 357, in find_model
>> return_list=return_list)
>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>> 3.1/metplus/wrappers/command_builder.py", line 468, in find_data
>> return self.find_exact_file(**arg_dict, allow_dir=allow_dir)
>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>> 3.1/metplus/wrappers/command_builder.py", line 495, in
find_exact_file
>> **time_info)
>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>> 3.1/metplus/util/config/string_template_substitution.py", line 399,
in
>> do_string_sub
>> return find_and_replace_tags_in_template(match_list, tmpl,
kwargs,
>> skip_missing_tags)
>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>> 3.1/metplus/util/config/string_template_substitution.py", line 431,
in
>> find_and_replace_tags_in_template
>> " for template: " + tmpl)
>> TypeError: The key valid was not passed to do_string_sub for
>> template:
>>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/WOFS/pcp_combine/{init?fmt=%Y%m%d?shift=-
>>
44100}/{init?fmt=%H%M}/ENS_MEM_{custom?fmt=%s}/wofs{custom?fmt=%s}_PCP_{init?fmt=%Y%m%d}_{init?fmt=%H%M}_{valid?fmt=%H%M}_A1.nc
>> 12/14 14:54:11Z run-METplus-metplus.GridStat: ERROR: Fatal error
>> occurred
>> 12/14 14:54:11.879 metplus.GridStat (met_util.py:216) INFO: Check
the
>> log file for more information:
>>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/logs/master_metplus.log.20201214145404
>> 12/14 14:54:11.879 metplus (met_util.py:812) INFO:
>>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/metplus_final.conf:
>> write metplus.conf here
>> 12/14 14:54:11.880 metplus (met_util.py:245) ERROR: METplus has
>> finished running but had 1 error.
>> 12/14 14:54:11Z run-METplus-metplus: ERROR: METplus has finished
>> running but had 1 error.
>>
>> I am not entirely sure if MET 9.x or the latest versions of METplus
>> have support to do ensemble-based percentile verification so I
decided
>> to try and run through each of the model members via grid_stat to
>> generate the individual probability fields which I would then
process
>> through ensemble_stat and then finally back through grid_stat to
>> generate the ensemble-based probabilities. Is there a way to work
>> around this particular issue to be able to process each member in
the
>> “grid_stat_custom_loop_list”?
>>
>> Many thanks!
>>
>> -Brian
>> —————————————————————
>> Brian Matilla
>> Research Associate— Warn-on-Forecast Team
>> Cooperative Institute for Mesoscale Meteorological Studies — The
>> University of Oklahoma
>> NOAA National Severe Storms Laboratory
>
>
>
------------------------------------------------
Subject: Problems with METplus "grid_stat_custom_loop_list"
From: George McCabe
Time: Mon Dec 21 09:11:31 2020
Hi Brian,
Thank you for sending these files. I was able to recreate the error
and it
looks like there is an odd bug in the code. Valid time should
definitely be
available to use to find the file you are looking for. I will look
into it
and let you know when I have a fix in place. My question is: are you
tied
to using METplus 3.1 and would require a bugfix release for that
version to
continue your work? If you can upgrade to using a beta or develop
version
of METplus, I can issue the fix there instead.
Let me know what you think.
Thanks,
George
On Fri, Dec 18, 2020 at 1:21 PM Brian Matilla - NOAA Affiliate via RT
<
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97897 >
>
> Hi George,
>
> I have gone ahead and rerun METplus with the log level set to DEBUG.
> Attached is the metplus_final.conf as well as the log file. I should
note
> here that the input expected into grid_stat is the output file from
> “pcp_combine” so that the percentiles can be calculated.
>
> Thanks,
>
> -Brian
> —————————————————————
> Brian Matilla
> Research Associate— Warn-on-Forecast Team
> Cooperative Institute for Mesoscale Meteorological Studies — The
> University of Oklahoma
> NOAA National Severe Storms Laboratory
>
>
> > On Dec 14, 2020, at 4:46 PM, George McCabe via RT
<met_help at ucar.edu>
> wrote:
> >
> > Hi Brian,
> >
> > I'm not sure why that error is occurring. You should be able to
run the
> way you described. I was not able to replicate the error on my end.
Could
> you please set LOG_LEVEL=DEBUG, rerun the use case, then send me the
full
> log file and the metplus_final.conf file?
> >
> > Thanks,
> > George
> >
> > On Mon Dec 14 14:16:34 2020, brian.matilla at noaa.gov wrote:
> >> Hi MET Help Desk,
> >>
> >> I am trying to run grid_stat over each individual member (18 in
total)
> >> in my use case. It will process member 1 with no issues, however
I do
> >> get the following error printout with any succeeding member:
> >>
> >> 12/14 14:54:05.639 metplus (met_util.py:920) INFO:
> >> ****************************************
> >> 12/14 14:54:05.640 metplus (met_util.py:921) INFO: * Running
METplus
> >> 12/14 14:54:05.640 metplus (met_util.py:923) INFO: * at init
time:
> >> 202006151700
> >> 12/14 14:54:05.640 metplus (met_util.py:926) INFO:
> >> ****************************************
> >> 12/14 14:54:05.640 metplus.GridStat
(compare_gridded_wrapper.py:176)
> >> INFO: Processing forecast lead 1 hour
> >> 12/14 14:54:05.640 metplus.GridStat
(compare_gridded_wrapper.py:184)
> >> INFO: Processing custom string: 01
> >> 12/14 14:54:05.643 metplus.GridStat (command_runner.py:89) INFO:
> >> COMMAND:
/home/brian.matilla/WoFS_2020/MET_scripts/met9/bin/grid_stat
> >> -v 3
> >>
>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/WOFS/pcp_combine/20200615/1700/ENS_MEM_01/wofs01_PCP_20200615_1700_1800_A1.nc
> >>
>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/OBS/pcp_combine/20200615/1700/mrms_PCP_20200615_1700_1800_A1_
> wofs.nc
> >>
>
/home/brian.matilla/WoFS_2020/MET_scripts/MET_configs/GridStatConfig_WOFS_PCP_1H
> >> -outdir
> >>
>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/WOFS/grid_stat/20200615/1700/
> >> 12/14 14:54:11.874 metplus.GridStat
(compare_gridded_wrapper.py:184)
> >> INFO: Processing custom string: 02
> >> 12/14 14:54:11.876 metplus.GridStat (met_util.py:215) ERROR:
Fatal
> >> error occurred
> >> Traceback (most recent call last):
> >> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >> 3.1/metplus/util/met_util.py", line 195, in run_metplus
> >> loop_over_times_and_call(config, processes)
> >> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >> 3.1/metplus/util/met_util.py", line 939, in
loop_over_times_and_call
> >> process.run_at_time(input_dict)
> >> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 189, in
> >> run_at_time
> >> self.run_at_time_once(time_info)
> >> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 224, in
> >> run_at_time_once
> >> self.run_at_time_all_fields(time_info)
> >> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 288, in
> >> run_at_time_all_fields
> >> return_list=True)
> >> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >> 3.1/metplus/wrappers/command_builder.py", line 357, in find_model
> >> return_list=return_list)
> >> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >> 3.1/metplus/wrappers/command_builder.py", line 468, in find_data
> >> return self.find_exact_file(**arg_dict, allow_dir=allow_dir)
> >> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >> 3.1/metplus/wrappers/command_builder.py", line 495, in
find_exact_file
> >> **time_info)
> >> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >> 3.1/metplus/util/config/string_template_substitution.py", line
399, in
> >> do_string_sub
> >> return find_and_replace_tags_in_template(match_list, tmpl,
kwargs,
> >> skip_missing_tags)
> >> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >> 3.1/metplus/util/config/string_template_substitution.py", line
431, in
> >> find_and_replace_tags_in_template
> >> " for template: " + tmpl)
> >> TypeError: The key valid was not passed to do_string_sub for
> >> template:
> >>
>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/WOFS/pcp_combine/{init?fmt=%Y%m%d?shift=-
> >>
>
44100}/{init?fmt=%H%M}/ENS_MEM_{custom?fmt=%s}/wofs{custom?fmt=%s}_PCP_{init?fmt=%Y%m%d}_{init?fmt=%H%M}_{valid?fmt=%H%M}_A1.nc
> >> 12/14 14:54:11Z run-METplus-metplus.GridStat: ERROR: Fatal error
> >> occurred
> >> 12/14 14:54:11.879 metplus.GridStat (met_util.py:216) INFO: Check
the
> >> log file for more information:
> >>
>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/logs/master_metplus.log.20201214145404
> >> 12/14 14:54:11.879 metplus (met_util.py:812) INFO:
> >>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/metplus_final.conf:
> >> write metplus.conf here
> >> 12/14 14:54:11.880 metplus (met_util.py:245) ERROR: METplus has
> >> finished running but had 1 error.
> >> 12/14 14:54:11Z run-METplus-metplus: ERROR: METplus has finished
> >> running but had 1 error.
> >>
> >> I am not entirely sure if MET 9.x or the latest versions of
METplus
> >> have support to do ensemble-based percentile verification so I
decided
> >> to try and run through each of the model members via grid_stat to
> >> generate the individual probability fields which I would then
process
> >> through ensemble_stat and then finally back through grid_stat to
> >> generate the ensemble-based probabilities. Is there a way to work
> >> around this particular issue to be able to process each member in
the
> >> “grid_stat_custom_loop_list”?
> >>
> >> Many thanks!
> >>
> >> -Brian
> >> —————————————————————
> >> Brian Matilla
> >> Research Associate— Warn-on-Forecast Team
> >> Cooperative Institute for Mesoscale Meteorological Studies — The
> >> University of Oklahoma
> >> NOAA National Severe Storms Laboratory
> >
> >
> >
>
>
> Hi George,
>
> I have gone ahead and rerun METplus with the log level set to DEBUG.
> Attached is the metplus_final.conf as well as the log file. I should
note
> here that the input expected into grid_stat is the output file from
> “pcp_combine” so that the percentiles can be calculated.
>
> Thanks,
>
> -Brian
> —————————————————————
> Brian Matilla
> Research Associate— Warn-on-Forecast Team
> Cooperative Institute for Mesoscale Meteorological Studies — The
> University of Oklahoma
> NOAA National Severe Storms Laboratory
>
>
> On Dec 14, 2020, at 4:46 PM, George McCabe via RT
<met_help at ucar.edu>
> wrote:
>
> Hi Brian,
>
> I'm not sure why that error is occurring. You should be able to run
the
> way you described. I was not able to replicate the error on my end.
Could
> you please set LOG_LEVEL=DEBUG, rerun the use case, then send me the
full
> log file and the metplus_final.conf file?
>
> Thanks,
> George
>
> On Mon Dec 14 14:16:34 2020, brian.matilla at noaa.gov wrote:
>
> Hi MET Help Desk,
>
> I am trying to run grid_stat over each individual member (18 in
total)
> in my use case. It will process member 1 with no issues, however I
do
> get the following error printout with any succeeding member:
>
> 12/14 14:54:05.639 metplus (met_util.py:920) INFO:
> ****************************************
> 12/14 14:54:05.640 metplus (met_util.py:921) INFO: * Running METplus
> 12/14 14:54:05.640 metplus (met_util.py:923) INFO: * at init time:
> 202006151700
> 12/14 14:54:05.640 metplus (met_util.py:926) INFO:
> ****************************************
> 12/14 14:54:05.640 metplus.GridStat (compare_gridded_wrapper.py:176)
> INFO: Processing forecast lead 1 hour
> 12/14 14:54:05.640 metplus.GridStat (compare_gridded_wrapper.py:184)
> INFO: Processing custom string: 01
> 12/14 14:54:05.643 metplus.GridStat (command_runner.py:89) INFO:
> COMMAND:
/home/brian.matilla/WoFS_2020/MET_scripts/met9/bin/grid_stat
> -v 3
>
>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/WOFS/pcp_combine/20200615/1700/ENS_MEM_01/wofs01_PCP_20200615_1700_1800_A1.nc
>
>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/OBS/pcp_combine/20200615/1700/mrms_PCP_20200615_1700_1800_A1_wofs.nc
>
>
/home/brian.matilla/WoFS_2020/MET_scripts/MET_configs/GridStatConfig_WOFS_PCP_1H
> -outdir
>
>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/WOFS/grid_stat/20200615/1700/
> 12/14 14:54:11.874 metplus.GridStat (compare_gridded_wrapper.py:184)
> INFO: Processing custom string: 02
> 12/14 14:54:11.876 metplus.GridStat (met_util.py:215) ERROR: Fatal
> error occurred
> Traceback (most recent call last):
> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> 3.1/metplus/util/met_util.py", line 195, in run_metplus
> loop_over_times_and_call(config, processes)
> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> 3.1/metplus/util/met_util.py", line 939, in loop_over_times_and_call
> process.run_at_time(input_dict)
> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 189, in
> run_at_time
> self.run_at_time_once(time_info)
> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 224, in
> run_at_time_once
> self.run_at_time_all_fields(time_info)
> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 288, in
> run_at_time_all_fields
> return_list=True)
> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> 3.1/metplus/wrappers/command_builder.py", line 357, in find_model
> return_list=return_list)
> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> 3.1/metplus/wrappers/command_builder.py", line 468, in find_data
> return self.find_exact_file(**arg_dict, allow_dir=allow_dir)
> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> 3.1/metplus/wrappers/command_builder.py", line 495, in
find_exact_file
> **time_info)
> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> 3.1/metplus/util/config/string_template_substitution.py", line 399,
in
> do_string_sub
> return find_and_replace_tags_in_template(match_list, tmpl,
kwargs,
> skip_missing_tags)
> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> 3.1/metplus/util/config/string_template_substitution.py", line 431,
in
> find_and_replace_tags_in_template
> " for template: " + tmpl)
> TypeError: The key valid was not passed to do_string_sub for
> template:
>
>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/WOFS/pcp_combine/{init?fmt=%Y%m%d?shift=-
>
>
44100}/{init?fmt=%H%M}/ENS_MEM_{custom?fmt=%s}/wofs{custom?fmt=%s}_PCP_{init?fmt=%Y%m%d}_{init?fmt=%H%M}_{valid?fmt=%H%M}_A1.nc
> 12/14 14:54:11Z run-METplus-metplus.GridStat: ERROR: Fatal error
> occurred
> 12/14 14:54:11.879 metplus.GridStat (met_util.py:216) INFO: Check
the
> log file for more information:
>
>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/logs/master_metplus.log.20201214145404
> 12/14 14:54:11.879 metplus (met_util.py:812) INFO:
> /work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/metplus_final.conf:
> write metplus.conf here
> 12/14 14:54:11.880 metplus (met_util.py:245) ERROR: METplus has
> finished running but had 1 error.
> 12/14 14:54:11Z run-METplus-metplus: ERROR: METplus has finished
> running but had 1 error.
>
> I am not entirely sure if MET 9.x or the latest versions of METplus
> have support to do ensemble-based percentile verification so I
decided
> to try and run through each of the model members via grid_stat to
> generate the individual probability fields which I would then
process
> through ensemble_stat and then finally back through grid_stat to
> generate the ensemble-based probabilities. Is there a way to work
> around this particular issue to be able to process each member in
the
> “grid_stat_custom_loop_list”?
>
> Many thanks!
>
> -Brian
> —————————————————————
> Brian Matilla
> Research Associate— Warn-on-Forecast Team
> Cooperative Institute for Mesoscale Meteorological Studies — The
> University of Oklahoma
> NOAA National Severe Storms Laboratory
>
>
>
>
>
>
--
George McCabe - Software Engineer III
National Center for Atmospheric Research
Research Applications Laboratory
303-497-2768
---
My working day may not be your working day. Please do not feel obliged
to
reply to this email outside of your normal working hours.
------------------------------------------------
Subject: Problems with METplus "grid_stat_custom_loop_list"
From: Brian Matilla - NOAA Affiliate
Time: Mon Dec 21 09:15:37 2020
Hi George,
Thanks for looking into this. I’m really only tied to the MET version
(9.0.1) that our IT staff was able to install on our machines but I do
have a copy of the latest METplus beta version so I can work with that
if that helps.
Thanks,
-Brian
—————————————————————
Brian Matilla
Research Associate— Warn-on-Forecast Team
Cooperative Institute for Mesoscale Meteorological Studies — The
University of Oklahoma
NOAA National Severe Storms Laboratory
> On Dec 21, 2020, at 10:11 AM, George McCabe via RT
<met_help at ucar.edu> wrote:
>
> Hi Brian,
>
> Thank you for sending these files. I was able to recreate the error
and it
> looks like there is an odd bug in the code. Valid time should
definitely be
> available to use to find the file you are looking for. I will look
into it
> and let you know when I have a fix in place. My question is: are you
tied
> to using METplus 3.1 and would require a bugfix release for that
version to
> continue your work? If you can upgrade to using a beta or develop
version
> of METplus, I can issue the fix there instead.
>
> Let me know what you think.
>
> Thanks,
> George
>
> On Fri, Dec 18, 2020 at 1:21 PM Brian Matilla - NOAA Affiliate via
RT <
> met_help at ucar.edu> wrote:
>
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97897 >
>>
>> Hi George,
>>
>> I have gone ahead and rerun METplus with the log level set to
DEBUG.
>> Attached is the metplus_final.conf as well as the log file. I
should note
>> here that the input expected into grid_stat is the output file from
>> “pcp_combine” so that the percentiles can be calculated.
>>
>> Thanks,
>>
>> -Brian
>> —————————————————————
>> Brian Matilla
>> Research Associate— Warn-on-Forecast Team
>> Cooperative Institute for Mesoscale Meteorological Studies — The
>> University of Oklahoma
>> NOAA National Severe Storms Laboratory
>>
>>
>>> On Dec 14, 2020, at 4:46 PM, George McCabe via RT
<met_help at ucar.edu>
>> wrote:
>>>
>>> Hi Brian,
>>>
>>> I'm not sure why that error is occurring. You should be able to
run the
>> way you described. I was not able to replicate the error on my end.
Could
>> you please set LOG_LEVEL=DEBUG, rerun the use case, then send me
the full
>> log file and the metplus_final.conf file?
>>>
>>> Thanks,
>>> George
>>>
>>> On Mon Dec 14 14:16:34 2020, brian.matilla at noaa.gov wrote:
>>>> Hi MET Help Desk,
>>>>
>>>> I am trying to run grid_stat over each individual member (18 in
total)
>>>> in my use case. It will process member 1 with no issues, however
I do
>>>> get the following error printout with any succeeding member:
>>>>
>>>> 12/14 14:54:05.639 metplus (met_util.py:920) INFO:
>>>> ****************************************
>>>> 12/14 14:54:05.640 metplus (met_util.py:921) INFO: * Running
METplus
>>>> 12/14 14:54:05.640 metplus (met_util.py:923) INFO: * at init
time:
>>>> 202006151700
>>>> 12/14 14:54:05.640 metplus (met_util.py:926) INFO:
>>>> ****************************************
>>>> 12/14 14:54:05.640 metplus.GridStat
(compare_gridded_wrapper.py:176)
>>>> INFO: Processing forecast lead 1 hour
>>>> 12/14 14:54:05.640 metplus.GridStat
(compare_gridded_wrapper.py:184)
>>>> INFO: Processing custom string: 01
>>>> 12/14 14:54:05.643 metplus.GridStat (command_runner.py:89) INFO:
>>>> COMMAND:
/home/brian.matilla/WoFS_2020/MET_scripts/met9/bin/grid_stat
>>>> -v 3
>>>>
>>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/WOFS/pcp_combine/20200615/1700/ENS_MEM_01/wofs01_PCP_20200615_1700_1800_A1.nc
>>>>
>>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/OBS/pcp_combine/20200615/1700/mrms_PCP_20200615_1700_1800_A1_
>> wofs.nc
>>>>
>>
/home/brian.matilla/WoFS_2020/MET_scripts/MET_configs/GridStatConfig_WOFS_PCP_1H
>>>> -outdir
>>>>
>>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/WOFS/grid_stat/20200615/1700/
>>>> 12/14 14:54:11.874 metplus.GridStat
(compare_gridded_wrapper.py:184)
>>>> INFO: Processing custom string: 02
>>>> 12/14 14:54:11.876 metplus.GridStat (met_util.py:215) ERROR:
Fatal
>>>> error occurred
>>>> Traceback (most recent call last):
>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>> 3.1/metplus/util/met_util.py", line 195, in run_metplus
>>>> loop_over_times_and_call(config, processes)
>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>> 3.1/metplus/util/met_util.py", line 939, in
loop_over_times_and_call
>>>> process.run_at_time(input_dict)
>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 189, in
>>>> run_at_time
>>>> self.run_at_time_once(time_info)
>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 224, in
>>>> run_at_time_once
>>>> self.run_at_time_all_fields(time_info)
>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 288, in
>>>> run_at_time_all_fields
>>>> return_list=True)
>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>> 3.1/metplus/wrappers/command_builder.py", line 357, in find_model
>>>> return_list=return_list)
>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>> 3.1/metplus/wrappers/command_builder.py", line 468, in find_data
>>>> return self.find_exact_file(**arg_dict, allow_dir=allow_dir)
>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>> 3.1/metplus/wrappers/command_builder.py", line 495, in
find_exact_file
>>>> **time_info)
>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>> 3.1/metplus/util/config/string_template_substitution.py", line
399, in
>>>> do_string_sub
>>>> return find_and_replace_tags_in_template(match_list, tmpl,
kwargs,
>>>> skip_missing_tags)
>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>> 3.1/metplus/util/config/string_template_substitution.py", line
431, in
>>>> find_and_replace_tags_in_template
>>>> " for template: " + tmpl)
>>>> TypeError: The key valid was not passed to do_string_sub for
>>>> template:
>>>>
>>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/WOFS/pcp_combine/{init?fmt=%Y%m%d?shift=-
>>>>
>>
44100}/{init?fmt=%H%M}/ENS_MEM_{custom?fmt=%s}/wofs{custom?fmt=%s}_PCP_{init?fmt=%Y%m%d}_{init?fmt=%H%M}_{valid?fmt=%H%M}_A1.nc
>>>> 12/14 14:54:11Z run-METplus-metplus.GridStat: ERROR: Fatal error
>>>> occurred
>>>> 12/14 14:54:11.879 metplus.GridStat (met_util.py:216) INFO: Check
the
>>>> log file for more information:
>>>>
>>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/logs/master_metplus.log.20201214145404
>>>> 12/14 14:54:11.879 metplus (met_util.py:812) INFO:
>>>>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/metplus_final.conf:
>>>> write metplus.conf here
>>>> 12/14 14:54:11.880 metplus (met_util.py:245) ERROR: METplus has
>>>> finished running but had 1 error.
>>>> 12/14 14:54:11Z run-METplus-metplus: ERROR: METplus has finished
>>>> running but had 1 error.
>>>>
>>>> I am not entirely sure if MET 9.x or the latest versions of
METplus
>>>> have support to do ensemble-based percentile verification so I
decided
>>>> to try and run through each of the model members via grid_stat to
>>>> generate the individual probability fields which I would then
process
>>>> through ensemble_stat and then finally back through grid_stat to
>>>> generate the ensemble-based probabilities. Is there a way to work
>>>> around this particular issue to be able to process each member in
the
>>>> “grid_stat_custom_loop_list”?
>>>>
>>>> Many thanks!
>>>>
>>>> -Brian
>>>> —————————————————————
>>>> Brian Matilla
>>>> Research Associate— Warn-on-Forecast Team
>>>> Cooperative Institute for Mesoscale Meteorological Studies — The
>>>> University of Oklahoma
>>>> NOAA National Severe Storms Laboratory
>>>
>>>
>>>
>>
>>
>> Hi George,
>>
>> I have gone ahead and rerun METplus with the log level set to
DEBUG.
>> Attached is the metplus_final.conf as well as the log file. I
should note
>> here that the input expected into grid_stat is the output file from
>> “pcp_combine” so that the percentiles can be calculated.
>>
>> Thanks,
>>
>> -Brian
>> —————————————————————
>> Brian Matilla
>> Research Associate— Warn-on-Forecast Team
>> Cooperative Institute for Mesoscale Meteorological Studies — The
>> University of Oklahoma
>> NOAA National Severe Storms Laboratory
>>
>>
>> On Dec 14, 2020, at 4:46 PM, George McCabe via RT
<met_help at ucar.edu>
>> wrote:
>>
>> Hi Brian,
>>
>> I'm not sure why that error is occurring. You should be able to run
the
>> way you described. I was not able to replicate the error on my end.
Could
>> you please set LOG_LEVEL=DEBUG, rerun the use case, then send me
the full
>> log file and the metplus_final.conf file?
>>
>> Thanks,
>> George
>>
>> On Mon Dec 14 14:16:34 2020, brian.matilla at noaa.gov wrote:
>>
>> Hi MET Help Desk,
>>
>> I am trying to run grid_stat over each individual member (18 in
total)
>> in my use case. It will process member 1 with no issues, however I
do
>> get the following error printout with any succeeding member:
>>
>> 12/14 14:54:05.639 metplus (met_util.py:920) INFO:
>> ****************************************
>> 12/14 14:54:05.640 metplus (met_util.py:921) INFO: * Running
METplus
>> 12/14 14:54:05.640 metplus (met_util.py:923) INFO: * at init time:
>> 202006151700
>> 12/14 14:54:05.640 metplus (met_util.py:926) INFO:
>> ****************************************
>> 12/14 14:54:05.640 metplus.GridStat
(compare_gridded_wrapper.py:176)
>> INFO: Processing forecast lead 1 hour
>> 12/14 14:54:05.640 metplus.GridStat
(compare_gridded_wrapper.py:184)
>> INFO: Processing custom string: 01
>> 12/14 14:54:05.643 metplus.GridStat (command_runner.py:89) INFO:
>> COMMAND:
/home/brian.matilla/WoFS_2020/MET_scripts/met9/bin/grid_stat
>> -v 3
>>
>>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/WOFS/pcp_combine/20200615/1700/ENS_MEM_01/wofs01_PCP_20200615_1700_1800_A1.nc
>>
>>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/OBS/pcp_combine/20200615/1700/mrms_PCP_20200615_1700_1800_A1_wofs.nc
>>
>>
/home/brian.matilla/WoFS_2020/MET_scripts/MET_configs/GridStatConfig_WOFS_PCP_1H
>> -outdir
>>
>>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/WOFS/grid_stat/20200615/1700/
>> 12/14 14:54:11.874 metplus.GridStat
(compare_gridded_wrapper.py:184)
>> INFO: Processing custom string: 02
>> 12/14 14:54:11.876 metplus.GridStat (met_util.py:215) ERROR: Fatal
>> error occurred
>> Traceback (most recent call last):
>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>> 3.1/metplus/util/met_util.py", line 195, in run_metplus
>> loop_over_times_and_call(config, processes)
>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>> 3.1/metplus/util/met_util.py", line 939, in
loop_over_times_and_call
>> process.run_at_time(input_dict)
>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 189, in
>> run_at_time
>> self.run_at_time_once(time_info)
>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 224, in
>> run_at_time_once
>> self.run_at_time_all_fields(time_info)
>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 288, in
>> run_at_time_all_fields
>> return_list=True)
>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>> 3.1/metplus/wrappers/command_builder.py", line 357, in find_model
>> return_list=return_list)
>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>> 3.1/metplus/wrappers/command_builder.py", line 468, in find_data
>> return self.find_exact_file(**arg_dict, allow_dir=allow_dir)
>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>> 3.1/metplus/wrappers/command_builder.py", line 495, in
find_exact_file
>> **time_info)
>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>> 3.1/metplus/util/config/string_template_substitution.py", line 399,
in
>> do_string_sub
>> return find_and_replace_tags_in_template(match_list, tmpl,
kwargs,
>> skip_missing_tags)
>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>> 3.1/metplus/util/config/string_template_substitution.py", line 431,
in
>> find_and_replace_tags_in_template
>> " for template: " + tmpl)
>> TypeError: The key valid was not passed to do_string_sub for
>> template:
>>
>>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/WOFS/pcp_combine/{init?fmt=%Y%m%d?shift=-
>>
>>
44100}/{init?fmt=%H%M}/ENS_MEM_{custom?fmt=%s}/wofs{custom?fmt=%s}_PCP_{init?fmt=%Y%m%d}_{init?fmt=%H%M}_{valid?fmt=%H%M}_A1.nc
>> 12/14 14:54:11Z run-METplus-metplus.GridStat: ERROR: Fatal error
>> occurred
>> 12/14 14:54:11.879 metplus.GridStat (met_util.py:216) INFO: Check
the
>> log file for more information:
>>
>>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/logs/master_metplus.log.20201214145404
>> 12/14 14:54:11.879 metplus (met_util.py:812) INFO:
>>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/metplus_final.conf:
>> write metplus.conf here
>> 12/14 14:54:11.880 metplus (met_util.py:245) ERROR: METplus has
>> finished running but had 1 error.
>> 12/14 14:54:11Z run-METplus-metplus: ERROR: METplus has finished
>> running but had 1 error.
>>
>> I am not entirely sure if MET 9.x or the latest versions of METplus
>> have support to do ensemble-based percentile verification so I
decided
>> to try and run through each of the model members via grid_stat to
>> generate the individual probability fields which I would then
process
>> through ensemble_stat and then finally back through grid_stat to
>> generate the ensemble-based probabilities. Is there a way to work
>> around this particular issue to be able to process each member in
the
>> “grid_stat_custom_loop_list”?
>>
>> Many thanks!
>>
>> -Brian
>> —————————————————————
>> Brian Matilla
>> Research Associate— Warn-on-Forecast Team
>> Cooperative Institute for Mesoscale Meteorological Studies — The
>> University of Oklahoma
>> NOAA National Severe Storms Laboratory
>>
>>
>>
>>
>>
>>
>
> --
> George McCabe - Software Engineer III
> National Center for Atmospheric Research
> Research Applications Laboratory
> 303-497-2768
> ---
> My working day may not be your working day. Please do not feel
obliged to
> reply to this email outside of your normal working hours.
>
------------------------------------------------
Subject: Problems with METplus "grid_stat_custom_loop_list"
From: George McCabe
Time: Mon Dec 21 09:26:10 2020
Hi Brian,
Since you have to use MET 9.0.1, I think it would be best if we issued
a
bugfix to METplus 3.0 to keep the versions aligned. The bug exists in
the
latest beta release, so upgrading to that would not solve the problem.
I
will let you know when the bugfix release is available. Sorry about
the
inconvenience and thank you for discovering this issue!
Thanks,
George
On Mon, Dec 21, 2020 at 9:16 AM Brian Matilla - NOAA Affiliate via RT
<
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97897 >
>
> Hi George,
>
> Thanks for looking into this. I’m really only tied to the MET
version
> (9.0.1) that our IT staff was able to install on our machines but I
do have
> a copy of the latest METplus beta version so I can work with that if
that
> helps.
>
> Thanks,
>
> -Brian
> —————————————————————
> Brian Matilla
> Research Associate— Warn-on-Forecast Team
> Cooperative Institute for Mesoscale Meteorological Studies — The
> University of Oklahoma
> NOAA National Severe Storms Laboratory
>
> > On Dec 21, 2020, at 10:11 AM, George McCabe via RT
<met_help at ucar.edu>
> wrote:
> >
> > Hi Brian,
> >
> > Thank you for sending these files. I was able to recreate the
error and
> it
> > looks like there is an odd bug in the code. Valid time should
definitely
> be
> > available to use to find the file you are looking for. I will look
into
> it
> > and let you know when I have a fix in place. My question is: are
you tied
> > to using METplus 3.1 and would require a bugfix release for that
version
> to
> > continue your work? If you can upgrade to using a beta or develop
version
> > of METplus, I can issue the fix there instead.
> >
> > Let me know what you think.
> >
> > Thanks,
> > George
> >
> > On Fri, Dec 18, 2020 at 1:21 PM Brian Matilla - NOAA Affiliate via
RT <
> > met_help at ucar.edu> wrote:
> >
> >>
> >> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97897 >
> >>
> >> Hi George,
> >>
> >> I have gone ahead and rerun METplus with the log level set to
DEBUG.
> >> Attached is the metplus_final.conf as well as the log file. I
should
> note
> >> here that the input expected into grid_stat is the output file
from
> >> “pcp_combine” so that the percentiles can be calculated.
> >>
> >> Thanks,
> >>
> >> -Brian
> >> —————————————————————
> >> Brian Matilla
> >> Research Associate— Warn-on-Forecast Team
> >> Cooperative Institute for Mesoscale Meteorological Studies — The
> >> University of Oklahoma
> >> NOAA National Severe Storms Laboratory
> >>
> >>
> >>> On Dec 14, 2020, at 4:46 PM, George McCabe via RT
<met_help at ucar.edu>
> >> wrote:
> >>>
> >>> Hi Brian,
> >>>
> >>> I'm not sure why that error is occurring. You should be able to
run the
> >> way you described. I was not able to replicate the error on my
end.
> Could
> >> you please set LOG_LEVEL=DEBUG, rerun the use case, then send me
the
> full
> >> log file and the metplus_final.conf file?
> >>>
> >>> Thanks,
> >>> George
> >>>
> >>> On Mon Dec 14 14:16:34 2020, brian.matilla at noaa.gov wrote:
> >>>> Hi MET Help Desk,
> >>>>
> >>>> I am trying to run grid_stat over each individual member (18 in
total)
> >>>> in my use case. It will process member 1 with no issues,
however I do
> >>>> get the following error printout with any succeeding member:
> >>>>
> >>>> 12/14 14:54:05.639 metplus (met_util.py:920) INFO:
> >>>> ****************************************
> >>>> 12/14 14:54:05.640 metplus (met_util.py:921) INFO: * Running
METplus
> >>>> 12/14 14:54:05.640 metplus (met_util.py:923) INFO: * at init
time:
> >>>> 202006151700
> >>>> 12/14 14:54:05.640 metplus (met_util.py:926) INFO:
> >>>> ****************************************
> >>>> 12/14 14:54:05.640 metplus.GridStat
(compare_gridded_wrapper.py:176)
> >>>> INFO: Processing forecast lead 1 hour
> >>>> 12/14 14:54:05.640 metplus.GridStat
(compare_gridded_wrapper.py:184)
> >>>> INFO: Processing custom string: 01
> >>>> 12/14 14:54:05.643 metplus.GridStat (command_runner.py:89)
INFO:
> >>>> COMMAND:
/home/brian.matilla/WoFS_2020/MET_scripts/met9/bin/grid_stat
> >>>> -v 3
> >>>>
> >>
>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/WOFS/pcp_combine/20200615/1700/ENS_MEM_01/wofs01_PCP_20200615_1700_1800_A1.nc
> >>>>
> >>
>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/OBS/pcp_combine/20200615/1700/mrms_PCP_20200615_1700_1800_A1_
> >> wofs.nc
> >>>>
> >>
>
/home/brian.matilla/WoFS_2020/MET_scripts/MET_configs/GridStatConfig_WOFS_PCP_1H
> >>>> -outdir
> >>>>
> >>
>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/WOFS/grid_stat/20200615/1700/
> >>>> 12/14 14:54:11.874 metplus.GridStat
(compare_gridded_wrapper.py:184)
> >>>> INFO: Processing custom string: 02
> >>>> 12/14 14:54:11.876 metplus.GridStat (met_util.py:215) ERROR:
Fatal
> >>>> error occurred
> >>>> Traceback (most recent call last):
> >>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >>>> 3.1/metplus/util/met_util.py", line 195, in run_metplus
> >>>> loop_over_times_and_call(config, processes)
> >>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >>>> 3.1/metplus/util/met_util.py", line 939, in
loop_over_times_and_call
> >>>> process.run_at_time(input_dict)
> >>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >>>> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 189, in
> >>>> run_at_time
> >>>> self.run_at_time_once(time_info)
> >>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >>>> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 224, in
> >>>> run_at_time_once
> >>>> self.run_at_time_all_fields(time_info)
> >>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >>>> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 288, in
> >>>> run_at_time_all_fields
> >>>> return_list=True)
> >>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >>>> 3.1/metplus/wrappers/command_builder.py", line 357, in
find_model
> >>>> return_list=return_list)
> >>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >>>> 3.1/metplus/wrappers/command_builder.py", line 468, in
find_data
> >>>> return self.find_exact_file(**arg_dict, allow_dir=allow_dir)
> >>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >>>> 3.1/metplus/wrappers/command_builder.py", line 495, in
find_exact_file
> >>>> **time_info)
> >>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >>>> 3.1/metplus/util/config/string_template_substitution.py", line
399, in
> >>>> do_string_sub
> >>>> return find_and_replace_tags_in_template(match_list, tmpl,
kwargs,
> >>>> skip_missing_tags)
> >>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >>>> 3.1/metplus/util/config/string_template_substitution.py", line
431, in
> >>>> find_and_replace_tags_in_template
> >>>> " for template: " + tmpl)
> >>>> TypeError: The key valid was not passed to do_string_sub for
> >>>> template:
> >>>>
> >>
>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/WOFS/pcp_combine/{init?fmt=%Y%m%d?shift=-
> >>>>
> >>
>
44100}/{init?fmt=%H%M}/ENS_MEM_{custom?fmt=%s}/wofs{custom?fmt=%s}_PCP_{init?fmt=%Y%m%d}_{init?fmt=%H%M}_{valid?fmt=%H%M}_A1.nc
> >>>> 12/14 14:54:11Z run-METplus-metplus.GridStat: ERROR: Fatal
error
> >>>> occurred
> >>>> 12/14 14:54:11.879 metplus.GridStat (met_util.py:216) INFO:
Check the
> >>>> log file for more information:
> >>>>
> >>
>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/logs/master_metplus.log.20201214145404
> >>>> 12/14 14:54:11.879 metplus (met_util.py:812) INFO:
> >>>>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/metplus_final.conf:
> >>>> write metplus.conf here
> >>>> 12/14 14:54:11.880 metplus (met_util.py:245) ERROR: METplus has
> >>>> finished running but had 1 error.
> >>>> 12/14 14:54:11Z run-METplus-metplus: ERROR: METplus has
finished
> >>>> running but had 1 error.
> >>>>
> >>>> I am not entirely sure if MET 9.x or the latest versions of
METplus
> >>>> have support to do ensemble-based percentile verification so I
decided
> >>>> to try and run through each of the model members via grid_stat
to
> >>>> generate the individual probability fields which I would then
process
> >>>> through ensemble_stat and then finally back through grid_stat
to
> >>>> generate the ensemble-based probabilities. Is there a way to
work
> >>>> around this particular issue to be able to process each member
in the
> >>>> “grid_stat_custom_loop_list”?
> >>>>
> >>>> Many thanks!
> >>>>
> >>>> -Brian
> >>>> —————————————————————
> >>>> Brian Matilla
> >>>> Research Associate— Warn-on-Forecast Team
> >>>> Cooperative Institute for Mesoscale Meteorological Studies —
The
> >>>> University of Oklahoma
> >>>> NOAA National Severe Storms Laboratory
> >>>
> >>>
> >>>
> >>
> >>
> >> Hi George,
> >>
> >> I have gone ahead and rerun METplus with the log level set to
DEBUG.
> >> Attached is the metplus_final.conf as well as the log file. I
should
> note
> >> here that the input expected into grid_stat is the output file
from
> >> “pcp_combine” so that the percentiles can be calculated.
> >>
> >> Thanks,
> >>
> >> -Brian
> >> —————————————————————
> >> Brian Matilla
> >> Research Associate— Warn-on-Forecast Team
> >> Cooperative Institute for Mesoscale Meteorological Studies — The
> >> University of Oklahoma
> >> NOAA National Severe Storms Laboratory
> >>
> >>
> >> On Dec 14, 2020, at 4:46 PM, George McCabe via RT
<met_help at ucar.edu>
> >> wrote:
> >>
> >> Hi Brian,
> >>
> >> I'm not sure why that error is occurring. You should be able to
run the
> >> way you described. I was not able to replicate the error on my
end.
> Could
> >> you please set LOG_LEVEL=DEBUG, rerun the use case, then send me
the
> full
> >> log file and the metplus_final.conf file?
> >>
> >> Thanks,
> >> George
> >>
> >> On Mon Dec 14 14:16:34 2020, brian.matilla at noaa.gov wrote:
> >>
> >> Hi MET Help Desk,
> >>
> >> I am trying to run grid_stat over each individual member (18 in
total)
> >> in my use case. It will process member 1 with no issues, however
I do
> >> get the following error printout with any succeeding member:
> >>
> >> 12/14 14:54:05.639 metplus (met_util.py:920) INFO:
> >> ****************************************
> >> 12/14 14:54:05.640 metplus (met_util.py:921) INFO: * Running
METplus
> >> 12/14 14:54:05.640 metplus (met_util.py:923) INFO: * at init
time:
> >> 202006151700
> >> 12/14 14:54:05.640 metplus (met_util.py:926) INFO:
> >> ****************************************
> >> 12/14 14:54:05.640 metplus.GridStat
(compare_gridded_wrapper.py:176)
> >> INFO: Processing forecast lead 1 hour
> >> 12/14 14:54:05.640 metplus.GridStat
(compare_gridded_wrapper.py:184)
> >> INFO: Processing custom string: 01
> >> 12/14 14:54:05.643 metplus.GridStat (command_runner.py:89) INFO:
> >> COMMAND:
/home/brian.matilla/WoFS_2020/MET_scripts/met9/bin/grid_stat
> >> -v 3
> >>
> >>
>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/WOFS/pcp_combine/20200615/1700/ENS_MEM_01/wofs01_PCP_20200615_1700_1800_A1.nc
> >>
> >>
>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/OBS/pcp_combine/20200615/1700/mrms_PCP_20200615_1700_1800_A1_
> wofs.nc
> >>
> >>
>
/home/brian.matilla/WoFS_2020/MET_scripts/MET_configs/GridStatConfig_WOFS_PCP_1H
> >> -outdir
> >>
> >>
>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/WOFS/grid_stat/20200615/1700/
> >> 12/14 14:54:11.874 metplus.GridStat
(compare_gridded_wrapper.py:184)
> >> INFO: Processing custom string: 02
> >> 12/14 14:54:11.876 metplus.GridStat (met_util.py:215) ERROR:
Fatal
> >> error occurred
> >> Traceback (most recent call last):
> >> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >> 3.1/metplus/util/met_util.py", line 195, in run_metplus
> >> loop_over_times_and_call(config, processes)
> >> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >> 3.1/metplus/util/met_util.py", line 939, in
loop_over_times_and_call
> >> process.run_at_time(input_dict)
> >> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 189, in
> >> run_at_time
> >> self.run_at_time_once(time_info)
> >> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 224, in
> >> run_at_time_once
> >> self.run_at_time_all_fields(time_info)
> >> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 288, in
> >> run_at_time_all_fields
> >> return_list=True)
> >> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >> 3.1/metplus/wrappers/command_builder.py", line 357, in find_model
> >> return_list=return_list)
> >> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >> 3.1/metplus/wrappers/command_builder.py", line 468, in find_data
> >> return self.find_exact_file(**arg_dict, allow_dir=allow_dir)
> >> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >> 3.1/metplus/wrappers/command_builder.py", line 495, in
find_exact_file
> >> **time_info)
> >> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >> 3.1/metplus/util/config/string_template_substitution.py", line
399, in
> >> do_string_sub
> >> return find_and_replace_tags_in_template(match_list, tmpl,
kwargs,
> >> skip_missing_tags)
> >> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >> 3.1/metplus/util/config/string_template_substitution.py", line
431, in
> >> find_and_replace_tags_in_template
> >> " for template: " + tmpl)
> >> TypeError: The key valid was not passed to do_string_sub for
> >> template:
> >>
> >>
>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/WOFS/pcp_combine/{init?fmt=%Y%m%d?shift=-
> >>
> >>
>
44100}/{init?fmt=%H%M}/ENS_MEM_{custom?fmt=%s}/wofs{custom?fmt=%s}_PCP_{init?fmt=%Y%m%d}_{init?fmt=%H%M}_{valid?fmt=%H%M}_A1.nc
> >> 12/14 14:54:11Z run-METplus-metplus.GridStat: ERROR: Fatal error
> >> occurred
> >> 12/14 14:54:11.879 metplus.GridStat (met_util.py:216) INFO: Check
the
> >> log file for more information:
> >>
> >>
>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/logs/master_metplus.log.20201214145404
> >> 12/14 14:54:11.879 metplus (met_util.py:812) INFO:
> >>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/metplus_final.conf:
> >> write metplus.conf here
> >> 12/14 14:54:11.880 metplus (met_util.py:245) ERROR: METplus has
> >> finished running but had 1 error.
> >> 12/14 14:54:11Z run-METplus-metplus: ERROR: METplus has finished
> >> running but had 1 error.
> >>
> >> I am not entirely sure if MET 9.x or the latest versions of
METplus
> >> have support to do ensemble-based percentile verification so I
decided
> >> to try and run through each of the model members via grid_stat to
> >> generate the individual probability fields which I would then
process
> >> through ensemble_stat and then finally back through grid_stat to
> >> generate the ensemble-based probabilities. Is there a way to work
> >> around this particular issue to be able to process each member in
the
> >> “grid_stat_custom_loop_list”?
> >>
> >> Many thanks!
> >>
> >> -Brian
> >> —————————————————————
> >> Brian Matilla
> >> Research Associate— Warn-on-Forecast Team
> >> Cooperative Institute for Mesoscale Meteorological Studies — The
> >> University of Oklahoma
> >> NOAA National Severe Storms Laboratory
> >>
> >>
> >>
> >>
> >>
> >>
> >
> > --
> > George McCabe - Software Engineer III
> > National Center for Atmospheric Research
> > Research Applications Laboratory
> > 303-497-2768
> > ---
> > My working day may not be your working day. Please do not feel
obliged to
> > reply to this email outside of your normal working hours.
> >
>
>
>
--
George McCabe - Software Engineer III
National Center for Atmospheric Research
Research Applications Laboratory
303-497-2768
---
My working day may not be your working day. Please do not feel obliged
to
reply to this email outside of your normal working hours.
------------------------------------------------
Subject: Problems with METplus "grid_stat_custom_loop_list"
From: Brian Matilla - NOAA Affiliate
Time: Mon Dec 21 10:30:10 2020
No problem, as METplus 3.0 (specifically 3.0.2) was actually the
version I used during our realtime cases this past spring and summer.
So with that, would that bug fix be applied to METplus 3.0.2? Glad I
could help uncover this issue.
-Brian
> On Dec 21, 2020, at 10:26 AM, George McCabe via RT
<met_help at ucar.edu> wrote:
>
> Hi Brian,
>
> Since you have to use MET 9.0.1, I think it would be best if we
issued a
> bugfix to METplus 3.0 to keep the versions aligned. The bug exists
in the
> latest beta release, so upgrading to that would not solve the
problem. I
> will let you know when the bugfix release is available. Sorry about
the
> inconvenience and thank you for discovering this issue!
>
> Thanks,
> George
>
> On Mon, Dec 21, 2020 at 9:16 AM Brian Matilla - NOAA Affiliate via
RT <
> met_help at ucar.edu> wrote:
>
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97897 >
>>
>> Hi George,
>>
>> Thanks for looking into this. I’m really only tied to the MET
version
>> (9.0.1) that our IT staff was able to install on our machines but I
do have
>> a copy of the latest METplus beta version so I can work with that
if that
>> helps.
>>
>> Thanks,
>>
>> -Brian
>> —————————————————————
>> Brian Matilla
>> Research Associate— Warn-on-Forecast Team
>> Cooperative Institute for Mesoscale Meteorological Studies — The
>> University of Oklahoma
>> NOAA National Severe Storms Laboratory
>>
>>> On Dec 21, 2020, at 10:11 AM, George McCabe via RT
<met_help at ucar.edu>
>> wrote:
>>>
>>> Hi Brian,
>>>
>>> Thank you for sending these files. I was able to recreate the
error and
>> it
>>> looks like there is an odd bug in the code. Valid time should
definitely
>> be
>>> available to use to find the file you are looking for. I will look
into
>> it
>>> and let you know when I have a fix in place. My question is: are
you tied
>>> to using METplus 3.1 and would require a bugfix release for that
version
>> to
>>> continue your work? If you can upgrade to using a beta or develop
version
>>> of METplus, I can issue the fix there instead.
>>>
>>> Let me know what you think.
>>>
>>> Thanks,
>>> George
>>>
>>> On Fri, Dec 18, 2020 at 1:21 PM Brian Matilla - NOAA Affiliate via
RT <
>>> met_help at ucar.edu> wrote:
>>>
>>>>
>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97897 >
>>>>
>>>> Hi George,
>>>>
>>>> I have gone ahead and rerun METplus with the log level set to
DEBUG.
>>>> Attached is the metplus_final.conf as well as the log file. I
should
>> note
>>>> here that the input expected into grid_stat is the output file
from
>>>> “pcp_combine” so that the percentiles can be calculated.
>>>>
>>>> Thanks,
>>>>
>>>> -Brian
>>>> —————————————————————
>>>> Brian Matilla
>>>> Research Associate— Warn-on-Forecast Team
>>>> Cooperative Institute for Mesoscale Meteorological Studies — The
>>>> University of Oklahoma
>>>> NOAA National Severe Storms Laboratory
>>>>
>>>>
>>>>> On Dec 14, 2020, at 4:46 PM, George McCabe via RT
<met_help at ucar.edu>
>>>> wrote:
>>>>>
>>>>> Hi Brian,
>>>>>
>>>>> I'm not sure why that error is occurring. You should be able to
run the
>>>> way you described. I was not able to replicate the error on my
end.
>> Could
>>>> you please set LOG_LEVEL=DEBUG, rerun the use case, then send me
the
>> full
>>>> log file and the metplus_final.conf file?
>>>>>
>>>>> Thanks,
>>>>> George
>>>>>
>>>>> On Mon Dec 14 14:16:34 2020, brian.matilla at noaa.gov wrote:
>>>>>> Hi MET Help Desk,
>>>>>>
>>>>>> I am trying to run grid_stat over each individual member (18 in
total)
>>>>>> in my use case. It will process member 1 with no issues,
however I do
>>>>>> get the following error printout with any succeeding member:
>>>>>>
>>>>>> 12/14 14:54:05.639 metplus (met_util.py:920) INFO:
>>>>>> ****************************************
>>>>>> 12/14 14:54:05.640 metplus (met_util.py:921) INFO: * Running
METplus
>>>>>> 12/14 14:54:05.640 metplus (met_util.py:923) INFO: * at init
time:
>>>>>> 202006151700
>>>>>> 12/14 14:54:05.640 metplus (met_util.py:926) INFO:
>>>>>> ****************************************
>>>>>> 12/14 14:54:05.640 metplus.GridStat
(compare_gridded_wrapper.py:176)
>>>>>> INFO: Processing forecast lead 1 hour
>>>>>> 12/14 14:54:05.640 metplus.GridStat
(compare_gridded_wrapper.py:184)
>>>>>> INFO: Processing custom string: 01
>>>>>> 12/14 14:54:05.643 metplus.GridStat (command_runner.py:89)
INFO:
>>>>>> COMMAND:
/home/brian.matilla/WoFS_2020/MET_scripts/met9/bin/grid_stat
>>>>>> -v 3
>>>>>>
>>>>
>>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/WOFS/pcp_combine/20200615/1700/ENS_MEM_01/wofs01_PCP_20200615_1700_1800_A1.nc
>>>>>>
>>>>
>>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/OBS/pcp_combine/20200615/1700/mrms_PCP_20200615_1700_1800_A1_
>>>> wofs.nc
>>>>>>
>>>>
>>
/home/brian.matilla/WoFS_2020/MET_scripts/MET_configs/GridStatConfig_WOFS_PCP_1H
>>>>>> -outdir
>>>>>>
>>>>
>>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/WOFS/grid_stat/20200615/1700/
>>>>>> 12/14 14:54:11.874 metplus.GridStat
(compare_gridded_wrapper.py:184)
>>>>>> INFO: Processing custom string: 02
>>>>>> 12/14 14:54:11.876 metplus.GridStat (met_util.py:215) ERROR:
Fatal
>>>>>> error occurred
>>>>>> Traceback (most recent call last):
>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>>> 3.1/metplus/util/met_util.py", line 195, in run_metplus
>>>>>> loop_over_times_and_call(config, processes)
>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>>> 3.1/metplus/util/met_util.py", line 939, in
loop_over_times_and_call
>>>>>> process.run_at_time(input_dict)
>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>>> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 189, in
>>>>>> run_at_time
>>>>>> self.run_at_time_once(time_info)
>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>>> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 224, in
>>>>>> run_at_time_once
>>>>>> self.run_at_time_all_fields(time_info)
>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>>> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 288, in
>>>>>> run_at_time_all_fields
>>>>>> return_list=True)
>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>>> 3.1/metplus/wrappers/command_builder.py", line 357, in
find_model
>>>>>> return_list=return_list)
>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>>> 3.1/metplus/wrappers/command_builder.py", line 468, in
find_data
>>>>>> return self.find_exact_file(**arg_dict, allow_dir=allow_dir)
>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>>> 3.1/metplus/wrappers/command_builder.py", line 495, in
find_exact_file
>>>>>> **time_info)
>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>>> 3.1/metplus/util/config/string_template_substitution.py", line
399, in
>>>>>> do_string_sub
>>>>>> return find_and_replace_tags_in_template(match_list, tmpl,
kwargs,
>>>>>> skip_missing_tags)
>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>>> 3.1/metplus/util/config/string_template_substitution.py", line
431, in
>>>>>> find_and_replace_tags_in_template
>>>>>> " for template: " + tmpl)
>>>>>> TypeError: The key valid was not passed to do_string_sub for
>>>>>> template:
>>>>>>
>>>>
>>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/WOFS/pcp_combine/{init?fmt=%Y%m%d?shift=-
>>>>>>
>>>>
>>
44100}/{init?fmt=%H%M}/ENS_MEM_{custom?fmt=%s}/wofs{custom?fmt=%s}_PCP_{init?fmt=%Y%m%d}_{init?fmt=%H%M}_{valid?fmt=%H%M}_A1.nc
>>>>>> 12/14 14:54:11Z run-METplus-metplus.GridStat: ERROR: Fatal
error
>>>>>> occurred
>>>>>> 12/14 14:54:11.879 metplus.GridStat (met_util.py:216) INFO:
Check the
>>>>>> log file for more information:
>>>>>>
>>>>
>>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/logs/master_metplus.log.20201214145404
>>>>>> 12/14 14:54:11.879 metplus (met_util.py:812) INFO:
>>>>>>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/metplus_final.conf:
>>>>>> write metplus.conf here
>>>>>> 12/14 14:54:11.880 metplus (met_util.py:245) ERROR: METplus has
>>>>>> finished running but had 1 error.
>>>>>> 12/14 14:54:11Z run-METplus-metplus: ERROR: METplus has
finished
>>>>>> running but had 1 error.
>>>>>>
>>>>>> I am not entirely sure if MET 9.x or the latest versions of
METplus
>>>>>> have support to do ensemble-based percentile verification so I
decided
>>>>>> to try and run through each of the model members via grid_stat
to
>>>>>> generate the individual probability fields which I would then
process
>>>>>> through ensemble_stat and then finally back through grid_stat
to
>>>>>> generate the ensemble-based probabilities. Is there a way to
work
>>>>>> around this particular issue to be able to process each member
in the
>>>>>> “grid_stat_custom_loop_list”?
>>>>>>
>>>>>> Many thanks!
>>>>>>
>>>>>> -Brian
>>>>>> —————————————————————
>>>>>> Brian Matilla
>>>>>> Research Associate— Warn-on-Forecast Team
>>>>>> Cooperative Institute for Mesoscale Meteorological Studies —
The
>>>>>> University of Oklahoma
>>>>>> NOAA National Severe Storms Laboratory
>>>>>
>>>>>
>>>>>
>>>>
>>>>
>>>> Hi George,
>>>>
>>>> I have gone ahead and rerun METplus with the log level set to
DEBUG.
>>>> Attached is the metplus_final.conf as well as the log file. I
should
>> note
>>>> here that the input expected into grid_stat is the output file
from
>>>> “pcp_combine” so that the percentiles can be calculated.
>>>>
>>>> Thanks,
>>>>
>>>> -Brian
>>>> —————————————————————
>>>> Brian Matilla
>>>> Research Associate— Warn-on-Forecast Team
>>>> Cooperative Institute for Mesoscale Meteorological Studies — The
>>>> University of Oklahoma
>>>> NOAA National Severe Storms Laboratory
>>>>
>>>>
>>>> On Dec 14, 2020, at 4:46 PM, George McCabe via RT
<met_help at ucar.edu>
>>>> wrote:
>>>>
>>>> Hi Brian,
>>>>
>>>> I'm not sure why that error is occurring. You should be able to
run the
>>>> way you described. I was not able to replicate the error on my
end.
>> Could
>>>> you please set LOG_LEVEL=DEBUG, rerun the use case, then send me
the
>> full
>>>> log file and the metplus_final.conf file?
>>>>
>>>> Thanks,
>>>> George
>>>>
>>>> On Mon Dec 14 14:16:34 2020, brian.matilla at noaa.gov wrote:
>>>>
>>>> Hi MET Help Desk,
>>>>
>>>> I am trying to run grid_stat over each individual member (18 in
total)
>>>> in my use case. It will process member 1 with no issues, however
I do
>>>> get the following error printout with any succeeding member:
>>>>
>>>> 12/14 14:54:05.639 metplus (met_util.py:920) INFO:
>>>> ****************************************
>>>> 12/14 14:54:05.640 metplus (met_util.py:921) INFO: * Running
METplus
>>>> 12/14 14:54:05.640 metplus (met_util.py:923) INFO: * at init
time:
>>>> 202006151700
>>>> 12/14 14:54:05.640 metplus (met_util.py:926) INFO:
>>>> ****************************************
>>>> 12/14 14:54:05.640 metplus.GridStat
(compare_gridded_wrapper.py:176)
>>>> INFO: Processing forecast lead 1 hour
>>>> 12/14 14:54:05.640 metplus.GridStat
(compare_gridded_wrapper.py:184)
>>>> INFO: Processing custom string: 01
>>>> 12/14 14:54:05.643 metplus.GridStat (command_runner.py:89) INFO:
>>>> COMMAND:
/home/brian.matilla/WoFS_2020/MET_scripts/met9/bin/grid_stat
>>>> -v 3
>>>>
>>>>
>>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/WOFS/pcp_combine/20200615/1700/ENS_MEM_01/wofs01_PCP_20200615_1700_1800_A1.nc
>>>>
>>>>
>>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/OBS/pcp_combine/20200615/1700/mrms_PCP_20200615_1700_1800_A1_
>> wofs.nc
>>>>
>>>>
>>
/home/brian.matilla/WoFS_2020/MET_scripts/MET_configs/GridStatConfig_WOFS_PCP_1H
>>>> -outdir
>>>>
>>>>
>>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/WOFS/grid_stat/20200615/1700/
>>>> 12/14 14:54:11.874 metplus.GridStat
(compare_gridded_wrapper.py:184)
>>>> INFO: Processing custom string: 02
>>>> 12/14 14:54:11.876 metplus.GridStat (met_util.py:215) ERROR:
Fatal
>>>> error occurred
>>>> Traceback (most recent call last):
>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>> 3.1/metplus/util/met_util.py", line 195, in run_metplus
>>>> loop_over_times_and_call(config, processes)
>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>> 3.1/metplus/util/met_util.py", line 939, in
loop_over_times_and_call
>>>> process.run_at_time(input_dict)
>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 189, in
>>>> run_at_time
>>>> self.run_at_time_once(time_info)
>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 224, in
>>>> run_at_time_once
>>>> self.run_at_time_all_fields(time_info)
>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 288, in
>>>> run_at_time_all_fields
>>>> return_list=True)
>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>> 3.1/metplus/wrappers/command_builder.py", line 357, in find_model
>>>> return_list=return_list)
>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>> 3.1/metplus/wrappers/command_builder.py", line 468, in find_data
>>>> return self.find_exact_file(**arg_dict, allow_dir=allow_dir)
>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>> 3.1/metplus/wrappers/command_builder.py", line 495, in
find_exact_file
>>>> **time_info)
>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>> 3.1/metplus/util/config/string_template_substitution.py", line
399, in
>>>> do_string_sub
>>>> return find_and_replace_tags_in_template(match_list, tmpl,
kwargs,
>>>> skip_missing_tags)
>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>> 3.1/metplus/util/config/string_template_substitution.py", line
431, in
>>>> find_and_replace_tags_in_template
>>>> " for template: " + tmpl)
>>>> TypeError: The key valid was not passed to do_string_sub for
>>>> template:
>>>>
>>>>
>>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/WOFS/pcp_combine/{init?fmt=%Y%m%d?shift=-
>>>>
>>>>
>>
44100}/{init?fmt=%H%M}/ENS_MEM_{custom?fmt=%s}/wofs{custom?fmt=%s}_PCP_{init?fmt=%Y%m%d}_{init?fmt=%H%M}_{valid?fmt=%H%M}_A1.nc
>>>> 12/14 14:54:11Z run-METplus-metplus.GridStat: ERROR: Fatal error
>>>> occurred
>>>> 12/14 14:54:11.879 metplus.GridStat (met_util.py:216) INFO: Check
the
>>>> log file for more information:
>>>>
>>>>
>>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/logs/master_metplus.log.20201214145404
>>>> 12/14 14:54:11.879 metplus (met_util.py:812) INFO:
>>>>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/metplus_final.conf:
>>>> write metplus.conf here
>>>> 12/14 14:54:11.880 metplus (met_util.py:245) ERROR: METplus has
>>>> finished running but had 1 error.
>>>> 12/14 14:54:11Z run-METplus-metplus: ERROR: METplus has finished
>>>> running but had 1 error.
>>>>
>>>> I am not entirely sure if MET 9.x or the latest versions of
METplus
>>>> have support to do ensemble-based percentile verification so I
decided
>>>> to try and run through each of the model members via grid_stat to
>>>> generate the individual probability fields which I would then
process
>>>> through ensemble_stat and then finally back through grid_stat to
>>>> generate the ensemble-based probabilities. Is there a way to work
>>>> around this particular issue to be able to process each member in
the
>>>> “grid_stat_custom_loop_list”?
>>>>
>>>> Many thanks!
>>>>
>>>> -Brian
>>>> —————————————————————
>>>> Brian Matilla
>>>> Research Associate— Warn-on-Forecast Team
>>>> Cooperative Institute for Mesoscale Meteorological Studies — The
>>>> University of Oklahoma
>>>> NOAA National Severe Storms Laboratory
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>
>>> --
>>> George McCabe - Software Engineer III
>>> National Center for Atmospheric Research
>>> Research Applications Laboratory
>>> 303-497-2768
>>> ---
>>> My working day may not be your working day. Please do not feel
obliged to
>>> reply to this email outside of your normal working hours.
>>>
>>
>>
>>
>
> --
> George McCabe - Software Engineer III
> National Center for Atmospheric Research
> Research Applications Laboratory
> 303-497-2768
> ---
> My working day may not be your working day. Please do not feel
obliged to
> reply to this email outside of your normal working hours.
>
------------------------------------------------
Subject: Problems with METplus "grid_stat_custom_loop_list"
From: John Halley Gotway
Time: Mon Dec 21 10:37:58 2020
Brian,
I couldn't find an existing MET issue about ensemble-stat
computing probabilities based on percentile thresholds. So I just
wrote up
this issue description:
https://github.com/dtcenter/MET/issues/1612
Please take a look and let me know if that description is accurate.
I'll
need to coordinate with Tara Jensen to figure out priorities, funding,
and
timeline for this work.
Thanks,
John
On Mon, Dec 21, 2020 at 9:26 AM George McCabe via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97897 >
>
> Hi Brian,
>
> Since you have to use MET 9.0.1, I think it would be best if we
issued a
> bugfix to METplus 3.0 to keep the versions aligned. The bug exists
in the
> latest beta release, so upgrading to that would not solve the
problem. I
> will let you know when the bugfix release is available. Sorry about
the
> inconvenience and thank you for discovering this issue!
>
> Thanks,
> George
>
> On Mon, Dec 21, 2020 at 9:16 AM Brian Matilla - NOAA Affiliate via
RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97897 >
> >
> > Hi George,
> >
> > Thanks for looking into this. I’m really only tied to the MET
version
> > (9.0.1) that our IT staff was able to install on our machines but
I do
> have
> > a copy of the latest METplus beta version so I can work with that
if that
> > helps.
> >
> > Thanks,
> >
> > -Brian
> > —————————————————————
> > Brian Matilla
> > Research Associate— Warn-on-Forecast Team
> > Cooperative Institute for Mesoscale Meteorological Studies — The
> > University of Oklahoma
> > NOAA National Severe Storms Laboratory
> >
> > > On Dec 21, 2020, at 10:11 AM, George McCabe via RT
<met_help at ucar.edu>
> > wrote:
> > >
> > > Hi Brian,
> > >
> > > Thank you for sending these files. I was able to recreate the
error and
> > it
> > > looks like there is an odd bug in the code. Valid time should
> definitely
> > be
> > > available to use to find the file you are looking for. I will
look into
> > it
> > > and let you know when I have a fix in place. My question is: are
you
> tied
> > > to using METplus 3.1 and would require a bugfix release for that
> version
> > to
> > > continue your work? If you can upgrade to using a beta or
develop
> version
> > > of METplus, I can issue the fix there instead.
> > >
> > > Let me know what you think.
> > >
> > > Thanks,
> > > George
> > >
> > > On Fri, Dec 18, 2020 at 1:21 PM Brian Matilla - NOAA Affiliate
via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > >>
> > >> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97897 >
> > >>
> > >> Hi George,
> > >>
> > >> I have gone ahead and rerun METplus with the log level set to
DEBUG.
> > >> Attached is the metplus_final.conf as well as the log file. I
should
> > note
> > >> here that the input expected into grid_stat is the output file
from
> > >> “pcp_combine” so that the percentiles can be calculated.
> > >>
> > >> Thanks,
> > >>
> > >> -Brian
> > >> —————————————————————
> > >> Brian Matilla
> > >> Research Associate— Warn-on-Forecast Team
> > >> Cooperative Institute for Mesoscale Meteorological Studies —
The
> > >> University of Oklahoma
> > >> NOAA National Severe Storms Laboratory
> > >>
> > >>
> > >>> On Dec 14, 2020, at 4:46 PM, George McCabe via RT
<met_help at ucar.edu
> >
> > >> wrote:
> > >>>
> > >>> Hi Brian,
> > >>>
> > >>> I'm not sure why that error is occurring. You should be able
to run
> the
> > >> way you described. I was not able to replicate the error on my
end.
> > Could
> > >> you please set LOG_LEVEL=DEBUG, rerun the use case, then send
me the
> > full
> > >> log file and the metplus_final.conf file?
> > >>>
> > >>> Thanks,
> > >>> George
> > >>>
> > >>> On Mon Dec 14 14:16:34 2020, brian.matilla at noaa.gov wrote:
> > >>>> Hi MET Help Desk,
> > >>>>
> > >>>> I am trying to run grid_stat over each individual member (18
in
> total)
> > >>>> in my use case. It will process member 1 with no issues,
however I
> do
> > >>>> get the following error printout with any succeeding member:
> > >>>>
> > >>>> 12/14 14:54:05.639 metplus (met_util.py:920) INFO:
> > >>>> ****************************************
> > >>>> 12/14 14:54:05.640 metplus (met_util.py:921) INFO: * Running
METplus
> > >>>> 12/14 14:54:05.640 metplus (met_util.py:923) INFO: * at init
time:
> > >>>> 202006151700
> > >>>> 12/14 14:54:05.640 metplus (met_util.py:926) INFO:
> > >>>> ****************************************
> > >>>> 12/14 14:54:05.640 metplus.GridStat
(compare_gridded_wrapper.py:176)
> > >>>> INFO: Processing forecast lead 1 hour
> > >>>> 12/14 14:54:05.640 metplus.GridStat
(compare_gridded_wrapper.py:184)
> > >>>> INFO: Processing custom string: 01
> > >>>> 12/14 14:54:05.643 metplus.GridStat (command_runner.py:89)
INFO:
> > >>>> COMMAND:
> /home/brian.matilla/WoFS_2020/MET_scripts/met9/bin/grid_stat
> > >>>> -v 3
> > >>>>
> > >>
> >
>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/WOFS/pcp_combine/20200615/1700/ENS_MEM_01/wofs01_PCP_20200615_1700_1800_A1.nc
> > >>>>
> > >>
> >
>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/OBS/pcp_combine/20200615/1700/mrms_PCP_20200615_1700_1800_A1_
> > >> wofs.nc
> > >>>>
> > >>
> >
>
/home/brian.matilla/WoFS_2020/MET_scripts/MET_configs/GridStatConfig_WOFS_PCP_1H
> > >>>> -outdir
> > >>>>
> > >>
> >
>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/WOFS/grid_stat/20200615/1700/
> > >>>> 12/14 14:54:11.874 metplus.GridStat
(compare_gridded_wrapper.py:184)
> > >>>> INFO: Processing custom string: 02
> > >>>> 12/14 14:54:11.876 metplus.GridStat (met_util.py:215) ERROR:
Fatal
> > >>>> error occurred
> > >>>> Traceback (most recent call last):
> > >>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> > >>>> 3.1/metplus/util/met_util.py", line 195, in run_metplus
> > >>>> loop_over_times_and_call(config, processes)
> > >>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> > >>>> 3.1/metplus/util/met_util.py", line 939, in
loop_over_times_and_call
> > >>>> process.run_at_time(input_dict)
> > >>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> > >>>> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 189,
in
> > >>>> run_at_time
> > >>>> self.run_at_time_once(time_info)
> > >>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> > >>>> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 224,
in
> > >>>> run_at_time_once
> > >>>> self.run_at_time_all_fields(time_info)
> > >>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> > >>>> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 288,
in
> > >>>> run_at_time_all_fields
> > >>>> return_list=True)
> > >>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> > >>>> 3.1/metplus/wrappers/command_builder.py", line 357, in
find_model
> > >>>> return_list=return_list)
> > >>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> > >>>> 3.1/metplus/wrappers/command_builder.py", line 468, in
find_data
> > >>>> return self.find_exact_file(**arg_dict,
allow_dir=allow_dir)
> > >>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> > >>>> 3.1/metplus/wrappers/command_builder.py", line 495, in
> find_exact_file
> > >>>> **time_info)
> > >>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> > >>>> 3.1/metplus/util/config/string_template_substitution.py",
line 399,
> in
> > >>>> do_string_sub
> > >>>> return find_and_replace_tags_in_template(match_list, tmpl,
kwargs,
> > >>>> skip_missing_tags)
> > >>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> > >>>> 3.1/metplus/util/config/string_template_substitution.py",
line 431,
> in
> > >>>> find_and_replace_tags_in_template
> > >>>> " for template: " + tmpl)
> > >>>> TypeError: The key valid was not passed to do_string_sub for
> > >>>> template:
> > >>>>
> > >>
> >
>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/WOFS/pcp_combine/{init?fmt=%Y%m%d?shift=-
> > >>>>
> > >>
> >
>
44100}/{init?fmt=%H%M}/ENS_MEM_{custom?fmt=%s}/wofs{custom?fmt=%s}_PCP_{init?fmt=%Y%m%d}_{init?fmt=%H%M}_{valid?fmt=%H%M}_A1.nc
> > >>>> 12/14 14:54:11Z run-METplus-metplus.GridStat: ERROR: Fatal
error
> > >>>> occurred
> > >>>> 12/14 14:54:11.879 metplus.GridStat (met_util.py:216) INFO:
Check
> the
> > >>>> log file for more information:
> > >>>>
> > >>
> >
>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/logs/master_metplus.log.20201214145404
> > >>>> 12/14 14:54:11.879 metplus (met_util.py:812) INFO:
> > >>>>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/metplus_final.conf:
> > >>>> write metplus.conf here
> > >>>> 12/14 14:54:11.880 metplus (met_util.py:245) ERROR: METplus
has
> > >>>> finished running but had 1 error.
> > >>>> 12/14 14:54:11Z run-METplus-metplus: ERROR: METplus has
finished
> > >>>> running but had 1 error.
> > >>>>
> > >>>> I am not entirely sure if MET 9.x or the latest versions of
METplus
> > >>>> have support to do ensemble-based percentile verification so
I
> decided
> > >>>> to try and run through each of the model members via
grid_stat to
> > >>>> generate the individual probability fields which I would then
> process
> > >>>> through ensemble_stat and then finally back through grid_stat
to
> > >>>> generate the ensemble-based probabilities. Is there a way to
work
> > >>>> around this particular issue to be able to process each
member in
> the
> > >>>> “grid_stat_custom_loop_list”?
> > >>>>
> > >>>> Many thanks!
> > >>>>
> > >>>> -Brian
> > >>>> —————————————————————
> > >>>> Brian Matilla
> > >>>> Research Associate— Warn-on-Forecast Team
> > >>>> Cooperative Institute for Mesoscale Meteorological Studies —
The
> > >>>> University of Oklahoma
> > >>>> NOAA National Severe Storms Laboratory
> > >>>
> > >>>
> > >>>
> > >>
> > >>
> > >> Hi George,
> > >>
> > >> I have gone ahead and rerun METplus with the log level set to
DEBUG.
> > >> Attached is the metplus_final.conf as well as the log file. I
should
> > note
> > >> here that the input expected into grid_stat is the output file
from
> > >> “pcp_combine” so that the percentiles can be calculated.
> > >>
> > >> Thanks,
> > >>
> > >> -Brian
> > >> —————————————————————
> > >> Brian Matilla
> > >> Research Associate— Warn-on-Forecast Team
> > >> Cooperative Institute for Mesoscale Meteorological Studies —
The
> > >> University of Oklahoma
> > >> NOAA National Severe Storms Laboratory
> > >>
> > >>
> > >> On Dec 14, 2020, at 4:46 PM, George McCabe via RT
<met_help at ucar.edu>
> > >> wrote:
> > >>
> > >> Hi Brian,
> > >>
> > >> I'm not sure why that error is occurring. You should be able to
run
> the
> > >> way you described. I was not able to replicate the error on my
end.
> > Could
> > >> you please set LOG_LEVEL=DEBUG, rerun the use case, then send
me the
> > full
> > >> log file and the metplus_final.conf file?
> > >>
> > >> Thanks,
> > >> George
> > >>
> > >> On Mon Dec 14 14:16:34 2020, brian.matilla at noaa.gov wrote:
> > >>
> > >> Hi MET Help Desk,
> > >>
> > >> I am trying to run grid_stat over each individual member (18 in
total)
> > >> in my use case. It will process member 1 with no issues,
however I do
> > >> get the following error printout with any succeeding member:
> > >>
> > >> 12/14 14:54:05.639 metplus (met_util.py:920) INFO:
> > >> ****************************************
> > >> 12/14 14:54:05.640 metplus (met_util.py:921) INFO: * Running
METplus
> > >> 12/14 14:54:05.640 metplus (met_util.py:923) INFO: * at init
time:
> > >> 202006151700
> > >> 12/14 14:54:05.640 metplus (met_util.py:926) INFO:
> > >> ****************************************
> > >> 12/14 14:54:05.640 metplus.GridStat
(compare_gridded_wrapper.py:176)
> > >> INFO: Processing forecast lead 1 hour
> > >> 12/14 14:54:05.640 metplus.GridStat
(compare_gridded_wrapper.py:184)
> > >> INFO: Processing custom string: 01
> > >> 12/14 14:54:05.643 metplus.GridStat (command_runner.py:89)
INFO:
> > >> COMMAND:
/home/brian.matilla/WoFS_2020/MET_scripts/met9/bin/grid_stat
> > >> -v 3
> > >>
> > >>
> >
>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/WOFS/pcp_combine/20200615/1700/ENS_MEM_01/wofs01_PCP_20200615_1700_1800_A1.nc
> > >>
> > >>
> >
>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/OBS/pcp_combine/20200615/1700/mrms_PCP_20200615_1700_1800_A1_
> > wofs.nc
> > >>
> > >>
> >
>
/home/brian.matilla/WoFS_2020/MET_scripts/MET_configs/GridStatConfig_WOFS_PCP_1H
> > >> -outdir
> > >>
> > >>
> >
>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/WOFS/grid_stat/20200615/1700/
> > >> 12/14 14:54:11.874 metplus.GridStat
(compare_gridded_wrapper.py:184)
> > >> INFO: Processing custom string: 02
> > >> 12/14 14:54:11.876 metplus.GridStat (met_util.py:215) ERROR:
Fatal
> > >> error occurred
> > >> Traceback (most recent call last):
> > >> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> > >> 3.1/metplus/util/met_util.py", line 195, in run_metplus
> > >> loop_over_times_and_call(config, processes)
> > >> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> > >> 3.1/metplus/util/met_util.py", line 939, in
loop_over_times_and_call
> > >> process.run_at_time(input_dict)
> > >> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> > >> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 189, in
> > >> run_at_time
> > >> self.run_at_time_once(time_info)
> > >> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> > >> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 224, in
> > >> run_at_time_once
> > >> self.run_at_time_all_fields(time_info)
> > >> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> > >> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 288, in
> > >> run_at_time_all_fields
> > >> return_list=True)
> > >> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> > >> 3.1/metplus/wrappers/command_builder.py", line 357, in
find_model
> > >> return_list=return_list)
> > >> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> > >> 3.1/metplus/wrappers/command_builder.py", line 468, in
find_data
> > >> return self.find_exact_file(**arg_dict, allow_dir=allow_dir)
> > >> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> > >> 3.1/metplus/wrappers/command_builder.py", line 495, in
find_exact_file
> > >> **time_info)
> > >> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> > >> 3.1/metplus/util/config/string_template_substitution.py", line
399, in
> > >> do_string_sub
> > >> return find_and_replace_tags_in_template(match_list, tmpl,
kwargs,
> > >> skip_missing_tags)
> > >> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> > >> 3.1/metplus/util/config/string_template_substitution.py", line
431, in
> > >> find_and_replace_tags_in_template
> > >> " for template: " + tmpl)
> > >> TypeError: The key valid was not passed to do_string_sub for
> > >> template:
> > >>
> > >>
> >
>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/WOFS/pcp_combine/{init?fmt=%Y%m%d?shift=-
> > >>
> > >>
> >
>
44100}/{init?fmt=%H%M}/ENS_MEM_{custom?fmt=%s}/wofs{custom?fmt=%s}_PCP_{init?fmt=%Y%m%d}_{init?fmt=%H%M}_{valid?fmt=%H%M}_A1.nc
> > >> 12/14 14:54:11Z run-METplus-metplus.GridStat: ERROR: Fatal
error
> > >> occurred
> > >> 12/14 14:54:11.879 metplus.GridStat (met_util.py:216) INFO:
Check the
> > >> log file for more information:
> > >>
> > >>
> >
>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/logs/master_metplus.log.20201214145404
> > >> 12/14 14:54:11.879 metplus (met_util.py:812) INFO:
> > >>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/metplus_final.conf:
> > >> write metplus.conf here
> > >> 12/14 14:54:11.880 metplus (met_util.py:245) ERROR: METplus has
> > >> finished running but had 1 error.
> > >> 12/14 14:54:11Z run-METplus-metplus: ERROR: METplus has
finished
> > >> running but had 1 error.
> > >>
> > >> I am not entirely sure if MET 9.x or the latest versions of
METplus
> > >> have support to do ensemble-based percentile verification so I
decided
> > >> to try and run through each of the model members via grid_stat
to
> > >> generate the individual probability fields which I would then
process
> > >> through ensemble_stat and then finally back through grid_stat
to
> > >> generate the ensemble-based probabilities. Is there a way to
work
> > >> around this particular issue to be able to process each member
in the
> > >> “grid_stat_custom_loop_list”?
> > >>
> > >> Many thanks!
> > >>
> > >> -Brian
> > >> —————————————————————
> > >> Brian Matilla
> > >> Research Associate— Warn-on-Forecast Team
> > >> Cooperative Institute for Mesoscale Meteorological Studies —
The
> > >> University of Oklahoma
> > >> NOAA National Severe Storms Laboratory
> > >>
> > >>
> > >>
> > >>
> > >>
> > >>
> > >
> > > --
> > > George McCabe - Software Engineer III
> > > National Center for Atmospheric Research
> > > Research Applications Laboratory
> > > 303-497-2768
> > > ---
> > > My working day may not be your working day. Please do not feel
obliged
> to
> > > reply to this email outside of your normal working hours.
> > >
> >
> >
> >
>
> --
> George McCabe - Software Engineer III
> National Center for Atmospheric Research
> Research Applications Laboratory
> 303-497-2768
> ---
> My working day may not be your working day. Please do not feel
obliged to
> reply to this email outside of your normal working hours.
>
>
------------------------------------------------
Subject: Problems with METplus "grid_stat_custom_loop_list"
From: George McCabe
Time: Mon Dec 21 10:39:52 2020
Hi Brian,
The bugfix version will be METplus 3.0.4, so it will include the fixes
from
3.0.2.
On Mon, Dec 21, 2020 at 10:37 AM John Halley Gotway via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97897 >
>
> Brian,
>
> I couldn't find an existing MET issue about ensemble-stat
> computing probabilities based on percentile thresholds. So I just
wrote up
> this issue description:
> https://github.com/dtcenter/MET/issues/1612
>
> Please take a look and let me know if that description is accurate.
I'll
> need to coordinate with Tara Jensen to figure out priorities,
funding, and
> timeline for this work.
>
> Thanks,
> John
>
> On Mon, Dec 21, 2020 at 9:26 AM George McCabe via RT
<met_help at ucar.edu>
> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97897 >
> >
> > Hi Brian,
> >
> > Since you have to use MET 9.0.1, I think it would be best if we
issued a
> > bugfix to METplus 3.0 to keep the versions aligned. The bug exists
in the
> > latest beta release, so upgrading to that would not solve the
problem. I
> > will let you know when the bugfix release is available. Sorry
about the
> > inconvenience and thank you for discovering this issue!
> >
> > Thanks,
> > George
> >
> > On Mon, Dec 21, 2020 at 9:16 AM Brian Matilla - NOAA Affiliate via
RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97897 >
> > >
> > > Hi George,
> > >
> > > Thanks for looking into this. I’m really only tied to the MET
version
> > > (9.0.1) that our IT staff was able to install on our machines
but I do
> > have
> > > a copy of the latest METplus beta version so I can work with
that if
> that
> > > helps.
> > >
> > > Thanks,
> > >
> > > -Brian
> > > —————————————————————
> > > Brian Matilla
> > > Research Associate— Warn-on-Forecast Team
> > > Cooperative Institute for Mesoscale Meteorological Studies — The
> > > University of Oklahoma
> > > NOAA National Severe Storms Laboratory
> > >
> > > > On Dec 21, 2020, at 10:11 AM, George McCabe via RT <
> met_help at ucar.edu>
> > > wrote:
> > > >
> > > > Hi Brian,
> > > >
> > > > Thank you for sending these files. I was able to recreate the
error
> and
> > > it
> > > > looks like there is an odd bug in the code. Valid time should
> > definitely
> > > be
> > > > available to use to find the file you are looking for. I will
look
> into
> > > it
> > > > and let you know when I have a fix in place. My question is:
are you
> > tied
> > > > to using METplus 3.1 and would require a bugfix release for
that
> > version
> > > to
> > > > continue your work? If you can upgrade to using a beta or
develop
> > version
> > > > of METplus, I can issue the fix there instead.
> > > >
> > > > Let me know what you think.
> > > >
> > > > Thanks,
> > > > George
> > > >
> > > > On Fri, Dec 18, 2020 at 1:21 PM Brian Matilla - NOAA Affiliate
via
> RT <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > >>
> > > >> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97897
>
> > > >>
> > > >> Hi George,
> > > >>
> > > >> I have gone ahead and rerun METplus with the log level set to
DEBUG.
> > > >> Attached is the metplus_final.conf as well as the log file. I
should
> > > note
> > > >> here that the input expected into grid_stat is the output
file from
> > > >> “pcp_combine” so that the percentiles can be calculated.
> > > >>
> > > >> Thanks,
> > > >>
> > > >> -Brian
> > > >> —————————————————————
> > > >> Brian Matilla
> > > >> Research Associate— Warn-on-Forecast Team
> > > >> Cooperative Institute for Mesoscale Meteorological Studies —
The
> > > >> University of Oklahoma
> > > >> NOAA National Severe Storms Laboratory
> > > >>
> > > >>
> > > >>> On Dec 14, 2020, at 4:46 PM, George McCabe via RT <
> met_help at ucar.edu
> > >
> > > >> wrote:
> > > >>>
> > > >>> Hi Brian,
> > > >>>
> > > >>> I'm not sure why that error is occurring. You should be able
to run
> > the
> > > >> way you described. I was not able to replicate the error on
my end.
> > > Could
> > > >> you please set LOG_LEVEL=DEBUG, rerun the use case, then send
me the
> > > full
> > > >> log file and the metplus_final.conf file?
> > > >>>
> > > >>> Thanks,
> > > >>> George
> > > >>>
> > > >>> On Mon Dec 14 14:16:34 2020, brian.matilla at noaa.gov wrote:
> > > >>>> Hi MET Help Desk,
> > > >>>>
> > > >>>> I am trying to run grid_stat over each individual member
(18 in
> > total)
> > > >>>> in my use case. It will process member 1 with no issues,
however I
> > do
> > > >>>> get the following error printout with any succeeding
member:
> > > >>>>
> > > >>>> 12/14 14:54:05.639 metplus (met_util.py:920) INFO:
> > > >>>> ****************************************
> > > >>>> 12/14 14:54:05.640 metplus (met_util.py:921) INFO: *
Running
> METplus
> > > >>>> 12/14 14:54:05.640 metplus (met_util.py:923) INFO: * at
init
> time:
> > > >>>> 202006151700
> > > >>>> 12/14 14:54:05.640 metplus (met_util.py:926) INFO:
> > > >>>> ****************************************
> > > >>>> 12/14 14:54:05.640 metplus.GridStat
> (compare_gridded_wrapper.py:176)
> > > >>>> INFO: Processing forecast lead 1 hour
> > > >>>> 12/14 14:54:05.640 metplus.GridStat
> (compare_gridded_wrapper.py:184)
> > > >>>> INFO: Processing custom string: 01
> > > >>>> 12/14 14:54:05.643 metplus.GridStat (command_runner.py:89)
INFO:
> > > >>>> COMMAND:
> > /home/brian.matilla/WoFS_2020/MET_scripts/met9/bin/grid_stat
> > > >>>> -v 3
> > > >>>>
> > > >>
> > >
> >
>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/WOFS/pcp_combine/20200615/1700/ENS_MEM_01/wofs01_PCP_20200615_1700_1800_A1.nc
> > > >>>>
> > > >>
> > >
> >
>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/OBS/pcp_combine/20200615/1700/mrms_PCP_20200615_1700_1800_A1_
> > > >> wofs.nc
> > > >>>>
> > > >>
> > >
> >
>
/home/brian.matilla/WoFS_2020/MET_scripts/MET_configs/GridStatConfig_WOFS_PCP_1H
> > > >>>> -outdir
> > > >>>>
> > > >>
> > >
> >
>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/WOFS/grid_stat/20200615/1700/
> > > >>>> 12/14 14:54:11.874 metplus.GridStat
> (compare_gridded_wrapper.py:184)
> > > >>>> INFO: Processing custom string: 02
> > > >>>> 12/14 14:54:11.876 metplus.GridStat (met_util.py:215)
ERROR: Fatal
> > > >>>> error occurred
> > > >>>> Traceback (most recent call last):
> > > >>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> > > >>>> 3.1/metplus/util/met_util.py", line 195, in run_metplus
> > > >>>> loop_over_times_and_call(config, processes)
> > > >>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> > > >>>> 3.1/metplus/util/met_util.py", line 939, in
> loop_over_times_and_call
> > > >>>> process.run_at_time(input_dict)
> > > >>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> > > >>>> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 189,
in
> > > >>>> run_at_time
> > > >>>> self.run_at_time_once(time_info)
> > > >>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> > > >>>> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 224,
in
> > > >>>> run_at_time_once
> > > >>>> self.run_at_time_all_fields(time_info)
> > > >>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> > > >>>> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 288,
in
> > > >>>> run_at_time_all_fields
> > > >>>> return_list=True)
> > > >>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> > > >>>> 3.1/metplus/wrappers/command_builder.py", line 357, in
find_model
> > > >>>> return_list=return_list)
> > > >>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> > > >>>> 3.1/metplus/wrappers/command_builder.py", line 468, in
find_data
> > > >>>> return self.find_exact_file(**arg_dict,
allow_dir=allow_dir)
> > > >>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> > > >>>> 3.1/metplus/wrappers/command_builder.py", line 495, in
> > find_exact_file
> > > >>>> **time_info)
> > > >>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> > > >>>> 3.1/metplus/util/config/string_template_substitution.py",
line
> 399,
> > in
> > > >>>> do_string_sub
> > > >>>> return find_and_replace_tags_in_template(match_list,
tmpl,
> kwargs,
> > > >>>> skip_missing_tags)
> > > >>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> > > >>>> 3.1/metplus/util/config/string_template_substitution.py",
line
> 431,
> > in
> > > >>>> find_and_replace_tags_in_template
> > > >>>> " for template: " + tmpl)
> > > >>>> TypeError: The key valid was not passed to do_string_sub
for
> > > >>>> template:
> > > >>>>
> > > >>
> > >
> >
>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/WOFS/pcp_combine/{init?fmt=%Y%m%d?shift=-
> > > >>>>
> > > >>
> > >
> >
>
44100}/{init?fmt=%H%M}/ENS_MEM_{custom?fmt=%s}/wofs{custom?fmt=%s}_PCP_{init?fmt=%Y%m%d}_{init?fmt=%H%M}_{valid?fmt=%H%M}_A1.nc
> > > >>>> 12/14 14:54:11Z run-METplus-metplus.GridStat: ERROR: Fatal
error
> > > >>>> occurred
> > > >>>> 12/14 14:54:11.879 metplus.GridStat (met_util.py:216) INFO:
Check
> > the
> > > >>>> log file for more information:
> > > >>>>
> > > >>
> > >
> >
>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/logs/master_metplus.log.20201214145404
> > > >>>> 12/14 14:54:11.879 metplus (met_util.py:812) INFO:
> > > >>>>
> /work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/metplus_final.conf:
> > > >>>> write metplus.conf here
> > > >>>> 12/14 14:54:11.880 metplus (met_util.py:245) ERROR: METplus
has
> > > >>>> finished running but had 1 error.
> > > >>>> 12/14 14:54:11Z run-METplus-metplus: ERROR: METplus has
finished
> > > >>>> running but had 1 error.
> > > >>>>
> > > >>>> I am not entirely sure if MET 9.x or the latest versions of
> METplus
> > > >>>> have support to do ensemble-based percentile verification
so I
> > decided
> > > >>>> to try and run through each of the model members via
grid_stat to
> > > >>>> generate the individual probability fields which I would
then
> > process
> > > >>>> through ensemble_stat and then finally back through
grid_stat to
> > > >>>> generate the ensemble-based probabilities. Is there a way
to work
> > > >>>> around this particular issue to be able to process each
member in
> > the
> > > >>>> “grid_stat_custom_loop_list”?
> > > >>>>
> > > >>>> Many thanks!
> > > >>>>
> > > >>>> -Brian
> > > >>>> —————————————————————
> > > >>>> Brian Matilla
> > > >>>> Research Associate— Warn-on-Forecast Team
> > > >>>> Cooperative Institute for Mesoscale Meteorological Studies
— The
> > > >>>> University of Oklahoma
> > > >>>> NOAA National Severe Storms Laboratory
> > > >>>
> > > >>>
> > > >>>
> > > >>
> > > >>
> > > >> Hi George,
> > > >>
> > > >> I have gone ahead and rerun METplus with the log level set to
DEBUG.
> > > >> Attached is the metplus_final.conf as well as the log file. I
should
> > > note
> > > >> here that the input expected into grid_stat is the output
file from
> > > >> “pcp_combine” so that the percentiles can be calculated.
> > > >>
> > > >> Thanks,
> > > >>
> > > >> -Brian
> > > >> —————————————————————
> > > >> Brian Matilla
> > > >> Research Associate— Warn-on-Forecast Team
> > > >> Cooperative Institute for Mesoscale Meteorological Studies —
The
> > > >> University of Oklahoma
> > > >> NOAA National Severe Storms Laboratory
> > > >>
> > > >>
> > > >> On Dec 14, 2020, at 4:46 PM, George McCabe via RT <
> met_help at ucar.edu>
> > > >> wrote:
> > > >>
> > > >> Hi Brian,
> > > >>
> > > >> I'm not sure why that error is occurring. You should be able
to run
> > the
> > > >> way you described. I was not able to replicate the error on
my end.
> > > Could
> > > >> you please set LOG_LEVEL=DEBUG, rerun the use case, then send
me the
> > > full
> > > >> log file and the metplus_final.conf file?
> > > >>
> > > >> Thanks,
> > > >> George
> > > >>
> > > >> On Mon Dec 14 14:16:34 2020, brian.matilla at noaa.gov wrote:
> > > >>
> > > >> Hi MET Help Desk,
> > > >>
> > > >> I am trying to run grid_stat over each individual member (18
in
> total)
> > > >> in my use case. It will process member 1 with no issues,
however I
> do
> > > >> get the following error printout with any succeeding member:
> > > >>
> > > >> 12/14 14:54:05.639 metplus (met_util.py:920) INFO:
> > > >> ****************************************
> > > >> 12/14 14:54:05.640 metplus (met_util.py:921) INFO: * Running
METplus
> > > >> 12/14 14:54:05.640 metplus (met_util.py:923) INFO: * at init
time:
> > > >> 202006151700
> > > >> 12/14 14:54:05.640 metplus (met_util.py:926) INFO:
> > > >> ****************************************
> > > >> 12/14 14:54:05.640 metplus.GridStat
(compare_gridded_wrapper.py:176)
> > > >> INFO: Processing forecast lead 1 hour
> > > >> 12/14 14:54:05.640 metplus.GridStat
(compare_gridded_wrapper.py:184)
> > > >> INFO: Processing custom string: 01
> > > >> 12/14 14:54:05.643 metplus.GridStat (command_runner.py:89)
INFO:
> > > >> COMMAND:
> /home/brian.matilla/WoFS_2020/MET_scripts/met9/bin/grid_stat
> > > >> -v 3
> > > >>
> > > >>
> > >
> >
>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/WOFS/pcp_combine/20200615/1700/ENS_MEM_01/wofs01_PCP_20200615_1700_1800_A1.nc
> > > >>
> > > >>
> > >
> >
>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/OBS/pcp_combine/20200615/1700/mrms_PCP_20200615_1700_1800_A1_
> > > wofs.nc
> > > >>
> > > >>
> > >
> >
>
/home/brian.matilla/WoFS_2020/MET_scripts/MET_configs/GridStatConfig_WOFS_PCP_1H
> > > >> -outdir
> > > >>
> > > >>
> > >
> >
>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/WOFS/grid_stat/20200615/1700/
> > > >> 12/14 14:54:11.874 metplus.GridStat
(compare_gridded_wrapper.py:184)
> > > >> INFO: Processing custom string: 02
> > > >> 12/14 14:54:11.876 metplus.GridStat (met_util.py:215) ERROR:
Fatal
> > > >> error occurred
> > > >> Traceback (most recent call last):
> > > >> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> > > >> 3.1/metplus/util/met_util.py", line 195, in run_metplus
> > > >> loop_over_times_and_call(config, processes)
> > > >> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> > > >> 3.1/metplus/util/met_util.py", line 939, in
loop_over_times_and_call
> > > >> process.run_at_time(input_dict)
> > > >> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> > > >> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 189,
in
> > > >> run_at_time
> > > >> self.run_at_time_once(time_info)
> > > >> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> > > >> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 224,
in
> > > >> run_at_time_once
> > > >> self.run_at_time_all_fields(time_info)
> > > >> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> > > >> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 288,
in
> > > >> run_at_time_all_fields
> > > >> return_list=True)
> > > >> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> > > >> 3.1/metplus/wrappers/command_builder.py", line 357, in
find_model
> > > >> return_list=return_list)
> > > >> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> > > >> 3.1/metplus/wrappers/command_builder.py", line 468, in
find_data
> > > >> return self.find_exact_file(**arg_dict,
allow_dir=allow_dir)
> > > >> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> > > >> 3.1/metplus/wrappers/command_builder.py", line 495, in
> find_exact_file
> > > >> **time_info)
> > > >> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> > > >> 3.1/metplus/util/config/string_template_substitution.py",
line 399,
> in
> > > >> do_string_sub
> > > >> return find_and_replace_tags_in_template(match_list, tmpl,
kwargs,
> > > >> skip_missing_tags)
> > > >> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> > > >> 3.1/metplus/util/config/string_template_substitution.py",
line 431,
> in
> > > >> find_and_replace_tags_in_template
> > > >> " for template: " + tmpl)
> > > >> TypeError: The key valid was not passed to do_string_sub for
> > > >> template:
> > > >>
> > > >>
> > >
> >
>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/WOFS/pcp_combine/{init?fmt=%Y%m%d?shift=-
> > > >>
> > > >>
> > >
> >
>
44100}/{init?fmt=%H%M}/ENS_MEM_{custom?fmt=%s}/wofs{custom?fmt=%s}_PCP_{init?fmt=%Y%m%d}_{init?fmt=%H%M}_{valid?fmt=%H%M}_A1.nc
> > > >> 12/14 14:54:11Z run-METplus-metplus.GridStat: ERROR: Fatal
error
> > > >> occurred
> > > >> 12/14 14:54:11.879 metplus.GridStat (met_util.py:216) INFO:
Check
> the
> > > >> log file for more information:
> > > >>
> > > >>
> > >
> >
>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/logs/master_metplus.log.20201214145404
> > > >> 12/14 14:54:11.879 metplus (met_util.py:812) INFO:
> > > >>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/metplus_final.conf:
> > > >> write metplus.conf here
> > > >> 12/14 14:54:11.880 metplus (met_util.py:245) ERROR: METplus
has
> > > >> finished running but had 1 error.
> > > >> 12/14 14:54:11Z run-METplus-metplus: ERROR: METplus has
finished
> > > >> running but had 1 error.
> > > >>
> > > >> I am not entirely sure if MET 9.x or the latest versions of
METplus
> > > >> have support to do ensemble-based percentile verification so
I
> decided
> > > >> to try and run through each of the model members via
grid_stat to
> > > >> generate the individual probability fields which I would then
> process
> > > >> through ensemble_stat and then finally back through grid_stat
to
> > > >> generate the ensemble-based probabilities. Is there a way to
work
> > > >> around this particular issue to be able to process each
member in
> the
> > > >> “grid_stat_custom_loop_list”?
> > > >>
> > > >> Many thanks!
> > > >>
> > > >> -Brian
> > > >> —————————————————————
> > > >> Brian Matilla
> > > >> Research Associate— Warn-on-Forecast Team
> > > >> Cooperative Institute for Mesoscale Meteorological Studies —
The
> > > >> University of Oklahoma
> > > >> NOAA National Severe Storms Laboratory
> > > >>
> > > >>
> > > >>
> > > >>
> > > >>
> > > >>
> > > >
> > > > --
> > > > George McCabe - Software Engineer III
> > > > National Center for Atmospheric Research
> > > > Research Applications Laboratory
> > > > 303-497-2768
> > > > ---
> > > > My working day may not be your working day. Please do not feel
> obliged
> > to
> > > > reply to this email outside of your normal working hours.
> > > >
> > >
> > >
> > >
> >
> > --
> > George McCabe - Software Engineer III
> > National Center for Atmospheric Research
> > Research Applications Laboratory
> > 303-497-2768
> > ---
> > My working day may not be your working day. Please do not feel
obliged to
> > reply to this email outside of your normal working hours.
> >
> >
>
>
--
George McCabe - Software Engineer III
National Center for Atmospheric Research
Research Applications Laboratory
303-497-2768
---
My working day may not be your working day. Please do not feel obliged
to
reply to this email outside of your normal working hours.
------------------------------------------------
Subject: Problems with METplus "grid_stat_custom_loop_list"
From: George McCabe
Time: Mon Dec 21 10:40:22 2020
Here is the GitHub issue for the fix:
https://github.com/dtcenter/METplus/issues/740
On Mon, Dec 21, 2020 at 10:39 AM George McCabe <mccabe at ucar.edu>
wrote:
> Hi Brian,
>
> The bugfix version will be METplus 3.0.4, so it will include the
fixes
> from 3.0.2.
>
> On Mon, Dec 21, 2020 at 10:37 AM John Halley Gotway via RT <
> met_help at ucar.edu> wrote:
>
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97897 >
>>
>> Brian,
>>
>> I couldn't find an existing MET issue about ensemble-stat
>> computing probabilities based on percentile thresholds. So I just
wrote up
>> this issue description:
>> https://github.com/dtcenter/MET/issues/1612
>>
>> Please take a look and let me know if that description is accurate.
I'll
>> need to coordinate with Tara Jensen to figure out priorities,
funding, and
>> timeline for this work.
>>
>> Thanks,
>> John
>>
>> On Mon, Dec 21, 2020 at 9:26 AM George McCabe via RT
<met_help at ucar.edu>
>> wrote:
>>
>> >
>> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97897 >
>> >
>> > Hi Brian,
>> >
>> > Since you have to use MET 9.0.1, I think it would be best if we
issued a
>> > bugfix to METplus 3.0 to keep the versions aligned. The bug
exists in
>> the
>> > latest beta release, so upgrading to that would not solve the
problem. I
>> > will let you know when the bugfix release is available. Sorry
about the
>> > inconvenience and thank you for discovering this issue!
>> >
>> > Thanks,
>> > George
>> >
>> > On Mon, Dec 21, 2020 at 9:16 AM Brian Matilla - NOAA Affiliate
via RT <
>> > met_help at ucar.edu> wrote:
>> >
>> > >
>> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97897 >
>> > >
>> > > Hi George,
>> > >
>> > > Thanks for looking into this. I’m really only tied to the MET
version
>> > > (9.0.1) that our IT staff was able to install on our machines
but I do
>> > have
>> > > a copy of the latest METplus beta version so I can work with
that if
>> that
>> > > helps.
>> > >
>> > > Thanks,
>> > >
>> > > -Brian
>> > > —————————————————————
>> > > Brian Matilla
>> > > Research Associate— Warn-on-Forecast Team
>> > > Cooperative Institute for Mesoscale Meteorological Studies —
The
>> > > University of Oklahoma
>> > > NOAA National Severe Storms Laboratory
>> > >
>> > > > On Dec 21, 2020, at 10:11 AM, George McCabe via RT <
>> met_help at ucar.edu>
>> > > wrote:
>> > > >
>> > > > Hi Brian,
>> > > >
>> > > > Thank you for sending these files. I was able to recreate the
error
>> and
>> > > it
>> > > > looks like there is an odd bug in the code. Valid time should
>> > definitely
>> > > be
>> > > > available to use to find the file you are looking for. I will
look
>> into
>> > > it
>> > > > and let you know when I have a fix in place. My question is:
are you
>> > tied
>> > > > to using METplus 3.1 and would require a bugfix release for
that
>> > version
>> > > to
>> > > > continue your work? If you can upgrade to using a beta or
develop
>> > version
>> > > > of METplus, I can issue the fix there instead.
>> > > >
>> > > > Let me know what you think.
>> > > >
>> > > > Thanks,
>> > > > George
>> > > >
>> > > > On Fri, Dec 18, 2020 at 1:21 PM Brian Matilla - NOAA
Affiliate via
>> RT <
>> > > > met_help at ucar.edu> wrote:
>> > > >
>> > > >>
>> > > >> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97897 >
>> > > >>
>> > > >> Hi George,
>> > > >>
>> > > >> I have gone ahead and rerun METplus with the log level set
to
>> DEBUG.
>> > > >> Attached is the metplus_final.conf as well as the log file.
I
>> should
>> > > note
>> > > >> here that the input expected into grid_stat is the output
file from
>> > > >> “pcp_combine” so that the percentiles can be calculated.
>> > > >>
>> > > >> Thanks,
>> > > >>
>> > > >> -Brian
>> > > >> —————————————————————
>> > > >> Brian Matilla
>> > > >> Research Associate— Warn-on-Forecast Team
>> > > >> Cooperative Institute for Mesoscale Meteorological Studies —
The
>> > > >> University of Oklahoma
>> > > >> NOAA National Severe Storms Laboratory
>> > > >>
>> > > >>
>> > > >>> On Dec 14, 2020, at 4:46 PM, George McCabe via RT <
>> met_help at ucar.edu
>> > >
>> > > >> wrote:
>> > > >>>
>> > > >>> Hi Brian,
>> > > >>>
>> > > >>> I'm not sure why that error is occurring. You should be
able to
>> run
>> > the
>> > > >> way you described. I was not able to replicate the error on
my end.
>> > > Could
>> > > >> you please set LOG_LEVEL=DEBUG, rerun the use case, then
send me
>> the
>> > > full
>> > > >> log file and the metplus_final.conf file?
>> > > >>>
>> > > >>> Thanks,
>> > > >>> George
>> > > >>>
>> > > >>> On Mon Dec 14 14:16:34 2020, brian.matilla at noaa.gov wrote:
>> > > >>>> Hi MET Help Desk,
>> > > >>>>
>> > > >>>> I am trying to run grid_stat over each individual member
(18 in
>> > total)
>> > > >>>> in my use case. It will process member 1 with no issues,
however
>> I
>> > do
>> > > >>>> get the following error printout with any succeeding
member:
>> > > >>>>
>> > > >>>> 12/14 14:54:05.639 metplus (met_util.py:920) INFO:
>> > > >>>> ****************************************
>> > > >>>> 12/14 14:54:05.640 metplus (met_util.py:921) INFO: *
Running
>> METplus
>> > > >>>> 12/14 14:54:05.640 metplus (met_util.py:923) INFO: * at
init
>> time:
>> > > >>>> 202006151700
>> > > >>>> 12/14 14:54:05.640 metplus (met_util.py:926) INFO:
>> > > >>>> ****************************************
>> > > >>>> 12/14 14:54:05.640 metplus.GridStat
>> (compare_gridded_wrapper.py:176)
>> > > >>>> INFO: Processing forecast lead 1 hour
>> > > >>>> 12/14 14:54:05.640 metplus.GridStat
>> (compare_gridded_wrapper.py:184)
>> > > >>>> INFO: Processing custom string: 01
>> > > >>>> 12/14 14:54:05.643 metplus.GridStat (command_runner.py:89)
INFO:
>> > > >>>> COMMAND:
>> > /home/brian.matilla/WoFS_2020/MET_scripts/met9/bin/grid_stat
>> > > >>>> -v 3
>> > > >>>>
>> > > >>
>> > >
>> >
>>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/WOFS/pcp_combine/20200615/1700/ENS_MEM_01/wofs01_PCP_20200615_1700_1800_A1.nc
>> > > >>>>
>> > > >>
>> > >
>> >
>>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/OBS/pcp_combine/20200615/1700/mrms_PCP_20200615_1700_1800_A1_
>> > > >> wofs.nc
>> > > >>>>
>> > > >>
>> > >
>> >
>>
/home/brian.matilla/WoFS_2020/MET_scripts/MET_configs/GridStatConfig_WOFS_PCP_1H
>> > > >>>> -outdir
>> > > >>>>
>> > > >>
>> > >
>> >
>>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/WOFS/grid_stat/20200615/1700/
>> > > >>>> 12/14 14:54:11.874 metplus.GridStat
>> (compare_gridded_wrapper.py:184)
>> > > >>>> INFO: Processing custom string: 02
>> > > >>>> 12/14 14:54:11.876 metplus.GridStat (met_util.py:215)
ERROR:
>> Fatal
>> > > >>>> error occurred
>> > > >>>> Traceback (most recent call last):
>> > > >>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>> > > >>>> 3.1/metplus/util/met_util.py", line 195, in run_metplus
>> > > >>>> loop_over_times_and_call(config, processes)
>> > > >>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>> > > >>>> 3.1/metplus/util/met_util.py", line 939, in
>> loop_over_times_and_call
>> > > >>>> process.run_at_time(input_dict)
>> > > >>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>> > > >>>> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line
189, in
>> > > >>>> run_at_time
>> > > >>>> self.run_at_time_once(time_info)
>> > > >>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>> > > >>>> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line
224, in
>> > > >>>> run_at_time_once
>> > > >>>> self.run_at_time_all_fields(time_info)
>> > > >>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>> > > >>>> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line
288, in
>> > > >>>> run_at_time_all_fields
>> > > >>>> return_list=True)
>> > > >>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>> > > >>>> 3.1/metplus/wrappers/command_builder.py", line 357, in
find_model
>> > > >>>> return_list=return_list)
>> > > >>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>> > > >>>> 3.1/metplus/wrappers/command_builder.py", line 468, in
find_data
>> > > >>>> return self.find_exact_file(**arg_dict,
allow_dir=allow_dir)
>> > > >>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>> > > >>>> 3.1/metplus/wrappers/command_builder.py", line 495, in
>> > find_exact_file
>> > > >>>> **time_info)
>> > > >>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>> > > >>>> 3.1/metplus/util/config/string_template_substitution.py",
line
>> 399,
>> > in
>> > > >>>> do_string_sub
>> > > >>>> return find_and_replace_tags_in_template(match_list,
tmpl,
>> kwargs,
>> > > >>>> skip_missing_tags)
>> > > >>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>> > > >>>> 3.1/metplus/util/config/string_template_substitution.py",
line
>> 431,
>> > in
>> > > >>>> find_and_replace_tags_in_template
>> > > >>>> " for template: " + tmpl)
>> > > >>>> TypeError: The key valid was not passed to do_string_sub
for
>> > > >>>> template:
>> > > >>>>
>> > > >>
>> > >
>> >
>>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/WOFS/pcp_combine/{init?fmt=%Y%m%d?shift=-
>> > > >>>>
>> > > >>
>> > >
>> >
>>
44100}/{init?fmt=%H%M}/ENS_MEM_{custom?fmt=%s}/wofs{custom?fmt=%s}_PCP_{init?fmt=%Y%m%d}_{init?fmt=%H%M}_{valid?fmt=%H%M}_A1.nc
>> > > >>>> 12/14 14:54:11Z run-METplus-metplus.GridStat: ERROR:
Fatal error
>> > > >>>> occurred
>> > > >>>> 12/14 14:54:11.879 metplus.GridStat (met_util.py:216)
INFO: Check
>> > the
>> > > >>>> log file for more information:
>> > > >>>>
>> > > >>
>> > >
>> >
>>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/logs/master_metplus.log.20201214145404
>> > > >>>> 12/14 14:54:11.879 metplus (met_util.py:812) INFO:
>> > > >>>>
>>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/metplus_final.conf:
>> > > >>>> write metplus.conf here
>> > > >>>> 12/14 14:54:11.880 metplus (met_util.py:245) ERROR:
METplus has
>> > > >>>> finished running but had 1 error.
>> > > >>>> 12/14 14:54:11Z run-METplus-metplus: ERROR: METplus has
finished
>> > > >>>> running but had 1 error.
>> > > >>>>
>> > > >>>> I am not entirely sure if MET 9.x or the latest versions
of
>> METplus
>> > > >>>> have support to do ensemble-based percentile verification
so I
>> > decided
>> > > >>>> to try and run through each of the model members via
grid_stat to
>> > > >>>> generate the individual probability fields which I would
then
>> > process
>> > > >>>> through ensemble_stat and then finally back through
grid_stat to
>> > > >>>> generate the ensemble-based probabilities. Is there a way
to work
>> > > >>>> around this particular issue to be able to process each
member in
>> > the
>> > > >>>> “grid_stat_custom_loop_list”?
>> > > >>>>
>> > > >>>> Many thanks!
>> > > >>>>
>> > > >>>> -Brian
>> > > >>>> —————————————————————
>> > > >>>> Brian Matilla
>> > > >>>> Research Associate— Warn-on-Forecast Team
>> > > >>>> Cooperative Institute for Mesoscale Meteorological Studies
— The
>> > > >>>> University of Oklahoma
>> > > >>>> NOAA National Severe Storms Laboratory
>> > > >>>
>> > > >>>
>> > > >>>
>> > > >>
>> > > >>
>> > > >> Hi George,
>> > > >>
>> > > >> I have gone ahead and rerun METplus with the log level set
to
>> DEBUG.
>> > > >> Attached is the metplus_final.conf as well as the log file.
I
>> should
>> > > note
>> > > >> here that the input expected into grid_stat is the output
file from
>> > > >> “pcp_combine” so that the percentiles can be calculated.
>> > > >>
>> > > >> Thanks,
>> > > >>
>> > > >> -Brian
>> > > >> —————————————————————
>> > > >> Brian Matilla
>> > > >> Research Associate— Warn-on-Forecast Team
>> > > >> Cooperative Institute for Mesoscale Meteorological Studies —
The
>> > > >> University of Oklahoma
>> > > >> NOAA National Severe Storms Laboratory
>> > > >>
>> > > >>
>> > > >> On Dec 14, 2020, at 4:46 PM, George McCabe via RT <
>> met_help at ucar.edu>
>> > > >> wrote:
>> > > >>
>> > > >> Hi Brian,
>> > > >>
>> > > >> I'm not sure why that error is occurring. You should be able
to run
>> > the
>> > > >> way you described. I was not able to replicate the error on
my end.
>> > > Could
>> > > >> you please set LOG_LEVEL=DEBUG, rerun the use case, then
send me
>> the
>> > > full
>> > > >> log file and the metplus_final.conf file?
>> > > >>
>> > > >> Thanks,
>> > > >> George
>> > > >>
>> > > >> On Mon Dec 14 14:16:34 2020, brian.matilla at noaa.gov wrote:
>> > > >>
>> > > >> Hi MET Help Desk,
>> > > >>
>> > > >> I am trying to run grid_stat over each individual member (18
in
>> total)
>> > > >> in my use case. It will process member 1 with no issues,
however I
>> do
>> > > >> get the following error printout with any succeeding member:
>> > > >>
>> > > >> 12/14 14:54:05.639 metplus (met_util.py:920) INFO:
>> > > >> ****************************************
>> > > >> 12/14 14:54:05.640 metplus (met_util.py:921) INFO: * Running
>> METplus
>> > > >> 12/14 14:54:05.640 metplus (met_util.py:923) INFO: * at
init time:
>> > > >> 202006151700
>> > > >> 12/14 14:54:05.640 metplus (met_util.py:926) INFO:
>> > > >> ****************************************
>> > > >> 12/14 14:54:05.640 metplus.GridStat
>> (compare_gridded_wrapper.py:176)
>> > > >> INFO: Processing forecast lead 1 hour
>> > > >> 12/14 14:54:05.640 metplus.GridStat
>> (compare_gridded_wrapper.py:184)
>> > > >> INFO: Processing custom string: 01
>> > > >> 12/14 14:54:05.643 metplus.GridStat (command_runner.py:89)
INFO:
>> > > >> COMMAND:
>> /home/brian.matilla/WoFS_2020/MET_scripts/met9/bin/grid_stat
>> > > >> -v 3
>> > > >>
>> > > >>
>> > >
>> >
>>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/WOFS/pcp_combine/20200615/1700/ENS_MEM_01/wofs01_PCP_20200615_1700_1800_A1.nc
>> > > >>
>> > > >>
>> > >
>> >
>>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/OBS/pcp_combine/20200615/1700/mrms_PCP_20200615_1700_1800_A1_
>> > > wofs.nc
>> > > >>
>> > > >>
>> > >
>> >
>>
/home/brian.matilla/WoFS_2020/MET_scripts/MET_configs/GridStatConfig_WOFS_PCP_1H
>> > > >> -outdir
>> > > >>
>> > > >>
>> > >
>> >
>>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/WOFS/grid_stat/20200615/1700/
>> > > >> 12/14 14:54:11.874 metplus.GridStat
>> (compare_gridded_wrapper.py:184)
>> > > >> INFO: Processing custom string: 02
>> > > >> 12/14 14:54:11.876 metplus.GridStat (met_util.py:215) ERROR:
Fatal
>> > > >> error occurred
>> > > >> Traceback (most recent call last):
>> > > >> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>> > > >> 3.1/metplus/util/met_util.py", line 195, in run_metplus
>> > > >> loop_over_times_and_call(config, processes)
>> > > >> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>> > > >> 3.1/metplus/util/met_util.py", line 939, in
>> loop_over_times_and_call
>> > > >> process.run_at_time(input_dict)
>> > > >> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>> > > >> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 189,
in
>> > > >> run_at_time
>> > > >> self.run_at_time_once(time_info)
>> > > >> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>> > > >> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 224,
in
>> > > >> run_at_time_once
>> > > >> self.run_at_time_all_fields(time_info)
>> > > >> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>> > > >> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 288,
in
>> > > >> run_at_time_all_fields
>> > > >> return_list=True)
>> > > >> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>> > > >> 3.1/metplus/wrappers/command_builder.py", line 357, in
find_model
>> > > >> return_list=return_list)
>> > > >> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>> > > >> 3.1/metplus/wrappers/command_builder.py", line 468, in
find_data
>> > > >> return self.find_exact_file(**arg_dict,
allow_dir=allow_dir)
>> > > >> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>> > > >> 3.1/metplus/wrappers/command_builder.py", line 495, in
>> find_exact_file
>> > > >> **time_info)
>> > > >> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>> > > >> 3.1/metplus/util/config/string_template_substitution.py",
line
>> 399, in
>> > > >> do_string_sub
>> > > >> return find_and_replace_tags_in_template(match_list, tmpl,
>> kwargs,
>> > > >> skip_missing_tags)
>> > > >> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>> > > >> 3.1/metplus/util/config/string_template_substitution.py",
line
>> 431, in
>> > > >> find_and_replace_tags_in_template
>> > > >> " for template: " + tmpl)
>> > > >> TypeError: The key valid was not passed to do_string_sub
for
>> > > >> template:
>> > > >>
>> > > >>
>> > >
>> >
>>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/WOFS/pcp_combine/{init?fmt=%Y%m%d?shift=-
>> > > >>
>> > > >>
>> > >
>> >
>>
44100}/{init?fmt=%H%M}/ENS_MEM_{custom?fmt=%s}/wofs{custom?fmt=%s}_PCP_{init?fmt=%Y%m%d}_{init?fmt=%H%M}_{valid?fmt=%H%M}_A1.nc
>> > > >> 12/14 14:54:11Z run-METplus-metplus.GridStat: ERROR: Fatal
error
>> > > >> occurred
>> > > >> 12/14 14:54:11.879 metplus.GridStat (met_util.py:216) INFO:
Check
>> the
>> > > >> log file for more information:
>> > > >>
>> > > >>
>> > >
>> >
>>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/logs/master_metplus.log.20201214145404
>> > > >> 12/14 14:54:11.879 metplus (met_util.py:812) INFO:
>> > > >>
>>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/metplus_final.conf:
>> > > >> write metplus.conf here
>> > > >> 12/14 14:54:11.880 metplus (met_util.py:245) ERROR: METplus
has
>> > > >> finished running but had 1 error.
>> > > >> 12/14 14:54:11Z run-METplus-metplus: ERROR: METplus has
finished
>> > > >> running but had 1 error.
>> > > >>
>> > > >> I am not entirely sure if MET 9.x or the latest versions of
METplus
>> > > >> have support to do ensemble-based percentile verification so
I
>> decided
>> > > >> to try and run through each of the model members via
grid_stat to
>> > > >> generate the individual probability fields which I would
then
>> process
>> > > >> through ensemble_stat and then finally back through
grid_stat to
>> > > >> generate the ensemble-based probabilities. Is there a way to
work
>> > > >> around this particular issue to be able to process each
member in
>> the
>> > > >> “grid_stat_custom_loop_list”?
>> > > >>
>> > > >> Many thanks!
>> > > >>
>> > > >> -Brian
>> > > >> —————————————————————
>> > > >> Brian Matilla
>> > > >> Research Associate— Warn-on-Forecast Team
>> > > >> Cooperative Institute for Mesoscale Meteorological Studies —
The
>> > > >> University of Oklahoma
>> > > >> NOAA National Severe Storms Laboratory
>> > > >>
>> > > >>
>> > > >>
>> > > >>
>> > > >>
>> > > >>
>> > > >
>> > > > --
>> > > > George McCabe - Software Engineer III
>> > > > National Center for Atmospheric Research
>> > > > Research Applications Laboratory
>> > > > 303-497-2768
>> > > > ---
>> > > > My working day may not be your working day. Please do not
feel
>> obliged
>> > to
>> > > > reply to this email outside of your normal working hours.
>> > > >
>> > >
>> > >
>> > >
>> >
>> > --
>> > George McCabe - Software Engineer III
>> > National Center for Atmospheric Research
>> > Research Applications Laboratory
>> > 303-497-2768
>> > ---
>> > My working day may not be your working day. Please do not feel
obliged
>> to
>> > reply to this email outside of your normal working hours.
>> >
>> >
>>
>>
>
> --
> George McCabe - Software Engineer III
> National Center for Atmospheric Research
> Research Applications Laboratory
> 303-497-2768
> ---
> My working day may not be your working day. Please do not feel
obliged to
> reply to this email outside of your normal working hours.
>
--
George McCabe - Software Engineer III
National Center for Atmospheric Research
Research Applications Laboratory
303-497-2768
---
My working day may not be your working day. Please do not feel obliged
to
reply to this email outside of your normal working hours.
------------------------------------------------
Subject: Problems with METplus "grid_stat_custom_loop_list"
From: Brian Matilla - NOAA Affiliate
Time: Mon Dec 21 11:03:21 2020
Thanks for that George! Feel free to let me know if there’s anything
you need for me to provide to help with the bug fix.
-Brian
—————————————————————
Brian Matilla
Research Associate— Warn-on-Forecast Team
Cooperative Institute for Mesoscale Meteorological Studies — The
University of Oklahoma
NOAA National Severe Storms Laboratory
> On Dec 21, 2020, at 11:40 AM, George McCabe via RT
<met_help at ucar.edu> wrote:
>
> Here is the GitHub issue for the fix:
> https://github.com/dtcenter/METplus/issues/740
>
> On Mon, Dec 21, 2020 at 10:39 AM George McCabe <mccabe at ucar.edu>
wrote:
>
>> Hi Brian,
>>
>> The bugfix version will be METplus 3.0.4, so it will include the
fixes
>> from 3.0.2.
>>
>> On Mon, Dec 21, 2020 at 10:37 AM John Halley Gotway via RT <
>> met_help at ucar.edu> wrote:
>>
>>>
>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97897 >
>>>
>>> Brian,
>>>
>>> I couldn't find an existing MET issue about ensemble-stat
>>> computing probabilities based on percentile thresholds. So I just
wrote up
>>> this issue description:
>>> https://github.com/dtcenter/MET/issues/1612
>>>
>>> Please take a look and let me know if that description is
accurate. I'll
>>> need to coordinate with Tara Jensen to figure out priorities,
funding, and
>>> timeline for this work.
>>>
>>> Thanks,
>>> John
>>>
>>> On Mon, Dec 21, 2020 at 9:26 AM George McCabe via RT
<met_help at ucar.edu>
>>> wrote:
>>>
>>>>
>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97897 >
>>>>
>>>> Hi Brian,
>>>>
>>>> Since you have to use MET 9.0.1, I think it would be best if we
issued a
>>>> bugfix to METplus 3.0 to keep the versions aligned. The bug
exists in
>>> the
>>>> latest beta release, so upgrading to that would not solve the
problem. I
>>>> will let you know when the bugfix release is available. Sorry
about the
>>>> inconvenience and thank you for discovering this issue!
>>>>
>>>> Thanks,
>>>> George
>>>>
>>>> On Mon, Dec 21, 2020 at 9:16 AM Brian Matilla - NOAA Affiliate
via RT <
>>>> met_help at ucar.edu> wrote:
>>>>
>>>>>
>>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97897 >
>>>>>
>>>>> Hi George,
>>>>>
>>>>> Thanks for looking into this. I’m really only tied to the MET
version
>>>>> (9.0.1) that our IT staff was able to install on our machines
but I do
>>>> have
>>>>> a copy of the latest METplus beta version so I can work with
that if
>>> that
>>>>> helps.
>>>>>
>>>>> Thanks,
>>>>>
>>>>> -Brian
>>>>> —————————————————————
>>>>> Brian Matilla
>>>>> Research Associate— Warn-on-Forecast Team
>>>>> Cooperative Institute for Mesoscale Meteorological Studies — The
>>>>> University of Oklahoma
>>>>> NOAA National Severe Storms Laboratory
>>>>>
>>>>>> On Dec 21, 2020, at 10:11 AM, George McCabe via RT <
>>> met_help at ucar.edu>
>>>>> wrote:
>>>>>>
>>>>>> Hi Brian,
>>>>>>
>>>>>> Thank you for sending these files. I was able to recreate the
error
>>> and
>>>>> it
>>>>>> looks like there is an odd bug in the code. Valid time should
>>>> definitely
>>>>> be
>>>>>> available to use to find the file you are looking for. I will
look
>>> into
>>>>> it
>>>>>> and let you know when I have a fix in place. My question is:
are you
>>>> tied
>>>>>> to using METplus 3.1 and would require a bugfix release for
that
>>>> version
>>>>> to
>>>>>> continue your work? If you can upgrade to using a beta or
develop
>>>> version
>>>>>> of METplus, I can issue the fix there instead.
>>>>>>
>>>>>> Let me know what you think.
>>>>>>
>>>>>> Thanks,
>>>>>> George
>>>>>>
>>>>>> On Fri, Dec 18, 2020 at 1:21 PM Brian Matilla - NOAA Affiliate
via
>>> RT <
>>>>>> met_help at ucar.edu> wrote:
>>>>>>
>>>>>>>
>>>>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97897
>
>>>>>>>
>>>>>>> Hi George,
>>>>>>>
>>>>>>> I have gone ahead and rerun METplus with the log level set to
>>> DEBUG.
>>>>>>> Attached is the metplus_final.conf as well as the log file. I
>>> should
>>>>> note
>>>>>>> here that the input expected into grid_stat is the output file
from
>>>>>>> “pcp_combine” so that the percentiles can be calculated.
>>>>>>>
>>>>>>> Thanks,
>>>>>>>
>>>>>>> -Brian
>>>>>>> —————————————————————
>>>>>>> Brian Matilla
>>>>>>> Research Associate— Warn-on-Forecast Team
>>>>>>> Cooperative Institute for Mesoscale Meteorological Studies —
The
>>>>>>> University of Oklahoma
>>>>>>> NOAA National Severe Storms Laboratory
>>>>>>>
>>>>>>>
>>>>>>>> On Dec 14, 2020, at 4:46 PM, George McCabe via RT <
>>> met_help at ucar.edu
>>>>>
>>>>>>> wrote:
>>>>>>>>
>>>>>>>> Hi Brian,
>>>>>>>>
>>>>>>>> I'm not sure why that error is occurring. You should be able
to
>>> run
>>>> the
>>>>>>> way you described. I was not able to replicate the error on my
end.
>>>>> Could
>>>>>>> you please set LOG_LEVEL=DEBUG, rerun the use case, then send
me
>>> the
>>>>> full
>>>>>>> log file and the metplus_final.conf file?
>>>>>>>>
>>>>>>>> Thanks,
>>>>>>>> George
>>>>>>>>
>>>>>>>> On Mon Dec 14 14:16:34 2020, brian.matilla at noaa.gov wrote:
>>>>>>>>> Hi MET Help Desk,
>>>>>>>>>
>>>>>>>>> I am trying to run grid_stat over each individual member (18
in
>>>> total)
>>>>>>>>> in my use case. It will process member 1 with no issues,
however
>>> I
>>>> do
>>>>>>>>> get the following error printout with any succeeding member:
>>>>>>>>>
>>>>>>>>> 12/14 14:54:05.639 metplus (met_util.py:920) INFO:
>>>>>>>>> ****************************************
>>>>>>>>> 12/14 14:54:05.640 metplus (met_util.py:921) INFO: * Running
>>> METplus
>>>>>>>>> 12/14 14:54:05.640 metplus (met_util.py:923) INFO: * at
init
>>> time:
>>>>>>>>> 202006151700
>>>>>>>>> 12/14 14:54:05.640 metplus (met_util.py:926) INFO:
>>>>>>>>> ****************************************
>>>>>>>>> 12/14 14:54:05.640 metplus.GridStat
>>> (compare_gridded_wrapper.py:176)
>>>>>>>>> INFO: Processing forecast lead 1 hour
>>>>>>>>> 12/14 14:54:05.640 metplus.GridStat
>>> (compare_gridded_wrapper.py:184)
>>>>>>>>> INFO: Processing custom string: 01
>>>>>>>>> 12/14 14:54:05.643 metplus.GridStat (command_runner.py:89)
INFO:
>>>>>>>>> COMMAND:
>>>> /home/brian.matilla/WoFS_2020/MET_scripts/met9/bin/grid_stat
>>>>>>>>> -v 3
>>>>>>>>>
>>>>>>>
>>>>>
>>>>
>>>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/WOFS/pcp_combine/20200615/1700/ENS_MEM_01/wofs01_PCP_20200615_1700_1800_A1.nc
>>>>>>>>>
>>>>>>>
>>>>>
>>>>
>>>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/OBS/pcp_combine/20200615/1700/mrms_PCP_20200615_1700_1800_A1_
>>>>>>> wofs.nc
>>>>>>>>>
>>>>>>>
>>>>>
>>>>
>>>
/home/brian.matilla/WoFS_2020/MET_scripts/MET_configs/GridStatConfig_WOFS_PCP_1H
>>>>>>>>> -outdir
>>>>>>>>>
>>>>>>>
>>>>>
>>>>
>>>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/WOFS/grid_stat/20200615/1700/
>>>>>>>>> 12/14 14:54:11.874 metplus.GridStat
>>> (compare_gridded_wrapper.py:184)
>>>>>>>>> INFO: Processing custom string: 02
>>>>>>>>> 12/14 14:54:11.876 metplus.GridStat (met_util.py:215) ERROR:
>>> Fatal
>>>>>>>>> error occurred
>>>>>>>>> Traceback (most recent call last):
>>>>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>>>>>> 3.1/metplus/util/met_util.py", line 195, in run_metplus
>>>>>>>>> loop_over_times_and_call(config, processes)
>>>>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>>>>>> 3.1/metplus/util/met_util.py", line 939, in
>>> loop_over_times_and_call
>>>>>>>>> process.run_at_time(input_dict)
>>>>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>>>>>> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 189,
in
>>>>>>>>> run_at_time
>>>>>>>>> self.run_at_time_once(time_info)
>>>>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>>>>>> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 224,
in
>>>>>>>>> run_at_time_once
>>>>>>>>> self.run_at_time_all_fields(time_info)
>>>>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>>>>>> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 288,
in
>>>>>>>>> run_at_time_all_fields
>>>>>>>>> return_list=True)
>>>>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>>>>>> 3.1/metplus/wrappers/command_builder.py", line 357, in
find_model
>>>>>>>>> return_list=return_list)
>>>>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>>>>>> 3.1/metplus/wrappers/command_builder.py", line 468, in
find_data
>>>>>>>>> return self.find_exact_file(**arg_dict,
allow_dir=allow_dir)
>>>>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>>>>>> 3.1/metplus/wrappers/command_builder.py", line 495, in
>>>> find_exact_file
>>>>>>>>> **time_info)
>>>>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>>>>>> 3.1/metplus/util/config/string_template_substitution.py",
line
>>> 399,
>>>> in
>>>>>>>>> do_string_sub
>>>>>>>>> return find_and_replace_tags_in_template(match_list, tmpl,
>>> kwargs,
>>>>>>>>> skip_missing_tags)
>>>>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>>>>>> 3.1/metplus/util/config/string_template_substitution.py",
line
>>> 431,
>>>> in
>>>>>>>>> find_and_replace_tags_in_template
>>>>>>>>> " for template: " + tmpl)
>>>>>>>>> TypeError: The key valid was not passed to do_string_sub
for
>>>>>>>>> template:
>>>>>>>>>
>>>>>>>
>>>>>
>>>>
>>>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/WOFS/pcp_combine/{init?fmt=%Y%m%d?shift=-
>>>>>>>>>
>>>>>>>
>>>>>
>>>>
>>>
44100}/{init?fmt=%H%M}/ENS_MEM_{custom?fmt=%s}/wofs{custom?fmt=%s}_PCP_{init?fmt=%Y%m%d}_{init?fmt=%H%M}_{valid?fmt=%H%M}_A1.nc
>>>>>>>>> 12/14 14:54:11Z run-METplus-metplus.GridStat: ERROR: Fatal
error
>>>>>>>>> occurred
>>>>>>>>> 12/14 14:54:11.879 metplus.GridStat (met_util.py:216) INFO:
Check
>>>> the
>>>>>>>>> log file for more information:
>>>>>>>>>
>>>>>>>
>>>>>
>>>>
>>>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/logs/master_metplus.log.20201214145404
>>>>>>>>> 12/14 14:54:11.879 metplus (met_util.py:812) INFO:
>>>>>>>>>
>>>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/metplus_final.conf:
>>>>>>>>> write metplus.conf here
>>>>>>>>> 12/14 14:54:11.880 metplus (met_util.py:245) ERROR: METplus
has
>>>>>>>>> finished running but had 1 error.
>>>>>>>>> 12/14 14:54:11Z run-METplus-metplus: ERROR: METplus has
finished
>>>>>>>>> running but had 1 error.
>>>>>>>>>
>>>>>>>>> I am not entirely sure if MET 9.x or the latest versions of
>>> METplus
>>>>>>>>> have support to do ensemble-based percentile verification so
I
>>>> decided
>>>>>>>>> to try and run through each of the model members via
grid_stat to
>>>>>>>>> generate the individual probability fields which I would
then
>>>> process
>>>>>>>>> through ensemble_stat and then finally back through
grid_stat to
>>>>>>>>> generate the ensemble-based probabilities. Is there a way to
work
>>>>>>>>> around this particular issue to be able to process each
member in
>>>> the
>>>>>>>>> “grid_stat_custom_loop_list”?
>>>>>>>>>
>>>>>>>>> Many thanks!
>>>>>>>>>
>>>>>>>>> -Brian
>>>>>>>>> —————————————————————
>>>>>>>>> Brian Matilla
>>>>>>>>> Research Associate— Warn-on-Forecast Team
>>>>>>>>> Cooperative Institute for Mesoscale Meteorological Studies —
The
>>>>>>>>> University of Oklahoma
>>>>>>>>> NOAA National Severe Storms Laboratory
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> Hi George,
>>>>>>>
>>>>>>> I have gone ahead and rerun METplus with the log level set to
>>> DEBUG.
>>>>>>> Attached is the metplus_final.conf as well as the log file. I
>>> should
>>>>> note
>>>>>>> here that the input expected into grid_stat is the output file
from
>>>>>>> “pcp_combine” so that the percentiles can be calculated.
>>>>>>>
>>>>>>> Thanks,
>>>>>>>
>>>>>>> -Brian
>>>>>>> —————————————————————
>>>>>>> Brian Matilla
>>>>>>> Research Associate— Warn-on-Forecast Team
>>>>>>> Cooperative Institute for Mesoscale Meteorological Studies —
The
>>>>>>> University of Oklahoma
>>>>>>> NOAA National Severe Storms Laboratory
>>>>>>>
>>>>>>>
>>>>>>> On Dec 14, 2020, at 4:46 PM, George McCabe via RT <
>>> met_help at ucar.edu>
>>>>>>> wrote:
>>>>>>>
>>>>>>> Hi Brian,
>>>>>>>
>>>>>>> I'm not sure why that error is occurring. You should be able
to run
>>>> the
>>>>>>> way you described. I was not able to replicate the error on my
end.
>>>>> Could
>>>>>>> you please set LOG_LEVEL=DEBUG, rerun the use case, then send
me
>>> the
>>>>> full
>>>>>>> log file and the metplus_final.conf file?
>>>>>>>
>>>>>>> Thanks,
>>>>>>> George
>>>>>>>
>>>>>>> On Mon Dec 14 14:16:34 2020, brian.matilla at noaa.gov wrote:
>>>>>>>
>>>>>>> Hi MET Help Desk,
>>>>>>>
>>>>>>> I am trying to run grid_stat over each individual member (18
in
>>> total)
>>>>>>> in my use case. It will process member 1 with no issues,
however I
>>> do
>>>>>>> get the following error printout with any succeeding member:
>>>>>>>
>>>>>>> 12/14 14:54:05.639 metplus (met_util.py:920) INFO:
>>>>>>> ****************************************
>>>>>>> 12/14 14:54:05.640 metplus (met_util.py:921) INFO: * Running
>>> METplus
>>>>>>> 12/14 14:54:05.640 metplus (met_util.py:923) INFO: * at init
time:
>>>>>>> 202006151700
>>>>>>> 12/14 14:54:05.640 metplus (met_util.py:926) INFO:
>>>>>>> ****************************************
>>>>>>> 12/14 14:54:05.640 metplus.GridStat
>>> (compare_gridded_wrapper.py:176)
>>>>>>> INFO: Processing forecast lead 1 hour
>>>>>>> 12/14 14:54:05.640 metplus.GridStat
>>> (compare_gridded_wrapper.py:184)
>>>>>>> INFO: Processing custom string: 01
>>>>>>> 12/14 14:54:05.643 metplus.GridStat (command_runner.py:89)
INFO:
>>>>>>> COMMAND:
>>> /home/brian.matilla/WoFS_2020/MET_scripts/met9/bin/grid_stat
>>>>>>> -v 3
>>>>>>>
>>>>>>>
>>>>>
>>>>
>>>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/WOFS/pcp_combine/20200615/1700/ENS_MEM_01/wofs01_PCP_20200615_1700_1800_A1.nc
>>>>>>>
>>>>>>>
>>>>>
>>>>
>>>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/OBS/pcp_combine/20200615/1700/mrms_PCP_20200615_1700_1800_A1_
>>>>> wofs.nc
>>>>>>>
>>>>>>>
>>>>>
>>>>
>>>
/home/brian.matilla/WoFS_2020/MET_scripts/MET_configs/GridStatConfig_WOFS_PCP_1H
>>>>>>> -outdir
>>>>>>>
>>>>>>>
>>>>>
>>>>
>>>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/WOFS/grid_stat/20200615/1700/
>>>>>>> 12/14 14:54:11.874 metplus.GridStat
>>> (compare_gridded_wrapper.py:184)
>>>>>>> INFO: Processing custom string: 02
>>>>>>> 12/14 14:54:11.876 metplus.GridStat (met_util.py:215) ERROR:
Fatal
>>>>>>> error occurred
>>>>>>> Traceback (most recent call last):
>>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>>>> 3.1/metplus/util/met_util.py", line 195, in run_metplus
>>>>>>> loop_over_times_and_call(config, processes)
>>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>>>> 3.1/metplus/util/met_util.py", line 939, in
>>> loop_over_times_and_call
>>>>>>> process.run_at_time(input_dict)
>>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>>>> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 189, in
>>>>>>> run_at_time
>>>>>>> self.run_at_time_once(time_info)
>>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>>>> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 224, in
>>>>>>> run_at_time_once
>>>>>>> self.run_at_time_all_fields(time_info)
>>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>>>> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 288, in
>>>>>>> run_at_time_all_fields
>>>>>>> return_list=True)
>>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>>>> 3.1/metplus/wrappers/command_builder.py", line 357, in
find_model
>>>>>>> return_list=return_list)
>>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>>>> 3.1/metplus/wrappers/command_builder.py", line 468, in
find_data
>>>>>>> return self.find_exact_file(**arg_dict, allow_dir=allow_dir)
>>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>>>> 3.1/metplus/wrappers/command_builder.py", line 495, in
>>> find_exact_file
>>>>>>> **time_info)
>>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>>>> 3.1/metplus/util/config/string_template_substitution.py", line
>>> 399, in
>>>>>>> do_string_sub
>>>>>>> return find_and_replace_tags_in_template(match_list, tmpl,
>>> kwargs,
>>>>>>> skip_missing_tags)
>>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>>>> 3.1/metplus/util/config/string_template_substitution.py", line
>>> 431, in
>>>>>>> find_and_replace_tags_in_template
>>>>>>> " for template: " + tmpl)
>>>>>>> TypeError: The key valid was not passed to do_string_sub for
>>>>>>> template:
>>>>>>>
>>>>>>>
>>>>>
>>>>
>>>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/WOFS/pcp_combine/{init?fmt=%Y%m%d?shift=-
>>>>>>>
>>>>>>>
>>>>>
>>>>
>>>
44100}/{init?fmt=%H%M}/ENS_MEM_{custom?fmt=%s}/wofs{custom?fmt=%s}_PCP_{init?fmt=%Y%m%d}_{init?fmt=%H%M}_{valid?fmt=%H%M}_A1.nc
>>>>>>> 12/14 14:54:11Z run-METplus-metplus.GridStat: ERROR: Fatal
error
>>>>>>> occurred
>>>>>>> 12/14 14:54:11.879 metplus.GridStat (met_util.py:216) INFO:
Check
>>> the
>>>>>>> log file for more information:
>>>>>>>
>>>>>>>
>>>>>
>>>>
>>>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/logs/master_metplus.log.20201214145404
>>>>>>> 12/14 14:54:11.879 metplus (met_util.py:812) INFO:
>>>>>>>
>>>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/metplus_final.conf:
>>>>>>> write metplus.conf here
>>>>>>> 12/14 14:54:11.880 metplus (met_util.py:245) ERROR: METplus
has
>>>>>>> finished running but had 1 error.
>>>>>>> 12/14 14:54:11Z run-METplus-metplus: ERROR: METplus has
finished
>>>>>>> running but had 1 error.
>>>>>>>
>>>>>>> I am not entirely sure if MET 9.x or the latest versions of
METplus
>>>>>>> have support to do ensemble-based percentile verification so I
>>> decided
>>>>>>> to try and run through each of the model members via grid_stat
to
>>>>>>> generate the individual probability fields which I would then
>>> process
>>>>>>> through ensemble_stat and then finally back through grid_stat
to
>>>>>>> generate the ensemble-based probabilities. Is there a way to
work
>>>>>>> around this particular issue to be able to process each member
in
>>> the
>>>>>>> “grid_stat_custom_loop_list”?
>>>>>>>
>>>>>>> Many thanks!
>>>>>>>
>>>>>>> -Brian
>>>>>>> —————————————————————
>>>>>>> Brian Matilla
>>>>>>> Research Associate— Warn-on-Forecast Team
>>>>>>> Cooperative Institute for Mesoscale Meteorological Studies —
The
>>>>>>> University of Oklahoma
>>>>>>> NOAA National Severe Storms Laboratory
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>
>>>>>> --
>>>>>> George McCabe - Software Engineer III
>>>>>> National Center for Atmospheric Research
>>>>>> Research Applications Laboratory
>>>>>> 303-497-2768
>>>>>> ---
>>>>>> My working day may not be your working day. Please do not feel
>>> obliged
>>>> to
>>>>>> reply to this email outside of your normal working hours.
>>>>>>
>>>>>
>>>>>
>>>>>
>>>>
>>>> --
>>>> George McCabe - Software Engineer III
>>>> National Center for Atmospheric Research
>>>> Research Applications Laboratory
>>>> 303-497-2768
>>>> ---
>>>> My working day may not be your working day. Please do not feel
obliged
>>> to
>>>> reply to this email outside of your normal working hours.
>>>>
>>>>
>>>
>>>
>>
>> --
>> George McCabe - Software Engineer III
>> National Center for Atmospheric Research
>> Research Applications Laboratory
>> 303-497-2768
>> ---
>> My working day may not be your working day. Please do not feel
obliged to
>> reply to this email outside of your normal working hours.
>>
>
>
> --
> George McCabe - Software Engineer III
> National Center for Atmospheric Research
> Research Applications Laboratory
> 303-497-2768
> ---
> My working day may not be your working day. Please do not feel
obliged to
> reply to this email outside of your normal working hours.
>
------------------------------------------------
Subject: Problems with METplus "grid_stat_custom_loop_list"
From: Brian Matilla - NOAA Affiliate
Time: Mon Dec 21 11:04:59 2020
Hi John,
Thanks for creating this issue. I’ve looked over the description and
that is on point with the request. Feel free to let me know if there’s
anything you need from me to help with this.
-Brian
> On Dec 21, 2020, at 11:37 AM, John Halley Gotway via RT
<met_help at ucar.edu> wrote:
>
> Brian,
>
> I couldn't find an existing MET issue about ensemble-stat
> computing probabilities based on percentile thresholds. So I just
wrote up
> this issue description:
> https://github.com/dtcenter/MET/issues/1612
>
> Please take a look and let me know if that description is accurate.
I'll
> need to coordinate with Tara Jensen to figure out priorities,
funding, and
> timeline for this work.
>
> Thanks,
> John
>
> On Mon, Dec 21, 2020 at 9:26 AM George McCabe via RT
<met_help at ucar.edu>
> wrote:
>
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97897 >
>>
>> Hi Brian,
>>
>> Since you have to use MET 9.0.1, I think it would be best if we
issued a
>> bugfix to METplus 3.0 to keep the versions aligned. The bug exists
in the
>> latest beta release, so upgrading to that would not solve the
problem. I
>> will let you know when the bugfix release is available. Sorry about
the
>> inconvenience and thank you for discovering this issue!
>>
>> Thanks,
>> George
>>
>> On Mon, Dec 21, 2020 at 9:16 AM Brian Matilla - NOAA Affiliate via
RT <
>> met_help at ucar.edu> wrote:
>>
>>>
>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97897 >
>>>
>>> Hi George,
>>>
>>> Thanks for looking into this. I’m really only tied to the MET
version
>>> (9.0.1) that our IT staff was able to install on our machines but
I do
>> have
>>> a copy of the latest METplus beta version so I can work with that
if that
>>> helps.
>>>
>>> Thanks,
>>>
>>> -Brian
>>> —————————————————————
>>> Brian Matilla
>>> Research Associate— Warn-on-Forecast Team
>>> Cooperative Institute for Mesoscale Meteorological Studies — The
>>> University of Oklahoma
>>> NOAA National Severe Storms Laboratory
>>>
>>>> On Dec 21, 2020, at 10:11 AM, George McCabe via RT
<met_help at ucar.edu>
>>> wrote:
>>>>
>>>> Hi Brian,
>>>>
>>>> Thank you for sending these files. I was able to recreate the
error and
>>> it
>>>> looks like there is an odd bug in the code. Valid time should
>> definitely
>>> be
>>>> available to use to find the file you are looking for. I will
look into
>>> it
>>>> and let you know when I have a fix in place. My question is: are
you
>> tied
>>>> to using METplus 3.1 and would require a bugfix release for that
>> version
>>> to
>>>> continue your work? If you can upgrade to using a beta or develop
>> version
>>>> of METplus, I can issue the fix there instead.
>>>>
>>>> Let me know what you think.
>>>>
>>>> Thanks,
>>>> George
>>>>
>>>> On Fri, Dec 18, 2020 at 1:21 PM Brian Matilla - NOAA Affiliate
via RT <
>>>> met_help at ucar.edu> wrote:
>>>>
>>>>>
>>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97897 >
>>>>>
>>>>> Hi George,
>>>>>
>>>>> I have gone ahead and rerun METplus with the log level set to
DEBUG.
>>>>> Attached is the metplus_final.conf as well as the log file. I
should
>>> note
>>>>> here that the input expected into grid_stat is the output file
from
>>>>> “pcp_combine” so that the percentiles can be calculated.
>>>>>
>>>>> Thanks,
>>>>>
>>>>> -Brian
>>>>> —————————————————————
>>>>> Brian Matilla
>>>>> Research Associate— Warn-on-Forecast Team
>>>>> Cooperative Institute for Mesoscale Meteorological Studies — The
>>>>> University of Oklahoma
>>>>> NOAA National Severe Storms Laboratory
>>>>>
>>>>>
>>>>>> On Dec 14, 2020, at 4:46 PM, George McCabe via RT
<met_help at ucar.edu
>>>
>>>>> wrote:
>>>>>>
>>>>>> Hi Brian,
>>>>>>
>>>>>> I'm not sure why that error is occurring. You should be able to
run
>> the
>>>>> way you described. I was not able to replicate the error on my
end.
>>> Could
>>>>> you please set LOG_LEVEL=DEBUG, rerun the use case, then send me
the
>>> full
>>>>> log file and the metplus_final.conf file?
>>>>>>
>>>>>> Thanks,
>>>>>> George
>>>>>>
>>>>>> On Mon Dec 14 14:16:34 2020, brian.matilla at noaa.gov wrote:
>>>>>>> Hi MET Help Desk,
>>>>>>>
>>>>>>> I am trying to run grid_stat over each individual member (18
in
>> total)
>>>>>>> in my use case. It will process member 1 with no issues,
however I
>> do
>>>>>>> get the following error printout with any succeeding member:
>>>>>>>
>>>>>>> 12/14 14:54:05.639 metplus (met_util.py:920) INFO:
>>>>>>> ****************************************
>>>>>>> 12/14 14:54:05.640 metplus (met_util.py:921) INFO: * Running
METplus
>>>>>>> 12/14 14:54:05.640 metplus (met_util.py:923) INFO: * at init
time:
>>>>>>> 202006151700
>>>>>>> 12/14 14:54:05.640 metplus (met_util.py:926) INFO:
>>>>>>> ****************************************
>>>>>>> 12/14 14:54:05.640 metplus.GridStat
(compare_gridded_wrapper.py:176)
>>>>>>> INFO: Processing forecast lead 1 hour
>>>>>>> 12/14 14:54:05.640 metplus.GridStat
(compare_gridded_wrapper.py:184)
>>>>>>> INFO: Processing custom string: 01
>>>>>>> 12/14 14:54:05.643 metplus.GridStat (command_runner.py:89)
INFO:
>>>>>>> COMMAND:
>> /home/brian.matilla/WoFS_2020/MET_scripts/met9/bin/grid_stat
>>>>>>> -v 3
>>>>>>>
>>>>>
>>>
>>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/WOFS/pcp_combine/20200615/1700/ENS_MEM_01/wofs01_PCP_20200615_1700_1800_A1.nc
>>>>>>>
>>>>>
>>>
>>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/OBS/pcp_combine/20200615/1700/mrms_PCP_20200615_1700_1800_A1_
>>>>> wofs.nc
>>>>>>>
>>>>>
>>>
>>
/home/brian.matilla/WoFS_2020/MET_scripts/MET_configs/GridStatConfig_WOFS_PCP_1H
>>>>>>> -outdir
>>>>>>>
>>>>>
>>>
>>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/WOFS/grid_stat/20200615/1700/
>>>>>>> 12/14 14:54:11.874 metplus.GridStat
(compare_gridded_wrapper.py:184)
>>>>>>> INFO: Processing custom string: 02
>>>>>>> 12/14 14:54:11.876 metplus.GridStat (met_util.py:215) ERROR:
Fatal
>>>>>>> error occurred
>>>>>>> Traceback (most recent call last):
>>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>>>> 3.1/metplus/util/met_util.py", line 195, in run_metplus
>>>>>>> loop_over_times_and_call(config, processes)
>>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>>>> 3.1/metplus/util/met_util.py", line 939, in
loop_over_times_and_call
>>>>>>> process.run_at_time(input_dict)
>>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>>>> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 189, in
>>>>>>> run_at_time
>>>>>>> self.run_at_time_once(time_info)
>>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>>>> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 224, in
>>>>>>> run_at_time_once
>>>>>>> self.run_at_time_all_fields(time_info)
>>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>>>> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 288, in
>>>>>>> run_at_time_all_fields
>>>>>>> return_list=True)
>>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>>>> 3.1/metplus/wrappers/command_builder.py", line 357, in
find_model
>>>>>>> return_list=return_list)
>>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>>>> 3.1/metplus/wrappers/command_builder.py", line 468, in
find_data
>>>>>>> return self.find_exact_file(**arg_dict, allow_dir=allow_dir)
>>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>>>> 3.1/metplus/wrappers/command_builder.py", line 495, in
>> find_exact_file
>>>>>>> **time_info)
>>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>>>> 3.1/metplus/util/config/string_template_substitution.py", line
399,
>> in
>>>>>>> do_string_sub
>>>>>>> return find_and_replace_tags_in_template(match_list, tmpl,
kwargs,
>>>>>>> skip_missing_tags)
>>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>>>> 3.1/metplus/util/config/string_template_substitution.py", line
431,
>> in
>>>>>>> find_and_replace_tags_in_template
>>>>>>> " for template: " + tmpl)
>>>>>>> TypeError: The key valid was not passed to do_string_sub for
>>>>>>> template:
>>>>>>>
>>>>>
>>>
>>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/WOFS/pcp_combine/{init?fmt=%Y%m%d?shift=-
>>>>>>>
>>>>>
>>>
>>
44100}/{init?fmt=%H%M}/ENS_MEM_{custom?fmt=%s}/wofs{custom?fmt=%s}_PCP_{init?fmt=%Y%m%d}_{init?fmt=%H%M}_{valid?fmt=%H%M}_A1.nc
>>>>>>> 12/14 14:54:11Z run-METplus-metplus.GridStat: ERROR: Fatal
error
>>>>>>> occurred
>>>>>>> 12/14 14:54:11.879 metplus.GridStat (met_util.py:216) INFO:
Check
>> the
>>>>>>> log file for more information:
>>>>>>>
>>>>>
>>>
>>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/logs/master_metplus.log.20201214145404
>>>>>>> 12/14 14:54:11.879 metplus (met_util.py:812) INFO:
>>>>>>>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/metplus_final.conf:
>>>>>>> write metplus.conf here
>>>>>>> 12/14 14:54:11.880 metplus (met_util.py:245) ERROR: METplus
has
>>>>>>> finished running but had 1 error.
>>>>>>> 12/14 14:54:11Z run-METplus-metplus: ERROR: METplus has
finished
>>>>>>> running but had 1 error.
>>>>>>>
>>>>>>> I am not entirely sure if MET 9.x or the latest versions of
METplus
>>>>>>> have support to do ensemble-based percentile verification so I
>> decided
>>>>>>> to try and run through each of the model members via grid_stat
to
>>>>>>> generate the individual probability fields which I would then
>> process
>>>>>>> through ensemble_stat and then finally back through grid_stat
to
>>>>>>> generate the ensemble-based probabilities. Is there a way to
work
>>>>>>> around this particular issue to be able to process each member
in
>> the
>>>>>>> “grid_stat_custom_loop_list”?
>>>>>>>
>>>>>>> Many thanks!
>>>>>>>
>>>>>>> -Brian
>>>>>>> —————————————————————
>>>>>>> Brian Matilla
>>>>>>> Research Associate— Warn-on-Forecast Team
>>>>>>> Cooperative Institute for Mesoscale Meteorological Studies —
The
>>>>>>> University of Oklahoma
>>>>>>> NOAA National Severe Storms Laboratory
>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>> Hi George,
>>>>>
>>>>> I have gone ahead and rerun METplus with the log level set to
DEBUG.
>>>>> Attached is the metplus_final.conf as well as the log file. I
should
>>> note
>>>>> here that the input expected into grid_stat is the output file
from
>>>>> “pcp_combine” so that the percentiles can be calculated.
>>>>>
>>>>> Thanks,
>>>>>
>>>>> -Brian
>>>>> —————————————————————
>>>>> Brian Matilla
>>>>> Research Associate— Warn-on-Forecast Team
>>>>> Cooperative Institute for Mesoscale Meteorological Studies — The
>>>>> University of Oklahoma
>>>>> NOAA National Severe Storms Laboratory
>>>>>
>>>>>
>>>>> On Dec 14, 2020, at 4:46 PM, George McCabe via RT
<met_help at ucar.edu>
>>>>> wrote:
>>>>>
>>>>> Hi Brian,
>>>>>
>>>>> I'm not sure why that error is occurring. You should be able to
run
>> the
>>>>> way you described. I was not able to replicate the error on my
end.
>>> Could
>>>>> you please set LOG_LEVEL=DEBUG, rerun the use case, then send me
the
>>> full
>>>>> log file and the metplus_final.conf file?
>>>>>
>>>>> Thanks,
>>>>> George
>>>>>
>>>>> On Mon Dec 14 14:16:34 2020, brian.matilla at noaa.gov wrote:
>>>>>
>>>>> Hi MET Help Desk,
>>>>>
>>>>> I am trying to run grid_stat over each individual member (18 in
total)
>>>>> in my use case. It will process member 1 with no issues, however
I do
>>>>> get the following error printout with any succeeding member:
>>>>>
>>>>> 12/14 14:54:05.639 metplus (met_util.py:920) INFO:
>>>>> ****************************************
>>>>> 12/14 14:54:05.640 metplus (met_util.py:921) INFO: * Running
METplus
>>>>> 12/14 14:54:05.640 metplus (met_util.py:923) INFO: * at init
time:
>>>>> 202006151700
>>>>> 12/14 14:54:05.640 metplus (met_util.py:926) INFO:
>>>>> ****************************************
>>>>> 12/14 14:54:05.640 metplus.GridStat
(compare_gridded_wrapper.py:176)
>>>>> INFO: Processing forecast lead 1 hour
>>>>> 12/14 14:54:05.640 metplus.GridStat
(compare_gridded_wrapper.py:184)
>>>>> INFO: Processing custom string: 01
>>>>> 12/14 14:54:05.643 metplus.GridStat (command_runner.py:89) INFO:
>>>>> COMMAND:
/home/brian.matilla/WoFS_2020/MET_scripts/met9/bin/grid_stat
>>>>> -v 3
>>>>>
>>>>>
>>>
>>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/WOFS/pcp_combine/20200615/1700/ENS_MEM_01/wofs01_PCP_20200615_1700_1800_A1.nc
>>>>>
>>>>>
>>>
>>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/OBS/pcp_combine/20200615/1700/mrms_PCP_20200615_1700_1800_A1_
>>> wofs.nc
>>>>>
>>>>>
>>>
>>
/home/brian.matilla/WoFS_2020/MET_scripts/MET_configs/GridStatConfig_WOFS_PCP_1H
>>>>> -outdir
>>>>>
>>>>>
>>>
>>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/WOFS/grid_stat/20200615/1700/
>>>>> 12/14 14:54:11.874 metplus.GridStat
(compare_gridded_wrapper.py:184)
>>>>> INFO: Processing custom string: 02
>>>>> 12/14 14:54:11.876 metplus.GridStat (met_util.py:215) ERROR:
Fatal
>>>>> error occurred
>>>>> Traceback (most recent call last):
>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>> 3.1/metplus/util/met_util.py", line 195, in run_metplus
>>>>> loop_over_times_and_call(config, processes)
>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>> 3.1/metplus/util/met_util.py", line 939, in
loop_over_times_and_call
>>>>> process.run_at_time(input_dict)
>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 189, in
>>>>> run_at_time
>>>>> self.run_at_time_once(time_info)
>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 224, in
>>>>> run_at_time_once
>>>>> self.run_at_time_all_fields(time_info)
>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 288, in
>>>>> run_at_time_all_fields
>>>>> return_list=True)
>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>> 3.1/metplus/wrappers/command_builder.py", line 357, in
find_model
>>>>> return_list=return_list)
>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>> 3.1/metplus/wrappers/command_builder.py", line 468, in find_data
>>>>> return self.find_exact_file(**arg_dict, allow_dir=allow_dir)
>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>> 3.1/metplus/wrappers/command_builder.py", line 495, in
find_exact_file
>>>>> **time_info)
>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>> 3.1/metplus/util/config/string_template_substitution.py", line
399, in
>>>>> do_string_sub
>>>>> return find_and_replace_tags_in_template(match_list, tmpl,
kwargs,
>>>>> skip_missing_tags)
>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>> 3.1/metplus/util/config/string_template_substitution.py", line
431, in
>>>>> find_and_replace_tags_in_template
>>>>> " for template: " + tmpl)
>>>>> TypeError: The key valid was not passed to do_string_sub for
>>>>> template:
>>>>>
>>>>>
>>>
>>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/WOFS/pcp_combine/{init?fmt=%Y%m%d?shift=-
>>>>>
>>>>>
>>>
>>
44100}/{init?fmt=%H%M}/ENS_MEM_{custom?fmt=%s}/wofs{custom?fmt=%s}_PCP_{init?fmt=%Y%m%d}_{init?fmt=%H%M}_{valid?fmt=%H%M}_A1.nc
>>>>> 12/14 14:54:11Z run-METplus-metplus.GridStat: ERROR: Fatal
error
>>>>> occurred
>>>>> 12/14 14:54:11.879 metplus.GridStat (met_util.py:216) INFO:
Check the
>>>>> log file for more information:
>>>>>
>>>>>
>>>
>>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/logs/master_metplus.log.20201214145404
>>>>> 12/14 14:54:11.879 metplus (met_util.py:812) INFO:
>>>>>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/metplus_final.conf:
>>>>> write metplus.conf here
>>>>> 12/14 14:54:11.880 metplus (met_util.py:245) ERROR: METplus has
>>>>> finished running but had 1 error.
>>>>> 12/14 14:54:11Z run-METplus-metplus: ERROR: METplus has
finished
>>>>> running but had 1 error.
>>>>>
>>>>> I am not entirely sure if MET 9.x or the latest versions of
METplus
>>>>> have support to do ensemble-based percentile verification so I
decided
>>>>> to try and run through each of the model members via grid_stat
to
>>>>> generate the individual probability fields which I would then
process
>>>>> through ensemble_stat and then finally back through grid_stat to
>>>>> generate the ensemble-based probabilities. Is there a way to
work
>>>>> around this particular issue to be able to process each member
in the
>>>>> “grid_stat_custom_loop_list”?
>>>>>
>>>>> Many thanks!
>>>>>
>>>>> -Brian
>>>>> —————————————————————
>>>>> Brian Matilla
>>>>> Research Associate— Warn-on-Forecast Team
>>>>> Cooperative Institute for Mesoscale Meteorological Studies — The
>>>>> University of Oklahoma
>>>>> NOAA National Severe Storms Laboratory
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>
>>>> --
>>>> George McCabe - Software Engineer III
>>>> National Center for Atmospheric Research
>>>> Research Applications Laboratory
>>>> 303-497-2768
>>>> ---
>>>> My working day may not be your working day. Please do not feel
obliged
>> to
>>>> reply to this email outside of your normal working hours.
>>>>
>>>
>>>
>>>
>>
>> --
>> George McCabe - Software Engineer III
>> National Center for Atmospheric Research
>> Research Applications Laboratory
>> 303-497-2768
>> ---
>> My working day may not be your working day. Please do not feel
obliged to
>> reply to this email outside of your normal working hours.
>>
>>
>
------------------------------------------------
Subject: Problems with METplus "grid_stat_custom_loop_list"
From: George McCabe
Time: Mon Dec 21 11:43:06 2020
Hi Brian,
>From your log file, it looks like you are using METplus 3.1, not
3.0.2. I
tried to recreate the bug using 3.0.2 and there were issues due to the
thresholds you used not being supported in 3.0.2. Are you sure the
bugfix
needs to be applied to 3.0.2? Or could it be applied to 3.1 instead.
Thanks,
George
On Mon, Dec 21, 2020 at 11:05 AM Brian Matilla - NOAA Affiliate via RT
<
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97897 >
>
> Hi John,
>
> Thanks for creating this issue. I’ve looked over the description and
that
> is on point with the request. Feel free to let me know if there’s
anything
> you need from me to help with this.
>
> -Brian
>
> > On Dec 21, 2020, at 11:37 AM, John Halley Gotway via RT <
> met_help at ucar.edu> wrote:
> >
> > Brian,
> >
> > I couldn't find an existing MET issue about ensemble-stat
> > computing probabilities based on percentile thresholds. So I just
wrote
> up
> > this issue description:
> > https://github.com/dtcenter/MET/issues/1612
> >
> > Please take a look and let me know if that description is
accurate. I'll
> > need to coordinate with Tara Jensen to figure out priorities,
funding,
> and
> > timeline for this work.
> >
> > Thanks,
> > John
> >
> > On Mon, Dec 21, 2020 at 9:26 AM George McCabe via RT
<met_help at ucar.edu>
> > wrote:
> >
> >>
> >> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97897 >
> >>
> >> Hi Brian,
> >>
> >> Since you have to use MET 9.0.1, I think it would be best if we
issued a
> >> bugfix to METplus 3.0 to keep the versions aligned. The bug
exists in
> the
> >> latest beta release, so upgrading to that would not solve the
problem. I
> >> will let you know when the bugfix release is available. Sorry
about the
> >> inconvenience and thank you for discovering this issue!
> >>
> >> Thanks,
> >> George
> >>
> >> On Mon, Dec 21, 2020 at 9:16 AM Brian Matilla - NOAA Affiliate
via RT <
> >> met_help at ucar.edu> wrote:
> >>
> >>>
> >>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97897 >
> >>>
> >>> Hi George,
> >>>
> >>> Thanks for looking into this. I’m really only tied to the MET
version
> >>> (9.0.1) that our IT staff was able to install on our machines
but I do
> >> have
> >>> a copy of the latest METplus beta version so I can work with
that if
> that
> >>> helps.
> >>>
> >>> Thanks,
> >>>
> >>> -Brian
> >>> —————————————————————
> >>> Brian Matilla
> >>> Research Associate— Warn-on-Forecast Team
> >>> Cooperative Institute for Mesoscale Meteorological Studies — The
> >>> University of Oklahoma
> >>> NOAA National Severe Storms Laboratory
> >>>
> >>>> On Dec 21, 2020, at 10:11 AM, George McCabe via RT
<met_help at ucar.edu
> >
> >>> wrote:
> >>>>
> >>>> Hi Brian,
> >>>>
> >>>> Thank you for sending these files. I was able to recreate the
error
> and
> >>> it
> >>>> looks like there is an odd bug in the code. Valid time should
> >> definitely
> >>> be
> >>>> available to use to find the file you are looking for. I will
look
> into
> >>> it
> >>>> and let you know when I have a fix in place. My question is:
are you
> >> tied
> >>>> to using METplus 3.1 and would require a bugfix release for
that
> >> version
> >>> to
> >>>> continue your work? If you can upgrade to using a beta or
develop
> >> version
> >>>> of METplus, I can issue the fix there instead.
> >>>>
> >>>> Let me know what you think.
> >>>>
> >>>> Thanks,
> >>>> George
> >>>>
> >>>> On Fri, Dec 18, 2020 at 1:21 PM Brian Matilla - NOAA Affiliate
via RT
> <
> >>>> met_help at ucar.edu> wrote:
> >>>>
> >>>>>
> >>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97897
>
> >>>>>
> >>>>> Hi George,
> >>>>>
> >>>>> I have gone ahead and rerun METplus with the log level set to
DEBUG.
> >>>>> Attached is the metplus_final.conf as well as the log file. I
should
> >>> note
> >>>>> here that the input expected into grid_stat is the output file
from
> >>>>> “pcp_combine” so that the percentiles can be calculated.
> >>>>>
> >>>>> Thanks,
> >>>>>
> >>>>> -Brian
> >>>>> —————————————————————
> >>>>> Brian Matilla
> >>>>> Research Associate— Warn-on-Forecast Team
> >>>>> Cooperative Institute for Mesoscale Meteorological Studies —
The
> >>>>> University of Oklahoma
> >>>>> NOAA National Severe Storms Laboratory
> >>>>>
> >>>>>
> >>>>>> On Dec 14, 2020, at 4:46 PM, George McCabe via RT <
> met_help at ucar.edu
> >>>
> >>>>> wrote:
> >>>>>>
> >>>>>> Hi Brian,
> >>>>>>
> >>>>>> I'm not sure why that error is occurring. You should be able
to run
> >> the
> >>>>> way you described. I was not able to replicate the error on my
end.
> >>> Could
> >>>>> you please set LOG_LEVEL=DEBUG, rerun the use case, then send
me the
> >>> full
> >>>>> log file and the metplus_final.conf file?
> >>>>>>
> >>>>>> Thanks,
> >>>>>> George
> >>>>>>
> >>>>>> On Mon Dec 14 14:16:34 2020, brian.matilla at noaa.gov wrote:
> >>>>>>> Hi MET Help Desk,
> >>>>>>>
> >>>>>>> I am trying to run grid_stat over each individual member (18
in
> >> total)
> >>>>>>> in my use case. It will process member 1 with no issues,
however I
> >> do
> >>>>>>> get the following error printout with any succeeding member:
> >>>>>>>
> >>>>>>> 12/14 14:54:05.639 metplus (met_util.py:920) INFO:
> >>>>>>> ****************************************
> >>>>>>> 12/14 14:54:05.640 metplus (met_util.py:921) INFO: * Running
> METplus
> >>>>>>> 12/14 14:54:05.640 metplus (met_util.py:923) INFO: * at
init time:
> >>>>>>> 202006151700
> >>>>>>> 12/14 14:54:05.640 metplus (met_util.py:926) INFO:
> >>>>>>> ****************************************
> >>>>>>> 12/14 14:54:05.640 metplus.GridStat
> (compare_gridded_wrapper.py:176)
> >>>>>>> INFO: Processing forecast lead 1 hour
> >>>>>>> 12/14 14:54:05.640 metplus.GridStat
> (compare_gridded_wrapper.py:184)
> >>>>>>> INFO: Processing custom string: 01
> >>>>>>> 12/14 14:54:05.643 metplus.GridStat (command_runner.py:89)
INFO:
> >>>>>>> COMMAND:
> >> /home/brian.matilla/WoFS_2020/MET_scripts/met9/bin/grid_stat
> >>>>>>> -v 3
> >>>>>>>
> >>>>>
> >>>
> >>
>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/WOFS/pcp_combine/20200615/1700/ENS_MEM_01/wofs01_PCP_20200615_1700_1800_A1.nc
> >>>>>>>
> >>>>>
> >>>
> >>
>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/OBS/pcp_combine/20200615/1700/mrms_PCP_20200615_1700_1800_A1_
> >>>>> wofs.nc
> >>>>>>>
> >>>>>
> >>>
> >>
>
/home/brian.matilla/WoFS_2020/MET_scripts/MET_configs/GridStatConfig_WOFS_PCP_1H
> >>>>>>> -outdir
> >>>>>>>
> >>>>>
> >>>
> >>
>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/WOFS/grid_stat/20200615/1700/
> >>>>>>> 12/14 14:54:11.874 metplus.GridStat
> (compare_gridded_wrapper.py:184)
> >>>>>>> INFO: Processing custom string: 02
> >>>>>>> 12/14 14:54:11.876 metplus.GridStat (met_util.py:215) ERROR:
Fatal
> >>>>>>> error occurred
> >>>>>>> Traceback (most recent call last):
> >>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >>>>>>> 3.1/metplus/util/met_util.py", line 195, in run_metplus
> >>>>>>> loop_over_times_and_call(config, processes)
> >>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >>>>>>> 3.1/metplus/util/met_util.py", line 939, in
> loop_over_times_and_call
> >>>>>>> process.run_at_time(input_dict)
> >>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >>>>>>> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 189,
in
> >>>>>>> run_at_time
> >>>>>>> self.run_at_time_once(time_info)
> >>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >>>>>>> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 224,
in
> >>>>>>> run_at_time_once
> >>>>>>> self.run_at_time_all_fields(time_info)
> >>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >>>>>>> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 288,
in
> >>>>>>> run_at_time_all_fields
> >>>>>>> return_list=True)
> >>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >>>>>>> 3.1/metplus/wrappers/command_builder.py", line 357, in
find_model
> >>>>>>> return_list=return_list)
> >>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >>>>>>> 3.1/metplus/wrappers/command_builder.py", line 468, in
find_data
> >>>>>>> return self.find_exact_file(**arg_dict,
allow_dir=allow_dir)
> >>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >>>>>>> 3.1/metplus/wrappers/command_builder.py", line 495, in
> >> find_exact_file
> >>>>>>> **time_info)
> >>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >>>>>>> 3.1/metplus/util/config/string_template_substitution.py",
line 399,
> >> in
> >>>>>>> do_string_sub
> >>>>>>> return find_and_replace_tags_in_template(match_list, tmpl,
kwargs,
> >>>>>>> skip_missing_tags)
> >>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >>>>>>> 3.1/metplus/util/config/string_template_substitution.py",
line 431,
> >> in
> >>>>>>> find_and_replace_tags_in_template
> >>>>>>> " for template: " + tmpl)
> >>>>>>> TypeError: The key valid was not passed to do_string_sub
for
> >>>>>>> template:
> >>>>>>>
> >>>>>
> >>>
> >>
>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/WOFS/pcp_combine/{init?fmt=%Y%m%d?shift=-
> >>>>>>>
> >>>>>
> >>>
> >>
>
44100}/{init?fmt=%H%M}/ENS_MEM_{custom?fmt=%s}/wofs{custom?fmt=%s}_PCP_{init?fmt=%Y%m%d}_{init?fmt=%H%M}_{valid?fmt=%H%M}_A1.nc
> >>>>>>> 12/14 14:54:11Z run-METplus-metplus.GridStat: ERROR: Fatal
error
> >>>>>>> occurred
> >>>>>>> 12/14 14:54:11.879 metplus.GridStat (met_util.py:216) INFO:
Check
> >> the
> >>>>>>> log file for more information:
> >>>>>>>
> >>>>>
> >>>
> >>
>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/logs/master_metplus.log.20201214145404
> >>>>>>> 12/14 14:54:11.879 metplus (met_util.py:812) INFO:
> >>>>>>>
> /work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/metplus_final.conf:
> >>>>>>> write metplus.conf here
> >>>>>>> 12/14 14:54:11.880 metplus (met_util.py:245) ERROR: METplus
has
> >>>>>>> finished running but had 1 error.
> >>>>>>> 12/14 14:54:11Z run-METplus-metplus: ERROR: METplus has
finished
> >>>>>>> running but had 1 error.
> >>>>>>>
> >>>>>>> I am not entirely sure if MET 9.x or the latest versions of
METplus
> >>>>>>> have support to do ensemble-based percentile verification so
I
> >> decided
> >>>>>>> to try and run through each of the model members via
grid_stat to
> >>>>>>> generate the individual probability fields which I would
then
> >> process
> >>>>>>> through ensemble_stat and then finally back through
grid_stat to
> >>>>>>> generate the ensemble-based probabilities. Is there a way to
work
> >>>>>>> around this particular issue to be able to process each
member in
> >> the
> >>>>>>> “grid_stat_custom_loop_list”?
> >>>>>>>
> >>>>>>> Many thanks!
> >>>>>>>
> >>>>>>> -Brian
> >>>>>>> —————————————————————
> >>>>>>> Brian Matilla
> >>>>>>> Research Associate— Warn-on-Forecast Team
> >>>>>>> Cooperative Institute for Mesoscale Meteorological Studies —
The
> >>>>>>> University of Oklahoma
> >>>>>>> NOAA National Severe Storms Laboratory
> >>>>>>
> >>>>>>
> >>>>>>
> >>>>>
> >>>>>
> >>>>> Hi George,
> >>>>>
> >>>>> I have gone ahead and rerun METplus with the log level set to
DEBUG.
> >>>>> Attached is the metplus_final.conf as well as the log file. I
should
> >>> note
> >>>>> here that the input expected into grid_stat is the output file
from
> >>>>> “pcp_combine” so that the percentiles can be calculated.
> >>>>>
> >>>>> Thanks,
> >>>>>
> >>>>> -Brian
> >>>>> —————————————————————
> >>>>> Brian Matilla
> >>>>> Research Associate— Warn-on-Forecast Team
> >>>>> Cooperative Institute for Mesoscale Meteorological Studies —
The
> >>>>> University of Oklahoma
> >>>>> NOAA National Severe Storms Laboratory
> >>>>>
> >>>>>
> >>>>> On Dec 14, 2020, at 4:46 PM, George McCabe via RT
<met_help at ucar.edu
> >
> >>>>> wrote:
> >>>>>
> >>>>> Hi Brian,
> >>>>>
> >>>>> I'm not sure why that error is occurring. You should be able
to run
> >> the
> >>>>> way you described. I was not able to replicate the error on my
end.
> >>> Could
> >>>>> you please set LOG_LEVEL=DEBUG, rerun the use case, then send
me the
> >>> full
> >>>>> log file and the metplus_final.conf file?
> >>>>>
> >>>>> Thanks,
> >>>>> George
> >>>>>
> >>>>> On Mon Dec 14 14:16:34 2020, brian.matilla at noaa.gov wrote:
> >>>>>
> >>>>> Hi MET Help Desk,
> >>>>>
> >>>>> I am trying to run grid_stat over each individual member (18
in
> total)
> >>>>> in my use case. It will process member 1 with no issues,
however I do
> >>>>> get the following error printout with any succeeding member:
> >>>>>
> >>>>> 12/14 14:54:05.639 metplus (met_util.py:920) INFO:
> >>>>> ****************************************
> >>>>> 12/14 14:54:05.640 metplus (met_util.py:921) INFO: * Running
METplus
> >>>>> 12/14 14:54:05.640 metplus (met_util.py:923) INFO: * at init
time:
> >>>>> 202006151700
> >>>>> 12/14 14:54:05.640 metplus (met_util.py:926) INFO:
> >>>>> ****************************************
> >>>>> 12/14 14:54:05.640 metplus.GridStat
(compare_gridded_wrapper.py:176)
> >>>>> INFO: Processing forecast lead 1 hour
> >>>>> 12/14 14:54:05.640 metplus.GridStat
(compare_gridded_wrapper.py:184)
> >>>>> INFO: Processing custom string: 01
> >>>>> 12/14 14:54:05.643 metplus.GridStat (command_runner.py:89)
INFO:
> >>>>> COMMAND:
/home/brian.matilla/WoFS_2020/MET_scripts/met9/bin/grid_stat
> >>>>> -v 3
> >>>>>
> >>>>>
> >>>
> >>
>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/WOFS/pcp_combine/20200615/1700/ENS_MEM_01/wofs01_PCP_20200615_1700_1800_A1.nc
> >>>>>
> >>>>>
> >>>
> >>
>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/OBS/pcp_combine/20200615/1700/mrms_PCP_20200615_1700_1800_A1_
> >>> wofs.nc
> >>>>>
> >>>>>
> >>>
> >>
>
/home/brian.matilla/WoFS_2020/MET_scripts/MET_configs/GridStatConfig_WOFS_PCP_1H
> >>>>> -outdir
> >>>>>
> >>>>>
> >>>
> >>
>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/WOFS/grid_stat/20200615/1700/
> >>>>> 12/14 14:54:11.874 metplus.GridStat
(compare_gridded_wrapper.py:184)
> >>>>> INFO: Processing custom string: 02
> >>>>> 12/14 14:54:11.876 metplus.GridStat (met_util.py:215) ERROR:
Fatal
> >>>>> error occurred
> >>>>> Traceback (most recent call last):
> >>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >>>>> 3.1/metplus/util/met_util.py", line 195, in run_metplus
> >>>>> loop_over_times_and_call(config, processes)
> >>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >>>>> 3.1/metplus/util/met_util.py", line 939, in
loop_over_times_and_call
> >>>>> process.run_at_time(input_dict)
> >>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >>>>> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 189, in
> >>>>> run_at_time
> >>>>> self.run_at_time_once(time_info)
> >>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >>>>> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 224, in
> >>>>> run_at_time_once
> >>>>> self.run_at_time_all_fields(time_info)
> >>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >>>>> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 288, in
> >>>>> run_at_time_all_fields
> >>>>> return_list=True)
> >>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >>>>> 3.1/metplus/wrappers/command_builder.py", line 357, in
find_model
> >>>>> return_list=return_list)
> >>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >>>>> 3.1/metplus/wrappers/command_builder.py", line 468, in
find_data
> >>>>> return self.find_exact_file(**arg_dict, allow_dir=allow_dir)
> >>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >>>>> 3.1/metplus/wrappers/command_builder.py", line 495, in
> find_exact_file
> >>>>> **time_info)
> >>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >>>>> 3.1/metplus/util/config/string_template_substitution.py", line
399,
> in
> >>>>> do_string_sub
> >>>>> return find_and_replace_tags_in_template(match_list, tmpl,
kwargs,
> >>>>> skip_missing_tags)
> >>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >>>>> 3.1/metplus/util/config/string_template_substitution.py", line
431,
> in
> >>>>> find_and_replace_tags_in_template
> >>>>> " for template: " + tmpl)
> >>>>> TypeError: The key valid was not passed to do_string_sub for
> >>>>> template:
> >>>>>
> >>>>>
> >>>
> >>
>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/WOFS/pcp_combine/{init?fmt=%Y%m%d?shift=-
> >>>>>
> >>>>>
> >>>
> >>
>
44100}/{init?fmt=%H%M}/ENS_MEM_{custom?fmt=%s}/wofs{custom?fmt=%s}_PCP_{init?fmt=%Y%m%d}_{init?fmt=%H%M}_{valid?fmt=%H%M}_A1.nc
> >>>>> 12/14 14:54:11Z run-METplus-metplus.GridStat: ERROR: Fatal
error
> >>>>> occurred
> >>>>> 12/14 14:54:11.879 metplus.GridStat (met_util.py:216) INFO:
Check the
> >>>>> log file for more information:
> >>>>>
> >>>>>
> >>>
> >>
>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/logs/master_metplus.log.20201214145404
> >>>>> 12/14 14:54:11.879 metplus (met_util.py:812) INFO:
> >>>>>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/metplus_final.conf:
> >>>>> write metplus.conf here
> >>>>> 12/14 14:54:11.880 metplus (met_util.py:245) ERROR: METplus
has
> >>>>> finished running but had 1 error.
> >>>>> 12/14 14:54:11Z run-METplus-metplus: ERROR: METplus has
finished
> >>>>> running but had 1 error.
> >>>>>
> >>>>> I am not entirely sure if MET 9.x or the latest versions of
METplus
> >>>>> have support to do ensemble-based percentile verification so I
> decided
> >>>>> to try and run through each of the model members via grid_stat
to
> >>>>> generate the individual probability fields which I would then
process
> >>>>> through ensemble_stat and then finally back through grid_stat
to
> >>>>> generate the ensemble-based probabilities. Is there a way to
work
> >>>>> around this particular issue to be able to process each member
in the
> >>>>> “grid_stat_custom_loop_list”?
> >>>>>
> >>>>> Many thanks!
> >>>>>
> >>>>> -Brian
> >>>>> —————————————————————
> >>>>> Brian Matilla
> >>>>> Research Associate— Warn-on-Forecast Team
> >>>>> Cooperative Institute for Mesoscale Meteorological Studies —
The
> >>>>> University of Oklahoma
> >>>>> NOAA National Severe Storms Laboratory
> >>>>>
> >>>>>
> >>>>>
> >>>>>
> >>>>>
> >>>>>
> >>>>
> >>>> --
> >>>> George McCabe - Software Engineer III
> >>>> National Center for Atmospheric Research
> >>>> Research Applications Laboratory
> >>>> 303-497-2768
> >>>> ---
> >>>> My working day may not be your working day. Please do not feel
obliged
> >> to
> >>>> reply to this email outside of your normal working hours.
> >>>>
> >>>
> >>>
> >>>
> >>
> >> --
> >> George McCabe - Software Engineer III
> >> National Center for Atmospheric Research
> >> Research Applications Laboratory
> >> 303-497-2768
> >> ---
> >> My working day may not be your working day. Please do not feel
obliged
> to
> >> reply to this email outside of your normal working hours.
> >>
> >>
> >
>
>
>
--
George McCabe - Software Engineer III
National Center for Atmospheric Research
Research Applications Laboratory
303-497-2768
---
My working day may not be your working day. Please do not feel obliged
to
reply to this email outside of your normal working hours.
------------------------------------------------
Subject: Problems with METplus "grid_stat_custom_loop_list"
From: Brian Matilla - NOAA Affiliate
Time: Mon Dec 21 13:10:30 2020
Hi George,
The bug fix can be applied to 3.1. I am using 3.1 for a retrospective
analysis since it did incorporate new fixes from the time we completed
our realtime cases including the thresholds specified in the log file.
Sorry for any confusion on this.
-Brian
> On Dec 21, 2020, at 12:43 PM, George McCabe via RT
<met_help at ucar.edu> wrote:
>
> Hi Brian,
>
> From your log file, it looks like you are using METplus 3.1, not
3.0.2. I
> tried to recreate the bug using 3.0.2 and there were issues due to
the
> thresholds you used not being supported in 3.0.2. Are you sure the
bugfix
> needs to be applied to 3.0.2? Or could it be applied to 3.1 instead.
>
> Thanks,
> George
>
> On Mon, Dec 21, 2020 at 11:05 AM Brian Matilla - NOAA Affiliate via
RT <
> met_help at ucar.edu> wrote:
>
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97897 >
>>
>> Hi John,
>>
>> Thanks for creating this issue. I’ve looked over the description
and that
>> is on point with the request. Feel free to let me know if there’s
anything
>> you need from me to help with this.
>>
>> -Brian
>>
>>> On Dec 21, 2020, at 11:37 AM, John Halley Gotway via RT <
>> met_help at ucar.edu> wrote:
>>>
>>> Brian,
>>>
>>> I couldn't find an existing MET issue about ensemble-stat
>>> computing probabilities based on percentile thresholds. So I just
wrote
>> up
>>> this issue description:
>>> https://github.com/dtcenter/MET/issues/1612
>>>
>>> Please take a look and let me know if that description is
accurate. I'll
>>> need to coordinate with Tara Jensen to figure out priorities,
funding,
>> and
>>> timeline for this work.
>>>
>>> Thanks,
>>> John
>>>
>>> On Mon, Dec 21, 2020 at 9:26 AM George McCabe via RT
<met_help at ucar.edu>
>>> wrote:
>>>
>>>>
>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97897 >
>>>>
>>>> Hi Brian,
>>>>
>>>> Since you have to use MET 9.0.1, I think it would be best if we
issued a
>>>> bugfix to METplus 3.0 to keep the versions aligned. The bug
exists in
>> the
>>>> latest beta release, so upgrading to that would not solve the
problem. I
>>>> will let you know when the bugfix release is available. Sorry
about the
>>>> inconvenience and thank you for discovering this issue!
>>>>
>>>> Thanks,
>>>> George
>>>>
>>>> On Mon, Dec 21, 2020 at 9:16 AM Brian Matilla - NOAA Affiliate
via RT <
>>>> met_help at ucar.edu> wrote:
>>>>
>>>>>
>>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97897 >
>>>>>
>>>>> Hi George,
>>>>>
>>>>> Thanks for looking into this. I’m really only tied to the MET
version
>>>>> (9.0.1) that our IT staff was able to install on our machines
but I do
>>>> have
>>>>> a copy of the latest METplus beta version so I can work with
that if
>> that
>>>>> helps.
>>>>>
>>>>> Thanks,
>>>>>
>>>>> -Brian
>>>>> —————————————————————
>>>>> Brian Matilla
>>>>> Research Associate— Warn-on-Forecast Team
>>>>> Cooperative Institute for Mesoscale Meteorological Studies — The
>>>>> University of Oklahoma
>>>>> NOAA National Severe Storms Laboratory
>>>>>
>>>>>> On Dec 21, 2020, at 10:11 AM, George McCabe via RT
<met_help at ucar.edu
>>>
>>>>> wrote:
>>>>>>
>>>>>> Hi Brian,
>>>>>>
>>>>>> Thank you for sending these files. I was able to recreate the
error
>> and
>>>>> it
>>>>>> looks like there is an odd bug in the code. Valid time should
>>>> definitely
>>>>> be
>>>>>> available to use to find the file you are looking for. I will
look
>> into
>>>>> it
>>>>>> and let you know when I have a fix in place. My question is:
are you
>>>> tied
>>>>>> to using METplus 3.1 and would require a bugfix release for
that
>>>> version
>>>>> to
>>>>>> continue your work? If you can upgrade to using a beta or
develop
>>>> version
>>>>>> of METplus, I can issue the fix there instead.
>>>>>>
>>>>>> Let me know what you think.
>>>>>>
>>>>>> Thanks,
>>>>>> George
>>>>>>
>>>>>> On Fri, Dec 18, 2020 at 1:21 PM Brian Matilla - NOAA Affiliate
via RT
>> <
>>>>>> met_help at ucar.edu> wrote:
>>>>>>
>>>>>>>
>>>>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97897
>
>>>>>>>
>>>>>>> Hi George,
>>>>>>>
>>>>>>> I have gone ahead and rerun METplus with the log level set to
DEBUG.
>>>>>>> Attached is the metplus_final.conf as well as the log file. I
should
>>>>> note
>>>>>>> here that the input expected into grid_stat is the output file
from
>>>>>>> “pcp_combine” so that the percentiles can be calculated.
>>>>>>>
>>>>>>> Thanks,
>>>>>>>
>>>>>>> -Brian
>>>>>>> —————————————————————
>>>>>>> Brian Matilla
>>>>>>> Research Associate— Warn-on-Forecast Team
>>>>>>> Cooperative Institute for Mesoscale Meteorological Studies —
The
>>>>>>> University of Oklahoma
>>>>>>> NOAA National Severe Storms Laboratory
>>>>>>>
>>>>>>>
>>>>>>>> On Dec 14, 2020, at 4:46 PM, George McCabe via RT <
>> met_help at ucar.edu
>>>>>
>>>>>>> wrote:
>>>>>>>>
>>>>>>>> Hi Brian,
>>>>>>>>
>>>>>>>> I'm not sure why that error is occurring. You should be able
to run
>>>> the
>>>>>>> way you described. I was not able to replicate the error on my
end.
>>>>> Could
>>>>>>> you please set LOG_LEVEL=DEBUG, rerun the use case, then send
me the
>>>>> full
>>>>>>> log file and the metplus_final.conf file?
>>>>>>>>
>>>>>>>> Thanks,
>>>>>>>> George
>>>>>>>>
>>>>>>>> On Mon Dec 14 14:16:34 2020, brian.matilla at noaa.gov wrote:
>>>>>>>>> Hi MET Help Desk,
>>>>>>>>>
>>>>>>>>> I am trying to run grid_stat over each individual member (18
in
>>>> total)
>>>>>>>>> in my use case. It will process member 1 with no issues,
however I
>>>> do
>>>>>>>>> get the following error printout with any succeeding member:
>>>>>>>>>
>>>>>>>>> 12/14 14:54:05.639 metplus (met_util.py:920) INFO:
>>>>>>>>> ****************************************
>>>>>>>>> 12/14 14:54:05.640 metplus (met_util.py:921) INFO: * Running
>> METplus
>>>>>>>>> 12/14 14:54:05.640 metplus (met_util.py:923) INFO: * at
init time:
>>>>>>>>> 202006151700
>>>>>>>>> 12/14 14:54:05.640 metplus (met_util.py:926) INFO:
>>>>>>>>> ****************************************
>>>>>>>>> 12/14 14:54:05.640 metplus.GridStat
>> (compare_gridded_wrapper.py:176)
>>>>>>>>> INFO: Processing forecast lead 1 hour
>>>>>>>>> 12/14 14:54:05.640 metplus.GridStat
>> (compare_gridded_wrapper.py:184)
>>>>>>>>> INFO: Processing custom string: 01
>>>>>>>>> 12/14 14:54:05.643 metplus.GridStat (command_runner.py:89)
INFO:
>>>>>>>>> COMMAND:
>>>> /home/brian.matilla/WoFS_2020/MET_scripts/met9/bin/grid_stat
>>>>>>>>> -v 3
>>>>>>>>>
>>>>>>>
>>>>>
>>>>
>>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/WOFS/pcp_combine/20200615/1700/ENS_MEM_01/wofs01_PCP_20200615_1700_1800_A1.nc
>>>>>>>>>
>>>>>>>
>>>>>
>>>>
>>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/OBS/pcp_combine/20200615/1700/mrms_PCP_20200615_1700_1800_A1_
>>>>>>> wofs.nc
>>>>>>>>>
>>>>>>>
>>>>>
>>>>
>>
/home/brian.matilla/WoFS_2020/MET_scripts/MET_configs/GridStatConfig_WOFS_PCP_1H
>>>>>>>>> -outdir
>>>>>>>>>
>>>>>>>
>>>>>
>>>>
>>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/WOFS/grid_stat/20200615/1700/
>>>>>>>>> 12/14 14:54:11.874 metplus.GridStat
>> (compare_gridded_wrapper.py:184)
>>>>>>>>> INFO: Processing custom string: 02
>>>>>>>>> 12/14 14:54:11.876 metplus.GridStat (met_util.py:215) ERROR:
Fatal
>>>>>>>>> error occurred
>>>>>>>>> Traceback (most recent call last):
>>>>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>>>>>> 3.1/metplus/util/met_util.py", line 195, in run_metplus
>>>>>>>>> loop_over_times_and_call(config, processes)
>>>>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>>>>>> 3.1/metplus/util/met_util.py", line 939, in
>> loop_over_times_and_call
>>>>>>>>> process.run_at_time(input_dict)
>>>>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>>>>>> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 189,
in
>>>>>>>>> run_at_time
>>>>>>>>> self.run_at_time_once(time_info)
>>>>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>>>>>> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 224,
in
>>>>>>>>> run_at_time_once
>>>>>>>>> self.run_at_time_all_fields(time_info)
>>>>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>>>>>> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 288,
in
>>>>>>>>> run_at_time_all_fields
>>>>>>>>> return_list=True)
>>>>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>>>>>> 3.1/metplus/wrappers/command_builder.py", line 357, in
find_model
>>>>>>>>> return_list=return_list)
>>>>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>>>>>> 3.1/metplus/wrappers/command_builder.py", line 468, in
find_data
>>>>>>>>> return self.find_exact_file(**arg_dict, allow_dir=allow_dir)
>>>>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>>>>>> 3.1/metplus/wrappers/command_builder.py", line 495, in
>>>> find_exact_file
>>>>>>>>> **time_info)
>>>>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>>>>>> 3.1/metplus/util/config/string_template_substitution.py",
line 399,
>>>> in
>>>>>>>>> do_string_sub
>>>>>>>>> return find_and_replace_tags_in_template(match_list, tmpl,
kwargs,
>>>>>>>>> skip_missing_tags)
>>>>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>>>>>> 3.1/metplus/util/config/string_template_substitution.py",
line 431,
>>>> in
>>>>>>>>> find_and_replace_tags_in_template
>>>>>>>>> " for template: " + tmpl)
>>>>>>>>> TypeError: The key valid was not passed to do_string_sub
for
>>>>>>>>> template:
>>>>>>>>>
>>>>>>>
>>>>>
>>>>
>>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/WOFS/pcp_combine/{init?fmt=%Y%m%d?shift=-
>>>>>>>>>
>>>>>>>
>>>>>
>>>>
>>
44100}/{init?fmt=%H%M}/ENS_MEM_{custom?fmt=%s}/wofs{custom?fmt=%s}_PCP_{init?fmt=%Y%m%d}_{init?fmt=%H%M}_{valid?fmt=%H%M}_A1.nc
>>>>>>>>> 12/14 14:54:11Z run-METplus-metplus.GridStat: ERROR: Fatal
error
>>>>>>>>> occurred
>>>>>>>>> 12/14 14:54:11.879 metplus.GridStat (met_util.py:216) INFO:
Check
>>>> the
>>>>>>>>> log file for more information:
>>>>>>>>>
>>>>>>>
>>>>>
>>>>
>>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/logs/master_metplus.log.20201214145404
>>>>>>>>> 12/14 14:54:11.879 metplus (met_util.py:812) INFO:
>>>>>>>>>
>>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/metplus_final.conf:
>>>>>>>>> write metplus.conf here
>>>>>>>>> 12/14 14:54:11.880 metplus (met_util.py:245) ERROR: METplus
has
>>>>>>>>> finished running but had 1 error.
>>>>>>>>> 12/14 14:54:11Z run-METplus-metplus: ERROR: METplus has
finished
>>>>>>>>> running but had 1 error.
>>>>>>>>>
>>>>>>>>> I am not entirely sure if MET 9.x or the latest versions of
METplus
>>>>>>>>> have support to do ensemble-based percentile verification so
I
>>>> decided
>>>>>>>>> to try and run through each of the model members via
grid_stat to
>>>>>>>>> generate the individual probability fields which I would
then
>>>> process
>>>>>>>>> through ensemble_stat and then finally back through
grid_stat to
>>>>>>>>> generate the ensemble-based probabilities. Is there a way to
work
>>>>>>>>> around this particular issue to be able to process each
member in
>>>> the
>>>>>>>>> “grid_stat_custom_loop_list”?
>>>>>>>>>
>>>>>>>>> Many thanks!
>>>>>>>>>
>>>>>>>>> -Brian
>>>>>>>>> —————————————————————
>>>>>>>>> Brian Matilla
>>>>>>>>> Research Associate— Warn-on-Forecast Team
>>>>>>>>> Cooperative Institute for Mesoscale Meteorological Studies —
The
>>>>>>>>> University of Oklahoma
>>>>>>>>> NOAA National Severe Storms Laboratory
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> Hi George,
>>>>>>>
>>>>>>> I have gone ahead and rerun METplus with the log level set to
DEBUG.
>>>>>>> Attached is the metplus_final.conf as well as the log file. I
should
>>>>> note
>>>>>>> here that the input expected into grid_stat is the output file
from
>>>>>>> “pcp_combine” so that the percentiles can be calculated.
>>>>>>>
>>>>>>> Thanks,
>>>>>>>
>>>>>>> -Brian
>>>>>>> —————————————————————
>>>>>>> Brian Matilla
>>>>>>> Research Associate— Warn-on-Forecast Team
>>>>>>> Cooperative Institute for Mesoscale Meteorological Studies —
The
>>>>>>> University of Oklahoma
>>>>>>> NOAA National Severe Storms Laboratory
>>>>>>>
>>>>>>>
>>>>>>> On Dec 14, 2020, at 4:46 PM, George McCabe via RT
<met_help at ucar.edu
>>>
>>>>>>> wrote:
>>>>>>>
>>>>>>> Hi Brian,
>>>>>>>
>>>>>>> I'm not sure why that error is occurring. You should be able
to run
>>>> the
>>>>>>> way you described. I was not able to replicate the error on my
end.
>>>>> Could
>>>>>>> you please set LOG_LEVEL=DEBUG, rerun the use case, then send
me the
>>>>> full
>>>>>>> log file and the metplus_final.conf file?
>>>>>>>
>>>>>>> Thanks,
>>>>>>> George
>>>>>>>
>>>>>>> On Mon Dec 14 14:16:34 2020, brian.matilla at noaa.gov wrote:
>>>>>>>
>>>>>>> Hi MET Help Desk,
>>>>>>>
>>>>>>> I am trying to run grid_stat over each individual member (18
in
>> total)
>>>>>>> in my use case. It will process member 1 with no issues,
however I do
>>>>>>> get the following error printout with any succeeding member:
>>>>>>>
>>>>>>> 12/14 14:54:05.639 metplus (met_util.py:920) INFO:
>>>>>>> ****************************************
>>>>>>> 12/14 14:54:05.640 metplus (met_util.py:921) INFO: * Running
METplus
>>>>>>> 12/14 14:54:05.640 metplus (met_util.py:923) INFO: * at init
time:
>>>>>>> 202006151700
>>>>>>> 12/14 14:54:05.640 metplus (met_util.py:926) INFO:
>>>>>>> ****************************************
>>>>>>> 12/14 14:54:05.640 metplus.GridStat
(compare_gridded_wrapper.py:176)
>>>>>>> INFO: Processing forecast lead 1 hour
>>>>>>> 12/14 14:54:05.640 metplus.GridStat
(compare_gridded_wrapper.py:184)
>>>>>>> INFO: Processing custom string: 01
>>>>>>> 12/14 14:54:05.643 metplus.GridStat (command_runner.py:89)
INFO:
>>>>>>> COMMAND:
/home/brian.matilla/WoFS_2020/MET_scripts/met9/bin/grid_stat
>>>>>>> -v 3
>>>>>>>
>>>>>>>
>>>>>
>>>>
>>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/WOFS/pcp_combine/20200615/1700/ENS_MEM_01/wofs01_PCP_20200615_1700_1800_A1.nc
>>>>>>>
>>>>>>>
>>>>>
>>>>
>>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/OBS/pcp_combine/20200615/1700/mrms_PCP_20200615_1700_1800_A1_
>>>>> wofs.nc
>>>>>>>
>>>>>>>
>>>>>
>>>>
>>
/home/brian.matilla/WoFS_2020/MET_scripts/MET_configs/GridStatConfig_WOFS_PCP_1H
>>>>>>> -outdir
>>>>>>>
>>>>>>>
>>>>>
>>>>
>>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/WOFS/grid_stat/20200615/1700/
>>>>>>> 12/14 14:54:11.874 metplus.GridStat
(compare_gridded_wrapper.py:184)
>>>>>>> INFO: Processing custom string: 02
>>>>>>> 12/14 14:54:11.876 metplus.GridStat (met_util.py:215) ERROR:
Fatal
>>>>>>> error occurred
>>>>>>> Traceback (most recent call last):
>>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>>>> 3.1/metplus/util/met_util.py", line 195, in run_metplus
>>>>>>> loop_over_times_and_call(config, processes)
>>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>>>> 3.1/metplus/util/met_util.py", line 939, in
loop_over_times_and_call
>>>>>>> process.run_at_time(input_dict)
>>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>>>> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 189, in
>>>>>>> run_at_time
>>>>>>> self.run_at_time_once(time_info)
>>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>>>> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 224, in
>>>>>>> run_at_time_once
>>>>>>> self.run_at_time_all_fields(time_info)
>>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>>>> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 288, in
>>>>>>> run_at_time_all_fields
>>>>>>> return_list=True)
>>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>>>> 3.1/metplus/wrappers/command_builder.py", line 357, in
find_model
>>>>>>> return_list=return_list)
>>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>>>> 3.1/metplus/wrappers/command_builder.py", line 468, in
find_data
>>>>>>> return self.find_exact_file(**arg_dict, allow_dir=allow_dir)
>>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>>>> 3.1/metplus/wrappers/command_builder.py", line 495, in
>> find_exact_file
>>>>>>> **time_info)
>>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>>>> 3.1/metplus/util/config/string_template_substitution.py", line
399,
>> in
>>>>>>> do_string_sub
>>>>>>> return find_and_replace_tags_in_template(match_list, tmpl,
kwargs,
>>>>>>> skip_missing_tags)
>>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
>>>>>>> 3.1/metplus/util/config/string_template_substitution.py", line
431,
>> in
>>>>>>> find_and_replace_tags_in_template
>>>>>>> " for template: " + tmpl)
>>>>>>> TypeError: The key valid was not passed to do_string_sub for
>>>>>>> template:
>>>>>>>
>>>>>>>
>>>>>
>>>>
>>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/WOFS/pcp_combine/{init?fmt=%Y%m%d?shift=-
>>>>>>>
>>>>>>>
>>>>>
>>>>
>>
44100}/{init?fmt=%H%M}/ENS_MEM_{custom?fmt=%s}/wofs{custom?fmt=%s}_PCP_{init?fmt=%Y%m%d}_{init?fmt=%H%M}_{valid?fmt=%H%M}_A1.nc
>>>>>>> 12/14 14:54:11Z run-METplus-metplus.GridStat: ERROR: Fatal
error
>>>>>>> occurred
>>>>>>> 12/14 14:54:11.879 metplus.GridStat (met_util.py:216) INFO:
Check the
>>>>>>> log file for more information:
>>>>>>>
>>>>>>>
>>>>>
>>>>
>>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/logs/master_metplus.log.20201214145404
>>>>>>> 12/14 14:54:11.879 metplus (met_util.py:812) INFO:
>>>>>>>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/metplus_final.conf:
>>>>>>> write metplus.conf here
>>>>>>> 12/14 14:54:11.880 metplus (met_util.py:245) ERROR: METplus
has
>>>>>>> finished running but had 1 error.
>>>>>>> 12/14 14:54:11Z run-METplus-metplus: ERROR: METplus has
finished
>>>>>>> running but had 1 error.
>>>>>>>
>>>>>>> I am not entirely sure if MET 9.x or the latest versions of
METplus
>>>>>>> have support to do ensemble-based percentile verification so I
>> decided
>>>>>>> to try and run through each of the model members via grid_stat
to
>>>>>>> generate the individual probability fields which I would then
process
>>>>>>> through ensemble_stat and then finally back through grid_stat
to
>>>>>>> generate the ensemble-based probabilities. Is there a way to
work
>>>>>>> around this particular issue to be able to process each member
in the
>>>>>>> “grid_stat_custom_loop_list”?
>>>>>>>
>>>>>>> Many thanks!
>>>>>>>
>>>>>>> -Brian
>>>>>>> —————————————————————
>>>>>>> Brian Matilla
>>>>>>> Research Associate— Warn-on-Forecast Team
>>>>>>> Cooperative Institute for Mesoscale Meteorological Studies —
The
>>>>>>> University of Oklahoma
>>>>>>> NOAA National Severe Storms Laboratory
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>
>>>>>> --
>>>>>> George McCabe - Software Engineer III
>>>>>> National Center for Atmospheric Research
>>>>>> Research Applications Laboratory
>>>>>> 303-497-2768
>>>>>> ---
>>>>>> My working day may not be your working day. Please do not feel
obliged
>>>> to
>>>>>> reply to this email outside of your normal working hours.
>>>>>>
>>>>>
>>>>>
>>>>>
>>>>
>>>> --
>>>> George McCabe - Software Engineer III
>>>> National Center for Atmospheric Research
>>>> Research Applications Laboratory
>>>> 303-497-2768
>>>> ---
>>>> My working day may not be your working day. Please do not feel
obliged
>> to
>>>> reply to this email outside of your normal working hours.
>>>>
>>>>
>>>
>>
>>
>>
>
> --
> George McCabe - Software Engineer III
> National Center for Atmospheric Research
> Research Applications Laboratory
> 303-497-2768
> ---
> My working day may not be your working day. Please do not feel
obliged to
> reply to this email outside of your normal working hours.
>
------------------------------------------------
Subject: Problems with METplus "grid_stat_custom_loop_list"
From: George McCabe
Time: Tue Dec 22 12:35:27 2020
Hi Brian,
The METplus 3.1.1 bugfix release is now available here:
https://github.com/dtcenter/METplus/releases/tag/v3.1.1
I know that Mallory Row also needs a fix from this release so that NCO
could install it. I'm not sure if you have access to that version but
it will eventually be there. I'm not sure of the timeline. In the
meantime you can obtain the release yourself and start using it.
Let me know if you have any questions or run into any other issues.
Thanks,
George
On Mon Dec 21 13:10:30 2020, brian.matilla at noaa.gov wrote:
> Hi George,
>
> The bug fix can be applied to 3.1. I am using 3.1 for a
retrospective
> analysis since it did incorporate new fixes from the time we
completed
> our realtime cases including the thresholds specified in the log
file.
> Sorry for any confusion on this.
>
> -Brian
> > On Dec 21, 2020, at 12:43 PM, George McCabe via RT
> > <met_help at ucar.edu> wrote:
> >
> > Hi Brian,
> >
> > From your log file, it looks like you are using METplus 3.1, not
> > 3.0.2. I
> > tried to recreate the bug using 3.0.2 and there were issues due to
> > the
> > thresholds you used not being supported in 3.0.2. Are you sure the
> > bugfix
> > needs to be applied to 3.0.2? Or could it be applied to 3.1
instead.
> >
> > Thanks,
> > George
> >
> > On Mon, Dec 21, 2020 at 11:05 AM Brian Matilla - NOAA Affiliate
via
> > RT <
> > met_help at ucar.edu> wrote:
> >
> >>
> >> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97897 >
> >>
> >> Hi John,
> >>
> >> Thanks for creating this issue. I’ve looked over the description
and
> >> that
> >> is on point with the request. Feel free to let me know if there’s
> >> anything
> >> you need from me to help with this.
> >>
> >> -Brian
> >>
> >>> On Dec 21, 2020, at 11:37 AM, John Halley Gotway via RT <
> >> met_help at ucar.edu> wrote:
> >>>
> >>> Brian,
> >>>
> >>> I couldn't find an existing MET issue about ensemble-stat
> >>> computing probabilities based on percentile thresholds. So I
just
> >>> wrote
> >> up
> >>> this issue description:
> >>> https://github.com/dtcenter/MET/issues/1612
> >>>
> >>> Please take a look and let me know if that description is
accurate.
> >>> I'll
> >>> need to coordinate with Tara Jensen to figure out priorities,
> >>> funding,
> >> and
> >>> timeline for this work.
> >>>
> >>> Thanks,
> >>> John
> >>>
> >>> On Mon, Dec 21, 2020 at 9:26 AM George McCabe via RT
> >>> <met_help at ucar.edu>
> >>> wrote:
> >>>
> >>>>
> >>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97897 >
> >>>>
> >>>> Hi Brian,
> >>>>
> >>>> Since you have to use MET 9.0.1, I think it would be best if we
> >>>> issued a
> >>>> bugfix to METplus 3.0 to keep the versions aligned. The bug
exists
> >>>> in
> >> the
> >>>> latest beta release, so upgrading to that would not solve the
> >>>> problem. I
> >>>> will let you know when the bugfix release is available. Sorry
> >>>> about the
> >>>> inconvenience and thank you for discovering this issue!
> >>>>
> >>>> Thanks,
> >>>> George
> >>>>
> >>>> On Mon, Dec 21, 2020 at 9:16 AM Brian Matilla - NOAA Affiliate
via
> >>>> RT <
> >>>> met_help at ucar.edu> wrote:
> >>>>
> >>>>>
> >>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97897
>
> >>>>>
> >>>>> Hi George,
> >>>>>
> >>>>> Thanks for looking into this. I’m really only tied to the MET
> >>>>> version
> >>>>> (9.0.1) that our IT staff was able to install on our machines
but
> >>>>> I do
> >>>> have
> >>>>> a copy of the latest METplus beta version so I can work with
that
> >>>>> if
> >> that
> >>>>> helps.
> >>>>>
> >>>>> Thanks,
> >>>>>
> >>>>> -Brian
> >>>>> —————————————————————
> >>>>> Brian Matilla
> >>>>> Research Associate— Warn-on-Forecast Team
> >>>>> Cooperative Institute for Mesoscale Meteorological Studies —
The
> >>>>> University of Oklahoma
> >>>>> NOAA National Severe Storms Laboratory
> >>>>>
> >>>>>> On Dec 21, 2020, at 10:11 AM, George McCabe via RT
> >>>>>> <met_help at ucar.edu
> >>>
> >>>>> wrote:
> >>>>>>
> >>>>>> Hi Brian,
> >>>>>>
> >>>>>> Thank you for sending these files. I was able to recreate the
> >>>>>> error
> >> and
> >>>>> it
> >>>>>> looks like there is an odd bug in the code. Valid time should
> >>>> definitely
> >>>>> be
> >>>>>> available to use to find the file you are looking for. I will
> >>>>>> look
> >> into
> >>>>> it
> >>>>>> and let you know when I have a fix in place. My question is:
are
> >>>>>> you
> >>>> tied
> >>>>>> to using METplus 3.1 and would require a bugfix release for
that
> >>>> version
> >>>>> to
> >>>>>> continue your work? If you can upgrade to using a beta or
> >>>>>> develop
> >>>> version
> >>>>>> of METplus, I can issue the fix there instead.
> >>>>>>
> >>>>>> Let me know what you think.
> >>>>>>
> >>>>>> Thanks,
> >>>>>> George
> >>>>>>
> >>>>>> On Fri, Dec 18, 2020 at 1:21 PM Brian Matilla - NOAA
Affiliate
> >>>>>> via RT
> >> <
> >>>>>> met_help at ucar.edu> wrote:
> >>>>>>
> >>>>>>>
> >>>>>>> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97897 >
> >>>>>>>
> >>>>>>> Hi George,
> >>>>>>>
> >>>>>>> I have gone ahead and rerun METplus with the log level set
to
> >>>>>>> DEBUG.
> >>>>>>> Attached is the metplus_final.conf as well as the log file.
I
> >>>>>>> should
> >>>>> note
> >>>>>>> here that the input expected into grid_stat is the output
file
> >>>>>>> from
> >>>>>>> “pcp_combine” so that the percentiles can be calculated.
> >>>>>>>
> >>>>>>> Thanks,
> >>>>>>>
> >>>>>>> -Brian
> >>>>>>> —————————————————————
> >>>>>>> Brian Matilla
> >>>>>>> Research Associate— Warn-on-Forecast Team
> >>>>>>> Cooperative Institute for Mesoscale Meteorological Studies —
> >>>>>>> The
> >>>>>>> University of Oklahoma
> >>>>>>> NOAA National Severe Storms Laboratory
> >>>>>>>
> >>>>>>>
> >>>>>>>> On Dec 14, 2020, at 4:46 PM, George McCabe via RT <
> >> met_help at ucar.edu
> >>>>>
> >>>>>>> wrote:
> >>>>>>>>
> >>>>>>>> Hi Brian,
> >>>>>>>>
> >>>>>>>> I'm not sure why that error is occurring. You should be
able
> >>>>>>>> to run
> >>>> the
> >>>>>>> way you described. I was not able to replicate the error on
my
> >>>>>>> end.
> >>>>> Could
> >>>>>>> you please set LOG_LEVEL=DEBUG, rerun the use case, then
send
> >>>>>>> me the
> >>>>> full
> >>>>>>> log file and the metplus_final.conf file?
> >>>>>>>>
> >>>>>>>> Thanks,
> >>>>>>>> George
> >>>>>>>>
> >>>>>>>> On Mon Dec 14 14:16:34 2020, brian.matilla at noaa.gov wrote:
> >>>>>>>>> Hi MET Help Desk,
> >>>>>>>>>
> >>>>>>>>> I am trying to run grid_stat over each individual member
(18
> >>>>>>>>> in
> >>>> total)
> >>>>>>>>> in my use case. It will process member 1 with no issues,
> >>>>>>>>> however I
> >>>> do
> >>>>>>>>> get the following error printout with any succeeding
member:
> >>>>>>>>>
> >>>>>>>>> 12/14 14:54:05.639 metplus (met_util.py:920) INFO:
> >>>>>>>>> ****************************************
> >>>>>>>>> 12/14 14:54:05.640 metplus (met_util.py:921) INFO: *
Running
> >> METplus
> >>>>>>>>> 12/14 14:54:05.640 metplus (met_util.py:923) INFO: * at
init
> >>>>>>>>> time:
> >>>>>>>>> 202006151700
> >>>>>>>>> 12/14 14:54:05.640 metplus (met_util.py:926) INFO:
> >>>>>>>>> ****************************************
> >>>>>>>>> 12/14 14:54:05.640 metplus.GridStat
> >> (compare_gridded_wrapper.py:176)
> >>>>>>>>> INFO: Processing forecast lead 1 hour
> >>>>>>>>> 12/14 14:54:05.640 metplus.GridStat
> >> (compare_gridded_wrapper.py:184)
> >>>>>>>>> INFO: Processing custom string: 01
> >>>>>>>>> 12/14 14:54:05.643 metplus.GridStat (command_runner.py:89)
> >>>>>>>>> INFO:
> >>>>>>>>> COMMAND:
> >>>> /home/brian.matilla/WoFS_2020/MET_scripts/met9/bin/grid_stat
> >>>>>>>>> -v 3
> >>>>>>>>>
> >>>>>>>
> >>>>>
> >>>>
> >>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/WOFS/pcp_combine/20200615/1700/ENS_MEM_01/wofs01_PCP_20200615_1700_1800_A1.nc
> >>>>>>>>>
> >>>>>>>
> >>>>>
> >>>>
> >>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/OBS/pcp_combine/20200615/1700/mrms_PCP_20200615_1700_1800_A1_
> >>>>>>> wofs.nc
> >>>>>>>>>
> >>>>>>>
> >>>>>
> >>>>
> >>
/home/brian.matilla/WoFS_2020/MET_scripts/MET_configs/GridStatConfig_WOFS_PCP_1H
> >>>>>>>>> -outdir
> >>>>>>>>>
> >>>>>>>
> >>>>>
> >>>>
> >>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/WOFS/grid_stat/20200615/1700/
> >>>>>>>>> 12/14 14:54:11.874 metplus.GridStat
> >> (compare_gridded_wrapper.py:184)
> >>>>>>>>> INFO: Processing custom string: 02
> >>>>>>>>> 12/14 14:54:11.876 metplus.GridStat (met_util.py:215)
ERROR:
> >>>>>>>>> Fatal
> >>>>>>>>> error occurred
> >>>>>>>>> Traceback (most recent call last):
> >>>>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >>>>>>>>> 3.1/metplus/util/met_util.py", line 195, in run_metplus
> >>>>>>>>> loop_over_times_and_call(config, processes)
> >>>>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >>>>>>>>> 3.1/metplus/util/met_util.py", line 939, in
> >> loop_over_times_and_call
> >>>>>>>>> process.run_at_time(input_dict)
> >>>>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >>>>>>>>> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line
189,
> >>>>>>>>> in
> >>>>>>>>> run_at_time
> >>>>>>>>> self.run_at_time_once(time_info)
> >>>>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >>>>>>>>> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line
224,
> >>>>>>>>> in
> >>>>>>>>> run_at_time_once
> >>>>>>>>> self.run_at_time_all_fields(time_info)
> >>>>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >>>>>>>>> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line
288,
> >>>>>>>>> in
> >>>>>>>>> run_at_time_all_fields
> >>>>>>>>> return_list=True)
> >>>>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >>>>>>>>> 3.1/metplus/wrappers/command_builder.py", line 357, in
> >>>>>>>>> find_model
> >>>>>>>>> return_list=return_list)
> >>>>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >>>>>>>>> 3.1/metplus/wrappers/command_builder.py", line 468, in
> >>>>>>>>> find_data
> >>>>>>>>> return self.find_exact_file(**arg_dict,
allow_dir=allow_dir)
> >>>>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >>>>>>>>> 3.1/metplus/wrappers/command_builder.py", line 495, in
> >>>> find_exact_file
> >>>>>>>>> **time_info)
> >>>>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >>>>>>>>> 3.1/metplus/util/config/string_template_substitution.py",
> >>>>>>>>> line 399,
> >>>> in
> >>>>>>>>> do_string_sub
> >>>>>>>>> return find_and_replace_tags_in_template(match_list, tmpl,
> >>>>>>>>> kwargs,
> >>>>>>>>> skip_missing_tags)
> >>>>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >>>>>>>>> 3.1/metplus/util/config/string_template_substitution.py",
> >>>>>>>>> line 431,
> >>>> in
> >>>>>>>>> find_and_replace_tags_in_template
> >>>>>>>>> " for template: " + tmpl)
> >>>>>>>>> TypeError: The key valid was not passed to do_string_sub
for
> >>>>>>>>> template:
> >>>>>>>>>
> >>>>>>>
> >>>>>
> >>>>
> >>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/WOFS/pcp_combine/{init?fmt=%Y%m%d?shift=-
> >>>>>>>>>
> >>>>>>>
> >>>>>
> >>>>
> >>
44100}/{init?fmt=%H%M}/ENS_MEM_{custom?fmt=%s}/wofs{custom?fmt=%s}_PCP_{init?fmt=%Y%m%d}_{init?fmt=%H%M}_{valid?fmt=%H%M}_A1.nc
> >>>>>>>>> 12/14 14:54:11Z run-METplus-metplus.GridStat: ERROR:
Fatal
> >>>>>>>>> error
> >>>>>>>>> occurred
> >>>>>>>>> 12/14 14:54:11.879 metplus.GridStat (met_util.py:216)
INFO:
> >>>>>>>>> Check
> >>>> the
> >>>>>>>>> log file for more information:
> >>>>>>>>>
> >>>>>>>
> >>>>>
> >>>>
> >>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/logs/master_metplus.log.20201214145404
> >>>>>>>>> 12/14 14:54:11.879 metplus (met_util.py:812) INFO:
> >>>>>>>>>
> >>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/metplus_final.conf:
> >>>>>>>>> write metplus.conf here
> >>>>>>>>> 12/14 14:54:11.880 metplus (met_util.py:245) ERROR:
METplus
> >>>>>>>>> has
> >>>>>>>>> finished running but had 1 error.
> >>>>>>>>> 12/14 14:54:11Z run-METplus-metplus: ERROR: METplus has
> >>>>>>>>> finished
> >>>>>>>>> running but had 1 error.
> >>>>>>>>>
> >>>>>>>>> I am not entirely sure if MET 9.x or the latest versions
of
> >>>>>>>>> METplus
> >>>>>>>>> have support to do ensemble-based percentile verification
so
> >>>>>>>>> I
> >>>> decided
> >>>>>>>>> to try and run through each of the model members via
> >>>>>>>>> grid_stat to
> >>>>>>>>> generate the individual probability fields which I would
then
> >>>> process
> >>>>>>>>> through ensemble_stat and then finally back through
grid_stat
> >>>>>>>>> to
> >>>>>>>>> generate the ensemble-based probabilities. Is there a way
to
> >>>>>>>>> work
> >>>>>>>>> around this particular issue to be able to process each
> >>>>>>>>> member in
> >>>> the
> >>>>>>>>> “grid_stat_custom_loop_list”?
> >>>>>>>>>
> >>>>>>>>> Many thanks!
> >>>>>>>>>
> >>>>>>>>> -Brian
> >>>>>>>>> —————————————————————
> >>>>>>>>> Brian Matilla
> >>>>>>>>> Research Associate— Warn-on-Forecast Team
> >>>>>>>>> Cooperative Institute for Mesoscale Meteorological Studies
—
> >>>>>>>>> The
> >>>>>>>>> University of Oklahoma
> >>>>>>>>> NOAA National Severe Storms Laboratory
> >>>>>>>>
> >>>>>>>>
> >>>>>>>>
> >>>>>>>
> >>>>>>>
> >>>>>>> Hi George,
> >>>>>>>
> >>>>>>> I have gone ahead and rerun METplus with the log level set
to
> >>>>>>> DEBUG.
> >>>>>>> Attached is the metplus_final.conf as well as the log file.
I
> >>>>>>> should
> >>>>> note
> >>>>>>> here that the input expected into grid_stat is the output
file
> >>>>>>> from
> >>>>>>> “pcp_combine” so that the percentiles can be calculated.
> >>>>>>>
> >>>>>>> Thanks,
> >>>>>>>
> >>>>>>> -Brian
> >>>>>>> —————————————————————
> >>>>>>> Brian Matilla
> >>>>>>> Research Associate— Warn-on-Forecast Team
> >>>>>>> Cooperative Institute for Mesoscale Meteorological Studies —
> >>>>>>> The
> >>>>>>> University of Oklahoma
> >>>>>>> NOAA National Severe Storms Laboratory
> >>>>>>>
> >>>>>>>
> >>>>>>> On Dec 14, 2020, at 4:46 PM, George McCabe via RT
> >>>>>>> <met_help at ucar.edu
> >>>
> >>>>>>> wrote:
> >>>>>>>
> >>>>>>> Hi Brian,
> >>>>>>>
> >>>>>>> I'm not sure why that error is occurring. You should be able
to
> >>>>>>> run
> >>>> the
> >>>>>>> way you described. I was not able to replicate the error on
my
> >>>>>>> end.
> >>>>> Could
> >>>>>>> you please set LOG_LEVEL=DEBUG, rerun the use case, then
send
> >>>>>>> me the
> >>>>> full
> >>>>>>> log file and the metplus_final.conf file?
> >>>>>>>
> >>>>>>> Thanks,
> >>>>>>> George
> >>>>>>>
> >>>>>>> On Mon Dec 14 14:16:34 2020, brian.matilla at noaa.gov wrote:
> >>>>>>>
> >>>>>>> Hi MET Help Desk,
> >>>>>>>
> >>>>>>> I am trying to run grid_stat over each individual member (18
in
> >> total)
> >>>>>>> in my use case. It will process member 1 with no issues,
> >>>>>>> however I do
> >>>>>>> get the following error printout with any succeeding member:
> >>>>>>>
> >>>>>>> 12/14 14:54:05.639 metplus (met_util.py:920) INFO:
> >>>>>>> ****************************************
> >>>>>>> 12/14 14:54:05.640 metplus (met_util.py:921) INFO: * Running
> >>>>>>> METplus
> >>>>>>> 12/14 14:54:05.640 metplus (met_util.py:923) INFO: * at
init
> >>>>>>> time:
> >>>>>>> 202006151700
> >>>>>>> 12/14 14:54:05.640 metplus (met_util.py:926) INFO:
> >>>>>>> ****************************************
> >>>>>>> 12/14 14:54:05.640 metplus.GridStat
> >>>>>>> (compare_gridded_wrapper.py:176)
> >>>>>>> INFO: Processing forecast lead 1 hour
> >>>>>>> 12/14 14:54:05.640 metplus.GridStat
> >>>>>>> (compare_gridded_wrapper.py:184)
> >>>>>>> INFO: Processing custom string: 01
> >>>>>>> 12/14 14:54:05.643 metplus.GridStat (command_runner.py:89)
> >>>>>>> INFO:
> >>>>>>> COMMAND:
> >>>>>>> /home/brian.matilla/WoFS_2020/MET_scripts/met9/bin/grid_stat
> >>>>>>> -v 3
> >>>>>>>
> >>>>>>>
> >>>>>
> >>>>
> >>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/WOFS/pcp_combine/20200615/1700/ENS_MEM_01/wofs01_PCP_20200615_1700_1800_A1.nc
> >>>>>>>
> >>>>>>>
> >>>>>
> >>>>
> >>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/OBS/pcp_combine/20200615/1700/mrms_PCP_20200615_1700_1800_A1_
> >>>>> wofs.nc
> >>>>>>>
> >>>>>>>
> >>>>>
> >>>>
> >>
/home/brian.matilla/WoFS_2020/MET_scripts/MET_configs/GridStatConfig_WOFS_PCP_1H
> >>>>>>> -outdir
> >>>>>>>
> >>>>>>>
> >>>>>
> >>>>
> >>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/WOFS/grid_stat/20200615/1700/
> >>>>>>> 12/14 14:54:11.874 metplus.GridStat
> >>>>>>> (compare_gridded_wrapper.py:184)
> >>>>>>> INFO: Processing custom string: 02
> >>>>>>> 12/14 14:54:11.876 metplus.GridStat (met_util.py:215) ERROR:
> >>>>>>> Fatal
> >>>>>>> error occurred
> >>>>>>> Traceback (most recent call last):
> >>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >>>>>>> 3.1/metplus/util/met_util.py", line 195, in run_metplus
> >>>>>>> loop_over_times_and_call(config, processes)
> >>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >>>>>>> 3.1/metplus/util/met_util.py", line 939, in
> >>>>>>> loop_over_times_and_call
> >>>>>>> process.run_at_time(input_dict)
> >>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >>>>>>> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 189,
in
> >>>>>>> run_at_time
> >>>>>>> self.run_at_time_once(time_info)
> >>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >>>>>>> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 224,
in
> >>>>>>> run_at_time_once
> >>>>>>> self.run_at_time_all_fields(time_info)
> >>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >>>>>>> 3.1/metplus/wrappers/compare_gridded_wrapper.py", line 288,
in
> >>>>>>> run_at_time_all_fields
> >>>>>>> return_list=True)
> >>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >>>>>>> 3.1/metplus/wrappers/command_builder.py", line 357, in
> >>>>>>> find_model
> >>>>>>> return_list=return_list)
> >>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >>>>>>> 3.1/metplus/wrappers/command_builder.py", line 468, in
> >>>>>>> find_data
> >>>>>>> return self.find_exact_file(**arg_dict, allow_dir=allow_dir)
> >>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >>>>>>> 3.1/metplus/wrappers/command_builder.py", line 495, in
> >> find_exact_file
> >>>>>>> **time_info)
> >>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >>>>>>> 3.1/metplus/util/config/string_template_substitution.py",
line
> >>>>>>> 399,
> >> in
> >>>>>>> do_string_sub
> >>>>>>> return find_and_replace_tags_in_template(match_list, tmpl,
> >>>>>>> kwargs,
> >>>>>>> skip_missing_tags)
> >>>>>>> File "/home/brian.matilla/WoFS_2020/MET_scripts/METplus-
> >>>>>>> 3.1/metplus/util/config/string_template_substitution.py",
line
> >>>>>>> 431,
> >> in
> >>>>>>> find_and_replace_tags_in_template
> >>>>>>> " for template: " + tmpl)
> >>>>>>> TypeError: The key valid was not passed to do_string_sub
for
> >>>>>>> template:
> >>>>>>>
> >>>>>>>
> >>>>>
> >>>>
> >>
/work/brian.matilla/WoFS_2020/MET_REALTIME/WPC/WOFS/pcp_combine/{init?fmt=%Y%m%d?shift=-
> >>>>>>>
> >>>>>>>
> >>>>>
> >>>>
> >>
44100}/{init?fmt=%H%M}/ENS_MEM_{custom?fmt=%s}/wofs{custom?fmt=%s}_PCP_{init?fmt=%Y%m%d}_{init?fmt=%H%M}_{valid?fmt=%H%M}_A1.nc
> >>>>>>> 12/14 14:54:11Z run-METplus-metplus.GridStat: ERROR: Fatal
> >>>>>>> error
> >>>>>>> occurred
> >>>>>>> 12/14 14:54:11.879 metplus.GridStat (met_util.py:216) INFO:
> >>>>>>> Check the
> >>>>>>> log file for more information:
> >>>>>>>
> >>>>>>>
> >>>>>
> >>>>
> >>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/logs/master_metplus.log.20201214145404
> >>>>>>> 12/14 14:54:11.879 metplus (met_util.py:812) INFO:
> >>>>>>>
/work/brian.matilla/WoFS_2020/MET_REANALYSIS/WPC/metplus_final.conf:
> >>>>>>> write metplus.conf here
> >>>>>>> 12/14 14:54:11.880 metplus (met_util.py:245) ERROR: METplus
has
> >>>>>>> finished running but had 1 error.
> >>>>>>> 12/14 14:54:11Z run-METplus-metplus: ERROR: METplus has
> >>>>>>> finished
> >>>>>>> running but had 1 error.
> >>>>>>>
> >>>>>>> I am not entirely sure if MET 9.x or the latest versions of
> >>>>>>> METplus
> >>>>>>> have support to do ensemble-based percentile verification so
I
> >> decided
> >>>>>>> to try and run through each of the model members via
grid_stat
> >>>>>>> to
> >>>>>>> generate the individual probability fields which I would
then
> >>>>>>> process
> >>>>>>> through ensemble_stat and then finally back through
grid_stat
> >>>>>>> to
> >>>>>>> generate the ensemble-based probabilities. Is there a way to
> >>>>>>> work
> >>>>>>> around this particular issue to be able to process each
member
> >>>>>>> in the
> >>>>>>> “grid_stat_custom_loop_list”?
> >>>>>>>
> >>>>>>> Many thanks!
> >>>>>>>
> >>>>>>> -Brian
> >>>>>>> —————————————————————
> >>>>>>> Brian Matilla
> >>>>>>> Research Associate— Warn-on-Forecast Team
> >>>>>>> Cooperative Institute for Mesoscale Meteorological Studies —
> >>>>>>> The
> >>>>>>> University of Oklahoma
> >>>>>>> NOAA National Severe Storms Laboratory
> >>>>>>>
> >>>>>>>
> >>>>>>>
> >>>>>>>
> >>>>>>>
> >>>>>>>
> >>>>>>
> >>>>>> --
> >>>>>> George McCabe - Software Engineer III
> >>>>>> National Center for Atmospheric Research
> >>>>>> Research Applications Laboratory
> >>>>>> 303-497-2768
> >>>>>> ---
> >>>>>> My working day may not be your working day. Please do not
feel
> >>>>>> obliged
> >>>> to
> >>>>>> reply to this email outside of your normal working hours.
> >>>>>>
> >>>>>
> >>>>>
> >>>>>
> >>>>
> >>>> --
> >>>> George McCabe - Software Engineer III
> >>>> National Center for Atmospheric Research
> >>>> Research Applications Laboratory
> >>>> 303-497-2768
> >>>> ---
> >>>> My working day may not be your working day. Please do not feel
> >>>> obliged
> >> to
> >>>> reply to this email outside of your normal working hours.
> >>>>
> >>>>
> >>>
> >>
> >>
> >>
> >
> > --
> > George McCabe - Software Engineer III
> > National Center for Atmospheric Research
> > Research Applications Laboratory
> > 303-497-2768
> > ---
> > My working day may not be your working day. Please do not feel
> > obliged to
> > reply to this email outside of your normal working hours.
> >
------------------------------------------------
More information about the Met_help
mailing list