[Met_help] [rt.rap.ucar.edu #98116] History for CDP threshold setting in EnsembleStat conf
John Halley Gotway via RT
met_help at ucar.edu
Thu Jan 7 15:13:57 MST 2021
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
George,
Happy New Year!
I am working on transition of our MET-based global ensemble verification
to METplus based package. In this package climatology bins (10 bins) are
used.
In current ensemble stat config file, the relevant entries iare defined
like following
ens = {
ens_thresh = 1.0;
vld_thresh = 1.0;
field = [
{
name = "HGT";
level = "P500";
obs_thresh = [ <=CDP10, >CDP10&&<=CDP20, >CDP20&&<=CDP30,
>CDP30&&<=CDP40, >CDP40&&<=CDP50, >CDP50&&<=CDP60, >CDP60&&<=CDP70,
>CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];
}
]
}
fcst = ens;
obs = fcst;
ens_ssvar_bin_size = 1000000;
ens_phist_bin_size = 0.05;
climo_mean = fcst;
climo_mean = {
file_name = "${CLIM_MEAN}";
time_interp_method = DW_MEAN;
match_day = TRUE;
time_step = 21600;
}
climo_stdev = climo_mean;
climo_stdev = {
file_name = "${CLIM_STDV}";
}
climo_cdf = {
cdf_bins = 11;
center_bins = TRUE;
write_bins = TRUE;
}
I can not find the correspondent settings in its conf file from METplus
online doc.
Can you help me look at this?
Thanks!
Binbin
--
Binbin Zhou
IMSG at NOAA/NWS/NCEP/EMC
5830 University Research Ct.
College Park, MD 20740
Binbin.Zhou at noaa.gov
301-683-3683
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: CDP threshold setting in EnsembleStat conf
From: George McCabe
Time: Tue Jan 05 08:17:38 2021
Hi Binbin,
Happy New Year to you too!
I will comment on each configuration variable and how to set it in a
METplus config inline:
ens = {
ens_thresh = 1.0;
*This is controlled by the ENSEMBLE_STAT_ENS_THRESH variable. The
default
value is 1.0, so you don't need to include it in your config file, but
you
can if you may adjust this value at some point.*
vld_thresh = 1.0;
*This value is set to 1.0 by default so we don't need to worry about
it
right now.*
field = [
{
name = "HGT";
level = "P500";
obs_thresh = [ <=CDP10, >CDP10&&<=CDP20, >CDP20&&<=CDP30,
>CDP30&&<=CDP40, >CDP40&&<=CDP50, >CDP50&&<=CDP60, >CDP60&&<=CDP70,
>CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];
}
]
}
fcst = ens;
obs = fcst;
*1) The field info for ens is set in the
ENS_VAR<n>_[NAME/LEVEL/THRESH/OPTIONS] variables. The fcst and obs
field
info are set in the corresponding FCST_VAR<n>_* and OBS_VAR<n>_*
variables
respectively, or you can use BOTH_VAR<n>_* if the FCST and OBS values
are
the same.*
*If ENS_VAR<n>_* variables are not explicitly set, then it will use
the
values from FCST_VAR<n>_*.*
*Since the fcst, obs, and ens are all the same you could just use
BOTH_VAR<n>_* variables to control all 3, although keep in mind that
if you
need to change one of them for any reason, it will be more difficult
to do
this. If you know that they will always be the same values, then I
recommend using BOTH_, but if you know they may change or are unsure,
I
would recommend setting them by referencing the other variables, i.e.*
*FCST_VAR1_NAME = HGT*
*FCST_VAR1_LEVELS = P500 *
*OBS_VAR1_NAME = {FCST_VAR1_NAME}*
*OBS_VAR1_LEVELS = {FCST_VAR1_LEVELS}*
*2) The [FCST/OBS/ENS]_VAR<n>_THRESH variables set the cat_thresh
values in
the field info. A variable specific to obs_thresh is not currently
supported, however you can set these values by using the
ENS_VAR1_OPTIONS
variable, i.e.*
*ENS_VAR1_OPTIONS = obs_thresh = [ <=CDP10, >CDP10&&<=CDP20,
>CDP20&&<=CDP30, >CDP30&&<=CDP40, >CDP40&&<=CDP50, >CDP50&&<=CDP60,
>CDP60&&<=CDP70, >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];*
*Remember to include the semicolon at the end! *
ens_ssvar_bin_size = 1000000;
*1) This variable is different from the default and not currently
supported
with a METplus config variable. I will add this to the list of
variables in
MET config files that we want to support. However, in the meantime you
can
copy the default wrapped MET config file and modify it to fit your
needs.
To do this, you will need to:*
* a) Copy METplus/parm/met_config/EnsembleStatConfig_wrapped to the
directory that contains your METplus config file for this use case.
Rename
it by replacing "wrapped" with a short description that pertains to
your
use case.*
* b) In your METplus config file, change the value of
ENSEMBLE_STAT_CONFIG_FILE to point to the path of this new config
file.*
* c) If you know the value you want to use for this variable will
always
be 1000000, then simply set the variable to that value. If you think
you
may want to change the value, then you can utilize the [user_env_vars]
functionality. See:
https://dtcenter.github.io/METplus/latest/Users_Guide/systemconfiguration.html#user-
defined-config
<https://dtcenter.github.io/METplus/latest/Users_Guide/systemconfiguration.html#user-
defined-config>*
*In this case, you would add the following to your METplus config:*
*[user_env_vars]*
*ENS_SSVAR_BIN_SIZE = 1000000*
*Then change the line in your EnsembleStat config file that you copied
to:*
* ens_ssvar_bin_size = ${ENS_SSVAR_BIN_SIZE}; *
ens_phist_bin_size = 0.05;
*This variable uses the default value, so you don't need to do
anything
here. If you need to make it configurable or change the value, then
follow
the instructions for setting ens_ssvar_bin_size.*
climo_mean = fcst;
climo_mean = {
file_name = "${CLIM_MEAN}";
time_interp_method = DW_MEAN;
match_day = TRUE;
time_step = 21600;
}
*Instead of using CLIM_MEAN, you can set
ENSEMBLE_STAT_CLIMO_MEAN_INPUT_[DIR/TEMPLATE] in the METplus config.
You
can use filename template syntax in the _TEMPLATE value, i.e.
{valid?fmt=%m%d}. The other variables in the climo_mean dictionary are
actually old variables that have been replaced with day_interval and
hour_interval, but the values you use are the old defaults, so you
shouldn't need to set them.*
climo_stdev = climo_mean;
climo_stdev = {
file_name = "${CLIM_STDV}";
}
*Similarly to CLIM_MEAN, you can use
ENSEMBLE_STAT_CLIMO_STDEV_INPUT_[DIR/TEMPLATE] to set this file name.*
climo_cdf = {
cdf_bins = 11;
center_bins = TRUE;
write_bins = TRUE;
}
*The value for write_bins is the default, but the values for cdf_bins
and
center_bins do not. To set these, follow the above instructions for
ens_ssvar_bin_size to override them and/or make them configurable
through
METplus. I will also add these variables to the list of MET configs
that
users want to be able to easily configure through METplus configs.*
Please let me know if you run into any issues setting any of that up.
Also,
if there are any other MET config variables that you want to see
supported
in METplus, let me know and I will make sure they get included when we
have
a chance to refactor those wrappers. It is possible to add support for
MET
configs using the above instructions, but it is always easier and less
error-prone to have them configurable directly through a variable in
the
METplus config.
Thanks,
George
On Tue, Jan 5, 2021 at 7:14 AM Binbin.Zhou at noaa.gov via RT <
met_help at ucar.edu> wrote:
>
> Tue Jan 05 07:14:54 2021: Request 98116 was acted upon.
> Transaction: Ticket created by Binbin.Zhou at noaa.gov
> Queue: met_help
> Subject: CDP threshold setting in EnsembleStat conf
> Owner: Nobody
> Requestors: Binbin.Zhou at noaa.gov
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116 >
>
>
> George,
>
> Happy New Year!
>
> I am working on transition of our MET-based global ensemble
verification
> to METplus based package. In this package climatology bins (10 bins)
are
> used.
> In current ensemble stat config file, the relevant entries iare
defined
> like following
>
> ens = {
> ens_thresh = 1.0;
> vld_thresh = 1.0;
>
> field = [
>
> {
> name = "HGT";
> level = "P500";
> obs_thresh = [ <=CDP10, >CDP10&&<=CDP20, >CDP20&&<=CDP30,
> >CDP30&&<=CDP40, >CDP40&&<=CDP50, >CDP50&&<=CDP60, >CDP60&&<=CDP70,
> >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];
> }
> ]
> }
> fcst = ens;
> obs = fcst;
> ens_ssvar_bin_size = 1000000;
> ens_phist_bin_size = 0.05;
> climo_mean = fcst;
> climo_mean = {
> file_name = "${CLIM_MEAN}";
> time_interp_method = DW_MEAN;
> match_day = TRUE;
> time_step = 21600;
> }
>
> climo_stdev = climo_mean;
> climo_stdev = {
> file_name = "${CLIM_STDV}";
> }
>
> climo_cdf = {
> cdf_bins = 11;
> center_bins = TRUE;
> write_bins = TRUE;
> }
>
> I can not find the correspondent settings in its conf file from
METplus
> online doc.
> Can you help me look at this?
>
> Thanks!
>
> Binbin
>
> --
>
> Binbin Zhou
>
> IMSG at NOAA/NWS/NCEP/EMC
>
> 5830 University Research Ct.
>
> College Park, MD 20740
>
> Binbin.Zhou at noaa.gov
>
> 301-683-3683
>
>
--
George McCabe - Software Engineer III
National Center for Atmospheric Research
Research Applications Laboratory
303-497-2768
---
My working day may not be your working day. Please do not feel obliged
to
reply to this email outside of your normal working hours.
------------------------------------------------
Subject: CDP threshold setting in EnsembleStat conf
From: Binbin.Zhou at noaa.gov
Time: Tue Jan 05 08:33:43 2021
George,
Thanks for your quick response! I'll test this settings and let you
know
the results.
Binbin
On Tue, Jan 5, 2021 at 10:17 AM George McCabe via RT
<met_help at ucar.edu>
wrote:
> Hi Binbin,
>
> Happy New Year to you too!
>
> I will comment on each configuration variable and how to set it in a
> METplus config inline:
>
> ens = {
> ens_thresh = 1.0;
>
>
> *This is controlled by the ENSEMBLE_STAT_ENS_THRESH variable. The
default
> value is 1.0, so you don't need to include it in your config file,
but you
> can if you may adjust this value at some point.*
>
> vld_thresh = 1.0;
>
> *This value is set to 1.0 by default so we don't need to worry about
it
> right now.*
>
> field = [
>
> {
> name = "HGT";
> level = "P500";
> obs_thresh = [ <=CDP10, >CDP10&&<=CDP20, >CDP20&&<=CDP30,
> >CDP30&&<=CDP40, >CDP40&&<=CDP50, >CDP50&&<=CDP60, >CDP60&&<=CDP70,
> >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];
> }
> ]
> }
> fcst = ens;
> obs = fcst;
>
> *1) The field info for ens is set in the
> ENS_VAR<n>_[NAME/LEVEL/THRESH/OPTIONS] variables. The fcst and obs
field
> info are set in the corresponding FCST_VAR<n>_* and OBS_VAR<n>_*
variables
> respectively, or you can use BOTH_VAR<n>_* if the FCST and OBS
values are
> the same.*
>
> *If ENS_VAR<n>_* variables are not explicitly set, then it will use
the
> values from FCST_VAR<n>_*.*
> *Since the fcst, obs, and ens are all the same you could just use
> BOTH_VAR<n>_* variables to control all 3, although keep in mind that
if you
> need to change one of them for any reason, it will be more difficult
to do
> this. If you know that they will always be the same values, then I
> recommend using BOTH_, but if you know they may change or are
unsure, I
> would recommend setting them by referencing the other variables,
i.e.*
>
> *FCST_VAR1_NAME = HGT*
> *FCST_VAR1_LEVELS = P500 *
> *OBS_VAR1_NAME = {FCST_VAR1_NAME}*
> *OBS_VAR1_LEVELS = {FCST_VAR1_LEVELS}*
>
> *2) The [FCST/OBS/ENS]_VAR<n>_THRESH variables set the cat_thresh
values in
> the field info. A variable specific to obs_thresh is not currently
> supported, however you can set these values by using the
ENS_VAR1_OPTIONS
> variable, i.e.*
>
> *ENS_VAR1_OPTIONS = obs_thresh = [ <=CDP10, >CDP10&&<=CDP20,
> >CDP20&&<=CDP30, >CDP30&&<=CDP40, >CDP40&&<=CDP50, >CDP50&&<=CDP60,
> >CDP60&&<=CDP70, >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];*
>
>
> *Remember to include the semicolon at the end! *
>
> ens_ssvar_bin_size = 1000000;
> *1) This variable is different from the default and not currently
supported
> with a METplus config variable. I will add this to the list of
variables in
> MET config files that we want to support. However, in the meantime
you can
> copy the default wrapped MET config file and modify it to fit your
needs.
> To do this, you will need to:*
>
> * a) Copy METplus/parm/met_config/EnsembleStatConfig_wrapped to the
> directory that contains your METplus config file for this use case.
Rename
> it by replacing "wrapped" with a short description that pertains to
your
> use case.*
>
> * b) In your METplus config file, change the value of
> ENSEMBLE_STAT_CONFIG_FILE to point to the path of this new config
file.*
>
> * c) If you know the value you want to use for this variable will
always
> be 1000000, then simply set the variable to that value. If you think
you
> may want to change the value, then you can utilize the
[user_env_vars]
> functionality. See:
>
>
https://dtcenter.github.io/METplus/latest/Users_Guide/systemconfiguration.html#user-
defined-config
> <
>
https://dtcenter.github.io/METplus/latest/Users_Guide/systemconfiguration.html#user-
defined-config
> >*
> *In this case, you would add the following to your METplus config:*
>
> *[user_env_vars]*
> *ENS_SSVAR_BIN_SIZE = 1000000*
>
> *Then change the line in your EnsembleStat config file that you
copied to:*
>
> * ens_ssvar_bin_size = ${ENS_SSVAR_BIN_SIZE}; *
>
> ens_phist_bin_size = 0.05;
> *This variable uses the default value, so you don't need to do
anything
> here. If you need to make it configurable or change the value, then
follow
> the instructions for setting ens_ssvar_bin_size.*
>
> climo_mean = fcst;
> climo_mean = {
> file_name = "${CLIM_MEAN}";
> time_interp_method = DW_MEAN;
> match_day = TRUE;
> time_step = 21600;
> }
>
>
> *Instead of using CLIM_MEAN, you can set
> ENSEMBLE_STAT_CLIMO_MEAN_INPUT_[DIR/TEMPLATE] in the METplus config.
You
> can use filename template syntax in the _TEMPLATE value, i.e.
> {valid?fmt=%m%d}. The other variables in the climo_mean dictionary
are
> actually old variables that have been replaced with day_interval and
> hour_interval, but the values you use are the old defaults, so you
> shouldn't need to set them.*
>
> climo_stdev = climo_mean;
> climo_stdev = {
> file_name = "${CLIM_STDV}";
> }
>
> *Similarly to CLIM_MEAN, you can use
> ENSEMBLE_STAT_CLIMO_STDEV_INPUT_[DIR/TEMPLATE] to set this file
name.*
>
> climo_cdf = {
> cdf_bins = 11;
> center_bins = TRUE;
> write_bins = TRUE;
> }
> *The value for write_bins is the default, but the values for
cdf_bins and
> center_bins do not. To set these, follow the above instructions for
> ens_ssvar_bin_size to override them and/or make them configurable
through
> METplus. I will also add these variables to the list of MET configs
that
> users want to be able to easily configure through METplus configs.*
>
> Please let me know if you run into any issues setting any of that
up. Also,
> if there are any other MET config variables that you want to see
supported
> in METplus, let me know and I will make sure they get included when
we have
> a chance to refactor those wrappers. It is possible to add support
for MET
> configs using the above instructions, but it is always easier and
less
> error-prone to have them configurable directly through a variable in
the
> METplus config.
>
> Thanks,
> George
>
> On Tue, Jan 5, 2021 at 7:14 AM Binbin.Zhou at noaa.gov via RT <
> met_help at ucar.edu> wrote:
>
> >
> > Tue Jan 05 07:14:54 2021: Request 98116 was acted upon.
> > Transaction: Ticket created by Binbin.Zhou at noaa.gov
> > Queue: met_help
> > Subject: CDP threshold setting in EnsembleStat conf
> > Owner: Nobody
> > Requestors: Binbin.Zhou at noaa.gov
> > Status: new
> > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116 >
> >
> >
> > George,
> >
> > Happy New Year!
> >
> > I am working on transition of our MET-based global ensemble
> verification
> > to METplus based package. In this package climatology bins (10
bins) are
> > used.
> > In current ensemble stat config file, the relevant entries iare
defined
> > like following
> >
> > ens = {
> > ens_thresh = 1.0;
> > vld_thresh = 1.0;
> >
> > field = [
> >
> > {
> > name = "HGT";
> > level = "P500";
> > obs_thresh = [ <=CDP10, >CDP10&&<=CDP20, >CDP20&&<=CDP30,
> > >CDP30&&<=CDP40, >CDP40&&<=CDP50, >CDP50&&<=CDP60,
>CDP60&&<=CDP70,
> > >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];
> > }
> > ]
> > }
> > fcst = ens;
> > obs = fcst;
> > ens_ssvar_bin_size = 1000000;
> > ens_phist_bin_size = 0.05;
> > climo_mean = fcst;
> > climo_mean = {
> > file_name = "${CLIM_MEAN}";
> > time_interp_method = DW_MEAN;
> > match_day = TRUE;
> > time_step = 21600;
> > }
> >
> > climo_stdev = climo_mean;
> > climo_stdev = {
> > file_name = "${CLIM_STDV}";
> > }
> >
> > climo_cdf = {
> > cdf_bins = 11;
> > center_bins = TRUE;
> > write_bins = TRUE;
> > }
> >
> > I can not find the correspondent settings in its conf file from
METplus
> > online doc.
> > Can you help me look at this?
> >
> > Thanks!
> >
> > Binbin
> >
> > --
> >
> > Binbin Zhou
> >
> > IMSG at NOAA/NWS/NCEP/EMC
> >
> > 5830 University Research Ct.
> >
> > College Park, MD 20740
> >
> > Binbin.Zhou at noaa.gov
> >
> > 301-683-3683
> >
> >
>
> --
> George McCabe - Software Engineer III
> National Center for Atmospheric Research
> Research Applications Laboratory
> 303-497-2768
> ---
> My working day may not be your working day. Please do not feel
obliged to
> reply to this email outside of your normal working hours.
>
>
--
Binbin Zhou
IMSG at NOAA/NWS/NCEP/EMC
5830 University Research Ct.
College Park, MD 20740
Binbin.Zhou at noaa.gov
301-683-3683
------------------------------------------------
Subject: CDP threshold setting in EnsembleStat conf
From: Binbin.Zhou at noaa.gov
Time: Tue Jan 05 13:45:13 2021
George,
I got another issue for verification mask setting.
I am using $VERIF_MASK in EnsembleStat config f/ile
mask = {
grid = [];
poly = [${VERIF_MASK}];
sid = [];
}
And using GRID_STAT_VERIFICATION_MASK_TEMPLATE to define several
polygon
nc mask files
But it seems not working. But it works for Gridstat config in suich
setting.
I can not find ENSEMBLE_STAT_ VERIFICATION_MASK_TEMPLATE in the
METplus doc
So I define VERIF_MASK in [user_env_vars] part.
It values can not be passed to ploy = [${VERIF_MASK}] in the
EnsembleStat
conf if more than one nc files included.
For example
VERIF_MASK=" '/part/p1.cn', '/path/p2.nc' "
the error says poly = [/path/p1,]
It seems double quote or single quote can not be passed to VERIF_MASK
in
the EnsembleStat config.
I tried use back slash \ to before quote, but still not working
Binbin
On Tue, Jan 5, 2021 at 10:33 AM Binbin Zhou - NOAA Affiliate <
binbin.zhou at noaa.gov> wrote:
> George,
>
> Thanks for your quick response! I'll test this settings and let
> you know the results.
>
> Binbin
>
> On Tue, Jan 5, 2021 at 10:17 AM George McCabe via RT
<met_help at ucar.edu>
> wrote:
>
>> Hi Binbin,
>>
>> Happy New Year to you too!
>>
>> I will comment on each configuration variable and how to set it in
a
>> METplus config inline:
>>
>> ens = {
>> ens_thresh = 1.0;
>>
>>
>> *This is controlled by the ENSEMBLE_STAT_ENS_THRESH variable. The
default
>> value is 1.0, so you don't need to include it in your config file,
but you
>> can if you may adjust this value at some point.*
>>
>> vld_thresh = 1.0;
>>
>> *This value is set to 1.0 by default so we don't need to worry
about it
>> right now.*
>>
>> field = [
>>
>> {
>> name = "HGT";
>> level = "P500";
>> obs_thresh = [ <=CDP10, >CDP10&&<=CDP20, >CDP20&&<=CDP30,
>> >CDP30&&<=CDP40, >CDP40&&<=CDP50, >CDP50&&<=CDP60, >CDP60&&<=CDP70,
>> >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];
>> }
>> ]
>> }
>> fcst = ens;
>> obs = fcst;
>>
>> *1) The field info for ens is set in the
>> ENS_VAR<n>_[NAME/LEVEL/THRESH/OPTIONS] variables. The fcst and obs
field
>> info are set in the corresponding FCST_VAR<n>_* and OBS_VAR<n>_*
variables
>> respectively, or you can use BOTH_VAR<n>_* if the FCST and OBS
values are
>> the same.*
>>
>> *If ENS_VAR<n>_* variables are not explicitly set, then it will use
the
>> values from FCST_VAR<n>_*.*
>> *Since the fcst, obs, and ens are all the same you could just use
>> BOTH_VAR<n>_* variables to control all 3, although keep in mind
that if
>> you
>> need to change one of them for any reason, it will be more
difficult to do
>> this. If you know that they will always be the same values, then I
>> recommend using BOTH_, but if you know they may change or are
unsure, I
>> would recommend setting them by referencing the other variables,
i.e.*
>>
>> *FCST_VAR1_NAME = HGT*
>> *FCST_VAR1_LEVELS = P500 *
>> *OBS_VAR1_NAME = {FCST_VAR1_NAME}*
>> *OBS_VAR1_LEVELS = {FCST_VAR1_LEVELS}*
>>
>> *2) The [FCST/OBS/ENS]_VAR<n>_THRESH variables set the cat_thresh
values
>> in
>> the field info. A variable specific to obs_thresh is not currently
>> supported, however you can set these values by using the
ENS_VAR1_OPTIONS
>> variable, i.e.*
>>
>> *ENS_VAR1_OPTIONS = obs_thresh = [ <=CDP10, >CDP10&&<=CDP20,
>> >CDP20&&<=CDP30, >CDP30&&<=CDP40, >CDP40&&<=CDP50, >CDP50&&<=CDP60,
>> >CDP60&&<=CDP70, >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];*
>>
>>
>> *Remember to include the semicolon at the end! *
>>
>> ens_ssvar_bin_size = 1000000;
>> *1) This variable is different from the default and not currently
>> supported
>> with a METplus config variable. I will add this to the list of
variables
>> in
>> MET config files that we want to support. However, in the meantime
you can
>> copy the default wrapped MET config file and modify it to fit your
needs.
>> To do this, you will need to:*
>>
>> * a) Copy METplus/parm/met_config/EnsembleStatConfig_wrapped to
the
>> directory that contains your METplus config file for this use case.
Rename
>> it by replacing "wrapped" with a short description that pertains to
your
>> use case.*
>>
>> * b) In your METplus config file, change the value of
>> ENSEMBLE_STAT_CONFIG_FILE to point to the path of this new config
file.*
>>
>> * c) If you know the value you want to use for this variable will
always
>> be 1000000, then simply set the variable to that value. If you
think you
>> may want to change the value, then you can utilize the
[user_env_vars]
>> functionality. See:
>>
>>
https://dtcenter.github.io/METplus/latest/Users_Guide/systemconfiguration.html#user-
defined-config
>> <
>>
https://dtcenter.github.io/METplus/latest/Users_Guide/systemconfiguration.html#user-
defined-config
>> >*
>> *In this case, you would add the following to your METplus config:*
>>
>> *[user_env_vars]*
>> *ENS_SSVAR_BIN_SIZE = 1000000*
>>
>> *Then change the line in your EnsembleStat config file that you
copied
>> to:*
>>
>> * ens_ssvar_bin_size = ${ENS_SSVAR_BIN_SIZE}; *
>>
>> ens_phist_bin_size = 0.05;
>> *This variable uses the default value, so you don't need to do
anything
>> here. If you need to make it configurable or change the value, then
follow
>> the instructions for setting ens_ssvar_bin_size.*
>>
>> climo_mean = fcst;
>> climo_mean = {
>> file_name = "${CLIM_MEAN}";
>> time_interp_method = DW_MEAN;
>> match_day = TRUE;
>> time_step = 21600;
>> }
>>
>>
>> *Instead of using CLIM_MEAN, you can set
>> ENSEMBLE_STAT_CLIMO_MEAN_INPUT_[DIR/TEMPLATE] in the METplus
config. You
>> can use filename template syntax in the _TEMPLATE value, i.e.
>> {valid?fmt=%m%d}. The other variables in the climo_mean dictionary
are
>> actually old variables that have been replaced with day_interval
and
>> hour_interval, but the values you use are the old defaults, so you
>> shouldn't need to set them.*
>>
>> climo_stdev = climo_mean;
>> climo_stdev = {
>> file_name = "${CLIM_STDV}";
>> }
>>
>> *Similarly to CLIM_MEAN, you can use
>> ENSEMBLE_STAT_CLIMO_STDEV_INPUT_[DIR/TEMPLATE] to set this file
name.*
>>
>> climo_cdf = {
>> cdf_bins = 11;
>> center_bins = TRUE;
>> write_bins = TRUE;
>> }
>> *The value for write_bins is the default, but the values for
cdf_bins and
>> center_bins do not. To set these, follow the above instructions for
>> ens_ssvar_bin_size to override them and/or make them configurable
through
>> METplus. I will also add these variables to the list of MET configs
that
>> users want to be able to easily configure through METplus configs.*
>>
>> Please let me know if you run into any issues setting any of that
up.
>> Also,
>> if there are any other MET config variables that you want to see
supported
>> in METplus, let me know and I will make sure they get included when
we
>> have
>> a chance to refactor those wrappers. It is possible to add support
for MET
>> configs using the above instructions, but it is always easier and
less
>> error-prone to have them configurable directly through a variable
in the
>> METplus config.
>>
>> Thanks,
>> George
>>
>> On Tue, Jan 5, 2021 at 7:14 AM Binbin.Zhou at noaa.gov via RT <
>> met_help at ucar.edu> wrote:
>>
>> >
>> > Tue Jan 05 07:14:54 2021: Request 98116 was acted upon.
>> > Transaction: Ticket created by Binbin.Zhou at noaa.gov
>> > Queue: met_help
>> > Subject: CDP threshold setting in EnsembleStat conf
>> > Owner: Nobody
>> > Requestors: Binbin.Zhou at noaa.gov
>> > Status: new
>> > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116 >
>> >
>> >
>> > George,
>> >
>> > Happy New Year!
>> >
>> > I am working on transition of our MET-based global ensemble
>> verification
>> > to METplus based package. In this package climatology bins (10
bins) are
>> > used.
>> > In current ensemble stat config file, the relevant entries iare
defined
>> > like following
>> >
>> > ens = {
>> > ens_thresh = 1.0;
>> > vld_thresh = 1.0;
>> >
>> > field = [
>> >
>> > {
>> > name = "HGT";
>> > level = "P500";
>> > obs_thresh = [ <=CDP10, >CDP10&&<=CDP20,
>CDP20&&<=CDP30,
>> > >CDP30&&<=CDP40, >CDP40&&<=CDP50, >CDP50&&<=CDP60,
>CDP60&&<=CDP70,
>> > >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];
>> > }
>> > ]
>> > }
>> > fcst = ens;
>> > obs = fcst;
>> > ens_ssvar_bin_size = 1000000;
>> > ens_phist_bin_size = 0.05;
>> > climo_mean = fcst;
>> > climo_mean = {
>> > file_name = "${CLIM_MEAN}";
>> > time_interp_method = DW_MEAN;
>> > match_day = TRUE;
>> > time_step = 21600;
>> > }
>> >
>> > climo_stdev = climo_mean;
>> > climo_stdev = {
>> > file_name = "${CLIM_STDV}";
>> > }
>> >
>> > climo_cdf = {
>> > cdf_bins = 11;
>> > center_bins = TRUE;
>> > write_bins = TRUE;
>> > }
>> >
>> > I can not find the correspondent settings in its conf file from
METplus
>> > online doc.
>> > Can you help me look at this?
>> >
>> > Thanks!
>> >
>> > Binbin
>> >
>> > --
>> >
>> > Binbin Zhou
>> >
>> > IMSG at NOAA/NWS/NCEP/EMC
>> >
>> > 5830 University Research Ct.
>> >
>> > College Park, MD 20740
>> >
>> > Binbin.Zhou at noaa.gov
>> >
>> > 301-683-3683
>> >
>> >
>>
>> --
>> George McCabe - Software Engineer III
>> National Center for Atmospheric Research
>> Research Applications Laboratory
>> 303-497-2768
>> ---
>> My working day may not be your working day. Please do not feel
obliged to
>> reply to this email outside of your normal working hours.
>>
>>
>
> --
>
> Binbin Zhou
>
> IMSG at NOAA/NWS/NCEP/EMC
>
> 5830 University Research Ct.
>
> College Park, MD 20740
>
> Binbin.Zhou at noaa.gov
>
> 301-683-3683
>
--
Binbin Zhou
IMSG at NOAA/NWS/NCEP/EMC
5830 University Research Ct.
College Park, MD 20740
Binbin.Zhou at noaa.gov
301-683-3683
------------------------------------------------
Subject: CDP threshold setting in EnsembleStat conf
From: George McCabe
Time: Tue Jan 05 13:49:54 2021
Hi Binbin,
You should be able to set it in the METplus config the same way it is
done
for GridStat -- no quotes with commas between each item. The wrapper
should
format it properly.
Here is an example from an existing use case:
GRID_STAT_VERIFICATION_MASK_TEMPLATE =
{INPUT_BASE}/model_applications/precipitation/mask/CONUS_HRRRTLE.nc,
{INPUT_BASE}/model_applications/precipitation/mask/EAST_HRRRTLE.nc,
{INPUT_BASE}/model_applications/precipitation/mask/WEST_HRRRTLE.nc
You should be able to set them the same way using
ENSEMBLE_STAT_VERIFICATION_MASK_TEMPLATE. Let me know if that doesn't
work.
- George
On Tue, Jan 5, 2021 at 1:45 PM Binbin.Zhou at noaa.gov via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116 >
>
> George,
>
> I got another issue for verification mask setting.
>
> I am using $VERIF_MASK in EnsembleStat config f/ile
> mask = {
> grid = [];
> poly = [${VERIF_MASK}];
> sid = [];
> }
>
> And using GRID_STAT_VERIFICATION_MASK_TEMPLATE to define several
polygon
> nc mask files
> But it seems not working. But it works for Gridstat config in suich
> setting.
> I can not find ENSEMBLE_STAT_ VERIFICATION_MASK_TEMPLATE in the
METplus doc
>
> So I define VERIF_MASK in [user_env_vars] part.
> It values can not be passed to ploy = [${VERIF_MASK}] in the
EnsembleStat
> conf if more than one nc files included.
> For example
> VERIF_MASK=" '/part/p1.cn', '/path/p2.nc' "
> the error says poly = [/path/p1,]
> It seems double quote or single quote can not be passed to
VERIF_MASK in
> the EnsembleStat config.
> I tried use back slash \ to before quote, but still not working
>
> Binbin
>
>
> On Tue, Jan 5, 2021 at 10:33 AM Binbin Zhou - NOAA Affiliate <
> binbin.zhou at noaa.gov> wrote:
>
> > George,
> >
> > Thanks for your quick response! I'll test this settings and let
> > you know the results.
> >
> > Binbin
> >
> > On Tue, Jan 5, 2021 at 10:17 AM George McCabe via RT
<met_help at ucar.edu>
> > wrote:
> >
> >> Hi Binbin,
> >>
> >> Happy New Year to you too!
> >>
> >> I will comment on each configuration variable and how to set it
in a
> >> METplus config inline:
> >>
> >> ens = {
> >> ens_thresh = 1.0;
> >>
> >>
> >> *This is controlled by the ENSEMBLE_STAT_ENS_THRESH variable. The
> default
> >> value is 1.0, so you don't need to include it in your config
file, but
> you
> >> can if you may adjust this value at some point.*
> >>
> >> vld_thresh = 1.0;
> >>
> >> *This value is set to 1.0 by default so we don't need to worry
about it
> >> right now.*
> >>
> >> field = [
> >>
> >> {
> >> name = "HGT";
> >> level = "P500";
> >> obs_thresh = [ <=CDP10, >CDP10&&<=CDP20,
>CDP20&&<=CDP30,
> >> >CDP30&&<=CDP40, >CDP40&&<=CDP50, >CDP50&&<=CDP60,
>CDP60&&<=CDP70,
> >> >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];
> >> }
> >> ]
> >> }
> >> fcst = ens;
> >> obs = fcst;
> >>
> >> *1) The field info for ens is set in the
> >> ENS_VAR<n>_[NAME/LEVEL/THRESH/OPTIONS] variables. The fcst and
obs field
> >> info are set in the corresponding FCST_VAR<n>_* and OBS_VAR<n>_*
> variables
> >> respectively, or you can use BOTH_VAR<n>_* if the FCST and OBS
values
> are
> >> the same.*
> >>
> >> *If ENS_VAR<n>_* variables are not explicitly set, then it will
use the
> >> values from FCST_VAR<n>_*.*
> >> *Since the fcst, obs, and ens are all the same you could just use
> >> BOTH_VAR<n>_* variables to control all 3, although keep in mind
that if
> >> you
> >> need to change one of them for any reason, it will be more
difficult to
> do
> >> this. If you know that they will always be the same values, then
I
> >> recommend using BOTH_, but if you know they may change or are
unsure, I
> >> would recommend setting them by referencing the other variables,
i.e.*
> >>
> >> *FCST_VAR1_NAME = HGT*
> >> *FCST_VAR1_LEVELS = P500 *
> >> *OBS_VAR1_NAME = {FCST_VAR1_NAME}*
> >> *OBS_VAR1_LEVELS = {FCST_VAR1_LEVELS}*
> >>
> >> *2) The [FCST/OBS/ENS]_VAR<n>_THRESH variables set the cat_thresh
values
> >> in
> >> the field info. A variable specific to obs_thresh is not
currently
> >> supported, however you can set these values by using the
> ENS_VAR1_OPTIONS
> >> variable, i.e.*
> >>
> >> *ENS_VAR1_OPTIONS = obs_thresh = [ <=CDP10, >CDP10&&<=CDP20,
> >> >CDP20&&<=CDP30, >CDP30&&<=CDP40, >CDP40&&<=CDP50,
>CDP50&&<=CDP60,
> >> >CDP60&&<=CDP70, >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];*
> >>
> >>
> >> *Remember to include the semicolon at the end! *
> >>
> >> ens_ssvar_bin_size = 1000000;
> >> *1) This variable is different from the default and not currently
> >> supported
> >> with a METplus config variable. I will add this to the list of
variables
> >> in
> >> MET config files that we want to support. However, in the
meantime you
> can
> >> copy the default wrapped MET config file and modify it to fit
your
> needs.
> >> To do this, you will need to:*
> >>
> >> * a) Copy METplus/parm/met_config/EnsembleStatConfig_wrapped to
the
> >> directory that contains your METplus config file for this use
case.
> Rename
> >> it by replacing "wrapped" with a short description that pertains
to your
> >> use case.*
> >>
> >> * b) In your METplus config file, change the value of
> >> ENSEMBLE_STAT_CONFIG_FILE to point to the path of this new config
file.*
> >>
> >> * c) If you know the value you want to use for this variable
will
> always
> >> be 1000000, then simply set the variable to that value. If you
think you
> >> may want to change the value, then you can utilize the
[user_env_vars]
> >> functionality. See:
> >>
> >>
>
https://dtcenter.github.io/METplus/latest/Users_Guide/systemconfiguration.html#user-
defined-config
> >> <
> >>
>
https://dtcenter.github.io/METplus/latest/Users_Guide/systemconfiguration.html#user-
defined-config
> >> >*
> >> *In this case, you would add the following to your METplus
config:*
> >>
> >> *[user_env_vars]*
> >> *ENS_SSVAR_BIN_SIZE = 1000000*
> >>
> >> *Then change the line in your EnsembleStat config file that you
copied
> >> to:*
> >>
> >> * ens_ssvar_bin_size = ${ENS_SSVAR_BIN_SIZE}; *
> >>
> >> ens_phist_bin_size = 0.05;
> >> *This variable uses the default value, so you don't need to do
anything
> >> here. If you need to make it configurable or change the value,
then
> follow
> >> the instructions for setting ens_ssvar_bin_size.*
> >>
> >> climo_mean = fcst;
> >> climo_mean = {
> >> file_name = "${CLIM_MEAN}";
> >> time_interp_method = DW_MEAN;
> >> match_day = TRUE;
> >> time_step = 21600;
> >> }
> >>
> >>
> >> *Instead of using CLIM_MEAN, you can set
> >> ENSEMBLE_STAT_CLIMO_MEAN_INPUT_[DIR/TEMPLATE] in the METplus
config. You
> >> can use filename template syntax in the _TEMPLATE value, i.e.
> >> {valid?fmt=%m%d}. The other variables in the climo_mean
dictionary are
> >> actually old variables that have been replaced with day_interval
and
> >> hour_interval, but the values you use are the old defaults, so
you
> >> shouldn't need to set them.*
> >>
> >> climo_stdev = climo_mean;
> >> climo_stdev = {
> >> file_name = "${CLIM_STDV}";
> >> }
> >>
> >> *Similarly to CLIM_MEAN, you can use
> >> ENSEMBLE_STAT_CLIMO_STDEV_INPUT_[DIR/TEMPLATE] to set this file
name.*
> >>
> >> climo_cdf = {
> >> cdf_bins = 11;
> >> center_bins = TRUE;
> >> write_bins = TRUE;
> >> }
> >> *The value for write_bins is the default, but the values for
cdf_bins
> and
> >> center_bins do not. To set these, follow the above instructions
for
> >> ens_ssvar_bin_size to override them and/or make them configurable
> through
> >> METplus. I will also add these variables to the list of MET
configs that
> >> users want to be able to easily configure through METplus
configs.*
> >>
> >> Please let me know if you run into any issues setting any of that
up.
> >> Also,
> >> if there are any other MET config variables that you want to see
> supported
> >> in METplus, let me know and I will make sure they get included
when we
> >> have
> >> a chance to refactor those wrappers. It is possible to add
support for
> MET
> >> configs using the above instructions, but it is always easier and
less
> >> error-prone to have them configurable directly through a variable
in the
> >> METplus config.
> >>
> >> Thanks,
> >> George
> >>
> >> On Tue, Jan 5, 2021 at 7:14 AM Binbin.Zhou at noaa.gov via RT <
> >> met_help at ucar.edu> wrote:
> >>
> >> >
> >> > Tue Jan 05 07:14:54 2021: Request 98116 was acted upon.
> >> > Transaction: Ticket created by Binbin.Zhou at noaa.gov
> >> > Queue: met_help
> >> > Subject: CDP threshold setting in EnsembleStat conf
> >> > Owner: Nobody
> >> > Requestors: Binbin.Zhou at noaa.gov
> >> > Status: new
> >> > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
> >
> >> >
> >> >
> >> > George,
> >> >
> >> > Happy New Year!
> >> >
> >> > I am working on transition of our MET-based global ensemble
> >> verification
> >> > to METplus based package. In this package climatology bins (10
bins)
> are
> >> > used.
> >> > In current ensemble stat config file, the relevant entries iare
> defined
> >> > like following
> >> >
> >> > ens = {
> >> > ens_thresh = 1.0;
> >> > vld_thresh = 1.0;
> >> >
> >> > field = [
> >> >
> >> > {
> >> > name = "HGT";
> >> > level = "P500";
> >> > obs_thresh = [ <=CDP10, >CDP10&&<=CDP20,
>CDP20&&<=CDP30,
> >> > >CDP30&&<=CDP40, >CDP40&&<=CDP50, >CDP50&&<=CDP60,
>CDP60&&<=CDP70,
> >> > >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];
> >> > }
> >> > ]
> >> > }
> >> > fcst = ens;
> >> > obs = fcst;
> >> > ens_ssvar_bin_size = 1000000;
> >> > ens_phist_bin_size = 0.05;
> >> > climo_mean = fcst;
> >> > climo_mean = {
> >> > file_name = "${CLIM_MEAN}";
> >> > time_interp_method = DW_MEAN;
> >> > match_day = TRUE;
> >> > time_step = 21600;
> >> > }
> >> >
> >> > climo_stdev = climo_mean;
> >> > climo_stdev = {
> >> > file_name = "${CLIM_STDV}";
> >> > }
> >> >
> >> > climo_cdf = {
> >> > cdf_bins = 11;
> >> > center_bins = TRUE;
> >> > write_bins = TRUE;
> >> > }
> >> >
> >> > I can not find the correspondent settings in its conf file from
> METplus
> >> > online doc.
> >> > Can you help me look at this?
> >> >
> >> > Thanks!
> >> >
> >> > Binbin
> >> >
> >> > --
> >> >
> >> > Binbin Zhou
> >> >
> >> > IMSG at NOAA/NWS/NCEP/EMC
> >> >
> >> > 5830 University Research Ct.
> >> >
> >> > College Park, MD 20740
> >> >
> >> > Binbin.Zhou at noaa.gov
> >> >
> >> > 301-683-3683
> >> >
> >> >
> >>
> >> --
> >> George McCabe - Software Engineer III
> >> National Center for Atmospheric Research
> >> Research Applications Laboratory
> >> 303-497-2768
> >> ---
> >> My working day may not be your working day. Please do not feel
obliged
> to
> >> reply to this email outside of your normal working hours.
> >>
> >>
> >
> > --
> >
> > Binbin Zhou
> >
> > IMSG at NOAA/NWS/NCEP/EMC
> >
> > 5830 University Research Ct.
> >
> > College Park, MD 20740
> >
> > Binbin.Zhou at noaa.gov
> >
> > 301-683-3683
> >
>
>
> --
>
> Binbin Zhou
>
> IMSG at NOAA/NWS/NCEP/EMC
>
> 5830 University Research Ct.
>
> College Park, MD 20740
>
> Binbin.Zhou at noaa.gov
>
> 301-683-3683
>
>
--
George McCabe - Software Engineer III
National Center for Atmospheric Research
Research Applications Laboratory
303-497-2768
---
My working day may not be your working day. Please do not feel obliged
to
reply to this email outside of your normal working hours.
------------------------------------------------
Subject: CDP threshold setting in EnsembleStat conf
From: George McCabe
Time: Tue Jan 05 13:51:39 2021
Also, you are right that ENSEMBLE_STAT_VERIFICATION_MASK_TEMPLATE is
not in
the glossary. It should still be supported, but I will be sure to add
it to
the glossary to be complete. Thanks for pointing that out!
- George
On Tue, Jan 5, 2021 at 1:49 PM George McCabe <mccabe at ucar.edu> wrote:
> Hi Binbin,
>
> You should be able to set it in the METplus config the same way it
is done
> for GridStat -- no quotes with commas between each item. The wrapper
should
> format it properly.
>
> Here is an example from an existing use case:
>
> GRID_STAT_VERIFICATION_MASK_TEMPLATE =
> {INPUT_BASE}/model_applications/precipitation/mask/CONUS_HRRRTLE.nc,
> {INPUT_BASE}/model_applications/precipitation/mask/EAST_HRRRTLE.nc,
> {INPUT_BASE}/model_applications/precipitation/mask/WEST_HRRRTLE.nc
>
> You should be able to set them the same way using
> ENSEMBLE_STAT_VERIFICATION_MASK_TEMPLATE. Let me know if that
doesn't work.
>
> - George
>
> On Tue, Jan 5, 2021 at 1:45 PM Binbin.Zhou at noaa.gov via RT <
> met_help at ucar.edu> wrote:
>
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116 >
>>
>> George,
>>
>> I got another issue for verification mask setting.
>>
>> I am using $VERIF_MASK in EnsembleStat config f/ile
>> mask = {
>> grid = [];
>> poly = [${VERIF_MASK}];
>> sid = [];
>> }
>>
>> And using GRID_STAT_VERIFICATION_MASK_TEMPLATE to define several
polygon
>> nc mask files
>> But it seems not working. But it works for Gridstat config in suich
>> setting.
>> I can not find ENSEMBLE_STAT_ VERIFICATION_MASK_TEMPLATE in the
METplus
>> doc
>>
>> So I define VERIF_MASK in [user_env_vars] part.
>> It values can not be passed to ploy = [${VERIF_MASK}] in the
EnsembleStat
>> conf if more than one nc files included.
>> For example
>> VERIF_MASK=" '/part/p1.cn', '/path/p2.nc' "
>> the error says poly = [/path/p1,]
>> It seems double quote or single quote can not be passed to
VERIF_MASK in
>> the EnsembleStat config.
>> I tried use back slash \ to before quote, but still not working
>>
>> Binbin
>>
>>
>> On Tue, Jan 5, 2021 at 10:33 AM Binbin Zhou - NOAA Affiliate <
>> binbin.zhou at noaa.gov> wrote:
>>
>> > George,
>> >
>> > Thanks for your quick response! I'll test this settings and
let
>> > you know the results.
>> >
>> > Binbin
>> >
>> > On Tue, Jan 5, 2021 at 10:17 AM George McCabe via RT
<met_help at ucar.edu
>> >
>> > wrote:
>> >
>> >> Hi Binbin,
>> >>
>> >> Happy New Year to you too!
>> >>
>> >> I will comment on each configuration variable and how to set it
in a
>> >> METplus config inline:
>> >>
>> >> ens = {
>> >> ens_thresh = 1.0;
>> >>
>> >>
>> >> *This is controlled by the ENSEMBLE_STAT_ENS_THRESH variable.
The
>> default
>> >> value is 1.0, so you don't need to include it in your config
file, but
>> you
>> >> can if you may adjust this value at some point.*
>> >>
>> >> vld_thresh = 1.0;
>> >>
>> >> *This value is set to 1.0 by default so we don't need to worry
about it
>> >> right now.*
>> >>
>> >> field = [
>> >>
>> >> {
>> >> name = "HGT";
>> >> level = "P500";
>> >> obs_thresh = [ <=CDP10, >CDP10&&<=CDP20,
>CDP20&&<=CDP30,
>> >> >CDP30&&<=CDP40, >CDP40&&<=CDP50, >CDP50&&<=CDP60,
>CDP60&&<=CDP70,
>> >> >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];
>> >> }
>> >> ]
>> >> }
>> >> fcst = ens;
>> >> obs = fcst;
>> >>
>> >> *1) The field info for ens is set in the
>> >> ENS_VAR<n>_[NAME/LEVEL/THRESH/OPTIONS] variables. The fcst and
obs
>> field
>> >> info are set in the corresponding FCST_VAR<n>_* and OBS_VAR<n>_*
>> variables
>> >> respectively, or you can use BOTH_VAR<n>_* if the FCST and OBS
values
>> are
>> >> the same.*
>> >>
>> >> *If ENS_VAR<n>_* variables are not explicitly set, then it will
use the
>> >> values from FCST_VAR<n>_*.*
>> >> *Since the fcst, obs, and ens are all the same you could just
use
>> >> BOTH_VAR<n>_* variables to control all 3, although keep in mind
that if
>> >> you
>> >> need to change one of them for any reason, it will be more
difficult
>> to do
>> >> this. If you know that they will always be the same values, then
I
>> >> recommend using BOTH_, but if you know they may change or are
unsure, I
>> >> would recommend setting them by referencing the other variables,
i.e.*
>> >>
>> >> *FCST_VAR1_NAME = HGT*
>> >> *FCST_VAR1_LEVELS = P500 *
>> >> *OBS_VAR1_NAME = {FCST_VAR1_NAME}*
>> >> *OBS_VAR1_LEVELS = {FCST_VAR1_LEVELS}*
>> >>
>> >> *2) The [FCST/OBS/ENS]_VAR<n>_THRESH variables set the
cat_thresh
>> values
>> >> in
>> >> the field info. A variable specific to obs_thresh is not
currently
>> >> supported, however you can set these values by using the
>> ENS_VAR1_OPTIONS
>> >> variable, i.e.*
>> >>
>> >> *ENS_VAR1_OPTIONS = obs_thresh = [ <=CDP10, >CDP10&&<=CDP20,
>> >> >CDP20&&<=CDP30, >CDP30&&<=CDP40, >CDP40&&<=CDP50,
>CDP50&&<=CDP60,
>> >> >CDP60&&<=CDP70, >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];*
>> >>
>> >>
>> >> *Remember to include the semicolon at the end! *
>> >>
>> >> ens_ssvar_bin_size = 1000000;
>> >> *1) This variable is different from the default and not
currently
>> >> supported
>> >> with a METplus config variable. I will add this to the list of
>> variables
>> >> in
>> >> MET config files that we want to support. However, in the
meantime you
>> can
>> >> copy the default wrapped MET config file and modify it to fit
your
>> needs.
>> >> To do this, you will need to:*
>> >>
>> >> * a) Copy METplus/parm/met_config/EnsembleStatConfig_wrapped to
the
>> >> directory that contains your METplus config file for this use
case.
>> Rename
>> >> it by replacing "wrapped" with a short description that pertains
to
>> your
>> >> use case.*
>> >>
>> >> * b) In your METplus config file, change the value of
>> >> ENSEMBLE_STAT_CONFIG_FILE to point to the path of this new
config
>> file.*
>> >>
>> >> * c) If you know the value you want to use for this variable
will
>> always
>> >> be 1000000, then simply set the variable to that value. If you
think
>> you
>> >> may want to change the value, then you can utilize the
[user_env_vars]
>> >> functionality. See:
>> >>
>> >>
>>
https://dtcenter.github.io/METplus/latest/Users_Guide/systemconfiguration.html#user-
defined-config
>> >> <
>> >>
>>
https://dtcenter.github.io/METplus/latest/Users_Guide/systemconfiguration.html#user-
defined-config
>> >> >*
>> >> *In this case, you would add the following to your METplus
config:*
>> >>
>> >> *[user_env_vars]*
>> >> *ENS_SSVAR_BIN_SIZE = 1000000*
>> >>
>> >> *Then change the line in your EnsembleStat config file that you
copied
>> >> to:*
>> >>
>> >> * ens_ssvar_bin_size = ${ENS_SSVAR_BIN_SIZE}; *
>> >>
>> >> ens_phist_bin_size = 0.05;
>> >> *This variable uses the default value, so you don't need to do
anything
>> >> here. If you need to make it configurable or change the value,
then
>> follow
>> >> the instructions for setting ens_ssvar_bin_size.*
>> >>
>> >> climo_mean = fcst;
>> >> climo_mean = {
>> >> file_name = "${CLIM_MEAN}";
>> >> time_interp_method = DW_MEAN;
>> >> match_day = TRUE;
>> >> time_step = 21600;
>> >> }
>> >>
>> >>
>> >> *Instead of using CLIM_MEAN, you can set
>> >> ENSEMBLE_STAT_CLIMO_MEAN_INPUT_[DIR/TEMPLATE] in the METplus
config.
>> You
>> >> can use filename template syntax in the _TEMPLATE value, i.e.
>> >> {valid?fmt=%m%d}. The other variables in the climo_mean
dictionary are
>> >> actually old variables that have been replaced with day_interval
and
>> >> hour_interval, but the values you use are the old defaults, so
you
>> >> shouldn't need to set them.*
>> >>
>> >> climo_stdev = climo_mean;
>> >> climo_stdev = {
>> >> file_name = "${CLIM_STDV}";
>> >> }
>> >>
>> >> *Similarly to CLIM_MEAN, you can use
>> >> ENSEMBLE_STAT_CLIMO_STDEV_INPUT_[DIR/TEMPLATE] to set this file
name.*
>> >>
>> >> climo_cdf = {
>> >> cdf_bins = 11;
>> >> center_bins = TRUE;
>> >> write_bins = TRUE;
>> >> }
>> >> *The value for write_bins is the default, but the values for
cdf_bins
>> and
>> >> center_bins do not. To set these, follow the above instructions
for
>> >> ens_ssvar_bin_size to override them and/or make them
configurable
>> through
>> >> METplus. I will also add these variables to the list of MET
configs
>> that
>> >> users want to be able to easily configure through METplus
configs.*
>> >>
>> >> Please let me know if you run into any issues setting any of
that up.
>> >> Also,
>> >> if there are any other MET config variables that you want to see
>> supported
>> >> in METplus, let me know and I will make sure they get included
when we
>> >> have
>> >> a chance to refactor those wrappers. It is possible to add
support for
>> MET
>> >> configs using the above instructions, but it is always easier
and less
>> >> error-prone to have them configurable directly through a
variable in
>> the
>> >> METplus config.
>> >>
>> >> Thanks,
>> >> George
>> >>
>> >> On Tue, Jan 5, 2021 at 7:14 AM Binbin.Zhou at noaa.gov via RT <
>> >> met_help at ucar.edu> wrote:
>> >>
>> >> >
>> >> > Tue Jan 05 07:14:54 2021: Request 98116 was acted upon.
>> >> > Transaction: Ticket created by Binbin.Zhou at noaa.gov
>> >> > Queue: met_help
>> >> > Subject: CDP threshold setting in EnsembleStat conf
>> >> > Owner: Nobody
>> >> > Requestors: Binbin.Zhou at noaa.gov
>> >> > Status: new
>> >> > Ticket <URL:
>> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116 >
>> >> >
>> >> >
>> >> > George,
>> >> >
>> >> > Happy New Year!
>> >> >
>> >> > I am working on transition of our MET-based global ensemble
>> >> verification
>> >> > to METplus based package. In this package climatology bins (10
bins)
>> are
>> >> > used.
>> >> > In current ensemble stat config file, the relevant entries
iare
>> defined
>> >> > like following
>> >> >
>> >> > ens = {
>> >> > ens_thresh = 1.0;
>> >> > vld_thresh = 1.0;
>> >> >
>> >> > field = [
>> >> >
>> >> > {
>> >> > name = "HGT";
>> >> > level = "P500";
>> >> > obs_thresh = [ <=CDP10, >CDP10&&<=CDP20,
>CDP20&&<=CDP30,
>> >> > >CDP30&&<=CDP40, >CDP40&&<=CDP50, >CDP50&&<=CDP60,
>CDP60&&<=CDP70,
>> >> > >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];
>> >> > }
>> >> > ]
>> >> > }
>> >> > fcst = ens;
>> >> > obs = fcst;
>> >> > ens_ssvar_bin_size = 1000000;
>> >> > ens_phist_bin_size = 0.05;
>> >> > climo_mean = fcst;
>> >> > climo_mean = {
>> >> > file_name = "${CLIM_MEAN}";
>> >> > time_interp_method = DW_MEAN;
>> >> > match_day = TRUE;
>> >> > time_step = 21600;
>> >> > }
>> >> >
>> >> > climo_stdev = climo_mean;
>> >> > climo_stdev = {
>> >> > file_name = "${CLIM_STDV}";
>> >> > }
>> >> >
>> >> > climo_cdf = {
>> >> > cdf_bins = 11;
>> >> > center_bins = TRUE;
>> >> > write_bins = TRUE;
>> >> > }
>> >> >
>> >> > I can not find the correspondent settings in its conf file
from
>> METplus
>> >> > online doc.
>> >> > Can you help me look at this?
>> >> >
>> >> > Thanks!
>> >> >
>> >> > Binbin
>> >> >
>> >> > --
>> >> >
>> >> > Binbin Zhou
>> >> >
>> >> > IMSG at NOAA/NWS/NCEP/EMC
>> >> >
>> >> > 5830 University Research Ct.
>> >> >
>> >> > College Park, MD 20740
>> >> >
>> >> > Binbin.Zhou at noaa.gov
>> >> >
>> >> > 301-683-3683
>> >> >
>> >> >
>> >>
>> >> --
>> >> George McCabe - Software Engineer III
>> >> National Center for Atmospheric Research
>> >> Research Applications Laboratory
>> >> 303-497-2768
>> >> ---
>> >> My working day may not be your working day. Please do not feel
obliged
>> to
>> >> reply to this email outside of your normal working hours.
>> >>
>> >>
>> >
>> > --
>> >
>> > Binbin Zhou
>> >
>> > IMSG at NOAA/NWS/NCEP/EMC
>> >
>> > 5830 University Research Ct.
>> >
>> > College Park, MD 20740
>> >
>> > Binbin.Zhou at noaa.gov
>> >
>> > 301-683-3683
>> >
>>
>>
>> --
>>
>> Binbin Zhou
>>
>> IMSG at NOAA/NWS/NCEP/EMC
>>
>> 5830 University Research Ct.
>>
>> College Park, MD 20740
>>
>> Binbin.Zhou at noaa.gov
>>
>> 301-683-3683
>>
>>
>
> --
> George McCabe - Software Engineer III
> National Center for Atmospheric Research
> Research Applications Laboratory
> 303-497-2768
> ---
> My working day may not be your working day. Please do not feel
obliged to
> reply to this email outside of your normal working hours.
>
--
George McCabe - Software Engineer III
National Center for Atmospheric Research
Research Applications Laboratory
303-497-2768
---
My working day may not be your working day. Please do not feel obliged
to
reply to this email outside of your normal working hours.
------------------------------------------------
Subject: CDP threshold setting in EnsembleStat conf
From: Binbin.Zhou at noaa.gov
Time: Tue Jan 05 14:25:45 2021
George,
Still not working, error says
ERROR : replace_env() -> unable to get value for environment
variable
"VERIF_MASK"
Binbin
On Tue, Jan 5, 2021 at 3:50 PM George McCabe via RT
<met_help at ucar.edu>
wrote:
> Hi Binbin,
>
> You should be able to set it in the METplus config the same way it
is done
> for GridStat -- no quotes with commas between each item. The wrapper
should
> format it properly.
>
> Here is an example from an existing use case:
>
> GRID_STAT_VERIFICATION_MASK_TEMPLATE =
> {INPUT_BASE}/model_applications/precipitation/mask/CONUS_HRRRTLE.nc,
> {INPUT_BASE}/model_applications/precipitation/mask/EAST_HRRRTLE.nc,
> {INPUT_BASE}/model_applications/precipitation/mask/WEST_HRRRTLE.nc
>
> You should be able to set them the same way using
> ENSEMBLE_STAT_VERIFICATION_MASK_TEMPLATE. Let me know if that
doesn't work.
>
> - George
>
> On Tue, Jan 5, 2021 at 1:45 PM Binbin.Zhou at noaa.gov via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116 >
> >
> > George,
> >
> > I got another issue for verification mask setting.
> >
> > I am using $VERIF_MASK in EnsembleStat config f/ile
> > mask = {
> > grid = [];
> > poly = [${VERIF_MASK}];
> > sid = [];
> > }
> >
> > And using GRID_STAT_VERIFICATION_MASK_TEMPLATE to define several
polygon
> > nc mask files
> > But it seems not working. But it works for Gridstat config in
suich
> > setting.
> > I can not find ENSEMBLE_STAT_ VERIFICATION_MASK_TEMPLATE in the
METplus
> doc
> >
> > So I define VERIF_MASK in [user_env_vars] part.
> > It values can not be passed to ploy = [${VERIF_MASK}] in the
EnsembleStat
> > conf if more than one nc files included.
> > For example
> > VERIF_MASK=" '/part/p1.cn', '/path/p2.nc' "
> > the error says poly = [/path/p1,]
> > It seems double quote or single quote can not be passed to
VERIF_MASK in
> > the EnsembleStat config.
> > I tried use back slash \ to before quote, but still not working
> >
> > Binbin
> >
> >
> > On Tue, Jan 5, 2021 at 10:33 AM Binbin Zhou - NOAA Affiliate <
> > binbin.zhou at noaa.gov> wrote:
> >
> > > George,
> > >
> > > Thanks for your quick response! I'll test this settings and
let
> > > you know the results.
> > >
> > > Binbin
> > >
> > > On Tue, Jan 5, 2021 at 10:17 AM George McCabe via RT <
> met_help at ucar.edu>
> > > wrote:
> > >
> > >> Hi Binbin,
> > >>
> > >> Happy New Year to you too!
> > >>
> > >> I will comment on each configuration variable and how to set it
in a
> > >> METplus config inline:
> > >>
> > >> ens = {
> > >> ens_thresh = 1.0;
> > >>
> > >>
> > >> *This is controlled by the ENSEMBLE_STAT_ENS_THRESH variable.
The
> > default
> > >> value is 1.0, so you don't need to include it in your config
file, but
> > you
> > >> can if you may adjust this value at some point.*
> > >>
> > >> vld_thresh = 1.0;
> > >>
> > >> *This value is set to 1.0 by default so we don't need to worry
about
> it
> > >> right now.*
> > >>
> > >> field = [
> > >>
> > >> {
> > >> name = "HGT";
> > >> level = "P500";
> > >> obs_thresh = [ <=CDP10, >CDP10&&<=CDP20,
>CDP20&&<=CDP30,
> > >> >CDP30&&<=CDP40, >CDP40&&<=CDP50, >CDP50&&<=CDP60,
>CDP60&&<=CDP70,
> > >> >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];
> > >> }
> > >> ]
> > >> }
> > >> fcst = ens;
> > >> obs = fcst;
> > >>
> > >> *1) The field info for ens is set in the
> > >> ENS_VAR<n>_[NAME/LEVEL/THRESH/OPTIONS] variables. The fcst and
obs
> field
> > >> info are set in the corresponding FCST_VAR<n>_* and
OBS_VAR<n>_*
> > variables
> > >> respectively, or you can use BOTH_VAR<n>_* if the FCST and OBS
values
> > are
> > >> the same.*
> > >>
> > >> *If ENS_VAR<n>_* variables are not explicitly set, then it will
use
> the
> > >> values from FCST_VAR<n>_*.*
> > >> *Since the fcst, obs, and ens are all the same you could just
use
> > >> BOTH_VAR<n>_* variables to control all 3, although keep in mind
that
> if
> > >> you
> > >> need to change one of them for any reason, it will be more
difficult
> to
> > do
> > >> this. If you know that they will always be the same values,
then I
> > >> recommend using BOTH_, but if you know they may change or are
unsure,
> I
> > >> would recommend setting them by referencing the other
variables, i.e.*
> > >>
> > >> *FCST_VAR1_NAME = HGT*
> > >> *FCST_VAR1_LEVELS = P500 *
> > >> *OBS_VAR1_NAME = {FCST_VAR1_NAME}*
> > >> *OBS_VAR1_LEVELS = {FCST_VAR1_LEVELS}*
> > >>
> > >> *2) The [FCST/OBS/ENS]_VAR<n>_THRESH variables set the
cat_thresh
> values
> > >> in
> > >> the field info. A variable specific to obs_thresh is not
currently
> > >> supported, however you can set these values by using the
> > ENS_VAR1_OPTIONS
> > >> variable, i.e.*
> > >>
> > >> *ENS_VAR1_OPTIONS = obs_thresh = [ <=CDP10, >CDP10&&<=CDP20,
> > >> >CDP20&&<=CDP30, >CDP30&&<=CDP40, >CDP40&&<=CDP50,
>CDP50&&<=CDP60,
> > >> >CDP60&&<=CDP70, >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];*
> > >>
> > >>
> > >> *Remember to include the semicolon at the end! *
> > >>
> > >> ens_ssvar_bin_size = 1000000;
> > >> *1) This variable is different from the default and not
currently
> > >> supported
> > >> with a METplus config variable. I will add this to the list of
> variables
> > >> in
> > >> MET config files that we want to support. However, in the
meantime you
> > can
> > >> copy the default wrapped MET config file and modify it to fit
your
> > needs.
> > >> To do this, you will need to:*
> > >>
> > >> * a) Copy METplus/parm/met_config/EnsembleStatConfig_wrapped
to the
> > >> directory that contains your METplus config file for this use
case.
> > Rename
> > >> it by replacing "wrapped" with a short description that
pertains to
> your
> > >> use case.*
> > >>
> > >> * b) In your METplus config file, change the value of
> > >> ENSEMBLE_STAT_CONFIG_FILE to point to the path of this new
config
> file.*
> > >>
> > >> * c) If you know the value you want to use for this variable
will
> > always
> > >> be 1000000, then simply set the variable to that value. If you
think
> you
> > >> may want to change the value, then you can utilize the
[user_env_vars]
> > >> functionality. See:
> > >>
> > >>
> >
>
https://dtcenter.github.io/METplus/latest/Users_Guide/systemconfiguration.html#user-
defined-config
> > >> <
> > >>
> >
>
https://dtcenter.github.io/METplus/latest/Users_Guide/systemconfiguration.html#user-
defined-config
> > >> >*
> > >> *In this case, you would add the following to your METplus
config:*
> > >>
> > >> *[user_env_vars]*
> > >> *ENS_SSVAR_BIN_SIZE = 1000000*
> > >>
> > >> *Then change the line in your EnsembleStat config file that you
copied
> > >> to:*
> > >>
> > >> * ens_ssvar_bin_size = ${ENS_SSVAR_BIN_SIZE}; *
> > >>
> > >> ens_phist_bin_size = 0.05;
> > >> *This variable uses the default value, so you don't need to do
> anything
> > >> here. If you need to make it configurable or change the value,
then
> > follow
> > >> the instructions for setting ens_ssvar_bin_size.*
> > >>
> > >> climo_mean = fcst;
> > >> climo_mean = {
> > >> file_name = "${CLIM_MEAN}";
> > >> time_interp_method = DW_MEAN;
> > >> match_day = TRUE;
> > >> time_step = 21600;
> > >> }
> > >>
> > >>
> > >> *Instead of using CLIM_MEAN, you can set
> > >> ENSEMBLE_STAT_CLIMO_MEAN_INPUT_[DIR/TEMPLATE] in the METplus
config.
> You
> > >> can use filename template syntax in the _TEMPLATE value, i.e.
> > >> {valid?fmt=%m%d}. The other variables in the climo_mean
dictionary are
> > >> actually old variables that have been replaced with
day_interval and
> > >> hour_interval, but the values you use are the old defaults, so
you
> > >> shouldn't need to set them.*
> > >>
> > >> climo_stdev = climo_mean;
> > >> climo_stdev = {
> > >> file_name = "${CLIM_STDV}";
> > >> }
> > >>
> > >> *Similarly to CLIM_MEAN, you can use
> > >> ENSEMBLE_STAT_CLIMO_STDEV_INPUT_[DIR/TEMPLATE] to set this file
name.*
> > >>
> > >> climo_cdf = {
> > >> cdf_bins = 11;
> > >> center_bins = TRUE;
> > >> write_bins = TRUE;
> > >> }
> > >> *The value for write_bins is the default, but the values for
cdf_bins
> > and
> > >> center_bins do not. To set these, follow the above instructions
for
> > >> ens_ssvar_bin_size to override them and/or make them
configurable
> > through
> > >> METplus. I will also add these variables to the list of MET
configs
> that
> > >> users want to be able to easily configure through METplus
configs.*
> > >>
> > >> Please let me know if you run into any issues setting any of
that up.
> > >> Also,
> > >> if there are any other MET config variables that you want to
see
> > supported
> > >> in METplus, let me know and I will make sure they get included
when we
> > >> have
> > >> a chance to refactor those wrappers. It is possible to add
support for
> > MET
> > >> configs using the above instructions, but it is always easier
and less
> > >> error-prone to have them configurable directly through a
variable in
> the
> > >> METplus config.
> > >>
> > >> Thanks,
> > >> George
> > >>
> > >> On Tue, Jan 5, 2021 at 7:14 AM Binbin.Zhou at noaa.gov via RT <
> > >> met_help at ucar.edu> wrote:
> > >>
> > >> >
> > >> > Tue Jan 05 07:14:54 2021: Request 98116 was acted upon.
> > >> > Transaction: Ticket created by Binbin.Zhou at noaa.gov
> > >> > Queue: met_help
> > >> > Subject: CDP threshold setting in EnsembleStat conf
> > >> > Owner: Nobody
> > >> > Requestors: Binbin.Zhou at noaa.gov
> > >> > Status: new
> > >> > Ticket <URL:
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
> > >
> > >> >
> > >> >
> > >> > George,
> > >> >
> > >> > Happy New Year!
> > >> >
> > >> > I am working on transition of our MET-based global
ensemble
> > >> verification
> > >> > to METplus based package. In this package climatology bins
(10 bins)
> > are
> > >> > used.
> > >> > In current ensemble stat config file, the relevant entries
iare
> > defined
> > >> > like following
> > >> >
> > >> > ens = {
> > >> > ens_thresh = 1.0;
> > >> > vld_thresh = 1.0;
> > >> >
> > >> > field = [
> > >> >
> > >> > {
> > >> > name = "HGT";
> > >> > level = "P500";
> > >> > obs_thresh = [ <=CDP10, >CDP10&&<=CDP20,
>CDP20&&<=CDP30,
> > >> > >CDP30&&<=CDP40, >CDP40&&<=CDP50, >CDP50&&<=CDP60,
>CDP60&&<=CDP70,
> > >> > >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];
> > >> > }
> > >> > ]
> > >> > }
> > >> > fcst = ens;
> > >> > obs = fcst;
> > >> > ens_ssvar_bin_size = 1000000;
> > >> > ens_phist_bin_size = 0.05;
> > >> > climo_mean = fcst;
> > >> > climo_mean = {
> > >> > file_name = "${CLIM_MEAN}";
> > >> > time_interp_method = DW_MEAN;
> > >> > match_day = TRUE;
> > >> > time_step = 21600;
> > >> > }
> > >> >
> > >> > climo_stdev = climo_mean;
> > >> > climo_stdev = {
> > >> > file_name = "${CLIM_STDV}";
> > >> > }
> > >> >
> > >> > climo_cdf = {
> > >> > cdf_bins = 11;
> > >> > center_bins = TRUE;
> > >> > write_bins = TRUE;
> > >> > }
> > >> >
> > >> > I can not find the correspondent settings in its conf file
from
> > METplus
> > >> > online doc.
> > >> > Can you help me look at this?
> > >> >
> > >> > Thanks!
> > >> >
> > >> > Binbin
> > >> >
> > >> > --
> > >> >
> > >> > Binbin Zhou
> > >> >
> > >> > IMSG at NOAA/NWS/NCEP/EMC
> > >> >
> > >> > 5830 University Research Ct.
> > >> >
> > >> > College Park, MD 20740
> > >> >
> > >> > Binbin.Zhou at noaa.gov
> > >> >
> > >> > 301-683-3683
> > >> >
> > >> >
> > >>
> > >> --
> > >> George McCabe - Software Engineer III
> > >> National Center for Atmospheric Research
> > >> Research Applications Laboratory
> > >> 303-497-2768
> > >> ---
> > >> My working day may not be your working day. Please do not feel
obliged
> > to
> > >> reply to this email outside of your normal working hours.
> > >>
> > >>
> > >
> > > --
> > >
> > > Binbin Zhou
> > >
> > > IMSG at NOAA/NWS/NCEP/EMC
> > >
> > > 5830 University Research Ct.
> > >
> > > College Park, MD 20740
> > >
> > > Binbin.Zhou at noaa.gov
> > >
> > > 301-683-3683
> > >
> >
> >
> > --
> >
> > Binbin Zhou
> >
> > IMSG at NOAA/NWS/NCEP/EMC
> >
> > 5830 University Research Ct.
> >
> > College Park, MD 20740
> >
> > Binbin.Zhou at noaa.gov
> >
> > 301-683-3683
> >
> >
>
> --
> George McCabe - Software Engineer III
> National Center for Atmospheric Research
> Research Applications Laboratory
> 303-497-2768
> ---
> My working day may not be your working day. Please do not feel
obliged to
> reply to this email outside of your normal working hours.
>
>
--
Binbin Zhou
IMSG at NOAA/NWS/NCEP/EMC
5830 University Research Ct.
College Park, MD 20740
Binbin.Zhou at noaa.gov
301-683-3683
------------------------------------------------
Subject: CDP threshold setting in EnsembleStat conf
From: Binbin.Zhou at noaa.gov
Time: Tue Jan 05 14:52:46 2021
George,
I have a temporal solution:
set ploy in EnembleStat config as
poly = [ "${MASKPATH}/lat_NHM.nc",
"${MASKPATH}/lat_NHM.nc",
"${MASKPATH}/lat_TRP.nc" ];
then set MASKPATH in user_env_vars part in the conf file
This MASKPAH then can be passed to EnsembleStat's poly [ ] entry
Binbin
On Tue, Jan 5, 2021 at 4:25 PM Binbin Zhou - NOAA Affiliate <
binbin.zhou at noaa.gov> wrote:
> George,
>
> Still not working, error says
> ERROR : replace_env() -> unable to get value for environment
variable
> "VERIF_MASK"
>
> Binbin
>
>
>
> On Tue, Jan 5, 2021 at 3:50 PM George McCabe via RT
<met_help at ucar.edu>
> wrote:
>
>> Hi Binbin,
>>
>> You should be able to set it in the METplus config the same way it
is done
>> for GridStat -- no quotes with commas between each item. The
wrapper
>> should
>> format it properly.
>>
>> Here is an example from an existing use case:
>>
>> GRID_STAT_VERIFICATION_MASK_TEMPLATE =
>>
{INPUT_BASE}/model_applications/precipitation/mask/CONUS_HRRRTLE.nc,
>> {INPUT_BASE}/model_applications/precipitation/mask/EAST_HRRRTLE.nc,
>> {INPUT_BASE}/model_applications/precipitation/mask/WEST_HRRRTLE.nc
>>
>> You should be able to set them the same way using
>> ENSEMBLE_STAT_VERIFICATION_MASK_TEMPLATE. Let me know if that
doesn't
>> work.
>>
>> - George
>>
>> On Tue, Jan 5, 2021 at 1:45 PM Binbin.Zhou at noaa.gov via RT <
>> met_help at ucar.edu> wrote:
>>
>> >
>> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116 >
>> >
>> > George,
>> >
>> > I got another issue for verification mask setting.
>> >
>> > I am using $VERIF_MASK in EnsembleStat config f/ile
>> > mask = {
>> > grid = [];
>> > poly = [${VERIF_MASK}];
>> > sid = [];
>> > }
>> >
>> > And using GRID_STAT_VERIFICATION_MASK_TEMPLATE to define several
>> polygon
>> > nc mask files
>> > But it seems not working. But it works for Gridstat config in
suich
>> > setting.
>> > I can not find ENSEMBLE_STAT_ VERIFICATION_MASK_TEMPLATE in the
METplus
>> doc
>> >
>> > So I define VERIF_MASK in [user_env_vars] part.
>> > It values can not be passed to ploy = [${VERIF_MASK}] in the
>> EnsembleStat
>> > conf if more than one nc files included.
>> > For example
>> > VERIF_MASK=" '/part/p1.cn', '/path/p2.nc' "
>> > the error says poly = [/path/p1,]
>> > It seems double quote or single quote can not be passed to
VERIF_MASK in
>> > the EnsembleStat config.
>> > I tried use back slash \ to before quote, but still not working
>> >
>> > Binbin
>> >
>> >
>> > On Tue, Jan 5, 2021 at 10:33 AM Binbin Zhou - NOAA Affiliate <
>> > binbin.zhou at noaa.gov> wrote:
>> >
>> > > George,
>> > >
>> > > Thanks for your quick response! I'll test this settings and
let
>> > > you know the results.
>> > >
>> > > Binbin
>> > >
>> > > On Tue, Jan 5, 2021 at 10:17 AM George McCabe via RT <
>> met_help at ucar.edu>
>> > > wrote:
>> > >
>> > >> Hi Binbin,
>> > >>
>> > >> Happy New Year to you too!
>> > >>
>> > >> I will comment on each configuration variable and how to set
it in a
>> > >> METplus config inline:
>> > >>
>> > >> ens = {
>> > >> ens_thresh = 1.0;
>> > >>
>> > >>
>> > >> *This is controlled by the ENSEMBLE_STAT_ENS_THRESH variable.
The
>> > default
>> > >> value is 1.0, so you don't need to include it in your config
file,
>> but
>> > you
>> > >> can if you may adjust this value at some point.*
>> > >>
>> > >> vld_thresh = 1.0;
>> > >>
>> > >> *This value is set to 1.0 by default so we don't need to worry
about
>> it
>> > >> right now.*
>> > >>
>> > >> field = [
>> > >>
>> > >> {
>> > >> name = "HGT";
>> > >> level = "P500";
>> > >> obs_thresh = [ <=CDP10, >CDP10&&<=CDP20,
>CDP20&&<=CDP30,
>> > >> >CDP30&&<=CDP40, >CDP40&&<=CDP50, >CDP50&&<=CDP60,
>CDP60&&<=CDP70,
>> > >> >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];
>> > >> }
>> > >> ]
>> > >> }
>> > >> fcst = ens;
>> > >> obs = fcst;
>> > >>
>> > >> *1) The field info for ens is set in the
>> > >> ENS_VAR<n>_[NAME/LEVEL/THRESH/OPTIONS] variables. The fcst and
obs
>> field
>> > >> info are set in the corresponding FCST_VAR<n>_* and
OBS_VAR<n>_*
>> > variables
>> > >> respectively, or you can use BOTH_VAR<n>_* if the FCST and OBS
values
>> > are
>> > >> the same.*
>> > >>
>> > >> *If ENS_VAR<n>_* variables are not explicitly set, then it
will use
>> the
>> > >> values from FCST_VAR<n>_*.*
>> > >> *Since the fcst, obs, and ens are all the same you could just
use
>> > >> BOTH_VAR<n>_* variables to control all 3, although keep in
mind that
>> if
>> > >> you
>> > >> need to change one of them for any reason, it will be more
difficult
>> to
>> > do
>> > >> this. If you know that they will always be the same values,
then I
>> > >> recommend using BOTH_, but if you know they may change or are
>> unsure, I
>> > >> would recommend setting them by referencing the other
variables,
>> i.e.*
>> > >>
>> > >> *FCST_VAR1_NAME = HGT*
>> > >> *FCST_VAR1_LEVELS = P500 *
>> > >> *OBS_VAR1_NAME = {FCST_VAR1_NAME}*
>> > >> *OBS_VAR1_LEVELS = {FCST_VAR1_LEVELS}*
>> > >>
>> > >> *2) The [FCST/OBS/ENS]_VAR<n>_THRESH variables set the
cat_thresh
>> values
>> > >> in
>> > >> the field info. A variable specific to obs_thresh is not
currently
>> > >> supported, however you can set these values by using the
>> > ENS_VAR1_OPTIONS
>> > >> variable, i.e.*
>> > >>
>> > >> *ENS_VAR1_OPTIONS = obs_thresh = [ <=CDP10, >CDP10&&<=CDP20,
>> > >> >CDP20&&<=CDP30, >CDP30&&<=CDP40, >CDP40&&<=CDP50,
>CDP50&&<=CDP60,
>> > >> >CDP60&&<=CDP70, >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];*
>> > >>
>> > >>
>> > >> *Remember to include the semicolon at the end! *
>> > >>
>> > >> ens_ssvar_bin_size = 1000000;
>> > >> *1) This variable is different from the default and not
currently
>> > >> supported
>> > >> with a METplus config variable. I will add this to the list of
>> variables
>> > >> in
>> > >> MET config files that we want to support. However, in the
meantime
>> you
>> > can
>> > >> copy the default wrapped MET config file and modify it to fit
your
>> > needs.
>> > >> To do this, you will need to:*
>> > >>
>> > >> * a) Copy METplus/parm/met_config/EnsembleStatConfig_wrapped
to the
>> > >> directory that contains your METplus config file for this use
case.
>> > Rename
>> > >> it by replacing "wrapped" with a short description that
pertains to
>> your
>> > >> use case.*
>> > >>
>> > >> * b) In your METplus config file, change the value of
>> > >> ENSEMBLE_STAT_CONFIG_FILE to point to the path of this new
config
>> file.*
>> > >>
>> > >> * c) If you know the value you want to use for this variable
will
>> > always
>> > >> be 1000000, then simply set the variable to that value. If you
think
>> you
>> > >> may want to change the value, then you can utilize the
>> [user_env_vars]
>> > >> functionality. See:
>> > >>
>> > >>
>> >
>>
https://dtcenter.github.io/METplus/latest/Users_Guide/systemconfiguration.html#user-
defined-config
>> > >> <
>> > >>
>> >
>>
https://dtcenter.github.io/METplus/latest/Users_Guide/systemconfiguration.html#user-
defined-config
>> > >> >*
>> > >> *In this case, you would add the following to your METplus
config:*
>> > >>
>> > >> *[user_env_vars]*
>> > >> *ENS_SSVAR_BIN_SIZE = 1000000*
>> > >>
>> > >> *Then change the line in your EnsembleStat config file that
you
>> copied
>> > >> to:*
>> > >>
>> > >> * ens_ssvar_bin_size = ${ENS_SSVAR_BIN_SIZE}; *
>> > >>
>> > >> ens_phist_bin_size = 0.05;
>> > >> *This variable uses the default value, so you don't need to do
>> anything
>> > >> here. If you need to make it configurable or change the value,
then
>> > follow
>> > >> the instructions for setting ens_ssvar_bin_size.*
>> > >>
>> > >> climo_mean = fcst;
>> > >> climo_mean = {
>> > >> file_name = "${CLIM_MEAN}";
>> > >> time_interp_method = DW_MEAN;
>> > >> match_day = TRUE;
>> > >> time_step = 21600;
>> > >> }
>> > >>
>> > >>
>> > >> *Instead of using CLIM_MEAN, you can set
>> > >> ENSEMBLE_STAT_CLIMO_MEAN_INPUT_[DIR/TEMPLATE] in the METplus
config.
>> You
>> > >> can use filename template syntax in the _TEMPLATE value, i.e.
>> > >> {valid?fmt=%m%d}. The other variables in the climo_mean
dictionary
>> are
>> > >> actually old variables that have been replaced with
day_interval and
>> > >> hour_interval, but the values you use are the old defaults, so
you
>> > >> shouldn't need to set them.*
>> > >>
>> > >> climo_stdev = climo_mean;
>> > >> climo_stdev = {
>> > >> file_name = "${CLIM_STDV}";
>> > >> }
>> > >>
>> > >> *Similarly to CLIM_MEAN, you can use
>> > >> ENSEMBLE_STAT_CLIMO_STDEV_INPUT_[DIR/TEMPLATE] to set this
file
>> name.*
>> > >>
>> > >> climo_cdf = {
>> > >> cdf_bins = 11;
>> > >> center_bins = TRUE;
>> > >> write_bins = TRUE;
>> > >> }
>> > >> *The value for write_bins is the default, but the values for
cdf_bins
>> > and
>> > >> center_bins do not. To set these, follow the above
instructions for
>> > >> ens_ssvar_bin_size to override them and/or make them
configurable
>> > through
>> > >> METplus. I will also add these variables to the list of MET
configs
>> that
>> > >> users want to be able to easily configure through METplus
configs.*
>> > >>
>> > >> Please let me know if you run into any issues setting any of
that up.
>> > >> Also,
>> > >> if there are any other MET config variables that you want to
see
>> > supported
>> > >> in METplus, let me know and I will make sure they get included
when
>> we
>> > >> have
>> > >> a chance to refactor those wrappers. It is possible to add
support
>> for
>> > MET
>> > >> configs using the above instructions, but it is always easier
and
>> less
>> > >> error-prone to have them configurable directly through a
variable in
>> the
>> > >> METplus config.
>> > >>
>> > >> Thanks,
>> > >> George
>> > >>
>> > >> On Tue, Jan 5, 2021 at 7:14 AM Binbin.Zhou at noaa.gov via RT <
>> > >> met_help at ucar.edu> wrote:
>> > >>
>> > >> >
>> > >> > Tue Jan 05 07:14:54 2021: Request 98116 was acted upon.
>> > >> > Transaction: Ticket created by Binbin.Zhou at noaa.gov
>> > >> > Queue: met_help
>> > >> > Subject: CDP threshold setting in EnsembleStat conf
>> > >> > Owner: Nobody
>> > >> > Requestors: Binbin.Zhou at noaa.gov
>> > >> > Status: new
>> > >> > Ticket <URL:
>> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
>> > >
>> > >> >
>> > >> >
>> > >> > George,
>> > >> >
>> > >> > Happy New Year!
>> > >> >
>> > >> > I am working on transition of our MET-based global
ensemble
>> > >> verification
>> > >> > to METplus based package. In this package climatology bins
(10
>> bins)
>> > are
>> > >> > used.
>> > >> > In current ensemble stat config file, the relevant entries
iare
>> > defined
>> > >> > like following
>> > >> >
>> > >> > ens = {
>> > >> > ens_thresh = 1.0;
>> > >> > vld_thresh = 1.0;
>> > >> >
>> > >> > field = [
>> > >> >
>> > >> > {
>> > >> > name = "HGT";
>> > >> > level = "P500";
>> > >> > obs_thresh = [ <=CDP10, >CDP10&&<=CDP20,
>CDP20&&<=CDP30,
>> > >> > >CDP30&&<=CDP40, >CDP40&&<=CDP50, >CDP50&&<=CDP60,
>CDP60&&<=CDP70,
>> > >> > >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];
>> > >> > }
>> > >> > ]
>> > >> > }
>> > >> > fcst = ens;
>> > >> > obs = fcst;
>> > >> > ens_ssvar_bin_size = 1000000;
>> > >> > ens_phist_bin_size = 0.05;
>> > >> > climo_mean = fcst;
>> > >> > climo_mean = {
>> > >> > file_name = "${CLIM_MEAN}";
>> > >> > time_interp_method = DW_MEAN;
>> > >> > match_day = TRUE;
>> > >> > time_step = 21600;
>> > >> > }
>> > >> >
>> > >> > climo_stdev = climo_mean;
>> > >> > climo_stdev = {
>> > >> > file_name = "${CLIM_STDV}";
>> > >> > }
>> > >> >
>> > >> > climo_cdf = {
>> > >> > cdf_bins = 11;
>> > >> > center_bins = TRUE;
>> > >> > write_bins = TRUE;
>> > >> > }
>> > >> >
>> > >> > I can not find the correspondent settings in its conf file
from
>> > METplus
>> > >> > online doc.
>> > >> > Can you help me look at this?
>> > >> >
>> > >> > Thanks!
>> > >> >
>> > >> > Binbin
>> > >> >
>> > >> > --
>> > >> >
>> > >> > Binbin Zhou
>> > >> >
>> > >> > IMSG at NOAA/NWS/NCEP/EMC
>> > >> >
>> > >> > 5830 University Research Ct.
>> > >> >
>> > >> > College Park, MD 20740
>> > >> >
>> > >> > Binbin.Zhou at noaa.gov
>> > >> >
>> > >> > 301-683-3683
>> > >> >
>> > >> >
>> > >>
>> > >> --
>> > >> George McCabe - Software Engineer III
>> > >> National Center for Atmospheric Research
>> > >> Research Applications Laboratory
>> > >> 303-497-2768
>> > >> ---
>> > >> My working day may not be your working day. Please do not feel
>> obliged
>> > to
>> > >> reply to this email outside of your normal working hours.
>> > >>
>> > >>
>> > >
>> > > --
>> > >
>> > > Binbin Zhou
>> > >
>> > > IMSG at NOAA/NWS/NCEP/EMC
>> > >
>> > > 5830 University Research Ct.
>> > >
>> > > College Park, MD 20740
>> > >
>> > > Binbin.Zhou at noaa.gov
>> > >
>> > > 301-683-3683
>> > >
>> >
>> >
>> > --
>> >
>> > Binbin Zhou
>> >
>> > IMSG at NOAA/NWS/NCEP/EMC
>> >
>> > 5830 University Research Ct.
>> >
>> > College Park, MD 20740
>> >
>> > Binbin.Zhou at noaa.gov
>> >
>> > 301-683-3683
>> >
>> >
>>
>> --
>> George McCabe - Software Engineer III
>> National Center for Atmospheric Research
>> Research Applications Laboratory
>> 303-497-2768
>> ---
>> My working day may not be your working day. Please do not feel
obliged to
>> reply to this email outside of your normal working hours.
>>
>>
>
> --
>
> Binbin Zhou
>
> IMSG at NOAA/NWS/NCEP/EMC
>
> 5830 University Research Ct.
>
> College Park, MD 20740
>
> Binbin.Zhou at noaa.gov
>
> 301-683-3683
>
--
Binbin Zhou
IMSG at NOAA/NWS/NCEP/EMC
5830 University Research Ct.
College Park, MD 20740
Binbin.Zhou at noaa.gov
301-683-3683
------------------------------------------------
Subject: CDP threshold setting in EnsembleStat conf
From: George McCabe
Time: Tue Jan 05 15:19:21 2021
Hi Binbin,
Your solution should work for now. It looks like although the METplus
variable does get read properly, the environment variable is not
actually
set by the EnsembleStat wrapper. I can make a note to add that for
4.0.0,
as it is an easy fix.
- George
On Tue, Jan 5, 2021 at 2:53 PM Binbin.Zhou at noaa.gov via RT <
met_help at ucar.edu> wrote:
> George,
>
> I have a temporal solution:
> set ploy in EnembleStat config as
> poly = [ "${MASKPATH}/lat_NHM.nc",
> "${MASKPATH}/lat_NHM.nc",
> "${MASKPATH}/lat_TRP.nc" ];
>
> then set MASKPATH in user_env_vars part in the conf file
> This MASKPAH then can be passed to EnsembleStat's poly [ ] entry
>
> Binbin
>
> On Tue, Jan 5, 2021 at 4:25 PM Binbin Zhou - NOAA Affiliate <
> binbin.zhou at noaa.gov> wrote:
>
> > George,
> >
> > Still not working, error says
> > ERROR : replace_env() -> unable to get value for environment
variable
> > "VERIF_MASK"
> >
> > Binbin
> >
> >
> >
> > On Tue, Jan 5, 2021 at 3:50 PM George McCabe via RT
<met_help at ucar.edu>
> > wrote:
> >
> >> Hi Binbin,
> >>
> >> You should be able to set it in the METplus config the same way
it is
> done
> >> for GridStat -- no quotes with commas between each item. The
wrapper
> >> should
> >> format it properly.
> >>
> >> Here is an example from an existing use case:
> >>
> >> GRID_STAT_VERIFICATION_MASK_TEMPLATE =
> >>
{INPUT_BASE}/model_applications/precipitation/mask/CONUS_HRRRTLE.nc,
> >>
{INPUT_BASE}/model_applications/precipitation/mask/EAST_HRRRTLE.nc,
> >>
{INPUT_BASE}/model_applications/precipitation/mask/WEST_HRRRTLE.nc
> >>
> >> You should be able to set them the same way using
> >> ENSEMBLE_STAT_VERIFICATION_MASK_TEMPLATE. Let me know if that
doesn't
> >> work.
> >>
> >> - George
> >>
> >> On Tue, Jan 5, 2021 at 1:45 PM Binbin.Zhou at noaa.gov via RT <
> >> met_help at ucar.edu> wrote:
> >>
> >> >
> >> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116 >
> >> >
> >> > George,
> >> >
> >> > I got another issue for verification mask setting.
> >> >
> >> > I am using $VERIF_MASK in EnsembleStat config f/ile
> >> > mask = {
> >> > grid = [];
> >> > poly = [${VERIF_MASK}];
> >> > sid = [];
> >> > }
> >> >
> >> > And using GRID_STAT_VERIFICATION_MASK_TEMPLATE to define
several
> >> polygon
> >> > nc mask files
> >> > But it seems not working. But it works for Gridstat config in
suich
> >> > setting.
> >> > I can not find ENSEMBLE_STAT_ VERIFICATION_MASK_TEMPLATE in the
> METplus
> >> doc
> >> >
> >> > So I define VERIF_MASK in [user_env_vars] part.
> >> > It values can not be passed to ploy = [${VERIF_MASK}] in the
> >> EnsembleStat
> >> > conf if more than one nc files included.
> >> > For example
> >> > VERIF_MASK=" '/part/p1.cn', '/path/p2.nc' "
> >> > the error says poly = [/path/p1,]
> >> > It seems double quote or single quote can not be passed to
VERIF_MASK
> in
> >> > the EnsembleStat config.
> >> > I tried use back slash \ to before quote, but still not working
> >> >
> >> > Binbin
> >> >
> >> >
> >> > On Tue, Jan 5, 2021 at 10:33 AM Binbin Zhou - NOAA Affiliate <
> >> > binbin.zhou at noaa.gov> wrote:
> >> >
> >> > > George,
> >> > >
> >> > > Thanks for your quick response! I'll test this settings
and let
> >> > > you know the results.
> >> > >
> >> > > Binbin
> >> > >
> >> > > On Tue, Jan 5, 2021 at 10:17 AM George McCabe via RT <
> >> met_help at ucar.edu>
> >> > > wrote:
> >> > >
> >> > >> Hi Binbin,
> >> > >>
> >> > >> Happy New Year to you too!
> >> > >>
> >> > >> I will comment on each configuration variable and how to set
it in
> a
> >> > >> METplus config inline:
> >> > >>
> >> > >> ens = {
> >> > >> ens_thresh = 1.0;
> >> > >>
> >> > >>
> >> > >> *This is controlled by the ENSEMBLE_STAT_ENS_THRESH
variable. The
> >> > default
> >> > >> value is 1.0, so you don't need to include it in your config
file,
> >> but
> >> > you
> >> > >> can if you may adjust this value at some point.*
> >> > >>
> >> > >> vld_thresh = 1.0;
> >> > >>
> >> > >> *This value is set to 1.0 by default so we don't need to
worry
> about
> >> it
> >> > >> right now.*
> >> > >>
> >> > >> field = [
> >> > >>
> >> > >> {
> >> > >> name = "HGT";
> >> > >> level = "P500";
> >> > >> obs_thresh = [ <=CDP10, >CDP10&&<=CDP20,
>CDP20&&<=CDP30,
> >> > >> >CDP30&&<=CDP40, >CDP40&&<=CDP50, >CDP50&&<=CDP60,
>CDP60&&<=CDP70,
> >> > >> >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];
> >> > >> }
> >> > >> ]
> >> > >> }
> >> > >> fcst = ens;
> >> > >> obs = fcst;
> >> > >>
> >> > >> *1) The field info for ens is set in the
> >> > >> ENS_VAR<n>_[NAME/LEVEL/THRESH/OPTIONS] variables. The fcst
and obs
> >> field
> >> > >> info are set in the corresponding FCST_VAR<n>_* and
OBS_VAR<n>_*
> >> > variables
> >> > >> respectively, or you can use BOTH_VAR<n>_* if the FCST and
OBS
> values
> >> > are
> >> > >> the same.*
> >> > >>
> >> > >> *If ENS_VAR<n>_* variables are not explicitly set, then it
will use
> >> the
> >> > >> values from FCST_VAR<n>_*.*
> >> > >> *Since the fcst, obs, and ens are all the same you could
just use
> >> > >> BOTH_VAR<n>_* variables to control all 3, although keep in
mind
> that
> >> if
> >> > >> you
> >> > >> need to change one of them for any reason, it will be more
> difficult
> >> to
> >> > do
> >> > >> this. If you know that they will always be the same values,
then I
> >> > >> recommend using BOTH_, but if you know they may change or
are
> >> unsure, I
> >> > >> would recommend setting them by referencing the other
variables,
> >> i.e.*
> >> > >>
> >> > >> *FCST_VAR1_NAME = HGT*
> >> > >> *FCST_VAR1_LEVELS = P500 *
> >> > >> *OBS_VAR1_NAME = {FCST_VAR1_NAME}*
> >> > >> *OBS_VAR1_LEVELS = {FCST_VAR1_LEVELS}*
> >> > >>
> >> > >> *2) The [FCST/OBS/ENS]_VAR<n>_THRESH variables set the
cat_thresh
> >> values
> >> > >> in
> >> > >> the field info. A variable specific to obs_thresh is not
currently
> >> > >> supported, however you can set these values by using the
> >> > ENS_VAR1_OPTIONS
> >> > >> variable, i.e.*
> >> > >>
> >> > >> *ENS_VAR1_OPTIONS = obs_thresh = [ <=CDP10, >CDP10&&<=CDP20,
> >> > >> >CDP20&&<=CDP30, >CDP30&&<=CDP40, >CDP40&&<=CDP50,
>CDP50&&<=CDP60,
> >> > >> >CDP60&&<=CDP70, >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90
];*
> >> > >>
> >> > >>
> >> > >> *Remember to include the semicolon at the end! *
> >> > >>
> >> > >> ens_ssvar_bin_size = 1000000;
> >> > >> *1) This variable is different from the default and not
currently
> >> > >> supported
> >> > >> with a METplus config variable. I will add this to the list
of
> >> variables
> >> > >> in
> >> > >> MET config files that we want to support. However, in the
meantime
> >> you
> >> > can
> >> > >> copy the default wrapped MET config file and modify it to
fit your
> >> > needs.
> >> > >> To do this, you will need to:*
> >> > >>
> >> > >> * a) Copy
METplus/parm/met_config/EnsembleStatConfig_wrapped to
> the
> >> > >> directory that contains your METplus config file for this
use case.
> >> > Rename
> >> > >> it by replacing "wrapped" with a short description that
pertains to
> >> your
> >> > >> use case.*
> >> > >>
> >> > >> * b) In your METplus config file, change the value of
> >> > >> ENSEMBLE_STAT_CONFIG_FILE to point to the path of this new
config
> >> file.*
> >> > >>
> >> > >> * c) If you know the value you want to use for this
variable will
> >> > always
> >> > >> be 1000000, then simply set the variable to that value. If
you
> think
> >> you
> >> > >> may want to change the value, then you can utilize the
> >> [user_env_vars]
> >> > >> functionality. See:
> >> > >>
> >> > >>
> >> >
> >>
>
https://dtcenter.github.io/METplus/latest/Users_Guide/systemconfiguration.html#user-
defined-config
> >> > >> <
> >> > >>
> >> >
> >>
>
https://dtcenter.github.io/METplus/latest/Users_Guide/systemconfiguration.html#user-
defined-config
> >> > >> >*
> >> > >> *In this case, you would add the following to your METplus
config:*
> >> > >>
> >> > >> *[user_env_vars]*
> >> > >> *ENS_SSVAR_BIN_SIZE = 1000000*
> >> > >>
> >> > >> *Then change the line in your EnsembleStat config file that
you
> >> copied
> >> > >> to:*
> >> > >>
> >> > >> * ens_ssvar_bin_size = ${ENS_SSVAR_BIN_SIZE}; *
> >> > >>
> >> > >> ens_phist_bin_size = 0.05;
> >> > >> *This variable uses the default value, so you don't need to
do
> >> anything
> >> > >> here. If you need to make it configurable or change the
value, then
> >> > follow
> >> > >> the instructions for setting ens_ssvar_bin_size.*
> >> > >>
> >> > >> climo_mean = fcst;
> >> > >> climo_mean = {
> >> > >> file_name = "${CLIM_MEAN}";
> >> > >> time_interp_method = DW_MEAN;
> >> > >> match_day = TRUE;
> >> > >> time_step = 21600;
> >> > >> }
> >> > >>
> >> > >>
> >> > >> *Instead of using CLIM_MEAN, you can set
> >> > >> ENSEMBLE_STAT_CLIMO_MEAN_INPUT_[DIR/TEMPLATE] in the METplus
> config.
> >> You
> >> > >> can use filename template syntax in the _TEMPLATE value,
i.e.
> >> > >> {valid?fmt=%m%d}. The other variables in the climo_mean
dictionary
> >> are
> >> > >> actually old variables that have been replaced with
day_interval
> and
> >> > >> hour_interval, but the values you use are the old defaults,
so you
> >> > >> shouldn't need to set them.*
> >> > >>
> >> > >> climo_stdev = climo_mean;
> >> > >> climo_stdev = {
> >> > >> file_name = "${CLIM_STDV}";
> >> > >> }
> >> > >>
> >> > >> *Similarly to CLIM_MEAN, you can use
> >> > >> ENSEMBLE_STAT_CLIMO_STDEV_INPUT_[DIR/TEMPLATE] to set this
file
> >> name.*
> >> > >>
> >> > >> climo_cdf = {
> >> > >> cdf_bins = 11;
> >> > >> center_bins = TRUE;
> >> > >> write_bins = TRUE;
> >> > >> }
> >> > >> *The value for write_bins is the default, but the values for
> cdf_bins
> >> > and
> >> > >> center_bins do not. To set these, follow the above
instructions for
> >> > >> ens_ssvar_bin_size to override them and/or make them
configurable
> >> > through
> >> > >> METplus. I will also add these variables to the list of MET
configs
> >> that
> >> > >> users want to be able to easily configure through METplus
configs.*
> >> > >>
> >> > >> Please let me know if you run into any issues setting any of
that
> up.
> >> > >> Also,
> >> > >> if there are any other MET config variables that you want to
see
> >> > supported
> >> > >> in METplus, let me know and I will make sure they get
included when
> >> we
> >> > >> have
> >> > >> a chance to refactor those wrappers. It is possible to add
support
> >> for
> >> > MET
> >> > >> configs using the above instructions, but it is always
easier and
> >> less
> >> > >> error-prone to have them configurable directly through a
variable
> in
> >> the
> >> > >> METplus config.
> >> > >>
> >> > >> Thanks,
> >> > >> George
> >> > >>
> >> > >> On Tue, Jan 5, 2021 at 7:14 AM Binbin.Zhou at noaa.gov via RT <
> >> > >> met_help at ucar.edu> wrote:
> >> > >>
> >> > >> >
> >> > >> > Tue Jan 05 07:14:54 2021: Request 98116 was acted upon.
> >> > >> > Transaction: Ticket created by Binbin.Zhou at noaa.gov
> >> > >> > Queue: met_help
> >> > >> > Subject: CDP threshold setting in EnsembleStat conf
> >> > >> > Owner: Nobody
> >> > >> > Requestors: Binbin.Zhou at noaa.gov
> >> > >> > Status: new
> >> > >> > Ticket <URL:
> >> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
> >> > >
> >> > >> >
> >> > >> >
> >> > >> > George,
> >> > >> >
> >> > >> > Happy New Year!
> >> > >> >
> >> > >> > I am working on transition of our MET-based global
ensemble
> >> > >> verification
> >> > >> > to METplus based package. In this package climatology bins
(10
> >> bins)
> >> > are
> >> > >> > used.
> >> > >> > In current ensemble stat config file, the relevant entries
iare
> >> > defined
> >> > >> > like following
> >> > >> >
> >> > >> > ens = {
> >> > >> > ens_thresh = 1.0;
> >> > >> > vld_thresh = 1.0;
> >> > >> >
> >> > >> > field = [
> >> > >> >
> >> > >> > {
> >> > >> > name = "HGT";
> >> > >> > level = "P500";
> >> > >> > obs_thresh = [ <=CDP10, >CDP10&&<=CDP20,
> >CDP20&&<=CDP30,
> >> > >> > >CDP30&&<=CDP40, >CDP40&&<=CDP50, >CDP50&&<=CDP60,
> >CDP60&&<=CDP70,
> >> > >> > >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];
> >> > >> > }
> >> > >> > ]
> >> > >> > }
> >> > >> > fcst = ens;
> >> > >> > obs = fcst;
> >> > >> > ens_ssvar_bin_size = 1000000;
> >> > >> > ens_phist_bin_size = 0.05;
> >> > >> > climo_mean = fcst;
> >> > >> > climo_mean = {
> >> > >> > file_name = "${CLIM_MEAN}";
> >> > >> > time_interp_method = DW_MEAN;
> >> > >> > match_day = TRUE;
> >> > >> > time_step = 21600;
> >> > >> > }
> >> > >> >
> >> > >> > climo_stdev = climo_mean;
> >> > >> > climo_stdev = {
> >> > >> > file_name = "${CLIM_STDV}";
> >> > >> > }
> >> > >> >
> >> > >> > climo_cdf = {
> >> > >> > cdf_bins = 11;
> >> > >> > center_bins = TRUE;
> >> > >> > write_bins = TRUE;
> >> > >> > }
> >> > >> >
> >> > >> > I can not find the correspondent settings in its conf file
from
> >> > METplus
> >> > >> > online doc.
> >> > >> > Can you help me look at this?
> >> > >> >
> >> > >> > Thanks!
> >> > >> >
> >> > >> > Binbin
> >> > >> >
> >> > >> > --
> >> > >> >
> >> > >> > Binbin Zhou
> >> > >> >
> >> > >> > IMSG at NOAA/NWS/NCEP/EMC
> >> > >> >
> >> > >> > 5830 University Research Ct.
> >> > >> >
> >> > >> > College Park, MD 20740
> >> > >> >
> >> > >> > Binbin.Zhou at noaa.gov
> >> > >> >
> >> > >> > 301-683-3683
> >> > >> >
> >> > >> >
> >> > >>
> >> > >> --
> >> > >> George McCabe - Software Engineer III
> >> > >> National Center for Atmospheric Research
> >> > >> Research Applications Laboratory
> >> > >> 303-497-2768
> >> > >> ---
> >> > >> My working day may not be your working day. Please do not
feel
> >> obliged
> >> > to
> >> > >> reply to this email outside of your normal working hours.
> >> > >>
> >> > >>
> >> > >
> >> > > --
> >> > >
> >> > > Binbin Zhou
> >> > >
> >> > > IMSG at NOAA/NWS/NCEP/EMC
> >> > >
> >> > > 5830 University Research Ct.
> >> > >
> >> > > College Park, MD 20740
> >> > >
> >> > > Binbin.Zhou at noaa.gov
> >> > >
> >> > > 301-683-3683
> >> > >
> >> >
> >> >
> >> > --
> >> >
> >> > Binbin Zhou
> >> >
> >> > IMSG at NOAA/NWS/NCEP/EMC
> >> >
> >> > 5830 University Research Ct.
> >> >
> >> > College Park, MD 20740
> >> >
> >> > Binbin.Zhou at noaa.gov
> >> >
> >> > 301-683-3683
> >> >
> >> >
> >>
> >> --
> >> George McCabe - Software Engineer III
> >> National Center for Atmospheric Research
> >> Research Applications Laboratory
> >> 303-497-2768
> >> ---
> >> My working day may not be your working day. Please do not feel
obliged
> to
> >> reply to this email outside of your normal working hours.
> >>
> >>
> >
> > --
> >
> > Binbin Zhou
> >
> > IMSG at NOAA/NWS/NCEP/EMC
> >
> > 5830 University Research Ct.
> >
> > College Park, MD 20740
> >
> > Binbin.Zhou at noaa.gov
> >
> > 301-683-3683
> >
>
>
> --
>
> Binbin Zhou
>
> IMSG at NOAA/NWS/NCEP/EMC
>
> 5830 University Research Ct.
>
> College Park, MD 20740
>
> Binbin.Zhou at noaa.gov
>
> 301-683-3683
>
>
--
George McCabe - Software Engineer III
National Center for Atmospheric Research
Research Applications Laboratory
303-497-2768
---
My working day may not be your working day. Please do not feel obliged
to
reply to this email outside of your normal working hours.
------------------------------------------------
Subject: CDP threshold setting in EnsembleStat conf
From: Binbin.Zhou at noaa.gov
Time: Tue Jan 05 15:59:40 2021
George,
Thanks!
Binbin
On Tue, Jan 5, 2021 at 5:19 PM George McCabe via RT
<met_help at ucar.edu>
wrote:
> Hi Binbin,
>
> Your solution should work for now. It looks like although the
METplus
> variable does get read properly, the environment variable is not
actually
> set by the EnsembleStat wrapper. I can make a note to add that for
4.0.0,
> as it is an easy fix.
>
> - George
>
> On Tue, Jan 5, 2021 at 2:53 PM Binbin.Zhou at noaa.gov via RT <
> met_help at ucar.edu> wrote:
>
> > George,
> >
> > I have a temporal solution:
> > set ploy in EnembleStat config as
> > poly = [ "${MASKPATH}/lat_NHM.nc",
> > "${MASKPATH}/lat_NHM.nc",
> > "${MASKPATH}/lat_TRP.nc" ];
> >
> > then set MASKPATH in user_env_vars part in the conf file
> > This MASKPAH then can be passed to EnsembleStat's poly [ ] entry
> >
> > Binbin
> >
> > On Tue, Jan 5, 2021 at 4:25 PM Binbin Zhou - NOAA Affiliate <
> > binbin.zhou at noaa.gov> wrote:
> >
> > > George,
> > >
> > > Still not working, error says
> > > ERROR : replace_env() -> unable to get value for environment
variable
> > > "VERIF_MASK"
> > >
> > > Binbin
> > >
> > >
> > >
> > > On Tue, Jan 5, 2021 at 3:50 PM George McCabe via RT
<met_help at ucar.edu
> >
> > > wrote:
> > >
> > >> Hi Binbin,
> > >>
> > >> You should be able to set it in the METplus config the same way
it is
> > done
> > >> for GridStat -- no quotes with commas between each item. The
wrapper
> > >> should
> > >> format it properly.
> > >>
> > >> Here is an example from an existing use case:
> > >>
> > >> GRID_STAT_VERIFICATION_MASK_TEMPLATE =
> > >>
{INPUT_BASE}/model_applications/precipitation/mask/CONUS_HRRRTLE.nc,
> > >>
{INPUT_BASE}/model_applications/precipitation/mask/EAST_HRRRTLE.nc,
> > >>
{INPUT_BASE}/model_applications/precipitation/mask/WEST_HRRRTLE.nc
> > >>
> > >> You should be able to set them the same way using
> > >> ENSEMBLE_STAT_VERIFICATION_MASK_TEMPLATE. Let me know if that
doesn't
> > >> work.
> > >>
> > >> - George
> > >>
> > >> On Tue, Jan 5, 2021 at 1:45 PM Binbin.Zhou at noaa.gov via RT <
> > >> met_help at ucar.edu> wrote:
> > >>
> > >> >
> > >> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
>
> > >> >
> > >> > George,
> > >> >
> > >> > I got another issue for verification mask setting.
> > >> >
> > >> > I am using $VERIF_MASK in EnsembleStat config f/ile
> > >> > mask = {
> > >> > grid = [];
> > >> > poly = [${VERIF_MASK}];
> > >> > sid = [];
> > >> > }
> > >> >
> > >> > And using GRID_STAT_VERIFICATION_MASK_TEMPLATE to define
several
> > >> polygon
> > >> > nc mask files
> > >> > But it seems not working. But it works for Gridstat config in
suich
> > >> > setting.
> > >> > I can not find ENSEMBLE_STAT_ VERIFICATION_MASK_TEMPLATE in
the
> > METplus
> > >> doc
> > >> >
> > >> > So I define VERIF_MASK in [user_env_vars] part.
> > >> > It values can not be passed to ploy = [${VERIF_MASK}] in the
> > >> EnsembleStat
> > >> > conf if more than one nc files included.
> > >> > For example
> > >> > VERIF_MASK=" '/part/p1.cn', '/path/p2.nc' "
> > >> > the error says poly = [/path/p1,]
> > >> > It seems double quote or single quote can not be passed to
> VERIF_MASK
> > in
> > >> > the EnsembleStat config.
> > >> > I tried use back slash \ to before quote, but still not
working
> > >> >
> > >> > Binbin
> > >> >
> > >> >
> > >> > On Tue, Jan 5, 2021 at 10:33 AM Binbin Zhou - NOAA Affiliate
<
> > >> > binbin.zhou at noaa.gov> wrote:
> > >> >
> > >> > > George,
> > >> > >
> > >> > > Thanks for your quick response! I'll test this settings
and let
> > >> > > you know the results.
> > >> > >
> > >> > > Binbin
> > >> > >
> > >> > > On Tue, Jan 5, 2021 at 10:17 AM George McCabe via RT <
> > >> met_help at ucar.edu>
> > >> > > wrote:
> > >> > >
> > >> > >> Hi Binbin,
> > >> > >>
> > >> > >> Happy New Year to you too!
> > >> > >>
> > >> > >> I will comment on each configuration variable and how to
set it
> in
> > a
> > >> > >> METplus config inline:
> > >> > >>
> > >> > >> ens = {
> > >> > >> ens_thresh = 1.0;
> > >> > >>
> > >> > >>
> > >> > >> *This is controlled by the ENSEMBLE_STAT_ENS_THRESH
variable. The
> > >> > default
> > >> > >> value is 1.0, so you don't need to include it in your
config
> file,
> > >> but
> > >> > you
> > >> > >> can if you may adjust this value at some point.*
> > >> > >>
> > >> > >> vld_thresh = 1.0;
> > >> > >>
> > >> > >> *This value is set to 1.0 by default so we don't need to
worry
> > about
> > >> it
> > >> > >> right now.*
> > >> > >>
> > >> > >> field = [
> > >> > >>
> > >> > >> {
> > >> > >> name = "HGT";
> > >> > >> level = "P500";
> > >> > >> obs_thresh = [ <=CDP10, >CDP10&&<=CDP20,
> >CDP20&&<=CDP30,
> > >> > >> >CDP30&&<=CDP40, >CDP40&&<=CDP50, >CDP50&&<=CDP60,
> >CDP60&&<=CDP70,
> > >> > >> >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];
> > >> > >> }
> > >> > >> ]
> > >> > >> }
> > >> > >> fcst = ens;
> > >> > >> obs = fcst;
> > >> > >>
> > >> > >> *1) The field info for ens is set in the
> > >> > >> ENS_VAR<n>_[NAME/LEVEL/THRESH/OPTIONS] variables. The fcst
and
> obs
> > >> field
> > >> > >> info are set in the corresponding FCST_VAR<n>_* and
OBS_VAR<n>_*
> > >> > variables
> > >> > >> respectively, or you can use BOTH_VAR<n>_* if the FCST and
OBS
> > values
> > >> > are
> > >> > >> the same.*
> > >> > >>
> > >> > >> *If ENS_VAR<n>_* variables are not explicitly set, then it
will
> use
> > >> the
> > >> > >> values from FCST_VAR<n>_*.*
> > >> > >> *Since the fcst, obs, and ens are all the same you could
just use
> > >> > >> BOTH_VAR<n>_* variables to control all 3, although keep in
mind
> > that
> > >> if
> > >> > >> you
> > >> > >> need to change one of them for any reason, it will be more
> > difficult
> > >> to
> > >> > do
> > >> > >> this. If you know that they will always be the same
values, then
> I
> > >> > >> recommend using BOTH_, but if you know they may change or
are
> > >> unsure, I
> > >> > >> would recommend setting them by referencing the other
variables,
> > >> i.e.*
> > >> > >>
> > >> > >> *FCST_VAR1_NAME = HGT*
> > >> > >> *FCST_VAR1_LEVELS = P500 *
> > >> > >> *OBS_VAR1_NAME = {FCST_VAR1_NAME}*
> > >> > >> *OBS_VAR1_LEVELS = {FCST_VAR1_LEVELS}*
> > >> > >>
> > >> > >> *2) The [FCST/OBS/ENS]_VAR<n>_THRESH variables set the
cat_thresh
> > >> values
> > >> > >> in
> > >> > >> the field info. A variable specific to obs_thresh is not
> currently
> > >> > >> supported, however you can set these values by using the
> > >> > ENS_VAR1_OPTIONS
> > >> > >> variable, i.e.*
> > >> > >>
> > >> > >> *ENS_VAR1_OPTIONS = obs_thresh = [ <=CDP10,
>CDP10&&<=CDP20,
> > >> > >> >CDP20&&<=CDP30, >CDP30&&<=CDP40, >CDP40&&<=CDP50,
> >CDP50&&<=CDP60,
> > >> > >> >CDP60&&<=CDP70, >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90
];*
> > >> > >>
> > >> > >>
> > >> > >> *Remember to include the semicolon at the end! *
> > >> > >>
> > >> > >> ens_ssvar_bin_size = 1000000;
> > >> > >> *1) This variable is different from the default and not
currently
> > >> > >> supported
> > >> > >> with a METplus config variable. I will add this to the
list of
> > >> variables
> > >> > >> in
> > >> > >> MET config files that we want to support. However, in the
> meantime
> > >> you
> > >> > can
> > >> > >> copy the default wrapped MET config file and modify it to
fit
> your
> > >> > needs.
> > >> > >> To do this, you will need to:*
> > >> > >>
> > >> > >> * a) Copy
METplus/parm/met_config/EnsembleStatConfig_wrapped to
> > the
> > >> > >> directory that contains your METplus config file for this
use
> case.
> > >> > Rename
> > >> > >> it by replacing "wrapped" with a short description that
pertains
> to
> > >> your
> > >> > >> use case.*
> > >> > >>
> > >> > >> * b) In your METplus config file, change the value of
> > >> > >> ENSEMBLE_STAT_CONFIG_FILE to point to the path of this new
config
> > >> file.*
> > >> > >>
> > >> > >> * c) If you know the value you want to use for this
variable
> will
> > >> > always
> > >> > >> be 1000000, then simply set the variable to that value. If
you
> > think
> > >> you
> > >> > >> may want to change the value, then you can utilize the
> > >> [user_env_vars]
> > >> > >> functionality. See:
> > >> > >>
> > >> > >>
> > >> >
> > >>
> >
>
https://dtcenter.github.io/METplus/latest/Users_Guide/systemconfiguration.html#user-
defined-config
> > >> > >> <
> > >> > >>
> > >> >
> > >>
> >
>
https://dtcenter.github.io/METplus/latest/Users_Guide/systemconfiguration.html#user-
defined-config
> > >> > >> >*
> > >> > >> *In this case, you would add the following to your METplus
> config:*
> > >> > >>
> > >> > >> *[user_env_vars]*
> > >> > >> *ENS_SSVAR_BIN_SIZE = 1000000*
> > >> > >>
> > >> > >> *Then change the line in your EnsembleStat config file
that you
> > >> copied
> > >> > >> to:*
> > >> > >>
> > >> > >> * ens_ssvar_bin_size = ${ENS_SSVAR_BIN_SIZE}; *
> > >> > >>
> > >> > >> ens_phist_bin_size = 0.05;
> > >> > >> *This variable uses the default value, so you don't need
to do
> > >> anything
> > >> > >> here. If you need to make it configurable or change the
value,
> then
> > >> > follow
> > >> > >> the instructions for setting ens_ssvar_bin_size.*
> > >> > >>
> > >> > >> climo_mean = fcst;
> > >> > >> climo_mean = {
> > >> > >> file_name = "${CLIM_MEAN}";
> > >> > >> time_interp_method = DW_MEAN;
> > >> > >> match_day = TRUE;
> > >> > >> time_step = 21600;
> > >> > >> }
> > >> > >>
> > >> > >>
> > >> > >> *Instead of using CLIM_MEAN, you can set
> > >> > >> ENSEMBLE_STAT_CLIMO_MEAN_INPUT_[DIR/TEMPLATE] in the
METplus
> > config.
> > >> You
> > >> > >> can use filename template syntax in the _TEMPLATE value,
i.e.
> > >> > >> {valid?fmt=%m%d}. The other variables in the climo_mean
> dictionary
> > >> are
> > >> > >> actually old variables that have been replaced with
day_interval
> > and
> > >> > >> hour_interval, but the values you use are the old
defaults, so
> you
> > >> > >> shouldn't need to set them.*
> > >> > >>
> > >> > >> climo_stdev = climo_mean;
> > >> > >> climo_stdev = {
> > >> > >> file_name = "${CLIM_STDV}";
> > >> > >> }
> > >> > >>
> > >> > >> *Similarly to CLIM_MEAN, you can use
> > >> > >> ENSEMBLE_STAT_CLIMO_STDEV_INPUT_[DIR/TEMPLATE] to set this
file
> > >> name.*
> > >> > >>
> > >> > >> climo_cdf = {
> > >> > >> cdf_bins = 11;
> > >> > >> center_bins = TRUE;
> > >> > >> write_bins = TRUE;
> > >> > >> }
> > >> > >> *The value for write_bins is the default, but the values
for
> > cdf_bins
> > >> > and
> > >> > >> center_bins do not. To set these, follow the above
instructions
> for
> > >> > >> ens_ssvar_bin_size to override them and/or make them
configurable
> > >> > through
> > >> > >> METplus. I will also add these variables to the list of
MET
> configs
> > >> that
> > >> > >> users want to be able to easily configure through METplus
> configs.*
> > >> > >>
> > >> > >> Please let me know if you run into any issues setting any
of that
> > up.
> > >> > >> Also,
> > >> > >> if there are any other MET config variables that you want
to see
> > >> > supported
> > >> > >> in METplus, let me know and I will make sure they get
included
> when
> > >> we
> > >> > >> have
> > >> > >> a chance to refactor those wrappers. It is possible to add
> support
> > >> for
> > >> > MET
> > >> > >> configs using the above instructions, but it is always
easier and
> > >> less
> > >> > >> error-prone to have them configurable directly through a
variable
> > in
> > >> the
> > >> > >> METplus config.
> > >> > >>
> > >> > >> Thanks,
> > >> > >> George
> > >> > >>
> > >> > >> On Tue, Jan 5, 2021 at 7:14 AM Binbin.Zhou at noaa.gov via RT
<
> > >> > >> met_help at ucar.edu> wrote:
> > >> > >>
> > >> > >> >
> > >> > >> > Tue Jan 05 07:14:54 2021: Request 98116 was acted upon.
> > >> > >> > Transaction: Ticket created by Binbin.Zhou at noaa.gov
> > >> > >> > Queue: met_help
> > >> > >> > Subject: CDP threshold setting in EnsembleStat conf
> > >> > >> > Owner: Nobody
> > >> > >> > Requestors: Binbin.Zhou at noaa.gov
> > >> > >> > Status: new
> > >> > >> > Ticket <URL:
> > >> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
> > >> > >
> > >> > >> >
> > >> > >> >
> > >> > >> > George,
> > >> > >> >
> > >> > >> > Happy New Year!
> > >> > >> >
> > >> > >> > I am working on transition of our MET-based global
ensemble
> > >> > >> verification
> > >> > >> > to METplus based package. In this package climatology
bins (10
> > >> bins)
> > >> > are
> > >> > >> > used.
> > >> > >> > In current ensemble stat config file, the relevant
entries iare
> > >> > defined
> > >> > >> > like following
> > >> > >> >
> > >> > >> > ens = {
> > >> > >> > ens_thresh = 1.0;
> > >> > >> > vld_thresh = 1.0;
> > >> > >> >
> > >> > >> > field = [
> > >> > >> >
> > >> > >> > {
> > >> > >> > name = "HGT";
> > >> > >> > level = "P500";
> > >> > >> > obs_thresh = [ <=CDP10, >CDP10&&<=CDP20,
> > >CDP20&&<=CDP30,
> > >> > >> > >CDP30&&<=CDP40, >CDP40&&<=CDP50, >CDP50&&<=CDP60,
> > >CDP60&&<=CDP70,
> > >> > >> > >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];
> > >> > >> > }
> > >> > >> > ]
> > >> > >> > }
> > >> > >> > fcst = ens;
> > >> > >> > obs = fcst;
> > >> > >> > ens_ssvar_bin_size = 1000000;
> > >> > >> > ens_phist_bin_size = 0.05;
> > >> > >> > climo_mean = fcst;
> > >> > >> > climo_mean = {
> > >> > >> > file_name = "${CLIM_MEAN}";
> > >> > >> > time_interp_method = DW_MEAN;
> > >> > >> > match_day = TRUE;
> > >> > >> > time_step = 21600;
> > >> > >> > }
> > >> > >> >
> > >> > >> > climo_stdev = climo_mean;
> > >> > >> > climo_stdev = {
> > >> > >> > file_name = "${CLIM_STDV}";
> > >> > >> > }
> > >> > >> >
> > >> > >> > climo_cdf = {
> > >> > >> > cdf_bins = 11;
> > >> > >> > center_bins = TRUE;
> > >> > >> > write_bins = TRUE;
> > >> > >> > }
> > >> > >> >
> > >> > >> > I can not find the correspondent settings in its conf
file from
> > >> > METplus
> > >> > >> > online doc.
> > >> > >> > Can you help me look at this?
> > >> > >> >
> > >> > >> > Thanks!
> > >> > >> >
> > >> > >> > Binbin
> > >> > >> >
> > >> > >> > --
> > >> > >> >
> > >> > >> > Binbin Zhou
> > >> > >> >
> > >> > >> > IMSG at NOAA/NWS/NCEP/EMC
> > >> > >> >
> > >> > >> > 5830 University Research Ct.
> > >> > >> >
> > >> > >> > College Park, MD 20740
> > >> > >> >
> > >> > >> > Binbin.Zhou at noaa.gov
> > >> > >> >
> > >> > >> > 301-683-3683
> > >> > >> >
> > >> > >> >
> > >> > >>
> > >> > >> --
> > >> > >> George McCabe - Software Engineer III
> > >> > >> National Center for Atmospheric Research
> > >> > >> Research Applications Laboratory
> > >> > >> 303-497-2768
> > >> > >> ---
> > >> > >> My working day may not be your working day. Please do not
feel
> > >> obliged
> > >> > to
> > >> > >> reply to this email outside of your normal working hours.
> > >> > >>
> > >> > >>
> > >> > >
> > >> > > --
> > >> > >
> > >> > > Binbin Zhou
> > >> > >
> > >> > > IMSG at NOAA/NWS/NCEP/EMC
> > >> > >
> > >> > > 5830 University Research Ct.
> > >> > >
> > >> > > College Park, MD 20740
> > >> > >
> > >> > > Binbin.Zhou at noaa.gov
> > >> > >
> > >> > > 301-683-3683
> > >> > >
> > >> >
> > >> >
> > >> > --
> > >> >
> > >> > Binbin Zhou
> > >> >
> > >> > IMSG at NOAA/NWS/NCEP/EMC
> > >> >
> > >> > 5830 University Research Ct.
> > >> >
> > >> > College Park, MD 20740
> > >> >
> > >> > Binbin.Zhou at noaa.gov
> > >> >
> > >> > 301-683-3683
> > >> >
> > >> >
> > >>
> > >> --
> > >> George McCabe - Software Engineer III
> > >> National Center for Atmospheric Research
> > >> Research Applications Laboratory
> > >> 303-497-2768
> > >> ---
> > >> My working day may not be your working day. Please do not feel
obliged
> > to
> > >> reply to this email outside of your normal working hours.
> > >>
> > >>
> > >
> > > --
> > >
> > > Binbin Zhou
> > >
> > > IMSG at NOAA/NWS/NCEP/EMC
> > >
> > > 5830 University Research Ct.
> > >
> > > College Park, MD 20740
> > >
> > > Binbin.Zhou at noaa.gov
> > >
> > > 301-683-3683
> > >
> >
> >
> > --
> >
> > Binbin Zhou
> >
> > IMSG at NOAA/NWS/NCEP/EMC
> >
> > 5830 University Research Ct.
> >
> > College Park, MD 20740
> >
> > Binbin.Zhou at noaa.gov
> >
> > 301-683-3683
> >
> >
>
> --
> George McCabe - Software Engineer III
> National Center for Atmospheric Research
> Research Applications Laboratory
> 303-497-2768
> ---
> My working day may not be your working day. Please do not feel
obliged to
> reply to this email outside of your normal working hours.
>
>
--
Binbin Zhou
IMSG at NOAA/NWS/NCEP/EMC
5830 University Research Ct.
College Park, MD 20740
Binbin.Zhou at noaa.gov
301-683-3683
------------------------------------------------
Subject: CDP threshold setting in EnsembleStat conf
From: Binbin.Zhou at noaa.gov
Time: Wed Jan 06 07:11:06 2021
George,
I got a new error in execution although some output files (nc file)
are
created but stat files not.
The error message is
ERROR :
ERROR : Simple_Node::check(double, double, double) const ->
climatological
distribution percentile threshold "<=CDP10" requested with invalid
mean
(-9999) or standard deviation (-9999).
ERROR :
Such an error was ever investigated by John H before (year ago): When
I
directly ran ensemble_stat for global ensemble (not METplus-based,
but hard code of all settings in EnsembleStat config file): If hard
code
fcst field in EnsembleStat config file like this
name = "HGT";
level = "P500";
cat_thresh = [ <=CDP10, >CDP10&&<=CDP20, >CDP20&&<=CDP30,
>CDP30&&<=CDP40, >CDP40&&<=CDP50, >CDP50&&<=CDP60, >CDP60&&<=CDP70,
>CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];
Run ensemble_stat will have such error: ERROR :
Simple_Node::check(double, double, double) const -> climatological
distribution percentile threshold "<=CDP10" requested with invalid
mean
(-9999) or standard deviation (-9999).
John H. suggested me change "cat_thresh = " to "obs_thresh = ", then
the
error was solved.
In current METplus version, following your suggestion as
ENS_VAR1_OPTIONS = obs_thresh = [ <=CDP10, >CDP10&&<=CDP20,
>CDP20&&<=CDP30, >CDP30&&<=CDP40, >CDP40&&<=CDP50, >CDP50&&<=CDP60,
>CDP60&&<=CDP70, >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];
the same error appears again. So I am not for sure if the
"obs_thresh"
setting is correctly passed.
Binbin
On Tue, Jan 5, 2021 at 5:19 PM George McCabe via RT
<met_help at ucar.edu>
wrote:
> Hi Binbin,
>
> Your solution should work for now. It looks like although the
METplus
> variable does get read properly, the environment variable is not
actually
> set by the EnsembleStat wrapper. I can make a note to add that for
4.0.0,
> as it is an easy fix.
>
> - George
>
> On Tue, Jan 5, 2021 at 2:53 PM Binbin.Zhou at noaa.gov via RT <
> met_help at ucar.edu> wrote:
>
> > George,
> >
> > I have a temporal solution:
> > set ploy in EnembleStat config as
> > poly = [ "${MASKPATH}/lat_NHM.nc",
> > "${MASKPATH}/lat_NHM.nc",
> > "${MASKPATH}/lat_TRP.nc" ];
> >
> > then set MASKPATH in user_env_vars part in the conf file
> > This MASKPAH then can be passed to EnsembleStat's poly [ ] entry
> >
> > Binbin
> >
> > On Tue, Jan 5, 2021 at 4:25 PM Binbin Zhou - NOAA Affiliate <
> > binbin.zhou at noaa.gov> wrote:
> >
> > > George,
> > >
> > > Still not working, error says
> > > ERROR : replace_env() -> unable to get value for environment
variable
> > > "VERIF_MASK"
> > >
> > > Binbin
> > >
> > >
> > >
> > > On Tue, Jan 5, 2021 at 3:50 PM George McCabe via RT
<met_help at ucar.edu
> >
> > > wrote:
> > >
> > >> Hi Binbin,
> > >>
> > >> You should be able to set it in the METplus config the same way
it is
> > done
> > >> for GridStat -- no quotes with commas between each item. The
wrapper
> > >> should
> > >> format it properly.
> > >>
> > >> Here is an example from an existing use case:
> > >>
> > >> GRID_STAT_VERIFICATION_MASK_TEMPLATE =
> > >>
{INPUT_BASE}/model_applications/precipitation/mask/CONUS_HRRRTLE.nc,
> > >>
{INPUT_BASE}/model_applications/precipitation/mask/EAST_HRRRTLE.nc,
> > >>
{INPUT_BASE}/model_applications/precipitation/mask/WEST_HRRRTLE.nc
> > >>
> > >> You should be able to set them the same way using
> > >> ENSEMBLE_STAT_VERIFICATION_MASK_TEMPLATE. Let me know if that
doesn't
> > >> work.
> > >>
> > >> - George
> > >>
> > >> On Tue, Jan 5, 2021 at 1:45 PM Binbin.Zhou at noaa.gov via RT <
> > >> met_help at ucar.edu> wrote:
> > >>
> > >> >
> > >> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
>
> > >> >
> > >> > George,
> > >> >
> > >> > I got another issue for verification mask setting.
> > >> >
> > >> > I am using $VERIF_MASK in EnsembleStat config f/ile
> > >> > mask = {
> > >> > grid = [];
> > >> > poly = [${VERIF_MASK}];
> > >> > sid = [];
> > >> > }
> > >> >
> > >> > And using GRID_STAT_VERIFICATION_MASK_TEMPLATE to define
several
> > >> polygon
> > >> > nc mask files
> > >> > But it seems not working. But it works for Gridstat config in
suich
> > >> > setting.
> > >> > I can not find ENSEMBLE_STAT_ VERIFICATION_MASK_TEMPLATE in
the
> > METplus
> > >> doc
> > >> >
> > >> > So I define VERIF_MASK in [user_env_vars] part.
> > >> > It values can not be passed to ploy = [${VERIF_MASK}] in the
> > >> EnsembleStat
> > >> > conf if more than one nc files included.
> > >> > For example
> > >> > VERIF_MASK=" '/part/p1.cn', '/path/p2.nc' "
> > >> > the error says poly = [/path/p1,]
> > >> > It seems double quote or single quote can not be passed to
> VERIF_MASK
> > in
> > >> > the EnsembleStat config.
> > >> > I tried use back slash \ to before quote, but still not
working
> > >> >
> > >> > Binbin
> > >> >
> > >> >
> > >> > On Tue, Jan 5, 2021 at 10:33 AM Binbin Zhou - NOAA Affiliate
<
> > >> > binbin.zhou at noaa.gov> wrote:
> > >> >
> > >> > > George,
> > >> > >
> > >> > > Thanks for your quick response! I'll test this settings
and let
> > >> > > you know the results.
> > >> > >
> > >> > > Binbin
> > >> > >
> > >> > > On Tue, Jan 5, 2021 at 10:17 AM George McCabe via RT <
> > >> met_help at ucar.edu>
> > >> > > wrote:
> > >> > >
> > >> > >> Hi Binbin,
> > >> > >>
> > >> > >> Happy New Year to you too!
> > >> > >>
> > >> > >> I will comment on each configuration variable and how to
set it
> in
> > a
> > >> > >> METplus config inline:
> > >> > >>
> > >> > >> ens = {
> > >> > >> ens_thresh = 1.0;
> > >> > >>
> > >> > >>
> > >> > >> *This is controlled by the ENSEMBLE_STAT_ENS_THRESH
variable. The
> > >> > default
> > >> > >> value is 1.0, so you don't need to include it in your
config
> file,
> > >> but
> > >> > you
> > >> > >> can if you may adjust this value at some point.*
> > >> > >>
> > >> > >> vld_thresh = 1.0;
> > >> > >>
> > >> > >> *This value is set to 1.0 by default so we don't need to
worry
> > about
> > >> it
> > >> > >> right now.*
> > >> > >>
> > >> > >> field = [
> > >> > >>
> > >> > >> {
> > >> > >> name = "HGT";
> > >> > >> level = "P500";
> > >> > >> obs_thresh = [ <=CDP10, >CDP10&&<=CDP20,
> >CDP20&&<=CDP30,
> > >> > >> >CDP30&&<=CDP40, >CDP40&&<=CDP50, >CDP50&&<=CDP60,
> >CDP60&&<=CDP70,
> > >> > >> >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];
> > >> > >> }
> > >> > >> ]
> > >> > >> }
> > >> > >> fcst = ens;
> > >> > >> obs = fcst;
> > >> > >>
> > >> > >> *1) The field info for ens is set in the
> > >> > >> ENS_VAR<n>_[NAME/LEVEL/THRESH/OPTIONS] variables. The fcst
and
> obs
> > >> field
> > >> > >> info are set in the corresponding FCST_VAR<n>_* and
OBS_VAR<n>_*
> > >> > variables
> > >> > >> respectively, or you can use BOTH_VAR<n>_* if the FCST and
OBS
> > values
> > >> > are
> > >> > >> the same.*
> > >> > >>
> > >> > >> *If ENS_VAR<n>_* variables are not explicitly set, then it
will
> use
> > >> the
> > >> > >> values from FCST_VAR<n>_*.*
> > >> > >> *Since the fcst, obs, and ens are all the same you could
just use
> > >> > >> BOTH_VAR<n>_* variables to control all 3, although keep in
mind
> > that
> > >> if
> > >> > >> you
> > >> > >> need to change one of them for any reason, it will be more
> > difficult
> > >> to
> > >> > do
> > >> > >> this. If you know that they will always be the same
values, then
> I
> > >> > >> recommend using BOTH_, but if you know they may change or
are
> > >> unsure, I
> > >> > >> would recommend setting them by referencing the other
variables,
> > >> i.e.*
> > >> > >>
> > >> > >> *FCST_VAR1_NAME = HGT*
> > >> > >> *FCST_VAR1_LEVELS = P500 *
> > >> > >> *OBS_VAR1_NAME = {FCST_VAR1_NAME}*
> > >> > >> *OBS_VAR1_LEVELS = {FCST_VAR1_LEVELS}*
> > >> > >>
> > >> > >> *2) The [FCST/OBS/ENS]_VAR<n>_THRESH variables set the
cat_thresh
> > >> values
> > >> > >> in
> > >> > >> the field info. A variable specific to obs_thresh is not
> currently
> > >> > >> supported, however you can set these values by using the
> > >> > ENS_VAR1_OPTIONS
> > >> > >> variable, i.e.*
> > >> > >>
> > >> > >> *ENS_VAR1_OPTIONS = obs_thresh = [ <=CDP10,
>CDP10&&<=CDP20,
> > >> > >> >CDP20&&<=CDP30, >CDP30&&<=CDP40, >CDP40&&<=CDP50,
> >CDP50&&<=CDP60,
> > >> > >> >CDP60&&<=CDP70, >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90
];*
> > >> > >>
> > >> > >>
> > >> > >> *Remember to include the semicolon at the end! *
> > >> > >>
> > >> > >> ens_ssvar_bin_size = 1000000;
> > >> > >> *1) This variable is different from the default and not
currently
> > >> > >> supported
> > >> > >> with a METplus config variable. I will add this to the
list of
> > >> variables
> > >> > >> in
> > >> > >> MET config files that we want to support. However, in the
> meantime
> > >> you
> > >> > can
> > >> > >> copy the default wrapped MET config file and modify it to
fit
> your
> > >> > needs.
> > >> > >> To do this, you will need to:*
> > >> > >>
> > >> > >> * a) Copy
METplus/parm/met_config/EnsembleStatConfig_wrapped to
> > the
> > >> > >> directory that contains your METplus config file for this
use
> case.
> > >> > Rename
> > >> > >> it by replacing "wrapped" with a short description that
pertains
> to
> > >> your
> > >> > >> use case.*
> > >> > >>
> > >> > >> * b) In your METplus config file, change the value of
> > >> > >> ENSEMBLE_STAT_CONFIG_FILE to point to the path of this new
config
> > >> file.*
> > >> > >>
> > >> > >> * c) If you know the value you want to use for this
variable
> will
> > >> > always
> > >> > >> be 1000000, then simply set the variable to that value. If
you
> > think
> > >> you
> > >> > >> may want to change the value, then you can utilize the
> > >> [user_env_vars]
> > >> > >> functionality. See:
> > >> > >>
> > >> > >>
> > >> >
> > >>
> >
>
https://dtcenter.github.io/METplus/latest/Users_Guide/systemconfiguration.html#user-
defined-config
> > >> > >> <
> > >> > >>
> > >> >
> > >>
> >
>
https://dtcenter.github.io/METplus/latest/Users_Guide/systemconfiguration.html#user-
defined-config
> > >> > >> >*
> > >> > >> *In this case, you would add the following to your METplus
> config:*
> > >> > >>
> > >> > >> *[user_env_vars]*
> > >> > >> *ENS_SSVAR_BIN_SIZE = 1000000*
> > >> > >>
> > >> > >> *Then change the line in your EnsembleStat config file
that you
> > >> copied
> > >> > >> to:*
> > >> > >>
> > >> > >> * ens_ssvar_bin_size = ${ENS_SSVAR_BIN_SIZE}; *
> > >> > >>
> > >> > >> ens_phist_bin_size = 0.05;
> > >> > >> *This variable uses the default value, so you don't need
to do
> > >> anything
> > >> > >> here. If you need to make it configurable or change the
value,
> then
> > >> > follow
> > >> > >> the instructions for setting ens_ssvar_bin_size.*
> > >> > >>
> > >> > >> climo_mean = fcst;
> > >> > >> climo_mean = {
> > >> > >> file_name = "${CLIM_MEAN}";
> > >> > >> time_interp_method = DW_MEAN;
> > >> > >> match_day = TRUE;
> > >> > >> time_step = 21600;
> > >> > >> }
> > >> > >>
> > >> > >>
> > >> > >> *Instead of using CLIM_MEAN, you can set
> > >> > >> ENSEMBLE_STAT_CLIMO_MEAN_INPUT_[DIR/TEMPLATE] in the
METplus
> > config.
> > >> You
> > >> > >> can use filename template syntax in the _TEMPLATE value,
i.e.
> > >> > >> {valid?fmt=%m%d}. The other variables in the climo_mean
> dictionary
> > >> are
> > >> > >> actually old variables that have been replaced with
day_interval
> > and
> > >> > >> hour_interval, but the values you use are the old
defaults, so
> you
> > >> > >> shouldn't need to set them.*
> > >> > >>
> > >> > >> climo_stdev = climo_mean;
> > >> > >> climo_stdev = {
> > >> > >> file_name = "${CLIM_STDV}";
> > >> > >> }
> > >> > >>
> > >> > >> *Similarly to CLIM_MEAN, you can use
> > >> > >> ENSEMBLE_STAT_CLIMO_STDEV_INPUT_[DIR/TEMPLATE] to set this
file
> > >> name.*
> > >> > >>
> > >> > >> climo_cdf = {
> > >> > >> cdf_bins = 11;
> > >> > >> center_bins = TRUE;
> > >> > >> write_bins = TRUE;
> > >> > >> }
> > >> > >> *The value for write_bins is the default, but the values
for
> > cdf_bins
> > >> > and
> > >> > >> center_bins do not. To set these, follow the above
instructions
> for
> > >> > >> ens_ssvar_bin_size to override them and/or make them
configurable
> > >> > through
> > >> > >> METplus. I will also add these variables to the list of
MET
> configs
> > >> that
> > >> > >> users want to be able to easily configure through METplus
> configs.*
> > >> > >>
> > >> > >> Please let me know if you run into any issues setting any
of that
> > up.
> > >> > >> Also,
> > >> > >> if there are any other MET config variables that you want
to see
> > >> > supported
> > >> > >> in METplus, let me know and I will make sure they get
included
> when
> > >> we
> > >> > >> have
> > >> > >> a chance to refactor those wrappers. It is possible to add
> support
> > >> for
> > >> > MET
> > >> > >> configs using the above instructions, but it is always
easier and
> > >> less
> > >> > >> error-prone to have them configurable directly through a
variable
> > in
> > >> the
> > >> > >> METplus config.
> > >> > >>
> > >> > >> Thanks,
> > >> > >> George
> > >> > >>
> > >> > >> On Tue, Jan 5, 2021 at 7:14 AM Binbin.Zhou at noaa.gov via RT
<
> > >> > >> met_help at ucar.edu> wrote:
> > >> > >>
> > >> > >> >
> > >> > >> > Tue Jan 05 07:14:54 2021: Request 98116 was acted upon.
> > >> > >> > Transaction: Ticket created by Binbin.Zhou at noaa.gov
> > >> > >> > Queue: met_help
> > >> > >> > Subject: CDP threshold setting in EnsembleStat conf
> > >> > >> > Owner: Nobody
> > >> > >> > Requestors: Binbin.Zhou at noaa.gov
> > >> > >> > Status: new
> > >> > >> > Ticket <URL:
> > >> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
> > >> > >
> > >> > >> >
> > >> > >> >
> > >> > >> > George,
> > >> > >> >
> > >> > >> > Happy New Year!
> > >> > >> >
> > >> > >> > I am working on transition of our MET-based global
ensemble
> > >> > >> verification
> > >> > >> > to METplus based package. In this package climatology
bins (10
> > >> bins)
> > >> > are
> > >> > >> > used.
> > >> > >> > In current ensemble stat config file, the relevant
entries iare
> > >> > defined
> > >> > >> > like following
> > >> > >> >
> > >> > >> > ens = {
> > >> > >> > ens_thresh = 1.0;
> > >> > >> > vld_thresh = 1.0;
> > >> > >> >
> > >> > >> > field = [
> > >> > >> >
> > >> > >> > {
> > >> > >> > name = "HGT";
> > >> > >> > level = "P500";
> > >> > >> > obs_thresh = [ <=CDP10, >CDP10&&<=CDP20,
> > >CDP20&&<=CDP30,
> > >> > >> > >CDP30&&<=CDP40, >CDP40&&<=CDP50, >CDP50&&<=CDP60,
> > >CDP60&&<=CDP70,
> > >> > >> > >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];
> > >> > >> > }
> > >> > >> > ]
> > >> > >> > }
> > >> > >> > fcst = ens;
> > >> > >> > obs = fcst;
> > >> > >> > ens_ssvar_bin_size = 1000000;
> > >> > >> > ens_phist_bin_size = 0.05;
> > >> > >> > climo_mean = fcst;
> > >> > >> > climo_mean = {
> > >> > >> > file_name = "${CLIM_MEAN}";
> > >> > >> > time_interp_method = DW_MEAN;
> > >> > >> > match_day = TRUE;
> > >> > >> > time_step = 21600;
> > >> > >> > }
> > >> > >> >
> > >> > >> > climo_stdev = climo_mean;
> > >> > >> > climo_stdev = {
> > >> > >> > file_name = "${CLIM_STDV}";
> > >> > >> > }
> > >> > >> >
> > >> > >> > climo_cdf = {
> > >> > >> > cdf_bins = 11;
> > >> > >> > center_bins = TRUE;
> > >> > >> > write_bins = TRUE;
> > >> > >> > }
> > >> > >> >
> > >> > >> > I can not find the correspondent settings in its conf
file from
> > >> > METplus
> > >> > >> > online doc.
> > >> > >> > Can you help me look at this?
> > >> > >> >
> > >> > >> > Thanks!
> > >> > >> >
> > >> > >> > Binbin
> > >> > >> >
> > >> > >> > --
> > >> > >> >
> > >> > >> > Binbin Zhou
> > >> > >> >
> > >> > >> > IMSG at NOAA/NWS/NCEP/EMC
> > >> > >> >
> > >> > >> > 5830 University Research Ct.
> > >> > >> >
> > >> > >> > College Park, MD 20740
> > >> > >> >
> > >> > >> > Binbin.Zhou at noaa.gov
> > >> > >> >
> > >> > >> > 301-683-3683
> > >> > >> >
> > >> > >> >
> > >> > >>
> > >> > >> --
> > >> > >> George McCabe - Software Engineer III
> > >> > >> National Center for Atmospheric Research
> > >> > >> Research Applications Laboratory
> > >> > >> 303-497-2768
> > >> > >> ---
> > >> > >> My working day may not be your working day. Please do not
feel
> > >> obliged
> > >> > to
> > >> > >> reply to this email outside of your normal working hours.
> > >> > >>
> > >> > >>
> > >> > >
> > >> > > --
> > >> > >
> > >> > > Binbin Zhou
> > >> > >
> > >> > > IMSG at NOAA/NWS/NCEP/EMC
> > >> > >
> > >> > > 5830 University Research Ct.
> > >> > >
> > >> > > College Park, MD 20740
> > >> > >
> > >> > > Binbin.Zhou at noaa.gov
> > >> > >
> > >> > > 301-683-3683
> > >> > >
> > >> >
> > >> >
> > >> > --
> > >> >
> > >> > Binbin Zhou
> > >> >
> > >> > IMSG at NOAA/NWS/NCEP/EMC
> > >> >
> > >> > 5830 University Research Ct.
> > >> >
> > >> > College Park, MD 20740
> > >> >
> > >> > Binbin.Zhou at noaa.gov
> > >> >
> > >> > 301-683-3683
> > >> >
> > >> >
> > >>
> > >> --
> > >> George McCabe - Software Engineer III
> > >> National Center for Atmospheric Research
> > >> Research Applications Laboratory
> > >> 303-497-2768
> > >> ---
> > >> My working day may not be your working day. Please do not feel
obliged
> > to
> > >> reply to this email outside of your normal working hours.
> > >>
> > >>
> > >
> > > --
> > >
> > > Binbin Zhou
> > >
> > > IMSG at NOAA/NWS/NCEP/EMC
> > >
> > > 5830 University Research Ct.
> > >
> > > College Park, MD 20740
> > >
> > > Binbin.Zhou at noaa.gov
> > >
> > > 301-683-3683
> > >
> >
> >
> > --
> >
> > Binbin Zhou
> >
> > IMSG at NOAA/NWS/NCEP/EMC
> >
> > 5830 University Research Ct.
> >
> > College Park, MD 20740
> >
> > Binbin.Zhou at noaa.gov
> >
> > 301-683-3683
> >
> >
>
> --
> George McCabe - Software Engineer III
> National Center for Atmospheric Research
> Research Applications Laboratory
> 303-497-2768
> ---
> My working day may not be your working day. Please do not feel
obliged to
> reply to this email outside of your normal working hours.
>
>
--
Binbin Zhou
IMSG at NOAA/NWS/NCEP/EMC
5830 University Research Ct.
College Park, MD 20740
Binbin.Zhou at noaa.gov
301-683-3683
------------------------------------------------
Subject: CDP threshold setting in EnsembleStat conf
From: George McCabe
Time: Wed Jan 06 08:46:15 2021
Hi Binbin,
Could you send me a log file for a run with LOG_LEVEL=DEBUG (in
METplus
config) so I can see how the environment variable ENS_FIELD is set?
The
values of ENS_VAR<n>_* are formatted and set in this environment
variable
which is passed into the MET config. You can compare that value with
what
you used in your successful run outside of the METplus wrapper to
determine
what is different.
Thanks,
George
On Wed, Jan 6, 2021 at 7:11 AM Binbin.Zhou at noaa.gov via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116 >
>
> George,
>
> I got a new error in execution although some output files (nc
file) are
> created but stat files not.
> The error message is
>
> ERROR :
> ERROR : Simple_Node::check(double, double, double) const ->
climatological
> distribution percentile threshold "<=CDP10" requested with invalid
mean
> (-9999) or standard deviation (-9999).
> ERROR :
>
> Such an error was ever investigated by John H before (year ago):
When I
> directly ran ensemble_stat for global ensemble (not METplus-based,
> but hard code of all settings in EnsembleStat config file): If hard
code
> fcst field in EnsembleStat config file like this
>
> name = "HGT";
> level = "P500";
> cat_thresh = [ <=CDP10, >CDP10&&<=CDP20, >CDP20&&<=CDP30,
> >CDP30&&<=CDP40, >CDP40&&<=CDP50, >CDP50&&<=CDP60, >CDP60&&<=CDP70,
> >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];
>
> Run ensemble_stat will have such error: ERROR :
> Simple_Node::check(double, double, double) const -> climatological
> distribution percentile threshold "<=CDP10" requested with invalid
mean
> (-9999) or standard deviation (-9999).
>
> John H. suggested me change "cat_thresh = " to "obs_thresh = ",
then the
> error was solved.
>
> In current METplus version, following your suggestion as
>
> ENS_VAR1_OPTIONS = obs_thresh = [ <=CDP10, >CDP10&&<=CDP20,
> >CDP20&&<=CDP30, >CDP30&&<=CDP40, >CDP40&&<=CDP50, >CDP50&&<=CDP60,
> >CDP60&&<=CDP70, >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];
>
> the same error appears again. So I am not for sure if the
"obs_thresh"
> setting is correctly passed.
>
> Binbin
>
>
>
>
> On Tue, Jan 5, 2021 at 5:19 PM George McCabe via RT
<met_help at ucar.edu>
> wrote:
>
> > Hi Binbin,
> >
> > Your solution should work for now. It looks like although the
METplus
> > variable does get read properly, the environment variable is not
actually
> > set by the EnsembleStat wrapper. I can make a note to add that for
4.0.0,
> > as it is an easy fix.
> >
> > - George
> >
> > On Tue, Jan 5, 2021 at 2:53 PM Binbin.Zhou at noaa.gov via RT <
> > met_help at ucar.edu> wrote:
> >
> > > George,
> > >
> > > I have a temporal solution:
> > > set ploy in EnembleStat config as
> > > poly = [ "${MASKPATH}/lat_NHM.nc",
> > > "${MASKPATH}/lat_NHM.nc",
> > > "${MASKPATH}/lat_TRP.nc" ];
> > >
> > > then set MASKPATH in user_env_vars part in the conf file
> > > This MASKPAH then can be passed to EnsembleStat's poly [ ] entry
> > >
> > > Binbin
> > >
> > > On Tue, Jan 5, 2021 at 4:25 PM Binbin Zhou - NOAA Affiliate <
> > > binbin.zhou at noaa.gov> wrote:
> > >
> > > > George,
> > > >
> > > > Still not working, error says
> > > > ERROR : replace_env() -> unable to get value for environment
> variable
> > > > "VERIF_MASK"
> > > >
> > > > Binbin
> > > >
> > > >
> > > >
> > > > On Tue, Jan 5, 2021 at 3:50 PM George McCabe via RT <
> met_help at ucar.edu
> > >
> > > > wrote:
> > > >
> > > >> Hi Binbin,
> > > >>
> > > >> You should be able to set it in the METplus config the same
way it
> is
> > > done
> > > >> for GridStat -- no quotes with commas between each item. The
wrapper
> > > >> should
> > > >> format it properly.
> > > >>
> > > >> Here is an example from an existing use case:
> > > >>
> > > >> GRID_STAT_VERIFICATION_MASK_TEMPLATE =
> > > >>
{INPUT_BASE}/model_applications/precipitation/mask/CONUS_HRRRTLE.nc,
> > > >>
{INPUT_BASE}/model_applications/precipitation/mask/EAST_HRRRTLE.nc,
> > > >>
{INPUT_BASE}/model_applications/precipitation/mask/WEST_HRRRTLE.nc
> > > >>
> > > >> You should be able to set them the same way using
> > > >> ENSEMBLE_STAT_VERIFICATION_MASK_TEMPLATE. Let me know if that
> doesn't
> > > >> work.
> > > >>
> > > >> - George
> > > >>
> > > >> On Tue, Jan 5, 2021 at 1:45 PM Binbin.Zhou at noaa.gov via RT <
> > > >> met_help at ucar.edu> wrote:
> > > >>
> > > >> >
> > > >> > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116 >
> > > >> >
> > > >> > George,
> > > >> >
> > > >> > I got another issue for verification mask setting.
> > > >> >
> > > >> > I am using $VERIF_MASK in EnsembleStat config f/ile
> > > >> > mask = {
> > > >> > grid = [];
> > > >> > poly = [${VERIF_MASK}];
> > > >> > sid = [];
> > > >> > }
> > > >> >
> > > >> > And using GRID_STAT_VERIFICATION_MASK_TEMPLATE to define
several
> > > >> polygon
> > > >> > nc mask files
> > > >> > But it seems not working. But it works for Gridstat config
in
> suich
> > > >> > setting.
> > > >> > I can not find ENSEMBLE_STAT_ VERIFICATION_MASK_TEMPLATE in
the
> > > METplus
> > > >> doc
> > > >> >
> > > >> > So I define VERIF_MASK in [user_env_vars] part.
> > > >> > It values can not be passed to ploy = [${VERIF_MASK}] in
the
> > > >> EnsembleStat
> > > >> > conf if more than one nc files included.
> > > >> > For example
> > > >> > VERIF_MASK=" '/part/p1.cn', '/path/p2.nc' "
> > > >> > the error says poly = [/path/p1,]
> > > >> > It seems double quote or single quote can not be passed to
> > VERIF_MASK
> > > in
> > > >> > the EnsembleStat config.
> > > >> > I tried use back slash \ to before quote, but still not
working
> > > >> >
> > > >> > Binbin
> > > >> >
> > > >> >
> > > >> > On Tue, Jan 5, 2021 at 10:33 AM Binbin Zhou - NOAA
Affiliate <
> > > >> > binbin.zhou at noaa.gov> wrote:
> > > >> >
> > > >> > > George,
> > > >> > >
> > > >> > > Thanks for your quick response! I'll test this
settings and
> let
> > > >> > > you know the results.
> > > >> > >
> > > >> > > Binbin
> > > >> > >
> > > >> > > On Tue, Jan 5, 2021 at 10:17 AM George McCabe via RT <
> > > >> met_help at ucar.edu>
> > > >> > > wrote:
> > > >> > >
> > > >> > >> Hi Binbin,
> > > >> > >>
> > > >> > >> Happy New Year to you too!
> > > >> > >>
> > > >> > >> I will comment on each configuration variable and how to
set it
> > in
> > > a
> > > >> > >> METplus config inline:
> > > >> > >>
> > > >> > >> ens = {
> > > >> > >> ens_thresh = 1.0;
> > > >> > >>
> > > >> > >>
> > > >> > >> *This is controlled by the ENSEMBLE_STAT_ENS_THRESH
variable.
> The
> > > >> > default
> > > >> > >> value is 1.0, so you don't need to include it in your
config
> > file,
> > > >> but
> > > >> > you
> > > >> > >> can if you may adjust this value at some point.*
> > > >> > >>
> > > >> > >> vld_thresh = 1.0;
> > > >> > >>
> > > >> > >> *This value is set to 1.0 by default so we don't need to
worry
> > > about
> > > >> it
> > > >> > >> right now.*
> > > >> > >>
> > > >> > >> field = [
> > > >> > >>
> > > >> > >> {
> > > >> > >> name = "HGT";
> > > >> > >> level = "P500";
> > > >> > >> obs_thresh = [ <=CDP10, >CDP10&&<=CDP20,
> > >CDP20&&<=CDP30,
> > > >> > >> >CDP30&&<=CDP40, >CDP40&&<=CDP50, >CDP50&&<=CDP60,
> > >CDP60&&<=CDP70,
> > > >> > >> >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];
> > > >> > >> }
> > > >> > >> ]
> > > >> > >> }
> > > >> > >> fcst = ens;
> > > >> > >> obs = fcst;
> > > >> > >>
> > > >> > >> *1) The field info for ens is set in the
> > > >> > >> ENS_VAR<n>_[NAME/LEVEL/THRESH/OPTIONS] variables. The
fcst and
> > obs
> > > >> field
> > > >> > >> info are set in the corresponding FCST_VAR<n>_* and
> OBS_VAR<n>_*
> > > >> > variables
> > > >> > >> respectively, or you can use BOTH_VAR<n>_* if the FCST
and OBS
> > > values
> > > >> > are
> > > >> > >> the same.*
> > > >> > >>
> > > >> > >> *If ENS_VAR<n>_* variables are not explicitly set, then
it will
> > use
> > > >> the
> > > >> > >> values from FCST_VAR<n>_*.*
> > > >> > >> *Since the fcst, obs, and ens are all the same you could
just
> use
> > > >> > >> BOTH_VAR<n>_* variables to control all 3, although keep
in mind
> > > that
> > > >> if
> > > >> > >> you
> > > >> > >> need to change one of them for any reason, it will be
more
> > > difficult
> > > >> to
> > > >> > do
> > > >> > >> this. If you know that they will always be the same
values,
> then
> > I
> > > >> > >> recommend using BOTH_, but if you know they may change
or are
> > > >> unsure, I
> > > >> > >> would recommend setting them by referencing the other
> variables,
> > > >> i.e.*
> > > >> > >>
> > > >> > >> *FCST_VAR1_NAME = HGT*
> > > >> > >> *FCST_VAR1_LEVELS = P500 *
> > > >> > >> *OBS_VAR1_NAME = {FCST_VAR1_NAME}*
> > > >> > >> *OBS_VAR1_LEVELS = {FCST_VAR1_LEVELS}*
> > > >> > >>
> > > >> > >> *2) The [FCST/OBS/ENS]_VAR<n>_THRESH variables set the
> cat_thresh
> > > >> values
> > > >> > >> in
> > > >> > >> the field info. A variable specific to obs_thresh is not
> > currently
> > > >> > >> supported, however you can set these values by using the
> > > >> > ENS_VAR1_OPTIONS
> > > >> > >> variable, i.e.*
> > > >> > >>
> > > >> > >> *ENS_VAR1_OPTIONS = obs_thresh = [ <=CDP10,
>CDP10&&<=CDP20,
> > > >> > >> >CDP20&&<=CDP30, >CDP30&&<=CDP40, >CDP40&&<=CDP50,
> > >CDP50&&<=CDP60,
> > > >> > >> >CDP60&&<=CDP70, >CDP70&&<=CDP80, >CDP80&&<=CDP90,
>CDP90 ];*
> > > >> > >>
> > > >> > >>
> > > >> > >> *Remember to include the semicolon at the end! *
> > > >> > >>
> > > >> > >> ens_ssvar_bin_size = 1000000;
> > > >> > >> *1) This variable is different from the default and not
> currently
> > > >> > >> supported
> > > >> > >> with a METplus config variable. I will add this to the
list of
> > > >> variables
> > > >> > >> in
> > > >> > >> MET config files that we want to support. However, in
the
> > meantime
> > > >> you
> > > >> > can
> > > >> > >> copy the default wrapped MET config file and modify it
to fit
> > your
> > > >> > needs.
> > > >> > >> To do this, you will need to:*
> > > >> > >>
> > > >> > >> * a) Copy
METplus/parm/met_config/EnsembleStatConfig_wrapped
> to
> > > the
> > > >> > >> directory that contains your METplus config file for
this use
> > case.
> > > >> > Rename
> > > >> > >> it by replacing "wrapped" with a short description that
> pertains
> > to
> > > >> your
> > > >> > >> use case.*
> > > >> > >>
> > > >> > >> * b) In your METplus config file, change the value of
> > > >> > >> ENSEMBLE_STAT_CONFIG_FILE to point to the path of this
new
> config
> > > >> file.*
> > > >> > >>
> > > >> > >> * c) If you know the value you want to use for this
variable
> > will
> > > >> > always
> > > >> > >> be 1000000, then simply set the variable to that value.
If you
> > > think
> > > >> you
> > > >> > >> may want to change the value, then you can utilize the
> > > >> [user_env_vars]
> > > >> > >> functionality. See:
> > > >> > >>
> > > >> > >>
> > > >> >
> > > >>
> > >
> >
>
https://dtcenter.github.io/METplus/latest/Users_Guide/systemconfiguration.html#user-
defined-config
> > > >> > >> <
> > > >> > >>
> > > >> >
> > > >>
> > >
> >
>
https://dtcenter.github.io/METplus/latest/Users_Guide/systemconfiguration.html#user-
defined-config
> > > >> > >> >*
> > > >> > >> *In this case, you would add the following to your
METplus
> > config:*
> > > >> > >>
> > > >> > >> *[user_env_vars]*
> > > >> > >> *ENS_SSVAR_BIN_SIZE = 1000000*
> > > >> > >>
> > > >> > >> *Then change the line in your EnsembleStat config file
that you
> > > >> copied
> > > >> > >> to:*
> > > >> > >>
> > > >> > >> * ens_ssvar_bin_size = ${ENS_SSVAR_BIN_SIZE}; *
> > > >> > >>
> > > >> > >> ens_phist_bin_size = 0.05;
> > > >> > >> *This variable uses the default value, so you don't need
to do
> > > >> anything
> > > >> > >> here. If you need to make it configurable or change the
value,
> > then
> > > >> > follow
> > > >> > >> the instructions for setting ens_ssvar_bin_size.*
> > > >> > >>
> > > >> > >> climo_mean = fcst;
> > > >> > >> climo_mean = {
> > > >> > >> file_name = "${CLIM_MEAN}";
> > > >> > >> time_interp_method = DW_MEAN;
> > > >> > >> match_day = TRUE;
> > > >> > >> time_step = 21600;
> > > >> > >> }
> > > >> > >>
> > > >> > >>
> > > >> > >> *Instead of using CLIM_MEAN, you can set
> > > >> > >> ENSEMBLE_STAT_CLIMO_MEAN_INPUT_[DIR/TEMPLATE] in the
METplus
> > > config.
> > > >> You
> > > >> > >> can use filename template syntax in the _TEMPLATE value,
i.e.
> > > >> > >> {valid?fmt=%m%d}. The other variables in the climo_mean
> > dictionary
> > > >> are
> > > >> > >> actually old variables that have been replaced with
> day_interval
> > > and
> > > >> > >> hour_interval, but the values you use are the old
defaults, so
> > you
> > > >> > >> shouldn't need to set them.*
> > > >> > >>
> > > >> > >> climo_stdev = climo_mean;
> > > >> > >> climo_stdev = {
> > > >> > >> file_name = "${CLIM_STDV}";
> > > >> > >> }
> > > >> > >>
> > > >> > >> *Similarly to CLIM_MEAN, you can use
> > > >> > >> ENSEMBLE_STAT_CLIMO_STDEV_INPUT_[DIR/TEMPLATE] to set
this file
> > > >> name.*
> > > >> > >>
> > > >> > >> climo_cdf = {
> > > >> > >> cdf_bins = 11;
> > > >> > >> center_bins = TRUE;
> > > >> > >> write_bins = TRUE;
> > > >> > >> }
> > > >> > >> *The value for write_bins is the default, but the values
for
> > > cdf_bins
> > > >> > and
> > > >> > >> center_bins do not. To set these, follow the above
instructions
> > for
> > > >> > >> ens_ssvar_bin_size to override them and/or make them
> configurable
> > > >> > through
> > > >> > >> METplus. I will also add these variables to the list of
MET
> > configs
> > > >> that
> > > >> > >> users want to be able to easily configure through
METplus
> > configs.*
> > > >> > >>
> > > >> > >> Please let me know if you run into any issues setting
any of
> that
> > > up.
> > > >> > >> Also,
> > > >> > >> if there are any other MET config variables that you
want to
> see
> > > >> > supported
> > > >> > >> in METplus, let me know and I will make sure they get
included
> > when
> > > >> we
> > > >> > >> have
> > > >> > >> a chance to refactor those wrappers. It is possible to
add
> > support
> > > >> for
> > > >> > MET
> > > >> > >> configs using the above instructions, but it is always
easier
> and
> > > >> less
> > > >> > >> error-prone to have them configurable directly through a
> variable
> > > in
> > > >> the
> > > >> > >> METplus config.
> > > >> > >>
> > > >> > >> Thanks,
> > > >> > >> George
> > > >> > >>
> > > >> > >> On Tue, Jan 5, 2021 at 7:14 AM Binbin.Zhou at noaa.gov via
RT <
> > > >> > >> met_help at ucar.edu> wrote:
> > > >> > >>
> > > >> > >> >
> > > >> > >> > Tue Jan 05 07:14:54 2021: Request 98116 was acted
upon.
> > > >> > >> > Transaction: Ticket created by Binbin.Zhou at noaa.gov
> > > >> > >> > Queue: met_help
> > > >> > >> > Subject: CDP threshold setting in EnsembleStat
conf
> > > >> > >> > Owner: Nobody
> > > >> > >> > Requestors: Binbin.Zhou at noaa.gov
> > > >> > >> > Status: new
> > > >> > >> > Ticket <URL:
> > > >> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
> > > >> > >
> > > >> > >> >
> > > >> > >> >
> > > >> > >> > George,
> > > >> > >> >
> > > >> > >> > Happy New Year!
> > > >> > >> >
> > > >> > >> > I am working on transition of our MET-based global
> ensemble
> > > >> > >> verification
> > > >> > >> > to METplus based package. In this package climatology
bins
> (10
> > > >> bins)
> > > >> > are
> > > >> > >> > used.
> > > >> > >> > In current ensemble stat config file, the relevant
entries
> iare
> > > >> > defined
> > > >> > >> > like following
> > > >> > >> >
> > > >> > >> > ens = {
> > > >> > >> > ens_thresh = 1.0;
> > > >> > >> > vld_thresh = 1.0;
> > > >> > >> >
> > > >> > >> > field = [
> > > >> > >> >
> > > >> > >> > {
> > > >> > >> > name = "HGT";
> > > >> > >> > level = "P500";
> > > >> > >> > obs_thresh = [ <=CDP10, >CDP10&&<=CDP20,
> > > >CDP20&&<=CDP30,
> > > >> > >> > >CDP30&&<=CDP40, >CDP40&&<=CDP50, >CDP50&&<=CDP60,
> > > >CDP60&&<=CDP70,
> > > >> > >> > >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];
> > > >> > >> > }
> > > >> > >> > ]
> > > >> > >> > }
> > > >> > >> > fcst = ens;
> > > >> > >> > obs = fcst;
> > > >> > >> > ens_ssvar_bin_size = 1000000;
> > > >> > >> > ens_phist_bin_size = 0.05;
> > > >> > >> > climo_mean = fcst;
> > > >> > >> > climo_mean = {
> > > >> > >> > file_name = "${CLIM_MEAN}";
> > > >> > >> > time_interp_method = DW_MEAN;
> > > >> > >> > match_day = TRUE;
> > > >> > >> > time_step = 21600;
> > > >> > >> > }
> > > >> > >> >
> > > >> > >> > climo_stdev = climo_mean;
> > > >> > >> > climo_stdev = {
> > > >> > >> > file_name = "${CLIM_STDV}";
> > > >> > >> > }
> > > >> > >> >
> > > >> > >> > climo_cdf = {
> > > >> > >> > cdf_bins = 11;
> > > >> > >> > center_bins = TRUE;
> > > >> > >> > write_bins = TRUE;
> > > >> > >> > }
> > > >> > >> >
> > > >> > >> > I can not find the correspondent settings in its conf
file
> from
> > > >> > METplus
> > > >> > >> > online doc.
> > > >> > >> > Can you help me look at this?
> > > >> > >> >
> > > >> > >> > Thanks!
> > > >> > >> >
> > > >> > >> > Binbin
> > > >> > >> >
> > > >> > >> > --
> > > >> > >> >
> > > >> > >> > Binbin Zhou
> > > >> > >> >
> > > >> > >> > IMSG at NOAA/NWS/NCEP/EMC
> > > >> > >> >
> > > >> > >> > 5830 University Research Ct.
> > > >> > >> >
> > > >> > >> > College Park, MD 20740
> > > >> > >> >
> > > >> > >> > Binbin.Zhou at noaa.gov
> > > >> > >> >
> > > >> > >> > 301-683-3683
> > > >> > >> >
> > > >> > >> >
> > > >> > >>
> > > >> > >> --
> > > >> > >> George McCabe - Software Engineer III
> > > >> > >> National Center for Atmospheric Research
> > > >> > >> Research Applications Laboratory
> > > >> > >> 303-497-2768
> > > >> > >> ---
> > > >> > >> My working day may not be your working day. Please do
not feel
> > > >> obliged
> > > >> > to
> > > >> > >> reply to this email outside of your normal working
hours.
> > > >> > >>
> > > >> > >>
> > > >> > >
> > > >> > > --
> > > >> > >
> > > >> > > Binbin Zhou
> > > >> > >
> > > >> > > IMSG at NOAA/NWS/NCEP/EMC
> > > >> > >
> > > >> > > 5830 University Research Ct.
> > > >> > >
> > > >> > > College Park, MD 20740
> > > >> > >
> > > >> > > Binbin.Zhou at noaa.gov
> > > >> > >
> > > >> > > 301-683-3683
> > > >> > >
> > > >> >
> > > >> >
> > > >> > --
> > > >> >
> > > >> > Binbin Zhou
> > > >> >
> > > >> > IMSG at NOAA/NWS/NCEP/EMC
> > > >> >
> > > >> > 5830 University Research Ct.
> > > >> >
> > > >> > College Park, MD 20740
> > > >> >
> > > >> > Binbin.Zhou at noaa.gov
> > > >> >
> > > >> > 301-683-3683
> > > >> >
> > > >> >
> > > >>
> > > >> --
> > > >> George McCabe - Software Engineer III
> > > >> National Center for Atmospheric Research
> > > >> Research Applications Laboratory
> > > >> 303-497-2768
> > > >> ---
> > > >> My working day may not be your working day. Please do not
feel
> obliged
> > > to
> > > >> reply to this email outside of your normal working hours.
> > > >>
> > > >>
> > > >
> > > > --
> > > >
> > > > Binbin Zhou
> > > >
> > > > IMSG at NOAA/NWS/NCEP/EMC
> > > >
> > > > 5830 University Research Ct.
> > > >
> > > > College Park, MD 20740
> > > >
> > > > Binbin.Zhou at noaa.gov
> > > >
> > > > 301-683-3683
> > > >
> > >
> > >
> > > --
> > >
> > > Binbin Zhou
> > >
> > > IMSG at NOAA/NWS/NCEP/EMC
> > >
> > > 5830 University Research Ct.
> > >
> > > College Park, MD 20740
> > >
> > > Binbin.Zhou at noaa.gov
> > >
> > > 301-683-3683
> > >
> > >
> >
> > --
> > George McCabe - Software Engineer III
> > National Center for Atmospheric Research
> > Research Applications Laboratory
> > 303-497-2768
> > ---
> > My working day may not be your working day. Please do not feel
obliged to
> > reply to this email outside of your normal working hours.
> >
> >
>
> --
>
> Binbin Zhou
>
> IMSG at NOAA/NWS/NCEP/EMC
>
> 5830 University Research Ct.
>
> College Park, MD 20740
>
> Binbin.Zhou at noaa.gov
>
> 301-683-3683
>
>
--
George McCabe - Software Engineer III
National Center for Atmospheric Research
Research Applications Laboratory
303-497-2768
---
My working day may not be your working day. Please do not feel obliged
to
reply to this email outside of your normal working hours.
------------------------------------------------
Subject: CDP threshold setting in EnsembleStat conf
From: Binbin.Zhou at noaa.gov
Time: Wed Jan 06 08:57:17 2021
George,
Can you access WCOSS or access HERA?
Otherwise I will email attached to you
Binbin
On Wed, Jan 6, 2021 at 10:46 AM George McCabe via RT
<met_help at ucar.edu>
wrote:
> Hi Binbin,
>
> Could you send me a log file for a run with LOG_LEVEL=DEBUG (in
METplus
> config) so I can see how the environment variable ENS_FIELD is set?
The
> values of ENS_VAR<n>_* are formatted and set in this environment
variable
> which is passed into the MET config. You can compare that value with
what
> you used in your successful run outside of the METplus wrapper to
determine
> what is different.
>
> Thanks,
> George
>
> On Wed, Jan 6, 2021 at 7:11 AM Binbin.Zhou at noaa.gov via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116 >
> >
> > George,
> >
> > I got a new error in execution although some output files (nc
file) are
> > created but stat files not.
> > The error message is
> >
> > ERROR :
> > ERROR : Simple_Node::check(double, double, double) const ->
> climatological
> > distribution percentile threshold "<=CDP10" requested with invalid
mean
> > (-9999) or standard deviation (-9999).
> > ERROR :
> >
> > Such an error was ever investigated by John H before (year ago):
When I
> > directly ran ensemble_stat for global ensemble (not METplus-based,
> > but hard code of all settings in EnsembleStat config file): If
hard code
> > fcst field in EnsembleStat config file like this
> >
> > name = "HGT";
> > level = "P500";
> > cat_thresh = [ <=CDP10, >CDP10&&<=CDP20, >CDP20&&<=CDP30,
> > >CDP30&&<=CDP40, >CDP40&&<=CDP50, >CDP50&&<=CDP60,
>CDP60&&<=CDP70,
> > >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];
> >
> > Run ensemble_stat will have such error: ERROR :
> > Simple_Node::check(double, double, double) const -> climatological
> > distribution percentile threshold "<=CDP10" requested with invalid
mean
> > (-9999) or standard deviation (-9999).
> >
> > John H. suggested me change "cat_thresh = " to "obs_thresh = ",
then
> the
> > error was solved.
> >
> > In current METplus version, following your suggestion as
> >
> > ENS_VAR1_OPTIONS = obs_thresh = [ <=CDP10, >CDP10&&<=CDP20,
> > >CDP20&&<=CDP30, >CDP30&&<=CDP40, >CDP40&&<=CDP50,
>CDP50&&<=CDP60,
> > >CDP60&&<=CDP70, >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];
> >
> > the same error appears again. So I am not for sure if the
"obs_thresh"
> > setting is correctly passed.
> >
> > Binbin
> >
> >
> >
> >
> > On Tue, Jan 5, 2021 at 5:19 PM George McCabe via RT
<met_help at ucar.edu>
> > wrote:
> >
> > > Hi Binbin,
> > >
> > > Your solution should work for now. It looks like although the
METplus
> > > variable does get read properly, the environment variable is not
> actually
> > > set by the EnsembleStat wrapper. I can make a note to add that
for
> 4.0.0,
> > > as it is an easy fix.
> > >
> > > - George
> > >
> > > On Tue, Jan 5, 2021 at 2:53 PM Binbin.Zhou at noaa.gov via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > > George,
> > > >
> > > > I have a temporal solution:
> > > > set ploy in EnembleStat config as
> > > > poly = [ "${MASKPATH}/lat_NHM.nc",
> > > > "${MASKPATH}/lat_NHM.nc",
> > > > "${MASKPATH}/lat_TRP.nc" ];
> > > >
> > > > then set MASKPATH in user_env_vars part in the conf file
> > > > This MASKPAH then can be passed to EnsembleStat's poly [ ]
entry
> > > >
> > > > Binbin
> > > >
> > > > On Tue, Jan 5, 2021 at 4:25 PM Binbin Zhou - NOAA Affiliate <
> > > > binbin.zhou at noaa.gov> wrote:
> > > >
> > > > > George,
> > > > >
> > > > > Still not working, error says
> > > > > ERROR : replace_env() -> unable to get value for
environment
> > variable
> > > > > "VERIF_MASK"
> > > > >
> > > > > Binbin
> > > > >
> > > > >
> > > > >
> > > > > On Tue, Jan 5, 2021 at 3:50 PM George McCabe via RT <
> > met_help at ucar.edu
> > > >
> > > > > wrote:
> > > > >
> > > > >> Hi Binbin,
> > > > >>
> > > > >> You should be able to set it in the METplus config the same
way it
> > is
> > > > done
> > > > >> for GridStat -- no quotes with commas between each item.
The
> wrapper
> > > > >> should
> > > > >> format it properly.
> > > > >>
> > > > >> Here is an example from an existing use case:
> > > > >>
> > > > >> GRID_STAT_VERIFICATION_MASK_TEMPLATE =
> > > > >>
> {INPUT_BASE}/model_applications/precipitation/mask/CONUS_HRRRTLE.nc,
> > > > >>
> {INPUT_BASE}/model_applications/precipitation/mask/EAST_HRRRTLE.nc,
> > > > >>
{INPUT_BASE}/model_applications/precipitation/mask/WEST_HRRRTLE.nc
> > > > >>
> > > > >> You should be able to set them the same way using
> > > > >> ENSEMBLE_STAT_VERIFICATION_MASK_TEMPLATE. Let me know if
that
> > doesn't
> > > > >> work.
> > > > >>
> > > > >> - George
> > > > >>
> > > > >> On Tue, Jan 5, 2021 at 1:45 PM Binbin.Zhou at noaa.gov via RT
<
> > > > >> met_help at ucar.edu> wrote:
> > > > >>
> > > > >> >
> > > > >> > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116 >
> > > > >> >
> > > > >> > George,
> > > > >> >
> > > > >> > I got another issue for verification mask setting.
> > > > >> >
> > > > >> > I am using $VERIF_MASK in EnsembleStat config f/ile
> > > > >> > mask = {
> > > > >> > grid = [];
> > > > >> > poly = [${VERIF_MASK}];
> > > > >> > sid = [];
> > > > >> > }
> > > > >> >
> > > > >> > And using GRID_STAT_VERIFICATION_MASK_TEMPLATE to define
> several
> > > > >> polygon
> > > > >> > nc mask files
> > > > >> > But it seems not working. But it works for Gridstat
config in
> > suich
> > > > >> > setting.
> > > > >> > I can not find ENSEMBLE_STAT_ VERIFICATION_MASK_TEMPLATE
in the
> > > > METplus
> > > > >> doc
> > > > >> >
> > > > >> > So I define VERIF_MASK in [user_env_vars] part.
> > > > >> > It values can not be passed to ploy = [${VERIF_MASK}] in
the
> > > > >> EnsembleStat
> > > > >> > conf if more than one nc files included.
> > > > >> > For example
> > > > >> > VERIF_MASK=" '/part/p1.cn', '/path/p2.nc' "
> > > > >> > the error says poly = [/path/p1,]
> > > > >> > It seems double quote or single quote can not be passed
to
> > > VERIF_MASK
> > > > in
> > > > >> > the EnsembleStat config.
> > > > >> > I tried use back slash \ to before quote, but still not
working
> > > > >> >
> > > > >> > Binbin
> > > > >> >
> > > > >> >
> > > > >> > On Tue, Jan 5, 2021 at 10:33 AM Binbin Zhou - NOAA
Affiliate <
> > > > >> > binbin.zhou at noaa.gov> wrote:
> > > > >> >
> > > > >> > > George,
> > > > >> > >
> > > > >> > > Thanks for your quick response! I'll test this
settings and
> > let
> > > > >> > > you know the results.
> > > > >> > >
> > > > >> > > Binbin
> > > > >> > >
> > > > >> > > On Tue, Jan 5, 2021 at 10:17 AM George McCabe via RT <
> > > > >> met_help at ucar.edu>
> > > > >> > > wrote:
> > > > >> > >
> > > > >> > >> Hi Binbin,
> > > > >> > >>
> > > > >> > >> Happy New Year to you too!
> > > > >> > >>
> > > > >> > >> I will comment on each configuration variable and how
to set
> it
> > > in
> > > > a
> > > > >> > >> METplus config inline:
> > > > >> > >>
> > > > >> > >> ens = {
> > > > >> > >> ens_thresh = 1.0;
> > > > >> > >>
> > > > >> > >>
> > > > >> > >> *This is controlled by the ENSEMBLE_STAT_ENS_THRESH
variable.
> > The
> > > > >> > default
> > > > >> > >> value is 1.0, so you don't need to include it in your
config
> > > file,
> > > > >> but
> > > > >> > you
> > > > >> > >> can if you may adjust this value at some point.*
> > > > >> > >>
> > > > >> > >> vld_thresh = 1.0;
> > > > >> > >>
> > > > >> > >> *This value is set to 1.0 by default so we don't need
to
> worry
> > > > about
> > > > >> it
> > > > >> > >> right now.*
> > > > >> > >>
> > > > >> > >> field = [
> > > > >> > >>
> > > > >> > >> {
> > > > >> > >> name = "HGT";
> > > > >> > >> level = "P500";
> > > > >> > >> obs_thresh = [ <=CDP10, >CDP10&&<=CDP20,
> > > >CDP20&&<=CDP30,
> > > > >> > >> >CDP30&&<=CDP40, >CDP40&&<=CDP50, >CDP50&&<=CDP60,
> > > >CDP60&&<=CDP70,
> > > > >> > >> >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];
> > > > >> > >> }
> > > > >> > >> ]
> > > > >> > >> }
> > > > >> > >> fcst = ens;
> > > > >> > >> obs = fcst;
> > > > >> > >>
> > > > >> > >> *1) The field info for ens is set in the
> > > > >> > >> ENS_VAR<n>_[NAME/LEVEL/THRESH/OPTIONS] variables. The
fcst
> and
> > > obs
> > > > >> field
> > > > >> > >> info are set in the corresponding FCST_VAR<n>_* and
> > OBS_VAR<n>_*
> > > > >> > variables
> > > > >> > >> respectively, or you can use BOTH_VAR<n>_* if the FCST
and
> OBS
> > > > values
> > > > >> > are
> > > > >> > >> the same.*
> > > > >> > >>
> > > > >> > >> *If ENS_VAR<n>_* variables are not explicitly set,
then it
> will
> > > use
> > > > >> the
> > > > >> > >> values from FCST_VAR<n>_*.*
> > > > >> > >> *Since the fcst, obs, and ens are all the same you
could just
> > use
> > > > >> > >> BOTH_VAR<n>_* variables to control all 3, although
keep in
> mind
> > > > that
> > > > >> if
> > > > >> > >> you
> > > > >> > >> need to change one of them for any reason, it will be
more
> > > > difficult
> > > > >> to
> > > > >> > do
> > > > >> > >> this. If you know that they will always be the same
values,
> > then
> > > I
> > > > >> > >> recommend using BOTH_, but if you know they may change
or are
> > > > >> unsure, I
> > > > >> > >> would recommend setting them by referencing the other
> > variables,
> > > > >> i.e.*
> > > > >> > >>
> > > > >> > >> *FCST_VAR1_NAME = HGT*
> > > > >> > >> *FCST_VAR1_LEVELS = P500 *
> > > > >> > >> *OBS_VAR1_NAME = {FCST_VAR1_NAME}*
> > > > >> > >> *OBS_VAR1_LEVELS = {FCST_VAR1_LEVELS}*
> > > > >> > >>
> > > > >> > >> *2) The [FCST/OBS/ENS]_VAR<n>_THRESH variables set the
> > cat_thresh
> > > > >> values
> > > > >> > >> in
> > > > >> > >> the field info. A variable specific to obs_thresh is
not
> > > currently
> > > > >> > >> supported, however you can set these values by using
the
> > > > >> > ENS_VAR1_OPTIONS
> > > > >> > >> variable, i.e.*
> > > > >> > >>
> > > > >> > >> *ENS_VAR1_OPTIONS = obs_thresh = [ <=CDP10,
>CDP10&&<=CDP20,
> > > > >> > >> >CDP20&&<=CDP30, >CDP30&&<=CDP40, >CDP40&&<=CDP50,
> > > >CDP50&&<=CDP60,
> > > > >> > >> >CDP60&&<=CDP70, >CDP70&&<=CDP80, >CDP80&&<=CDP90,
>CDP90 ];*
> > > > >> > >>
> > > > >> > >>
> > > > >> > >> *Remember to include the semicolon at the end! *
> > > > >> > >>
> > > > >> > >> ens_ssvar_bin_size = 1000000;
> > > > >> > >> *1) This variable is different from the default and
not
> > currently
> > > > >> > >> supported
> > > > >> > >> with a METplus config variable. I will add this to the
list
> of
> > > > >> variables
> > > > >> > >> in
> > > > >> > >> MET config files that we want to support. However, in
the
> > > meantime
> > > > >> you
> > > > >> > can
> > > > >> > >> copy the default wrapped MET config file and modify it
to fit
> > > your
> > > > >> > needs.
> > > > >> > >> To do this, you will need to:*
> > > > >> > >>
> > > > >> > >> * a) Copy
METplus/parm/met_config/EnsembleStatConfig_wrapped
> > to
> > > > the
> > > > >> > >> directory that contains your METplus config file for
this use
> > > case.
> > > > >> > Rename
> > > > >> > >> it by replacing "wrapped" with a short description
that
> > pertains
> > > to
> > > > >> your
> > > > >> > >> use case.*
> > > > >> > >>
> > > > >> > >> * b) In your METplus config file, change the value of
> > > > >> > >> ENSEMBLE_STAT_CONFIG_FILE to point to the path of this
new
> > config
> > > > >> file.*
> > > > >> > >>
> > > > >> > >> * c) If you know the value you want to use for this
variable
> > > will
> > > > >> > always
> > > > >> > >> be 1000000, then simply set the variable to that
value. If
> you
> > > > think
> > > > >> you
> > > > >> > >> may want to change the value, then you can utilize the
> > > > >> [user_env_vars]
> > > > >> > >> functionality. See:
> > > > >> > >>
> > > > >> > >>
> > > > >> >
> > > > >>
> > > >
> > >
> >
>
https://dtcenter.github.io/METplus/latest/Users_Guide/systemconfiguration.html#user-
defined-config
> > > > >> > >> <
> > > > >> > >>
> > > > >> >
> > > > >>
> > > >
> > >
> >
>
https://dtcenter.github.io/METplus/latest/Users_Guide/systemconfiguration.html#user-
defined-config
> > > > >> > >> >*
> > > > >> > >> *In this case, you would add the following to your
METplus
> > > config:*
> > > > >> > >>
> > > > >> > >> *[user_env_vars]*
> > > > >> > >> *ENS_SSVAR_BIN_SIZE = 1000000*
> > > > >> > >>
> > > > >> > >> *Then change the line in your EnsembleStat config file
that
> you
> > > > >> copied
> > > > >> > >> to:*
> > > > >> > >>
> > > > >> > >> * ens_ssvar_bin_size = ${ENS_SSVAR_BIN_SIZE}; *
> > > > >> > >>
> > > > >> > >> ens_phist_bin_size = 0.05;
> > > > >> > >> *This variable uses the default value, so you don't
need to
> do
> > > > >> anything
> > > > >> > >> here. If you need to make it configurable or change
the
> value,
> > > then
> > > > >> > follow
> > > > >> > >> the instructions for setting ens_ssvar_bin_size.*
> > > > >> > >>
> > > > >> > >> climo_mean = fcst;
> > > > >> > >> climo_mean = {
> > > > >> > >> file_name = "${CLIM_MEAN}";
> > > > >> > >> time_interp_method = DW_MEAN;
> > > > >> > >> match_day = TRUE;
> > > > >> > >> time_step = 21600;
> > > > >> > >> }
> > > > >> > >>
> > > > >> > >>
> > > > >> > >> *Instead of using CLIM_MEAN, you can set
> > > > >> > >> ENSEMBLE_STAT_CLIMO_MEAN_INPUT_[DIR/TEMPLATE] in the
METplus
> > > > config.
> > > > >> You
> > > > >> > >> can use filename template syntax in the _TEMPLATE
value, i.e.
> > > > >> > >> {valid?fmt=%m%d}. The other variables in the
climo_mean
> > > dictionary
> > > > >> are
> > > > >> > >> actually old variables that have been replaced with
> > day_interval
> > > > and
> > > > >> > >> hour_interval, but the values you use are the old
defaults,
> so
> > > you
> > > > >> > >> shouldn't need to set them.*
> > > > >> > >>
> > > > >> > >> climo_stdev = climo_mean;
> > > > >> > >> climo_stdev = {
> > > > >> > >> file_name = "${CLIM_STDV}";
> > > > >> > >> }
> > > > >> > >>
> > > > >> > >> *Similarly to CLIM_MEAN, you can use
> > > > >> > >> ENSEMBLE_STAT_CLIMO_STDEV_INPUT_[DIR/TEMPLATE] to set
this
> file
> > > > >> name.*
> > > > >> > >>
> > > > >> > >> climo_cdf = {
> > > > >> > >> cdf_bins = 11;
> > > > >> > >> center_bins = TRUE;
> > > > >> > >> write_bins = TRUE;
> > > > >> > >> }
> > > > >> > >> *The value for write_bins is the default, but the
values for
> > > > cdf_bins
> > > > >> > and
> > > > >> > >> center_bins do not. To set these, follow the above
> instructions
> > > for
> > > > >> > >> ens_ssvar_bin_size to override them and/or make them
> > configurable
> > > > >> > through
> > > > >> > >> METplus. I will also add these variables to the list
of MET
> > > configs
> > > > >> that
> > > > >> > >> users want to be able to easily configure through
METplus
> > > configs.*
> > > > >> > >>
> > > > >> > >> Please let me know if you run into any issues setting
any of
> > that
> > > > up.
> > > > >> > >> Also,
> > > > >> > >> if there are any other MET config variables that you
want to
> > see
> > > > >> > supported
> > > > >> > >> in METplus, let me know and I will make sure they get
> included
> > > when
> > > > >> we
> > > > >> > >> have
> > > > >> > >> a chance to refactor those wrappers. It is possible to
add
> > > support
> > > > >> for
> > > > >> > MET
> > > > >> > >> configs using the above instructions, but it is always
easier
> > and
> > > > >> less
> > > > >> > >> error-prone to have them configurable directly through
a
> > variable
> > > > in
> > > > >> the
> > > > >> > >> METplus config.
> > > > >> > >>
> > > > >> > >> Thanks,
> > > > >> > >> George
> > > > >> > >>
> > > > >> > >> On Tue, Jan 5, 2021 at 7:14 AM Binbin.Zhou at noaa.gov
via RT <
> > > > >> > >> met_help at ucar.edu> wrote:
> > > > >> > >>
> > > > >> > >> >
> > > > >> > >> > Tue Jan 05 07:14:54 2021: Request 98116 was acted
upon.
> > > > >> > >> > Transaction: Ticket created by Binbin.Zhou at noaa.gov
> > > > >> > >> > Queue: met_help
> > > > >> > >> > Subject: CDP threshold setting in EnsembleStat
conf
> > > > >> > >> > Owner: Nobody
> > > > >> > >> > Requestors: Binbin.Zhou at noaa.gov
> > > > >> > >> > Status: new
> > > > >> > >> > Ticket <URL:
> > > > >> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
> > > > >> > >
> > > > >> > >> >
> > > > >> > >> >
> > > > >> > >> > George,
> > > > >> > >> >
> > > > >> > >> > Happy New Year!
> > > > >> > >> >
> > > > >> > >> > I am working on transition of our MET-based
global
> > ensemble
> > > > >> > >> verification
> > > > >> > >> > to METplus based package. In this package
climatology bins
> > (10
> > > > >> bins)
> > > > >> > are
> > > > >> > >> > used.
> > > > >> > >> > In current ensemble stat config file, the relevant
entries
> > iare
> > > > >> > defined
> > > > >> > >> > like following
> > > > >> > >> >
> > > > >> > >> > ens = {
> > > > >> > >> > ens_thresh = 1.0;
> > > > >> > >> > vld_thresh = 1.0;
> > > > >> > >> >
> > > > >> > >> > field = [
> > > > >> > >> >
> > > > >> > >> > {
> > > > >> > >> > name = "HGT";
> > > > >> > >> > level = "P500";
> > > > >> > >> > obs_thresh = [ <=CDP10, >CDP10&&<=CDP20,
> > > > >CDP20&&<=CDP30,
> > > > >> > >> > >CDP30&&<=CDP40, >CDP40&&<=CDP50, >CDP50&&<=CDP60,
> > > > >CDP60&&<=CDP70,
> > > > >> > >> > >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];
> > > > >> > >> > }
> > > > >> > >> > ]
> > > > >> > >> > }
> > > > >> > >> > fcst = ens;
> > > > >> > >> > obs = fcst;
> > > > >> > >> > ens_ssvar_bin_size = 1000000;
> > > > >> > >> > ens_phist_bin_size = 0.05;
> > > > >> > >> > climo_mean = fcst;
> > > > >> > >> > climo_mean = {
> > > > >> > >> > file_name = "${CLIM_MEAN}";
> > > > >> > >> > time_interp_method = DW_MEAN;
> > > > >> > >> > match_day = TRUE;
> > > > >> > >> > time_step = 21600;
> > > > >> > >> > }
> > > > >> > >> >
> > > > >> > >> > climo_stdev = climo_mean;
> > > > >> > >> > climo_stdev = {
> > > > >> > >> > file_name = "${CLIM_STDV}";
> > > > >> > >> > }
> > > > >> > >> >
> > > > >> > >> > climo_cdf = {
> > > > >> > >> > cdf_bins = 11;
> > > > >> > >> > center_bins = TRUE;
> > > > >> > >> > write_bins = TRUE;
> > > > >> > >> > }
> > > > >> > >> >
> > > > >> > >> > I can not find the correspondent settings in its
conf file
> > from
> > > > >> > METplus
> > > > >> > >> > online doc.
> > > > >> > >> > Can you help me look at this?
> > > > >> > >> >
> > > > >> > >> > Thanks!
> > > > >> > >> >
> > > > >> > >> > Binbin
> > > > >> > >> >
> > > > >> > >> > --
> > > > >> > >> >
> > > > >> > >> > Binbin Zhou
> > > > >> > >> >
> > > > >> > >> > IMSG at NOAA/NWS/NCEP/EMC
> > > > >> > >> >
> > > > >> > >> > 5830 University Research Ct.
> > > > >> > >> >
> > > > >> > >> > College Park, MD 20740
> > > > >> > >> >
> > > > >> > >> > Binbin.Zhou at noaa.gov
> > > > >> > >> >
> > > > >> > >> > 301-683-3683
> > > > >> > >> >
> > > > >> > >> >
> > > > >> > >>
> > > > >> > >> --
> > > > >> > >> George McCabe - Software Engineer III
> > > > >> > >> National Center for Atmospheric Research
> > > > >> > >> Research Applications Laboratory
> > > > >> > >> 303-497-2768
> > > > >> > >> ---
> > > > >> > >> My working day may not be your working day. Please do
not
> feel
> > > > >> obliged
> > > > >> > to
> > > > >> > >> reply to this email outside of your normal working
hours.
> > > > >> > >>
> > > > >> > >>
> > > > >> > >
> > > > >> > > --
> > > > >> > >
> > > > >> > > Binbin Zhou
> > > > >> > >
> > > > >> > > IMSG at NOAA/NWS/NCEP/EMC
> > > > >> > >
> > > > >> > > 5830 University Research Ct.
> > > > >> > >
> > > > >> > > College Park, MD 20740
> > > > >> > >
> > > > >> > > Binbin.Zhou at noaa.gov
> > > > >> > >
> > > > >> > > 301-683-3683
> > > > >> > >
> > > > >> >
> > > > >> >
> > > > >> > --
> > > > >> >
> > > > >> > Binbin Zhou
> > > > >> >
> > > > >> > IMSG at NOAA/NWS/NCEP/EMC
> > > > >> >
> > > > >> > 5830 University Research Ct.
> > > > >> >
> > > > >> > College Park, MD 20740
> > > > >> >
> > > > >> > Binbin.Zhou at noaa.gov
> > > > >> >
> > > > >> > 301-683-3683
> > > > >> >
> > > > >> >
> > > > >>
> > > > >> --
> > > > >> George McCabe - Software Engineer III
> > > > >> National Center for Atmospheric Research
> > > > >> Research Applications Laboratory
> > > > >> 303-497-2768
> > > > >> ---
> > > > >> My working day may not be your working day. Please do not
feel
> > obliged
> > > > to
> > > > >> reply to this email outside of your normal working hours.
> > > > >>
> > > > >>
> > > > >
> > > > > --
> > > > >
> > > > > Binbin Zhou
> > > > >
> > > > > IMSG at NOAA/NWS/NCEP/EMC
> > > > >
> > > > > 5830 University Research Ct.
> > > > >
> > > > > College Park, MD 20740
> > > > >
> > > > > Binbin.Zhou at noaa.gov
> > > > >
> > > > > 301-683-3683
> > > > >
> > > >
> > > >
> > > > --
> > > >
> > > > Binbin Zhou
> > > >
> > > > IMSG at NOAA/NWS/NCEP/EMC
> > > >
> > > > 5830 University Research Ct.
> > > >
> > > > College Park, MD 20740
> > > >
> > > > Binbin.Zhou at noaa.gov
> > > >
> > > > 301-683-3683
> > > >
> > > >
> > >
> > > --
> > > George McCabe - Software Engineer III
> > > National Center for Atmospheric Research
> > > Research Applications Laboratory
> > > 303-497-2768
> > > ---
> > > My working day may not be your working day. Please do not feel
obliged
> to
> > > reply to this email outside of your normal working hours.
> > >
> > >
> >
> > --
> >
> > Binbin Zhou
> >
> > IMSG at NOAA/NWS/NCEP/EMC
> >
> > 5830 University Research Ct.
> >
> > College Park, MD 20740
> >
> > Binbin.Zhou at noaa.gov
> >
> > 301-683-3683
> >
> >
>
> --
> George McCabe - Software Engineer III
> National Center for Atmospheric Research
> Research Applications Laboratory
> 303-497-2768
> ---
> My working day may not be your working day. Please do not feel
obliged to
> reply to this email outside of your normal working hours.
>
>
--
Binbin Zhou
IMSG at NOAA/NWS/NCEP/EMC
5830 University Research Ct.
College Park, MD 20740
Binbin.Zhou at noaa.gov
301-683-3683
------------------------------------------------
Subject: CDP threshold setting in EnsembleStat conf
From: George McCabe
Time: Wed Jan 06 08:59:19 2021
Hi Binbin,
I am still waiting on WCOSS access, but I do have access to HERA.
Thanks,
George
On Wed, Jan 6, 2021 at 8:57 AM Binbin.Zhou at noaa.gov via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116 >
>
> George,
>
> Can you access WCOSS or access HERA?
> Otherwise I will email attached to you
>
> Binbin
>
>
>
> On Wed, Jan 6, 2021 at 10:46 AM George McCabe via RT
<met_help at ucar.edu>
> wrote:
>
> > Hi Binbin,
> >
> > Could you send me a log file for a run with LOG_LEVEL=DEBUG (in
METplus
> > config) so I can see how the environment variable ENS_FIELD is
set? The
> > values of ENS_VAR<n>_* are formatted and set in this environment
variable
> > which is passed into the MET config. You can compare that value
with what
> > you used in your successful run outside of the METplus wrapper to
> determine
> > what is different.
> >
> > Thanks,
> > George
> >
> > On Wed, Jan 6, 2021 at 7:11 AM Binbin.Zhou at noaa.gov via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116 >
> > >
> > > George,
> > >
> > > I got a new error in execution although some output files (nc
file)
> are
> > > created but stat files not.
> > > The error message is
> > >
> > > ERROR :
> > > ERROR : Simple_Node::check(double, double, double) const ->
> > climatological
> > > distribution percentile threshold "<=CDP10" requested with
invalid mean
> > > (-9999) or standard deviation (-9999).
> > > ERROR :
> > >
> > > Such an error was ever investigated by John H before (year ago):
When I
> > > directly ran ensemble_stat for global ensemble (not METplus-
based,
> > > but hard code of all settings in EnsembleStat config file): If
hard
> code
> > > fcst field in EnsembleStat config file like this
> > >
> > > name = "HGT";
> > > level = "P500";
> > > cat_thresh = [ <=CDP10, >CDP10&&<=CDP20,
>CDP20&&<=CDP30,
> > > >CDP30&&<=CDP40, >CDP40&&<=CDP50, >CDP50&&<=CDP60,
>CDP60&&<=CDP70,
> > > >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];
> > >
> > > Run ensemble_stat will have such error: ERROR :
> > > Simple_Node::check(double, double, double) const ->
climatological
> > > distribution percentile threshold "<=CDP10" requested with
invalid mean
> > > (-9999) or standard deviation (-9999).
> > >
> > > John H. suggested me change "cat_thresh = " to "obs_thresh = ",
then
> > the
> > > error was solved.
> > >
> > > In current METplus version, following your suggestion as
> > >
> > > ENS_VAR1_OPTIONS = obs_thresh = [ <=CDP10, >CDP10&&<=CDP20,
> > > >CDP20&&<=CDP30, >CDP30&&<=CDP40, >CDP40&&<=CDP50,
>CDP50&&<=CDP60,
> > > >CDP60&&<=CDP70, >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];
> > >
> > > the same error appears again. So I am not for sure if the
> "obs_thresh"
> > > setting is correctly passed.
> > >
> > > Binbin
> > >
> > >
> > >
> > >
> > > On Tue, Jan 5, 2021 at 5:19 PM George McCabe via RT
<met_help at ucar.edu
> >
> > > wrote:
> > >
> > > > Hi Binbin,
> > > >
> > > > Your solution should work for now. It looks like although the
METplus
> > > > variable does get read properly, the environment variable is
not
> > actually
> > > > set by the EnsembleStat wrapper. I can make a note to add that
for
> > 4.0.0,
> > > > as it is an easy fix.
> > > >
> > > > - George
> > > >
> > > > On Tue, Jan 5, 2021 at 2:53 PM Binbin.Zhou at noaa.gov via RT <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > > > George,
> > > > >
> > > > > I have a temporal solution:
> > > > > set ploy in EnembleStat config as
> > > > > poly = [ "${MASKPATH}/lat_NHM.nc",
> > > > > "${MASKPATH}/lat_NHM.nc",
> > > > > "${MASKPATH}/lat_TRP.nc" ];
> > > > >
> > > > > then set MASKPATH in user_env_vars part in the conf file
> > > > > This MASKPAH then can be passed to EnsembleStat's poly [ ]
entry
> > > > >
> > > > > Binbin
> > > > >
> > > > > On Tue, Jan 5, 2021 at 4:25 PM Binbin Zhou - NOAA Affiliate
<
> > > > > binbin.zhou at noaa.gov> wrote:
> > > > >
> > > > > > George,
> > > > > >
> > > > > > Still not working, error says
> > > > > > ERROR : replace_env() -> unable to get value for
environment
> > > variable
> > > > > > "VERIF_MASK"
> > > > > >
> > > > > > Binbin
> > > > > >
> > > > > >
> > > > > >
> > > > > > On Tue, Jan 5, 2021 at 3:50 PM George McCabe via RT <
> > > met_help at ucar.edu
> > > > >
> > > > > > wrote:
> > > > > >
> > > > > >> Hi Binbin,
> > > > > >>
> > > > > >> You should be able to set it in the METplus config the
same way
> it
> > > is
> > > > > done
> > > > > >> for GridStat -- no quotes with commas between each item.
The
> > wrapper
> > > > > >> should
> > > > > >> format it properly.
> > > > > >>
> > > > > >> Here is an example from an existing use case:
> > > > > >>
> > > > > >> GRID_STAT_VERIFICATION_MASK_TEMPLATE =
> > > > > >>
> >
{INPUT_BASE}/model_applications/precipitation/mask/CONUS_HRRRTLE.nc,
> > > > > >>
> >
{INPUT_BASE}/model_applications/precipitation/mask/EAST_HRRRTLE.nc,
> > > > > >>
> {INPUT_BASE}/model_applications/precipitation/mask/WEST_HRRRTLE.nc
> > > > > >>
> > > > > >> You should be able to set them the same way using
> > > > > >> ENSEMBLE_STAT_VERIFICATION_MASK_TEMPLATE. Let me know if
that
> > > doesn't
> > > > > >> work.
> > > > > >>
> > > > > >> - George
> > > > > >>
> > > > > >> On Tue, Jan 5, 2021 at 1:45 PM Binbin.Zhou at noaa.gov via
RT <
> > > > > >> met_help at ucar.edu> wrote:
> > > > > >>
> > > > > >> >
> > > > > >> > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
> >
> > > > > >> >
> > > > > >> > George,
> > > > > >> >
> > > > > >> > I got another issue for verification mask setting.
> > > > > >> >
> > > > > >> > I am using $VERIF_MASK in EnsembleStat config f/ile
> > > > > >> > mask = {
> > > > > >> > grid = [];
> > > > > >> > poly = [${VERIF_MASK}];
> > > > > >> > sid = [];
> > > > > >> > }
> > > > > >> >
> > > > > >> > And using GRID_STAT_VERIFICATION_MASK_TEMPLATE to
define
> > several
> > > > > >> polygon
> > > > > >> > nc mask files
> > > > > >> > But it seems not working. But it works for Gridstat
config in
> > > suich
> > > > > >> > setting.
> > > > > >> > I can not find ENSEMBLE_STAT_
VERIFICATION_MASK_TEMPLATE in
> the
> > > > > METplus
> > > > > >> doc
> > > > > >> >
> > > > > >> > So I define VERIF_MASK in [user_env_vars] part.
> > > > > >> > It values can not be passed to ploy = [${VERIF_MASK}]
in the
> > > > > >> EnsembleStat
> > > > > >> > conf if more than one nc files included.
> > > > > >> > For example
> > > > > >> > VERIF_MASK=" '/part/p1.cn', '/path/p2.nc' "
> > > > > >> > the error says poly = [/path/p1,]
> > > > > >> > It seems double quote or single quote can not be passed
to
> > > > VERIF_MASK
> > > > > in
> > > > > >> > the EnsembleStat config.
> > > > > >> > I tried use back slash \ to before quote, but still not
> working
> > > > > >> >
> > > > > >> > Binbin
> > > > > >> >
> > > > > >> >
> > > > > >> > On Tue, Jan 5, 2021 at 10:33 AM Binbin Zhou - NOAA
Affiliate <
> > > > > >> > binbin.zhou at noaa.gov> wrote:
> > > > > >> >
> > > > > >> > > George,
> > > > > >> > >
> > > > > >> > > Thanks for your quick response! I'll test this
settings
> and
> > > let
> > > > > >> > > you know the results.
> > > > > >> > >
> > > > > >> > > Binbin
> > > > > >> > >
> > > > > >> > > On Tue, Jan 5, 2021 at 10:17 AM George McCabe via RT
<
> > > > > >> met_help at ucar.edu>
> > > > > >> > > wrote:
> > > > > >> > >
> > > > > >> > >> Hi Binbin,
> > > > > >> > >>
> > > > > >> > >> Happy New Year to you too!
> > > > > >> > >>
> > > > > >> > >> I will comment on each configuration variable and
how to
> set
> > it
> > > > in
> > > > > a
> > > > > >> > >> METplus config inline:
> > > > > >> > >>
> > > > > >> > >> ens = {
> > > > > >> > >> ens_thresh = 1.0;
> > > > > >> > >>
> > > > > >> > >>
> > > > > >> > >> *This is controlled by the ENSEMBLE_STAT_ENS_THRESH
> variable.
> > > The
> > > > > >> > default
> > > > > >> > >> value is 1.0, so you don't need to include it in
your
> config
> > > > file,
> > > > > >> but
> > > > > >> > you
> > > > > >> > >> can if you may adjust this value at some point.*
> > > > > >> > >>
> > > > > >> > >> vld_thresh = 1.0;
> > > > > >> > >>
> > > > > >> > >> *This value is set to 1.0 by default so we don't
need to
> > worry
> > > > > about
> > > > > >> it
> > > > > >> > >> right now.*
> > > > > >> > >>
> > > > > >> > >> field = [
> > > > > >> > >>
> > > > > >> > >> {
> > > > > >> > >> name = "HGT";
> > > > > >> > >> level = "P500";
> > > > > >> > >> obs_thresh = [ <=CDP10, >CDP10&&<=CDP20,
> > > > >CDP20&&<=CDP30,
> > > > > >> > >> >CDP30&&<=CDP40, >CDP40&&<=CDP50, >CDP50&&<=CDP60,
> > > > >CDP60&&<=CDP70,
> > > > > >> > >> >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];
> > > > > >> > >> }
> > > > > >> > >> ]
> > > > > >> > >> }
> > > > > >> > >> fcst = ens;
> > > > > >> > >> obs = fcst;
> > > > > >> > >>
> > > > > >> > >> *1) The field info for ens is set in the
> > > > > >> > >> ENS_VAR<n>_[NAME/LEVEL/THRESH/OPTIONS] variables.
The fcst
> > and
> > > > obs
> > > > > >> field
> > > > > >> > >> info are set in the corresponding FCST_VAR<n>_* and
> > > OBS_VAR<n>_*
> > > > > >> > variables
> > > > > >> > >> respectively, or you can use BOTH_VAR<n>_* if the
FCST and
> > OBS
> > > > > values
> > > > > >> > are
> > > > > >> > >> the same.*
> > > > > >> > >>
> > > > > >> > >> *If ENS_VAR<n>_* variables are not explicitly set,
then it
> > will
> > > > use
> > > > > >> the
> > > > > >> > >> values from FCST_VAR<n>_*.*
> > > > > >> > >> *Since the fcst, obs, and ens are all the same you
could
> just
> > > use
> > > > > >> > >> BOTH_VAR<n>_* variables to control all 3, although
keep in
> > mind
> > > > > that
> > > > > >> if
> > > > > >> > >> you
> > > > > >> > >> need to change one of them for any reason, it will
be more
> > > > > difficult
> > > > > >> to
> > > > > >> > do
> > > > > >> > >> this. If you know that they will always be the same
values,
> > > then
> > > > I
> > > > > >> > >> recommend using BOTH_, but if you know they may
change or
> are
> > > > > >> unsure, I
> > > > > >> > >> would recommend setting them by referencing the
other
> > > variables,
> > > > > >> i.e.*
> > > > > >> > >>
> > > > > >> > >> *FCST_VAR1_NAME = HGT*
> > > > > >> > >> *FCST_VAR1_LEVELS = P500 *
> > > > > >> > >> *OBS_VAR1_NAME = {FCST_VAR1_NAME}*
> > > > > >> > >> *OBS_VAR1_LEVELS = {FCST_VAR1_LEVELS}*
> > > > > >> > >>
> > > > > >> > >> *2) The [FCST/OBS/ENS]_VAR<n>_THRESH variables set
the
> > > cat_thresh
> > > > > >> values
> > > > > >> > >> in
> > > > > >> > >> the field info. A variable specific to obs_thresh is
not
> > > > currently
> > > > > >> > >> supported, however you can set these values by using
the
> > > > > >> > ENS_VAR1_OPTIONS
> > > > > >> > >> variable, i.e.*
> > > > > >> > >>
> > > > > >> > >> *ENS_VAR1_OPTIONS = obs_thresh = [ <=CDP10,
> >CDP10&&<=CDP20,
> > > > > >> > >> >CDP20&&<=CDP30, >CDP30&&<=CDP40, >CDP40&&<=CDP50,
> > > > >CDP50&&<=CDP60,
> > > > > >> > >> >CDP60&&<=CDP70, >CDP70&&<=CDP80, >CDP80&&<=CDP90,
>CDP90
> ];*
> > > > > >> > >>
> > > > > >> > >>
> > > > > >> > >> *Remember to include the semicolon at the end! *
> > > > > >> > >>
> > > > > >> > >> ens_ssvar_bin_size = 1000000;
> > > > > >> > >> *1) This variable is different from the default and
not
> > > currently
> > > > > >> > >> supported
> > > > > >> > >> with a METplus config variable. I will add this to
the list
> > of
> > > > > >> variables
> > > > > >> > >> in
> > > > > >> > >> MET config files that we want to support. However,
in the
> > > > meantime
> > > > > >> you
> > > > > >> > can
> > > > > >> > >> copy the default wrapped MET config file and modify
it to
> fit
> > > > your
> > > > > >> > needs.
> > > > > >> > >> To do this, you will need to:*
> > > > > >> > >>
> > > > > >> > >> * a) Copy
> METplus/parm/met_config/EnsembleStatConfig_wrapped
> > > to
> > > > > the
> > > > > >> > >> directory that contains your METplus config file for
this
> use
> > > > case.
> > > > > >> > Rename
> > > > > >> > >> it by replacing "wrapped" with a short description
that
> > > pertains
> > > > to
> > > > > >> your
> > > > > >> > >> use case.*
> > > > > >> > >>
> > > > > >> > >> * b) In your METplus config file, change the value
of
> > > > > >> > >> ENSEMBLE_STAT_CONFIG_FILE to point to the path of
this new
> > > config
> > > > > >> file.*
> > > > > >> > >>
> > > > > >> > >> * c) If you know the value you want to use for this
> variable
> > > > will
> > > > > >> > always
> > > > > >> > >> be 1000000, then simply set the variable to that
value. If
> > you
> > > > > think
> > > > > >> you
> > > > > >> > >> may want to change the value, then you can utilize
the
> > > > > >> [user_env_vars]
> > > > > >> > >> functionality. See:
> > > > > >> > >>
> > > > > >> > >>
> > > > > >> >
> > > > > >>
> > > > >
> > > >
> > >
> >
>
https://dtcenter.github.io/METplus/latest/Users_Guide/systemconfiguration.html#user-
defined-config
> > > > > >> > >> <
> > > > > >> > >>
> > > > > >> >
> > > > > >>
> > > > >
> > > >
> > >
> >
>
https://dtcenter.github.io/METplus/latest/Users_Guide/systemconfiguration.html#user-
defined-config
> > > > > >> > >> >*
> > > > > >> > >> *In this case, you would add the following to your
METplus
> > > > config:*
> > > > > >> > >>
> > > > > >> > >> *[user_env_vars]*
> > > > > >> > >> *ENS_SSVAR_BIN_SIZE = 1000000*
> > > > > >> > >>
> > > > > >> > >> *Then change the line in your EnsembleStat config
file that
> > you
> > > > > >> copied
> > > > > >> > >> to:*
> > > > > >> > >>
> > > > > >> > >> * ens_ssvar_bin_size = ${ENS_SSVAR_BIN_SIZE}; *
> > > > > >> > >>
> > > > > >> > >> ens_phist_bin_size = 0.05;
> > > > > >> > >> *This variable uses the default value, so you don't
need to
> > do
> > > > > >> anything
> > > > > >> > >> here. If you need to make it configurable or change
the
> > value,
> > > > then
> > > > > >> > follow
> > > > > >> > >> the instructions for setting ens_ssvar_bin_size.*
> > > > > >> > >>
> > > > > >> > >> climo_mean = fcst;
> > > > > >> > >> climo_mean = {
> > > > > >> > >> file_name = "${CLIM_MEAN}";
> > > > > >> > >> time_interp_method = DW_MEAN;
> > > > > >> > >> match_day = TRUE;
> > > > > >> > >> time_step = 21600;
> > > > > >> > >> }
> > > > > >> > >>
> > > > > >> > >>
> > > > > >> > >> *Instead of using CLIM_MEAN, you can set
> > > > > >> > >> ENSEMBLE_STAT_CLIMO_MEAN_INPUT_[DIR/TEMPLATE] in the
> METplus
> > > > > config.
> > > > > >> You
> > > > > >> > >> can use filename template syntax in the _TEMPLATE
value,
> i.e.
> > > > > >> > >> {valid?fmt=%m%d}. The other variables in the
climo_mean
> > > > dictionary
> > > > > >> are
> > > > > >> > >> actually old variables that have been replaced with
> > > day_interval
> > > > > and
> > > > > >> > >> hour_interval, but the values you use are the old
defaults,
> > so
> > > > you
> > > > > >> > >> shouldn't need to set them.*
> > > > > >> > >>
> > > > > >> > >> climo_stdev = climo_mean;
> > > > > >> > >> climo_stdev = {
> > > > > >> > >> file_name = "${CLIM_STDV}";
> > > > > >> > >> }
> > > > > >> > >>
> > > > > >> > >> *Similarly to CLIM_MEAN, you can use
> > > > > >> > >> ENSEMBLE_STAT_CLIMO_STDEV_INPUT_[DIR/TEMPLATE] to
set this
> > file
> > > > > >> name.*
> > > > > >> > >>
> > > > > >> > >> climo_cdf = {
> > > > > >> > >> cdf_bins = 11;
> > > > > >> > >> center_bins = TRUE;
> > > > > >> > >> write_bins = TRUE;
> > > > > >> > >> }
> > > > > >> > >> *The value for write_bins is the default, but the
values
> for
> > > > > cdf_bins
> > > > > >> > and
> > > > > >> > >> center_bins do not. To set these, follow the above
> > instructions
> > > > for
> > > > > >> > >> ens_ssvar_bin_size to override them and/or make them
> > > configurable
> > > > > >> > through
> > > > > >> > >> METplus. I will also add these variables to the list
of MET
> > > > configs
> > > > > >> that
> > > > > >> > >> users want to be able to easily configure through
METplus
> > > > configs.*
> > > > > >> > >>
> > > > > >> > >> Please let me know if you run into any issues
setting any
> of
> > > that
> > > > > up.
> > > > > >> > >> Also,
> > > > > >> > >> if there are any other MET config variables that you
want
> to
> > > see
> > > > > >> > supported
> > > > > >> > >> in METplus, let me know and I will make sure they
get
> > included
> > > > when
> > > > > >> we
> > > > > >> > >> have
> > > > > >> > >> a chance to refactor those wrappers. It is possible
to add
> > > > support
> > > > > >> for
> > > > > >> > MET
> > > > > >> > >> configs using the above instructions, but it is
always
> easier
> > > and
> > > > > >> less
> > > > > >> > >> error-prone to have them configurable directly
through a
> > > variable
> > > > > in
> > > > > >> the
> > > > > >> > >> METplus config.
> > > > > >> > >>
> > > > > >> > >> Thanks,
> > > > > >> > >> George
> > > > > >> > >>
> > > > > >> > >> On Tue, Jan 5, 2021 at 7:14 AM Binbin.Zhou at noaa.gov
via
> RT <
> > > > > >> > >> met_help at ucar.edu> wrote:
> > > > > >> > >>
> > > > > >> > >> >
> > > > > >> > >> > Tue Jan 05 07:14:54 2021: Request 98116 was acted
upon.
> > > > > >> > >> > Transaction: Ticket created by
Binbin.Zhou at noaa.gov
> > > > > >> > >> > Queue: met_help
> > > > > >> > >> > Subject: CDP threshold setting in
EnsembleStat conf
> > > > > >> > >> > Owner: Nobody
> > > > > >> > >> > Requestors: Binbin.Zhou at noaa.gov
> > > > > >> > >> > Status: new
> > > > > >> > >> > Ticket <URL:
> > > > > >> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
> > > > > >> > >
> > > > > >> > >> >
> > > > > >> > >> >
> > > > > >> > >> > George,
> > > > > >> > >> >
> > > > > >> > >> > Happy New Year!
> > > > > >> > >> >
> > > > > >> > >> > I am working on transition of our MET-based
global
> > > ensemble
> > > > > >> > >> verification
> > > > > >> > >> > to METplus based package. In this package
climatology
> bins
> > > (10
> > > > > >> bins)
> > > > > >> > are
> > > > > >> > >> > used.
> > > > > >> > >> > In current ensemble stat config file, the relevant
> entries
> > > iare
> > > > > >> > defined
> > > > > >> > >> > like following
> > > > > >> > >> >
> > > > > >> > >> > ens = {
> > > > > >> > >> > ens_thresh = 1.0;
> > > > > >> > >> > vld_thresh = 1.0;
> > > > > >> > >> >
> > > > > >> > >> > field = [
> > > > > >> > >> >
> > > > > >> > >> > {
> > > > > >> > >> > name = "HGT";
> > > > > >> > >> > level = "P500";
> > > > > >> > >> > obs_thresh = [ <=CDP10, >CDP10&&<=CDP20,
> > > > > >CDP20&&<=CDP30,
> > > > > >> > >> > >CDP30&&<=CDP40, >CDP40&&<=CDP50, >CDP50&&<=CDP60,
> > > > > >CDP60&&<=CDP70,
> > > > > >> > >> > >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];
> > > > > >> > >> > }
> > > > > >> > >> > ]
> > > > > >> > >> > }
> > > > > >> > >> > fcst = ens;
> > > > > >> > >> > obs = fcst;
> > > > > >> > >> > ens_ssvar_bin_size = 1000000;
> > > > > >> > >> > ens_phist_bin_size = 0.05;
> > > > > >> > >> > climo_mean = fcst;
> > > > > >> > >> > climo_mean = {
> > > > > >> > >> > file_name = "${CLIM_MEAN}";
> > > > > >> > >> > time_interp_method = DW_MEAN;
> > > > > >> > >> > match_day = TRUE;
> > > > > >> > >> > time_step = 21600;
> > > > > >> > >> > }
> > > > > >> > >> >
> > > > > >> > >> > climo_stdev = climo_mean;
> > > > > >> > >> > climo_stdev = {
> > > > > >> > >> > file_name = "${CLIM_STDV}";
> > > > > >> > >> > }
> > > > > >> > >> >
> > > > > >> > >> > climo_cdf = {
> > > > > >> > >> > cdf_bins = 11;
> > > > > >> > >> > center_bins = TRUE;
> > > > > >> > >> > write_bins = TRUE;
> > > > > >> > >> > }
> > > > > >> > >> >
> > > > > >> > >> > I can not find the correspondent settings in its
conf
> file
> > > from
> > > > > >> > METplus
> > > > > >> > >> > online doc.
> > > > > >> > >> > Can you help me look at this?
> > > > > >> > >> >
> > > > > >> > >> > Thanks!
> > > > > >> > >> >
> > > > > >> > >> > Binbin
> > > > > >> > >> >
> > > > > >> > >> > --
> > > > > >> > >> >
> > > > > >> > >> > Binbin Zhou
> > > > > >> > >> >
> > > > > >> > >> > IMSG at NOAA/NWS/NCEP/EMC
> > > > > >> > >> >
> > > > > >> > >> > 5830 University Research Ct.
> > > > > >> > >> >
> > > > > >> > >> > College Park, MD 20740
> > > > > >> > >> >
> > > > > >> > >> > Binbin.Zhou at noaa.gov
> > > > > >> > >> >
> > > > > >> > >> > 301-683-3683
> > > > > >> > >> >
> > > > > >> > >> >
> > > > > >> > >>
> > > > > >> > >> --
> > > > > >> > >> George McCabe - Software Engineer III
> > > > > >> > >> National Center for Atmospheric Research
> > > > > >> > >> Research Applications Laboratory
> > > > > >> > >> 303-497-2768
> > > > > >> > >> ---
> > > > > >> > >> My working day may not be your working day. Please
do not
> > feel
> > > > > >> obliged
> > > > > >> > to
> > > > > >> > >> reply to this email outside of your normal working
hours.
> > > > > >> > >>
> > > > > >> > >>
> > > > > >> > >
> > > > > >> > > --
> > > > > >> > >
> > > > > >> > > Binbin Zhou
> > > > > >> > >
> > > > > >> > > IMSG at NOAA/NWS/NCEP/EMC
> > > > > >> > >
> > > > > >> > > 5830 University Research Ct.
> > > > > >> > >
> > > > > >> > > College Park, MD 20740
> > > > > >> > >
> > > > > >> > > Binbin.Zhou at noaa.gov
> > > > > >> > >
> > > > > >> > > 301-683-3683
> > > > > >> > >
> > > > > >> >
> > > > > >> >
> > > > > >> > --
> > > > > >> >
> > > > > >> > Binbin Zhou
> > > > > >> >
> > > > > >> > IMSG at NOAA/NWS/NCEP/EMC
> > > > > >> >
> > > > > >> > 5830 University Research Ct.
> > > > > >> >
> > > > > >> > College Park, MD 20740
> > > > > >> >
> > > > > >> > Binbin.Zhou at noaa.gov
> > > > > >> >
> > > > > >> > 301-683-3683
> > > > > >> >
> > > > > >> >
> > > > > >>
> > > > > >> --
> > > > > >> George McCabe - Software Engineer III
> > > > > >> National Center for Atmospheric Research
> > > > > >> Research Applications Laboratory
> > > > > >> 303-497-2768
> > > > > >> ---
> > > > > >> My working day may not be your working day. Please do not
feel
> > > obliged
> > > > > to
> > > > > >> reply to this email outside of your normal working hours.
> > > > > >>
> > > > > >>
> > > > > >
> > > > > > --
> > > > > >
> > > > > > Binbin Zhou
> > > > > >
> > > > > > IMSG at NOAA/NWS/NCEP/EMC
> > > > > >
> > > > > > 5830 University Research Ct.
> > > > > >
> > > > > > College Park, MD 20740
> > > > > >
> > > > > > Binbin.Zhou at noaa.gov
> > > > > >
> > > > > > 301-683-3683
> > > > > >
> > > > >
> > > > >
> > > > > --
> > > > >
> > > > > Binbin Zhou
> > > > >
> > > > > IMSG at NOAA/NWS/NCEP/EMC
> > > > >
> > > > > 5830 University Research Ct.
> > > > >
> > > > > College Park, MD 20740
> > > > >
> > > > > Binbin.Zhou at noaa.gov
> > > > >
> > > > > 301-683-3683
> > > > >
> > > > >
> > > >
> > > > --
> > > > George McCabe - Software Engineer III
> > > > National Center for Atmospheric Research
> > > > Research Applications Laboratory
> > > > 303-497-2768
> > > > ---
> > > > My working day may not be your working day. Please do not feel
> obliged
> > to
> > > > reply to this email outside of your normal working hours.
> > > >
> > > >
> > >
> > > --
> > >
> > > Binbin Zhou
> > >
> > > IMSG at NOAA/NWS/NCEP/EMC
> > >
> > > 5830 University Research Ct.
> > >
> > > College Park, MD 20740
> > >
> > > Binbin.Zhou at noaa.gov
> > >
> > > 301-683-3683
> > >
> > >
> >
> > --
> > George McCabe - Software Engineer III
> > National Center for Atmospheric Research
> > Research Applications Laboratory
> > 303-497-2768
> > ---
> > My working day may not be your working day. Please do not feel
obliged to
> > reply to this email outside of your normal working hours.
> >
> >
>
> --
>
> Binbin Zhou
>
> IMSG at NOAA/NWS/NCEP/EMC
>
> 5830 University Research Ct.
>
> College Park, MD 20740
>
> Binbin.Zhou at noaa.gov
>
> 301-683-3683
>
>
--
George McCabe - Software Engineer III
National Center for Atmospheric Research
Research Applications Laboratory
303-497-2768
---
My working day may not be your working day. Please do not feel obliged
to
reply to this email outside of your normal working hours.
------------------------------------------------
Subject: CDP threshold setting in EnsembleStat conf
From: Julie Prestopnik
Time: Wed Jan 06 09:00:27 2021
Hi Binbin.
This is Julie. I haven't been following this entire thread, but I am
on
WCOSS right now. If you send a path to a file, I can pull it and put
it on
our ftp server for George.
Julie
On Wed, Jan 6, 2021 at 8:57 AM Binbin.Zhou at noaa.gov via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116 >
>
> George,
>
> Can you access WCOSS or access HERA?
> Otherwise I will email attached to you
>
> Binbin
>
>
>
> On Wed, Jan 6, 2021 at 10:46 AM George McCabe via RT
<met_help at ucar.edu>
> wrote:
>
> > Hi Binbin,
> >
> > Could you send me a log file for a run with LOG_LEVEL=DEBUG (in
METplus
> > config) so I can see how the environment variable ENS_FIELD is
set? The
> > values of ENS_VAR<n>_* are formatted and set in this environment
variable
> > which is passed into the MET config. You can compare that value
with what
> > you used in your successful run outside of the METplus wrapper to
> determine
> > what is different.
> >
> > Thanks,
> > George
> >
> > On Wed, Jan 6, 2021 at 7:11 AM Binbin.Zhou at noaa.gov via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116 >
> > >
> > > George,
> > >
> > > I got a new error in execution although some output files (nc
file)
> are
> > > created but stat files not.
> > > The error message is
> > >
> > > ERROR :
> > > ERROR : Simple_Node::check(double, double, double) const ->
> > climatological
> > > distribution percentile threshold "<=CDP10" requested with
invalid mean
> > > (-9999) or standard deviation (-9999).
> > > ERROR :
> > >
> > > Such an error was ever investigated by John H before (year ago):
When I
> > > directly ran ensemble_stat for global ensemble (not METplus-
based,
> > > but hard code of all settings in EnsembleStat config file): If
hard
> code
> > > fcst field in EnsembleStat config file like this
> > >
> > > name = "HGT";
> > > level = "P500";
> > > cat_thresh = [ <=CDP10, >CDP10&&<=CDP20,
>CDP20&&<=CDP30,
> > > >CDP30&&<=CDP40, >CDP40&&<=CDP50, >CDP50&&<=CDP60,
>CDP60&&<=CDP70,
> > > >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];
> > >
> > > Run ensemble_stat will have such error: ERROR :
> > > Simple_Node::check(double, double, double) const ->
climatological
> > > distribution percentile threshold "<=CDP10" requested with
invalid mean
> > > (-9999) or standard deviation (-9999).
> > >
> > > John H. suggested me change "cat_thresh = " to "obs_thresh = ",
then
> > the
> > > error was solved.
> > >
> > > In current METplus version, following your suggestion as
> > >
> > > ENS_VAR1_OPTIONS = obs_thresh = [ <=CDP10, >CDP10&&<=CDP20,
> > > >CDP20&&<=CDP30, >CDP30&&<=CDP40, >CDP40&&<=CDP50,
>CDP50&&<=CDP60,
> > > >CDP60&&<=CDP70, >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];
> > >
> > > the same error appears again. So I am not for sure if the
> "obs_thresh"
> > > setting is correctly passed.
> > >
> > > Binbin
> > >
> > >
> > >
> > >
> > > On Tue, Jan 5, 2021 at 5:19 PM George McCabe via RT
<met_help at ucar.edu
> >
> > > wrote:
> > >
> > > > Hi Binbin,
> > > >
> > > > Your solution should work for now. It looks like although the
METplus
> > > > variable does get read properly, the environment variable is
not
> > actually
> > > > set by the EnsembleStat wrapper. I can make a note to add that
for
> > 4.0.0,
> > > > as it is an easy fix.
> > > >
> > > > - George
> > > >
> > > > On Tue, Jan 5, 2021 at 2:53 PM Binbin.Zhou at noaa.gov via RT <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > > > George,
> > > > >
> > > > > I have a temporal solution:
> > > > > set ploy in EnembleStat config as
> > > > > poly = [ "${MASKPATH}/lat_NHM.nc",
> > > > > "${MASKPATH}/lat_NHM.nc",
> > > > > "${MASKPATH}/lat_TRP.nc" ];
> > > > >
> > > > > then set MASKPATH in user_env_vars part in the conf file
> > > > > This MASKPAH then can be passed to EnsembleStat's poly [ ]
entry
> > > > >
> > > > > Binbin
> > > > >
> > > > > On Tue, Jan 5, 2021 at 4:25 PM Binbin Zhou - NOAA Affiliate
<
> > > > > binbin.zhou at noaa.gov> wrote:
> > > > >
> > > > > > George,
> > > > > >
> > > > > > Still not working, error says
> > > > > > ERROR : replace_env() -> unable to get value for
environment
> > > variable
> > > > > > "VERIF_MASK"
> > > > > >
> > > > > > Binbin
> > > > > >
> > > > > >
> > > > > >
> > > > > > On Tue, Jan 5, 2021 at 3:50 PM George McCabe via RT <
> > > met_help at ucar.edu
> > > > >
> > > > > > wrote:
> > > > > >
> > > > > >> Hi Binbin,
> > > > > >>
> > > > > >> You should be able to set it in the METplus config the
same way
> it
> > > is
> > > > > done
> > > > > >> for GridStat -- no quotes with commas between each item.
The
> > wrapper
> > > > > >> should
> > > > > >> format it properly.
> > > > > >>
> > > > > >> Here is an example from an existing use case:
> > > > > >>
> > > > > >> GRID_STAT_VERIFICATION_MASK_TEMPLATE =
> > > > > >>
> >
{INPUT_BASE}/model_applications/precipitation/mask/CONUS_HRRRTLE.nc,
> > > > > >>
> >
{INPUT_BASE}/model_applications/precipitation/mask/EAST_HRRRTLE.nc,
> > > > > >>
> {INPUT_BASE}/model_applications/precipitation/mask/WEST_HRRRTLE.nc
> > > > > >>
> > > > > >> You should be able to set them the same way using
> > > > > >> ENSEMBLE_STAT_VERIFICATION_MASK_TEMPLATE. Let me know if
that
> > > doesn't
> > > > > >> work.
> > > > > >>
> > > > > >> - George
> > > > > >>
> > > > > >> On Tue, Jan 5, 2021 at 1:45 PM Binbin.Zhou at noaa.gov via
RT <
> > > > > >> met_help at ucar.edu> wrote:
> > > > > >>
> > > > > >> >
> > > > > >> > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
> >
> > > > > >> >
> > > > > >> > George,
> > > > > >> >
> > > > > >> > I got another issue for verification mask setting.
> > > > > >> >
> > > > > >> > I am using $VERIF_MASK in EnsembleStat config f/ile
> > > > > >> > mask = {
> > > > > >> > grid = [];
> > > > > >> > poly = [${VERIF_MASK}];
> > > > > >> > sid = [];
> > > > > >> > }
> > > > > >> >
> > > > > >> > And using GRID_STAT_VERIFICATION_MASK_TEMPLATE to
define
> > several
> > > > > >> polygon
> > > > > >> > nc mask files
> > > > > >> > But it seems not working. But it works for Gridstat
config in
> > > suich
> > > > > >> > setting.
> > > > > >> > I can not find ENSEMBLE_STAT_
VERIFICATION_MASK_TEMPLATE in
> the
> > > > > METplus
> > > > > >> doc
> > > > > >> >
> > > > > >> > So I define VERIF_MASK in [user_env_vars] part.
> > > > > >> > It values can not be passed to ploy = [${VERIF_MASK}]
in the
> > > > > >> EnsembleStat
> > > > > >> > conf if more than one nc files included.
> > > > > >> > For example
> > > > > >> > VERIF_MASK=" '/part/p1.cn', '/path/p2.nc' "
> > > > > >> > the error says poly = [/path/p1,]
> > > > > >> > It seems double quote or single quote can not be passed
to
> > > > VERIF_MASK
> > > > > in
> > > > > >> > the EnsembleStat config.
> > > > > >> > I tried use back slash \ to before quote, but still not
> working
> > > > > >> >
> > > > > >> > Binbin
> > > > > >> >
> > > > > >> >
> > > > > >> > On Tue, Jan 5, 2021 at 10:33 AM Binbin Zhou - NOAA
Affiliate <
> > > > > >> > binbin.zhou at noaa.gov> wrote:
> > > > > >> >
> > > > > >> > > George,
> > > > > >> > >
> > > > > >> > > Thanks for your quick response! I'll test this
settings
> and
> > > let
> > > > > >> > > you know the results.
> > > > > >> > >
> > > > > >> > > Binbin
> > > > > >> > >
> > > > > >> > > On Tue, Jan 5, 2021 at 10:17 AM George McCabe via RT
<
> > > > > >> met_help at ucar.edu>
> > > > > >> > > wrote:
> > > > > >> > >
> > > > > >> > >> Hi Binbin,
> > > > > >> > >>
> > > > > >> > >> Happy New Year to you too!
> > > > > >> > >>
> > > > > >> > >> I will comment on each configuration variable and
how to
> set
> > it
> > > > in
> > > > > a
> > > > > >> > >> METplus config inline:
> > > > > >> > >>
> > > > > >> > >> ens = {
> > > > > >> > >> ens_thresh = 1.0;
> > > > > >> > >>
> > > > > >> > >>
> > > > > >> > >> *This is controlled by the ENSEMBLE_STAT_ENS_THRESH
> variable.
> > > The
> > > > > >> > default
> > > > > >> > >> value is 1.0, so you don't need to include it in
your
> config
> > > > file,
> > > > > >> but
> > > > > >> > you
> > > > > >> > >> can if you may adjust this value at some point.*
> > > > > >> > >>
> > > > > >> > >> vld_thresh = 1.0;
> > > > > >> > >>
> > > > > >> > >> *This value is set to 1.0 by default so we don't
need to
> > worry
> > > > > about
> > > > > >> it
> > > > > >> > >> right now.*
> > > > > >> > >>
> > > > > >> > >> field = [
> > > > > >> > >>
> > > > > >> > >> {
> > > > > >> > >> name = "HGT";
> > > > > >> > >> level = "P500";
> > > > > >> > >> obs_thresh = [ <=CDP10, >CDP10&&<=CDP20,
> > > > >CDP20&&<=CDP30,
> > > > > >> > >> >CDP30&&<=CDP40, >CDP40&&<=CDP50, >CDP50&&<=CDP60,
> > > > >CDP60&&<=CDP70,
> > > > > >> > >> >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];
> > > > > >> > >> }
> > > > > >> > >> ]
> > > > > >> > >> }
> > > > > >> > >> fcst = ens;
> > > > > >> > >> obs = fcst;
> > > > > >> > >>
> > > > > >> > >> *1) The field info for ens is set in the
> > > > > >> > >> ENS_VAR<n>_[NAME/LEVEL/THRESH/OPTIONS] variables.
The fcst
> > and
> > > > obs
> > > > > >> field
> > > > > >> > >> info are set in the corresponding FCST_VAR<n>_* and
> > > OBS_VAR<n>_*
> > > > > >> > variables
> > > > > >> > >> respectively, or you can use BOTH_VAR<n>_* if the
FCST and
> > OBS
> > > > > values
> > > > > >> > are
> > > > > >> > >> the same.*
> > > > > >> > >>
> > > > > >> > >> *If ENS_VAR<n>_* variables are not explicitly set,
then it
> > will
> > > > use
> > > > > >> the
> > > > > >> > >> values from FCST_VAR<n>_*.*
> > > > > >> > >> *Since the fcst, obs, and ens are all the same you
could
> just
> > > use
> > > > > >> > >> BOTH_VAR<n>_* variables to control all 3, although
keep in
> > mind
> > > > > that
> > > > > >> if
> > > > > >> > >> you
> > > > > >> > >> need to change one of them for any reason, it will
be more
> > > > > difficult
> > > > > >> to
> > > > > >> > do
> > > > > >> > >> this. If you know that they will always be the same
values,
> > > then
> > > > I
> > > > > >> > >> recommend using BOTH_, but if you know they may
change or
> are
> > > > > >> unsure, I
> > > > > >> > >> would recommend setting them by referencing the
other
> > > variables,
> > > > > >> i.e.*
> > > > > >> > >>
> > > > > >> > >> *FCST_VAR1_NAME = HGT*
> > > > > >> > >> *FCST_VAR1_LEVELS = P500 *
> > > > > >> > >> *OBS_VAR1_NAME = {FCST_VAR1_NAME}*
> > > > > >> > >> *OBS_VAR1_LEVELS = {FCST_VAR1_LEVELS}*
> > > > > >> > >>
> > > > > >> > >> *2) The [FCST/OBS/ENS]_VAR<n>_THRESH variables set
the
> > > cat_thresh
> > > > > >> values
> > > > > >> > >> in
> > > > > >> > >> the field info. A variable specific to obs_thresh is
not
> > > > currently
> > > > > >> > >> supported, however you can set these values by using
the
> > > > > >> > ENS_VAR1_OPTIONS
> > > > > >> > >> variable, i.e.*
> > > > > >> > >>
> > > > > >> > >> *ENS_VAR1_OPTIONS = obs_thresh = [ <=CDP10,
> >CDP10&&<=CDP20,
> > > > > >> > >> >CDP20&&<=CDP30, >CDP30&&<=CDP40, >CDP40&&<=CDP50,
> > > > >CDP50&&<=CDP60,
> > > > > >> > >> >CDP60&&<=CDP70, >CDP70&&<=CDP80, >CDP80&&<=CDP90,
>CDP90
> ];*
> > > > > >> > >>
> > > > > >> > >>
> > > > > >> > >> *Remember to include the semicolon at the end! *
> > > > > >> > >>
> > > > > >> > >> ens_ssvar_bin_size = 1000000;
> > > > > >> > >> *1) This variable is different from the default and
not
> > > currently
> > > > > >> > >> supported
> > > > > >> > >> with a METplus config variable. I will add this to
the list
> > of
> > > > > >> variables
> > > > > >> > >> in
> > > > > >> > >> MET config files that we want to support. However,
in the
> > > > meantime
> > > > > >> you
> > > > > >> > can
> > > > > >> > >> copy the default wrapped MET config file and modify
it to
> fit
> > > > your
> > > > > >> > needs.
> > > > > >> > >> To do this, you will need to:*
> > > > > >> > >>
> > > > > >> > >> * a) Copy
> METplus/parm/met_config/EnsembleStatConfig_wrapped
> > > to
> > > > > the
> > > > > >> > >> directory that contains your METplus config file for
this
> use
> > > > case.
> > > > > >> > Rename
> > > > > >> > >> it by replacing "wrapped" with a short description
that
> > > pertains
> > > > to
> > > > > >> your
> > > > > >> > >> use case.*
> > > > > >> > >>
> > > > > >> > >> * b) In your METplus config file, change the value
of
> > > > > >> > >> ENSEMBLE_STAT_CONFIG_FILE to point to the path of
this new
> > > config
> > > > > >> file.*
> > > > > >> > >>
> > > > > >> > >> * c) If you know the value you want to use for this
> variable
> > > > will
> > > > > >> > always
> > > > > >> > >> be 1000000, then simply set the variable to that
value. If
> > you
> > > > > think
> > > > > >> you
> > > > > >> > >> may want to change the value, then you can utilize
the
> > > > > >> [user_env_vars]
> > > > > >> > >> functionality. See:
> > > > > >> > >>
> > > > > >> > >>
> > > > > >> >
> > > > > >>
> > > > >
> > > >
> > >
> >
>
https://dtcenter.github.io/METplus/latest/Users_Guide/systemconfiguration.html#user-
defined-config
> > > > > >> > >> <
> > > > > >> > >>
> > > > > >> >
> > > > > >>
> > > > >
> > > >
> > >
> >
>
https://dtcenter.github.io/METplus/latest/Users_Guide/systemconfiguration.html#user-
defined-config
> > > > > >> > >> >*
> > > > > >> > >> *In this case, you would add the following to your
METplus
> > > > config:*
> > > > > >> > >>
> > > > > >> > >> *[user_env_vars]*
> > > > > >> > >> *ENS_SSVAR_BIN_SIZE = 1000000*
> > > > > >> > >>
> > > > > >> > >> *Then change the line in your EnsembleStat config
file that
> > you
> > > > > >> copied
> > > > > >> > >> to:*
> > > > > >> > >>
> > > > > >> > >> * ens_ssvar_bin_size = ${ENS_SSVAR_BIN_SIZE}; *
> > > > > >> > >>
> > > > > >> > >> ens_phist_bin_size = 0.05;
> > > > > >> > >> *This variable uses the default value, so you don't
need to
> > do
> > > > > >> anything
> > > > > >> > >> here. If you need to make it configurable or change
the
> > value,
> > > > then
> > > > > >> > follow
> > > > > >> > >> the instructions for setting ens_ssvar_bin_size.*
> > > > > >> > >>
> > > > > >> > >> climo_mean = fcst;
> > > > > >> > >> climo_mean = {
> > > > > >> > >> file_name = "${CLIM_MEAN}";
> > > > > >> > >> time_interp_method = DW_MEAN;
> > > > > >> > >> match_day = TRUE;
> > > > > >> > >> time_step = 21600;
> > > > > >> > >> }
> > > > > >> > >>
> > > > > >> > >>
> > > > > >> > >> *Instead of using CLIM_MEAN, you can set
> > > > > >> > >> ENSEMBLE_STAT_CLIMO_MEAN_INPUT_[DIR/TEMPLATE] in the
> METplus
> > > > > config.
> > > > > >> You
> > > > > >> > >> can use filename template syntax in the _TEMPLATE
value,
> i.e.
> > > > > >> > >> {valid?fmt=%m%d}. The other variables in the
climo_mean
> > > > dictionary
> > > > > >> are
> > > > > >> > >> actually old variables that have been replaced with
> > > day_interval
> > > > > and
> > > > > >> > >> hour_interval, but the values you use are the old
defaults,
> > so
> > > > you
> > > > > >> > >> shouldn't need to set them.*
> > > > > >> > >>
> > > > > >> > >> climo_stdev = climo_mean;
> > > > > >> > >> climo_stdev = {
> > > > > >> > >> file_name = "${CLIM_STDV}";
> > > > > >> > >> }
> > > > > >> > >>
> > > > > >> > >> *Similarly to CLIM_MEAN, you can use
> > > > > >> > >> ENSEMBLE_STAT_CLIMO_STDEV_INPUT_[DIR/TEMPLATE] to
set this
> > file
> > > > > >> name.*
> > > > > >> > >>
> > > > > >> > >> climo_cdf = {
> > > > > >> > >> cdf_bins = 11;
> > > > > >> > >> center_bins = TRUE;
> > > > > >> > >> write_bins = TRUE;
> > > > > >> > >> }
> > > > > >> > >> *The value for write_bins is the default, but the
values
> for
> > > > > cdf_bins
> > > > > >> > and
> > > > > >> > >> center_bins do not. To set these, follow the above
> > instructions
> > > > for
> > > > > >> > >> ens_ssvar_bin_size to override them and/or make them
> > > configurable
> > > > > >> > through
> > > > > >> > >> METplus. I will also add these variables to the list
of MET
> > > > configs
> > > > > >> that
> > > > > >> > >> users want to be able to easily configure through
METplus
> > > > configs.*
> > > > > >> > >>
> > > > > >> > >> Please let me know if you run into any issues
setting any
> of
> > > that
> > > > > up.
> > > > > >> > >> Also,
> > > > > >> > >> if there are any other MET config variables that you
want
> to
> > > see
> > > > > >> > supported
> > > > > >> > >> in METplus, let me know and I will make sure they
get
> > included
> > > > when
> > > > > >> we
> > > > > >> > >> have
> > > > > >> > >> a chance to refactor those wrappers. It is possible
to add
> > > > support
> > > > > >> for
> > > > > >> > MET
> > > > > >> > >> configs using the above instructions, but it is
always
> easier
> > > and
> > > > > >> less
> > > > > >> > >> error-prone to have them configurable directly
through a
> > > variable
> > > > > in
> > > > > >> the
> > > > > >> > >> METplus config.
> > > > > >> > >>
> > > > > >> > >> Thanks,
> > > > > >> > >> George
> > > > > >> > >>
> > > > > >> > >> On Tue, Jan 5, 2021 at 7:14 AM Binbin.Zhou at noaa.gov
via
> RT <
> > > > > >> > >> met_help at ucar.edu> wrote:
> > > > > >> > >>
> > > > > >> > >> >
> > > > > >> > >> > Tue Jan 05 07:14:54 2021: Request 98116 was acted
upon.
> > > > > >> > >> > Transaction: Ticket created by
Binbin.Zhou at noaa.gov
> > > > > >> > >> > Queue: met_help
> > > > > >> > >> > Subject: CDP threshold setting in
EnsembleStat conf
> > > > > >> > >> > Owner: Nobody
> > > > > >> > >> > Requestors: Binbin.Zhou at noaa.gov
> > > > > >> > >> > Status: new
> > > > > >> > >> > Ticket <URL:
> > > > > >> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
> > > > > >> > >
> > > > > >> > >> >
> > > > > >> > >> >
> > > > > >> > >> > George,
> > > > > >> > >> >
> > > > > >> > >> > Happy New Year!
> > > > > >> > >> >
> > > > > >> > >> > I am working on transition of our MET-based
global
> > > ensemble
> > > > > >> > >> verification
> > > > > >> > >> > to METplus based package. In this package
climatology
> bins
> > > (10
> > > > > >> bins)
> > > > > >> > are
> > > > > >> > >> > used.
> > > > > >> > >> > In current ensemble stat config file, the relevant
> entries
> > > iare
> > > > > >> > defined
> > > > > >> > >> > like following
> > > > > >> > >> >
> > > > > >> > >> > ens = {
> > > > > >> > >> > ens_thresh = 1.0;
> > > > > >> > >> > vld_thresh = 1.0;
> > > > > >> > >> >
> > > > > >> > >> > field = [
> > > > > >> > >> >
> > > > > >> > >> > {
> > > > > >> > >> > name = "HGT";
> > > > > >> > >> > level = "P500";
> > > > > >> > >> > obs_thresh = [ <=CDP10, >CDP10&&<=CDP20,
> > > > > >CDP20&&<=CDP30,
> > > > > >> > >> > >CDP30&&<=CDP40, >CDP40&&<=CDP50, >CDP50&&<=CDP60,
> > > > > >CDP60&&<=CDP70,
> > > > > >> > >> > >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];
> > > > > >> > >> > }
> > > > > >> > >> > ]
> > > > > >> > >> > }
> > > > > >> > >> > fcst = ens;
> > > > > >> > >> > obs = fcst;
> > > > > >> > >> > ens_ssvar_bin_size = 1000000;
> > > > > >> > >> > ens_phist_bin_size = 0.05;
> > > > > >> > >> > climo_mean = fcst;
> > > > > >> > >> > climo_mean = {
> > > > > >> > >> > file_name = "${CLIM_MEAN}";
> > > > > >> > >> > time_interp_method = DW_MEAN;
> > > > > >> > >> > match_day = TRUE;
> > > > > >> > >> > time_step = 21600;
> > > > > >> > >> > }
> > > > > >> > >> >
> > > > > >> > >> > climo_stdev = climo_mean;
> > > > > >> > >> > climo_stdev = {
> > > > > >> > >> > file_name = "${CLIM_STDV}";
> > > > > >> > >> > }
> > > > > >> > >> >
> > > > > >> > >> > climo_cdf = {
> > > > > >> > >> > cdf_bins = 11;
> > > > > >> > >> > center_bins = TRUE;
> > > > > >> > >> > write_bins = TRUE;
> > > > > >> > >> > }
> > > > > >> > >> >
> > > > > >> > >> > I can not find the correspondent settings in its
conf
> file
> > > from
> > > > > >> > METplus
> > > > > >> > >> > online doc.
> > > > > >> > >> > Can you help me look at this?
> > > > > >> > >> >
> > > > > >> > >> > Thanks!
> > > > > >> > >> >
> > > > > >> > >> > Binbin
> > > > > >> > >> >
> > > > > >> > >> > --
> > > > > >> > >> >
> > > > > >> > >> > Binbin Zhou
> > > > > >> > >> >
> > > > > >> > >> > IMSG at NOAA/NWS/NCEP/EMC
> > > > > >> > >> >
> > > > > >> > >> > 5830 University Research Ct.
> > > > > >> > >> >
> > > > > >> > >> > College Park, MD 20740
> > > > > >> > >> >
> > > > > >> > >> > Binbin.Zhou at noaa.gov
> > > > > >> > >> >
> > > > > >> > >> > 301-683-3683
> > > > > >> > >> >
> > > > > >> > >> >
> > > > > >> > >>
> > > > > >> > >> --
> > > > > >> > >> George McCabe - Software Engineer III
> > > > > >> > >> National Center for Atmospheric Research
> > > > > >> > >> Research Applications Laboratory
> > > > > >> > >> 303-497-2768
> > > > > >> > >> ---
> > > > > >> > >> My working day may not be your working day. Please
do not
> > feel
> > > > > >> obliged
> > > > > >> > to
> > > > > >> > >> reply to this email outside of your normal working
hours.
> > > > > >> > >>
> > > > > >> > >>
> > > > > >> > >
> > > > > >> > > --
> > > > > >> > >
> > > > > >> > > Binbin Zhou
> > > > > >> > >
> > > > > >> > > IMSG at NOAA/NWS/NCEP/EMC
> > > > > >> > >
> > > > > >> > > 5830 University Research Ct.
> > > > > >> > >
> > > > > >> > > College Park, MD 20740
> > > > > >> > >
> > > > > >> > > Binbin.Zhou at noaa.gov
> > > > > >> > >
> > > > > >> > > 301-683-3683
> > > > > >> > >
> > > > > >> >
> > > > > >> >
> > > > > >> > --
> > > > > >> >
> > > > > >> > Binbin Zhou
> > > > > >> >
> > > > > >> > IMSG at NOAA/NWS/NCEP/EMC
> > > > > >> >
> > > > > >> > 5830 University Research Ct.
> > > > > >> >
> > > > > >> > College Park, MD 20740
> > > > > >> >
> > > > > >> > Binbin.Zhou at noaa.gov
> > > > > >> >
> > > > > >> > 301-683-3683
> > > > > >> >
> > > > > >> >
> > > > > >>
> > > > > >> --
> > > > > >> George McCabe - Software Engineer III
> > > > > >> National Center for Atmospheric Research
> > > > > >> Research Applications Laboratory
> > > > > >> 303-497-2768
> > > > > >> ---
> > > > > >> My working day may not be your working day. Please do not
feel
> > > obliged
> > > > > to
> > > > > >> reply to this email outside of your normal working hours.
> > > > > >>
> > > > > >>
> > > > > >
> > > > > > --
> > > > > >
> > > > > > Binbin Zhou
> > > > > >
> > > > > > IMSG at NOAA/NWS/NCEP/EMC
> > > > > >
> > > > > > 5830 University Research Ct.
> > > > > >
> > > > > > College Park, MD 20740
> > > > > >
> > > > > > Binbin.Zhou at noaa.gov
> > > > > >
> > > > > > 301-683-3683
> > > > > >
> > > > >
> > > > >
> > > > > --
> > > > >
> > > > > Binbin Zhou
> > > > >
> > > > > IMSG at NOAA/NWS/NCEP/EMC
> > > > >
> > > > > 5830 University Research Ct.
> > > > >
> > > > > College Park, MD 20740
> > > > >
> > > > > Binbin.Zhou at noaa.gov
> > > > >
> > > > > 301-683-3683
> > > > >
> > > > >
> > > >
> > > > --
> > > > George McCabe - Software Engineer III
> > > > National Center for Atmospheric Research
> > > > Research Applications Laboratory
> > > > 303-497-2768
> > > > ---
> > > > My working day may not be your working day. Please do not feel
> obliged
> > to
> > > > reply to this email outside of your normal working hours.
> > > >
> > > >
> > >
> > > --
> > >
> > > Binbin Zhou
> > >
> > > IMSG at NOAA/NWS/NCEP/EMC
> > >
> > > 5830 University Research Ct.
> > >
> > > College Park, MD 20740
> > >
> > > Binbin.Zhou at noaa.gov
> > >
> > > 301-683-3683
> > >
> > >
> >
> > --
> > George McCabe - Software Engineer III
> > National Center for Atmospheric Research
> > Research Applications Laboratory
> > 303-497-2768
> > ---
> > My working day may not be your working day. Please do not feel
obliged to
> > reply to this email outside of your normal working hours.
> >
> >
>
> --
>
> Binbin Zhou
>
> IMSG at NOAA/NWS/NCEP/EMC
>
> 5830 University Research Ct.
>
> College Park, MD 20740
>
> Binbin.Zhou at noaa.gov
>
> 301-683-3683
>
>
--
Julie Prestopnik (she/her)
Software Engineer
National Center for Atmospheric Research
Research Applications Laboratory
Email: jpresto at ucar.edu
My working day may not be your working day. Please do not feel
obliged to
reply to this email outside of your normal working hours.
------------------------------------------------
Subject: CDP threshold setting in EnsembleStat conf
From: Binbin.Zhou at noaa.gov
Time: Wed Jan 06 09:23:05 2021
George,
I have copied entire output directory onto HERA
/scratch2/NCEPDEV/fv3-
cam/noscrub/Binbin.Zhou/metplus_test/metplus3.out
You can see the log file in log directory
I also copied my METplus package there:
/scratch2/NCEPDEV/fv3-
cam/noscrub/Binbin.Zhou/metplus_test/verf_g2g.v4.0.0
This package is a comprehensive verification for many models of EMC.
If you
want
to look at global ensemble GEFS part, you can see its EnsembleGrid
config
file
EnsembleStatConfig_gefs_bin11 in directory
/scratch2/NCEPDEV/fv3-
cam/noscrub/Binbin.Zhou/metplus_test/verf_g2g.v4.0.0/parm/app_conf/grid2grid/met_config
Its METplus conf file gefs_bin11.conf in directory
/scratch2/NCEPDEV/fv3-
cam/noscrub/Binbin.Zhou/metplus_test/verf_g2g.v4.0.0/parm/app_conf/grid2grid/gefs_conf
I can not run it on HERA since some environment path settings are not
reset.
The output directory is just copied from WCOSS.
Binbin
On Wed, Jan 6, 2021 at 10:59 AM George McCabe via RT
<met_help at ucar.edu>
wrote:
> Hi Binbin,
>
> I am still waiting on WCOSS access, but I do have access to HERA.
>
> Thanks,
> George
>
> On Wed, Jan 6, 2021 at 8:57 AM Binbin.Zhou at noaa.gov via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116 >
> >
> > George,
> >
> > Can you access WCOSS or access HERA?
> > Otherwise I will email attached to you
> >
> > Binbin
> >
> >
> >
> > On Wed, Jan 6, 2021 at 10:46 AM George McCabe via RT
<met_help at ucar.edu>
> > wrote:
> >
> > > Hi Binbin,
> > >
> > > Could you send me a log file for a run with LOG_LEVEL=DEBUG (in
METplus
> > > config) so I can see how the environment variable ENS_FIELD is
set? The
> > > values of ENS_VAR<n>_* are formatted and set in this environment
> variable
> > > which is passed into the MET config. You can compare that value
with
> what
> > > you used in your successful run outside of the METplus wrapper
to
> > determine
> > > what is different.
> > >
> > > Thanks,
> > > George
> > >
> > > On Wed, Jan 6, 2021 at 7:11 AM Binbin.Zhou at noaa.gov via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
>
> > > >
> > > > George,
> > > >
> > > > I got a new error in execution although some output files
(nc file)
> > are
> > > > created but stat files not.
> > > > The error message is
> > > >
> > > > ERROR :
> > > > ERROR : Simple_Node::check(double, double, double) const ->
> > > climatological
> > > > distribution percentile threshold "<=CDP10" requested with
invalid
> mean
> > > > (-9999) or standard deviation (-9999).
> > > > ERROR :
> > > >
> > > > Such an error was ever investigated by John H before (year
ago):
> When I
> > > > directly ran ensemble_stat for global ensemble (not METplus-
based,
> > > > but hard code of all settings in EnsembleStat config file):
If hard
> > code
> > > > fcst field in EnsembleStat config file like this
> > > >
> > > > name = "HGT";
> > > > level = "P500";
> > > > cat_thresh = [ <=CDP10, >CDP10&&<=CDP20,
>CDP20&&<=CDP30,
> > > > >CDP30&&<=CDP40, >CDP40&&<=CDP50, >CDP50&&<=CDP60,
>CDP60&&<=CDP70,
> > > > >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];
> > > >
> > > > Run ensemble_stat will have such error: ERROR :
> > > > Simple_Node::check(double, double, double) const ->
climatological
> > > > distribution percentile threshold "<=CDP10" requested with
invalid
> mean
> > > > (-9999) or standard deviation (-9999).
> > > >
> > > > John H. suggested me change "cat_thresh = " to "obs_thresh =
",
> then
> > > the
> > > > error was solved.
> > > >
> > > > In current METplus version, following your suggestion as
> > > >
> > > > ENS_VAR1_OPTIONS = obs_thresh = [ <=CDP10, >CDP10&&<=CDP20,
> > > > >CDP20&&<=CDP30, >CDP30&&<=CDP40, >CDP40&&<=CDP50,
>CDP50&&<=CDP60,
> > > > >CDP60&&<=CDP70, >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];
> > > >
> > > > the same error appears again. So I am not for sure if the
> > "obs_thresh"
> > > > setting is correctly passed.
> > > >
> > > > Binbin
> > > >
> > > >
> > > >
> > > >
> > > > On Tue, Jan 5, 2021 at 5:19 PM George McCabe via RT <
> met_help at ucar.edu
> > >
> > > > wrote:
> > > >
> > > > > Hi Binbin,
> > > > >
> > > > > Your solution should work for now. It looks like although
the
> METplus
> > > > > variable does get read properly, the environment variable is
not
> > > actually
> > > > > set by the EnsembleStat wrapper. I can make a note to add
that for
> > > 4.0.0,
> > > > > as it is an easy fix.
> > > > >
> > > > > - George
> > > > >
> > > > > On Tue, Jan 5, 2021 at 2:53 PM Binbin.Zhou at noaa.gov via RT <
> > > > > met_help at ucar.edu> wrote:
> > > > >
> > > > > > George,
> > > > > >
> > > > > > I have a temporal solution:
> > > > > > set ploy in EnembleStat config as
> > > > > > poly = [ "${MASKPATH}/lat_NHM.nc",
> > > > > > "${MASKPATH}/lat_NHM.nc",
> > > > > > "${MASKPATH}/lat_TRP.nc" ];
> > > > > >
> > > > > > then set MASKPATH in user_env_vars part in the conf file
> > > > > > This MASKPAH then can be passed to EnsembleStat's poly [ ]
entry
> > > > > >
> > > > > > Binbin
> > > > > >
> > > > > > On Tue, Jan 5, 2021 at 4:25 PM Binbin Zhou - NOAA
Affiliate <
> > > > > > binbin.zhou at noaa.gov> wrote:
> > > > > >
> > > > > > > George,
> > > > > > >
> > > > > > > Still not working, error says
> > > > > > > ERROR : replace_env() -> unable to get value for
environment
> > > > variable
> > > > > > > "VERIF_MASK"
> > > > > > >
> > > > > > > Binbin
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > On Tue, Jan 5, 2021 at 3:50 PM George McCabe via RT <
> > > > met_help at ucar.edu
> > > > > >
> > > > > > > wrote:
> > > > > > >
> > > > > > >> Hi Binbin,
> > > > > > >>
> > > > > > >> You should be able to set it in the METplus config the
same
> way
> > it
> > > > is
> > > > > > done
> > > > > > >> for GridStat -- no quotes with commas between each
item. The
> > > wrapper
> > > > > > >> should
> > > > > > >> format it properly.
> > > > > > >>
> > > > > > >> Here is an example from an existing use case:
> > > > > > >>
> > > > > > >> GRID_STAT_VERIFICATION_MASK_TEMPLATE =
> > > > > > >>
> > >
{INPUT_BASE}/model_applications/precipitation/mask/CONUS_HRRRTLE.nc,
> > > > > > >>
> > >
{INPUT_BASE}/model_applications/precipitation/mask/EAST_HRRRTLE.nc,
> > > > > > >>
> > {INPUT_BASE}/model_applications/precipitation/mask/WEST_HRRRTLE.nc
> > > > > > >>
> > > > > > >> You should be able to set them the same way using
> > > > > > >> ENSEMBLE_STAT_VERIFICATION_MASK_TEMPLATE. Let me know
if that
> > > > doesn't
> > > > > > >> work.
> > > > > > >>
> > > > > > >> - George
> > > > > > >>
> > > > > > >> On Tue, Jan 5, 2021 at 1:45 PM Binbin.Zhou at noaa.gov via
RT <
> > > > > > >> met_help at ucar.edu> wrote:
> > > > > > >>
> > > > > > >> >
> > > > > > >> > <URL:
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
> > >
> > > > > > >> >
> > > > > > >> > George,
> > > > > > >> >
> > > > > > >> > I got another issue for verification mask setting.
> > > > > > >> >
> > > > > > >> > I am using $VERIF_MASK in EnsembleStat config f/ile
> > > > > > >> > mask = {
> > > > > > >> > grid = [];
> > > > > > >> > poly = [${VERIF_MASK}];
> > > > > > >> > sid = [];
> > > > > > >> > }
> > > > > > >> >
> > > > > > >> > And using GRID_STAT_VERIFICATION_MASK_TEMPLATE to
define
> > > several
> > > > > > >> polygon
> > > > > > >> > nc mask files
> > > > > > >> > But it seems not working. But it works for Gridstat
config
> in
> > > > suich
> > > > > > >> > setting.
> > > > > > >> > I can not find ENSEMBLE_STAT_
VERIFICATION_MASK_TEMPLATE in
> > the
> > > > > > METplus
> > > > > > >> doc
> > > > > > >> >
> > > > > > >> > So I define VERIF_MASK in [user_env_vars] part.
> > > > > > >> > It values can not be passed to ploy = [${VERIF_MASK}]
in the
> > > > > > >> EnsembleStat
> > > > > > >> > conf if more than one nc files included.
> > > > > > >> > For example
> > > > > > >> > VERIF_MASK=" '/part/p1.cn', '/path/p2.nc' "
> > > > > > >> > the error says poly = [/path/p1,]
> > > > > > >> > It seems double quote or single quote can not be
passed to
> > > > > VERIF_MASK
> > > > > > in
> > > > > > >> > the EnsembleStat config.
> > > > > > >> > I tried use back slash \ to before quote, but still
not
> > working
> > > > > > >> >
> > > > > > >> > Binbin
> > > > > > >> >
> > > > > > >> >
> > > > > > >> > On Tue, Jan 5, 2021 at 10:33 AM Binbin Zhou - NOAA
> Affiliate <
> > > > > > >> > binbin.zhou at noaa.gov> wrote:
> > > > > > >> >
> > > > > > >> > > George,
> > > > > > >> > >
> > > > > > >> > > Thanks for your quick response! I'll test this
settings
> > and
> > > > let
> > > > > > >> > > you know the results.
> > > > > > >> > >
> > > > > > >> > > Binbin
> > > > > > >> > >
> > > > > > >> > > On Tue, Jan 5, 2021 at 10:17 AM George McCabe via
RT <
> > > > > > >> met_help at ucar.edu>
> > > > > > >> > > wrote:
> > > > > > >> > >
> > > > > > >> > >> Hi Binbin,
> > > > > > >> > >>
> > > > > > >> > >> Happy New Year to you too!
> > > > > > >> > >>
> > > > > > >> > >> I will comment on each configuration variable and
how to
> > set
> > > it
> > > > > in
> > > > > > a
> > > > > > >> > >> METplus config inline:
> > > > > > >> > >>
> > > > > > >> > >> ens = {
> > > > > > >> > >> ens_thresh = 1.0;
> > > > > > >> > >>
> > > > > > >> > >>
> > > > > > >> > >> *This is controlled by the
ENSEMBLE_STAT_ENS_THRESH
> > variable.
> > > > The
> > > > > > >> > default
> > > > > > >> > >> value is 1.0, so you don't need to include it in
your
> > config
> > > > > file,
> > > > > > >> but
> > > > > > >> > you
> > > > > > >> > >> can if you may adjust this value at some point.*
> > > > > > >> > >>
> > > > > > >> > >> vld_thresh = 1.0;
> > > > > > >> > >>
> > > > > > >> > >> *This value is set to 1.0 by default so we don't
need to
> > > worry
> > > > > > about
> > > > > > >> it
> > > > > > >> > >> right now.*
> > > > > > >> > >>
> > > > > > >> > >> field = [
> > > > > > >> > >>
> > > > > > >> > >> {
> > > > > > >> > >> name = "HGT";
> > > > > > >> > >> level = "P500";
> > > > > > >> > >> obs_thresh = [ <=CDP10, >CDP10&&<=CDP20,
> > > > > >CDP20&&<=CDP30,
> > > > > > >> > >> >CDP30&&<=CDP40, >CDP40&&<=CDP50, >CDP50&&<=CDP60,
> > > > > >CDP60&&<=CDP70,
> > > > > > >> > >> >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];
> > > > > > >> > >> }
> > > > > > >> > >> ]
> > > > > > >> > >> }
> > > > > > >> > >> fcst = ens;
> > > > > > >> > >> obs = fcst;
> > > > > > >> > >>
> > > > > > >> > >> *1) The field info for ens is set in the
> > > > > > >> > >> ENS_VAR<n>_[NAME/LEVEL/THRESH/OPTIONS] variables.
The
> fcst
> > > and
> > > > > obs
> > > > > > >> field
> > > > > > >> > >> info are set in the corresponding FCST_VAR<n>_*
and
> > > > OBS_VAR<n>_*
> > > > > > >> > variables
> > > > > > >> > >> respectively, or you can use BOTH_VAR<n>_* if the
FCST
> and
> > > OBS
> > > > > > values
> > > > > > >> > are
> > > > > > >> > >> the same.*
> > > > > > >> > >>
> > > > > > >> > >> *If ENS_VAR<n>_* variables are not explicitly set,
then
> it
> > > will
> > > > > use
> > > > > > >> the
> > > > > > >> > >> values from FCST_VAR<n>_*.*
> > > > > > >> > >> *Since the fcst, obs, and ens are all the same you
could
> > just
> > > > use
> > > > > > >> > >> BOTH_VAR<n>_* variables to control all 3, although
keep
> in
> > > mind
> > > > > > that
> > > > > > >> if
> > > > > > >> > >> you
> > > > > > >> > >> need to change one of them for any reason, it will
be
> more
> > > > > > difficult
> > > > > > >> to
> > > > > > >> > do
> > > > > > >> > >> this. If you know that they will always be the
same
> values,
> > > > then
> > > > > I
> > > > > > >> > >> recommend using BOTH_, but if you know they may
change or
> > are
> > > > > > >> unsure, I
> > > > > > >> > >> would recommend setting them by referencing the
other
> > > > variables,
> > > > > > >> i.e.*
> > > > > > >> > >>
> > > > > > >> > >> *FCST_VAR1_NAME = HGT*
> > > > > > >> > >> *FCST_VAR1_LEVELS = P500 *
> > > > > > >> > >> *OBS_VAR1_NAME = {FCST_VAR1_NAME}*
> > > > > > >> > >> *OBS_VAR1_LEVELS = {FCST_VAR1_LEVELS}*
> > > > > > >> > >>
> > > > > > >> > >> *2) The [FCST/OBS/ENS]_VAR<n>_THRESH variables set
the
> > > > cat_thresh
> > > > > > >> values
> > > > > > >> > >> in
> > > > > > >> > >> the field info. A variable specific to obs_thresh
is not
> > > > > currently
> > > > > > >> > >> supported, however you can set these values by
using the
> > > > > > >> > ENS_VAR1_OPTIONS
> > > > > > >> > >> variable, i.e.*
> > > > > > >> > >>
> > > > > > >> > >> *ENS_VAR1_OPTIONS = obs_thresh = [ <=CDP10,
> > >CDP10&&<=CDP20,
> > > > > > >> > >> >CDP20&&<=CDP30, >CDP30&&<=CDP40, >CDP40&&<=CDP50,
> > > > > >CDP50&&<=CDP60,
> > > > > > >> > >> >CDP60&&<=CDP70, >CDP70&&<=CDP80, >CDP80&&<=CDP90,
>CDP90
> > ];*
> > > > > > >> > >>
> > > > > > >> > >>
> > > > > > >> > >> *Remember to include the semicolon at the end! *
> > > > > > >> > >>
> > > > > > >> > >> ens_ssvar_bin_size = 1000000;
> > > > > > >> > >> *1) This variable is different from the default
and not
> > > > currently
> > > > > > >> > >> supported
> > > > > > >> > >> with a METplus config variable. I will add this to
the
> list
> > > of
> > > > > > >> variables
> > > > > > >> > >> in
> > > > > > >> > >> MET config files that we want to support. However,
in the
> > > > > meantime
> > > > > > >> you
> > > > > > >> > can
> > > > > > >> > >> copy the default wrapped MET config file and
modify it to
> > fit
> > > > > your
> > > > > > >> > needs.
> > > > > > >> > >> To do this, you will need to:*
> > > > > > >> > >>
> > > > > > >> > >> * a) Copy
> > METplus/parm/met_config/EnsembleStatConfig_wrapped
> > > > to
> > > > > > the
> > > > > > >> > >> directory that contains your METplus config file
for this
> > use
> > > > > case.
> > > > > > >> > Rename
> > > > > > >> > >> it by replacing "wrapped" with a short description
that
> > > > pertains
> > > > > to
> > > > > > >> your
> > > > > > >> > >> use case.*
> > > > > > >> > >>
> > > > > > >> > >> * b) In your METplus config file, change the
value of
> > > > > > >> > >> ENSEMBLE_STAT_CONFIG_FILE to point to the path of
this
> new
> > > > config
> > > > > > >> file.*
> > > > > > >> > >>
> > > > > > >> > >> * c) If you know the value you want to use for
this
> > variable
> > > > > will
> > > > > > >> > always
> > > > > > >> > >> be 1000000, then simply set the variable to that
value.
> If
> > > you
> > > > > > think
> > > > > > >> you
> > > > > > >> > >> may want to change the value, then you can utilize
the
> > > > > > >> [user_env_vars]
> > > > > > >> > >> functionality. See:
> > > > > > >> > >>
> > > > > > >> > >>
> > > > > > >> >
> > > > > > >>
> > > > > >
> > > > >
> > > >
> > >
> >
>
https://dtcenter.github.io/METplus/latest/Users_Guide/systemconfiguration.html#user-
defined-config
> > > > > > >> > >> <
> > > > > > >> > >>
> > > > > > >> >
> > > > > > >>
> > > > > >
> > > > >
> > > >
> > >
> >
>
https://dtcenter.github.io/METplus/latest/Users_Guide/systemconfiguration.html#user-
defined-config
> > > > > > >> > >> >*
> > > > > > >> > >> *In this case, you would add the following to your
> METplus
> > > > > config:*
> > > > > > >> > >>
> > > > > > >> > >> *[user_env_vars]*
> > > > > > >> > >> *ENS_SSVAR_BIN_SIZE = 1000000*
> > > > > > >> > >>
> > > > > > >> > >> *Then change the line in your EnsembleStat config
file
> that
> > > you
> > > > > > >> copied
> > > > > > >> > >> to:*
> > > > > > >> > >>
> > > > > > >> > >> * ens_ssvar_bin_size = ${ENS_SSVAR_BIN_SIZE}; *
> > > > > > >> > >>
> > > > > > >> > >> ens_phist_bin_size = 0.05;
> > > > > > >> > >> *This variable uses the default value, so you
don't need
> to
> > > do
> > > > > > >> anything
> > > > > > >> > >> here. If you need to make it configurable or
change the
> > > value,
> > > > > then
> > > > > > >> > follow
> > > > > > >> > >> the instructions for setting ens_ssvar_bin_size.*
> > > > > > >> > >>
> > > > > > >> > >> climo_mean = fcst;
> > > > > > >> > >> climo_mean = {
> > > > > > >> > >> file_name = "${CLIM_MEAN}";
> > > > > > >> > >> time_interp_method = DW_MEAN;
> > > > > > >> > >> match_day = TRUE;
> > > > > > >> > >> time_step = 21600;
> > > > > > >> > >> }
> > > > > > >> > >>
> > > > > > >> > >>
> > > > > > >> > >> *Instead of using CLIM_MEAN, you can set
> > > > > > >> > >> ENSEMBLE_STAT_CLIMO_MEAN_INPUT_[DIR/TEMPLATE] in
the
> > METplus
> > > > > > config.
> > > > > > >> You
> > > > > > >> > >> can use filename template syntax in the _TEMPLATE
value,
> > i.e.
> > > > > > >> > >> {valid?fmt=%m%d}. The other variables in the
climo_mean
> > > > > dictionary
> > > > > > >> are
> > > > > > >> > >> actually old variables that have been replaced
with
> > > > day_interval
> > > > > > and
> > > > > > >> > >> hour_interval, but the values you use are the old
> defaults,
> > > so
> > > > > you
> > > > > > >> > >> shouldn't need to set them.*
> > > > > > >> > >>
> > > > > > >> > >> climo_stdev = climo_mean;
> > > > > > >> > >> climo_stdev = {
> > > > > > >> > >> file_name = "${CLIM_STDV}";
> > > > > > >> > >> }
> > > > > > >> > >>
> > > > > > >> > >> *Similarly to CLIM_MEAN, you can use
> > > > > > >> > >> ENSEMBLE_STAT_CLIMO_STDEV_INPUT_[DIR/TEMPLATE] to
set
> this
> > > file
> > > > > > >> name.*
> > > > > > >> > >>
> > > > > > >> > >> climo_cdf = {
> > > > > > >> > >> cdf_bins = 11;
> > > > > > >> > >> center_bins = TRUE;
> > > > > > >> > >> write_bins = TRUE;
> > > > > > >> > >> }
> > > > > > >> > >> *The value for write_bins is the default, but the
values
> > for
> > > > > > cdf_bins
> > > > > > >> > and
> > > > > > >> > >> center_bins do not. To set these, follow the above
> > > instructions
> > > > > for
> > > > > > >> > >> ens_ssvar_bin_size to override them and/or make
them
> > > > configurable
> > > > > > >> > through
> > > > > > >> > >> METplus. I will also add these variables to the
list of
> MET
> > > > > configs
> > > > > > >> that
> > > > > > >> > >> users want to be able to easily configure through
METplus
> > > > > configs.*
> > > > > > >> > >>
> > > > > > >> > >> Please let me know if you run into any issues
setting any
> > of
> > > > that
> > > > > > up.
> > > > > > >> > >> Also,
> > > > > > >> > >> if there are any other MET config variables that
you want
> > to
> > > > see
> > > > > > >> > supported
> > > > > > >> > >> in METplus, let me know and I will make sure they
get
> > > included
> > > > > when
> > > > > > >> we
> > > > > > >> > >> have
> > > > > > >> > >> a chance to refactor those wrappers. It is
possible to
> add
> > > > > support
> > > > > > >> for
> > > > > > >> > MET
> > > > > > >> > >> configs using the above instructions, but it is
always
> > easier
> > > > and
> > > > > > >> less
> > > > > > >> > >> error-prone to have them configurable directly
through a
> > > > variable
> > > > > > in
> > > > > > >> the
> > > > > > >> > >> METplus config.
> > > > > > >> > >>
> > > > > > >> > >> Thanks,
> > > > > > >> > >> George
> > > > > > >> > >>
> > > > > > >> > >> On Tue, Jan 5, 2021 at 7:14 AM
Binbin.Zhou at noaa.gov via
> > RT <
> > > > > > >> > >> met_help at ucar.edu> wrote:
> > > > > > >> > >>
> > > > > > >> > >> >
> > > > > > >> > >> > Tue Jan 05 07:14:54 2021: Request 98116 was
acted upon.
> > > > > > >> > >> > Transaction: Ticket created by
Binbin.Zhou at noaa.gov
> > > > > > >> > >> > Queue: met_help
> > > > > > >> > >> > Subject: CDP threshold setting in
EnsembleStat
> conf
> > > > > > >> > >> > Owner: Nobody
> > > > > > >> > >> > Requestors: Binbin.Zhou at noaa.gov
> > > > > > >> > >> > Status: new
> > > > > > >> > >> > Ticket <URL:
> > > > > > >> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
> > > > > > >> > >
> > > > > > >> > >> >
> > > > > > >> > >> >
> > > > > > >> > >> > George,
> > > > > > >> > >> >
> > > > > > >> > >> > Happy New Year!
> > > > > > >> > >> >
> > > > > > >> > >> > I am working on transition of our MET-based
global
> > > > ensemble
> > > > > > >> > >> verification
> > > > > > >> > >> > to METplus based package. In this package
climatology
> > bins
> > > > (10
> > > > > > >> bins)
> > > > > > >> > are
> > > > > > >> > >> > used.
> > > > > > >> > >> > In current ensemble stat config file, the
relevant
> > entries
> > > > iare
> > > > > > >> > defined
> > > > > > >> > >> > like following
> > > > > > >> > >> >
> > > > > > >> > >> > ens = {
> > > > > > >> > >> > ens_thresh = 1.0;
> > > > > > >> > >> > vld_thresh = 1.0;
> > > > > > >> > >> >
> > > > > > >> > >> > field = [
> > > > > > >> > >> >
> > > > > > >> > >> > {
> > > > > > >> > >> > name = "HGT";
> > > > > > >> > >> > level = "P500";
> > > > > > >> > >> > obs_thresh = [ <=CDP10,
>CDP10&&<=CDP20,
> > > > > > >CDP20&&<=CDP30,
> > > > > > >> > >> > >CDP30&&<=CDP40, >CDP40&&<=CDP50,
>CDP50&&<=CDP60,
> > > > > > >CDP60&&<=CDP70,
> > > > > > >> > >> > >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];
> > > > > > >> > >> > }
> > > > > > >> > >> > ]
> > > > > > >> > >> > }
> > > > > > >> > >> > fcst = ens;
> > > > > > >> > >> > obs = fcst;
> > > > > > >> > >> > ens_ssvar_bin_size = 1000000;
> > > > > > >> > >> > ens_phist_bin_size = 0.05;
> > > > > > >> > >> > climo_mean = fcst;
> > > > > > >> > >> > climo_mean = {
> > > > > > >> > >> > file_name = "${CLIM_MEAN}";
> > > > > > >> > >> > time_interp_method = DW_MEAN;
> > > > > > >> > >> > match_day = TRUE;
> > > > > > >> > >> > time_step = 21600;
> > > > > > >> > >> > }
> > > > > > >> > >> >
> > > > > > >> > >> > climo_stdev = climo_mean;
> > > > > > >> > >> > climo_stdev = {
> > > > > > >> > >> > file_name = "${CLIM_STDV}";
> > > > > > >> > >> > }
> > > > > > >> > >> >
> > > > > > >> > >> > climo_cdf = {
> > > > > > >> > >> > cdf_bins = 11;
> > > > > > >> > >> > center_bins = TRUE;
> > > > > > >> > >> > write_bins = TRUE;
> > > > > > >> > >> > }
> > > > > > >> > >> >
> > > > > > >> > >> > I can not find the correspondent settings in its
conf
> > file
> > > > from
> > > > > > >> > METplus
> > > > > > >> > >> > online doc.
> > > > > > >> > >> > Can you help me look at this?
> > > > > > >> > >> >
> > > > > > >> > >> > Thanks!
> > > > > > >> > >> >
> > > > > > >> > >> > Binbin
> > > > > > >> > >> >
> > > > > > >> > >> > --
> > > > > > >> > >> >
> > > > > > >> > >> > Binbin Zhou
> > > > > > >> > >> >
> > > > > > >> > >> > IMSG at NOAA/NWS/NCEP/EMC
> > > > > > >> > >> >
> > > > > > >> > >> > 5830 University Research Ct.
> > > > > > >> > >> >
> > > > > > >> > >> > College Park, MD 20740
> > > > > > >> > >> >
> > > > > > >> > >> > Binbin.Zhou at noaa.gov
> > > > > > >> > >> >
> > > > > > >> > >> > 301-683-3683
> > > > > > >> > >> >
> > > > > > >> > >> >
> > > > > > >> > >>
> > > > > > >> > >> --
> > > > > > >> > >> George McCabe - Software Engineer III
> > > > > > >> > >> National Center for Atmospheric Research
> > > > > > >> > >> Research Applications Laboratory
> > > > > > >> > >> 303-497-2768
> > > > > > >> > >> ---
> > > > > > >> > >> My working day may not be your working day. Please
do not
> > > feel
> > > > > > >> obliged
> > > > > > >> > to
> > > > > > >> > >> reply to this email outside of your normal working
hours.
> > > > > > >> > >>
> > > > > > >> > >>
> > > > > > >> > >
> > > > > > >> > > --
> > > > > > >> > >
> > > > > > >> > > Binbin Zhou
> > > > > > >> > >
> > > > > > >> > > IMSG at NOAA/NWS/NCEP/EMC
> > > > > > >> > >
> > > > > > >> > > 5830 University Research Ct.
> > > > > > >> > >
> > > > > > >> > > College Park, MD 20740
> > > > > > >> > >
> > > > > > >> > > Binbin.Zhou at noaa.gov
> > > > > > >> > >
> > > > > > >> > > 301-683-3683
> > > > > > >> > >
> > > > > > >> >
> > > > > > >> >
> > > > > > >> > --
> > > > > > >> >
> > > > > > >> > Binbin Zhou
> > > > > > >> >
> > > > > > >> > IMSG at NOAA/NWS/NCEP/EMC
> > > > > > >> >
> > > > > > >> > 5830 University Research Ct.
> > > > > > >> >
> > > > > > >> > College Park, MD 20740
> > > > > > >> >
> > > > > > >> > Binbin.Zhou at noaa.gov
> > > > > > >> >
> > > > > > >> > 301-683-3683
> > > > > > >> >
> > > > > > >> >
> > > > > > >>
> > > > > > >> --
> > > > > > >> George McCabe - Software Engineer III
> > > > > > >> National Center for Atmospheric Research
> > > > > > >> Research Applications Laboratory
> > > > > > >> 303-497-2768
> > > > > > >> ---
> > > > > > >> My working day may not be your working day. Please do
not feel
> > > > obliged
> > > > > > to
> > > > > > >> reply to this email outside of your normal working
hours.
> > > > > > >>
> > > > > > >>
> > > > > > >
> > > > > > > --
> > > > > > >
> > > > > > > Binbin Zhou
> > > > > > >
> > > > > > > IMSG at NOAA/NWS/NCEP/EMC
> > > > > > >
> > > > > > > 5830 University Research Ct.
> > > > > > >
> > > > > > > College Park, MD 20740
> > > > > > >
> > > > > > > Binbin.Zhou at noaa.gov
> > > > > > >
> > > > > > > 301-683-3683
> > > > > > >
> > > > > >
> > > > > >
> > > > > > --
> > > > > >
> > > > > > Binbin Zhou
> > > > > >
> > > > > > IMSG at NOAA/NWS/NCEP/EMC
> > > > > >
> > > > > > 5830 University Research Ct.
> > > > > >
> > > > > > College Park, MD 20740
> > > > > >
> > > > > > Binbin.Zhou at noaa.gov
> > > > > >
> > > > > > 301-683-3683
> > > > > >
> > > > > >
> > > > >
> > > > > --
> > > > > George McCabe - Software Engineer III
> > > > > National Center for Atmospheric Research
> > > > > Research Applications Laboratory
> > > > > 303-497-2768
> > > > > ---
> > > > > My working day may not be your working day. Please do not
feel
> > obliged
> > > to
> > > > > reply to this email outside of your normal working hours.
> > > > >
> > > > >
> > > >
> > > > --
> > > >
> > > > Binbin Zhou
> > > >
> > > > IMSG at NOAA/NWS/NCEP/EMC
> > > >
> > > > 5830 University Research Ct.
> > > >
> > > > College Park, MD 20740
> > > >
> > > > Binbin.Zhou at noaa.gov
> > > >
> > > > 301-683-3683
> > > >
> > > >
> > >
> > > --
> > > George McCabe - Software Engineer III
> > > National Center for Atmospheric Research
> > > Research Applications Laboratory
> > > 303-497-2768
> > > ---
> > > My working day may not be your working day. Please do not feel
obliged
> to
> > > reply to this email outside of your normal working hours.
> > >
> > >
> >
> > --
> >
> > Binbin Zhou
> >
> > IMSG at NOAA/NWS/NCEP/EMC
> >
> > 5830 University Research Ct.
> >
> > College Park, MD 20740
> >
> > Binbin.Zhou at noaa.gov
> >
> > 301-683-3683
> >
> >
>
> --
> George McCabe - Software Engineer III
> National Center for Atmospheric Research
> Research Applications Laboratory
> 303-497-2768
> ---
> My working day may not be your working day. Please do not feel
obliged to
> reply to this email outside of your normal working hours.
>
>
--
Binbin Zhou
IMSG at NOAA/NWS/NCEP/EMC
5830 University Research Ct.
College Park, MD 20740
Binbin.Zhou at noaa.gov
301-683-3683
------------------------------------------------
Subject: CDP threshold setting in EnsembleStat conf
From: Binbin.Zhou at noaa.gov
Time: Wed Jan 06 09:34:24 2021
Julie,
The output directory on WCOSS is
/gpfs/dell1/ptmp/Binbin.Zhou/g2g/RFC2/tmpnwprd/verf_g2g_gefs_00_dev.161076/metplus3.out
My METplus package on WCOSS is
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_g2g.v4.0.0
For GEFS, the EnsembleGrid config file is
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_g2g.v4.0.0/parm/app_conf/grid2grid/met_config/EnsembleStatConfig_gefs_bin11
Its conf file
is
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_g2g.v4.0.0/parm/app_conf/grid2grid/gefs_conf/gefs_bin11.conf
The running process is little bit complex since this is a transition
to
future operational package that uses
mpi parallel: the script is
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_g2g.v4.0.0/ush/verf_g2g_metplus_run_gefs_mpi.sh
Binbin
On Wed, Jan 6, 2021 at 11:00 AM Julie Prestopnik via RT
<met_help at ucar.edu>
wrote:
> Hi Binbin.
>
> This is Julie. I haven't been following this entire thread, but I
am on
> WCOSS right now. If you send a path to a file, I can pull it and
put it on
> our ftp server for George.
>
> Julie
>
> On Wed, Jan 6, 2021 at 8:57 AM Binbin.Zhou at noaa.gov via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116 >
> >
> > George,
> >
> > Can you access WCOSS or access HERA?
> > Otherwise I will email attached to you
> >
> > Binbin
> >
> >
> >
> > On Wed, Jan 6, 2021 at 10:46 AM George McCabe via RT
<met_help at ucar.edu>
> > wrote:
> >
> > > Hi Binbin,
> > >
> > > Could you send me a log file for a run with LOG_LEVEL=DEBUG (in
METplus
> > > config) so I can see how the environment variable ENS_FIELD is
set? The
> > > values of ENS_VAR<n>_* are formatted and set in this environment
> variable
> > > which is passed into the MET config. You can compare that value
with
> what
> > > you used in your successful run outside of the METplus wrapper
to
> > determine
> > > what is different.
> > >
> > > Thanks,
> > > George
> > >
> > > On Wed, Jan 6, 2021 at 7:11 AM Binbin.Zhou at noaa.gov via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
>
> > > >
> > > > George,
> > > >
> > > > I got a new error in execution although some output files
(nc file)
> > are
> > > > created but stat files not.
> > > > The error message is
> > > >
> > > > ERROR :
> > > > ERROR : Simple_Node::check(double, double, double) const ->
> > > climatological
> > > > distribution percentile threshold "<=CDP10" requested with
invalid
> mean
> > > > (-9999) or standard deviation (-9999).
> > > > ERROR :
> > > >
> > > > Such an error was ever investigated by John H before (year
ago):
> When I
> > > > directly ran ensemble_stat for global ensemble (not METplus-
based,
> > > > but hard code of all settings in EnsembleStat config file):
If hard
> > code
> > > > fcst field in EnsembleStat config file like this
> > > >
> > > > name = "HGT";
> > > > level = "P500";
> > > > cat_thresh = [ <=CDP10, >CDP10&&<=CDP20,
>CDP20&&<=CDP30,
> > > > >CDP30&&<=CDP40, >CDP40&&<=CDP50, >CDP50&&<=CDP60,
>CDP60&&<=CDP70,
> > > > >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];
> > > >
> > > > Run ensemble_stat will have such error: ERROR :
> > > > Simple_Node::check(double, double, double) const ->
climatological
> > > > distribution percentile threshold "<=CDP10" requested with
invalid
> mean
> > > > (-9999) or standard deviation (-9999).
> > > >
> > > > John H. suggested me change "cat_thresh = " to "obs_thresh =
",
> then
> > > the
> > > > error was solved.
> > > >
> > > > In current METplus version, following your suggestion as
> > > >
> > > > ENS_VAR1_OPTIONS = obs_thresh = [ <=CDP10, >CDP10&&<=CDP20,
> > > > >CDP20&&<=CDP30, >CDP30&&<=CDP40, >CDP40&&<=CDP50,
>CDP50&&<=CDP60,
> > > > >CDP60&&<=CDP70, >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];
> > > >
> > > > the same error appears again. So I am not for sure if the
> > "obs_thresh"
> > > > setting is correctly passed.
> > > >
> > > > Binbin
> > > >
> > > >
> > > >
> > > >
> > > > On Tue, Jan 5, 2021 at 5:19 PM George McCabe via RT <
> met_help at ucar.edu
> > >
> > > > wrote:
> > > >
> > > > > Hi Binbin,
> > > > >
> > > > > Your solution should work for now. It looks like although
the
> METplus
> > > > > variable does get read properly, the environment variable is
not
> > > actually
> > > > > set by the EnsembleStat wrapper. I can make a note to add
that for
> > > 4.0.0,
> > > > > as it is an easy fix.
> > > > >
> > > > > - George
> > > > >
> > > > > On Tue, Jan 5, 2021 at 2:53 PM Binbin.Zhou at noaa.gov via RT <
> > > > > met_help at ucar.edu> wrote:
> > > > >
> > > > > > George,
> > > > > >
> > > > > > I have a temporal solution:
> > > > > > set ploy in EnembleStat config as
> > > > > > poly = [ "${MASKPATH}/lat_NHM.nc",
> > > > > > "${MASKPATH}/lat_NHM.nc",
> > > > > > "${MASKPATH}/lat_TRP.nc" ];
> > > > > >
> > > > > > then set MASKPATH in user_env_vars part in the conf file
> > > > > > This MASKPAH then can be passed to EnsembleStat's poly [ ]
entry
> > > > > >
> > > > > > Binbin
> > > > > >
> > > > > > On Tue, Jan 5, 2021 at 4:25 PM Binbin Zhou - NOAA
Affiliate <
> > > > > > binbin.zhou at noaa.gov> wrote:
> > > > > >
> > > > > > > George,
> > > > > > >
> > > > > > > Still not working, error says
> > > > > > > ERROR : replace_env() -> unable to get value for
environment
> > > > variable
> > > > > > > "VERIF_MASK"
> > > > > > >
> > > > > > > Binbin
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > On Tue, Jan 5, 2021 at 3:50 PM George McCabe via RT <
> > > > met_help at ucar.edu
> > > > > >
> > > > > > > wrote:
> > > > > > >
> > > > > > >> Hi Binbin,
> > > > > > >>
> > > > > > >> You should be able to set it in the METplus config the
same
> way
> > it
> > > > is
> > > > > > done
> > > > > > >> for GridStat -- no quotes with commas between each
item. The
> > > wrapper
> > > > > > >> should
> > > > > > >> format it properly.
> > > > > > >>
> > > > > > >> Here is an example from an existing use case:
> > > > > > >>
> > > > > > >> GRID_STAT_VERIFICATION_MASK_TEMPLATE =
> > > > > > >>
> > >
{INPUT_BASE}/model_applications/precipitation/mask/CONUS_HRRRTLE.nc,
> > > > > > >>
> > >
{INPUT_BASE}/model_applications/precipitation/mask/EAST_HRRRTLE.nc,
> > > > > > >>
> > {INPUT_BASE}/model_applications/precipitation/mask/WEST_HRRRTLE.nc
> > > > > > >>
> > > > > > >> You should be able to set them the same way using
> > > > > > >> ENSEMBLE_STAT_VERIFICATION_MASK_TEMPLATE. Let me know
if that
> > > > doesn't
> > > > > > >> work.
> > > > > > >>
> > > > > > >> - George
> > > > > > >>
> > > > > > >> On Tue, Jan 5, 2021 at 1:45 PM Binbin.Zhou at noaa.gov via
RT <
> > > > > > >> met_help at ucar.edu> wrote:
> > > > > > >>
> > > > > > >> >
> > > > > > >> > <URL:
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
> > >
> > > > > > >> >
> > > > > > >> > George,
> > > > > > >> >
> > > > > > >> > I got another issue for verification mask setting.
> > > > > > >> >
> > > > > > >> > I am using $VERIF_MASK in EnsembleStat config f/ile
> > > > > > >> > mask = {
> > > > > > >> > grid = [];
> > > > > > >> > poly = [${VERIF_MASK}];
> > > > > > >> > sid = [];
> > > > > > >> > }
> > > > > > >> >
> > > > > > >> > And using GRID_STAT_VERIFICATION_MASK_TEMPLATE to
define
> > > several
> > > > > > >> polygon
> > > > > > >> > nc mask files
> > > > > > >> > But it seems not working. But it works for Gridstat
config
> in
> > > > suich
> > > > > > >> > setting.
> > > > > > >> > I can not find ENSEMBLE_STAT_
VERIFICATION_MASK_TEMPLATE in
> > the
> > > > > > METplus
> > > > > > >> doc
> > > > > > >> >
> > > > > > >> > So I define VERIF_MASK in [user_env_vars] part.
> > > > > > >> > It values can not be passed to ploy = [${VERIF_MASK}]
in the
> > > > > > >> EnsembleStat
> > > > > > >> > conf if more than one nc files included.
> > > > > > >> > For example
> > > > > > >> > VERIF_MASK=" '/part/p1.cn', '/path/p2.nc' "
> > > > > > >> > the error says poly = [/path/p1,]
> > > > > > >> > It seems double quote or single quote can not be
passed to
> > > > > VERIF_MASK
> > > > > > in
> > > > > > >> > the EnsembleStat config.
> > > > > > >> > I tried use back slash \ to before quote, but still
not
> > working
> > > > > > >> >
> > > > > > >> > Binbin
> > > > > > >> >
> > > > > > >> >
> > > > > > >> > On Tue, Jan 5, 2021 at 10:33 AM Binbin Zhou - NOAA
> Affiliate <
> > > > > > >> > binbin.zhou at noaa.gov> wrote:
> > > > > > >> >
> > > > > > >> > > George,
> > > > > > >> > >
> > > > > > >> > > Thanks for your quick response! I'll test this
settings
> > and
> > > > let
> > > > > > >> > > you know the results.
> > > > > > >> > >
> > > > > > >> > > Binbin
> > > > > > >> > >
> > > > > > >> > > On Tue, Jan 5, 2021 at 10:17 AM George McCabe via
RT <
> > > > > > >> met_help at ucar.edu>
> > > > > > >> > > wrote:
> > > > > > >> > >
> > > > > > >> > >> Hi Binbin,
> > > > > > >> > >>
> > > > > > >> > >> Happy New Year to you too!
> > > > > > >> > >>
> > > > > > >> > >> I will comment on each configuration variable and
how to
> > set
> > > it
> > > > > in
> > > > > > a
> > > > > > >> > >> METplus config inline:
> > > > > > >> > >>
> > > > > > >> > >> ens = {
> > > > > > >> > >> ens_thresh = 1.0;
> > > > > > >> > >>
> > > > > > >> > >>
> > > > > > >> > >> *This is controlled by the
ENSEMBLE_STAT_ENS_THRESH
> > variable.
> > > > The
> > > > > > >> > default
> > > > > > >> > >> value is 1.0, so you don't need to include it in
your
> > config
> > > > > file,
> > > > > > >> but
> > > > > > >> > you
> > > > > > >> > >> can if you may adjust this value at some point.*
> > > > > > >> > >>
> > > > > > >> > >> vld_thresh = 1.0;
> > > > > > >> > >>
> > > > > > >> > >> *This value is set to 1.0 by default so we don't
need to
> > > worry
> > > > > > about
> > > > > > >> it
> > > > > > >> > >> right now.*
> > > > > > >> > >>
> > > > > > >> > >> field = [
> > > > > > >> > >>
> > > > > > >> > >> {
> > > > > > >> > >> name = "HGT";
> > > > > > >> > >> level = "P500";
> > > > > > >> > >> obs_thresh = [ <=CDP10, >CDP10&&<=CDP20,
> > > > > >CDP20&&<=CDP30,
> > > > > > >> > >> >CDP30&&<=CDP40, >CDP40&&<=CDP50, >CDP50&&<=CDP60,
> > > > > >CDP60&&<=CDP70,
> > > > > > >> > >> >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];
> > > > > > >> > >> }
> > > > > > >> > >> ]
> > > > > > >> > >> }
> > > > > > >> > >> fcst = ens;
> > > > > > >> > >> obs = fcst;
> > > > > > >> > >>
> > > > > > >> > >> *1) The field info for ens is set in the
> > > > > > >> > >> ENS_VAR<n>_[NAME/LEVEL/THRESH/OPTIONS] variables.
The
> fcst
> > > and
> > > > > obs
> > > > > > >> field
> > > > > > >> > >> info are set in the corresponding FCST_VAR<n>_*
and
> > > > OBS_VAR<n>_*
> > > > > > >> > variables
> > > > > > >> > >> respectively, or you can use BOTH_VAR<n>_* if the
FCST
> and
> > > OBS
> > > > > > values
> > > > > > >> > are
> > > > > > >> > >> the same.*
> > > > > > >> > >>
> > > > > > >> > >> *If ENS_VAR<n>_* variables are not explicitly set,
then
> it
> > > will
> > > > > use
> > > > > > >> the
> > > > > > >> > >> values from FCST_VAR<n>_*.*
> > > > > > >> > >> *Since the fcst, obs, and ens are all the same you
could
> > just
> > > > use
> > > > > > >> > >> BOTH_VAR<n>_* variables to control all 3, although
keep
> in
> > > mind
> > > > > > that
> > > > > > >> if
> > > > > > >> > >> you
> > > > > > >> > >> need to change one of them for any reason, it will
be
> more
> > > > > > difficult
> > > > > > >> to
> > > > > > >> > do
> > > > > > >> > >> this. If you know that they will always be the
same
> values,
> > > > then
> > > > > I
> > > > > > >> > >> recommend using BOTH_, but if you know they may
change or
> > are
> > > > > > >> unsure, I
> > > > > > >> > >> would recommend setting them by referencing the
other
> > > > variables,
> > > > > > >> i.e.*
> > > > > > >> > >>
> > > > > > >> > >> *FCST_VAR1_NAME = HGT*
> > > > > > >> > >> *FCST_VAR1_LEVELS = P500 *
> > > > > > >> > >> *OBS_VAR1_NAME = {FCST_VAR1_NAME}*
> > > > > > >> > >> *OBS_VAR1_LEVELS = {FCST_VAR1_LEVELS}*
> > > > > > >> > >>
> > > > > > >> > >> *2) The [FCST/OBS/ENS]_VAR<n>_THRESH variables set
the
> > > > cat_thresh
> > > > > > >> values
> > > > > > >> > >> in
> > > > > > >> > >> the field info. A variable specific to obs_thresh
is not
> > > > > currently
> > > > > > >> > >> supported, however you can set these values by
using the
> > > > > > >> > ENS_VAR1_OPTIONS
> > > > > > >> > >> variable, i.e.*
> > > > > > >> > >>
> > > > > > >> > >> *ENS_VAR1_OPTIONS = obs_thresh = [ <=CDP10,
> > >CDP10&&<=CDP20,
> > > > > > >> > >> >CDP20&&<=CDP30, >CDP30&&<=CDP40, >CDP40&&<=CDP50,
> > > > > >CDP50&&<=CDP60,
> > > > > > >> > >> >CDP60&&<=CDP70, >CDP70&&<=CDP80, >CDP80&&<=CDP90,
>CDP90
> > ];*
> > > > > > >> > >>
> > > > > > >> > >>
> > > > > > >> > >> *Remember to include the semicolon at the end! *
> > > > > > >> > >>
> > > > > > >> > >> ens_ssvar_bin_size = 1000000;
> > > > > > >> > >> *1) This variable is different from the default
and not
> > > > currently
> > > > > > >> > >> supported
> > > > > > >> > >> with a METplus config variable. I will add this to
the
> list
> > > of
> > > > > > >> variables
> > > > > > >> > >> in
> > > > > > >> > >> MET config files that we want to support. However,
in the
> > > > > meantime
> > > > > > >> you
> > > > > > >> > can
> > > > > > >> > >> copy the default wrapped MET config file and
modify it to
> > fit
> > > > > your
> > > > > > >> > needs.
> > > > > > >> > >> To do this, you will need to:*
> > > > > > >> > >>
> > > > > > >> > >> * a) Copy
> > METplus/parm/met_config/EnsembleStatConfig_wrapped
> > > > to
> > > > > > the
> > > > > > >> > >> directory that contains your METplus config file
for this
> > use
> > > > > case.
> > > > > > >> > Rename
> > > > > > >> > >> it by replacing "wrapped" with a short description
that
> > > > pertains
> > > > > to
> > > > > > >> your
> > > > > > >> > >> use case.*
> > > > > > >> > >>
> > > > > > >> > >> * b) In your METplus config file, change the
value of
> > > > > > >> > >> ENSEMBLE_STAT_CONFIG_FILE to point to the path of
this
> new
> > > > config
> > > > > > >> file.*
> > > > > > >> > >>
> > > > > > >> > >> * c) If you know the value you want to use for
this
> > variable
> > > > > will
> > > > > > >> > always
> > > > > > >> > >> be 1000000, then simply set the variable to that
value.
> If
> > > you
> > > > > > think
> > > > > > >> you
> > > > > > >> > >> may want to change the value, then you can utilize
the
> > > > > > >> [user_env_vars]
> > > > > > >> > >> functionality. See:
> > > > > > >> > >>
> > > > > > >> > >>
> > > > > > >> >
> > > > > > >>
> > > > > >
> > > > >
> > > >
> > >
> >
>
https://dtcenter.github.io/METplus/latest/Users_Guide/systemconfiguration.html#user-
defined-config
> > > > > > >> > >> <
> > > > > > >> > >>
> > > > > > >> >
> > > > > > >>
> > > > > >
> > > > >
> > > >
> > >
> >
>
https://dtcenter.github.io/METplus/latest/Users_Guide/systemconfiguration.html#user-
defined-config
> > > > > > >> > >> >*
> > > > > > >> > >> *In this case, you would add the following to your
> METplus
> > > > > config:*
> > > > > > >> > >>
> > > > > > >> > >> *[user_env_vars]*
> > > > > > >> > >> *ENS_SSVAR_BIN_SIZE = 1000000*
> > > > > > >> > >>
> > > > > > >> > >> *Then change the line in your EnsembleStat config
file
> that
> > > you
> > > > > > >> copied
> > > > > > >> > >> to:*
> > > > > > >> > >>
> > > > > > >> > >> * ens_ssvar_bin_size = ${ENS_SSVAR_BIN_SIZE}; *
> > > > > > >> > >>
> > > > > > >> > >> ens_phist_bin_size = 0.05;
> > > > > > >> > >> *This variable uses the default value, so you
don't need
> to
> > > do
> > > > > > >> anything
> > > > > > >> > >> here. If you need to make it configurable or
change the
> > > value,
> > > > > then
> > > > > > >> > follow
> > > > > > >> > >> the instructions for setting ens_ssvar_bin_size.*
> > > > > > >> > >>
> > > > > > >> > >> climo_mean = fcst;
> > > > > > >> > >> climo_mean = {
> > > > > > >> > >> file_name = "${CLIM_MEAN}";
> > > > > > >> > >> time_interp_method = DW_MEAN;
> > > > > > >> > >> match_day = TRUE;
> > > > > > >> > >> time_step = 21600;
> > > > > > >> > >> }
> > > > > > >> > >>
> > > > > > >> > >>
> > > > > > >> > >> *Instead of using CLIM_MEAN, you can set
> > > > > > >> > >> ENSEMBLE_STAT_CLIMO_MEAN_INPUT_[DIR/TEMPLATE] in
the
> > METplus
> > > > > > config.
> > > > > > >> You
> > > > > > >> > >> can use filename template syntax in the _TEMPLATE
value,
> > i.e.
> > > > > > >> > >> {valid?fmt=%m%d}. The other variables in the
climo_mean
> > > > > dictionary
> > > > > > >> are
> > > > > > >> > >> actually old variables that have been replaced
with
> > > > day_interval
> > > > > > and
> > > > > > >> > >> hour_interval, but the values you use are the old
> defaults,
> > > so
> > > > > you
> > > > > > >> > >> shouldn't need to set them.*
> > > > > > >> > >>
> > > > > > >> > >> climo_stdev = climo_mean;
> > > > > > >> > >> climo_stdev = {
> > > > > > >> > >> file_name = "${CLIM_STDV}";
> > > > > > >> > >> }
> > > > > > >> > >>
> > > > > > >> > >> *Similarly to CLIM_MEAN, you can use
> > > > > > >> > >> ENSEMBLE_STAT_CLIMO_STDEV_INPUT_[DIR/TEMPLATE] to
set
> this
> > > file
> > > > > > >> name.*
> > > > > > >> > >>
> > > > > > >> > >> climo_cdf = {
> > > > > > >> > >> cdf_bins = 11;
> > > > > > >> > >> center_bins = TRUE;
> > > > > > >> > >> write_bins = TRUE;
> > > > > > >> > >> }
> > > > > > >> > >> *The value for write_bins is the default, but the
values
> > for
> > > > > > cdf_bins
> > > > > > >> > and
> > > > > > >> > >> center_bins do not. To set these, follow the above
> > > instructions
> > > > > for
> > > > > > >> > >> ens_ssvar_bin_size to override them and/or make
them
> > > > configurable
> > > > > > >> > through
> > > > > > >> > >> METplus. I will also add these variables to the
list of
> MET
> > > > > configs
> > > > > > >> that
> > > > > > >> > >> users want to be able to easily configure through
METplus
> > > > > configs.*
> > > > > > >> > >>
> > > > > > >> > >> Please let me know if you run into any issues
setting any
> > of
> > > > that
> > > > > > up.
> > > > > > >> > >> Also,
> > > > > > >> > >> if there are any other MET config variables that
you want
> > to
> > > > see
> > > > > > >> > supported
> > > > > > >> > >> in METplus, let me know and I will make sure they
get
> > > included
> > > > > when
> > > > > > >> we
> > > > > > >> > >> have
> > > > > > >> > >> a chance to refactor those wrappers. It is
possible to
> add
> > > > > support
> > > > > > >> for
> > > > > > >> > MET
> > > > > > >> > >> configs using the above instructions, but it is
always
> > easier
> > > > and
> > > > > > >> less
> > > > > > >> > >> error-prone to have them configurable directly
through a
> > > > variable
> > > > > > in
> > > > > > >> the
> > > > > > >> > >> METplus config.
> > > > > > >> > >>
> > > > > > >> > >> Thanks,
> > > > > > >> > >> George
> > > > > > >> > >>
> > > > > > >> > >> On Tue, Jan 5, 2021 at 7:14 AM
Binbin.Zhou at noaa.gov via
> > RT <
> > > > > > >> > >> met_help at ucar.edu> wrote:
> > > > > > >> > >>
> > > > > > >> > >> >
> > > > > > >> > >> > Tue Jan 05 07:14:54 2021: Request 98116 was
acted upon.
> > > > > > >> > >> > Transaction: Ticket created by
Binbin.Zhou at noaa.gov
> > > > > > >> > >> > Queue: met_help
> > > > > > >> > >> > Subject: CDP threshold setting in
EnsembleStat
> conf
> > > > > > >> > >> > Owner: Nobody
> > > > > > >> > >> > Requestors: Binbin.Zhou at noaa.gov
> > > > > > >> > >> > Status: new
> > > > > > >> > >> > Ticket <URL:
> > > > > > >> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
> > > > > > >> > >
> > > > > > >> > >> >
> > > > > > >> > >> >
> > > > > > >> > >> > George,
> > > > > > >> > >> >
> > > > > > >> > >> > Happy New Year!
> > > > > > >> > >> >
> > > > > > >> > >> > I am working on transition of our MET-based
global
> > > > ensemble
> > > > > > >> > >> verification
> > > > > > >> > >> > to METplus based package. In this package
climatology
> > bins
> > > > (10
> > > > > > >> bins)
> > > > > > >> > are
> > > > > > >> > >> > used.
> > > > > > >> > >> > In current ensemble stat config file, the
relevant
> > entries
> > > > iare
> > > > > > >> > defined
> > > > > > >> > >> > like following
> > > > > > >> > >> >
> > > > > > >> > >> > ens = {
> > > > > > >> > >> > ens_thresh = 1.0;
> > > > > > >> > >> > vld_thresh = 1.0;
> > > > > > >> > >> >
> > > > > > >> > >> > field = [
> > > > > > >> > >> >
> > > > > > >> > >> > {
> > > > > > >> > >> > name = "HGT";
> > > > > > >> > >> > level = "P500";
> > > > > > >> > >> > obs_thresh = [ <=CDP10,
>CDP10&&<=CDP20,
> > > > > > >CDP20&&<=CDP30,
> > > > > > >> > >> > >CDP30&&<=CDP40, >CDP40&&<=CDP50,
>CDP50&&<=CDP60,
> > > > > > >CDP60&&<=CDP70,
> > > > > > >> > >> > >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];
> > > > > > >> > >> > }
> > > > > > >> > >> > ]
> > > > > > >> > >> > }
> > > > > > >> > >> > fcst = ens;
> > > > > > >> > >> > obs = fcst;
> > > > > > >> > >> > ens_ssvar_bin_size = 1000000;
> > > > > > >> > >> > ens_phist_bin_size = 0.05;
> > > > > > >> > >> > climo_mean = fcst;
> > > > > > >> > >> > climo_mean = {
> > > > > > >> > >> > file_name = "${CLIM_MEAN}";
> > > > > > >> > >> > time_interp_method = DW_MEAN;
> > > > > > >> > >> > match_day = TRUE;
> > > > > > >> > >> > time_step = 21600;
> > > > > > >> > >> > }
> > > > > > >> > >> >
> > > > > > >> > >> > climo_stdev = climo_mean;
> > > > > > >> > >> > climo_stdev = {
> > > > > > >> > >> > file_name = "${CLIM_STDV}";
> > > > > > >> > >> > }
> > > > > > >> > >> >
> > > > > > >> > >> > climo_cdf = {
> > > > > > >> > >> > cdf_bins = 11;
> > > > > > >> > >> > center_bins = TRUE;
> > > > > > >> > >> > write_bins = TRUE;
> > > > > > >> > >> > }
> > > > > > >> > >> >
> > > > > > >> > >> > I can not find the correspondent settings in its
conf
> > file
> > > > from
> > > > > > >> > METplus
> > > > > > >> > >> > online doc.
> > > > > > >> > >> > Can you help me look at this?
> > > > > > >> > >> >
> > > > > > >> > >> > Thanks!
> > > > > > >> > >> >
> > > > > > >> > >> > Binbin
> > > > > > >> > >> >
> > > > > > >> > >> > --
> > > > > > >> > >> >
> > > > > > >> > >> > Binbin Zhou
> > > > > > >> > >> >
> > > > > > >> > >> > IMSG at NOAA/NWS/NCEP/EMC
> > > > > > >> > >> >
> > > > > > >> > >> > 5830 University Research Ct.
> > > > > > >> > >> >
> > > > > > >> > >> > College Park, MD 20740
> > > > > > >> > >> >
> > > > > > >> > >> > Binbin.Zhou at noaa.gov
> > > > > > >> > >> >
> > > > > > >> > >> > 301-683-3683
> > > > > > >> > >> >
> > > > > > >> > >> >
> > > > > > >> > >>
> > > > > > >> > >> --
> > > > > > >> > >> George McCabe - Software Engineer III
> > > > > > >> > >> National Center for Atmospheric Research
> > > > > > >> > >> Research Applications Laboratory
> > > > > > >> > >> 303-497-2768
> > > > > > >> > >> ---
> > > > > > >> > >> My working day may not be your working day. Please
do not
> > > feel
> > > > > > >> obliged
> > > > > > >> > to
> > > > > > >> > >> reply to this email outside of your normal working
hours.
> > > > > > >> > >>
> > > > > > >> > >>
> > > > > > >> > >
> > > > > > >> > > --
> > > > > > >> > >
> > > > > > >> > > Binbin Zhou
> > > > > > >> > >
> > > > > > >> > > IMSG at NOAA/NWS/NCEP/EMC
> > > > > > >> > >
> > > > > > >> > > 5830 University Research Ct.
> > > > > > >> > >
> > > > > > >> > > College Park, MD 20740
> > > > > > >> > >
> > > > > > >> > > Binbin.Zhou at noaa.gov
> > > > > > >> > >
> > > > > > >> > > 301-683-3683
> > > > > > >> > >
> > > > > > >> >
> > > > > > >> >
> > > > > > >> > --
> > > > > > >> >
> > > > > > >> > Binbin Zhou
> > > > > > >> >
> > > > > > >> > IMSG at NOAA/NWS/NCEP/EMC
> > > > > > >> >
> > > > > > >> > 5830 University Research Ct.
> > > > > > >> >
> > > > > > >> > College Park, MD 20740
> > > > > > >> >
> > > > > > >> > Binbin.Zhou at noaa.gov
> > > > > > >> >
> > > > > > >> > 301-683-3683
> > > > > > >> >
> > > > > > >> >
> > > > > > >>
> > > > > > >> --
> > > > > > >> George McCabe - Software Engineer III
> > > > > > >> National Center for Atmospheric Research
> > > > > > >> Research Applications Laboratory
> > > > > > >> 303-497-2768
> > > > > > >> ---
> > > > > > >> My working day may not be your working day. Please do
not feel
> > > > obliged
> > > > > > to
> > > > > > >> reply to this email outside of your normal working
hours.
> > > > > > >>
> > > > > > >>
> > > > > > >
> > > > > > > --
> > > > > > >
> > > > > > > Binbin Zhou
> > > > > > >
> > > > > > > IMSG at NOAA/NWS/NCEP/EMC
> > > > > > >
> > > > > > > 5830 University Research Ct.
> > > > > > >
> > > > > > > College Park, MD 20740
> > > > > > >
> > > > > > > Binbin.Zhou at noaa.gov
> > > > > > >
> > > > > > > 301-683-3683
> > > > > > >
> > > > > >
> > > > > >
> > > > > > --
> > > > > >
> > > > > > Binbin Zhou
> > > > > >
> > > > > > IMSG at NOAA/NWS/NCEP/EMC
> > > > > >
> > > > > > 5830 University Research Ct.
> > > > > >
> > > > > > College Park, MD 20740
> > > > > >
> > > > > > Binbin.Zhou at noaa.gov
> > > > > >
> > > > > > 301-683-3683
> > > > > >
> > > > > >
> > > > >
> > > > > --
> > > > > George McCabe - Software Engineer III
> > > > > National Center for Atmospheric Research
> > > > > Research Applications Laboratory
> > > > > 303-497-2768
> > > > > ---
> > > > > My working day may not be your working day. Please do not
feel
> > obliged
> > > to
> > > > > reply to this email outside of your normal working hours.
> > > > >
> > > > >
> > > >
> > > > --
> > > >
> > > > Binbin Zhou
> > > >
> > > > IMSG at NOAA/NWS/NCEP/EMC
> > > >
> > > > 5830 University Research Ct.
> > > >
> > > > College Park, MD 20740
> > > >
> > > > Binbin.Zhou at noaa.gov
> > > >
> > > > 301-683-3683
> > > >
> > > >
> > >
> > > --
> > > George McCabe - Software Engineer III
> > > National Center for Atmospheric Research
> > > Research Applications Laboratory
> > > 303-497-2768
> > > ---
> > > My working day may not be your working day. Please do not feel
obliged
> to
> > > reply to this email outside of your normal working hours.
> > >
> > >
> >
> > --
> >
> > Binbin Zhou
> >
> > IMSG at NOAA/NWS/NCEP/EMC
> >
> > 5830 University Research Ct.
> >
> > College Park, MD 20740
> >
> > Binbin.Zhou at noaa.gov
> >
> > 301-683-3683
> >
> >
>
> --
> Julie Prestopnik (she/her)
> Software Engineer
> National Center for Atmospheric Research
> Research Applications Laboratory
> Email: jpresto at ucar.edu
>
> My working day may not be your working day. Please do not feel
obliged to
> reply to this email outside of your normal working hours.
>
>
--
Binbin Zhou
IMSG at NOAA/NWS/NCEP/EMC
5830 University Research Ct.
College Park, MD 20740
Binbin.Zhou at noaa.gov
301-683-3683
------------------------------------------------
Subject: CDP threshold setting in EnsembleStat conf
From: Binbin.Zhou at noaa.gov
Time: Wed Jan 06 09:38:45 2021
The EnsembleStat config file for the successful run outside of METplus
is
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_met_global_ens1p0.v1.0.0/parm/verf_g2g_ens_stat_config_bin11
on WCOSS
Binbin
On Wed, Jan 6, 2021 at 11:34 AM Binbin Zhou - NOAA Affiliate <
binbin.zhou at noaa.gov> wrote:
> Julie,
>
> The output directory on WCOSS is
>
>
/gpfs/dell1/ptmp/Binbin.Zhou/g2g/RFC2/tmpnwprd/verf_g2g_gefs_00_dev.161076/metplus3.out
>
> My METplus package on WCOSS is
>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_g2g.v4.0.0
>
> For GEFS, the EnsembleGrid config file is
>
>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_g2g.v4.0.0/parm/app_conf/grid2grid/met_config/EnsembleStatConfig_gefs_bin11
> Its conf file
> is
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_g2g.v4.0.0/parm/app_conf/grid2grid/gefs_conf/gefs_bin11.conf
>
> The running process is little bit complex since this is a transition
to
> future operational package that uses
> mpi parallel: the script is
>
>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_g2g.v4.0.0/ush/verf_g2g_metplus_run_gefs_mpi.sh
>
> Binbin
>
>
>
>
> On Wed, Jan 6, 2021 at 11:00 AM Julie Prestopnik via RT
<met_help at ucar.edu>
> wrote:
>
>> Hi Binbin.
>>
>> This is Julie. I haven't been following this entire thread, but I
am on
>> WCOSS right now. If you send a path to a file, I can pull it and
put it
>> on
>> our ftp server for George.
>>
>> Julie
>>
>> On Wed, Jan 6, 2021 at 8:57 AM Binbin.Zhou at noaa.gov via RT <
>> met_help at ucar.edu> wrote:
>>
>> >
>> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116 >
>> >
>> > George,
>> >
>> > Can you access WCOSS or access HERA?
>> > Otherwise I will email attached to you
>> >
>> > Binbin
>> >
>> >
>> >
>> > On Wed, Jan 6, 2021 at 10:46 AM George McCabe via RT
<met_help at ucar.edu
>> >
>> > wrote:
>> >
>> > > Hi Binbin,
>> > >
>> > > Could you send me a log file for a run with LOG_LEVEL=DEBUG (in
>> METplus
>> > > config) so I can see how the environment variable ENS_FIELD is
set?
>> The
>> > > values of ENS_VAR<n>_* are formatted and set in this
environment
>> variable
>> > > which is passed into the MET config. You can compare that value
with
>> what
>> > > you used in your successful run outside of the METplus wrapper
to
>> > determine
>> > > what is different.
>> > >
>> > > Thanks,
>> > > George
>> > >
>> > > On Wed, Jan 6, 2021 at 7:11 AM Binbin.Zhou at noaa.gov via RT <
>> > > met_help at ucar.edu> wrote:
>> > >
>> > > >
>> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
>
>> > > >
>> > > > George,
>> > > >
>> > > > I got a new error in execution although some output files
(nc
>> file)
>> > are
>> > > > created but stat files not.
>> > > > The error message is
>> > > >
>> > > > ERROR :
>> > > > ERROR : Simple_Node::check(double, double, double) const ->
>> > > climatological
>> > > > distribution percentile threshold "<=CDP10" requested with
invalid
>> mean
>> > > > (-9999) or standard deviation (-9999).
>> > > > ERROR :
>> > > >
>> > > > Such an error was ever investigated by John H before (year
ago):
>> When I
>> > > > directly ran ensemble_stat for global ensemble (not METplus-
based,
>> > > > but hard code of all settings in EnsembleStat config file):
If hard
>> > code
>> > > > fcst field in EnsembleStat config file like this
>> > > >
>> > > > name = "HGT";
>> > > > level = "P500";
>> > > > cat_thresh = [ <=CDP10, >CDP10&&<=CDP20,
>CDP20&&<=CDP30,
>> > > > >CDP30&&<=CDP40, >CDP40&&<=CDP50, >CDP50&&<=CDP60,
>CDP60&&<=CDP70,
>> > > > >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];
>> > > >
>> > > > Run ensemble_stat will have such error: ERROR :
>> > > > Simple_Node::check(double, double, double) const ->
climatological
>> > > > distribution percentile threshold "<=CDP10" requested with
invalid
>> mean
>> > > > (-9999) or standard deviation (-9999).
>> > > >
>> > > > John H. suggested me change "cat_thresh = " to "obs_thresh =
",
>> then
>> > > the
>> > > > error was solved.
>> > > >
>> > > > In current METplus version, following your suggestion as
>> > > >
>> > > > ENS_VAR1_OPTIONS = obs_thresh = [ <=CDP10, >CDP10&&<=CDP20,
>> > > > >CDP20&&<=CDP30, >CDP30&&<=CDP40, >CDP40&&<=CDP50,
>CDP50&&<=CDP60,
>> > > > >CDP60&&<=CDP70, >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];
>> > > >
>> > > > the same error appears again. So I am not for sure if the
>> > "obs_thresh"
>> > > > setting is correctly passed.
>> > > >
>> > > > Binbin
>> > > >
>> > > >
>> > > >
>> > > >
>> > > > On Tue, Jan 5, 2021 at 5:19 PM George McCabe via RT <
>> met_help at ucar.edu
>> > >
>> > > > wrote:
>> > > >
>> > > > > Hi Binbin,
>> > > > >
>> > > > > Your solution should work for now. It looks like although
the
>> METplus
>> > > > > variable does get read properly, the environment variable
is not
>> > > actually
>> > > > > set by the EnsembleStat wrapper. I can make a note to add
that for
>> > > 4.0.0,
>> > > > > as it is an easy fix.
>> > > > >
>> > > > > - George
>> > > > >
>> > > > > On Tue, Jan 5, 2021 at 2:53 PM Binbin.Zhou at noaa.gov via RT
<
>> > > > > met_help at ucar.edu> wrote:
>> > > > >
>> > > > > > George,
>> > > > > >
>> > > > > > I have a temporal solution:
>> > > > > > set ploy in EnembleStat config as
>> > > > > > poly = [ "${MASKPATH}/lat_NHM.nc",
>> > > > > > "${MASKPATH}/lat_NHM.nc",
>> > > > > > "${MASKPATH}/lat_TRP.nc" ];
>> > > > > >
>> > > > > > then set MASKPATH in user_env_vars part in the conf file
>> > > > > > This MASKPAH then can be passed to EnsembleStat's poly [
] entry
>> > > > > >
>> > > > > > Binbin
>> > > > > >
>> > > > > > On Tue, Jan 5, 2021 at 4:25 PM Binbin Zhou - NOAA
Affiliate <
>> > > > > > binbin.zhou at noaa.gov> wrote:
>> > > > > >
>> > > > > > > George,
>> > > > > > >
>> > > > > > > Still not working, error says
>> > > > > > > ERROR : replace_env() -> unable to get value for
environment
>> > > > variable
>> > > > > > > "VERIF_MASK"
>> > > > > > >
>> > > > > > > Binbin
>> > > > > > >
>> > > > > > >
>> > > > > > >
>> > > > > > > On Tue, Jan 5, 2021 at 3:50 PM George McCabe via RT <
>> > > > met_help at ucar.edu
>> > > > > >
>> > > > > > > wrote:
>> > > > > > >
>> > > > > > >> Hi Binbin,
>> > > > > > >>
>> > > > > > >> You should be able to set it in the METplus config the
same
>> way
>> > it
>> > > > is
>> > > > > > done
>> > > > > > >> for GridStat -- no quotes with commas between each
item. The
>> > > wrapper
>> > > > > > >> should
>> > > > > > >> format it properly.
>> > > > > > >>
>> > > > > > >> Here is an example from an existing use case:
>> > > > > > >>
>> > > > > > >> GRID_STAT_VERIFICATION_MASK_TEMPLATE =
>> > > > > > >>
>> > >
{INPUT_BASE}/model_applications/precipitation/mask/CONUS_HRRRTLE.nc,
>> > > > > > >>
>> > >
{INPUT_BASE}/model_applications/precipitation/mask/EAST_HRRRTLE.nc,
>> > > > > > >>
>> >
{INPUT_BASE}/model_applications/precipitation/mask/WEST_HRRRTLE.nc
>> > > > > > >>
>> > > > > > >> You should be able to set them the same way using
>> > > > > > >> ENSEMBLE_STAT_VERIFICATION_MASK_TEMPLATE. Let me know
if that
>> > > > doesn't
>> > > > > > >> work.
>> > > > > > >>
>> > > > > > >> - George
>> > > > > > >>
>> > > > > > >> On Tue, Jan 5, 2021 at 1:45 PM Binbin.Zhou at noaa.gov
via RT <
>> > > > > > >> met_help at ucar.edu> wrote:
>> > > > > > >>
>> > > > > > >> >
>> > > > > > >> > <URL:
>> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
>> > >
>> > > > > > >> >
>> > > > > > >> > George,
>> > > > > > >> >
>> > > > > > >> > I got another issue for verification mask setting.
>> > > > > > >> >
>> > > > > > >> > I am using $VERIF_MASK in EnsembleStat config f/ile
>> > > > > > >> > mask = {
>> > > > > > >> > grid = [];
>> > > > > > >> > poly = [${VERIF_MASK}];
>> > > > > > >> > sid = [];
>> > > > > > >> > }
>> > > > > > >> >
>> > > > > > >> > And using GRID_STAT_VERIFICATION_MASK_TEMPLATE to
define
>> > > several
>> > > > > > >> polygon
>> > > > > > >> > nc mask files
>> > > > > > >> > But it seems not working. But it works for Gridstat
config
>> in
>> > > > suich
>> > > > > > >> > setting.
>> > > > > > >> > I can not find ENSEMBLE_STAT_
VERIFICATION_MASK_TEMPLATE in
>> > the
>> > > > > > METplus
>> > > > > > >> doc
>> > > > > > >> >
>> > > > > > >> > So I define VERIF_MASK in [user_env_vars] part.
>> > > > > > >> > It values can not be passed to ploy =
[${VERIF_MASK}] in
>> the
>> > > > > > >> EnsembleStat
>> > > > > > >> > conf if more than one nc files included.
>> > > > > > >> > For example
>> > > > > > >> > VERIF_MASK=" '/part/p1.cn', '/path/p2.nc' "
>> > > > > > >> > the error says poly = [/path/p1,]
>> > > > > > >> > It seems double quote or single quote can not be
passed to
>> > > > > VERIF_MASK
>> > > > > > in
>> > > > > > >> > the EnsembleStat config.
>> > > > > > >> > I tried use back slash \ to before quote, but still
not
>> > working
>> > > > > > >> >
>> > > > > > >> > Binbin
>> > > > > > >> >
>> > > > > > >> >
>> > > > > > >> > On Tue, Jan 5, 2021 at 10:33 AM Binbin Zhou - NOAA
>> Affiliate <
>> > > > > > >> > binbin.zhou at noaa.gov> wrote:
>> > > > > > >> >
>> > > > > > >> > > George,
>> > > > > > >> > >
>> > > > > > >> > > Thanks for your quick response! I'll test this
>> settings
>> > and
>> > > > let
>> > > > > > >> > > you know the results.
>> > > > > > >> > >
>> > > > > > >> > > Binbin
>> > > > > > >> > >
>> > > > > > >> > > On Tue, Jan 5, 2021 at 10:17 AM George McCabe via
RT <
>> > > > > > >> met_help at ucar.edu>
>> > > > > > >> > > wrote:
>> > > > > > >> > >
>> > > > > > >> > >> Hi Binbin,
>> > > > > > >> > >>
>> > > > > > >> > >> Happy New Year to you too!
>> > > > > > >> > >>
>> > > > > > >> > >> I will comment on each configuration variable and
how to
>> > set
>> > > it
>> > > > > in
>> > > > > > a
>> > > > > > >> > >> METplus config inline:
>> > > > > > >> > >>
>> > > > > > >> > >> ens = {
>> > > > > > >> > >> ens_thresh = 1.0;
>> > > > > > >> > >>
>> > > > > > >> > >>
>> > > > > > >> > >> *This is controlled by the
ENSEMBLE_STAT_ENS_THRESH
>> > variable.
>> > > > The
>> > > > > > >> > default
>> > > > > > >> > >> value is 1.0, so you don't need to include it in
your
>> > config
>> > > > > file,
>> > > > > > >> but
>> > > > > > >> > you
>> > > > > > >> > >> can if you may adjust this value at some point.*
>> > > > > > >> > >>
>> > > > > > >> > >> vld_thresh = 1.0;
>> > > > > > >> > >>
>> > > > > > >> > >> *This value is set to 1.0 by default so we don't
need to
>> > > worry
>> > > > > > about
>> > > > > > >> it
>> > > > > > >> > >> right now.*
>> > > > > > >> > >>
>> > > > > > >> > >> field = [
>> > > > > > >> > >>
>> > > > > > >> > >> {
>> > > > > > >> > >> name = "HGT";
>> > > > > > >> > >> level = "P500";
>> > > > > > >> > >> obs_thresh = [ <=CDP10, >CDP10&&<=CDP20,
>> > > > > >CDP20&&<=CDP30,
>> > > > > > >> > >> >CDP30&&<=CDP40, >CDP40&&<=CDP50,
>CDP50&&<=CDP60,
>> > > > > >CDP60&&<=CDP70,
>> > > > > > >> > >> >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];
>> > > > > > >> > >> }
>> > > > > > >> > >> ]
>> > > > > > >> > >> }
>> > > > > > >> > >> fcst = ens;
>> > > > > > >> > >> obs = fcst;
>> > > > > > >> > >>
>> > > > > > >> > >> *1) The field info for ens is set in the
>> > > > > > >> > >> ENS_VAR<n>_[NAME/LEVEL/THRESH/OPTIONS] variables.
The
>> fcst
>> > > and
>> > > > > obs
>> > > > > > >> field
>> > > > > > >> > >> info are set in the corresponding FCST_VAR<n>_*
and
>> > > > OBS_VAR<n>_*
>> > > > > > >> > variables
>> > > > > > >> > >> respectively, or you can use BOTH_VAR<n>_* if the
FCST
>> and
>> > > OBS
>> > > > > > values
>> > > > > > >> > are
>> > > > > > >> > >> the same.*
>> > > > > > >> > >>
>> > > > > > >> > >> *If ENS_VAR<n>_* variables are not explicitly
set, then
>> it
>> > > will
>> > > > > use
>> > > > > > >> the
>> > > > > > >> > >> values from FCST_VAR<n>_*.*
>> > > > > > >> > >> *Since the fcst, obs, and ens are all the same
you could
>> > just
>> > > > use
>> > > > > > >> > >> BOTH_VAR<n>_* variables to control all 3,
although keep
>> in
>> > > mind
>> > > > > > that
>> > > > > > >> if
>> > > > > > >> > >> you
>> > > > > > >> > >> need to change one of them for any reason, it
will be
>> more
>> > > > > > difficult
>> > > > > > >> to
>> > > > > > >> > do
>> > > > > > >> > >> this. If you know that they will always be the
same
>> values,
>> > > > then
>> > > > > I
>> > > > > > >> > >> recommend using BOTH_, but if you know they may
change
>> or
>> > are
>> > > > > > >> unsure, I
>> > > > > > >> > >> would recommend setting them by referencing the
other
>> > > > variables,
>> > > > > > >> i.e.*
>> > > > > > >> > >>
>> > > > > > >> > >> *FCST_VAR1_NAME = HGT*
>> > > > > > >> > >> *FCST_VAR1_LEVELS = P500 *
>> > > > > > >> > >> *OBS_VAR1_NAME = {FCST_VAR1_NAME}*
>> > > > > > >> > >> *OBS_VAR1_LEVELS = {FCST_VAR1_LEVELS}*
>> > > > > > >> > >>
>> > > > > > >> > >> *2) The [FCST/OBS/ENS]_VAR<n>_THRESH variables
set the
>> > > > cat_thresh
>> > > > > > >> values
>> > > > > > >> > >> in
>> > > > > > >> > >> the field info. A variable specific to obs_thresh
is not
>> > > > > currently
>> > > > > > >> > >> supported, however you can set these values by
using the
>> > > > > > >> > ENS_VAR1_OPTIONS
>> > > > > > >> > >> variable, i.e.*
>> > > > > > >> > >>
>> > > > > > >> > >> *ENS_VAR1_OPTIONS = obs_thresh = [ <=CDP10,
>> > >CDP10&&<=CDP20,
>> > > > > > >> > >> >CDP20&&<=CDP30, >CDP30&&<=CDP40,
>CDP40&&<=CDP50,
>> > > > > >CDP50&&<=CDP60,
>> > > > > > >> > >> >CDP60&&<=CDP70, >CDP70&&<=CDP80,
>CDP80&&<=CDP90,
>> >CDP90
>> > ];*
>> > > > > > >> > >>
>> > > > > > >> > >>
>> > > > > > >> > >> *Remember to include the semicolon at the end! *
>> > > > > > >> > >>
>> > > > > > >> > >> ens_ssvar_bin_size = 1000000;
>> > > > > > >> > >> *1) This variable is different from the default
and not
>> > > > currently
>> > > > > > >> > >> supported
>> > > > > > >> > >> with a METplus config variable. I will add this
to the
>> list
>> > > of
>> > > > > > >> variables
>> > > > > > >> > >> in
>> > > > > > >> > >> MET config files that we want to support.
However, in
>> the
>> > > > > meantime
>> > > > > > >> you
>> > > > > > >> > can
>> > > > > > >> > >> copy the default wrapped MET config file and
modify it
>> to
>> > fit
>> > > > > your
>> > > > > > >> > needs.
>> > > > > > >> > >> To do this, you will need to:*
>> > > > > > >> > >>
>> > > > > > >> > >> * a) Copy
>> > METplus/parm/met_config/EnsembleStatConfig_wrapped
>> > > > to
>> > > > > > the
>> > > > > > >> > >> directory that contains your METplus config file
for
>> this
>> > use
>> > > > > case.
>> > > > > > >> > Rename
>> > > > > > >> > >> it by replacing "wrapped" with a short
description that
>> > > > pertains
>> > > > > to
>> > > > > > >> your
>> > > > > > >> > >> use case.*
>> > > > > > >> > >>
>> > > > > > >> > >> * b) In your METplus config file, change the
value of
>> > > > > > >> > >> ENSEMBLE_STAT_CONFIG_FILE to point to the path of
this
>> new
>> > > > config
>> > > > > > >> file.*
>> > > > > > >> > >>
>> > > > > > >> > >> * c) If you know the value you want to use for
this
>> > variable
>> > > > > will
>> > > > > > >> > always
>> > > > > > >> > >> be 1000000, then simply set the variable to that
value.
>> If
>> > > you
>> > > > > > think
>> > > > > > >> you
>> > > > > > >> > >> may want to change the value, then you can
utilize the
>> > > > > > >> [user_env_vars]
>> > > > > > >> > >> functionality. See:
>> > > > > > >> > >>
>> > > > > > >> > >>
>> > > > > > >> >
>> > > > > > >>
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>>
https://dtcenter.github.io/METplus/latest/Users_Guide/systemconfiguration.html#user-
defined-config
>> > > > > > >> > >> <
>> > > > > > >> > >>
>> > > > > > >> >
>> > > > > > >>
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>>
https://dtcenter.github.io/METplus/latest/Users_Guide/systemconfiguration.html#user-
defined-config
>> > > > > > >> > >> >*
>> > > > > > >> > >> *In this case, you would add the following to
your
>> METplus
>> > > > > config:*
>> > > > > > >> > >>
>> > > > > > >> > >> *[user_env_vars]*
>> > > > > > >> > >> *ENS_SSVAR_BIN_SIZE = 1000000*
>> > > > > > >> > >>
>> > > > > > >> > >> *Then change the line in your EnsembleStat config
file
>> that
>> > > you
>> > > > > > >> copied
>> > > > > > >> > >> to:*
>> > > > > > >> > >>
>> > > > > > >> > >> * ens_ssvar_bin_size = ${ENS_SSVAR_BIN_SIZE}; *
>> > > > > > >> > >>
>> > > > > > >> > >> ens_phist_bin_size = 0.05;
>> > > > > > >> > >> *This variable uses the default value, so you
don't
>> need to
>> > > do
>> > > > > > >> anything
>> > > > > > >> > >> here. If you need to make it configurable or
change the
>> > > value,
>> > > > > then
>> > > > > > >> > follow
>> > > > > > >> > >> the instructions for setting ens_ssvar_bin_size.*
>> > > > > > >> > >>
>> > > > > > >> > >> climo_mean = fcst;
>> > > > > > >> > >> climo_mean = {
>> > > > > > >> > >> file_name = "${CLIM_MEAN}";
>> > > > > > >> > >> time_interp_method = DW_MEAN;
>> > > > > > >> > >> match_day = TRUE;
>> > > > > > >> > >> time_step = 21600;
>> > > > > > >> > >> }
>> > > > > > >> > >>
>> > > > > > >> > >>
>> > > > > > >> > >> *Instead of using CLIM_MEAN, you can set
>> > > > > > >> > >> ENSEMBLE_STAT_CLIMO_MEAN_INPUT_[DIR/TEMPLATE] in
the
>> > METplus
>> > > > > > config.
>> > > > > > >> You
>> > > > > > >> > >> can use filename template syntax in the _TEMPLATE
value,
>> > i.e.
>> > > > > > >> > >> {valid?fmt=%m%d}. The other variables in the
climo_mean
>> > > > > dictionary
>> > > > > > >> are
>> > > > > > >> > >> actually old variables that have been replaced
with
>> > > > day_interval
>> > > > > > and
>> > > > > > >> > >> hour_interval, but the values you use are the old
>> defaults,
>> > > so
>> > > > > you
>> > > > > > >> > >> shouldn't need to set them.*
>> > > > > > >> > >>
>> > > > > > >> > >> climo_stdev = climo_mean;
>> > > > > > >> > >> climo_stdev = {
>> > > > > > >> > >> file_name = "${CLIM_STDV}";
>> > > > > > >> > >> }
>> > > > > > >> > >>
>> > > > > > >> > >> *Similarly to CLIM_MEAN, you can use
>> > > > > > >> > >> ENSEMBLE_STAT_CLIMO_STDEV_INPUT_[DIR/TEMPLATE] to
set
>> this
>> > > file
>> > > > > > >> name.*
>> > > > > > >> > >>
>> > > > > > >> > >> climo_cdf = {
>> > > > > > >> > >> cdf_bins = 11;
>> > > > > > >> > >> center_bins = TRUE;
>> > > > > > >> > >> write_bins = TRUE;
>> > > > > > >> > >> }
>> > > > > > >> > >> *The value for write_bins is the default, but the
values
>> > for
>> > > > > > cdf_bins
>> > > > > > >> > and
>> > > > > > >> > >> center_bins do not. To set these, follow the
above
>> > > instructions
>> > > > > for
>> > > > > > >> > >> ens_ssvar_bin_size to override them and/or make
them
>> > > > configurable
>> > > > > > >> > through
>> > > > > > >> > >> METplus. I will also add these variables to the
list of
>> MET
>> > > > > configs
>> > > > > > >> that
>> > > > > > >> > >> users want to be able to easily configure through
>> METplus
>> > > > > configs.*
>> > > > > > >> > >>
>> > > > > > >> > >> Please let me know if you run into any issues
setting
>> any
>> > of
>> > > > that
>> > > > > > up.
>> > > > > > >> > >> Also,
>> > > > > > >> > >> if there are any other MET config variables that
you
>> want
>> > to
>> > > > see
>> > > > > > >> > supported
>> > > > > > >> > >> in METplus, let me know and I will make sure they
get
>> > > included
>> > > > > when
>> > > > > > >> we
>> > > > > > >> > >> have
>> > > > > > >> > >> a chance to refactor those wrappers. It is
possible to
>> add
>> > > > > support
>> > > > > > >> for
>> > > > > > >> > MET
>> > > > > > >> > >> configs using the above instructions, but it is
always
>> > easier
>> > > > and
>> > > > > > >> less
>> > > > > > >> > >> error-prone to have them configurable directly
through a
>> > > > variable
>> > > > > > in
>> > > > > > >> the
>> > > > > > >> > >> METplus config.
>> > > > > > >> > >>
>> > > > > > >> > >> Thanks,
>> > > > > > >> > >> George
>> > > > > > >> > >>
>> > > > > > >> > >> On Tue, Jan 5, 2021 at 7:14 AM
Binbin.Zhou at noaa.gov via
>> > RT <
>> > > > > > >> > >> met_help at ucar.edu> wrote:
>> > > > > > >> > >>
>> > > > > > >> > >> >
>> > > > > > >> > >> > Tue Jan 05 07:14:54 2021: Request 98116 was
acted
>> upon.
>> > > > > > >> > >> > Transaction: Ticket created by
Binbin.Zhou at noaa.gov
>> > > > > > >> > >> > Queue: met_help
>> > > > > > >> > >> > Subject: CDP threshold setting in
EnsembleStat
>> conf
>> > > > > > >> > >> > Owner: Nobody
>> > > > > > >> > >> > Requestors: Binbin.Zhou at noaa.gov
>> > > > > > >> > >> > Status: new
>> > > > > > >> > >> > Ticket <URL:
>> > > > > > >>
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
>> > > > > > >> > >
>> > > > > > >> > >> >
>> > > > > > >> > >> >
>> > > > > > >> > >> > George,
>> > > > > > >> > >> >
>> > > > > > >> > >> > Happy New Year!
>> > > > > > >> > >> >
>> > > > > > >> > >> > I am working on transition of our MET-based
global
>> > > > ensemble
>> > > > > > >> > >> verification
>> > > > > > >> > >> > to METplus based package. In this package
climatology
>> > bins
>> > > > (10
>> > > > > > >> bins)
>> > > > > > >> > are
>> > > > > > >> > >> > used.
>> > > > > > >> > >> > In current ensemble stat config file, the
relevant
>> > entries
>> > > > iare
>> > > > > > >> > defined
>> > > > > > >> > >> > like following
>> > > > > > >> > >> >
>> > > > > > >> > >> > ens = {
>> > > > > > >> > >> > ens_thresh = 1.0;
>> > > > > > >> > >> > vld_thresh = 1.0;
>> > > > > > >> > >> >
>> > > > > > >> > >> > field = [
>> > > > > > >> > >> >
>> > > > > > >> > >> > {
>> > > > > > >> > >> > name = "HGT";
>> > > > > > >> > >> > level = "P500";
>> > > > > > >> > >> > obs_thresh = [ <=CDP10,
>CDP10&&<=CDP20,
>> > > > > > >CDP20&&<=CDP30,
>> > > > > > >> > >> > >CDP30&&<=CDP40, >CDP40&&<=CDP50,
>CDP50&&<=CDP60,
>> > > > > > >CDP60&&<=CDP70,
>> > > > > > >> > >> > >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];
>> > > > > > >> > >> > }
>> > > > > > >> > >> > ]
>> > > > > > >> > >> > }
>> > > > > > >> > >> > fcst = ens;
>> > > > > > >> > >> > obs = fcst;
>> > > > > > >> > >> > ens_ssvar_bin_size = 1000000;
>> > > > > > >> > >> > ens_phist_bin_size = 0.05;
>> > > > > > >> > >> > climo_mean = fcst;
>> > > > > > >> > >> > climo_mean = {
>> > > > > > >> > >> > file_name = "${CLIM_MEAN}";
>> > > > > > >> > >> > time_interp_method = DW_MEAN;
>> > > > > > >> > >> > match_day = TRUE;
>> > > > > > >> > >> > time_step = 21600;
>> > > > > > >> > >> > }
>> > > > > > >> > >> >
>> > > > > > >> > >> > climo_stdev = climo_mean;
>> > > > > > >> > >> > climo_stdev = {
>> > > > > > >> > >> > file_name = "${CLIM_STDV}";
>> > > > > > >> > >> > }
>> > > > > > >> > >> >
>> > > > > > >> > >> > climo_cdf = {
>> > > > > > >> > >> > cdf_bins = 11;
>> > > > > > >> > >> > center_bins = TRUE;
>> > > > > > >> > >> > write_bins = TRUE;
>> > > > > > >> > >> > }
>> > > > > > >> > >> >
>> > > > > > >> > >> > I can not find the correspondent settings in
its conf
>> > file
>> > > > from
>> > > > > > >> > METplus
>> > > > > > >> > >> > online doc.
>> > > > > > >> > >> > Can you help me look at this?
>> > > > > > >> > >> >
>> > > > > > >> > >> > Thanks!
>> > > > > > >> > >> >
>> > > > > > >> > >> > Binbin
>> > > > > > >> > >> >
>> > > > > > >> > >> > --
>> > > > > > >> > >> >
>> > > > > > >> > >> > Binbin Zhou
>> > > > > > >> > >> >
>> > > > > > >> > >> > IMSG at NOAA/NWS/NCEP/EMC
>> > > > > > >> > >> >
>> > > > > > >> > >> > 5830 University Research Ct.
>> > > > > > >> > >> >
>> > > > > > >> > >> > College Park, MD 20740
>> > > > > > >> > >> >
>> > > > > > >> > >> > Binbin.Zhou at noaa.gov
>> > > > > > >> > >> >
>> > > > > > >> > >> > 301-683-3683
>> > > > > > >> > >> >
>> > > > > > >> > >> >
>> > > > > > >> > >>
>> > > > > > >> > >> --
>> > > > > > >> > >> George McCabe - Software Engineer III
>> > > > > > >> > >> National Center for Atmospheric Research
>> > > > > > >> > >> Research Applications Laboratory
>> > > > > > >> > >> 303-497-2768
>> > > > > > >> > >> ---
>> > > > > > >> > >> My working day may not be your working day.
Please do
>> not
>> > > feel
>> > > > > > >> obliged
>> > > > > > >> > to
>> > > > > > >> > >> reply to this email outside of your normal
working
>> hours.
>> > > > > > >> > >>
>> > > > > > >> > >>
>> > > > > > >> > >
>> > > > > > >> > > --
>> > > > > > >> > >
>> > > > > > >> > > Binbin Zhou
>> > > > > > >> > >
>> > > > > > >> > > IMSG at NOAA/NWS/NCEP/EMC
>> > > > > > >> > >
>> > > > > > >> > > 5830 University Research Ct.
>> > > > > > >> > >
>> > > > > > >> > > College Park, MD 20740
>> > > > > > >> > >
>> > > > > > >> > > Binbin.Zhou at noaa.gov
>> > > > > > >> > >
>> > > > > > >> > > 301-683-3683
>> > > > > > >> > >
>> > > > > > >> >
>> > > > > > >> >
>> > > > > > >> > --
>> > > > > > >> >
>> > > > > > >> > Binbin Zhou
>> > > > > > >> >
>> > > > > > >> > IMSG at NOAA/NWS/NCEP/EMC
>> > > > > > >> >
>> > > > > > >> > 5830 University Research Ct.
>> > > > > > >> >
>> > > > > > >> > College Park, MD 20740
>> > > > > > >> >
>> > > > > > >> > Binbin.Zhou at noaa.gov
>> > > > > > >> >
>> > > > > > >> > 301-683-3683
>> > > > > > >> >
>> > > > > > >> >
>> > > > > > >>
>> > > > > > >> --
>> > > > > > >> George McCabe - Software Engineer III
>> > > > > > >> National Center for Atmospheric Research
>> > > > > > >> Research Applications Laboratory
>> > > > > > >> 303-497-2768
>> > > > > > >> ---
>> > > > > > >> My working day may not be your working day. Please do
not
>> feel
>> > > > obliged
>> > > > > > to
>> > > > > > >> reply to this email outside of your normal working
hours.
>> > > > > > >>
>> > > > > > >>
>> > > > > > >
>> > > > > > > --
>> > > > > > >
>> > > > > > > Binbin Zhou
>> > > > > > >
>> > > > > > > IMSG at NOAA/NWS/NCEP/EMC
>> > > > > > >
>> > > > > > > 5830 University Research Ct.
>> > > > > > >
>> > > > > > > College Park, MD 20740
>> > > > > > >
>> > > > > > > Binbin.Zhou at noaa.gov
>> > > > > > >
>> > > > > > > 301-683-3683
>> > > > > > >
>> > > > > >
>> > > > > >
>> > > > > > --
>> > > > > >
>> > > > > > Binbin Zhou
>> > > > > >
>> > > > > > IMSG at NOAA/NWS/NCEP/EMC
>> > > > > >
>> > > > > > 5830 University Research Ct.
>> > > > > >
>> > > > > > College Park, MD 20740
>> > > > > >
>> > > > > > Binbin.Zhou at noaa.gov
>> > > > > >
>> > > > > > 301-683-3683
>> > > > > >
>> > > > > >
>> > > > >
>> > > > > --
>> > > > > George McCabe - Software Engineer III
>> > > > > National Center for Atmospheric Research
>> > > > > Research Applications Laboratory
>> > > > > 303-497-2768
>> > > > > ---
>> > > > > My working day may not be your working day. Please do not
feel
>> > obliged
>> > > to
>> > > > > reply to this email outside of your normal working hours.
>> > > > >
>> > > > >
>> > > >
>> > > > --
>> > > >
>> > > > Binbin Zhou
>> > > >
>> > > > IMSG at NOAA/NWS/NCEP/EMC
>> > > >
>> > > > 5830 University Research Ct.
>> > > >
>> > > > College Park, MD 20740
>> > > >
>> > > > Binbin.Zhou at noaa.gov
>> > > >
>> > > > 301-683-3683
>> > > >
>> > > >
>> > >
>> > > --
>> > > George McCabe - Software Engineer III
>> > > National Center for Atmospheric Research
>> > > Research Applications Laboratory
>> > > 303-497-2768
>> > > ---
>> > > My working day may not be your working day. Please do not feel
>> obliged to
>> > > reply to this email outside of your normal working hours.
>> > >
>> > >
>> >
>> > --
>> >
>> > Binbin Zhou
>> >
>> > IMSG at NOAA/NWS/NCEP/EMC
>> >
>> > 5830 University Research Ct.
>> >
>> > College Park, MD 20740
>> >
>> > Binbin.Zhou at noaa.gov
>> >
>> > 301-683-3683
>> >
>> >
>>
>> --
>> Julie Prestopnik (she/her)
>> Software Engineer
>> National Center for Atmospheric Research
>> Research Applications Laboratory
>> Email: jpresto at ucar.edu
>>
>> My working day may not be your working day. Please do not feel
obliged to
>> reply to this email outside of your normal working hours.
>>
>>
>
> --
>
> Binbin Zhou
>
> IMSG at NOAA/NWS/NCEP/EMC
>
> 5830 University Research Ct.
>
> College Park, MD 20740
>
> Binbin.Zhou at noaa.gov
>
> 301-683-3683
>
--
Binbin Zhou
IMSG at NOAA/NWS/NCEP/EMC
5830 University Research Ct.
College Park, MD 20740
Binbin.Zhou at noaa.gov
301-683-3683
------------------------------------------------
Subject: CDP threshold setting in EnsembleStat conf
From: Julie Prestopnik
Time: Wed Jan 06 09:50:47 2021
Thanks for all of the info Binbin. I saw that you had copied
everything to
hera for George. I am currently no longer on WCOSS, so I unless
George
lets me know that he needs something from WCOSS, I'll assume he is
able to
get it from hera.
Julie
On Wed, Jan 6, 2021 at 9:39 AM Binbin.Zhou at noaa.gov via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116 >
>
> The EnsembleStat config file for the successful run outside of
METplus is
>
>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_met_global_ens1p0.v1.0.0/parm/verf_g2g_ens_stat_config_bin11
> on WCOSS
>
> Binbin
>
> On Wed, Jan 6, 2021 at 11:34 AM Binbin Zhou - NOAA Affiliate <
> binbin.zhou at noaa.gov> wrote:
>
> > Julie,
> >
> > The output directory on WCOSS is
> >
> >
>
/gpfs/dell1/ptmp/Binbin.Zhou/g2g/RFC2/tmpnwprd/verf_g2g_gefs_00_dev.161076/metplus3.out
> >
> > My METplus package on WCOSS is
> >
>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_g2g.v4.0.0
> >
> > For GEFS, the EnsembleGrid config file is
> >
> >
>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_g2g.v4.0.0/parm/app_conf/grid2grid/met_config/EnsembleStatConfig_gefs_bin11
> > Its conf file
> > is
>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_g2g.v4.0.0/parm/app_conf/grid2grid/gefs_conf/gefs_bin11.conf
> >
> > The running process is little bit complex since this is a
transition to
> > future operational package that uses
> > mpi parallel: the script is
> >
> >
>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_g2g.v4.0.0/ush/verf_g2g_metplus_run_gefs_mpi.sh
> >
> > Binbin
> >
> >
> >
> >
> > On Wed, Jan 6, 2021 at 11:00 AM Julie Prestopnik via RT <
> met_help at ucar.edu>
> > wrote:
> >
> >> Hi Binbin.
> >>
> >> This is Julie. I haven't been following this entire thread, but
I am on
> >> WCOSS right now. If you send a path to a file, I can pull it and
put it
> >> on
> >> our ftp server for George.
> >>
> >> Julie
> >>
> >> On Wed, Jan 6, 2021 at 8:57 AM Binbin.Zhou at noaa.gov via RT <
> >> met_help at ucar.edu> wrote:
> >>
> >> >
> >> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116 >
> >> >
> >> > George,
> >> >
> >> > Can you access WCOSS or access HERA?
> >> > Otherwise I will email attached to you
> >> >
> >> > Binbin
> >> >
> >> >
> >> >
> >> > On Wed, Jan 6, 2021 at 10:46 AM George McCabe via RT <
> met_help at ucar.edu
> >> >
> >> > wrote:
> >> >
> >> > > Hi Binbin,
> >> > >
> >> > > Could you send me a log file for a run with LOG_LEVEL=DEBUG
(in
> >> METplus
> >> > > config) so I can see how the environment variable ENS_FIELD
is set?
> >> The
> >> > > values of ENS_VAR<n>_* are formatted and set in this
environment
> >> variable
> >> > > which is passed into the MET config. You can compare that
value with
> >> what
> >> > > you used in your successful run outside of the METplus
wrapper to
> >> > determine
> >> > > what is different.
> >> > >
> >> > > Thanks,
> >> > > George
> >> > >
> >> > > On Wed, Jan 6, 2021 at 7:11 AM Binbin.Zhou at noaa.gov via RT <
> >> > > met_help at ucar.edu> wrote:
> >> > >
> >> > > >
> >> > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116 >
> >> > > >
> >> > > > George,
> >> > > >
> >> > > > I got a new error in execution although some output files
(nc
> >> file)
> >> > are
> >> > > > created but stat files not.
> >> > > > The error message is
> >> > > >
> >> > > > ERROR :
> >> > > > ERROR : Simple_Node::check(double, double, double) const
->
> >> > > climatological
> >> > > > distribution percentile threshold "<=CDP10" requested with
invalid
> >> mean
> >> > > > (-9999) or standard deviation (-9999).
> >> > > > ERROR :
> >> > > >
> >> > > > Such an error was ever investigated by John H before (year
ago):
> >> When I
> >> > > > directly ran ensemble_stat for global ensemble (not
METplus-based,
> >> > > > but hard code of all settings in EnsembleStat config file):
If
> hard
> >> > code
> >> > > > fcst field in EnsembleStat config file like this
> >> > > >
> >> > > > name = "HGT";
> >> > > > level = "P500";
> >> > > > cat_thresh = [ <=CDP10, >CDP10&&<=CDP20,
>CDP20&&<=CDP30,
> >> > > > >CDP30&&<=CDP40, >CDP40&&<=CDP50, >CDP50&&<=CDP60,
> >CDP60&&<=CDP70,
> >> > > > >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];
> >> > > >
> >> > > > Run ensemble_stat will have such error: ERROR :
> >> > > > Simple_Node::check(double, double, double) const ->
climatological
> >> > > > distribution percentile threshold "<=CDP10" requested with
invalid
> >> mean
> >> > > > (-9999) or standard deviation (-9999).
> >> > > >
> >> > > > John H. suggested me change "cat_thresh = " to "obs_thresh
= ",
> >> then
> >> > > the
> >> > > > error was solved.
> >> > > >
> >> > > > In current METplus version, following your suggestion as
> >> > > >
> >> > > > ENS_VAR1_OPTIONS = obs_thresh = [ <=CDP10, >CDP10&&<=CDP20,
> >> > > > >CDP20&&<=CDP30, >CDP30&&<=CDP40, >CDP40&&<=CDP50,
> >CDP50&&<=CDP60,
> >> > > > >CDP60&&<=CDP70, >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90
];
> >> > > >
> >> > > > the same error appears again. So I am not for sure if the
> >> > "obs_thresh"
> >> > > > setting is correctly passed.
> >> > > >
> >> > > > Binbin
> >> > > >
> >> > > >
> >> > > >
> >> > > >
> >> > > > On Tue, Jan 5, 2021 at 5:19 PM George McCabe via RT <
> >> met_help at ucar.edu
> >> > >
> >> > > > wrote:
> >> > > >
> >> > > > > Hi Binbin,
> >> > > > >
> >> > > > > Your solution should work for now. It looks like although
the
> >> METplus
> >> > > > > variable does get read properly, the environment variable
is not
> >> > > actually
> >> > > > > set by the EnsembleStat wrapper. I can make a note to add
that
> for
> >> > > 4.0.0,
> >> > > > > as it is an easy fix.
> >> > > > >
> >> > > > > - George
> >> > > > >
> >> > > > > On Tue, Jan 5, 2021 at 2:53 PM Binbin.Zhou at noaa.gov via
RT <
> >> > > > > met_help at ucar.edu> wrote:
> >> > > > >
> >> > > > > > George,
> >> > > > > >
> >> > > > > > I have a temporal solution:
> >> > > > > > set ploy in EnembleStat config as
> >> > > > > > poly = [ "${MASKPATH}/lat_NHM.nc",
> >> > > > > > "${MASKPATH}/lat_NHM.nc",
> >> > > > > > "${MASKPATH}/lat_TRP.nc" ];
> >> > > > > >
> >> > > > > > then set MASKPATH in user_env_vars part in the conf
file
> >> > > > > > This MASKPAH then can be passed to EnsembleStat's poly
[ ]
> entry
> >> > > > > >
> >> > > > > > Binbin
> >> > > > > >
> >> > > > > > On Tue, Jan 5, 2021 at 4:25 PM Binbin Zhou - NOAA
Affiliate <
> >> > > > > > binbin.zhou at noaa.gov> wrote:
> >> > > > > >
> >> > > > > > > George,
> >> > > > > > >
> >> > > > > > > Still not working, error says
> >> > > > > > > ERROR : replace_env() -> unable to get value for
> environment
> >> > > > variable
> >> > > > > > > "VERIF_MASK"
> >> > > > > > >
> >> > > > > > > Binbin
> >> > > > > > >
> >> > > > > > >
> >> > > > > > >
> >> > > > > > > On Tue, Jan 5, 2021 at 3:50 PM George McCabe via RT <
> >> > > > met_help at ucar.edu
> >> > > > > >
> >> > > > > > > wrote:
> >> > > > > > >
> >> > > > > > >> Hi Binbin,
> >> > > > > > >>
> >> > > > > > >> You should be able to set it in the METplus config
the same
> >> way
> >> > it
> >> > > > is
> >> > > > > > done
> >> > > > > > >> for GridStat -- no quotes with commas between each
item.
> The
> >> > > wrapper
> >> > > > > > >> should
> >> > > > > > >> format it properly.
> >> > > > > > >>
> >> > > > > > >> Here is an example from an existing use case:
> >> > > > > > >>
> >> > > > > > >> GRID_STAT_VERIFICATION_MASK_TEMPLATE =
> >> > > > > > >>
> >> > >
{INPUT_BASE}/model_applications/precipitation/mask/CONUS_HRRRTLE.nc,
> >> > > > > > >>
> >> > >
{INPUT_BASE}/model_applications/precipitation/mask/EAST_HRRRTLE.nc,
> >> > > > > > >>
> >> >
{INPUT_BASE}/model_applications/precipitation/mask/WEST_HRRRTLE.nc
> >> > > > > > >>
> >> > > > > > >> You should be able to set them the same way using
> >> > > > > > >> ENSEMBLE_STAT_VERIFICATION_MASK_TEMPLATE. Let me
know if
> that
> >> > > > doesn't
> >> > > > > > >> work.
> >> > > > > > >>
> >> > > > > > >> - George
> >> > > > > > >>
> >> > > > > > >> On Tue, Jan 5, 2021 at 1:45 PM Binbin.Zhou at noaa.gov
via
> RT <
> >> > > > > > >> met_help at ucar.edu> wrote:
> >> > > > > > >>
> >> > > > > > >> >
> >> > > > > > >> > <URL:
> >> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
> >> > >
> >> > > > > > >> >
> >> > > > > > >> > George,
> >> > > > > > >> >
> >> > > > > > >> > I got another issue for verification mask
setting.
> >> > > > > > >> >
> >> > > > > > >> > I am using $VERIF_MASK in EnsembleStat config
f/ile
> >> > > > > > >> > mask = {
> >> > > > > > >> > grid = [];
> >> > > > > > >> > poly = [${VERIF_MASK}];
> >> > > > > > >> > sid = [];
> >> > > > > > >> > }
> >> > > > > > >> >
> >> > > > > > >> > And using GRID_STAT_VERIFICATION_MASK_TEMPLATE to
define
> >> > > several
> >> > > > > > >> polygon
> >> > > > > > >> > nc mask files
> >> > > > > > >> > But it seems not working. But it works for
Gridstat
> config
> >> in
> >> > > > suich
> >> > > > > > >> > setting.
> >> > > > > > >> > I can not find ENSEMBLE_STAT_
VERIFICATION_MASK_TEMPLATE
> in
> >> > the
> >> > > > > > METplus
> >> > > > > > >> doc
> >> > > > > > >> >
> >> > > > > > >> > So I define VERIF_MASK in [user_env_vars] part.
> >> > > > > > >> > It values can not be passed to ploy =
[${VERIF_MASK}] in
> >> the
> >> > > > > > >> EnsembleStat
> >> > > > > > >> > conf if more than one nc files included.
> >> > > > > > >> > For example
> >> > > > > > >> > VERIF_MASK=" '/part/p1.cn', '/path/p2.nc' "
> >> > > > > > >> > the error says poly = [/path/p1,]
> >> > > > > > >> > It seems double quote or single quote can not be
passed
> to
> >> > > > > VERIF_MASK
> >> > > > > > in
> >> > > > > > >> > the EnsembleStat config.
> >> > > > > > >> > I tried use back slash \ to before quote, but
still not
> >> > working
> >> > > > > > >> >
> >> > > > > > >> > Binbin
> >> > > > > > >> >
> >> > > > > > >> >
> >> > > > > > >> > On Tue, Jan 5, 2021 at 10:33 AM Binbin Zhou - NOAA
> >> Affiliate <
> >> > > > > > >> > binbin.zhou at noaa.gov> wrote:
> >> > > > > > >> >
> >> > > > > > >> > > George,
> >> > > > > > >> > >
> >> > > > > > >> > > Thanks for your quick response! I'll test
this
> >> settings
> >> > and
> >> > > > let
> >> > > > > > >> > > you know the results.
> >> > > > > > >> > >
> >> > > > > > >> > > Binbin
> >> > > > > > >> > >
> >> > > > > > >> > > On Tue, Jan 5, 2021 at 10:17 AM George McCabe
via RT <
> >> > > > > > >> met_help at ucar.edu>
> >> > > > > > >> > > wrote:
> >> > > > > > >> > >
> >> > > > > > >> > >> Hi Binbin,
> >> > > > > > >> > >>
> >> > > > > > >> > >> Happy New Year to you too!
> >> > > > > > >> > >>
> >> > > > > > >> > >> I will comment on each configuration variable
and how
> to
> >> > set
> >> > > it
> >> > > > > in
> >> > > > > > a
> >> > > > > > >> > >> METplus config inline:
> >> > > > > > >> > >>
> >> > > > > > >> > >> ens = {
> >> > > > > > >> > >> ens_thresh = 1.0;
> >> > > > > > >> > >>
> >> > > > > > >> > >>
> >> > > > > > >> > >> *This is controlled by the
ENSEMBLE_STAT_ENS_THRESH
> >> > variable.
> >> > > > The
> >> > > > > > >> > default
> >> > > > > > >> > >> value is 1.0, so you don't need to include it
in your
> >> > config
> >> > > > > file,
> >> > > > > > >> but
> >> > > > > > >> > you
> >> > > > > > >> > >> can if you may adjust this value at some
point.*
> >> > > > > > >> > >>
> >> > > > > > >> > >> vld_thresh = 1.0;
> >> > > > > > >> > >>
> >> > > > > > >> > >> *This value is set to 1.0 by default so we
don't need
> to
> >> > > worry
> >> > > > > > about
> >> > > > > > >> it
> >> > > > > > >> > >> right now.*
> >> > > > > > >> > >>
> >> > > > > > >> > >> field = [
> >> > > > > > >> > >>
> >> > > > > > >> > >> {
> >> > > > > > >> > >> name = "HGT";
> >> > > > > > >> > >> level = "P500";
> >> > > > > > >> > >> obs_thresh = [ <=CDP10,
>CDP10&&<=CDP20,
> >> > > > > >CDP20&&<=CDP30,
> >> > > > > > >> > >> >CDP30&&<=CDP40, >CDP40&&<=CDP50,
>CDP50&&<=CDP60,
> >> > > > > >CDP60&&<=CDP70,
> >> > > > > > >> > >> >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];
> >> > > > > > >> > >> }
> >> > > > > > >> > >> ]
> >> > > > > > >> > >> }
> >> > > > > > >> > >> fcst = ens;
> >> > > > > > >> > >> obs = fcst;
> >> > > > > > >> > >>
> >> > > > > > >> > >> *1) The field info for ens is set in the
> >> > > > > > >> > >> ENS_VAR<n>_[NAME/LEVEL/THRESH/OPTIONS]
variables. The
> >> fcst
> >> > > and
> >> > > > > obs
> >> > > > > > >> field
> >> > > > > > >> > >> info are set in the corresponding FCST_VAR<n>_*
and
> >> > > > OBS_VAR<n>_*
> >> > > > > > >> > variables
> >> > > > > > >> > >> respectively, or you can use BOTH_VAR<n>_* if
the FCST
> >> and
> >> > > OBS
> >> > > > > > values
> >> > > > > > >> > are
> >> > > > > > >> > >> the same.*
> >> > > > > > >> > >>
> >> > > > > > >> > >> *If ENS_VAR<n>_* variables are not explicitly
set,
> then
> >> it
> >> > > will
> >> > > > > use
> >> > > > > > >> the
> >> > > > > > >> > >> values from FCST_VAR<n>_*.*
> >> > > > > > >> > >> *Since the fcst, obs, and ens are all the same
you
> could
> >> > just
> >> > > > use
> >> > > > > > >> > >> BOTH_VAR<n>_* variables to control all 3,
although
> keep
> >> in
> >> > > mind
> >> > > > > > that
> >> > > > > > >> if
> >> > > > > > >> > >> you
> >> > > > > > >> > >> need to change one of them for any reason, it
will be
> >> more
> >> > > > > > difficult
> >> > > > > > >> to
> >> > > > > > >> > do
> >> > > > > > >> > >> this. If you know that they will always be the
same
> >> values,
> >> > > > then
> >> > > > > I
> >> > > > > > >> > >> recommend using BOTH_, but if you know they may
change
> >> or
> >> > are
> >> > > > > > >> unsure, I
> >> > > > > > >> > >> would recommend setting them by referencing the
other
> >> > > > variables,
> >> > > > > > >> i.e.*
> >> > > > > > >> > >>
> >> > > > > > >> > >> *FCST_VAR1_NAME = HGT*
> >> > > > > > >> > >> *FCST_VAR1_LEVELS = P500 *
> >> > > > > > >> > >> *OBS_VAR1_NAME = {FCST_VAR1_NAME}*
> >> > > > > > >> > >> *OBS_VAR1_LEVELS = {FCST_VAR1_LEVELS}*
> >> > > > > > >> > >>
> >> > > > > > >> > >> *2) The [FCST/OBS/ENS]_VAR<n>_THRESH variables
set the
> >> > > > cat_thresh
> >> > > > > > >> values
> >> > > > > > >> > >> in
> >> > > > > > >> > >> the field info. A variable specific to
obs_thresh is
> not
> >> > > > > currently
> >> > > > > > >> > >> supported, however you can set these values by
using
> the
> >> > > > > > >> > ENS_VAR1_OPTIONS
> >> > > > > > >> > >> variable, i.e.*
> >> > > > > > >> > >>
> >> > > > > > >> > >> *ENS_VAR1_OPTIONS = obs_thresh = [ <=CDP10,
> >> > >CDP10&&<=CDP20,
> >> > > > > > >> > >> >CDP20&&<=CDP30, >CDP30&&<=CDP40,
>CDP40&&<=CDP50,
> >> > > > > >CDP50&&<=CDP60,
> >> > > > > > >> > >> >CDP60&&<=CDP70, >CDP70&&<=CDP80,
>CDP80&&<=CDP90,
> >> >CDP90
> >> > ];*
> >> > > > > > >> > >>
> >> > > > > > >> > >>
> >> > > > > > >> > >> *Remember to include the semicolon at the end!
*
> >> > > > > > >> > >>
> >> > > > > > >> > >> ens_ssvar_bin_size = 1000000;
> >> > > > > > >> > >> *1) This variable is different from the default
and
> not
> >> > > > currently
> >> > > > > > >> > >> supported
> >> > > > > > >> > >> with a METplus config variable. I will add this
to the
> >> list
> >> > > of
> >> > > > > > >> variables
> >> > > > > > >> > >> in
> >> > > > > > >> > >> MET config files that we want to support.
However, in
> >> the
> >> > > > > meantime
> >> > > > > > >> you
> >> > > > > > >> > can
> >> > > > > > >> > >> copy the default wrapped MET config file and
modify it
> >> to
> >> > fit
> >> > > > > your
> >> > > > > > >> > needs.
> >> > > > > > >> > >> To do this, you will need to:*
> >> > > > > > >> > >>
> >> > > > > > >> > >> * a) Copy
> >> > METplus/parm/met_config/EnsembleStatConfig_wrapped
> >> > > > to
> >> > > > > > the
> >> > > > > > >> > >> directory that contains your METplus config
file for
> >> this
> >> > use
> >> > > > > case.
> >> > > > > > >> > Rename
> >> > > > > > >> > >> it by replacing "wrapped" with a short
description
> that
> >> > > > pertains
> >> > > > > to
> >> > > > > > >> your
> >> > > > > > >> > >> use case.*
> >> > > > > > >> > >>
> >> > > > > > >> > >> * b) In your METplus config file, change the
value of
> >> > > > > > >> > >> ENSEMBLE_STAT_CONFIG_FILE to point to the path
of this
> >> new
> >> > > > config
> >> > > > > > >> file.*
> >> > > > > > >> > >>
> >> > > > > > >> > >> * c) If you know the value you want to use for
this
> >> > variable
> >> > > > > will
> >> > > > > > >> > always
> >> > > > > > >> > >> be 1000000, then simply set the variable to
that
> value.
> >> If
> >> > > you
> >> > > > > > think
> >> > > > > > >> you
> >> > > > > > >> > >> may want to change the value, then you can
utilize the
> >> > > > > > >> [user_env_vars]
> >> > > > > > >> > >> functionality. See:
> >> > > > > > >> > >>
> >> > > > > > >> > >>
> >> > > > > > >> >
> >> > > > > > >>
> >> > > > > >
> >> > > > >
> >> > > >
> >> > >
> >> >
> >>
>
https://dtcenter.github.io/METplus/latest/Users_Guide/systemconfiguration.html#user-
defined-config
> >> > > > > > >> > >> <
> >> > > > > > >> > >>
> >> > > > > > >> >
> >> > > > > > >>
> >> > > > > >
> >> > > > >
> >> > > >
> >> > >
> >> >
> >>
>
https://dtcenter.github.io/METplus/latest/Users_Guide/systemconfiguration.html#user-
defined-config
> >> > > > > > >> > >> >*
> >> > > > > > >> > >> *In this case, you would add the following to
your
> >> METplus
> >> > > > > config:*
> >> > > > > > >> > >>
> >> > > > > > >> > >> *[user_env_vars]*
> >> > > > > > >> > >> *ENS_SSVAR_BIN_SIZE = 1000000*
> >> > > > > > >> > >>
> >> > > > > > >> > >> *Then change the line in your EnsembleStat
config file
> >> that
> >> > > you
> >> > > > > > >> copied
> >> > > > > > >> > >> to:*
> >> > > > > > >> > >>
> >> > > > > > >> > >> * ens_ssvar_bin_size = ${ENS_SSVAR_BIN_SIZE}; *
> >> > > > > > >> > >>
> >> > > > > > >> > >> ens_phist_bin_size = 0.05;
> >> > > > > > >> > >> *This variable uses the default value, so you
don't
> >> need to
> >> > > do
> >> > > > > > >> anything
> >> > > > > > >> > >> here. If you need to make it configurable or
change
> the
> >> > > value,
> >> > > > > then
> >> > > > > > >> > follow
> >> > > > > > >> > >> the instructions for setting
ens_ssvar_bin_size.*
> >> > > > > > >> > >>
> >> > > > > > >> > >> climo_mean = fcst;
> >> > > > > > >> > >> climo_mean = {
> >> > > > > > >> > >> file_name = "${CLIM_MEAN}";
> >> > > > > > >> > >> time_interp_method = DW_MEAN;
> >> > > > > > >> > >> match_day = TRUE;
> >> > > > > > >> > >> time_step = 21600;
> >> > > > > > >> > >> }
> >> > > > > > >> > >>
> >> > > > > > >> > >>
> >> > > > > > >> > >> *Instead of using CLIM_MEAN, you can set
> >> > > > > > >> > >> ENSEMBLE_STAT_CLIMO_MEAN_INPUT_[DIR/TEMPLATE]
in the
> >> > METplus
> >> > > > > > config.
> >> > > > > > >> You
> >> > > > > > >> > >> can use filename template syntax in the
_TEMPLATE
> value,
> >> > i.e.
> >> > > > > > >> > >> {valid?fmt=%m%d}. The other variables in the
> climo_mean
> >> > > > > dictionary
> >> > > > > > >> are
> >> > > > > > >> > >> actually old variables that have been replaced
with
> >> > > > day_interval
> >> > > > > > and
> >> > > > > > >> > >> hour_interval, but the values you use are the
old
> >> defaults,
> >> > > so
> >> > > > > you
> >> > > > > > >> > >> shouldn't need to set them.*
> >> > > > > > >> > >>
> >> > > > > > >> > >> climo_stdev = climo_mean;
> >> > > > > > >> > >> climo_stdev = {
> >> > > > > > >> > >> file_name = "${CLIM_STDV}";
> >> > > > > > >> > >> }
> >> > > > > > >> > >>
> >> > > > > > >> > >> *Similarly to CLIM_MEAN, you can use
> >> > > > > > >> > >> ENSEMBLE_STAT_CLIMO_STDEV_INPUT_[DIR/TEMPLATE]
to set
> >> this
> >> > > file
> >> > > > > > >> name.*
> >> > > > > > >> > >>
> >> > > > > > >> > >> climo_cdf = {
> >> > > > > > >> > >> cdf_bins = 11;
> >> > > > > > >> > >> center_bins = TRUE;
> >> > > > > > >> > >> write_bins = TRUE;
> >> > > > > > >> > >> }
> >> > > > > > >> > >> *The value for write_bins is the default, but
the
> values
> >> > for
> >> > > > > > cdf_bins
> >> > > > > > >> > and
> >> > > > > > >> > >> center_bins do not. To set these, follow the
above
> >> > > instructions
> >> > > > > for
> >> > > > > > >> > >> ens_ssvar_bin_size to override them and/or make
them
> >> > > > configurable
> >> > > > > > >> > through
> >> > > > > > >> > >> METplus. I will also add these variables to the
list
> of
> >> MET
> >> > > > > configs
> >> > > > > > >> that
> >> > > > > > >> > >> users want to be able to easily configure
through
> >> METplus
> >> > > > > configs.*
> >> > > > > > >> > >>
> >> > > > > > >> > >> Please let me know if you run into any issues
setting
> >> any
> >> > of
> >> > > > that
> >> > > > > > up.
> >> > > > > > >> > >> Also,
> >> > > > > > >> > >> if there are any other MET config variables
that you
> >> want
> >> > to
> >> > > > see
> >> > > > > > >> > supported
> >> > > > > > >> > >> in METplus, let me know and I will make sure
they get
> >> > > included
> >> > > > > when
> >> > > > > > >> we
> >> > > > > > >> > >> have
> >> > > > > > >> > >> a chance to refactor those wrappers. It is
possible to
> >> add
> >> > > > > support
> >> > > > > > >> for
> >> > > > > > >> > MET
> >> > > > > > >> > >> configs using the above instructions, but it is
always
> >> > easier
> >> > > > and
> >> > > > > > >> less
> >> > > > > > >> > >> error-prone to have them configurable directly
> through a
> >> > > > variable
> >> > > > > > in
> >> > > > > > >> the
> >> > > > > > >> > >> METplus config.
> >> > > > > > >> > >>
> >> > > > > > >> > >> Thanks,
> >> > > > > > >> > >> George
> >> > > > > > >> > >>
> >> > > > > > >> > >> On Tue, Jan 5, 2021 at 7:14 AM
Binbin.Zhou at noaa.gov
> via
> >> > RT <
> >> > > > > > >> > >> met_help at ucar.edu> wrote:
> >> > > > > > >> > >>
> >> > > > > > >> > >> >
> >> > > > > > >> > >> > Tue Jan 05 07:14:54 2021: Request 98116 was
acted
> >> upon.
> >> > > > > > >> > >> > Transaction: Ticket created by
Binbin.Zhou at noaa.gov
> >> > > > > > >> > >> > Queue: met_help
> >> > > > > > >> > >> > Subject: CDP threshold setting in
EnsembleStat
> >> conf
> >> > > > > > >> > >> > Owner: Nobody
> >> > > > > > >> > >> > Requestors: Binbin.Zhou at noaa.gov
> >> > > > > > >> > >> > Status: new
> >> > > > > > >> > >> > Ticket <URL:
> >> > > > > > >>
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
> >> > > > > > >> > >
> >> > > > > > >> > >> >
> >> > > > > > >> > >> >
> >> > > > > > >> > >> > George,
> >> > > > > > >> > >> >
> >> > > > > > >> > >> > Happy New Year!
> >> > > > > > >> > >> >
> >> > > > > > >> > >> > I am working on transition of our MET-
based
> global
> >> > > > ensemble
> >> > > > > > >> > >> verification
> >> > > > > > >> > >> > to METplus based package. In this package
> climatology
> >> > bins
> >> > > > (10
> >> > > > > > >> bins)
> >> > > > > > >> > are
> >> > > > > > >> > >> > used.
> >> > > > > > >> > >> > In current ensemble stat config file, the
relevant
> >> > entries
> >> > > > iare
> >> > > > > > >> > defined
> >> > > > > > >> > >> > like following
> >> > > > > > >> > >> >
> >> > > > > > >> > >> > ens = {
> >> > > > > > >> > >> > ens_thresh = 1.0;
> >> > > > > > >> > >> > vld_thresh = 1.0;
> >> > > > > > >> > >> >
> >> > > > > > >> > >> > field = [
> >> > > > > > >> > >> >
> >> > > > > > >> > >> > {
> >> > > > > > >> > >> > name = "HGT";
> >> > > > > > >> > >> > level = "P500";
> >> > > > > > >> > >> > obs_thresh = [ <=CDP10,
>CDP10&&<=CDP20,
> >> > > > > > >CDP20&&<=CDP30,
> >> > > > > > >> > >> > >CDP30&&<=CDP40, >CDP40&&<=CDP50,
>CDP50&&<=CDP60,
> >> > > > > > >CDP60&&<=CDP70,
> >> > > > > > >> > >> > >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];
> >> > > > > > >> > >> > }
> >> > > > > > >> > >> > ]
> >> > > > > > >> > >> > }
> >> > > > > > >> > >> > fcst = ens;
> >> > > > > > >> > >> > obs = fcst;
> >> > > > > > >> > >> > ens_ssvar_bin_size = 1000000;
> >> > > > > > >> > >> > ens_phist_bin_size = 0.05;
> >> > > > > > >> > >> > climo_mean = fcst;
> >> > > > > > >> > >> > climo_mean = {
> >> > > > > > >> > >> > file_name = "${CLIM_MEAN}";
> >> > > > > > >> > >> > time_interp_method = DW_MEAN;
> >> > > > > > >> > >> > match_day = TRUE;
> >> > > > > > >> > >> > time_step = 21600;
> >> > > > > > >> > >> > }
> >> > > > > > >> > >> >
> >> > > > > > >> > >> > climo_stdev = climo_mean;
> >> > > > > > >> > >> > climo_stdev = {
> >> > > > > > >> > >> > file_name = "${CLIM_STDV}";
> >> > > > > > >> > >> > }
> >> > > > > > >> > >> >
> >> > > > > > >> > >> > climo_cdf = {
> >> > > > > > >> > >> > cdf_bins = 11;
> >> > > > > > >> > >> > center_bins = TRUE;
> >> > > > > > >> > >> > write_bins = TRUE;
> >> > > > > > >> > >> > }
> >> > > > > > >> > >> >
> >> > > > > > >> > >> > I can not find the correspondent settings in
its
> conf
> >> > file
> >> > > > from
> >> > > > > > >> > METplus
> >> > > > > > >> > >> > online doc.
> >> > > > > > >> > >> > Can you help me look at this?
> >> > > > > > >> > >> >
> >> > > > > > >> > >> > Thanks!
> >> > > > > > >> > >> >
> >> > > > > > >> > >> > Binbin
> >> > > > > > >> > >> >
> >> > > > > > >> > >> > --
> >> > > > > > >> > >> >
> >> > > > > > >> > >> > Binbin Zhou
> >> > > > > > >> > >> >
> >> > > > > > >> > >> > IMSG at NOAA/NWS/NCEP/EMC
> >> > > > > > >> > >> >
> >> > > > > > >> > >> > 5830 University Research Ct.
> >> > > > > > >> > >> >
> >> > > > > > >> > >> > College Park, MD 20740
> >> > > > > > >> > >> >
> >> > > > > > >> > >> > Binbin.Zhou at noaa.gov
> >> > > > > > >> > >> >
> >> > > > > > >> > >> > 301-683-3683
> >> > > > > > >> > >> >
> >> > > > > > >> > >> >
> >> > > > > > >> > >>
> >> > > > > > >> > >> --
> >> > > > > > >> > >> George McCabe - Software Engineer III
> >> > > > > > >> > >> National Center for Atmospheric Research
> >> > > > > > >> > >> Research Applications Laboratory
> >> > > > > > >> > >> 303-497-2768
> >> > > > > > >> > >> ---
> >> > > > > > >> > >> My working day may not be your working day.
Please do
> >> not
> >> > > feel
> >> > > > > > >> obliged
> >> > > > > > >> > to
> >> > > > > > >> > >> reply to this email outside of your normal
working
> >> hours.
> >> > > > > > >> > >>
> >> > > > > > >> > >>
> >> > > > > > >> > >
> >> > > > > > >> > > --
> >> > > > > > >> > >
> >> > > > > > >> > > Binbin Zhou
> >> > > > > > >> > >
> >> > > > > > >> > > IMSG at NOAA/NWS/NCEP/EMC
> >> > > > > > >> > >
> >> > > > > > >> > > 5830 University Research Ct.
> >> > > > > > >> > >
> >> > > > > > >> > > College Park, MD 20740
> >> > > > > > >> > >
> >> > > > > > >> > > Binbin.Zhou at noaa.gov
> >> > > > > > >> > >
> >> > > > > > >> > > 301-683-3683
> >> > > > > > >> > >
> >> > > > > > >> >
> >> > > > > > >> >
> >> > > > > > >> > --
> >> > > > > > >> >
> >> > > > > > >> > Binbin Zhou
> >> > > > > > >> >
> >> > > > > > >> > IMSG at NOAA/NWS/NCEP/EMC
> >> > > > > > >> >
> >> > > > > > >> > 5830 University Research Ct.
> >> > > > > > >> >
> >> > > > > > >> > College Park, MD 20740
> >> > > > > > >> >
> >> > > > > > >> > Binbin.Zhou at noaa.gov
> >> > > > > > >> >
> >> > > > > > >> > 301-683-3683
> >> > > > > > >> >
> >> > > > > > >> >
> >> > > > > > >>
> >> > > > > > >> --
> >> > > > > > >> George McCabe - Software Engineer III
> >> > > > > > >> National Center for Atmospheric Research
> >> > > > > > >> Research Applications Laboratory
> >> > > > > > >> 303-497-2768
> >> > > > > > >> ---
> >> > > > > > >> My working day may not be your working day. Please
do not
> >> feel
> >> > > > obliged
> >> > > > > > to
> >> > > > > > >> reply to this email outside of your normal working
hours.
> >> > > > > > >>
> >> > > > > > >>
> >> > > > > > >
> >> > > > > > > --
> >> > > > > > >
> >> > > > > > > Binbin Zhou
> >> > > > > > >
> >> > > > > > > IMSG at NOAA/NWS/NCEP/EMC
> >> > > > > > >
> >> > > > > > > 5830 University Research Ct.
> >> > > > > > >
> >> > > > > > > College Park, MD 20740
> >> > > > > > >
> >> > > > > > > Binbin.Zhou at noaa.gov
> >> > > > > > >
> >> > > > > > > 301-683-3683
> >> > > > > > >
> >> > > > > >
> >> > > > > >
> >> > > > > > --
> >> > > > > >
> >> > > > > > Binbin Zhou
> >> > > > > >
> >> > > > > > IMSG at NOAA/NWS/NCEP/EMC
> >> > > > > >
> >> > > > > > 5830 University Research Ct.
> >> > > > > >
> >> > > > > > College Park, MD 20740
> >> > > > > >
> >> > > > > > Binbin.Zhou at noaa.gov
> >> > > > > >
> >> > > > > > 301-683-3683
> >> > > > > >
> >> > > > > >
> >> > > > >
> >> > > > > --
> >> > > > > George McCabe - Software Engineer III
> >> > > > > National Center for Atmospheric Research
> >> > > > > Research Applications Laboratory
> >> > > > > 303-497-2768
> >> > > > > ---
> >> > > > > My working day may not be your working day. Please do not
feel
> >> > obliged
> >> > > to
> >> > > > > reply to this email outside of your normal working hours.
> >> > > > >
> >> > > > >
> >> > > >
> >> > > > --
> >> > > >
> >> > > > Binbin Zhou
> >> > > >
> >> > > > IMSG at NOAA/NWS/NCEP/EMC
> >> > > >
> >> > > > 5830 University Research Ct.
> >> > > >
> >> > > > College Park, MD 20740
> >> > > >
> >> > > > Binbin.Zhou at noaa.gov
> >> > > >
> >> > > > 301-683-3683
> >> > > >
> >> > > >
> >> > >
> >> > > --
> >> > > George McCabe - Software Engineer III
> >> > > National Center for Atmospheric Research
> >> > > Research Applications Laboratory
> >> > > 303-497-2768
> >> > > ---
> >> > > My working day may not be your working day. Please do not
feel
> >> obliged to
> >> > > reply to this email outside of your normal working hours.
> >> > >
> >> > >
> >> >
> >> > --
> >> >
> >> > Binbin Zhou
> >> >
> >> > IMSG at NOAA/NWS/NCEP/EMC
> >> >
> >> > 5830 University Research Ct.
> >> >
> >> > College Park, MD 20740
> >> >
> >> > Binbin.Zhou at noaa.gov
> >> >
> >> > 301-683-3683
> >> >
> >> >
> >>
> >> --
> >> Julie Prestopnik (she/her)
> >> Software Engineer
> >> National Center for Atmospheric Research
> >> Research Applications Laboratory
> >> Email: jpresto at ucar.edu
> >>
> >> My working day may not be your working day. Please do not feel
obliged
> to
> >> reply to this email outside of your normal working hours.
> >>
> >>
> >
> > --
> >
> > Binbin Zhou
> >
> > IMSG at NOAA/NWS/NCEP/EMC
> >
> > 5830 University Research Ct.
> >
> > College Park, MD 20740
> >
> > Binbin.Zhou at noaa.gov
> >
> > 301-683-3683
> >
>
>
> --
>
> Binbin Zhou
>
> IMSG at NOAA/NWS/NCEP/EMC
>
> 5830 University Research Ct.
>
> College Park, MD 20740
>
> Binbin.Zhou at noaa.gov
>
> 301-683-3683
>
>
--
Julie Prestopnik (she/her)
Software Engineer
National Center for Atmospheric Research
Research Applications Laboratory
Email: jpresto at ucar.edu
My working day may not be your working day. Please do not feel
obliged to
reply to this email outside of your normal working hours.
------------------------------------------------
Subject: CDP threshold setting in EnsembleStat conf
From: George McCabe
Time: Wed Jan 06 12:19:05 2021
Hi Binbin,
Thanks for putting those files on hera. The log output you sent
doesn't
have the DEBUG level output (LOG_LEVEL=DEBUG). However, I tried to run
EnsembleStat locally using the _OPTIONS value you set and it seems to
run
fine. The error seems to suggest that something went wrong when
computing
the mean and standard deviation before the obs_thresh values are
applied. I
have reached out to John HG to see if he has any insight as to why
that is
happening. In the meantime, you could rerun with
LOG_ENSEMBLE_STAT_VERBOSITY set to a higher value than 2 to see if
the
extra log output from the MET tool gives you any more insight as to
what is
going wrong.
- George
On Wed, Jan 6, 2021 at 9:51 AM Julie Prestopnik via RT
<met_help at ucar.edu>
wrote:
> Thanks for all of the info Binbin. I saw that you had copied
everything to
> hera for George. I am currently no longer on WCOSS, so I unless
George
> lets me know that he needs something from WCOSS, I'll assume he is
able to
> get it from hera.
>
> Julie
>
> On Wed, Jan 6, 2021 at 9:39 AM Binbin.Zhou at noaa.gov via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116 >
> >
> > The EnsembleStat config file for the successful run outside of
METplus is
> >
> >
>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_met_global_ens1p0.v1.0.0/parm/verf_g2g_ens_stat_config_bin11
> > on WCOSS
> >
> > Binbin
> >
> > On Wed, Jan 6, 2021 at 11:34 AM Binbin Zhou - NOAA Affiliate <
> > binbin.zhou at noaa.gov> wrote:
> >
> > > Julie,
> > >
> > > The output directory on WCOSS is
> > >
> > >
> >
>
/gpfs/dell1/ptmp/Binbin.Zhou/g2g/RFC2/tmpnwprd/verf_g2g_gefs_00_dev.161076/metplus3.out
> > >
> > > My METplus package on WCOSS is
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_g2g.v4.0.0
> > >
> > > For GEFS, the EnsembleGrid config file is
> > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_g2g.v4.0.0/parm/app_conf/grid2grid/met_config/EnsembleStatConfig_gefs_bin11
> > > Its conf file
> > > is
> >
>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_g2g.v4.0.0/parm/app_conf/grid2grid/gefs_conf/gefs_bin11.conf
> > >
> > > The running process is little bit complex since this is a
transition to
> > > future operational package that uses
> > > mpi parallel: the script is
> > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_g2g.v4.0.0/ush/verf_g2g_metplus_run_gefs_mpi.sh
> > >
> > > Binbin
> > >
> > >
> > >
> > >
> > > On Wed, Jan 6, 2021 at 11:00 AM Julie Prestopnik via RT <
> > met_help at ucar.edu>
> > > wrote:
> > >
> > >> Hi Binbin.
> > >>
> > >> This is Julie. I haven't been following this entire thread,
but I am
> on
> > >> WCOSS right now. If you send a path to a file, I can pull it
and put
> it
> > >> on
> > >> our ftp server for George.
> > >>
> > >> Julie
> > >>
> > >> On Wed, Jan 6, 2021 at 8:57 AM Binbin.Zhou at noaa.gov via RT <
> > >> met_help at ucar.edu> wrote:
> > >>
> > >> >
> > >> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
>
> > >> >
> > >> > George,
> > >> >
> > >> > Can you access WCOSS or access HERA?
> > >> > Otherwise I will email attached to you
> > >> >
> > >> > Binbin
> > >> >
> > >> >
> > >> >
> > >> > On Wed, Jan 6, 2021 at 10:46 AM George McCabe via RT <
> > met_help at ucar.edu
> > >> >
> > >> > wrote:
> > >> >
> > >> > > Hi Binbin,
> > >> > >
> > >> > > Could you send me a log file for a run with LOG_LEVEL=DEBUG
(in
> > >> METplus
> > >> > > config) so I can see how the environment variable ENS_FIELD
is
> set?
> > >> The
> > >> > > values of ENS_VAR<n>_* are formatted and set in this
environment
> > >> variable
> > >> > > which is passed into the MET config. You can compare that
value
> with
> > >> what
> > >> > > you used in your successful run outside of the METplus
wrapper to
> > >> > determine
> > >> > > what is different.
> > >> > >
> > >> > > Thanks,
> > >> > > George
> > >> > >
> > >> > > On Wed, Jan 6, 2021 at 7:11 AM Binbin.Zhou at noaa.gov via RT
<
> > >> > > met_help at ucar.edu> wrote:
> > >> > >
> > >> > > >
> > >> > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116 >
> > >> > > >
> > >> > > > George,
> > >> > > >
> > >> > > > I got a new error in execution although some output
files (nc
> > >> file)
> > >> > are
> > >> > > > created but stat files not.
> > >> > > > The error message is
> > >> > > >
> > >> > > > ERROR :
> > >> > > > ERROR : Simple_Node::check(double, double, double) const
->
> > >> > > climatological
> > >> > > > distribution percentile threshold "<=CDP10" requested
with
> invalid
> > >> mean
> > >> > > > (-9999) or standard deviation (-9999).
> > >> > > > ERROR :
> > >> > > >
> > >> > > > Such an error was ever investigated by John H before
(year ago):
> > >> When I
> > >> > > > directly ran ensemble_stat for global ensemble (not
> METplus-based,
> > >> > > > but hard code of all settings in EnsembleStat config
file): If
> > hard
> > >> > code
> > >> > > > fcst field in EnsembleStat config file like this
> > >> > > >
> > >> > > > name = "HGT";
> > >> > > > level = "P500";
> > >> > > > cat_thresh = [ <=CDP10, >CDP10&&<=CDP20,
> >CDP20&&<=CDP30,
> > >> > > > >CDP30&&<=CDP40, >CDP40&&<=CDP50, >CDP50&&<=CDP60,
> > >CDP60&&<=CDP70,
> > >> > > > >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];
> > >> > > >
> > >> > > > Run ensemble_stat will have such error: ERROR :
> > >> > > > Simple_Node::check(double, double, double) const ->
> climatological
> > >> > > > distribution percentile threshold "<=CDP10" requested
with
> invalid
> > >> mean
> > >> > > > (-9999) or standard deviation (-9999).
> > >> > > >
> > >> > > > John H. suggested me change "cat_thresh = " to
"obs_thresh = ",
> > >> then
> > >> > > the
> > >> > > > error was solved.
> > >> > > >
> > >> > > > In current METplus version, following your suggestion as
> > >> > > >
> > >> > > > ENS_VAR1_OPTIONS = obs_thresh = [ <=CDP10,
>CDP10&&<=CDP20,
> > >> > > > >CDP20&&<=CDP30, >CDP30&&<=CDP40, >CDP40&&<=CDP50,
> > >CDP50&&<=CDP60,
> > >> > > > >CDP60&&<=CDP70, >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90
];
> > >> > > >
> > >> > > > the same error appears again. So I am not for sure if
the
> > >> > "obs_thresh"
> > >> > > > setting is correctly passed.
> > >> > > >
> > >> > > > Binbin
> > >> > > >
> > >> > > >
> > >> > > >
> > >> > > >
> > >> > > > On Tue, Jan 5, 2021 at 5:19 PM George McCabe via RT <
> > >> met_help at ucar.edu
> > >> > >
> > >> > > > wrote:
> > >> > > >
> > >> > > > > Hi Binbin,
> > >> > > > >
> > >> > > > > Your solution should work for now. It looks like
although the
> > >> METplus
> > >> > > > > variable does get read properly, the environment
variable is
> not
> > >> > > actually
> > >> > > > > set by the EnsembleStat wrapper. I can make a note to
add that
> > for
> > >> > > 4.0.0,
> > >> > > > > as it is an easy fix.
> > >> > > > >
> > >> > > > > - George
> > >> > > > >
> > >> > > > > On Tue, Jan 5, 2021 at 2:53 PM Binbin.Zhou at noaa.gov via
RT <
> > >> > > > > met_help at ucar.edu> wrote:
> > >> > > > >
> > >> > > > > > George,
> > >> > > > > >
> > >> > > > > > I have a temporal solution:
> > >> > > > > > set ploy in EnembleStat config as
> > >> > > > > > poly = [ "${MASKPATH}/lat_NHM.nc",
> > >> > > > > > "${MASKPATH}/lat_NHM.nc",
> > >> > > > > > "${MASKPATH}/lat_TRP.nc" ];
> > >> > > > > >
> > >> > > > > > then set MASKPATH in user_env_vars part in the conf
file
> > >> > > > > > This MASKPAH then can be passed to EnsembleStat's
poly [ ]
> > entry
> > >> > > > > >
> > >> > > > > > Binbin
> > >> > > > > >
> > >> > > > > > On Tue, Jan 5, 2021 at 4:25 PM Binbin Zhou - NOAA
Affiliate
> <
> > >> > > > > > binbin.zhou at noaa.gov> wrote:
> > >> > > > > >
> > >> > > > > > > George,
> > >> > > > > > >
> > >> > > > > > > Still not working, error says
> > >> > > > > > > ERROR : replace_env() -> unable to get value for
> > environment
> > >> > > > variable
> > >> > > > > > > "VERIF_MASK"
> > >> > > > > > >
> > >> > > > > > > Binbin
> > >> > > > > > >
> > >> > > > > > >
> > >> > > > > > >
> > >> > > > > > > On Tue, Jan 5, 2021 at 3:50 PM George McCabe via RT
<
> > >> > > > met_help at ucar.edu
> > >> > > > > >
> > >> > > > > > > wrote:
> > >> > > > > > >
> > >> > > > > > >> Hi Binbin,
> > >> > > > > > >>
> > >> > > > > > >> You should be able to set it in the METplus config
the
> same
> > >> way
> > >> > it
> > >> > > > is
> > >> > > > > > done
> > >> > > > > > >> for GridStat -- no quotes with commas between each
item.
> > The
> > >> > > wrapper
> > >> > > > > > >> should
> > >> > > > > > >> format it properly.
> > >> > > > > > >>
> > >> > > > > > >> Here is an example from an existing use case:
> > >> > > > > > >>
> > >> > > > > > >> GRID_STAT_VERIFICATION_MASK_TEMPLATE =
> > >> > > > > > >>
> > >> > >
> {INPUT_BASE}/model_applications/precipitation/mask/CONUS_HRRRTLE.nc,
> > >> > > > > > >>
> > >> > >
> {INPUT_BASE}/model_applications/precipitation/mask/EAST_HRRRTLE.nc,
> > >> > > > > > >>
> > >> >
{INPUT_BASE}/model_applications/precipitation/mask/WEST_HRRRTLE.nc
> > >> > > > > > >>
> > >> > > > > > >> You should be able to set them the same way using
> > >> > > > > > >> ENSEMBLE_STAT_VERIFICATION_MASK_TEMPLATE. Let me
know if
> > that
> > >> > > > doesn't
> > >> > > > > > >> work.
> > >> > > > > > >>
> > >> > > > > > >> - George
> > >> > > > > > >>
> > >> > > > > > >> On Tue, Jan 5, 2021 at 1:45 PM
Binbin.Zhou at noaa.gov via
> > RT <
> > >> > > > > > >> met_help at ucar.edu> wrote:
> > >> > > > > > >>
> > >> > > > > > >> >
> > >> > > > > > >> > <URL:
> > >> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
> > >> > >
> > >> > > > > > >> >
> > >> > > > > > >> > George,
> > >> > > > > > >> >
> > >> > > > > > >> > I got another issue for verification mask
setting.
> > >> > > > > > >> >
> > >> > > > > > >> > I am using $VERIF_MASK in EnsembleStat config
f/ile
> > >> > > > > > >> > mask = {
> > >> > > > > > >> > grid = [];
> > >> > > > > > >> > poly = [${VERIF_MASK}];
> > >> > > > > > >> > sid = [];
> > >> > > > > > >> > }
> > >> > > > > > >> >
> > >> > > > > > >> > And using GRID_STAT_VERIFICATION_MASK_TEMPLATE
to
> define
> > >> > > several
> > >> > > > > > >> polygon
> > >> > > > > > >> > nc mask files
> > >> > > > > > >> > But it seems not working. But it works for
Gridstat
> > config
> > >> in
> > >> > > > suich
> > >> > > > > > >> > setting.
> > >> > > > > > >> > I can not find ENSEMBLE_STAT_
> VERIFICATION_MASK_TEMPLATE
> > in
> > >> > the
> > >> > > > > > METplus
> > >> > > > > > >> doc
> > >> > > > > > >> >
> > >> > > > > > >> > So I define VERIF_MASK in [user_env_vars] part.
> > >> > > > > > >> > It values can not be passed to ploy =
[${VERIF_MASK}]
> in
> > >> the
> > >> > > > > > >> EnsembleStat
> > >> > > > > > >> > conf if more than one nc files included.
> > >> > > > > > >> > For example
> > >> > > > > > >> > VERIF_MASK=" '/part/p1.cn', '/path/p2.nc' "
> > >> > > > > > >> > the error says poly = [/path/p1,]
> > >> > > > > > >> > It seems double quote or single quote can not be
passed
> > to
> > >> > > > > VERIF_MASK
> > >> > > > > > in
> > >> > > > > > >> > the EnsembleStat config.
> > >> > > > > > >> > I tried use back slash \ to before quote, but
still not
> > >> > working
> > >> > > > > > >> >
> > >> > > > > > >> > Binbin
> > >> > > > > > >> >
> > >> > > > > > >> >
> > >> > > > > > >> > On Tue, Jan 5, 2021 at 10:33 AM Binbin Zhou -
NOAA
> > >> Affiliate <
> > >> > > > > > >> > binbin.zhou at noaa.gov> wrote:
> > >> > > > > > >> >
> > >> > > > > > >> > > George,
> > >> > > > > > >> > >
> > >> > > > > > >> > > Thanks for your quick response! I'll test
this
> > >> settings
> > >> > and
> > >> > > > let
> > >> > > > > > >> > > you know the results.
> > >> > > > > > >> > >
> > >> > > > > > >> > > Binbin
> > >> > > > > > >> > >
> > >> > > > > > >> > > On Tue, Jan 5, 2021 at 10:17 AM George McCabe
via RT
> <
> > >> > > > > > >> met_help at ucar.edu>
> > >> > > > > > >> > > wrote:
> > >> > > > > > >> > >
> > >> > > > > > >> > >> Hi Binbin,
> > >> > > > > > >> > >>
> > >> > > > > > >> > >> Happy New Year to you too!
> > >> > > > > > >> > >>
> > >> > > > > > >> > >> I will comment on each configuration variable
and
> how
> > to
> > >> > set
> > >> > > it
> > >> > > > > in
> > >> > > > > > a
> > >> > > > > > >> > >> METplus config inline:
> > >> > > > > > >> > >>
> > >> > > > > > >> > >> ens = {
> > >> > > > > > >> > >> ens_thresh = 1.0;
> > >> > > > > > >> > >>
> > >> > > > > > >> > >>
> > >> > > > > > >> > >> *This is controlled by the
ENSEMBLE_STAT_ENS_THRESH
> > >> > variable.
> > >> > > > The
> > >> > > > > > >> > default
> > >> > > > > > >> > >> value is 1.0, so you don't need to include it
in
> your
> > >> > config
> > >> > > > > file,
> > >> > > > > > >> but
> > >> > > > > > >> > you
> > >> > > > > > >> > >> can if you may adjust this value at some
point.*
> > >> > > > > > >> > >>
> > >> > > > > > >> > >> vld_thresh = 1.0;
> > >> > > > > > >> > >>
> > >> > > > > > >> > >> *This value is set to 1.0 by default so we
don't
> need
> > to
> > >> > > worry
> > >> > > > > > about
> > >> > > > > > >> it
> > >> > > > > > >> > >> right now.*
> > >> > > > > > >> > >>
> > >> > > > > > >> > >> field = [
> > >> > > > > > >> > >>
> > >> > > > > > >> > >> {
> > >> > > > > > >> > >> name = "HGT";
> > >> > > > > > >> > >> level = "P500";
> > >> > > > > > >> > >> obs_thresh = [ <=CDP10,
>CDP10&&<=CDP20,
> > >> > > > > >CDP20&&<=CDP30,
> > >> > > > > > >> > >> >CDP30&&<=CDP40, >CDP40&&<=CDP50,
>CDP50&&<=CDP60,
> > >> > > > > >CDP60&&<=CDP70,
> > >> > > > > > >> > >> >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];
> > >> > > > > > >> > >> }
> > >> > > > > > >> > >> ]
> > >> > > > > > >> > >> }
> > >> > > > > > >> > >> fcst = ens;
> > >> > > > > > >> > >> obs = fcst;
> > >> > > > > > >> > >>
> > >> > > > > > >> > >> *1) The field info for ens is set in the
> > >> > > > > > >> > >> ENS_VAR<n>_[NAME/LEVEL/THRESH/OPTIONS]
variables.
> The
> > >> fcst
> > >> > > and
> > >> > > > > obs
> > >> > > > > > >> field
> > >> > > > > > >> > >> info are set in the corresponding
FCST_VAR<n>_* and
> > >> > > > OBS_VAR<n>_*
> > >> > > > > > >> > variables
> > >> > > > > > >> > >> respectively, or you can use BOTH_VAR<n>_* if
the
> FCST
> > >> and
> > >> > > OBS
> > >> > > > > > values
> > >> > > > > > >> > are
> > >> > > > > > >> > >> the same.*
> > >> > > > > > >> > >>
> > >> > > > > > >> > >> *If ENS_VAR<n>_* variables are not explicitly
set,
> > then
> > >> it
> > >> > > will
> > >> > > > > use
> > >> > > > > > >> the
> > >> > > > > > >> > >> values from FCST_VAR<n>_*.*
> > >> > > > > > >> > >> *Since the fcst, obs, and ens are all the
same you
> > could
> > >> > just
> > >> > > > use
> > >> > > > > > >> > >> BOTH_VAR<n>_* variables to control all 3,
although
> > keep
> > >> in
> > >> > > mind
> > >> > > > > > that
> > >> > > > > > >> if
> > >> > > > > > >> > >> you
> > >> > > > > > >> > >> need to change one of them for any reason, it
will
> be
> > >> more
> > >> > > > > > difficult
> > >> > > > > > >> to
> > >> > > > > > >> > do
> > >> > > > > > >> > >> this. If you know that they will always be
the same
> > >> values,
> > >> > > > then
> > >> > > > > I
> > >> > > > > > >> > >> recommend using BOTH_, but if you know they
may
> change
> > >> or
> > >> > are
> > >> > > > > > >> unsure, I
> > >> > > > > > >> > >> would recommend setting them by referencing
the
> other
> > >> > > > variables,
> > >> > > > > > >> i.e.*
> > >> > > > > > >> > >>
> > >> > > > > > >> > >> *FCST_VAR1_NAME = HGT*
> > >> > > > > > >> > >> *FCST_VAR1_LEVELS = P500 *
> > >> > > > > > >> > >> *OBS_VAR1_NAME = {FCST_VAR1_NAME}*
> > >> > > > > > >> > >> *OBS_VAR1_LEVELS = {FCST_VAR1_LEVELS}*
> > >> > > > > > >> > >>
> > >> > > > > > >> > >> *2) The [FCST/OBS/ENS]_VAR<n>_THRESH
variables set
> the
> > >> > > > cat_thresh
> > >> > > > > > >> values
> > >> > > > > > >> > >> in
> > >> > > > > > >> > >> the field info. A variable specific to
obs_thresh is
> > not
> > >> > > > > currently
> > >> > > > > > >> > >> supported, however you can set these values
by using
> > the
> > >> > > > > > >> > ENS_VAR1_OPTIONS
> > >> > > > > > >> > >> variable, i.e.*
> > >> > > > > > >> > >>
> > >> > > > > > >> > >> *ENS_VAR1_OPTIONS = obs_thresh = [ <=CDP10,
> > >> > >CDP10&&<=CDP20,
> > >> > > > > > >> > >> >CDP20&&<=CDP30, >CDP30&&<=CDP40,
>CDP40&&<=CDP50,
> > >> > > > > >CDP50&&<=CDP60,
> > >> > > > > > >> > >> >CDP60&&<=CDP70, >CDP70&&<=CDP80,
>CDP80&&<=CDP90,
> > >> >CDP90
> > >> > ];*
> > >> > > > > > >> > >>
> > >> > > > > > >> > >>
> > >> > > > > > >> > >> *Remember to include the semicolon at the
end! *
> > >> > > > > > >> > >>
> > >> > > > > > >> > >> ens_ssvar_bin_size = 1000000;
> > >> > > > > > >> > >> *1) This variable is different from the
default and
> > not
> > >> > > > currently
> > >> > > > > > >> > >> supported
> > >> > > > > > >> > >> with a METplus config variable. I will add
this to
> the
> > >> list
> > >> > > of
> > >> > > > > > >> variables
> > >> > > > > > >> > >> in
> > >> > > > > > >> > >> MET config files that we want to support.
However,
> in
> > >> the
> > >> > > > > meantime
> > >> > > > > > >> you
> > >> > > > > > >> > can
> > >> > > > > > >> > >> copy the default wrapped MET config file and
modify
> it
> > >> to
> > >> > fit
> > >> > > > > your
> > >> > > > > > >> > needs.
> > >> > > > > > >> > >> To do this, you will need to:*
> > >> > > > > > >> > >>
> > >> > > > > > >> > >> * a) Copy
> > >> > METplus/parm/met_config/EnsembleStatConfig_wrapped
> > >> > > > to
> > >> > > > > > the
> > >> > > > > > >> > >> directory that contains your METplus config
file for
> > >> this
> > >> > use
> > >> > > > > case.
> > >> > > > > > >> > Rename
> > >> > > > > > >> > >> it by replacing "wrapped" with a short
description
> > that
> > >> > > > pertains
> > >> > > > > to
> > >> > > > > > >> your
> > >> > > > > > >> > >> use case.*
> > >> > > > > > >> > >>
> > >> > > > > > >> > >> * b) In your METplus config file, change the
value
> of
> > >> > > > > > >> > >> ENSEMBLE_STAT_CONFIG_FILE to point to the
path of
> this
> > >> new
> > >> > > > config
> > >> > > > > > >> file.*
> > >> > > > > > >> > >>
> > >> > > > > > >> > >> * c) If you know the value you want to use
for this
> > >> > variable
> > >> > > > > will
> > >> > > > > > >> > always
> > >> > > > > > >> > >> be 1000000, then simply set the variable to
that
> > value.
> > >> If
> > >> > > you
> > >> > > > > > think
> > >> > > > > > >> you
> > >> > > > > > >> > >> may want to change the value, then you can
utilize
> the
> > >> > > > > > >> [user_env_vars]
> > >> > > > > > >> > >> functionality. See:
> > >> > > > > > >> > >>
> > >> > > > > > >> > >>
> > >> > > > > > >> >
> > >> > > > > > >>
> > >> > > > > >
> > >> > > > >
> > >> > > >
> > >> > >
> > >> >
> > >>
> >
>
https://dtcenter.github.io/METplus/latest/Users_Guide/systemconfiguration.html#user-
defined-config
> > >> > > > > > >> > >> <
> > >> > > > > > >> > >>
> > >> > > > > > >> >
> > >> > > > > > >>
> > >> > > > > >
> > >> > > > >
> > >> > > >
> > >> > >
> > >> >
> > >>
> >
>
https://dtcenter.github.io/METplus/latest/Users_Guide/systemconfiguration.html#user-
defined-config
> > >> > > > > > >> > >> >*
> > >> > > > > > >> > >> *In this case, you would add the following to
your
> > >> METplus
> > >> > > > > config:*
> > >> > > > > > >> > >>
> > >> > > > > > >> > >> *[user_env_vars]*
> > >> > > > > > >> > >> *ENS_SSVAR_BIN_SIZE = 1000000*
> > >> > > > > > >> > >>
> > >> > > > > > >> > >> *Then change the line in your EnsembleStat
config
> file
> > >> that
> > >> > > you
> > >> > > > > > >> copied
> > >> > > > > > >> > >> to:*
> > >> > > > > > >> > >>
> > >> > > > > > >> > >> * ens_ssvar_bin_size = ${ENS_SSVAR_BIN_SIZE};
*
> > >> > > > > > >> > >>
> > >> > > > > > >> > >> ens_phist_bin_size = 0.05;
> > >> > > > > > >> > >> *This variable uses the default value, so you
don't
> > >> need to
> > >> > > do
> > >> > > > > > >> anything
> > >> > > > > > >> > >> here. If you need to make it configurable or
change
> > the
> > >> > > value,
> > >> > > > > then
> > >> > > > > > >> > follow
> > >> > > > > > >> > >> the instructions for setting
ens_ssvar_bin_size.*
> > >> > > > > > >> > >>
> > >> > > > > > >> > >> climo_mean = fcst;
> > >> > > > > > >> > >> climo_mean = {
> > >> > > > > > >> > >> file_name = "${CLIM_MEAN}";
> > >> > > > > > >> > >> time_interp_method = DW_MEAN;
> > >> > > > > > >> > >> match_day = TRUE;
> > >> > > > > > >> > >> time_step = 21600;
> > >> > > > > > >> > >> }
> > >> > > > > > >> > >>
> > >> > > > > > >> > >>
> > >> > > > > > >> > >> *Instead of using CLIM_MEAN, you can set
> > >> > > > > > >> > >> ENSEMBLE_STAT_CLIMO_MEAN_INPUT_[DIR/TEMPLATE]
in the
> > >> > METplus
> > >> > > > > > config.
> > >> > > > > > >> You
> > >> > > > > > >> > >> can use filename template syntax in the
_TEMPLATE
> > value,
> > >> > i.e.
> > >> > > > > > >> > >> {valid?fmt=%m%d}. The other variables in the
> > climo_mean
> > >> > > > > dictionary
> > >> > > > > > >> are
> > >> > > > > > >> > >> actually old variables that have been
replaced with
> > >> > > > day_interval
> > >> > > > > > and
> > >> > > > > > >> > >> hour_interval, but the values you use are the
old
> > >> defaults,
> > >> > > so
> > >> > > > > you
> > >> > > > > > >> > >> shouldn't need to set them.*
> > >> > > > > > >> > >>
> > >> > > > > > >> > >> climo_stdev = climo_mean;
> > >> > > > > > >> > >> climo_stdev = {
> > >> > > > > > >> > >> file_name = "${CLIM_STDV}";
> > >> > > > > > >> > >> }
> > >> > > > > > >> > >>
> > >> > > > > > >> > >> *Similarly to CLIM_MEAN, you can use
> > >> > > > > > >> > >>
ENSEMBLE_STAT_CLIMO_STDEV_INPUT_[DIR/TEMPLATE] to
> set
> > >> this
> > >> > > file
> > >> > > > > > >> name.*
> > >> > > > > > >> > >>
> > >> > > > > > >> > >> climo_cdf = {
> > >> > > > > > >> > >> cdf_bins = 11;
> > >> > > > > > >> > >> center_bins = TRUE;
> > >> > > > > > >> > >> write_bins = TRUE;
> > >> > > > > > >> > >> }
> > >> > > > > > >> > >> *The value for write_bins is the default, but
the
> > values
> > >> > for
> > >> > > > > > cdf_bins
> > >> > > > > > >> > and
> > >> > > > > > >> > >> center_bins do not. To set these, follow the
above
> > >> > > instructions
> > >> > > > > for
> > >> > > > > > >> > >> ens_ssvar_bin_size to override them and/or
make them
> > >> > > > configurable
> > >> > > > > > >> > through
> > >> > > > > > >> > >> METplus. I will also add these variables to
the list
> > of
> > >> MET
> > >> > > > > configs
> > >> > > > > > >> that
> > >> > > > > > >> > >> users want to be able to easily configure
through
> > >> METplus
> > >> > > > > configs.*
> > >> > > > > > >> > >>
> > >> > > > > > >> > >> Please let me know if you run into any issues
> setting
> > >> any
> > >> > of
> > >> > > > that
> > >> > > > > > up.
> > >> > > > > > >> > >> Also,
> > >> > > > > > >> > >> if there are any other MET config variables
that you
> > >> want
> > >> > to
> > >> > > > see
> > >> > > > > > >> > supported
> > >> > > > > > >> > >> in METplus, let me know and I will make sure
they
> get
> > >> > > included
> > >> > > > > when
> > >> > > > > > >> we
> > >> > > > > > >> > >> have
> > >> > > > > > >> > >> a chance to refactor those wrappers. It is
possible
> to
> > >> add
> > >> > > > > support
> > >> > > > > > >> for
> > >> > > > > > >> > MET
> > >> > > > > > >> > >> configs using the above instructions, but it
is
> always
> > >> > easier
> > >> > > > and
> > >> > > > > > >> less
> > >> > > > > > >> > >> error-prone to have them configurable
directly
> > through a
> > >> > > > variable
> > >> > > > > > in
> > >> > > > > > >> the
> > >> > > > > > >> > >> METplus config.
> > >> > > > > > >> > >>
> > >> > > > > > >> > >> Thanks,
> > >> > > > > > >> > >> George
> > >> > > > > > >> > >>
> > >> > > > > > >> > >> On Tue, Jan 5, 2021 at 7:14 AM
Binbin.Zhou at noaa.gov
> > via
> > >> > RT <
> > >> > > > > > >> > >> met_help at ucar.edu> wrote:
> > >> > > > > > >> > >>
> > >> > > > > > >> > >> >
> > >> > > > > > >> > >> > Tue Jan 05 07:14:54 2021: Request 98116 was
acted
> > >> upon.
> > >> > > > > > >> > >> > Transaction: Ticket created by
> Binbin.Zhou at noaa.gov
> > >> > > > > > >> > >> > Queue: met_help
> > >> > > > > > >> > >> > Subject: CDP threshold setting in
> EnsembleStat
> > >> conf
> > >> > > > > > >> > >> > Owner: Nobody
> > >> > > > > > >> > >> > Requestors: Binbin.Zhou at noaa.gov
> > >> > > > > > >> > >> > Status: new
> > >> > > > > > >> > >> > Ticket <URL:
> > >> > > > > > >>
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
> > >> > > > > > >> > >
> > >> > > > > > >> > >> >
> > >> > > > > > >> > >> >
> > >> > > > > > >> > >> > George,
> > >> > > > > > >> > >> >
> > >> > > > > > >> > >> > Happy New Year!
> > >> > > > > > >> > >> >
> > >> > > > > > >> > >> > I am working on transition of our MET-
based
> > global
> > >> > > > ensemble
> > >> > > > > > >> > >> verification
> > >> > > > > > >> > >> > to METplus based package. In this package
> > climatology
> > >> > bins
> > >> > > > (10
> > >> > > > > > >> bins)
> > >> > > > > > >> > are
> > >> > > > > > >> > >> > used.
> > >> > > > > > >> > >> > In current ensemble stat config file, the
relevant
> > >> > entries
> > >> > > > iare
> > >> > > > > > >> > defined
> > >> > > > > > >> > >> > like following
> > >> > > > > > >> > >> >
> > >> > > > > > >> > >> > ens = {
> > >> > > > > > >> > >> > ens_thresh = 1.0;
> > >> > > > > > >> > >> > vld_thresh = 1.0;
> > >> > > > > > >> > >> >
> > >> > > > > > >> > >> > field = [
> > >> > > > > > >> > >> >
> > >> > > > > > >> > >> > {
> > >> > > > > > >> > >> > name = "HGT";
> > >> > > > > > >> > >> > level = "P500";
> > >> > > > > > >> > >> > obs_thresh = [ <=CDP10,
>CDP10&&<=CDP20,
> > >> > > > > > >CDP20&&<=CDP30,
> > >> > > > > > >> > >> > >CDP30&&<=CDP40, >CDP40&&<=CDP50,
>CDP50&&<=CDP60,
> > >> > > > > > >CDP60&&<=CDP70,
> > >> > > > > > >> > >> > >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];
> > >> > > > > > >> > >> > }
> > >> > > > > > >> > >> > ]
> > >> > > > > > >> > >> > }
> > >> > > > > > >> > >> > fcst = ens;
> > >> > > > > > >> > >> > obs = fcst;
> > >> > > > > > >> > >> > ens_ssvar_bin_size = 1000000;
> > >> > > > > > >> > >> > ens_phist_bin_size = 0.05;
> > >> > > > > > >> > >> > climo_mean = fcst;
> > >> > > > > > >> > >> > climo_mean = {
> > >> > > > > > >> > >> > file_name = "${CLIM_MEAN}";
> > >> > > > > > >> > >> > time_interp_method = DW_MEAN;
> > >> > > > > > >> > >> > match_day = TRUE;
> > >> > > > > > >> > >> > time_step = 21600;
> > >> > > > > > >> > >> > }
> > >> > > > > > >> > >> >
> > >> > > > > > >> > >> > climo_stdev = climo_mean;
> > >> > > > > > >> > >> > climo_stdev = {
> > >> > > > > > >> > >> > file_name = "${CLIM_STDV}";
> > >> > > > > > >> > >> > }
> > >> > > > > > >> > >> >
> > >> > > > > > >> > >> > climo_cdf = {
> > >> > > > > > >> > >> > cdf_bins = 11;
> > >> > > > > > >> > >> > center_bins = TRUE;
> > >> > > > > > >> > >> > write_bins = TRUE;
> > >> > > > > > >> > >> > }
> > >> > > > > > >> > >> >
> > >> > > > > > >> > >> > I can not find the correspondent settings
in its
> > conf
> > >> > file
> > >> > > > from
> > >> > > > > > >> > METplus
> > >> > > > > > >> > >> > online doc.
> > >> > > > > > >> > >> > Can you help me look at this?
> > >> > > > > > >> > >> >
> > >> > > > > > >> > >> > Thanks!
> > >> > > > > > >> > >> >
> > >> > > > > > >> > >> > Binbin
> > >> > > > > > >> > >> >
> > >> > > > > > >> > >> > --
> > >> > > > > > >> > >> >
> > >> > > > > > >> > >> > Binbin Zhou
> > >> > > > > > >> > >> >
> > >> > > > > > >> > >> > IMSG at NOAA/NWS/NCEP/EMC
> > >> > > > > > >> > >> >
> > >> > > > > > >> > >> > 5830 University Research Ct.
> > >> > > > > > >> > >> >
> > >> > > > > > >> > >> > College Park, MD 20740
> > >> > > > > > >> > >> >
> > >> > > > > > >> > >> > Binbin.Zhou at noaa.gov
> > >> > > > > > >> > >> >
> > >> > > > > > >> > >> > 301-683-3683
> > >> > > > > > >> > >> >
> > >> > > > > > >> > >> >
> > >> > > > > > >> > >>
> > >> > > > > > >> > >> --
> > >> > > > > > >> > >> George McCabe - Software Engineer III
> > >> > > > > > >> > >> National Center for Atmospheric Research
> > >> > > > > > >> > >> Research Applications Laboratory
> > >> > > > > > >> > >> 303-497-2768
> > >> > > > > > >> > >> ---
> > >> > > > > > >> > >> My working day may not be your working day.
Please
> do
> > >> not
> > >> > > feel
> > >> > > > > > >> obliged
> > >> > > > > > >> > to
> > >> > > > > > >> > >> reply to this email outside of your normal
working
> > >> hours.
> > >> > > > > > >> > >>
> > >> > > > > > >> > >>
> > >> > > > > > >> > >
> > >> > > > > > >> > > --
> > >> > > > > > >> > >
> > >> > > > > > >> > > Binbin Zhou
> > >> > > > > > >> > >
> > >> > > > > > >> > > IMSG at NOAA/NWS/NCEP/EMC
> > >> > > > > > >> > >
> > >> > > > > > >> > > 5830 University Research Ct.
> > >> > > > > > >> > >
> > >> > > > > > >> > > College Park, MD 20740
> > >> > > > > > >> > >
> > >> > > > > > >> > > Binbin.Zhou at noaa.gov
> > >> > > > > > >> > >
> > >> > > > > > >> > > 301-683-3683
> > >> > > > > > >> > >
> > >> > > > > > >> >
> > >> > > > > > >> >
> > >> > > > > > >> > --
> > >> > > > > > >> >
> > >> > > > > > >> > Binbin Zhou
> > >> > > > > > >> >
> > >> > > > > > >> > IMSG at NOAA/NWS/NCEP/EMC
> > >> > > > > > >> >
> > >> > > > > > >> > 5830 University Research Ct.
> > >> > > > > > >> >
> > >> > > > > > >> > College Park, MD 20740
> > >> > > > > > >> >
> > >> > > > > > >> > Binbin.Zhou at noaa.gov
> > >> > > > > > >> >
> > >> > > > > > >> > 301-683-3683
> > >> > > > > > >> >
> > >> > > > > > >> >
> > >> > > > > > >>
> > >> > > > > > >> --
> > >> > > > > > >> George McCabe - Software Engineer III
> > >> > > > > > >> National Center for Atmospheric Research
> > >> > > > > > >> Research Applications Laboratory
> > >> > > > > > >> 303-497-2768
> > >> > > > > > >> ---
> > >> > > > > > >> My working day may not be your working day. Please
do not
> > >> feel
> > >> > > > obliged
> > >> > > > > > to
> > >> > > > > > >> reply to this email outside of your normal working
hours.
> > >> > > > > > >>
> > >> > > > > > >>
> > >> > > > > > >
> > >> > > > > > > --
> > >> > > > > > >
> > >> > > > > > > Binbin Zhou
> > >> > > > > > >
> > >> > > > > > > IMSG at NOAA/NWS/NCEP/EMC
> > >> > > > > > >
> > >> > > > > > > 5830 University Research Ct.
> > >> > > > > > >
> > >> > > > > > > College Park, MD 20740
> > >> > > > > > >
> > >> > > > > > > Binbin.Zhou at noaa.gov
> > >> > > > > > >
> > >> > > > > > > 301-683-3683
> > >> > > > > > >
> > >> > > > > >
> > >> > > > > >
> > >> > > > > > --
> > >> > > > > >
> > >> > > > > > Binbin Zhou
> > >> > > > > >
> > >> > > > > > IMSG at NOAA/NWS/NCEP/EMC
> > >> > > > > >
> > >> > > > > > 5830 University Research Ct.
> > >> > > > > >
> > >> > > > > > College Park, MD 20740
> > >> > > > > >
> > >> > > > > > Binbin.Zhou at noaa.gov
> > >> > > > > >
> > >> > > > > > 301-683-3683
> > >> > > > > >
> > >> > > > > >
> > >> > > > >
> > >> > > > > --
> > >> > > > > George McCabe - Software Engineer III
> > >> > > > > National Center for Atmospheric Research
> > >> > > > > Research Applications Laboratory
> > >> > > > > 303-497-2768
> > >> > > > > ---
> > >> > > > > My working day may not be your working day. Please do
not feel
> > >> > obliged
> > >> > > to
> > >> > > > > reply to this email outside of your normal working
hours.
> > >> > > > >
> > >> > > > >
> > >> > > >
> > >> > > > --
> > >> > > >
> > >> > > > Binbin Zhou
> > >> > > >
> > >> > > > IMSG at NOAA/NWS/NCEP/EMC
> > >> > > >
> > >> > > > 5830 University Research Ct.
> > >> > > >
> > >> > > > College Park, MD 20740
> > >> > > >
> > >> > > > Binbin.Zhou at noaa.gov
> > >> > > >
> > >> > > > 301-683-3683
> > >> > > >
> > >> > > >
> > >> > >
> > >> > > --
> > >> > > George McCabe - Software Engineer III
> > >> > > National Center for Atmospheric Research
> > >> > > Research Applications Laboratory
> > >> > > 303-497-2768
> > >> > > ---
> > >> > > My working day may not be your working day. Please do not
feel
> > >> obliged to
> > >> > > reply to this email outside of your normal working hours.
> > >> > >
> > >> > >
> > >> >
> > >> > --
> > >> >
> > >> > Binbin Zhou
> > >> >
> > >> > IMSG at NOAA/NWS/NCEP/EMC
> > >> >
> > >> > 5830 University Research Ct.
> > >> >
> > >> > College Park, MD 20740
> > >> >
> > >> > Binbin.Zhou at noaa.gov
> > >> >
> > >> > 301-683-3683
> > >> >
> > >> >
> > >>
> > >> --
> > >> Julie Prestopnik (she/her)
> > >> Software Engineer
> > >> National Center for Atmospheric Research
> > >> Research Applications Laboratory
> > >> Email: jpresto at ucar.edu
> > >>
> > >> My working day may not be your working day. Please do not feel
> obliged
> > to
> > >> reply to this email outside of your normal working hours.
> > >>
> > >>
> > >
> > > --
> > >
> > > Binbin Zhou
> > >
> > > IMSG at NOAA/NWS/NCEP/EMC
> > >
> > > 5830 University Research Ct.
> > >
> > > College Park, MD 20740
> > >
> > > Binbin.Zhou at noaa.gov
> > >
> > > 301-683-3683
> > >
> >
> >
> > --
> >
> > Binbin Zhou
> >
> > IMSG at NOAA/NWS/NCEP/EMC
> >
> > 5830 University Research Ct.
> >
> > College Park, MD 20740
> >
> > Binbin.Zhou at noaa.gov
> >
> > 301-683-3683
> >
> >
>
> --
> Julie Prestopnik (she/her)
> Software Engineer
> National Center for Atmospheric Research
> Research Applications Laboratory
> Email: jpresto at ucar.edu
>
> My working day may not be your working day. Please do not feel
obliged to
> reply to this email outside of your normal working hours.
>
>
--
George McCabe - Software Engineer III
National Center for Atmospheric Research
Research Applications Laboratory
303-497-2768
---
My working day may not be your working day. Please do not feel obliged
to
reply to this email outside of your normal working hours.
------------------------------------------------
Subject: CDP threshold setting in EnsembleStat conf
From: Binbin.Zhou at noaa.gov
Time: Wed Jan 06 12:43:14 2021
George,
I have re-run the case with LOG_LEVEL=DEBUG and
LOG_ENSEMBLE_STAT_VERBOSITY =3.
The output log file has been sent to hera:
/scratch2/NCEPDEV/fv3-
cam/noscrub/Binbin.Zhou/metplus_test/metplus3.out/log/master_metplus.log.20210106193455
Please look at it.
Thanks!
Biinbin
On Wed, Jan 6, 2021 at 2:19 PM George McCabe <mccabe at ucar.edu> wrote:
> Hi Binbin,
>
> Thanks for putting those files on hera. The log output you sent
doesn't
> have the DEBUG level output (LOG_LEVEL=DEBUG). However, I tried to
run
> EnsembleStat locally using the _OPTIONS value you set and it seems
to run
> fine. The error seems to suggest that something went wrong when
computing
> the mean and standard deviation before the obs_thresh values are
applied. I
> have reached out to John HG to see if he has any insight as to why
that is
> happening. In the meantime, you could rerun with
> LOG_ENSEMBLE_STAT_VERBOSITY set to a higher value than 2 to see if
the
> extra log output from the MET tool gives you any more insight as to
what is
> going wrong.
>
> - George
>
> On Wed, Jan 6, 2021 at 9:51 AM Julie Prestopnik via RT
<met_help at ucar.edu>
> wrote:
>
>> Thanks for all of the info Binbin. I saw that you had copied
everything
>> to
>> hera for George. I am currently no longer on WCOSS, so I unless
George
>> lets me know that he needs something from WCOSS, I'll assume he is
able to
>> get it from hera.
>>
>> Julie
>>
>> On Wed, Jan 6, 2021 at 9:39 AM Binbin.Zhou at noaa.gov via RT <
>> met_help at ucar.edu> wrote:
>>
>> >
>> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116 >
>> >
>> > The EnsembleStat config file for the successful run outside of
METplus
>> is
>> >
>> >
>>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_met_global_ens1p0.v1.0.0/parm/verf_g2g_ens_stat_config_bin11
>> > on WCOSS
>> >
>> > Binbin
>> >
>> > On Wed, Jan 6, 2021 at 11:34 AM Binbin Zhou - NOAA Affiliate <
>> > binbin.zhou at noaa.gov> wrote:
>> >
>> > > Julie,
>> > >
>> > > The output directory on WCOSS is
>> > >
>> > >
>> >
>>
/gpfs/dell1/ptmp/Binbin.Zhou/g2g/RFC2/tmpnwprd/verf_g2g_gefs_00_dev.161076/metplus3.out
>> > >
>> > > My METplus package on WCOSS is
>> > >
>> >
>>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_g2g.v4.0.0
>> > >
>> > > For GEFS, the EnsembleGrid config file is
>> > >
>> > >
>> >
>>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_g2g.v4.0.0/parm/app_conf/grid2grid/met_config/EnsembleStatConfig_gefs_bin11
>> > > Its conf file
>> > > is
>> >
>>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_g2g.v4.0.0/parm/app_conf/grid2grid/gefs_conf/gefs_bin11.conf
>> > >
>> > > The running process is little bit complex since this is a
transition
>> to
>> > > future operational package that uses
>> > > mpi parallel: the script is
>> > >
>> > >
>> >
>>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_g2g.v4.0.0/ush/verf_g2g_metplus_run_gefs_mpi.sh
>> > >
>> > > Binbin
>> > >
>> > >
>> > >
>> > >
>> > > On Wed, Jan 6, 2021 at 11:00 AM Julie Prestopnik via RT <
>> > met_help at ucar.edu>
>> > > wrote:
>> > >
>> > >> Hi Binbin.
>> > >>
>> > >> This is Julie. I haven't been following this entire thread,
but I
>> am on
>> > >> WCOSS right now. If you send a path to a file, I can pull it
and
>> put it
>> > >> on
>> > >> our ftp server for George.
>> > >>
>> > >> Julie
>> > >>
>> > >> On Wed, Jan 6, 2021 at 8:57 AM Binbin.Zhou at noaa.gov via RT <
>> > >> met_help at ucar.edu> wrote:
>> > >>
>> > >> >
>> > >> > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116 >
>> > >> >
>> > >> > George,
>> > >> >
>> > >> > Can you access WCOSS or access HERA?
>> > >> > Otherwise I will email attached to you
>> > >> >
>> > >> > Binbin
>> > >> >
>> > >> >
>> > >> >
>> > >> > On Wed, Jan 6, 2021 at 10:46 AM George McCabe via RT <
>> > met_help at ucar.edu
>> > >> >
>> > >> > wrote:
>> > >> >
>> > >> > > Hi Binbin,
>> > >> > >
>> > >> > > Could you send me a log file for a run with
LOG_LEVEL=DEBUG (in
>> > >> METplus
>> > >> > > config) so I can see how the environment variable
ENS_FIELD is
>> set?
>> > >> The
>> > >> > > values of ENS_VAR<n>_* are formatted and set in this
environment
>> > >> variable
>> > >> > > which is passed into the MET config. You can compare that
value
>> with
>> > >> what
>> > >> > > you used in your successful run outside of the METplus
wrapper to
>> > >> > determine
>> > >> > > what is different.
>> > >> > >
>> > >> > > Thanks,
>> > >> > > George
>> > >> > >
>> > >> > > On Wed, Jan 6, 2021 at 7:11 AM Binbin.Zhou at noaa.gov via RT
<
>> > >> > > met_help at ucar.edu> wrote:
>> > >> > >
>> > >> > > >
>> > >> > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
>> >
>> > >> > > >
>> > >> > > > George,
>> > >> > > >
>> > >> > > > I got a new error in execution although some output
files (nc
>> > >> file)
>> > >> > are
>> > >> > > > created but stat files not.
>> > >> > > > The error message is
>> > >> > > >
>> > >> > > > ERROR :
>> > >> > > > ERROR : Simple_Node::check(double, double, double)
const ->
>> > >> > > climatological
>> > >> > > > distribution percentile threshold "<=CDP10" requested
with
>> invalid
>> > >> mean
>> > >> > > > (-9999) or standard deviation (-9999).
>> > >> > > > ERROR :
>> > >> > > >
>> > >> > > > Such an error was ever investigated by John H before
(year
>> ago):
>> > >> When I
>> > >> > > > directly ran ensemble_stat for global ensemble (not
>> METplus-based,
>> > >> > > > but hard code of all settings in EnsembleStat config
file): If
>> > hard
>> > >> > code
>> > >> > > > fcst field in EnsembleStat config file like this
>> > >> > > >
>> > >> > > > name = "HGT";
>> > >> > > > level = "P500";
>> > >> > > > cat_thresh = [ <=CDP10, >CDP10&&<=CDP20,
>> >CDP20&&<=CDP30,
>> > >> > > > >CDP30&&<=CDP40, >CDP40&&<=CDP50, >CDP50&&<=CDP60,
>> > >CDP60&&<=CDP70,
>> > >> > > > >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];
>> > >> > > >
>> > >> > > > Run ensemble_stat will have such error: ERROR :
>> > >> > > > Simple_Node::check(double, double, double) const ->
>> climatological
>> > >> > > > distribution percentile threshold "<=CDP10" requested
with
>> invalid
>> > >> mean
>> > >> > > > (-9999) or standard deviation (-9999).
>> > >> > > >
>> > >> > > > John H. suggested me change "cat_thresh = " to
"obs_thresh =
>> ",
>> > >> then
>> > >> > > the
>> > >> > > > error was solved.
>> > >> > > >
>> > >> > > > In current METplus version, following your suggestion as
>> > >> > > >
>> > >> > > > ENS_VAR1_OPTIONS = obs_thresh = [ <=CDP10,
>CDP10&&<=CDP20,
>> > >> > > > >CDP20&&<=CDP30, >CDP30&&<=CDP40, >CDP40&&<=CDP50,
>> > >CDP50&&<=CDP60,
>> > >> > > > >CDP60&&<=CDP70, >CDP70&&<=CDP80, >CDP80&&<=CDP90,
>CDP90 ];
>> > >> > > >
>> > >> > > > the same error appears again. So I am not for sure if
the
>> > >> > "obs_thresh"
>> > >> > > > setting is correctly passed.
>> > >> > > >
>> > >> > > > Binbin
>> > >> > > >
>> > >> > > >
>> > >> > > >
>> > >> > > >
>> > >> > > > On Tue, Jan 5, 2021 at 5:19 PM George McCabe via RT <
>> > >> met_help at ucar.edu
>> > >> > >
>> > >> > > > wrote:
>> > >> > > >
>> > >> > > > > Hi Binbin,
>> > >> > > > >
>> > >> > > > > Your solution should work for now. It looks like
although the
>> > >> METplus
>> > >> > > > > variable does get read properly, the environment
variable is
>> not
>> > >> > > actually
>> > >> > > > > set by the EnsembleStat wrapper. I can make a note to
add
>> that
>> > for
>> > >> > > 4.0.0,
>> > >> > > > > as it is an easy fix.
>> > >> > > > >
>> > >> > > > > - George
>> > >> > > > >
>> > >> > > > > On Tue, Jan 5, 2021 at 2:53 PM Binbin.Zhou at noaa.gov
via RT <
>> > >> > > > > met_help at ucar.edu> wrote:
>> > >> > > > >
>> > >> > > > > > George,
>> > >> > > > > >
>> > >> > > > > > I have a temporal solution:
>> > >> > > > > > set ploy in EnembleStat config as
>> > >> > > > > > poly = [ "${MASKPATH}/lat_NHM.nc",
>> > >> > > > > > "${MASKPATH}/lat_NHM.nc",
>> > >> > > > > > "${MASKPATH}/lat_TRP.nc" ];
>> > >> > > > > >
>> > >> > > > > > then set MASKPATH in user_env_vars part in the conf
file
>> > >> > > > > > This MASKPAH then can be passed to EnsembleStat's
poly [ ]
>> > entry
>> > >> > > > > >
>> > >> > > > > > Binbin
>> > >> > > > > >
>> > >> > > > > > On Tue, Jan 5, 2021 at 4:25 PM Binbin Zhou - NOAA
>> Affiliate <
>> > >> > > > > > binbin.zhou at noaa.gov> wrote:
>> > >> > > > > >
>> > >> > > > > > > George,
>> > >> > > > > > >
>> > >> > > > > > > Still not working, error says
>> > >> > > > > > > ERROR : replace_env() -> unable to get value for
>> > environment
>> > >> > > > variable
>> > >> > > > > > > "VERIF_MASK"
>> > >> > > > > > >
>> > >> > > > > > > Binbin
>> > >> > > > > > >
>> > >> > > > > > >
>> > >> > > > > > >
>> > >> > > > > > > On Tue, Jan 5, 2021 at 3:50 PM George McCabe via
RT <
>> > >> > > > met_help at ucar.edu
>> > >> > > > > >
>> > >> > > > > > > wrote:
>> > >> > > > > > >
>> > >> > > > > > >> Hi Binbin,
>> > >> > > > > > >>
>> > >> > > > > > >> You should be able to set it in the METplus
config the
>> same
>> > >> way
>> > >> > it
>> > >> > > > is
>> > >> > > > > > done
>> > >> > > > > > >> for GridStat -- no quotes with commas between
each item.
>> > The
>> > >> > > wrapper
>> > >> > > > > > >> should
>> > >> > > > > > >> format it properly.
>> > >> > > > > > >>
>> > >> > > > > > >> Here is an example from an existing use case:
>> > >> > > > > > >>
>> > >> > > > > > >> GRID_STAT_VERIFICATION_MASK_TEMPLATE =
>> > >> > > > > > >>
>> > >> > >
>>
{INPUT_BASE}/model_applications/precipitation/mask/CONUS_HRRRTLE.nc,
>> > >> > > > > > >>
>> > >> > >
>> {INPUT_BASE}/model_applications/precipitation/mask/EAST_HRRRTLE.nc,
>> > >> > > > > > >>
>> > >> >
{INPUT_BASE}/model_applications/precipitation/mask/WEST_HRRRTLE.nc
>> > >> > > > > > >>
>> > >> > > > > > >> You should be able to set them the same way using
>> > >> > > > > > >> ENSEMBLE_STAT_VERIFICATION_MASK_TEMPLATE. Let me
know if
>> > that
>> > >> > > > doesn't
>> > >> > > > > > >> work.
>> > >> > > > > > >>
>> > >> > > > > > >> - George
>> > >> > > > > > >>
>> > >> > > > > > >> On Tue, Jan 5, 2021 at 1:45 PM
Binbin.Zhou at noaa.gov via
>> > RT <
>> > >> > > > > > >> met_help at ucar.edu> wrote:
>> > >> > > > > > >>
>> > >> > > > > > >> >
>> > >> > > > > > >> > <URL:
>> > >> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
>> > >> > >
>> > >> > > > > > >> >
>> > >> > > > > > >> > George,
>> > >> > > > > > >> >
>> > >> > > > > > >> > I got another issue for verification mask
setting.
>> > >> > > > > > >> >
>> > >> > > > > > >> > I am using $VERIF_MASK in EnsembleStat config
f/ile
>> > >> > > > > > >> > mask = {
>> > >> > > > > > >> > grid = [];
>> > >> > > > > > >> > poly = [${VERIF_MASK}];
>> > >> > > > > > >> > sid = [];
>> > >> > > > > > >> > }
>> > >> > > > > > >> >
>> > >> > > > > > >> > And using GRID_STAT_VERIFICATION_MASK_TEMPLATE
to
>> define
>> > >> > > several
>> > >> > > > > > >> polygon
>> > >> > > > > > >> > nc mask files
>> > >> > > > > > >> > But it seems not working. But it works for
Gridstat
>> > config
>> > >> in
>> > >> > > > suich
>> > >> > > > > > >> > setting.
>> > >> > > > > > >> > I can not find ENSEMBLE_STAT_
>> VERIFICATION_MASK_TEMPLATE
>> > in
>> > >> > the
>> > >> > > > > > METplus
>> > >> > > > > > >> doc
>> > >> > > > > > >> >
>> > >> > > > > > >> > So I define VERIF_MASK in [user_env_vars] part.
>> > >> > > > > > >> > It values can not be passed to ploy =
[${VERIF_MASK}]
>> in
>> > >> the
>> > >> > > > > > >> EnsembleStat
>> > >> > > > > > >> > conf if more than one nc files included.
>> > >> > > > > > >> > For example
>> > >> > > > > > >> > VERIF_MASK=" '/part/p1.cn', '/path/p2.nc' "
>> > >> > > > > > >> > the error says poly = [/path/p1,]
>> > >> > > > > > >> > It seems double quote or single quote can not
be
>> passed
>> > to
>> > >> > > > > VERIF_MASK
>> > >> > > > > > in
>> > >> > > > > > >> > the EnsembleStat config.
>> > >> > > > > > >> > I tried use back slash \ to before quote, but
still
>> not
>> > >> > working
>> > >> > > > > > >> >
>> > >> > > > > > >> > Binbin
>> > >> > > > > > >> >
>> > >> > > > > > >> >
>> > >> > > > > > >> > On Tue, Jan 5, 2021 at 10:33 AM Binbin Zhou -
NOAA
>> > >> Affiliate <
>> > >> > > > > > >> > binbin.zhou at noaa.gov> wrote:
>> > >> > > > > > >> >
>> > >> > > > > > >> > > George,
>> > >> > > > > > >> > >
>> > >> > > > > > >> > > Thanks for your quick response! I'll test
this
>> > >> settings
>> > >> > and
>> > >> > > > let
>> > >> > > > > > >> > > you know the results.
>> > >> > > > > > >> > >
>> > >> > > > > > >> > > Binbin
>> > >> > > > > > >> > >
>> > >> > > > > > >> > > On Tue, Jan 5, 2021 at 10:17 AM George McCabe
via
>> RT <
>> > >> > > > > > >> met_help at ucar.edu>
>> > >> > > > > > >> > > wrote:
>> > >> > > > > > >> > >
>> > >> > > > > > >> > >> Hi Binbin,
>> > >> > > > > > >> > >>
>> > >> > > > > > >> > >> Happy New Year to you too!
>> > >> > > > > > >> > >>
>> > >> > > > > > >> > >> I will comment on each configuration
variable and
>> how
>> > to
>> > >> > set
>> > >> > > it
>> > >> > > > > in
>> > >> > > > > > a
>> > >> > > > > > >> > >> METplus config inline:
>> > >> > > > > > >> > >>
>> > >> > > > > > >> > >> ens = {
>> > >> > > > > > >> > >> ens_thresh = 1.0;
>> > >> > > > > > >> > >>
>> > >> > > > > > >> > >>
>> > >> > > > > > >> > >> *This is controlled by the
ENSEMBLE_STAT_ENS_THRESH
>> > >> > variable.
>> > >> > > > The
>> > >> > > > > > >> > default
>> > >> > > > > > >> > >> value is 1.0, so you don't need to include
it in
>> your
>> > >> > config
>> > >> > > > > file,
>> > >> > > > > > >> but
>> > >> > > > > > >> > you
>> > >> > > > > > >> > >> can if you may adjust this value at some
point.*
>> > >> > > > > > >> > >>
>> > >> > > > > > >> > >> vld_thresh = 1.0;
>> > >> > > > > > >> > >>
>> > >> > > > > > >> > >> *This value is set to 1.0 by default so we
don't
>> need
>> > to
>> > >> > > worry
>> > >> > > > > > about
>> > >> > > > > > >> it
>> > >> > > > > > >> > >> right now.*
>> > >> > > > > > >> > >>
>> > >> > > > > > >> > >> field = [
>> > >> > > > > > >> > >>
>> > >> > > > > > >> > >> {
>> > >> > > > > > >> > >> name = "HGT";
>> > >> > > > > > >> > >> level = "P500";
>> > >> > > > > > >> > >> obs_thresh = [ <=CDP10,
>CDP10&&<=CDP20,
>> > >> > > > > >CDP20&&<=CDP30,
>> > >> > > > > > >> > >> >CDP30&&<=CDP40, >CDP40&&<=CDP50,
>CDP50&&<=CDP60,
>> > >> > > > > >CDP60&&<=CDP70,
>> > >> > > > > > >> > >> >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];
>> > >> > > > > > >> > >> }
>> > >> > > > > > >> > >> ]
>> > >> > > > > > >> > >> }
>> > >> > > > > > >> > >> fcst = ens;
>> > >> > > > > > >> > >> obs = fcst;
>> > >> > > > > > >> > >>
>> > >> > > > > > >> > >> *1) The field info for ens is set in the
>> > >> > > > > > >> > >> ENS_VAR<n>_[NAME/LEVEL/THRESH/OPTIONS]
variables.
>> The
>> > >> fcst
>> > >> > > and
>> > >> > > > > obs
>> > >> > > > > > >> field
>> > >> > > > > > >> > >> info are set in the corresponding
FCST_VAR<n>_* and
>> > >> > > > OBS_VAR<n>_*
>> > >> > > > > > >> > variables
>> > >> > > > > > >> > >> respectively, or you can use BOTH_VAR<n>_*
if the
>> FCST
>> > >> and
>> > >> > > OBS
>> > >> > > > > > values
>> > >> > > > > > >> > are
>> > >> > > > > > >> > >> the same.*
>> > >> > > > > > >> > >>
>> > >> > > > > > >> > >> *If ENS_VAR<n>_* variables are not
explicitly set,
>> > then
>> > >> it
>> > >> > > will
>> > >> > > > > use
>> > >> > > > > > >> the
>> > >> > > > > > >> > >> values from FCST_VAR<n>_*.*
>> > >> > > > > > >> > >> *Since the fcst, obs, and ens are all the
same you
>> > could
>> > >> > just
>> > >> > > > use
>> > >> > > > > > >> > >> BOTH_VAR<n>_* variables to control all 3,
although
>> > keep
>> > >> in
>> > >> > > mind
>> > >> > > > > > that
>> > >> > > > > > >> if
>> > >> > > > > > >> > >> you
>> > >> > > > > > >> > >> need to change one of them for any reason,
it will
>> be
>> > >> more
>> > >> > > > > > difficult
>> > >> > > > > > >> to
>> > >> > > > > > >> > do
>> > >> > > > > > >> > >> this. If you know that they will always be
the same
>> > >> values,
>> > >> > > > then
>> > >> > > > > I
>> > >> > > > > > >> > >> recommend using BOTH_, but if you know they
may
>> change
>> > >> or
>> > >> > are
>> > >> > > > > > >> unsure, I
>> > >> > > > > > >> > >> would recommend setting them by referencing
the
>> other
>> > >> > > > variables,
>> > >> > > > > > >> i.e.*
>> > >> > > > > > >> > >>
>> > >> > > > > > >> > >> *FCST_VAR1_NAME = HGT*
>> > >> > > > > > >> > >> *FCST_VAR1_LEVELS = P500 *
>> > >> > > > > > >> > >> *OBS_VAR1_NAME = {FCST_VAR1_NAME}*
>> > >> > > > > > >> > >> *OBS_VAR1_LEVELS = {FCST_VAR1_LEVELS}*
>> > >> > > > > > >> > >>
>> > >> > > > > > >> > >> *2) The [FCST/OBS/ENS]_VAR<n>_THRESH
variables set
>> the
>> > >> > > > cat_thresh
>> > >> > > > > > >> values
>> > >> > > > > > >> > >> in
>> > >> > > > > > >> > >> the field info. A variable specific to
obs_thresh
>> is
>> > not
>> > >> > > > > currently
>> > >> > > > > > >> > >> supported, however you can set these values
by
>> using
>> > the
>> > >> > > > > > >> > ENS_VAR1_OPTIONS
>> > >> > > > > > >> > >> variable, i.e.*
>> > >> > > > > > >> > >>
>> > >> > > > > > >> > >> *ENS_VAR1_OPTIONS = obs_thresh = [ <=CDP10,
>> > >> > >CDP10&&<=CDP20,
>> > >> > > > > > >> > >> >CDP20&&<=CDP30, >CDP30&&<=CDP40,
>CDP40&&<=CDP50,
>> > >> > > > > >CDP50&&<=CDP60,
>> > >> > > > > > >> > >> >CDP60&&<=CDP70, >CDP70&&<=CDP80,
>CDP80&&<=CDP90,
>> > >> >CDP90
>> > >> > ];*
>> > >> > > > > > >> > >>
>> > >> > > > > > >> > >>
>> > >> > > > > > >> > >> *Remember to include the semicolon at the
end! *
>> > >> > > > > > >> > >>
>> > >> > > > > > >> > >> ens_ssvar_bin_size = 1000000;
>> > >> > > > > > >> > >> *1) This variable is different from the
default and
>> > not
>> > >> > > > currently
>> > >> > > > > > >> > >> supported
>> > >> > > > > > >> > >> with a METplus config variable. I will add
this to
>> the
>> > >> list
>> > >> > > of
>> > >> > > > > > >> variables
>> > >> > > > > > >> > >> in
>> > >> > > > > > >> > >> MET config files that we want to support.
However,
>> in
>> > >> the
>> > >> > > > > meantime
>> > >> > > > > > >> you
>> > >> > > > > > >> > can
>> > >> > > > > > >> > >> copy the default wrapped MET config file and
>> modify it
>> > >> to
>> > >> > fit
>> > >> > > > > your
>> > >> > > > > > >> > needs.
>> > >> > > > > > >> > >> To do this, you will need to:*
>> > >> > > > > > >> > >>
>> > >> > > > > > >> > >> * a) Copy
>> > >> > METplus/parm/met_config/EnsembleStatConfig_wrapped
>> > >> > > > to
>> > >> > > > > > the
>> > >> > > > > > >> > >> directory that contains your METplus config
file
>> for
>> > >> this
>> > >> > use
>> > >> > > > > case.
>> > >> > > > > > >> > Rename
>> > >> > > > > > >> > >> it by replacing "wrapped" with a short
description
>> > that
>> > >> > > > pertains
>> > >> > > > > to
>> > >> > > > > > >> your
>> > >> > > > > > >> > >> use case.*
>> > >> > > > > > >> > >>
>> > >> > > > > > >> > >> * b) In your METplus config file, change
the
>> value of
>> > >> > > > > > >> > >> ENSEMBLE_STAT_CONFIG_FILE to point to the
path of
>> this
>> > >> new
>> > >> > > > config
>> > >> > > > > > >> file.*
>> > >> > > > > > >> > >>
>> > >> > > > > > >> > >> * c) If you know the value you want to use
for
>> this
>> > >> > variable
>> > >> > > > > will
>> > >> > > > > > >> > always
>> > >> > > > > > >> > >> be 1000000, then simply set the variable to
that
>> > value.
>> > >> If
>> > >> > > you
>> > >> > > > > > think
>> > >> > > > > > >> you
>> > >> > > > > > >> > >> may want to change the value, then you can
utilize
>> the
>> > >> > > > > > >> [user_env_vars]
>> > >> > > > > > >> > >> functionality. See:
>> > >> > > > > > >> > >>
>> > >> > > > > > >> > >>
>> > >> > > > > > >> >
>> > >> > > > > > >>
>> > >> > > > > >
>> > >> > > > >
>> > >> > > >
>> > >> > >
>> > >> >
>> > >>
>> >
>>
https://dtcenter.github.io/METplus/latest/Users_Guide/systemconfiguration.html#user-
defined-config
>> > >> > > > > > >> > >> <
>> > >> > > > > > >> > >>
>> > >> > > > > > >> >
>> > >> > > > > > >>
>> > >> > > > > >
>> > >> > > > >
>> > >> > > >
>> > >> > >
>> > >> >
>> > >>
>> >
>>
https://dtcenter.github.io/METplus/latest/Users_Guide/systemconfiguration.html#user-
defined-config
>> > >> > > > > > >> > >> >*
>> > >> > > > > > >> > >> *In this case, you would add the following
to your
>> > >> METplus
>> > >> > > > > config:*
>> > >> > > > > > >> > >>
>> > >> > > > > > >> > >> *[user_env_vars]*
>> > >> > > > > > >> > >> *ENS_SSVAR_BIN_SIZE = 1000000*
>> > >> > > > > > >> > >>
>> > >> > > > > > >> > >> *Then change the line in your EnsembleStat
config
>> file
>> > >> that
>> > >> > > you
>> > >> > > > > > >> copied
>> > >> > > > > > >> > >> to:*
>> > >> > > > > > >> > >>
>> > >> > > > > > >> > >> * ens_ssvar_bin_size =
${ENS_SSVAR_BIN_SIZE}; *
>> > >> > > > > > >> > >>
>> > >> > > > > > >> > >> ens_phist_bin_size = 0.05;
>> > >> > > > > > >> > >> *This variable uses the default value, so
you don't
>> > >> need to
>> > >> > > do
>> > >> > > > > > >> anything
>> > >> > > > > > >> > >> here. If you need to make it configurable or
change
>> > the
>> > >> > > value,
>> > >> > > > > then
>> > >> > > > > > >> > follow
>> > >> > > > > > >> > >> the instructions for setting
ens_ssvar_bin_size.*
>> > >> > > > > > >> > >>
>> > >> > > > > > >> > >> climo_mean = fcst;
>> > >> > > > > > >> > >> climo_mean = {
>> > >> > > > > > >> > >> file_name = "${CLIM_MEAN}";
>> > >> > > > > > >> > >> time_interp_method = DW_MEAN;
>> > >> > > > > > >> > >> match_day = TRUE;
>> > >> > > > > > >> > >> time_step = 21600;
>> > >> > > > > > >> > >> }
>> > >> > > > > > >> > >>
>> > >> > > > > > >> > >>
>> > >> > > > > > >> > >> *Instead of using CLIM_MEAN, you can set
>> > >> > > > > > >> > >>
ENSEMBLE_STAT_CLIMO_MEAN_INPUT_[DIR/TEMPLATE] in
>> the
>> > >> > METplus
>> > >> > > > > > config.
>> > >> > > > > > >> You
>> > >> > > > > > >> > >> can use filename template syntax in the
_TEMPLATE
>> > value,
>> > >> > i.e.
>> > >> > > > > > >> > >> {valid?fmt=%m%d}. The other variables in the
>> > climo_mean
>> > >> > > > > dictionary
>> > >> > > > > > >> are
>> > >> > > > > > >> > >> actually old variables that have been
replaced with
>> > >> > > > day_interval
>> > >> > > > > > and
>> > >> > > > > > >> > >> hour_interval, but the values you use are
the old
>> > >> defaults,
>> > >> > > so
>> > >> > > > > you
>> > >> > > > > > >> > >> shouldn't need to set them.*
>> > >> > > > > > >> > >>
>> > >> > > > > > >> > >> climo_stdev = climo_mean;
>> > >> > > > > > >> > >> climo_stdev = {
>> > >> > > > > > >> > >> file_name = "${CLIM_STDV}";
>> > >> > > > > > >> > >> }
>> > >> > > > > > >> > >>
>> > >> > > > > > >> > >> *Similarly to CLIM_MEAN, you can use
>> > >> > > > > > >> > >>
ENSEMBLE_STAT_CLIMO_STDEV_INPUT_[DIR/TEMPLATE] to
>> set
>> > >> this
>> > >> > > file
>> > >> > > > > > >> name.*
>> > >> > > > > > >> > >>
>> > >> > > > > > >> > >> climo_cdf = {
>> > >> > > > > > >> > >> cdf_bins = 11;
>> > >> > > > > > >> > >> center_bins = TRUE;
>> > >> > > > > > >> > >> write_bins = TRUE;
>> > >> > > > > > >> > >> }
>> > >> > > > > > >> > >> *The value for write_bins is the default,
but the
>> > values
>> > >> > for
>> > >> > > > > > cdf_bins
>> > >> > > > > > >> > and
>> > >> > > > > > >> > >> center_bins do not. To set these, follow the
above
>> > >> > > instructions
>> > >> > > > > for
>> > >> > > > > > >> > >> ens_ssvar_bin_size to override them and/or
make
>> them
>> > >> > > > configurable
>> > >> > > > > > >> > through
>> > >> > > > > > >> > >> METplus. I will also add these variables to
the
>> list
>> > of
>> > >> MET
>> > >> > > > > configs
>> > >> > > > > > >> that
>> > >> > > > > > >> > >> users want to be able to easily configure
through
>> > >> METplus
>> > >> > > > > configs.*
>> > >> > > > > > >> > >>
>> > >> > > > > > >> > >> Please let me know if you run into any
issues
>> setting
>> > >> any
>> > >> > of
>> > >> > > > that
>> > >> > > > > > up.
>> > >> > > > > > >> > >> Also,
>> > >> > > > > > >> > >> if there are any other MET config variables
that
>> you
>> > >> want
>> > >> > to
>> > >> > > > see
>> > >> > > > > > >> > supported
>> > >> > > > > > >> > >> in METplus, let me know and I will make sure
they
>> get
>> > >> > > included
>> > >> > > > > when
>> > >> > > > > > >> we
>> > >> > > > > > >> > >> have
>> > >> > > > > > >> > >> a chance to refactor those wrappers. It is
>> possible to
>> > >> add
>> > >> > > > > support
>> > >> > > > > > >> for
>> > >> > > > > > >> > MET
>> > >> > > > > > >> > >> configs using the above instructions, but it
is
>> always
>> > >> > easier
>> > >> > > > and
>> > >> > > > > > >> less
>> > >> > > > > > >> > >> error-prone to have them configurable
directly
>> > through a
>> > >> > > > variable
>> > >> > > > > > in
>> > >> > > > > > >> the
>> > >> > > > > > >> > >> METplus config.
>> > >> > > > > > >> > >>
>> > >> > > > > > >> > >> Thanks,
>> > >> > > > > > >> > >> George
>> > >> > > > > > >> > >>
>> > >> > > > > > >> > >> On Tue, Jan 5, 2021 at 7:14 AM
>> Binbin.Zhou at noaa.gov
>> > via
>> > >> > RT <
>> > >> > > > > > >> > >> met_help at ucar.edu> wrote:
>> > >> > > > > > >> > >>
>> > >> > > > > > >> > >> >
>> > >> > > > > > >> > >> > Tue Jan 05 07:14:54 2021: Request 98116
was acted
>> > >> upon.
>> > >> > > > > > >> > >> > Transaction: Ticket created by
>> Binbin.Zhou at noaa.gov
>> > >> > > > > > >> > >> > Queue: met_help
>> > >> > > > > > >> > >> > Subject: CDP threshold setting in
>> EnsembleStat
>> > >> conf
>> > >> > > > > > >> > >> > Owner: Nobody
>> > >> > > > > > >> > >> > Requestors: Binbin.Zhou at noaa.gov
>> > >> > > > > > >> > >> > Status: new
>> > >> > > > > > >> > >> > Ticket <URL:
>> > >> > > > > > >>
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
>> > >> > > > > > >> > >
>> > >> > > > > > >> > >> >
>> > >> > > > > > >> > >> >
>> > >> > > > > > >> > >> > George,
>> > >> > > > > > >> > >> >
>> > >> > > > > > >> > >> > Happy New Year!
>> > >> > > > > > >> > >> >
>> > >> > > > > > >> > >> > I am working on transition of our MET-
based
>> > global
>> > >> > > > ensemble
>> > >> > > > > > >> > >> verification
>> > >> > > > > > >> > >> > to METplus based package. In this package
>> > climatology
>> > >> > bins
>> > >> > > > (10
>> > >> > > > > > >> bins)
>> > >> > > > > > >> > are
>> > >> > > > > > >> > >> > used.
>> > >> > > > > > >> > >> > In current ensemble stat config file, the
>> relevant
>> > >> > entries
>> > >> > > > iare
>> > >> > > > > > >> > defined
>> > >> > > > > > >> > >> > like following
>> > >> > > > > > >> > >> >
>> > >> > > > > > >> > >> > ens = {
>> > >> > > > > > >> > >> > ens_thresh = 1.0;
>> > >> > > > > > >> > >> > vld_thresh = 1.0;
>> > >> > > > > > >> > >> >
>> > >> > > > > > >> > >> > field = [
>> > >> > > > > > >> > >> >
>> > >> > > > > > >> > >> > {
>> > >> > > > > > >> > >> > name = "HGT";
>> > >> > > > > > >> > >> > level = "P500";
>> > >> > > > > > >> > >> > obs_thresh = [ <=CDP10,
>CDP10&&<=CDP20,
>> > >> > > > > > >CDP20&&<=CDP30,
>> > >> > > > > > >> > >> > >CDP30&&<=CDP40, >CDP40&&<=CDP50,
>> >CDP50&&<=CDP60,
>> > >> > > > > > >CDP60&&<=CDP70,
>> > >> > > > > > >> > >> > >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90
];
>> > >> > > > > > >> > >> > }
>> > >> > > > > > >> > >> > ]
>> > >> > > > > > >> > >> > }
>> > >> > > > > > >> > >> > fcst = ens;
>> > >> > > > > > >> > >> > obs = fcst;
>> > >> > > > > > >> > >> > ens_ssvar_bin_size = 1000000;
>> > >> > > > > > >> > >> > ens_phist_bin_size = 0.05;
>> > >> > > > > > >> > >> > climo_mean = fcst;
>> > >> > > > > > >> > >> > climo_mean = {
>> > >> > > > > > >> > >> > file_name = "${CLIM_MEAN}";
>> > >> > > > > > >> > >> > time_interp_method = DW_MEAN;
>> > >> > > > > > >> > >> > match_day = TRUE;
>> > >> > > > > > >> > >> > time_step = 21600;
>> > >> > > > > > >> > >> > }
>> > >> > > > > > >> > >> >
>> > >> > > > > > >> > >> > climo_stdev = climo_mean;
>> > >> > > > > > >> > >> > climo_stdev = {
>> > >> > > > > > >> > >> > file_name = "${CLIM_STDV}";
>> > >> > > > > > >> > >> > }
>> > >> > > > > > >> > >> >
>> > >> > > > > > >> > >> > climo_cdf = {
>> > >> > > > > > >> > >> > cdf_bins = 11;
>> > >> > > > > > >> > >> > center_bins = TRUE;
>> > >> > > > > > >> > >> > write_bins = TRUE;
>> > >> > > > > > >> > >> > }
>> > >> > > > > > >> > >> >
>> > >> > > > > > >> > >> > I can not find the correspondent settings
in its
>> > conf
>> > >> > file
>> > >> > > > from
>> > >> > > > > > >> > METplus
>> > >> > > > > > >> > >> > online doc.
>> > >> > > > > > >> > >> > Can you help me look at this?
>> > >> > > > > > >> > >> >
>> > >> > > > > > >> > >> > Thanks!
>> > >> > > > > > >> > >> >
>> > >> > > > > > >> > >> > Binbin
>> > >> > > > > > >> > >> >
>> > >> > > > > > >> > >> > --
>> > >> > > > > > >> > >> >
>> > >> > > > > > >> > >> > Binbin Zhou
>> > >> > > > > > >> > >> >
>> > >> > > > > > >> > >> > IMSG at NOAA/NWS/NCEP/EMC
>> > >> > > > > > >> > >> >
>> > >> > > > > > >> > >> > 5830 University Research Ct.
>> > >> > > > > > >> > >> >
>> > >> > > > > > >> > >> > College Park, MD 20740
>> > >> > > > > > >> > >> >
>> > >> > > > > > >> > >> > Binbin.Zhou at noaa.gov
>> > >> > > > > > >> > >> >
>> > >> > > > > > >> > >> > 301-683-3683
>> > >> > > > > > >> > >> >
>> > >> > > > > > >> > >> >
>> > >> > > > > > >> > >>
>> > >> > > > > > >> > >> --
>> > >> > > > > > >> > >> George McCabe - Software Engineer III
>> > >> > > > > > >> > >> National Center for Atmospheric Research
>> > >> > > > > > >> > >> Research Applications Laboratory
>> > >> > > > > > >> > >> 303-497-2768
>> > >> > > > > > >> > >> ---
>> > >> > > > > > >> > >> My working day may not be your working day.
Please
>> do
>> > >> not
>> > >> > > feel
>> > >> > > > > > >> obliged
>> > >> > > > > > >> > to
>> > >> > > > > > >> > >> reply to this email outside of your normal
working
>> > >> hours.
>> > >> > > > > > >> > >>
>> > >> > > > > > >> > >>
>> > >> > > > > > >> > >
>> > >> > > > > > >> > > --
>> > >> > > > > > >> > >
>> > >> > > > > > >> > > Binbin Zhou
>> > >> > > > > > >> > >
>> > >> > > > > > >> > > IMSG at NOAA/NWS/NCEP/EMC
>> > >> > > > > > >> > >
>> > >> > > > > > >> > > 5830 University Research Ct.
>> > >> > > > > > >> > >
>> > >> > > > > > >> > > College Park, MD 20740
>> > >> > > > > > >> > >
>> > >> > > > > > >> > > Binbin.Zhou at noaa.gov
>> > >> > > > > > >> > >
>> > >> > > > > > >> > > 301-683-3683
>> > >> > > > > > >> > >
>> > >> > > > > > >> >
>> > >> > > > > > >> >
>> > >> > > > > > >> > --
>> > >> > > > > > >> >
>> > >> > > > > > >> > Binbin Zhou
>> > >> > > > > > >> >
>> > >> > > > > > >> > IMSG at NOAA/NWS/NCEP/EMC
>> > >> > > > > > >> >
>> > >> > > > > > >> > 5830 University Research Ct.
>> > >> > > > > > >> >
>> > >> > > > > > >> > College Park, MD 20740
>> > >> > > > > > >> >
>> > >> > > > > > >> > Binbin.Zhou at noaa.gov
>> > >> > > > > > >> >
>> > >> > > > > > >> > 301-683-3683
>> > >> > > > > > >> >
>> > >> > > > > > >> >
>> > >> > > > > > >>
>> > >> > > > > > >> --
>> > >> > > > > > >> George McCabe - Software Engineer III
>> > >> > > > > > >> National Center for Atmospheric Research
>> > >> > > > > > >> Research Applications Laboratory
>> > >> > > > > > >> 303-497-2768
>> > >> > > > > > >> ---
>> > >> > > > > > >> My working day may not be your working day.
Please do
>> not
>> > >> feel
>> > >> > > > obliged
>> > >> > > > > > to
>> > >> > > > > > >> reply to this email outside of your normal
working
>> hours.
>> > >> > > > > > >>
>> > >> > > > > > >>
>> > >> > > > > > >
>> > >> > > > > > > --
>> > >> > > > > > >
>> > >> > > > > > > Binbin Zhou
>> > >> > > > > > >
>> > >> > > > > > > IMSG at NOAA/NWS/NCEP/EMC
>> > >> > > > > > >
>> > >> > > > > > > 5830 University Research Ct.
>> > >> > > > > > >
>> > >> > > > > > > College Park, MD 20740
>> > >> > > > > > >
>> > >> > > > > > > Binbin.Zhou at noaa.gov
>> > >> > > > > > >
>> > >> > > > > > > 301-683-3683
>> > >> > > > > > >
>> > >> > > > > >
>> > >> > > > > >
>> > >> > > > > > --
>> > >> > > > > >
>> > >> > > > > > Binbin Zhou
>> > >> > > > > >
>> > >> > > > > > IMSG at NOAA/NWS/NCEP/EMC
>> > >> > > > > >
>> > >> > > > > > 5830 University Research Ct.
>> > >> > > > > >
>> > >> > > > > > College Park, MD 20740
>> > >> > > > > >
>> > >> > > > > > Binbin.Zhou at noaa.gov
>> > >> > > > > >
>> > >> > > > > > 301-683-3683
>> > >> > > > > >
>> > >> > > > > >
>> > >> > > > >
>> > >> > > > > --
>> > >> > > > > George McCabe - Software Engineer III
>> > >> > > > > National Center for Atmospheric Research
>> > >> > > > > Research Applications Laboratory
>> > >> > > > > 303-497-2768
>> > >> > > > > ---
>> > >> > > > > My working day may not be your working day. Please do
not
>> feel
>> > >> > obliged
>> > >> > > to
>> > >> > > > > reply to this email outside of your normal working
hours.
>> > >> > > > >
>> > >> > > > >
>> > >> > > >
>> > >> > > > --
>> > >> > > >
>> > >> > > > Binbin Zhou
>> > >> > > >
>> > >> > > > IMSG at NOAA/NWS/NCEP/EMC
>> > >> > > >
>> > >> > > > 5830 University Research Ct.
>> > >> > > >
>> > >> > > > College Park, MD 20740
>> > >> > > >
>> > >> > > > Binbin.Zhou at noaa.gov
>> > >> > > >
>> > >> > > > 301-683-3683
>> > >> > > >
>> > >> > > >
>> > >> > >
>> > >> > > --
>> > >> > > George McCabe - Software Engineer III
>> > >> > > National Center for Atmospheric Research
>> > >> > > Research Applications Laboratory
>> > >> > > 303-497-2768
>> > >> > > ---
>> > >> > > My working day may not be your working day. Please do not
feel
>> > >> obliged to
>> > >> > > reply to this email outside of your normal working hours.
>> > >> > >
>> > >> > >
>> > >> >
>> > >> > --
>> > >> >
>> > >> > Binbin Zhou
>> > >> >
>> > >> > IMSG at NOAA/NWS/NCEP/EMC
>> > >> >
>> > >> > 5830 University Research Ct.
>> > >> >
>> > >> > College Park, MD 20740
>> > >> >
>> > >> > Binbin.Zhou at noaa.gov
>> > >> >
>> > >> > 301-683-3683
>> > >> >
>> > >> >
>> > >>
>> > >> --
>> > >> Julie Prestopnik (she/her)
>> > >> Software Engineer
>> > >> National Center for Atmospheric Research
>> > >> Research Applications Laboratory
>> > >> Email: jpresto at ucar.edu
>> > >>
>> > >> My working day may not be your working day. Please do not
feel
>> obliged
>> > to
>> > >> reply to this email outside of your normal working hours.
>> > >>
>> > >>
>> > >
>> > > --
>> > >
>> > > Binbin Zhou
>> > >
>> > > IMSG at NOAA/NWS/NCEP/EMC
>> > >
>> > > 5830 University Research Ct.
>> > >
>> > > College Park, MD 20740
>> > >
>> > > Binbin.Zhou at noaa.gov
>> > >
>> > > 301-683-3683
>> > >
>> >
>> >
>> > --
>> >
>> > Binbin Zhou
>> >
>> > IMSG at NOAA/NWS/NCEP/EMC
>> >
>> > 5830 University Research Ct.
>> >
>> > College Park, MD 20740
>> >
>> > Binbin.Zhou at noaa.gov
>> >
>> > 301-683-3683
>> >
>> >
>>
>> --
>> Julie Prestopnik (she/her)
>> Software Engineer
>> National Center for Atmospheric Research
>> Research Applications Laboratory
>> Email: jpresto at ucar.edu
>>
>> My working day may not be your working day. Please do not feel
obliged to
>> reply to this email outside of your normal working hours.
>>
>>
>
> --
> George McCabe - Software Engineer III
> National Center for Atmospheric Research
> Research Applications Laboratory
> 303-497-2768
> ---
> My working day may not be your working day. Please do not feel
obliged to
> reply to this email outside of your normal working hours.
>
--
Binbin Zhou
IMSG at NOAA/NWS/NCEP/EMC
5830 University Research Ct.
College Park, MD 20740
Binbin.Zhou at noaa.gov
301-683-3683
------------------------------------------------
Subject: CDP threshold setting in EnsembleStat conf
From: George McCabe
Time: Wed Jan 06 13:15:45 2021
Hi Binbin,
Thanks for sending the updated logs. It looks like your climatology
fields
are not being read properly. I think this line explains the problem:
DEBUG 3: Skipping the 19590104_000000 "HGT/P500" climatology field
since
the time offset (43200 seconds) >= the "hour_interval" entry (21600
seconds) from file:
/gpfs/dell2/emc/modeling/noscrub/Binbin.Zhou/g2g/com/verf/dev/ens.20210104/clim.grid3.stdv.010400.grib2
The variables match_day and time_step in your climo_mean dictionary
are
actually no longer used and have been replaced with:
day_interval = 31;
hour_interval = 6;
21600 seconds is 6 hours and it sounds like your climo field is offset
by
12 hours. I believe setting hour_interval to 12 should allow it to
find the
climatology field and compute the statistics properly. Let me know if
it
does not.
Thanks,
George
On Wed, Jan 6, 2021 at 12:43 PM Binbin.Zhou at noaa.gov via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116 >
>
> George,
>
> I have re-run the case with LOG_LEVEL=DEBUG and
> LOG_ENSEMBLE_STAT_VERBOSITY =3.
> The output log file has been sent to hera:
>
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Binbin.Zhou/metplus_test/metplus3.out/log/master_metplus.log.20210106193455
>
> Please look at it.
>
> Thanks!
>
> Biinbin
>
> On Wed, Jan 6, 2021 at 2:19 PM George McCabe <mccabe at ucar.edu>
wrote:
>
> > Hi Binbin,
> >
> > Thanks for putting those files on hera. The log output you sent
doesn't
> > have the DEBUG level output (LOG_LEVEL=DEBUG). However, I tried to
run
> > EnsembleStat locally using the _OPTIONS value you set and it seems
to run
> > fine. The error seems to suggest that something went wrong when
computing
> > the mean and standard deviation before the obs_thresh values are
> applied. I
> > have reached out to John HG to see if he has any insight as to why
that
> is
> > happening. In the meantime, you could rerun with
> > LOG_ENSEMBLE_STAT_VERBOSITY set to a higher value than 2 to see
if the
> > extra log output from the MET tool gives you any more insight as
to what
> is
> > going wrong.
> >
> > - George
> >
> > On Wed, Jan 6, 2021 at 9:51 AM Julie Prestopnik via RT <
> met_help at ucar.edu>
> > wrote:
> >
> >> Thanks for all of the info Binbin. I saw that you had copied
everything
> >> to
> >> hera for George. I am currently no longer on WCOSS, so I unless
George
> >> lets me know that he needs something from WCOSS, I'll assume he
is able
> to
> >> get it from hera.
> >>
> >> Julie
> >>
> >> On Wed, Jan 6, 2021 at 9:39 AM Binbin.Zhou at noaa.gov via RT <
> >> met_help at ucar.edu> wrote:
> >>
> >> >
> >> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116 >
> >> >
> >> > The EnsembleStat config file for the successful run outside of
METplus
> >> is
> >> >
> >> >
> >>
>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_met_global_ens1p0.v1.0.0/parm/verf_g2g_ens_stat_config_bin11
> >> > on WCOSS
> >> >
> >> > Binbin
> >> >
> >> > On Wed, Jan 6, 2021 at 11:34 AM Binbin Zhou - NOAA Affiliate <
> >> > binbin.zhou at noaa.gov> wrote:
> >> >
> >> > > Julie,
> >> > >
> >> > > The output directory on WCOSS is
> >> > >
> >> > >
> >> >
> >>
>
/gpfs/dell1/ptmp/Binbin.Zhou/g2g/RFC2/tmpnwprd/verf_g2g_gefs_00_dev.161076/metplus3.out
> >> > >
> >> > > My METplus package on WCOSS is
> >> > >
> >> >
> >>
>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_g2g.v4.0.0
> >> > >
> >> > > For GEFS, the EnsembleGrid config file is
> >> > >
> >> > >
> >> >
> >>
>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_g2g.v4.0.0/parm/app_conf/grid2grid/met_config/EnsembleStatConfig_gefs_bin11
> >> > > Its conf file
> >> > > is
> >> >
> >>
>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_g2g.v4.0.0/parm/app_conf/grid2grid/gefs_conf/gefs_bin11.conf
> >> > >
> >> > > The running process is little bit complex since this is a
transition
> >> to
> >> > > future operational package that uses
> >> > > mpi parallel: the script is
> >> > >
> >> > >
> >> >
> >>
>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_g2g.v4.0.0/ush/verf_g2g_metplus_run_gefs_mpi.sh
> >> > >
> >> > > Binbin
> >> > >
> >> > >
> >> > >
> >> > >
> >> > > On Wed, Jan 6, 2021 at 11:00 AM Julie Prestopnik via RT <
> >> > met_help at ucar.edu>
> >> > > wrote:
> >> > >
> >> > >> Hi Binbin.
> >> > >>
> >> > >> This is Julie. I haven't been following this entire thread,
but I
> >> am on
> >> > >> WCOSS right now. If you send a path to a file, I can pull
it and
> >> put it
> >> > >> on
> >> > >> our ftp server for George.
> >> > >>
> >> > >> Julie
> >> > >>
> >> > >> On Wed, Jan 6, 2021 at 8:57 AM Binbin.Zhou at noaa.gov via RT <
> >> > >> met_help at ucar.edu> wrote:
> >> > >>
> >> > >> >
> >> > >> > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116 >
> >> > >> >
> >> > >> > George,
> >> > >> >
> >> > >> > Can you access WCOSS or access HERA?
> >> > >> > Otherwise I will email attached to you
> >> > >> >
> >> > >> > Binbin
> >> > >> >
> >> > >> >
> >> > >> >
> >> > >> > On Wed, Jan 6, 2021 at 10:46 AM George McCabe via RT <
> >> > met_help at ucar.edu
> >> > >> >
> >> > >> > wrote:
> >> > >> >
> >> > >> > > Hi Binbin,
> >> > >> > >
> >> > >> > > Could you send me a log file for a run with
LOG_LEVEL=DEBUG (in
> >> > >> METplus
> >> > >> > > config) so I can see how the environment variable
ENS_FIELD is
> >> set?
> >> > >> The
> >> > >> > > values of ENS_VAR<n>_* are formatted and set in this
> environment
> >> > >> variable
> >> > >> > > which is passed into the MET config. You can compare
that value
> >> with
> >> > >> what
> >> > >> > > you used in your successful run outside of the METplus
wrapper
> to
> >> > >> > determine
> >> > >> > > what is different.
> >> > >> > >
> >> > >> > > Thanks,
> >> > >> > > George
> >> > >> > >
> >> > >> > > On Wed, Jan 6, 2021 at 7:11 AM Binbin.Zhou at noaa.gov via
RT <
> >> > >> > > met_help at ucar.edu> wrote:
> >> > >> > >
> >> > >> > > >
> >> > >> > > > <URL:
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
> >> >
> >> > >> > > >
> >> > >> > > > George,
> >> > >> > > >
> >> > >> > > > I got a new error in execution although some output
files
> (nc
> >> > >> file)
> >> > >> > are
> >> > >> > > > created but stat files not.
> >> > >> > > > The error message is
> >> > >> > > >
> >> > >> > > > ERROR :
> >> > >> > > > ERROR : Simple_Node::check(double, double, double)
const ->
> >> > >> > > climatological
> >> > >> > > > distribution percentile threshold "<=CDP10" requested
with
> >> invalid
> >> > >> mean
> >> > >> > > > (-9999) or standard deviation (-9999).
> >> > >> > > > ERROR :
> >> > >> > > >
> >> > >> > > > Such an error was ever investigated by John H before
(year
> >> ago):
> >> > >> When I
> >> > >> > > > directly ran ensemble_stat for global ensemble (not
> >> METplus-based,
> >> > >> > > > but hard code of all settings in EnsembleStat config
file):
> If
> >> > hard
> >> > >> > code
> >> > >> > > > fcst field in EnsembleStat config file like this
> >> > >> > > >
> >> > >> > > > name = "HGT";
> >> > >> > > > level = "P500";
> >> > >> > > > cat_thresh = [ <=CDP10, >CDP10&&<=CDP20,
> >> >CDP20&&<=CDP30,
> >> > >> > > > >CDP30&&<=CDP40, >CDP40&&<=CDP50, >CDP50&&<=CDP60,
> >> > >CDP60&&<=CDP70,
> >> > >> > > > >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];
> >> > >> > > >
> >> > >> > > > Run ensemble_stat will have such error: ERROR :
> >> > >> > > > Simple_Node::check(double, double, double) const ->
> >> climatological
> >> > >> > > > distribution percentile threshold "<=CDP10" requested
with
> >> invalid
> >> > >> mean
> >> > >> > > > (-9999) or standard deviation (-9999).
> >> > >> > > >
> >> > >> > > > John H. suggested me change "cat_thresh = " to
"obs_thresh =
> >> ",
> >> > >> then
> >> > >> > > the
> >> > >> > > > error was solved.
> >> > >> > > >
> >> > >> > > > In current METplus version, following your suggestion
as
> >> > >> > > >
> >> > >> > > > ENS_VAR1_OPTIONS = obs_thresh = [ <=CDP10,
>CDP10&&<=CDP20,
> >> > >> > > > >CDP20&&<=CDP30, >CDP30&&<=CDP40, >CDP40&&<=CDP50,
> >> > >CDP50&&<=CDP60,
> >> > >> > > > >CDP60&&<=CDP70, >CDP70&&<=CDP80, >CDP80&&<=CDP90,
>CDP90 ];
> >> > >> > > >
> >> > >> > > > the same error appears again. So I am not for sure
if the
> >> > >> > "obs_thresh"
> >> > >> > > > setting is correctly passed.
> >> > >> > > >
> >> > >> > > > Binbin
> >> > >> > > >
> >> > >> > > >
> >> > >> > > >
> >> > >> > > >
> >> > >> > > > On Tue, Jan 5, 2021 at 5:19 PM George McCabe via RT <
> >> > >> met_help at ucar.edu
> >> > >> > >
> >> > >> > > > wrote:
> >> > >> > > >
> >> > >> > > > > Hi Binbin,
> >> > >> > > > >
> >> > >> > > > > Your solution should work for now. It looks like
although
> the
> >> > >> METplus
> >> > >> > > > > variable does get read properly, the environment
variable
> is
> >> not
> >> > >> > > actually
> >> > >> > > > > set by the EnsembleStat wrapper. I can make a note
to add
> >> that
> >> > for
> >> > >> > > 4.0.0,
> >> > >> > > > > as it is an easy fix.
> >> > >> > > > >
> >> > >> > > > > - George
> >> > >> > > > >
> >> > >> > > > > On Tue, Jan 5, 2021 at 2:53 PM Binbin.Zhou at noaa.gov
via
> RT <
> >> > >> > > > > met_help at ucar.edu> wrote:
> >> > >> > > > >
> >> > >> > > > > > George,
> >> > >> > > > > >
> >> > >> > > > > > I have a temporal solution:
> >> > >> > > > > > set ploy in EnembleStat config as
> >> > >> > > > > > poly = [ "${MASKPATH}/lat_NHM.nc",
> >> > >> > > > > > "${MASKPATH}/lat_NHM.nc",
> >> > >> > > > > > "${MASKPATH}/lat_TRP.nc" ];
> >> > >> > > > > >
> >> > >> > > > > > then set MASKPATH in user_env_vars part in the
conf file
> >> > >> > > > > > This MASKPAH then can be passed to EnsembleStat's
poly [
> ]
> >> > entry
> >> > >> > > > > >
> >> > >> > > > > > Binbin
> >> > >> > > > > >
> >> > >> > > > > > On Tue, Jan 5, 2021 at 4:25 PM Binbin Zhou - NOAA
> >> Affiliate <
> >> > >> > > > > > binbin.zhou at noaa.gov> wrote:
> >> > >> > > > > >
> >> > >> > > > > > > George,
> >> > >> > > > > > >
> >> > >> > > > > > > Still not working, error says
> >> > >> > > > > > > ERROR : replace_env() -> unable to get value
for
> >> > environment
> >> > >> > > > variable
> >> > >> > > > > > > "VERIF_MASK"
> >> > >> > > > > > >
> >> > >> > > > > > > Binbin
> >> > >> > > > > > >
> >> > >> > > > > > >
> >> > >> > > > > > >
> >> > >> > > > > > > On Tue, Jan 5, 2021 at 3:50 PM George McCabe via
RT <
> >> > >> > > > met_help at ucar.edu
> >> > >> > > > > >
> >> > >> > > > > > > wrote:
> >> > >> > > > > > >
> >> > >> > > > > > >> Hi Binbin,
> >> > >> > > > > > >>
> >> > >> > > > > > >> You should be able to set it in the METplus
config the
> >> same
> >> > >> way
> >> > >> > it
> >> > >> > > > is
> >> > >> > > > > > done
> >> > >> > > > > > >> for GridStat -- no quotes with commas between
each
> item.
> >> > The
> >> > >> > > wrapper
> >> > >> > > > > > >> should
> >> > >> > > > > > >> format it properly.
> >> > >> > > > > > >>
> >> > >> > > > > > >> Here is an example from an existing use case:
> >> > >> > > > > > >>
> >> > >> > > > > > >> GRID_STAT_VERIFICATION_MASK_TEMPLATE =
> >> > >> > > > > > >>
> >> > >> > >
> >>
{INPUT_BASE}/model_applications/precipitation/mask/CONUS_HRRRTLE.nc,
> >> > >> > > > > > >>
> >> > >> > >
> >>
{INPUT_BASE}/model_applications/precipitation/mask/EAST_HRRRTLE.nc,
> >> > >> > > > > > >>
> >> > >> >
> {INPUT_BASE}/model_applications/precipitation/mask/WEST_HRRRTLE.nc
> >> > >> > > > > > >>
> >> > >> > > > > > >> You should be able to set them the same way
using
> >> > >> > > > > > >> ENSEMBLE_STAT_VERIFICATION_MASK_TEMPLATE. Let
me know
> if
> >> > that
> >> > >> > > > doesn't
> >> > >> > > > > > >> work.
> >> > >> > > > > > >>
> >> > >> > > > > > >> - George
> >> > >> > > > > > >>
> >> > >> > > > > > >> On Tue, Jan 5, 2021 at 1:45 PM
Binbin.Zhou at noaa.gov
> via
> >> > RT <
> >> > >> > > > > > >> met_help at ucar.edu> wrote:
> >> > >> > > > > > >>
> >> > >> > > > > > >> >
> >> > >> > > > > > >> > <URL:
> >> > >> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
> >> > >> > >
> >> > >> > > > > > >> >
> >> > >> > > > > > >> > George,
> >> > >> > > > > > >> >
> >> > >> > > > > > >> > I got another issue for verification mask
setting.
> >> > >> > > > > > >> >
> >> > >> > > > > > >> > I am using $VERIF_MASK in EnsembleStat config
f/ile
> >> > >> > > > > > >> > mask = {
> >> > >> > > > > > >> > grid = [];
> >> > >> > > > > > >> > poly = [${VERIF_MASK}];
> >> > >> > > > > > >> > sid = [];
> >> > >> > > > > > >> > }
> >> > >> > > > > > >> >
> >> > >> > > > > > >> > And using
GRID_STAT_VERIFICATION_MASK_TEMPLATE to
> >> define
> >> > >> > > several
> >> > >> > > > > > >> polygon
> >> > >> > > > > > >> > nc mask files
> >> > >> > > > > > >> > But it seems not working. But it works for
Gridstat
> >> > config
> >> > >> in
> >> > >> > > > suich
> >> > >> > > > > > >> > setting.
> >> > >> > > > > > >> > I can not find ENSEMBLE_STAT_
> >> VERIFICATION_MASK_TEMPLATE
> >> > in
> >> > >> > the
> >> > >> > > > > > METplus
> >> > >> > > > > > >> doc
> >> > >> > > > > > >> >
> >> > >> > > > > > >> > So I define VERIF_MASK in [user_env_vars]
part.
> >> > >> > > > > > >> > It values can not be passed to ploy =
> [${VERIF_MASK}]
> >> in
> >> > >> the
> >> > >> > > > > > >> EnsembleStat
> >> > >> > > > > > >> > conf if more than one nc files included.
> >> > >> > > > > > >> > For example
> >> > >> > > > > > >> > VERIF_MASK=" '/part/p1.cn', '/path/p2.nc' "
> >> > >> > > > > > >> > the error says poly = [/path/p1,]
> >> > >> > > > > > >> > It seems double quote or single quote can not
be
> >> passed
> >> > to
> >> > >> > > > > VERIF_MASK
> >> > >> > > > > > in
> >> > >> > > > > > >> > the EnsembleStat config.
> >> > >> > > > > > >> > I tried use back slash \ to before quote, but
still
> >> not
> >> > >> > working
> >> > >> > > > > > >> >
> >> > >> > > > > > >> > Binbin
> >> > >> > > > > > >> >
> >> > >> > > > > > >> >
> >> > >> > > > > > >> > On Tue, Jan 5, 2021 at 10:33 AM Binbin Zhou -
NOAA
> >> > >> Affiliate <
> >> > >> > > > > > >> > binbin.zhou at noaa.gov> wrote:
> >> > >> > > > > > >> >
> >> > >> > > > > > >> > > George,
> >> > >> > > > > > >> > >
> >> > >> > > > > > >> > > Thanks for your quick response! I'll
test this
> >> > >> settings
> >> > >> > and
> >> > >> > > > let
> >> > >> > > > > > >> > > you know the results.
> >> > >> > > > > > >> > >
> >> > >> > > > > > >> > > Binbin
> >> > >> > > > > > >> > >
> >> > >> > > > > > >> > > On Tue, Jan 5, 2021 at 10:17 AM George
McCabe via
> >> RT <
> >> > >> > > > > > >> met_help at ucar.edu>
> >> > >> > > > > > >> > > wrote:
> >> > >> > > > > > >> > >
> >> > >> > > > > > >> > >> Hi Binbin,
> >> > >> > > > > > >> > >>
> >> > >> > > > > > >> > >> Happy New Year to you too!
> >> > >> > > > > > >> > >>
> >> > >> > > > > > >> > >> I will comment on each configuration
variable and
> >> how
> >> > to
> >> > >> > set
> >> > >> > > it
> >> > >> > > > > in
> >> > >> > > > > > a
> >> > >> > > > > > >> > >> METplus config inline:
> >> > >> > > > > > >> > >>
> >> > >> > > > > > >> > >> ens = {
> >> > >> > > > > > >> > >> ens_thresh = 1.0;
> >> > >> > > > > > >> > >>
> >> > >> > > > > > >> > >>
> >> > >> > > > > > >> > >> *This is controlled by the
> ENSEMBLE_STAT_ENS_THRESH
> >> > >> > variable.
> >> > >> > > > The
> >> > >> > > > > > >> > default
> >> > >> > > > > > >> > >> value is 1.0, so you don't need to include
it in
> >> your
> >> > >> > config
> >> > >> > > > > file,
> >> > >> > > > > > >> but
> >> > >> > > > > > >> > you
> >> > >> > > > > > >> > >> can if you may adjust this value at some
point.*
> >> > >> > > > > > >> > >>
> >> > >> > > > > > >> > >> vld_thresh = 1.0;
> >> > >> > > > > > >> > >>
> >> > >> > > > > > >> > >> *This value is set to 1.0 by default so we
don't
> >> need
> >> > to
> >> > >> > > worry
> >> > >> > > > > > about
> >> > >> > > > > > >> it
> >> > >> > > > > > >> > >> right now.*
> >> > >> > > > > > >> > >>
> >> > >> > > > > > >> > >> field = [
> >> > >> > > > > > >> > >>
> >> > >> > > > > > >> > >> {
> >> > >> > > > > > >> > >> name = "HGT";
> >> > >> > > > > > >> > >> level = "P500";
> >> > >> > > > > > >> > >> obs_thresh = [ <=CDP10,
>CDP10&&<=CDP20,
> >> > >> > > > > >CDP20&&<=CDP30,
> >> > >> > > > > > >> > >> >CDP30&&<=CDP40, >CDP40&&<=CDP50,
> >CDP50&&<=CDP60,
> >> > >> > > > > >CDP60&&<=CDP70,
> >> > >> > > > > > >> > >> >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90
];
> >> > >> > > > > > >> > >> }
> >> > >> > > > > > >> > >> ]
> >> > >> > > > > > >> > >> }
> >> > >> > > > > > >> > >> fcst = ens;
> >> > >> > > > > > >> > >> obs = fcst;
> >> > >> > > > > > >> > >>
> >> > >> > > > > > >> > >> *1) The field info for ens is set in the
> >> > >> > > > > > >> > >> ENS_VAR<n>_[NAME/LEVEL/THRESH/OPTIONS]
variables.
> >> The
> >> > >> fcst
> >> > >> > > and
> >> > >> > > > > obs
> >> > >> > > > > > >> field
> >> > >> > > > > > >> > >> info are set in the corresponding
FCST_VAR<n>_*
> and
> >> > >> > > > OBS_VAR<n>_*
> >> > >> > > > > > >> > variables
> >> > >> > > > > > >> > >> respectively, or you can use BOTH_VAR<n>_*
if the
> >> FCST
> >> > >> and
> >> > >> > > OBS
> >> > >> > > > > > values
> >> > >> > > > > > >> > are
> >> > >> > > > > > >> > >> the same.*
> >> > >> > > > > > >> > >>
> >> > >> > > > > > >> > >> *If ENS_VAR<n>_* variables are not
explicitly
> set,
> >> > then
> >> > >> it
> >> > >> > > will
> >> > >> > > > > use
> >> > >> > > > > > >> the
> >> > >> > > > > > >> > >> values from FCST_VAR<n>_*.*
> >> > >> > > > > > >> > >> *Since the fcst, obs, and ens are all the
same
> you
> >> > could
> >> > >> > just
> >> > >> > > > use
> >> > >> > > > > > >> > >> BOTH_VAR<n>_* variables to control all 3,
> although
> >> > keep
> >> > >> in
> >> > >> > > mind
> >> > >> > > > > > that
> >> > >> > > > > > >> if
> >> > >> > > > > > >> > >> you
> >> > >> > > > > > >> > >> need to change one of them for any reason,
it
> will
> >> be
> >> > >> more
> >> > >> > > > > > difficult
> >> > >> > > > > > >> to
> >> > >> > > > > > >> > do
> >> > >> > > > > > >> > >> this. If you know that they will always be
the
> same
> >> > >> values,
> >> > >> > > > then
> >> > >> > > > > I
> >> > >> > > > > > >> > >> recommend using BOTH_, but if you know
they may
> >> change
> >> > >> or
> >> > >> > are
> >> > >> > > > > > >> unsure, I
> >> > >> > > > > > >> > >> would recommend setting them by
referencing the
> >> other
> >> > >> > > > variables,
> >> > >> > > > > > >> i.e.*
> >> > >> > > > > > >> > >>
> >> > >> > > > > > >> > >> *FCST_VAR1_NAME = HGT*
> >> > >> > > > > > >> > >> *FCST_VAR1_LEVELS = P500 *
> >> > >> > > > > > >> > >> *OBS_VAR1_NAME = {FCST_VAR1_NAME}*
> >> > >> > > > > > >> > >> *OBS_VAR1_LEVELS = {FCST_VAR1_LEVELS}*
> >> > >> > > > > > >> > >>
> >> > >> > > > > > >> > >> *2) The [FCST/OBS/ENS]_VAR<n>_THRESH
variables
> set
> >> the
> >> > >> > > > cat_thresh
> >> > >> > > > > > >> values
> >> > >> > > > > > >> > >> in
> >> > >> > > > > > >> > >> the field info. A variable specific to
obs_thresh
> >> is
> >> > not
> >> > >> > > > > currently
> >> > >> > > > > > >> > >> supported, however you can set these
values by
> >> using
> >> > the
> >> > >> > > > > > >> > ENS_VAR1_OPTIONS
> >> > >> > > > > > >> > >> variable, i.e.*
> >> > >> > > > > > >> > >>
> >> > >> > > > > > >> > >> *ENS_VAR1_OPTIONS = obs_thresh = [
<=CDP10,
> >> > >> > >CDP10&&<=CDP20,
> >> > >> > > > > > >> > >> >CDP20&&<=CDP30, >CDP30&&<=CDP40,
> >CDP40&&<=CDP50,
> >> > >> > > > > >CDP50&&<=CDP60,
> >> > >> > > > > > >> > >> >CDP60&&<=CDP70, >CDP70&&<=CDP80,
> >CDP80&&<=CDP90,
> >> > >> >CDP90
> >> > >> > ];*
> >> > >> > > > > > >> > >>
> >> > >> > > > > > >> > >>
> >> > >> > > > > > >> > >> *Remember to include the semicolon at the
end! *
> >> > >> > > > > > >> > >>
> >> > >> > > > > > >> > >> ens_ssvar_bin_size = 1000000;
> >> > >> > > > > > >> > >> *1) This variable is different from the
default
> and
> >> > not
> >> > >> > > > currently
> >> > >> > > > > > >> > >> supported
> >> > >> > > > > > >> > >> with a METplus config variable. I will add
this
> to
> >> the
> >> > >> list
> >> > >> > > of
> >> > >> > > > > > >> variables
> >> > >> > > > > > >> > >> in
> >> > >> > > > > > >> > >> MET config files that we want to support.
> However,
> >> in
> >> > >> the
> >> > >> > > > > meantime
> >> > >> > > > > > >> you
> >> > >> > > > > > >> > can
> >> > >> > > > > > >> > >> copy the default wrapped MET config file
and
> >> modify it
> >> > >> to
> >> > >> > fit
> >> > >> > > > > your
> >> > >> > > > > > >> > needs.
> >> > >> > > > > > >> > >> To do this, you will need to:*
> >> > >> > > > > > >> > >>
> >> > >> > > > > > >> > >> * a) Copy
> >> > >> > METplus/parm/met_config/EnsembleStatConfig_wrapped
> >> > >> > > > to
> >> > >> > > > > > the
> >> > >> > > > > > >> > >> directory that contains your METplus
config file
> >> for
> >> > >> this
> >> > >> > use
> >> > >> > > > > case.
> >> > >> > > > > > >> > Rename
> >> > >> > > > > > >> > >> it by replacing "wrapped" with a short
> description
> >> > that
> >> > >> > > > pertains
> >> > >> > > > > to
> >> > >> > > > > > >> your
> >> > >> > > > > > >> > >> use case.*
> >> > >> > > > > > >> > >>
> >> > >> > > > > > >> > >> * b) In your METplus config file, change
the
> >> value of
> >> > >> > > > > > >> > >> ENSEMBLE_STAT_CONFIG_FILE to point to the
path of
> >> this
> >> > >> new
> >> > >> > > > config
> >> > >> > > > > > >> file.*
> >> > >> > > > > > >> > >>
> >> > >> > > > > > >> > >> * c) If you know the value you want to
use for
> >> this
> >> > >> > variable
> >> > >> > > > > will
> >> > >> > > > > > >> > always
> >> > >> > > > > > >> > >> be 1000000, then simply set the variable
to that
> >> > value.
> >> > >> If
> >> > >> > > you
> >> > >> > > > > > think
> >> > >> > > > > > >> you
> >> > >> > > > > > >> > >> may want to change the value, then you can
> utilize
> >> the
> >> > >> > > > > > >> [user_env_vars]
> >> > >> > > > > > >> > >> functionality. See:
> >> > >> > > > > > >> > >>
> >> > >> > > > > > >> > >>
> >> > >> > > > > > >> >
> >> > >> > > > > > >>
> >> > >> > > > > >
> >> > >> > > > >
> >> > >> > > >
> >> > >> > >
> >> > >> >
> >> > >>
> >> >
> >>
>
https://dtcenter.github.io/METplus/latest/Users_Guide/systemconfiguration.html#user-
defined-config
> >> > >> > > > > > >> > >> <
> >> > >> > > > > > >> > >>
> >> > >> > > > > > >> >
> >> > >> > > > > > >>
> >> > >> > > > > >
> >> > >> > > > >
> >> > >> > > >
> >> > >> > >
> >> > >> >
> >> > >>
> >> >
> >>
>
https://dtcenter.github.io/METplus/latest/Users_Guide/systemconfiguration.html#user-
defined-config
> >> > >> > > > > > >> > >> >*
> >> > >> > > > > > >> > >> *In this case, you would add the following
to
> your
> >> > >> METplus
> >> > >> > > > > config:*
> >> > >> > > > > > >> > >>
> >> > >> > > > > > >> > >> *[user_env_vars]*
> >> > >> > > > > > >> > >> *ENS_SSVAR_BIN_SIZE = 1000000*
> >> > >> > > > > > >> > >>
> >> > >> > > > > > >> > >> *Then change the line in your EnsembleStat
config
> >> file
> >> > >> that
> >> > >> > > you
> >> > >> > > > > > >> copied
> >> > >> > > > > > >> > >> to:*
> >> > >> > > > > > >> > >>
> >> > >> > > > > > >> > >> * ens_ssvar_bin_size =
${ENS_SSVAR_BIN_SIZE}; *
> >> > >> > > > > > >> > >>
> >> > >> > > > > > >> > >> ens_phist_bin_size = 0.05;
> >> > >> > > > > > >> > >> *This variable uses the default value, so
you
> don't
> >> > >> need to
> >> > >> > > do
> >> > >> > > > > > >> anything
> >> > >> > > > > > >> > >> here. If you need to make it configurable
or
> change
> >> > the
> >> > >> > > value,
> >> > >> > > > > then
> >> > >> > > > > > >> > follow
> >> > >> > > > > > >> > >> the instructions for setting
ens_ssvar_bin_size.*
> >> > >> > > > > > >> > >>
> >> > >> > > > > > >> > >> climo_mean = fcst;
> >> > >> > > > > > >> > >> climo_mean = {
> >> > >> > > > > > >> > >> file_name = "${CLIM_MEAN}";
> >> > >> > > > > > >> > >> time_interp_method = DW_MEAN;
> >> > >> > > > > > >> > >> match_day = TRUE;
> >> > >> > > > > > >> > >> time_step = 21600;
> >> > >> > > > > > >> > >> }
> >> > >> > > > > > >> > >>
> >> > >> > > > > > >> > >>
> >> > >> > > > > > >> > >> *Instead of using CLIM_MEAN, you can set
> >> > >> > > > > > >> > >>
ENSEMBLE_STAT_CLIMO_MEAN_INPUT_[DIR/TEMPLATE] in
> >> the
> >> > >> > METplus
> >> > >> > > > > > config.
> >> > >> > > > > > >> You
> >> > >> > > > > > >> > >> can use filename template syntax in the
_TEMPLATE
> >> > value,
> >> > >> > i.e.
> >> > >> > > > > > >> > >> {valid?fmt=%m%d}. The other variables in
the
> >> > climo_mean
> >> > >> > > > > dictionary
> >> > >> > > > > > >> are
> >> > >> > > > > > >> > >> actually old variables that have been
replaced
> with
> >> > >> > > > day_interval
> >> > >> > > > > > and
> >> > >> > > > > > >> > >> hour_interval, but the values you use are
the old
> >> > >> defaults,
> >> > >> > > so
> >> > >> > > > > you
> >> > >> > > > > > >> > >> shouldn't need to set them.*
> >> > >> > > > > > >> > >>
> >> > >> > > > > > >> > >> climo_stdev = climo_mean;
> >> > >> > > > > > >> > >> climo_stdev = {
> >> > >> > > > > > >> > >> file_name = "${CLIM_STDV}";
> >> > >> > > > > > >> > >> }
> >> > >> > > > > > >> > >>
> >> > >> > > > > > >> > >> *Similarly to CLIM_MEAN, you can use
> >> > >> > > > > > >> > >>
ENSEMBLE_STAT_CLIMO_STDEV_INPUT_[DIR/TEMPLATE] to
> >> set
> >> > >> this
> >> > >> > > file
> >> > >> > > > > > >> name.*
> >> > >> > > > > > >> > >>
> >> > >> > > > > > >> > >> climo_cdf = {
> >> > >> > > > > > >> > >> cdf_bins = 11;
> >> > >> > > > > > >> > >> center_bins = TRUE;
> >> > >> > > > > > >> > >> write_bins = TRUE;
> >> > >> > > > > > >> > >> }
> >> > >> > > > > > >> > >> *The value for write_bins is the default,
but the
> >> > values
> >> > >> > for
> >> > >> > > > > > cdf_bins
> >> > >> > > > > > >> > and
> >> > >> > > > > > >> > >> center_bins do not. To set these, follow
the
> above
> >> > >> > > instructions
> >> > >> > > > > for
> >> > >> > > > > > >> > >> ens_ssvar_bin_size to override them and/or
make
> >> them
> >> > >> > > > configurable
> >> > >> > > > > > >> > through
> >> > >> > > > > > >> > >> METplus. I will also add these variables
to the
> >> list
> >> > of
> >> > >> MET
> >> > >> > > > > configs
> >> > >> > > > > > >> that
> >> > >> > > > > > >> > >> users want to be able to easily configure
through
> >> > >> METplus
> >> > >> > > > > configs.*
> >> > >> > > > > > >> > >>
> >> > >> > > > > > >> > >> Please let me know if you run into any
issues
> >> setting
> >> > >> any
> >> > >> > of
> >> > >> > > > that
> >> > >> > > > > > up.
> >> > >> > > > > > >> > >> Also,
> >> > >> > > > > > >> > >> if there are any other MET config
variables that
> >> you
> >> > >> want
> >> > >> > to
> >> > >> > > > see
> >> > >> > > > > > >> > supported
> >> > >> > > > > > >> > >> in METplus, let me know and I will make
sure they
> >> get
> >> > >> > > included
> >> > >> > > > > when
> >> > >> > > > > > >> we
> >> > >> > > > > > >> > >> have
> >> > >> > > > > > >> > >> a chance to refactor those wrappers. It is
> >> possible to
> >> > >> add
> >> > >> > > > > support
> >> > >> > > > > > >> for
> >> > >> > > > > > >> > MET
> >> > >> > > > > > >> > >> configs using the above instructions, but
it is
> >> always
> >> > >> > easier
> >> > >> > > > and
> >> > >> > > > > > >> less
> >> > >> > > > > > >> > >> error-prone to have them configurable
directly
> >> > through a
> >> > >> > > > variable
> >> > >> > > > > > in
> >> > >> > > > > > >> the
> >> > >> > > > > > >> > >> METplus config.
> >> > >> > > > > > >> > >>
> >> > >> > > > > > >> > >> Thanks,
> >> > >> > > > > > >> > >> George
> >> > >> > > > > > >> > >>
> >> > >> > > > > > >> > >> On Tue, Jan 5, 2021 at 7:14 AM
> >> Binbin.Zhou at noaa.gov
> >> > via
> >> > >> > RT <
> >> > >> > > > > > >> > >> met_help at ucar.edu> wrote:
> >> > >> > > > > > >> > >>
> >> > >> > > > > > >> > >> >
> >> > >> > > > > > >> > >> > Tue Jan 05 07:14:54 2021: Request 98116
was
> acted
> >> > >> upon.
> >> > >> > > > > > >> > >> > Transaction: Ticket created by
> >> Binbin.Zhou at noaa.gov
> >> > >> > > > > > >> > >> > Queue: met_help
> >> > >> > > > > > >> > >> > Subject: CDP threshold setting in
> >> EnsembleStat
> >> > >> conf
> >> > >> > > > > > >> > >> > Owner: Nobody
> >> > >> > > > > > >> > >> > Requestors: Binbin.Zhou at noaa.gov
> >> > >> > > > > > >> > >> > Status: new
> >> > >> > > > > > >> > >> > Ticket <URL:
> >> > >> > > > > > >>
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
> >> > >> > > > > > >> > >
> >> > >> > > > > > >> > >> >
> >> > >> > > > > > >> > >> >
> >> > >> > > > > > >> > >> > George,
> >> > >> > > > > > >> > >> >
> >> > >> > > > > > >> > >> > Happy New Year!
> >> > >> > > > > > >> > >> >
> >> > >> > > > > > >> > >> > I am working on transition of our
MET-based
> >> > global
> >> > >> > > > ensemble
> >> > >> > > > > > >> > >> verification
> >> > >> > > > > > >> > >> > to METplus based package. In this
package
> >> > climatology
> >> > >> > bins
> >> > >> > > > (10
> >> > >> > > > > > >> bins)
> >> > >> > > > > > >> > are
> >> > >> > > > > > >> > >> > used.
> >> > >> > > > > > >> > >> > In current ensemble stat config file,
the
> >> relevant
> >> > >> > entries
> >> > >> > > > iare
> >> > >> > > > > > >> > defined
> >> > >> > > > > > >> > >> > like following
> >> > >> > > > > > >> > >> >
> >> > >> > > > > > >> > >> > ens = {
> >> > >> > > > > > >> > >> > ens_thresh = 1.0;
> >> > >> > > > > > >> > >> > vld_thresh = 1.0;
> >> > >> > > > > > >> > >> >
> >> > >> > > > > > >> > >> > field = [
> >> > >> > > > > > >> > >> >
> >> > >> > > > > > >> > >> > {
> >> > >> > > > > > >> > >> > name = "HGT";
> >> > >> > > > > > >> > >> > level = "P500";
> >> > >> > > > > > >> > >> > obs_thresh = [ <=CDP10,
> >CDP10&&<=CDP20,
> >> > >> > > > > > >CDP20&&<=CDP30,
> >> > >> > > > > > >> > >> > >CDP30&&<=CDP40, >CDP40&&<=CDP50,
> >> >CDP50&&<=CDP60,
> >> > >> > > > > > >CDP60&&<=CDP70,
> >> > >> > > > > > >> > >> > >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90
];
> >> > >> > > > > > >> > >> > }
> >> > >> > > > > > >> > >> > ]
> >> > >> > > > > > >> > >> > }
> >> > >> > > > > > >> > >> > fcst = ens;
> >> > >> > > > > > >> > >> > obs = fcst;
> >> > >> > > > > > >> > >> > ens_ssvar_bin_size = 1000000;
> >> > >> > > > > > >> > >> > ens_phist_bin_size = 0.05;
> >> > >> > > > > > >> > >> > climo_mean = fcst;
> >> > >> > > > > > >> > >> > climo_mean = {
> >> > >> > > > > > >> > >> > file_name = "${CLIM_MEAN}";
> >> > >> > > > > > >> > >> > time_interp_method = DW_MEAN;
> >> > >> > > > > > >> > >> > match_day = TRUE;
> >> > >> > > > > > >> > >> > time_step = 21600;
> >> > >> > > > > > >> > >> > }
> >> > >> > > > > > >> > >> >
> >> > >> > > > > > >> > >> > climo_stdev = climo_mean;
> >> > >> > > > > > >> > >> > climo_stdev = {
> >> > >> > > > > > >> > >> > file_name = "${CLIM_STDV}";
> >> > >> > > > > > >> > >> > }
> >> > >> > > > > > >> > >> >
> >> > >> > > > > > >> > >> > climo_cdf = {
> >> > >> > > > > > >> > >> > cdf_bins = 11;
> >> > >> > > > > > >> > >> > center_bins = TRUE;
> >> > >> > > > > > >> > >> > write_bins = TRUE;
> >> > >> > > > > > >> > >> > }
> >> > >> > > > > > >> > >> >
> >> > >> > > > > > >> > >> > I can not find the correspondent
settings in
> its
> >> > conf
> >> > >> > file
> >> > >> > > > from
> >> > >> > > > > > >> > METplus
> >> > >> > > > > > >> > >> > online doc.
> >> > >> > > > > > >> > >> > Can you help me look at this?
> >> > >> > > > > > >> > >> >
> >> > >> > > > > > >> > >> > Thanks!
> >> > >> > > > > > >> > >> >
> >> > >> > > > > > >> > >> > Binbin
> >> > >> > > > > > >> > >> >
> >> > >> > > > > > >> > >> > --
> >> > >> > > > > > >> > >> >
> >> > >> > > > > > >> > >> > Binbin Zhou
> >> > >> > > > > > >> > >> >
> >> > >> > > > > > >> > >> > IMSG at NOAA/NWS/NCEP/EMC
> >> > >> > > > > > >> > >> >
> >> > >> > > > > > >> > >> > 5830 University Research Ct.
> >> > >> > > > > > >> > >> >
> >> > >> > > > > > >> > >> > College Park, MD 20740
> >> > >> > > > > > >> > >> >
> >> > >> > > > > > >> > >> > Binbin.Zhou at noaa.gov
> >> > >> > > > > > >> > >> >
> >> > >> > > > > > >> > >> > 301-683-3683
> >> > >> > > > > > >> > >> >
> >> > >> > > > > > >> > >> >
> >> > >> > > > > > >> > >>
> >> > >> > > > > > >> > >> --
> >> > >> > > > > > >> > >> George McCabe - Software Engineer III
> >> > >> > > > > > >> > >> National Center for Atmospheric Research
> >> > >> > > > > > >> > >> Research Applications Laboratory
> >> > >> > > > > > >> > >> 303-497-2768
> >> > >> > > > > > >> > >> ---
> >> > >> > > > > > >> > >> My working day may not be your working
day.
> Please
> >> do
> >> > >> not
> >> > >> > > feel
> >> > >> > > > > > >> obliged
> >> > >> > > > > > >> > to
> >> > >> > > > > > >> > >> reply to this email outside of your normal
> working
> >> > >> hours.
> >> > >> > > > > > >> > >>
> >> > >> > > > > > >> > >>
> >> > >> > > > > > >> > >
> >> > >> > > > > > >> > > --
> >> > >> > > > > > >> > >
> >> > >> > > > > > >> > > Binbin Zhou
> >> > >> > > > > > >> > >
> >> > >> > > > > > >> > > IMSG at NOAA/NWS/NCEP/EMC
> >> > >> > > > > > >> > >
> >> > >> > > > > > >> > > 5830 University Research Ct.
> >> > >> > > > > > >> > >
> >> > >> > > > > > >> > > College Park, MD 20740
> >> > >> > > > > > >> > >
> >> > >> > > > > > >> > > Binbin.Zhou at noaa.gov
> >> > >> > > > > > >> > >
> >> > >> > > > > > >> > > 301-683-3683
> >> > >> > > > > > >> > >
> >> > >> > > > > > >> >
> >> > >> > > > > > >> >
> >> > >> > > > > > >> > --
> >> > >> > > > > > >> >
> >> > >> > > > > > >> > Binbin Zhou
> >> > >> > > > > > >> >
> >> > >> > > > > > >> > IMSG at NOAA/NWS/NCEP/EMC
> >> > >> > > > > > >> >
> >> > >> > > > > > >> > 5830 University Research Ct.
> >> > >> > > > > > >> >
> >> > >> > > > > > >> > College Park, MD 20740
> >> > >> > > > > > >> >
> >> > >> > > > > > >> > Binbin.Zhou at noaa.gov
> >> > >> > > > > > >> >
> >> > >> > > > > > >> > 301-683-3683
> >> > >> > > > > > >> >
> >> > >> > > > > > >> >
> >> > >> > > > > > >>
> >> > >> > > > > > >> --
> >> > >> > > > > > >> George McCabe - Software Engineer III
> >> > >> > > > > > >> National Center for Atmospheric Research
> >> > >> > > > > > >> Research Applications Laboratory
> >> > >> > > > > > >> 303-497-2768
> >> > >> > > > > > >> ---
> >> > >> > > > > > >> My working day may not be your working day.
Please do
> >> not
> >> > >> feel
> >> > >> > > > obliged
> >> > >> > > > > > to
> >> > >> > > > > > >> reply to this email outside of your normal
working
> >> hours.
> >> > >> > > > > > >>
> >> > >> > > > > > >>
> >> > >> > > > > > >
> >> > >> > > > > > > --
> >> > >> > > > > > >
> >> > >> > > > > > > Binbin Zhou
> >> > >> > > > > > >
> >> > >> > > > > > > IMSG at NOAA/NWS/NCEP/EMC
> >> > >> > > > > > >
> >> > >> > > > > > > 5830 University Research Ct.
> >> > >> > > > > > >
> >> > >> > > > > > > College Park, MD 20740
> >> > >> > > > > > >
> >> > >> > > > > > > Binbin.Zhou at noaa.gov
> >> > >> > > > > > >
> >> > >> > > > > > > 301-683-3683
> >> > >> > > > > > >
> >> > >> > > > > >
> >> > >> > > > > >
> >> > >> > > > > > --
> >> > >> > > > > >
> >> > >> > > > > > Binbin Zhou
> >> > >> > > > > >
> >> > >> > > > > > IMSG at NOAA/NWS/NCEP/EMC
> >> > >> > > > > >
> >> > >> > > > > > 5830 University Research Ct.
> >> > >> > > > > >
> >> > >> > > > > > College Park, MD 20740
> >> > >> > > > > >
> >> > >> > > > > > Binbin.Zhou at noaa.gov
> >> > >> > > > > >
> >> > >> > > > > > 301-683-3683
> >> > >> > > > > >
> >> > >> > > > > >
> >> > >> > > > >
> >> > >> > > > > --
> >> > >> > > > > George McCabe - Software Engineer III
> >> > >> > > > > National Center for Atmospheric Research
> >> > >> > > > > Research Applications Laboratory
> >> > >> > > > > 303-497-2768
> >> > >> > > > > ---
> >> > >> > > > > My working day may not be your working day. Please
do not
> >> feel
> >> > >> > obliged
> >> > >> > > to
> >> > >> > > > > reply to this email outside of your normal working
hours.
> >> > >> > > > >
> >> > >> > > > >
> >> > >> > > >
> >> > >> > > > --
> >> > >> > > >
> >> > >> > > > Binbin Zhou
> >> > >> > > >
> >> > >> > > > IMSG at NOAA/NWS/NCEP/EMC
> >> > >> > > >
> >> > >> > > > 5830 University Research Ct.
> >> > >> > > >
> >> > >> > > > College Park, MD 20740
> >> > >> > > >
> >> > >> > > > Binbin.Zhou at noaa.gov
> >> > >> > > >
> >> > >> > > > 301-683-3683
> >> > >> > > >
> >> > >> > > >
> >> > >> > >
> >> > >> > > --
> >> > >> > > George McCabe - Software Engineer III
> >> > >> > > National Center for Atmospheric Research
> >> > >> > > Research Applications Laboratory
> >> > >> > > 303-497-2768
> >> > >> > > ---
> >> > >> > > My working day may not be your working day. Please do
not feel
> >> > >> obliged to
> >> > >> > > reply to this email outside of your normal working
hours.
> >> > >> > >
> >> > >> > >
> >> > >> >
> >> > >> > --
> >> > >> >
> >> > >> > Binbin Zhou
> >> > >> >
> >> > >> > IMSG at NOAA/NWS/NCEP/EMC
> >> > >> >
> >> > >> > 5830 University Research Ct.
> >> > >> >
> >> > >> > College Park, MD 20740
> >> > >> >
> >> > >> > Binbin.Zhou at noaa.gov
> >> > >> >
> >> > >> > 301-683-3683
> >> > >> >
> >> > >> >
> >> > >>
> >> > >> --
> >> > >> Julie Prestopnik (she/her)
> >> > >> Software Engineer
> >> > >> National Center for Atmospheric Research
> >> > >> Research Applications Laboratory
> >> > >> Email: jpresto at ucar.edu
> >> > >>
> >> > >> My working day may not be your working day. Please do not
feel
> >> obliged
> >> > to
> >> > >> reply to this email outside of your normal working hours.
> >> > >>
> >> > >>
> >> > >
> >> > > --
> >> > >
> >> > > Binbin Zhou
> >> > >
> >> > > IMSG at NOAA/NWS/NCEP/EMC
> >> > >
> >> > > 5830 University Research Ct.
> >> > >
> >> > > College Park, MD 20740
> >> > >
> >> > > Binbin.Zhou at noaa.gov
> >> > >
> >> > > 301-683-3683
> >> > >
> >> >
> >> >
> >> > --
> >> >
> >> > Binbin Zhou
> >> >
> >> > IMSG at NOAA/NWS/NCEP/EMC
> >> >
> >> > 5830 University Research Ct.
> >> >
> >> > College Park, MD 20740
> >> >
> >> > Binbin.Zhou at noaa.gov
> >> >
> >> > 301-683-3683
> >> >
> >> >
> >>
> >> --
> >> Julie Prestopnik (she/her)
> >> Software Engineer
> >> National Center for Atmospheric Research
> >> Research Applications Laboratory
> >> Email: jpresto at ucar.edu
> >>
> >> My working day may not be your working day. Please do not feel
obliged
> to
> >> reply to this email outside of your normal working hours.
> >>
> >>
> >
> > --
> > George McCabe - Software Engineer III
> > National Center for Atmospheric Research
> > Research Applications Laboratory
> > 303-497-2768
> > ---
> > My working day may not be your working day. Please do not feel
obliged to
> > reply to this email outside of your normal working hours.
> >
>
>
> --
>
> Binbin Zhou
>
> IMSG at NOAA/NWS/NCEP/EMC
>
> 5830 University Research Ct.
>
> College Park, MD 20740
>
> Binbin.Zhou at noaa.gov
>
> 301-683-3683
>
>
--
George McCabe - Software Engineer III
National Center for Atmospheric Research
Research Applications Laboratory
303-497-2768
---
My working day may not be your working day. Please do not feel obliged
to
reply to this email outside of your normal working hours.
------------------------------------------------
Subject: CDP threshold setting in EnsembleStat conf
From: Binbin.Zhou at noaa.gov
Time: Wed Jan 06 14:19:02 2021
George,
Rerun has same error
Skipping the 19590104_000000 "HGT/P500" climatology field since the
time
offset (43200 seconds) >= the "hour_interval" entry (21600 seconds)
from
file:
/gpfs/dell2/emc/modeling/noscrub/Binbin.Zhou/g2g/com/verf/dev/ens.20210104/clim.grid3.mean.010400.grib2
The new setting for climo in EnemsbleGrid config file is
climo_mean = fcst;
climo_mean = {
file_name = [ ${CLIMO_MEAN_FILE} ];
time_interp_method = DW_MEAN;
match_day = FALSE;
time_step = 43200;
}
climo_stdev = climo_mean;
climo_stdev = {
file_name = [ ${CLIMO_STDEV_FILE} ];
}
climo_cdf = {
cdf_bins = 11;
center_bins = TRUE;
write_bins = TRUE;
}
It seems time_step is not effective?
Binbin
On Wed, Jan 6, 2021 at 3:15 PM George McCabe via RT
<met_help at ucar.edu>
wrote:
> Hi Binbin,
>
> Thanks for sending the updated logs. It looks like your climatology
fields
> are not being read properly. I think this line explains the problem:
>
> DEBUG 3: Skipping the 19590104_000000 "HGT/P500" climatology field
since
> the time offset (43200 seconds) >= the "hour_interval" entry (21600
> seconds) from file:
>
>
/gpfs/dell2/emc/modeling/noscrub/Binbin.Zhou/g2g/com/verf/dev/ens.20210104/clim.grid3.stdv.010400.grib2
>
> The variables match_day and time_step in your climo_mean dictionary
are
> actually no longer used and have been replaced with:
>
> day_interval = 31;
> hour_interval = 6;
>
> 21600 seconds is 6 hours and it sounds like your climo field is
offset by
> 12 hours. I believe setting hour_interval to 12 should allow it to
find the
> climatology field and compute the statistics properly. Let me know
if it
> does not.
>
> Thanks,
> George
>
> On Wed, Jan 6, 2021 at 12:43 PM Binbin.Zhou at noaa.gov via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116 >
> >
> > George,
> >
> > I have re-run the case with LOG_LEVEL=DEBUG and
> > LOG_ENSEMBLE_STAT_VERBOSITY =3.
> > The output log file has been sent to hera:
> >
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Binbin.Zhou/metplus_test/metplus3.out/log/master_metplus.log.20210106193455
> >
> > Please look at it.
> >
> > Thanks!
> >
> > Biinbin
> >
> > On Wed, Jan 6, 2021 at 2:19 PM George McCabe <mccabe at ucar.edu>
wrote:
> >
> > > Hi Binbin,
> > >
> > > Thanks for putting those files on hera. The log output you sent
doesn't
> > > have the DEBUG level output (LOG_LEVEL=DEBUG). However, I tried
to run
> > > EnsembleStat locally using the _OPTIONS value you set and it
seems to
> run
> > > fine. The error seems to suggest that something went wrong when
> computing
> > > the mean and standard deviation before the obs_thresh values are
> > applied. I
> > > have reached out to John HG to see if he has any insight as to
why that
> > is
> > > happening. In the meantime, you could rerun with
> > > LOG_ENSEMBLE_STAT_VERBOSITY set to a higher value than 2 to see
if the
> > > extra log output from the MET tool gives you any more insight as
to
> what
> > is
> > > going wrong.
> > >
> > > - George
> > >
> > > On Wed, Jan 6, 2021 at 9:51 AM Julie Prestopnik via RT <
> > met_help at ucar.edu>
> > > wrote:
> > >
> > >> Thanks for all of the info Binbin. I saw that you had copied
> everything
> > >> to
> > >> hera for George. I am currently no longer on WCOSS, so I
unless
> George
> > >> lets me know that he needs something from WCOSS, I'll assume he
is
> able
> > to
> > >> get it from hera.
> > >>
> > >> Julie
> > >>
> > >> On Wed, Jan 6, 2021 at 9:39 AM Binbin.Zhou at noaa.gov via RT <
> > >> met_help at ucar.edu> wrote:
> > >>
> > >> >
> > >> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
>
> > >> >
> > >> > The EnsembleStat config file for the successful run outside
of
> METplus
> > >> is
> > >> >
> > >> >
> > >>
> >
>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_met_global_ens1p0.v1.0.0/parm/verf_g2g_ens_stat_config_bin11
> > >> > on WCOSS
> > >> >
> > >> > Binbin
> > >> >
> > >> > On Wed, Jan 6, 2021 at 11:34 AM Binbin Zhou - NOAA Affiliate
<
> > >> > binbin.zhou at noaa.gov> wrote:
> > >> >
> > >> > > Julie,
> > >> > >
> > >> > > The output directory on WCOSS is
> > >> > >
> > >> > >
> > >> >
> > >>
> >
>
/gpfs/dell1/ptmp/Binbin.Zhou/g2g/RFC2/tmpnwprd/verf_g2g_gefs_00_dev.161076/metplus3.out
> > >> > >
> > >> > > My METplus package on WCOSS is
> > >> > >
> > >> >
> > >>
> >
>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_g2g.v4.0.0
> > >> > >
> > >> > > For GEFS, the EnsembleGrid config file is
> > >> > >
> > >> > >
> > >> >
> > >>
> >
>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_g2g.v4.0.0/parm/app_conf/grid2grid/met_config/EnsembleStatConfig_gefs_bin11
> > >> > > Its conf file
> > >> > > is
> > >> >
> > >>
> >
>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_g2g.v4.0.0/parm/app_conf/grid2grid/gefs_conf/gefs_bin11.conf
> > >> > >
> > >> > > The running process is little bit complex since this is a
> transition
> > >> to
> > >> > > future operational package that uses
> > >> > > mpi parallel: the script is
> > >> > >
> > >> > >
> > >> >
> > >>
> >
>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_g2g.v4.0.0/ush/verf_g2g_metplus_run_gefs_mpi.sh
> > >> > >
> > >> > > Binbin
> > >> > >
> > >> > >
> > >> > >
> > >> > >
> > >> > > On Wed, Jan 6, 2021 at 11:00 AM Julie Prestopnik via RT <
> > >> > met_help at ucar.edu>
> > >> > > wrote:
> > >> > >
> > >> > >> Hi Binbin.
> > >> > >>
> > >> > >> This is Julie. I haven't been following this entire
thread, but
> I
> > >> am on
> > >> > >> WCOSS right now. If you send a path to a file, I can pull
it and
> > >> put it
> > >> > >> on
> > >> > >> our ftp server for George.
> > >> > >>
> > >> > >> Julie
> > >> > >>
> > >> > >> On Wed, Jan 6, 2021 at 8:57 AM Binbin.Zhou at noaa.gov via RT
<
> > >> > >> met_help at ucar.edu> wrote:
> > >> > >>
> > >> > >> >
> > >> > >> > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
> >
> > >> > >> >
> > >> > >> > George,
> > >> > >> >
> > >> > >> > Can you access WCOSS or access HERA?
> > >> > >> > Otherwise I will email attached to you
> > >> > >> >
> > >> > >> > Binbin
> > >> > >> >
> > >> > >> >
> > >> > >> >
> > >> > >> > On Wed, Jan 6, 2021 at 10:46 AM George McCabe via RT <
> > >> > met_help at ucar.edu
> > >> > >> >
> > >> > >> > wrote:
> > >> > >> >
> > >> > >> > > Hi Binbin,
> > >> > >> > >
> > >> > >> > > Could you send me a log file for a run with
LOG_LEVEL=DEBUG
> (in
> > >> > >> METplus
> > >> > >> > > config) so I can see how the environment variable
ENS_FIELD
> is
> > >> set?
> > >> > >> The
> > >> > >> > > values of ENS_VAR<n>_* are formatted and set in this
> > environment
> > >> > >> variable
> > >> > >> > > which is passed into the MET config. You can compare
that
> value
> > >> with
> > >> > >> what
> > >> > >> > > you used in your successful run outside of the METplus
> wrapper
> > to
> > >> > >> > determine
> > >> > >> > > what is different.
> > >> > >> > >
> > >> > >> > > Thanks,
> > >> > >> > > George
> > >> > >> > >
> > >> > >> > > On Wed, Jan 6, 2021 at 7:11 AM Binbin.Zhou at noaa.gov
via RT <
> > >> > >> > > met_help at ucar.edu> wrote:
> > >> > >> > >
> > >> > >> > > >
> > >> > >> > > > <URL:
> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
> > >> >
> > >> > >> > > >
> > >> > >> > > > George,
> > >> > >> > > >
> > >> > >> > > > I got a new error in execution although some
output files
> > (nc
> > >> > >> file)
> > >> > >> > are
> > >> > >> > > > created but stat files not.
> > >> > >> > > > The error message is
> > >> > >> > > >
> > >> > >> > > > ERROR :
> > >> > >> > > > ERROR : Simple_Node::check(double, double, double)
const
> ->
> > >> > >> > > climatological
> > >> > >> > > > distribution percentile threshold "<=CDP10"
requested with
> > >> invalid
> > >> > >> mean
> > >> > >> > > > (-9999) or standard deviation (-9999).
> > >> > >> > > > ERROR :
> > >> > >> > > >
> > >> > >> > > > Such an error was ever investigated by John H before
(year
> > >> ago):
> > >> > >> When I
> > >> > >> > > > directly ran ensemble_stat for global ensemble (not
> > >> METplus-based,
> > >> > >> > > > but hard code of all settings in EnsembleStat config
file):
> > If
> > >> > hard
> > >> > >> > code
> > >> > >> > > > fcst field in EnsembleStat config file like this
> > >> > >> > > >
> > >> > >> > > > name = "HGT";
> > >> > >> > > > level = "P500";
> > >> > >> > > > cat_thresh = [ <=CDP10, >CDP10&&<=CDP20,
> > >> >CDP20&&<=CDP30,
> > >> > >> > > > >CDP30&&<=CDP40, >CDP40&&<=CDP50, >CDP50&&<=CDP60,
> > >> > >CDP60&&<=CDP70,
> > >> > >> > > > >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];
> > >> > >> > > >
> > >> > >> > > > Run ensemble_stat will have such error: ERROR :
> > >> > >> > > > Simple_Node::check(double, double, double) const ->
> > >> climatological
> > >> > >> > > > distribution percentile threshold "<=CDP10"
requested with
> > >> invalid
> > >> > >> mean
> > >> > >> > > > (-9999) or standard deviation (-9999).
> > >> > >> > > >
> > >> > >> > > > John H. suggested me change "cat_thresh = " to
> "obs_thresh =
> > >> ",
> > >> > >> then
> > >> > >> > > the
> > >> > >> > > > error was solved.
> > >> > >> > > >
> > >> > >> > > > In current METplus version, following your
suggestion as
> > >> > >> > > >
> > >> > >> > > > ENS_VAR1_OPTIONS = obs_thresh = [ <=CDP10,
>CDP10&&<=CDP20,
> > >> > >> > > > >CDP20&&<=CDP30, >CDP30&&<=CDP40, >CDP40&&<=CDP50,
> > >> > >CDP50&&<=CDP60,
> > >> > >> > > > >CDP60&&<=CDP70, >CDP70&&<=CDP80, >CDP80&&<=CDP90,
>CDP90
> ];
> > >> > >> > > >
> > >> > >> > > > the same error appears again. So I am not for sure
if the
> > >> > >> > "obs_thresh"
> > >> > >> > > > setting is correctly passed.
> > >> > >> > > >
> > >> > >> > > > Binbin
> > >> > >> > > >
> > >> > >> > > >
> > >> > >> > > >
> > >> > >> > > >
> > >> > >> > > > On Tue, Jan 5, 2021 at 5:19 PM George McCabe via RT
<
> > >> > >> met_help at ucar.edu
> > >> > >> > >
> > >> > >> > > > wrote:
> > >> > >> > > >
> > >> > >> > > > > Hi Binbin,
> > >> > >> > > > >
> > >> > >> > > > > Your solution should work for now. It looks like
although
> > the
> > >> > >> METplus
> > >> > >> > > > > variable does get read properly, the environment
variable
> > is
> > >> not
> > >> > >> > > actually
> > >> > >> > > > > set by the EnsembleStat wrapper. I can make a note
to add
> > >> that
> > >> > for
> > >> > >> > > 4.0.0,
> > >> > >> > > > > as it is an easy fix.
> > >> > >> > > > >
> > >> > >> > > > > - George
> > >> > >> > > > >
> > >> > >> > > > > On Tue, Jan 5, 2021 at 2:53 PM
Binbin.Zhou at noaa.gov via
> > RT <
> > >> > >> > > > > met_help at ucar.edu> wrote:
> > >> > >> > > > >
> > >> > >> > > > > > George,
> > >> > >> > > > > >
> > >> > >> > > > > > I have a temporal solution:
> > >> > >> > > > > > set ploy in EnembleStat config as
> > >> > >> > > > > > poly = [ "${MASKPATH}/lat_NHM.nc",
> > >> > >> > > > > > "${MASKPATH}/lat_NHM.nc",
> > >> > >> > > > > > "${MASKPATH}/lat_TRP.nc" ];
> > >> > >> > > > > >
> > >> > >> > > > > > then set MASKPATH in user_env_vars part in the
conf
> file
> > >> > >> > > > > > This MASKPAH then can be passed to
EnsembleStat's poly
> [
> > ]
> > >> > entry
> > >> > >> > > > > >
> > >> > >> > > > > > Binbin
> > >> > >> > > > > >
> > >> > >> > > > > > On Tue, Jan 5, 2021 at 4:25 PM Binbin Zhou -
NOAA
> > >> Affiliate <
> > >> > >> > > > > > binbin.zhou at noaa.gov> wrote:
> > >> > >> > > > > >
> > >> > >> > > > > > > George,
> > >> > >> > > > > > >
> > >> > >> > > > > > > Still not working, error says
> > >> > >> > > > > > > ERROR : replace_env() -> unable to get value
for
> > >> > environment
> > >> > >> > > > variable
> > >> > >> > > > > > > "VERIF_MASK"
> > >> > >> > > > > > >
> > >> > >> > > > > > > Binbin
> > >> > >> > > > > > >
> > >> > >> > > > > > >
> > >> > >> > > > > > >
> > >> > >> > > > > > > On Tue, Jan 5, 2021 at 3:50 PM George McCabe
via RT <
> > >> > >> > > > met_help at ucar.edu
> > >> > >> > > > > >
> > >> > >> > > > > > > wrote:
> > >> > >> > > > > > >
> > >> > >> > > > > > >> Hi Binbin,
> > >> > >> > > > > > >>
> > >> > >> > > > > > >> You should be able to set it in the METplus
config
> the
> > >> same
> > >> > >> way
> > >> > >> > it
> > >> > >> > > > is
> > >> > >> > > > > > done
> > >> > >> > > > > > >> for GridStat -- no quotes with commas between
each
> > item.
> > >> > The
> > >> > >> > > wrapper
> > >> > >> > > > > > >> should
> > >> > >> > > > > > >> format it properly.
> > >> > >> > > > > > >>
> > >> > >> > > > > > >> Here is an example from an existing use case:
> > >> > >> > > > > > >>
> > >> > >> > > > > > >> GRID_STAT_VERIFICATION_MASK_TEMPLATE =
> > >> > >> > > > > > >>
> > >> > >> > >
> > >>
{INPUT_BASE}/model_applications/precipitation/mask/CONUS_HRRRTLE.nc,
> > >> > >> > > > > > >>
> > >> > >> > >
> > >>
{INPUT_BASE}/model_applications/precipitation/mask/EAST_HRRRTLE.nc,
> > >> > >> > > > > > >>
> > >> > >> >
> > {INPUT_BASE}/model_applications/precipitation/mask/WEST_HRRRTLE.nc
> > >> > >> > > > > > >>
> > >> > >> > > > > > >> You should be able to set them the same way
using
> > >> > >> > > > > > >> ENSEMBLE_STAT_VERIFICATION_MASK_TEMPLATE. Let
me
> know
> > if
> > >> > that
> > >> > >> > > > doesn't
> > >> > >> > > > > > >> work.
> > >> > >> > > > > > >>
> > >> > >> > > > > > >> - George
> > >> > >> > > > > > >>
> > >> > >> > > > > > >> On Tue, Jan 5, 2021 at 1:45 PM
Binbin.Zhou at noaa.gov
> > via
> > >> > RT <
> > >> > >> > > > > > >> met_help at ucar.edu> wrote:
> > >> > >> > > > > > >>
> > >> > >> > > > > > >> >
> > >> > >> > > > > > >> > <URL:
> > >> > >> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
> > >> > >> > >
> > >> > >> > > > > > >> >
> > >> > >> > > > > > >> > George,
> > >> > >> > > > > > >> >
> > >> > >> > > > > > >> > I got another issue for verification mask
> setting.
> > >> > >> > > > > > >> >
> > >> > >> > > > > > >> > I am using $VERIF_MASK in EnsembleStat
config
> f/ile
> > >> > >> > > > > > >> > mask = {
> > >> > >> > > > > > >> > grid = [];
> > >> > >> > > > > > >> > poly = [${VERIF_MASK}];
> > >> > >> > > > > > >> > sid = [];
> > >> > >> > > > > > >> > }
> > >> > >> > > > > > >> >
> > >> > >> > > > > > >> > And using
GRID_STAT_VERIFICATION_MASK_TEMPLATE to
> > >> define
> > >> > >> > > several
> > >> > >> > > > > > >> polygon
> > >> > >> > > > > > >> > nc mask files
> > >> > >> > > > > > >> > But it seems not working. But it works for
> Gridstat
> > >> > config
> > >> > >> in
> > >> > >> > > > suich
> > >> > >> > > > > > >> > setting.
> > >> > >> > > > > > >> > I can not find ENSEMBLE_STAT_
> > >> VERIFICATION_MASK_TEMPLATE
> > >> > in
> > >> > >> > the
> > >> > >> > > > > > METplus
> > >> > >> > > > > > >> doc
> > >> > >> > > > > > >> >
> > >> > >> > > > > > >> > So I define VERIF_MASK in [user_env_vars]
part.
> > >> > >> > > > > > >> > It values can not be passed to ploy =
> > [${VERIF_MASK}]
> > >> in
> > >> > >> the
> > >> > >> > > > > > >> EnsembleStat
> > >> > >> > > > > > >> > conf if more than one nc files included.
> > >> > >> > > > > > >> > For example
> > >> > >> > > > > > >> > VERIF_MASK=" '/part/p1.cn', '/path/p2.nc'
"
> > >> > >> > > > > > >> > the error says poly = [/path/p1,]
> > >> > >> > > > > > >> > It seems double quote or single quote can
not be
> > >> passed
> > >> > to
> > >> > >> > > > > VERIF_MASK
> > >> > >> > > > > > in
> > >> > >> > > > > > >> > the EnsembleStat config.
> > >> > >> > > > > > >> > I tried use back slash \ to before quote,
but
> still
> > >> not
> > >> > >> > working
> > >> > >> > > > > > >> >
> > >> > >> > > > > > >> > Binbin
> > >> > >> > > > > > >> >
> > >> > >> > > > > > >> >
> > >> > >> > > > > > >> > On Tue, Jan 5, 2021 at 10:33 AM Binbin Zhou
- NOAA
> > >> > >> Affiliate <
> > >> > >> > > > > > >> > binbin.zhou at noaa.gov> wrote:
> > >> > >> > > > > > >> >
> > >> > >> > > > > > >> > > George,
> > >> > >> > > > > > >> > >
> > >> > >> > > > > > >> > > Thanks for your quick response! I'll
test
> this
> > >> > >> settings
> > >> > >> > and
> > >> > >> > > > let
> > >> > >> > > > > > >> > > you know the results.
> > >> > >> > > > > > >> > >
> > >> > >> > > > > > >> > > Binbin
> > >> > >> > > > > > >> > >
> > >> > >> > > > > > >> > > On Tue, Jan 5, 2021 at 10:17 AM George
McCabe
> via
> > >> RT <
> > >> > >> > > > > > >> met_help at ucar.edu>
> > >> > >> > > > > > >> > > wrote:
> > >> > >> > > > > > >> > >
> > >> > >> > > > > > >> > >> Hi Binbin,
> > >> > >> > > > > > >> > >>
> > >> > >> > > > > > >> > >> Happy New Year to you too!
> > >> > >> > > > > > >> > >>
> > >> > >> > > > > > >> > >> I will comment on each configuration
variable
> and
> > >> how
> > >> > to
> > >> > >> > set
> > >> > >> > > it
> > >> > >> > > > > in
> > >> > >> > > > > > a
> > >> > >> > > > > > >> > >> METplus config inline:
> > >> > >> > > > > > >> > >>
> > >> > >> > > > > > >> > >> ens = {
> > >> > >> > > > > > >> > >> ens_thresh = 1.0;
> > >> > >> > > > > > >> > >>
> > >> > >> > > > > > >> > >>
> > >> > >> > > > > > >> > >> *This is controlled by the
> > ENSEMBLE_STAT_ENS_THRESH
> > >> > >> > variable.
> > >> > >> > > > The
> > >> > >> > > > > > >> > default
> > >> > >> > > > > > >> > >> value is 1.0, so you don't need to
include it
> in
> > >> your
> > >> > >> > config
> > >> > >> > > > > file,
> > >> > >> > > > > > >> but
> > >> > >> > > > > > >> > you
> > >> > >> > > > > > >> > >> can if you may adjust this value at some
> point.*
> > >> > >> > > > > > >> > >>
> > >> > >> > > > > > >> > >> vld_thresh = 1.0;
> > >> > >> > > > > > >> > >>
> > >> > >> > > > > > >> > >> *This value is set to 1.0 by default so
we
> don't
> > >> need
> > >> > to
> > >> > >> > > worry
> > >> > >> > > > > > about
> > >> > >> > > > > > >> it
> > >> > >> > > > > > >> > >> right now.*
> > >> > >> > > > > > >> > >>
> > >> > >> > > > > > >> > >> field = [
> > >> > >> > > > > > >> > >>
> > >> > >> > > > > > >> > >> {
> > >> > >> > > > > > >> > >> name = "HGT";
> > >> > >> > > > > > >> > >> level = "P500";
> > >> > >> > > > > > >> > >> obs_thresh = [ <=CDP10,
> >CDP10&&<=CDP20,
> > >> > >> > > > > >CDP20&&<=CDP30,
> > >> > >> > > > > > >> > >> >CDP30&&<=CDP40, >CDP40&&<=CDP50,
> > >CDP50&&<=CDP60,
> > >> > >> > > > > >CDP60&&<=CDP70,
> > >> > >> > > > > > >> > >> >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90
];
> > >> > >> > > > > > >> > >> }
> > >> > >> > > > > > >> > >> ]
> > >> > >> > > > > > >> > >> }
> > >> > >> > > > > > >> > >> fcst = ens;
> > >> > >> > > > > > >> > >> obs = fcst;
> > >> > >> > > > > > >> > >>
> > >> > >> > > > > > >> > >> *1) The field info for ens is set in the
> > >> > >> > > > > > >> > >> ENS_VAR<n>_[NAME/LEVEL/THRESH/OPTIONS]
> variables.
> > >> The
> > >> > >> fcst
> > >> > >> > > and
> > >> > >> > > > > obs
> > >> > >> > > > > > >> field
> > >> > >> > > > > > >> > >> info are set in the corresponding
FCST_VAR<n>_*
> > and
> > >> > >> > > > OBS_VAR<n>_*
> > >> > >> > > > > > >> > variables
> > >> > >> > > > > > >> > >> respectively, or you can use
BOTH_VAR<n>_* if
> the
> > >> FCST
> > >> > >> and
> > >> > >> > > OBS
> > >> > >> > > > > > values
> > >> > >> > > > > > >> > are
> > >> > >> > > > > > >> > >> the same.*
> > >> > >> > > > > > >> > >>
> > >> > >> > > > > > >> > >> *If ENS_VAR<n>_* variables are not
explicitly
> > set,
> > >> > then
> > >> > >> it
> > >> > >> > > will
> > >> > >> > > > > use
> > >> > >> > > > > > >> the
> > >> > >> > > > > > >> > >> values from FCST_VAR<n>_*.*
> > >> > >> > > > > > >> > >> *Since the fcst, obs, and ens are all
the same
> > you
> > >> > could
> > >> > >> > just
> > >> > >> > > > use
> > >> > >> > > > > > >> > >> BOTH_VAR<n>_* variables to control all
3,
> > although
> > >> > keep
> > >> > >> in
> > >> > >> > > mind
> > >> > >> > > > > > that
> > >> > >> > > > > > >> if
> > >> > >> > > > > > >> > >> you
> > >> > >> > > > > > >> > >> need to change one of them for any
reason, it
> > will
> > >> be
> > >> > >> more
> > >> > >> > > > > > difficult
> > >> > >> > > > > > >> to
> > >> > >> > > > > > >> > do
> > >> > >> > > > > > >> > >> this. If you know that they will always
be the
> > same
> > >> > >> values,
> > >> > >> > > > then
> > >> > >> > > > > I
> > >> > >> > > > > > >> > >> recommend using BOTH_, but if you know
they may
> > >> change
> > >> > >> or
> > >> > >> > are
> > >> > >> > > > > > >> unsure, I
> > >> > >> > > > > > >> > >> would recommend setting them by
referencing the
> > >> other
> > >> > >> > > > variables,
> > >> > >> > > > > > >> i.e.*
> > >> > >> > > > > > >> > >>
> > >> > >> > > > > > >> > >> *FCST_VAR1_NAME = HGT*
> > >> > >> > > > > > >> > >> *FCST_VAR1_LEVELS = P500 *
> > >> > >> > > > > > >> > >> *OBS_VAR1_NAME = {FCST_VAR1_NAME}*
> > >> > >> > > > > > >> > >> *OBS_VAR1_LEVELS = {FCST_VAR1_LEVELS}*
> > >> > >> > > > > > >> > >>
> > >> > >> > > > > > >> > >> *2) The [FCST/OBS/ENS]_VAR<n>_THRESH
variables
> > set
> > >> the
> > >> > >> > > > cat_thresh
> > >> > >> > > > > > >> values
> > >> > >> > > > > > >> > >> in
> > >> > >> > > > > > >> > >> the field info. A variable specific to
> obs_thresh
> > >> is
> > >> > not
> > >> > >> > > > > currently
> > >> > >> > > > > > >> > >> supported, however you can set these
values by
> > >> using
> > >> > the
> > >> > >> > > > > > >> > ENS_VAR1_OPTIONS
> > >> > >> > > > > > >> > >> variable, i.e.*
> > >> > >> > > > > > >> > >>
> > >> > >> > > > > > >> > >> *ENS_VAR1_OPTIONS = obs_thresh = [
<=CDP10,
> > >> > >> > >CDP10&&<=CDP20,
> > >> > >> > > > > > >> > >> >CDP20&&<=CDP30, >CDP30&&<=CDP40,
> > >CDP40&&<=CDP50,
> > >> > >> > > > > >CDP50&&<=CDP60,
> > >> > >> > > > > > >> > >> >CDP60&&<=CDP70, >CDP70&&<=CDP80,
> > >CDP80&&<=CDP90,
> > >> > >> >CDP90
> > >> > >> > ];*
> > >> > >> > > > > > >> > >>
> > >> > >> > > > > > >> > >>
> > >> > >> > > > > > >> > >> *Remember to include the semicolon at
the end!
> *
> > >> > >> > > > > > >> > >>
> > >> > >> > > > > > >> > >> ens_ssvar_bin_size = 1000000;
> > >> > >> > > > > > >> > >> *1) This variable is different from the
default
> > and
> > >> > not
> > >> > >> > > > currently
> > >> > >> > > > > > >> > >> supported
> > >> > >> > > > > > >> > >> with a METplus config variable. I will
add this
> > to
> > >> the
> > >> > >> list
> > >> > >> > > of
> > >> > >> > > > > > >> variables
> > >> > >> > > > > > >> > >> in
> > >> > >> > > > > > >> > >> MET config files that we want to
support.
> > However,
> > >> in
> > >> > >> the
> > >> > >> > > > > meantime
> > >> > >> > > > > > >> you
> > >> > >> > > > > > >> > can
> > >> > >> > > > > > >> > >> copy the default wrapped MET config file
and
> > >> modify it
> > >> > >> to
> > >> > >> > fit
> > >> > >> > > > > your
> > >> > >> > > > > > >> > needs.
> > >> > >> > > > > > >> > >> To do this, you will need to:*
> > >> > >> > > > > > >> > >>
> > >> > >> > > > > > >> > >> * a) Copy
> > >> > >> > METplus/parm/met_config/EnsembleStatConfig_wrapped
> > >> > >> > > > to
> > >> > >> > > > > > the
> > >> > >> > > > > > >> > >> directory that contains your METplus
config
> file
> > >> for
> > >> > >> this
> > >> > >> > use
> > >> > >> > > > > case.
> > >> > >> > > > > > >> > Rename
> > >> > >> > > > > > >> > >> it by replacing "wrapped" with a short
> > description
> > >> > that
> > >> > >> > > > pertains
> > >> > >> > > > > to
> > >> > >> > > > > > >> your
> > >> > >> > > > > > >> > >> use case.*
> > >> > >> > > > > > >> > >>
> > >> > >> > > > > > >> > >> * b) In your METplus config file,
change the
> > >> value of
> > >> > >> > > > > > >> > >> ENSEMBLE_STAT_CONFIG_FILE to point to
the path
> of
> > >> this
> > >> > >> new
> > >> > >> > > > config
> > >> > >> > > > > > >> file.*
> > >> > >> > > > > > >> > >>
> > >> > >> > > > > > >> > >> * c) If you know the value you want to
use for
> > >> this
> > >> > >> > variable
> > >> > >> > > > > will
> > >> > >> > > > > > >> > always
> > >> > >> > > > > > >> > >> be 1000000, then simply set the variable
to
> that
> > >> > value.
> > >> > >> If
> > >> > >> > > you
> > >> > >> > > > > > think
> > >> > >> > > > > > >> you
> > >> > >> > > > > > >> > >> may want to change the value, then you
can
> > utilize
> > >> the
> > >> > >> > > > > > >> [user_env_vars]
> > >> > >> > > > > > >> > >> functionality. See:
> > >> > >> > > > > > >> > >>
> > >> > >> > > > > > >> > >>
> > >> > >> > > > > > >> >
> > >> > >> > > > > > >>
> > >> > >> > > > > >
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >> >
> > >> > >>
> > >> >
> > >>
> >
>
https://dtcenter.github.io/METplus/latest/Users_Guide/systemconfiguration.html#user-
defined-config
> > >> > >> > > > > > >> > >> <
> > >> > >> > > > > > >> > >>
> > >> > >> > > > > > >> >
> > >> > >> > > > > > >>
> > >> > >> > > > > >
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >> >
> > >> > >>
> > >> >
> > >>
> >
>
https://dtcenter.github.io/METplus/latest/Users_Guide/systemconfiguration.html#user-
defined-config
> > >> > >> > > > > > >> > >> >*
> > >> > >> > > > > > >> > >> *In this case, you would add the
following to
> > your
> > >> > >> METplus
> > >> > >> > > > > config:*
> > >> > >> > > > > > >> > >>
> > >> > >> > > > > > >> > >> *[user_env_vars]*
> > >> > >> > > > > > >> > >> *ENS_SSVAR_BIN_SIZE = 1000000*
> > >> > >> > > > > > >> > >>
> > >> > >> > > > > > >> > >> *Then change the line in your
EnsembleStat
> config
> > >> file
> > >> > >> that
> > >> > >> > > you
> > >> > >> > > > > > >> copied
> > >> > >> > > > > > >> > >> to:*
> > >> > >> > > > > > >> > >>
> > >> > >> > > > > > >> > >> * ens_ssvar_bin_size =
${ENS_SSVAR_BIN_SIZE}; *
> > >> > >> > > > > > >> > >>
> > >> > >> > > > > > >> > >> ens_phist_bin_size = 0.05;
> > >> > >> > > > > > >> > >> *This variable uses the default value,
so you
> > don't
> > >> > >> need to
> > >> > >> > > do
> > >> > >> > > > > > >> anything
> > >> > >> > > > > > >> > >> here. If you need to make it
configurable or
> > change
> > >> > the
> > >> > >> > > value,
> > >> > >> > > > > then
> > >> > >> > > > > > >> > follow
> > >> > >> > > > > > >> > >> the instructions for setting
> ens_ssvar_bin_size.*
> > >> > >> > > > > > >> > >>
> > >> > >> > > > > > >> > >> climo_mean = fcst;
> > >> > >> > > > > > >> > >> climo_mean = {
> > >> > >> > > > > > >> > >> file_name = "${CLIM_MEAN}";
> > >> > >> > > > > > >> > >> time_interp_method = DW_MEAN;
> > >> > >> > > > > > >> > >> match_day = TRUE;
> > >> > >> > > > > > >> > >> time_step = 21600;
> > >> > >> > > > > > >> > >> }
> > >> > >> > > > > > >> > >>
> > >> > >> > > > > > >> > >>
> > >> > >> > > > > > >> > >> *Instead of using CLIM_MEAN, you can set
> > >> > >> > > > > > >> > >>
ENSEMBLE_STAT_CLIMO_MEAN_INPUT_[DIR/TEMPLATE]
> in
> > >> the
> > >> > >> > METplus
> > >> > >> > > > > > config.
> > >> > >> > > > > > >> You
> > >> > >> > > > > > >> > >> can use filename template syntax in the
> _TEMPLATE
> > >> > value,
> > >> > >> > i.e.
> > >> > >> > > > > > >> > >> {valid?fmt=%m%d}. The other variables in
the
> > >> > climo_mean
> > >> > >> > > > > dictionary
> > >> > >> > > > > > >> are
> > >> > >> > > > > > >> > >> actually old variables that have been
replaced
> > with
> > >> > >> > > > day_interval
> > >> > >> > > > > > and
> > >> > >> > > > > > >> > >> hour_interval, but the values you use
are the
> old
> > >> > >> defaults,
> > >> > >> > > so
> > >> > >> > > > > you
> > >> > >> > > > > > >> > >> shouldn't need to set them.*
> > >> > >> > > > > > >> > >>
> > >> > >> > > > > > >> > >> climo_stdev = climo_mean;
> > >> > >> > > > > > >> > >> climo_stdev = {
> > >> > >> > > > > > >> > >> file_name = "${CLIM_STDV}";
> > >> > >> > > > > > >> > >> }
> > >> > >> > > > > > >> > >>
> > >> > >> > > > > > >> > >> *Similarly to CLIM_MEAN, you can use
> > >> > >> > > > > > >> > >>
ENSEMBLE_STAT_CLIMO_STDEV_INPUT_[DIR/TEMPLATE]
> to
> > >> set
> > >> > >> this
> > >> > >> > > file
> > >> > >> > > > > > >> name.*
> > >> > >> > > > > > >> > >>
> > >> > >> > > > > > >> > >> climo_cdf = {
> > >> > >> > > > > > >> > >> cdf_bins = 11;
> > >> > >> > > > > > >> > >> center_bins = TRUE;
> > >> > >> > > > > > >> > >> write_bins = TRUE;
> > >> > >> > > > > > >> > >> }
> > >> > >> > > > > > >> > >> *The value for write_bins is the
default, but
> the
> > >> > values
> > >> > >> > for
> > >> > >> > > > > > cdf_bins
> > >> > >> > > > > > >> > and
> > >> > >> > > > > > >> > >> center_bins do not. To set these, follow
the
> > above
> > >> > >> > > instructions
> > >> > >> > > > > for
> > >> > >> > > > > > >> > >> ens_ssvar_bin_size to override them
and/or make
> > >> them
> > >> > >> > > > configurable
> > >> > >> > > > > > >> > through
> > >> > >> > > > > > >> > >> METplus. I will also add these variables
to the
> > >> list
> > >> > of
> > >> > >> MET
> > >> > >> > > > > configs
> > >> > >> > > > > > >> that
> > >> > >> > > > > > >> > >> users want to be able to easily
configure
> through
> > >> > >> METplus
> > >> > >> > > > > configs.*
> > >> > >> > > > > > >> > >>
> > >> > >> > > > > > >> > >> Please let me know if you run into any
issues
> > >> setting
> > >> > >> any
> > >> > >> > of
> > >> > >> > > > that
> > >> > >> > > > > > up.
> > >> > >> > > > > > >> > >> Also,
> > >> > >> > > > > > >> > >> if there are any other MET config
variables
> that
> > >> you
> > >> > >> want
> > >> > >> > to
> > >> > >> > > > see
> > >> > >> > > > > > >> > supported
> > >> > >> > > > > > >> > >> in METplus, let me know and I will make
sure
> they
> > >> get
> > >> > >> > > included
> > >> > >> > > > > when
> > >> > >> > > > > > >> we
> > >> > >> > > > > > >> > >> have
> > >> > >> > > > > > >> > >> a chance to refactor those wrappers. It
is
> > >> possible to
> > >> > >> add
> > >> > >> > > > > support
> > >> > >> > > > > > >> for
> > >> > >> > > > > > >> > MET
> > >> > >> > > > > > >> > >> configs using the above instructions,
but it is
> > >> always
> > >> > >> > easier
> > >> > >> > > > and
> > >> > >> > > > > > >> less
> > >> > >> > > > > > >> > >> error-prone to have them configurable
directly
> > >> > through a
> > >> > >> > > > variable
> > >> > >> > > > > > in
> > >> > >> > > > > > >> the
> > >> > >> > > > > > >> > >> METplus config.
> > >> > >> > > > > > >> > >>
> > >> > >> > > > > > >> > >> Thanks,
> > >> > >> > > > > > >> > >> George
> > >> > >> > > > > > >> > >>
> > >> > >> > > > > > >> > >> On Tue, Jan 5, 2021 at 7:14 AM
> > >> Binbin.Zhou at noaa.gov
> > >> > via
> > >> > >> > RT <
> > >> > >> > > > > > >> > >> met_help at ucar.edu> wrote:
> > >> > >> > > > > > >> > >>
> > >> > >> > > > > > >> > >> >
> > >> > >> > > > > > >> > >> > Tue Jan 05 07:14:54 2021: Request
98116 was
> > acted
> > >> > >> upon.
> > >> > >> > > > > > >> > >> > Transaction: Ticket created by
> > >> Binbin.Zhou at noaa.gov
> > >> > >> > > > > > >> > >> > Queue: met_help
> > >> > >> > > > > > >> > >> > Subject: CDP threshold setting in
> > >> EnsembleStat
> > >> > >> conf
> > >> > >> > > > > > >> > >> > Owner: Nobody
> > >> > >> > > > > > >> > >> > Requestors: Binbin.Zhou at noaa.gov
> > >> > >> > > > > > >> > >> > Status: new
> > >> > >> > > > > > >> > >> > Ticket <URL:
> > >> > >> > > > > > >>
> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
> > >> > >> > > > > > >> > >
> > >> > >> > > > > > >> > >> >
> > >> > >> > > > > > >> > >> >
> > >> > >> > > > > > >> > >> > George,
> > >> > >> > > > > > >> > >> >
> > >> > >> > > > > > >> > >> > Happy New Year!
> > >> > >> > > > > > >> > >> >
> > >> > >> > > > > > >> > >> > I am working on transition of our
> MET-based
> > >> > global
> > >> > >> > > > ensemble
> > >> > >> > > > > > >> > >> verification
> > >> > >> > > > > > >> > >> > to METplus based package. In this
package
> > >> > climatology
> > >> > >> > bins
> > >> > >> > > > (10
> > >> > >> > > > > > >> bins)
> > >> > >> > > > > > >> > are
> > >> > >> > > > > > >> > >> > used.
> > >> > >> > > > > > >> > >> > In current ensemble stat config file,
the
> > >> relevant
> > >> > >> > entries
> > >> > >> > > > iare
> > >> > >> > > > > > >> > defined
> > >> > >> > > > > > >> > >> > like following
> > >> > >> > > > > > >> > >> >
> > >> > >> > > > > > >> > >> > ens = {
> > >> > >> > > > > > >> > >> > ens_thresh = 1.0;
> > >> > >> > > > > > >> > >> > vld_thresh = 1.0;
> > >> > >> > > > > > >> > >> >
> > >> > >> > > > > > >> > >> > field = [
> > >> > >> > > > > > >> > >> >
> > >> > >> > > > > > >> > >> > {
> > >> > >> > > > > > >> > >> > name = "HGT";
> > >> > >> > > > > > >> > >> > level = "P500";
> > >> > >> > > > > > >> > >> > obs_thresh = [ <=CDP10,
> > >CDP10&&<=CDP20,
> > >> > >> > > > > > >CDP20&&<=CDP30,
> > >> > >> > > > > > >> > >> > >CDP30&&<=CDP40, >CDP40&&<=CDP50,
> > >> >CDP50&&<=CDP60,
> > >> > >> > > > > > >CDP60&&<=CDP70,
> > >> > >> > > > > > >> > >> > >CDP70&&<=CDP80, >CDP80&&<=CDP90,
>CDP90 ];
> > >> > >> > > > > > >> > >> > }
> > >> > >> > > > > > >> > >> > ]
> > >> > >> > > > > > >> > >> > }
> > >> > >> > > > > > >> > >> > fcst = ens;
> > >> > >> > > > > > >> > >> > obs = fcst;
> > >> > >> > > > > > >> > >> > ens_ssvar_bin_size = 1000000;
> > >> > >> > > > > > >> > >> > ens_phist_bin_size = 0.05;
> > >> > >> > > > > > >> > >> > climo_mean = fcst;
> > >> > >> > > > > > >> > >> > climo_mean = {
> > >> > >> > > > > > >> > >> > file_name = "${CLIM_MEAN}";
> > >> > >> > > > > > >> > >> > time_interp_method = DW_MEAN;
> > >> > >> > > > > > >> > >> > match_day = TRUE;
> > >> > >> > > > > > >> > >> > time_step = 21600;
> > >> > >> > > > > > >> > >> > }
> > >> > >> > > > > > >> > >> >
> > >> > >> > > > > > >> > >> > climo_stdev = climo_mean;
> > >> > >> > > > > > >> > >> > climo_stdev = {
> > >> > >> > > > > > >> > >> > file_name = "${CLIM_STDV}";
> > >> > >> > > > > > >> > >> > }
> > >> > >> > > > > > >> > >> >
> > >> > >> > > > > > >> > >> > climo_cdf = {
> > >> > >> > > > > > >> > >> > cdf_bins = 11;
> > >> > >> > > > > > >> > >> > center_bins = TRUE;
> > >> > >> > > > > > >> > >> > write_bins = TRUE;
> > >> > >> > > > > > >> > >> > }
> > >> > >> > > > > > >> > >> >
> > >> > >> > > > > > >> > >> > I can not find the correspondent
settings in
> > its
> > >> > conf
> > >> > >> > file
> > >> > >> > > > from
> > >> > >> > > > > > >> > METplus
> > >> > >> > > > > > >> > >> > online doc.
> > >> > >> > > > > > >> > >> > Can you help me look at this?
> > >> > >> > > > > > >> > >> >
> > >> > >> > > > > > >> > >> > Thanks!
> > >> > >> > > > > > >> > >> >
> > >> > >> > > > > > >> > >> > Binbin
> > >> > >> > > > > > >> > >> >
> > >> > >> > > > > > >> > >> > --
> > >> > >> > > > > > >> > >> >
> > >> > >> > > > > > >> > >> > Binbin Zhou
> > >> > >> > > > > > >> > >> >
> > >> > >> > > > > > >> > >> > IMSG at NOAA/NWS/NCEP/EMC
> > >> > >> > > > > > >> > >> >
> > >> > >> > > > > > >> > >> > 5830 University Research Ct.
> > >> > >> > > > > > >> > >> >
> > >> > >> > > > > > >> > >> > College Park, MD 20740
> > >> > >> > > > > > >> > >> >
> > >> > >> > > > > > >> > >> > Binbin.Zhou at noaa.gov
> > >> > >> > > > > > >> > >> >
> > >> > >> > > > > > >> > >> > 301-683-3683
> > >> > >> > > > > > >> > >> >
> > >> > >> > > > > > >> > >> >
> > >> > >> > > > > > >> > >>
> > >> > >> > > > > > >> > >> --
> > >> > >> > > > > > >> > >> George McCabe - Software Engineer III
> > >> > >> > > > > > >> > >> National Center for Atmospheric Research
> > >> > >> > > > > > >> > >> Research Applications Laboratory
> > >> > >> > > > > > >> > >> 303-497-2768
> > >> > >> > > > > > >> > >> ---
> > >> > >> > > > > > >> > >> My working day may not be your working
day.
> > Please
> > >> do
> > >> > >> not
> > >> > >> > > feel
> > >> > >> > > > > > >> obliged
> > >> > >> > > > > > >> > to
> > >> > >> > > > > > >> > >> reply to this email outside of your
normal
> > working
> > >> > >> hours.
> > >> > >> > > > > > >> > >>
> > >> > >> > > > > > >> > >>
> > >> > >> > > > > > >> > >
> > >> > >> > > > > > >> > > --
> > >> > >> > > > > > >> > >
> > >> > >> > > > > > >> > > Binbin Zhou
> > >> > >> > > > > > >> > >
> > >> > >> > > > > > >> > > IMSG at NOAA/NWS/NCEP/EMC
> > >> > >> > > > > > >> > >
> > >> > >> > > > > > >> > > 5830 University Research Ct.
> > >> > >> > > > > > >> > >
> > >> > >> > > > > > >> > > College Park, MD 20740
> > >> > >> > > > > > >> > >
> > >> > >> > > > > > >> > > Binbin.Zhou at noaa.gov
> > >> > >> > > > > > >> > >
> > >> > >> > > > > > >> > > 301-683-3683
> > >> > >> > > > > > >> > >
> > >> > >> > > > > > >> >
> > >> > >> > > > > > >> >
> > >> > >> > > > > > >> > --
> > >> > >> > > > > > >> >
> > >> > >> > > > > > >> > Binbin Zhou
> > >> > >> > > > > > >> >
> > >> > >> > > > > > >> > IMSG at NOAA/NWS/NCEP/EMC
> > >> > >> > > > > > >> >
> > >> > >> > > > > > >> > 5830 University Research Ct.
> > >> > >> > > > > > >> >
> > >> > >> > > > > > >> > College Park, MD 20740
> > >> > >> > > > > > >> >
> > >> > >> > > > > > >> > Binbin.Zhou at noaa.gov
> > >> > >> > > > > > >> >
> > >> > >> > > > > > >> > 301-683-3683
> > >> > >> > > > > > >> >
> > >> > >> > > > > > >> >
> > >> > >> > > > > > >>
> > >> > >> > > > > > >> --
> > >> > >> > > > > > >> George McCabe - Software Engineer III
> > >> > >> > > > > > >> National Center for Atmospheric Research
> > >> > >> > > > > > >> Research Applications Laboratory
> > >> > >> > > > > > >> 303-497-2768
> > >> > >> > > > > > >> ---
> > >> > >> > > > > > >> My working day may not be your working day.
Please
> do
> > >> not
> > >> > >> feel
> > >> > >> > > > obliged
> > >> > >> > > > > > to
> > >> > >> > > > > > >> reply to this email outside of your normal
working
> > >> hours.
> > >> > >> > > > > > >>
> > >> > >> > > > > > >>
> > >> > >> > > > > > >
> > >> > >> > > > > > > --
> > >> > >> > > > > > >
> > >> > >> > > > > > > Binbin Zhou
> > >> > >> > > > > > >
> > >> > >> > > > > > > IMSG at NOAA/NWS/NCEP/EMC
> > >> > >> > > > > > >
> > >> > >> > > > > > > 5830 University Research Ct.
> > >> > >> > > > > > >
> > >> > >> > > > > > > College Park, MD 20740
> > >> > >> > > > > > >
> > >> > >> > > > > > > Binbin.Zhou at noaa.gov
> > >> > >> > > > > > >
> > >> > >> > > > > > > 301-683-3683
> > >> > >> > > > > > >
> > >> > >> > > > > >
> > >> > >> > > > > >
> > >> > >> > > > > > --
> > >> > >> > > > > >
> > >> > >> > > > > > Binbin Zhou
> > >> > >> > > > > >
> > >> > >> > > > > > IMSG at NOAA/NWS/NCEP/EMC
> > >> > >> > > > > >
> > >> > >> > > > > > 5830 University Research Ct.
> > >> > >> > > > > >
> > >> > >> > > > > > College Park, MD 20740
> > >> > >> > > > > >
> > >> > >> > > > > > Binbin.Zhou at noaa.gov
> > >> > >> > > > > >
> > >> > >> > > > > > 301-683-3683
> > >> > >> > > > > >
> > >> > >> > > > > >
> > >> > >> > > > >
> > >> > >> > > > > --
> > >> > >> > > > > George McCabe - Software Engineer III
> > >> > >> > > > > National Center for Atmospheric Research
> > >> > >> > > > > Research Applications Laboratory
> > >> > >> > > > > 303-497-2768
> > >> > >> > > > > ---
> > >> > >> > > > > My working day may not be your working day. Please
do not
> > >> feel
> > >> > >> > obliged
> > >> > >> > > to
> > >> > >> > > > > reply to this email outside of your normal working
hours.
> > >> > >> > > > >
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > > > --
> > >> > >> > > >
> > >> > >> > > > Binbin Zhou
> > >> > >> > > >
> > >> > >> > > > IMSG at NOAA/NWS/NCEP/EMC
> > >> > >> > > >
> > >> > >> > > > 5830 University Research Ct.
> > >> > >> > > >
> > >> > >> > > > College Park, MD 20740
> > >> > >> > > >
> > >> > >> > > > Binbin.Zhou at noaa.gov
> > >> > >> > > >
> > >> > >> > > > 301-683-3683
> > >> > >> > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >> > > --
> > >> > >> > > George McCabe - Software Engineer III
> > >> > >> > > National Center for Atmospheric Research
> > >> > >> > > Research Applications Laboratory
> > >> > >> > > 303-497-2768
> > >> > >> > > ---
> > >> > >> > > My working day may not be your working day. Please do
not
> feel
> > >> > >> obliged to
> > >> > >> > > reply to this email outside of your normal working
hours.
> > >> > >> > >
> > >> > >> > >
> > >> > >> >
> > >> > >> > --
> > >> > >> >
> > >> > >> > Binbin Zhou
> > >> > >> >
> > >> > >> > IMSG at NOAA/NWS/NCEP/EMC
> > >> > >> >
> > >> > >> > 5830 University Research Ct.
> > >> > >> >
> > >> > >> > College Park, MD 20740
> > >> > >> >
> > >> > >> > Binbin.Zhou at noaa.gov
> > >> > >> >
> > >> > >> > 301-683-3683
> > >> > >> >
> > >> > >> >
> > >> > >>
> > >> > >> --
> > >> > >> Julie Prestopnik (she/her)
> > >> > >> Software Engineer
> > >> > >> National Center for Atmospheric Research
> > >> > >> Research Applications Laboratory
> > >> > >> Email: jpresto at ucar.edu
> > >> > >>
> > >> > >> My working day may not be your working day. Please do not
feel
> > >> obliged
> > >> > to
> > >> > >> reply to this email outside of your normal working hours.
> > >> > >>
> > >> > >>
> > >> > >
> > >> > > --
> > >> > >
> > >> > > Binbin Zhou
> > >> > >
> > >> > > IMSG at NOAA/NWS/NCEP/EMC
> > >> > >
> > >> > > 5830 University Research Ct.
> > >> > >
> > >> > > College Park, MD 20740
> > >> > >
> > >> > > Binbin.Zhou at noaa.gov
> > >> > >
> > >> > > 301-683-3683
> > >> > >
> > >> >
> > >> >
> > >> > --
> > >> >
> > >> > Binbin Zhou
> > >> >
> > >> > IMSG at NOAA/NWS/NCEP/EMC
> > >> >
> > >> > 5830 University Research Ct.
> > >> >
> > >> > College Park, MD 20740
> > >> >
> > >> > Binbin.Zhou at noaa.gov
> > >> >
> > >> > 301-683-3683
> > >> >
> > >> >
> > >>
> > >> --
> > >> Julie Prestopnik (she/her)
> > >> Software Engineer
> > >> National Center for Atmospheric Research
> > >> Research Applications Laboratory
> > >> Email: jpresto at ucar.edu
> > >>
> > >> My working day may not be your working day. Please do not feel
> obliged
> > to
> > >> reply to this email outside of your normal working hours.
> > >>
> > >>
> > >
> > > --
> > > George McCabe - Software Engineer III
> > > National Center for Atmospheric Research
> > > Research Applications Laboratory
> > > 303-497-2768
> > > ---
> > > My working day may not be your working day. Please do not feel
obliged
> to
> > > reply to this email outside of your normal working hours.
> > >
> >
> >
> > --
> >
> > Binbin Zhou
> >
> > IMSG at NOAA/NWS/NCEP/EMC
> >
> > 5830 University Research Ct.
> >
> > College Park, MD 20740
> >
> > Binbin.Zhou at noaa.gov
> >
> > 301-683-3683
> >
> >
>
> --
> George McCabe - Software Engineer III
> National Center for Atmospheric Research
> Research Applications Laboratory
> 303-497-2768
> ---
> My working day may not be your working day. Please do not feel
obliged to
> reply to this email outside of your normal working hours.
>
>
--
Binbin Zhou
IMSG at NOAA/NWS/NCEP/EMC
5830 University Research Ct.
College Park, MD 20740
Binbin.Zhou at noaa.gov
301-683-3683
------------------------------------------------
Subject: CDP threshold setting in EnsembleStat conf
From: Binbin.Zhou at noaa.gov
Time: Wed Jan 06 14:38:59 2021
George,
Even I deleted time_step in the climo_mean entry, this error is
still
there.
So I think climo_mean=fcst should be removed and define climo_mean
part
separately.
But how to define the fields (name, level) in climo_mean in METplus
conf
file?
Maybe hard copy the fields for climo_mean in EnsembleGrid config file?
Binbin
On Wed, Jan 6, 2021 at 4:18 PM Binbin Zhou - NOAA Affiliate <
binbin.zhou at noaa.gov> wrote:
> George,
>
> Rerun has same error
> Skipping the 19590104_000000 "HGT/P500" climatology field since the
time
> offset (43200 seconds) >= the "hour_interval" entry (21600 seconds)
from
> file:
>
/gpfs/dell2/emc/modeling/noscrub/Binbin.Zhou/g2g/com/verf/dev/ens.20210104/clim.grid3.mean.010400.grib2
>
> The new setting for climo in EnemsbleGrid config file is
> climo_mean = fcst;
> climo_mean = {
> file_name = [ ${CLIMO_MEAN_FILE} ];
> time_interp_method = DW_MEAN;
> match_day = FALSE;
> time_step = 43200;
> }
> climo_stdev = climo_mean;
> climo_stdev = {
> file_name = [ ${CLIMO_STDEV_FILE} ];
> }
>
> climo_cdf = {
> cdf_bins = 11;
> center_bins = TRUE;
> write_bins = TRUE;
> }
>
> It seems time_step is not effective?
>
> Binbin
>
> On Wed, Jan 6, 2021 at 3:15 PM George McCabe via RT
<met_help at ucar.edu>
> wrote:
>
>> Hi Binbin,
>>
>> Thanks for sending the updated logs. It looks like your climatology
fields
>> are not being read properly. I think this line explains the
problem:
>>
>> DEBUG 3: Skipping the 19590104_000000 "HGT/P500" climatology field
since
>> the time offset (43200 seconds) >= the "hour_interval" entry (21600
>> seconds) from file:
>>
>>
/gpfs/dell2/emc/modeling/noscrub/Binbin.Zhou/g2g/com/verf/dev/ens.20210104/clim.grid3.stdv.010400.grib2
>>
>> The variables match_day and time_step in your climo_mean dictionary
are
>> actually no longer used and have been replaced with:
>>
>> day_interval = 31;
>> hour_interval = 6;
>>
>> 21600 seconds is 6 hours and it sounds like your climo field is
offset by
>> 12 hours. I believe setting hour_interval to 12 should allow it to
find
>> the
>> climatology field and compute the statistics properly. Let me know
if it
>> does not.
>>
>> Thanks,
>> George
>>
>> On Wed, Jan 6, 2021 at 12:43 PM Binbin.Zhou at noaa.gov via RT <
>> met_help at ucar.edu> wrote:
>>
>> >
>> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116 >
>> >
>> > George,
>> >
>> > I have re-run the case with LOG_LEVEL=DEBUG and
>> > LOG_ENSEMBLE_STAT_VERBOSITY =3.
>> > The output log file has been sent to hera:
>> >
>> >
>> /scratch2/NCEPDEV/fv3-
cam/noscrub/Binbin.Zhou/metplus_test/metplus3.out/log/master_metplus.log.20210106193455
>> >
>> > Please look at it.
>> >
>> > Thanks!
>> >
>> > Biinbin
>> >
>> > On Wed, Jan 6, 2021 at 2:19 PM George McCabe <mccabe at ucar.edu>
wrote:
>> >
>> > > Hi Binbin,
>> > >
>> > > Thanks for putting those files on hera. The log output you sent
>> doesn't
>> > > have the DEBUG level output (LOG_LEVEL=DEBUG). However, I tried
to run
>> > > EnsembleStat locally using the _OPTIONS value you set and it
seems to
>> run
>> > > fine. The error seems to suggest that something went wrong when
>> computing
>> > > the mean and standard deviation before the obs_thresh values
are
>> > applied. I
>> > > have reached out to John HG to see if he has any insight as to
why
>> that
>> > is
>> > > happening. In the meantime, you could rerun with
>> > > LOG_ENSEMBLE_STAT_VERBOSITY set to a higher value than 2 to
see if
>> the
>> > > extra log output from the MET tool gives you any more insight
as to
>> what
>> > is
>> > > going wrong.
>> > >
>> > > - George
>> > >
>> > > On Wed, Jan 6, 2021 at 9:51 AM Julie Prestopnik via RT <
>> > met_help at ucar.edu>
>> > > wrote:
>> > >
>> > >> Thanks for all of the info Binbin. I saw that you had copied
>> everything
>> > >> to
>> > >> hera for George. I am currently no longer on WCOSS, so I
unless
>> George
>> > >> lets me know that he needs something from WCOSS, I'll assume
he is
>> able
>> > to
>> > >> get it from hera.
>> > >>
>> > >> Julie
>> > >>
>> > >> On Wed, Jan 6, 2021 at 9:39 AM Binbin.Zhou at noaa.gov via RT <
>> > >> met_help at ucar.edu> wrote:
>> > >>
>> > >> >
>> > >> > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116 >
>> > >> >
>> > >> > The EnsembleStat config file for the successful run outside
of
>> METplus
>> > >> is
>> > >> >
>> > >> >
>> > >>
>> >
>>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_met_global_ens1p0.v1.0.0/parm/verf_g2g_ens_stat_config_bin11
>> > >> > on WCOSS
>> > >> >
>> > >> > Binbin
>> > >> >
>> > >> > On Wed, Jan 6, 2021 at 11:34 AM Binbin Zhou - NOAA Affiliate
<
>> > >> > binbin.zhou at noaa.gov> wrote:
>> > >> >
>> > >> > > Julie,
>> > >> > >
>> > >> > > The output directory on WCOSS is
>> > >> > >
>> > >> > >
>> > >> >
>> > >>
>> >
>>
/gpfs/dell1/ptmp/Binbin.Zhou/g2g/RFC2/tmpnwprd/verf_g2g_gefs_00_dev.161076/metplus3.out
>> > >> > >
>> > >> > > My METplus package on WCOSS is
>> > >> > >
>> > >> >
>> > >>
>> >
>>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_g2g.v4.0.0
>> > >> > >
>> > >> > > For GEFS, the EnsembleGrid config file is
>> > >> > >
>> > >> > >
>> > >> >
>> > >>
>> >
>>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_g2g.v4.0.0/parm/app_conf/grid2grid/met_config/EnsembleStatConfig_gefs_bin11
>> > >> > > Its conf file
>> > >> > > is
>> > >> >
>> > >>
>> >
>>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_g2g.v4.0.0/parm/app_conf/grid2grid/gefs_conf/gefs_bin11.conf
>> > >> > >
>> > >> > > The running process is little bit complex since this is a
>> transition
>> > >> to
>> > >> > > future operational package that uses
>> > >> > > mpi parallel: the script is
>> > >> > >
>> > >> > >
>> > >> >
>> > >>
>> >
>>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_g2g.v4.0.0/ush/verf_g2g_metplus_run_gefs_mpi.sh
>> > >> > >
>> > >> > > Binbin
>> > >> > >
>> > >> > >
>> > >> > >
>> > >> > >
>> > >> > > On Wed, Jan 6, 2021 at 11:00 AM Julie Prestopnik via RT <
>> > >> > met_help at ucar.edu>
>> > >> > > wrote:
>> > >> > >
>> > >> > >> Hi Binbin.
>> > >> > >>
>> > >> > >> This is Julie. I haven't been following this entire
thread,
>> but I
>> > >> am on
>> > >> > >> WCOSS right now. If you send a path to a file, I can
pull it
>> and
>> > >> put it
>> > >> > >> on
>> > >> > >> our ftp server for George.
>> > >> > >>
>> > >> > >> Julie
>> > >> > >>
>> > >> > >> On Wed, Jan 6, 2021 at 8:57 AM Binbin.Zhou at noaa.gov via
RT <
>> > >> > >> met_help at ucar.edu> wrote:
>> > >> > >>
>> > >> > >> >
>> > >> > >> > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
>> >
>> > >> > >> >
>> > >> > >> > George,
>> > >> > >> >
>> > >> > >> > Can you access WCOSS or access HERA?
>> > >> > >> > Otherwise I will email attached to you
>> > >> > >> >
>> > >> > >> > Binbin
>> > >> > >> >
>> > >> > >> >
>> > >> > >> >
>> > >> > >> > On Wed, Jan 6, 2021 at 10:46 AM George McCabe via RT <
>> > >> > met_help at ucar.edu
>> > >> > >> >
>> > >> > >> > wrote:
>> > >> > >> >
>> > >> > >> > > Hi Binbin,
>> > >> > >> > >
>> > >> > >> > > Could you send me a log file for a run with
LOG_LEVEL=DEBUG
>> (in
>> > >> > >> METplus
>> > >> > >> > > config) so I can see how the environment variable
ENS_FIELD
>> is
>> > >> set?
>> > >> > >> The
>> > >> > >> > > values of ENS_VAR<n>_* are formatted and set in this
>> > environment
>> > >> > >> variable
>> > >> > >> > > which is passed into the MET config. You can compare
that
>> value
>> > >> with
>> > >> > >> what
>> > >> > >> > > you used in your successful run outside of the
METplus
>> wrapper
>> > to
>> > >> > >> > determine
>> > >> > >> > > what is different.
>> > >> > >> > >
>> > >> > >> > > Thanks,
>> > >> > >> > > George
>> > >> > >> > >
>> > >> > >> > > On Wed, Jan 6, 2021 at 7:11 AM Binbin.Zhou at noaa.gov
via RT
>> <
>> > >> > >> > > met_help at ucar.edu> wrote:
>> > >> > >> > >
>> > >> > >> > > >
>> > >> > >> > > > <URL:
>> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
>> > >> >
>> > >> > >> > > >
>> > >> > >> > > > George,
>> > >> > >> > > >
>> > >> > >> > > > I got a new error in execution although some
output
>> files
>> > (nc
>> > >> > >> file)
>> > >> > >> > are
>> > >> > >> > > > created but stat files not.
>> > >> > >> > > > The error message is
>> > >> > >> > > >
>> > >> > >> > > > ERROR :
>> > >> > >> > > > ERROR : Simple_Node::check(double, double, double)
const
>> ->
>> > >> > >> > > climatological
>> > >> > >> > > > distribution percentile threshold "<=CDP10"
requested with
>> > >> invalid
>> > >> > >> mean
>> > >> > >> > > > (-9999) or standard deviation (-9999).
>> > >> > >> > > > ERROR :
>> > >> > >> > > >
>> > >> > >> > > > Such an error was ever investigated by John H
before (year
>> > >> ago):
>> > >> > >> When I
>> > >> > >> > > > directly ran ensemble_stat for global ensemble (not
>> > >> METplus-based,
>> > >> > >> > > > but hard code of all settings in EnsembleStat
config
>> file):
>> > If
>> > >> > hard
>> > >> > >> > code
>> > >> > >> > > > fcst field in EnsembleStat config file like this
>> > >> > >> > > >
>> > >> > >> > > > name = "HGT";
>> > >> > >> > > > level = "P500";
>> > >> > >> > > > cat_thresh = [ <=CDP10, >CDP10&&<=CDP20,
>> > >> >CDP20&&<=CDP30,
>> > >> > >> > > > >CDP30&&<=CDP40, >CDP40&&<=CDP50, >CDP50&&<=CDP60,
>> > >> > >CDP60&&<=CDP70,
>> > >> > >> > > > >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];
>> > >> > >> > > >
>> > >> > >> > > > Run ensemble_stat will have such error: ERROR :
>> > >> > >> > > > Simple_Node::check(double, double, double) const ->
>> > >> climatological
>> > >> > >> > > > distribution percentile threshold "<=CDP10"
requested with
>> > >> invalid
>> > >> > >> mean
>> > >> > >> > > > (-9999) or standard deviation (-9999).
>> > >> > >> > > >
>> > >> > >> > > > John H. suggested me change "cat_thresh = " to
>> "obs_thresh =
>> > >> ",
>> > >> > >> then
>> > >> > >> > > the
>> > >> > >> > > > error was solved.
>> > >> > >> > > >
>> > >> > >> > > > In current METplus version, following your
suggestion as
>> > >> > >> > > >
>> > >> > >> > > > ENS_VAR1_OPTIONS = obs_thresh = [ <=CDP10,
>> >CDP10&&<=CDP20,
>> > >> > >> > > > >CDP20&&<=CDP30, >CDP30&&<=CDP40, >CDP40&&<=CDP50,
>> > >> > >CDP50&&<=CDP60,
>> > >> > >> > > > >CDP60&&<=CDP70, >CDP70&&<=CDP80, >CDP80&&<=CDP90,
>CDP90
>> ];
>> > >> > >> > > >
>> > >> > >> > > > the same error appears again. So I am not for sure
if
>> the
>> > >> > >> > "obs_thresh"
>> > >> > >> > > > setting is correctly passed.
>> > >> > >> > > >
>> > >> > >> > > > Binbin
>> > >> > >> > > >
>> > >> > >> > > >
>> > >> > >> > > >
>> > >> > >> > > >
>> > >> > >> > > > On Tue, Jan 5, 2021 at 5:19 PM George McCabe via RT
<
>> > >> > >> met_help at ucar.edu
>> > >> > >> > >
>> > >> > >> > > > wrote:
>> > >> > >> > > >
>> > >> > >> > > > > Hi Binbin,
>> > >> > >> > > > >
>> > >> > >> > > > > Your solution should work for now. It looks like
>> although
>> > the
>> > >> > >> METplus
>> > >> > >> > > > > variable does get read properly, the environment
>> variable
>> > is
>> > >> not
>> > >> > >> > > actually
>> > >> > >> > > > > set by the EnsembleStat wrapper. I can make a
note to
>> add
>> > >> that
>> > >> > for
>> > >> > >> > > 4.0.0,
>> > >> > >> > > > > as it is an easy fix.
>> > >> > >> > > > >
>> > >> > >> > > > > - George
>> > >> > >> > > > >
>> > >> > >> > > > > On Tue, Jan 5, 2021 at 2:53 PM
Binbin.Zhou at noaa.gov via
>> > RT <
>> > >> > >> > > > > met_help at ucar.edu> wrote:
>> > >> > >> > > > >
>> > >> > >> > > > > > George,
>> > >> > >> > > > > >
>> > >> > >> > > > > > I have a temporal solution:
>> > >> > >> > > > > > set ploy in EnembleStat config as
>> > >> > >> > > > > > poly = [ "${MASKPATH}/lat_NHM.nc",
>> > >> > >> > > > > > "${MASKPATH}/lat_NHM.nc",
>> > >> > >> > > > > > "${MASKPATH}/lat_TRP.nc" ];
>> > >> > >> > > > > >
>> > >> > >> > > > > > then set MASKPATH in user_env_vars part in the
conf
>> file
>> > >> > >> > > > > > This MASKPAH then can be passed to
EnsembleStat's
>> poly [
>> > ]
>> > >> > entry
>> > >> > >> > > > > >
>> > >> > >> > > > > > Binbin
>> > >> > >> > > > > >
>> > >> > >> > > > > > On Tue, Jan 5, 2021 at 4:25 PM Binbin Zhou -
NOAA
>> > >> Affiliate <
>> > >> > >> > > > > > binbin.zhou at noaa.gov> wrote:
>> > >> > >> > > > > >
>> > >> > >> > > > > > > George,
>> > >> > >> > > > > > >
>> > >> > >> > > > > > > Still not working, error says
>> > >> > >> > > > > > > ERROR : replace_env() -> unable to get
value for
>> > >> > environment
>> > >> > >> > > > variable
>> > >> > >> > > > > > > "VERIF_MASK"
>> > >> > >> > > > > > >
>> > >> > >> > > > > > > Binbin
>> > >> > >> > > > > > >
>> > >> > >> > > > > > >
>> > >> > >> > > > > > >
>> > >> > >> > > > > > > On Tue, Jan 5, 2021 at 3:50 PM George McCabe
via RT
>> <
>> > >> > >> > > > met_help at ucar.edu
>> > >> > >> > > > > >
>> > >> > >> > > > > > > wrote:
>> > >> > >> > > > > > >
>> > >> > >> > > > > > >> Hi Binbin,
>> > >> > >> > > > > > >>
>> > >> > >> > > > > > >> You should be able to set it in the METplus
config
>> the
>> > >> same
>> > >> > >> way
>> > >> > >> > it
>> > >> > >> > > > is
>> > >> > >> > > > > > done
>> > >> > >> > > > > > >> for GridStat -- no quotes with commas
between each
>> > item.
>> > >> > The
>> > >> > >> > > wrapper
>> > >> > >> > > > > > >> should
>> > >> > >> > > > > > >> format it properly.
>> > >> > >> > > > > > >>
>> > >> > >> > > > > > >> Here is an example from an existing use
case:
>> > >> > >> > > > > > >>
>> > >> > >> > > > > > >> GRID_STAT_VERIFICATION_MASK_TEMPLATE =
>> > >> > >> > > > > > >>
>> > >> > >> > >
>> > >>
{INPUT_BASE}/model_applications/precipitation/mask/CONUS_HRRRTLE.nc,
>> > >> > >> > > > > > >>
>> > >> > >> > >
>> > >>
{INPUT_BASE}/model_applications/precipitation/mask/EAST_HRRRTLE.nc,
>> > >> > >> > > > > > >>
>> > >> > >> >
>> >
{INPUT_BASE}/model_applications/precipitation/mask/WEST_HRRRTLE.nc
>> > >> > >> > > > > > >>
>> > >> > >> > > > > > >> You should be able to set them the same way
using
>> > >> > >> > > > > > >> ENSEMBLE_STAT_VERIFICATION_MASK_TEMPLATE.
Let me
>> know
>> > if
>> > >> > that
>> > >> > >> > > > doesn't
>> > >> > >> > > > > > >> work.
>> > >> > >> > > > > > >>
>> > >> > >> > > > > > >> - George
>> > >> > >> > > > > > >>
>> > >> > >> > > > > > >> On Tue, Jan 5, 2021 at 1:45 PM
>> Binbin.Zhou at noaa.gov
>> > via
>> > >> > RT <
>> > >> > >> > > > > > >> met_help at ucar.edu> wrote:
>> > >> > >> > > > > > >>
>> > >> > >> > > > > > >> >
>> > >> > >> > > > > > >> > <URL:
>> > >> > >> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
>> > >> > >> > >
>> > >> > >> > > > > > >> >
>> > >> > >> > > > > > >> > George,
>> > >> > >> > > > > > >> >
>> > >> > >> > > > > > >> > I got another issue for verification
mask
>> setting.
>> > >> > >> > > > > > >> >
>> > >> > >> > > > > > >> > I am using $VERIF_MASK in EnsembleStat
config
>> f/ile
>> > >> > >> > > > > > >> > mask = {
>> > >> > >> > > > > > >> > grid = [];
>> > >> > >> > > > > > >> > poly = [${VERIF_MASK}];
>> > >> > >> > > > > > >> > sid = [];
>> > >> > >> > > > > > >> > }
>> > >> > >> > > > > > >> >
>> > >> > >> > > > > > >> > And using
GRID_STAT_VERIFICATION_MASK_TEMPLATE
>> to
>> > >> define
>> > >> > >> > > several
>> > >> > >> > > > > > >> polygon
>> > >> > >> > > > > > >> > nc mask files
>> > >> > >> > > > > > >> > But it seems not working. But it works for
>> Gridstat
>> > >> > config
>> > >> > >> in
>> > >> > >> > > > suich
>> > >> > >> > > > > > >> > setting.
>> > >> > >> > > > > > >> > I can not find ENSEMBLE_STAT_
>> > >> VERIFICATION_MASK_TEMPLATE
>> > >> > in
>> > >> > >> > the
>> > >> > >> > > > > > METplus
>> > >> > >> > > > > > >> doc
>> > >> > >> > > > > > >> >
>> > >> > >> > > > > > >> > So I define VERIF_MASK in [user_env_vars]
part.
>> > >> > >> > > > > > >> > It values can not be passed to ploy =
>> > [${VERIF_MASK}]
>> > >> in
>> > >> > >> the
>> > >> > >> > > > > > >> EnsembleStat
>> > >> > >> > > > > > >> > conf if more than one nc files included.
>> > >> > >> > > > > > >> > For example
>> > >> > >> > > > > > >> > VERIF_MASK=" '/part/p1.cn', '/path/p2.nc'
"
>> > >> > >> > > > > > >> > the error says poly = [/path/p1,]
>> > >> > >> > > > > > >> > It seems double quote or single quote can
not be
>> > >> passed
>> > >> > to
>> > >> > >> > > > > VERIF_MASK
>> > >> > >> > > > > > in
>> > >> > >> > > > > > >> > the EnsembleStat config.
>> > >> > >> > > > > > >> > I tried use back slash \ to before quote,
but
>> still
>> > >> not
>> > >> > >> > working
>> > >> > >> > > > > > >> >
>> > >> > >> > > > > > >> > Binbin
>> > >> > >> > > > > > >> >
>> > >> > >> > > > > > >> >
>> > >> > >> > > > > > >> > On Tue, Jan 5, 2021 at 10:33 AM Binbin
Zhou -
>> NOAA
>> > >> > >> Affiliate <
>> > >> > >> > > > > > >> > binbin.zhou at noaa.gov> wrote:
>> > >> > >> > > > > > >> >
>> > >> > >> > > > > > >> > > George,
>> > >> > >> > > > > > >> > >
>> > >> > >> > > > > > >> > > Thanks for your quick response! I'll
test
>> this
>> > >> > >> settings
>> > >> > >> > and
>> > >> > >> > > > let
>> > >> > >> > > > > > >> > > you know the results.
>> > >> > >> > > > > > >> > >
>> > >> > >> > > > > > >> > > Binbin
>> > >> > >> > > > > > >> > >
>> > >> > >> > > > > > >> > > On Tue, Jan 5, 2021 at 10:17 AM George
McCabe
>> via
>> > >> RT <
>> > >> > >> > > > > > >> met_help at ucar.edu>
>> > >> > >> > > > > > >> > > wrote:
>> > >> > >> > > > > > >> > >
>> > >> > >> > > > > > >> > >> Hi Binbin,
>> > >> > >> > > > > > >> > >>
>> > >> > >> > > > > > >> > >> Happy New Year to you too!
>> > >> > >> > > > > > >> > >>
>> > >> > >> > > > > > >> > >> I will comment on each configuration
variable
>> and
>> > >> how
>> > >> > to
>> > >> > >> > set
>> > >> > >> > > it
>> > >> > >> > > > > in
>> > >> > >> > > > > > a
>> > >> > >> > > > > > >> > >> METplus config inline:
>> > >> > >> > > > > > >> > >>
>> > >> > >> > > > > > >> > >> ens = {
>> > >> > >> > > > > > >> > >> ens_thresh = 1.0;
>> > >> > >> > > > > > >> > >>
>> > >> > >> > > > > > >> > >>
>> > >> > >> > > > > > >> > >> *This is controlled by the
>> > ENSEMBLE_STAT_ENS_THRESH
>> > >> > >> > variable.
>> > >> > >> > > > The
>> > >> > >> > > > > > >> > default
>> > >> > >> > > > > > >> > >> value is 1.0, so you don't need to
include it
>> in
>> > >> your
>> > >> > >> > config
>> > >> > >> > > > > file,
>> > >> > >> > > > > > >> but
>> > >> > >> > > > > > >> > you
>> > >> > >> > > > > > >> > >> can if you may adjust this value at
some
>> point.*
>> > >> > >> > > > > > >> > >>
>> > >> > >> > > > > > >> > >> vld_thresh = 1.0;
>> > >> > >> > > > > > >> > >>
>> > >> > >> > > > > > >> > >> *This value is set to 1.0 by default so
we
>> don't
>> > >> need
>> > >> > to
>> > >> > >> > > worry
>> > >> > >> > > > > > about
>> > >> > >> > > > > > >> it
>> > >> > >> > > > > > >> > >> right now.*
>> > >> > >> > > > > > >> > >>
>> > >> > >> > > > > > >> > >> field = [
>> > >> > >> > > > > > >> > >>
>> > >> > >> > > > > > >> > >> {
>> > >> > >> > > > > > >> > >> name = "HGT";
>> > >> > >> > > > > > >> > >> level = "P500";
>> > >> > >> > > > > > >> > >> obs_thresh = [ <=CDP10,
>> >CDP10&&<=CDP20,
>> > >> > >> > > > > >CDP20&&<=CDP30,
>> > >> > >> > > > > > >> > >> >CDP30&&<=CDP40, >CDP40&&<=CDP50,
>> > >CDP50&&<=CDP60,
>> > >> > >> > > > > >CDP60&&<=CDP70,
>> > >> > >> > > > > > >> > >> >CDP70&&<=CDP80, >CDP80&&<=CDP90,
>CDP90 ];
>> > >> > >> > > > > > >> > >> }
>> > >> > >> > > > > > >> > >> ]
>> > >> > >> > > > > > >> > >> }
>> > >> > >> > > > > > >> > >> fcst = ens;
>> > >> > >> > > > > > >> > >> obs = fcst;
>> > >> > >> > > > > > >> > >>
>> > >> > >> > > > > > >> > >> *1) The field info for ens is set in
the
>> > >> > >> > > > > > >> > >> ENS_VAR<n>_[NAME/LEVEL/THRESH/OPTIONS]
>> variables.
>> > >> The
>> > >> > >> fcst
>> > >> > >> > > and
>> > >> > >> > > > > obs
>> > >> > >> > > > > > >> field
>> > >> > >> > > > > > >> > >> info are set in the corresponding
>> FCST_VAR<n>_*
>> > and
>> > >> > >> > > > OBS_VAR<n>_*
>> > >> > >> > > > > > >> > variables
>> > >> > >> > > > > > >> > >> respectively, or you can use
BOTH_VAR<n>_* if
>> the
>> > >> FCST
>> > >> > >> and
>> > >> > >> > > OBS
>> > >> > >> > > > > > values
>> > >> > >> > > > > > >> > are
>> > >> > >> > > > > > >> > >> the same.*
>> > >> > >> > > > > > >> > >>
>> > >> > >> > > > > > >> > >> *If ENS_VAR<n>_* variables are not
explicitly
>> > set,
>> > >> > then
>> > >> > >> it
>> > >> > >> > > will
>> > >> > >> > > > > use
>> > >> > >> > > > > > >> the
>> > >> > >> > > > > > >> > >> values from FCST_VAR<n>_*.*
>> > >> > >> > > > > > >> > >> *Since the fcst, obs, and ens are all
the same
>> > you
>> > >> > could
>> > >> > >> > just
>> > >> > >> > > > use
>> > >> > >> > > > > > >> > >> BOTH_VAR<n>_* variables to control all
3,
>> > although
>> > >> > keep
>> > >> > >> in
>> > >> > >> > > mind
>> > >> > >> > > > > > that
>> > >> > >> > > > > > >> if
>> > >> > >> > > > > > >> > >> you
>> > >> > >> > > > > > >> > >> need to change one of them for any
reason, it
>> > will
>> > >> be
>> > >> > >> more
>> > >> > >> > > > > > difficult
>> > >> > >> > > > > > >> to
>> > >> > >> > > > > > >> > do
>> > >> > >> > > > > > >> > >> this. If you know that they will always
be the
>> > same
>> > >> > >> values,
>> > >> > >> > > > then
>> > >> > >> > > > > I
>> > >> > >> > > > > > >> > >> recommend using BOTH_, but if you know
they
>> may
>> > >> change
>> > >> > >> or
>> > >> > >> > are
>> > >> > >> > > > > > >> unsure, I
>> > >> > >> > > > > > >> > >> would recommend setting them by
referencing
>> the
>> > >> other
>> > >> > >> > > > variables,
>> > >> > >> > > > > > >> i.e.*
>> > >> > >> > > > > > >> > >>
>> > >> > >> > > > > > >> > >> *FCST_VAR1_NAME = HGT*
>> > >> > >> > > > > > >> > >> *FCST_VAR1_LEVELS = P500 *
>> > >> > >> > > > > > >> > >> *OBS_VAR1_NAME = {FCST_VAR1_NAME}*
>> > >> > >> > > > > > >> > >> *OBS_VAR1_LEVELS = {FCST_VAR1_LEVELS}*
>> > >> > >> > > > > > >> > >>
>> > >> > >> > > > > > >> > >> *2) The [FCST/OBS/ENS]_VAR<n>_THRESH
variables
>> > set
>> > >> the
>> > >> > >> > > > cat_thresh
>> > >> > >> > > > > > >> values
>> > >> > >> > > > > > >> > >> in
>> > >> > >> > > > > > >> > >> the field info. A variable specific to
>> obs_thresh
>> > >> is
>> > >> > not
>> > >> > >> > > > > currently
>> > >> > >> > > > > > >> > >> supported, however you can set these
values by
>> > >> using
>> > >> > the
>> > >> > >> > > > > > >> > ENS_VAR1_OPTIONS
>> > >> > >> > > > > > >> > >> variable, i.e.*
>> > >> > >> > > > > > >> > >>
>> > >> > >> > > > > > >> > >> *ENS_VAR1_OPTIONS = obs_thresh = [
<=CDP10,
>> > >> > >> > >CDP10&&<=CDP20,
>> > >> > >> > > > > > >> > >> >CDP20&&<=CDP30, >CDP30&&<=CDP40,
>> > >CDP40&&<=CDP50,
>> > >> > >> > > > > >CDP50&&<=CDP60,
>> > >> > >> > > > > > >> > >> >CDP60&&<=CDP70, >CDP70&&<=CDP80,
>> > >CDP80&&<=CDP90,
>> > >> > >> >CDP90
>> > >> > >> > ];*
>> > >> > >> > > > > > >> > >>
>> > >> > >> > > > > > >> > >>
>> > >> > >> > > > > > >> > >> *Remember to include the semicolon at
the
>> end! *
>> > >> > >> > > > > > >> > >>
>> > >> > >> > > > > > >> > >> ens_ssvar_bin_size = 1000000;
>> > >> > >> > > > > > >> > >> *1) This variable is different from the
>> default
>> > and
>> > >> > not
>> > >> > >> > > > currently
>> > >> > >> > > > > > >> > >> supported
>> > >> > >> > > > > > >> > >> with a METplus config variable. I will
add
>> this
>> > to
>> > >> the
>> > >> > >> list
>> > >> > >> > > of
>> > >> > >> > > > > > >> variables
>> > >> > >> > > > > > >> > >> in
>> > >> > >> > > > > > >> > >> MET config files that we want to
support.
>> > However,
>> > >> in
>> > >> > >> the
>> > >> > >> > > > > meantime
>> > >> > >> > > > > > >> you
>> > >> > >> > > > > > >> > can
>> > >> > >> > > > > > >> > >> copy the default wrapped MET config
file and
>> > >> modify it
>> > >> > >> to
>> > >> > >> > fit
>> > >> > >> > > > > your
>> > >> > >> > > > > > >> > needs.
>> > >> > >> > > > > > >> > >> To do this, you will need to:*
>> > >> > >> > > > > > >> > >>
>> > >> > >> > > > > > >> > >> * a) Copy
>> > >> > >> > METplus/parm/met_config/EnsembleStatConfig_wrapped
>> > >> > >> > > > to
>> > >> > >> > > > > > the
>> > >> > >> > > > > > >> > >> directory that contains your METplus
config
>> file
>> > >> for
>> > >> > >> this
>> > >> > >> > use
>> > >> > >> > > > > case.
>> > >> > >> > > > > > >> > Rename
>> > >> > >> > > > > > >> > >> it by replacing "wrapped" with a short
>> > description
>> > >> > that
>> > >> > >> > > > pertains
>> > >> > >> > > > > to
>> > >> > >> > > > > > >> your
>> > >> > >> > > > > > >> > >> use case.*
>> > >> > >> > > > > > >> > >>
>> > >> > >> > > > > > >> > >> * b) In your METplus config file,
change the
>> > >> value of
>> > >> > >> > > > > > >> > >> ENSEMBLE_STAT_CONFIG_FILE to point to
the
>> path of
>> > >> this
>> > >> > >> new
>> > >> > >> > > > config
>> > >> > >> > > > > > >> file.*
>> > >> > >> > > > > > >> > >>
>> > >> > >> > > > > > >> > >> * c) If you know the value you want to
use
>> for
>> > >> this
>> > >> > >> > variable
>> > >> > >> > > > > will
>> > >> > >> > > > > > >> > always
>> > >> > >> > > > > > >> > >> be 1000000, then simply set the
variable to
>> that
>> > >> > value.
>> > >> > >> If
>> > >> > >> > > you
>> > >> > >> > > > > > think
>> > >> > >> > > > > > >> you
>> > >> > >> > > > > > >> > >> may want to change the value, then you
can
>> > utilize
>> > >> the
>> > >> > >> > > > > > >> [user_env_vars]
>> > >> > >> > > > > > >> > >> functionality. See:
>> > >> > >> > > > > > >> > >>
>> > >> > >> > > > > > >> > >>
>> > >> > >> > > > > > >> >
>> > >> > >> > > > > > >>
>> > >> > >> > > > > >
>> > >> > >> > > > >
>> > >> > >> > > >
>> > >> > >> > >
>> > >> > >> >
>> > >> > >>
>> > >> >
>> > >>
>> >
>>
https://dtcenter.github.io/METplus/latest/Users_Guide/systemconfiguration.html#user-
defined-config
>> > >> > >> > > > > > >> > >> <
>> > >> > >> > > > > > >> > >>
>> > >> > >> > > > > > >> >
>> > >> > >> > > > > > >>
>> > >> > >> > > > > >
>> > >> > >> > > > >
>> > >> > >> > > >
>> > >> > >> > >
>> > >> > >> >
>> > >> > >>
>> > >> >
>> > >>
>> >
>>
https://dtcenter.github.io/METplus/latest/Users_Guide/systemconfiguration.html#user-
defined-config
>> > >> > >> > > > > > >> > >> >*
>> > >> > >> > > > > > >> > >> *In this case, you would add the
following to
>> > your
>> > >> > >> METplus
>> > >> > >> > > > > config:*
>> > >> > >> > > > > > >> > >>
>> > >> > >> > > > > > >> > >> *[user_env_vars]*
>> > >> > >> > > > > > >> > >> *ENS_SSVAR_BIN_SIZE = 1000000*
>> > >> > >> > > > > > >> > >>
>> > >> > >> > > > > > >> > >> *Then change the line in your
EnsembleStat
>> config
>> > >> file
>> > >> > >> that
>> > >> > >> > > you
>> > >> > >> > > > > > >> copied
>> > >> > >> > > > > > >> > >> to:*
>> > >> > >> > > > > > >> > >>
>> > >> > >> > > > > > >> > >> * ens_ssvar_bin_size =
${ENS_SSVAR_BIN_SIZE};
>> *
>> > >> > >> > > > > > >> > >>
>> > >> > >> > > > > > >> > >> ens_phist_bin_size = 0.05;
>> > >> > >> > > > > > >> > >> *This variable uses the default value,
so you
>> > don't
>> > >> > >> need to
>> > >> > >> > > do
>> > >> > >> > > > > > >> anything
>> > >> > >> > > > > > >> > >> here. If you need to make it
configurable or
>> > change
>> > >> > the
>> > >> > >> > > value,
>> > >> > >> > > > > then
>> > >> > >> > > > > > >> > follow
>> > >> > >> > > > > > >> > >> the instructions for setting
>> ens_ssvar_bin_size.*
>> > >> > >> > > > > > >> > >>
>> > >> > >> > > > > > >> > >> climo_mean = fcst;
>> > >> > >> > > > > > >> > >> climo_mean = {
>> > >> > >> > > > > > >> > >> file_name = "${CLIM_MEAN}";
>> > >> > >> > > > > > >> > >> time_interp_method = DW_MEAN;
>> > >> > >> > > > > > >> > >> match_day = TRUE;
>> > >> > >> > > > > > >> > >> time_step = 21600;
>> > >> > >> > > > > > >> > >> }
>> > >> > >> > > > > > >> > >>
>> > >> > >> > > > > > >> > >>
>> > >> > >> > > > > > >> > >> *Instead of using CLIM_MEAN, you can
set
>> > >> > >> > > > > > >> > >>
ENSEMBLE_STAT_CLIMO_MEAN_INPUT_[DIR/TEMPLATE]
>> in
>> > >> the
>> > >> > >> > METplus
>> > >> > >> > > > > > config.
>> > >> > >> > > > > > >> You
>> > >> > >> > > > > > >> > >> can use filename template syntax in the
>> _TEMPLATE
>> > >> > value,
>> > >> > >> > i.e.
>> > >> > >> > > > > > >> > >> {valid?fmt=%m%d}. The other variables
in the
>> > >> > climo_mean
>> > >> > >> > > > > dictionary
>> > >> > >> > > > > > >> are
>> > >> > >> > > > > > >> > >> actually old variables that have been
replaced
>> > with
>> > >> > >> > > > day_interval
>> > >> > >> > > > > > and
>> > >> > >> > > > > > >> > >> hour_interval, but the values you use
are the
>> old
>> > >> > >> defaults,
>> > >> > >> > > so
>> > >> > >> > > > > you
>> > >> > >> > > > > > >> > >> shouldn't need to set them.*
>> > >> > >> > > > > > >> > >>
>> > >> > >> > > > > > >> > >> climo_stdev = climo_mean;
>> > >> > >> > > > > > >> > >> climo_stdev = {
>> > >> > >> > > > > > >> > >> file_name = "${CLIM_STDV}";
>> > >> > >> > > > > > >> > >> }
>> > >> > >> > > > > > >> > >>
>> > >> > >> > > > > > >> > >> *Similarly to CLIM_MEAN, you can use
>> > >> > >> > > > > > >> > >>
>> ENSEMBLE_STAT_CLIMO_STDEV_INPUT_[DIR/TEMPLATE] to
>> > >> set
>> > >> > >> this
>> > >> > >> > > file
>> > >> > >> > > > > > >> name.*
>> > >> > >> > > > > > >> > >>
>> > >> > >> > > > > > >> > >> climo_cdf = {
>> > >> > >> > > > > > >> > >> cdf_bins = 11;
>> > >> > >> > > > > > >> > >> center_bins = TRUE;
>> > >> > >> > > > > > >> > >> write_bins = TRUE;
>> > >> > >> > > > > > >> > >> }
>> > >> > >> > > > > > >> > >> *The value for write_bins is the
default, but
>> the
>> > >> > values
>> > >> > >> > for
>> > >> > >> > > > > > cdf_bins
>> > >> > >> > > > > > >> > and
>> > >> > >> > > > > > >> > >> center_bins do not. To set these,
follow the
>> > above
>> > >> > >> > > instructions
>> > >> > >> > > > > for
>> > >> > >> > > > > > >> > >> ens_ssvar_bin_size to override them
and/or
>> make
>> > >> them
>> > >> > >> > > > configurable
>> > >> > >> > > > > > >> > through
>> > >> > >> > > > > > >> > >> METplus. I will also add these
variables to
>> the
>> > >> list
>> > >> > of
>> > >> > >> MET
>> > >> > >> > > > > configs
>> > >> > >> > > > > > >> that
>> > >> > >> > > > > > >> > >> users want to be able to easily
configure
>> through
>> > >> > >> METplus
>> > >> > >> > > > > configs.*
>> > >> > >> > > > > > >> > >>
>> > >> > >> > > > > > >> > >> Please let me know if you run into any
issues
>> > >> setting
>> > >> > >> any
>> > >> > >> > of
>> > >> > >> > > > that
>> > >> > >> > > > > > up.
>> > >> > >> > > > > > >> > >> Also,
>> > >> > >> > > > > > >> > >> if there are any other MET config
variables
>> that
>> > >> you
>> > >> > >> want
>> > >> > >> > to
>> > >> > >> > > > see
>> > >> > >> > > > > > >> > supported
>> > >> > >> > > > > > >> > >> in METplus, let me know and I will make
sure
>> they
>> > >> get
>> > >> > >> > > included
>> > >> > >> > > > > when
>> > >> > >> > > > > > >> we
>> > >> > >> > > > > > >> > >> have
>> > >> > >> > > > > > >> > >> a chance to refactor those wrappers. It
is
>> > >> possible to
>> > >> > >> add
>> > >> > >> > > > > support
>> > >> > >> > > > > > >> for
>> > >> > >> > > > > > >> > MET
>> > >> > >> > > > > > >> > >> configs using the above instructions,
but it
>> is
>> > >> always
>> > >> > >> > easier
>> > >> > >> > > > and
>> > >> > >> > > > > > >> less
>> > >> > >> > > > > > >> > >> error-prone to have them configurable
directly
>> > >> > through a
>> > >> > >> > > > variable
>> > >> > >> > > > > > in
>> > >> > >> > > > > > >> the
>> > >> > >> > > > > > >> > >> METplus config.
>> > >> > >> > > > > > >> > >>
>> > >> > >> > > > > > >> > >> Thanks,
>> > >> > >> > > > > > >> > >> George
>> > >> > >> > > > > > >> > >>
>> > >> > >> > > > > > >> > >> On Tue, Jan 5, 2021 at 7:14 AM
>> > >> Binbin.Zhou at noaa.gov
>> > >> > via
>> > >> > >> > RT <
>> > >> > >> > > > > > >> > >> met_help at ucar.edu> wrote:
>> > >> > >> > > > > > >> > >>
>> > >> > >> > > > > > >> > >> >
>> > >> > >> > > > > > >> > >> > Tue Jan 05 07:14:54 2021: Request
98116 was
>> > acted
>> > >> > >> upon.
>> > >> > >> > > > > > >> > >> > Transaction: Ticket created by
>> > >> Binbin.Zhou at noaa.gov
>> > >> > >> > > > > > >> > >> > Queue: met_help
>> > >> > >> > > > > > >> > >> > Subject: CDP threshold setting
in
>> > >> EnsembleStat
>> > >> > >> conf
>> > >> > >> > > > > > >> > >> > Owner: Nobody
>> > >> > >> > > > > > >> > >> > Requestors: Binbin.Zhou at noaa.gov
>> > >> > >> > > > > > >> > >> > Status: new
>> > >> > >> > > > > > >> > >> > Ticket <URL:
>> > >> > >> > > > > > >>
>> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
>> > >> > >> > > > > > >> > >
>> > >> > >> > > > > > >> > >> >
>> > >> > >> > > > > > >> > >> >
>> > >> > >> > > > > > >> > >> > George,
>> > >> > >> > > > > > >> > >> >
>> > >> > >> > > > > > >> > >> > Happy New Year!
>> > >> > >> > > > > > >> > >> >
>> > >> > >> > > > > > >> > >> > I am working on transition of our
>> MET-based
>> > >> > global
>> > >> > >> > > > ensemble
>> > >> > >> > > > > > >> > >> verification
>> > >> > >> > > > > > >> > >> > to METplus based package. In this
package
>> > >> > climatology
>> > >> > >> > bins
>> > >> > >> > > > (10
>> > >> > >> > > > > > >> bins)
>> > >> > >> > > > > > >> > are
>> > >> > >> > > > > > >> > >> > used.
>> > >> > >> > > > > > >> > >> > In current ensemble stat config file,
the
>> > >> relevant
>> > >> > >> > entries
>> > >> > >> > > > iare
>> > >> > >> > > > > > >> > defined
>> > >> > >> > > > > > >> > >> > like following
>> > >> > >> > > > > > >> > >> >
>> > >> > >> > > > > > >> > >> > ens = {
>> > >> > >> > > > > > >> > >> > ens_thresh = 1.0;
>> > >> > >> > > > > > >> > >> > vld_thresh = 1.0;
>> > >> > >> > > > > > >> > >> >
>> > >> > >> > > > > > >> > >> > field = [
>> > >> > >> > > > > > >> > >> >
>> > >> > >> > > > > > >> > >> > {
>> > >> > >> > > > > > >> > >> > name = "HGT";
>> > >> > >> > > > > > >> > >> > level = "P500";
>> > >> > >> > > > > > >> > >> > obs_thresh = [ <=CDP10,
>> > >CDP10&&<=CDP20,
>> > >> > >> > > > > > >CDP20&&<=CDP30,
>> > >> > >> > > > > > >> > >> > >CDP30&&<=CDP40, >CDP40&&<=CDP50,
>> > >> >CDP50&&<=CDP60,
>> > >> > >> > > > > > >CDP60&&<=CDP70,
>> > >> > >> > > > > > >> > >> > >CDP70&&<=CDP80, >CDP80&&<=CDP90,
>CDP90 ];
>> > >> > >> > > > > > >> > >> > }
>> > >> > >> > > > > > >> > >> > ]
>> > >> > >> > > > > > >> > >> > }
>> > >> > >> > > > > > >> > >> > fcst = ens;
>> > >> > >> > > > > > >> > >> > obs = fcst;
>> > >> > >> > > > > > >> > >> > ens_ssvar_bin_size = 1000000;
>> > >> > >> > > > > > >> > >> > ens_phist_bin_size = 0.05;
>> > >> > >> > > > > > >> > >> > climo_mean = fcst;
>> > >> > >> > > > > > >> > >> > climo_mean = {
>> > >> > >> > > > > > >> > >> > file_name = "${CLIM_MEAN}";
>> > >> > >> > > > > > >> > >> > time_interp_method = DW_MEAN;
>> > >> > >> > > > > > >> > >> > match_day = TRUE;
>> > >> > >> > > > > > >> > >> > time_step = 21600;
>> > >> > >> > > > > > >> > >> > }
>> > >> > >> > > > > > >> > >> >
>> > >> > >> > > > > > >> > >> > climo_stdev = climo_mean;
>> > >> > >> > > > > > >> > >> > climo_stdev = {
>> > >> > >> > > > > > >> > >> > file_name = "${CLIM_STDV}";
>> > >> > >> > > > > > >> > >> > }
>> > >> > >> > > > > > >> > >> >
>> > >> > >> > > > > > >> > >> > climo_cdf = {
>> > >> > >> > > > > > >> > >> > cdf_bins = 11;
>> > >> > >> > > > > > >> > >> > center_bins = TRUE;
>> > >> > >> > > > > > >> > >> > write_bins = TRUE;
>> > >> > >> > > > > > >> > >> > }
>> > >> > >> > > > > > >> > >> >
>> > >> > >> > > > > > >> > >> > I can not find the correspondent
settings in
>> > its
>> > >> > conf
>> > >> > >> > file
>> > >> > >> > > > from
>> > >> > >> > > > > > >> > METplus
>> > >> > >> > > > > > >> > >> > online doc.
>> > >> > >> > > > > > >> > >> > Can you help me look at this?
>> > >> > >> > > > > > >> > >> >
>> > >> > >> > > > > > >> > >> > Thanks!
>> > >> > >> > > > > > >> > >> >
>> > >> > >> > > > > > >> > >> > Binbin
>> > >> > >> > > > > > >> > >> >
>> > >> > >> > > > > > >> > >> > --
>> > >> > >> > > > > > >> > >> >
>> > >> > >> > > > > > >> > >> > Binbin Zhou
>> > >> > >> > > > > > >> > >> >
>> > >> > >> > > > > > >> > >> > IMSG at NOAA/NWS/NCEP/EMC
>> > >> > >> > > > > > >> > >> >
>> > >> > >> > > > > > >> > >> > 5830 University Research Ct.
>> > >> > >> > > > > > >> > >> >
>> > >> > >> > > > > > >> > >> > College Park, MD 20740
>> > >> > >> > > > > > >> > >> >
>> > >> > >> > > > > > >> > >> > Binbin.Zhou at noaa.gov
>> > >> > >> > > > > > >> > >> >
>> > >> > >> > > > > > >> > >> > 301-683-3683
>> > >> > >> > > > > > >> > >> >
>> > >> > >> > > > > > >> > >> >
>> > >> > >> > > > > > >> > >>
>> > >> > >> > > > > > >> > >> --
>> > >> > >> > > > > > >> > >> George McCabe - Software Engineer III
>> > >> > >> > > > > > >> > >> National Center for Atmospheric
Research
>> > >> > >> > > > > > >> > >> Research Applications Laboratory
>> > >> > >> > > > > > >> > >> 303-497-2768
>> > >> > >> > > > > > >> > >> ---
>> > >> > >> > > > > > >> > >> My working day may not be your working
day.
>> > Please
>> > >> do
>> > >> > >> not
>> > >> > >> > > feel
>> > >> > >> > > > > > >> obliged
>> > >> > >> > > > > > >> > to
>> > >> > >> > > > > > >> > >> reply to this email outside of your
normal
>> > working
>> > >> > >> hours.
>> > >> > >> > > > > > >> > >>
>> > >> > >> > > > > > >> > >>
>> > >> > >> > > > > > >> > >
>> > >> > >> > > > > > >> > > --
>> > >> > >> > > > > > >> > >
>> > >> > >> > > > > > >> > > Binbin Zhou
>> > >> > >> > > > > > >> > >
>> > >> > >> > > > > > >> > > IMSG at NOAA/NWS/NCEP/EMC
>> > >> > >> > > > > > >> > >
>> > >> > >> > > > > > >> > > 5830 University Research Ct.
>> > >> > >> > > > > > >> > >
>> > >> > >> > > > > > >> > > College Park, MD 20740
>> > >> > >> > > > > > >> > >
>> > >> > >> > > > > > >> > > Binbin.Zhou at noaa.gov
>> > >> > >> > > > > > >> > >
>> > >> > >> > > > > > >> > > 301-683-3683
>> > >> > >> > > > > > >> > >
>> > >> > >> > > > > > >> >
>> > >> > >> > > > > > >> >
>> > >> > >> > > > > > >> > --
>> > >> > >> > > > > > >> >
>> > >> > >> > > > > > >> > Binbin Zhou
>> > >> > >> > > > > > >> >
>> > >> > >> > > > > > >> > IMSG at NOAA/NWS/NCEP/EMC
>> > >> > >> > > > > > >> >
>> > >> > >> > > > > > >> > 5830 University Research Ct.
>> > >> > >> > > > > > >> >
>> > >> > >> > > > > > >> > College Park, MD 20740
>> > >> > >> > > > > > >> >
>> > >> > >> > > > > > >> > Binbin.Zhou at noaa.gov
>> > >> > >> > > > > > >> >
>> > >> > >> > > > > > >> > 301-683-3683
>> > >> > >> > > > > > >> >
>> > >> > >> > > > > > >> >
>> > >> > >> > > > > > >>
>> > >> > >> > > > > > >> --
>> > >> > >> > > > > > >> George McCabe - Software Engineer III
>> > >> > >> > > > > > >> National Center for Atmospheric Research
>> > >> > >> > > > > > >> Research Applications Laboratory
>> > >> > >> > > > > > >> 303-497-2768
>> > >> > >> > > > > > >> ---
>> > >> > >> > > > > > >> My working day may not be your working day.
Please
>> do
>> > >> not
>> > >> > >> feel
>> > >> > >> > > > obliged
>> > >> > >> > > > > > to
>> > >> > >> > > > > > >> reply to this email outside of your normal
working
>> > >> hours.
>> > >> > >> > > > > > >>
>> > >> > >> > > > > > >>
>> > >> > >> > > > > > >
>> > >> > >> > > > > > > --
>> > >> > >> > > > > > >
>> > >> > >> > > > > > > Binbin Zhou
>> > >> > >> > > > > > >
>> > >> > >> > > > > > > IMSG at NOAA/NWS/NCEP/EMC
>> > >> > >> > > > > > >
>> > >> > >> > > > > > > 5830 University Research Ct.
>> > >> > >> > > > > > >
>> > >> > >> > > > > > > College Park, MD 20740
>> > >> > >> > > > > > >
>> > >> > >> > > > > > > Binbin.Zhou at noaa.gov
>> > >> > >> > > > > > >
>> > >> > >> > > > > > > 301-683-3683
>> > >> > >> > > > > > >
>> > >> > >> > > > > >
>> > >> > >> > > > > >
>> > >> > >> > > > > > --
>> > >> > >> > > > > >
>> > >> > >> > > > > > Binbin Zhou
>> > >> > >> > > > > >
>> > >> > >> > > > > > IMSG at NOAA/NWS/NCEP/EMC
>> > >> > >> > > > > >
>> > >> > >> > > > > > 5830 University Research Ct.
>> > >> > >> > > > > >
>> > >> > >> > > > > > College Park, MD 20740
>> > >> > >> > > > > >
>> > >> > >> > > > > > Binbin.Zhou at noaa.gov
>> > >> > >> > > > > >
>> > >> > >> > > > > > 301-683-3683
>> > >> > >> > > > > >
>> > >> > >> > > > > >
>> > >> > >> > > > >
>> > >> > >> > > > > --
>> > >> > >> > > > > George McCabe - Software Engineer III
>> > >> > >> > > > > National Center for Atmospheric Research
>> > >> > >> > > > > Research Applications Laboratory
>> > >> > >> > > > > 303-497-2768
>> > >> > >> > > > > ---
>> > >> > >> > > > > My working day may not be your working day.
Please do
>> not
>> > >> feel
>> > >> > >> > obliged
>> > >> > >> > > to
>> > >> > >> > > > > reply to this email outside of your normal
working
>> hours.
>> > >> > >> > > > >
>> > >> > >> > > > >
>> > >> > >> > > >
>> > >> > >> > > > --
>> > >> > >> > > >
>> > >> > >> > > > Binbin Zhou
>> > >> > >> > > >
>> > >> > >> > > > IMSG at NOAA/NWS/NCEP/EMC
>> > >> > >> > > >
>> > >> > >> > > > 5830 University Research Ct.
>> > >> > >> > > >
>> > >> > >> > > > College Park, MD 20740
>> > >> > >> > > >
>> > >> > >> > > > Binbin.Zhou at noaa.gov
>> > >> > >> > > >
>> > >> > >> > > > 301-683-3683
>> > >> > >> > > >
>> > >> > >> > > >
>> > >> > >> > >
>> > >> > >> > > --
>> > >> > >> > > George McCabe - Software Engineer III
>> > >> > >> > > National Center for Atmospheric Research
>> > >> > >> > > Research Applications Laboratory
>> > >> > >> > > 303-497-2768
>> > >> > >> > > ---
>> > >> > >> > > My working day may not be your working day. Please do
not
>> feel
>> > >> > >> obliged to
>> > >> > >> > > reply to this email outside of your normal working
hours.
>> > >> > >> > >
>> > >> > >> > >
>> > >> > >> >
>> > >> > >> > --
>> > >> > >> >
>> > >> > >> > Binbin Zhou
>> > >> > >> >
>> > >> > >> > IMSG at NOAA/NWS/NCEP/EMC
>> > >> > >> >
>> > >> > >> > 5830 University Research Ct.
>> > >> > >> >
>> > >> > >> > College Park, MD 20740
>> > >> > >> >
>> > >> > >> > Binbin.Zhou at noaa.gov
>> > >> > >> >
>> > >> > >> > 301-683-3683
>> > >> > >> >
>> > >> > >> >
>> > >> > >>
>> > >> > >> --
>> > >> > >> Julie Prestopnik (she/her)
>> > >> > >> Software Engineer
>> > >> > >> National Center for Atmospheric Research
>> > >> > >> Research Applications Laboratory
>> > >> > >> Email: jpresto at ucar.edu
>> > >> > >>
>> > >> > >> My working day may not be your working day. Please do
not feel
>> > >> obliged
>> > >> > to
>> > >> > >> reply to this email outside of your normal working hours.
>> > >> > >>
>> > >> > >>
>> > >> > >
>> > >> > > --
>> > >> > >
>> > >> > > Binbin Zhou
>> > >> > >
>> > >> > > IMSG at NOAA/NWS/NCEP/EMC
>> > >> > >
>> > >> > > 5830 University Research Ct.
>> > >> > >
>> > >> > > College Park, MD 20740
>> > >> > >
>> > >> > > Binbin.Zhou at noaa.gov
>> > >> > >
>> > >> > > 301-683-3683
>> > >> > >
>> > >> >
>> > >> >
>> > >> > --
>> > >> >
>> > >> > Binbin Zhou
>> > >> >
>> > >> > IMSG at NOAA/NWS/NCEP/EMC
>> > >> >
>> > >> > 5830 University Research Ct.
>> > >> >
>> > >> > College Park, MD 20740
>> > >> >
>> > >> > Binbin.Zhou at noaa.gov
>> > >> >
>> > >> > 301-683-3683
>> > >> >
>> > >> >
>> > >>
>> > >> --
>> > >> Julie Prestopnik (she/her)
>> > >> Software Engineer
>> > >> National Center for Atmospheric Research
>> > >> Research Applications Laboratory
>> > >> Email: jpresto at ucar.edu
>> > >>
>> > >> My working day may not be your working day. Please do not
feel
>> obliged
>> > to
>> > >> reply to this email outside of your normal working hours.
>> > >>
>> > >>
>> > >
>> > > --
>> > > George McCabe - Software Engineer III
>> > > National Center for Atmospheric Research
>> > > Research Applications Laboratory
>> > > 303-497-2768
>> > > ---
>> > > My working day may not be your working day. Please do not feel
>> obliged to
>> > > reply to this email outside of your normal working hours.
>> > >
>> >
>> >
>> > --
>> >
>> > Binbin Zhou
>> >
>> > IMSG at NOAA/NWS/NCEP/EMC
>> >
>> > 5830 University Research Ct.
>> >
>> > College Park, MD 20740
>> >
>> > Binbin.Zhou at noaa.gov
>> >
>> > 301-683-3683
>> >
>> >
>>
>> --
>> George McCabe - Software Engineer III
>> National Center for Atmospheric Research
>> Research Applications Laboratory
>> 303-497-2768
>> ---
>> My working day may not be your working day. Please do not feel
obliged to
>> reply to this email outside of your normal working hours.
>>
>>
>
> --
>
> Binbin Zhou
>
> IMSG at NOAA/NWS/NCEP/EMC
>
> 5830 University Research Ct.
>
> College Park, MD 20740
>
> Binbin.Zhou at noaa.gov
>
> 301-683-3683
>
--
Binbin Zhou
IMSG at NOAA/NWS/NCEP/EMC
5830 University Research Ct.
College Park, MD 20740
Binbin.Zhou at noaa.gov
301-683-3683
------------------------------------------------
Subject: CDP threshold setting in EnsembleStat conf
From: George McCabe
Time: Wed Jan 06 15:08:11 2021
Hi Binbin,
match_day and time_step are no longer used, so they should be removed.
You
should replace them with:
day_interval = 31;
hour_interval = 12;
31 is the default for day interval. The default for hour_interval is
6, but
we want it to be 12 so it finds your climo files.
- George
On Wed, Jan 6, 2021 at 2:39 PM Binbin.Zhou at noaa.gov via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116 >
>
> George,
>
> Even I deleted time_step in the climo_mean entry, this error is
still
> there.
> So I think climo_mean=fcst should be removed and define climo_mean
part
> separately.
> But how to define the fields (name, level) in climo_mean in METplus
conf
> file?
> Maybe hard copy the fields for climo_mean in EnsembleGrid config
file?
>
> Binbin
>
> On Wed, Jan 6, 2021 at 4:18 PM Binbin Zhou - NOAA Affiliate <
> binbin.zhou at noaa.gov> wrote:
>
> > George,
> >
> > Rerun has same error
> > Skipping the 19590104_000000 "HGT/P500" climatology field since
the time
> > offset (43200 seconds) >= the "hour_interval" entry (21600
seconds) from
> > file:
> >
>
/gpfs/dell2/emc/modeling/noscrub/Binbin.Zhou/g2g/com/verf/dev/ens.20210104/clim.grid3.mean.010400.grib2
> >
> > The new setting for climo in EnemsbleGrid config file is
> > climo_mean = fcst;
> > climo_mean = {
> > file_name = [ ${CLIMO_MEAN_FILE} ];
> > time_interp_method = DW_MEAN;
> > match_day = FALSE;
> > time_step = 43200;
> > }
> > climo_stdev = climo_mean;
> > climo_stdev = {
> > file_name = [ ${CLIMO_STDEV_FILE} ];
> > }
> >
> > climo_cdf = {
> > cdf_bins = 11;
> > center_bins = TRUE;
> > write_bins = TRUE;
> > }
> >
> > It seems time_step is not effective?
> >
> > Binbin
> >
> > On Wed, Jan 6, 2021 at 3:15 PM George McCabe via RT
<met_help at ucar.edu>
> > wrote:
> >
> >> Hi Binbin,
> >>
> >> Thanks for sending the updated logs. It looks like your
climatology
> fields
> >> are not being read properly. I think this line explains the
problem:
> >>
> >> DEBUG 3: Skipping the 19590104_000000 "HGT/P500" climatology
field since
> >> the time offset (43200 seconds) >= the "hour_interval" entry
(21600
> >> seconds) from file:
> >>
> >>
>
/gpfs/dell2/emc/modeling/noscrub/Binbin.Zhou/g2g/com/verf/dev/ens.20210104/clim.grid3.stdv.010400.grib2
> >>
> >> The variables match_day and time_step in your climo_mean
dictionary are
> >> actually no longer used and have been replaced with:
> >>
> >> day_interval = 31;
> >> hour_interval = 6;
> >>
> >> 21600 seconds is 6 hours and it sounds like your climo field is
offset
> by
> >> 12 hours. I believe setting hour_interval to 12 should allow it
to find
> >> the
> >> climatology field and compute the statistics properly. Let me
know if it
> >> does not.
> >>
> >> Thanks,
> >> George
> >>
> >> On Wed, Jan 6, 2021 at 12:43 PM Binbin.Zhou at noaa.gov via RT <
> >> met_help at ucar.edu> wrote:
> >>
> >> >
> >> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116 >
> >> >
> >> > George,
> >> >
> >> > I have re-run the case with LOG_LEVEL=DEBUG and
> >> > LOG_ENSEMBLE_STAT_VERBOSITY =3.
> >> > The output log file has been sent to hera:
> >> >
> >> >
> >>
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Binbin.Zhou/metplus_test/metplus3.out/log/master_metplus.log.20210106193455
> >> >
> >> > Please look at it.
> >> >
> >> > Thanks!
> >> >
> >> > Biinbin
> >> >
> >> > On Wed, Jan 6, 2021 at 2:19 PM George McCabe <mccabe at ucar.edu>
wrote:
> >> >
> >> > > Hi Binbin,
> >> > >
> >> > > Thanks for putting those files on hera. The log output you
sent
> >> doesn't
> >> > > have the DEBUG level output (LOG_LEVEL=DEBUG). However, I
tried to
> run
> >> > > EnsembleStat locally using the _OPTIONS value you set and it
seems
> to
> >> run
> >> > > fine. The error seems to suggest that something went wrong
when
> >> computing
> >> > > the mean and standard deviation before the obs_thresh values
are
> >> > applied. I
> >> > > have reached out to John HG to see if he has any insight as
to why
> >> that
> >> > is
> >> > > happening. In the meantime, you could rerun with
> >> > > LOG_ENSEMBLE_STAT_VERBOSITY set to a higher value than 2 to
see if
> >> the
> >> > > extra log output from the MET tool gives you any more insight
as to
> >> what
> >> > is
> >> > > going wrong.
> >> > >
> >> > > - George
> >> > >
> >> > > On Wed, Jan 6, 2021 at 9:51 AM Julie Prestopnik via RT <
> >> > met_help at ucar.edu>
> >> > > wrote:
> >> > >
> >> > >> Thanks for all of the info Binbin. I saw that you had
copied
> >> everything
> >> > >> to
> >> > >> hera for George. I am currently no longer on WCOSS, so I
unless
> >> George
> >> > >> lets me know that he needs something from WCOSS, I'll assume
he is
> >> able
> >> > to
> >> > >> get it from hera.
> >> > >>
> >> > >> Julie
> >> > >>
> >> > >> On Wed, Jan 6, 2021 at 9:39 AM Binbin.Zhou at noaa.gov via RT <
> >> > >> met_help at ucar.edu> wrote:
> >> > >>
> >> > >> >
> >> > >> > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116 >
> >> > >> >
> >> > >> > The EnsembleStat config file for the successful run
outside of
> >> METplus
> >> > >> is
> >> > >> >
> >> > >> >
> >> > >>
> >> >
> >>
>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_met_global_ens1p0.v1.0.0/parm/verf_g2g_ens_stat_config_bin11
> >> > >> > on WCOSS
> >> > >> >
> >> > >> > Binbin
> >> > >> >
> >> > >> > On Wed, Jan 6, 2021 at 11:34 AM Binbin Zhou - NOAA
Affiliate <
> >> > >> > binbin.zhou at noaa.gov> wrote:
> >> > >> >
> >> > >> > > Julie,
> >> > >> > >
> >> > >> > > The output directory on WCOSS is
> >> > >> > >
> >> > >> > >
> >> > >> >
> >> > >>
> >> >
> >>
>
/gpfs/dell1/ptmp/Binbin.Zhou/g2g/RFC2/tmpnwprd/verf_g2g_gefs_00_dev.161076/metplus3.out
> >> > >> > >
> >> > >> > > My METplus package on WCOSS is
> >> > >> > >
> >> > >> >
> >> > >>
> >> >
> >>
>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_g2g.v4.0.0
> >> > >> > >
> >> > >> > > For GEFS, the EnsembleGrid config file is
> >> > >> > >
> >> > >> > >
> >> > >> >
> >> > >>
> >> >
> >>
>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_g2g.v4.0.0/parm/app_conf/grid2grid/met_config/EnsembleStatConfig_gefs_bin11
> >> > >> > > Its conf file
> >> > >> > > is
> >> > >> >
> >> > >>
> >> >
> >>
>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_g2g.v4.0.0/parm/app_conf/grid2grid/gefs_conf/gefs_bin11.conf
> >> > >> > >
> >> > >> > > The running process is little bit complex since this is
a
> >> transition
> >> > >> to
> >> > >> > > future operational package that uses
> >> > >> > > mpi parallel: the script is
> >> > >> > >
> >> > >> > >
> >> > >> >
> >> > >>
> >> >
> >>
>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_g2g.v4.0.0/ush/verf_g2g_metplus_run_gefs_mpi.sh
> >> > >> > >
> >> > >> > > Binbin
> >> > >> > >
> >> > >> > >
> >> > >> > >
> >> > >> > >
> >> > >> > > On Wed, Jan 6, 2021 at 11:00 AM Julie Prestopnik via RT
<
> >> > >> > met_help at ucar.edu>
> >> > >> > > wrote:
> >> > >> > >
> >> > >> > >> Hi Binbin.
> >> > >> > >>
> >> > >> > >> This is Julie. I haven't been following this entire
thread,
> >> but I
> >> > >> am on
> >> > >> > >> WCOSS right now. If you send a path to a file, I can
pull it
> >> and
> >> > >> put it
> >> > >> > >> on
> >> > >> > >> our ftp server for George.
> >> > >> > >>
> >> > >> > >> Julie
> >> > >> > >>
> >> > >> > >> On Wed, Jan 6, 2021 at 8:57 AM Binbin.Zhou at noaa.gov via
RT <
> >> > >> > >> met_help at ucar.edu> wrote:
> >> > >> > >>
> >> > >> > >> >
> >> > >> > >> > <URL:
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
> >> >
> >> > >> > >> >
> >> > >> > >> > George,
> >> > >> > >> >
> >> > >> > >> > Can you access WCOSS or access HERA?
> >> > >> > >> > Otherwise I will email attached to you
> >> > >> > >> >
> >> > >> > >> > Binbin
> >> > >> > >> >
> >> > >> > >> >
> >> > >> > >> >
> >> > >> > >> > On Wed, Jan 6, 2021 at 10:46 AM George McCabe via RT
<
> >> > >> > met_help at ucar.edu
> >> > >> > >> >
> >> > >> > >> > wrote:
> >> > >> > >> >
> >> > >> > >> > > Hi Binbin,
> >> > >> > >> > >
> >> > >> > >> > > Could you send me a log file for a run with
> LOG_LEVEL=DEBUG
> >> (in
> >> > >> > >> METplus
> >> > >> > >> > > config) so I can see how the environment variable
> ENS_FIELD
> >> is
> >> > >> set?
> >> > >> > >> The
> >> > >> > >> > > values of ENS_VAR<n>_* are formatted and set in
this
> >> > environment
> >> > >> > >> variable
> >> > >> > >> > > which is passed into the MET config. You can
compare that
> >> value
> >> > >> with
> >> > >> > >> what
> >> > >> > >> > > you used in your successful run outside of the
METplus
> >> wrapper
> >> > to
> >> > >> > >> > determine
> >> > >> > >> > > what is different.
> >> > >> > >> > >
> >> > >> > >> > > Thanks,
> >> > >> > >> > > George
> >> > >> > >> > >
> >> > >> > >> > > On Wed, Jan 6, 2021 at 7:11 AM Binbin.Zhou at noaa.gov
via
> RT
> >> <
> >> > >> > >> > > met_help at ucar.edu> wrote:
> >> > >> > >> > >
> >> > >> > >> > > >
> >> > >> > >> > > > <URL:
> >> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
> >> > >> >
> >> > >> > >> > > >
> >> > >> > >> > > > George,
> >> > >> > >> > > >
> >> > >> > >> > > > I got a new error in execution although some
output
> >> files
> >> > (nc
> >> > >> > >> file)
> >> > >> > >> > are
> >> > >> > >> > > > created but stat files not.
> >> > >> > >> > > > The error message is
> >> > >> > >> > > >
> >> > >> > >> > > > ERROR :
> >> > >> > >> > > > ERROR : Simple_Node::check(double, double,
double)
> const
> >> ->
> >> > >> > >> > > climatological
> >> > >> > >> > > > distribution percentile threshold "<=CDP10"
requested
> with
> >> > >> invalid
> >> > >> > >> mean
> >> > >> > >> > > > (-9999) or standard deviation (-9999).
> >> > >> > >> > > > ERROR :
> >> > >> > >> > > >
> >> > >> > >> > > > Such an error was ever investigated by John H
before
> (year
> >> > >> ago):
> >> > >> > >> When I
> >> > >> > >> > > > directly ran ensemble_stat for global ensemble
(not
> >> > >> METplus-based,
> >> > >> > >> > > > but hard code of all settings in EnsembleStat
config
> >> file):
> >> > If
> >> > >> > hard
> >> > >> > >> > code
> >> > >> > >> > > > fcst field in EnsembleStat config file like this
> >> > >> > >> > > >
> >> > >> > >> > > > name = "HGT";
> >> > >> > >> > > > level = "P500";
> >> > >> > >> > > > cat_thresh = [ <=CDP10, >CDP10&&<=CDP20,
> >> > >> >CDP20&&<=CDP30,
> >> > >> > >> > > > >CDP30&&<=CDP40, >CDP40&&<=CDP50,
>CDP50&&<=CDP60,
> >> > >> > >CDP60&&<=CDP70,
> >> > >> > >> > > > >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];
> >> > >> > >> > > >
> >> > >> > >> > > > Run ensemble_stat will have such error: ERROR
:
> >> > >> > >> > > > Simple_Node::check(double, double, double) const
->
> >> > >> climatological
> >> > >> > >> > > > distribution percentile threshold "<=CDP10"
requested
> with
> >> > >> invalid
> >> > >> > >> mean
> >> > >> > >> > > > (-9999) or standard deviation (-9999).
> >> > >> > >> > > >
> >> > >> > >> > > > John H. suggested me change "cat_thresh = " to
> >> "obs_thresh =
> >> > >> ",
> >> > >> > >> then
> >> > >> > >> > > the
> >> > >> > >> > > > error was solved.
> >> > >> > >> > > >
> >> > >> > >> > > > In current METplus version, following your
suggestion as
> >> > >> > >> > > >
> >> > >> > >> > > > ENS_VAR1_OPTIONS = obs_thresh = [ <=CDP10,
> >> >CDP10&&<=CDP20,
> >> > >> > >> > > > >CDP20&&<=CDP30, >CDP30&&<=CDP40,
>CDP40&&<=CDP50,
> >> > >> > >CDP50&&<=CDP60,
> >> > >> > >> > > > >CDP60&&<=CDP70, >CDP70&&<=CDP80,
>CDP80&&<=CDP90,
> >CDP90
> >> ];
> >> > >> > >> > > >
> >> > >> > >> > > > the same error appears again. So I am not for
sure if
> >> the
> >> > >> > >> > "obs_thresh"
> >> > >> > >> > > > setting is correctly passed.
> >> > >> > >> > > >
> >> > >> > >> > > > Binbin
> >> > >> > >> > > >
> >> > >> > >> > > >
> >> > >> > >> > > >
> >> > >> > >> > > >
> >> > >> > >> > > > On Tue, Jan 5, 2021 at 5:19 PM George McCabe via
RT <
> >> > >> > >> met_help at ucar.edu
> >> > >> > >> > >
> >> > >> > >> > > > wrote:
> >> > >> > >> > > >
> >> > >> > >> > > > > Hi Binbin,
> >> > >> > >> > > > >
> >> > >> > >> > > > > Your solution should work for now. It looks
like
> >> although
> >> > the
> >> > >> > >> METplus
> >> > >> > >> > > > > variable does get read properly, the
environment
> >> variable
> >> > is
> >> > >> not
> >> > >> > >> > > actually
> >> > >> > >> > > > > set by the EnsembleStat wrapper. I can make a
note to
> >> add
> >> > >> that
> >> > >> > for
> >> > >> > >> > > 4.0.0,
> >> > >> > >> > > > > as it is an easy fix.
> >> > >> > >> > > > >
> >> > >> > >> > > > > - George
> >> > >> > >> > > > >
> >> > >> > >> > > > > On Tue, Jan 5, 2021 at 2:53 PM
Binbin.Zhou at noaa.gov
> via
> >> > RT <
> >> > >> > >> > > > > met_help at ucar.edu> wrote:
> >> > >> > >> > > > >
> >> > >> > >> > > > > > George,
> >> > >> > >> > > > > >
> >> > >> > >> > > > > > I have a temporal solution:
> >> > >> > >> > > > > > set ploy in EnembleStat config as
> >> > >> > >> > > > > > poly = [ "${MASKPATH}/lat_NHM.nc",
> >> > >> > >> > > > > > "${MASKPATH}/lat_NHM.nc",
> >> > >> > >> > > > > > "${MASKPATH}/lat_TRP.nc" ];
> >> > >> > >> > > > > >
> >> > >> > >> > > > > > then set MASKPATH in user_env_vars part in
the conf
> >> file
> >> > >> > >> > > > > > This MASKPAH then can be passed to
EnsembleStat's
> >> poly [
> >> > ]
> >> > >> > entry
> >> > >> > >> > > > > >
> >> > >> > >> > > > > > Binbin
> >> > >> > >> > > > > >
> >> > >> > >> > > > > > On Tue, Jan 5, 2021 at 4:25 PM Binbin Zhou -
NOAA
> >> > >> Affiliate <
> >> > >> > >> > > > > > binbin.zhou at noaa.gov> wrote:
> >> > >> > >> > > > > >
> >> > >> > >> > > > > > > George,
> >> > >> > >> > > > > > >
> >> > >> > >> > > > > > > Still not working, error says
> >> > >> > >> > > > > > > ERROR : replace_env() -> unable to get
value for
> >> > >> > environment
> >> > >> > >> > > > variable
> >> > >> > >> > > > > > > "VERIF_MASK"
> >> > >> > >> > > > > > >
> >> > >> > >> > > > > > > Binbin
> >> > >> > >> > > > > > >
> >> > >> > >> > > > > > >
> >> > >> > >> > > > > > >
> >> > >> > >> > > > > > > On Tue, Jan 5, 2021 at 3:50 PM George
McCabe via
> RT
> >> <
> >> > >> > >> > > > met_help at ucar.edu
> >> > >> > >> > > > > >
> >> > >> > >> > > > > > > wrote:
> >> > >> > >> > > > > > >
> >> > >> > >> > > > > > >> Hi Binbin,
> >> > >> > >> > > > > > >>
> >> > >> > >> > > > > > >> You should be able to set it in the
METplus
> config
> >> the
> >> > >> same
> >> > >> > >> way
> >> > >> > >> > it
> >> > >> > >> > > > is
> >> > >> > >> > > > > > done
> >> > >> > >> > > > > > >> for GridStat -- no quotes with commas
between
> each
> >> > item.
> >> > >> > The
> >> > >> > >> > > wrapper
> >> > >> > >> > > > > > >> should
> >> > >> > >> > > > > > >> format it properly.
> >> > >> > >> > > > > > >>
> >> > >> > >> > > > > > >> Here is an example from an existing use
case:
> >> > >> > >> > > > > > >>
> >> > >> > >> > > > > > >> GRID_STAT_VERIFICATION_MASK_TEMPLATE =
> >> > >> > >> > > > > > >>
> >> > >> > >> > >
> >> > >>
> {INPUT_BASE}/model_applications/precipitation/mask/CONUS_HRRRTLE.nc,
> >> > >> > >> > > > > > >>
> >> > >> > >> > >
> >> > >>
{INPUT_BASE}/model_applications/precipitation/mask/EAST_HRRRTLE.nc,
> >> > >> > >> > > > > > >>
> >> > >> > >> >
> >> >
{INPUT_BASE}/model_applications/precipitation/mask/WEST_HRRRTLE.nc
> >> > >> > >> > > > > > >>
> >> > >> > >> > > > > > >> You should be able to set them the same
way using
> >> > >> > >> > > > > > >> ENSEMBLE_STAT_VERIFICATION_MASK_TEMPLATE.
Let me
> >> know
> >> > if
> >> > >> > that
> >> > >> > >> > > > doesn't
> >> > >> > >> > > > > > >> work.
> >> > >> > >> > > > > > >>
> >> > >> > >> > > > > > >> - George
> >> > >> > >> > > > > > >>
> >> > >> > >> > > > > > >> On Tue, Jan 5, 2021 at 1:45 PM
> >> Binbin.Zhou at noaa.gov
> >> > via
> >> > >> > RT <
> >> > >> > >> > > > > > >> met_help at ucar.edu> wrote:
> >> > >> > >> > > > > > >>
> >> > >> > >> > > > > > >> >
> >> > >> > >> > > > > > >> > <URL:
> >> > >> > >> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
> >> > >> > >> > >
> >> > >> > >> > > > > > >> >
> >> > >> > >> > > > > > >> > George,
> >> > >> > >> > > > > > >> >
> >> > >> > >> > > > > > >> > I got another issue for verification
mask
> >> setting.
> >> > >> > >> > > > > > >> >
> >> > >> > >> > > > > > >> > I am using $VERIF_MASK in EnsembleStat
config
> >> f/ile
> >> > >> > >> > > > > > >> > mask = {
> >> > >> > >> > > > > > >> > grid = [];
> >> > >> > >> > > > > > >> > poly = [${VERIF_MASK}];
> >> > >> > >> > > > > > >> > sid = [];
> >> > >> > >> > > > > > >> > }
> >> > >> > >> > > > > > >> >
> >> > >> > >> > > > > > >> > And using
GRID_STAT_VERIFICATION_MASK_TEMPLATE
> >> to
> >> > >> define
> >> > >> > >> > > several
> >> > >> > >> > > > > > >> polygon
> >> > >> > >> > > > > > >> > nc mask files
> >> > >> > >> > > > > > >> > But it seems not working. But it works
for
> >> Gridstat
> >> > >> > config
> >> > >> > >> in
> >> > >> > >> > > > suich
> >> > >> > >> > > > > > >> > setting.
> >> > >> > >> > > > > > >> > I can not find ENSEMBLE_STAT_
> >> > >> VERIFICATION_MASK_TEMPLATE
> >> > >> > in
> >> > >> > >> > the
> >> > >> > >> > > > > > METplus
> >> > >> > >> > > > > > >> doc
> >> > >> > >> > > > > > >> >
> >> > >> > >> > > > > > >> > So I define VERIF_MASK in
[user_env_vars] part.
> >> > >> > >> > > > > > >> > It values can not be passed to ploy =
> >> > [${VERIF_MASK}]
> >> > >> in
> >> > >> > >> the
> >> > >> > >> > > > > > >> EnsembleStat
> >> > >> > >> > > > > > >> > conf if more than one nc files included.
> >> > >> > >> > > > > > >> > For example
> >> > >> > >> > > > > > >> > VERIF_MASK=" '/part/p1.cn',
'/path/p2.nc' "
> >> > >> > >> > > > > > >> > the error says poly = [/path/p1,]
> >> > >> > >> > > > > > >> > It seems double quote or single quote
can not
> be
> >> > >> passed
> >> > >> > to
> >> > >> > >> > > > > VERIF_MASK
> >> > >> > >> > > > > > in
> >> > >> > >> > > > > > >> > the EnsembleStat config.
> >> > >> > >> > > > > > >> > I tried use back slash \ to before
quote, but
> >> still
> >> > >> not
> >> > >> > >> > working
> >> > >> > >> > > > > > >> >
> >> > >> > >> > > > > > >> > Binbin
> >> > >> > >> > > > > > >> >
> >> > >> > >> > > > > > >> >
> >> > >> > >> > > > > > >> > On Tue, Jan 5, 2021 at 10:33 AM Binbin
Zhou -
> >> NOAA
> >> > >> > >> Affiliate <
> >> > >> > >> > > > > > >> > binbin.zhou at noaa.gov> wrote:
> >> > >> > >> > > > > > >> >
> >> > >> > >> > > > > > >> > > George,
> >> > >> > >> > > > > > >> > >
> >> > >> > >> > > > > > >> > > Thanks for your quick response!
I'll test
> >> this
> >> > >> > >> settings
> >> > >> > >> > and
> >> > >> > >> > > > let
> >> > >> > >> > > > > > >> > > you know the results.
> >> > >> > >> > > > > > >> > >
> >> > >> > >> > > > > > >> > > Binbin
> >> > >> > >> > > > > > >> > >
> >> > >> > >> > > > > > >> > > On Tue, Jan 5, 2021 at 10:17 AM George
McCabe
> >> via
> >> > >> RT <
> >> > >> > >> > > > > > >> met_help at ucar.edu>
> >> > >> > >> > > > > > >> > > wrote:
> >> > >> > >> > > > > > >> > >
> >> > >> > >> > > > > > >> > >> Hi Binbin,
> >> > >> > >> > > > > > >> > >>
> >> > >> > >> > > > > > >> > >> Happy New Year to you too!
> >> > >> > >> > > > > > >> > >>
> >> > >> > >> > > > > > >> > >> I will comment on each configuration
> variable
> >> and
> >> > >> how
> >> > >> > to
> >> > >> > >> > set
> >> > >> > >> > > it
> >> > >> > >> > > > > in
> >> > >> > >> > > > > > a
> >> > >> > >> > > > > > >> > >> METplus config inline:
> >> > >> > >> > > > > > >> > >>
> >> > >> > >> > > > > > >> > >> ens = {
> >> > >> > >> > > > > > >> > >> ens_thresh = 1.0;
> >> > >> > >> > > > > > >> > >>
> >> > >> > >> > > > > > >> > >>
> >> > >> > >> > > > > > >> > >> *This is controlled by the
> >> > ENSEMBLE_STAT_ENS_THRESH
> >> > >> > >> > variable.
> >> > >> > >> > > > The
> >> > >> > >> > > > > > >> > default
> >> > >> > >> > > > > > >> > >> value is 1.0, so you don't need to
include
> it
> >> in
> >> > >> your
> >> > >> > >> > config
> >> > >> > >> > > > > file,
> >> > >> > >> > > > > > >> but
> >> > >> > >> > > > > > >> > you
> >> > >> > >> > > > > > >> > >> can if you may adjust this value at
some
> >> point.*
> >> > >> > >> > > > > > >> > >>
> >> > >> > >> > > > > > >> > >> vld_thresh = 1.0;
> >> > >> > >> > > > > > >> > >>
> >> > >> > >> > > > > > >> > >> *This value is set to 1.0 by default
so we
> >> don't
> >> > >> need
> >> > >> > to
> >> > >> > >> > > worry
> >> > >> > >> > > > > > about
> >> > >> > >> > > > > > >> it
> >> > >> > >> > > > > > >> > >> right now.*
> >> > >> > >> > > > > > >> > >>
> >> > >> > >> > > > > > >> > >> field = [
> >> > >> > >> > > > > > >> > >>
> >> > >> > >> > > > > > >> > >> {
> >> > >> > >> > > > > > >> > >> name = "HGT";
> >> > >> > >> > > > > > >> > >> level = "P500";
> >> > >> > >> > > > > > >> > >> obs_thresh = [ <=CDP10,
> >> >CDP10&&<=CDP20,
> >> > >> > >> > > > > >CDP20&&<=CDP30,
> >> > >> > >> > > > > > >> > >> >CDP30&&<=CDP40, >CDP40&&<=CDP50,
> >> > >CDP50&&<=CDP60,
> >> > >> > >> > > > > >CDP60&&<=CDP70,
> >> > >> > >> > > > > > >> > >> >CDP70&&<=CDP80, >CDP80&&<=CDP90,
>CDP90 ];
> >> > >> > >> > > > > > >> > >> }
> >> > >> > >> > > > > > >> > >> ]
> >> > >> > >> > > > > > >> > >> }
> >> > >> > >> > > > > > >> > >> fcst = ens;
> >> > >> > >> > > > > > >> > >> obs = fcst;
> >> > >> > >> > > > > > >> > >>
> >> > >> > >> > > > > > >> > >> *1) The field info for ens is set in
the
> >> > >> > >> > > > > > >> > >>
ENS_VAR<n>_[NAME/LEVEL/THRESH/OPTIONS]
> >> variables.
> >> > >> The
> >> > >> > >> fcst
> >> > >> > >> > > and
> >> > >> > >> > > > > obs
> >> > >> > >> > > > > > >> field
> >> > >> > >> > > > > > >> > >> info are set in the corresponding
> >> FCST_VAR<n>_*
> >> > and
> >> > >> > >> > > > OBS_VAR<n>_*
> >> > >> > >> > > > > > >> > variables
> >> > >> > >> > > > > > >> > >> respectively, or you can use
BOTH_VAR<n>_*
> if
> >> the
> >> > >> FCST
> >> > >> > >> and
> >> > >> > >> > > OBS
> >> > >> > >> > > > > > values
> >> > >> > >> > > > > > >> > are
> >> > >> > >> > > > > > >> > >> the same.*
> >> > >> > >> > > > > > >> > >>
> >> > >> > >> > > > > > >> > >> *If ENS_VAR<n>_* variables are not
> explicitly
> >> > set,
> >> > >> > then
> >> > >> > >> it
> >> > >> > >> > > will
> >> > >> > >> > > > > use
> >> > >> > >> > > > > > >> the
> >> > >> > >> > > > > > >> > >> values from FCST_VAR<n>_*.*
> >> > >> > >> > > > > > >> > >> *Since the fcst, obs, and ens are all
the
> same
> >> > you
> >> > >> > could
> >> > >> > >> > just
> >> > >> > >> > > > use
> >> > >> > >> > > > > > >> > >> BOTH_VAR<n>_* variables to control
all 3,
> >> > although
> >> > >> > keep
> >> > >> > >> in
> >> > >> > >> > > mind
> >> > >> > >> > > > > > that
> >> > >> > >> > > > > > >> if
> >> > >> > >> > > > > > >> > >> you
> >> > >> > >> > > > > > >> > >> need to change one of them for any
reason,
> it
> >> > will
> >> > >> be
> >> > >> > >> more
> >> > >> > >> > > > > > difficult
> >> > >> > >> > > > > > >> to
> >> > >> > >> > > > > > >> > do
> >> > >> > >> > > > > > >> > >> this. If you know that they will
always be
> the
> >> > same
> >> > >> > >> values,
> >> > >> > >> > > > then
> >> > >> > >> > > > > I
> >> > >> > >> > > > > > >> > >> recommend using BOTH_, but if you
know they
> >> may
> >> > >> change
> >> > >> > >> or
> >> > >> > >> > are
> >> > >> > >> > > > > > >> unsure, I
> >> > >> > >> > > > > > >> > >> would recommend setting them by
referencing
> >> the
> >> > >> other
> >> > >> > >> > > > variables,
> >> > >> > >> > > > > > >> i.e.*
> >> > >> > >> > > > > > >> > >>
> >> > >> > >> > > > > > >> > >> *FCST_VAR1_NAME = HGT*
> >> > >> > >> > > > > > >> > >> *FCST_VAR1_LEVELS = P500 *
> >> > >> > >> > > > > > >> > >> *OBS_VAR1_NAME = {FCST_VAR1_NAME}*
> >> > >> > >> > > > > > >> > >> *OBS_VAR1_LEVELS =
{FCST_VAR1_LEVELS}*
> >> > >> > >> > > > > > >> > >>
> >> > >> > >> > > > > > >> > >> *2) The [FCST/OBS/ENS]_VAR<n>_THRESH
> variables
> >> > set
> >> > >> the
> >> > >> > >> > > > cat_thresh
> >> > >> > >> > > > > > >> values
> >> > >> > >> > > > > > >> > >> in
> >> > >> > >> > > > > > >> > >> the field info. A variable specific
to
> >> obs_thresh
> >> > >> is
> >> > >> > not
> >> > >> > >> > > > > currently
> >> > >> > >> > > > > > >> > >> supported, however you can set these
values
> by
> >> > >> using
> >> > >> > the
> >> > >> > >> > > > > > >> > ENS_VAR1_OPTIONS
> >> > >> > >> > > > > > >> > >> variable, i.e.*
> >> > >> > >> > > > > > >> > >>
> >> > >> > >> > > > > > >> > >> *ENS_VAR1_OPTIONS = obs_thresh = [
<=CDP10,
> >> > >> > >> > >CDP10&&<=CDP20,
> >> > >> > >> > > > > > >> > >> >CDP20&&<=CDP30, >CDP30&&<=CDP40,
> >> > >CDP40&&<=CDP50,
> >> > >> > >> > > > > >CDP50&&<=CDP60,
> >> > >> > >> > > > > > >> > >> >CDP60&&<=CDP70, >CDP70&&<=CDP80,
> >> > >CDP80&&<=CDP90,
> >> > >> > >> >CDP90
> >> > >> > >> > ];*
> >> > >> > >> > > > > > >> > >>
> >> > >> > >> > > > > > >> > >>
> >> > >> > >> > > > > > >> > >> *Remember to include the semicolon at
the
> >> end! *
> >> > >> > >> > > > > > >> > >>
> >> > >> > >> > > > > > >> > >> ens_ssvar_bin_size = 1000000;
> >> > >> > >> > > > > > >> > >> *1) This variable is different from
the
> >> default
> >> > and
> >> > >> > not
> >> > >> > >> > > > currently
> >> > >> > >> > > > > > >> > >> supported
> >> > >> > >> > > > > > >> > >> with a METplus config variable. I
will add
> >> this
> >> > to
> >> > >> the
> >> > >> > >> list
> >> > >> > >> > > of
> >> > >> > >> > > > > > >> variables
> >> > >> > >> > > > > > >> > >> in
> >> > >> > >> > > > > > >> > >> MET config files that we want to
support.
> >> > However,
> >> > >> in
> >> > >> > >> the
> >> > >> > >> > > > > meantime
> >> > >> > >> > > > > > >> you
> >> > >> > >> > > > > > >> > can
> >> > >> > >> > > > > > >> > >> copy the default wrapped MET config
file and
> >> > >> modify it
> >> > >> > >> to
> >> > >> > >> > fit
> >> > >> > >> > > > > your
> >> > >> > >> > > > > > >> > needs.
> >> > >> > >> > > > > > >> > >> To do this, you will need to:*
> >> > >> > >> > > > > > >> > >>
> >> > >> > >> > > > > > >> > >> * a) Copy
> >> > >> > >> > METplus/parm/met_config/EnsembleStatConfig_wrapped
> >> > >> > >> > > > to
> >> > >> > >> > > > > > the
> >> > >> > >> > > > > > >> > >> directory that contains your METplus
config
> >> file
> >> > >> for
> >> > >> > >> this
> >> > >> > >> > use
> >> > >> > >> > > > > case.
> >> > >> > >> > > > > > >> > Rename
> >> > >> > >> > > > > > >> > >> it by replacing "wrapped" with a
short
> >> > description
> >> > >> > that
> >> > >> > >> > > > pertains
> >> > >> > >> > > > > to
> >> > >> > >> > > > > > >> your
> >> > >> > >> > > > > > >> > >> use case.*
> >> > >> > >> > > > > > >> > >>
> >> > >> > >> > > > > > >> > >> * b) In your METplus config file,
change
> the
> >> > >> value of
> >> > >> > >> > > > > > >> > >> ENSEMBLE_STAT_CONFIG_FILE to point to
the
> >> path of
> >> > >> this
> >> > >> > >> new
> >> > >> > >> > > > config
> >> > >> > >> > > > > > >> file.*
> >> > >> > >> > > > > > >> > >>
> >> > >> > >> > > > > > >> > >> * c) If you know the value you want
to use
> >> for
> >> > >> this
> >> > >> > >> > variable
> >> > >> > >> > > > > will
> >> > >> > >> > > > > > >> > always
> >> > >> > >> > > > > > >> > >> be 1000000, then simply set the
variable to
> >> that
> >> > >> > value.
> >> > >> > >> If
> >> > >> > >> > > you
> >> > >> > >> > > > > > think
> >> > >> > >> > > > > > >> you
> >> > >> > >> > > > > > >> > >> may want to change the value, then
you can
> >> > utilize
> >> > >> the
> >> > >> > >> > > > > > >> [user_env_vars]
> >> > >> > >> > > > > > >> > >> functionality. See:
> >> > >> > >> > > > > > >> > >>
> >> > >> > >> > > > > > >> > >>
> >> > >> > >> > > > > > >> >
> >> > >> > >> > > > > > >>
> >> > >> > >> > > > > >
> >> > >> > >> > > > >
> >> > >> > >> > > >
> >> > >> > >> > >
> >> > >> > >> >
> >> > >> > >>
> >> > >> >
> >> > >>
> >> >
> >>
>
https://dtcenter.github.io/METplus/latest/Users_Guide/systemconfiguration.html#user-
defined-config
> >> > >> > >> > > > > > >> > >> <
> >> > >> > >> > > > > > >> > >>
> >> > >> > >> > > > > > >> >
> >> > >> > >> > > > > > >>
> >> > >> > >> > > > > >
> >> > >> > >> > > > >
> >> > >> > >> > > >
> >> > >> > >> > >
> >> > >> > >> >
> >> > >> > >>
> >> > >> >
> >> > >>
> >> >
> >>
>
https://dtcenter.github.io/METplus/latest/Users_Guide/systemconfiguration.html#user-
defined-config
> >> > >> > >> > > > > > >> > >> >*
> >> > >> > >> > > > > > >> > >> *In this case, you would add the
following
> to
> >> > your
> >> > >> > >> METplus
> >> > >> > >> > > > > config:*
> >> > >> > >> > > > > > >> > >>
> >> > >> > >> > > > > > >> > >> *[user_env_vars]*
> >> > >> > >> > > > > > >> > >> *ENS_SSVAR_BIN_SIZE = 1000000*
> >> > >> > >> > > > > > >> > >>
> >> > >> > >> > > > > > >> > >> *Then change the line in your
EnsembleStat
> >> config
> >> > >> file
> >> > >> > >> that
> >> > >> > >> > > you
> >> > >> > >> > > > > > >> copied
> >> > >> > >> > > > > > >> > >> to:*
> >> > >> > >> > > > > > >> > >>
> >> > >> > >> > > > > > >> > >> * ens_ssvar_bin_size =
> ${ENS_SSVAR_BIN_SIZE};
> >> *
> >> > >> > >> > > > > > >> > >>
> >> > >> > >> > > > > > >> > >> ens_phist_bin_size = 0.05;
> >> > >> > >> > > > > > >> > >> *This variable uses the default
value, so
> you
> >> > don't
> >> > >> > >> need to
> >> > >> > >> > > do
> >> > >> > >> > > > > > >> anything
> >> > >> > >> > > > > > >> > >> here. If you need to make it
configurable or
> >> > change
> >> > >> > the
> >> > >> > >> > > value,
> >> > >> > >> > > > > then
> >> > >> > >> > > > > > >> > follow
> >> > >> > >> > > > > > >> > >> the instructions for setting
> >> ens_ssvar_bin_size.*
> >> > >> > >> > > > > > >> > >>
> >> > >> > >> > > > > > >> > >> climo_mean = fcst;
> >> > >> > >> > > > > > >> > >> climo_mean = {
> >> > >> > >> > > > > > >> > >> file_name = "${CLIM_MEAN}";
> >> > >> > >> > > > > > >> > >> time_interp_method = DW_MEAN;
> >> > >> > >> > > > > > >> > >> match_day = TRUE;
> >> > >> > >> > > > > > >> > >> time_step = 21600;
> >> > >> > >> > > > > > >> > >> }
> >> > >> > >> > > > > > >> > >>
> >> > >> > >> > > > > > >> > >>
> >> > >> > >> > > > > > >> > >> *Instead of using CLIM_MEAN, you can
set
> >> > >> > >> > > > > > >> > >>
> ENSEMBLE_STAT_CLIMO_MEAN_INPUT_[DIR/TEMPLATE]
> >> in
> >> > >> the
> >> > >> > >> > METplus
> >> > >> > >> > > > > > config.
> >> > >> > >> > > > > > >> You
> >> > >> > >> > > > > > >> > >> can use filename template syntax in
the
> >> _TEMPLATE
> >> > >> > value,
> >> > >> > >> > i.e.
> >> > >> > >> > > > > > >> > >> {valid?fmt=%m%d}. The other variables
in the
> >> > >> > climo_mean
> >> > >> > >> > > > > dictionary
> >> > >> > >> > > > > > >> are
> >> > >> > >> > > > > > >> > >> actually old variables that have been
> replaced
> >> > with
> >> > >> > >> > > > day_interval
> >> > >> > >> > > > > > and
> >> > >> > >> > > > > > >> > >> hour_interval, but the values you use
are
> the
> >> old
> >> > >> > >> defaults,
> >> > >> > >> > > so
> >> > >> > >> > > > > you
> >> > >> > >> > > > > > >> > >> shouldn't need to set them.*
> >> > >> > >> > > > > > >> > >>
> >> > >> > >> > > > > > >> > >> climo_stdev = climo_mean;
> >> > >> > >> > > > > > >> > >> climo_stdev = {
> >> > >> > >> > > > > > >> > >> file_name = "${CLIM_STDV}";
> >> > >> > >> > > > > > >> > >> }
> >> > >> > >> > > > > > >> > >>
> >> > >> > >> > > > > > >> > >> *Similarly to CLIM_MEAN, you can use
> >> > >> > >> > > > > > >> > >>
> >> ENSEMBLE_STAT_CLIMO_STDEV_INPUT_[DIR/TEMPLATE] to
> >> > >> set
> >> > >> > >> this
> >> > >> > >> > > file
> >> > >> > >> > > > > > >> name.*
> >> > >> > >> > > > > > >> > >>
> >> > >> > >> > > > > > >> > >> climo_cdf = {
> >> > >> > >> > > > > > >> > >> cdf_bins = 11;
> >> > >> > >> > > > > > >> > >> center_bins = TRUE;
> >> > >> > >> > > > > > >> > >> write_bins = TRUE;
> >> > >> > >> > > > > > >> > >> }
> >> > >> > >> > > > > > >> > >> *The value for write_bins is the
default,
> but
> >> the
> >> > >> > values
> >> > >> > >> > for
> >> > >> > >> > > > > > cdf_bins
> >> > >> > >> > > > > > >> > and
> >> > >> > >> > > > > > >> > >> center_bins do not. To set these,
follow the
> >> > above
> >> > >> > >> > > instructions
> >> > >> > >> > > > > for
> >> > >> > >> > > > > > >> > >> ens_ssvar_bin_size to override them
and/or
> >> make
> >> > >> them
> >> > >> > >> > > > configurable
> >> > >> > >> > > > > > >> > through
> >> > >> > >> > > > > > >> > >> METplus. I will also add these
variables to
> >> the
> >> > >> list
> >> > >> > of
> >> > >> > >> MET
> >> > >> > >> > > > > configs
> >> > >> > >> > > > > > >> that
> >> > >> > >> > > > > > >> > >> users want to be able to easily
configure
> >> through
> >> > >> > >> METplus
> >> > >> > >> > > > > configs.*
> >> > >> > >> > > > > > >> > >>
> >> > >> > >> > > > > > >> > >> Please let me know if you run into
any
> issues
> >> > >> setting
> >> > >> > >> any
> >> > >> > >> > of
> >> > >> > >> > > > that
> >> > >> > >> > > > > > up.
> >> > >> > >> > > > > > >> > >> Also,
> >> > >> > >> > > > > > >> > >> if there are any other MET config
variables
> >> that
> >> > >> you
> >> > >> > >> want
> >> > >> > >> > to
> >> > >> > >> > > > see
> >> > >> > >> > > > > > >> > supported
> >> > >> > >> > > > > > >> > >> in METplus, let me know and I will
make sure
> >> they
> >> > >> get
> >> > >> > >> > > included
> >> > >> > >> > > > > when
> >> > >> > >> > > > > > >> we
> >> > >> > >> > > > > > >> > >> have
> >> > >> > >> > > > > > >> > >> a chance to refactor those wrappers.
It is
> >> > >> possible to
> >> > >> > >> add
> >> > >> > >> > > > > support
> >> > >> > >> > > > > > >> for
> >> > >> > >> > > > > > >> > MET
> >> > >> > >> > > > > > >> > >> configs using the above instructions,
but it
> >> is
> >> > >> always
> >> > >> > >> > easier
> >> > >> > >> > > > and
> >> > >> > >> > > > > > >> less
> >> > >> > >> > > > > > >> > >> error-prone to have them configurable
> directly
> >> > >> > through a
> >> > >> > >> > > > variable
> >> > >> > >> > > > > > in
> >> > >> > >> > > > > > >> the
> >> > >> > >> > > > > > >> > >> METplus config.
> >> > >> > >> > > > > > >> > >>
> >> > >> > >> > > > > > >> > >> Thanks,
> >> > >> > >> > > > > > >> > >> George
> >> > >> > >> > > > > > >> > >>
> >> > >> > >> > > > > > >> > >> On Tue, Jan 5, 2021 at 7:14 AM
> >> > >> Binbin.Zhou at noaa.gov
> >> > >> > via
> >> > >> > >> > RT <
> >> > >> > >> > > > > > >> > >> met_help at ucar.edu> wrote:
> >> > >> > >> > > > > > >> > >>
> >> > >> > >> > > > > > >> > >> >
> >> > >> > >> > > > > > >> > >> > Tue Jan 05 07:14:54 2021: Request
98116
> was
> >> > acted
> >> > >> > >> upon.
> >> > >> > >> > > > > > >> > >> > Transaction: Ticket created by
> >> > >> Binbin.Zhou at noaa.gov
> >> > >> > >> > > > > > >> > >> > Queue: met_help
> >> > >> > >> > > > > > >> > >> > Subject: CDP threshold setting
in
> >> > >> EnsembleStat
> >> > >> > >> conf
> >> > >> > >> > > > > > >> > >> > Owner: Nobody
> >> > >> > >> > > > > > >> > >> > Requestors: Binbin.Zhou at noaa.gov
> >> > >> > >> > > > > > >> > >> > Status: new
> >> > >> > >> > > > > > >> > >> > Ticket <URL:
> >> > >> > >> > > > > > >>
> >> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
> >> > >> > >> > > > > > >> > >
> >> > >> > >> > > > > > >> > >> >
> >> > >> > >> > > > > > >> > >> >
> >> > >> > >> > > > > > >> > >> > George,
> >> > >> > >> > > > > > >> > >> >
> >> > >> > >> > > > > > >> > >> > Happy New Year!
> >> > >> > >> > > > > > >> > >> >
> >> > >> > >> > > > > > >> > >> > I am working on transition of
our
> >> MET-based
> >> > >> > global
> >> > >> > >> > > > ensemble
> >> > >> > >> > > > > > >> > >> verification
> >> > >> > >> > > > > > >> > >> > to METplus based package. In this
package
> >> > >> > climatology
> >> > >> > >> > bins
> >> > >> > >> > > > (10
> >> > >> > >> > > > > > >> bins)
> >> > >> > >> > > > > > >> > are
> >> > >> > >> > > > > > >> > >> > used.
> >> > >> > >> > > > > > >> > >> > In current ensemble stat config
file, the
> >> > >> relevant
> >> > >> > >> > entries
> >> > >> > >> > > > iare
> >> > >> > >> > > > > > >> > defined
> >> > >> > >> > > > > > >> > >> > like following
> >> > >> > >> > > > > > >> > >> >
> >> > >> > >> > > > > > >> > >> > ens = {
> >> > >> > >> > > > > > >> > >> > ens_thresh = 1.0;
> >> > >> > >> > > > > > >> > >> > vld_thresh = 1.0;
> >> > >> > >> > > > > > >> > >> >
> >> > >> > >> > > > > > >> > >> > field = [
> >> > >> > >> > > > > > >> > >> >
> >> > >> > >> > > > > > >> > >> > {
> >> > >> > >> > > > > > >> > >> > name = "HGT";
> >> > >> > >> > > > > > >> > >> > level = "P500";
> >> > >> > >> > > > > > >> > >> > obs_thresh = [ <=CDP10,
> >> > >CDP10&&<=CDP20,
> >> > >> > >> > > > > > >CDP20&&<=CDP30,
> >> > >> > >> > > > > > >> > >> > >CDP30&&<=CDP40, >CDP40&&<=CDP50,
> >> > >> >CDP50&&<=CDP60,
> >> > >> > >> > > > > > >CDP60&&<=CDP70,
> >> > >> > >> > > > > > >> > >> > >CDP70&&<=CDP80, >CDP80&&<=CDP90,
>CDP90
> ];
> >> > >> > >> > > > > > >> > >> > }
> >> > >> > >> > > > > > >> > >> > ]
> >> > >> > >> > > > > > >> > >> > }
> >> > >> > >> > > > > > >> > >> > fcst = ens;
> >> > >> > >> > > > > > >> > >> > obs = fcst;
> >> > >> > >> > > > > > >> > >> > ens_ssvar_bin_size = 1000000;
> >> > >> > >> > > > > > >> > >> > ens_phist_bin_size = 0.05;
> >> > >> > >> > > > > > >> > >> > climo_mean = fcst;
> >> > >> > >> > > > > > >> > >> > climo_mean = {
> >> > >> > >> > > > > > >> > >> > file_name = "${CLIM_MEAN}";
> >> > >> > >> > > > > > >> > >> > time_interp_method = DW_MEAN;
> >> > >> > >> > > > > > >> > >> > match_day = TRUE;
> >> > >> > >> > > > > > >> > >> > time_step = 21600;
> >> > >> > >> > > > > > >> > >> > }
> >> > >> > >> > > > > > >> > >> >
> >> > >> > >> > > > > > >> > >> > climo_stdev = climo_mean;
> >> > >> > >> > > > > > >> > >> > climo_stdev = {
> >> > >> > >> > > > > > >> > >> > file_name = "${CLIM_STDV}";
> >> > >> > >> > > > > > >> > >> > }
> >> > >> > >> > > > > > >> > >> >
> >> > >> > >> > > > > > >> > >> > climo_cdf = {
> >> > >> > >> > > > > > >> > >> > cdf_bins = 11;
> >> > >> > >> > > > > > >> > >> > center_bins = TRUE;
> >> > >> > >> > > > > > >> > >> > write_bins = TRUE;
> >> > >> > >> > > > > > >> > >> > }
> >> > >> > >> > > > > > >> > >> >
> >> > >> > >> > > > > > >> > >> > I can not find the correspondent
settings
> in
> >> > its
> >> > >> > conf
> >> > >> > >> > file
> >> > >> > >> > > > from
> >> > >> > >> > > > > > >> > METplus
> >> > >> > >> > > > > > >> > >> > online doc.
> >> > >> > >> > > > > > >> > >> > Can you help me look at this?
> >> > >> > >> > > > > > >> > >> >
> >> > >> > >> > > > > > >> > >> > Thanks!
> >> > >> > >> > > > > > >> > >> >
> >> > >> > >> > > > > > >> > >> > Binbin
> >> > >> > >> > > > > > >> > >> >
> >> > >> > >> > > > > > >> > >> > --
> >> > >> > >> > > > > > >> > >> >
> >> > >> > >> > > > > > >> > >> > Binbin Zhou
> >> > >> > >> > > > > > >> > >> >
> >> > >> > >> > > > > > >> > >> > IMSG at NOAA/NWS/NCEP/EMC
> >> > >> > >> > > > > > >> > >> >
> >> > >> > >> > > > > > >> > >> > 5830 University Research Ct.
> >> > >> > >> > > > > > >> > >> >
> >> > >> > >> > > > > > >> > >> > College Park, MD 20740
> >> > >> > >> > > > > > >> > >> >
> >> > >> > >> > > > > > >> > >> > Binbin.Zhou at noaa.gov
> >> > >> > >> > > > > > >> > >> >
> >> > >> > >> > > > > > >> > >> > 301-683-3683
> >> > >> > >> > > > > > >> > >> >
> >> > >> > >> > > > > > >> > >> >
> >> > >> > >> > > > > > >> > >>
> >> > >> > >> > > > > > >> > >> --
> >> > >> > >> > > > > > >> > >> George McCabe - Software Engineer III
> >> > >> > >> > > > > > >> > >> National Center for Atmospheric
Research
> >> > >> > >> > > > > > >> > >> Research Applications Laboratory
> >> > >> > >> > > > > > >> > >> 303-497-2768
> >> > >> > >> > > > > > >> > >> ---
> >> > >> > >> > > > > > >> > >> My working day may not be your
working day.
> >> > Please
> >> > >> do
> >> > >> > >> not
> >> > >> > >> > > feel
> >> > >> > >> > > > > > >> obliged
> >> > >> > >> > > > > > >> > to
> >> > >> > >> > > > > > >> > >> reply to this email outside of your
normal
> >> > working
> >> > >> > >> hours.
> >> > >> > >> > > > > > >> > >>
> >> > >> > >> > > > > > >> > >>
> >> > >> > >> > > > > > >> > >
> >> > >> > >> > > > > > >> > > --
> >> > >> > >> > > > > > >> > >
> >> > >> > >> > > > > > >> > > Binbin Zhou
> >> > >> > >> > > > > > >> > >
> >> > >> > >> > > > > > >> > > IMSG at NOAA/NWS/NCEP/EMC
> >> > >> > >> > > > > > >> > >
> >> > >> > >> > > > > > >> > > 5830 University Research Ct.
> >> > >> > >> > > > > > >> > >
> >> > >> > >> > > > > > >> > > College Park, MD 20740
> >> > >> > >> > > > > > >> > >
> >> > >> > >> > > > > > >> > > Binbin.Zhou at noaa.gov
> >> > >> > >> > > > > > >> > >
> >> > >> > >> > > > > > >> > > 301-683-3683
> >> > >> > >> > > > > > >> > >
> >> > >> > >> > > > > > >> >
> >> > >> > >> > > > > > >> >
> >> > >> > >> > > > > > >> > --
> >> > >> > >> > > > > > >> >
> >> > >> > >> > > > > > >> > Binbin Zhou
> >> > >> > >> > > > > > >> >
> >> > >> > >> > > > > > >> > IMSG at NOAA/NWS/NCEP/EMC
> >> > >> > >> > > > > > >> >
> >> > >> > >> > > > > > >> > 5830 University Research Ct.
> >> > >> > >> > > > > > >> >
> >> > >> > >> > > > > > >> > College Park, MD 20740
> >> > >> > >> > > > > > >> >
> >> > >> > >> > > > > > >> > Binbin.Zhou at noaa.gov
> >> > >> > >> > > > > > >> >
> >> > >> > >> > > > > > >> > 301-683-3683
> >> > >> > >> > > > > > >> >
> >> > >> > >> > > > > > >> >
> >> > >> > >> > > > > > >>
> >> > >> > >> > > > > > >> --
> >> > >> > >> > > > > > >> George McCabe - Software Engineer III
> >> > >> > >> > > > > > >> National Center for Atmospheric Research
> >> > >> > >> > > > > > >> Research Applications Laboratory
> >> > >> > >> > > > > > >> 303-497-2768
> >> > >> > >> > > > > > >> ---
> >> > >> > >> > > > > > >> My working day may not be your working
day.
> Please
> >> do
> >> > >> not
> >> > >> > >> feel
> >> > >> > >> > > > obliged
> >> > >> > >> > > > > > to
> >> > >> > >> > > > > > >> reply to this email outside of your normal
> working
> >> > >> hours.
> >> > >> > >> > > > > > >>
> >> > >> > >> > > > > > >>
> >> > >> > >> > > > > > >
> >> > >> > >> > > > > > > --
> >> > >> > >> > > > > > >
> >> > >> > >> > > > > > > Binbin Zhou
> >> > >> > >> > > > > > >
> >> > >> > >> > > > > > > IMSG at NOAA/NWS/NCEP/EMC
> >> > >> > >> > > > > > >
> >> > >> > >> > > > > > > 5830 University Research Ct.
> >> > >> > >> > > > > > >
> >> > >> > >> > > > > > > College Park, MD 20740
> >> > >> > >> > > > > > >
> >> > >> > >> > > > > > > Binbin.Zhou at noaa.gov
> >> > >> > >> > > > > > >
> >> > >> > >> > > > > > > 301-683-3683
> >> > >> > >> > > > > > >
> >> > >> > >> > > > > >
> >> > >> > >> > > > > >
> >> > >> > >> > > > > > --
> >> > >> > >> > > > > >
> >> > >> > >> > > > > > Binbin Zhou
> >> > >> > >> > > > > >
> >> > >> > >> > > > > > IMSG at NOAA/NWS/NCEP/EMC
> >> > >> > >> > > > > >
> >> > >> > >> > > > > > 5830 University Research Ct.
> >> > >> > >> > > > > >
> >> > >> > >> > > > > > College Park, MD 20740
> >> > >> > >> > > > > >
> >> > >> > >> > > > > > Binbin.Zhou at noaa.gov
> >> > >> > >> > > > > >
> >> > >> > >> > > > > > 301-683-3683
> >> > >> > >> > > > > >
> >> > >> > >> > > > > >
> >> > >> > >> > > > >
> >> > >> > >> > > > > --
> >> > >> > >> > > > > George McCabe - Software Engineer III
> >> > >> > >> > > > > National Center for Atmospheric Research
> >> > >> > >> > > > > Research Applications Laboratory
> >> > >> > >> > > > > 303-497-2768
> >> > >> > >> > > > > ---
> >> > >> > >> > > > > My working day may not be your working day.
Please do
> >> not
> >> > >> feel
> >> > >> > >> > obliged
> >> > >> > >> > > to
> >> > >> > >> > > > > reply to this email outside of your normal
working
> >> hours.
> >> > >> > >> > > > >
> >> > >> > >> > > > >
> >> > >> > >> > > >
> >> > >> > >> > > > --
> >> > >> > >> > > >
> >> > >> > >> > > > Binbin Zhou
> >> > >> > >> > > >
> >> > >> > >> > > > IMSG at NOAA/NWS/NCEP/EMC
> >> > >> > >> > > >
> >> > >> > >> > > > 5830 University Research Ct.
> >> > >> > >> > > >
> >> > >> > >> > > > College Park, MD 20740
> >> > >> > >> > > >
> >> > >> > >> > > > Binbin.Zhou at noaa.gov
> >> > >> > >> > > >
> >> > >> > >> > > > 301-683-3683
> >> > >> > >> > > >
> >> > >> > >> > > >
> >> > >> > >> > >
> >> > >> > >> > > --
> >> > >> > >> > > George McCabe - Software Engineer III
> >> > >> > >> > > National Center for Atmospheric Research
> >> > >> > >> > > Research Applications Laboratory
> >> > >> > >> > > 303-497-2768
> >> > >> > >> > > ---
> >> > >> > >> > > My working day may not be your working day. Please
do not
> >> feel
> >> > >> > >> obliged to
> >> > >> > >> > > reply to this email outside of your normal working
hours.
> >> > >> > >> > >
> >> > >> > >> > >
> >> > >> > >> >
> >> > >> > >> > --
> >> > >> > >> >
> >> > >> > >> > Binbin Zhou
> >> > >> > >> >
> >> > >> > >> > IMSG at NOAA/NWS/NCEP/EMC
> >> > >> > >> >
> >> > >> > >> > 5830 University Research Ct.
> >> > >> > >> >
> >> > >> > >> > College Park, MD 20740
> >> > >> > >> >
> >> > >> > >> > Binbin.Zhou at noaa.gov
> >> > >> > >> >
> >> > >> > >> > 301-683-3683
> >> > >> > >> >
> >> > >> > >> >
> >> > >> > >>
> >> > >> > >> --
> >> > >> > >> Julie Prestopnik (she/her)
> >> > >> > >> Software Engineer
> >> > >> > >> National Center for Atmospheric Research
> >> > >> > >> Research Applications Laboratory
> >> > >> > >> Email: jpresto at ucar.edu
> >> > >> > >>
> >> > >> > >> My working day may not be your working day. Please do
not
> feel
> >> > >> obliged
> >> > >> > to
> >> > >> > >> reply to this email outside of your normal working
hours.
> >> > >> > >>
> >> > >> > >>
> >> > >> > >
> >> > >> > > --
> >> > >> > >
> >> > >> > > Binbin Zhou
> >> > >> > >
> >> > >> > > IMSG at NOAA/NWS/NCEP/EMC
> >> > >> > >
> >> > >> > > 5830 University Research Ct.
> >> > >> > >
> >> > >> > > College Park, MD 20740
> >> > >> > >
> >> > >> > > Binbin.Zhou at noaa.gov
> >> > >> > >
> >> > >> > > 301-683-3683
> >> > >> > >
> >> > >> >
> >> > >> >
> >> > >> > --
> >> > >> >
> >> > >> > Binbin Zhou
> >> > >> >
> >> > >> > IMSG at NOAA/NWS/NCEP/EMC
> >> > >> >
> >> > >> > 5830 University Research Ct.
> >> > >> >
> >> > >> > College Park, MD 20740
> >> > >> >
> >> > >> > Binbin.Zhou at noaa.gov
> >> > >> >
> >> > >> > 301-683-3683
> >> > >> >
> >> > >> >
> >> > >>
> >> > >> --
> >> > >> Julie Prestopnik (she/her)
> >> > >> Software Engineer
> >> > >> National Center for Atmospheric Research
> >> > >> Research Applications Laboratory
> >> > >> Email: jpresto at ucar.edu
> >> > >>
> >> > >> My working day may not be your working day. Please do not
feel
> >> obliged
> >> > to
> >> > >> reply to this email outside of your normal working hours.
> >> > >>
> >> > >>
> >> > >
> >> > > --
> >> > > George McCabe - Software Engineer III
> >> > > National Center for Atmospheric Research
> >> > > Research Applications Laboratory
> >> > > 303-497-2768
> >> > > ---
> >> > > My working day may not be your working day. Please do not
feel
> >> obliged to
> >> > > reply to this email outside of your normal working hours.
> >> > >
> >> >
> >> >
> >> > --
> >> >
> >> > Binbin Zhou
> >> >
> >> > IMSG at NOAA/NWS/NCEP/EMC
> >> >
> >> > 5830 University Research Ct.
> >> >
> >> > College Park, MD 20740
> >> >
> >> > Binbin.Zhou at noaa.gov
> >> >
> >> > 301-683-3683
> >> >
> >> >
> >>
> >> --
> >> George McCabe - Software Engineer III
> >> National Center for Atmospheric Research
> >> Research Applications Laboratory
> >> 303-497-2768
> >> ---
> >> My working day may not be your working day. Please do not feel
obliged
> to
> >> reply to this email outside of your normal working hours.
> >>
> >>
> >
> > --
> >
> > Binbin Zhou
> >
> > IMSG at NOAA/NWS/NCEP/EMC
> >
> > 5830 University Research Ct.
> >
> > College Park, MD 20740
> >
> > Binbin.Zhou at noaa.gov
> >
> > 301-683-3683
> >
>
>
> --
>
> Binbin Zhou
>
> IMSG at NOAA/NWS/NCEP/EMC
>
> 5830 University Research Ct.
>
> College Park, MD 20740
>
> Binbin.Zhou at noaa.gov
>
> 301-683-3683
>
>
--
George McCabe - Software Engineer III
National Center for Atmospheric Research
Research Applications Laboratory
303-497-2768
---
My working day may not be your working day. Please do not feel obliged
to
reply to this email outside of your normal working hours.
------------------------------------------------
Subject: CDP threshold setting in EnsembleStat conf
From: Binbin.Zhou at noaa.gov
Time: Wed Jan 06 15:49:47 2021
George
I'll test it tomorrow,
Thanks!
Binbin
On Wed, Jan 6, 2021 at 5:08 PM George McCabe via RT
<met_help at ucar.edu>
wrote:
> Hi Binbin,
>
> match_day and time_step are no longer used, so they should be
removed. You
> should replace them with:
>
> day_interval = 31;
> hour_interval = 12;
>
> 31 is the default for day interval. The default for hour_interval is
6, but
> we want it to be 12 so it finds your climo files.
>
> - George
>
> On Wed, Jan 6, 2021 at 2:39 PM Binbin.Zhou at noaa.gov via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116 >
> >
> > George,
> >
> > Even I deleted time_step in the climo_mean entry, this error
is still
> > there.
> > So I think climo_mean=fcst should be removed and define climo_mean
part
> > separately.
> > But how to define the fields (name, level) in climo_mean in
METplus conf
> > file?
> > Maybe hard copy the fields for climo_mean in EnsembleGrid config
file?
> >
> > Binbin
> >
> > On Wed, Jan 6, 2021 at 4:18 PM Binbin Zhou - NOAA Affiliate <
> > binbin.zhou at noaa.gov> wrote:
> >
> > > George,
> > >
> > > Rerun has same error
> > > Skipping the 19590104_000000 "HGT/P500" climatology field since
the
> time
> > > offset (43200 seconds) >= the "hour_interval" entry (21600
seconds)
> from
> > > file:
> > >
> >
>
/gpfs/dell2/emc/modeling/noscrub/Binbin.Zhou/g2g/com/verf/dev/ens.20210104/clim.grid3.mean.010400.grib2
> > >
> > > The new setting for climo in EnemsbleGrid config file is
> > > climo_mean = fcst;
> > > climo_mean = {
> > > file_name = [ ${CLIMO_MEAN_FILE} ];
> > > time_interp_method = DW_MEAN;
> > > match_day = FALSE;
> > > time_step = 43200;
> > > }
> > > climo_stdev = climo_mean;
> > > climo_stdev = {
> > > file_name = [ ${CLIMO_STDEV_FILE} ];
> > > }
> > >
> > > climo_cdf = {
> > > cdf_bins = 11;
> > > center_bins = TRUE;
> > > write_bins = TRUE;
> > > }
> > >
> > > It seems time_step is not effective?
> > >
> > > Binbin
> > >
> > > On Wed, Jan 6, 2021 at 3:15 PM George McCabe via RT
<met_help at ucar.edu
> >
> > > wrote:
> > >
> > >> Hi Binbin,
> > >>
> > >> Thanks for sending the updated logs. It looks like your
climatology
> > fields
> > >> are not being read properly. I think this line explains the
problem:
> > >>
> > >> DEBUG 3: Skipping the 19590104_000000 "HGT/P500" climatology
field
> since
> > >> the time offset (43200 seconds) >= the "hour_interval" entry
(21600
> > >> seconds) from file:
> > >>
> > >>
> >
>
/gpfs/dell2/emc/modeling/noscrub/Binbin.Zhou/g2g/com/verf/dev/ens.20210104/clim.grid3.stdv.010400.grib2
> > >>
> > >> The variables match_day and time_step in your climo_mean
dictionary
> are
> > >> actually no longer used and have been replaced with:
> > >>
> > >> day_interval = 31;
> > >> hour_interval = 6;
> > >>
> > >> 21600 seconds is 6 hours and it sounds like your climo field is
offset
> > by
> > >> 12 hours. I believe setting hour_interval to 12 should allow it
to
> find
> > >> the
> > >> climatology field and compute the statistics properly. Let me
know if
> it
> > >> does not.
> > >>
> > >> Thanks,
> > >> George
> > >>
> > >> On Wed, Jan 6, 2021 at 12:43 PM Binbin.Zhou at noaa.gov via RT <
> > >> met_help at ucar.edu> wrote:
> > >>
> > >> >
> > >> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
>
> > >> >
> > >> > George,
> > >> >
> > >> > I have re-run the case with LOG_LEVEL=DEBUG and
> > >> > LOG_ENSEMBLE_STAT_VERBOSITY =3.
> > >> > The output log file has been sent to hera:
> > >> >
> > >> >
> > >>
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Binbin.Zhou/metplus_test/metplus3.out/log/master_metplus.log.20210106193455
> > >> >
> > >> > Please look at it.
> > >> >
> > >> > Thanks!
> > >> >
> > >> > Biinbin
> > >> >
> > >> > On Wed, Jan 6, 2021 at 2:19 PM George McCabe
<mccabe at ucar.edu>
> wrote:
> > >> >
> > >> > > Hi Binbin,
> > >> > >
> > >> > > Thanks for putting those files on hera. The log output you
sent
> > >> doesn't
> > >> > > have the DEBUG level output (LOG_LEVEL=DEBUG). However, I
tried to
> > run
> > >> > > EnsembleStat locally using the _OPTIONS value you set and
it seems
> > to
> > >> run
> > >> > > fine. The error seems to suggest that something went wrong
when
> > >> computing
> > >> > > the mean and standard deviation before the obs_thresh
values are
> > >> > applied. I
> > >> > > have reached out to John HG to see if he has any insight as
to why
> > >> that
> > >> > is
> > >> > > happening. In the meantime, you could rerun with
> > >> > > LOG_ENSEMBLE_STAT_VERBOSITY set to a higher value than 2
to see
> if
> > >> the
> > >> > > extra log output from the MET tool gives you any more
insight as
> to
> > >> what
> > >> > is
> > >> > > going wrong.
> > >> > >
> > >> > > - George
> > >> > >
> > >> > > On Wed, Jan 6, 2021 at 9:51 AM Julie Prestopnik via RT <
> > >> > met_help at ucar.edu>
> > >> > > wrote:
> > >> > >
> > >> > >> Thanks for all of the info Binbin. I saw that you had
copied
> > >> everything
> > >> > >> to
> > >> > >> hera for George. I am currently no longer on WCOSS, so I
unless
> > >> George
> > >> > >> lets me know that he needs something from WCOSS, I'll
assume he
> is
> > >> able
> > >> > to
> > >> > >> get it from hera.
> > >> > >>
> > >> > >> Julie
> > >> > >>
> > >> > >> On Wed, Jan 6, 2021 at 9:39 AM Binbin.Zhou at noaa.gov via RT
<
> > >> > >> met_help at ucar.edu> wrote:
> > >> > >>
> > >> > >> >
> > >> > >> > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
> >
> > >> > >> >
> > >> > >> > The EnsembleStat config file for the successful run
outside of
> > >> METplus
> > >> > >> is
> > >> > >> >
> > >> > >> >
> > >> > >>
> > >> >
> > >>
> >
>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_met_global_ens1p0.v1.0.0/parm/verf_g2g_ens_stat_config_bin11
> > >> > >> > on WCOSS
> > >> > >> >
> > >> > >> > Binbin
> > >> > >> >
> > >> > >> > On Wed, Jan 6, 2021 at 11:34 AM Binbin Zhou - NOAA
Affiliate <
> > >> > >> > binbin.zhou at noaa.gov> wrote:
> > >> > >> >
> > >> > >> > > Julie,
> > >> > >> > >
> > >> > >> > > The output directory on WCOSS is
> > >> > >> > >
> > >> > >> > >
> > >> > >> >
> > >> > >>
> > >> >
> > >>
> >
>
/gpfs/dell1/ptmp/Binbin.Zhou/g2g/RFC2/tmpnwprd/verf_g2g_gefs_00_dev.161076/metplus3.out
> > >> > >> > >
> > >> > >> > > My METplus package on WCOSS is
> > >> > >> > >
> > >> > >> >
> > >> > >>
> > >> >
> > >>
> >
>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_g2g.v4.0.0
> > >> > >> > >
> > >> > >> > > For GEFS, the EnsembleGrid config file is
> > >> > >> > >
> > >> > >> > >
> > >> > >> >
> > >> > >>
> > >> >
> > >>
> >
>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_g2g.v4.0.0/parm/app_conf/grid2grid/met_config/EnsembleStatConfig_gefs_bin11
> > >> > >> > > Its conf file
> > >> > >> > > is
> > >> > >> >
> > >> > >>
> > >> >
> > >>
> >
>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_g2g.v4.0.0/parm/app_conf/grid2grid/gefs_conf/gefs_bin11.conf
> > >> > >> > >
> > >> > >> > > The running process is little bit complex since this
is a
> > >> transition
> > >> > >> to
> > >> > >> > > future operational package that uses
> > >> > >> > > mpi parallel: the script is
> > >> > >> > >
> > >> > >> > >
> > >> > >> >
> > >> > >>
> > >> >
> > >>
> >
>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_g2g.v4.0.0/ush/verf_g2g_metplus_run_gefs_mpi.sh
> > >> > >> > >
> > >> > >> > > Binbin
> > >> > >> > >
> > >> > >> > >
> > >> > >> > >
> > >> > >> > >
> > >> > >> > > On Wed, Jan 6, 2021 at 11:00 AM Julie Prestopnik via
RT <
> > >> > >> > met_help at ucar.edu>
> > >> > >> > > wrote:
> > >> > >> > >
> > >> > >> > >> Hi Binbin.
> > >> > >> > >>
> > >> > >> > >> This is Julie. I haven't been following this entire
thread,
> > >> but I
> > >> > >> am on
> > >> > >> > >> WCOSS right now. If you send a path to a file, I can
pull
> it
> > >> and
> > >> > >> put it
> > >> > >> > >> on
> > >> > >> > >> our ftp server for George.
> > >> > >> > >>
> > >> > >> > >> Julie
> > >> > >> > >>
> > >> > >> > >> On Wed, Jan 6, 2021 at 8:57 AM Binbin.Zhou at noaa.gov
via RT
> <
> > >> > >> > >> met_help at ucar.edu> wrote:
> > >> > >> > >>
> > >> > >> > >> >
> > >> > >> > >> > <URL:
> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
> > >> >
> > >> > >> > >> >
> > >> > >> > >> > George,
> > >> > >> > >> >
> > >> > >> > >> > Can you access WCOSS or access HERA?
> > >> > >> > >> > Otherwise I will email attached to you
> > >> > >> > >> >
> > >> > >> > >> > Binbin
> > >> > >> > >> >
> > >> > >> > >> >
> > >> > >> > >> >
> > >> > >> > >> > On Wed, Jan 6, 2021 at 10:46 AM George McCabe via
RT <
> > >> > >> > met_help at ucar.edu
> > >> > >> > >> >
> > >> > >> > >> > wrote:
> > >> > >> > >> >
> > >> > >> > >> > > Hi Binbin,
> > >> > >> > >> > >
> > >> > >> > >> > > Could you send me a log file for a run with
> > LOG_LEVEL=DEBUG
> > >> (in
> > >> > >> > >> METplus
> > >> > >> > >> > > config) so I can see how the environment variable
> > ENS_FIELD
> > >> is
> > >> > >> set?
> > >> > >> > >> The
> > >> > >> > >> > > values of ENS_VAR<n>_* are formatted and set in
this
> > >> > environment
> > >> > >> > >> variable
> > >> > >> > >> > > which is passed into the MET config. You can
compare
> that
> > >> value
> > >> > >> with
> > >> > >> > >> what
> > >> > >> > >> > > you used in your successful run outside of the
METplus
> > >> wrapper
> > >> > to
> > >> > >> > >> > determine
> > >> > >> > >> > > what is different.
> > >> > >> > >> > >
> > >> > >> > >> > > Thanks,
> > >> > >> > >> > > George
> > >> > >> > >> > >
> > >> > >> > >> > > On Wed, Jan 6, 2021 at 7:11 AM
Binbin.Zhou at noaa.gov via
> > RT
> > >> <
> > >> > >> > >> > > met_help at ucar.edu> wrote:
> > >> > >> > >> > >
> > >> > >> > >> > > >
> > >> > >> > >> > > > <URL:
> > >> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
> > >> > >> >
> > >> > >> > >> > > >
> > >> > >> > >> > > > George,
> > >> > >> > >> > > >
> > >> > >> > >> > > > I got a new error in execution although some
output
> > >> files
> > >> > (nc
> > >> > >> > >> file)
> > >> > >> > >> > are
> > >> > >> > >> > > > created but stat files not.
> > >> > >> > >> > > > The error message is
> > >> > >> > >> > > >
> > >> > >> > >> > > > ERROR :
> > >> > >> > >> > > > ERROR : Simple_Node::check(double, double,
double)
> > const
> > >> ->
> > >> > >> > >> > > climatological
> > >> > >> > >> > > > distribution percentile threshold "<=CDP10"
requested
> > with
> > >> > >> invalid
> > >> > >> > >> mean
> > >> > >> > >> > > > (-9999) or standard deviation (-9999).
> > >> > >> > >> > > > ERROR :
> > >> > >> > >> > > >
> > >> > >> > >> > > > Such an error was ever investigated by John H
before
> > (year
> > >> > >> ago):
> > >> > >> > >> When I
> > >> > >> > >> > > > directly ran ensemble_stat for global ensemble
(not
> > >> > >> METplus-based,
> > >> > >> > >> > > > but hard code of all settings in EnsembleStat
config
> > >> file):
> > >> > If
> > >> > >> > hard
> > >> > >> > >> > code
> > >> > >> > >> > > > fcst field in EnsembleStat config file like
this
> > >> > >> > >> > > >
> > >> > >> > >> > > > name = "HGT";
> > >> > >> > >> > > > level = "P500";
> > >> > >> > >> > > > cat_thresh = [ <=CDP10,
>CDP10&&<=CDP20,
> > >> > >> >CDP20&&<=CDP30,
> > >> > >> > >> > > > >CDP30&&<=CDP40, >CDP40&&<=CDP50,
>CDP50&&<=CDP60,
> > >> > >> > >CDP60&&<=CDP70,
> > >> > >> > >> > > > >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];
> > >> > >> > >> > > >
> > >> > >> > >> > > > Run ensemble_stat will have such error: ERROR
:
> > >> > >> > >> > > > Simple_Node::check(double, double, double)
const ->
> > >> > >> climatological
> > >> > >> > >> > > > distribution percentile threshold "<=CDP10"
requested
> > with
> > >> > >> invalid
> > >> > >> > >> mean
> > >> > >> > >> > > > (-9999) or standard deviation (-9999).
> > >> > >> > >> > > >
> > >> > >> > >> > > > John H. suggested me change "cat_thresh = " to
> > >> "obs_thresh =
> > >> > >> ",
> > >> > >> > >> then
> > >> > >> > >> > > the
> > >> > >> > >> > > > error was solved.
> > >> > >> > >> > > >
> > >> > >> > >> > > > In current METplus version, following your
suggestion
> as
> > >> > >> > >> > > >
> > >> > >> > >> > > > ENS_VAR1_OPTIONS = obs_thresh = [ <=CDP10,
> > >> >CDP10&&<=CDP20,
> > >> > >> > >> > > > >CDP20&&<=CDP30, >CDP30&&<=CDP40,
>CDP40&&<=CDP50,
> > >> > >> > >CDP50&&<=CDP60,
> > >> > >> > >> > > > >CDP60&&<=CDP70, >CDP70&&<=CDP80,
>CDP80&&<=CDP90,
> > >CDP90
> > >> ];
> > >> > >> > >> > > >
> > >> > >> > >> > > > the same error appears again. So I am not for
sure
> if
> > >> the
> > >> > >> > >> > "obs_thresh"
> > >> > >> > >> > > > setting is correctly passed.
> > >> > >> > >> > > >
> > >> > >> > >> > > > Binbin
> > >> > >> > >> > > >
> > >> > >> > >> > > >
> > >> > >> > >> > > >
> > >> > >> > >> > > >
> > >> > >> > >> > > > On Tue, Jan 5, 2021 at 5:19 PM George McCabe
via RT <
> > >> > >> > >> met_help at ucar.edu
> > >> > >> > >> > >
> > >> > >> > >> > > > wrote:
> > >> > >> > >> > > >
> > >> > >> > >> > > > > Hi Binbin,
> > >> > >> > >> > > > >
> > >> > >> > >> > > > > Your solution should work for now. It looks
like
> > >> although
> > >> > the
> > >> > >> > >> METplus
> > >> > >> > >> > > > > variable does get read properly, the
environment
> > >> variable
> > >> > is
> > >> > >> not
> > >> > >> > >> > > actually
> > >> > >> > >> > > > > set by the EnsembleStat wrapper. I can make a
note
> to
> > >> add
> > >> > >> that
> > >> > >> > for
> > >> > >> > >> > > 4.0.0,
> > >> > >> > >> > > > > as it is an easy fix.
> > >> > >> > >> > > > >
> > >> > >> > >> > > > > - George
> > >> > >> > >> > > > >
> > >> > >> > >> > > > > On Tue, Jan 5, 2021 at 2:53 PM
Binbin.Zhou at noaa.gov
> > via
> > >> > RT <
> > >> > >> > >> > > > > met_help at ucar.edu> wrote:
> > >> > >> > >> > > > >
> > >> > >> > >> > > > > > George,
> > >> > >> > >> > > > > >
> > >> > >> > >> > > > > > I have a temporal solution:
> > >> > >> > >> > > > > > set ploy in EnembleStat config as
> > >> > >> > >> > > > > > poly = [ "${MASKPATH}/lat_NHM.nc",
> > >> > >> > >> > > > > > "${MASKPATH}/lat_NHM.nc",
> > >> > >> > >> > > > > > "${MASKPATH}/lat_TRP.nc" ];
> > >> > >> > >> > > > > >
> > >> > >> > >> > > > > > then set MASKPATH in user_env_vars part in
the
> conf
> > >> file
> > >> > >> > >> > > > > > This MASKPAH then can be passed to
EnsembleStat's
> > >> poly [
> > >> > ]
> > >> > >> > entry
> > >> > >> > >> > > > > >
> > >> > >> > >> > > > > > Binbin
> > >> > >> > >> > > > > >
> > >> > >> > >> > > > > > On Tue, Jan 5, 2021 at 4:25 PM Binbin Zhou
- NOAA
> > >> > >> Affiliate <
> > >> > >> > >> > > > > > binbin.zhou at noaa.gov> wrote:
> > >> > >> > >> > > > > >
> > >> > >> > >> > > > > > > George,
> > >> > >> > >> > > > > > >
> > >> > >> > >> > > > > > > Still not working, error says
> > >> > >> > >> > > > > > > ERROR : replace_env() -> unable to get
value
> for
> > >> > >> > environment
> > >> > >> > >> > > > variable
> > >> > >> > >> > > > > > > "VERIF_MASK"
> > >> > >> > >> > > > > > >
> > >> > >> > >> > > > > > > Binbin
> > >> > >> > >> > > > > > >
> > >> > >> > >> > > > > > >
> > >> > >> > >> > > > > > >
> > >> > >> > >> > > > > > > On Tue, Jan 5, 2021 at 3:50 PM George
McCabe via
> > RT
> > >> <
> > >> > >> > >> > > > met_help at ucar.edu
> > >> > >> > >> > > > > >
> > >> > >> > >> > > > > > > wrote:
> > >> > >> > >> > > > > > >
> > >> > >> > >> > > > > > >> Hi Binbin,
> > >> > >> > >> > > > > > >>
> > >> > >> > >> > > > > > >> You should be able to set it in the
METplus
> > config
> > >> the
> > >> > >> same
> > >> > >> > >> way
> > >> > >> > >> > it
> > >> > >> > >> > > > is
> > >> > >> > >> > > > > > done
> > >> > >> > >> > > > > > >> for GridStat -- no quotes with commas
between
> > each
> > >> > item.
> > >> > >> > The
> > >> > >> > >> > > wrapper
> > >> > >> > >> > > > > > >> should
> > >> > >> > >> > > > > > >> format it properly.
> > >> > >> > >> > > > > > >>
> > >> > >> > >> > > > > > >> Here is an example from an existing use
case:
> > >> > >> > >> > > > > > >>
> > >> > >> > >> > > > > > >> GRID_STAT_VERIFICATION_MASK_TEMPLATE =
> > >> > >> > >> > > > > > >>
> > >> > >> > >> > >
> > >> > >>
> >
{INPUT_BASE}/model_applications/precipitation/mask/CONUS_HRRRTLE.nc,
> > >> > >> > >> > > > > > >>
> > >> > >> > >> > >
> > >> > >>
> {INPUT_BASE}/model_applications/precipitation/mask/EAST_HRRRTLE.nc,
> > >> > >> > >> > > > > > >>
> > >> > >> > >> >
> > >> >
{INPUT_BASE}/model_applications/precipitation/mask/WEST_HRRRTLE.nc
> > >> > >> > >> > > > > > >>
> > >> > >> > >> > > > > > >> You should be able to set them the same
way
> using
> > >> > >> > >> > > > > > >>
ENSEMBLE_STAT_VERIFICATION_MASK_TEMPLATE. Let
> me
> > >> know
> > >> > if
> > >> > >> > that
> > >> > >> > >> > > > doesn't
> > >> > >> > >> > > > > > >> work.
> > >> > >> > >> > > > > > >>
> > >> > >> > >> > > > > > >> - George
> > >> > >> > >> > > > > > >>
> > >> > >> > >> > > > > > >> On Tue, Jan 5, 2021 at 1:45 PM
> > >> Binbin.Zhou at noaa.gov
> > >> > via
> > >> > >> > RT <
> > >> > >> > >> > > > > > >> met_help at ucar.edu> wrote:
> > >> > >> > >> > > > > > >>
> > >> > >> > >> > > > > > >> >
> > >> > >> > >> > > > > > >> > <URL:
> > >> > >> > >>
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
> > >> > >> > >> > >
> > >> > >> > >> > > > > > >> >
> > >> > >> > >> > > > > > >> > George,
> > >> > >> > >> > > > > > >> >
> > >> > >> > >> > > > > > >> > I got another issue for verification
mask
> > >> setting.
> > >> > >> > >> > > > > > >> >
> > >> > >> > >> > > > > > >> > I am using $VERIF_MASK in EnsembleStat
config
> > >> f/ile
> > >> > >> > >> > > > > > >> > mask = {
> > >> > >> > >> > > > > > >> > grid = [];
> > >> > >> > >> > > > > > >> > poly = [${VERIF_MASK}];
> > >> > >> > >> > > > > > >> > sid = [];
> > >> > >> > >> > > > > > >> > }
> > >> > >> > >> > > > > > >> >
> > >> > >> > >> > > > > > >> > And using
> GRID_STAT_VERIFICATION_MASK_TEMPLATE
> > >> to
> > >> > >> define
> > >> > >> > >> > > several
> > >> > >> > >> > > > > > >> polygon
> > >> > >> > >> > > > > > >> > nc mask files
> > >> > >> > >> > > > > > >> > But it seems not working. But it works
for
> > >> Gridstat
> > >> > >> > config
> > >> > >> > >> in
> > >> > >> > >> > > > suich
> > >> > >> > >> > > > > > >> > setting.
> > >> > >> > >> > > > > > >> > I can not find ENSEMBLE_STAT_
> > >> > >> VERIFICATION_MASK_TEMPLATE
> > >> > >> > in
> > >> > >> > >> > the
> > >> > >> > >> > > > > > METplus
> > >> > >> > >> > > > > > >> doc
> > >> > >> > >> > > > > > >> >
> > >> > >> > >> > > > > > >> > So I define VERIF_MASK in
[user_env_vars]
> part.
> > >> > >> > >> > > > > > >> > It values can not be passed to ploy =
> > >> > [${VERIF_MASK}]
> > >> > >> in
> > >> > >> > >> the
> > >> > >> > >> > > > > > >> EnsembleStat
> > >> > >> > >> > > > > > >> > conf if more than one nc files
included.
> > >> > >> > >> > > > > > >> > For example
> > >> > >> > >> > > > > > >> > VERIF_MASK=" '/part/p1.cn',
'/path/p2.nc' "
> > >> > >> > >> > > > > > >> > the error says poly = [/path/p1,]
> > >> > >> > >> > > > > > >> > It seems double quote or single quote
can not
> > be
> > >> > >> passed
> > >> > >> > to
> > >> > >> > >> > > > > VERIF_MASK
> > >> > >> > >> > > > > > in
> > >> > >> > >> > > > > > >> > the EnsembleStat config.
> > >> > >> > >> > > > > > >> > I tried use back slash \ to before
quote, but
> > >> still
> > >> > >> not
> > >> > >> > >> > working
> > >> > >> > >> > > > > > >> >
> > >> > >> > >> > > > > > >> > Binbin
> > >> > >> > >> > > > > > >> >
> > >> > >> > >> > > > > > >> >
> > >> > >> > >> > > > > > >> > On Tue, Jan 5, 2021 at 10:33 AM Binbin
Zhou -
> > >> NOAA
> > >> > >> > >> Affiliate <
> > >> > >> > >> > > > > > >> > binbin.zhou at noaa.gov> wrote:
> > >> > >> > >> > > > > > >> >
> > >> > >> > >> > > > > > >> > > George,
> > >> > >> > >> > > > > > >> > >
> > >> > >> > >> > > > > > >> > > Thanks for your quick response!
I'll
> test
> > >> this
> > >> > >> > >> settings
> > >> > >> > >> > and
> > >> > >> > >> > > > let
> > >> > >> > >> > > > > > >> > > you know the results.
> > >> > >> > >> > > > > > >> > >
> > >> > >> > >> > > > > > >> > > Binbin
> > >> > >> > >> > > > > > >> > >
> > >> > >> > >> > > > > > >> > > On Tue, Jan 5, 2021 at 10:17 AM
George
> McCabe
> > >> via
> > >> > >> RT <
> > >> > >> > >> > > > > > >> met_help at ucar.edu>
> > >> > >> > >> > > > > > >> > > wrote:
> > >> > >> > >> > > > > > >> > >
> > >> > >> > >> > > > > > >> > >> Hi Binbin,
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >> Happy New Year to you too!
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >> I will comment on each
configuration
> > variable
> > >> and
> > >> > >> how
> > >> > >> > to
> > >> > >> > >> > set
> > >> > >> > >> > > it
> > >> > >> > >> > > > > in
> > >> > >> > >> > > > > > a
> > >> > >> > >> > > > > > >> > >> METplus config inline:
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >> ens = {
> > >> > >> > >> > > > > > >> > >> ens_thresh = 1.0;
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >> *This is controlled by the
> > >> > ENSEMBLE_STAT_ENS_THRESH
> > >> > >> > >> > variable.
> > >> > >> > >> > > > The
> > >> > >> > >> > > > > > >> > default
> > >> > >> > >> > > > > > >> > >> value is 1.0, so you don't need to
include
> > it
> > >> in
> > >> > >> your
> > >> > >> > >> > config
> > >> > >> > >> > > > > file,
> > >> > >> > >> > > > > > >> but
> > >> > >> > >> > > > > > >> > you
> > >> > >> > >> > > > > > >> > >> can if you may adjust this value at
some
> > >> point.*
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >> vld_thresh = 1.0;
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >> *This value is set to 1.0 by
default so we
> > >> don't
> > >> > >> need
> > >> > >> > to
> > >> > >> > >> > > worry
> > >> > >> > >> > > > > > about
> > >> > >> > >> > > > > > >> it
> > >> > >> > >> > > > > > >> > >> right now.*
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >> field = [
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >> {
> > >> > >> > >> > > > > > >> > >> name = "HGT";
> > >> > >> > >> > > > > > >> > >> level = "P500";
> > >> > >> > >> > > > > > >> > >> obs_thresh = [ <=CDP10,
> > >> >CDP10&&<=CDP20,
> > >> > >> > >> > > > > >CDP20&&<=CDP30,
> > >> > >> > >> > > > > > >> > >> >CDP30&&<=CDP40, >CDP40&&<=CDP50,
> > >> > >CDP50&&<=CDP60,
> > >> > >> > >> > > > > >CDP60&&<=CDP70,
> > >> > >> > >> > > > > > >> > >> >CDP70&&<=CDP80, >CDP80&&<=CDP90,
>CDP90
> ];
> > >> > >> > >> > > > > > >> > >> }
> > >> > >> > >> > > > > > >> > >> ]
> > >> > >> > >> > > > > > >> > >> }
> > >> > >> > >> > > > > > >> > >> fcst = ens;
> > >> > >> > >> > > > > > >> > >> obs = fcst;
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >> *1) The field info for ens is set
in the
> > >> > >> > >> > > > > > >> > >>
ENS_VAR<n>_[NAME/LEVEL/THRESH/OPTIONS]
> > >> variables.
> > >> > >> The
> > >> > >> > >> fcst
> > >> > >> > >> > > and
> > >> > >> > >> > > > > obs
> > >> > >> > >> > > > > > >> field
> > >> > >> > >> > > > > > >> > >> info are set in the corresponding
> > >> FCST_VAR<n>_*
> > >> > and
> > >> > >> > >> > > > OBS_VAR<n>_*
> > >> > >> > >> > > > > > >> > variables
> > >> > >> > >> > > > > > >> > >> respectively, or you can use
BOTH_VAR<n>_*
> > if
> > >> the
> > >> > >> FCST
> > >> > >> > >> and
> > >> > >> > >> > > OBS
> > >> > >> > >> > > > > > values
> > >> > >> > >> > > > > > >> > are
> > >> > >> > >> > > > > > >> > >> the same.*
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >> *If ENS_VAR<n>_* variables are not
> > explicitly
> > >> > set,
> > >> > >> > then
> > >> > >> > >> it
> > >> > >> > >> > > will
> > >> > >> > >> > > > > use
> > >> > >> > >> > > > > > >> the
> > >> > >> > >> > > > > > >> > >> values from FCST_VAR<n>_*.*
> > >> > >> > >> > > > > > >> > >> *Since the fcst, obs, and ens are
all the
> > same
> > >> > you
> > >> > >> > could
> > >> > >> > >> > just
> > >> > >> > >> > > > use
> > >> > >> > >> > > > > > >> > >> BOTH_VAR<n>_* variables to control
all 3,
> > >> > although
> > >> > >> > keep
> > >> > >> > >> in
> > >> > >> > >> > > mind
> > >> > >> > >> > > > > > that
> > >> > >> > >> > > > > > >> if
> > >> > >> > >> > > > > > >> > >> you
> > >> > >> > >> > > > > > >> > >> need to change one of them for any
reason,
> > it
> > >> > will
> > >> > >> be
> > >> > >> > >> more
> > >> > >> > >> > > > > > difficult
> > >> > >> > >> > > > > > >> to
> > >> > >> > >> > > > > > >> > do
> > >> > >> > >> > > > > > >> > >> this. If you know that they will
always be
> > the
> > >> > same
> > >> > >> > >> values,
> > >> > >> > >> > > > then
> > >> > >> > >> > > > > I
> > >> > >> > >> > > > > > >> > >> recommend using BOTH_, but if you
know
> they
> > >> may
> > >> > >> change
> > >> > >> > >> or
> > >> > >> > >> > are
> > >> > >> > >> > > > > > >> unsure, I
> > >> > >> > >> > > > > > >> > >> would recommend setting them by
> referencing
> > >> the
> > >> > >> other
> > >> > >> > >> > > > variables,
> > >> > >> > >> > > > > > >> i.e.*
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >> *FCST_VAR1_NAME = HGT*
> > >> > >> > >> > > > > > >> > >> *FCST_VAR1_LEVELS = P500 *
> > >> > >> > >> > > > > > >> > >> *OBS_VAR1_NAME = {FCST_VAR1_NAME}*
> > >> > >> > >> > > > > > >> > >> *OBS_VAR1_LEVELS =
{FCST_VAR1_LEVELS}*
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >> *2) The
[FCST/OBS/ENS]_VAR<n>_THRESH
> > variables
> > >> > set
> > >> > >> the
> > >> > >> > >> > > > cat_thresh
> > >> > >> > >> > > > > > >> values
> > >> > >> > >> > > > > > >> > >> in
> > >> > >> > >> > > > > > >> > >> the field info. A variable specific
to
> > >> obs_thresh
> > >> > >> is
> > >> > >> > not
> > >> > >> > >> > > > > currently
> > >> > >> > >> > > > > > >> > >> supported, however you can set
these
> values
> > by
> > >> > >> using
> > >> > >> > the
> > >> > >> > >> > > > > > >> > ENS_VAR1_OPTIONS
> > >> > >> > >> > > > > > >> > >> variable, i.e.*
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >> *ENS_VAR1_OPTIONS = obs_thresh = [
> <=CDP10,
> > >> > >> > >> > >CDP10&&<=CDP20,
> > >> > >> > >> > > > > > >> > >> >CDP20&&<=CDP30, >CDP30&&<=CDP40,
> > >> > >CDP40&&<=CDP50,
> > >> > >> > >> > > > > >CDP50&&<=CDP60,
> > >> > >> > >> > > > > > >> > >> >CDP60&&<=CDP70, >CDP70&&<=CDP80,
> > >> > >CDP80&&<=CDP90,
> > >> > >> > >> >CDP90
> > >> > >> > >> > ];*
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >> *Remember to include the semicolon
at the
> > >> end! *
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >> ens_ssvar_bin_size = 1000000;
> > >> > >> > >> > > > > > >> > >> *1) This variable is different from
the
> > >> default
> > >> > and
> > >> > >> > not
> > >> > >> > >> > > > currently
> > >> > >> > >> > > > > > >> > >> supported
> > >> > >> > >> > > > > > >> > >> with a METplus config variable. I
will add
> > >> this
> > >> > to
> > >> > >> the
> > >> > >> > >> list
> > >> > >> > >> > > of
> > >> > >> > >> > > > > > >> variables
> > >> > >> > >> > > > > > >> > >> in
> > >> > >> > >> > > > > > >> > >> MET config files that we want to
support.
> > >> > However,
> > >> > >> in
> > >> > >> > >> the
> > >> > >> > >> > > > > meantime
> > >> > >> > >> > > > > > >> you
> > >> > >> > >> > > > > > >> > can
> > >> > >> > >> > > > > > >> > >> copy the default wrapped MET config
file
> and
> > >> > >> modify it
> > >> > >> > >> to
> > >> > >> > >> > fit
> > >> > >> > >> > > > > your
> > >> > >> > >> > > > > > >> > needs.
> > >> > >> > >> > > > > > >> > >> To do this, you will need to:*
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >> * a) Copy
> > >> > >> > >> > METplus/parm/met_config/EnsembleStatConfig_wrapped
> > >> > >> > >> > > > to
> > >> > >> > >> > > > > > the
> > >> > >> > >> > > > > > >> > >> directory that contains your
METplus
> config
> > >> file
> > >> > >> for
> > >> > >> > >> this
> > >> > >> > >> > use
> > >> > >> > >> > > > > case.
> > >> > >> > >> > > > > > >> > Rename
> > >> > >> > >> > > > > > >> > >> it by replacing "wrapped" with a
short
> > >> > description
> > >> > >> > that
> > >> > >> > >> > > > pertains
> > >> > >> > >> > > > > to
> > >> > >> > >> > > > > > >> your
> > >> > >> > >> > > > > > >> > >> use case.*
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >> * b) In your METplus config file,
change
> > the
> > >> > >> value of
> > >> > >> > >> > > > > > >> > >> ENSEMBLE_STAT_CONFIG_FILE to point
to the
> > >> path of
> > >> > >> this
> > >> > >> > >> new
> > >> > >> > >> > > > config
> > >> > >> > >> > > > > > >> file.*
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >> * c) If you know the value you
want to
> use
> > >> for
> > >> > >> this
> > >> > >> > >> > variable
> > >> > >> > >> > > > > will
> > >> > >> > >> > > > > > >> > always
> > >> > >> > >> > > > > > >> > >> be 1000000, then simply set the
variable
> to
> > >> that
> > >> > >> > value.
> > >> > >> > >> If
> > >> > >> > >> > > you
> > >> > >> > >> > > > > > think
> > >> > >> > >> > > > > > >> you
> > >> > >> > >> > > > > > >> > >> may want to change the value, then
you can
> > >> > utilize
> > >> > >> the
> > >> > >> > >> > > > > > >> [user_env_vars]
> > >> > >> > >> > > > > > >> > >> functionality. See:
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> >
> > >> > >> > >> > > > > > >>
> > >> > >> > >> > > > > >
> > >> > >> > >> > > > >
> > >> > >> > >> > > >
> > >> > >> > >> > >
> > >> > >> > >> >
> > >> > >> > >>
> > >> > >> >
> > >> > >>
> > >> >
> > >>
> >
>
https://dtcenter.github.io/METplus/latest/Users_Guide/systemconfiguration.html#user-
defined-config
> > >> > >> > >> > > > > > >> > >> <
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> >
> > >> > >> > >> > > > > > >>
> > >> > >> > >> > > > > >
> > >> > >> > >> > > > >
> > >> > >> > >> > > >
> > >> > >> > >> > >
> > >> > >> > >> >
> > >> > >> > >>
> > >> > >> >
> > >> > >>
> > >> >
> > >>
> >
>
https://dtcenter.github.io/METplus/latest/Users_Guide/systemconfiguration.html#user-
defined-config
> > >> > >> > >> > > > > > >> > >> >*
> > >> > >> > >> > > > > > >> > >> *In this case, you would add the
following
> > to
> > >> > your
> > >> > >> > >> METplus
> > >> > >> > >> > > > > config:*
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >> *[user_env_vars]*
> > >> > >> > >> > > > > > >> > >> *ENS_SSVAR_BIN_SIZE = 1000000*
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >> *Then change the line in your
EnsembleStat
> > >> config
> > >> > >> file
> > >> > >> > >> that
> > >> > >> > >> > > you
> > >> > >> > >> > > > > > >> copied
> > >> > >> > >> > > > > > >> > >> to:*
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >> * ens_ssvar_bin_size =
> > ${ENS_SSVAR_BIN_SIZE};
> > >> *
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >> ens_phist_bin_size = 0.05;
> > >> > >> > >> > > > > > >> > >> *This variable uses the default
value, so
> > you
> > >> > don't
> > >> > >> > >> need to
> > >> > >> > >> > > do
> > >> > >> > >> > > > > > >> anything
> > >> > >> > >> > > > > > >> > >> here. If you need to make it
configurable
> or
> > >> > change
> > >> > >> > the
> > >> > >> > >> > > value,
> > >> > >> > >> > > > > then
> > >> > >> > >> > > > > > >> > follow
> > >> > >> > >> > > > > > >> > >> the instructions for setting
> > >> ens_ssvar_bin_size.*
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >> climo_mean = fcst;
> > >> > >> > >> > > > > > >> > >> climo_mean = {
> > >> > >> > >> > > > > > >> > >> file_name = "${CLIM_MEAN}";
> > >> > >> > >> > > > > > >> > >> time_interp_method = DW_MEAN;
> > >> > >> > >> > > > > > >> > >> match_day = TRUE;
> > >> > >> > >> > > > > > >> > >> time_step = 21600;
> > >> > >> > >> > > > > > >> > >> }
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >> *Instead of using CLIM_MEAN, you
can set
> > >> > >> > >> > > > > > >> > >>
> > ENSEMBLE_STAT_CLIMO_MEAN_INPUT_[DIR/TEMPLATE]
> > >> in
> > >> > >> the
> > >> > >> > >> > METplus
> > >> > >> > >> > > > > > config.
> > >> > >> > >> > > > > > >> You
> > >> > >> > >> > > > > > >> > >> can use filename template syntax in
the
> > >> _TEMPLATE
> > >> > >> > value,
> > >> > >> > >> > i.e.
> > >> > >> > >> > > > > > >> > >> {valid?fmt=%m%d}. The other
variables in
> the
> > >> > >> > climo_mean
> > >> > >> > >> > > > > dictionary
> > >> > >> > >> > > > > > >> are
> > >> > >> > >> > > > > > >> > >> actually old variables that have
been
> > replaced
> > >> > with
> > >> > >> > >> > > > day_interval
> > >> > >> > >> > > > > > and
> > >> > >> > >> > > > > > >> > >> hour_interval, but the values you
use are
> > the
> > >> old
> > >> > >> > >> defaults,
> > >> > >> > >> > > so
> > >> > >> > >> > > > > you
> > >> > >> > >> > > > > > >> > >> shouldn't need to set them.*
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >> climo_stdev = climo_mean;
> > >> > >> > >> > > > > > >> > >> climo_stdev = {
> > >> > >> > >> > > > > > >> > >> file_name = "${CLIM_STDV}";
> > >> > >> > >> > > > > > >> > >> }
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >> *Similarly to CLIM_MEAN, you can
use
> > >> > >> > >> > > > > > >> > >>
> > >> ENSEMBLE_STAT_CLIMO_STDEV_INPUT_[DIR/TEMPLATE] to
> > >> > >> set
> > >> > >> > >> this
> > >> > >> > >> > > file
> > >> > >> > >> > > > > > >> name.*
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >> climo_cdf = {
> > >> > >> > >> > > > > > >> > >> cdf_bins = 11;
> > >> > >> > >> > > > > > >> > >> center_bins = TRUE;
> > >> > >> > >> > > > > > >> > >> write_bins = TRUE;
> > >> > >> > >> > > > > > >> > >> }
> > >> > >> > >> > > > > > >> > >> *The value for write_bins is the
default,
> > but
> > >> the
> > >> > >> > values
> > >> > >> > >> > for
> > >> > >> > >> > > > > > cdf_bins
> > >> > >> > >> > > > > > >> > and
> > >> > >> > >> > > > > > >> > >> center_bins do not. To set these,
follow
> the
> > >> > above
> > >> > >> > >> > > instructions
> > >> > >> > >> > > > > for
> > >> > >> > >> > > > > > >> > >> ens_ssvar_bin_size to override them
and/or
> > >> make
> > >> > >> them
> > >> > >> > >> > > > configurable
> > >> > >> > >> > > > > > >> > through
> > >> > >> > >> > > > > > >> > >> METplus. I will also add these
variables
> to
> > >> the
> > >> > >> list
> > >> > >> > of
> > >> > >> > >> MET
> > >> > >> > >> > > > > configs
> > >> > >> > >> > > > > > >> that
> > >> > >> > >> > > > > > >> > >> users want to be able to easily
configure
> > >> through
> > >> > >> > >> METplus
> > >> > >> > >> > > > > configs.*
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >> Please let me know if you run into
any
> > issues
> > >> > >> setting
> > >> > >> > >> any
> > >> > >> > >> > of
> > >> > >> > >> > > > that
> > >> > >> > >> > > > > > up.
> > >> > >> > >> > > > > > >> > >> Also,
> > >> > >> > >> > > > > > >> > >> if there are any other MET config
> variables
> > >> that
> > >> > >> you
> > >> > >> > >> want
> > >> > >> > >> > to
> > >> > >> > >> > > > see
> > >> > >> > >> > > > > > >> > supported
> > >> > >> > >> > > > > > >> > >> in METplus, let me know and I will
make
> sure
> > >> they
> > >> > >> get
> > >> > >> > >> > > included
> > >> > >> > >> > > > > when
> > >> > >> > >> > > > > > >> we
> > >> > >> > >> > > > > > >> > >> have
> > >> > >> > >> > > > > > >> > >> a chance to refactor those
wrappers. It is
> > >> > >> possible to
> > >> > >> > >> add
> > >> > >> > >> > > > > support
> > >> > >> > >> > > > > > >> for
> > >> > >> > >> > > > > > >> > MET
> > >> > >> > >> > > > > > >> > >> configs using the above
instructions, but
> it
> > >> is
> > >> > >> always
> > >> > >> > >> > easier
> > >> > >> > >> > > > and
> > >> > >> > >> > > > > > >> less
> > >> > >> > >> > > > > > >> > >> error-prone to have them
configurable
> > directly
> > >> > >> > through a
> > >> > >> > >> > > > variable
> > >> > >> > >> > > > > > in
> > >> > >> > >> > > > > > >> the
> > >> > >> > >> > > > > > >> > >> METplus config.
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >> Thanks,
> > >> > >> > >> > > > > > >> > >> George
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >> On Tue, Jan 5, 2021 at 7:14 AM
> > >> > >> Binbin.Zhou at noaa.gov
> > >> > >> > via
> > >> > >> > >> > RT <
> > >> > >> > >> > > > > > >> > >> met_help at ucar.edu> wrote:
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >> >
> > >> > >> > >> > > > > > >> > >> > Tue Jan 05 07:14:54 2021: Request
98116
> > was
> > >> > acted
> > >> > >> > >> upon.
> > >> > >> > >> > > > > > >> > >> > Transaction: Ticket created by
> > >> > >> Binbin.Zhou at noaa.gov
> > >> > >> > >> > > > > > >> > >> > Queue: met_help
> > >> > >> > >> > > > > > >> > >> > Subject: CDP threshold
setting in
> > >> > >> EnsembleStat
> > >> > >> > >> conf
> > >> > >> > >> > > > > > >> > >> > Owner: Nobody
> > >> > >> > >> > > > > > >> > >> > Requestors:
Binbin.Zhou at noaa.gov
> > >> > >> > >> > > > > > >> > >> > Status: new
> > >> > >> > >> > > > > > >> > >> > Ticket <URL:
> > >> > >> > >> > > > > > >>
> > >> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
> > >> > >> > >> > > > > > >> > >
> > >> > >> > >> > > > > > >> > >> >
> > >> > >> > >> > > > > > >> > >> >
> > >> > >> > >> > > > > > >> > >> > George,
> > >> > >> > >> > > > > > >> > >> >
> > >> > >> > >> > > > > > >> > >> > Happy New Year!
> > >> > >> > >> > > > > > >> > >> >
> > >> > >> > >> > > > > > >> > >> > I am working on transition of
our
> > >> MET-based
> > >> > >> > global
> > >> > >> > >> > > > ensemble
> > >> > >> > >> > > > > > >> > >> verification
> > >> > >> > >> > > > > > >> > >> > to METplus based package. In this
> package
> > >> > >> > climatology
> > >> > >> > >> > bins
> > >> > >> > >> > > > (10
> > >> > >> > >> > > > > > >> bins)
> > >> > >> > >> > > > > > >> > are
> > >> > >> > >> > > > > > >> > >> > used.
> > >> > >> > >> > > > > > >> > >> > In current ensemble stat config
file,
> the
> > >> > >> relevant
> > >> > >> > >> > entries
> > >> > >> > >> > > > iare
> > >> > >> > >> > > > > > >> > defined
> > >> > >> > >> > > > > > >> > >> > like following
> > >> > >> > >> > > > > > >> > >> >
> > >> > >> > >> > > > > > >> > >> > ens = {
> > >> > >> > >> > > > > > >> > >> > ens_thresh = 1.0;
> > >> > >> > >> > > > > > >> > >> > vld_thresh = 1.0;
> > >> > >> > >> > > > > > >> > >> >
> > >> > >> > >> > > > > > >> > >> > field = [
> > >> > >> > >> > > > > > >> > >> >
> > >> > >> > >> > > > > > >> > >> > {
> > >> > >> > >> > > > > > >> > >> > name = "HGT";
> > >> > >> > >> > > > > > >> > >> > level = "P500";
> > >> > >> > >> > > > > > >> > >> > obs_thresh = [ <=CDP10,
> > >> > >CDP10&&<=CDP20,
> > >> > >> > >> > > > > > >CDP20&&<=CDP30,
> > >> > >> > >> > > > > > >> > >> > >CDP30&&<=CDP40, >CDP40&&<=CDP50,
> > >> > >> >CDP50&&<=CDP60,
> > >> > >> > >> > > > > > >CDP60&&<=CDP70,
> > >> > >> > >> > > > > > >> > >> > >CDP70&&<=CDP80, >CDP80&&<=CDP90,
>CDP90
> > ];
> > >> > >> > >> > > > > > >> > >> > }
> > >> > >> > >> > > > > > >> > >> > ]
> > >> > >> > >> > > > > > >> > >> > }
> > >> > >> > >> > > > > > >> > >> > fcst = ens;
> > >> > >> > >> > > > > > >> > >> > obs = fcst;
> > >> > >> > >> > > > > > >> > >> > ens_ssvar_bin_size = 1000000;
> > >> > >> > >> > > > > > >> > >> > ens_phist_bin_size = 0.05;
> > >> > >> > >> > > > > > >> > >> > climo_mean = fcst;
> > >> > >> > >> > > > > > >> > >> > climo_mean = {
> > >> > >> > >> > > > > > >> > >> > file_name = "${CLIM_MEAN}";
> > >> > >> > >> > > > > > >> > >> > time_interp_method = DW_MEAN;
> > >> > >> > >> > > > > > >> > >> > match_day = TRUE;
> > >> > >> > >> > > > > > >> > >> > time_step = 21600;
> > >> > >> > >> > > > > > >> > >> > }
> > >> > >> > >> > > > > > >> > >> >
> > >> > >> > >> > > > > > >> > >> > climo_stdev = climo_mean;
> > >> > >> > >> > > > > > >> > >> > climo_stdev = {
> > >> > >> > >> > > > > > >> > >> > file_name = "${CLIM_STDV}";
> > >> > >> > >> > > > > > >> > >> > }
> > >> > >> > >> > > > > > >> > >> >
> > >> > >> > >> > > > > > >> > >> > climo_cdf = {
> > >> > >> > >> > > > > > >> > >> > cdf_bins = 11;
> > >> > >> > >> > > > > > >> > >> > center_bins = TRUE;
> > >> > >> > >> > > > > > >> > >> > write_bins = TRUE;
> > >> > >> > >> > > > > > >> > >> > }
> > >> > >> > >> > > > > > >> > >> >
> > >> > >> > >> > > > > > >> > >> > I can not find the correspondent
> settings
> > in
> > >> > its
> > >> > >> > conf
> > >> > >> > >> > file
> > >> > >> > >> > > > from
> > >> > >> > >> > > > > > >> > METplus
> > >> > >> > >> > > > > > >> > >> > online doc.
> > >> > >> > >> > > > > > >> > >> > Can you help me look at this?
> > >> > >> > >> > > > > > >> > >> >
> > >> > >> > >> > > > > > >> > >> > Thanks!
> > >> > >> > >> > > > > > >> > >> >
> > >> > >> > >> > > > > > >> > >> > Binbin
> > >> > >> > >> > > > > > >> > >> >
> > >> > >> > >> > > > > > >> > >> > --
> > >> > >> > >> > > > > > >> > >> >
> > >> > >> > >> > > > > > >> > >> > Binbin Zhou
> > >> > >> > >> > > > > > >> > >> >
> > >> > >> > >> > > > > > >> > >> > IMSG at NOAA/NWS/NCEP/EMC
> > >> > >> > >> > > > > > >> > >> >
> > >> > >> > >> > > > > > >> > >> > 5830 University Research Ct.
> > >> > >> > >> > > > > > >> > >> >
> > >> > >> > >> > > > > > >> > >> > College Park, MD 20740
> > >> > >> > >> > > > > > >> > >> >
> > >> > >> > >> > > > > > >> > >> > Binbin.Zhou at noaa.gov
> > >> > >> > >> > > > > > >> > >> >
> > >> > >> > >> > > > > > >> > >> > 301-683-3683
> > >> > >> > >> > > > > > >> > >> >
> > >> > >> > >> > > > > > >> > >> >
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >> --
> > >> > >> > >> > > > > > >> > >> George McCabe - Software Engineer
III
> > >> > >> > >> > > > > > >> > >> National Center for Atmospheric
Research
> > >> > >> > >> > > > > > >> > >> Research Applications Laboratory
> > >> > >> > >> > > > > > >> > >> 303-497-2768
> > >> > >> > >> > > > > > >> > >> ---
> > >> > >> > >> > > > > > >> > >> My working day may not be your
working
> day.
> > >> > Please
> > >> > >> do
> > >> > >> > >> not
> > >> > >> > >> > > feel
> > >> > >> > >> > > > > > >> obliged
> > >> > >> > >> > > > > > >> > to
> > >> > >> > >> > > > > > >> > >> reply to this email outside of your
normal
> > >> > working
> > >> > >> > >> hours.
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >
> > >> > >> > >> > > > > > >> > > --
> > >> > >> > >> > > > > > >> > >
> > >> > >> > >> > > > > > >> > > Binbin Zhou
> > >> > >> > >> > > > > > >> > >
> > >> > >> > >> > > > > > >> > > IMSG at NOAA/NWS/NCEP/EMC
> > >> > >> > >> > > > > > >> > >
> > >> > >> > >> > > > > > >> > > 5830 University Research Ct.
> > >> > >> > >> > > > > > >> > >
> > >> > >> > >> > > > > > >> > > College Park, MD 20740
> > >> > >> > >> > > > > > >> > >
> > >> > >> > >> > > > > > >> > > Binbin.Zhou at noaa.gov
> > >> > >> > >> > > > > > >> > >
> > >> > >> > >> > > > > > >> > > 301-683-3683
> > >> > >> > >> > > > > > >> > >
> > >> > >> > >> > > > > > >> >
> > >> > >> > >> > > > > > >> >
> > >> > >> > >> > > > > > >> > --
> > >> > >> > >> > > > > > >> >
> > >> > >> > >> > > > > > >> > Binbin Zhou
> > >> > >> > >> > > > > > >> >
> > >> > >> > >> > > > > > >> > IMSG at NOAA/NWS/NCEP/EMC
> > >> > >> > >> > > > > > >> >
> > >> > >> > >> > > > > > >> > 5830 University Research Ct.
> > >> > >> > >> > > > > > >> >
> > >> > >> > >> > > > > > >> > College Park, MD 20740
> > >> > >> > >> > > > > > >> >
> > >> > >> > >> > > > > > >> > Binbin.Zhou at noaa.gov
> > >> > >> > >> > > > > > >> >
> > >> > >> > >> > > > > > >> > 301-683-3683
> > >> > >> > >> > > > > > >> >
> > >> > >> > >> > > > > > >> >
> > >> > >> > >> > > > > > >>
> > >> > >> > >> > > > > > >> --
> > >> > >> > >> > > > > > >> George McCabe - Software Engineer III
> > >> > >> > >> > > > > > >> National Center for Atmospheric Research
> > >> > >> > >> > > > > > >> Research Applications Laboratory
> > >> > >> > >> > > > > > >> 303-497-2768
> > >> > >> > >> > > > > > >> ---
> > >> > >> > >> > > > > > >> My working day may not be your working
day.
> > Please
> > >> do
> > >> > >> not
> > >> > >> > >> feel
> > >> > >> > >> > > > obliged
> > >> > >> > >> > > > > > to
> > >> > >> > >> > > > > > >> reply to this email outside of your
normal
> > working
> > >> > >> hours.
> > >> > >> > >> > > > > > >>
> > >> > >> > >> > > > > > >>
> > >> > >> > >> > > > > > >
> > >> > >> > >> > > > > > > --
> > >> > >> > >> > > > > > >
> > >> > >> > >> > > > > > > Binbin Zhou
> > >> > >> > >> > > > > > >
> > >> > >> > >> > > > > > > IMSG at NOAA/NWS/NCEP/EMC
> > >> > >> > >> > > > > > >
> > >> > >> > >> > > > > > > 5830 University Research Ct.
> > >> > >> > >> > > > > > >
> > >> > >> > >> > > > > > > College Park, MD 20740
> > >> > >> > >> > > > > > >
> > >> > >> > >> > > > > > > Binbin.Zhou at noaa.gov
> > >> > >> > >> > > > > > >
> > >> > >> > >> > > > > > > 301-683-3683
> > >> > >> > >> > > > > > >
> > >> > >> > >> > > > > >
> > >> > >> > >> > > > > >
> > >> > >> > >> > > > > > --
> > >> > >> > >> > > > > >
> > >> > >> > >> > > > > > Binbin Zhou
> > >> > >> > >> > > > > >
> > >> > >> > >> > > > > > IMSG at NOAA/NWS/NCEP/EMC
> > >> > >> > >> > > > > >
> > >> > >> > >> > > > > > 5830 University Research Ct.
> > >> > >> > >> > > > > >
> > >> > >> > >> > > > > > College Park, MD 20740
> > >> > >> > >> > > > > >
> > >> > >> > >> > > > > > Binbin.Zhou at noaa.gov
> > >> > >> > >> > > > > >
> > >> > >> > >> > > > > > 301-683-3683
> > >> > >> > >> > > > > >
> > >> > >> > >> > > > > >
> > >> > >> > >> > > > >
> > >> > >> > >> > > > > --
> > >> > >> > >> > > > > George McCabe - Software Engineer III
> > >> > >> > >> > > > > National Center for Atmospheric Research
> > >> > >> > >> > > > > Research Applications Laboratory
> > >> > >> > >> > > > > 303-497-2768
> > >> > >> > >> > > > > ---
> > >> > >> > >> > > > > My working day may not be your working day.
Please
> do
> > >> not
> > >> > >> feel
> > >> > >> > >> > obliged
> > >> > >> > >> > > to
> > >> > >> > >> > > > > reply to this email outside of your normal
working
> > >> hours.
> > >> > >> > >> > > > >
> > >> > >> > >> > > > >
> > >> > >> > >> > > >
> > >> > >> > >> > > > --
> > >> > >> > >> > > >
> > >> > >> > >> > > > Binbin Zhou
> > >> > >> > >> > > >
> > >> > >> > >> > > > IMSG at NOAA/NWS/NCEP/EMC
> > >> > >> > >> > > >
> > >> > >> > >> > > > 5830 University Research Ct.
> > >> > >> > >> > > >
> > >> > >> > >> > > > College Park, MD 20740
> > >> > >> > >> > > >
> > >> > >> > >> > > > Binbin.Zhou at noaa.gov
> > >> > >> > >> > > >
> > >> > >> > >> > > > 301-683-3683
> > >> > >> > >> > > >
> > >> > >> > >> > > >
> > >> > >> > >> > >
> > >> > >> > >> > > --
> > >> > >> > >> > > George McCabe - Software Engineer III
> > >> > >> > >> > > National Center for Atmospheric Research
> > >> > >> > >> > > Research Applications Laboratory
> > >> > >> > >> > > 303-497-2768
> > >> > >> > >> > > ---
> > >> > >> > >> > > My working day may not be your working day.
Please do
> not
> > >> feel
> > >> > >> > >> obliged to
> > >> > >> > >> > > reply to this email outside of your normal
working
> hours.
> > >> > >> > >> > >
> > >> > >> > >> > >
> > >> > >> > >> >
> > >> > >> > >> > --
> > >> > >> > >> >
> > >> > >> > >> > Binbin Zhou
> > >> > >> > >> >
> > >> > >> > >> > IMSG at NOAA/NWS/NCEP/EMC
> > >> > >> > >> >
> > >> > >> > >> > 5830 University Research Ct.
> > >> > >> > >> >
> > >> > >> > >> > College Park, MD 20740
> > >> > >> > >> >
> > >> > >> > >> > Binbin.Zhou at noaa.gov
> > >> > >> > >> >
> > >> > >> > >> > 301-683-3683
> > >> > >> > >> >
> > >> > >> > >> >
> > >> > >> > >>
> > >> > >> > >> --
> > >> > >> > >> Julie Prestopnik (she/her)
> > >> > >> > >> Software Engineer
> > >> > >> > >> National Center for Atmospheric Research
> > >> > >> > >> Research Applications Laboratory
> > >> > >> > >> Email: jpresto at ucar.edu
> > >> > >> > >>
> > >> > >> > >> My working day may not be your working day. Please
do not
> > feel
> > >> > >> obliged
> > >> > >> > to
> > >> > >> > >> reply to this email outside of your normal working
hours.
> > >> > >> > >>
> > >> > >> > >>
> > >> > >> > >
> > >> > >> > > --
> > >> > >> > >
> > >> > >> > > Binbin Zhou
> > >> > >> > >
> > >> > >> > > IMSG at NOAA/NWS/NCEP/EMC
> > >> > >> > >
> > >> > >> > > 5830 University Research Ct.
> > >> > >> > >
> > >> > >> > > College Park, MD 20740
> > >> > >> > >
> > >> > >> > > Binbin.Zhou at noaa.gov
> > >> > >> > >
> > >> > >> > > 301-683-3683
> > >> > >> > >
> > >> > >> >
> > >> > >> >
> > >> > >> > --
> > >> > >> >
> > >> > >> > Binbin Zhou
> > >> > >> >
> > >> > >> > IMSG at NOAA/NWS/NCEP/EMC
> > >> > >> >
> > >> > >> > 5830 University Research Ct.
> > >> > >> >
> > >> > >> > College Park, MD 20740
> > >> > >> >
> > >> > >> > Binbin.Zhou at noaa.gov
> > >> > >> >
> > >> > >> > 301-683-3683
> > >> > >> >
> > >> > >> >
> > >> > >>
> > >> > >> --
> > >> > >> Julie Prestopnik (she/her)
> > >> > >> Software Engineer
> > >> > >> National Center for Atmospheric Research
> > >> > >> Research Applications Laboratory
> > >> > >> Email: jpresto at ucar.edu
> > >> > >>
> > >> > >> My working day may not be your working day. Please do not
feel
> > >> obliged
> > >> > to
> > >> > >> reply to this email outside of your normal working hours.
> > >> > >>
> > >> > >>
> > >> > >
> > >> > > --
> > >> > > George McCabe - Software Engineer III
> > >> > > National Center for Atmospheric Research
> > >> > > Research Applications Laboratory
> > >> > > 303-497-2768
> > >> > > ---
> > >> > > My working day may not be your working day. Please do not
feel
> > >> obliged to
> > >> > > reply to this email outside of your normal working hours.
> > >> > >
> > >> >
> > >> >
> > >> > --
> > >> >
> > >> > Binbin Zhou
> > >> >
> > >> > IMSG at NOAA/NWS/NCEP/EMC
> > >> >
> > >> > 5830 University Research Ct.
> > >> >
> > >> > College Park, MD 20740
> > >> >
> > >> > Binbin.Zhou at noaa.gov
> > >> >
> > >> > 301-683-3683
> > >> >
> > >> >
> > >>
> > >> --
> > >> George McCabe - Software Engineer III
> > >> National Center for Atmospheric Research
> > >> Research Applications Laboratory
> > >> 303-497-2768
> > >> ---
> > >> My working day may not be your working day. Please do not feel
obliged
> > to
> > >> reply to this email outside of your normal working hours.
> > >>
> > >>
> > >
> > > --
> > >
> > > Binbin Zhou
> > >
> > > IMSG at NOAA/NWS/NCEP/EMC
> > >
> > > 5830 University Research Ct.
> > >
> > > College Park, MD 20740
> > >
> > > Binbin.Zhou at noaa.gov
> > >
> > > 301-683-3683
> > >
> >
> >
> > --
> >
> > Binbin Zhou
> >
> > IMSG at NOAA/NWS/NCEP/EMC
> >
> > 5830 University Research Ct.
> >
> > College Park, MD 20740
> >
> > Binbin.Zhou at noaa.gov
> >
> > 301-683-3683
> >
> >
>
> --
> George McCabe - Software Engineer III
> National Center for Atmospheric Research
> Research Applications Laboratory
> 303-497-2768
> ---
> My working day may not be your working day. Please do not feel
obliged to
> reply to this email outside of your normal working hours.
>
>
--
Binbin Zhou
IMSG at NOAA/NWS/NCEP/EMC
5830 University Research Ct.
College Park, MD 20740
Binbin.Zhou at noaa.gov
301-683-3683
------------------------------------------------
Subject: CDP threshold setting in EnsembleStat conf
From: Binbin.Zhou at noaa.gov
Time: Thu Jan 07 07:19:22 2021
George,
With setting
day_interval = 31;
hour_interval = 12;
The error message became:
DEBUG 3: Skipping the 19590104_000000 "HGT/P500" climatology field
since
the time offset (43200 seconds) >= the "hour_interval" entry (43200
seconds) from file:
/gpfs/dell2/emc/modeling/noscrub/Binbin.Zhou/g2g/com/verf/dev/ens.20210104/clim.grid3.stdv.010400.grib2
This error seems strange. So I changed the setting
day_interval = 31;
hour_interval = 18;
This time, the run is successful! This means the time_offset must
smaller than the hour_interval. SO I used a large number 18.
I'll do more test to see if the run is stable.
Thanks!
Binbin
On Wed, Jan 6, 2021 at 5:08 PM George McCabe via RT
<met_help at ucar.edu>
wrote:
> Hi Binbin,
>
> match_day and time_step are no longer used, so they should be
removed. You
> should replace them with:
>
> day_interval = 31;
> hour_interval = 12;
>
> 31 is the default for day interval. The default for hour_interval is
6, but
> we want it to be 12 so it finds your climo files.
>
> - George
>
> On Wed, Jan 6, 2021 at 2:39 PM Binbin.Zhou at noaa.gov via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116 >
> >
> > George,
> >
> > Even I deleted time_step in the climo_mean entry, this error
is still
> > there.
> > So I think climo_mean=fcst should be removed and define climo_mean
part
> > separately.
> > But how to define the fields (name, level) in climo_mean in
METplus conf
> > file?
> > Maybe hard copy the fields for climo_mean in EnsembleGrid config
file?
> >
> > Binbin
> >
> > On Wed, Jan 6, 2021 at 4:18 PM Binbin Zhou - NOAA Affiliate <
> > binbin.zhou at noaa.gov> wrote:
> >
> > > George,
> > >
> > > Rerun has same error
> > > Skipping the 19590104_000000 "HGT/P500" climatology field since
the
> time
> > > offset (43200 seconds) >= the "hour_interval" entry (21600
seconds)
> from
> > > file:
> > >
> >
>
/gpfs/dell2/emc/modeling/noscrub/Binbin.Zhou/g2g/com/verf/dev/ens.20210104/clim.grid3.mean.010400.grib2
> > >
> > > The new setting for climo in EnemsbleGrid config file is
> > > climo_mean = fcst;
> > > climo_mean = {
> > > file_name = [ ${CLIMO_MEAN_FILE} ];
> > > time_interp_method = DW_MEAN;
> > > match_day = FALSE;
> > > time_step = 43200;
> > > }
> > > climo_stdev = climo_mean;
> > > climo_stdev = {
> > > file_name = [ ${CLIMO_STDEV_FILE} ];
> > > }
> > >
> > > climo_cdf = {
> > > cdf_bins = 11;
> > > center_bins = TRUE;
> > > write_bins = TRUE;
> > > }
> > >
> > > It seems time_step is not effective?
> > >
> > > Binbin
> > >
> > > On Wed, Jan 6, 2021 at 3:15 PM George McCabe via RT
<met_help at ucar.edu
> >
> > > wrote:
> > >
> > >> Hi Binbin,
> > >>
> > >> Thanks for sending the updated logs. It looks like your
climatology
> > fields
> > >> are not being read properly. I think this line explains the
problem:
> > >>
> > >> DEBUG 3: Skipping the 19590104_000000 "HGT/P500" climatology
field
> since
> > >> the time offset (43200 seconds) >= the "hour_interval" entry
(21600
> > >> seconds) from file:
> > >>
> > >>
> >
>
/gpfs/dell2/emc/modeling/noscrub/Binbin.Zhou/g2g/com/verf/dev/ens.20210104/clim.grid3.stdv.010400.grib2
> > >>
> > >> The variables match_day and time_step in your climo_mean
dictionary
> are
> > >> actually no longer used and have been replaced with:
> > >>
> > >> day_interval = 31;
> > >> hour_interval = 6;
> > >>
> > >> 21600 seconds is 6 hours and it sounds like your climo field is
offset
> > by
> > >> 12 hours. I believe setting hour_interval to 12 should allow it
to
> find
> > >> the
> > >> climatology field and compute the statistics properly. Let me
know if
> it
> > >> does not.
> > >>
> > >> Thanks,
> > >> George
> > >>
> > >> On Wed, Jan 6, 2021 at 12:43 PM Binbin.Zhou at noaa.gov via RT <
> > >> met_help at ucar.edu> wrote:
> > >>
> > >> >
> > >> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
>
> > >> >
> > >> > George,
> > >> >
> > >> > I have re-run the case with LOG_LEVEL=DEBUG and
> > >> > LOG_ENSEMBLE_STAT_VERBOSITY =3.
> > >> > The output log file has been sent to hera:
> > >> >
> > >> >
> > >>
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Binbin.Zhou/metplus_test/metplus3.out/log/master_metplus.log.20210106193455
> > >> >
> > >> > Please look at it.
> > >> >
> > >> > Thanks!
> > >> >
> > >> > Biinbin
> > >> >
> > >> > On Wed, Jan 6, 2021 at 2:19 PM George McCabe
<mccabe at ucar.edu>
> wrote:
> > >> >
> > >> > > Hi Binbin,
> > >> > >
> > >> > > Thanks for putting those files on hera. The log output you
sent
> > >> doesn't
> > >> > > have the DEBUG level output (LOG_LEVEL=DEBUG). However, I
tried to
> > run
> > >> > > EnsembleStat locally using the _OPTIONS value you set and
it seems
> > to
> > >> run
> > >> > > fine. The error seems to suggest that something went wrong
when
> > >> computing
> > >> > > the mean and standard deviation before the obs_thresh
values are
> > >> > applied. I
> > >> > > have reached out to John HG to see if he has any insight as
to why
> > >> that
> > >> > is
> > >> > > happening. In the meantime, you could rerun with
> > >> > > LOG_ENSEMBLE_STAT_VERBOSITY set to a higher value than 2
to see
> if
> > >> the
> > >> > > extra log output from the MET tool gives you any more
insight as
> to
> > >> what
> > >> > is
> > >> > > going wrong.
> > >> > >
> > >> > > - George
> > >> > >
> > >> > > On Wed, Jan 6, 2021 at 9:51 AM Julie Prestopnik via RT <
> > >> > met_help at ucar.edu>
> > >> > > wrote:
> > >> > >
> > >> > >> Thanks for all of the info Binbin. I saw that you had
copied
> > >> everything
> > >> > >> to
> > >> > >> hera for George. I am currently no longer on WCOSS, so I
unless
> > >> George
> > >> > >> lets me know that he needs something from WCOSS, I'll
assume he
> is
> > >> able
> > >> > to
> > >> > >> get it from hera.
> > >> > >>
> > >> > >> Julie
> > >> > >>
> > >> > >> On Wed, Jan 6, 2021 at 9:39 AM Binbin.Zhou at noaa.gov via RT
<
> > >> > >> met_help at ucar.edu> wrote:
> > >> > >>
> > >> > >> >
> > >> > >> > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
> >
> > >> > >> >
> > >> > >> > The EnsembleStat config file for the successful run
outside of
> > >> METplus
> > >> > >> is
> > >> > >> >
> > >> > >> >
> > >> > >>
> > >> >
> > >>
> >
>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_met_global_ens1p0.v1.0.0/parm/verf_g2g_ens_stat_config_bin11
> > >> > >> > on WCOSS
> > >> > >> >
> > >> > >> > Binbin
> > >> > >> >
> > >> > >> > On Wed, Jan 6, 2021 at 11:34 AM Binbin Zhou - NOAA
Affiliate <
> > >> > >> > binbin.zhou at noaa.gov> wrote:
> > >> > >> >
> > >> > >> > > Julie,
> > >> > >> > >
> > >> > >> > > The output directory on WCOSS is
> > >> > >> > >
> > >> > >> > >
> > >> > >> >
> > >> > >>
> > >> >
> > >>
> >
>
/gpfs/dell1/ptmp/Binbin.Zhou/g2g/RFC2/tmpnwprd/verf_g2g_gefs_00_dev.161076/metplus3.out
> > >> > >> > >
> > >> > >> > > My METplus package on WCOSS is
> > >> > >> > >
> > >> > >> >
> > >> > >>
> > >> >
> > >>
> >
>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_g2g.v4.0.0
> > >> > >> > >
> > >> > >> > > For GEFS, the EnsembleGrid config file is
> > >> > >> > >
> > >> > >> > >
> > >> > >> >
> > >> > >>
> > >> >
> > >>
> >
>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_g2g.v4.0.0/parm/app_conf/grid2grid/met_config/EnsembleStatConfig_gefs_bin11
> > >> > >> > > Its conf file
> > >> > >> > > is
> > >> > >> >
> > >> > >>
> > >> >
> > >>
> >
>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_g2g.v4.0.0/parm/app_conf/grid2grid/gefs_conf/gefs_bin11.conf
> > >> > >> > >
> > >> > >> > > The running process is little bit complex since this
is a
> > >> transition
> > >> > >> to
> > >> > >> > > future operational package that uses
> > >> > >> > > mpi parallel: the script is
> > >> > >> > >
> > >> > >> > >
> > >> > >> >
> > >> > >>
> > >> >
> > >>
> >
>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_g2g.v4.0.0/ush/verf_g2g_metplus_run_gefs_mpi.sh
> > >> > >> > >
> > >> > >> > > Binbin
> > >> > >> > >
> > >> > >> > >
> > >> > >> > >
> > >> > >> > >
> > >> > >> > > On Wed, Jan 6, 2021 at 11:00 AM Julie Prestopnik via
RT <
> > >> > >> > met_help at ucar.edu>
> > >> > >> > > wrote:
> > >> > >> > >
> > >> > >> > >> Hi Binbin.
> > >> > >> > >>
> > >> > >> > >> This is Julie. I haven't been following this entire
thread,
> > >> but I
> > >> > >> am on
> > >> > >> > >> WCOSS right now. If you send a path to a file, I can
pull
> it
> > >> and
> > >> > >> put it
> > >> > >> > >> on
> > >> > >> > >> our ftp server for George.
> > >> > >> > >>
> > >> > >> > >> Julie
> > >> > >> > >>
> > >> > >> > >> On Wed, Jan 6, 2021 at 8:57 AM Binbin.Zhou at noaa.gov
via RT
> <
> > >> > >> > >> met_help at ucar.edu> wrote:
> > >> > >> > >>
> > >> > >> > >> >
> > >> > >> > >> > <URL:
> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
> > >> >
> > >> > >> > >> >
> > >> > >> > >> > George,
> > >> > >> > >> >
> > >> > >> > >> > Can you access WCOSS or access HERA?
> > >> > >> > >> > Otherwise I will email attached to you
> > >> > >> > >> >
> > >> > >> > >> > Binbin
> > >> > >> > >> >
> > >> > >> > >> >
> > >> > >> > >> >
> > >> > >> > >> > On Wed, Jan 6, 2021 at 10:46 AM George McCabe via
RT <
> > >> > >> > met_help at ucar.edu
> > >> > >> > >> >
> > >> > >> > >> > wrote:
> > >> > >> > >> >
> > >> > >> > >> > > Hi Binbin,
> > >> > >> > >> > >
> > >> > >> > >> > > Could you send me a log file for a run with
> > LOG_LEVEL=DEBUG
> > >> (in
> > >> > >> > >> METplus
> > >> > >> > >> > > config) so I can see how the environment variable
> > ENS_FIELD
> > >> is
> > >> > >> set?
> > >> > >> > >> The
> > >> > >> > >> > > values of ENS_VAR<n>_* are formatted and set in
this
> > >> > environment
> > >> > >> > >> variable
> > >> > >> > >> > > which is passed into the MET config. You can
compare
> that
> > >> value
> > >> > >> with
> > >> > >> > >> what
> > >> > >> > >> > > you used in your successful run outside of the
METplus
> > >> wrapper
> > >> > to
> > >> > >> > >> > determine
> > >> > >> > >> > > what is different.
> > >> > >> > >> > >
> > >> > >> > >> > > Thanks,
> > >> > >> > >> > > George
> > >> > >> > >> > >
> > >> > >> > >> > > On Wed, Jan 6, 2021 at 7:11 AM
Binbin.Zhou at noaa.gov via
> > RT
> > >> <
> > >> > >> > >> > > met_help at ucar.edu> wrote:
> > >> > >> > >> > >
> > >> > >> > >> > > >
> > >> > >> > >> > > > <URL:
> > >> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
> > >> > >> >
> > >> > >> > >> > > >
> > >> > >> > >> > > > George,
> > >> > >> > >> > > >
> > >> > >> > >> > > > I got a new error in execution although some
output
> > >> files
> > >> > (nc
> > >> > >> > >> file)
> > >> > >> > >> > are
> > >> > >> > >> > > > created but stat files not.
> > >> > >> > >> > > > The error message is
> > >> > >> > >> > > >
> > >> > >> > >> > > > ERROR :
> > >> > >> > >> > > > ERROR : Simple_Node::check(double, double,
double)
> > const
> > >> ->
> > >> > >> > >> > > climatological
> > >> > >> > >> > > > distribution percentile threshold "<=CDP10"
requested
> > with
> > >> > >> invalid
> > >> > >> > >> mean
> > >> > >> > >> > > > (-9999) or standard deviation (-9999).
> > >> > >> > >> > > > ERROR :
> > >> > >> > >> > > >
> > >> > >> > >> > > > Such an error was ever investigated by John H
before
> > (year
> > >> > >> ago):
> > >> > >> > >> When I
> > >> > >> > >> > > > directly ran ensemble_stat for global ensemble
(not
> > >> > >> METplus-based,
> > >> > >> > >> > > > but hard code of all settings in EnsembleStat
config
> > >> file):
> > >> > If
> > >> > >> > hard
> > >> > >> > >> > code
> > >> > >> > >> > > > fcst field in EnsembleStat config file like
this
> > >> > >> > >> > > >
> > >> > >> > >> > > > name = "HGT";
> > >> > >> > >> > > > level = "P500";
> > >> > >> > >> > > > cat_thresh = [ <=CDP10,
>CDP10&&<=CDP20,
> > >> > >> >CDP20&&<=CDP30,
> > >> > >> > >> > > > >CDP30&&<=CDP40, >CDP40&&<=CDP50,
>CDP50&&<=CDP60,
> > >> > >> > >CDP60&&<=CDP70,
> > >> > >> > >> > > > >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];
> > >> > >> > >> > > >
> > >> > >> > >> > > > Run ensemble_stat will have such error: ERROR
:
> > >> > >> > >> > > > Simple_Node::check(double, double, double)
const ->
> > >> > >> climatological
> > >> > >> > >> > > > distribution percentile threshold "<=CDP10"
requested
> > with
> > >> > >> invalid
> > >> > >> > >> mean
> > >> > >> > >> > > > (-9999) or standard deviation (-9999).
> > >> > >> > >> > > >
> > >> > >> > >> > > > John H. suggested me change "cat_thresh = " to
> > >> "obs_thresh =
> > >> > >> ",
> > >> > >> > >> then
> > >> > >> > >> > > the
> > >> > >> > >> > > > error was solved.
> > >> > >> > >> > > >
> > >> > >> > >> > > > In current METplus version, following your
suggestion
> as
> > >> > >> > >> > > >
> > >> > >> > >> > > > ENS_VAR1_OPTIONS = obs_thresh = [ <=CDP10,
> > >> >CDP10&&<=CDP20,
> > >> > >> > >> > > > >CDP20&&<=CDP30, >CDP30&&<=CDP40,
>CDP40&&<=CDP50,
> > >> > >> > >CDP50&&<=CDP60,
> > >> > >> > >> > > > >CDP60&&<=CDP70, >CDP70&&<=CDP80,
>CDP80&&<=CDP90,
> > >CDP90
> > >> ];
> > >> > >> > >> > > >
> > >> > >> > >> > > > the same error appears again. So I am not for
sure
> if
> > >> the
> > >> > >> > >> > "obs_thresh"
> > >> > >> > >> > > > setting is correctly passed.
> > >> > >> > >> > > >
> > >> > >> > >> > > > Binbin
> > >> > >> > >> > > >
> > >> > >> > >> > > >
> > >> > >> > >> > > >
> > >> > >> > >> > > >
> > >> > >> > >> > > > On Tue, Jan 5, 2021 at 5:19 PM George McCabe
via RT <
> > >> > >> > >> met_help at ucar.edu
> > >> > >> > >> > >
> > >> > >> > >> > > > wrote:
> > >> > >> > >> > > >
> > >> > >> > >> > > > > Hi Binbin,
> > >> > >> > >> > > > >
> > >> > >> > >> > > > > Your solution should work for now. It looks
like
> > >> although
> > >> > the
> > >> > >> > >> METplus
> > >> > >> > >> > > > > variable does get read properly, the
environment
> > >> variable
> > >> > is
> > >> > >> not
> > >> > >> > >> > > actually
> > >> > >> > >> > > > > set by the EnsembleStat wrapper. I can make a
note
> to
> > >> add
> > >> > >> that
> > >> > >> > for
> > >> > >> > >> > > 4.0.0,
> > >> > >> > >> > > > > as it is an easy fix.
> > >> > >> > >> > > > >
> > >> > >> > >> > > > > - George
> > >> > >> > >> > > > >
> > >> > >> > >> > > > > On Tue, Jan 5, 2021 at 2:53 PM
Binbin.Zhou at noaa.gov
> > via
> > >> > RT <
> > >> > >> > >> > > > > met_help at ucar.edu> wrote:
> > >> > >> > >> > > > >
> > >> > >> > >> > > > > > George,
> > >> > >> > >> > > > > >
> > >> > >> > >> > > > > > I have a temporal solution:
> > >> > >> > >> > > > > > set ploy in EnembleStat config as
> > >> > >> > >> > > > > > poly = [ "${MASKPATH}/lat_NHM.nc",
> > >> > >> > >> > > > > > "${MASKPATH}/lat_NHM.nc",
> > >> > >> > >> > > > > > "${MASKPATH}/lat_TRP.nc" ];
> > >> > >> > >> > > > > >
> > >> > >> > >> > > > > > then set MASKPATH in user_env_vars part in
the
> conf
> > >> file
> > >> > >> > >> > > > > > This MASKPAH then can be passed to
EnsembleStat's
> > >> poly [
> > >> > ]
> > >> > >> > entry
> > >> > >> > >> > > > > >
> > >> > >> > >> > > > > > Binbin
> > >> > >> > >> > > > > >
> > >> > >> > >> > > > > > On Tue, Jan 5, 2021 at 4:25 PM Binbin Zhou
- NOAA
> > >> > >> Affiliate <
> > >> > >> > >> > > > > > binbin.zhou at noaa.gov> wrote:
> > >> > >> > >> > > > > >
> > >> > >> > >> > > > > > > George,
> > >> > >> > >> > > > > > >
> > >> > >> > >> > > > > > > Still not working, error says
> > >> > >> > >> > > > > > > ERROR : replace_env() -> unable to get
value
> for
> > >> > >> > environment
> > >> > >> > >> > > > variable
> > >> > >> > >> > > > > > > "VERIF_MASK"
> > >> > >> > >> > > > > > >
> > >> > >> > >> > > > > > > Binbin
> > >> > >> > >> > > > > > >
> > >> > >> > >> > > > > > >
> > >> > >> > >> > > > > > >
> > >> > >> > >> > > > > > > On Tue, Jan 5, 2021 at 3:50 PM George
McCabe via
> > RT
> > >> <
> > >> > >> > >> > > > met_help at ucar.edu
> > >> > >> > >> > > > > >
> > >> > >> > >> > > > > > > wrote:
> > >> > >> > >> > > > > > >
> > >> > >> > >> > > > > > >> Hi Binbin,
> > >> > >> > >> > > > > > >>
> > >> > >> > >> > > > > > >> You should be able to set it in the
METplus
> > config
> > >> the
> > >> > >> same
> > >> > >> > >> way
> > >> > >> > >> > it
> > >> > >> > >> > > > is
> > >> > >> > >> > > > > > done
> > >> > >> > >> > > > > > >> for GridStat -- no quotes with commas
between
> > each
> > >> > item.
> > >> > >> > The
> > >> > >> > >> > > wrapper
> > >> > >> > >> > > > > > >> should
> > >> > >> > >> > > > > > >> format it properly.
> > >> > >> > >> > > > > > >>
> > >> > >> > >> > > > > > >> Here is an example from an existing use
case:
> > >> > >> > >> > > > > > >>
> > >> > >> > >> > > > > > >> GRID_STAT_VERIFICATION_MASK_TEMPLATE =
> > >> > >> > >> > > > > > >>
> > >> > >> > >> > >
> > >> > >>
> >
{INPUT_BASE}/model_applications/precipitation/mask/CONUS_HRRRTLE.nc,
> > >> > >> > >> > > > > > >>
> > >> > >> > >> > >
> > >> > >>
> {INPUT_BASE}/model_applications/precipitation/mask/EAST_HRRRTLE.nc,
> > >> > >> > >> > > > > > >>
> > >> > >> > >> >
> > >> >
{INPUT_BASE}/model_applications/precipitation/mask/WEST_HRRRTLE.nc
> > >> > >> > >> > > > > > >>
> > >> > >> > >> > > > > > >> You should be able to set them the same
way
> using
> > >> > >> > >> > > > > > >>
ENSEMBLE_STAT_VERIFICATION_MASK_TEMPLATE. Let
> me
> > >> know
> > >> > if
> > >> > >> > that
> > >> > >> > >> > > > doesn't
> > >> > >> > >> > > > > > >> work.
> > >> > >> > >> > > > > > >>
> > >> > >> > >> > > > > > >> - George
> > >> > >> > >> > > > > > >>
> > >> > >> > >> > > > > > >> On Tue, Jan 5, 2021 at 1:45 PM
> > >> Binbin.Zhou at noaa.gov
> > >> > via
> > >> > >> > RT <
> > >> > >> > >> > > > > > >> met_help at ucar.edu> wrote:
> > >> > >> > >> > > > > > >>
> > >> > >> > >> > > > > > >> >
> > >> > >> > >> > > > > > >> > <URL:
> > >> > >> > >>
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
> > >> > >> > >> > >
> > >> > >> > >> > > > > > >> >
> > >> > >> > >> > > > > > >> > George,
> > >> > >> > >> > > > > > >> >
> > >> > >> > >> > > > > > >> > I got another issue for verification
mask
> > >> setting.
> > >> > >> > >> > > > > > >> >
> > >> > >> > >> > > > > > >> > I am using $VERIF_MASK in EnsembleStat
config
> > >> f/ile
> > >> > >> > >> > > > > > >> > mask = {
> > >> > >> > >> > > > > > >> > grid = [];
> > >> > >> > >> > > > > > >> > poly = [${VERIF_MASK}];
> > >> > >> > >> > > > > > >> > sid = [];
> > >> > >> > >> > > > > > >> > }
> > >> > >> > >> > > > > > >> >
> > >> > >> > >> > > > > > >> > And using
> GRID_STAT_VERIFICATION_MASK_TEMPLATE
> > >> to
> > >> > >> define
> > >> > >> > >> > > several
> > >> > >> > >> > > > > > >> polygon
> > >> > >> > >> > > > > > >> > nc mask files
> > >> > >> > >> > > > > > >> > But it seems not working. But it works
for
> > >> Gridstat
> > >> > >> > config
> > >> > >> > >> in
> > >> > >> > >> > > > suich
> > >> > >> > >> > > > > > >> > setting.
> > >> > >> > >> > > > > > >> > I can not find ENSEMBLE_STAT_
> > >> > >> VERIFICATION_MASK_TEMPLATE
> > >> > >> > in
> > >> > >> > >> > the
> > >> > >> > >> > > > > > METplus
> > >> > >> > >> > > > > > >> doc
> > >> > >> > >> > > > > > >> >
> > >> > >> > >> > > > > > >> > So I define VERIF_MASK in
[user_env_vars]
> part.
> > >> > >> > >> > > > > > >> > It values can not be passed to ploy =
> > >> > [${VERIF_MASK}]
> > >> > >> in
> > >> > >> > >> the
> > >> > >> > >> > > > > > >> EnsembleStat
> > >> > >> > >> > > > > > >> > conf if more than one nc files
included.
> > >> > >> > >> > > > > > >> > For example
> > >> > >> > >> > > > > > >> > VERIF_MASK=" '/part/p1.cn',
'/path/p2.nc' "
> > >> > >> > >> > > > > > >> > the error says poly = [/path/p1,]
> > >> > >> > >> > > > > > >> > It seems double quote or single quote
can not
> > be
> > >> > >> passed
> > >> > >> > to
> > >> > >> > >> > > > > VERIF_MASK
> > >> > >> > >> > > > > > in
> > >> > >> > >> > > > > > >> > the EnsembleStat config.
> > >> > >> > >> > > > > > >> > I tried use back slash \ to before
quote, but
> > >> still
> > >> > >> not
> > >> > >> > >> > working
> > >> > >> > >> > > > > > >> >
> > >> > >> > >> > > > > > >> > Binbin
> > >> > >> > >> > > > > > >> >
> > >> > >> > >> > > > > > >> >
> > >> > >> > >> > > > > > >> > On Tue, Jan 5, 2021 at 10:33 AM Binbin
Zhou -
> > >> NOAA
> > >> > >> > >> Affiliate <
> > >> > >> > >> > > > > > >> > binbin.zhou at noaa.gov> wrote:
> > >> > >> > >> > > > > > >> >
> > >> > >> > >> > > > > > >> > > George,
> > >> > >> > >> > > > > > >> > >
> > >> > >> > >> > > > > > >> > > Thanks for your quick response!
I'll
> test
> > >> this
> > >> > >> > >> settings
> > >> > >> > >> > and
> > >> > >> > >> > > > let
> > >> > >> > >> > > > > > >> > > you know the results.
> > >> > >> > >> > > > > > >> > >
> > >> > >> > >> > > > > > >> > > Binbin
> > >> > >> > >> > > > > > >> > >
> > >> > >> > >> > > > > > >> > > On Tue, Jan 5, 2021 at 10:17 AM
George
> McCabe
> > >> via
> > >> > >> RT <
> > >> > >> > >> > > > > > >> met_help at ucar.edu>
> > >> > >> > >> > > > > > >> > > wrote:
> > >> > >> > >> > > > > > >> > >
> > >> > >> > >> > > > > > >> > >> Hi Binbin,
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >> Happy New Year to you too!
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >> I will comment on each
configuration
> > variable
> > >> and
> > >> > >> how
> > >> > >> > to
> > >> > >> > >> > set
> > >> > >> > >> > > it
> > >> > >> > >> > > > > in
> > >> > >> > >> > > > > > a
> > >> > >> > >> > > > > > >> > >> METplus config inline:
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >> ens = {
> > >> > >> > >> > > > > > >> > >> ens_thresh = 1.0;
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >> *This is controlled by the
> > >> > ENSEMBLE_STAT_ENS_THRESH
> > >> > >> > >> > variable.
> > >> > >> > >> > > > The
> > >> > >> > >> > > > > > >> > default
> > >> > >> > >> > > > > > >> > >> value is 1.0, so you don't need to
include
> > it
> > >> in
> > >> > >> your
> > >> > >> > >> > config
> > >> > >> > >> > > > > file,
> > >> > >> > >> > > > > > >> but
> > >> > >> > >> > > > > > >> > you
> > >> > >> > >> > > > > > >> > >> can if you may adjust this value at
some
> > >> point.*
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >> vld_thresh = 1.0;
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >> *This value is set to 1.0 by
default so we
> > >> don't
> > >> > >> need
> > >> > >> > to
> > >> > >> > >> > > worry
> > >> > >> > >> > > > > > about
> > >> > >> > >> > > > > > >> it
> > >> > >> > >> > > > > > >> > >> right now.*
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >> field = [
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >> {
> > >> > >> > >> > > > > > >> > >> name = "HGT";
> > >> > >> > >> > > > > > >> > >> level = "P500";
> > >> > >> > >> > > > > > >> > >> obs_thresh = [ <=CDP10,
> > >> >CDP10&&<=CDP20,
> > >> > >> > >> > > > > >CDP20&&<=CDP30,
> > >> > >> > >> > > > > > >> > >> >CDP30&&<=CDP40, >CDP40&&<=CDP50,
> > >> > >CDP50&&<=CDP60,
> > >> > >> > >> > > > > >CDP60&&<=CDP70,
> > >> > >> > >> > > > > > >> > >> >CDP70&&<=CDP80, >CDP80&&<=CDP90,
>CDP90
> ];
> > >> > >> > >> > > > > > >> > >> }
> > >> > >> > >> > > > > > >> > >> ]
> > >> > >> > >> > > > > > >> > >> }
> > >> > >> > >> > > > > > >> > >> fcst = ens;
> > >> > >> > >> > > > > > >> > >> obs = fcst;
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >> *1) The field info for ens is set
in the
> > >> > >> > >> > > > > > >> > >>
ENS_VAR<n>_[NAME/LEVEL/THRESH/OPTIONS]
> > >> variables.
> > >> > >> The
> > >> > >> > >> fcst
> > >> > >> > >> > > and
> > >> > >> > >> > > > > obs
> > >> > >> > >> > > > > > >> field
> > >> > >> > >> > > > > > >> > >> info are set in the corresponding
> > >> FCST_VAR<n>_*
> > >> > and
> > >> > >> > >> > > > OBS_VAR<n>_*
> > >> > >> > >> > > > > > >> > variables
> > >> > >> > >> > > > > > >> > >> respectively, or you can use
BOTH_VAR<n>_*
> > if
> > >> the
> > >> > >> FCST
> > >> > >> > >> and
> > >> > >> > >> > > OBS
> > >> > >> > >> > > > > > values
> > >> > >> > >> > > > > > >> > are
> > >> > >> > >> > > > > > >> > >> the same.*
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >> *If ENS_VAR<n>_* variables are not
> > explicitly
> > >> > set,
> > >> > >> > then
> > >> > >> > >> it
> > >> > >> > >> > > will
> > >> > >> > >> > > > > use
> > >> > >> > >> > > > > > >> the
> > >> > >> > >> > > > > > >> > >> values from FCST_VAR<n>_*.*
> > >> > >> > >> > > > > > >> > >> *Since the fcst, obs, and ens are
all the
> > same
> > >> > you
> > >> > >> > could
> > >> > >> > >> > just
> > >> > >> > >> > > > use
> > >> > >> > >> > > > > > >> > >> BOTH_VAR<n>_* variables to control
all 3,
> > >> > although
> > >> > >> > keep
> > >> > >> > >> in
> > >> > >> > >> > > mind
> > >> > >> > >> > > > > > that
> > >> > >> > >> > > > > > >> if
> > >> > >> > >> > > > > > >> > >> you
> > >> > >> > >> > > > > > >> > >> need to change one of them for any
reason,
> > it
> > >> > will
> > >> > >> be
> > >> > >> > >> more
> > >> > >> > >> > > > > > difficult
> > >> > >> > >> > > > > > >> to
> > >> > >> > >> > > > > > >> > do
> > >> > >> > >> > > > > > >> > >> this. If you know that they will
always be
> > the
> > >> > same
> > >> > >> > >> values,
> > >> > >> > >> > > > then
> > >> > >> > >> > > > > I
> > >> > >> > >> > > > > > >> > >> recommend using BOTH_, but if you
know
> they
> > >> may
> > >> > >> change
> > >> > >> > >> or
> > >> > >> > >> > are
> > >> > >> > >> > > > > > >> unsure, I
> > >> > >> > >> > > > > > >> > >> would recommend setting them by
> referencing
> > >> the
> > >> > >> other
> > >> > >> > >> > > > variables,
> > >> > >> > >> > > > > > >> i.e.*
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >> *FCST_VAR1_NAME = HGT*
> > >> > >> > >> > > > > > >> > >> *FCST_VAR1_LEVELS = P500 *
> > >> > >> > >> > > > > > >> > >> *OBS_VAR1_NAME = {FCST_VAR1_NAME}*
> > >> > >> > >> > > > > > >> > >> *OBS_VAR1_LEVELS =
{FCST_VAR1_LEVELS}*
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >> *2) The
[FCST/OBS/ENS]_VAR<n>_THRESH
> > variables
> > >> > set
> > >> > >> the
> > >> > >> > >> > > > cat_thresh
> > >> > >> > >> > > > > > >> values
> > >> > >> > >> > > > > > >> > >> in
> > >> > >> > >> > > > > > >> > >> the field info. A variable specific
to
> > >> obs_thresh
> > >> > >> is
> > >> > >> > not
> > >> > >> > >> > > > > currently
> > >> > >> > >> > > > > > >> > >> supported, however you can set
these
> values
> > by
> > >> > >> using
> > >> > >> > the
> > >> > >> > >> > > > > > >> > ENS_VAR1_OPTIONS
> > >> > >> > >> > > > > > >> > >> variable, i.e.*
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >> *ENS_VAR1_OPTIONS = obs_thresh = [
> <=CDP10,
> > >> > >> > >> > >CDP10&&<=CDP20,
> > >> > >> > >> > > > > > >> > >> >CDP20&&<=CDP30, >CDP30&&<=CDP40,
> > >> > >CDP40&&<=CDP50,
> > >> > >> > >> > > > > >CDP50&&<=CDP60,
> > >> > >> > >> > > > > > >> > >> >CDP60&&<=CDP70, >CDP70&&<=CDP80,
> > >> > >CDP80&&<=CDP90,
> > >> > >> > >> >CDP90
> > >> > >> > >> > ];*
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >> *Remember to include the semicolon
at the
> > >> end! *
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >> ens_ssvar_bin_size = 1000000;
> > >> > >> > >> > > > > > >> > >> *1) This variable is different from
the
> > >> default
> > >> > and
> > >> > >> > not
> > >> > >> > >> > > > currently
> > >> > >> > >> > > > > > >> > >> supported
> > >> > >> > >> > > > > > >> > >> with a METplus config variable. I
will add
> > >> this
> > >> > to
> > >> > >> the
> > >> > >> > >> list
> > >> > >> > >> > > of
> > >> > >> > >> > > > > > >> variables
> > >> > >> > >> > > > > > >> > >> in
> > >> > >> > >> > > > > > >> > >> MET config files that we want to
support.
> > >> > However,
> > >> > >> in
> > >> > >> > >> the
> > >> > >> > >> > > > > meantime
> > >> > >> > >> > > > > > >> you
> > >> > >> > >> > > > > > >> > can
> > >> > >> > >> > > > > > >> > >> copy the default wrapped MET config
file
> and
> > >> > >> modify it
> > >> > >> > >> to
> > >> > >> > >> > fit
> > >> > >> > >> > > > > your
> > >> > >> > >> > > > > > >> > needs.
> > >> > >> > >> > > > > > >> > >> To do this, you will need to:*
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >> * a) Copy
> > >> > >> > >> > METplus/parm/met_config/EnsembleStatConfig_wrapped
> > >> > >> > >> > > > to
> > >> > >> > >> > > > > > the
> > >> > >> > >> > > > > > >> > >> directory that contains your
METplus
> config
> > >> file
> > >> > >> for
> > >> > >> > >> this
> > >> > >> > >> > use
> > >> > >> > >> > > > > case.
> > >> > >> > >> > > > > > >> > Rename
> > >> > >> > >> > > > > > >> > >> it by replacing "wrapped" with a
short
> > >> > description
> > >> > >> > that
> > >> > >> > >> > > > pertains
> > >> > >> > >> > > > > to
> > >> > >> > >> > > > > > >> your
> > >> > >> > >> > > > > > >> > >> use case.*
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >> * b) In your METplus config file,
change
> > the
> > >> > >> value of
> > >> > >> > >> > > > > > >> > >> ENSEMBLE_STAT_CONFIG_FILE to point
to the
> > >> path of
> > >> > >> this
> > >> > >> > >> new
> > >> > >> > >> > > > config
> > >> > >> > >> > > > > > >> file.*
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >> * c) If you know the value you
want to
> use
> > >> for
> > >> > >> this
> > >> > >> > >> > variable
> > >> > >> > >> > > > > will
> > >> > >> > >> > > > > > >> > always
> > >> > >> > >> > > > > > >> > >> be 1000000, then simply set the
variable
> to
> > >> that
> > >> > >> > value.
> > >> > >> > >> If
> > >> > >> > >> > > you
> > >> > >> > >> > > > > > think
> > >> > >> > >> > > > > > >> you
> > >> > >> > >> > > > > > >> > >> may want to change the value, then
you can
> > >> > utilize
> > >> > >> the
> > >> > >> > >> > > > > > >> [user_env_vars]
> > >> > >> > >> > > > > > >> > >> functionality. See:
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> >
> > >> > >> > >> > > > > > >>
> > >> > >> > >> > > > > >
> > >> > >> > >> > > > >
> > >> > >> > >> > > >
> > >> > >> > >> > >
> > >> > >> > >> >
> > >> > >> > >>
> > >> > >> >
> > >> > >>
> > >> >
> > >>
> >
>
https://dtcenter.github.io/METplus/latest/Users_Guide/systemconfiguration.html#user-
defined-config
> > >> > >> > >> > > > > > >> > >> <
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> >
> > >> > >> > >> > > > > > >>
> > >> > >> > >> > > > > >
> > >> > >> > >> > > > >
> > >> > >> > >> > > >
> > >> > >> > >> > >
> > >> > >> > >> >
> > >> > >> > >>
> > >> > >> >
> > >> > >>
> > >> >
> > >>
> >
>
https://dtcenter.github.io/METplus/latest/Users_Guide/systemconfiguration.html#user-
defined-config
> > >> > >> > >> > > > > > >> > >> >*
> > >> > >> > >> > > > > > >> > >> *In this case, you would add the
following
> > to
> > >> > your
> > >> > >> > >> METplus
> > >> > >> > >> > > > > config:*
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >> *[user_env_vars]*
> > >> > >> > >> > > > > > >> > >> *ENS_SSVAR_BIN_SIZE = 1000000*
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >> *Then change the line in your
EnsembleStat
> > >> config
> > >> > >> file
> > >> > >> > >> that
> > >> > >> > >> > > you
> > >> > >> > >> > > > > > >> copied
> > >> > >> > >> > > > > > >> > >> to:*
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >> * ens_ssvar_bin_size =
> > ${ENS_SSVAR_BIN_SIZE};
> > >> *
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >> ens_phist_bin_size = 0.05;
> > >> > >> > >> > > > > > >> > >> *This variable uses the default
value, so
> > you
> > >> > don't
> > >> > >> > >> need to
> > >> > >> > >> > > do
> > >> > >> > >> > > > > > >> anything
> > >> > >> > >> > > > > > >> > >> here. If you need to make it
configurable
> or
> > >> > change
> > >> > >> > the
> > >> > >> > >> > > value,
> > >> > >> > >> > > > > then
> > >> > >> > >> > > > > > >> > follow
> > >> > >> > >> > > > > > >> > >> the instructions for setting
> > >> ens_ssvar_bin_size.*
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >> climo_mean = fcst;
> > >> > >> > >> > > > > > >> > >> climo_mean = {
> > >> > >> > >> > > > > > >> > >> file_name = "${CLIM_MEAN}";
> > >> > >> > >> > > > > > >> > >> time_interp_method = DW_MEAN;
> > >> > >> > >> > > > > > >> > >> match_day = TRUE;
> > >> > >> > >> > > > > > >> > >> time_step = 21600;
> > >> > >> > >> > > > > > >> > >> }
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >> *Instead of using CLIM_MEAN, you
can set
> > >> > >> > >> > > > > > >> > >>
> > ENSEMBLE_STAT_CLIMO_MEAN_INPUT_[DIR/TEMPLATE]
> > >> in
> > >> > >> the
> > >> > >> > >> > METplus
> > >> > >> > >> > > > > > config.
> > >> > >> > >> > > > > > >> You
> > >> > >> > >> > > > > > >> > >> can use filename template syntax in
the
> > >> _TEMPLATE
> > >> > >> > value,
> > >> > >> > >> > i.e.
> > >> > >> > >> > > > > > >> > >> {valid?fmt=%m%d}. The other
variables in
> the
> > >> > >> > climo_mean
> > >> > >> > >> > > > > dictionary
> > >> > >> > >> > > > > > >> are
> > >> > >> > >> > > > > > >> > >> actually old variables that have
been
> > replaced
> > >> > with
> > >> > >> > >> > > > day_interval
> > >> > >> > >> > > > > > and
> > >> > >> > >> > > > > > >> > >> hour_interval, but the values you
use are
> > the
> > >> old
> > >> > >> > >> defaults,
> > >> > >> > >> > > so
> > >> > >> > >> > > > > you
> > >> > >> > >> > > > > > >> > >> shouldn't need to set them.*
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >> climo_stdev = climo_mean;
> > >> > >> > >> > > > > > >> > >> climo_stdev = {
> > >> > >> > >> > > > > > >> > >> file_name = "${CLIM_STDV}";
> > >> > >> > >> > > > > > >> > >> }
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >> *Similarly to CLIM_MEAN, you can
use
> > >> > >> > >> > > > > > >> > >>
> > >> ENSEMBLE_STAT_CLIMO_STDEV_INPUT_[DIR/TEMPLATE] to
> > >> > >> set
> > >> > >> > >> this
> > >> > >> > >> > > file
> > >> > >> > >> > > > > > >> name.*
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >> climo_cdf = {
> > >> > >> > >> > > > > > >> > >> cdf_bins = 11;
> > >> > >> > >> > > > > > >> > >> center_bins = TRUE;
> > >> > >> > >> > > > > > >> > >> write_bins = TRUE;
> > >> > >> > >> > > > > > >> > >> }
> > >> > >> > >> > > > > > >> > >> *The value for write_bins is the
default,
> > but
> > >> the
> > >> > >> > values
> > >> > >> > >> > for
> > >> > >> > >> > > > > > cdf_bins
> > >> > >> > >> > > > > > >> > and
> > >> > >> > >> > > > > > >> > >> center_bins do not. To set these,
follow
> the
> > >> > above
> > >> > >> > >> > > instructions
> > >> > >> > >> > > > > for
> > >> > >> > >> > > > > > >> > >> ens_ssvar_bin_size to override them
and/or
> > >> make
> > >> > >> them
> > >> > >> > >> > > > configurable
> > >> > >> > >> > > > > > >> > through
> > >> > >> > >> > > > > > >> > >> METplus. I will also add these
variables
> to
> > >> the
> > >> > >> list
> > >> > >> > of
> > >> > >> > >> MET
> > >> > >> > >> > > > > configs
> > >> > >> > >> > > > > > >> that
> > >> > >> > >> > > > > > >> > >> users want to be able to easily
configure
> > >> through
> > >> > >> > >> METplus
> > >> > >> > >> > > > > configs.*
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >> Please let me know if you run into
any
> > issues
> > >> > >> setting
> > >> > >> > >> any
> > >> > >> > >> > of
> > >> > >> > >> > > > that
> > >> > >> > >> > > > > > up.
> > >> > >> > >> > > > > > >> > >> Also,
> > >> > >> > >> > > > > > >> > >> if there are any other MET config
> variables
> > >> that
> > >> > >> you
> > >> > >> > >> want
> > >> > >> > >> > to
> > >> > >> > >> > > > see
> > >> > >> > >> > > > > > >> > supported
> > >> > >> > >> > > > > > >> > >> in METplus, let me know and I will
make
> sure
> > >> they
> > >> > >> get
> > >> > >> > >> > > included
> > >> > >> > >> > > > > when
> > >> > >> > >> > > > > > >> we
> > >> > >> > >> > > > > > >> > >> have
> > >> > >> > >> > > > > > >> > >> a chance to refactor those
wrappers. It is
> > >> > >> possible to
> > >> > >> > >> add
> > >> > >> > >> > > > > support
> > >> > >> > >> > > > > > >> for
> > >> > >> > >> > > > > > >> > MET
> > >> > >> > >> > > > > > >> > >> configs using the above
instructions, but
> it
> > >> is
> > >> > >> always
> > >> > >> > >> > easier
> > >> > >> > >> > > > and
> > >> > >> > >> > > > > > >> less
> > >> > >> > >> > > > > > >> > >> error-prone to have them
configurable
> > directly
> > >> > >> > through a
> > >> > >> > >> > > > variable
> > >> > >> > >> > > > > > in
> > >> > >> > >> > > > > > >> the
> > >> > >> > >> > > > > > >> > >> METplus config.
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >> Thanks,
> > >> > >> > >> > > > > > >> > >> George
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >> On Tue, Jan 5, 2021 at 7:14 AM
> > >> > >> Binbin.Zhou at noaa.gov
> > >> > >> > via
> > >> > >> > >> > RT <
> > >> > >> > >> > > > > > >> > >> met_help at ucar.edu> wrote:
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >> >
> > >> > >> > >> > > > > > >> > >> > Tue Jan 05 07:14:54 2021: Request
98116
> > was
> > >> > acted
> > >> > >> > >> upon.
> > >> > >> > >> > > > > > >> > >> > Transaction: Ticket created by
> > >> > >> Binbin.Zhou at noaa.gov
> > >> > >> > >> > > > > > >> > >> > Queue: met_help
> > >> > >> > >> > > > > > >> > >> > Subject: CDP threshold
setting in
> > >> > >> EnsembleStat
> > >> > >> > >> conf
> > >> > >> > >> > > > > > >> > >> > Owner: Nobody
> > >> > >> > >> > > > > > >> > >> > Requestors:
Binbin.Zhou at noaa.gov
> > >> > >> > >> > > > > > >> > >> > Status: new
> > >> > >> > >> > > > > > >> > >> > Ticket <URL:
> > >> > >> > >> > > > > > >>
> > >> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
> > >> > >> > >> > > > > > >> > >
> > >> > >> > >> > > > > > >> > >> >
> > >> > >> > >> > > > > > >> > >> >
> > >> > >> > >> > > > > > >> > >> > George,
> > >> > >> > >> > > > > > >> > >> >
> > >> > >> > >> > > > > > >> > >> > Happy New Year!
> > >> > >> > >> > > > > > >> > >> >
> > >> > >> > >> > > > > > >> > >> > I am working on transition of
our
> > >> MET-based
> > >> > >> > global
> > >> > >> > >> > > > ensemble
> > >> > >> > >> > > > > > >> > >> verification
> > >> > >> > >> > > > > > >> > >> > to METplus based package. In this
> package
> > >> > >> > climatology
> > >> > >> > >> > bins
> > >> > >> > >> > > > (10
> > >> > >> > >> > > > > > >> bins)
> > >> > >> > >> > > > > > >> > are
> > >> > >> > >> > > > > > >> > >> > used.
> > >> > >> > >> > > > > > >> > >> > In current ensemble stat config
file,
> the
> > >> > >> relevant
> > >> > >> > >> > entries
> > >> > >> > >> > > > iare
> > >> > >> > >> > > > > > >> > defined
> > >> > >> > >> > > > > > >> > >> > like following
> > >> > >> > >> > > > > > >> > >> >
> > >> > >> > >> > > > > > >> > >> > ens = {
> > >> > >> > >> > > > > > >> > >> > ens_thresh = 1.0;
> > >> > >> > >> > > > > > >> > >> > vld_thresh = 1.0;
> > >> > >> > >> > > > > > >> > >> >
> > >> > >> > >> > > > > > >> > >> > field = [
> > >> > >> > >> > > > > > >> > >> >
> > >> > >> > >> > > > > > >> > >> > {
> > >> > >> > >> > > > > > >> > >> > name = "HGT";
> > >> > >> > >> > > > > > >> > >> > level = "P500";
> > >> > >> > >> > > > > > >> > >> > obs_thresh = [ <=CDP10,
> > >> > >CDP10&&<=CDP20,
> > >> > >> > >> > > > > > >CDP20&&<=CDP30,
> > >> > >> > >> > > > > > >> > >> > >CDP30&&<=CDP40, >CDP40&&<=CDP50,
> > >> > >> >CDP50&&<=CDP60,
> > >> > >> > >> > > > > > >CDP60&&<=CDP70,
> > >> > >> > >> > > > > > >> > >> > >CDP70&&<=CDP80, >CDP80&&<=CDP90,
>CDP90
> > ];
> > >> > >> > >> > > > > > >> > >> > }
> > >> > >> > >> > > > > > >> > >> > ]
> > >> > >> > >> > > > > > >> > >> > }
> > >> > >> > >> > > > > > >> > >> > fcst = ens;
> > >> > >> > >> > > > > > >> > >> > obs = fcst;
> > >> > >> > >> > > > > > >> > >> > ens_ssvar_bin_size = 1000000;
> > >> > >> > >> > > > > > >> > >> > ens_phist_bin_size = 0.05;
> > >> > >> > >> > > > > > >> > >> > climo_mean = fcst;
> > >> > >> > >> > > > > > >> > >> > climo_mean = {
> > >> > >> > >> > > > > > >> > >> > file_name = "${CLIM_MEAN}";
> > >> > >> > >> > > > > > >> > >> > time_interp_method = DW_MEAN;
> > >> > >> > >> > > > > > >> > >> > match_day = TRUE;
> > >> > >> > >> > > > > > >> > >> > time_step = 21600;
> > >> > >> > >> > > > > > >> > >> > }
> > >> > >> > >> > > > > > >> > >> >
> > >> > >> > >> > > > > > >> > >> > climo_stdev = climo_mean;
> > >> > >> > >> > > > > > >> > >> > climo_stdev = {
> > >> > >> > >> > > > > > >> > >> > file_name = "${CLIM_STDV}";
> > >> > >> > >> > > > > > >> > >> > }
> > >> > >> > >> > > > > > >> > >> >
> > >> > >> > >> > > > > > >> > >> > climo_cdf = {
> > >> > >> > >> > > > > > >> > >> > cdf_bins = 11;
> > >> > >> > >> > > > > > >> > >> > center_bins = TRUE;
> > >> > >> > >> > > > > > >> > >> > write_bins = TRUE;
> > >> > >> > >> > > > > > >> > >> > }
> > >> > >> > >> > > > > > >> > >> >
> > >> > >> > >> > > > > > >> > >> > I can not find the correspondent
> settings
> > in
> > >> > its
> > >> > >> > conf
> > >> > >> > >> > file
> > >> > >> > >> > > > from
> > >> > >> > >> > > > > > >> > METplus
> > >> > >> > >> > > > > > >> > >> > online doc.
> > >> > >> > >> > > > > > >> > >> > Can you help me look at this?
> > >> > >> > >> > > > > > >> > >> >
> > >> > >> > >> > > > > > >> > >> > Thanks!
> > >> > >> > >> > > > > > >> > >> >
> > >> > >> > >> > > > > > >> > >> > Binbin
> > >> > >> > >> > > > > > >> > >> >
> > >> > >> > >> > > > > > >> > >> > --
> > >> > >> > >> > > > > > >> > >> >
> > >> > >> > >> > > > > > >> > >> > Binbin Zhou
> > >> > >> > >> > > > > > >> > >> >
> > >> > >> > >> > > > > > >> > >> > IMSG at NOAA/NWS/NCEP/EMC
> > >> > >> > >> > > > > > >> > >> >
> > >> > >> > >> > > > > > >> > >> > 5830 University Research Ct.
> > >> > >> > >> > > > > > >> > >> >
> > >> > >> > >> > > > > > >> > >> > College Park, MD 20740
> > >> > >> > >> > > > > > >> > >> >
> > >> > >> > >> > > > > > >> > >> > Binbin.Zhou at noaa.gov
> > >> > >> > >> > > > > > >> > >> >
> > >> > >> > >> > > > > > >> > >> > 301-683-3683
> > >> > >> > >> > > > > > >> > >> >
> > >> > >> > >> > > > > > >> > >> >
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >> --
> > >> > >> > >> > > > > > >> > >> George McCabe - Software Engineer
III
> > >> > >> > >> > > > > > >> > >> National Center for Atmospheric
Research
> > >> > >> > >> > > > > > >> > >> Research Applications Laboratory
> > >> > >> > >> > > > > > >> > >> 303-497-2768
> > >> > >> > >> > > > > > >> > >> ---
> > >> > >> > >> > > > > > >> > >> My working day may not be your
working
> day.
> > >> > Please
> > >> > >> do
> > >> > >> > >> not
> > >> > >> > >> > > feel
> > >> > >> > >> > > > > > >> obliged
> > >> > >> > >> > > > > > >> > to
> > >> > >> > >> > > > > > >> > >> reply to this email outside of your
normal
> > >> > working
> > >> > >> > >> hours.
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >>
> > >> > >> > >> > > > > > >> > >
> > >> > >> > >> > > > > > >> > > --
> > >> > >> > >> > > > > > >> > >
> > >> > >> > >> > > > > > >> > > Binbin Zhou
> > >> > >> > >> > > > > > >> > >
> > >> > >> > >> > > > > > >> > > IMSG at NOAA/NWS/NCEP/EMC
> > >> > >> > >> > > > > > >> > >
> > >> > >> > >> > > > > > >> > > 5830 University Research Ct.
> > >> > >> > >> > > > > > >> > >
> > >> > >> > >> > > > > > >> > > College Park, MD 20740
> > >> > >> > >> > > > > > >> > >
> > >> > >> > >> > > > > > >> > > Binbin.Zhou at noaa.gov
> > >> > >> > >> > > > > > >> > >
> > >> > >> > >> > > > > > >> > > 301-683-3683
> > >> > >> > >> > > > > > >> > >
> > >> > >> > >> > > > > > >> >
> > >> > >> > >> > > > > > >> >
> > >> > >> > >> > > > > > >> > --
> > >> > >> > >> > > > > > >> >
> > >> > >> > >> > > > > > >> > Binbin Zhou
> > >> > >> > >> > > > > > >> >
> > >> > >> > >> > > > > > >> > IMSG at NOAA/NWS/NCEP/EMC
> > >> > >> > >> > > > > > >> >
> > >> > >> > >> > > > > > >> > 5830 University Research Ct.
> > >> > >> > >> > > > > > >> >
> > >> > >> > >> > > > > > >> > College Park, MD 20740
> > >> > >> > >> > > > > > >> >
> > >> > >> > >> > > > > > >> > Binbin.Zhou at noaa.gov
> > >> > >> > >> > > > > > >> >
> > >> > >> > >> > > > > > >> > 301-683-3683
> > >> > >> > >> > > > > > >> >
> > >> > >> > >> > > > > > >> >
> > >> > >> > >> > > > > > >>
> > >> > >> > >> > > > > > >> --
> > >> > >> > >> > > > > > >> George McCabe - Software Engineer III
> > >> > >> > >> > > > > > >> National Center for Atmospheric Research
> > >> > >> > >> > > > > > >> Research Applications Laboratory
> > >> > >> > >> > > > > > >> 303-497-2768
> > >> > >> > >> > > > > > >> ---
> > >> > >> > >> > > > > > >> My working day may not be your working
day.
> > Please
> > >> do
> > >> > >> not
> > >> > >> > >> feel
> > >> > >> > >> > > > obliged
> > >> > >> > >> > > > > > to
> > >> > >> > >> > > > > > >> reply to this email outside of your
normal
> > working
> > >> > >> hours.
> > >> > >> > >> > > > > > >>
> > >> > >> > >> > > > > > >>
> > >> > >> > >> > > > > > >
> > >> > >> > >> > > > > > > --
> > >> > >> > >> > > > > > >
> > >> > >> > >> > > > > > > Binbin Zhou
> > >> > >> > >> > > > > > >
> > >> > >> > >> > > > > > > IMSG at NOAA/NWS/NCEP/EMC
> > >> > >> > >> > > > > > >
> > >> > >> > >> > > > > > > 5830 University Research Ct.
> > >> > >> > >> > > > > > >
> > >> > >> > >> > > > > > > College Park, MD 20740
> > >> > >> > >> > > > > > >
> > >> > >> > >> > > > > > > Binbin.Zhou at noaa.gov
> > >> > >> > >> > > > > > >
> > >> > >> > >> > > > > > > 301-683-3683
> > >> > >> > >> > > > > > >
> > >> > >> > >> > > > > >
> > >> > >> > >> > > > > >
> > >> > >> > >> > > > > > --
> > >> > >> > >> > > > > >
> > >> > >> > >> > > > > > Binbin Zhou
> > >> > >> > >> > > > > >
> > >> > >> > >> > > > > > IMSG at NOAA/NWS/NCEP/EMC
> > >> > >> > >> > > > > >
> > >> > >> > >> > > > > > 5830 University Research Ct.
> > >> > >> > >> > > > > >
> > >> > >> > >> > > > > > College Park, MD 20740
> > >> > >> > >> > > > > >
> > >> > >> > >> > > > > > Binbin.Zhou at noaa.gov
> > >> > >> > >> > > > > >
> > >> > >> > >> > > > > > 301-683-3683
> > >> > >> > >> > > > > >
> > >> > >> > >> > > > > >
> > >> > >> > >> > > > >
> > >> > >> > >> > > > > --
> > >> > >> > >> > > > > George McCabe - Software Engineer III
> > >> > >> > >> > > > > National Center for Atmospheric Research
> > >> > >> > >> > > > > Research Applications Laboratory
> > >> > >> > >> > > > > 303-497-2768
> > >> > >> > >> > > > > ---
> > >> > >> > >> > > > > My working day may not be your working day.
Please
> do
> > >> not
> > >> > >> feel
> > >> > >> > >> > obliged
> > >> > >> > >> > > to
> > >> > >> > >> > > > > reply to this email outside of your normal
working
> > >> hours.
> > >> > >> > >> > > > >
> > >> > >> > >> > > > >
> > >> > >> > >> > > >
> > >> > >> > >> > > > --
> > >> > >> > >> > > >
> > >> > >> > >> > > > Binbin Zhou
> > >> > >> > >> > > >
> > >> > >> > >> > > > IMSG at NOAA/NWS/NCEP/EMC
> > >> > >> > >> > > >
> > >> > >> > >> > > > 5830 University Research Ct.
> > >> > >> > >> > > >
> > >> > >> > >> > > > College Park, MD 20740
> > >> > >> > >> > > >
> > >> > >> > >> > > > Binbin.Zhou at noaa.gov
> > >> > >> > >> > > >
> > >> > >> > >> > > > 301-683-3683
> > >> > >> > >> > > >
> > >> > >> > >> > > >
> > >> > >> > >> > >
> > >> > >> > >> > > --
> > >> > >> > >> > > George McCabe - Software Engineer III
> > >> > >> > >> > > National Center for Atmospheric Research
> > >> > >> > >> > > Research Applications Laboratory
> > >> > >> > >> > > 303-497-2768
> > >> > >> > >> > > ---
> > >> > >> > >> > > My working day may not be your working day.
Please do
> not
> > >> feel
> > >> > >> > >> obliged to
> > >> > >> > >> > > reply to this email outside of your normal
working
> hours.
> > >> > >> > >> > >
> > >> > >> > >> > >
> > >> > >> > >> >
> > >> > >> > >> > --
> > >> > >> > >> >
> > >> > >> > >> > Binbin Zhou
> > >> > >> > >> >
> > >> > >> > >> > IMSG at NOAA/NWS/NCEP/EMC
> > >> > >> > >> >
> > >> > >> > >> > 5830 University Research Ct.
> > >> > >> > >> >
> > >> > >> > >> > College Park, MD 20740
> > >> > >> > >> >
> > >> > >> > >> > Binbin.Zhou at noaa.gov
> > >> > >> > >> >
> > >> > >> > >> > 301-683-3683
> > >> > >> > >> >
> > >> > >> > >> >
> > >> > >> > >>
> > >> > >> > >> --
> > >> > >> > >> Julie Prestopnik (she/her)
> > >> > >> > >> Software Engineer
> > >> > >> > >> National Center for Atmospheric Research
> > >> > >> > >> Research Applications Laboratory
> > >> > >> > >> Email: jpresto at ucar.edu
> > >> > >> > >>
> > >> > >> > >> My working day may not be your working day. Please
do not
> > feel
> > >> > >> obliged
> > >> > >> > to
> > >> > >> > >> reply to this email outside of your normal working
hours.
> > >> > >> > >>
> > >> > >> > >>
> > >> > >> > >
> > >> > >> > > --
> > >> > >> > >
> > >> > >> > > Binbin Zhou
> > >> > >> > >
> > >> > >> > > IMSG at NOAA/NWS/NCEP/EMC
> > >> > >> > >
> > >> > >> > > 5830 University Research Ct.
> > >> > >> > >
> > >> > >> > > College Park, MD 20740
> > >> > >> > >
> > >> > >> > > Binbin.Zhou at noaa.gov
> > >> > >> > >
> > >> > >> > > 301-683-3683
> > >> > >> > >
> > >> > >> >
> > >> > >> >
> > >> > >> > --
> > >> > >> >
> > >> > >> > Binbin Zhou
> > >> > >> >
> > >> > >> > IMSG at NOAA/NWS/NCEP/EMC
> > >> > >> >
> > >> > >> > 5830 University Research Ct.
> > >> > >> >
> > >> > >> > College Park, MD 20740
> > >> > >> >
> > >> > >> > Binbin.Zhou at noaa.gov
> > >> > >> >
> > >> > >> > 301-683-3683
> > >> > >> >
> > >> > >> >
> > >> > >>
> > >> > >> --
> > >> > >> Julie Prestopnik (she/her)
> > >> > >> Software Engineer
> > >> > >> National Center for Atmospheric Research
> > >> > >> Research Applications Laboratory
> > >> > >> Email: jpresto at ucar.edu
> > >> > >>
> > >> > >> My working day may not be your working day. Please do not
feel
> > >> obliged
> > >> > to
> > >> > >> reply to this email outside of your normal working hours.
> > >> > >>
> > >> > >>
> > >> > >
> > >> > > --
> > >> > > George McCabe - Software Engineer III
> > >> > > National Center for Atmospheric Research
> > >> > > Research Applications Laboratory
> > >> > > 303-497-2768
> > >> > > ---
> > >> > > My working day may not be your working day. Please do not
feel
> > >> obliged to
> > >> > > reply to this email outside of your normal working hours.
> > >> > >
> > >> >
> > >> >
> > >> > --
> > >> >
> > >> > Binbin Zhou
> > >> >
> > >> > IMSG at NOAA/NWS/NCEP/EMC
> > >> >
> > >> > 5830 University Research Ct.
> > >> >
> > >> > College Park, MD 20740
> > >> >
> > >> > Binbin.Zhou at noaa.gov
> > >> >
> > >> > 301-683-3683
> > >> >
> > >> >
> > >>
> > >> --
> > >> George McCabe - Software Engineer III
> > >> National Center for Atmospheric Research
> > >> Research Applications Laboratory
> > >> 303-497-2768
> > >> ---
> > >> My working day may not be your working day. Please do not feel
obliged
> > to
> > >> reply to this email outside of your normal working hours.
> > >>
> > >>
> > >
> > > --
> > >
> > > Binbin Zhou
> > >
> > > IMSG at NOAA/NWS/NCEP/EMC
> > >
> > > 5830 University Research Ct.
> > >
> > > College Park, MD 20740
> > >
> > > Binbin.Zhou at noaa.gov
> > >
> > > 301-683-3683
> > >
> >
> >
> > --
> >
> > Binbin Zhou
> >
> > IMSG at NOAA/NWS/NCEP/EMC
> >
> > 5830 University Research Ct.
> >
> > College Park, MD 20740
> >
> > Binbin.Zhou at noaa.gov
> >
> > 301-683-3683
> >
> >
>
> --
> George McCabe - Software Engineer III
> National Center for Atmospheric Research
> Research Applications Laboratory
> 303-497-2768
> ---
> My working day may not be your working day. Please do not feel
obliged to
> reply to this email outside of your normal working hours.
>
>
--
Binbin Zhou
IMSG at NOAA/NWS/NCEP/EMC
5830 University Research Ct.
College Park, MD 20740
Binbin.Zhou at noaa.gov
301-683-3683
------------------------------------------------
Subject: CDP threshold setting in EnsembleStat conf
From: George McCabe
Time: Thu Jan 07 08:26:53 2021
Hi Binbin,
It looks like either the debug log message is inaccurate and the time
offset must be "less than" the hour interval instead of "less than or
equal
to" or the actual logic is incorrect. My guess is the latter, but I am
not
familiar enough with that portion of the code to know what it "should"
be.
I will let John HG know. Thanks for verifying that it does work
properly
when the hour interval value is greater than the time offset.
- George
On Thu, Jan 7, 2021 at 7:19 AM Binbin.Zhou at noaa.gov via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116 >
>
> George,
>
> With setting
> day_interval = 31;
> hour_interval = 12;
>
> The error message became:
> DEBUG 3: Skipping the 19590104_000000 "HGT/P500" climatology field
since
> the time offset (43200 seconds) >= the "hour_interval" entry (43200
> seconds) from file:
>
>
/gpfs/dell2/emc/modeling/noscrub/Binbin.Zhou/g2g/com/verf/dev/ens.20210104/clim.grid3.stdv.010400.grib2
>
> This error seems strange. So I changed the setting
> day_interval = 31;
> hour_interval = 18;
>
> This time, the run is successful! This means the time_offset must
> smaller than the hour_interval. SO I used a large number 18.
> I'll do more test to see if the run is stable.
>
> Thanks!
>
> Binbin
>
>
>
>
> On Wed, Jan 6, 2021 at 5:08 PM George McCabe via RT
<met_help at ucar.edu>
> wrote:
>
> > Hi Binbin,
> >
> > match_day and time_step are no longer used, so they should be
removed.
> You
> > should replace them with:
> >
> > day_interval = 31;
> > hour_interval = 12;
> >
> > 31 is the default for day interval. The default for hour_interval
is 6,
> but
> > we want it to be 12 so it finds your climo files.
> >
> > - George
> >
> > On Wed, Jan 6, 2021 at 2:39 PM Binbin.Zhou at noaa.gov via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116 >
> > >
> > > George,
> > >
> > > Even I deleted time_step in the climo_mean entry, this error
is
> still
> > > there.
> > > So I think climo_mean=fcst should be removed and define
climo_mean part
> > > separately.
> > > But how to define the fields (name, level) in climo_mean in
METplus
> conf
> > > file?
> > > Maybe hard copy the fields for climo_mean in EnsembleGrid config
file?
> > >
> > > Binbin
> > >
> > > On Wed, Jan 6, 2021 at 4:18 PM Binbin Zhou - NOAA Affiliate <
> > > binbin.zhou at noaa.gov> wrote:
> > >
> > > > George,
> > > >
> > > > Rerun has same error
> > > > Skipping the 19590104_000000 "HGT/P500" climatology field
since the
> > time
> > > > offset (43200 seconds) >= the "hour_interval" entry (21600
seconds)
> > from
> > > > file:
> > > >
> > >
> >
>
/gpfs/dell2/emc/modeling/noscrub/Binbin.Zhou/g2g/com/verf/dev/ens.20210104/clim.grid3.mean.010400.grib2
> > > >
> > > > The new setting for climo in EnemsbleGrid config file is
> > > > climo_mean = fcst;
> > > > climo_mean = {
> > > > file_name = [ ${CLIMO_MEAN_FILE} ];
> > > > time_interp_method = DW_MEAN;
> > > > match_day = FALSE;
> > > > time_step = 43200;
> > > > }
> > > > climo_stdev = climo_mean;
> > > > climo_stdev = {
> > > > file_name = [ ${CLIMO_STDEV_FILE} ];
> > > > }
> > > >
> > > > climo_cdf = {
> > > > cdf_bins = 11;
> > > > center_bins = TRUE;
> > > > write_bins = TRUE;
> > > > }
> > > >
> > > > It seems time_step is not effective?
> > > >
> > > > Binbin
> > > >
> > > > On Wed, Jan 6, 2021 at 3:15 PM George McCabe via RT <
> met_help at ucar.edu
> > >
> > > > wrote:
> > > >
> > > >> Hi Binbin,
> > > >>
> > > >> Thanks for sending the updated logs. It looks like your
climatology
> > > fields
> > > >> are not being read properly. I think this line explains the
problem:
> > > >>
> > > >> DEBUG 3: Skipping the 19590104_000000 "HGT/P500" climatology
field
> > since
> > > >> the time offset (43200 seconds) >= the "hour_interval" entry
(21600
> > > >> seconds) from file:
> > > >>
> > > >>
> > >
> >
>
/gpfs/dell2/emc/modeling/noscrub/Binbin.Zhou/g2g/com/verf/dev/ens.20210104/clim.grid3.stdv.010400.grib2
> > > >>
> > > >> The variables match_day and time_step in your climo_mean
dictionary
> > are
> > > >> actually no longer used and have been replaced with:
> > > >>
> > > >> day_interval = 31;
> > > >> hour_interval = 6;
> > > >>
> > > >> 21600 seconds is 6 hours and it sounds like your climo field
is
> offset
> > > by
> > > >> 12 hours. I believe setting hour_interval to 12 should allow
it to
> > find
> > > >> the
> > > >> climatology field and compute the statistics properly. Let me
know
> if
> > it
> > > >> does not.
> > > >>
> > > >> Thanks,
> > > >> George
> > > >>
> > > >> On Wed, Jan 6, 2021 at 12:43 PM Binbin.Zhou at noaa.gov via RT <
> > > >> met_help at ucar.edu> wrote:
> > > >>
> > > >> >
> > > >> > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116 >
> > > >> >
> > > >> > George,
> > > >> >
> > > >> > I have re-run the case with LOG_LEVEL=DEBUG and
> > > >> > LOG_ENSEMBLE_STAT_VERBOSITY =3.
> > > >> > The output log file has been sent to hera:
> > > >> >
> > > >> >
> > > >>
> > >
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Binbin.Zhou/metplus_test/metplus3.out/log/master_metplus.log.20210106193455
> > > >> >
> > > >> > Please look at it.
> > > >> >
> > > >> > Thanks!
> > > >> >
> > > >> > Biinbin
> > > >> >
> > > >> > On Wed, Jan 6, 2021 at 2:19 PM George McCabe
<mccabe at ucar.edu>
> > wrote:
> > > >> >
> > > >> > > Hi Binbin,
> > > >> > >
> > > >> > > Thanks for putting those files on hera. The log output
you sent
> > > >> doesn't
> > > >> > > have the DEBUG level output (LOG_LEVEL=DEBUG). However, I
tried
> to
> > > run
> > > >> > > EnsembleStat locally using the _OPTIONS value you set and
it
> seems
> > > to
> > > >> run
> > > >> > > fine. The error seems to suggest that something went
wrong when
> > > >> computing
> > > >> > > the mean and standard deviation before the obs_thresh
values are
> > > >> > applied. I
> > > >> > > have reached out to John HG to see if he has any insight
as to
> why
> > > >> that
> > > >> > is
> > > >> > > happening. In the meantime, you could rerun with
> > > >> > > LOG_ENSEMBLE_STAT_VERBOSITY set to a higher value than 2
to see
> > if
> > > >> the
> > > >> > > extra log output from the MET tool gives you any more
insight as
> > to
> > > >> what
> > > >> > is
> > > >> > > going wrong.
> > > >> > >
> > > >> > > - George
> > > >> > >
> > > >> > > On Wed, Jan 6, 2021 at 9:51 AM Julie Prestopnik via RT <
> > > >> > met_help at ucar.edu>
> > > >> > > wrote:
> > > >> > >
> > > >> > >> Thanks for all of the info Binbin. I saw that you had
copied
> > > >> everything
> > > >> > >> to
> > > >> > >> hera for George. I am currently no longer on WCOSS, so
I
> unless
> > > >> George
> > > >> > >> lets me know that he needs something from WCOSS, I'll
assume he
> > is
> > > >> able
> > > >> > to
> > > >> > >> get it from hera.
> > > >> > >>
> > > >> > >> Julie
> > > >> > >>
> > > >> > >> On Wed, Jan 6, 2021 at 9:39 AM Binbin.Zhou at noaa.gov via
RT <
> > > >> > >> met_help at ucar.edu> wrote:
> > > >> > >>
> > > >> > >> >
> > > >> > >> > <URL:
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
> > >
> > > >> > >> >
> > > >> > >> > The EnsembleStat config file for the successful run
outside
> of
> > > >> METplus
> > > >> > >> is
> > > >> > >> >
> > > >> > >> >
> > > >> > >>
> > > >> >
> > > >>
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_met_global_ens1p0.v1.0.0/parm/verf_g2g_ens_stat_config_bin11
> > > >> > >> > on WCOSS
> > > >> > >> >
> > > >> > >> > Binbin
> > > >> > >> >
> > > >> > >> > On Wed, Jan 6, 2021 at 11:34 AM Binbin Zhou - NOAA
Affiliate
> <
> > > >> > >> > binbin.zhou at noaa.gov> wrote:
> > > >> > >> >
> > > >> > >> > > Julie,
> > > >> > >> > >
> > > >> > >> > > The output directory on WCOSS is
> > > >> > >> > >
> > > >> > >> > >
> > > >> > >> >
> > > >> > >>
> > > >> >
> > > >>
> > >
> >
>
/gpfs/dell1/ptmp/Binbin.Zhou/g2g/RFC2/tmpnwprd/verf_g2g_gefs_00_dev.161076/metplus3.out
> > > >> > >> > >
> > > >> > >> > > My METplus package on WCOSS is
> > > >> > >> > >
> > > >> > >> >
> > > >> > >>
> > > >> >
> > > >>
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_g2g.v4.0.0
> > > >> > >> > >
> > > >> > >> > > For GEFS, the EnsembleGrid config file is
> > > >> > >> > >
> > > >> > >> > >
> > > >> > >> >
> > > >> > >>
> > > >> >
> > > >>
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_g2g.v4.0.0/parm/app_conf/grid2grid/met_config/EnsembleStatConfig_gefs_bin11
> > > >> > >> > > Its conf file
> > > >> > >> > > is
> > > >> > >> >
> > > >> > >>
> > > >> >
> > > >>
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_g2g.v4.0.0/parm/app_conf/grid2grid/gefs_conf/gefs_bin11.conf
> > > >> > >> > >
> > > >> > >> > > The running process is little bit complex since this
is a
> > > >> transition
> > > >> > >> to
> > > >> > >> > > future operational package that uses
> > > >> > >> > > mpi parallel: the script is
> > > >> > >> > >
> > > >> > >> > >
> > > >> > >> >
> > > >> > >>
> > > >> >
> > > >>
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_g2g.v4.0.0/ush/verf_g2g_metplus_run_gefs_mpi.sh
> > > >> > >> > >
> > > >> > >> > > Binbin
> > > >> > >> > >
> > > >> > >> > >
> > > >> > >> > >
> > > >> > >> > >
> > > >> > >> > > On Wed, Jan 6, 2021 at 11:00 AM Julie Prestopnik via
RT <
> > > >> > >> > met_help at ucar.edu>
> > > >> > >> > > wrote:
> > > >> > >> > >
> > > >> > >> > >> Hi Binbin.
> > > >> > >> > >>
> > > >> > >> > >> This is Julie. I haven't been following this
entire
> thread,
> > > >> but I
> > > >> > >> am on
> > > >> > >> > >> WCOSS right now. If you send a path to a file, I
can pull
> > it
> > > >> and
> > > >> > >> put it
> > > >> > >> > >> on
> > > >> > >> > >> our ftp server for George.
> > > >> > >> > >>
> > > >> > >> > >> Julie
> > > >> > >> > >>
> > > >> > >> > >> On Wed, Jan 6, 2021 at 8:57 AM Binbin.Zhou at noaa.gov
via
> RT
> > <
> > > >> > >> > >> met_help at ucar.edu> wrote:
> > > >> > >> > >>
> > > >> > >> > >> >
> > > >> > >> > >> > <URL:
> > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
> > > >> >
> > > >> > >> > >> >
> > > >> > >> > >> > George,
> > > >> > >> > >> >
> > > >> > >> > >> > Can you access WCOSS or access HERA?
> > > >> > >> > >> > Otherwise I will email attached to you
> > > >> > >> > >> >
> > > >> > >> > >> > Binbin
> > > >> > >> > >> >
> > > >> > >> > >> >
> > > >> > >> > >> >
> > > >> > >> > >> > On Wed, Jan 6, 2021 at 10:46 AM George McCabe via
RT <
> > > >> > >> > met_help at ucar.edu
> > > >> > >> > >> >
> > > >> > >> > >> > wrote:
> > > >> > >> > >> >
> > > >> > >> > >> > > Hi Binbin,
> > > >> > >> > >> > >
> > > >> > >> > >> > > Could you send me a log file for a run with
> > > LOG_LEVEL=DEBUG
> > > >> (in
> > > >> > >> > >> METplus
> > > >> > >> > >> > > config) so I can see how the environment
variable
> > > ENS_FIELD
> > > >> is
> > > >> > >> set?
> > > >> > >> > >> The
> > > >> > >> > >> > > values of ENS_VAR<n>_* are formatted and set in
this
> > > >> > environment
> > > >> > >> > >> variable
> > > >> > >> > >> > > which is passed into the MET config. You can
compare
> > that
> > > >> value
> > > >> > >> with
> > > >> > >> > >> what
> > > >> > >> > >> > > you used in your successful run outside of the
METplus
> > > >> wrapper
> > > >> > to
> > > >> > >> > >> > determine
> > > >> > >> > >> > > what is different.
> > > >> > >> > >> > >
> > > >> > >> > >> > > Thanks,
> > > >> > >> > >> > > George
> > > >> > >> > >> > >
> > > >> > >> > >> > > On Wed, Jan 6, 2021 at 7:11 AM
Binbin.Zhou at noaa.gov
> via
> > > RT
> > > >> <
> > > >> > >> > >> > > met_help at ucar.edu> wrote:
> > > >> > >> > >> > >
> > > >> > >> > >> > > >
> > > >> > >> > >> > > > <URL:
> > > >> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
> > > >> > >> >
> > > >> > >> > >> > > >
> > > >> > >> > >> > > > George,
> > > >> > >> > >> > > >
> > > >> > >> > >> > > > I got a new error in execution although
some
> output
> > > >> files
> > > >> > (nc
> > > >> > >> > >> file)
> > > >> > >> > >> > are
> > > >> > >> > >> > > > created but stat files not.
> > > >> > >> > >> > > > The error message is
> > > >> > >> > >> > > >
> > > >> > >> > >> > > > ERROR :
> > > >> > >> > >> > > > ERROR : Simple_Node::check(double, double,
double)
> > > const
> > > >> ->
> > > >> > >> > >> > > climatological
> > > >> > >> > >> > > > distribution percentile threshold "<=CDP10"
> requested
> > > with
> > > >> > >> invalid
> > > >> > >> > >> mean
> > > >> > >> > >> > > > (-9999) or standard deviation (-9999).
> > > >> > >> > >> > > > ERROR :
> > > >> > >> > >> > > >
> > > >> > >> > >> > > > Such an error was ever investigated by John H
before
> > > (year
> > > >> > >> ago):
> > > >> > >> > >> When I
> > > >> > >> > >> > > > directly ran ensemble_stat for global
ensemble (not
> > > >> > >> METplus-based,
> > > >> > >> > >> > > > but hard code of all settings in EnsembleStat
config
> > > >> file):
> > > >> > If
> > > >> > >> > hard
> > > >> > >> > >> > code
> > > >> > >> > >> > > > fcst field in EnsembleStat config file like
this
> > > >> > >> > >> > > >
> > > >> > >> > >> > > > name = "HGT";
> > > >> > >> > >> > > > level = "P500";
> > > >> > >> > >> > > > cat_thresh = [ <=CDP10,
>CDP10&&<=CDP20,
> > > >> > >> >CDP20&&<=CDP30,
> > > >> > >> > >> > > > >CDP30&&<=CDP40, >CDP40&&<=CDP50,
>CDP50&&<=CDP60,
> > > >> > >> > >CDP60&&<=CDP70,
> > > >> > >> > >> > > > >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];
> > > >> > >> > >> > > >
> > > >> > >> > >> > > > Run ensemble_stat will have such error:
ERROR :
> > > >> > >> > >> > > > Simple_Node::check(double, double, double)
const ->
> > > >> > >> climatological
> > > >> > >> > >> > > > distribution percentile threshold "<=CDP10"
> requested
> > > with
> > > >> > >> invalid
> > > >> > >> > >> mean
> > > >> > >> > >> > > > (-9999) or standard deviation (-9999).
> > > >> > >> > >> > > >
> > > >> > >> > >> > > > John H. suggested me change "cat_thresh = "
to
> > > >> "obs_thresh =
> > > >> > >> ",
> > > >> > >> > >> then
> > > >> > >> > >> > > the
> > > >> > >> > >> > > > error was solved.
> > > >> > >> > >> > > >
> > > >> > >> > >> > > > In current METplus version, following your
> suggestion
> > as
> > > >> > >> > >> > > >
> > > >> > >> > >> > > > ENS_VAR1_OPTIONS = obs_thresh = [ <=CDP10,
> > > >> >CDP10&&<=CDP20,
> > > >> > >> > >> > > > >CDP20&&<=CDP30, >CDP30&&<=CDP40,
>CDP40&&<=CDP50,
> > > >> > >> > >CDP50&&<=CDP60,
> > > >> > >> > >> > > > >CDP60&&<=CDP70, >CDP70&&<=CDP80,
>CDP80&&<=CDP90,
> > > >CDP90
> > > >> ];
> > > >> > >> > >> > > >
> > > >> > >> > >> > > > the same error appears again. So I am not
for sure
> > if
> > > >> the
> > > >> > >> > >> > "obs_thresh"
> > > >> > >> > >> > > > setting is correctly passed.
> > > >> > >> > >> > > >
> > > >> > >> > >> > > > Binbin
> > > >> > >> > >> > > >
> > > >> > >> > >> > > >
> > > >> > >> > >> > > >
> > > >> > >> > >> > > >
> > > >> > >> > >> > > > On Tue, Jan 5, 2021 at 5:19 PM George McCabe
via RT
> <
> > > >> > >> > >> met_help at ucar.edu
> > > >> > >> > >> > >
> > > >> > >> > >> > > > wrote:
> > > >> > >> > >> > > >
> > > >> > >> > >> > > > > Hi Binbin,
> > > >> > >> > >> > > > >
> > > >> > >> > >> > > > > Your solution should work for now. It looks
like
> > > >> although
> > > >> > the
> > > >> > >> > >> METplus
> > > >> > >> > >> > > > > variable does get read properly, the
environment
> > > >> variable
> > > >> > is
> > > >> > >> not
> > > >> > >> > >> > > actually
> > > >> > >> > >> > > > > set by the EnsembleStat wrapper. I can make
a note
> > to
> > > >> add
> > > >> > >> that
> > > >> > >> > for
> > > >> > >> > >> > > 4.0.0,
> > > >> > >> > >> > > > > as it is an easy fix.
> > > >> > >> > >> > > > >
> > > >> > >> > >> > > > > - George
> > > >> > >> > >> > > > >
> > > >> > >> > >> > > > > On Tue, Jan 5, 2021 at 2:53 PM
> Binbin.Zhou at noaa.gov
> > > via
> > > >> > RT <
> > > >> > >> > >> > > > > met_help at ucar.edu> wrote:
> > > >> > >> > >> > > > >
> > > >> > >> > >> > > > > > George,
> > > >> > >> > >> > > > > >
> > > >> > >> > >> > > > > > I have a temporal solution:
> > > >> > >> > >> > > > > > set ploy in EnembleStat config as
> > > >> > >> > >> > > > > > poly = [ "${MASKPATH}/lat_NHM.nc",
> > > >> > >> > >> > > > > > "${MASKPATH}/lat_NHM.nc",
> > > >> > >> > >> > > > > > "${MASKPATH}/lat_TRP.nc"
];
> > > >> > >> > >> > > > > >
> > > >> > >> > >> > > > > > then set MASKPATH in user_env_vars part
in the
> > conf
> > > >> file
> > > >> > >> > >> > > > > > This MASKPAH then can be passed to
> EnsembleStat's
> > > >> poly [
> > > >> > ]
> > > >> > >> > entry
> > > >> > >> > >> > > > > >
> > > >> > >> > >> > > > > > Binbin
> > > >> > >> > >> > > > > >
> > > >> > >> > >> > > > > > On Tue, Jan 5, 2021 at 4:25 PM Binbin
Zhou -
> NOAA
> > > >> > >> Affiliate <
> > > >> > >> > >> > > > > > binbin.zhou at noaa.gov> wrote:
> > > >> > >> > >> > > > > >
> > > >> > >> > >> > > > > > > George,
> > > >> > >> > >> > > > > > >
> > > >> > >> > >> > > > > > > Still not working, error says
> > > >> > >> > >> > > > > > > ERROR : replace_env() -> unable to
get value
> > for
> > > >> > >> > environment
> > > >> > >> > >> > > > variable
> > > >> > >> > >> > > > > > > "VERIF_MASK"
> > > >> > >> > >> > > > > > >
> > > >> > >> > >> > > > > > > Binbin
> > > >> > >> > >> > > > > > >
> > > >> > >> > >> > > > > > >
> > > >> > >> > >> > > > > > >
> > > >> > >> > >> > > > > > > On Tue, Jan 5, 2021 at 3:50 PM George
McCabe
> via
> > > RT
> > > >> <
> > > >> > >> > >> > > > met_help at ucar.edu
> > > >> > >> > >> > > > > >
> > > >> > >> > >> > > > > > > wrote:
> > > >> > >> > >> > > > > > >
> > > >> > >> > >> > > > > > >> Hi Binbin,
> > > >> > >> > >> > > > > > >>
> > > >> > >> > >> > > > > > >> You should be able to set it in the
METplus
> > > config
> > > >> the
> > > >> > >> same
> > > >> > >> > >> way
> > > >> > >> > >> > it
> > > >> > >> > >> > > > is
> > > >> > >> > >> > > > > > done
> > > >> > >> > >> > > > > > >> for GridStat -- no quotes with commas
between
> > > each
> > > >> > item.
> > > >> > >> > The
> > > >> > >> > >> > > wrapper
> > > >> > >> > >> > > > > > >> should
> > > >> > >> > >> > > > > > >> format it properly.
> > > >> > >> > >> > > > > > >>
> > > >> > >> > >> > > > > > >> Here is an example from an existing
use case:
> > > >> > >> > >> > > > > > >>
> > > >> > >> > >> > > > > > >> GRID_STAT_VERIFICATION_MASK_TEMPLATE =
> > > >> > >> > >> > > > > > >>
> > > >> > >> > >> > >
> > > >> > >>
> > >
{INPUT_BASE}/model_applications/precipitation/mask/CONUS_HRRRTLE.nc,
> > > >> > >> > >> > > > > > >>
> > > >> > >> > >> > >
> > > >> > >>
> >
{INPUT_BASE}/model_applications/precipitation/mask/EAST_HRRRTLE.nc,
> > > >> > >> > >> > > > > > >>
> > > >> > >> > >> >
> > > >> >
{INPUT_BASE}/model_applications/precipitation/mask/WEST_HRRRTLE.nc
> > > >> > >> > >> > > > > > >>
> > > >> > >> > >> > > > > > >> You should be able to set them the
same way
> > using
> > > >> > >> > >> > > > > > >>
ENSEMBLE_STAT_VERIFICATION_MASK_TEMPLATE. Let
> > me
> > > >> know
> > > >> > if
> > > >> > >> > that
> > > >> > >> > >> > > > doesn't
> > > >> > >> > >> > > > > > >> work.
> > > >> > >> > >> > > > > > >>
> > > >> > >> > >> > > > > > >> - George
> > > >> > >> > >> > > > > > >>
> > > >> > >> > >> > > > > > >> On Tue, Jan 5, 2021 at 1:45 PM
> > > >> Binbin.Zhou at noaa.gov
> > > >> > via
> > > >> > >> > RT <
> > > >> > >> > >> > > > > > >> met_help at ucar.edu> wrote:
> > > >> > >> > >> > > > > > >>
> > > >> > >> > >> > > > > > >> >
> > > >> > >> > >> > > > > > >> > <URL:
> > > >> > >> > >>
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
> > > >> > >> > >> > >
> > > >> > >> > >> > > > > > >> >
> > > >> > >> > >> > > > > > >> > George,
> > > >> > >> > >> > > > > > >> >
> > > >> > >> > >> > > > > > >> > I got another issue for
verification mask
> > > >> setting.
> > > >> > >> > >> > > > > > >> >
> > > >> > >> > >> > > > > > >> > I am using $VERIF_MASK in
EnsembleStat
> config
> > > >> f/ile
> > > >> > >> > >> > > > > > >> > mask = {
> > > >> > >> > >> > > > > > >> > grid = [];
> > > >> > >> > >> > > > > > >> > poly = [${VERIF_MASK}];
> > > >> > >> > >> > > > > > >> > sid = [];
> > > >> > >> > >> > > > > > >> > }
> > > >> > >> > >> > > > > > >> >
> > > >> > >> > >> > > > > > >> > And using
> > GRID_STAT_VERIFICATION_MASK_TEMPLATE
> > > >> to
> > > >> > >> define
> > > >> > >> > >> > > several
> > > >> > >> > >> > > > > > >> polygon
> > > >> > >> > >> > > > > > >> > nc mask files
> > > >> > >> > >> > > > > > >> > But it seems not working. But it
works for
> > > >> Gridstat
> > > >> > >> > config
> > > >> > >> > >> in
> > > >> > >> > >> > > > suich
> > > >> > >> > >> > > > > > >> > setting.
> > > >> > >> > >> > > > > > >> > I can not find ENSEMBLE_STAT_
> > > >> > >> VERIFICATION_MASK_TEMPLATE
> > > >> > >> > in
> > > >> > >> > >> > the
> > > >> > >> > >> > > > > > METplus
> > > >> > >> > >> > > > > > >> doc
> > > >> > >> > >> > > > > > >> >
> > > >> > >> > >> > > > > > >> > So I define VERIF_MASK in
[user_env_vars]
> > part.
> > > >> > >> > >> > > > > > >> > It values can not be passed to ploy
=
> > > >> > [${VERIF_MASK}]
> > > >> > >> in
> > > >> > >> > >> the
> > > >> > >> > >> > > > > > >> EnsembleStat
> > > >> > >> > >> > > > > > >> > conf if more than one nc files
included.
> > > >> > >> > >> > > > > > >> > For example
> > > >> > >> > >> > > > > > >> > VERIF_MASK=" '/part/p1.cn',
'/path/p2.nc'
> "
> > > >> > >> > >> > > > > > >> > the error says poly = [/path/p1,]
> > > >> > >> > >> > > > > > >> > It seems double quote or single
quote can
> not
> > > be
> > > >> > >> passed
> > > >> > >> > to
> > > >> > >> > >> > > > > VERIF_MASK
> > > >> > >> > >> > > > > > in
> > > >> > >> > >> > > > > > >> > the EnsembleStat config.
> > > >> > >> > >> > > > > > >> > I tried use back slash \ to before
quote,
> but
> > > >> still
> > > >> > >> not
> > > >> > >> > >> > working
> > > >> > >> > >> > > > > > >> >
> > > >> > >> > >> > > > > > >> > Binbin
> > > >> > >> > >> > > > > > >> >
> > > >> > >> > >> > > > > > >> >
> > > >> > >> > >> > > > > > >> > On Tue, Jan 5, 2021 at 10:33 AM
Binbin
> Zhou -
> > > >> NOAA
> > > >> > >> > >> Affiliate <
> > > >> > >> > >> > > > > > >> > binbin.zhou at noaa.gov> wrote:
> > > >> > >> > >> > > > > > >> >
> > > >> > >> > >> > > > > > >> > > George,
> > > >> > >> > >> > > > > > >> > >
> > > >> > >> > >> > > > > > >> > > Thanks for your quick response!
I'll
> > test
> > > >> this
> > > >> > >> > >> settings
> > > >> > >> > >> > and
> > > >> > >> > >> > > > let
> > > >> > >> > >> > > > > > >> > > you know the results.
> > > >> > >> > >> > > > > > >> > >
> > > >> > >> > >> > > > > > >> > > Binbin
> > > >> > >> > >> > > > > > >> > >
> > > >> > >> > >> > > > > > >> > > On Tue, Jan 5, 2021 at 10:17 AM
George
> > McCabe
> > > >> via
> > > >> > >> RT <
> > > >> > >> > >> > > > > > >> met_help at ucar.edu>
> > > >> > >> > >> > > > > > >> > > wrote:
> > > >> > >> > >> > > > > > >> > >
> > > >> > >> > >> > > > > > >> > >> Hi Binbin,
> > > >> > >> > >> > > > > > >> > >>
> > > >> > >> > >> > > > > > >> > >> Happy New Year to you too!
> > > >> > >> > >> > > > > > >> > >>
> > > >> > >> > >> > > > > > >> > >> I will comment on each
configuration
> > > variable
> > > >> and
> > > >> > >> how
> > > >> > >> > to
> > > >> > >> > >> > set
> > > >> > >> > >> > > it
> > > >> > >> > >> > > > > in
> > > >> > >> > >> > > > > > a
> > > >> > >> > >> > > > > > >> > >> METplus config inline:
> > > >> > >> > >> > > > > > >> > >>
> > > >> > >> > >> > > > > > >> > >> ens = {
> > > >> > >> > >> > > > > > >> > >> ens_thresh = 1.0;
> > > >> > >> > >> > > > > > >> > >>
> > > >> > >> > >> > > > > > >> > >>
> > > >> > >> > >> > > > > > >> > >> *This is controlled by the
> > > >> > ENSEMBLE_STAT_ENS_THRESH
> > > >> > >> > >> > variable.
> > > >> > >> > >> > > > The
> > > >> > >> > >> > > > > > >> > default
> > > >> > >> > >> > > > > > >> > >> value is 1.0, so you don't need
to
> include
> > > it
> > > >> in
> > > >> > >> your
> > > >> > >> > >> > config
> > > >> > >> > >> > > > > file,
> > > >> > >> > >> > > > > > >> but
> > > >> > >> > >> > > > > > >> > you
> > > >> > >> > >> > > > > > >> > >> can if you may adjust this value
at some
> > > >> point.*
> > > >> > >> > >> > > > > > >> > >>
> > > >> > >> > >> > > > > > >> > >> vld_thresh = 1.0;
> > > >> > >> > >> > > > > > >> > >>
> > > >> > >> > >> > > > > > >> > >> *This value is set to 1.0 by
default so
> we
> > > >> don't
> > > >> > >> need
> > > >> > >> > to
> > > >> > >> > >> > > worry
> > > >> > >> > >> > > > > > about
> > > >> > >> > >> > > > > > >> it
> > > >> > >> > >> > > > > > >> > >> right now.*
> > > >> > >> > >> > > > > > >> > >>
> > > >> > >> > >> > > > > > >> > >> field = [
> > > >> > >> > >> > > > > > >> > >>
> > > >> > >> > >> > > > > > >> > >> {
> > > >> > >> > >> > > > > > >> > >> name = "HGT";
> > > >> > >> > >> > > > > > >> > >> level = "P500";
> > > >> > >> > >> > > > > > >> > >> obs_thresh = [ <=CDP10,
> > > >> >CDP10&&<=CDP20,
> > > >> > >> > >> > > > > >CDP20&&<=CDP30,
> > > >> > >> > >> > > > > > >> > >> >CDP30&&<=CDP40, >CDP40&&<=CDP50,
> > > >> > >CDP50&&<=CDP60,
> > > >> > >> > >> > > > > >CDP60&&<=CDP70,
> > > >> > >> > >> > > > > > >> > >> >CDP70&&<=CDP80, >CDP80&&<=CDP90,
>CDP90
> > ];
> > > >> > >> > >> > > > > > >> > >> }
> > > >> > >> > >> > > > > > >> > >> ]
> > > >> > >> > >> > > > > > >> > >> }
> > > >> > >> > >> > > > > > >> > >> fcst = ens;
> > > >> > >> > >> > > > > > >> > >> obs = fcst;
> > > >> > >> > >> > > > > > >> > >>
> > > >> > >> > >> > > > > > >> > >> *1) The field info for ens is set
in the
> > > >> > >> > >> > > > > > >> > >>
ENS_VAR<n>_[NAME/LEVEL/THRESH/OPTIONS]
> > > >> variables.
> > > >> > >> The
> > > >> > >> > >> fcst
> > > >> > >> > >> > > and
> > > >> > >> > >> > > > > obs
> > > >> > >> > >> > > > > > >> field
> > > >> > >> > >> > > > > > >> > >> info are set in the corresponding
> > > >> FCST_VAR<n>_*
> > > >> > and
> > > >> > >> > >> > > > OBS_VAR<n>_*
> > > >> > >> > >> > > > > > >> > variables
> > > >> > >> > >> > > > > > >> > >> respectively, or you can use
> BOTH_VAR<n>_*
> > > if
> > > >> the
> > > >> > >> FCST
> > > >> > >> > >> and
> > > >> > >> > >> > > OBS
> > > >> > >> > >> > > > > > values
> > > >> > >> > >> > > > > > >> > are
> > > >> > >> > >> > > > > > >> > >> the same.*
> > > >> > >> > >> > > > > > >> > >>
> > > >> > >> > >> > > > > > >> > >> *If ENS_VAR<n>_* variables are
not
> > > explicitly
> > > >> > set,
> > > >> > >> > then
> > > >> > >> > >> it
> > > >> > >> > >> > > will
> > > >> > >> > >> > > > > use
> > > >> > >> > >> > > > > > >> the
> > > >> > >> > >> > > > > > >> > >> values from FCST_VAR<n>_*.*
> > > >> > >> > >> > > > > > >> > >> *Since the fcst, obs, and ens are
all
> the
> > > same
> > > >> > you
> > > >> > >> > could
> > > >> > >> > >> > just
> > > >> > >> > >> > > > use
> > > >> > >> > >> > > > > > >> > >> BOTH_VAR<n>_* variables to
control all
> 3,
> > > >> > although
> > > >> > >> > keep
> > > >> > >> > >> in
> > > >> > >> > >> > > mind
> > > >> > >> > >> > > > > > that
> > > >> > >> > >> > > > > > >> if
> > > >> > >> > >> > > > > > >> > >> you
> > > >> > >> > >> > > > > > >> > >> need to change one of them for
any
> reason,
> > > it
> > > >> > will
> > > >> > >> be
> > > >> > >> > >> more
> > > >> > >> > >> > > > > > difficult
> > > >> > >> > >> > > > > > >> to
> > > >> > >> > >> > > > > > >> > do
> > > >> > >> > >> > > > > > >> > >> this. If you know that they will
always
> be
> > > the
> > > >> > same
> > > >> > >> > >> values,
> > > >> > >> > >> > > > then
> > > >> > >> > >> > > > > I
> > > >> > >> > >> > > > > > >> > >> recommend using BOTH_, but if you
know
> > they
> > > >> may
> > > >> > >> change
> > > >> > >> > >> or
> > > >> > >> > >> > are
> > > >> > >> > >> > > > > > >> unsure, I
> > > >> > >> > >> > > > > > >> > >> would recommend setting them by
> > referencing
> > > >> the
> > > >> > >> other
> > > >> > >> > >> > > > variables,
> > > >> > >> > >> > > > > > >> i.e.*
> > > >> > >> > >> > > > > > >> > >>
> > > >> > >> > >> > > > > > >> > >> *FCST_VAR1_NAME = HGT*
> > > >> > >> > >> > > > > > >> > >> *FCST_VAR1_LEVELS = P500 *
> > > >> > >> > >> > > > > > >> > >> *OBS_VAR1_NAME =
{FCST_VAR1_NAME}*
> > > >> > >> > >> > > > > > >> > >> *OBS_VAR1_LEVELS =
{FCST_VAR1_LEVELS}*
> > > >> > >> > >> > > > > > >> > >>
> > > >> > >> > >> > > > > > >> > >> *2) The
[FCST/OBS/ENS]_VAR<n>_THRESH
> > > variables
> > > >> > set
> > > >> > >> the
> > > >> > >> > >> > > > cat_thresh
> > > >> > >> > >> > > > > > >> values
> > > >> > >> > >> > > > > > >> > >> in
> > > >> > >> > >> > > > > > >> > >> the field info. A variable
specific to
> > > >> obs_thresh
> > > >> > >> is
> > > >> > >> > not
> > > >> > >> > >> > > > > currently
> > > >> > >> > >> > > > > > >> > >> supported, however you can set
these
> > values
> > > by
> > > >> > >> using
> > > >> > >> > the
> > > >> > >> > >> > > > > > >> > ENS_VAR1_OPTIONS
> > > >> > >> > >> > > > > > >> > >> variable, i.e.*
> > > >> > >> > >> > > > > > >> > >>
> > > >> > >> > >> > > > > > >> > >> *ENS_VAR1_OPTIONS = obs_thresh =
[
> > <=CDP10,
> > > >> > >> > >> > >CDP10&&<=CDP20,
> > > >> > >> > >> > > > > > >> > >> >CDP20&&<=CDP30, >CDP30&&<=CDP40,
> > > >> > >CDP40&&<=CDP50,
> > > >> > >> > >> > > > > >CDP50&&<=CDP60,
> > > >> > >> > >> > > > > > >> > >> >CDP60&&<=CDP70, >CDP70&&<=CDP80,
> > > >> > >CDP80&&<=CDP90,
> > > >> > >> > >> >CDP90
> > > >> > >> > >> > ];*
> > > >> > >> > >> > > > > > >> > >>
> > > >> > >> > >> > > > > > >> > >>
> > > >> > >> > >> > > > > > >> > >> *Remember to include the
semicolon at
> the
> > > >> end! *
> > > >> > >> > >> > > > > > >> > >>
> > > >> > >> > >> > > > > > >> > >> ens_ssvar_bin_size = 1000000;
> > > >> > >> > >> > > > > > >> > >> *1) This variable is different
from the
> > > >> default
> > > >> > and
> > > >> > >> > not
> > > >> > >> > >> > > > currently
> > > >> > >> > >> > > > > > >> > >> supported
> > > >> > >> > >> > > > > > >> > >> with a METplus config variable. I
will
> add
> > > >> this
> > > >> > to
> > > >> > >> the
> > > >> > >> > >> list
> > > >> > >> > >> > > of
> > > >> > >> > >> > > > > > >> variables
> > > >> > >> > >> > > > > > >> > >> in
> > > >> > >> > >> > > > > > >> > >> MET config files that we want to
> support.
> > > >> > However,
> > > >> > >> in
> > > >> > >> > >> the
> > > >> > >> > >> > > > > meantime
> > > >> > >> > >> > > > > > >> you
> > > >> > >> > >> > > > > > >> > can
> > > >> > >> > >> > > > > > >> > >> copy the default wrapped MET
config file
> > and
> > > >> > >> modify it
> > > >> > >> > >> to
> > > >> > >> > >> > fit
> > > >> > >> > >> > > > > your
> > > >> > >> > >> > > > > > >> > needs.
> > > >> > >> > >> > > > > > >> > >> To do this, you will need to:*
> > > >> > >> > >> > > > > > >> > >>
> > > >> > >> > >> > > > > > >> > >> * a) Copy
> > > >> > >> > >> >
METplus/parm/met_config/EnsembleStatConfig_wrapped
> > > >> > >> > >> > > > to
> > > >> > >> > >> > > > > > the
> > > >> > >> > >> > > > > > >> > >> directory that contains your
METplus
> > config
> > > >> file
> > > >> > >> for
> > > >> > >> > >> this
> > > >> > >> > >> > use
> > > >> > >> > >> > > > > case.
> > > >> > >> > >> > > > > > >> > Rename
> > > >> > >> > >> > > > > > >> > >> it by replacing "wrapped" with a
short
> > > >> > description
> > > >> > >> > that
> > > >> > >> > >> > > > pertains
> > > >> > >> > >> > > > > to
> > > >> > >> > >> > > > > > >> your
> > > >> > >> > >> > > > > > >> > >> use case.*
> > > >> > >> > >> > > > > > >> > >>
> > > >> > >> > >> > > > > > >> > >> * b) In your METplus config
file,
> change
> > > the
> > > >> > >> value of
> > > >> > >> > >> > > > > > >> > >> ENSEMBLE_STAT_CONFIG_FILE to
point to
> the
> > > >> path of
> > > >> > >> this
> > > >> > >> > >> new
> > > >> > >> > >> > > > config
> > > >> > >> > >> > > > > > >> file.*
> > > >> > >> > >> > > > > > >> > >>
> > > >> > >> > >> > > > > > >> > >> * c) If you know the value you
want to
> > use
> > > >> for
> > > >> > >> this
> > > >> > >> > >> > variable
> > > >> > >> > >> > > > > will
> > > >> > >> > >> > > > > > >> > always
> > > >> > >> > >> > > > > > >> > >> be 1000000, then simply set the
variable
> > to
> > > >> that
> > > >> > >> > value.
> > > >> > >> > >> If
> > > >> > >> > >> > > you
> > > >> > >> > >> > > > > > think
> > > >> > >> > >> > > > > > >> you
> > > >> > >> > >> > > > > > >> > >> may want to change the value,
then you
> can
> > > >> > utilize
> > > >> > >> the
> > > >> > >> > >> > > > > > >> [user_env_vars]
> > > >> > >> > >> > > > > > >> > >> functionality. See:
> > > >> > >> > >> > > > > > >> > >>
> > > >> > >> > >> > > > > > >> > >>
> > > >> > >> > >> > > > > > >> >
> > > >> > >> > >> > > > > > >>
> > > >> > >> > >> > > > > >
> > > >> > >> > >> > > > >
> > > >> > >> > >> > > >
> > > >> > >> > >> > >
> > > >> > >> > >> >
> > > >> > >> > >>
> > > >> > >> >
> > > >> > >>
> > > >> >
> > > >>
> > >
> >
>
https://dtcenter.github.io/METplus/latest/Users_Guide/systemconfiguration.html#user-
defined-config
> > > >> > >> > >> > > > > > >> > >> <
> > > >> > >> > >> > > > > > >> > >>
> > > >> > >> > >> > > > > > >> >
> > > >> > >> > >> > > > > > >>
> > > >> > >> > >> > > > > >
> > > >> > >> > >> > > > >
> > > >> > >> > >> > > >
> > > >> > >> > >> > >
> > > >> > >> > >> >
> > > >> > >> > >>
> > > >> > >> >
> > > >> > >>
> > > >> >
> > > >>
> > >
> >
>
https://dtcenter.github.io/METplus/latest/Users_Guide/systemconfiguration.html#user-
defined-config
> > > >> > >> > >> > > > > > >> > >> >*
> > > >> > >> > >> > > > > > >> > >> *In this case, you would add the
> following
> > > to
> > > >> > your
> > > >> > >> > >> METplus
> > > >> > >> > >> > > > > config:*
> > > >> > >> > >> > > > > > >> > >>
> > > >> > >> > >> > > > > > >> > >> *[user_env_vars]*
> > > >> > >> > >> > > > > > >> > >> *ENS_SSVAR_BIN_SIZE = 1000000*
> > > >> > >> > >> > > > > > >> > >>
> > > >> > >> > >> > > > > > >> > >> *Then change the line in your
> EnsembleStat
> > > >> config
> > > >> > >> file
> > > >> > >> > >> that
> > > >> > >> > >> > > you
> > > >> > >> > >> > > > > > >> copied
> > > >> > >> > >> > > > > > >> > >> to:*
> > > >> > >> > >> > > > > > >> > >>
> > > >> > >> > >> > > > > > >> > >> * ens_ssvar_bin_size =
> > > ${ENS_SSVAR_BIN_SIZE};
> > > >> *
> > > >> > >> > >> > > > > > >> > >>
> > > >> > >> > >> > > > > > >> > >> ens_phist_bin_size = 0.05;
> > > >> > >> > >> > > > > > >> > >> *This variable uses the default
value,
> so
> > > you
> > > >> > don't
> > > >> > >> > >> need to
> > > >> > >> > >> > > do
> > > >> > >> > >> > > > > > >> anything
> > > >> > >> > >> > > > > > >> > >> here. If you need to make it
> configurable
> > or
> > > >> > change
> > > >> > >> > the
> > > >> > >> > >> > > value,
> > > >> > >> > >> > > > > then
> > > >> > >> > >> > > > > > >> > follow
> > > >> > >> > >> > > > > > >> > >> the instructions for setting
> > > >> ens_ssvar_bin_size.*
> > > >> > >> > >> > > > > > >> > >>
> > > >> > >> > >> > > > > > >> > >> climo_mean = fcst;
> > > >> > >> > >> > > > > > >> > >> climo_mean = {
> > > >> > >> > >> > > > > > >> > >> file_name = "${CLIM_MEAN}";
> > > >> > >> > >> > > > > > >> > >> time_interp_method = DW_MEAN;
> > > >> > >> > >> > > > > > >> > >> match_day = TRUE;
> > > >> > >> > >> > > > > > >> > >> time_step = 21600;
> > > >> > >> > >> > > > > > >> > >> }
> > > >> > >> > >> > > > > > >> > >>
> > > >> > >> > >> > > > > > >> > >>
> > > >> > >> > >> > > > > > >> > >> *Instead of using CLIM_MEAN, you
can set
> > > >> > >> > >> > > > > > >> > >>
> > > ENSEMBLE_STAT_CLIMO_MEAN_INPUT_[DIR/TEMPLATE]
> > > >> in
> > > >> > >> the
> > > >> > >> > >> > METplus
> > > >> > >> > >> > > > > > config.
> > > >> > >> > >> > > > > > >> You
> > > >> > >> > >> > > > > > >> > >> can use filename template syntax
in the
> > > >> _TEMPLATE
> > > >> > >> > value,
> > > >> > >> > >> > i.e.
> > > >> > >> > >> > > > > > >> > >> {valid?fmt=%m%d}. The other
variables in
> > the
> > > >> > >> > climo_mean
> > > >> > >> > >> > > > > dictionary
> > > >> > >> > >> > > > > > >> are
> > > >> > >> > >> > > > > > >> > >> actually old variables that have
been
> > > replaced
> > > >> > with
> > > >> > >> > >> > > > day_interval
> > > >> > >> > >> > > > > > and
> > > >> > >> > >> > > > > > >> > >> hour_interval, but the values you
use
> are
> > > the
> > > >> old
> > > >> > >> > >> defaults,
> > > >> > >> > >> > > so
> > > >> > >> > >> > > > > you
> > > >> > >> > >> > > > > > >> > >> shouldn't need to set them.*
> > > >> > >> > >> > > > > > >> > >>
> > > >> > >> > >> > > > > > >> > >> climo_stdev = climo_mean;
> > > >> > >> > >> > > > > > >> > >> climo_stdev = {
> > > >> > >> > >> > > > > > >> > >> file_name = "${CLIM_STDV}";
> > > >> > >> > >> > > > > > >> > >> }
> > > >> > >> > >> > > > > > >> > >>
> > > >> > >> > >> > > > > > >> > >> *Similarly to CLIM_MEAN, you can
use
> > > >> > >> > >> > > > > > >> > >>
> > > >> ENSEMBLE_STAT_CLIMO_STDEV_INPUT_[DIR/TEMPLATE] to
> > > >> > >> set
> > > >> > >> > >> this
> > > >> > >> > >> > > file
> > > >> > >> > >> > > > > > >> name.*
> > > >> > >> > >> > > > > > >> > >>
> > > >> > >> > >> > > > > > >> > >> climo_cdf = {
> > > >> > >> > >> > > > > > >> > >> cdf_bins = 11;
> > > >> > >> > >> > > > > > >> > >> center_bins = TRUE;
> > > >> > >> > >> > > > > > >> > >> write_bins = TRUE;
> > > >> > >> > >> > > > > > >> > >> }
> > > >> > >> > >> > > > > > >> > >> *The value for write_bins is the
> default,
> > > but
> > > >> the
> > > >> > >> > values
> > > >> > >> > >> > for
> > > >> > >> > >> > > > > > cdf_bins
> > > >> > >> > >> > > > > > >> > and
> > > >> > >> > >> > > > > > >> > >> center_bins do not. To set these,
follow
> > the
> > > >> > above
> > > >> > >> > >> > > instructions
> > > >> > >> > >> > > > > for
> > > >> > >> > >> > > > > > >> > >> ens_ssvar_bin_size to override
them
> and/or
> > > >> make
> > > >> > >> them
> > > >> > >> > >> > > > configurable
> > > >> > >> > >> > > > > > >> > through
> > > >> > >> > >> > > > > > >> > >> METplus. I will also add these
variables
> > to
> > > >> the
> > > >> > >> list
> > > >> > >> > of
> > > >> > >> > >> MET
> > > >> > >> > >> > > > > configs
> > > >> > >> > >> > > > > > >> that
> > > >> > >> > >> > > > > > >> > >> users want to be able to easily
> configure
> > > >> through
> > > >> > >> > >> METplus
> > > >> > >> > >> > > > > configs.*
> > > >> > >> > >> > > > > > >> > >>
> > > >> > >> > >> > > > > > >> > >> Please let me know if you run
into any
> > > issues
> > > >> > >> setting
> > > >> > >> > >> any
> > > >> > >> > >> > of
> > > >> > >> > >> > > > that
> > > >> > >> > >> > > > > > up.
> > > >> > >> > >> > > > > > >> > >> Also,
> > > >> > >> > >> > > > > > >> > >> if there are any other MET config
> > variables
> > > >> that
> > > >> > >> you
> > > >> > >> > >> want
> > > >> > >> > >> > to
> > > >> > >> > >> > > > see
> > > >> > >> > >> > > > > > >> > supported
> > > >> > >> > >> > > > > > >> > >> in METplus, let me know and I
will make
> > sure
> > > >> they
> > > >> > >> get
> > > >> > >> > >> > > included
> > > >> > >> > >> > > > > when
> > > >> > >> > >> > > > > > >> we
> > > >> > >> > >> > > > > > >> > >> have
> > > >> > >> > >> > > > > > >> > >> a chance to refactor those
wrappers. It
> is
> > > >> > >> possible to
> > > >> > >> > >> add
> > > >> > >> > >> > > > > support
> > > >> > >> > >> > > > > > >> for
> > > >> > >> > >> > > > > > >> > MET
> > > >> > >> > >> > > > > > >> > >> configs using the above
instructions,
> but
> > it
> > > >> is
> > > >> > >> always
> > > >> > >> > >> > easier
> > > >> > >> > >> > > > and
> > > >> > >> > >> > > > > > >> less
> > > >> > >> > >> > > > > > >> > >> error-prone to have them
configurable
> > > directly
> > > >> > >> > through a
> > > >> > >> > >> > > > variable
> > > >> > >> > >> > > > > > in
> > > >> > >> > >> > > > > > >> the
> > > >> > >> > >> > > > > > >> > >> METplus config.
> > > >> > >> > >> > > > > > >> > >>
> > > >> > >> > >> > > > > > >> > >> Thanks,
> > > >> > >> > >> > > > > > >> > >> George
> > > >> > >> > >> > > > > > >> > >>
> > > >> > >> > >> > > > > > >> > >> On Tue, Jan 5, 2021 at 7:14 AM
> > > >> > >> Binbin.Zhou at noaa.gov
> > > >> > >> > via
> > > >> > >> > >> > RT <
> > > >> > >> > >> > > > > > >> > >> met_help at ucar.edu> wrote:
> > > >> > >> > >> > > > > > >> > >>
> > > >> > >> > >> > > > > > >> > >> >
> > > >> > >> > >> > > > > > >> > >> > Tue Jan 05 07:14:54 2021:
Request
> 98116
> > > was
> > > >> > acted
> > > >> > >> > >> upon.
> > > >> > >> > >> > > > > > >> > >> > Transaction: Ticket created by
> > > >> > >> Binbin.Zhou at noaa.gov
> > > >> > >> > >> > > > > > >> > >> > Queue: met_help
> > > >> > >> > >> > > > > > >> > >> > Subject: CDP threshold
setting in
> > > >> > >> EnsembleStat
> > > >> > >> > >> conf
> > > >> > >> > >> > > > > > >> > >> > Owner: Nobody
> > > >> > >> > >> > > > > > >> > >> > Requestors:
Binbin.Zhou at noaa.gov
> > > >> > >> > >> > > > > > >> > >> > Status: new
> > > >> > >> > >> > > > > > >> > >> > Ticket <URL:
> > > >> > >> > >> > > > > > >>
> > > >> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
> > > >> > >> > >> > > > > > >> > >
> > > >> > >> > >> > > > > > >> > >> >
> > > >> > >> > >> > > > > > >> > >> >
> > > >> > >> > >> > > > > > >> > >> > George,
> > > >> > >> > >> > > > > > >> > >> >
> > > >> > >> > >> > > > > > >> > >> > Happy New Year!
> > > >> > >> > >> > > > > > >> > >> >
> > > >> > >> > >> > > > > > >> > >> > I am working on transition of
our
> > > >> MET-based
> > > >> > >> > global
> > > >> > >> > >> > > > ensemble
> > > >> > >> > >> > > > > > >> > >> verification
> > > >> > >> > >> > > > > > >> > >> > to METplus based package. In
this
> > package
> > > >> > >> > climatology
> > > >> > >> > >> > bins
> > > >> > >> > >> > > > (10
> > > >> > >> > >> > > > > > >> bins)
> > > >> > >> > >> > > > > > >> > are
> > > >> > >> > >> > > > > > >> > >> > used.
> > > >> > >> > >> > > > > > >> > >> > In current ensemble stat config
file,
> > the
> > > >> > >> relevant
> > > >> > >> > >> > entries
> > > >> > >> > >> > > > iare
> > > >> > >> > >> > > > > > >> > defined
> > > >> > >> > >> > > > > > >> > >> > like following
> > > >> > >> > >> > > > > > >> > >> >
> > > >> > >> > >> > > > > > >> > >> > ens = {
> > > >> > >> > >> > > > > > >> > >> > ens_thresh = 1.0;
> > > >> > >> > >> > > > > > >> > >> > vld_thresh = 1.0;
> > > >> > >> > >> > > > > > >> > >> >
> > > >> > >> > >> > > > > > >> > >> > field = [
> > > >> > >> > >> > > > > > >> > >> >
> > > >> > >> > >> > > > > > >> > >> > {
> > > >> > >> > >> > > > > > >> > >> > name = "HGT";
> > > >> > >> > >> > > > > > >> > >> > level = "P500";
> > > >> > >> > >> > > > > > >> > >> > obs_thresh = [
<=CDP10,
> > > >> > >CDP10&&<=CDP20,
> > > >> > >> > >> > > > > > >CDP20&&<=CDP30,
> > > >> > >> > >> > > > > > >> > >> > >CDP30&&<=CDP40,
>CDP40&&<=CDP50,
> > > >> > >> >CDP50&&<=CDP60,
> > > >> > >> > >> > > > > > >CDP60&&<=CDP70,
> > > >> > >> > >> > > > > > >> > >> > >CDP70&&<=CDP80,
>CDP80&&<=CDP90,
> >CDP90
> > > ];
> > > >> > >> > >> > > > > > >> > >> > }
> > > >> > >> > >> > > > > > >> > >> > ]
> > > >> > >> > >> > > > > > >> > >> > }
> > > >> > >> > >> > > > > > >> > >> > fcst = ens;
> > > >> > >> > >> > > > > > >> > >> > obs = fcst;
> > > >> > >> > >> > > > > > >> > >> > ens_ssvar_bin_size = 1000000;
> > > >> > >> > >> > > > > > >> > >> > ens_phist_bin_size = 0.05;
> > > >> > >> > >> > > > > > >> > >> > climo_mean = fcst;
> > > >> > >> > >> > > > > > >> > >> > climo_mean = {
> > > >> > >> > >> > > > > > >> > >> > file_name = "${CLIM_MEAN}";
> > > >> > >> > >> > > > > > >> > >> > time_interp_method =
DW_MEAN;
> > > >> > >> > >> > > > > > >> > >> > match_day = TRUE;
> > > >> > >> > >> > > > > > >> > >> > time_step = 21600;
> > > >> > >> > >> > > > > > >> > >> > }
> > > >> > >> > >> > > > > > >> > >> >
> > > >> > >> > >> > > > > > >> > >> > climo_stdev = climo_mean;
> > > >> > >> > >> > > > > > >> > >> > climo_stdev = {
> > > >> > >> > >> > > > > > >> > >> > file_name = "${CLIM_STDV}";
> > > >> > >> > >> > > > > > >> > >> > }
> > > >> > >> > >> > > > > > >> > >> >
> > > >> > >> > >> > > > > > >> > >> > climo_cdf = {
> > > >> > >> > >> > > > > > >> > >> > cdf_bins = 11;
> > > >> > >> > >> > > > > > >> > >> > center_bins = TRUE;
> > > >> > >> > >> > > > > > >> > >> > write_bins = TRUE;
> > > >> > >> > >> > > > > > >> > >> > }
> > > >> > >> > >> > > > > > >> > >> >
> > > >> > >> > >> > > > > > >> > >> > I can not find the
correspondent
> > settings
> > > in
> > > >> > its
> > > >> > >> > conf
> > > >> > >> > >> > file
> > > >> > >> > >> > > > from
> > > >> > >> > >> > > > > > >> > METplus
> > > >> > >> > >> > > > > > >> > >> > online doc.
> > > >> > >> > >> > > > > > >> > >> > Can you help me look at this?
> > > >> > >> > >> > > > > > >> > >> >
> > > >> > >> > >> > > > > > >> > >> > Thanks!
> > > >> > >> > >> > > > > > >> > >> >
> > > >> > >> > >> > > > > > >> > >> > Binbin
> > > >> > >> > >> > > > > > >> > >> >
> > > >> > >> > >> > > > > > >> > >> > --
> > > >> > >> > >> > > > > > >> > >> >
> > > >> > >> > >> > > > > > >> > >> > Binbin Zhou
> > > >> > >> > >> > > > > > >> > >> >
> > > >> > >> > >> > > > > > >> > >> > IMSG at NOAA/NWS/NCEP/EMC
> > > >> > >> > >> > > > > > >> > >> >
> > > >> > >> > >> > > > > > >> > >> > 5830 University Research Ct.
> > > >> > >> > >> > > > > > >> > >> >
> > > >> > >> > >> > > > > > >> > >> > College Park, MD 20740
> > > >> > >> > >> > > > > > >> > >> >
> > > >> > >> > >> > > > > > >> > >> > Binbin.Zhou at noaa.gov
> > > >> > >> > >> > > > > > >> > >> >
> > > >> > >> > >> > > > > > >> > >> > 301-683-3683
> > > >> > >> > >> > > > > > >> > >> >
> > > >> > >> > >> > > > > > >> > >> >
> > > >> > >> > >> > > > > > >> > >>
> > > >> > >> > >> > > > > > >> > >> --
> > > >> > >> > >> > > > > > >> > >> George McCabe - Software Engineer
III
> > > >> > >> > >> > > > > > >> > >> National Center for Atmospheric
Research
> > > >> > >> > >> > > > > > >> > >> Research Applications Laboratory
> > > >> > >> > >> > > > > > >> > >> 303-497-2768
> > > >> > >> > >> > > > > > >> > >> ---
> > > >> > >> > >> > > > > > >> > >> My working day may not be your
working
> > day.
> > > >> > Please
> > > >> > >> do
> > > >> > >> > >> not
> > > >> > >> > >> > > feel
> > > >> > >> > >> > > > > > >> obliged
> > > >> > >> > >> > > > > > >> > to
> > > >> > >> > >> > > > > > >> > >> reply to this email outside of
your
> normal
> > > >> > working
> > > >> > >> > >> hours.
> > > >> > >> > >> > > > > > >> > >>
> > > >> > >> > >> > > > > > >> > >>
> > > >> > >> > >> > > > > > >> > >
> > > >> > >> > >> > > > > > >> > > --
> > > >> > >> > >> > > > > > >> > >
> > > >> > >> > >> > > > > > >> > > Binbin Zhou
> > > >> > >> > >> > > > > > >> > >
> > > >> > >> > >> > > > > > >> > > IMSG at NOAA/NWS/NCEP/EMC
> > > >> > >> > >> > > > > > >> > >
> > > >> > >> > >> > > > > > >> > > 5830 University Research Ct.
> > > >> > >> > >> > > > > > >> > >
> > > >> > >> > >> > > > > > >> > > College Park, MD 20740
> > > >> > >> > >> > > > > > >> > >
> > > >> > >> > >> > > > > > >> > > Binbin.Zhou at noaa.gov
> > > >> > >> > >> > > > > > >> > >
> > > >> > >> > >> > > > > > >> > > 301-683-3683
> > > >> > >> > >> > > > > > >> > >
> > > >> > >> > >> > > > > > >> >
> > > >> > >> > >> > > > > > >> >
> > > >> > >> > >> > > > > > >> > --
> > > >> > >> > >> > > > > > >> >
> > > >> > >> > >> > > > > > >> > Binbin Zhou
> > > >> > >> > >> > > > > > >> >
> > > >> > >> > >> > > > > > >> > IMSG at NOAA/NWS/NCEP/EMC
> > > >> > >> > >> > > > > > >> >
> > > >> > >> > >> > > > > > >> > 5830 University Research Ct.
> > > >> > >> > >> > > > > > >> >
> > > >> > >> > >> > > > > > >> > College Park, MD 20740
> > > >> > >> > >> > > > > > >> >
> > > >> > >> > >> > > > > > >> > Binbin.Zhou at noaa.gov
> > > >> > >> > >> > > > > > >> >
> > > >> > >> > >> > > > > > >> > 301-683-3683
> > > >> > >> > >> > > > > > >> >
> > > >> > >> > >> > > > > > >> >
> > > >> > >> > >> > > > > > >>
> > > >> > >> > >> > > > > > >> --
> > > >> > >> > >> > > > > > >> George McCabe - Software Engineer III
> > > >> > >> > >> > > > > > >> National Center for Atmospheric
Research
> > > >> > >> > >> > > > > > >> Research Applications Laboratory
> > > >> > >> > >> > > > > > >> 303-497-2768
> > > >> > >> > >> > > > > > >> ---
> > > >> > >> > >> > > > > > >> My working day may not be your working
day.
> > > Please
> > > >> do
> > > >> > >> not
> > > >> > >> > >> feel
> > > >> > >> > >> > > > obliged
> > > >> > >> > >> > > > > > to
> > > >> > >> > >> > > > > > >> reply to this email outside of your
normal
> > > working
> > > >> > >> hours.
> > > >> > >> > >> > > > > > >>
> > > >> > >> > >> > > > > > >>
> > > >> > >> > >> > > > > > >
> > > >> > >> > >> > > > > > > --
> > > >> > >> > >> > > > > > >
> > > >> > >> > >> > > > > > > Binbin Zhou
> > > >> > >> > >> > > > > > >
> > > >> > >> > >> > > > > > > IMSG at NOAA/NWS/NCEP/EMC
> > > >> > >> > >> > > > > > >
> > > >> > >> > >> > > > > > > 5830 University Research Ct.
> > > >> > >> > >> > > > > > >
> > > >> > >> > >> > > > > > > College Park, MD 20740
> > > >> > >> > >> > > > > > >
> > > >> > >> > >> > > > > > > Binbin.Zhou at noaa.gov
> > > >> > >> > >> > > > > > >
> > > >> > >> > >> > > > > > > 301-683-3683
> > > >> > >> > >> > > > > > >
> > > >> > >> > >> > > > > >
> > > >> > >> > >> > > > > >
> > > >> > >> > >> > > > > > --
> > > >> > >> > >> > > > > >
> > > >> > >> > >> > > > > > Binbin Zhou
> > > >> > >> > >> > > > > >
> > > >> > >> > >> > > > > > IMSG at NOAA/NWS/NCEP/EMC
> > > >> > >> > >> > > > > >
> > > >> > >> > >> > > > > > 5830 University Research Ct.
> > > >> > >> > >> > > > > >
> > > >> > >> > >> > > > > > College Park, MD 20740
> > > >> > >> > >> > > > > >
> > > >> > >> > >> > > > > > Binbin.Zhou at noaa.gov
> > > >> > >> > >> > > > > >
> > > >> > >> > >> > > > > > 301-683-3683
> > > >> > >> > >> > > > > >
> > > >> > >> > >> > > > > >
> > > >> > >> > >> > > > >
> > > >> > >> > >> > > > > --
> > > >> > >> > >> > > > > George McCabe - Software Engineer III
> > > >> > >> > >> > > > > National Center for Atmospheric Research
> > > >> > >> > >> > > > > Research Applications Laboratory
> > > >> > >> > >> > > > > 303-497-2768
> > > >> > >> > >> > > > > ---
> > > >> > >> > >> > > > > My working day may not be your working day.
Please
> > do
> > > >> not
> > > >> > >> feel
> > > >> > >> > >> > obliged
> > > >> > >> > >> > > to
> > > >> > >> > >> > > > > reply to this email outside of your normal
working
> > > >> hours.
> > > >> > >> > >> > > > >
> > > >> > >> > >> > > > >
> > > >> > >> > >> > > >
> > > >> > >> > >> > > > --
> > > >> > >> > >> > > >
> > > >> > >> > >> > > > Binbin Zhou
> > > >> > >> > >> > > >
> > > >> > >> > >> > > > IMSG at NOAA/NWS/NCEP/EMC
> > > >> > >> > >> > > >
> > > >> > >> > >> > > > 5830 University Research Ct.
> > > >> > >> > >> > > >
> > > >> > >> > >> > > > College Park, MD 20740
> > > >> > >> > >> > > >
> > > >> > >> > >> > > > Binbin.Zhou at noaa.gov
> > > >> > >> > >> > > >
> > > >> > >> > >> > > > 301-683-3683
> > > >> > >> > >> > > >
> > > >> > >> > >> > > >
> > > >> > >> > >> > >
> > > >> > >> > >> > > --
> > > >> > >> > >> > > George McCabe - Software Engineer III
> > > >> > >> > >> > > National Center for Atmospheric Research
> > > >> > >> > >> > > Research Applications Laboratory
> > > >> > >> > >> > > 303-497-2768
> > > >> > >> > >> > > ---
> > > >> > >> > >> > > My working day may not be your working day.
Please do
> > not
> > > >> feel
> > > >> > >> > >> obliged to
> > > >> > >> > >> > > reply to this email outside of your normal
working
> > hours.
> > > >> > >> > >> > >
> > > >> > >> > >> > >
> > > >> > >> > >> >
> > > >> > >> > >> > --
> > > >> > >> > >> >
> > > >> > >> > >> > Binbin Zhou
> > > >> > >> > >> >
> > > >> > >> > >> > IMSG at NOAA/NWS/NCEP/EMC
> > > >> > >> > >> >
> > > >> > >> > >> > 5830 University Research Ct.
> > > >> > >> > >> >
> > > >> > >> > >> > College Park, MD 20740
> > > >> > >> > >> >
> > > >> > >> > >> > Binbin.Zhou at noaa.gov
> > > >> > >> > >> >
> > > >> > >> > >> > 301-683-3683
> > > >> > >> > >> >
> > > >> > >> > >> >
> > > >> > >> > >>
> > > >> > >> > >> --
> > > >> > >> > >> Julie Prestopnik (she/her)
> > > >> > >> > >> Software Engineer
> > > >> > >> > >> National Center for Atmospheric Research
> > > >> > >> > >> Research Applications Laboratory
> > > >> > >> > >> Email: jpresto at ucar.edu
> > > >> > >> > >>
> > > >> > >> > >> My working day may not be your working day. Please
do not
> > > feel
> > > >> > >> obliged
> > > >> > >> > to
> > > >> > >> > >> reply to this email outside of your normal working
hours.
> > > >> > >> > >>
> > > >> > >> > >>
> > > >> > >> > >
> > > >> > >> > > --
> > > >> > >> > >
> > > >> > >> > > Binbin Zhou
> > > >> > >> > >
> > > >> > >> > > IMSG at NOAA/NWS/NCEP/EMC
> > > >> > >> > >
> > > >> > >> > > 5830 University Research Ct.
> > > >> > >> > >
> > > >> > >> > > College Park, MD 20740
> > > >> > >> > >
> > > >> > >> > > Binbin.Zhou at noaa.gov
> > > >> > >> > >
> > > >> > >> > > 301-683-3683
> > > >> > >> > >
> > > >> > >> >
> > > >> > >> >
> > > >> > >> > --
> > > >> > >> >
> > > >> > >> > Binbin Zhou
> > > >> > >> >
> > > >> > >> > IMSG at NOAA/NWS/NCEP/EMC
> > > >> > >> >
> > > >> > >> > 5830 University Research Ct.
> > > >> > >> >
> > > >> > >> > College Park, MD 20740
> > > >> > >> >
> > > >> > >> > Binbin.Zhou at noaa.gov
> > > >> > >> >
> > > >> > >> > 301-683-3683
> > > >> > >> >
> > > >> > >> >
> > > >> > >>
> > > >> > >> --
> > > >> > >> Julie Prestopnik (she/her)
> > > >> > >> Software Engineer
> > > >> > >> National Center for Atmospheric Research
> > > >> > >> Research Applications Laboratory
> > > >> > >> Email: jpresto at ucar.edu
> > > >> > >>
> > > >> > >> My working day may not be your working day. Please do
not feel
> > > >> obliged
> > > >> > to
> > > >> > >> reply to this email outside of your normal working
hours.
> > > >> > >>
> > > >> > >>
> > > >> > >
> > > >> > > --
> > > >> > > George McCabe - Software Engineer III
> > > >> > > National Center for Atmospheric Research
> > > >> > > Research Applications Laboratory
> > > >> > > 303-497-2768
> > > >> > > ---
> > > >> > > My working day may not be your working day. Please do not
feel
> > > >> obliged to
> > > >> > > reply to this email outside of your normal working hours.
> > > >> > >
> > > >> >
> > > >> >
> > > >> > --
> > > >> >
> > > >> > Binbin Zhou
> > > >> >
> > > >> > IMSG at NOAA/NWS/NCEP/EMC
> > > >> >
> > > >> > 5830 University Research Ct.
> > > >> >
> > > >> > College Park, MD 20740
> > > >> >
> > > >> > Binbin.Zhou at noaa.gov
> > > >> >
> > > >> > 301-683-3683
> > > >> >
> > > >> >
> > > >>
> > > >> --
> > > >> George McCabe - Software Engineer III
> > > >> National Center for Atmospheric Research
> > > >> Research Applications Laboratory
> > > >> 303-497-2768
> > > >> ---
> > > >> My working day may not be your working day. Please do not
feel
> obliged
> > > to
> > > >> reply to this email outside of your normal working hours.
> > > >>
> > > >>
> > > >
> > > > --
> > > >
> > > > Binbin Zhou
> > > >
> > > > IMSG at NOAA/NWS/NCEP/EMC
> > > >
> > > > 5830 University Research Ct.
> > > >
> > > > College Park, MD 20740
> > > >
> > > > Binbin.Zhou at noaa.gov
> > > >
> > > > 301-683-3683
> > > >
> > >
> > >
> > > --
> > >
> > > Binbin Zhou
> > >
> > > IMSG at NOAA/NWS/NCEP/EMC
> > >
> > > 5830 University Research Ct.
> > >
> > > College Park, MD 20740
> > >
> > > Binbin.Zhou at noaa.gov
> > >
> > > 301-683-3683
> > >
> > >
> >
> > --
> > George McCabe - Software Engineer III
> > National Center for Atmospheric Research
> > Research Applications Laboratory
> > 303-497-2768
> > ---
> > My working day may not be your working day. Please do not feel
obliged to
> > reply to this email outside of your normal working hours.
> >
> >
>
> --
>
> Binbin Zhou
>
> IMSG at NOAA/NWS/NCEP/EMC
>
> 5830 University Research Ct.
>
> College Park, MD 20740
>
> Binbin.Zhou at noaa.gov
>
> 301-683-3683
>
>
--
George McCabe - Software Engineer III
National Center for Atmospheric Research
Research Applications Laboratory
303-497-2768
---
My working day may not be your working day. Please do not feel obliged
to
reply to this email outside of your normal working hours.
------------------------------------------------
Subject: CDP threshold setting in EnsembleStat conf
From: George McCabe
Time: Thu Jan 07 08:36:47 2021
Binbin,
I'm sorry, I had the logic confused. The logic does match the log
message.
I will let you know what John says.
- George
On Thu, Jan 7, 2021 at 8:26 AM George McCabe <mccabe at ucar.edu> wrote:
> Hi Binbin,
>
> It looks like either the debug log message is inaccurate and the
time
> offset must be "less than" the hour interval instead of "less than
or equal
> to" or the actual logic is incorrect. My guess is the latter, but I
am not
> familiar enough with that portion of the code to know what it
"should" be.
> I will let John HG know. Thanks for verifying that it does work
properly
> when the hour interval value is greater than the time offset.
>
> - George
>
> On Thu, Jan 7, 2021 at 7:19 AM Binbin.Zhou at noaa.gov via RT <
> met_help at ucar.edu> wrote:
>
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116 >
>>
>> George,
>>
>> With setting
>> day_interval = 31;
>> hour_interval = 12;
>>
>> The error message became:
>> DEBUG 3: Skipping the 19590104_000000 "HGT/P500" climatology field
since
>> the time offset (43200 seconds) >= the "hour_interval" entry (43200
>> seconds) from file:
>>
>>
/gpfs/dell2/emc/modeling/noscrub/Binbin.Zhou/g2g/com/verf/dev/ens.20210104/clim.grid3.stdv.010400.grib2
>>
>> This error seems strange. So I changed the setting
>> day_interval = 31;
>> hour_interval = 18;
>>
>> This time, the run is successful! This means the time_offset must
>> smaller than the hour_interval. SO I used a large number 18.
>> I'll do more test to see if the run is stable.
>>
>> Thanks!
>>
>> Binbin
>>
>>
>>
>>
>> On Wed, Jan 6, 2021 at 5:08 PM George McCabe via RT
<met_help at ucar.edu>
>> wrote:
>>
>> > Hi Binbin,
>> >
>> > match_day and time_step are no longer used, so they should be
removed.
>> You
>> > should replace them with:
>> >
>> > day_interval = 31;
>> > hour_interval = 12;
>> >
>> > 31 is the default for day interval. The default for hour_interval
is 6,
>> but
>> > we want it to be 12 so it finds your climo files.
>> >
>> > - George
>> >
>> > On Wed, Jan 6, 2021 at 2:39 PM Binbin.Zhou at noaa.gov via RT <
>> > met_help at ucar.edu> wrote:
>> >
>> > >
>> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116 >
>> > >
>> > > George,
>> > >
>> > > Even I deleted time_step in the climo_mean entry, this
error is
>> still
>> > > there.
>> > > So I think climo_mean=fcst should be removed and define
climo_mean
>> part
>> > > separately.
>> > > But how to define the fields (name, level) in climo_mean in
METplus
>> conf
>> > > file?
>> > > Maybe hard copy the fields for climo_mean in EnsembleGrid
config file?
>> > >
>> > > Binbin
>> > >
>> > > On Wed, Jan 6, 2021 at 4:18 PM Binbin Zhou - NOAA Affiliate <
>> > > binbin.zhou at noaa.gov> wrote:
>> > >
>> > > > George,
>> > > >
>> > > > Rerun has same error
>> > > > Skipping the 19590104_000000 "HGT/P500" climatology field
since the
>> > time
>> > > > offset (43200 seconds) >= the "hour_interval" entry (21600
seconds)
>> > from
>> > > > file:
>> > > >
>> > >
>> >
>>
/gpfs/dell2/emc/modeling/noscrub/Binbin.Zhou/g2g/com/verf/dev/ens.20210104/clim.grid3.mean.010400.grib2
>> > > >
>> > > > The new setting for climo in EnemsbleGrid config file is
>> > > > climo_mean = fcst;
>> > > > climo_mean = {
>> > > > file_name = [ ${CLIMO_MEAN_FILE} ];
>> > > > time_interp_method = DW_MEAN;
>> > > > match_day = FALSE;
>> > > > time_step = 43200;
>> > > > }
>> > > > climo_stdev = climo_mean;
>> > > > climo_stdev = {
>> > > > file_name = [ ${CLIMO_STDEV_FILE} ];
>> > > > }
>> > > >
>> > > > climo_cdf = {
>> > > > cdf_bins = 11;
>> > > > center_bins = TRUE;
>> > > > write_bins = TRUE;
>> > > > }
>> > > >
>> > > > It seems time_step is not effective?
>> > > >
>> > > > Binbin
>> > > >
>> > > > On Wed, Jan 6, 2021 at 3:15 PM George McCabe via RT <
>> met_help at ucar.edu
>> > >
>> > > > wrote:
>> > > >
>> > > >> Hi Binbin,
>> > > >>
>> > > >> Thanks for sending the updated logs. It looks like your
climatology
>> > > fields
>> > > >> are not being read properly. I think this line explains the
>> problem:
>> > > >>
>> > > >> DEBUG 3: Skipping the 19590104_000000 "HGT/P500" climatology
field
>> > since
>> > > >> the time offset (43200 seconds) >= the "hour_interval" entry
(21600
>> > > >> seconds) from file:
>> > > >>
>> > > >>
>> > >
>> >
>>
/gpfs/dell2/emc/modeling/noscrub/Binbin.Zhou/g2g/com/verf/dev/ens.20210104/clim.grid3.stdv.010400.grib2
>> > > >>
>> > > >> The variables match_day and time_step in your climo_mean
dictionary
>> > are
>> > > >> actually no longer used and have been replaced with:
>> > > >>
>> > > >> day_interval = 31;
>> > > >> hour_interval = 6;
>> > > >>
>> > > >> 21600 seconds is 6 hours and it sounds like your climo field
is
>> offset
>> > > by
>> > > >> 12 hours. I believe setting hour_interval to 12 should allow
it to
>> > find
>> > > >> the
>> > > >> climatology field and compute the statistics properly. Let
me know
>> if
>> > it
>> > > >> does not.
>> > > >>
>> > > >> Thanks,
>> > > >> George
>> > > >>
>> > > >> On Wed, Jan 6, 2021 at 12:43 PM Binbin.Zhou at noaa.gov via RT
<
>> > > >> met_help at ucar.edu> wrote:
>> > > >>
>> > > >> >
>> > > >> > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116 >
>> > > >> >
>> > > >> > George,
>> > > >> >
>> > > >> > I have re-run the case with LOG_LEVEL=DEBUG and
>> > > >> > LOG_ENSEMBLE_STAT_VERBOSITY =3.
>> > > >> > The output log file has been sent to hera:
>> > > >> >
>> > > >> >
>> > > >>
>> > >
>> >
>> /scratch2/NCEPDEV/fv3-
cam/noscrub/Binbin.Zhou/metplus_test/metplus3.out/log/master_metplus.log.20210106193455
>> > > >> >
>> > > >> > Please look at it.
>> > > >> >
>> > > >> > Thanks!
>> > > >> >
>> > > >> > Biinbin
>> > > >> >
>> > > >> > On Wed, Jan 6, 2021 at 2:19 PM George McCabe
<mccabe at ucar.edu>
>> > wrote:
>> > > >> >
>> > > >> > > Hi Binbin,
>> > > >> > >
>> > > >> > > Thanks for putting those files on hera. The log output
you sent
>> > > >> doesn't
>> > > >> > > have the DEBUG level output (LOG_LEVEL=DEBUG). However,
I
>> tried to
>> > > run
>> > > >> > > EnsembleStat locally using the _OPTIONS value you set
and it
>> seems
>> > > to
>> > > >> run
>> > > >> > > fine. The error seems to suggest that something went
wrong when
>> > > >> computing
>> > > >> > > the mean and standard deviation before the obs_thresh
values
>> are
>> > > >> > applied. I
>> > > >> > > have reached out to John HG to see if he has any insight
as to
>> why
>> > > >> that
>> > > >> > is
>> > > >> > > happening. In the meantime, you could rerun with
>> > > >> > > LOG_ENSEMBLE_STAT_VERBOSITY set to a higher value than
2 to
>> see
>> > if
>> > > >> the
>> > > >> > > extra log output from the MET tool gives you any more
insight
>> as
>> > to
>> > > >> what
>> > > >> > is
>> > > >> > > going wrong.
>> > > >> > >
>> > > >> > > - George
>> > > >> > >
>> > > >> > > On Wed, Jan 6, 2021 at 9:51 AM Julie Prestopnik via RT <
>> > > >> > met_help at ucar.edu>
>> > > >> > > wrote:
>> > > >> > >
>> > > >> > >> Thanks for all of the info Binbin. I saw that you had
copied
>> > > >> everything
>> > > >> > >> to
>> > > >> > >> hera for George. I am currently no longer on WCOSS, so
I
>> unless
>> > > >> George
>> > > >> > >> lets me know that he needs something from WCOSS, I'll
assume
>> he
>> > is
>> > > >> able
>> > > >> > to
>> > > >> > >> get it from hera.
>> > > >> > >>
>> > > >> > >> Julie
>> > > >> > >>
>> > > >> > >> On Wed, Jan 6, 2021 at 9:39 AM Binbin.Zhou at noaa.gov via
RT <
>> > > >> > >> met_help at ucar.edu> wrote:
>> > > >> > >>
>> > > >> > >> >
>> > > >> > >> > <URL:
>> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
>> > >
>> > > >> > >> >
>> > > >> > >> > The EnsembleStat config file for the successful run
outside
>> of
>> > > >> METplus
>> > > >> > >> is
>> > > >> > >> >
>> > > >> > >> >
>> > > >> > >>
>> > > >> >
>> > > >>
>> > >
>> >
>>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_met_global_ens1p0.v1.0.0/parm/verf_g2g_ens_stat_config_bin11
>> > > >> > >> > on WCOSS
>> > > >> > >> >
>> > > >> > >> > Binbin
>> > > >> > >> >
>> > > >> > >> > On Wed, Jan 6, 2021 at 11:34 AM Binbin Zhou - NOAA
>> Affiliate <
>> > > >> > >> > binbin.zhou at noaa.gov> wrote:
>> > > >> > >> >
>> > > >> > >> > > Julie,
>> > > >> > >> > >
>> > > >> > >> > > The output directory on WCOSS is
>> > > >> > >> > >
>> > > >> > >> > >
>> > > >> > >> >
>> > > >> > >>
>> > > >> >
>> > > >>
>> > >
>> >
>>
/gpfs/dell1/ptmp/Binbin.Zhou/g2g/RFC2/tmpnwprd/verf_g2g_gefs_00_dev.161076/metplus3.out
>> > > >> > >> > >
>> > > >> > >> > > My METplus package on WCOSS is
>> > > >> > >> > >
>> > > >> > >> >
>> > > >> > >>
>> > > >> >
>> > > >>
>> > >
>> >
>>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_g2g.v4.0.0
>> > > >> > >> > >
>> > > >> > >> > > For GEFS, the EnsembleGrid config file is
>> > > >> > >> > >
>> > > >> > >> > >
>> > > >> > >> >
>> > > >> > >>
>> > > >> >
>> > > >>
>> > >
>> >
>>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_g2g.v4.0.0/parm/app_conf/grid2grid/met_config/EnsembleStatConfig_gefs_bin11
>> > > >> > >> > > Its conf file
>> > > >> > >> > > is
>> > > >> > >> >
>> > > >> > >>
>> > > >> >
>> > > >>
>> > >
>> >
>>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_g2g.v4.0.0/parm/app_conf/grid2grid/gefs_conf/gefs_bin11.conf
>> > > >> > >> > >
>> > > >> > >> > > The running process is little bit complex since
this is a
>> > > >> transition
>> > > >> > >> to
>> > > >> > >> > > future operational package that uses
>> > > >> > >> > > mpi parallel: the script is
>> > > >> > >> > >
>> > > >> > >> > >
>> > > >> > >> >
>> > > >> > >>
>> > > >> >
>> > > >>
>> > >
>> >
>>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_g2g.v4.0.0/ush/verf_g2g_metplus_run_gefs_mpi.sh
>> > > >> > >> > >
>> > > >> > >> > > Binbin
>> > > >> > >> > >
>> > > >> > >> > >
>> > > >> > >> > >
>> > > >> > >> > >
>> > > >> > >> > > On Wed, Jan 6, 2021 at 11:00 AM Julie Prestopnik
via RT <
>> > > >> > >> > met_help at ucar.edu>
>> > > >> > >> > > wrote:
>> > > >> > >> > >
>> > > >> > >> > >> Hi Binbin.
>> > > >> > >> > >>
>> > > >> > >> > >> This is Julie. I haven't been following this
entire
>> thread,
>> > > >> but I
>> > > >> > >> am on
>> > > >> > >> > >> WCOSS right now. If you send a path to a file, I
can
>> pull
>> > it
>> > > >> and
>> > > >> > >> put it
>> > > >> > >> > >> on
>> > > >> > >> > >> our ftp server for George.
>> > > >> > >> > >>
>> > > >> > >> > >> Julie
>> > > >> > >> > >>
>> > > >> > >> > >> On Wed, Jan 6, 2021 at 8:57 AM
Binbin.Zhou at noaa.gov via
>> RT
>> > <
>> > > >> > >> > >> met_help at ucar.edu> wrote:
>> > > >> > >> > >>
>> > > >> > >> > >> >
>> > > >> > >> > >> > <URL:
>> > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
>> > > >> >
>> > > >> > >> > >> >
>> > > >> > >> > >> > George,
>> > > >> > >> > >> >
>> > > >> > >> > >> > Can you access WCOSS or access HERA?
>> > > >> > >> > >> > Otherwise I will email attached to you
>> > > >> > >> > >> >
>> > > >> > >> > >> > Binbin
>> > > >> > >> > >> >
>> > > >> > >> > >> >
>> > > >> > >> > >> >
>> > > >> > >> > >> > On Wed, Jan 6, 2021 at 10:46 AM George McCabe
via RT <
>> > > >> > >> > met_help at ucar.edu
>> > > >> > >> > >> >
>> > > >> > >> > >> > wrote:
>> > > >> > >> > >> >
>> > > >> > >> > >> > > Hi Binbin,
>> > > >> > >> > >> > >
>> > > >> > >> > >> > > Could you send me a log file for a run with
>> > > LOG_LEVEL=DEBUG
>> > > >> (in
>> > > >> > >> > >> METplus
>> > > >> > >> > >> > > config) so I can see how the environment
variable
>> > > ENS_FIELD
>> > > >> is
>> > > >> > >> set?
>> > > >> > >> > >> The
>> > > >> > >> > >> > > values of ENS_VAR<n>_* are formatted and set
in this
>> > > >> > environment
>> > > >> > >> > >> variable
>> > > >> > >> > >> > > which is passed into the MET config. You can
compare
>> > that
>> > > >> value
>> > > >> > >> with
>> > > >> > >> > >> what
>> > > >> > >> > >> > > you used in your successful run outside of the
>> METplus
>> > > >> wrapper
>> > > >> > to
>> > > >> > >> > >> > determine
>> > > >> > >> > >> > > what is different.
>> > > >> > >> > >> > >
>> > > >> > >> > >> > > Thanks,
>> > > >> > >> > >> > > George
>> > > >> > >> > >> > >
>> > > >> > >> > >> > > On Wed, Jan 6, 2021 at 7:11 AM
Binbin.Zhou at noaa.gov
>> via
>> > > RT
>> > > >> <
>> > > >> > >> > >> > > met_help at ucar.edu> wrote:
>> > > >> > >> > >> > >
>> > > >> > >> > >> > > >
>> > > >> > >> > >> > > > <URL:
>> > > >> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
>> > > >> > >> >
>> > > >> > >> > >> > > >
>> > > >> > >> > >> > > > George,
>> > > >> > >> > >> > > >
>> > > >> > >> > >> > > > I got a new error in execution although
some
>> output
>> > > >> files
>> > > >> > (nc
>> > > >> > >> > >> file)
>> > > >> > >> > >> > are
>> > > >> > >> > >> > > > created but stat files not.
>> > > >> > >> > >> > > > The error message is
>> > > >> > >> > >> > > >
>> > > >> > >> > >> > > > ERROR :
>> > > >> > >> > >> > > > ERROR : Simple_Node::check(double, double,
double)
>> > > const
>> > > >> ->
>> > > >> > >> > >> > > climatological
>> > > >> > >> > >> > > > distribution percentile threshold "<=CDP10"
>> requested
>> > > with
>> > > >> > >> invalid
>> > > >> > >> > >> mean
>> > > >> > >> > >> > > > (-9999) or standard deviation (-9999).
>> > > >> > >> > >> > > > ERROR :
>> > > >> > >> > >> > > >
>> > > >> > >> > >> > > > Such an error was ever investigated by John
H
>> before
>> > > (year
>> > > >> > >> ago):
>> > > >> > >> > >> When I
>> > > >> > >> > >> > > > directly ran ensemble_stat for global
ensemble (not
>> > > >> > >> METplus-based,
>> > > >> > >> > >> > > > but hard code of all settings in
EnsembleStat
>> config
>> > > >> file):
>> > > >> > If
>> > > >> > >> > hard
>> > > >> > >> > >> > code
>> > > >> > >> > >> > > > fcst field in EnsembleStat config file like
this
>> > > >> > >> > >> > > >
>> > > >> > >> > >> > > > name = "HGT";
>> > > >> > >> > >> > > > level = "P500";
>> > > >> > >> > >> > > > cat_thresh = [ <=CDP10,
>CDP10&&<=CDP20,
>> > > >> > >> >CDP20&&<=CDP30,
>> > > >> > >> > >> > > > >CDP30&&<=CDP40, >CDP40&&<=CDP50,
>CDP50&&<=CDP60,
>> > > >> > >> > >CDP60&&<=CDP70,
>> > > >> > >> > >> > > > >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];
>> > > >> > >> > >> > > >
>> > > >> > >> > >> > > > Run ensemble_stat will have such error:
ERROR :
>> > > >> > >> > >> > > > Simple_Node::check(double, double, double)
const ->
>> > > >> > >> climatological
>> > > >> > >> > >> > > > distribution percentile threshold "<=CDP10"
>> requested
>> > > with
>> > > >> > >> invalid
>> > > >> > >> > >> mean
>> > > >> > >> > >> > > > (-9999) or standard deviation (-9999).
>> > > >> > >> > >> > > >
>> > > >> > >> > >> > > > John H. suggested me change "cat_thresh = "
to
>> > > >> "obs_thresh =
>> > > >> > >> ",
>> > > >> > >> > >> then
>> > > >> > >> > >> > > the
>> > > >> > >> > >> > > > error was solved.
>> > > >> > >> > >> > > >
>> > > >> > >> > >> > > > In current METplus version, following your
>> suggestion
>> > as
>> > > >> > >> > >> > > >
>> > > >> > >> > >> > > > ENS_VAR1_OPTIONS = obs_thresh = [ <=CDP10,
>> > > >> >CDP10&&<=CDP20,
>> > > >> > >> > >> > > > >CDP20&&<=CDP30, >CDP30&&<=CDP40,
>CDP40&&<=CDP50,
>> > > >> > >> > >CDP50&&<=CDP60,
>> > > >> > >> > >> > > > >CDP60&&<=CDP70, >CDP70&&<=CDP80,
>CDP80&&<=CDP90,
>> > > >CDP90
>> > > >> ];
>> > > >> > >> > >> > > >
>> > > >> > >> > >> > > > the same error appears again. So I am not
for sure
>> > if
>> > > >> the
>> > > >> > >> > >> > "obs_thresh"
>> > > >> > >> > >> > > > setting is correctly passed.
>> > > >> > >> > >> > > >
>> > > >> > >> > >> > > > Binbin
>> > > >> > >> > >> > > >
>> > > >> > >> > >> > > >
>> > > >> > >> > >> > > >
>> > > >> > >> > >> > > >
>> > > >> > >> > >> > > > On Tue, Jan 5, 2021 at 5:19 PM George McCabe
via
>> RT <
>> > > >> > >> > >> met_help at ucar.edu
>> > > >> > >> > >> > >
>> > > >> > >> > >> > > > wrote:
>> > > >> > >> > >> > > >
>> > > >> > >> > >> > > > > Hi Binbin,
>> > > >> > >> > >> > > > >
>> > > >> > >> > >> > > > > Your solution should work for now. It
looks like
>> > > >> although
>> > > >> > the
>> > > >> > >> > >> METplus
>> > > >> > >> > >> > > > > variable does get read properly, the
environment
>> > > >> variable
>> > > >> > is
>> > > >> > >> not
>> > > >> > >> > >> > > actually
>> > > >> > >> > >> > > > > set by the EnsembleStat wrapper. I can
make a
>> note
>> > to
>> > > >> add
>> > > >> > >> that
>> > > >> > >> > for
>> > > >> > >> > >> > > 4.0.0,
>> > > >> > >> > >> > > > > as it is an easy fix.
>> > > >> > >> > >> > > > >
>> > > >> > >> > >> > > > > - George
>> > > >> > >> > >> > > > >
>> > > >> > >> > >> > > > > On Tue, Jan 5, 2021 at 2:53 PM
>> Binbin.Zhou at noaa.gov
>> > > via
>> > > >> > RT <
>> > > >> > >> > >> > > > > met_help at ucar.edu> wrote:
>> > > >> > >> > >> > > > >
>> > > >> > >> > >> > > > > > George,
>> > > >> > >> > >> > > > > >
>> > > >> > >> > >> > > > > > I have a temporal solution:
>> > > >> > >> > >> > > > > > set ploy in EnembleStat config as
>> > > >> > >> > >> > > > > > poly = [ "${MASKPATH}/lat_NHM.nc",
>> > > >> > >> > >> > > > > > "${MASKPATH}/lat_NHM.nc",
>> > > >> > >> > >> > > > > > "${MASKPATH}/lat_TRP.nc"
];
>> > > >> > >> > >> > > > > >
>> > > >> > >> > >> > > > > > then set MASKPATH in user_env_vars part
in the
>> > conf
>> > > >> file
>> > > >> > >> > >> > > > > > This MASKPAH then can be passed to
>> EnsembleStat's
>> > > >> poly [
>> > > >> > ]
>> > > >> > >> > entry
>> > > >> > >> > >> > > > > >
>> > > >> > >> > >> > > > > > Binbin
>> > > >> > >> > >> > > > > >
>> > > >> > >> > >> > > > > > On Tue, Jan 5, 2021 at 4:25 PM Binbin
Zhou -
>> NOAA
>> > > >> > >> Affiliate <
>> > > >> > >> > >> > > > > > binbin.zhou at noaa.gov> wrote:
>> > > >> > >> > >> > > > > >
>> > > >> > >> > >> > > > > > > George,
>> > > >> > >> > >> > > > > > >
>> > > >> > >> > >> > > > > > > Still not working, error says
>> > > >> > >> > >> > > > > > > ERROR : replace_env() -> unable to
get
>> value
>> > for
>> > > >> > >> > environment
>> > > >> > >> > >> > > > variable
>> > > >> > >> > >> > > > > > > "VERIF_MASK"
>> > > >> > >> > >> > > > > > >
>> > > >> > >> > >> > > > > > > Binbin
>> > > >> > >> > >> > > > > > >
>> > > >> > >> > >> > > > > > >
>> > > >> > >> > >> > > > > > >
>> > > >> > >> > >> > > > > > > On Tue, Jan 5, 2021 at 3:50 PM George
McCabe
>> via
>> > > RT
>> > > >> <
>> > > >> > >> > >> > > > met_help at ucar.edu
>> > > >> > >> > >> > > > > >
>> > > >> > >> > >> > > > > > > wrote:
>> > > >> > >> > >> > > > > > >
>> > > >> > >> > >> > > > > > >> Hi Binbin,
>> > > >> > >> > >> > > > > > >>
>> > > >> > >> > >> > > > > > >> You should be able to set it in the
METplus
>> > > config
>> > > >> the
>> > > >> > >> same
>> > > >> > >> > >> way
>> > > >> > >> > >> > it
>> > > >> > >> > >> > > > is
>> > > >> > >> > >> > > > > > done
>> > > >> > >> > >> > > > > > >> for GridStat -- no quotes with commas
>> between
>> > > each
>> > > >> > item.
>> > > >> > >> > The
>> > > >> > >> > >> > > wrapper
>> > > >> > >> > >> > > > > > >> should
>> > > >> > >> > >> > > > > > >> format it properly.
>> > > >> > >> > >> > > > > > >>
>> > > >> > >> > >> > > > > > >> Here is an example from an existing
use
>> case:
>> > > >> > >> > >> > > > > > >>
>> > > >> > >> > >> > > > > > >> GRID_STAT_VERIFICATION_MASK_TEMPLATE
=
>> > > >> > >> > >> > > > > > >>
>> > > >> > >> > >> > >
>> > > >> > >>
>> > >
{INPUT_BASE}/model_applications/precipitation/mask/CONUS_HRRRTLE.nc,
>> > > >> > >> > >> > > > > > >>
>> > > >> > >> > >> > >
>> > > >> > >>
>> >
{INPUT_BASE}/model_applications/precipitation/mask/EAST_HRRRTLE.nc,
>> > > >> > >> > >> > > > > > >>
>> > > >> > >> > >> >
>> > > >> >
>> {INPUT_BASE}/model_applications/precipitation/mask/WEST_HRRRTLE.nc
>> > > >> > >> > >> > > > > > >>
>> > > >> > >> > >> > > > > > >> You should be able to set them the
same way
>> > using
>> > > >> > >> > >> > > > > > >>
ENSEMBLE_STAT_VERIFICATION_MASK_TEMPLATE.
>> Let
>> > me
>> > > >> know
>> > > >> > if
>> > > >> > >> > that
>> > > >> > >> > >> > > > doesn't
>> > > >> > >> > >> > > > > > >> work.
>> > > >> > >> > >> > > > > > >>
>> > > >> > >> > >> > > > > > >> - George
>> > > >> > >> > >> > > > > > >>
>> > > >> > >> > >> > > > > > >> On Tue, Jan 5, 2021 at 1:45 PM
>> > > >> Binbin.Zhou at noaa.gov
>> > > >> > via
>> > > >> > >> > RT <
>> > > >> > >> > >> > > > > > >> met_help at ucar.edu> wrote:
>> > > >> > >> > >> > > > > > >>
>> > > >> > >> > >> > > > > > >> >
>> > > >> > >> > >> > > > > > >> > <URL:
>> > > >> > >> > >>
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
>> > > >> > >> > >> > >
>> > > >> > >> > >> > > > > > >> >
>> > > >> > >> > >> > > > > > >> > George,
>> > > >> > >> > >> > > > > > >> >
>> > > >> > >> > >> > > > > > >> > I got another issue for
verification
>> mask
>> > > >> setting.
>> > > >> > >> > >> > > > > > >> >
>> > > >> > >> > >> > > > > > >> > I am using $VERIF_MASK in
EnsembleStat
>> config
>> > > >> f/ile
>> > > >> > >> > >> > > > > > >> > mask = {
>> > > >> > >> > >> > > > > > >> > grid = [];
>> > > >> > >> > >> > > > > > >> > poly = [${VERIF_MASK}];
>> > > >> > >> > >> > > > > > >> > sid = [];
>> > > >> > >> > >> > > > > > >> > }
>> > > >> > >> > >> > > > > > >> >
>> > > >> > >> > >> > > > > > >> > And using
>> > GRID_STAT_VERIFICATION_MASK_TEMPLATE
>> > > >> to
>> > > >> > >> define
>> > > >> > >> > >> > > several
>> > > >> > >> > >> > > > > > >> polygon
>> > > >> > >> > >> > > > > > >> > nc mask files
>> > > >> > >> > >> > > > > > >> > But it seems not working. But it
works for
>> > > >> Gridstat
>> > > >> > >> > config
>> > > >> > >> > >> in
>> > > >> > >> > >> > > > suich
>> > > >> > >> > >> > > > > > >> > setting.
>> > > >> > >> > >> > > > > > >> > I can not find ENSEMBLE_STAT_
>> > > >> > >> VERIFICATION_MASK_TEMPLATE
>> > > >> > >> > in
>> > > >> > >> > >> > the
>> > > >> > >> > >> > > > > > METplus
>> > > >> > >> > >> > > > > > >> doc
>> > > >> > >> > >> > > > > > >> >
>> > > >> > >> > >> > > > > > >> > So I define VERIF_MASK in
[user_env_vars]
>> > part.
>> > > >> > >> > >> > > > > > >> > It values can not be passed to ploy
=
>> > > >> > [${VERIF_MASK}]
>> > > >> > >> in
>> > > >> > >> > >> the
>> > > >> > >> > >> > > > > > >> EnsembleStat
>> > > >> > >> > >> > > > > > >> > conf if more than one nc files
included.
>> > > >> > >> > >> > > > > > >> > For example
>> > > >> > >> > >> > > > > > >> > VERIF_MASK=" '/part/p1.cn',
'/path/p2.nc'
>> "
>> > > >> > >> > >> > > > > > >> > the error says poly = [/path/p1,]
>> > > >> > >> > >> > > > > > >> > It seems double quote or single
quote can
>> not
>> > > be
>> > > >> > >> passed
>> > > >> > >> > to
>> > > >> > >> > >> > > > > VERIF_MASK
>> > > >> > >> > >> > > > > > in
>> > > >> > >> > >> > > > > > >> > the EnsembleStat config.
>> > > >> > >> > >> > > > > > >> > I tried use back slash \ to before
quote,
>> but
>> > > >> still
>> > > >> > >> not
>> > > >> > >> > >> > working
>> > > >> > >> > >> > > > > > >> >
>> > > >> > >> > >> > > > > > >> > Binbin
>> > > >> > >> > >> > > > > > >> >
>> > > >> > >> > >> > > > > > >> >
>> > > >> > >> > >> > > > > > >> > On Tue, Jan 5, 2021 at 10:33 AM
Binbin
>> Zhou -
>> > > >> NOAA
>> > > >> > >> > >> Affiliate <
>> > > >> > >> > >> > > > > > >> > binbin.zhou at noaa.gov> wrote:
>> > > >> > >> > >> > > > > > >> >
>> > > >> > >> > >> > > > > > >> > > George,
>> > > >> > >> > >> > > > > > >> > >
>> > > >> > >> > >> > > > > > >> > > Thanks for your quick response!
I'll
>> > test
>> > > >> this
>> > > >> > >> > >> settings
>> > > >> > >> > >> > and
>> > > >> > >> > >> > > > let
>> > > >> > >> > >> > > > > > >> > > you know the results.
>> > > >> > >> > >> > > > > > >> > >
>> > > >> > >> > >> > > > > > >> > > Binbin
>> > > >> > >> > >> > > > > > >> > >
>> > > >> > >> > >> > > > > > >> > > On Tue, Jan 5, 2021 at 10:17 AM
George
>> > McCabe
>> > > >> via
>> > > >> > >> RT <
>> > > >> > >> > >> > > > > > >> met_help at ucar.edu>
>> > > >> > >> > >> > > > > > >> > > wrote:
>> > > >> > >> > >> > > > > > >> > >
>> > > >> > >> > >> > > > > > >> > >> Hi Binbin,
>> > > >> > >> > >> > > > > > >> > >>
>> > > >> > >> > >> > > > > > >> > >> Happy New Year to you too!
>> > > >> > >> > >> > > > > > >> > >>
>> > > >> > >> > >> > > > > > >> > >> I will comment on each
configuration
>> > > variable
>> > > >> and
>> > > >> > >> how
>> > > >> > >> > to
>> > > >> > >> > >> > set
>> > > >> > >> > >> > > it
>> > > >> > >> > >> > > > > in
>> > > >> > >> > >> > > > > > a
>> > > >> > >> > >> > > > > > >> > >> METplus config inline:
>> > > >> > >> > >> > > > > > >> > >>
>> > > >> > >> > >> > > > > > >> > >> ens = {
>> > > >> > >> > >> > > > > > >> > >> ens_thresh = 1.0;
>> > > >> > >> > >> > > > > > >> > >>
>> > > >> > >> > >> > > > > > >> > >>
>> > > >> > >> > >> > > > > > >> > >> *This is controlled by the
>> > > >> > ENSEMBLE_STAT_ENS_THRESH
>> > > >> > >> > >> > variable.
>> > > >> > >> > >> > > > The
>> > > >> > >> > >> > > > > > >> > default
>> > > >> > >> > >> > > > > > >> > >> value is 1.0, so you don't need
to
>> include
>> > > it
>> > > >> in
>> > > >> > >> your
>> > > >> > >> > >> > config
>> > > >> > >> > >> > > > > file,
>> > > >> > >> > >> > > > > > >> but
>> > > >> > >> > >> > > > > > >> > you
>> > > >> > >> > >> > > > > > >> > >> can if you may adjust this value
at
>> some
>> > > >> point.*
>> > > >> > >> > >> > > > > > >> > >>
>> > > >> > >> > >> > > > > > >> > >> vld_thresh = 1.0;
>> > > >> > >> > >> > > > > > >> > >>
>> > > >> > >> > >> > > > > > >> > >> *This value is set to 1.0 by
default
>> so we
>> > > >> don't
>> > > >> > >> need
>> > > >> > >> > to
>> > > >> > >> > >> > > worry
>> > > >> > >> > >> > > > > > about
>> > > >> > >> > >> > > > > > >> it
>> > > >> > >> > >> > > > > > >> > >> right now.*
>> > > >> > >> > >> > > > > > >> > >>
>> > > >> > >> > >> > > > > > >> > >> field = [
>> > > >> > >> > >> > > > > > >> > >>
>> > > >> > >> > >> > > > > > >> > >> {
>> > > >> > >> > >> > > > > > >> > >> name = "HGT";
>> > > >> > >> > >> > > > > > >> > >> level = "P500";
>> > > >> > >> > >> > > > > > >> > >> obs_thresh = [ <=CDP10,
>> > > >> >CDP10&&<=CDP20,
>> > > >> > >> > >> > > > > >CDP20&&<=CDP30,
>> > > >> > >> > >> > > > > > >> > >> >CDP30&&<=CDP40,
>CDP40&&<=CDP50,
>> > > >> > >CDP50&&<=CDP60,
>> > > >> > >> > >> > > > > >CDP60&&<=CDP70,
>> > > >> > >> > >> > > > > > >> > >> >CDP70&&<=CDP80,
>CDP80&&<=CDP90,
>> >CDP90
>> > ];
>> > > >> > >> > >> > > > > > >> > >> }
>> > > >> > >> > >> > > > > > >> > >> ]
>> > > >> > >> > >> > > > > > >> > >> }
>> > > >> > >> > >> > > > > > >> > >> fcst = ens;
>> > > >> > >> > >> > > > > > >> > >> obs = fcst;
>> > > >> > >> > >> > > > > > >> > >>
>> > > >> > >> > >> > > > > > >> > >> *1) The field info for ens is
set in
>> the
>> > > >> > >> > >> > > > > > >> > >>
ENS_VAR<n>_[NAME/LEVEL/THRESH/OPTIONS]
>> > > >> variables.
>> > > >> > >> The
>> > > >> > >> > >> fcst
>> > > >> > >> > >> > > and
>> > > >> > >> > >> > > > > obs
>> > > >> > >> > >> > > > > > >> field
>> > > >> > >> > >> > > > > > >> > >> info are set in the
corresponding
>> > > >> FCST_VAR<n>_*
>> > > >> > and
>> > > >> > >> > >> > > > OBS_VAR<n>_*
>> > > >> > >> > >> > > > > > >> > variables
>> > > >> > >> > >> > > > > > >> > >> respectively, or you can use
>> BOTH_VAR<n>_*
>> > > if
>> > > >> the
>> > > >> > >> FCST
>> > > >> > >> > >> and
>> > > >> > >> > >> > > OBS
>> > > >> > >> > >> > > > > > values
>> > > >> > >> > >> > > > > > >> > are
>> > > >> > >> > >> > > > > > >> > >> the same.*
>> > > >> > >> > >> > > > > > >> > >>
>> > > >> > >> > >> > > > > > >> > >> *If ENS_VAR<n>_* variables are
not
>> > > explicitly
>> > > >> > set,
>> > > >> > >> > then
>> > > >> > >> > >> it
>> > > >> > >> > >> > > will
>> > > >> > >> > >> > > > > use
>> > > >> > >> > >> > > > > > >> the
>> > > >> > >> > >> > > > > > >> > >> values from FCST_VAR<n>_*.*
>> > > >> > >> > >> > > > > > >> > >> *Since the fcst, obs, and ens
are all
>> the
>> > > same
>> > > >> > you
>> > > >> > >> > could
>> > > >> > >> > >> > just
>> > > >> > >> > >> > > > use
>> > > >> > >> > >> > > > > > >> > >> BOTH_VAR<n>_* variables to
control all
>> 3,
>> > > >> > although
>> > > >> > >> > keep
>> > > >> > >> > >> in
>> > > >> > >> > >> > > mind
>> > > >> > >> > >> > > > > > that
>> > > >> > >> > >> > > > > > >> if
>> > > >> > >> > >> > > > > > >> > >> you
>> > > >> > >> > >> > > > > > >> > >> need to change one of them for
any
>> reason,
>> > > it
>> > > >> > will
>> > > >> > >> be
>> > > >> > >> > >> more
>> > > >> > >> > >> > > > > > difficult
>> > > >> > >> > >> > > > > > >> to
>> > > >> > >> > >> > > > > > >> > do
>> > > >> > >> > >> > > > > > >> > >> this. If you know that they will
>> always be
>> > > the
>> > > >> > same
>> > > >> > >> > >> values,
>> > > >> > >> > >> > > > then
>> > > >> > >> > >> > > > > I
>> > > >> > >> > >> > > > > > >> > >> recommend using BOTH_, but if
you know
>> > they
>> > > >> may
>> > > >> > >> change
>> > > >> > >> > >> or
>> > > >> > >> > >> > are
>> > > >> > >> > >> > > > > > >> unsure, I
>> > > >> > >> > >> > > > > > >> > >> would recommend setting them by
>> > referencing
>> > > >> the
>> > > >> > >> other
>> > > >> > >> > >> > > > variables,
>> > > >> > >> > >> > > > > > >> i.e.*
>> > > >> > >> > >> > > > > > >> > >>
>> > > >> > >> > >> > > > > > >> > >> *FCST_VAR1_NAME = HGT*
>> > > >> > >> > >> > > > > > >> > >> *FCST_VAR1_LEVELS = P500 *
>> > > >> > >> > >> > > > > > >> > >> *OBS_VAR1_NAME =
{FCST_VAR1_NAME}*
>> > > >> > >> > >> > > > > > >> > >> *OBS_VAR1_LEVELS =
{FCST_VAR1_LEVELS}*
>> > > >> > >> > >> > > > > > >> > >>
>> > > >> > >> > >> > > > > > >> > >> *2) The
[FCST/OBS/ENS]_VAR<n>_THRESH
>> > > variables
>> > > >> > set
>> > > >> > >> the
>> > > >> > >> > >> > > > cat_thresh
>> > > >> > >> > >> > > > > > >> values
>> > > >> > >> > >> > > > > > >> > >> in
>> > > >> > >> > >> > > > > > >> > >> the field info. A variable
specific to
>> > > >> obs_thresh
>> > > >> > >> is
>> > > >> > >> > not
>> > > >> > >> > >> > > > > currently
>> > > >> > >> > >> > > > > > >> > >> supported, however you can set
these
>> > values
>> > > by
>> > > >> > >> using
>> > > >> > >> > the
>> > > >> > >> > >> > > > > > >> > ENS_VAR1_OPTIONS
>> > > >> > >> > >> > > > > > >> > >> variable, i.e.*
>> > > >> > >> > >> > > > > > >> > >>
>> > > >> > >> > >> > > > > > >> > >> *ENS_VAR1_OPTIONS = obs_thresh =
[
>> > <=CDP10,
>> > > >> > >> > >> > >CDP10&&<=CDP20,
>> > > >> > >> > >> > > > > > >> > >> >CDP20&&<=CDP30,
>CDP30&&<=CDP40,
>> > > >> > >CDP40&&<=CDP50,
>> > > >> > >> > >> > > > > >CDP50&&<=CDP60,
>> > > >> > >> > >> > > > > > >> > >> >CDP60&&<=CDP70,
>CDP70&&<=CDP80,
>> > > >> > >CDP80&&<=CDP90,
>> > > >> > >> > >> >CDP90
>> > > >> > >> > >> > ];*
>> > > >> > >> > >> > > > > > >> > >>
>> > > >> > >> > >> > > > > > >> > >>
>> > > >> > >> > >> > > > > > >> > >> *Remember to include the
semicolon at
>> the
>> > > >> end! *
>> > > >> > >> > >> > > > > > >> > >>
>> > > >> > >> > >> > > > > > >> > >> ens_ssvar_bin_size = 1000000;
>> > > >> > >> > >> > > > > > >> > >> *1) This variable is different
from the
>> > > >> default
>> > > >> > and
>> > > >> > >> > not
>> > > >> > >> > >> > > > currently
>> > > >> > >> > >> > > > > > >> > >> supported
>> > > >> > >> > >> > > > > > >> > >> with a METplus config variable.
I will
>> add
>> > > >> this
>> > > >> > to
>> > > >> > >> the
>> > > >> > >> > >> list
>> > > >> > >> > >> > > of
>> > > >> > >> > >> > > > > > >> variables
>> > > >> > >> > >> > > > > > >> > >> in
>> > > >> > >> > >> > > > > > >> > >> MET config files that we want to
>> support.
>> > > >> > However,
>> > > >> > >> in
>> > > >> > >> > >> the
>> > > >> > >> > >> > > > > meantime
>> > > >> > >> > >> > > > > > >> you
>> > > >> > >> > >> > > > > > >> > can
>> > > >> > >> > >> > > > > > >> > >> copy the default wrapped MET
config
>> file
>> > and
>> > > >> > >> modify it
>> > > >> > >> > >> to
>> > > >> > >> > >> > fit
>> > > >> > >> > >> > > > > your
>> > > >> > >> > >> > > > > > >> > needs.
>> > > >> > >> > >> > > > > > >> > >> To do this, you will need to:*
>> > > >> > >> > >> > > > > > >> > >>
>> > > >> > >> > >> > > > > > >> > >> * a) Copy
>> > > >> > >> > >> >
METplus/parm/met_config/EnsembleStatConfig_wrapped
>> > > >> > >> > >> > > > to
>> > > >> > >> > >> > > > > > the
>> > > >> > >> > >> > > > > > >> > >> directory that contains your
METplus
>> > config
>> > > >> file
>> > > >> > >> for
>> > > >> > >> > >> this
>> > > >> > >> > >> > use
>> > > >> > >> > >> > > > > case.
>> > > >> > >> > >> > > > > > >> > Rename
>> > > >> > >> > >> > > > > > >> > >> it by replacing "wrapped" with a
short
>> > > >> > description
>> > > >> > >> > that
>> > > >> > >> > >> > > > pertains
>> > > >> > >> > >> > > > > to
>> > > >> > >> > >> > > > > > >> your
>> > > >> > >> > >> > > > > > >> > >> use case.*
>> > > >> > >> > >> > > > > > >> > >>
>> > > >> > >> > >> > > > > > >> > >> * b) In your METplus config
file,
>> change
>> > > the
>> > > >> > >> value of
>> > > >> > >> > >> > > > > > >> > >> ENSEMBLE_STAT_CONFIG_FILE to
point to
>> the
>> > > >> path of
>> > > >> > >> this
>> > > >> > >> > >> new
>> > > >> > >> > >> > > > config
>> > > >> > >> > >> > > > > > >> file.*
>> > > >> > >> > >> > > > > > >> > >>
>> > > >> > >> > >> > > > > > >> > >> * c) If you know the value you
want to
>> > use
>> > > >> for
>> > > >> > >> this
>> > > >> > >> > >> > variable
>> > > >> > >> > >> > > > > will
>> > > >> > >> > >> > > > > > >> > always
>> > > >> > >> > >> > > > > > >> > >> be 1000000, then simply set the
>> variable
>> > to
>> > > >> that
>> > > >> > >> > value.
>> > > >> > >> > >> If
>> > > >> > >> > >> > > you
>> > > >> > >> > >> > > > > > think
>> > > >> > >> > >> > > > > > >> you
>> > > >> > >> > >> > > > > > >> > >> may want to change the value,
then you
>> can
>> > > >> > utilize
>> > > >> > >> the
>> > > >> > >> > >> > > > > > >> [user_env_vars]
>> > > >> > >> > >> > > > > > >> > >> functionality. See:
>> > > >> > >> > >> > > > > > >> > >>
>> > > >> > >> > >> > > > > > >> > >>
>> > > >> > >> > >> > > > > > >> >
>> > > >> > >> > >> > > > > > >>
>> > > >> > >> > >> > > > > >
>> > > >> > >> > >> > > > >
>> > > >> > >> > >> > > >
>> > > >> > >> > >> > >
>> > > >> > >> > >> >
>> > > >> > >> > >>
>> > > >> > >> >
>> > > >> > >>
>> > > >> >
>> > > >>
>> > >
>> >
>>
https://dtcenter.github.io/METplus/latest/Users_Guide/systemconfiguration.html#user-
defined-config
>> > > >> > >> > >> > > > > > >> > >> <
>> > > >> > >> > >> > > > > > >> > >>
>> > > >> > >> > >> > > > > > >> >
>> > > >> > >> > >> > > > > > >>
>> > > >> > >> > >> > > > > >
>> > > >> > >> > >> > > > >
>> > > >> > >> > >> > > >
>> > > >> > >> > >> > >
>> > > >> > >> > >> >
>> > > >> > >> > >>
>> > > >> > >> >
>> > > >> > >>
>> > > >> >
>> > > >>
>> > >
>> >
>>
https://dtcenter.github.io/METplus/latest/Users_Guide/systemconfiguration.html#user-
defined-config
>> > > >> > >> > >> > > > > > >> > >> >*
>> > > >> > >> > >> > > > > > >> > >> *In this case, you would add the
>> following
>> > > to
>> > > >> > your
>> > > >> > >> > >> METplus
>> > > >> > >> > >> > > > > config:*
>> > > >> > >> > >> > > > > > >> > >>
>> > > >> > >> > >> > > > > > >> > >> *[user_env_vars]*
>> > > >> > >> > >> > > > > > >> > >> *ENS_SSVAR_BIN_SIZE = 1000000*
>> > > >> > >> > >> > > > > > >> > >>
>> > > >> > >> > >> > > > > > >> > >> *Then change the line in your
>> EnsembleStat
>> > > >> config
>> > > >> > >> file
>> > > >> > >> > >> that
>> > > >> > >> > >> > > you
>> > > >> > >> > >> > > > > > >> copied
>> > > >> > >> > >> > > > > > >> > >> to:*
>> > > >> > >> > >> > > > > > >> > >>
>> > > >> > >> > >> > > > > > >> > >> * ens_ssvar_bin_size =
>> > > ${ENS_SSVAR_BIN_SIZE};
>> > > >> *
>> > > >> > >> > >> > > > > > >> > >>
>> > > >> > >> > >> > > > > > >> > >> ens_phist_bin_size = 0.05;
>> > > >> > >> > >> > > > > > >> > >> *This variable uses the default
value,
>> so
>> > > you
>> > > >> > don't
>> > > >> > >> > >> need to
>> > > >> > >> > >> > > do
>> > > >> > >> > >> > > > > > >> anything
>> > > >> > >> > >> > > > > > >> > >> here. If you need to make it
>> configurable
>> > or
>> > > >> > change
>> > > >> > >> > the
>> > > >> > >> > >> > > value,
>> > > >> > >> > >> > > > > then
>> > > >> > >> > >> > > > > > >> > follow
>> > > >> > >> > >> > > > > > >> > >> the instructions for setting
>> > > >> ens_ssvar_bin_size.*
>> > > >> > >> > >> > > > > > >> > >>
>> > > >> > >> > >> > > > > > >> > >> climo_mean = fcst;
>> > > >> > >> > >> > > > > > >> > >> climo_mean = {
>> > > >> > >> > >> > > > > > >> > >> file_name = "${CLIM_MEAN}";
>> > > >> > >> > >> > > > > > >> > >> time_interp_method = DW_MEAN;
>> > > >> > >> > >> > > > > > >> > >> match_day = TRUE;
>> > > >> > >> > >> > > > > > >> > >> time_step = 21600;
>> > > >> > >> > >> > > > > > >> > >> }
>> > > >> > >> > >> > > > > > >> > >>
>> > > >> > >> > >> > > > > > >> > >>
>> > > >> > >> > >> > > > > > >> > >> *Instead of using CLIM_MEAN, you
can
>> set
>> > > >> > >> > >> > > > > > >> > >>
>> > > ENSEMBLE_STAT_CLIMO_MEAN_INPUT_[DIR/TEMPLATE]
>> > > >> in
>> > > >> > >> the
>> > > >> > >> > >> > METplus
>> > > >> > >> > >> > > > > > config.
>> > > >> > >> > >> > > > > > >> You
>> > > >> > >> > >> > > > > > >> > >> can use filename template syntax
in the
>> > > >> _TEMPLATE
>> > > >> > >> > value,
>> > > >> > >> > >> > i.e.
>> > > >> > >> > >> > > > > > >> > >> {valid?fmt=%m%d}. The other
variables
>> in
>> > the
>> > > >> > >> > climo_mean
>> > > >> > >> > >> > > > > dictionary
>> > > >> > >> > >> > > > > > >> are
>> > > >> > >> > >> > > > > > >> > >> actually old variables that have
been
>> > > replaced
>> > > >> > with
>> > > >> > >> > >> > > > day_interval
>> > > >> > >> > >> > > > > > and
>> > > >> > >> > >> > > > > > >> > >> hour_interval, but the values
you use
>> are
>> > > the
>> > > >> old
>> > > >> > >> > >> defaults,
>> > > >> > >> > >> > > so
>> > > >> > >> > >> > > > > you
>> > > >> > >> > >> > > > > > >> > >> shouldn't need to set them.*
>> > > >> > >> > >> > > > > > >> > >>
>> > > >> > >> > >> > > > > > >> > >> climo_stdev = climo_mean;
>> > > >> > >> > >> > > > > > >> > >> climo_stdev = {
>> > > >> > >> > >> > > > > > >> > >> file_name = "${CLIM_STDV}";
>> > > >> > >> > >> > > > > > >> > >> }
>> > > >> > >> > >> > > > > > >> > >>
>> > > >> > >> > >> > > > > > >> > >> *Similarly to CLIM_MEAN, you can
use
>> > > >> > >> > >> > > > > > >> > >>
>> > > >> ENSEMBLE_STAT_CLIMO_STDEV_INPUT_[DIR/TEMPLATE] to
>> > > >> > >> set
>> > > >> > >> > >> this
>> > > >> > >> > >> > > file
>> > > >> > >> > >> > > > > > >> name.*
>> > > >> > >> > >> > > > > > >> > >>
>> > > >> > >> > >> > > > > > >> > >> climo_cdf = {
>> > > >> > >> > >> > > > > > >> > >> cdf_bins = 11;
>> > > >> > >> > >> > > > > > >> > >> center_bins = TRUE;
>> > > >> > >> > >> > > > > > >> > >> write_bins = TRUE;
>> > > >> > >> > >> > > > > > >> > >> }
>> > > >> > >> > >> > > > > > >> > >> *The value for write_bins is the
>> default,
>> > > but
>> > > >> the
>> > > >> > >> > values
>> > > >> > >> > >> > for
>> > > >> > >> > >> > > > > > cdf_bins
>> > > >> > >> > >> > > > > > >> > and
>> > > >> > >> > >> > > > > > >> > >> center_bins do not. To set
these,
>> follow
>> > the
>> > > >> > above
>> > > >> > >> > >> > > instructions
>> > > >> > >> > >> > > > > for
>> > > >> > >> > >> > > > > > >> > >> ens_ssvar_bin_size to override
them
>> and/or
>> > > >> make
>> > > >> > >> them
>> > > >> > >> > >> > > > configurable
>> > > >> > >> > >> > > > > > >> > through
>> > > >> > >> > >> > > > > > >> > >> METplus. I will also add these
>> variables
>> > to
>> > > >> the
>> > > >> > >> list
>> > > >> > >> > of
>> > > >> > >> > >> MET
>> > > >> > >> > >> > > > > configs
>> > > >> > >> > >> > > > > > >> that
>> > > >> > >> > >> > > > > > >> > >> users want to be able to easily
>> configure
>> > > >> through
>> > > >> > >> > >> METplus
>> > > >> > >> > >> > > > > configs.*
>> > > >> > >> > >> > > > > > >> > >>
>> > > >> > >> > >> > > > > > >> > >> Please let me know if you run
into any
>> > > issues
>> > > >> > >> setting
>> > > >> > >> > >> any
>> > > >> > >> > >> > of
>> > > >> > >> > >> > > > that
>> > > >> > >> > >> > > > > > up.
>> > > >> > >> > >> > > > > > >> > >> Also,
>> > > >> > >> > >> > > > > > >> > >> if there are any other MET
config
>> > variables
>> > > >> that
>> > > >> > >> you
>> > > >> > >> > >> want
>> > > >> > >> > >> > to
>> > > >> > >> > >> > > > see
>> > > >> > >> > >> > > > > > >> > supported
>> > > >> > >> > >> > > > > > >> > >> in METplus, let me know and I
will make
>> > sure
>> > > >> they
>> > > >> > >> get
>> > > >> > >> > >> > > included
>> > > >> > >> > >> > > > > when
>> > > >> > >> > >> > > > > > >> we
>> > > >> > >> > >> > > > > > >> > >> have
>> > > >> > >> > >> > > > > > >> > >> a chance to refactor those
wrappers.
>> It is
>> > > >> > >> possible to
>> > > >> > >> > >> add
>> > > >> > >> > >> > > > > support
>> > > >> > >> > >> > > > > > >> for
>> > > >> > >> > >> > > > > > >> > MET
>> > > >> > >> > >> > > > > > >> > >> configs using the above
instructions,
>> but
>> > it
>> > > >> is
>> > > >> > >> always
>> > > >> > >> > >> > easier
>> > > >> > >> > >> > > > and
>> > > >> > >> > >> > > > > > >> less
>> > > >> > >> > >> > > > > > >> > >> error-prone to have them
configurable
>> > > directly
>> > > >> > >> > through a
>> > > >> > >> > >> > > > variable
>> > > >> > >> > >> > > > > > in
>> > > >> > >> > >> > > > > > >> the
>> > > >> > >> > >> > > > > > >> > >> METplus config.
>> > > >> > >> > >> > > > > > >> > >>
>> > > >> > >> > >> > > > > > >> > >> Thanks,
>> > > >> > >> > >> > > > > > >> > >> George
>> > > >> > >> > >> > > > > > >> > >>
>> > > >> > >> > >> > > > > > >> > >> On Tue, Jan 5, 2021 at 7:14 AM
>> > > >> > >> Binbin.Zhou at noaa.gov
>> > > >> > >> > via
>> > > >> > >> > >> > RT <
>> > > >> > >> > >> > > > > > >> > >> met_help at ucar.edu> wrote:
>> > > >> > >> > >> > > > > > >> > >>
>> > > >> > >> > >> > > > > > >> > >> >
>> > > >> > >> > >> > > > > > >> > >> > Tue Jan 05 07:14:54 2021:
Request
>> 98116
>> > > was
>> > > >> > acted
>> > > >> > >> > >> upon.
>> > > >> > >> > >> > > > > > >> > >> > Transaction: Ticket created by
>> > > >> > >> Binbin.Zhou at noaa.gov
>> > > >> > >> > >> > > > > > >> > >> > Queue: met_help
>> > > >> > >> > >> > > > > > >> > >> > Subject: CDP threshold
setting
>> in
>> > > >> > >> EnsembleStat
>> > > >> > >> > >> conf
>> > > >> > >> > >> > > > > > >> > >> > Owner: Nobody
>> > > >> > >> > >> > > > > > >> > >> > Requestors:
Binbin.Zhou at noaa.gov
>> > > >> > >> > >> > > > > > >> > >> > Status: new
>> > > >> > >> > >> > > > > > >> > >> > Ticket <URL:
>> > > >> > >> > >> > > > > > >>
>> > > >> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
>> > > >> > >> > >> > > > > > >> > >
>> > > >> > >> > >> > > > > > >> > >> >
>> > > >> > >> > >> > > > > > >> > >> >
>> > > >> > >> > >> > > > > > >> > >> > George,
>> > > >> > >> > >> > > > > > >> > >> >
>> > > >> > >> > >> > > > > > >> > >> > Happy New Year!
>> > > >> > >> > >> > > > > > >> > >> >
>> > > >> > >> > >> > > > > > >> > >> > I am working on transition
of our
>> > > >> MET-based
>> > > >> > >> > global
>> > > >> > >> > >> > > > ensemble
>> > > >> > >> > >> > > > > > >> > >> verification
>> > > >> > >> > >> > > > > > >> > >> > to METplus based package. In
this
>> > package
>> > > >> > >> > climatology
>> > > >> > >> > >> > bins
>> > > >> > >> > >> > > > (10
>> > > >> > >> > >> > > > > > >> bins)
>> > > >> > >> > >> > > > > > >> > are
>> > > >> > >> > >> > > > > > >> > >> > used.
>> > > >> > >> > >> > > > > > >> > >> > In current ensemble stat
config file,
>> > the
>> > > >> > >> relevant
>> > > >> > >> > >> > entries
>> > > >> > >> > >> > > > iare
>> > > >> > >> > >> > > > > > >> > defined
>> > > >> > >> > >> > > > > > >> > >> > like following
>> > > >> > >> > >> > > > > > >> > >> >
>> > > >> > >> > >> > > > > > >> > >> > ens = {
>> > > >> > >> > >> > > > > > >> > >> > ens_thresh = 1.0;
>> > > >> > >> > >> > > > > > >> > >> > vld_thresh = 1.0;
>> > > >> > >> > >> > > > > > >> > >> >
>> > > >> > >> > >> > > > > > >> > >> > field = [
>> > > >> > >> > >> > > > > > >> > >> >
>> > > >> > >> > >> > > > > > >> > >> > {
>> > > >> > >> > >> > > > > > >> > >> > name = "HGT";
>> > > >> > >> > >> > > > > > >> > >> > level = "P500";
>> > > >> > >> > >> > > > > > >> > >> > obs_thresh = [
<=CDP10,
>> > > >> > >CDP10&&<=CDP20,
>> > > >> > >> > >> > > > > > >CDP20&&<=CDP30,
>> > > >> > >> > >> > > > > > >> > >> > >CDP30&&<=CDP40,
>CDP40&&<=CDP50,
>> > > >> > >> >CDP50&&<=CDP60,
>> > > >> > >> > >> > > > > > >CDP60&&<=CDP70,
>> > > >> > >> > >> > > > > > >> > >> > >CDP70&&<=CDP80,
>CDP80&&<=CDP90,
>> >CDP90
>> > > ];
>> > > >> > >> > >> > > > > > >> > >> > }
>> > > >> > >> > >> > > > > > >> > >> > ]
>> > > >> > >> > >> > > > > > >> > >> > }
>> > > >> > >> > >> > > > > > >> > >> > fcst = ens;
>> > > >> > >> > >> > > > > > >> > >> > obs = fcst;
>> > > >> > >> > >> > > > > > >> > >> > ens_ssvar_bin_size = 1000000;
>> > > >> > >> > >> > > > > > >> > >> > ens_phist_bin_size = 0.05;
>> > > >> > >> > >> > > > > > >> > >> > climo_mean = fcst;
>> > > >> > >> > >> > > > > > >> > >> > climo_mean = {
>> > > >> > >> > >> > > > > > >> > >> > file_name = "${CLIM_MEAN}";
>> > > >> > >> > >> > > > > > >> > >> > time_interp_method =
DW_MEAN;
>> > > >> > >> > >> > > > > > >> > >> > match_day = TRUE;
>> > > >> > >> > >> > > > > > >> > >> > time_step = 21600;
>> > > >> > >> > >> > > > > > >> > >> > }
>> > > >> > >> > >> > > > > > >> > >> >
>> > > >> > >> > >> > > > > > >> > >> > climo_stdev = climo_mean;
>> > > >> > >> > >> > > > > > >> > >> > climo_stdev = {
>> > > >> > >> > >> > > > > > >> > >> > file_name = "${CLIM_STDV}";
>> > > >> > >> > >> > > > > > >> > >> > }
>> > > >> > >> > >> > > > > > >> > >> >
>> > > >> > >> > >> > > > > > >> > >> > climo_cdf = {
>> > > >> > >> > >> > > > > > >> > >> > cdf_bins = 11;
>> > > >> > >> > >> > > > > > >> > >> > center_bins = TRUE;
>> > > >> > >> > >> > > > > > >> > >> > write_bins = TRUE;
>> > > >> > >> > >> > > > > > >> > >> > }
>> > > >> > >> > >> > > > > > >> > >> >
>> > > >> > >> > >> > > > > > >> > >> > I can not find the
correspondent
>> > settings
>> > > in
>> > > >> > its
>> > > >> > >> > conf
>> > > >> > >> > >> > file
>> > > >> > >> > >> > > > from
>> > > >> > >> > >> > > > > > >> > METplus
>> > > >> > >> > >> > > > > > >> > >> > online doc.
>> > > >> > >> > >> > > > > > >> > >> > Can you help me look at this?
>> > > >> > >> > >> > > > > > >> > >> >
>> > > >> > >> > >> > > > > > >> > >> > Thanks!
>> > > >> > >> > >> > > > > > >> > >> >
>> > > >> > >> > >> > > > > > >> > >> > Binbin
>> > > >> > >> > >> > > > > > >> > >> >
>> > > >> > >> > >> > > > > > >> > >> > --
>> > > >> > >> > >> > > > > > >> > >> >
>> > > >> > >> > >> > > > > > >> > >> > Binbin Zhou
>> > > >> > >> > >> > > > > > >> > >> >
>> > > >> > >> > >> > > > > > >> > >> > IMSG at NOAA/NWS/NCEP/EMC
>> > > >> > >> > >> > > > > > >> > >> >
>> > > >> > >> > >> > > > > > >> > >> > 5830 University Research Ct.
>> > > >> > >> > >> > > > > > >> > >> >
>> > > >> > >> > >> > > > > > >> > >> > College Park, MD 20740
>> > > >> > >> > >> > > > > > >> > >> >
>> > > >> > >> > >> > > > > > >> > >> > Binbin.Zhou at noaa.gov
>> > > >> > >> > >> > > > > > >> > >> >
>> > > >> > >> > >> > > > > > >> > >> > 301-683-3683
>> > > >> > >> > >> > > > > > >> > >> >
>> > > >> > >> > >> > > > > > >> > >> >
>> > > >> > >> > >> > > > > > >> > >>
>> > > >> > >> > >> > > > > > >> > >> --
>> > > >> > >> > >> > > > > > >> > >> George McCabe - Software
Engineer III
>> > > >> > >> > >> > > > > > >> > >> National Center for Atmospheric
>> Research
>> > > >> > >> > >> > > > > > >> > >> Research Applications Laboratory
>> > > >> > >> > >> > > > > > >> > >> 303-497-2768
>> > > >> > >> > >> > > > > > >> > >> ---
>> > > >> > >> > >> > > > > > >> > >> My working day may not be your
working
>> > day.
>> > > >> > Please
>> > > >> > >> do
>> > > >> > >> > >> not
>> > > >> > >> > >> > > feel
>> > > >> > >> > >> > > > > > >> obliged
>> > > >> > >> > >> > > > > > >> > to
>> > > >> > >> > >> > > > > > >> > >> reply to this email outside of
your
>> normal
>> > > >> > working
>> > > >> > >> > >> hours.
>> > > >> > >> > >> > > > > > >> > >>
>> > > >> > >> > >> > > > > > >> > >>
>> > > >> > >> > >> > > > > > >> > >
>> > > >> > >> > >> > > > > > >> > > --
>> > > >> > >> > >> > > > > > >> > >
>> > > >> > >> > >> > > > > > >> > > Binbin Zhou
>> > > >> > >> > >> > > > > > >> > >
>> > > >> > >> > >> > > > > > >> > > IMSG at NOAA/NWS/NCEP/EMC
>> > > >> > >> > >> > > > > > >> > >
>> > > >> > >> > >> > > > > > >> > > 5830 University Research Ct.
>> > > >> > >> > >> > > > > > >> > >
>> > > >> > >> > >> > > > > > >> > > College Park, MD 20740
>> > > >> > >> > >> > > > > > >> > >
>> > > >> > >> > >> > > > > > >> > > Binbin.Zhou at noaa.gov
>> > > >> > >> > >> > > > > > >> > >
>> > > >> > >> > >> > > > > > >> > > 301-683-3683
>> > > >> > >> > >> > > > > > >> > >
>> > > >> > >> > >> > > > > > >> >
>> > > >> > >> > >> > > > > > >> >
>> > > >> > >> > >> > > > > > >> > --
>> > > >> > >> > >> > > > > > >> >
>> > > >> > >> > >> > > > > > >> > Binbin Zhou
>> > > >> > >> > >> > > > > > >> >
>> > > >> > >> > >> > > > > > >> > IMSG at NOAA/NWS/NCEP/EMC
>> > > >> > >> > >> > > > > > >> >
>> > > >> > >> > >> > > > > > >> > 5830 University Research Ct.
>> > > >> > >> > >> > > > > > >> >
>> > > >> > >> > >> > > > > > >> > College Park, MD 20740
>> > > >> > >> > >> > > > > > >> >
>> > > >> > >> > >> > > > > > >> > Binbin.Zhou at noaa.gov
>> > > >> > >> > >> > > > > > >> >
>> > > >> > >> > >> > > > > > >> > 301-683-3683
>> > > >> > >> > >> > > > > > >> >
>> > > >> > >> > >> > > > > > >> >
>> > > >> > >> > >> > > > > > >>
>> > > >> > >> > >> > > > > > >> --
>> > > >> > >> > >> > > > > > >> George McCabe - Software Engineer III
>> > > >> > >> > >> > > > > > >> National Center for Atmospheric
Research
>> > > >> > >> > >> > > > > > >> Research Applications Laboratory
>> > > >> > >> > >> > > > > > >> 303-497-2768
>> > > >> > >> > >> > > > > > >> ---
>> > > >> > >> > >> > > > > > >> My working day may not be your
working day.
>> > > Please
>> > > >> do
>> > > >> > >> not
>> > > >> > >> > >> feel
>> > > >> > >> > >> > > > obliged
>> > > >> > >> > >> > > > > > to
>> > > >> > >> > >> > > > > > >> reply to this email outside of your
normal
>> > > working
>> > > >> > >> hours.
>> > > >> > >> > >> > > > > > >>
>> > > >> > >> > >> > > > > > >>
>> > > >> > >> > >> > > > > > >
>> > > >> > >> > >> > > > > > > --
>> > > >> > >> > >> > > > > > >
>> > > >> > >> > >> > > > > > > Binbin Zhou
>> > > >> > >> > >> > > > > > >
>> > > >> > >> > >> > > > > > > IMSG at NOAA/NWS/NCEP/EMC
>> > > >> > >> > >> > > > > > >
>> > > >> > >> > >> > > > > > > 5830 University Research Ct.
>> > > >> > >> > >> > > > > > >
>> > > >> > >> > >> > > > > > > College Park, MD 20740
>> > > >> > >> > >> > > > > > >
>> > > >> > >> > >> > > > > > > Binbin.Zhou at noaa.gov
>> > > >> > >> > >> > > > > > >
>> > > >> > >> > >> > > > > > > 301-683-3683
>> > > >> > >> > >> > > > > > >
>> > > >> > >> > >> > > > > >
>> > > >> > >> > >> > > > > >
>> > > >> > >> > >> > > > > > --
>> > > >> > >> > >> > > > > >
>> > > >> > >> > >> > > > > > Binbin Zhou
>> > > >> > >> > >> > > > > >
>> > > >> > >> > >> > > > > > IMSG at NOAA/NWS/NCEP/EMC
>> > > >> > >> > >> > > > > >
>> > > >> > >> > >> > > > > > 5830 University Research Ct.
>> > > >> > >> > >> > > > > >
>> > > >> > >> > >> > > > > > College Park, MD 20740
>> > > >> > >> > >> > > > > >
>> > > >> > >> > >> > > > > > Binbin.Zhou at noaa.gov
>> > > >> > >> > >> > > > > >
>> > > >> > >> > >> > > > > > 301-683-3683
>> > > >> > >> > >> > > > > >
>> > > >> > >> > >> > > > > >
>> > > >> > >> > >> > > > >
>> > > >> > >> > >> > > > > --
>> > > >> > >> > >> > > > > George McCabe - Software Engineer III
>> > > >> > >> > >> > > > > National Center for Atmospheric Research
>> > > >> > >> > >> > > > > Research Applications Laboratory
>> > > >> > >> > >> > > > > 303-497-2768
>> > > >> > >> > >> > > > > ---
>> > > >> > >> > >> > > > > My working day may not be your working
day.
>> Please
>> > do
>> > > >> not
>> > > >> > >> feel
>> > > >> > >> > >> > obliged
>> > > >> > >> > >> > > to
>> > > >> > >> > >> > > > > reply to this email outside of your normal
>> working
>> > > >> hours.
>> > > >> > >> > >> > > > >
>> > > >> > >> > >> > > > >
>> > > >> > >> > >> > > >
>> > > >> > >> > >> > > > --
>> > > >> > >> > >> > > >
>> > > >> > >> > >> > > > Binbin Zhou
>> > > >> > >> > >> > > >
>> > > >> > >> > >> > > > IMSG at NOAA/NWS/NCEP/EMC
>> > > >> > >> > >> > > >
>> > > >> > >> > >> > > > 5830 University Research Ct.
>> > > >> > >> > >> > > >
>> > > >> > >> > >> > > > College Park, MD 20740
>> > > >> > >> > >> > > >
>> > > >> > >> > >> > > > Binbin.Zhou at noaa.gov
>> > > >> > >> > >> > > >
>> > > >> > >> > >> > > > 301-683-3683
>> > > >> > >> > >> > > >
>> > > >> > >> > >> > > >
>> > > >> > >> > >> > >
>> > > >> > >> > >> > > --
>> > > >> > >> > >> > > George McCabe - Software Engineer III
>> > > >> > >> > >> > > National Center for Atmospheric Research
>> > > >> > >> > >> > > Research Applications Laboratory
>> > > >> > >> > >> > > 303-497-2768
>> > > >> > >> > >> > > ---
>> > > >> > >> > >> > > My working day may not be your working day.
Please do
>> > not
>> > > >> feel
>> > > >> > >> > >> obliged to
>> > > >> > >> > >> > > reply to this email outside of your normal
working
>> > hours.
>> > > >> > >> > >> > >
>> > > >> > >> > >> > >
>> > > >> > >> > >> >
>> > > >> > >> > >> > --
>> > > >> > >> > >> >
>> > > >> > >> > >> > Binbin Zhou
>> > > >> > >> > >> >
>> > > >> > >> > >> > IMSG at NOAA/NWS/NCEP/EMC
>> > > >> > >> > >> >
>> > > >> > >> > >> > 5830 University Research Ct.
>> > > >> > >> > >> >
>> > > >> > >> > >> > College Park, MD 20740
>> > > >> > >> > >> >
>> > > >> > >> > >> > Binbin.Zhou at noaa.gov
>> > > >> > >> > >> >
>> > > >> > >> > >> > 301-683-3683
>> > > >> > >> > >> >
>> > > >> > >> > >> >
>> > > >> > >> > >>
>> > > >> > >> > >> --
>> > > >> > >> > >> Julie Prestopnik (she/her)
>> > > >> > >> > >> Software Engineer
>> > > >> > >> > >> National Center for Atmospheric Research
>> > > >> > >> > >> Research Applications Laboratory
>> > > >> > >> > >> Email: jpresto at ucar.edu
>> > > >> > >> > >>
>> > > >> > >> > >> My working day may not be your working day.
Please do
>> not
>> > > feel
>> > > >> > >> obliged
>> > > >> > >> > to
>> > > >> > >> > >> reply to this email outside of your normal working
hours.
>> > > >> > >> > >>
>> > > >> > >> > >>
>> > > >> > >> > >
>> > > >> > >> > > --
>> > > >> > >> > >
>> > > >> > >> > > Binbin Zhou
>> > > >> > >> > >
>> > > >> > >> > > IMSG at NOAA/NWS/NCEP/EMC
>> > > >> > >> > >
>> > > >> > >> > > 5830 University Research Ct.
>> > > >> > >> > >
>> > > >> > >> > > College Park, MD 20740
>> > > >> > >> > >
>> > > >> > >> > > Binbin.Zhou at noaa.gov
>> > > >> > >> > >
>> > > >> > >> > > 301-683-3683
>> > > >> > >> > >
>> > > >> > >> >
>> > > >> > >> >
>> > > >> > >> > --
>> > > >> > >> >
>> > > >> > >> > Binbin Zhou
>> > > >> > >> >
>> > > >> > >> > IMSG at NOAA/NWS/NCEP/EMC
>> > > >> > >> >
>> > > >> > >> > 5830 University Research Ct.
>> > > >> > >> >
>> > > >> > >> > College Park, MD 20740
>> > > >> > >> >
>> > > >> > >> > Binbin.Zhou at noaa.gov
>> > > >> > >> >
>> > > >> > >> > 301-683-3683
>> > > >> > >> >
>> > > >> > >> >
>> > > >> > >>
>> > > >> > >> --
>> > > >> > >> Julie Prestopnik (she/her)
>> > > >> > >> Software Engineer
>> > > >> > >> National Center for Atmospheric Research
>> > > >> > >> Research Applications Laboratory
>> > > >> > >> Email: jpresto at ucar.edu
>> > > >> > >>
>> > > >> > >> My working day may not be your working day. Please do
not
>> feel
>> > > >> obliged
>> > > >> > to
>> > > >> > >> reply to this email outside of your normal working
hours.
>> > > >> > >>
>> > > >> > >>
>> > > >> > >
>> > > >> > > --
>> > > >> > > George McCabe - Software Engineer III
>> > > >> > > National Center for Atmospheric Research
>> > > >> > > Research Applications Laboratory
>> > > >> > > 303-497-2768
>> > > >> > > ---
>> > > >> > > My working day may not be your working day. Please do
not feel
>> > > >> obliged to
>> > > >> > > reply to this email outside of your normal working
hours.
>> > > >> > >
>> > > >> >
>> > > >> >
>> > > >> > --
>> > > >> >
>> > > >> > Binbin Zhou
>> > > >> >
>> > > >> > IMSG at NOAA/NWS/NCEP/EMC
>> > > >> >
>> > > >> > 5830 University Research Ct.
>> > > >> >
>> > > >> > College Park, MD 20740
>> > > >> >
>> > > >> > Binbin.Zhou at noaa.gov
>> > > >> >
>> > > >> > 301-683-3683
>> > > >> >
>> > > >> >
>> > > >>
>> > > >> --
>> > > >> George McCabe - Software Engineer III
>> > > >> National Center for Atmospheric Research
>> > > >> Research Applications Laboratory
>> > > >> 303-497-2768
>> > > >> ---
>> > > >> My working day may not be your working day. Please do not
feel
>> obliged
>> > > to
>> > > >> reply to this email outside of your normal working hours.
>> > > >>
>> > > >>
>> > > >
>> > > > --
>> > > >
>> > > > Binbin Zhou
>> > > >
>> > > > IMSG at NOAA/NWS/NCEP/EMC
>> > > >
>> > > > 5830 University Research Ct.
>> > > >
>> > > > College Park, MD 20740
>> > > >
>> > > > Binbin.Zhou at noaa.gov
>> > > >
>> > > > 301-683-3683
>> > > >
>> > >
>> > >
>> > > --
>> > >
>> > > Binbin Zhou
>> > >
>> > > IMSG at NOAA/NWS/NCEP/EMC
>> > >
>> > > 5830 University Research Ct.
>> > >
>> > > College Park, MD 20740
>> > >
>> > > Binbin.Zhou at noaa.gov
>> > >
>> > > 301-683-3683
>> > >
>> > >
>> >
>> > --
>> > George McCabe - Software Engineer III
>> > National Center for Atmospheric Research
>> > Research Applications Laboratory
>> > 303-497-2768
>> > ---
>> > My working day may not be your working day. Please do not feel
obliged
>> to
>> > reply to this email outside of your normal working hours.
>> >
>> >
>>
>> --
>>
>> Binbin Zhou
>>
>> IMSG at NOAA/NWS/NCEP/EMC
>>
>> 5830 University Research Ct.
>>
>> College Park, MD 20740
>>
>> Binbin.Zhou at noaa.gov
>>
>> 301-683-3683
>>
>>
>
> --
> George McCabe - Software Engineer III
> National Center for Atmospheric Research
> Research Applications Laboratory
> 303-497-2768
> ---
> My working day may not be your working day. Please do not feel
obliged to
> reply to this email outside of your normal working hours.
>
--
George McCabe - Software Engineer III
National Center for Atmospheric Research
Research Applications Laboratory
303-497-2768
---
My working day may not be your working day. Please do not feel obliged
to
reply to this email outside of your normal working hours.
------------------------------------------------
Subject: CDP threshold setting in EnsembleStat conf
From: Binbin.Zhou at noaa.gov
Time: Thu Jan 07 09:21:33 2021
George,
The DEBUG message is very helpful although it is a little bit
confusing.
Right now we have found the issue is not due to CDP setting but
duo to Climatology reading and solved the problem according to
your suggestion. I did several tests and the running is stable,
So this ticket can be closed.
Thanks for helping me to solve this issue!
Binbin
On Thu, Jan 7, 2021 at 10:27 AM George McCabe via RT
<met_help at ucar.edu>
wrote:
> Hi Binbin,
>
> It looks like either the debug log message is inaccurate and the
time
> offset must be "less than" the hour interval instead of "less than
or equal
> to" or the actual logic is incorrect. My guess is the latter, but I
am not
> familiar enough with that portion of the code to know what it
"should" be.
> I will let John HG know. Thanks for verifying that it does work
properly
> when the hour interval value is greater than the time offset.
>
> - George
>
> On Thu, Jan 7, 2021 at 7:19 AM Binbin.Zhou at noaa.gov via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116 >
> >
> > George,
> >
> > With setting
> > day_interval = 31;
> > hour_interval = 12;
> >
> > The error message became:
> > DEBUG 3: Skipping the 19590104_000000 "HGT/P500" climatology field
since
> > the time offset (43200 seconds) >= the "hour_interval" entry
(43200
> > seconds) from file:
> >
> >
>
/gpfs/dell2/emc/modeling/noscrub/Binbin.Zhou/g2g/com/verf/dev/ens.20210104/clim.grid3.stdv.010400.grib2
> >
> > This error seems strange. So I changed the setting
> > day_interval = 31;
> > hour_interval = 18;
> >
> > This time, the run is successful! This means the time_offset must
> > smaller than the hour_interval. SO I used a large number 18.
> > I'll do more test to see if the run is stable.
> >
> > Thanks!
> >
> > Binbin
> >
> >
> >
> >
> > On Wed, Jan 6, 2021 at 5:08 PM George McCabe via RT
<met_help at ucar.edu>
> > wrote:
> >
> > > Hi Binbin,
> > >
> > > match_day and time_step are no longer used, so they should be
removed.
> > You
> > > should replace them with:
> > >
> > > day_interval = 31;
> > > hour_interval = 12;
> > >
> > > 31 is the default for day interval. The default for
hour_interval is 6,
> > but
> > > we want it to be 12 so it finds your climo files.
> > >
> > > - George
> > >
> > > On Wed, Jan 6, 2021 at 2:39 PM Binbin.Zhou at noaa.gov via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
>
> > > >
> > > > George,
> > > >
> > > > Even I deleted time_step in the climo_mean entry, this
error is
> > still
> > > > there.
> > > > So I think climo_mean=fcst should be removed and define
climo_mean
> part
> > > > separately.
> > > > But how to define the fields (name, level) in climo_mean in
METplus
> > conf
> > > > file?
> > > > Maybe hard copy the fields for climo_mean in EnsembleGrid
config
> file?
> > > >
> > > > Binbin
> > > >
> > > > On Wed, Jan 6, 2021 at 4:18 PM Binbin Zhou - NOAA Affiliate <
> > > > binbin.zhou at noaa.gov> wrote:
> > > >
> > > > > George,
> > > > >
> > > > > Rerun has same error
> > > > > Skipping the 19590104_000000 "HGT/P500" climatology field
since
> the
> > > time
> > > > > offset (43200 seconds) >= the "hour_interval" entry (21600
seconds)
> > > from
> > > > > file:
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/emc/modeling/noscrub/Binbin.Zhou/g2g/com/verf/dev/ens.20210104/clim.grid3.mean.010400.grib2
> > > > >
> > > > > The new setting for climo in EnemsbleGrid config file is
> > > > > climo_mean = fcst;
> > > > > climo_mean = {
> > > > > file_name = [ ${CLIMO_MEAN_FILE} ];
> > > > > time_interp_method = DW_MEAN;
> > > > > match_day = FALSE;
> > > > > time_step = 43200;
> > > > > }
> > > > > climo_stdev = climo_mean;
> > > > > climo_stdev = {
> > > > > file_name = [ ${CLIMO_STDEV_FILE} ];
> > > > > }
> > > > >
> > > > > climo_cdf = {
> > > > > cdf_bins = 11;
> > > > > center_bins = TRUE;
> > > > > write_bins = TRUE;
> > > > > }
> > > > >
> > > > > It seems time_step is not effective?
> > > > >
> > > > > Binbin
> > > > >
> > > > > On Wed, Jan 6, 2021 at 3:15 PM George McCabe via RT <
> > met_help at ucar.edu
> > > >
> > > > > wrote:
> > > > >
> > > > >> Hi Binbin,
> > > > >>
> > > > >> Thanks for sending the updated logs. It looks like your
> climatology
> > > > fields
> > > > >> are not being read properly. I think this line explains the
> problem:
> > > > >>
> > > > >> DEBUG 3: Skipping the 19590104_000000 "HGT/P500"
climatology field
> > > since
> > > > >> the time offset (43200 seconds) >= the "hour_interval"
entry
> (21600
> > > > >> seconds) from file:
> > > > >>
> > > > >>
> > > >
> > >
> >
>
/gpfs/dell2/emc/modeling/noscrub/Binbin.Zhou/g2g/com/verf/dev/ens.20210104/clim.grid3.stdv.010400.grib2
> > > > >>
> > > > >> The variables match_day and time_step in your climo_mean
> dictionary
> > > are
> > > > >> actually no longer used and have been replaced with:
> > > > >>
> > > > >> day_interval = 31;
> > > > >> hour_interval = 6;
> > > > >>
> > > > >> 21600 seconds is 6 hours and it sounds like your climo
field is
> > offset
> > > > by
> > > > >> 12 hours. I believe setting hour_interval to 12 should
allow it to
> > > find
> > > > >> the
> > > > >> climatology field and compute the statistics properly. Let
me know
> > if
> > > it
> > > > >> does not.
> > > > >>
> > > > >> Thanks,
> > > > >> George
> > > > >>
> > > > >> On Wed, Jan 6, 2021 at 12:43 PM Binbin.Zhou at noaa.gov via RT
<
> > > > >> met_help at ucar.edu> wrote:
> > > > >>
> > > > >> >
> > > > >> > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116 >
> > > > >> >
> > > > >> > George,
> > > > >> >
> > > > >> > I have re-run the case with LOG_LEVEL=DEBUG and
> > > > >> > LOG_ENSEMBLE_STAT_VERBOSITY =3.
> > > > >> > The output log file has been sent to hera:
> > > > >> >
> > > > >> >
> > > > >>
> > > >
> > >
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Binbin.Zhou/metplus_test/metplus3.out/log/master_metplus.log.20210106193455
> > > > >> >
> > > > >> > Please look at it.
> > > > >> >
> > > > >> > Thanks!
> > > > >> >
> > > > >> > Biinbin
> > > > >> >
> > > > >> > On Wed, Jan 6, 2021 at 2:19 PM George McCabe
<mccabe at ucar.edu>
> > > wrote:
> > > > >> >
> > > > >> > > Hi Binbin,
> > > > >> > >
> > > > >> > > Thanks for putting those files on hera. The log output
you
> sent
> > > > >> doesn't
> > > > >> > > have the DEBUG level output (LOG_LEVEL=DEBUG). However,
I
> tried
> > to
> > > > run
> > > > >> > > EnsembleStat locally using the _OPTIONS value you set
and it
> > seems
> > > > to
> > > > >> run
> > > > >> > > fine. The error seems to suggest that something went
wrong
> when
> > > > >> computing
> > > > >> > > the mean and standard deviation before the obs_thresh
values
> are
> > > > >> > applied. I
> > > > >> > > have reached out to John HG to see if he has any
insight as to
> > why
> > > > >> that
> > > > >> > is
> > > > >> > > happening. In the meantime, you could rerun with
> > > > >> > > LOG_ENSEMBLE_STAT_VERBOSITY set to a higher value than
2 to
> see
> > > if
> > > > >> the
> > > > >> > > extra log output from the MET tool gives you any more
insight
> as
> > > to
> > > > >> what
> > > > >> > is
> > > > >> > > going wrong.
> > > > >> > >
> > > > >> > > - George
> > > > >> > >
> > > > >> > > On Wed, Jan 6, 2021 at 9:51 AM Julie Prestopnik via RT
<
> > > > >> > met_help at ucar.edu>
> > > > >> > > wrote:
> > > > >> > >
> > > > >> > >> Thanks for all of the info Binbin. I saw that you had
copied
> > > > >> everything
> > > > >> > >> to
> > > > >> > >> hera for George. I am currently no longer on WCOSS,
so I
> > unless
> > > > >> George
> > > > >> > >> lets me know that he needs something from WCOSS, I'll
assume
> he
> > > is
> > > > >> able
> > > > >> > to
> > > > >> > >> get it from hera.
> > > > >> > >>
> > > > >> > >> Julie
> > > > >> > >>
> > > > >> > >> On Wed, Jan 6, 2021 at 9:39 AM Binbin.Zhou at noaa.gov
via RT <
> > > > >> > >> met_help at ucar.edu> wrote:
> > > > >> > >>
> > > > >> > >> >
> > > > >> > >> > <URL:
> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
> > > >
> > > > >> > >> >
> > > > >> > >> > The EnsembleStat config file for the successful run
outside
> > of
> > > > >> METplus
> > > > >> > >> is
> > > > >> > >> >
> > > > >> > >> >
> > > > >> > >>
> > > > >> >
> > > > >>
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_met_global_ens1p0.v1.0.0/parm/verf_g2g_ens_stat_config_bin11
> > > > >> > >> > on WCOSS
> > > > >> > >> >
> > > > >> > >> > Binbin
> > > > >> > >> >
> > > > >> > >> > On Wed, Jan 6, 2021 at 11:34 AM Binbin Zhou - NOAA
> Affiliate
> > <
> > > > >> > >> > binbin.zhou at noaa.gov> wrote:
> > > > >> > >> >
> > > > >> > >> > > Julie,
> > > > >> > >> > >
> > > > >> > >> > > The output directory on WCOSS is
> > > > >> > >> > >
> > > > >> > >> > >
> > > > >> > >> >
> > > > >> > >>
> > > > >> >
> > > > >>
> > > >
> > >
> >
>
/gpfs/dell1/ptmp/Binbin.Zhou/g2g/RFC2/tmpnwprd/verf_g2g_gefs_00_dev.161076/metplus3.out
> > > > >> > >> > >
> > > > >> > >> > > My METplus package on WCOSS is
> > > > >> > >> > >
> > > > >> > >> >
> > > > >> > >>
> > > > >> >
> > > > >>
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_g2g.v4.0.0
> > > > >> > >> > >
> > > > >> > >> > > For GEFS, the EnsembleGrid config file is
> > > > >> > >> > >
> > > > >> > >> > >
> > > > >> > >> >
> > > > >> > >>
> > > > >> >
> > > > >>
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_g2g.v4.0.0/parm/app_conf/grid2grid/met_config/EnsembleStatConfig_gefs_bin11
> > > > >> > >> > > Its conf file
> > > > >> > >> > > is
> > > > >> > >> >
> > > > >> > >>
> > > > >> >
> > > > >>
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_g2g.v4.0.0/parm/app_conf/grid2grid/gefs_conf/gefs_bin11.conf
> > > > >> > >> > >
> > > > >> > >> > > The running process is little bit complex since
this is a
> > > > >> transition
> > > > >> > >> to
> > > > >> > >> > > future operational package that uses
> > > > >> > >> > > mpi parallel: the script is
> > > > >> > >> > >
> > > > >> > >> > >
> > > > >> > >> >
> > > > >> > >>
> > > > >> >
> > > > >>
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_g2g.v4.0.0/ush/verf_g2g_metplus_run_gefs_mpi.sh
> > > > >> > >> > >
> > > > >> > >> > > Binbin
> > > > >> > >> > >
> > > > >> > >> > >
> > > > >> > >> > >
> > > > >> > >> > >
> > > > >> > >> > > On Wed, Jan 6, 2021 at 11:00 AM Julie Prestopnik
via RT <
> > > > >> > >> > met_help at ucar.edu>
> > > > >> > >> > > wrote:
> > > > >> > >> > >
> > > > >> > >> > >> Hi Binbin.
> > > > >> > >> > >>
> > > > >> > >> > >> This is Julie. I haven't been following this
entire
> > thread,
> > > > >> but I
> > > > >> > >> am on
> > > > >> > >> > >> WCOSS right now. If you send a path to a file, I
can
> pull
> > > it
> > > > >> and
> > > > >> > >> put it
> > > > >> > >> > >> on
> > > > >> > >> > >> our ftp server for George.
> > > > >> > >> > >>
> > > > >> > >> > >> Julie
> > > > >> > >> > >>
> > > > >> > >> > >> On Wed, Jan 6, 2021 at 8:57 AM
Binbin.Zhou at noaa.gov via
> > RT
> > > <
> > > > >> > >> > >> met_help at ucar.edu> wrote:
> > > > >> > >> > >>
> > > > >> > >> > >> >
> > > > >> > >> > >> > <URL:
> > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
> > > > >> >
> > > > >> > >> > >> >
> > > > >> > >> > >> > George,
> > > > >> > >> > >> >
> > > > >> > >> > >> > Can you access WCOSS or access HERA?
> > > > >> > >> > >> > Otherwise I will email attached to you
> > > > >> > >> > >> >
> > > > >> > >> > >> > Binbin
> > > > >> > >> > >> >
> > > > >> > >> > >> >
> > > > >> > >> > >> >
> > > > >> > >> > >> > On Wed, Jan 6, 2021 at 10:46 AM George McCabe
via RT <
> > > > >> > >> > met_help at ucar.edu
> > > > >> > >> > >> >
> > > > >> > >> > >> > wrote:
> > > > >> > >> > >> >
> > > > >> > >> > >> > > Hi Binbin,
> > > > >> > >> > >> > >
> > > > >> > >> > >> > > Could you send me a log file for a run with
> > > > LOG_LEVEL=DEBUG
> > > > >> (in
> > > > >> > >> > >> METplus
> > > > >> > >> > >> > > config) so I can see how the environment
variable
> > > > ENS_FIELD
> > > > >> is
> > > > >> > >> set?
> > > > >> > >> > >> The
> > > > >> > >> > >> > > values of ENS_VAR<n>_* are formatted and set
in this
> > > > >> > environment
> > > > >> > >> > >> variable
> > > > >> > >> > >> > > which is passed into the MET config. You can
compare
> > > that
> > > > >> value
> > > > >> > >> with
> > > > >> > >> > >> what
> > > > >> > >> > >> > > you used in your successful run outside of
the
> METplus
> > > > >> wrapper
> > > > >> > to
> > > > >> > >> > >> > determine
> > > > >> > >> > >> > > what is different.
> > > > >> > >> > >> > >
> > > > >> > >> > >> > > Thanks,
> > > > >> > >> > >> > > George
> > > > >> > >> > >> > >
> > > > >> > >> > >> > > On Wed, Jan 6, 2021 at 7:11 AM
Binbin.Zhou at noaa.gov
> > via
> > > > RT
> > > > >> <
> > > > >> > >> > >> > > met_help at ucar.edu> wrote:
> > > > >> > >> > >> > >
> > > > >> > >> > >> > > >
> > > > >> > >> > >> > > > <URL:
> > > > >> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
> > > > >> > >> >
> > > > >> > >> > >> > > >
> > > > >> > >> > >> > > > George,
> > > > >> > >> > >> > > >
> > > > >> > >> > >> > > > I got a new error in execution although
some
> > output
> > > > >> files
> > > > >> > (nc
> > > > >> > >> > >> file)
> > > > >> > >> > >> > are
> > > > >> > >> > >> > > > created but stat files not.
> > > > >> > >> > >> > > > The error message is
> > > > >> > >> > >> > > >
> > > > >> > >> > >> > > > ERROR :
> > > > >> > >> > >> > > > ERROR : Simple_Node::check(double, double,
> double)
> > > > const
> > > > >> ->
> > > > >> > >> > >> > > climatological
> > > > >> > >> > >> > > > distribution percentile threshold "<=CDP10"
> > requested
> > > > with
> > > > >> > >> invalid
> > > > >> > >> > >> mean
> > > > >> > >> > >> > > > (-9999) or standard deviation (-9999).
> > > > >> > >> > >> > > > ERROR :
> > > > >> > >> > >> > > >
> > > > >> > >> > >> > > > Such an error was ever investigated by John
H
> before
> > > > (year
> > > > >> > >> ago):
> > > > >> > >> > >> When I
> > > > >> > >> > >> > > > directly ran ensemble_stat for global
ensemble
> (not
> > > > >> > >> METplus-based,
> > > > >> > >> > >> > > > but hard code of all settings in
EnsembleStat
> config
> > > > >> file):
> > > > >> > If
> > > > >> > >> > hard
> > > > >> > >> > >> > code
> > > > >> > >> > >> > > > fcst field in EnsembleStat config file like
this
> > > > >> > >> > >> > > >
> > > > >> > >> > >> > > > name = "HGT";
> > > > >> > >> > >> > > > level = "P500";
> > > > >> > >> > >> > > > cat_thresh = [ <=CDP10,
>CDP10&&<=CDP20,
> > > > >> > >> >CDP20&&<=CDP30,
> > > > >> > >> > >> > > > >CDP30&&<=CDP40, >CDP40&&<=CDP50,
>CDP50&&<=CDP60,
> > > > >> > >> > >CDP60&&<=CDP70,
> > > > >> > >> > >> > > > >CDP70&&<=CDP80, >CDP80&&<=CDP90, >CDP90 ];
> > > > >> > >> > >> > > >
> > > > >> > >> > >> > > > Run ensemble_stat will have such error:
ERROR :
> > > > >> > >> > >> > > > Simple_Node::check(double, double, double)
const
> ->
> > > > >> > >> climatological
> > > > >> > >> > >> > > > distribution percentile threshold "<=CDP10"
> > requested
> > > > with
> > > > >> > >> invalid
> > > > >> > >> > >> mean
> > > > >> > >> > >> > > > (-9999) or standard deviation (-9999).
> > > > >> > >> > >> > > >
> > > > >> > >> > >> > > > John H. suggested me change "cat_thresh = "
to
> > > > >> "obs_thresh =
> > > > >> > >> ",
> > > > >> > >> > >> then
> > > > >> > >> > >> > > the
> > > > >> > >> > >> > > > error was solved.
> > > > >> > >> > >> > > >
> > > > >> > >> > >> > > > In current METplus version, following your
> > suggestion
> > > as
> > > > >> > >> > >> > > >
> > > > >> > >> > >> > > > ENS_VAR1_OPTIONS = obs_thresh = [ <=CDP10,
> > > > >> >CDP10&&<=CDP20,
> > > > >> > >> > >> > > > >CDP20&&<=CDP30, >CDP30&&<=CDP40,
>CDP40&&<=CDP50,
> > > > >> > >> > >CDP50&&<=CDP60,
> > > > >> > >> > >> > > > >CDP60&&<=CDP70, >CDP70&&<=CDP80,
>CDP80&&<=CDP90,
> > > > >CDP90
> > > > >> ];
> > > > >> > >> > >> > > >
> > > > >> > >> > >> > > > the same error appears again. So I am not
for
> sure
> > > if
> > > > >> the
> > > > >> > >> > >> > "obs_thresh"
> > > > >> > >> > >> > > > setting is correctly passed.
> > > > >> > >> > >> > > >
> > > > >> > >> > >> > > > Binbin
> > > > >> > >> > >> > > >
> > > > >> > >> > >> > > >
> > > > >> > >> > >> > > >
> > > > >> > >> > >> > > >
> > > > >> > >> > >> > > > On Tue, Jan 5, 2021 at 5:19 PM George
McCabe via
> RT
> > <
> > > > >> > >> > >> met_help at ucar.edu
> > > > >> > >> > >> > >
> > > > >> > >> > >> > > > wrote:
> > > > >> > >> > >> > > >
> > > > >> > >> > >> > > > > Hi Binbin,
> > > > >> > >> > >> > > > >
> > > > >> > >> > >> > > > > Your solution should work for now. It
looks like
> > > > >> although
> > > > >> > the
> > > > >> > >> > >> METplus
> > > > >> > >> > >> > > > > variable does get read properly, the
environment
> > > > >> variable
> > > > >> > is
> > > > >> > >> not
> > > > >> > >> > >> > > actually
> > > > >> > >> > >> > > > > set by the EnsembleStat wrapper. I can
make a
> note
> > > to
> > > > >> add
> > > > >> > >> that
> > > > >> > >> > for
> > > > >> > >> > >> > > 4.0.0,
> > > > >> > >> > >> > > > > as it is an easy fix.
> > > > >> > >> > >> > > > >
> > > > >> > >> > >> > > > > - George
> > > > >> > >> > >> > > > >
> > > > >> > >> > >> > > > > On Tue, Jan 5, 2021 at 2:53 PM
> > Binbin.Zhou at noaa.gov
> > > > via
> > > > >> > RT <
> > > > >> > >> > >> > > > > met_help at ucar.edu> wrote:
> > > > >> > >> > >> > > > >
> > > > >> > >> > >> > > > > > George,
> > > > >> > >> > >> > > > > >
> > > > >> > >> > >> > > > > > I have a temporal solution:
> > > > >> > >> > >> > > > > > set ploy in EnembleStat config as
> > > > >> > >> > >> > > > > > poly = [
"${MASKPATH}/lat_NHM.nc",
> > > > >> > >> > >> > > > > >
"${MASKPATH}/lat_NHM.nc",
> > > > >> > >> > >> > > > > > "${MASKPATH}/lat_TRP.nc"
];
> > > > >> > >> > >> > > > > >
> > > > >> > >> > >> > > > > > then set MASKPATH in user_env_vars
part in
> the
> > > conf
> > > > >> file
> > > > >> > >> > >> > > > > > This MASKPAH then can be passed to
> > EnsembleStat's
> > > > >> poly [
> > > > >> > ]
> > > > >> > >> > entry
> > > > >> > >> > >> > > > > >
> > > > >> > >> > >> > > > > > Binbin
> > > > >> > >> > >> > > > > >
> > > > >> > >> > >> > > > > > On Tue, Jan 5, 2021 at 4:25 PM Binbin
Zhou -
> > NOAA
> > > > >> > >> Affiliate <
> > > > >> > >> > >> > > > > > binbin.zhou at noaa.gov> wrote:
> > > > >> > >> > >> > > > > >
> > > > >> > >> > >> > > > > > > George,
> > > > >> > >> > >> > > > > > >
> > > > >> > >> > >> > > > > > > Still not working, error says
> > > > >> > >> > >> > > > > > > ERROR : replace_env() -> unable to
get
> value
> > > for
> > > > >> > >> > environment
> > > > >> > >> > >> > > > variable
> > > > >> > >> > >> > > > > > > "VERIF_MASK"
> > > > >> > >> > >> > > > > > >
> > > > >> > >> > >> > > > > > > Binbin
> > > > >> > >> > >> > > > > > >
> > > > >> > >> > >> > > > > > >
> > > > >> > >> > >> > > > > > >
> > > > >> > >> > >> > > > > > > On Tue, Jan 5, 2021 at 3:50 PM George
McCabe
> > via
> > > > RT
> > > > >> <
> > > > >> > >> > >> > > > met_help at ucar.edu
> > > > >> > >> > >> > > > > >
> > > > >> > >> > >> > > > > > > wrote:
> > > > >> > >> > >> > > > > > >
> > > > >> > >> > >> > > > > > >> Hi Binbin,
> > > > >> > >> > >> > > > > > >>
> > > > >> > >> > >> > > > > > >> You should be able to set it in the
METplus
> > > > config
> > > > >> the
> > > > >> > >> same
> > > > >> > >> > >> way
> > > > >> > >> > >> > it
> > > > >> > >> > >> > > > is
> > > > >> > >> > >> > > > > > done
> > > > >> > >> > >> > > > > > >> for GridStat -- no quotes with
commas
> between
> > > > each
> > > > >> > item.
> > > > >> > >> > The
> > > > >> > >> > >> > > wrapper
> > > > >> > >> > >> > > > > > >> should
> > > > >> > >> > >> > > > > > >> format it properly.
> > > > >> > >> > >> > > > > > >>
> > > > >> > >> > >> > > > > > >> Here is an example from an existing
use
> case:
> > > > >> > >> > >> > > > > > >>
> > > > >> > >> > >> > > > > > >> GRID_STAT_VERIFICATION_MASK_TEMPLATE
=
> > > > >> > >> > >> > > > > > >>
> > > > >> > >> > >> > >
> > > > >> > >>
> > > >
{INPUT_BASE}/model_applications/precipitation/mask/CONUS_HRRRTLE.nc,
> > > > >> > >> > >> > > > > > >>
> > > > >> > >> > >> > >
> > > > >> > >>
> > >
{INPUT_BASE}/model_applications/precipitation/mask/EAST_HRRRTLE.nc,
> > > > >> > >> > >> > > > > > >>
> > > > >> > >> > >> >
> > > > >> >
> {INPUT_BASE}/model_applications/precipitation/mask/WEST_HRRRTLE.nc
> > > > >> > >> > >> > > > > > >>
> > > > >> > >> > >> > > > > > >> You should be able to set them the
same way
> > > using
> > > > >> > >> > >> > > > > > >>
ENSEMBLE_STAT_VERIFICATION_MASK_TEMPLATE.
> Let
> > > me
> > > > >> know
> > > > >> > if
> > > > >> > >> > that
> > > > >> > >> > >> > > > doesn't
> > > > >> > >> > >> > > > > > >> work.
> > > > >> > >> > >> > > > > > >>
> > > > >> > >> > >> > > > > > >> - George
> > > > >> > >> > >> > > > > > >>
> > > > >> > >> > >> > > > > > >> On Tue, Jan 5, 2021 at 1:45 PM
> > > > >> Binbin.Zhou at noaa.gov
> > > > >> > via
> > > > >> > >> > RT <
> > > > >> > >> > >> > > > > > >> met_help at ucar.edu> wrote:
> > > > >> > >> > >> > > > > > >>
> > > > >> > >> > >> > > > > > >> >
> > > > >> > >> > >> > > > > > >> > <URL:
> > > > >> > >> > >>
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
> > > > >> > >> > >> > >
> > > > >> > >> > >> > > > > > >> >
> > > > >> > >> > >> > > > > > >> > George,
> > > > >> > >> > >> > > > > > >> >
> > > > >> > >> > >> > > > > > >> > I got another issue for
verification
> mask
> > > > >> setting.
> > > > >> > >> > >> > > > > > >> >
> > > > >> > >> > >> > > > > > >> > I am using $VERIF_MASK in
EnsembleStat
> > config
> > > > >> f/ile
> > > > >> > >> > >> > > > > > >> > mask = {
> > > > >> > >> > >> > > > > > >> > grid = [];
> > > > >> > >> > >> > > > > > >> > poly = [${VERIF_MASK}];
> > > > >> > >> > >> > > > > > >> > sid = [];
> > > > >> > >> > >> > > > > > >> > }
> > > > >> > >> > >> > > > > > >> >
> > > > >> > >> > >> > > > > > >> > And using
> > > GRID_STAT_VERIFICATION_MASK_TEMPLATE
> > > > >> to
> > > > >> > >> define
> > > > >> > >> > >> > > several
> > > > >> > >> > >> > > > > > >> polygon
> > > > >> > >> > >> > > > > > >> > nc mask files
> > > > >> > >> > >> > > > > > >> > But it seems not working. But it
works
> for
> > > > >> Gridstat
> > > > >> > >> > config
> > > > >> > >> > >> in
> > > > >> > >> > >> > > > suich
> > > > >> > >> > >> > > > > > >> > setting.
> > > > >> > >> > >> > > > > > >> > I can not find ENSEMBLE_STAT_
> > > > >> > >> VERIFICATION_MASK_TEMPLATE
> > > > >> > >> > in
> > > > >> > >> > >> > the
> > > > >> > >> > >> > > > > > METplus
> > > > >> > >> > >> > > > > > >> doc
> > > > >> > >> > >> > > > > > >> >
> > > > >> > >> > >> > > > > > >> > So I define VERIF_MASK in
[user_env_vars]
> > > part.
> > > > >> > >> > >> > > > > > >> > It values can not be passed to
ploy =
> > > > >> > [${VERIF_MASK}]
> > > > >> > >> in
> > > > >> > >> > >> the
> > > > >> > >> > >> > > > > > >> EnsembleStat
> > > > >> > >> > >> > > > > > >> > conf if more than one nc files
included.
> > > > >> > >> > >> > > > > > >> > For example
> > > > >> > >> > >> > > > > > >> > VERIF_MASK=" '/part/p1.cn',
'/path/
> p2.nc'
> > "
> > > > >> > >> > >> > > > > > >> > the error says poly = [/path/p1,]
> > > > >> > >> > >> > > > > > >> > It seems double quote or single
quote can
> > not
> > > > be
> > > > >> > >> passed
> > > > >> > >> > to
> > > > >> > >> > >> > > > > VERIF_MASK
> > > > >> > >> > >> > > > > > in
> > > > >> > >> > >> > > > > > >> > the EnsembleStat config.
> > > > >> > >> > >> > > > > > >> > I tried use back slash \ to before
quote,
> > but
> > > > >> still
> > > > >> > >> not
> > > > >> > >> > >> > working
> > > > >> > >> > >> > > > > > >> >
> > > > >> > >> > >> > > > > > >> > Binbin
> > > > >> > >> > >> > > > > > >> >
> > > > >> > >> > >> > > > > > >> >
> > > > >> > >> > >> > > > > > >> > On Tue, Jan 5, 2021 at 10:33 AM
Binbin
> > Zhou -
> > > > >> NOAA
> > > > >> > >> > >> Affiliate <
> > > > >> > >> > >> > > > > > >> > binbin.zhou at noaa.gov> wrote:
> > > > >> > >> > >> > > > > > >> >
> > > > >> > >> > >> > > > > > >> > > George,
> > > > >> > >> > >> > > > > > >> > >
> > > > >> > >> > >> > > > > > >> > > Thanks for your quick
response! I'll
> > > test
> > > > >> this
> > > > >> > >> > >> settings
> > > > >> > >> > >> > and
> > > > >> > >> > >> > > > let
> > > > >> > >> > >> > > > > > >> > > you know the results.
> > > > >> > >> > >> > > > > > >> > >
> > > > >> > >> > >> > > > > > >> > > Binbin
> > > > >> > >> > >> > > > > > >> > >
> > > > >> > >> > >> > > > > > >> > > On Tue, Jan 5, 2021 at 10:17 AM
George
> > > McCabe
> > > > >> via
> > > > >> > >> RT <
> > > > >> > >> > >> > > > > > >> met_help at ucar.edu>
> > > > >> > >> > >> > > > > > >> > > wrote:
> > > > >> > >> > >> > > > > > >> > >
> > > > >> > >> > >> > > > > > >> > >> Hi Binbin,
> > > > >> > >> > >> > > > > > >> > >>
> > > > >> > >> > >> > > > > > >> > >> Happy New Year to you too!
> > > > >> > >> > >> > > > > > >> > >>
> > > > >> > >> > >> > > > > > >> > >> I will comment on each
configuration
> > > > variable
> > > > >> and
> > > > >> > >> how
> > > > >> > >> > to
> > > > >> > >> > >> > set
> > > > >> > >> > >> > > it
> > > > >> > >> > >> > > > > in
> > > > >> > >> > >> > > > > > a
> > > > >> > >> > >> > > > > > >> > >> METplus config inline:
> > > > >> > >> > >> > > > > > >> > >>
> > > > >> > >> > >> > > > > > >> > >> ens = {
> > > > >> > >> > >> > > > > > >> > >> ens_thresh = 1.0;
> > > > >> > >> > >> > > > > > >> > >>
> > > > >> > >> > >> > > > > > >> > >>
> > > > >> > >> > >> > > > > > >> > >> *This is controlled by the
> > > > >> > ENSEMBLE_STAT_ENS_THRESH
> > > > >> > >> > >> > variable.
> > > > >> > >> > >> > > > The
> > > > >> > >> > >> > > > > > >> > default
> > > > >> > >> > >> > > > > > >> > >> value is 1.0, so you don't need
to
> > include
> > > > it
> > > > >> in
> > > > >> > >> your
> > > > >> > >> > >> > config
> > > > >> > >> > >> > > > > file,
> > > > >> > >> > >> > > > > > >> but
> > > > >> > >> > >> > > > > > >> > you
> > > > >> > >> > >> > > > > > >> > >> can if you may adjust this
value at
> some
> > > > >> point.*
> > > > >> > >> > >> > > > > > >> > >>
> > > > >> > >> > >> > > > > > >> > >> vld_thresh = 1.0;
> > > > >> > >> > >> > > > > > >> > >>
> > > > >> > >> > >> > > > > > >> > >> *This value is set to 1.0 by
default
> so
> > we
> > > > >> don't
> > > > >> > >> need
> > > > >> > >> > to
> > > > >> > >> > >> > > worry
> > > > >> > >> > >> > > > > > about
> > > > >> > >> > >> > > > > > >> it
> > > > >> > >> > >> > > > > > >> > >> right now.*
> > > > >> > >> > >> > > > > > >> > >>
> > > > >> > >> > >> > > > > > >> > >> field = [
> > > > >> > >> > >> > > > > > >> > >>
> > > > >> > >> > >> > > > > > >> > >> {
> > > > >> > >> > >> > > > > > >> > >> name = "HGT";
> > > > >> > >> > >> > > > > > >> > >> level = "P500";
> > > > >> > >> > >> > > > > > >> > >> obs_thresh = [
<=CDP10,
> > > > >> >CDP10&&<=CDP20,
> > > > >> > >> > >> > > > > >CDP20&&<=CDP30,
> > > > >> > >> > >> > > > > > >> > >> >CDP30&&<=CDP40,
>CDP40&&<=CDP50,
> > > > >> > >CDP50&&<=CDP60,
> > > > >> > >> > >> > > > > >CDP60&&<=CDP70,
> > > > >> > >> > >> > > > > > >> > >> >CDP70&&<=CDP80,
>CDP80&&<=CDP90,
> >CDP90
> > > ];
> > > > >> > >> > >> > > > > > >> > >> }
> > > > >> > >> > >> > > > > > >> > >> ]
> > > > >> > >> > >> > > > > > >> > >> }
> > > > >> > >> > >> > > > > > >> > >> fcst = ens;
> > > > >> > >> > >> > > > > > >> > >> obs = fcst;
> > > > >> > >> > >> > > > > > >> > >>
> > > > >> > >> > >> > > > > > >> > >> *1) The field info for ens is
set in
> the
> > > > >> > >> > >> > > > > > >> > >>
ENS_VAR<n>_[NAME/LEVEL/THRESH/OPTIONS]
> > > > >> variables.
> > > > >> > >> The
> > > > >> > >> > >> fcst
> > > > >> > >> > >> > > and
> > > > >> > >> > >> > > > > obs
> > > > >> > >> > >> > > > > > >> field
> > > > >> > >> > >> > > > > > >> > >> info are set in the
corresponding
> > > > >> FCST_VAR<n>_*
> > > > >> > and
> > > > >> > >> > >> > > > OBS_VAR<n>_*
> > > > >> > >> > >> > > > > > >> > variables
> > > > >> > >> > >> > > > > > >> > >> respectively, or you can use
> > BOTH_VAR<n>_*
> > > > if
> > > > >> the
> > > > >> > >> FCST
> > > > >> > >> > >> and
> > > > >> > >> > >> > > OBS
> > > > >> > >> > >> > > > > > values
> > > > >> > >> > >> > > > > > >> > are
> > > > >> > >> > >> > > > > > >> > >> the same.*
> > > > >> > >> > >> > > > > > >> > >>
> > > > >> > >> > >> > > > > > >> > >> *If ENS_VAR<n>_* variables are
not
> > > > explicitly
> > > > >> > set,
> > > > >> > >> > then
> > > > >> > >> > >> it
> > > > >> > >> > >> > > will
> > > > >> > >> > >> > > > > use
> > > > >> > >> > >> > > > > > >> the
> > > > >> > >> > >> > > > > > >> > >> values from FCST_VAR<n>_*.*
> > > > >> > >> > >> > > > > > >> > >> *Since the fcst, obs, and ens
are all
> > the
> > > > same
> > > > >> > you
> > > > >> > >> > could
> > > > >> > >> > >> > just
> > > > >> > >> > >> > > > use
> > > > >> > >> > >> > > > > > >> > >> BOTH_VAR<n>_* variables to
control all
> > 3,
> > > > >> > although
> > > > >> > >> > keep
> > > > >> > >> > >> in
> > > > >> > >> > >> > > mind
> > > > >> > >> > >> > > > > > that
> > > > >> > >> > >> > > > > > >> if
> > > > >> > >> > >> > > > > > >> > >> you
> > > > >> > >> > >> > > > > > >> > >> need to change one of them for
any
> > reason,
> > > > it
> > > > >> > will
> > > > >> > >> be
> > > > >> > >> > >> more
> > > > >> > >> > >> > > > > > difficult
> > > > >> > >> > >> > > > > > >> to
> > > > >> > >> > >> > > > > > >> > do
> > > > >> > >> > >> > > > > > >> > >> this. If you know that they
will
> always
> > be
> > > > the
> > > > >> > same
> > > > >> > >> > >> values,
> > > > >> > >> > >> > > > then
> > > > >> > >> > >> > > > > I
> > > > >> > >> > >> > > > > > >> > >> recommend using BOTH_, but if
you know
> > > they
> > > > >> may
> > > > >> > >> change
> > > > >> > >> > >> or
> > > > >> > >> > >> > are
> > > > >> > >> > >> > > > > > >> unsure, I
> > > > >> > >> > >> > > > > > >> > >> would recommend setting them by
> > > referencing
> > > > >> the
> > > > >> > >> other
> > > > >> > >> > >> > > > variables,
> > > > >> > >> > >> > > > > > >> i.e.*
> > > > >> > >> > >> > > > > > >> > >>
> > > > >> > >> > >> > > > > > >> > >> *FCST_VAR1_NAME = HGT*
> > > > >> > >> > >> > > > > > >> > >> *FCST_VAR1_LEVELS = P500 *
> > > > >> > >> > >> > > > > > >> > >> *OBS_VAR1_NAME =
{FCST_VAR1_NAME}*
> > > > >> > >> > >> > > > > > >> > >> *OBS_VAR1_LEVELS =
{FCST_VAR1_LEVELS}*
> > > > >> > >> > >> > > > > > >> > >>
> > > > >> > >> > >> > > > > > >> > >> *2) The
[FCST/OBS/ENS]_VAR<n>_THRESH
> > > > variables
> > > > >> > set
> > > > >> > >> the
> > > > >> > >> > >> > > > cat_thresh
> > > > >> > >> > >> > > > > > >> values
> > > > >> > >> > >> > > > > > >> > >> in
> > > > >> > >> > >> > > > > > >> > >> the field info. A variable
specific to
> > > > >> obs_thresh
> > > > >> > >> is
> > > > >> > >> > not
> > > > >> > >> > >> > > > > currently
> > > > >> > >> > >> > > > > > >> > >> supported, however you can set
these
> > > values
> > > > by
> > > > >> > >> using
> > > > >> > >> > the
> > > > >> > >> > >> > > > > > >> > ENS_VAR1_OPTIONS
> > > > >> > >> > >> > > > > > >> > >> variable, i.e.*
> > > > >> > >> > >> > > > > > >> > >>
> > > > >> > >> > >> > > > > > >> > >> *ENS_VAR1_OPTIONS = obs_thresh
= [
> > > <=CDP10,
> > > > >> > >> > >> > >CDP10&&<=CDP20,
> > > > >> > >> > >> > > > > > >> > >> >CDP20&&<=CDP30,
>CDP30&&<=CDP40,
> > > > >> > >CDP40&&<=CDP50,
> > > > >> > >> > >> > > > > >CDP50&&<=CDP60,
> > > > >> > >> > >> > > > > > >> > >> >CDP60&&<=CDP70,
>CDP70&&<=CDP80,
> > > > >> > >CDP80&&<=CDP90,
> > > > >> > >> > >> >CDP90
> > > > >> > >> > >> > ];*
> > > > >> > >> > >> > > > > > >> > >>
> > > > >> > >> > >> > > > > > >> > >>
> > > > >> > >> > >> > > > > > >> > >> *Remember to include the
semicolon at
> > the
> > > > >> end! *
> > > > >> > >> > >> > > > > > >> > >>
> > > > >> > >> > >> > > > > > >> > >> ens_ssvar_bin_size = 1000000;
> > > > >> > >> > >> > > > > > >> > >> *1) This variable is different
from
> the
> > > > >> default
> > > > >> > and
> > > > >> > >> > not
> > > > >> > >> > >> > > > currently
> > > > >> > >> > >> > > > > > >> > >> supported
> > > > >> > >> > >> > > > > > >> > >> with a METplus config variable.
I will
> > add
> > > > >> this
> > > > >> > to
> > > > >> > >> the
> > > > >> > >> > >> list
> > > > >> > >> > >> > > of
> > > > >> > >> > >> > > > > > >> variables
> > > > >> > >> > >> > > > > > >> > >> in
> > > > >> > >> > >> > > > > > >> > >> MET config files that we want
to
> > support.
> > > > >> > However,
> > > > >> > >> in
> > > > >> > >> > >> the
> > > > >> > >> > >> > > > > meantime
> > > > >> > >> > >> > > > > > >> you
> > > > >> > >> > >> > > > > > >> > can
> > > > >> > >> > >> > > > > > >> > >> copy the default wrapped MET
config
> file
> > > and
> > > > >> > >> modify it
> > > > >> > >> > >> to
> > > > >> > >> > >> > fit
> > > > >> > >> > >> > > > > your
> > > > >> > >> > >> > > > > > >> > needs.
> > > > >> > >> > >> > > > > > >> > >> To do this, you will need to:*
> > > > >> > >> > >> > > > > > >> > >>
> > > > >> > >> > >> > > > > > >> > >> * a) Copy
> > > > >> > >> > >> >
METplus/parm/met_config/EnsembleStatConfig_wrapped
> > > > >> > >> > >> > > > to
> > > > >> > >> > >> > > > > > the
> > > > >> > >> > >> > > > > > >> > >> directory that contains your
METplus
> > > config
> > > > >> file
> > > > >> > >> for
> > > > >> > >> > >> this
> > > > >> > >> > >> > use
> > > > >> > >> > >> > > > > case.
> > > > >> > >> > >> > > > > > >> > Rename
> > > > >> > >> > >> > > > > > >> > >> it by replacing "wrapped" with
a short
> > > > >> > description
> > > > >> > >> > that
> > > > >> > >> > >> > > > pertains
> > > > >> > >> > >> > > > > to
> > > > >> > >> > >> > > > > > >> your
> > > > >> > >> > >> > > > > > >> > >> use case.*
> > > > >> > >> > >> > > > > > >> > >>
> > > > >> > >> > >> > > > > > >> > >> * b) In your METplus config
file,
> > change
> > > > the
> > > > >> > >> value of
> > > > >> > >> > >> > > > > > >> > >> ENSEMBLE_STAT_CONFIG_FILE to
point to
> > the
> > > > >> path of
> > > > >> > >> this
> > > > >> > >> > >> new
> > > > >> > >> > >> > > > config
> > > > >> > >> > >> > > > > > >> file.*
> > > > >> > >> > >> > > > > > >> > >>
> > > > >> > >> > >> > > > > > >> > >> * c) If you know the value you
want
> to
> > > use
> > > > >> for
> > > > >> > >> this
> > > > >> > >> > >> > variable
> > > > >> > >> > >> > > > > will
> > > > >> > >> > >> > > > > > >> > always
> > > > >> > >> > >> > > > > > >> > >> be 1000000, then simply set the
> variable
> > > to
> > > > >> that
> > > > >> > >> > value.
> > > > >> > >> > >> If
> > > > >> > >> > >> > > you
> > > > >> > >> > >> > > > > > think
> > > > >> > >> > >> > > > > > >> you
> > > > >> > >> > >> > > > > > >> > >> may want to change the value,
then you
> > can
> > > > >> > utilize
> > > > >> > >> the
> > > > >> > >> > >> > > > > > >> [user_env_vars]
> > > > >> > >> > >> > > > > > >> > >> functionality. See:
> > > > >> > >> > >> > > > > > >> > >>
> > > > >> > >> > >> > > > > > >> > >>
> > > > >> > >> > >> > > > > > >> >
> > > > >> > >> > >> > > > > > >>
> > > > >> > >> > >> > > > > >
> > > > >> > >> > >> > > > >
> > > > >> > >> > >> > > >
> > > > >> > >> > >> > >
> > > > >> > >> > >> >
> > > > >> > >> > >>
> > > > >> > >> >
> > > > >> > >>
> > > > >> >
> > > > >>
> > > >
> > >
> >
>
https://dtcenter.github.io/METplus/latest/Users_Guide/systemconfiguration.html#user-
defined-config
> > > > >> > >> > >> > > > > > >> > >> <
> > > > >> > >> > >> > > > > > >> > >>
> > > > >> > >> > >> > > > > > >> >
> > > > >> > >> > >> > > > > > >>
> > > > >> > >> > >> > > > > >
> > > > >> > >> > >> > > > >
> > > > >> > >> > >> > > >
> > > > >> > >> > >> > >
> > > > >> > >> > >> >
> > > > >> > >> > >>
> > > > >> > >> >
> > > > >> > >>
> > > > >> >
> > > > >>
> > > >
> > >
> >
>
https://dtcenter.github.io/METplus/latest/Users_Guide/systemconfiguration.html#user-
defined-config
> > > > >> > >> > >> > > > > > >> > >> >*
> > > > >> > >> > >> > > > > > >> > >> *In this case, you would add
the
> > following
> > > > to
> > > > >> > your
> > > > >> > >> > >> METplus
> > > > >> > >> > >> > > > > config:*
> > > > >> > >> > >> > > > > > >> > >>
> > > > >> > >> > >> > > > > > >> > >> *[user_env_vars]*
> > > > >> > >> > >> > > > > > >> > >> *ENS_SSVAR_BIN_SIZE = 1000000*
> > > > >> > >> > >> > > > > > >> > >>
> > > > >> > >> > >> > > > > > >> > >> *Then change the line in your
> > EnsembleStat
> > > > >> config
> > > > >> > >> file
> > > > >> > >> > >> that
> > > > >> > >> > >> > > you
> > > > >> > >> > >> > > > > > >> copied
> > > > >> > >> > >> > > > > > >> > >> to:*
> > > > >> > >> > >> > > > > > >> > >>
> > > > >> > >> > >> > > > > > >> > >> * ens_ssvar_bin_size =
> > > > ${ENS_SSVAR_BIN_SIZE};
> > > > >> *
> > > > >> > >> > >> > > > > > >> > >>
> > > > >> > >> > >> > > > > > >> > >> ens_phist_bin_size = 0.05;
> > > > >> > >> > >> > > > > > >> > >> *This variable uses the default
value,
> > so
> > > > you
> > > > >> > don't
> > > > >> > >> > >> need to
> > > > >> > >> > >> > > do
> > > > >> > >> > >> > > > > > >> anything
> > > > >> > >> > >> > > > > > >> > >> here. If you need to make it
> > configurable
> > > or
> > > > >> > change
> > > > >> > >> > the
> > > > >> > >> > >> > > value,
> > > > >> > >> > >> > > > > then
> > > > >> > >> > >> > > > > > >> > follow
> > > > >> > >> > >> > > > > > >> > >> the instructions for setting
> > > > >> ens_ssvar_bin_size.*
> > > > >> > >> > >> > > > > > >> > >>
> > > > >> > >> > >> > > > > > >> > >> climo_mean = fcst;
> > > > >> > >> > >> > > > > > >> > >> climo_mean = {
> > > > >> > >> > >> > > > > > >> > >> file_name = "${CLIM_MEAN}";
> > > > >> > >> > >> > > > > > >> > >> time_interp_method =
DW_MEAN;
> > > > >> > >> > >> > > > > > >> > >> match_day = TRUE;
> > > > >> > >> > >> > > > > > >> > >> time_step = 21600;
> > > > >> > >> > >> > > > > > >> > >> }
> > > > >> > >> > >> > > > > > >> > >>
> > > > >> > >> > >> > > > > > >> > >>
> > > > >> > >> > >> > > > > > >> > >> *Instead of using CLIM_MEAN,
you can
> set
> > > > >> > >> > >> > > > > > >> > >>
> > > > ENSEMBLE_STAT_CLIMO_MEAN_INPUT_[DIR/TEMPLATE]
> > > > >> in
> > > > >> > >> the
> > > > >> > >> > >> > METplus
> > > > >> > >> > >> > > > > > config.
> > > > >> > >> > >> > > > > > >> You
> > > > >> > >> > >> > > > > > >> > >> can use filename template
syntax in
> the
> > > > >> _TEMPLATE
> > > > >> > >> > value,
> > > > >> > >> > >> > i.e.
> > > > >> > >> > >> > > > > > >> > >> {valid?fmt=%m%d}. The other
variables
> in
> > > the
> > > > >> > >> > climo_mean
> > > > >> > >> > >> > > > > dictionary
> > > > >> > >> > >> > > > > > >> are
> > > > >> > >> > >> > > > > > >> > >> actually old variables that
have been
> > > > replaced
> > > > >> > with
> > > > >> > >> > >> > > > day_interval
> > > > >> > >> > >> > > > > > and
> > > > >> > >> > >> > > > > > >> > >> hour_interval, but the values
you use
> > are
> > > > the
> > > > >> old
> > > > >> > >> > >> defaults,
> > > > >> > >> > >> > > so
> > > > >> > >> > >> > > > > you
> > > > >> > >> > >> > > > > > >> > >> shouldn't need to set them.*
> > > > >> > >> > >> > > > > > >> > >>
> > > > >> > >> > >> > > > > > >> > >> climo_stdev = climo_mean;
> > > > >> > >> > >> > > > > > >> > >> climo_stdev = {
> > > > >> > >> > >> > > > > > >> > >> file_name = "${CLIM_STDV}";
> > > > >> > >> > >> > > > > > >> > >> }
> > > > >> > >> > >> > > > > > >> > >>
> > > > >> > >> > >> > > > > > >> > >> *Similarly to CLIM_MEAN, you
can use
> > > > >> > >> > >> > > > > > >> > >>
> > > > >> ENSEMBLE_STAT_CLIMO_STDEV_INPUT_[DIR/TEMPLATE] to
> > > > >> > >> set
> > > > >> > >> > >> this
> > > > >> > >> > >> > > file
> > > > >> > >> > >> > > > > > >> name.*
> > > > >> > >> > >> > > > > > >> > >>
> > > > >> > >> > >> > > > > > >> > >> climo_cdf = {
> > > > >> > >> > >> > > > > > >> > >> cdf_bins = 11;
> > > > >> > >> > >> > > > > > >> > >> center_bins = TRUE;
> > > > >> > >> > >> > > > > > >> > >> write_bins = TRUE;
> > > > >> > >> > >> > > > > > >> > >> }
> > > > >> > >> > >> > > > > > >> > >> *The value for write_bins is
the
> > default,
> > > > but
> > > > >> the
> > > > >> > >> > values
> > > > >> > >> > >> > for
> > > > >> > >> > >> > > > > > cdf_bins
> > > > >> > >> > >> > > > > > >> > and
> > > > >> > >> > >> > > > > > >> > >> center_bins do not. To set
these,
> follow
> > > the
> > > > >> > above
> > > > >> > >> > >> > > instructions
> > > > >> > >> > >> > > > > for
> > > > >> > >> > >> > > > > > >> > >> ens_ssvar_bin_size to override
them
> > and/or
> > > > >> make
> > > > >> > >> them
> > > > >> > >> > >> > > > configurable
> > > > >> > >> > >> > > > > > >> > through
> > > > >> > >> > >> > > > > > >> > >> METplus. I will also add these
> variables
> > > to
> > > > >> the
> > > > >> > >> list
> > > > >> > >> > of
> > > > >> > >> > >> MET
> > > > >> > >> > >> > > > > configs
> > > > >> > >> > >> > > > > > >> that
> > > > >> > >> > >> > > > > > >> > >> users want to be able to easily
> > configure
> > > > >> through
> > > > >> > >> > >> METplus
> > > > >> > >> > >> > > > > configs.*
> > > > >> > >> > >> > > > > > >> > >>
> > > > >> > >> > >> > > > > > >> > >> Please let me know if you run
into any
> > > > issues
> > > > >> > >> setting
> > > > >> > >> > >> any
> > > > >> > >> > >> > of
> > > > >> > >> > >> > > > that
> > > > >> > >> > >> > > > > > up.
> > > > >> > >> > >> > > > > > >> > >> Also,
> > > > >> > >> > >> > > > > > >> > >> if there are any other MET
config
> > > variables
> > > > >> that
> > > > >> > >> you
> > > > >> > >> > >> want
> > > > >> > >> > >> > to
> > > > >> > >> > >> > > > see
> > > > >> > >> > >> > > > > > >> > supported
> > > > >> > >> > >> > > > > > >> > >> in METplus, let me know and I
will
> make
> > > sure
> > > > >> they
> > > > >> > >> get
> > > > >> > >> > >> > > included
> > > > >> > >> > >> > > > > when
> > > > >> > >> > >> > > > > > >> we
> > > > >> > >> > >> > > > > > >> > >> have
> > > > >> > >> > >> > > > > > >> > >> a chance to refactor those
wrappers.
> It
> > is
> > > > >> > >> possible to
> > > > >> > >> > >> add
> > > > >> > >> > >> > > > > support
> > > > >> > >> > >> > > > > > >> for
> > > > >> > >> > >> > > > > > >> > MET
> > > > >> > >> > >> > > > > > >> > >> configs using the above
instructions,
> > but
> > > it
> > > > >> is
> > > > >> > >> always
> > > > >> > >> > >> > easier
> > > > >> > >> > >> > > > and
> > > > >> > >> > >> > > > > > >> less
> > > > >> > >> > >> > > > > > >> > >> error-prone to have them
configurable
> > > > directly
> > > > >> > >> > through a
> > > > >> > >> > >> > > > variable
> > > > >> > >> > >> > > > > > in
> > > > >> > >> > >> > > > > > >> the
> > > > >> > >> > >> > > > > > >> > >> METplus config.
> > > > >> > >> > >> > > > > > >> > >>
> > > > >> > >> > >> > > > > > >> > >> Thanks,
> > > > >> > >> > >> > > > > > >> > >> George
> > > > >> > >> > >> > > > > > >> > >>
> > > > >> > >> > >> > > > > > >> > >> On Tue, Jan 5, 2021 at 7:14 AM
> > > > >> > >> Binbin.Zhou at noaa.gov
> > > > >> > >> > via
> > > > >> > >> > >> > RT <
> > > > >> > >> > >> > > > > > >> > >> met_help at ucar.edu> wrote:
> > > > >> > >> > >> > > > > > >> > >>
> > > > >> > >> > >> > > > > > >> > >> >
> > > > >> > >> > >> > > > > > >> > >> > Tue Jan 05 07:14:54 2021:
Request
> > 98116
> > > > was
> > > > >> > acted
> > > > >> > >> > >> upon.
> > > > >> > >> > >> > > > > > >> > >> > Transaction: Ticket created
by
> > > > >> > >> Binbin.Zhou at noaa.gov
> > > > >> > >> > >> > > > > > >> > >> > Queue: met_help
> > > > >> > >> > >> > > > > > >> > >> > Subject: CDP threshold
setting
> in
> > > > >> > >> EnsembleStat
> > > > >> > >> > >> conf
> > > > >> > >> > >> > > > > > >> > >> > Owner: Nobody
> > > > >> > >> > >> > > > > > >> > >> > Requestors:
Binbin.Zhou at noaa.gov
> > > > >> > >> > >> > > > > > >> > >> > Status: new
> > > > >> > >> > >> > > > > > >> > >> > Ticket <URL:
> > > > >> > >> > >> > > > > > >>
> > > > >> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116
> > > > >> > >> > >> > > > > > >> > >
> > > > >> > >> > >> > > > > > >> > >> >
> > > > >> > >> > >> > > > > > >> > >> >
> > > > >> > >> > >> > > > > > >> > >> > George,
> > > > >> > >> > >> > > > > > >> > >> >
> > > > >> > >> > >> > > > > > >> > >> > Happy New Year!
> > > > >> > >> > >> > > > > > >> > >> >
> > > > >> > >> > >> > > > > > >> > >> > I am working on transition
of our
> > > > >> MET-based
> > > > >> > >> > global
> > > > >> > >> > >> > > > ensemble
> > > > >> > >> > >> > > > > > >> > >> verification
> > > > >> > >> > >> > > > > > >> > >> > to METplus based package. In
this
> > > package
> > > > >> > >> > climatology
> > > > >> > >> > >> > bins
> > > > >> > >> > >> > > > (10
> > > > >> > >> > >> > > > > > >> bins)
> > > > >> > >> > >> > > > > > >> > are
> > > > >> > >> > >> > > > > > >> > >> > used.
> > > > >> > >> > >> > > > > > >> > >> > In current ensemble stat
config
> file,
> > > the
> > > > >> > >> relevant
> > > > >> > >> > >> > entries
> > > > >> > >> > >> > > > iare
> > > > >> > >> > >> > > > > > >> > defined
> > > > >> > >> > >> > > > > > >> > >> > like following
> > > > >> > >> > >> > > > > > >> > >> >
> > > > >> > >> > >> > > > > > >> > >> > ens = {
> > > > >> > >> > >> > > > > > >> > >> > ens_thresh = 1.0;
> > > > >> > >> > >> > > > > > >> > >> > vld_thresh = 1.0;
> > > > >> > >> > >> > > > > > >> > >> >
> > > > >> > >> > >> > > > > > >> > >> > field = [
> > > > >> > >> > >> > > > > > >> > >> >
> > > > >> > >> > >> > > > > > >> > >> > {
> > > > >> > >> > >> > > > > > >> > >> > name = "HGT";
> > > > >> > >> > >> > > > > > >> > >> > level = "P500";
> > > > >> > >> > >> > > > > > >> > >> > obs_thresh = [
<=CDP10,
> > > > >> > >CDP10&&<=CDP20,
> > > > >> > >> > >> > > > > > >CDP20&&<=CDP30,
> > > > >> > >> > >> > > > > > >> > >> > >CDP30&&<=CDP40,
>CDP40&&<=CDP50,
> > > > >> > >> >CDP50&&<=CDP60,
> > > > >> > >> > >> > > > > > >CDP60&&<=CDP70,
> > > > >> > >> > >> > > > > > >> > >> > >CDP70&&<=CDP80,
>CDP80&&<=CDP90,
> > >CDP90
> > > > ];
> > > > >> > >> > >> > > > > > >> > >> > }
> > > > >> > >> > >> > > > > > >> > >> > ]
> > > > >> > >> > >> > > > > > >> > >> > }
> > > > >> > >> > >> > > > > > >> > >> > fcst = ens;
> > > > >> > >> > >> > > > > > >> > >> > obs = fcst;
> > > > >> > >> > >> > > > > > >> > >> > ens_ssvar_bin_size = 1000000;
> > > > >> > >> > >> > > > > > >> > >> > ens_phist_bin_size = 0.05;
> > > > >> > >> > >> > > > > > >> > >> > climo_mean = fcst;
> > > > >> > >> > >> > > > > > >> > >> > climo_mean = {
> > > > >> > >> > >> > > > > > >> > >> > file_name =
"${CLIM_MEAN}";
> > > > >> > >> > >> > > > > > >> > >> > time_interp_method =
DW_MEAN;
> > > > >> > >> > >> > > > > > >> > >> > match_day = TRUE;
> > > > >> > >> > >> > > > > > >> > >> > time_step =
21600;
> > > > >> > >> > >> > > > > > >> > >> > }
> > > > >> > >> > >> > > > > > >> > >> >
> > > > >> > >> > >> > > > > > >> > >> > climo_stdev = climo_mean;
> > > > >> > >> > >> > > > > > >> > >> > climo_stdev = {
> > > > >> > >> > >> > > > > > >> > >> > file_name = "${CLIM_STDV}";
> > > > >> > >> > >> > > > > > >> > >> > }
> > > > >> > >> > >> > > > > > >> > >> >
> > > > >> > >> > >> > > > > > >> > >> > climo_cdf = {
> > > > >> > >> > >> > > > > > >> > >> > cdf_bins = 11;
> > > > >> > >> > >> > > > > > >> > >> > center_bins = TRUE;
> > > > >> > >> > >> > > > > > >> > >> > write_bins = TRUE;
> > > > >> > >> > >> > > > > > >> > >> > }
> > > > >> > >> > >> > > > > > >> > >> >
> > > > >> > >> > >> > > > > > >> > >> > I can not find the
correspondent
> > > settings
> > > > in
> > > > >> > its
> > > > >> > >> > conf
> > > > >> > >> > >> > file
> > > > >> > >> > >> > > > from
> > > > >> > >> > >> > > > > > >> > METplus
> > > > >> > >> > >> > > > > > >> > >> > online doc.
> > > > >> > >> > >> > > > > > >> > >> > Can you help me look at this?
> > > > >> > >> > >> > > > > > >> > >> >
> > > > >> > >> > >> > > > > > >> > >> > Thanks!
> > > > >> > >> > >> > > > > > >> > >> >
> > > > >> > >> > >> > > > > > >> > >> > Binbin
> > > > >> > >> > >> > > > > > >> > >> >
> > > > >> > >> > >> > > > > > >> > >> > --
> > > > >> > >> > >> > > > > > >> > >> >
> > > > >> > >> > >> > > > > > >> > >> > Binbin Zhou
> > > > >> > >> > >> > > > > > >> > >> >
> > > > >> > >> > >> > > > > > >> > >> > IMSG at NOAA/NWS/NCEP/EMC
> > > > >> > >> > >> > > > > > >> > >> >
> > > > >> > >> > >> > > > > > >> > >> > 5830 University Research Ct.
> > > > >> > >> > >> > > > > > >> > >> >
> > > > >> > >> > >> > > > > > >> > >> > College Park, MD 20740
> > > > >> > >> > >> > > > > > >> > >> >
> > > > >> > >> > >> > > > > > >> > >> > Binbin.Zhou at noaa.gov
> > > > >> > >> > >> > > > > > >> > >> >
> > > > >> > >> > >> > > > > > >> > >> > 301-683-3683
> > > > >> > >> > >> > > > > > >> > >> >
> > > > >> > >> > >> > > > > > >> > >> >
> > > > >> > >> > >> > > > > > >> > >>
> > > > >> > >> > >> > > > > > >> > >> --
> > > > >> > >> > >> > > > > > >> > >> George McCabe - Software
Engineer III
> > > > >> > >> > >> > > > > > >> > >> National Center for Atmospheric
> Research
> > > > >> > >> > >> > > > > > >> > >> Research Applications
Laboratory
> > > > >> > >> > >> > > > > > >> > >> 303-497-2768
> > > > >> > >> > >> > > > > > >> > >> ---
> > > > >> > >> > >> > > > > > >> > >> My working day may not be your
working
> > > day.
> > > > >> > Please
> > > > >> > >> do
> > > > >> > >> > >> not
> > > > >> > >> > >> > > feel
> > > > >> > >> > >> > > > > > >> obliged
> > > > >> > >> > >> > > > > > >> > to
> > > > >> > >> > >> > > > > > >> > >> reply to this email outside of
your
> > normal
> > > > >> > working
> > > > >> > >> > >> hours.
> > > > >> > >> > >> > > > > > >> > >>
> > > > >> > >> > >> > > > > > >> > >>
> > > > >> > >> > >> > > > > > >> > >
> > > > >> > >> > >> > > > > > >> > > --
> > > > >> > >> > >> > > > > > >> > >
> > > > >> > >> > >> > > > > > >> > > Binbin Zhou
> > > > >> > >> > >> > > > > > >> > >
> > > > >> > >> > >> > > > > > >> > > IMSG at NOAA/NWS/NCEP/EMC
> > > > >> > >> > >> > > > > > >> > >
> > > > >> > >> > >> > > > > > >> > > 5830 University Research Ct.
> > > > >> > >> > >> > > > > > >> > >
> > > > >> > >> > >> > > > > > >> > > College Park, MD 20740
> > > > >> > >> > >> > > > > > >> > >
> > > > >> > >> > >> > > > > > >> > > Binbin.Zhou at noaa.gov
> > > > >> > >> > >> > > > > > >> > >
> > > > >> > >> > >> > > > > > >> > > 301-683-3683
> > > > >> > >> > >> > > > > > >> > >
> > > > >> > >> > >> > > > > > >> >
> > > > >> > >> > >> > > > > > >> >
> > > > >> > >> > >> > > > > > >> > --
> > > > >> > >> > >> > > > > > >> >
> > > > >> > >> > >> > > > > > >> > Binbin Zhou
> > > > >> > >> > >> > > > > > >> >
> > > > >> > >> > >> > > > > > >> > IMSG at NOAA/NWS/NCEP/EMC
> > > > >> > >> > >> > > > > > >> >
> > > > >> > >> > >> > > > > > >> > 5830 University Research Ct.
> > > > >> > >> > >> > > > > > >> >
> > > > >> > >> > >> > > > > > >> > College Park, MD 20740
> > > > >> > >> > >> > > > > > >> >
> > > > >> > >> > >> > > > > > >> > Binbin.Zhou at noaa.gov
> > > > >> > >> > >> > > > > > >> >
> > > > >> > >> > >> > > > > > >> > 301-683-3683
> > > > >> > >> > >> > > > > > >> >
> > > > >> > >> > >> > > > > > >> >
> > > > >> > >> > >> > > > > > >>
> > > > >> > >> > >> > > > > > >> --
> > > > >> > >> > >> > > > > > >> George McCabe - Software Engineer
III
> > > > >> > >> > >> > > > > > >> National Center for Atmospheric
Research
> > > > >> > >> > >> > > > > > >> Research Applications Laboratory
> > > > >> > >> > >> > > > > > >> 303-497-2768
> > > > >> > >> > >> > > > > > >> ---
> > > > >> > >> > >> > > > > > >> My working day may not be your
working day.
> > > > Please
> > > > >> do
> > > > >> > >> not
> > > > >> > >> > >> feel
> > > > >> > >> > >> > > > obliged
> > > > >> > >> > >> > > > > > to
> > > > >> > >> > >> > > > > > >> reply to this email outside of your
normal
> > > > working
> > > > >> > >> hours.
> > > > >> > >> > >> > > > > > >>
> > > > >> > >> > >> > > > > > >>
> > > > >> > >> > >> > > > > > >
> > > > >> > >> > >> > > > > > > --
> > > > >> > >> > >> > > > > > >
> > > > >> > >> > >> > > > > > > Binbin Zhou
> > > > >> > >> > >> > > > > > >
> > > > >> > >> > >> > > > > > > IMSG at NOAA/NWS/NCEP/EMC
> > > > >> > >> > >> > > > > > >
> > > > >> > >> > >> > > > > > > 5830 University Research Ct.
> > > > >> > >> > >> > > > > > >
> > > > >> > >> > >> > > > > > > College Park, MD 20740
> > > > >> > >> > >> > > > > > >
> > > > >> > >> > >> > > > > > > Binbin.Zhou at noaa.gov
> > > > >> > >> > >> > > > > > >
> > > > >> > >> > >> > > > > > > 301-683-3683
> > > > >> > >> > >> > > > > > >
> > > > >> > >> > >> > > > > >
> > > > >> > >> > >> > > > > >
> > > > >> > >> > >> > > > > > --
> > > > >> > >> > >> > > > > >
> > > > >> > >> > >> > > > > > Binbin Zhou
> > > > >> > >> > >> > > > > >
> > > > >> > >> > >> > > > > > IMSG at NOAA/NWS/NCEP/EMC
> > > > >> > >> > >> > > > > >
> > > > >> > >> > >> > > > > > 5830 University Research Ct.
> > > > >> > >> > >> > > > > >
> > > > >> > >> > >> > > > > > College Park, MD 20740
> > > > >> > >> > >> > > > > >
> > > > >> > >> > >> > > > > > Binbin.Zhou at noaa.gov
> > > > >> > >> > >> > > > > >
> > > > >> > >> > >> > > > > > 301-683-3683
> > > > >> > >> > >> > > > > >
> > > > >> > >> > >> > > > > >
> > > > >> > >> > >> > > > >
> > > > >> > >> > >> > > > > --
> > > > >> > >> > >> > > > > George McCabe - Software Engineer III
> > > > >> > >> > >> > > > > National Center for Atmospheric Research
> > > > >> > >> > >> > > > > Research Applications Laboratory
> > > > >> > >> > >> > > > > 303-497-2768
> > > > >> > >> > >> > > > > ---
> > > > >> > >> > >> > > > > My working day may not be your working
day.
> Please
> > > do
> > > > >> not
> > > > >> > >> feel
> > > > >> > >> > >> > obliged
> > > > >> > >> > >> > > to
> > > > >> > >> > >> > > > > reply to this email outside of your
normal
> working
> > > > >> hours.
> > > > >> > >> > >> > > > >
> > > > >> > >> > >> > > > >
> > > > >> > >> > >> > > >
> > > > >> > >> > >> > > > --
> > > > >> > >> > >> > > >
> > > > >> > >> > >> > > > Binbin Zhou
> > > > >> > >> > >> > > >
> > > > >> > >> > >> > > > IMSG at NOAA/NWS/NCEP/EMC
> > > > >> > >> > >> > > >
> > > > >> > >> > >> > > > 5830 University Research Ct.
> > > > >> > >> > >> > > >
> > > > >> > >> > >> > > > College Park, MD 20740
> > > > >> > >> > >> > > >
> > > > >> > >> > >> > > > Binbin.Zhou at noaa.gov
> > > > >> > >> > >> > > >
> > > > >> > >> > >> > > > 301-683-3683
> > > > >> > >> > >> > > >
> > > > >> > >> > >> > > >
> > > > >> > >> > >> > >
> > > > >> > >> > >> > > --
> > > > >> > >> > >> > > George McCabe - Software Engineer III
> > > > >> > >> > >> > > National Center for Atmospheric Research
> > > > >> > >> > >> > > Research Applications Laboratory
> > > > >> > >> > >> > > 303-497-2768
> > > > >> > >> > >> > > ---
> > > > >> > >> > >> > > My working day may not be your working day.
Please
> do
> > > not
> > > > >> feel
> > > > >> > >> > >> obliged to
> > > > >> > >> > >> > > reply to this email outside of your normal
working
> > > hours.
> > > > >> > >> > >> > >
> > > > >> > >> > >> > >
> > > > >> > >> > >> >
> > > > >> > >> > >> > --
> > > > >> > >> > >> >
> > > > >> > >> > >> > Binbin Zhou
> > > > >> > >> > >> >
> > > > >> > >> > >> > IMSG at NOAA/NWS/NCEP/EMC
> > > > >> > >> > >> >
> > > > >> > >> > >> > 5830 University Research Ct.
> > > > >> > >> > >> >
> > > > >> > >> > >> > College Park, MD 20740
> > > > >> > >> > >> >
> > > > >> > >> > >> > Binbin.Zhou at noaa.gov
> > > > >> > >> > >> >
> > > > >> > >> > >> > 301-683-3683
> > > > >> > >> > >> >
> > > > >> > >> > >> >
> > > > >> > >> > >>
> > > > >> > >> > >> --
> > > > >> > >> > >> Julie Prestopnik (she/her)
> > > > >> > >> > >> Software Engineer
> > > > >> > >> > >> National Center for Atmospheric Research
> > > > >> > >> > >> Research Applications Laboratory
> > > > >> > >> > >> Email: jpresto at ucar.edu
> > > > >> > >> > >>
> > > > >> > >> > >> My working day may not be your working day.
Please do
> not
> > > > feel
> > > > >> > >> obliged
> > > > >> > >> > to
> > > > >> > >> > >> reply to this email outside of your normal
working
> hours.
> > > > >> > >> > >>
> > > > >> > >> > >>
> > > > >> > >> > >
> > > > >> > >> > > --
> > > > >> > >> > >
> > > > >> > >> > > Binbin Zhou
> > > > >> > >> > >
> > > > >> > >> > > IMSG at NOAA/NWS/NCEP/EMC
> > > > >> > >> > >
> > > > >> > >> > > 5830 University Research Ct.
> > > > >> > >> > >
> > > > >> > >> > > College Park, MD 20740
> > > > >> > >> > >
> > > > >> > >> > > Binbin.Zhou at noaa.gov
> > > > >> > >> > >
> > > > >> > >> > > 301-683-3683
> > > > >> > >> > >
> > > > >> > >> >
> > > > >> > >> >
> > > > >> > >> > --
> > > > >> > >> >
> > > > >> > >> > Binbin Zhou
> > > > >> > >> >
> > > > >> > >> > IMSG at NOAA/NWS/NCEP/EMC
> > > > >> > >> >
> > > > >> > >> > 5830 University Research Ct.
> > > > >> > >> >
> > > > >> > >> > College Park, MD 20740
> > > > >> > >> >
> > > > >> > >> > Binbin.Zhou at noaa.gov
> > > > >> > >> >
> > > > >> > >> > 301-683-3683
> > > > >> > >> >
> > > > >> > >> >
> > > > >> > >>
> > > > >> > >> --
> > > > >> > >> Julie Prestopnik (she/her)
> > > > >> > >> Software Engineer
> > > > >> > >> National Center for Atmospheric Research
> > > > >> > >> Research Applications Laboratory
> > > > >> > >> Email: jpresto at ucar.edu
> > > > >> > >>
> > > > >> > >> My working day may not be your working day. Please do
not
> feel
> > > > >> obliged
> > > > >> > to
> > > > >> > >> reply to this email outside of your normal working
hours.
> > > > >> > >>
> > > > >> > >>
> > > > >> > >
> > > > >> > > --
> > > > >> > > George McCabe - Software Engineer III
> > > > >> > > National Center for Atmospheric Research
> > > > >> > > Research Applications Laboratory
> > > > >> > > 303-497-2768
> > > > >> > > ---
> > > > >> > > My working day may not be your working day. Please do
not feel
> > > > >> obliged to
> > > > >> > > reply to this email outside of your normal working
hours.
> > > > >> > >
> > > > >> >
> > > > >> >
> > > > >> > --
> > > > >> >
> > > > >> > Binbin Zhou
> > > > >> >
> > > > >> > IMSG at NOAA/NWS/NCEP/EMC
> > > > >> >
> > > > >> > 5830 University Research Ct.
> > > > >> >
> > > > >> > College Park, MD 20740
> > > > >> >
> > > > >> > Binbin.Zhou at noaa.gov
> > > > >> >
> > > > >> > 301-683-3683
> > > > >> >
> > > > >> >
> > > > >>
> > > > >> --
> > > > >> George McCabe - Software Engineer III
> > > > >> National Center for Atmospheric Research
> > > > >> Research Applications Laboratory
> > > > >> 303-497-2768
> > > > >> ---
> > > > >> My working day may not be your working day. Please do not
feel
> > obliged
> > > > to
> > > > >> reply to this email outside of your normal working hours.
> > > > >>
> > > > >>
> > > > >
> > > > > --
> > > > >
> > > > > Binbin Zhou
> > > > >
> > > > > IMSG at NOAA/NWS/NCEP/EMC
> > > > >
> > > > > 5830 University Research Ct.
> > > > >
> > > > > College Park, MD 20740
> > > > >
> > > > > Binbin.Zhou at noaa.gov
> > > > >
> > > > > 301-683-3683
> > > > >
> > > >
> > > >
> > > > --
> > > >
> > > > Binbin Zhou
> > > >
> > > > IMSG at NOAA/NWS/NCEP/EMC
> > > >
> > > > 5830 University Research Ct.
> > > >
> > > > College Park, MD 20740
> > > >
> > > > Binbin.Zhou at noaa.gov
> > > >
> > > > 301-683-3683
> > > >
> > > >
> > >
> > > --
> > > George McCabe - Software Engineer III
> > > National Center for Atmospheric Research
> > > Research Applications Laboratory
> > > 303-497-2768
> > > ---
> > > My working day may not be your working day. Please do not feel
obliged
> to
> > > reply to this email outside of your normal working hours.
> > >
> > >
> >
> > --
> >
> > Binbin Zhou
> >
> > IMSG at NOAA/NWS/NCEP/EMC
> >
> > 5830 University Research Ct.
> >
> > College Park, MD 20740
> >
> > Binbin.Zhou at noaa.gov
> >
> > 301-683-3683
> >
> >
>
> --
> George McCabe - Software Engineer III
> National Center for Atmospheric Research
> Research Applications Laboratory
> 303-497-2768
> ---
> My working day may not be your working day. Please do not feel
obliged to
> reply to this email outside of your normal working hours.
>
>
--
Binbin Zhou
IMSG at NOAA/NWS/NCEP/EMC
5830 University Research Ct.
College Park, MD 20740
Binbin.Zhou at noaa.gov
301-683-3683
------------------------------------------------
Subject: CDP threshold setting in EnsembleStat conf
From: John Halley Gotway
Time: Thu Jan 07 09:35:03 2021
Binbin,
George asked me to take a look at this issue regarding the use of
climatology data in Ensemble-Stat. I just logged on to WCOSS to take a
closer look at these details. There sure are a lot directories to keep
track of! For my own sanity, I listed them out at the bottom of this
email.
So you're running Ensemble-Stat for data with a valid time
of 20210104_120000. The error is related to climo distribution
percentile
thresholds not working because no climo data was found.
You have configured Ensemble-Stat to pass it a single climo file for
the
mean and a single climo file for the standard deviation:
/gpfs/dell2/emc/modeling/noscrub/Binbin.Zhou/g2g/com/verf/dev/ens.20210104/clim.grid3.mean.010400.grib2
/gpfs/dell2/emc/modeling/noscrub/Binbin.Zhou/g2g/com/verf/dev/ens.20210104/clim.grid3.stdv.010400.grib2
Checking those files using wgrib2, I see that they contain data for a
*single
timestamp*:
$WGRIB2
/gpfs/dell2/emc/modeling/noscrub/Binbin.Zhou/g2g/com/verf/dev/ens.20210104/clim.grid3.mean.010400.grib2
| cut -d':' -f3 | sort -u
d=1959010400
So this is climo data for January 4th.
The configuration controls for climo data (day_interval and
hour_interval)
enable MET tools to handle climo data organized in multiple ways...
whether
it's data for all times in a single file or 4 hours/day in each file
or
whatever else. Having a single timestamp in each file (as you do) is
the
simplest option. So we just need to think about the setting of
day_interval
and hour_interval and choose what makes sense.
They are described in more detail on this page:
https://dtcenter.github.io/MET/latest/Users_Guide/data_io.html?highlight=climo_mean#intermediate-
data-formats
Just search for day_interval and hour_interval.
Note that day_interval and hour_interval REPLACED the old match_day
and
time_step config options in met-9.0.
Here's the GitHub issue <https://github.com/NCAR/MET/issues/1138> for
that.
And here's the met-9.0 release notes
<http://dtcenter.org/community-code/model-evaluation-tools-met/met-
version-9-0#notes>
.
You should update your Ensemble-Stat config file to use these options.
You could set:
* day_interval = NA;*
* hour_interval = NA;*
And that'd tell Ensemble-Stat to just use whatever data it finds in
those
climo files without sanity checking the timestamps at all. That will
make
it work but also won't double check to make sure you don't have
problems in
any of logic/script upstream.
So instead, I'd recommend setting:
* day_interval = 1;*
* hour_interval = 24;*
This states that you have climo data for each day of the year. And for
each
day, you have a single time (not 2 times per day, 00 and 12, and not 4
times per day, 00, 06, 12, and 18). I think this is the best way to
configure it. So as long as the climo date matches the date of the
current
valid time (regardless of the hours), MET will use it.
Sorry this is so confusing! Please let me know if you'd recommend any
changes to the documentation to better describe how to set up config
options for climo data.
Thanks,
John
Paths on WCOSS...
User script:
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_g2g.v4.0.0/ush/verf_g2g_metplus_run_gefs_mpi.sh
Generates run scripts named: run_gefs_mpi_${FHR}.sh (don't know where
those
live)
METplus config file:
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_g2g.v4.0.0/parm/app_conf/grid2grid/gefs_conf/gefs_bin11.conf
Ensemble-Stat config file:
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_met_global_ens1p0.v1.0.0/parm/verf_g2g_ens_stat_config_bin11
METplus log file:
/gpfs/dell1/ptmp/Binbin.Zhou/g2g/RFC2/tmpnwprd/verf_g2g_gefs_00_dev.161076/metplus3.out/log/master_metplus.log.20210106155927
climo_mean = {
file_name = "${CLIM_MEAN}";
time_interp_method = DW_MEAN;
match_day = TRUE;
time_step = 21600;
}
The running process is little bit complex since this is a transition
to
future operational package that uses
mpi parallel: the script is
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_g2g.v4.0.0/ush/verf_g2g_metplus_run_gefs_mpi.sh
------------------------------------------------
Subject: CDP threshold setting in EnsembleStat conf
From: Binbin.Zhou at noaa.gov
Time: Thu Jan 07 12:32:43 2021
John,
Your infor is more helpful to understand the settings in climo
entry.
Only only suggestion: "NA" s default value of day_interval and
hour_interval.
Thanks!
Binbin
On Thu, Jan 7, 2021 at 11:35 AM John Halley Gotway via RT
<met_help at ucar.edu>
wrote:
> Binbin,
>
> George asked me to take a look at this issue regarding the use of
> climatology data in Ensemble-Stat. I just logged on to WCOSS to take
a
> closer look at these details. There sure are a lot directories to
keep
> track of! For my own sanity, I listed them out at the bottom of this
email.
>
> So you're running Ensemble-Stat for data with a valid time
> of 20210104_120000. The error is related to climo distribution
percentile
> thresholds not working because no climo data was found.
>
> You have configured Ensemble-Stat to pass it a single climo file for
the
> mean and a single climo file for the standard deviation:
>
>
/gpfs/dell2/emc/modeling/noscrub/Binbin.Zhou/g2g/com/verf/dev/ens.20210104/clim.grid3.mean.010400.grib2
>
>
/gpfs/dell2/emc/modeling/noscrub/Binbin.Zhou/g2g/com/verf/dev/ens.20210104/clim.grid3.stdv.010400.grib2
>
> Checking those files using wgrib2, I see that they contain data for
a
> *single
> timestamp*:
> $WGRIB2
>
>
/gpfs/dell2/emc/modeling/noscrub/Binbin.Zhou/g2g/com/verf/dev/ens.20210104/clim.grid3.mean.010400.grib2
> | cut -d':' -f3 | sort -u
> d=1959010400
> So this is climo data for January 4th.
>
> The configuration controls for climo data (day_interval and
hour_interval)
> enable MET tools to handle climo data organized in multiple ways...
whether
> it's data for all times in a single file or 4 hours/day in each file
or
> whatever else. Having a single timestamp in each file (as you do) is
the
> simplest option. So we just need to think about the setting of
day_interval
> and hour_interval and choose what makes sense.
>
> They are described in more detail on this page:
>
>
https://dtcenter.github.io/MET/latest/Users_Guide/data_io.html?highlight=climo_mean#intermediate-
data-formats
> Just search for day_interval and hour_interval.
>
> Note that day_interval and hour_interval REPLACED the old match_day
and
> time_step config options in met-9.0.
> Here's the GitHub issue <https://github.com/NCAR/MET/issues/1138>
for
> that.
> And here's the met-9.0 release notes
> <
> http://dtcenter.org/community-code/model-evaluation-tools-met/met-
version-9-0#notes
> >
> .
> You should update your Ensemble-Stat config file to use these
options.
>
> You could set:
> * day_interval = NA;*
> * hour_interval = NA;*
> And that'd tell Ensemble-Stat to just use whatever data it finds in
those
> climo files without sanity checking the timestamps at all. That will
make
> it work but also won't double check to make sure you don't have
problems in
> any of logic/script upstream.
>
> So instead, I'd recommend setting:
> * day_interval = 1;*
> * hour_interval = 24;*
> This states that you have climo data for each day of the year. And
for each
> day, you have a single time (not 2 times per day, 00 and 12, and not
4
> times per day, 00, 06, 12, and 18). I think this is the best way to
> configure it. So as long as the climo date matches the date of the
current
> valid time (regardless of the hours), MET will use it.
>
> Sorry this is so confusing! Please let me know if you'd recommend
any
> changes to the documentation to better describe how to set up config
> options for climo data.
>
> Thanks,
> John
>
> Paths on WCOSS...
>
> User script:
>
>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_g2g.v4.0.0/ush/verf_g2g_metplus_run_gefs_mpi.sh
> Generates run scripts named: run_gefs_mpi_${FHR}.sh (don't know
where those
> live)
>
> METplus config file:
>
>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_g2g.v4.0.0/parm/app_conf/grid2grid/gefs_conf/gefs_bin11.conf
>
> Ensemble-Stat config file:
>
>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_met_global_ens1p0.v1.0.0/parm/verf_g2g_ens_stat_config_bin11
>
> METplus log file:
>
>
/gpfs/dell1/ptmp/Binbin.Zhou/g2g/RFC2/tmpnwprd/verf_g2g_gefs_00_dev.161076/metplus3.out/log/master_metplus.log.20210106155927
>
> climo_mean = {
> file_name = "${CLIM_MEAN}";
> time_interp_method = DW_MEAN;
> match_day = TRUE;
> time_step = 21600;
> }
>
>
>
>
>
> The running process is little bit complex since this is a transition
to
> future operational package that uses
> mpi parallel: the script is
>
>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_g2g.v4.0.0/ush/verf_g2g_metplus_run_gefs_mpi.sh
>
>
--
Binbin Zhou
IMSG at NOAA/NWS/NCEP/EMC
5830 University Research Ct.
College Park, MD 20740
Binbin.Zhou at noaa.gov
301-683-3683
------------------------------------------------
Subject: CDP threshold setting in EnsembleStat conf
From: John Halley Gotway
Time: Thu Jan 07 12:59:31 2021
Binbin,
I'm uncomfortable changing the default of day_interval and
hour_interval to
NA. Think about the impact that'd have. MET would just automatically
use
whatever climo data it finds regardless of it's timestamp! That would
quietly create bogus output.
I'd much rather have the tool error out instead of quietly processing
erroneous data. Perhaps there's some way we could improve the log
messages
to more quickly point users to the actual underlying problem?
John
On Thu, Jan 7, 2021 at 12:32 PM Binbin.Zhou at noaa.gov via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116 >
>
> John,
>
> Your infor is more helpful to understand the settings in climo
entry.
> Only only suggestion: "NA" s default value of day_interval and
> hour_interval.
>
> Thanks!
>
> Binbin
>
>
> On Thu, Jan 7, 2021 at 11:35 AM John Halley Gotway via RT <
> met_help at ucar.edu>
> wrote:
>
> > Binbin,
> >
> > George asked me to take a look at this issue regarding the use of
> > climatology data in Ensemble-Stat. I just logged on to WCOSS to
take a
> > closer look at these details. There sure are a lot directories to
keep
> > track of! For my own sanity, I listed them out at the bottom of
this
> email.
> >
> > So you're running Ensemble-Stat for data with a valid time
> > of 20210104_120000. The error is related to climo distribution
percentile
> > thresholds not working because no climo data was found.
> >
> > You have configured Ensemble-Stat to pass it a single climo file
for the
> > mean and a single climo file for the standard deviation:
> >
> >
>
/gpfs/dell2/emc/modeling/noscrub/Binbin.Zhou/g2g/com/verf/dev/ens.20210104/clim.grid3.mean.010400.grib2
> >
> >
>
/gpfs/dell2/emc/modeling/noscrub/Binbin.Zhou/g2g/com/verf/dev/ens.20210104/clim.grid3.stdv.010400.grib2
> >
> > Checking those files using wgrib2, I see that they contain data
for a
> > *single
> > timestamp*:
> > $WGRIB2
> >
> >
>
/gpfs/dell2/emc/modeling/noscrub/Binbin.Zhou/g2g/com/verf/dev/ens.20210104/clim.grid3.mean.010400.grib2
> > | cut -d':' -f3 | sort -u
> > d=1959010400
> > So this is climo data for January 4th.
> >
> > The configuration controls for climo data (day_interval and
> hour_interval)
> > enable MET tools to handle climo data organized in multiple
ways...
> whether
> > it's data for all times in a single file or 4 hours/day in each
file or
> > whatever else. Having a single timestamp in each file (as you do)
is the
> > simplest option. So we just need to think about the setting of
> day_interval
> > and hour_interval and choose what makes sense.
> >
> > They are described in more detail on this page:
> >
> >
>
https://dtcenter.github.io/MET/latest/Users_Guide/data_io.html?highlight=climo_mean#intermediate-
data-formats
> > Just search for day_interval and hour_interval.
> >
> > Note that day_interval and hour_interval REPLACED the old
match_day and
> > time_step config options in met-9.0.
> > Here's the GitHub issue <https://github.com/NCAR/MET/issues/1138>
for
> > that.
> > And here's the met-9.0 release notes
> > <
> >
> http://dtcenter.org/community-code/model-evaluation-tools-met/met-
version-9-0#notes
> > >
> > .
> > You should update your Ensemble-Stat config file to use these
options.
> >
> > You could set:
> > * day_interval = NA;*
> > * hour_interval = NA;*
> > And that'd tell Ensemble-Stat to just use whatever data it finds
in those
> > climo files without sanity checking the timestamps at all. That
will make
> > it work but also won't double check to make sure you don't have
problems
> in
> > any of logic/script upstream.
> >
> > So instead, I'd recommend setting:
> > * day_interval = 1;*
> > * hour_interval = 24;*
> > This states that you have climo data for each day of the year. And
for
> each
> > day, you have a single time (not 2 times per day, 00 and 12, and
not 4
> > times per day, 00, 06, 12, and 18). I think this is the best way
to
> > configure it. So as long as the climo date matches the date of the
> current
> > valid time (regardless of the hours), MET will use it.
> >
> > Sorry this is so confusing! Please let me know if you'd recommend
any
> > changes to the documentation to better describe how to set up
config
> > options for climo data.
> >
> > Thanks,
> > John
> >
> > Paths on WCOSS...
> >
> > User script:
> >
> >
>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_g2g.v4.0.0/ush/verf_g2g_metplus_run_gefs_mpi.sh
> > Generates run scripts named: run_gefs_mpi_${FHR}.sh (don't know
where
> those
> > live)
> >
> > METplus config file:
> >
> >
>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_g2g.v4.0.0/parm/app_conf/grid2grid/gefs_conf/gefs_bin11.conf
> >
> > Ensemble-Stat config file:
> >
> >
>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_met_global_ens1p0.v1.0.0/parm/verf_g2g_ens_stat_config_bin11
> >
> > METplus log file:
> >
> >
>
/gpfs/dell1/ptmp/Binbin.Zhou/g2g/RFC2/tmpnwprd/verf_g2g_gefs_00_dev.161076/metplus3.out/log/master_metplus.log.20210106155927
> >
> > climo_mean = {
> > file_name = "${CLIM_MEAN}";
> > time_interp_method = DW_MEAN;
> > match_day = TRUE;
> > time_step = 21600;
> > }
> >
> >
> >
> >
> >
> > The running process is little bit complex since this is a
transition to
> > future operational package that uses
> > mpi parallel: the script is
> >
> >
>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_g2g.v4.0.0/ush/verf_g2g_metplus_run_gefs_mpi.sh
> >
> >
>
> --
>
> Binbin Zhou
>
> IMSG at NOAA/NWS/NCEP/EMC
>
> 5830 University Research Ct.
>
> College Park, MD 20740
>
> Binbin.Zhou at noaa.gov
>
> 301-683-3683
>
>
------------------------------------------------
Subject: CDP threshold setting in EnsembleStat conf
From: Binbin.Zhou at noaa.gov
Time: Thu Jan 07 13:29:04 2021
John,
OK, understand. No problem to keep current day_interval and
hour_interval.
Thanks!
Binbin
On Thu, Jan 7, 2021 at 2:59 PM John Halley Gotway via RT
<met_help at ucar.edu>
wrote:
> Binbin,
>
> I'm uncomfortable changing the default of day_interval and
hour_interval to
> NA. Think about the impact that'd have. MET would just automatically
use
> whatever climo data it finds regardless of it's timestamp! That
would
> quietly create bogus output.
>
> I'd much rather have the tool error out instead of quietly
processing
> erroneous data. Perhaps there's some way we could improve the log
messages
> to more quickly point users to the actual underlying problem?
>
> John
>
> On Thu, Jan 7, 2021 at 12:32 PM Binbin.Zhou at noaa.gov via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98116 >
> >
> > John,
> >
> > Your infor is more helpful to understand the settings in climo
entry.
> > Only only suggestion: "NA" s default value of day_interval and
> > hour_interval.
> >
> > Thanks!
> >
> > Binbin
> >
> >
> > On Thu, Jan 7, 2021 at 11:35 AM John Halley Gotway via RT <
> > met_help at ucar.edu>
> > wrote:
> >
> > > Binbin,
> > >
> > > George asked me to take a look at this issue regarding the use
of
> > > climatology data in Ensemble-Stat. I just logged on to WCOSS to
take a
> > > closer look at these details. There sure are a lot directories
to keep
> > > track of! For my own sanity, I listed them out at the bottom of
this
> > email.
> > >
> > > So you're running Ensemble-Stat for data with a valid time
> > > of 20210104_120000. The error is related to climo distribution
> percentile
> > > thresholds not working because no climo data was found.
> > >
> > > You have configured Ensemble-Stat to pass it a single climo file
for
> the
> > > mean and a single climo file for the standard deviation:
> > >
> > >
> >
>
/gpfs/dell2/emc/modeling/noscrub/Binbin.Zhou/g2g/com/verf/dev/ens.20210104/clim.grid3.mean.010400.grib2
> > >
> > >
> >
>
/gpfs/dell2/emc/modeling/noscrub/Binbin.Zhou/g2g/com/verf/dev/ens.20210104/clim.grid3.stdv.010400.grib2
> > >
> > > Checking those files using wgrib2, I see that they contain data
for a
> > > *single
> > > timestamp*:
> > > $WGRIB2
> > >
> > >
> >
>
/gpfs/dell2/emc/modeling/noscrub/Binbin.Zhou/g2g/com/verf/dev/ens.20210104/clim.grid3.mean.010400.grib2
> > > | cut -d':' -f3 | sort -u
> > > d=1959010400
> > > So this is climo data for January 4th.
> > >
> > > The configuration controls for climo data (day_interval and
> > hour_interval)
> > > enable MET tools to handle climo data organized in multiple
ways...
> > whether
> > > it's data for all times in a single file or 4 hours/day in each
file or
> > > whatever else. Having a single timestamp in each file (as you
do) is
> the
> > > simplest option. So we just need to think about the setting of
> > day_interval
> > > and hour_interval and choose what makes sense.
> > >
> > > They are described in more detail on this page:
> > >
> > >
> >
>
https://dtcenter.github.io/MET/latest/Users_Guide/data_io.html?highlight=climo_mean#intermediate-
data-formats
> > > Just search for day_interval and hour_interval.
> > >
> > > Note that day_interval and hour_interval REPLACED the old
match_day and
> > > time_step config options in met-9.0.
> > > Here's the GitHub issue
<https://github.com/NCAR/MET/issues/1138> for
> > > that.
> > > And here's the met-9.0 release notes
> > > <
> > >
> >
> http://dtcenter.org/community-code/model-evaluation-tools-met/met-
version-9-0#notes
> > > >
> > > .
> > > You should update your Ensemble-Stat config file to use these
options.
> > >
> > > You could set:
> > > * day_interval = NA;*
> > > * hour_interval = NA;*
> > > And that'd tell Ensemble-Stat to just use whatever data it finds
in
> those
> > > climo files without sanity checking the timestamps at all. That
will
> make
> > > it work but also won't double check to make sure you don't have
> problems
> > in
> > > any of logic/script upstream.
> > >
> > > So instead, I'd recommend setting:
> > > * day_interval = 1;*
> > > * hour_interval = 24;*
> > > This states that you have climo data for each day of the year.
And for
> > each
> > > day, you have a single time (not 2 times per day, 00 and 12, and
not 4
> > > times per day, 00, 06, 12, and 18). I think this is the best way
to
> > > configure it. So as long as the climo date matches the date of
the
> > current
> > > valid time (regardless of the hours), MET will use it.
> > >
> > > Sorry this is so confusing! Please let me know if you'd
recommend any
> > > changes to the documentation to better describe how to set up
config
> > > options for climo data.
> > >
> > > Thanks,
> > > John
> > >
> > > Paths on WCOSS...
> > >
> > > User script:
> > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_g2g.v4.0.0/ush/verf_g2g_metplus_run_gefs_mpi.sh
> > > Generates run scripts named: run_gefs_mpi_${FHR}.sh (don't know
where
> > those
> > > live)
> > >
> > > METplus config file:
> > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_g2g.v4.0.0/parm/app_conf/grid2grid/gefs_conf/gefs_bin11.conf
> > >
> > > Ensemble-Stat config file:
> > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_met_global_ens1p0.v1.0.0/parm/verf_g2g_ens_stat_config_bin11
> > >
> > > METplus log file:
> > >
> > >
> >
>
/gpfs/dell1/ptmp/Binbin.Zhou/g2g/RFC2/tmpnwprd/verf_g2g_gefs_00_dev.161076/metplus3.out/log/master_metplus.log.20210106155927
> > >
> > > climo_mean = {
> > > file_name = "${CLIM_MEAN}";
> > > time_interp_method = DW_MEAN;
> > > match_day = TRUE;
> > > time_step = 21600;
> > > }
> > >
> > >
> > >
> > >
> > >
> > > The running process is little bit complex since this is a
transition to
> > > future operational package that uses
> > > mpi parallel: the script is
> > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/grid2grid/verf_g2g.v4.0.0/ush/verf_g2g_metplus_run_gefs_mpi.sh
> > >
> > >
> >
> > --
> >
> > Binbin Zhou
> >
> > IMSG at NOAA/NWS/NCEP/EMC
> >
> > 5830 University Research Ct.
> >
> > College Park, MD 20740
> >
> > Binbin.Zhou at noaa.gov
> >
> > 301-683-3683
> >
> >
>
>
--
Binbin Zhou
IMSG at NOAA/NWS/NCEP/EMC
5830 University Research Ct.
College Park, MD 20740
Binbin.Zhou at noaa.gov
301-683-3683
------------------------------------------------
More information about the Met_help
mailing list