[Met_help] [rt.rap.ucar.edu #91006] History for MET set multiple category thresholds
John Halley Gotway via RT
met_help at ucar.edu
Thu Jul 11 09:30:36 MDT 2019
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Dear Colleagues,
When I ran the “grid_stat” tool in MET, I wanted to stratify the data into two categories: [230- 250] and [250-270]. In the grid stat configuration file, I set this as
cat_thresh = [ >=230&&<=250, >=250&&<=270 ];
but when I ran grid_stat command I saw error that said:
ERROR : check_mctc_thresh() -> when verifying using multi-category contingency tables, the thresholds must be monotonically increasing and be of the same inequality type (lt, le, gt, or ge).
Could you please advise how to realize the above stratification in grid_stat?
Thanks,
Shaowu
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: MET set multiple category thresholds
From: John Halley Gotway
Time: Wed Jul 10 15:03:55 2019
Shaowu,
This means that you have requested multi-category output statistics
(i.e.
MCTC and/or MCTS). When MCTC and/or MCTS are requested, the
categorical
thresholds must follow a specific convention, as described in that
error
message.
If you actually do want to compute MCTC and/or MCTS stats, try using
this
instead:
cat_thresh = [ >=230, >=250, >=270 ];
But if you're not interested in MCTC/MCTS, just disable them in the
config
file:
mctc = NONE;
mcts = NONE;
Thanks,
John
On Wed, Jul 10, 2019 at 2:55 PM sbao at coastal.edu via RT
<met_help at ucar.edu>
wrote:
>
> Wed Jul 10 14:55:00 2019: Request 91006 was acted upon.
> Transaction: Ticket created by sbao at coastal.edu
> Queue: met_help
> Subject: MET set multiple category thresholds
> Owner: Nobody
> Requestors: sbao at coastal.edu
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=91006 >
>
>
> Dear Colleagues,
>
> When I ran the “grid_stat” tool in MET, I wanted to stratify the
data into
> two categories: [230- 250] and [250-270]. In the grid stat
configuration
> file, I set this as
> cat_thresh = [ >=230&&<=250, >=250&&<=270 ];
>
> but when I ran grid_stat command I saw error that said:
> ERROR : check_mctc_thresh() -> when verifying using multi-category
> contingency tables, the thresholds must be monotonically increasing
and be
> of the same inequality type (lt, le, gt, or ge).
>
> Could you please advise how to realize the above stratification in
> grid_stat?
>
> Thanks,
> Shaowu
>
>
>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #91006] MET set multiple category thresholds
From: sbao at coastal.edu
Time: Wed Jul 10 16:18:22 2019
John,
Thanks for your quick reply. So when I set, say, cat_thresh = [ >=230,
>=250, >=270 ], did I divide the data into ranges of [230-250] [250-
270] and [270-max]? or did I divide it into [230-max],[250-max] and
[270-max]?
I want to stratify the data by dividing them into groups and look at
the MET statistics of each.
Thanks,
Shaowu
On 7/10/19, 5:04 PM, "John Halley Gotway via RT" <met_help at ucar.edu>
wrote:
Shaowu,
This means that you have requested multi-category output
statistics (i.e.
MCTC and/or MCTS). When MCTC and/or MCTS are requested, the
categorical
thresholds must follow a specific convention, as described in that
error
message.
If you actually do want to compute MCTC and/or MCTS stats, try
using this
instead:
cat_thresh = [ >=230, >=250, >=270 ];
But if you're not interested in MCTC/MCTS, just disable them in
the config
file:
mctc = NONE;
mcts = NONE;
Thanks,
John
On Wed, Jul 10, 2019 at 2:55 PM sbao at coastal.edu via RT
<met_help at ucar.edu>
wrote:
>
> Wed Jul 10 14:55:00 2019: Request 91006 was acted upon.
> Transaction: Ticket created by sbao at coastal.edu
> Queue: met_help
> Subject: MET set multiple category thresholds
> Owner: Nobody
> Requestors: sbao at coastal.edu
> Status: new
> Ticket <URL:
https://nam03.safelinks.protection.outlook.com/?url=https%3A%2F%2Frt.rap.ucar.edu%2Frt%2FTicket%2FDisplay.html%3Fid%3D91006&data=02%7C01%7Csbao%40coastal.edu%7C2beb3633bddc4de26d6d08d7057a3ccb%7Cbf1f856b8ef84e52be9387d3c3622797%7C0%7C0%7C636983894892789957&sdata=ub3%2Bz14Q%2FMqpdlcipg32wTuC%2FE0ixS7k%2Fs0vK1RAfsQ%3D&reserved=0
>
>
>
> Dear Colleagues,
>
> When I ran the “grid_stat” tool in MET, I wanted to stratify the
data into
> two categories: [230- 250] and [250-270]. In the grid stat
configuration
> file, I set this as
> cat_thresh = [ >=230&&<=250, >=250&&<=270 ];
>
> but when I ran grid_stat command I saw error that said:
> ERROR : check_mctc_thresh() -> when verifying using multi-
category
> contingency tables, the thresholds must be monotonically
increasing and be
> of the same inequality type (lt, le, gt, or ge).
>
> Could you please advise how to realize the above stratification
in
> grid_stat?
>
> Thanks,
> Shaowu
>
>
>
------------------------------------------------
Subject: MET set multiple category thresholds
From: John Halley Gotway
Time: Wed Jul 10 16:34:10 2019
Shaowu,
There's several ways of slicing/dicing the data. And defining exactly
what
you mean by "dividing them into groups and look at the MET statistics
of
each" will indicate how we should configure the tool.
I am guessing that you want to stratify your data down into subsets
using
those thresholds and then look at the continuous statistics for each
subset. If that's correct, then you'll use the "cnt_thresh" setting,
not
the "cat_thresh" setting.
cat_thresh defines category thresholds and impacts the categorical
counts
and statistics in the CTC, CTS, MCTC, and MCTS output line types.
cnt_thresh defines how to filter the raw data values and impacts the
pairs
used in the CNT and SL1L2 output lines types.
If that sounds like what you want, try this setting:
* cnt_thresh = [ NA, >=230&&<=250, >=250&&<=270 ];*
Instead of getting 1 CNT output line, you'll get 3:
- For all pairs.
- For pairs with values >=230&&<=250
- For pairs with values >=250&&<=270
But there's one additional thing to consider. Do you want to apply
this
filtering logic to the forecast *AND* observation values... or the
forecast
*OR* observation values. This is controlled by the cnt_logic setting.
And
the default is UNION, meaning OR:
*cnt_logic = UNION;*
Let's say you only want to condition the filtering only on the obs
values.
This is how you'd do that:
*cnt_logic = INTERSECTION;*
*fcst = {*
* cnt_thresh = [ NA, NA, NA ];*
*...*
*}*
*obs = {*
* cnt_thresh = [ NA, >=230&&<=250, >=250&&<=270 ];*
*...*
*}*
The *NA* threshold always evaluates to true. So the cnt_thresh is
always
true for the forecast data. And the cnt_thresh for the observation
data
will evaluate to true or false depending on the value. Computing the
intersection will have the desired effect.
Make sense? If that's not what you're trying to do, please let me
know.
Thanks,
John
On Wed, Jul 10, 2019 at 4:18 PM sbao at coastal.edu via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=91006 >
>
> John,
>
> Thanks for your quick reply. So when I set, say, cat_thresh = [
>=230,
> >=250, >=270 ], did I divide the data into ranges of [230-250]
[250-270]
> and [270-max]? or did I divide it into [230-max],[250-max] and [270-
max]?
> I want to stratify the data by dividing them into groups and look at
the
> MET statistics of each.
>
> Thanks,
> Shaowu
>
> On 7/10/19, 5:04 PM, "John Halley Gotway via RT"
<met_help at ucar.edu>
> wrote:
>
> Shaowu,
>
> This means that you have requested multi-category output
statistics
> (i.e.
> MCTC and/or MCTS). When MCTC and/or MCTS are requested, the
> categorical
> thresholds must follow a specific convention, as described in
that
> error
> message.
>
> If you actually do want to compute MCTC and/or MCTS stats, try
using
> this
> instead:
> cat_thresh = [ >=230, >=250, >=270 ];
>
> But if you're not interested in MCTC/MCTS, just disable them in
the
> config
> file:
> mctc = NONE;
> mcts = NONE;
>
> Thanks,
> John
>
> On Wed, Jul 10, 2019 at 2:55 PM sbao at coastal.edu via RT <
> met_help at ucar.edu>
> wrote:
>
> >
> > Wed Jul 10 14:55:00 2019: Request 91006 was acted upon.
> > Transaction: Ticket created by sbao at coastal.edu
> > Queue: met_help
> > Subject: MET set multiple category thresholds
> > Owner: Nobody
> > Requestors: sbao at coastal.edu
> > Status: new
> > Ticket <URL:
>
https://nam03.safelinks.protection.outlook.com/?url=https%3A%2F%2Frt.rap.ucar.edu%2Frt%2FTicket%2FDisplay.html%3Fid%3D91006&data=02%7C01%7Csbao%40coastal.edu%7C2beb3633bddc4de26d6d08d7057a3ccb%7Cbf1f856b8ef84e52be9387d3c3622797%7C0%7C0%7C636983894892789957&sdata=ub3%2Bz14Q%2FMqpdlcipg32wTuC%2FE0ixS7k%2Fs0vK1RAfsQ%3D&reserved=0
> >
> >
> >
> > Dear Colleagues,
> >
> > When I ran the “grid_stat” tool in MET, I wanted to stratify
the
> data into
> > two categories: [230- 250] and [250-270]. In the grid stat
> configuration
> > file, I set this as
> > cat_thresh = [ >=230&&<=250, >=250&&<=270 ];
> >
> > but when I ran grid_stat command I saw error that said:
> > ERROR : check_mctc_thresh() -> when verifying using multi-
category
> > contingency tables, the thresholds must be monotonically
increasing
> and be
> > of the same inequality type (lt, le, gt, or ge).
> >
> > Could you please advise how to realize the above
stratification in
> > grid_stat?
> >
> > Thanks,
> > Shaowu
> >
> >
> >
>
>
>
>
>
>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #91006] MET set multiple category thresholds
From: sbao at coastal.edu
Time: Wed Jul 10 17:16:17 2019
John,
This is exactly what I wanted to do. Your answer is very helpful,
Thanks,
Shaowu
On 7/10/19, 6:35 PM, "John Halley Gotway via RT" <met_help at ucar.edu>
wrote:
Shaowu,
There's several ways of slicing/dicing the data. And defining
exactly what
you mean by "dividing them into groups and look at the MET
statistics of
each" will indicate how we should configure the tool.
I am guessing that you want to stratify your data down into
subsets using
those thresholds and then look at the continuous statistics for
each
subset. If that's correct, then you'll use the "cnt_thresh"
setting, not
the "cat_thresh" setting.
cat_thresh defines category thresholds and impacts the categorical
counts
and statistics in the CTC, CTS, MCTC, and MCTS output line types.
cnt_thresh defines how to filter the raw data values and impacts
the pairs
used in the CNT and SL1L2 output lines types.
If that sounds like what you want, try this setting:
* cnt_thresh = [ NA, >=230&&<=250, >=250&&<=270 ];*
Instead of getting 1 CNT output line, you'll get 3:
- For all pairs.
- For pairs with values >=230&&<=250
- For pairs with values >=250&&<=270
But there's one additional thing to consider. Do you want to
apply this
filtering logic to the forecast *AND* observation values... or the
forecast
*OR* observation values. This is controlled by the cnt_logic
setting. And
the default is UNION, meaning OR:
*cnt_logic = UNION;*
Let's say you only want to condition the filtering only on the obs
values.
This is how you'd do that:
*cnt_logic = INTERSECTION;*
*fcst = {*
* cnt_thresh = [ NA, NA, NA ];*
*...*
*}*
*obs = {*
* cnt_thresh = [ NA, >=230&&<=250, >=250&&<=270 ];*
*...*
*}*
The *NA* threshold always evaluates to true. So the cnt_thresh is
always
true for the forecast data. And the cnt_thresh for the
observation data
will evaluate to true or false depending on the value. Computing
the
intersection will have the desired effect.
Make sense? If that's not what you're trying to do, please let me
know.
Thanks,
John
On Wed, Jul 10, 2019 at 4:18 PM sbao at coastal.edu via RT
<met_help at ucar.edu>
wrote:
>
> <URL:
https://nam03.safelinks.protection.outlook.com/?url=https%3A%2F%2Frt.rap.ucar.edu%2Frt%2FTicket%2FDisplay.html%3Fid%3D91006&data=02%7C01%7Csbao%40coastal.edu%7C87c8d572cf0e4eb1665e08d70586d8f2%7Cbf1f856b8ef84e52be9387d3c3622797%7C0%7C0%7C636983949047004119&sdata=ts7X0QKC9iCgoDXAOs%2Fd1gYmptHFerP3kj0GxuVutzg%3D&reserved=0
>
>
> John,
>
> Thanks for your quick reply. So when I set, say, cat_thresh = [
>=230,
> >=250, >=270 ], did I divide the data into ranges of [230-250]
[250-270]
> and [270-max]? or did I divide it into [230-max],[250-max] and
[270-max]?
> I want to stratify the data by dividing them into groups and
look at the
> MET statistics of each.
>
> Thanks,
> Shaowu
>
> On 7/10/19, 5:04 PM, "John Halley Gotway via RT"
<met_help at ucar.edu>
> wrote:
>
> Shaowu,
>
> This means that you have requested multi-category output
statistics
> (i.e.
> MCTC and/or MCTS). When MCTC and/or MCTS are requested, the
> categorical
> thresholds must follow a specific convention, as described
in that
> error
> message.
>
> If you actually do want to compute MCTC and/or MCTS stats,
try using
> this
> instead:
> cat_thresh = [ >=230, >=250, >=270 ];
>
> But if you're not interested in MCTC/MCTS, just disable them
in the
> config
> file:
> mctc = NONE;
> mcts = NONE;
>
> Thanks,
> John
>
> On Wed, Jul 10, 2019 at 2:55 PM sbao at coastal.edu via RT <
> met_help at ucar.edu>
> wrote:
>
> >
> > Wed Jul 10 14:55:00 2019: Request 91006 was acted upon.
> > Transaction: Ticket created by sbao at coastal.edu
> > Queue: met_help
> > Subject: MET set multiple category thresholds
> > Owner: Nobody
> > Requestors: sbao at coastal.edu
> > Status: new
> > Ticket <URL:
>
https://nam03.safelinks.protection.outlook.com/?url=https%3A%2F%2Frt.rap.ucar.edu%2Frt%2FTicket%2FDisplay.html%3Fid%3D91006&data=02%7C01%7Csbao%40coastal.edu%7C87c8d572cf0e4eb1665e08d70586d8f2%7Cbf1f856b8ef84e52be9387d3c3622797%7C0%7C0%7C636983949047004119&sdata=ts7X0QKC9iCgoDXAOs%2Fd1gYmptHFerP3kj0GxuVutzg%3D&reserved=0
> >
> >
> >
> > Dear Colleagues,
> >
> > When I ran the “grid_stat” tool in MET, I wanted to
stratify the
> data into
> > two categories: [230- 250] and [250-270]. In the grid stat
> configuration
> > file, I set this as
> > cat_thresh = [ >=230&&<=250, >=250&&<=270 ];
> >
> > but when I ran grid_stat command I saw error that said:
> > ERROR : check_mctc_thresh() -> when verifying using
multi-category
> > contingency tables, the thresholds must be monotonically
increasing
> and be
> > of the same inequality type (lt, le, gt, or ge).
> >
> > Could you please advise how to realize the above
stratification in
> > grid_stat?
> >
> > Thanks,
> > Shaowu
> >
> >
> >
>
>
>
>
>
>
------------------------------------------------
More information about the Met_help
mailing list