[Met_help] [rt.rap.ucar.edu #95036] History for grid_stat

John Halley Gotway via RT met_help at ucar.edu
Fri Apr 24 16:54:16 MDT 2020


----------------------------------------------------------------
  Initial Request
----------------------------------------------------------------

Folks - I'm specifying the following cat_thresh for a probability field:

        cat_thresh = [ ==0.1 ];

In the resulting pjc.txt file, I get THRESH_1 = 0,... ,THRESH_11 = 1, but I only get LIKELIHOOD_1, ..., LIKELIHOOD_10. I was wondering how come there is no LIKELIHOOD_11.
How can I make sure that 1.0 is included in the statistics? Thanks.

Efren A. Serra (Contractor)
Physicist

DeVine Consulting, Inc.
Naval Research Laboratory
Marine Meteorology Division
7 Grace Hopper Ave., STOP 2
Monterey, CA 93943
Code 7542
Mobile: 408-425-5027



----------------------------------------------------------------
  Complete Ticket History
----------------------------------------------------------------

Subject: grid_stat
From: David Fillmore
Time: Fri Apr 24 12:50:31 2020

Hi Efren -
I think John should be able to help with the Grid Stat question.
I'll assign the ticket to him.
thanks,
David

On Fri, Apr 24, 2020 at 11:39 AM efren.serra.ctr at nrlmry.navy.mil via
RT <
met_help at ucar.edu> wrote:

>
> Fri Apr 24 11:38:59 2020: Request 95036 was acted upon.
> Transaction: Ticket created by efren.serra.ctr at nrlmry.navy.mil
>        Queue: met_help
>      Subject: grid_stat
>        Owner: Nobody
>   Requestors: efren.serra.ctr at nrlmry.navy.mil
>       Status: new
>  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95036 >
>
>
> Folks - I'm specifying the following cat_thresh for a probability
field:
>
>         cat_thresh = [ ==0.1 ];
>
> In the resulting pjc.txt file, I get THRESH_1 = 0,... ,THRESH_11 =
1, but
> I only get LIKELIHOOD_1, ..., LIKELIHOOD_10. I was wondering how
come there
> is no LIKELIHOOD_11.
> How can I make sure that 1.0 is included in the statistics? Thanks.
>
> Efren A. Serra (Contractor)
> Physicist
>
> DeVine Consulting, Inc.
> Naval Research Laboratory
> Marine Meteorology Division
> 7 Grace Hopper Ave., STOP 2
> Monterey, CA 93943
> Code 7542
> Mobile: 408-425-5027
>
>
>

------------------------------------------------
Subject: grid_stat
From: John Halley Gotway
Time: Fri Apr 24 16:09:49 2020

Efren,

You're correct in noticing that for "cat_thresh = [ ==0.1 ];" you see
THRESH_1 through THRESH_11 in the output, but only LIKELIHOOD_1
through
LIKELIHOOD_10.  And there's a good reason for this.  We really only
include
the final THRESH_11 for completeness sake, but it could easily be
excluded
from the output.

Here's what's going on.  Probability forecast values should always be
in a
range for 0 to 1.  Or if they're in the range 0 to 100, MET
automatically
divides by 100 to put them into (0, 1).  The "cat_thresh" setting
defines
the probability bins used in the verification.  By convention, those
thresholds must start with 0 and end with 1, e.g. cat_thresh = [ >0,
>0.25,
>.5, >1.0 ];

Along the way, we got tired of typing all those thresholds and came up
with
the shortcut you're using.  Setting "==0.1" to define equally sized
bins
between 0 and 1.  This results in 10 bins, form 0.0 to 0.1, 0.1 to
0.2, and
so on up to 0.9 to 1.0.  So 1.0 is the end of the last bin and that's
what's written in the THRESH_11 column.

If you switched to using "==0.01", you'd get 100 bins and THRESH_101
would
also be 1.0, the endpoint of the last bin.  So you can see that column
isn't all that meaningful.

Does that make sense?

Thanks,
John Halley Gotway

On Fri, Apr 24, 2020 at 12:51 PM David Fillmore via RT
<met_help at ucar.edu>
wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95036 >
>
> Hi Efren -
> I think John should be able to help with the Grid Stat question.
> I'll assign the ticket to him.
> thanks,
> David
>
> On Fri, Apr 24, 2020 at 11:39 AM efren.serra.ctr at nrlmry.navy.mil via
RT <
> met_help at ucar.edu> wrote:
>
> >
> > Fri Apr 24 11:38:59 2020: Request 95036 was acted upon.
> > Transaction: Ticket created by efren.serra.ctr at nrlmry.navy.mil
> >        Queue: met_help
> >      Subject: grid_stat
> >        Owner: Nobody
> >   Requestors: efren.serra.ctr at nrlmry.navy.mil
> >       Status: new
> >  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95036 >
> >
> >
> > Folks - I'm specifying the following cat_thresh for a probability
field:
> >
> >         cat_thresh = [ ==0.1 ];
> >
> > In the resulting pjc.txt file, I get THRESH_1 = 0,... ,THRESH_11 =
1, but
> > I only get LIKELIHOOD_1, ..., LIKELIHOOD_10. I was wondering how
come
> there
> > is no LIKELIHOOD_11.
> > How can I make sure that 1.0 is included in the statistics?
Thanks.
> >
> > Efren A. Serra (Contractor)
> > Physicist
> >
> > DeVine Consulting, Inc.
> > Naval Research Laboratory
> > Marine Meteorology Division
> > 7 Grace Hopper Ave., STOP 2
> > Monterey, CA 93943
> > Code 7542
> > Mobile: 408-425-5027
> >
> >
> >
>
>

------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #95036] grid_stat
From: efren.serra.ctr at nrlmry.navy.mil
Time: Fri Apr 24 16:51:34 2020

John - This makes perfect sense; thank you so much for this thorough
explanation. I take it we can close this ticket.

-----Original Message-----
From: John Halley Gotway via RT <met_help at ucar.edu>
Sent: Friday, April 24, 2020 3:10 PM
To: Serra, Mr. Efren, Contractor, Code 7531
<efren.serra.ctr at nrlmry.navy.mil>
Subject: Re: [rt.rap.ucar.edu #95036] grid_stat

Efren,

You're correct in noticing that for "cat_thresh = [ ==0.1 ];" you see
THRESH_1 through THRESH_11 in the output, but only LIKELIHOOD_1
through LIKELIHOOD_10.  And there's a good reason for this.  We really
only include the final THRESH_11 for completeness sake, but it could
easily be excluded from the output.

Here's what's going on.  Probability forecast values should always be
in a range for 0 to 1.  Or if they're in the range 0 to 100, MET
automatically divides by 100 to put them into (0, 1).  The
"cat_thresh" setting defines the probability bins used in the
verification.  By convention, those thresholds must start with 0 and
end with 1, e.g. cat_thresh = [ >0, >0.25,
>.5, >1.0 ];

Along the way, we got tired of typing all those thresholds and came up
with the shortcut you're using.  Setting "==0.1" to define equally
sized bins between 0 and 1.  This results in 10 bins, form 0.0 to 0.1,
0.1 to 0.2, and so on up to 0.9 to 1.0.  So 1.0 is the end of the last
bin and that's what's written in the THRESH_11 column.

If you switched to using "==0.01", you'd get 100 bins and THRESH_101
would also be 1.0, the endpoint of the last bin.  So you can see that
column isn't all that meaningful.

Does that make sense?

Thanks,
John Halley Gotway

On Fri, Apr 24, 2020 at 12:51 PM David Fillmore via RT
<met_help at ucar.edu>
wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95036 >
>
> Hi Efren -
> I think John should be able to help with the Grid Stat question.
> I'll assign the ticket to him.
> thanks,
> David
>
> On Fri, Apr 24, 2020 at 11:39 AM efren.serra.ctr at nrlmry.navy.mil via
> RT < met_help at ucar.edu> wrote:
>
> >
> > Fri Apr 24 11:38:59 2020: Request 95036 was acted upon.
> > Transaction: Ticket created by efren.serra.ctr at nrlmry.navy.mil
> >        Queue: met_help
> >      Subject: grid_stat
> >        Owner: Nobody
> >   Requestors: efren.serra.ctr at nrlmry.navy.mil
> >       Status: new
> >  Ticket <URL:
> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95036 >
> >
> >
> > Folks - I'm specifying the following cat_thresh for a probability
field:
> >
> >         cat_thresh = [ ==0.1 ];
> >
> > In the resulting pjc.txt file, I get THRESH_1 = 0,... ,THRESH_11 =
> > 1, but I only get LIKELIHOOD_1, ..., LIKELIHOOD_10. I was
wondering
> > how come
> there
> > is no LIKELIHOOD_11.
> > How can I make sure that 1.0 is included in the statistics?
Thanks.
> >
> > Efren A. Serra (Contractor)
> > Physicist
> >
> > DeVine Consulting, Inc.
> > Naval Research Laboratory
> > Marine Meteorology Division
> > 7 Grace Hopper Ave., STOP 2
> > Monterey, CA 93943
> > Code 7542
> > Mobile: 408-425-5027
> >
> >
> >
>
>



------------------------------------------------


More information about the Met_help mailing list