[Met_help] [rt.rap.ucar.edu #95898] History for FCST_THRESH and OBS_THRESH
Julie Prestopnik via RT
met_help at ucar.edu
Fri Jul 17 13:38:05 MDT 2020
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Hello,
I want to double check the choice "THRESH" for "Fixed Values":
I tried to make a CSI plot using METViewer, I had several options for
"FCST_THRESH" (eg: >=0.1, >=1 etc). My question is if I choose " >=1" for
"FCST_THRESH", this means BOTH forecast AND obs. have "1" for thresh, so
it should be the same thing as I choose "OBS_THRESH >=1". Is that correct?
Thank you.
Binyu
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: FCST_THRESH and OBS_THRESH
From: Julie Prestopnik
Time: Mon Jul 13 17:38:50 2020
Hi Binyu.
Unfortunately, I do not know the answer to your question. However, I
have
inquired with my team members and will get back to you as soon as I
know
more.
Julie
On Mon, Jul 13, 2020 at 2:48 PM binyu.wang at noaa.gov via RT <
met_help at ucar.edu> wrote:
>
> Mon Jul 13 14:47:50 2020: Request 95898 was acted upon.
> Transaction: Ticket created by binyu.wang at noaa.gov
> Queue: met_help
> Subject: FCST_THRESH and OBS_THRESH
> Owner: Nobody
> Requestors: binyu.wang at noaa.gov
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95898 >
>
>
> Hello,
>
> I want to double check the choice "THRESH" for "Fixed Values":
>
> I tried to make a CSI plot using METViewer, I had several options
for
> "FCST_THRESH" (eg: >=0.1, >=1 etc). My question is if I choose "
>=1" for
> "FCST_THRESH", this means BOTH forecast AND obs. have "1" for
thresh, so
> it should be the same thing as I choose "OBS_THRESH >=1". Is that
correct?
>
> Thank you.
> Binyu
>
>
--
Julie Prestopnik
Software Engineer
National Center for Atmospheric Research
Research Applications Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
My working day may not be your working day. Please do not feel
obliged to
reply to this email outside of your normal working hours.
------------------------------------------------
Subject: FCST_THRESH and OBS_THRESH
From: Tatiana Burek
Time: Tue Jul 14 08:21:29 2020
Hi Binyu,
If you choose a value for fcst_thresh (" >=1") this value will be
applied only to fcst_thresh and not to obs_thresh. If the values of
these two fields are the same then it doesn't matter which one to
choose.
Tatiana
On Mon Jul 13 14:47:50 2020, binyu.wang at noaa.gov wrote:
> Hello,
>
> I want to double check the choice "THRESH" for "Fixed Values":
>
> I tried to make a CSI plot using METViewer, I had several options
for
> "FCST_THRESH" (eg: >=0.1, >=1 etc). My question is if I choose "
>=1" for
> "FCST_THRESH", this means BOTH forecast AND obs. have "1" for
thresh, so
> it should be the same thing as I choose "OBS_THRESH >=1". Is that
correct?
>
> Thank you.
> Binyu
------------------------------------------------
Subject: FCST_THRESH and OBS_THRESH
From: Tara Jensen
Time: Tue Jul 14 08:23:27 2020
Binyu,
I see you have a question about picking thresholds for plotting CSI
(or
other categorical statistics for that matter).
Picking either FCST_THRESH or OBS_THRESH is generally okay. Here's
why:
- If FCST_THRESH and OBS_THRESH were set to the same value when MET
was
run, then picking just one value will result in the correct data
records
- If FCST_THRESH and OBS_THRESH were not set the to the same value
when
MET was run, the relationship between the two thresholds would be
present
and it would still pull the correct records.
However, If you made several runs of MET with FCST_THRESH and
OBS_THRESH
not set to the same value and the relationship between them also
changed
between MET runs:
e.g.
- MET run 1 FCST_THRESH > 1.0 and OBS_THRESH > 0.1 (due to a
scaling
issue) and
- MET run 2 FCST_THRESH > 1.0 and OBS_THRESH > 2.54 (due to a
unit's
conversion difference)
- MET run 3 FCST_THRESH > 1.0 and OBS_THRESH > 5.08 (due to a unit
conversion and known bias that you want to systematically
eliminate)
It is possible that you may want to make sure that you set both
FCST_THRESH
> 1.0 and OBS_THRESH > 0.1 if you are interested only in the
performance
against a particular obs data source (i.e. the one with the scaling
issue).
Hopefully this helps.
Cheers, Tara
On Mon, Jul 13, 2020 at 2:48 PM binyu.wang at noaa.gov via RT <
met_help at ucar.edu> wrote:
>
> Mon Jul 13 14:47:50 2020: Request 95898 was acted upon.
> Transaction: Ticket created by binyu.wang at noaa.gov
> Queue: met_help
> Subject: FCST_THRESH and OBS_THRESH
> Owner: Nobody
> Requestors: binyu.wang at noaa.gov
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95898 >
>
>
> Hello,
>
> I want to double check the choice "THRESH" for "Fixed Values":
>
> I tried to make a CSI plot using METViewer, I had several options
for
> "FCST_THRESH" (eg: >=0.1, >=1 etc). My question is if I choose "
>=1" for
> "FCST_THRESH", this means BOTH forecast AND obs. have "1" for
thresh, so
> it should be the same thing as I choose "OBS_THRESH >=1". Is that
correct?
>
> Thank you.
> Binyu
>
>
--
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Tara Jensen
Project Manager II
NCAR RAL and DTC
PO Box 3000, Boulder, Colorado 80307 USA
+1 303-497-8479 jensen at ucar.edu
------------------------------------------------
Subject: FCST_THRESH and OBS_THRESH
From: binyu.wang at noaa.gov
Time: Tue Jul 14 08:45:24 2020
Tara,
Thank you for the clarification. I never realized I could set
different cat_thresh for fcst and obs based on so many conditions
before.
Just to confirm here: the threshold value can be different, but the
number
of cat_thresh MUST BE THE SAME, right?
I did set the SAME cat_thresh in both fields for fcst and obs. in my
config file,
cat_thresh = [ >=0.1,>=0.3, >=0.5,>=1,>=3,>=5,>=7, >=10 ];
so even if I pick "FCST_THRESH > 1.0" (or "OBS_THRESH > 1.0) ONLY, it
means BOTH forecast AND obs. have "1" for thresh, which makes sense.
Best.
Binyu
On Tue, Jul 14, 2020 at 10:23 AM Tara Jensen via RT
<met_help at ucar.edu>
wrote:
> Binyu,
>
> I see you have a question about picking thresholds for plotting CSI
(or
> other categorical statistics for that matter).
>
> Picking either FCST_THRESH or OBS_THRESH is generally okay. Here's
why:
>
> - If FCST_THRESH and OBS_THRESH were set to the same value when
MET was
> run, then picking just one value will result in the correct data
records
> - If FCST_THRESH and OBS_THRESH were not set the to the same
value when
> MET was run, the relationship between the two thresholds would be
> present
> and it would still pull the correct records.
>
> However, If you made several runs of MET with FCST_THRESH and
OBS_THRESH
> not set to the same value and the relationship between them also
changed
> between MET runs:
> e.g.
>
> - MET run 1 FCST_THRESH > 1.0 and OBS_THRESH > 0.1 (due to a
scaling
> issue) and
> - MET run 2 FCST_THRESH > 1.0 and OBS_THRESH > 2.54 (due to a
unit's
> conversion difference)
> - MET run 3 FCST_THRESH > 1.0 and OBS_THRESH > 5.08 (due to a
unit
> conversion and known bias that you want to systematically
eliminate)
>
> It is possible that you may want to make sure that you set both
FCST_THRESH
> > 1.0 and OBS_THRESH > 0.1 if you are interested only in the
performance
> against a particular obs data source (i.e. the one with the scaling
issue).
>
> Hopefully this helps.
> Cheers, Tara
>
> On Mon, Jul 13, 2020 at 2:48 PM binyu.wang at noaa.gov via RT <
> met_help at ucar.edu> wrote:
>
> >
> > Mon Jul 13 14:47:50 2020: Request 95898 was acted upon.
> > Transaction: Ticket created by binyu.wang at noaa.gov
> > Queue: met_help
> > Subject: FCST_THRESH and OBS_THRESH
> > Owner: Nobody
> > Requestors: binyu.wang at noaa.gov
> > Status: new
> > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95898 >
> >
> >
> > Hello,
> >
> > I want to double check the choice "THRESH" for "Fixed Values":
> >
> > I tried to make a CSI plot using METViewer, I had several
options for
> > "FCST_THRESH" (eg: >=0.1, >=1 etc). My question is if I choose "
>=1" for
> > "FCST_THRESH", this means BOTH forecast AND obs. have "1" for
thresh, so
> > it should be the same thing as I choose "OBS_THRESH >=1". Is that
> correct?
> >
> > Thank you.
> > Binyu
> >
> >
>
> --
> ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
> Tara Jensen
> Project Manager II
> NCAR RAL and DTC
> PO Box 3000, Boulder, Colorado 80307 USA
> +1 303-497-8479 jensen at ucar.edu
>
>
------------------------------------------------
Subject: FCST_THRESH and OBS_THRESH
From: Tara Jensen
Time: Tue Jul 14 08:59:36 2020
Binyu,
You are correct in that:
1) The number of FCST_THRESH and OBS_THRESH can be different but
there
must be the same number of thresholds in the two dictionaries.
2) If you pick "FCST_THRESH > 1.0" (or "OBS_THRESH > 1.0) ONLY, it
means
BOTH forecast AND obs have ">1" for thresh.
Cheers, Tara
On Tue, Jul 14, 2020 at 8:45 AM binyu.wang at noaa.gov via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95898 >
>
> Tara,
>
> Thank you for the clarification. I never realized I could set
> different cat_thresh for fcst and obs based on so many conditions
before.
> Just to confirm here: the threshold value can be different, but the
number
> of cat_thresh MUST BE THE SAME, right?
>
> I did set the SAME cat_thresh in both fields for fcst and obs. in
my
> config file,
> cat_thresh = [ >=0.1,>=0.3, >=0.5,>=1,>=3,>=5,>=7, >=10 ];
> so even if I pick "FCST_THRESH > 1.0" (or "OBS_THRESH > 1.0) ONLY,
it
> means BOTH forecast AND obs. have "1" for thresh, which makes sense.
>
> Best.
> Binyu
>
>
> On Tue, Jul 14, 2020 at 10:23 AM Tara Jensen via RT
<met_help at ucar.edu>
> wrote:
>
> > Binyu,
> >
> > I see you have a question about picking thresholds for plotting
CSI (or
> > other categorical statistics for that matter).
> >
> > Picking either FCST_THRESH or OBS_THRESH is generally okay.
Here's why:
> >
> > - If FCST_THRESH and OBS_THRESH were set to the same value when
MET
> was
> > run, then picking just one value will result in the correct
data
> records
> > - If FCST_THRESH and OBS_THRESH were not set the to the same
value
> when
> > MET was run, the relationship between the two thresholds would
be
> > present
> > and it would still pull the correct records.
> >
> > However, If you made several runs of MET with FCST_THRESH and
OBS_THRESH
> > not set to the same value and the relationship between them also
changed
> > between MET runs:
> > e.g.
> >
> > - MET run 1 FCST_THRESH > 1.0 and OBS_THRESH > 0.1 (due to a
scaling
> > issue) and
> > - MET run 2 FCST_THRESH > 1.0 and OBS_THRESH > 2.54 (due to a
unit's
> > conversion difference)
> > - MET run 3 FCST_THRESH > 1.0 and OBS_THRESH > 5.08 (due to a
unit
> > conversion and known bias that you want to systematically
eliminate)
> >
> > It is possible that you may want to make sure that you set both
> FCST_THRESH
> > > 1.0 and OBS_THRESH > 0.1 if you are interested only in the
performance
> > against a particular obs data source (i.e. the one with the
scaling
> issue).
> >
> > Hopefully this helps.
> > Cheers, Tara
> >
> > On Mon, Jul 13, 2020 at 2:48 PM binyu.wang at noaa.gov via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > Mon Jul 13 14:47:50 2020: Request 95898 was acted upon.
> > > Transaction: Ticket created by binyu.wang at noaa.gov
> > > Queue: met_help
> > > Subject: FCST_THRESH and OBS_THRESH
> > > Owner: Nobody
> > > Requestors: binyu.wang at noaa.gov
> > > Status: new
> > > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95898
> >
> > >
> > >
> > > Hello,
> > >
> > > I want to double check the choice "THRESH" for "Fixed Values":
> > >
> > > I tried to make a CSI plot using METViewer, I had several
options for
> > > "FCST_THRESH" (eg: >=0.1, >=1 etc). My question is if I choose "
>=1"
> for
> > > "FCST_THRESH", this means BOTH forecast AND obs. have "1" for
thresh,
> so
> > > it should be the same thing as I choose "OBS_THRESH >=1". Is
that
> > correct?
> > >
> > > Thank you.
> > > Binyu
> > >
> > >
> >
> > --
> > ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
> > Tara Jensen
> > Project Manager II
> > NCAR RAL and DTC
> > PO Box 3000, Boulder, Colorado 80307 USA
> > +1 303-497-8479 jensen at ucar.edu
> >
> >
>
>
--
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Tara Jensen
Project Manager II
NCAR RAL and DTC
PO Box 3000, Boulder, Colorado 80307 USA
+1 303-497-8479 jensen at ucar.edu
------------------------------------------------
More information about the Met_help
mailing list