[Met_help] [rt.rap.ucar.edu #97210] History for pjc, prc, and pstd output files
John Halley Gotway via RT
met_help at ucar.edu
Tue Nov 17 10:45:30 MST 2020
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Folks - I was wondering where I could find samples of graphs plot from the pjc, prc and pstd files. At the moment I am plotting reliability diagrams (BASER), ROC (PODY vs POFD), Brier score (BRIER) and discrimination diagrams (oy_tp and on_tp). Thanks.
Efren A. Serra (Contractor)
Physicist
DeVine Consulting, Inc.
Naval Research Laboratory
Marine Meteorology Division
7 Grace Hopper Ave., STOP 2
Monterey, CA 93943
Code 7542
Mobile: 408-425-5027
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: pjc, prc, and pstd output files
From: John Halley Gotway
Time: Mon Oct 26 09:00:12 2020
Efren,
It sounds like you're already making good use of the probabilistic
output
lines types created by MET. Do realize that all of the output is
created
and derivable from the Nx2 probabilistic contingency table counts
included
in the PCT line type.
The PSTD line type (
https://dtcenter.github.io/MET/latest/Users_Guide/point-
stat.html#id15)
includes the Brier Score, which you're already plotting.
The PJC line type (
https://dtcenter.github.io/MET/latest/Users_Guide/point-
stat.html#id16)
includes rates for each of the bins which are uses in creating
discrimination diagrams.
The PRC line type (
https://dtcenter.github.io/MET/latest/Users_Guide/point-
stat.html#id17)
includes the points for a receiver operating characteristic curve.
Ideally, I'd be able to point you to examples of plots created by
METviewer
for each of these. While we're in the process of adding those examples
to
the METviewer user's guide, unfortunately, they're not quite ready
yet.
I've cc'ed Lindsay Blank on this email. I believe she's the person
actively
working on adding examples to the METviewer docs, which live here:
https://github.com/dtcenter/METviewer/tree/main_v3.1/docs
Thanks,
John
On Fri, Oct 23, 2020 at 1:18 PM efren.serra.ctr at nrlmry.navy.mil via RT
<
met_help at ucar.edu> wrote:
>
> Fri Oct 23 13:17:58 2020: Request 97210 was acted upon.
> Transaction: Ticket created by efren.serra.ctr at nrlmry.navy.mil
> Queue: met_help
> Subject: pjc, prc, and pstd output files
> Owner: Nobody
> Requestors: efren.serra.ctr at nrlmry.navy.mil
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97210 >
>
>
> Folks - I was wondering where I could find samples of graphs plot
from the
> pjc, prc and pstd files. At the moment I am plotting reliability
diagrams
> (BASER), ROC (PODY vs POFD), Brier score (BRIER) and discrimination
> diagrams (oy_tp and on_tp). Thanks.
>
> Efren A. Serra (Contractor)
> Physicist
>
> DeVine Consulting, Inc.
> Naval Research Laboratory
> Marine Meteorology Division
> 7 Grace Hopper Ave., STOP 2
> Monterey, CA 93943
> Code 7542
> Mobile: 408-425-5027
>
>
>
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #97210] pjc, prc, and pstd output files
From: efren.serra.ctr at nrlmry.navy.mil
Time: Mon Oct 26 12:39:17 2020
John - Thanks for the links below.
A side note: I have a forecast DTG of 20180705_00 96hr and valid at
20180709_00. Hence, the FCST_VALID_BEG is 20180705_00, the FCST_LEAD
is 96 and the OBS_VALID_BEG is 20180709_00 and the OBS_LEAD is 0.
-----Original Message-----
From: John Halley Gotway via RT <met_help at ucar.edu>
Sent: Monday, October 26, 2020 8:00 AM
To: Serra, Mr. Efren, Contractor, Code 7531
<efren.serra.ctr at nrlmry.navy.mil>
Subject: Re: [rt.rap.ucar.edu #97210] pjc, prc, and pstd output files
Efren,
It sounds like you're already making good use of the probabilistic
output lines types created by MET. Do realize that all of the output
is created and derivable from the Nx2 probabilistic contingency table
counts included in the PCT line type.
The PSTD line type (
https://dtcenter.github.io/MET/latest/Users_Guide/point-
stat.html#id15)
includes the Brier Score, which you're already plotting.
The PJC line type (
https://dtcenter.github.io/MET/latest/Users_Guide/point-
stat.html#id16)
includes rates for each of the bins which are uses in creating
discrimination diagrams.
The PRC line type (
https://dtcenter.github.io/MET/latest/Users_Guide/point-
stat.html#id17)
includes the points for a receiver operating characteristic curve.
Ideally, I'd be able to point you to examples of plots created by
METviewer for each of these. While we're in the process of adding
those examples to the METviewer user's guide, unfortunately, they're
not quite ready yet.
I've cc'ed Lindsay Blank on this email. I believe she's the person
actively working on adding examples to the METviewer docs, which live
here:
https://github.com/dtcenter/METviewer/tree/main_v3.1/docs
Thanks,
John
On Fri, Oct 23, 2020 at 1:18 PM efren.serra.ctr at nrlmry.navy.mil via RT
< met_help at ucar.edu> wrote:
>
> Fri Oct 23 13:17:58 2020: Request 97210 was acted upon.
> Transaction: Ticket created by efren.serra.ctr at nrlmry.navy.mil
> Queue: met_help
> Subject: pjc, prc, and pstd output files
> Owner: Nobody
> Requestors: efren.serra.ctr at nrlmry.navy.mil
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97210
> >
>
>
> Folks - I was wondering where I could find samples of graphs plot
from
> the pjc, prc and pstd files. At the moment I am plotting reliability
> diagrams (BASER), ROC (PODY vs POFD), Brier score (BRIER) and
> discrimination diagrams (oy_tp and on_tp). Thanks.
>
> Efren A. Serra (Contractor)
> Physicist
>
> DeVine Consulting, Inc.
> Naval Research Laboratory
> Marine Meteorology Division
> 7 Grace Hopper Ave., STOP 2
> Monterey, CA 93943
> Code 7542
> Mobile: 408-425-5027
>
>
>
------------------------------------------------
Subject: pjc, prc, and pstd output files
From: Lindsay Blank
Time: Mon Oct 26 13:02:34 2020
Hi Efren,
Here is a link to the in-progress METviewer user's guide that John
mentioned. I've included links to the chapters that cover the plots
you
want to make.
Reliability diagram:
https://github.com/dtcenter/METviewer/blob/task_204_documentation/docs/reliabilityplots.rst
ROC plots:
https://github.com/dtcenter/METviewer/blob/task_204_documentation/docs/rocplot.rst
Brier Score is a type of series plot:
https://github.com/dtcenter/METviewer/blob/task_204_documentation/docs/seriesplots.rst
I don't have an example of a discrimination plot, unfortunately, but I
think that is also a series plot.
Please let me know if you have any questions or have trouble accessing
the
links I sent.
Best,
Lindsay
On Mon, Oct 26, 2020 at 12:39 PM efren.serra.ctr at nrlmry.navy.mil via
RT <
met_help at ucar.edu> wrote:
> John - Thanks for the links below.
>
> A side note: I have a forecast DTG of 20180705_00 96hr and valid at
> 20180709_00. Hence, the FCST_VALID_BEG is 20180705_00, the FCST_LEAD
is 96
> and the OBS_VALID_BEG is 20180709_00 and the OBS_LEAD is 0.
>
> -----Original Message-----
> From: John Halley Gotway via RT <met_help at ucar.edu>
> Sent: Monday, October 26, 2020 8:00 AM
> To: Serra, Mr. Efren, Contractor, Code 7531 <
> efren.serra.ctr at nrlmry.navy.mil>
> Subject: Re: [rt.rap.ucar.edu #97210] pjc, prc, and pstd output
files
>
> Efren,
>
> It sounds like you're already making good use of the probabilistic
output
> lines types created by MET. Do realize that all of the output is
created
> and derivable from the Nx2 probabilistic contingency table counts
included
> in the PCT line type.
>
> The PSTD line type (
> https://dtcenter.github.io/MET/latest/Users_Guide/point-
stat.html#id15)
> includes the Brier Score, which you're already plotting.
> The PJC line type (
> https://dtcenter.github.io/MET/latest/Users_Guide/point-
stat.html#id16)
> includes rates for each of the bins which are uses in creating
> discrimination diagrams.
> The PRC line type (
> https://dtcenter.github.io/MET/latest/Users_Guide/point-
stat.html#id17)
> includes the points for a receiver operating characteristic curve.
>
> Ideally, I'd be able to point you to examples of plots created by
> METviewer for each of these. While we're in the process of adding
those
> examples to the METviewer user's guide, unfortunately, they're not
quite
> ready yet.
> I've cc'ed Lindsay Blank on this email. I believe she's the person
> actively working on adding examples to the METviewer docs, which
live here:
> https://github.com/dtcenter/METviewer/tree/main_v3.1/docs
>
> Thanks,
> John
>
> On Fri, Oct 23, 2020 at 1:18 PM efren.serra.ctr at nrlmry.navy.mil via
RT <
> met_help at ucar.edu> wrote:
>
> >
> > Fri Oct 23 13:17:58 2020: Request 97210 was acted upon.
> > Transaction: Ticket created by efren.serra.ctr at nrlmry.navy.mil
> > Queue: met_help
> > Subject: pjc, prc, and pstd output files
> > Owner: Nobody
> > Requestors: efren.serra.ctr at nrlmry.navy.mil
> > Status: new
> > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97210
> > >
> >
> >
> > Folks - I was wondering where I could find samples of graphs plot
from
> > the pjc, prc and pstd files. At the moment I am plotting
reliability
> > diagrams (BASER), ROC (PODY vs POFD), Brier score (BRIER) and
> > discrimination diagrams (oy_tp and on_tp). Thanks.
> >
> > Efren A. Serra (Contractor)
> > Physicist
> >
> > DeVine Consulting, Inc.
> > Naval Research Laboratory
> > Marine Meteorology Division
> > 7 Grace Hopper Ave., STOP 2
> > Monterey, CA 93943
> > Code 7542
> > Mobile: 408-425-5027
> >
> >
> >
>
>
>
>
--
Lindsay R. Blank
Associate Scientist
Joint Numerical Testbed Program
National Center for Atmospheric Research
+1 (303)-497-2772
*My working day may not be your working day. Please do not feel
obliged to
reply to this email outside of your normal working hours.*
------------------------------------------------
More information about the Met_help
mailing list