[Met_help] [rt.rap.ucar.edu #97173] History for point_stat after ensemble_stat
Tatiana Burek via RT
met_help at ucar.edu
Thu Mar 18 11:21:08 MDT 2021
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Hello,
I was trying to do GEFS WIND speed verification using prepbufr data (I
derived WIND speed using UGRD and VGRD through PB2NC). I had no problem to
do ensemble_stat but I always get "0 matching pair" using "point_stat"
afterwards. There is no any ERROR/WARNING message in the log file. I also
did a test by only using "point_stat" (without ensemble_stat) and it
worked fine. So what is the problem then?
My overall log file is:
/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/grid2grid/verf_met_ens_g2o/ecf/test_bufr_pt.ecf.log
The "ensemble_stat" log and "point_stat" log files for a specific day are:
/gpfs/dell1/ptmp/Binyu.Wang/gens/tmpnwprd/verf_g2o_gefs_00_dev.10333/run_es.log.12.24
/gpfs/dell1/ptmp/Binyu.Wang/gens/tmpnwprd/verf_g2o_gefs_00_dev.10333/run_ps.log.12.24
The config files for "ensemble_stat" log and "point_stat" for that day are:
/gpfs/dell1/ptmp/Binyu.Wang/gens/tmpnwprd/verf_g2o_gefs_00_dev.10333/verf_g2o_ens_gens_config.bufr
/gpfs/dell1/ptmp/Binyu.Wang/gens/tmpnwprd/verf_g2o_gefs_00_dev.10333/verf_g2o_point_stat_gens_config.bufr_pt
Thank you
Binyu
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: point_stat after ensemble_stat
From: John Halley Gotway
Time: Fri Oct 23 10:59:49 2020
Binyu,
Whenever you get 0 matched pairs from Point-Stat, it's always a good
idea
to rerun Point-Stat at verbosity level 3 or higher (-v 3). Then look
carefully at the log messages for a list of reason codes explaining
why
each observation was or was not used in each verification task. Below,
I've
listed an example of the type of log messages you should look for.
Please give that a shot and let me know if you have any questions
interpreting those log messages.
Thanks,
John
DEBUG 2: Processing TMP/P900-750 versus TMP/P900-750, for observation
type
ADPUPA, over region DTC165, for interpolation method NEAREST(1), using
132
matched pairs.
DEBUG 3: Number of matched pairs = 132
DEBUG 3: Observations processed = 89893
DEBUG 3: Rejected: station id = 0
DEBUG 3: Rejected: obs type = 79788
DEBUG 3: Rejected: valid time = 0
DEBUG 3: Rejected: bad obs value = 0
DEBUG 3: Rejected: off the grid = 5
DEBUG 3: Rejected: topography = 0
DEBUG 3: Rejected: level mismatch = 9219
DEBUG 3: Rejected: quality marker = 0
DEBUG 3: Rejected: message type = 344
DEBUG 3: Rejected: masking region = 405
DEBUG 3: Rejected: bad fcst value = 0
DEBUG 3: Rejected: bad climo mean = 0
DEBUG 3: Rejected: bad climo stdev = 0
DEBUG 3: Rejected: duplicates = 0
On Wed, Oct 21, 2020 at 2:15 PM binyu.wang at noaa.gov via RT <
met_help at ucar.edu> wrote:
>
> Wed Oct 21 14:15:36 2020: Request 97173 was acted upon.
> Transaction: Ticket created by binyu.wang at noaa.gov
> Queue: met_help
> Subject: point_stat after ensemble_stat
> Owner: Nobody
> Requestors: binyu.wang at noaa.gov
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97173 >
>
>
> Hello,
>
> I was trying to do GEFS WIND speed verification using prepbufr data
(I
> derived WIND speed using UGRD and VGRD through PB2NC). I had no
problem to
> do ensemble_stat but I always get "0 matching pair" using
"point_stat"
> afterwards. There is no any ERROR/WARNING message in the log file. I
also
> did a test by only using "point_stat" (without ensemble_stat) and
it
> worked fine. So what is the problem then?
>
> My overall log file is:
>
>
/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/grid2grid/verf_met_ens_g2o/ecf/test_bufr_pt.ecf.log
>
> The "ensemble_stat" log and "point_stat" log files for a specific
day are:
>
>
/gpfs/dell1/ptmp/Binyu.Wang/gens/tmpnwprd/verf_g2o_gefs_00_dev.10333/run_es.log.12.24
>
>
/gpfs/dell1/ptmp/Binyu.Wang/gens/tmpnwprd/verf_g2o_gefs_00_dev.10333/run_ps.log.12.24
>
> The config files for "ensemble_stat" log and "point_stat" for that
day
> are:
>
>
/gpfs/dell1/ptmp/Binyu.Wang/gens/tmpnwprd/verf_g2o_gefs_00_dev.10333/verf_g2o_ens_gens_config.bufr
>
>
/gpfs/dell1/ptmp/Binyu.Wang/gens/tmpnwprd/verf_g2o_gefs_00_dev.10333/verf_g2o_point_stat_gens_config.bufr_pt
>
> Thank you
> Binyu
>
>
------------------------------------------------
Subject: point_stat after ensemble_stat
From: binyu.wang at noaa.gov
Time: Fri Oct 23 11:48:26 2020
Hello John,
I did as you suggested, here is what I got. But I had no problem to do
ensemble_stat using the same inputs, (log from ensemble_stat DEBUG 2:
Processing point verification WIND/P250 versus WIND/P250, for
observation
type ADPUPA, over region FULL, for interpolation method NEAREST(1),
using
583 matched pairs.). So I am sure there should have some matching
pairs
extracted log from point_stat:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Processing WIND_P250_ENS_FREQ_le1(*,*) versus WIND/P250, for
observation type ADPUMA, over region FULL, for interpolation method
UW_MEAN_SQUARE(25), using 0 matched pairs.
DEBUG 3: Number of matched pairs = 0
DEBUG 3: Observations processed = 216308
DEBUG 3: Rejected: station id = 0
DEBUG 3: Rejected: obs type = 182749
DEBUG 3: Rejected: valid time = 0
DEBUG 3: Rejected: bad obs value = 0
DEBUG 3: Rejected: off the grid = 0
DEBUG 3: Rejected: topography = 0
DEBUG 3: Rejected: level mismatch = 32976
DEBUG 3: Rejected: quality marker = 0
DEBUG 3: Rejected: message type = 583
DEBUG 3: Rejected: masking region = 0
DEBUG 3: Rejected: bad fcst value = 0
DEBUG 3: Rejected: bad climo mean = 0
DEBUG 3: Rejected: bad climo stdev = 0
DEBUG 3: Rejected: duplicates = 0
On Fri, Oct 23, 2020 at 1:05 PM John Halley Gotway via RT
<met_help at ucar.edu>
wrote:
> Binyu,
>
> Whenever you get 0 matched pairs from Point-Stat, it's always a good
idea
> to rerun Point-Stat at verbosity level 3 or higher (-v 3). Then look
> carefully at the log messages for a list of reason codes explaining
why
> each observation was or was not used in each verification task.
Below, I've
> listed an example of the type of log messages you should look for.
>
> Please give that a shot and let me know if you have any questions
> interpreting those log messages.
>
> Thanks,
> John
>
> DEBUG 2: Processing TMP/P900-750 versus TMP/P900-750, for
observation type
> ADPUPA, over region DTC165, for interpolation method NEAREST(1),
using 132
> matched pairs.
> DEBUG 3: Number of matched pairs = 132
> DEBUG 3: Observations processed = 89893
> DEBUG 3: Rejected: station id = 0
> DEBUG 3: Rejected: obs type = 79788
> DEBUG 3: Rejected: valid time = 0
> DEBUG 3: Rejected: bad obs value = 0
> DEBUG 3: Rejected: off the grid = 5
> DEBUG 3: Rejected: topography = 0
> DEBUG 3: Rejected: level mismatch = 9219
> DEBUG 3: Rejected: quality marker = 0
> DEBUG 3: Rejected: message type = 344
> DEBUG 3: Rejected: masking region = 405
> DEBUG 3: Rejected: bad fcst value = 0
> DEBUG 3: Rejected: bad climo mean = 0
> DEBUG 3: Rejected: bad climo stdev = 0
> DEBUG 3: Rejected: duplicates = 0
>
>
> On Wed, Oct 21, 2020 at 2:15 PM binyu.wang at noaa.gov via RT <
> met_help at ucar.edu> wrote:
>
> >
> > Wed Oct 21 14:15:36 2020: Request 97173 was acted upon.
> > Transaction: Ticket created by binyu.wang at noaa.gov
> > Queue: met_help
> > Subject: point_stat after ensemble_stat
> > Owner: Nobody
> > Requestors: binyu.wang at noaa.gov
> > Status: new
> > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97173 >
> >
> >
> > Hello,
> >
> > I was trying to do GEFS WIND speed verification using prepbufr
data (I
> > derived WIND speed using UGRD and VGRD through PB2NC). I had no
problem
> to
> > do ensemble_stat but I always get "0 matching pair" using
"point_stat"
> > afterwards. There is no any ERROR/WARNING message in the log file.
I also
> > did a test by only using "point_stat" (without ensemble_stat) and
it
> > worked fine. So what is the problem then?
> >
> > My overall log file is:
> >
> >
>
/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/grid2grid/verf_met_ens_g2o/ecf/test_bufr_pt.ecf.log
> >
> > The "ensemble_stat" log and "point_stat" log files for a specific
day
> are:
> >
> >
>
/gpfs/dell1/ptmp/Binyu.Wang/gens/tmpnwprd/verf_g2o_gefs_00_dev.10333/run_es.log.12.24
> >
> >
>
/gpfs/dell1/ptmp/Binyu.Wang/gens/tmpnwprd/verf_g2o_gefs_00_dev.10333/run_ps.log.12.24
> >
> > The config files for "ensemble_stat" log and "point_stat" for
that day
> > are:
> >
> >
>
/gpfs/dell1/ptmp/Binyu.Wang/gens/tmpnwprd/verf_g2o_gefs_00_dev.10333/verf_g2o_ens_gens_config.bufr
> >
> >
>
/gpfs/dell1/ptmp/Binyu.Wang/gens/tmpnwprd/verf_g2o_gefs_00_dev.10333/verf_g2o_point_stat_gens_config.bufr_pt
> >
> > Thank you
> > Binyu
> >
> >
>
>
------------------------------------------------
Subject: point_stat after ensemble_stat
From: binyu.wang at noaa.gov
Time: Fri Oct 23 12:02:15 2020
Ok, after following your suggestion, I noticed there is an ERROR with
"message type" in my setup. Thank you so much for help!
But I did get another question for you: I tried to make a
performance diagram with POD vs (1-FAR), but I got an empty plot. I
compared the option (on METViewer) with a successful plot from others
and I
did notice that using my input, FCST_LEAD is empty (see the
attachment) ,
but others do have option for FCST_LEAD.
Here is the grid_stat config file that I used to create CSI, I could
create
the time series plot for CSI, but I can not make the performance
diagra, I
guess I miss something in the config file?
/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/grid2grid/verf_met_ens/parm/verf_g2g_grid_stat_config_Raikoke_csi
Thank you.
BInyu
------------------------------------------------
Subject: point_stat after ensemble_stat
From: John Halley Gotway
Time: Fri Oct 23 12:37:21 2020
Binyu,
It looks like you have a typo in your Point-Stat config file. Look
closely
at this log message you just sent me:
*DEBUG 2: Processing WIND_P250_ENS_FREQ_le1(*,*) versus WIND/P250,
for observation type ADPUMA, over region FULL, for interpolation
method\\*
That "ADPUMA" should really be "ADPUPA".
John
------------------------------------------------
Subject: point_stat after ensemble_stat
From: binyu.wang at noaa.gov
Time: Fri Oct 23 14:13:34 2020
Yes you are right. Thank you for quickly fixing my question. It worked
after I made the change. How to get the performance diagram? Why
don't I
have the option of "FCST_LEAD" and "FCST_INIT_BEG" in the METviewer to
make
that plot as attached in my previous mail?
Binyu
On Fri, Oct 23, 2020 at 2:37 PM John Halley Gotway via RT
<met_help at ucar.edu>
wrote:
> Binyu,
>
> It looks like you have a typo in your Point-Stat config file. Look
closely
> at this log message you just sent me:
>
> *DEBUG 2: Processing WIND_P250_ENS_FREQ_le1(*,*) versus WIND/P250,
> for observation type ADPUMA, over region FULL, for interpolation
method\\*
>
> That "ADPUMA" should really be "ADPUPA".
>
> John
>
>
------------------------------------------------
Subject: point_stat after ensemble_stat
From: John Halley Gotway
Time: Mon Oct 26 09:36:34 2020
Binyu,
I'm going to assign this issue to Tatiana Burek to look more into it.
I went to https://metviewer.nws.noaa.gov/metviewer1.jsp and loaded
database
"NCEP Bwang -> mv_g2g_met_verf_Raikoke31_0p25_CSI".
Doing some testing using the "Series" plot template, I suspect that
this
database ONLY contains the NBRCTS line type. Those are the
neighborhood
contingency table statistics.
Looking at the METviewer "Perf" plot template, it appears that it can
be
created from the contingency table counts in the CTC or the NBRCTC
line
types.
Tatiana, take a look at the attached screenshot and notice that the
FCST_LEAD list is NA. But when I create a "Series" plot of the
NBR_BASER
statistic, the lead list is NOT empty. So the question is...
How does the "Independent Variables: FCST_LEAD" list of values get
populated? Do it only query the lead times for the CTC/CTS line types?
Or
are the NBRCTC/NBRCTS line types included?
If this database only contains NBRCTS stats, will METviewer know how
to
create a performance diagram? Or for neighborhood stats, does is need
to
aggreate NBRCTC counts?
Thanks,
John
On Fri, Oct 23, 2020 at 2:14 PM binyu.wang at noaa.gov via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97173 >
>
> Yes you are right. Thank you for quickly fixing my question. It
worked
> after I made the change. How to get the performance diagram? Why
don't I
> have the option of "FCST_LEAD" and "FCST_INIT_BEG" in the METviewer
to make
> that plot as attached in my previous mail?
>
> Binyu
>
> On Fri, Oct 23, 2020 at 2:37 PM John Halley Gotway via RT <
> met_help at ucar.edu>
> wrote:
>
> > Binyu,
> >
> > It looks like you have a typo in your Point-Stat config file. Look
> closely
> > at this log message you just sent me:
> >
> > *DEBUG 2: Processing WIND_P250_ENS_FREQ_le1(*,*) versus WIND/P250,
> > for observation type ADPUMA, over region FULL, for interpolation
> method\\*
> >
> > That "ADPUMA" should really be "ADPUPA".
> >
> > John
> >
> >
>
>
------------------------------------------------
Subject: point_stat after ensemble_stat
From: John Halley Gotway
Time: Mon Oct 26 09:40:30 2020
Sorry, forgot the screenshot.
[image: Screen Shot 2020-10-26 at 9.31.17 AM.png]
John
On Mon, Oct 26, 2020 at 9:36 AM John Halley Gotway <johnhg at ucar.edu>
wrote:
> Binyu,
>
> I'm going to assign this issue to Tatiana Burek to look more into
it.
>
> I went to https://metviewer.nws.noaa.gov/metviewer1.jsp and loaded
> database "NCEP Bwang -> mv_g2g_met_verf_Raikoke31_0p25_CSI".
>
> Doing some testing using the "Series" plot template, I suspect that
this
> database ONLY contains the NBRCTS line type. Those are the
neighborhood
> contingency table statistics.
>
> Looking at the METviewer "Perf" plot template, it appears that it
can be
> created from the contingency table counts in the CTC or the NBRCTC
line
> types.
>
> Tatiana, take a look at the attached screenshot and notice that the
> FCST_LEAD list is NA. But when I create a "Series" plot of the
NBR_BASER
> statistic, the lead list is NOT empty. So the question is...
>
> How does the "Independent Variables: FCST_LEAD" list of values get
> populated? Do it only query the lead times for the CTC/CTS line
types? Or
> are the NBRCTC/NBRCTS line types included?
>
> If this database only contains NBRCTS stats, will METviewer know how
to
> create a performance diagram? Or for neighborhood stats, does is
need to
> aggreate NBRCTC counts?
>
> Thanks,
> John
>
> On Fri, Oct 23, 2020 at 2:14 PM binyu.wang at noaa.gov via RT <
> met_help at ucar.edu> wrote:
>
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97173 >
>>
>> Yes you are right. Thank you for quickly fixing my question. It
worked
>> after I made the change. How to get the performance diagram? Why
don't I
>> have the option of "FCST_LEAD" and "FCST_INIT_BEG" in the METviewer
to
>> make
>> that plot as attached in my previous mail?
>>
>> Binyu
>>
>> On Fri, Oct 23, 2020 at 2:37 PM John Halley Gotway via RT <
>> met_help at ucar.edu>
>> wrote:
>>
>> > Binyu,
>> >
>> > It looks like you have a typo in your Point-Stat config file.
Look
>> closely
>> > at this log message you just sent me:
>> >
>> > *DEBUG 2: Processing WIND_P250_ENS_FREQ_le1(*,*) versus
WIND/P250,
>> > for observation type ADPUMA, over region FULL, for interpolation
>> method\\*
>> >
>> > That "ADPUMA" should really be "ADPUPA".
>> >
>> > John
>> >
>> >
>>
>>
------------------------------------------------
Subject: point_stat after ensemble_stat
From: Tatiana Burek
Time: Mon Oct 26 13:18:40 2020
For the Performance diagram METviewer looks in line_data_ctc and
line_data_cts tables for the metadata values. I agree that we need to
add line_data_nbrctc table to this list. I created a GitHub issue:
https://github.com/dtcenter/METviewer/issues/212
Tatiana
On Mon Oct 26 09:36:34 2020, johnhg wrote:
> Binyu,
>
> I'm going to assign this issue to Tatiana Burek to look more into
it.
>
> I went to https://metviewer.nws.noaa.gov/metviewer1.jsp and loaded
> database
> "NCEP Bwang -> mv_g2g_met_verf_Raikoke31_0p25_CSI".
>
> Doing some testing using the "Series" plot template, I suspect that
> this
> database ONLY contains the NBRCTS line type. Those are the
> neighborhood
> contingency table statistics.
>
> Looking at the METviewer "Perf" plot template, it appears that it
can
> be
> created from the contingency table counts in the CTC or the NBRCTC
> line
> types.
>
> Tatiana, take a look at the attached screenshot and notice that the
> FCST_LEAD list is NA. But when I create a "Series" plot of the
> NBR_BASER
> statistic, the lead list is NOT empty. So the question is...
>
> How does the "Independent Variables: FCST_LEAD" list of values get
> populated? Do it only query the lead times for the CTC/CTS line
types?
> Or
> are the NBRCTC/NBRCTS line types included?
>
> If this database only contains NBRCTS stats, will METviewer know how
> to
> create a performance diagram? Or for neighborhood stats, does is
need
> to
> aggreate NBRCTC counts?
>
> Thanks,
> John
>
> On Fri, Oct 23, 2020 at 2:14 PM binyu.wang at noaa.gov via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97173 >
> >
> > Yes you are right. Thank you for quickly fixing my question. It
> > worked
> > after I made the change. How to get the performance diagram? Why
> > don't I
> > have the option of "FCST_LEAD" and "FCST_INIT_BEG" in the
METviewer
> > to make
> > that plot as attached in my previous mail?
> >
> > Binyu
> >
> > On Fri, Oct 23, 2020 at 2:37 PM John Halley Gotway via RT <
> > met_help at ucar.edu>
> > wrote:
> >
> > > Binyu,
> > >
> > > It looks like you have a typo in your Point-Stat config file.
Look
> > closely
> > > at this log message you just sent me:
> > >
> > > *DEBUG 2: Processing WIND_P250_ENS_FREQ_le1(*,*) versus
WIND/P250,
> > > for observation type ADPUMA, over region FULL, for interpolation
> > method\\*
> > >
> > > That "ADPUMA" should really be "ADPUPA".
> > >
> > > John
> > >
> > >
> >
> >
------------------------------------------------
Subject: point_stat after ensemble_stat
From: binyu.wang at noaa.gov
Time: Mon Oct 26 20:40:09 2020
Thank you, Tatana. So currently I can not make "performance dia" using
"NBRCTC"?
Binyu
On Mon, Oct 26, 2020 at 3:18 PM Tatiana Burek via RT
<met_help at ucar.edu>
wrote:
> For the Performance diagram METviewer looks in line_data_ctc and
> line_data_cts tables for the metadata values. I agree that we need
to add
> line_data_nbrctc table to this list. I created a GitHub issue:
> https://github.com/dtcenter/METviewer/issues/212
>
> Tatiana
>
> On Mon Oct 26 09:36:34 2020, johnhg wrote:
> > Binyu,
> >
> > I'm going to assign this issue to Tatiana Burek to look more into
it.
> >
> > I went to https://metviewer.nws.noaa.gov/metviewer1.jsp and loaded
> > database
> > "NCEP Bwang -> mv_g2g_met_verf_Raikoke31_0p25_CSI".
> >
> > Doing some testing using the "Series" plot template, I suspect
that
> > this
> > database ONLY contains the NBRCTS line type. Those are the
> > neighborhood
> > contingency table statistics.
> >
> > Looking at the METviewer "Perf" plot template, it appears that it
can
> > be
> > created from the contingency table counts in the CTC or the NBRCTC
> > line
> > types.
> >
> > Tatiana, take a look at the attached screenshot and notice that
the
> > FCST_LEAD list is NA. But when I create a "Series" plot of the
> > NBR_BASER
> > statistic, the lead list is NOT empty. So the question is...
> >
> > How does the "Independent Variables: FCST_LEAD" list of values get
> > populated? Do it only query the lead times for the CTC/CTS line
types?
> > Or
> > are the NBRCTC/NBRCTS line types included?
> >
> > If this database only contains NBRCTS stats, will METviewer know
how
> > to
> > create a performance diagram? Or for neighborhood stats, does is
need
> > to
> > aggreate NBRCTC counts?
> >
> > Thanks,
> > John
> >
> > On Fri, Oct 23, 2020 at 2:14 PM binyu.wang at noaa.gov via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97173 >
> > >
> > > Yes you are right. Thank you for quickly fixing my question. It
> > > worked
> > > after I made the change. How to get the performance diagram?
Why
> > > don't I
> > > have the option of "FCST_LEAD" and "FCST_INIT_BEG" in the
METviewer
> > > to make
> > > that plot as attached in my previous mail?
> > >
> > > Binyu
> > >
> > > On Fri, Oct 23, 2020 at 2:37 PM John Halley Gotway via RT <
> > > met_help at ucar.edu>
> > > wrote:
> > >
> > > > Binyu,
> > > >
> > > > It looks like you have a typo in your Point-Stat config file.
Look
> > > closely
> > > > at this log message you just sent me:
> > > >
> > > > *DEBUG 2: Processing WIND_P250_ENS_FREQ_le1(*,*) versus
WIND/P250,
> > > > for observation type ADPUMA, over region FULL, for
interpolation
> > > method\\*
> > > >
> > > > That "ADPUMA" should really be "ADPUPA".
> > > >
> > > > John
> > > >
> > > >
> > >
> > >
>
>
>
>
------------------------------------------------
Subject: point_stat after ensemble_stat
From: Tatiana Burek
Time: Tue Oct 27 08:03:22 2020
Binyu,
We will add a fix for the Performance diagram to the beta2 release
that will be available in the beginning of December on METviewer dev
instance:
https://metviewer.nws.noaa.gov/metviewer_dev/
Until then you can't use"NBRCTC"
Tatiana
On Mon Oct 26 20:40:09 2020, binyu.wang at noaa.gov wrote:
> Thank you, Tatana. So currently I can not make "performance dia"
using
> "NBRCTC"?
>
> Binyu
>
> On Mon, Oct 26, 2020 at 3:18 PM Tatiana Burek via RT
<met_help at ucar.edu>
> wrote:
>
> > For the Performance diagram METviewer looks in line_data_ctc and
> > line_data_cts tables for the metadata values. I agree that we need
to add
> > line_data_nbrctc table to this list. I created a GitHub issue:
> > https://github.com/dtcenter/METviewer/issues/212
> >
> > Tatiana
> >
> > On Mon Oct 26 09:36:34 2020, johnhg wrote:
> > > Binyu,
> > >
> > > I'm going to assign this issue to Tatiana Burek to look more
into it.
> > >
> > > I went to https://metviewer.nws.noaa.gov/metviewer1.jsp and
loaded
> > > database
> > > "NCEP Bwang -> mv_g2g_met_verf_Raikoke31_0p25_CSI".
> > >
> > > Doing some testing using the "Series" plot template, I suspect
that
> > > this
> > > database ONLY contains the NBRCTS line type. Those are the
> > > neighborhood
> > > contingency table statistics.
> > >
> > > Looking at the METviewer "Perf" plot template, it appears that
it can
> > > be
> > > created from the contingency table counts in the CTC or the
NBRCTC
> > > line
> > > types.
> > >
> > > Tatiana, take a look at the attached screenshot and notice that
the
> > > FCST_LEAD list is NA. But when I create a "Series" plot of the
> > > NBR_BASER
> > > statistic, the lead list is NOT empty. So the question is...
> > >
> > > How does the "Independent Variables: FCST_LEAD" list of values
get
> > > populated? Do it only query the lead times for the CTC/CTS line
types?
> > > Or
> > > are the NBRCTC/NBRCTS line types included?
> > >
> > > If this database only contains NBRCTS stats, will METviewer know
how
> > > to
> > > create a performance diagram? Or for neighborhood stats, does is
need
> > > to
> > > aggreate NBRCTC counts?
> > >
> > > Thanks,
> > > John
> > >
> > > On Fri, Oct 23, 2020 at 2:14 PM binyu.wang at noaa.gov via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97173
>
> > > >
> > > > Yes you are right. Thank you for quickly fixing my question.
It
> > > > worked
> > > > after I made the change. How to get the performance diagram?
Why
> > > > don't I
> > > > have the option of "FCST_LEAD" and "FCST_INIT_BEG" in the
METviewer
> > > > to make
> > > > that plot as attached in my previous mail?
> > > >
> > > > Binyu
> > > >
> > > > On Fri, Oct 23, 2020 at 2:37 PM John Halley Gotway via RT <
> > > > met_help at ucar.edu>
> > > > wrote:
> > > >
> > > > > Binyu,
> > > > >
> > > > > It looks like you have a typo in your Point-Stat config
file. Look
> > > > closely
> > > > > at this log message you just sent me:
> > > > >
> > > > > *DEBUG 2: Processing WIND_P250_ENS_FREQ_le1(*,*) versus
WIND/P250,
> > > > > for observation type ADPUMA, over region FULL, for
interpolation
> > > > method\\*
> > > > >
> > > > > That "ADPUMA" should really be "ADPUPA".
> > > > >
> > > > > John
> > > > >
> > > > >
> > > >
> > > >
> >
> >
> >
> >
------------------------------------------------
Subject: point_stat after ensemble_stat
From: binyu.wang at noaa.gov
Time: Tue Oct 27 08:37:55 2020
Got it. Thank you.
Binyu
On Tue, Oct 27, 2020 at 10:03 AM Tatiana Burek via RT
<met_help at ucar.edu>
wrote:
> Binyu,
>
> We will add a fix for the Performance diagram to the beta2 release
that
> will be available in the beginning of December on METviewer dev
instance:
> https://metviewer.nws.noaa.gov/metviewer_dev/
> Until then you can't use"NBRCTC"
>
> Tatiana
>
> On Mon Oct 26 20:40:09 2020, binyu.wang at noaa.gov wrote:
> > Thank you, Tatana. So currently I can not make "performance dia"
using
> > "NBRCTC"?
> >
> > Binyu
> >
>
> > On Mon, Oct 26, 2020 at 3:18 PM Tatiana Burek via RT
<met_help at ucar.edu>
> > wrote:
> >
> > > For the Performance diagram METviewer looks in line_data_ctc and
> > > line_data_cts tables for the metadata values. I agree that we
need to
> add
> > > line_data_nbrctc table to this list. I created a GitHub issue:
> > > https://github.com/dtcenter/METviewer/issues/212
> > >
> > > Tatiana
> > >
> > > On Mon Oct 26 09:36:34 2020, johnhg wrote:
> > > > Binyu,
> > > >
> > > > I'm going to assign this issue to Tatiana Burek to look more
into it.
> > > >
> > > > I went to https://metviewer.nws.noaa.gov/metviewer1.jsp and
loaded
> > > > database
> > > > "NCEP Bwang -> mv_g2g_met_verf_Raikoke31_0p25_CSI".
> > > >
> > > > Doing some testing using the "Series" plot template, I suspect
that
> > > > this
> > > > database ONLY contains the NBRCTS line type. Those are the
> > > > neighborhood
> > > > contingency table statistics.
> > > >
> > > > Looking at the METviewer "Perf" plot template, it appears that
it can
> > > > be
> > > > created from the contingency table counts in the CTC or the
NBRCTC
> > > > line
> > > > types.
> > > >
> > > > Tatiana, take a look at the attached screenshot and notice
that the
> > > > FCST_LEAD list is NA. But when I create a "Series" plot of the
> > > > NBR_BASER
> > > > statistic, the lead list is NOT empty. So the question is...
> > > >
> > > > How does the "Independent Variables: FCST_LEAD" list of values
get
> > > > populated? Do it only query the lead times for the CTC/CTS
line
> types?
> > > > Or
> > > > are the NBRCTC/NBRCTS line types included?
> > > >
> > > > If this database only contains NBRCTS stats, will METviewer
know how
> > > > to
> > > > create a performance diagram? Or for neighborhood stats, does
is need
> > > > to
> > > > aggreate NBRCTC counts?
> > > >
> > > > Thanks,
> > > > John
> > > >
> > > > On Fri, Oct 23, 2020 at 2:14 PM binyu.wang at noaa.gov via RT <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > > >
> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97173 >
> > > > >
> > > > > Yes you are right. Thank you for quickly fixing my question.
It
> > > > > worked
> > > > > after I made the change. How to get the performance
diagram? Why
> > > > > don't I
> > > > > have the option of "FCST_LEAD" and "FCST_INIT_BEG" in the
METviewer
> > > > > to make
> > > > > that plot as attached in my previous mail?
> > > > >
> > > > > Binyu
> > > > >
> > > > > On Fri, Oct 23, 2020 at 2:37 PM John Halley Gotway via RT <
> > > > > met_help at ucar.edu>
> > > > > wrote:
> > > > >
> > > > > > Binyu,
> > > > > >
> > > > > > It looks like you have a typo in your Point-Stat config
file.
> Look
> > > > > closely
> > > > > > at this log message you just sent me:
> > > > > >
> > > > > > *DEBUG 2: Processing WIND_P250_ENS_FREQ_le1(*,*) versus
> WIND/P250,
> > > > > > for observation type ADPUMA, over region FULL, for
interpolation
> > > > > method\\*
> > > > > >
> > > > > > That "ADPUMA" should really be "ADPUPA".
> > > > > >
> > > > > > John
> > > > > >
> > > > > >
> > > > >
> > > > >
> > >
> > >
> > >
> > >
>
>
>
>
------------------------------------------------
More information about the Met_help
mailing list