[Met_help] [rt.rap.ucar.edu #95068] History for Stat Analysis PSTD File From MPR Bad Value Error

John Halley Gotway via RT met_help at ucar.edu
Fri May 1 12:03:37 MDT 2020 

----------------------------------------------------------------
  Initial Request
----------------------------------------------------------------

/gpfs/dell3/mdl/mdlverif/noscrub/usr/Brooke.Karlee.Adams/qpfvs/processing$ stat_analysis -lookin  /gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/01/00/po/point_stat_480000L_20191101_000000V_mpr.txt /gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/02/00/po/point_stat_480000L_20191102_000000V_mpr.txt /gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/03/00/po/point_stat_480000L_20191103_000000V_mpr.txt /gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/04/00/po/point_stat_480000L_20191104_000000V_mpr.txt /gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/05/00/po/point_stat_480000L_20191105_000000V_mpr.txt /gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/06/00/po/point_stat_480000L_20191106_000000V_mpr.txt /gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/07/00/po/point_stat_480000L_20191107_000000V_mpr.txt /g!
 pfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/08/00/po/point_stat_480000L_20191108_000000V_mpr.txt /gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/09/00/po/point_stat_480000L_20191109_000000V_mpr.txt /gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/10/00/po/point_stat_480000L_20191110_000000V_mpr.txt /gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/11/00/po/point_stat_480000L_20191111_000000V_mpr.txt /gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/12/00/po/point_stat_480000L_20191112_000000V_mpr.txt /gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/13/00/po/point_stat_480000L_20191113_000000V_mpr.txt /gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/14/00/po/point_stat_480000L_20191114_000000V_mpr.txt /gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/15/00/po/point_stat_480000L!
 _20191115_000000V_mpr.txt /gpfs/dell2/mdl/mdlens/noscrub/John.!
 L.Wagner/mdl.verif/blend/co/ptst/1911/16/00/po/point_stat_480000L_20191116_000000V_mpr.txt /gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/17/00/po/point_stat_480000L_20191117_000000V_mpr.txt /gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/18/00/po/point_stat_480000L_20191118_000000V_mpr.txt /gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/19/00/po/point_stat_480000L_20191119_000000V_mpr.txt /gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/20/00/po/point_stat_480000L_20191120_000000V_mpr.txt /gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/21/00/po/point_stat_480000L_20191121_000000V_mpr.txt /gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/22/00/po/point_stat_480000L_20191122_000000V_mpr.txt /gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/23/00/po/point_stat_480000L_20191123_000000V_mpr.txt /gpfs/de!
 ll2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/24/00/po/point_stat_480000L_20191124_000000V_mpr.txt /gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/25/00/po/point_stat_480000L_20191125_000000V_mpr.txt /gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/26/00/po/point_stat_480000L_20191126_000000V_mpr.txt /gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/27/00/po/point_stat_480000L_20191127_000000V_mpr.txt /gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/28/00/po/point_stat_480000L_20191128_000000V_mpr.txt /gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/30/00/po/point_stat_480000L_20191130_000000V_mpr.txt -config /gpfs/dell3/mdl/mdlverif/noscrub/usr/Brooke.Karlee.Adams/qpfvs/met_util/stat_analysis_config_point_po -v 4 -vx_mask FULL -job aggregate_stat -line_type MPR -fcst_lead 480000 -fcst_valid_beg 20191101 -fcst_valid_end 20191130 -o!
 bs_valid_beg 20191101 -obs_valid_end 20191130 -out_line_type P!
 STD -out_!
 fcst_thresh ge0,ge0.1,ge0.2,ge0.3,ge0.4,ge0.5,ge0.6,ge0.7,ge0.8,ge0.9,ge1.0 -out_obs_thresh ge0 -out_stat /gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/stpt/1911/00/po/validtime_point_blend191100_48_po_mpr_to_TESTPSTD.stat -by FCST_VAR,OBS_SID -set_hdr VX_MASK OBS_SID -set_hdr DESC CASE

----------------------------------------------------------------
  Complete Ticket History
----------------------------------------------------------------

Subject: Stat Analysis PSTD File From MPR Bad Value Error
From: John Halley Gotway
Time: Mon Apr 27 16:23:57 2020

Hello Brooke,

I see that you're having trouble running Stat-Analysis.  Looks like
you're
reading many matched pair files (*_mpr.txt) and trying to run the
following
type of job on that data:
   -job aggregate_stat -line_type MPR -out_line_type PSTD

You're trying to compute PSTD statistics for each station id.  And
you're
getting this error message:
*ERROR: Nx2ContingencyTable::inc_event(double) -> bad value ... 12*

Here's what this error message means.  When MET evaluates probability
forecasts, it expects the probability values to be in the range of [0,
1].
If the max prob value is greater than 1.0, then it assumes the actual
range
is [0, 100] and automatically re-scales it to [0, 1] by dividing by
100.
This is done by the Point-Stat tool and the resulting matched pair
values
can be written to the MPR output line type.

You're running Stat-Analysis to re-process these matched pairs and
compute
probabilistic statistics.  MET is expecting all the probability values
to
be in the range [0, 1] but it encountered one outside that range...
namely
a value of 12.  And that results in the error you're seeing.

One reasonable explanation for this is that perhaps your MPR data
files
contain more than just probability data?  And you're just not
filtering out
the probability pairs, which is causing this issue.  In the command
you're
running, please try replacing "-by FCST_VAR" with "-fcst_var po".
Judging
by the config file you sent, it looks like perhaps the FCST_VAR column
=
"po" in the MPR data.  And if I'm wrong, just take a look at the
FCST_VAR
column for one of those files and use the forecast probability
variable
name you find there.

I did look at the Stat-Analysis config file you sent, and was confused
by
some of your settings.

If you continue to have issues, feel free to send me some sample data
along
with a description of what you want to accomplish with Stat-Analysis.
And
I could send you some suggestions.  Here's how you can post data to
our
anonymous ftp site:
https://dtcenter.org/community-code/model-evaluation-tools-met/met-
help-desk#ftp

Thanks,
John Halley Gotway

On Mon, Apr 27, 2020 at 2:43 PM Brooke Adams - NOAA Affiliate via RT <
met_help at ucar.edu> wrote:

>
> Mon Apr 27 14:43:35 2020: Request 95068 was acted upon.
> Transaction: Ticket created by brooke.karlee.adams at noaa.gov
>        Queue: met_help
>      Subject: Stat Analysis PSTD File From MPR Bad Value Error
>        Owner: Nobody
>   Requestors: brooke.karlee.adams at noaa.gov
>       Status: new
>  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95068 >
>
>
>
/gpfs/dell3/mdl/mdlverif/noscrub/usr/Brooke.Karlee.Adams/qpfvs/processing$
> stat_analysis -lookin
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/01/00/po/point_stat_480000L_20191101_000000V_mpr.txt
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/02/00/po/point_stat_480000L_20191102_000000V_mpr.txt
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/03/00/po/point_stat_480000L_20191103_000000V_mpr.txt
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/04/00/po/point_stat_480000L_20191104_000000V_mpr.txt
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/05/00/po/point_stat_480000L_20191105_000000V_mpr.txt
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/06/00/po/point_stat_480000L_20191106_000000V_mpr.txt
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/07/00/po/point_stat_480000L_20191107_000000V_mpr.txt
> /g!
>
pfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/08/00/po/point_stat_480000L_20191108_000000V_mpr.txt
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/09/00/po/point_stat_480000L_20191109_000000V_mpr.txt
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/10/00/po/point_stat_480000L_20191110_000000V_mpr.txt
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/11/00/po/point_stat_480000L_20191111_000000V_mpr.txt
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/12/00/po/point_stat_480000L_20191112_000000V_mpr.txt
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/13/00/po/point_stat_480000L_20191113_000000V_mpr.txt
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/14/00/po/point_stat_480000L_20191114_000000V_mpr.txt
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/15/00/po/point_stat_480000L!
>  _20191115_000000V_mpr.txt /gpfs/dell2/mdl/mdlens/noscrub/John.!
>
L.Wagner/mdl.verif/blend/co/ptst/1911/16/00/po/point_stat_480000L_20191116_000000V_mpr.txt
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/17/00/po/point_stat_480000L_20191117_000000V_mpr.txt
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/18/00/po/point_stat_480000L_20191118_000000V_mpr.txt
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/19/00/po/point_stat_480000L_20191119_000000V_mpr.txt
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/20/00/po/point_stat_480000L_20191120_000000V_mpr.txt
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/21/00/po/point_stat_480000L_20191121_000000V_mpr.txt
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/22/00/po/point_stat_480000L_20191122_000000V_mpr.txt
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/23/00/po/point_stat_480000L_20191123_000000V_mpr.txt
> /gpfs/de!
>
ll2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/24/00/po/point_stat_480000L_20191124_000000V_mpr.txt
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/25/00/po/point_stat_480000L_20191125_000000V_mpr.txt
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/26/00/po/point_stat_480000L_20191126_000000V_mpr.txt
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/27/00/po/point_stat_480000L_20191127_000000V_mpr.txt
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/28/00/po/point_stat_480000L_20191128_000000V_mpr.txt
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/30/00/po/point_stat_480000L_20191130_000000V_mpr.txt
> -config
>
/gpfs/dell3/mdl/mdlverif/noscrub/usr/Brooke.Karlee.Adams/qpfvs/met_util/stat_analysis_config_point_po
> -v 4 -vx_mask FULL -job aggregate_stat -line_type MPR -fcst_lead
480000
> -fcst_valid_beg 20191101 -fcst_valid_end 20191130 -o!
>  bs_valid_beg 20191101 -obs_valid_end 20191130 -out_line_type P!
>  STD -out_!
>  fcst_thresh
> ge0,ge0.1,ge0.2,ge0.3,ge0.4,ge0.5,ge0.6,ge0.7,ge0.8,ge0.9,ge1.0
> -out_obs_thresh ge0 -out_stat
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/stpt/1911/00/po/validtime_point_blend191100_48_po_mpr_to_TESTPSTD.stat
> -by FCST_VAR,OBS_SID -set_hdr VX_MASK OBS_SID -set_hdr DESC CASE
> Hi MET Help Team,
>
> I hope you are well.
>
> I am working on running stat analysis on matched pair files from
running
> point stat (analysis= QPF12 and Forecast= PoP12 data). My goal is to
get an
> overall brier score which I believe I can obtain from the PSTD file.
I am
> running into a "bad value error" before stat analysis is able to
finish
> running.
>
> Attached is a text file with the commands I am running via command
line, my
> config file, an example MPR file, and the error message I am
recieving.
>
> I get the same "bad value" error when I remove the config file
argument
> from my stat_analysis call.
>
> Any guidance you can provide would be greatly appreciated.
>
> I also added in the ASCII file and the assiociated output netCDF
from
> ASCII2NC that was used as the analysis file in point stat to
generate the
> MPR file. I noticed that the units on the obs are NA and I am not
sure why
> that is /  if it is contributing to the error.
>
> Thank you for any help you can provide.
>
> [image: METoutput_badvalueerror.PNG]
>
> Best,
> Brooke Adams
>
> Scientific Programmer, AceInfo Solutions
> Supporting Meteorological Development Laboratory
> Cell: (518)361-6900
> Brooke.Karlee.Adams at noaa.gov
> Hi MET Help Team,
>
> I hope you are well.
>
> I am working on running stat analysis on matched pair files from
running
> point stat (analysis= QPF12 and Forecast= PoP12 data). My goal is to
get an
> overall brier score which I believe I can obtain from the PSTD file.
I am
> running into a "bad value error" before stat analysis is able to
finish
> running.
>
> Attached is a text file with the commands I am running via command
line,
> my config file, an example MPR file, and the error message I am
recieving.
>
> I get the same "bad value" error when I remove the config file
argument
> from my stat_analysis call.
>
> Any guidance you can provide would be greatly appreciated.
>
> I also added in the ASCII file and the assiociated output netCDF
from
> ASCII2NC that was used as the analysis file in point stat to
generate the
> MPR file. I noticed that the units on the obs are NA and I am not
sure why
> that is /  if it is contributing to the error.
>
> Thank you for any help you can provide.
>
> [image: METoutput_badvalueerror.PNG]
>
> Best,
> Brooke Adams
>
> Scientific Programmer, AceInfo Solutions
> Supporting Meteorological Development Laboratory
> Cell: (518)361-6900
> Brooke.Karlee.Adams at noaa.gov
>

------------------------------------------------
Subject: Stat Analysis PSTD File From MPR Bad Value Error
From: Brooke Adams - NOAA Affiliate
Time: Fri May 01 11:53:55 2020

John,

Thank you very much for your helpful response. I was able to trace the
problem back to the MPR files not being reported in probabilities and
have
now successfully run.
I appreciate your help!

Thanks,
Brooke Adams

Scientific Programmer, AceInfo Solutions
Supporting Meteorological Development Laboratory
Cell: (518)361-6900
Brooke.Karlee.Adams at noaa.gov


On Mon, Apr 27, 2020 at 6:24 PM John Halley Gotway via RT
<met_help at ucar.edu>
wrote:

> Hello Brooke,
>
> I see that you're having trouble running Stat-Analysis.  Looks like
you're
> reading many matched pair files (*_mpr.txt) and trying to run the
following
> type of job on that data:
>    -job aggregate_stat -line_type MPR -out_line_type PSTD
>
> You're trying to compute PSTD statistics for each station id.  And
you're
> getting this error message:
> *ERROR: Nx2ContingencyTable::inc_event(double) -> bad value ... 12*
>
> Here's what this error message means.  When MET evaluates
probability
> forecasts, it expects the probability values to be in the range of
[0, 1].
> If the max prob value is greater than 1.0, then it assumes the
actual range
> is [0, 100] and automatically re-scales it to [0, 1] by dividing by
100.
> This is done by the Point-Stat tool and the resulting matched pair
values
> can be written to the MPR output line type.
>
> You're running Stat-Analysis to re-process these matched pairs and
compute
> probabilistic statistics.  MET is expecting all the probability
values to
> be in the range [0, 1] but it encountered one outside that range...
namely
> a value of 12.  And that results in the error you're seeing.
>
> One reasonable explanation for this is that perhaps your MPR data
files
> contain more than just probability data?  And you're just not
filtering out
> the probability pairs, which is causing this issue.  In the command
you're
> running, please try replacing "-by FCST_VAR" with "-fcst_var po".
Judging
> by the config file you sent, it looks like perhaps the FCST_VAR
column =
> "po" in the MPR data.  And if I'm wrong, just take a look at the
FCST_VAR
> column for one of those files and use the forecast probability
variable
> name you find there.
>
> I did look at the Stat-Analysis config file you sent, and was
confused by
> some of your settings.
>
> If you continue to have issues, feel free to send me some sample
data along
> with a description of what you want to accomplish with Stat-
Analysis.  And
> I could send you some suggestions.  Here's how you can post data to
our
> anonymous ftp site:
>
> https://dtcenter.org/community-code/model-evaluation-tools-met/met-
help-desk#ftp
>
> Thanks,
> John Halley Gotway
>
> On Mon, Apr 27, 2020 at 2:43 PM Brooke Adams - NOAA Affiliate via RT
<
> met_help at ucar.edu> wrote:
>
> >
> > Mon Apr 27 14:43:35 2020: Request 95068 was acted upon.
> > Transaction: Ticket created by brooke.karlee.adams at noaa.gov
> >        Queue: met_help
> >      Subject: Stat Analysis PSTD File From MPR Bad Value Error
> >        Owner: Nobody
> >   Requestors: brooke.karlee.adams at noaa.gov
> >       Status: new
> >  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95068 >
> >
> >
> >
>
/gpfs/dell3/mdl/mdlverif/noscrub/usr/Brooke.Karlee.Adams/qpfvs/processing$
> > stat_analysis -lookin
> >
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/01/00/po/point_stat_480000L_20191101_000000V_mpr.txt
> >
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/02/00/po/point_stat_480000L_20191102_000000V_mpr.txt
> >
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/03/00/po/point_stat_480000L_20191103_000000V_mpr.txt
> >
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/04/00/po/point_stat_480000L_20191104_000000V_mpr.txt
> >
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/05/00/po/point_stat_480000L_20191105_000000V_mpr.txt
> >
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/06/00/po/point_stat_480000L_20191106_000000V_mpr.txt
> >
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/07/00/po/point_stat_480000L_20191107_000000V_mpr.txt
> > /g!
> >
>
pfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/08/00/po/point_stat_480000L_20191108_000000V_mpr.txt
> >
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/09/00/po/point_stat_480000L_20191109_000000V_mpr.txt
> >
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/10/00/po/point_stat_480000L_20191110_000000V_mpr.txt
> >
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/11/00/po/point_stat_480000L_20191111_000000V_mpr.txt
> >
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/12/00/po/point_stat_480000L_20191112_000000V_mpr.txt
> >
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/13/00/po/point_stat_480000L_20191113_000000V_mpr.txt
> >
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/14/00/po/point_stat_480000L_20191114_000000V_mpr.txt
> >
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/15/00/po/point_stat_480000L!
> >  _20191115_000000V_mpr.txt /gpfs/dell2/mdl/mdlens/noscrub/John.!
> >
>
L.Wagner/mdl.verif/blend/co/ptst/1911/16/00/po/point_stat_480000L_20191116_000000V_mpr.txt
> >
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/17/00/po/point_stat_480000L_20191117_000000V_mpr.txt
> >
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/18/00/po/point_stat_480000L_20191118_000000V_mpr.txt
> >
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/19/00/po/point_stat_480000L_20191119_000000V_mpr.txt
> >
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/20/00/po/point_stat_480000L_20191120_000000V_mpr.txt
> >
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/21/00/po/point_stat_480000L_20191121_000000V_mpr.txt
> >
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/22/00/po/point_stat_480000L_20191122_000000V_mpr.txt
> >
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/23/00/po/point_stat_480000L_20191123_000000V_mpr.txt
> > /gpfs/de!
> >
>
ll2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/24/00/po/point_stat_480000L_20191124_000000V_mpr.txt
> >
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/25/00/po/point_stat_480000L_20191125_000000V_mpr.txt
> >
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/26/00/po/point_stat_480000L_20191126_000000V_mpr.txt
> >
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/27/00/po/point_stat_480000L_20191127_000000V_mpr.txt
> >
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/28/00/po/point_stat_480000L_20191128_000000V_mpr.txt
> >
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/30/00/po/point_stat_480000L_20191130_000000V_mpr.txt
> > -config
> >
>
/gpfs/dell3/mdl/mdlverif/noscrub/usr/Brooke.Karlee.Adams/qpfvs/met_util/stat_analysis_config_point_po
> > -v 4 -vx_mask FULL -job aggregate_stat -line_type MPR -fcst_lead
480000
> > -fcst_valid_beg 20191101 -fcst_valid_end 20191130 -o!
> >  bs_valid_beg 20191101 -obs_valid_end 20191130 -out_line_type P!
> >  STD -out_!
> >  fcst_thresh
> > ge0,ge0.1,ge0.2,ge0.3,ge0.4,ge0.5,ge0.6,ge0.7,ge0.8,ge0.9,ge1.0
> > -out_obs_thresh ge0 -out_stat
> >
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/stpt/1911/00/po/validtime_point_blend191100_48_po_mpr_to_TESTPSTD.stat
> > -by FCST_VAR,OBS_SID -set_hdr VX_MASK OBS_SID -set_hdr DESC CASE
> > Hi MET Help Team,
> >
> > I hope you are well.
> >
> > I am working on running stat analysis on matched pair files from
running
> > point stat (analysis= QPF12 and Forecast= PoP12 data). My goal is
to get
> an
> > overall brier score which I believe I can obtain from the PSTD
file. I am
> > running into a "bad value error" before stat analysis is able to
finish
> > running.
> >
> > Attached is a text file with the commands I am running via command
line,
> my
> > config file, an example MPR file, and the error message I am
recieving.
> >
> > I get the same "bad value" error when I remove the config file
argument
> > from my stat_analysis call.
> >
> > Any guidance you can provide would be greatly appreciated.
> >
> > I also added in the ASCII file and the assiociated output netCDF
from
> > ASCII2NC that was used as the analysis file in point stat to
generate the
> > MPR file. I noticed that the units on the obs are NA and I am not
sure
> why
> > that is /  if it is contributing to the error.
> >
> > Thank you for any help you can provide.
> >
> > [image: METoutput_badvalueerror.PNG]
> >
> > Best,
> > Brooke Adams
> >
> > Scientific Programmer, AceInfo Solutions
> > Supporting Meteorological Development Laboratory
> > Cell: (518)361-6900
> > Brooke.Karlee.Adams at noaa.gov
> > Hi MET Help Team,
> >
> > I hope you are well.
> >
> > I am working on running stat analysis on matched pair files from
running
> > point stat (analysis= QPF12 and Forecast= PoP12 data). My goal is
to get
> an
> > overall brier score which I believe I can obtain from the PSTD
file. I am
> > running into a "bad value error" before stat analysis is able to
finish
> > running.
> >
> > Attached is a text file with the commands I am running via command
line,
> > my config file, an example MPR file, and the error message I am
> recieving.
> >
> > I get the same "bad value" error when I remove the config file
argument
> > from my stat_analysis call.
> >
> > Any guidance you can provide would be greatly appreciated.
> >
> > I also added in the ASCII file and the assiociated output netCDF
from
> > ASCII2NC that was used as the analysis file in point stat to
generate the
> > MPR file. I noticed that the units on the obs are NA and I am not
sure
> why
> > that is /  if it is contributing to the error.
> >
> > Thank you for any help you can provide.
> >
> > [image: METoutput_badvalueerror.PNG]
> >
> > Best,
> > Brooke Adams
> >
> > Scientific Programmer, AceInfo Solutions
> > Supporting Meteorological Development Laboratory
> > Cell: (518)361-6900
> > Brooke.Karlee.Adams at noaa.gov
> >
>
>

------------------------------------------------
Subject: Stat Analysis PSTD File From MPR Bad Value Error
From: John Halley Gotway
Time: Fri May 01 12:03:33 2020

Great!  Thanks for confirming that you were able to fix the issue.

And have a nice weekend.

John

On Fri, May 1, 2020 at 11:54 AM Brooke Adams - NOAA Affiliate via RT <
met_help at ucar.edu> wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95068 >
>
> John,
>
> Thank you very much for your helpful response. I was able to trace
the
> problem back to the MPR files not being reported in probabilities
and have
> now successfully run.
> I appreciate your help!
>
> Thanks,
> Brooke Adams
>
> Scientific Programmer, AceInfo Solutions
> Supporting Meteorological Development Laboratory
> Cell: (518)361-6900
> Brooke.Karlee.Adams at noaa.gov
>
>
> On Mon, Apr 27, 2020 at 6:24 PM John Halley Gotway via RT <
> met_help at ucar.edu>
> wrote:
>
> > Hello Brooke,
> >
> > I see that you're having trouble running Stat-Analysis.  Looks
like
> you're
> > reading many matched pair files (*_mpr.txt) and trying to run the
> following
> > type of job on that data:
> >    -job aggregate_stat -line_type MPR -out_line_type PSTD
> >
> > You're trying to compute PSTD statistics for each station id.  And
you're
> > getting this error message:
> > *ERROR: Nx2ContingencyTable::inc_event(double) -> bad value ...
12*
> >
> > Here's what this error message means.  When MET evaluates
probability
> > forecasts, it expects the probability values to be in the range of
[0,
> 1].
> > If the max prob value is greater than 1.0, then it assumes the
actual
> range
> > is [0, 100] and automatically re-scales it to [0, 1] by dividing
by 100.
> > This is done by the Point-Stat tool and the resulting matched pair
values
> > can be written to the MPR output line type.
> >
> > You're running Stat-Analysis to re-process these matched pairs and
> compute
> > probabilistic statistics.  MET is expecting all the probability
values to
> > be in the range [0, 1] but it encountered one outside that
range...
> namely
> > a value of 12.  And that results in the error you're seeing.
> >
> > One reasonable explanation for this is that perhaps your MPR data
files
> > contain more than just probability data?  And you're just not
filtering
> out
> > the probability pairs, which is causing this issue.  In the
command
> you're
> > running, please try replacing "-by FCST_VAR" with "-fcst_var po".
> Judging
> > by the config file you sent, it looks like perhaps the FCST_VAR
column =
> > "po" in the MPR data.  And if I'm wrong, just take a look at the
FCST_VAR
> > column for one of those files and use the forecast probability
variable
> > name you find there.
> >
> > I did look at the Stat-Analysis config file you sent, and was
confused by
> > some of your settings.
> >
> > If you continue to have issues, feel free to send me some sample
data
> along
> > with a description of what you want to accomplish with Stat-
Analysis.
> And
> > I could send you some suggestions.  Here's how you can post data
to our
> > anonymous ftp site:
> >
> >
> https://dtcenter.org/community-code/model-evaluation-tools-met/met-
help-desk#ftp
> >
> > Thanks,
> > John Halley Gotway
> >
> > On Mon, Apr 27, 2020 at 2:43 PM Brooke Adams - NOAA Affiliate via
RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > Mon Apr 27 14:43:35 2020: Request 95068 was acted upon.
> > > Transaction: Ticket created by brooke.karlee.adams at noaa.gov
> > >        Queue: met_help
> > >      Subject: Stat Analysis PSTD File From MPR Bad Value Error
> > >        Owner: Nobody
> > >   Requestors: brooke.karlee.adams at noaa.gov
> > >       Status: new
> > >  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95068
> >
> > >
> > >
> > >
> >
>
/gpfs/dell3/mdl/mdlverif/noscrub/usr/Brooke.Karlee.Adams/qpfvs/processing$
> > > stat_analysis -lookin
> > >
> >
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/01/00/po/point_stat_480000L_20191101_000000V_mpr.txt
> > >
> >
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/02/00/po/point_stat_480000L_20191102_000000V_mpr.txt
> > >
> >
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/03/00/po/point_stat_480000L_20191103_000000V_mpr.txt
> > >
> >
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/04/00/po/point_stat_480000L_20191104_000000V_mpr.txt
> > >
> >
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/05/00/po/point_stat_480000L_20191105_000000V_mpr.txt
> > >
> >
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/06/00/po/point_stat_480000L_20191106_000000V_mpr.txt
> > >
> >
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/07/00/po/point_stat_480000L_20191107_000000V_mpr.txt
> > > /g!
> > >
> >
>
pfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/08/00/po/point_stat_480000L_20191108_000000V_mpr.txt
> > >
> >
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/09/00/po/point_stat_480000L_20191109_000000V_mpr.txt
> > >
> >
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/10/00/po/point_stat_480000L_20191110_000000V_mpr.txt
> > >
> >
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/11/00/po/point_stat_480000L_20191111_000000V_mpr.txt
> > >
> >
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/12/00/po/point_stat_480000L_20191112_000000V_mpr.txt
> > >
> >
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/13/00/po/point_stat_480000L_20191113_000000V_mpr.txt
> > >
> >
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/14/00/po/point_stat_480000L_20191114_000000V_mpr.txt
> > >
> >
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/15/00/po/point_stat_480000L!
> > >  _20191115_000000V_mpr.txt /gpfs/dell2/mdl/mdlens/noscrub/John.!
> > >
> >
>
L.Wagner/mdl.verif/blend/co/ptst/1911/16/00/po/point_stat_480000L_20191116_000000V_mpr.txt
> > >
> >
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/17/00/po/point_stat_480000L_20191117_000000V_mpr.txt
> > >
> >
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/18/00/po/point_stat_480000L_20191118_000000V_mpr.txt
> > >
> >
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/19/00/po/point_stat_480000L_20191119_000000V_mpr.txt
> > >
> >
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/20/00/po/point_stat_480000L_20191120_000000V_mpr.txt
> > >
> >
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/21/00/po/point_stat_480000L_20191121_000000V_mpr.txt
> > >
> >
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/22/00/po/point_stat_480000L_20191122_000000V_mpr.txt
> > >
> >
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/23/00/po/point_stat_480000L_20191123_000000V_mpr.txt
> > > /gpfs/de!
> > >
> >
>
ll2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/24/00/po/point_stat_480000L_20191124_000000V_mpr.txt
> > >
> >
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/25/00/po/point_stat_480000L_20191125_000000V_mpr.txt
> > >
> >
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/26/00/po/point_stat_480000L_20191126_000000V_mpr.txt
> > >
> >
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/27/00/po/point_stat_480000L_20191127_000000V_mpr.txt
> > >
> >
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/28/00/po/point_stat_480000L_20191128_000000V_mpr.txt
> > >
> >
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/ptst/1911/30/00/po/point_stat_480000L_20191130_000000V_mpr.txt
> > > -config
> > >
> >
>
/gpfs/dell3/mdl/mdlverif/noscrub/usr/Brooke.Karlee.Adams/qpfvs/met_util/stat_analysis_config_point_po
> > > -v 4 -vx_mask FULL -job aggregate_stat -line_type MPR -fcst_lead
480000
> > > -fcst_valid_beg 20191101 -fcst_valid_end 20191130 -o!
> > >  bs_valid_beg 20191101 -obs_valid_end 20191130 -out_line_type P!
> > >  STD -out_!
> > >  fcst_thresh
> > > ge0,ge0.1,ge0.2,ge0.3,ge0.4,ge0.5,ge0.6,ge0.7,ge0.8,ge0.9,ge1.0
> > > -out_obs_thresh ge0 -out_stat
> > >
> >
>
/gpfs/dell2/mdl/mdlens/noscrub/John.L.Wagner/mdl.verif/blend/co/stpt/1911/00/po/validtime_point_blend191100_48_po_mpr_to_TESTPSTD.stat
> > > -by FCST_VAR,OBS_SID -set_hdr VX_MASK OBS_SID -set_hdr DESC CASE
> > > Hi MET Help Team,
> > >
> > > I hope you are well.
> > >
> > > I am working on running stat analysis on matched pair files from
> running
> > > point stat (analysis= QPF12 and Forecast= PoP12 data). My goal
is to
> get
> > an
> > > overall brier score which I believe I can obtain from the PSTD
file. I
> am
> > > running into a "bad value error" before stat analysis is able to
finish
> > > running.
> > >
> > > Attached is a text file with the commands I am running via
command
> line,
> > my
> > > config file, an example MPR file, and the error message I am
recieving.
> > >
> > > I get the same "bad value" error when I remove the config file
argument
> > > from my stat_analysis call.
> > >
> > > Any guidance you can provide would be greatly appreciated.
> > >
> > > I also added in the ASCII file and the assiociated output netCDF
from
> > > ASCII2NC that was used as the analysis file in point stat to
generate
> the
> > > MPR file. I noticed that the units on the obs are NA and I am
not sure
> > why
> > > that is /  if it is contributing to the error.
> > >
> > > Thank you for any help you can provide.
> > >
> > > [image: METoutput_badvalueerror.PNG]
> > >
> > > Best,
> > > Brooke Adams
> > >
> > > Scientific Programmer, AceInfo Solutions
> > > Supporting Meteorological Development Laboratory
> > > Cell: (518)361-6900
> > > Brooke.Karlee.Adams at noaa.gov
> > > Hi MET Help Team,
> > >
> > > I hope you are well.
> > >
> > > I am working on running stat analysis on matched pair files from
> running
> > > point stat (analysis= QPF12 and Forecast= PoP12 data). My goal
is to
> get
> > an
> > > overall brier score which I believe I can obtain from the PSTD
file. I
> am
> > > running into a "bad value error" before stat analysis is able to
finish
> > > running.
> > >
> > > Attached is a text file with the commands I am running via
command
> line,
> > > my config file, an example MPR file, and the error message I am
> > recieving.
> > >
> > > I get the same "bad value" error when I remove the config file
argument
> > > from my stat_analysis call.
> > >
> > > Any guidance you can provide would be greatly appreciated.
> > >
> > > I also added in the ASCII file and the assiociated output netCDF
from
> > > ASCII2NC that was used as the analysis file in point stat to
generate
> the
> > > MPR file. I noticed that the units on the obs are NA and I am
not sure
> > why
> > > that is /  if it is contributing to the error.
> > >
> > > Thank you for any help you can provide.
> > >
> > > [image: METoutput_badvalueerror.PNG]
> > >
> > > Best,
> > > Brooke Adams
> > >
> > > Scientific Programmer, AceInfo Solutions
> > > Supporting Meteorological Development Laboratory
> > > Cell: (518)361-6900
> > > Brooke.Karlee.Adams at noaa.gov
> > >
> >
> >
>
>

------------------------------------------------

More information about the Met_help mailing list