[Met_help] [rt.rap.ucar.edu #89284] History for Fractions Skill Score Confidence Intervals

John Halley Gotway via RT met_help at ucar.edu
Tue Jul 9 12:06:54 MDT 2019


----------------------------------------------------------------
  Initial Request
----------------------------------------------------------------

John, when I run grid stat for neighborhoods, I am getting NAs in all the
confidence intervals.    In this case the FBS, FSS, AFSS, and UFSS
confidence intervals are all NA.  Attached in my gridstat config file.  Why
are these NA? What needs to be turned on?  I am having a similar problem
with MAE in CNT out files generated from MPR files.

 

Thanks

Bob



----------------------------------------------------------------
  Complete Ticket History
----------------------------------------------------------------

Subject: Fractions Skill Score Confidence Intervals
From: John Halley Gotway
Time: Mon Mar 11 15:35:04 2019

Bob,

Confidence intervals in the MET output come in two types, those that
are
generated by using a parametric (or normal approximation) and those
that
are generated using the non-parametric, bootstrap resampling,
approach.
Columns ending in _NCL and _NCU contain the parametric/normal CI
approximation while columns ending in _BCL and _BCU contain the
non-parametric/bootstrap CI.

By default, bootstrapping is disabled in Grid-Stat since it's so
resource
intensive.  Applying random resampling of gridded data is a lot of a
number
crunching.  And you should really think about what the resulting CI
represents.  It's an estimate of spatial sampling uncertainty on the
current day.

Anyway, in order to enable it, you just need to turn bootstrapping on
and
select the desired number of bootstrap resamples (typically at least
1000):







*boot = {   interval = PCTILE;   rep_prop = 1.0;   n_rep    = 1000;
rng      = "mt19937";   seed     = "";}*

And you can read more info about these options in the MET User's
Guide.

Thanks,
John

On Mon, Mar 11, 2019 at 1:49 PM robert.craig.2 at us.af.mil via RT <
met_help at ucar.edu> wrote:

>
> Mon Mar 11 13:49:27 2019: Request 89284 was acted upon.
> Transaction: Ticket created by robert.craig.2 at us.af.mil
>        Queue: met_help
>      Subject: Fractions Skill Score Confidence Intervals
>        Owner: Nobody
>   Requestors: robert.craig.2 at us.af.mil
>       Status: new
>  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=89284 >
>
>
> John, when I run grid stat for neighborhoods, I am getting NAs in
all the
> confidence intervals.    In this case the FBS, FSS, AFSS, and UFSS
> confidence intervals are all NA.  Attached in my gridstat config
file.  Why
> are these NA? What needs to be turned on?  I am having a similar
problem
> with MAE in CNT out files generated from MPR files.
>
>
>
> Thanks
>
> Bob
>
>
>

------------------------------------------------
Subject: Fractions Skill Score Confidence Intervals
From: robert.craig.2 at us.af.mil
Time: Thu Mar 14 15:16:59 2019

John, I am not quite sure how to turn boot strap on for stat analysis.
I set
n_rep = 1000 in the stat analysis config file and then included the
-config
option pointing to my command line but the CI 's  weren't calculated.
My
command line is:

/h/WXQC/met-8.1_beta1/bin/stat_analysis -lookin
/h/data/global/WXQC/data/met/gdstat/mdlob_pairs/korea_4_10_6/TC  -out
/h/data/global/WXQC/data/met/summary/TC_kor
ea_4 -tmp_dir /h/data/global/WXQC/data/met/tmp -job aggregate -by
INTERP_PNTS -line_type NBRCNT -out_line_type NBRCTS -fcst_valid_beg
20171201_000000 -fcst_valid
_end 20180531_180000 -out_fcst_thresh ==0.1 -by FCST_VAR -by FCST_LEAD
-by
fcst_thresh -fcst_thresh ">=80,<=20" -out_obs_thresh "ge80,le20"
-interp_mthd
NBRHD_SQ
UARE -dump_row /h/data/global/WXQC/data/met/filter_job_4_tc -config
/h/WXQC/met-6.1/data/config/STATAnalysisConfig_bootstrap -v 4.0

My output says  it found the user statanal config file:

DEBUG 1: Reading user-defined grib1 MET_GRIB_TABLES file:
/h/data/global/WXQC/data/met/config/grib2/grib1_af_131_57.txt
DEBUG 1: Reading user-defined grib2 MET_GRIB_TABLES file:
/h/data/global/WXQC/data/met/config/grib2/grib2_geps.txt
DEBUG 1: Creating STAT-Analysis output file
"/h/data/global/WXQC/data/met/summary/TC_korea_4"
DEBUG 1: Default Config File:
/h/WXQC/met-8.1_beta1/share/met/config/STATAnalysisConfig_default
DEBUG 1: User Config File:
/h/WXQC/met-6.1/data/config/STATAnalysisConfig_bootstrap
DEBUG 4: Default Job from the config file: "(nul)"
DEBUG 4: Amending default job with command line options: "-job
aggregate -by
INTERP_PNTS -line_type NBRCNT -out_line_type NBRCTS -fcst_valid_beg
20171201_000000 -fcst_valid_end 20180531_180000 -out_fcst_thresh ==0.1
-by
FCST_VAR -by FCST_LEAD -by fcst_thresh -fcst_thresh >=80,<=20
-out_obs_thresh
ge80,le20 -interp_mthd NBRHD_SQUARE -dump_row
/h/data/global/WXQC/data/met/filter_job_4_tc"
DEBUG 2: Processing 4249 STAT files.
DEBUG 3: Processing STAT file
"/h/data/global/WXQC/data/met/gdstat/mdlob_pairs/korea_4_10_6/TC/grid_stat_korea_4_10_6_all_060000L_20180422_180000V.stat"
........ 1 of 4249
DEBUG 3: Processing STAT file
"/h/data/global/WXQC/data/met/gdstat/mdlob_pairs/korea_4_10_6/TC/grid_stat_korea_4_10_6_all_060000L_20180301_180000V.stat"
........ 2 o

So, why no CI's?

Thanks
Bob

-----Original Message-----
From: John Halley Gotway via RT <met_help at ucar.edu>
Sent: Monday, March 11, 2019 4:35 PM
To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
<robert.craig.2 at us.af.mil>
Cc: MELICK, CHRISTOPHER J GS-12 USAF ACC 16 WS/WXEV
<christopher.melick at us.af.mil>; SITTEL, MATTHEW C CTR USAF AFMC
AFLCMC/HBAW-OL
<matthew.sittel.ctr at us.af.mil>
Subject: [Non-DoD Source] Re: [rt.rap.ucar.edu #89284] Fractions Skill
Score
Confidence Intervals

Bob,

Confidence intervals in the MET output come in two types, those that
are
generated by using a parametric (or normal approximation) and those
that are
generated using the non-parametric, bootstrap resampling, approach.
Columns ending in _NCL and _NCU contain the parametric/normal CI
approximation
while columns ending in _BCL and _BCU contain the non-
parametric/bootstrap CI.

By default, bootstrapping is disabled in Grid-Stat since it's so
resource
intensive.  Applying random resampling of gridded data is a lot of a
number
crunching.  And you should really think about what the resulting CI
represents.  It's an estimate of spatial sampling uncertainty on the
current
day.

Anyway, in order to enable it, you just need to turn bootstrapping on
and
select the desired number of bootstrap resamples (typically at least
1000):







*boot = {   interval = PCTILE;   rep_prop = 1.0;   n_rep    = 1000;
rng      = "mt19937";   seed     = "";}*

And you can read more info about these options in the MET User's
Guide.

Thanks,
John

On Mon, Mar 11, 2019 at 1:49 PM robert.craig.2 at us.af.mil via RT <
met_help at ucar.edu> wrote:

>
> Mon Mar 11 13:49:27 2019: Request 89284 was acted upon.
> Transaction: Ticket created by robert.craig.2 at us.af.mil
>        Queue: met_help
>      Subject: Fractions Skill Score Confidence Intervals
>        Owner: Nobody
>   Requestors: robert.craig.2 at us.af.mil
>       Status: new
>  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=89284
> >
>
>
> John, when I run grid stat for neighborhoods, I am getting NAs in
all the
> confidence intervals.    In this case the FBS, FSS, AFSS, and UFSS
> confidence intervals are all NA.  Attached in my gridstat config
file.
> Why are these NA? What needs to be turned on?  I am having a similar
> problem with MAE in CNT out files generated from MPR files.
>
>
>
> Thanks
>
> Bob
>
>
>


------------------------------------------------
Subject: Fractions Skill Score Confidence Intervals
From: robert.craig.2 at us.af.mil
Time: Thu Mar 14 15:20:46 2019

Correction to my command line, I was using this:

/h/WXQC/met-8.1_beta1/bin/stat_analysis -lookin
/h/data/global/WXQC/data/met/gdstat/mdlob_pairs/korea_4_10_6/TC/test
-out
/h/data/global/WXQC/data/met/summary/TC_korea_4 -tmp_dir
/h/data/global/WXQC/data/met/tmp -config
/h/WXQC/met-6.1/data/config/STATAnalysisConfig_bootstrap -job
aggregate -by
INTERP_PNTS -line_type NBRCNT -out_line_type NBRCTS -fcst_valid_beg
20171201_000000 -fcst_valid_end 20180531_180000 -out_fcst_thresh ==0.1
-by
FCST_VAR -by FCST_LEAD -by fcst_thresh -fcst_thresh
">=80,<=20" -out_obs_thresh "ge80,le20" -interp_mthd NBRHD_SQUARE
-dump_row
/h/data/global/WXQC/data/met/filter_job_4_tc -v 4.0

I didn't have two calls to -config.

Bob

-----Original Message-----
From: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
Sent: Thursday, March 14, 2019 4:17 PM
To: 'met_help at ucar.edu' <met_help at ucar.edu>
Subject: RE: [Non-DoD Source] Re: [rt.rap.ucar.edu #89284] Fractions
Skill
Score Confidence Intervals

John, I am not quite sure how to turn boot strap on for stat analysis.
I set
n_rep = 1000 in the stat analysis config file and then included the
-config
option pointing to my command line but the CI 's  weren't calculated.
My
command line is:

/h/WXQC/met-8.1_beta1/bin/stat_analysis -lookin
/h/data/global/WXQC/data/met/gdstat/mdlob_pairs/korea_4_10_6/TC  -out
/h/data/global/WXQC/data/met/summary/TC_kor
ea_4 -tmp_dir /h/data/global/WXQC/data/met/tmp -job aggregate -by
INTERP_PNTS -line_type NBRCNT -out_line_type NBRCTS -fcst_valid_beg
20171201_000000 -fcst_valid
_end 20180531_180000 -out_fcst_thresh ==0.1 -by FCST_VAR -by FCST_LEAD
-by
fcst_thresh -fcst_thresh ">=80,<=20" -out_obs_thresh "ge80,le20"
-interp_mthd
NBRHD_SQ
UARE -dump_row /h/data/global/WXQC/data/met/filter_job_4_tc -config
/h/WXQC/met-6.1/data/config/STATAnalysisConfig_bootstrap -v 4.0

My output says  it found the user statanal config file:

DEBUG 1: Reading user-defined grib1 MET_GRIB_TABLES file:
/h/data/global/WXQC/data/met/config/grib2/grib1_af_131_57.txt
DEBUG 1: Reading user-defined grib2 MET_GRIB_TABLES file:
/h/data/global/WXQC/data/met/config/grib2/grib2_geps.txt
DEBUG 1: Creating STAT-Analysis output file
"/h/data/global/WXQC/data/met/summary/TC_korea_4"
DEBUG 1: Default Config File:
/h/WXQC/met-8.1_beta1/share/met/config/STATAnalysisConfig_default
DEBUG 1: User Config File:
/h/WXQC/met-6.1/data/config/STATAnalysisConfig_bootstrap
DEBUG 4: Default Job from the config file: "(nul)"
DEBUG 4: Amending default job with command line options: "-job
aggregate -by
INTERP_PNTS -line_type NBRCNT -out_line_type NBRCTS -fcst_valid_beg
20171201_000000 -fcst_valid_end 20180531_180000 -out_fcst_thresh ==0.1
-by
FCST_VAR -by FCST_LEAD -by fcst_thresh -fcst_thresh >=80,<=20
-out_obs_thresh
ge80,le20 -interp_mthd NBRHD_SQUARE -dump_row
/h/data/global/WXQC/data/met/filter_job_4_tc"
DEBUG 2: Processing 4249 STAT files.
DEBUG 3: Processing STAT file
"/h/data/global/WXQC/data/met/gdstat/mdlob_pairs/korea_4_10_6/TC/grid_stat_korea_4_10_6_all_060000L_20180422_180000V.stat"
........ 1 of 4249
DEBUG 3: Processing STAT file
"/h/data/global/WXQC/data/met/gdstat/mdlob_pairs/korea_4_10_6/TC/grid_stat_korea_4_10_6_all_060000L_20180301_180000V.stat"
........ 2 o

So, why no CI's?

Thanks
Bob

-----Original Message-----
From: John Halley Gotway via RT <met_help at ucar.edu>
Sent: Monday, March 11, 2019 4:35 PM
To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
<robert.craig.2 at us.af.mil>
Cc: MELICK, CHRISTOPHER J GS-12 USAF ACC 16 WS/WXEV
<christopher.melick at us.af.mil>; SITTEL, MATTHEW C CTR USAF AFMC
AFLCMC/HBAW-OL
<matthew.sittel.ctr at us.af.mil>
Subject: [Non-DoD Source] Re: [rt.rap.ucar.edu #89284] Fractions Skill
Score
Confidence Intervals

Bob,

Confidence intervals in the MET output come in two types, those that
are
generated by using a parametric (or normal approximation) and those
that are
generated using the non-parametric, bootstrap resampling, approach.
Columns ending in _NCL and _NCU contain the parametric/normal CI
approximation
while columns ending in _BCL and _BCU contain the non-
parametric/bootstrap CI.

By default, bootstrapping is disabled in Grid-Stat since it's so
resource
intensive.  Applying random resampling of gridded data is a lot of a
number
crunching.  And you should really think about what the resulting CI
represents.  It's an estimate of spatial sampling uncertainty on the
current
day.

Anyway, in order to enable it, you just need to turn bootstrapping on
and
select the desired number of bootstrap resamples (typically at least
1000):







*boot = {   interval = PCTILE;   rep_prop = 1.0;   n_rep    = 1000;
rng      = "mt19937";   seed     = "";}*

And you can read more info about these options in the MET User's
Guide.

Thanks,
John

On Mon, Mar 11, 2019 at 1:49 PM robert.craig.2 at us.af.mil via RT <
met_help at ucar.edu> wrote:

>
> Mon Mar 11 13:49:27 2019: Request 89284 was acted upon.
> Transaction: Ticket created by robert.craig.2 at us.af.mil
>        Queue: met_help
>      Subject: Fractions Skill Score Confidence Intervals
>        Owner: Nobody
>   Requestors: robert.craig.2 at us.af.mil
>       Status: new
>  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=89284
> >
>
>
> John, when I run grid stat for neighborhoods, I am getting NAs in
all the
> confidence intervals.    In this case the FBS, FSS, AFSS, and UFSS
> confidence intervals are all NA.  Attached in my gridstat config
file.
> Why are these NA? What needs to be turned on?  I am having a similar
> problem with MAE in CNT out files generated from MPR files.
>
>
>
> Thanks
>
> Bob
>
>
>


------------------------------------------------
Subject: Fractions Skill Score Confidence Intervals
From: John Halley Gotway
Time: Thu Mar 14 16:14:22 2019

Bob,

I see that you're running stat_analysis to aggregate the NBRCNT line
type
from multiple runs of Grid-Stat.  You'd like to turn on bootstrapping
with
the hopes of populating the FSS_BCL and FSS_BCU output columns with
bootstrap confidence intervals.

Unfortunately, this functionality doesn't currently exist.  The MET
tools
only support the computation of bootstrap CI's using individual
matched
pairs as input.  Point-Stat and Grid-Stat both create lists of paired
fcst/obs/climo data and apply bootstraping to those matched pairs when
computing output statistics.  Similarly, when Stat-Analysis reads the
MPR
line type as input, it also calls the same library functions to
bootstrap
those MPR's and compute its output.

So if you were running the following type of job, you'd use "-
n_boot_rep"
to specify the number of bootstrap replications to be run:
*stat_analysis -lookin point_stat/point_stat*_mpr.txt -job
aggregate_stat
-line_type MPR -out_line_type CNT -by FCST_VAR -n_boot_rep 1000*
And the _BCL and _BCU columns would be populated.

But for any other type of aggregation (such as NBRCNT) bootstrapping
is not
supported in Stat-Analysis.  Since the DTC has relied so heavily on
METviewer for analysis and plotting, we've used it to aggregate and
compute
bootstrap CI's for Fractions Skill Score.  We were aware of this
deficiency
in Stat-Analysis, but it has never bubbled up to the top of the
priority
list since METviewer provides an alternative solution.

I also notice that you're trying to combine the "-config" option with
specifying a job on the command line.  That won't work well.  You
should
either specify one job entirely on the command line or specify them in
the
"jobs" array of the config file.

Sorry I don't have a better solution for you.  The logic for
bootstrapping
these other aggregation types is pretty clear, it just hasn't been a
top
priority yet.

Thanks,
John

On Thu, Mar 14, 2019 at 3:20 PM robert.craig.2 at us.af.mil via RT <
met_help at ucar.edu> wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=89284 >
>
> Correction to my command line, I was using this:
>
> /h/WXQC/met-8.1_beta1/bin/stat_analysis -lookin
> /h/data/global/WXQC/data/met/gdstat/mdlob_pairs/korea_4_10_6/TC/test
-out
> /h/data/global/WXQC/data/met/summary/TC_korea_4 -tmp_dir
> /h/data/global/WXQC/data/met/tmp -config
> /h/WXQC/met-6.1/data/config/STATAnalysisConfig_bootstrap -job
aggregate
> -by
> INTERP_PNTS -line_type NBRCNT -out_line_type NBRCTS -fcst_valid_beg
> 20171201_000000 -fcst_valid_end 20180531_180000 -out_fcst_thresh
==0.1 -by
> FCST_VAR -by FCST_LEAD -by fcst_thresh -fcst_thresh
> ">=80,<=20" -out_obs_thresh "ge80,le20" -interp_mthd NBRHD_SQUARE
> -dump_row
> /h/data/global/WXQC/data/met/filter_job_4_tc -v 4.0
>
> I didn't have two calls to -config.
>
> Bob
>
> -----Original Message-----
> From: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
> Sent: Thursday, March 14, 2019 4:17 PM
> To: 'met_help at ucar.edu' <met_help at ucar.edu>
> Subject: RE: [Non-DoD Source] Re: [rt.rap.ucar.edu #89284] Fractions
> Skill
> Score Confidence Intervals
>
> John, I am not quite sure how to turn boot strap on for stat
analysis.  I
> set
> n_rep = 1000 in the stat analysis config file and then included the
-config
> option pointing to my command line but the CI 's  weren't
calculated.  My
> command line is:
>
> /h/WXQC/met-8.1_beta1/bin/stat_analysis -lookin
> /h/data/global/WXQC/data/met/gdstat/mdlob_pairs/korea_4_10_6/TC
-out
> /h/data/global/WXQC/data/met/summary/TC_kor
> ea_4 -tmp_dir /h/data/global/WXQC/data/met/tmp -job aggregate -by
> INTERP_PNTS -line_type NBRCNT -out_line_type NBRCTS -fcst_valid_beg
> 20171201_000000 -fcst_valid
> _end 20180531_180000 -out_fcst_thresh ==0.1 -by FCST_VAR -by
FCST_LEAD -by
> fcst_thresh -fcst_thresh ">=80,<=20" -out_obs_thresh "ge80,le20"
> -interp_mthd
> NBRHD_SQ
> UARE -dump_row /h/data/global/WXQC/data/met/filter_job_4_tc -config
> /h/WXQC/met-6.1/data/config/STATAnalysisConfig_bootstrap -v 4.0
>
> My output says  it found the user statanal config file:
>
> DEBUG 1: Reading user-defined grib1 MET_GRIB_TABLES file:
> /h/data/global/WXQC/data/met/config/grib2/grib1_af_131_57.txt
> DEBUG 1: Reading user-defined grib2 MET_GRIB_TABLES file:
> /h/data/global/WXQC/data/met/config/grib2/grib2_geps.txt
> DEBUG 1: Creating STAT-Analysis output file
> "/h/data/global/WXQC/data/met/summary/TC_korea_4"
> DEBUG 1: Default Config File:
> /h/WXQC/met-8.1_beta1/share/met/config/STATAnalysisConfig_default
> DEBUG 1: User Config File:
> /h/WXQC/met-6.1/data/config/STATAnalysisConfig_bootstrap
> DEBUG 4: Default Job from the config file: "(nul)"
> DEBUG 4: Amending default job with command line options: "-job
aggregate
> -by
> INTERP_PNTS -line_type NBRCNT -out_line_type NBRCTS -fcst_valid_beg
> 20171201_000000 -fcst_valid_end 20180531_180000 -out_fcst_thresh
==0.1 -by
> FCST_VAR -by FCST_LEAD -by fcst_thresh -fcst_thresh >=80,<=20
> -out_obs_thresh
> ge80,le20 -interp_mthd NBRHD_SQUARE -dump_row
> /h/data/global/WXQC/data/met/filter_job_4_tc"
> DEBUG 2: Processing 4249 STAT files.
> DEBUG 3: Processing STAT file
>
>
"/h/data/global/WXQC/data/met/gdstat/mdlob_pairs/korea_4_10_6/TC/grid_stat_korea_4_10_6_all_060000L_20180422_180000V.stat"
> ........ 1 of 4249
> DEBUG 3: Processing STAT file
>
>
"/h/data/global/WXQC/data/met/gdstat/mdlob_pairs/korea_4_10_6/TC/grid_stat_korea_4_10_6_all_060000L_20180301_180000V.stat"
> ........ 2 o
>
> So, why no CI's?
>
> Thanks
> Bob
>
> -----Original Message-----
> From: John Halley Gotway via RT <met_help at ucar.edu>
> Sent: Monday, March 11, 2019 4:35 PM
> To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
<robert.craig.2 at us.af.mil>
> Cc: MELICK, CHRISTOPHER J GS-12 USAF ACC 16 WS/WXEV
> <christopher.melick at us.af.mil>; SITTEL, MATTHEW C CTR USAF AFMC
> AFLCMC/HBAW-OL
> <matthew.sittel.ctr at us.af.mil>
> Subject: [Non-DoD Source] Re: [rt.rap.ucar.edu #89284] Fractions
Skill
> Score
> Confidence Intervals
>
> Bob,
>
> Confidence intervals in the MET output come in two types, those that
are
> generated by using a parametric (or normal approximation) and those
that
> are
> generated using the non-parametric, bootstrap resampling, approach.
> Columns ending in _NCL and _NCU contain the parametric/normal CI
> approximation
> while columns ending in _BCL and _BCU contain the non-
parametric/bootstrap
> CI.
>
> By default, bootstrapping is disabled in Grid-Stat since it's so
resource
> intensive.  Applying random resampling of gridded data is a lot of a
number
> crunching.  And you should really think about what the resulting CI
> represents.  It's an estimate of spatial sampling uncertainty on the
> current
> day.
>
> Anyway, in order to enable it, you just need to turn bootstrapping
on and
> select the desired number of bootstrap resamples (typically at least
1000):
>
>
>
>
>
>
>
> *boot = {   interval = PCTILE;   rep_prop = 1.0;   n_rep    = 1000;
> rng      = "mt19937";   seed     = "";}*
>
> And you can read more info about these options in the MET User's
Guide.
>
> Thanks,
> John
>
> On Mon, Mar 11, 2019 at 1:49 PM robert.craig.2 at us.af.mil via RT <
> met_help at ucar.edu> wrote:
>
> >
> > Mon Mar 11 13:49:27 2019: Request 89284 was acted upon.
> > Transaction: Ticket created by robert.craig.2 at us.af.mil
> >        Queue: met_help
> >      Subject: Fractions Skill Score Confidence Intervals
> >        Owner: Nobody
> >   Requestors: robert.craig.2 at us.af.mil
> >       Status: new
> >  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=89284
> > >
> >
> >
> > John, when I run grid stat for neighborhoods, I am getting NAs in
all the
> > confidence intervals.    In this case the FBS, FSS, AFSS, and UFSS
> > confidence intervals are all NA.  Attached in my gridstat config
file.
> > Why are these NA? What needs to be turned on?  I am having a
similar
> > problem with MAE in CNT out files generated from MPR files.
> >
> >
> >
> > Thanks
> >
> > Bob
> >
> >
> >
>
>
>

------------------------------------------------


More information about the Met_help mailing list