[Met_help] [rt.rap.ucar.edu #95588] History for Summary FIles Confidence Intervals are NA

Minna Win via RT met_help at ucar.edu
Thu Jun 11 10:46:34 MDT 2020


----------------------------------------------------------------
  Initial Request
----------------------------------------------------------------

John, when running Stat Anal Summary option, a lot of times I get confidence intervals of NA.  This happens if I set PCTILE or BCA and n_rep to 1000 or 0.  What causes this to happen?  A portion of my config file is:

////////////////////////////////////////////////////////////////////////////////

//
// Array of STAT-Analysis jobs to be performed on the filtered data
//
jobs = [
   "-job summary"
];

////////////////////////////////////////////////////////////////////////////////

//
// Confidence interval settings
//
out_alpha = 0.05;

boot = {
   interval = PCTILE;
   rep_prop = 1.0;
   n_rep    = 0;
   rng      = "mt19937";
   seed     = "10";
}

////////////////////////////////////////////////////////////////////////////////

//
// WMO mean computation logic
//
wmo_sqrt_stats   = [ "CNT:FSTDEV",  "CNT:OSTDEV",  "CNT:ESTDEV",
                     "CNT:RMSE",    "CNT:RMSFA",   "CNT:RMSOA",
                     "VCNT:FS_RMS", "VCNT:OS_RMS", "VCNT:RMSVE",
                     "VCNT:FSTDEV", "VCNT:OSTDEV" ];

wmo_fisher_stats = [ "CNT:PR_CORR", "CNT:SP_CORR",
                     "CNT:KT_CORR", "CNT:ANOM_CORR" ];

////////////////////////////////////////////////////////////////////////////////

rank_corr_flag = FALSE;
vif_flag       = FALSE;
tmp_dir        = "/tmp";
version        = "V8.1";

The command line I am using is:
/h/MET/bin/stat_analysis -lookin /h/data/global/WXQC/data/met/ptstat/stats/galwem/TT/temp -out /h/data/global/WXQC/data/met/ptstat/stats/timeseries/stat_anal_galwem_full_TT_Z2_20200401_20200430.txt -tmp_dir /h/data/global/WXQC/data/met/tmp -job summary -column CNT:RMSE,CNT:ME -fcst_init_beg 20200401_000000 -fcst_init_end 20204030_180000 -fcst_lead 24 -fcst_lev Z2 -vx_mask FULL -by fcst_lead -by fcst_init_hour -by model -by fcst_valid_beg -config /h/data/global/WXQC/data/met/config/met_config/STATAnalysisConfig_bootstrap_summary -v 4.0

Thanks
Bob


----------------------------------------------------------------
  Complete Ticket History
----------------------------------------------------------------

Subject: Summary FIles Confidence Intervals are NA
From: Minna Win
Time: Thu Jun 11 10:23:35 2020

Hi John,

It looks like you have a few questions about confidence intervals in
MET.
I'm assigning this ticket to John Halley Gotway.

Regards,
Minna
---------------
Minna Win
National Center for Atmospheric Research
Developmental Testbed Center
Phone: 303-497-8423
Fax:   303-497-8401



On Thu, Jun 11, 2020 at 10:16 AM robert.craig.2 at us.af.mil via RT <
met_help at ucar.edu> wrote:

>
> Thu Jun 11 10:15:32 2020: Request 95588 was acted upon.
> Transaction: Ticket created by robert.craig.2 at us.af.mil
>        Queue: met_help
>      Subject: Summary FIles Confidence Intervals are NA
>        Owner: Nobody
>   Requestors: robert.craig.2 at us.af.mil
>       Status: new
>  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95588 >
>
>
> John, when running Stat Anal Summary option, a lot of times I get
> confidence intervals of NA.  This happens if I set PCTILE or BCA and
n_rep
> to 1000 or 0.  What causes this to happen?  A portion of my config
file is:
>
>
>
////////////////////////////////////////////////////////////////////////////////
>
> //
> // Array of STAT-Analysis jobs to be performed on the filtered data
> //
> jobs = [
>    "-job summary"
> ];
>
>
>
////////////////////////////////////////////////////////////////////////////////
>
> //
> // Confidence interval settings
> //
> out_alpha = 0.05;
>
> boot = {
>    interval = PCTILE;
>    rep_prop = 1.0;
>    n_rep    = 0;
>    rng      = "mt19937";
>    seed     = "10";
> }
>
>
>
////////////////////////////////////////////////////////////////////////////////
>
> //
> // WMO mean computation logic
> //
> wmo_sqrt_stats   = [ "CNT:FSTDEV",  "CNT:OSTDEV",  "CNT:ESTDEV",
>                      "CNT:RMSE",    "CNT:RMSFA",   "CNT:RMSOA",
>                      "VCNT:FS_RMS", "VCNT:OS_RMS", "VCNT:RMSVE",
>                      "VCNT:FSTDEV", "VCNT:OSTDEV" ];
>
> wmo_fisher_stats = [ "CNT:PR_CORR", "CNT:SP_CORR",
>                      "CNT:KT_CORR", "CNT:ANOM_CORR" ];
>
>
>
////////////////////////////////////////////////////////////////////////////////
>
> rank_corr_flag = FALSE;
> vif_flag       = FALSE;
> tmp_dir        = "/tmp";
> version        = "V8.1";
>
> The command line I am using is:
> /h/MET/bin/stat_analysis -lookin
> /h/data/global/WXQC/data/met/ptstat/stats/galwem/TT/temp -out
>
/h/data/global/WXQC/data/met/ptstat/stats/timeseries/stat_anal_galwem_full_TT_Z2_20200401_20200430.txt
> -tmp_dir /h/data/global/WXQC/data/met/tmp -job summary -column
> CNT:RMSE,CNT:ME -fcst_init_beg 20200401_000000 -fcst_init_end
> 20204030_180000 -fcst_lead 24 -fcst_lev Z2 -vx_mask FULL -by
fcst_lead -by
> fcst_init_hour -by model -by fcst_valid_beg -config
>
/h/data/global/WXQC/data/met/config/met_config/STATAnalysisConfig_bootstrap_summary
> -v 4.0
>
> Thanks
> Bob
>
>

------------------------------------------------
Subject: RE: [Non-DoD Source] Re: [rt.rap.ucar.edu #95588] Summary FIles Confidence Intervals are NA
From: robert.craig.2 at us.af.mil
Time: Thu Jun 11 10:38:07 2020

I think I answered my own question.  I was running the job to output
data daily - so not enough data to calculate a confidence Interval.

Bob

-----Original Message-----
From: Minna Win via RT <met_help at ucar.edu>
Sent: Thursday, June 11, 2020 11:24 AM
To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
<robert.craig.2 at us.af.mil>
Subject: [Non-DoD Source] Re: [rt.rap.ucar.edu #95588] Summary FIles
Confidence Intervals are NA

Hi John,

It looks like you have a few questions about confidence intervals in
MET.
I'm assigning this ticket to John Halley Gotway.

Regards,
Minna
---------------
Minna Win
National Center for Atmospheric Research Developmental Testbed Center
Phone: 303-497-8423
Fax:   303-497-8401



On Thu, Jun 11, 2020 at 10:16 AM robert.craig.2 at us.af.mil via RT <
met_help at ucar.edu> wrote:

>
> Thu Jun 11 10:15:32 2020: Request 95588 was acted upon.
> Transaction: Ticket created by robert.craig.2 at us.af.mil
>        Queue: met_help
>      Subject: Summary FIles Confidence Intervals are NA
>        Owner: Nobody
>   Requestors: robert.craig.2 at us.af.mil
>       Status: new
>  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95588
> >
>
>
> John, when running Stat Anal Summary option, a lot of times I get
> confidence intervals of NA.  This happens if I set PCTILE or BCA and
> n_rep to 1000 or 0.  What causes this to happen?  A portion of my
config file is:
>
>
>
//////////////////////////////////////////////////////////////////////
> //////////
>
> //
> // Array of STAT-Analysis jobs to be performed on the filtered data
//
> jobs = [
>    "-job summary"
> ];
>
>
>
//////////////////////////////////////////////////////////////////////
> //////////
>
> //
> // Confidence interval settings
> //
> out_alpha = 0.05;
>
> boot = {
>    interval = PCTILE;
>    rep_prop = 1.0;
>    n_rep    = 0;
>    rng      = "mt19937";
>    seed     = "10";
> }
>
>
>
//////////////////////////////////////////////////////////////////////
> //////////
>
> //
> // WMO mean computation logic
> //
> wmo_sqrt_stats   = [ "CNT:FSTDEV",  "CNT:OSTDEV",  "CNT:ESTDEV",
>                      "CNT:RMSE",    "CNT:RMSFA",   "CNT:RMSOA",
>                      "VCNT:FS_RMS", "VCNT:OS_RMS", "VCNT:RMSVE",
>                      "VCNT:FSTDEV", "VCNT:OSTDEV" ];
>
> wmo_fisher_stats = [ "CNT:PR_CORR", "CNT:SP_CORR",
>                      "CNT:KT_CORR", "CNT:ANOM_CORR" ];
>
>
>
//////////////////////////////////////////////////////////////////////
> //////////
>
> rank_corr_flag = FALSE;
> vif_flag       = FALSE;
> tmp_dir        = "/tmp";
> version        = "V8.1";
>
> The command line I am using is:
> /h/MET/bin/stat_analysis -lookin
> /h/data/global/WXQC/data/met/ptstat/stats/galwem/TT/temp -out
>
/h/data/global/WXQC/data/met/ptstat/stats/timeseries/stat_anal_galwem_
> full_TT_Z2_20200401_20200430.txt -tmp_dir
> /h/data/global/WXQC/data/met/tmp -job summary -column
CNT:RMSE,CNT:ME
> -fcst_init_beg 20200401_000000 -fcst_init_end
> 20204030_180000 -fcst_lead 24 -fcst_lev Z2 -vx_mask FULL -by
fcst_lead
> -by fcst_init_hour -by model -by fcst_valid_beg -config
>
/h/data/global/WXQC/data/met/config/met_config/STATAnalysisConfig_boot
> strap_summary
> -v 4.0
>
> Thanks
> Bob
>
>



------------------------------------------------


More information about the Met_help mailing list