[Met_help] [rt.rap.ucar.edu #76225] History for Stat Anal Issue
John Halley Gotway via RT
met_help at ucar.edu
Thu May 5 07:44:05 MDT 2016
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
John, I am running a stat analysis job looking for MPR lines in .stat files ( the config file is attached). When I run this with the fcst_thresh and ob_thresh set to empty, everything runs fine and I get output. However, when I run the job with obs_thresh set to [<8046], I get no lines returned. The .stat files it is reading has many cases where the ob value is less than 8046 (visibility in meters). I included some on the ftp site. Below is output from the run.
DEBUG 3: Processing STAT file "/h/data/global/WXQC/data/met/data/filtered/point_stat_MEPS20KM_300000L_20160321_060000V.stat" ... 3151 of 3157
DEBUG 3: Processing STAT file "/h/data/global/WXQC/data/met/data/filtered/point_stat_MEPS20KM_480000L_20160317_120000V.stat" ... 3152 of 3157
DEBUG 3: Processing STAT file "/h/data/global/WXQC/data/met/data/filtered/point_stat_GALWEM_150000L_20160319_030000V.stat" ..... 3153 of 3157
DEBUG 3: Processing STAT file "/h/data/global/WXQC/data/met/data/filtered/point_stat_GCWRF_330000L_20160401_090000V.stat" ...... 3154 of 3157
DEBUG 3: Processing STAT file "/h/data/global/WXQC/data/met/data/filtered/point_stat_GCWRF_420000L_20160310_180000V.stat" ...... 3155 of 3157
DEBUG 3: Processing STAT file "/h/data/global/WXQC/data/met/data/filtered/point_stat_GCWRF_210000L_20160313_210000V.stat" ...... 3156 of 3157
DEBUG 3: Processing STAT file "/h/data/global/WXQC/data/met/data/filtered/point_stat_GALWEM_240000L_20160409_120000V.stat" ..... 3157 of 3157
DEBUG 2: STAT Lines read = 3678048
DEBUG 2: STAT Lines retained = 0
DEBUG 4:
DEBUG 4: Initializing Job 1 to default job: "-model GALWEM -fcst_lead 120000 -fcst_init_beg 20160301_000000 -fcst_init_end 20160419_000000 -obs_thresh <8046 -line_type MPR -vif_flag 1 "
DEBUG 4:
DEBUG 4: Amending Job 1 with options: "-job aggregate_stat -out_line_type CNT -dump_row /h/data/global/WXQC/data/met/filter_job.stat"
DEBUG 4:
DEBUG 4: Amending Job 1 with command line options: "(nul)"
DEBUG 2:
DEBUG 2: Processing Job 1: -job aggregate_stat -model GALWEM -fcst_lead 120000 -fcst_init_beg 20160301_000000 -fcst_init_end 20160419_000000 -obs_thresh <8046 -line_type MPR -dump_row /h/data/global/WXQC/data/met/filter_job.stat -out_line_type CNT -out_alpha 0.05000 -boot_interval 2 -boot_rep_prop 1.00000 -n_boot_rep 0 -boot_rng mt19937 -rank_corr_flag 1 -vif_flag 1
DEBUG 1: Creating dump row output file "/h/data/global/WXQC/data/met/filter_job.stat"
GSL_RNG_TYPE=mt19937
GSL_RNG_SEED=18446744073377294935
DEBUG 2: Computing output for 0 case(s).
WARNING:
WARNING: do_job_aggr_stat() -> no matching STAT lines found for job: -job aggregate_stat -model GALWEM -fcst_lead 120000 -fcst_init_beg 20160301_000000 -fcst_init_end 20160419_000000 -obs_thresh <8046 -line_type MPR -dump_row /h/data/global/WXQC/data/met/filter_job.stat -out_line_type CNT -out_alpha 0.05000 -boot_interval 2 -boot_rep_prop 1.00000 -n_boot_rep 0 -boot_rng mt19937 -rank_corr_flag 1 -vif_flag 1
WARNING:
DEBUG 2: Job 1 used 0 out of 0 STAT lines.
['GALWEM', '15', '20160301', '20160419', 'CNT']
['/h/WXQC/met-5.1/bin/stat_analysis', '-lookin', '/h/data/global/WXQC/data/met/data/filtered', '-out', '/h/data/global/WXQC/data/met/summary/GALWEM_dust_15hr_cont_CNT', '-config', '/h/WXQC/met-5
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: Stat Anal Issue
From: Julie Prestopnik
Time: Wed May 04 13:15:07 2016
Hi Bob. Unfortunately, John is on travel this week. I ran
stat_analysis
using the data and config file that you uploaded, however, I am unable
to
reproduce your results. I am not as familiar with stat_analysis as
John
is. He should be able to help you, but unfortunately, it may not be
until
next week. Thanks in advance for your patience.
Julie
On Wed, May 4, 2016 at 11:51 AM, robert.craig.2 at us.af.mil via RT <
met_help at ucar.edu> wrote:
>
> Wed May 04 11:51:50 2016: Request 76225 was acted upon.
> Transaction: Ticket created by robert.craig.2 at us.af.mil
> Queue: met_help
> Subject: Stat Anal Issue
> Owner: Nobody
> Requestors: robert.craig.2 at us.af.mil
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=76225 >
>
>
> John, I am running a stat analysis job looking for MPR lines in
.stat
> files ( the config file is attached). When I run this with the
fcst_thresh
> and ob_thresh set to empty, everything runs fine and I get output.
> However, when I run the job with obs_thresh set to [<8046], I get no
lines
> returned. The .stat files it is reading has many cases where the
ob value
> is less than 8046 (visibility in meters). I included some on the
ftp
> site. Below is output from the run.
>
> DEBUG 3: Processing STAT file
>
"/h/data/global/WXQC/data/met/data/filtered/point_stat_MEPS20KM_300000L_20160321_060000V.stat"
> ... 3151 of 3157
> DEBUG 3: Processing STAT file
>
"/h/data/global/WXQC/data/met/data/filtered/point_stat_MEPS20KM_480000L_20160317_120000V.stat"
> ... 3152 of 3157
> DEBUG 3: Processing STAT file
>
"/h/data/global/WXQC/data/met/data/filtered/point_stat_GALWEM_150000L_20160319_030000V.stat"
> ..... 3153 of 3157
> DEBUG 3: Processing STAT file
>
"/h/data/global/WXQC/data/met/data/filtered/point_stat_GCWRF_330000L_20160401_090000V.stat"
> ...... 3154 of 3157
> DEBUG 3: Processing STAT file
>
"/h/data/global/WXQC/data/met/data/filtered/point_stat_GCWRF_420000L_20160310_180000V.stat"
> ...... 3155 of 3157
> DEBUG 3: Processing STAT file
>
"/h/data/global/WXQC/data/met/data/filtered/point_stat_GCWRF_210000L_20160313_210000V.stat"
> ...... 3156 of 3157
> DEBUG 3: Processing STAT file
>
"/h/data/global/WXQC/data/met/data/filtered/point_stat_GALWEM_240000L_20160409_120000V.stat"
> ..... 3157 of 3157
> DEBUG 2: STAT Lines read = 3678048
> DEBUG 2: STAT Lines retained = 0
> DEBUG 4:
> DEBUG 4: Initializing Job 1 to default job: "-model GALWEM
-fcst_lead
> 120000 -fcst_init_beg 20160301_000000 -fcst_init_end 20160419_000000
> -obs_thresh <8046 -line_type MPR -vif_flag 1 "
> DEBUG 4:
> DEBUG 4: Amending Job 1 with options: "-job aggregate_stat
-out_line_type
> CNT -dump_row /h/data/global/WXQC/data/met/filter_job.stat"
> DEBUG 4:
> DEBUG 4: Amending Job 1 with command line options: "(nul)"
> DEBUG 2:
> DEBUG 2: Processing Job 1: -job aggregate_stat -model GALWEM
-fcst_lead
> 120000 -fcst_init_beg 20160301_000000 -fcst_init_end 20160419_000000
> -obs_thresh <8046 -line_type MPR -dump_row
> /h/data/global/WXQC/data/met/filter_job.stat -out_line_type CNT
-out_alpha
> 0.05000 -boot_interval 2 -boot_rep_prop 1.00000 -n_boot_rep 0
-boot_rng
> mt19937 -rank_corr_flag 1 -vif_flag 1
> DEBUG 1: Creating dump row output file
> "/h/data/global/WXQC/data/met/filter_job.stat"
> GSL_RNG_TYPE=mt19937
> GSL_RNG_SEED=18446744073377294935
> DEBUG 2: Computing output for 0 case(s).
> WARNING:
> WARNING: do_job_aggr_stat() -> no matching STAT lines found for job:
-job
> aggregate_stat -model GALWEM -fcst_lead 120000 -fcst_init_beg
> 20160301_000000 -fcst_init_end 20160419_000000 -obs_thresh <8046
-line_type
> MPR -dump_row /h/data/global/WXQC/data/met/filter_job.stat
-out_line_type
> CNT -out_alpha 0.05000 -boot_interval 2 -boot_rep_prop 1.00000
-n_boot_rep
> 0 -boot_rng mt19937 -rank_corr_flag 1 -vif_flag 1
> WARNING:
> DEBUG 2: Job 1 used 0 out of 0 STAT lines.
> ['GALWEM', '15', '20160301', '20160419', 'CNT']
> ['/h/WXQC/met-5.1/bin/stat_analysis', '-lookin',
> '/h/data/global/WXQC/data/met/data/filtered', '-out',
> '/h/data/global/WXQC/data/met/summary/GALWEM_dust_15hr_cont_CNT',
> '-config', '/h/WXQC/met-5
>
>
>
>
>
>
>
--
Julie Prestopnik
National Center for Atmospheric Research
Research Applications Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #76225] Stat Anal Issue
From: robert.craig.2 at us.af.mil
Time: Wed May 04 15:00:01 2016
Julie, I take it you were able to get some lines in the .stat file to
be used?
Bob
-----Original Message-----
From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
Sent: Wednesday, May 04, 2016 2:15 PM
To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
<robert.craig.2 at us.af.mil>
Subject: Re: [rt.rap.ucar.edu #76225] Stat Anal Issue
Hi Bob. Unfortunately, John is on travel this week. I ran
stat_analysis using the data and config file that you uploaded,
however, I am unable to reproduce your results. I am not as familiar
with stat_analysis as John is. He should be able to help you, but
unfortunately, it may not be until next week. Thanks in advance for
your patience.
Julie
On Wed, May 4, 2016 at 11:51 AM, robert.craig.2 at us.af.mil via RT <
met_help at ucar.edu> wrote:
>
> Wed May 04 11:51:50 2016: Request 76225 was acted upon.
> Transaction: Ticket created by robert.craig.2 at us.af.mil
> Queue: met_help
> Subject: Stat Anal Issue
> Owner: Nobody
> Requestors: robert.craig.2 at us.af.mil
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=76225
> >
>
>
> John, I am running a stat analysis job looking for MPR lines in
.stat
> files ( the config file is attached). When I run this with the
> fcst_thresh and ob_thresh set to empty, everything runs fine and I
get output.
> However, when I run the job with obs_thresh set to [<8046], I get no
lines
> returned. The .stat files it is reading has many cases where the
ob value
> is less than 8046 (visibility in meters). I included some on the
ftp
> site. Below is output from the run.
>
> DEBUG 3: Processing STAT file
>
"/h/data/global/WXQC/data/met/data/filtered/point_stat_MEPS20KM_300000L_20160321_060000V.stat"
> ... 3151 of 3157
> DEBUG 3: Processing STAT file
>
"/h/data/global/WXQC/data/met/data/filtered/point_stat_MEPS20KM_480000L_20160317_120000V.stat"
> ... 3152 of 3157
> DEBUG 3: Processing STAT file
>
"/h/data/global/WXQC/data/met/data/filtered/point_stat_GALWEM_150000L_20160319_030000V.stat"
> ..... 3153 of 3157
> DEBUG 3: Processing STAT file
>
"/h/data/global/WXQC/data/met/data/filtered/point_stat_GCWRF_330000L_20160401_090000V.stat"
> ...... 3154 of 3157
> DEBUG 3: Processing STAT file
>
"/h/data/global/WXQC/data/met/data/filtered/point_stat_GCWRF_420000L_20160310_180000V.stat"
> ...... 3155 of 3157
> DEBUG 3: Processing STAT file
>
"/h/data/global/WXQC/data/met/data/filtered/point_stat_GCWRF_210000L_20160313_210000V.stat"
> ...... 3156 of 3157
> DEBUG 3: Processing STAT file
>
"/h/data/global/WXQC/data/met/data/filtered/point_stat_GALWEM_240000L_20160409_120000V.stat"
> ..... 3157 of 3157
> DEBUG 2: STAT Lines read = 3678048
> DEBUG 2: STAT Lines retained = 0
> DEBUG 4:
> DEBUG 4: Initializing Job 1 to default job: "-model GALWEM
-fcst_lead
> 120000 -fcst_init_beg 20160301_000000 -fcst_init_end 20160419_000000
> -obs_thresh <8046 -line_type MPR -vif_flag 1 "
> DEBUG 4:
> DEBUG 4: Amending Job 1 with options: "-job aggregate_stat
> -out_line_type CNT -dump_row
/h/data/global/WXQC/data/met/filter_job.stat"
> DEBUG 4:
> DEBUG 4: Amending Job 1 with command line options: "(nul)"
> DEBUG 2:
> DEBUG 2: Processing Job 1: -job aggregate_stat -model GALWEM
> -fcst_lead
> 120000 -fcst_init_beg 20160301_000000 -fcst_init_end 20160419_000000
> -obs_thresh <8046 -line_type MPR -dump_row
> /h/data/global/WXQC/data/met/filter_job.stat -out_line_type CNT
> -out_alpha
> 0.05000 -boot_interval 2 -boot_rep_prop 1.00000 -n_boot_rep 0
> -boot_rng
> mt19937 -rank_corr_flag 1 -vif_flag 1
> DEBUG 1: Creating dump row output file
> "/h/data/global/WXQC/data/met/filter_job.stat"
> GSL_RNG_TYPE=mt19937
> GSL_RNG_SEED=18446744073377294935
> DEBUG 2: Computing output for 0 case(s).
> WARNING:
> WARNING: do_job_aggr_stat() -> no matching STAT lines found for job:
> -job aggregate_stat -model GALWEM -fcst_lead 120000 -fcst_init_beg
> 20160301_000000 -fcst_init_end 20160419_000000 -obs_thresh <8046
> -line_type MPR -dump_row
/h/data/global/WXQC/data/met/filter_job.stat
> -out_line_type CNT -out_alpha 0.05000 -boot_interval 2
-boot_rep_prop
> 1.00000 -n_boot_rep
> 0 -boot_rng mt19937 -rank_corr_flag 1 -vif_flag 1
> WARNING:
> DEBUG 2: Job 1 used 0 out of 0 STAT lines.
> ['GALWEM', '15', '20160301', '20160419', 'CNT']
> ['/h/WXQC/met-5.1/bin/stat_analysis', '-lookin',
> '/h/data/global/WXQC/data/met/data/filtered', '-out',
> '/h/data/global/WXQC/data/met/summary/GALWEM_dust_15hr_cont_CNT',
> '-config', '/h/WXQC/met-5
>
>
>
>
>
>
>
--
Julie Prestopnik
National Center for Atmospheric Research Research Applications
Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
------------------------------------------------
Subject: Stat Anal Issue
From: Julie Prestopnik
Time: Wed May 04 15:05:38 2016
Actually, no. I got 0 in both cases.
Julie
On May 4, 2016 3:00 PM, "robert.craig.2 at us.af.mil via RT"
<met_help at ucar.edu>
wrote:
>
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=76225 >
>
> Julie, I take it you were able to get some lines in the .stat file
to be
used?
>
> Bob
>
> -----Original Message-----
> From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> Sent: Wednesday, May 04, 2016 2:15 PM
> To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
<robert.craig.2 at us.af.mil>
> Subject: Re: [rt.rap.ucar.edu #76225] Stat Anal Issue
>
> Hi Bob. Unfortunately, John is on travel this week. I ran
stat_analysis
using the data and config file that you uploaded, however, I am unable
to
reproduce your results. I am not as familiar with stat_analysis as
John
is. He should be able to help you, but unfortunately, it may not be
until
next week. Thanks in advance for your patience.
>
> Julie
>
>
>
> On Wed, May 4, 2016 at 11:51 AM, robert.craig.2 at us.af.mil via RT <
met_help at ucar.edu> wrote:
>
> >
> > Wed May 04 11:51:50 2016: Request 76225 was acted upon.
> > Transaction: Ticket created by robert.craig.2 at us.af.mil
> > Queue: met_help
> > Subject: Stat Anal Issue
> > Owner: Nobody
> > Requestors: robert.craig.2 at us.af.mil
> > Status: new
> > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=76225
> > >
> >
> >
> > John, I am running a stat analysis job looking for MPR lines in
.stat
> > files ( the config file is attached). When I run this with the
> > fcst_thresh and ob_thresh set to empty, everything runs fine and I
get
output.
> > However, when I run the job with obs_thresh set to [<8046], I get
no
lines
> > returned. The .stat files it is reading has many cases where the
ob
value
> > is less than 8046 (visibility in meters). I included some on the
ftp
> > site. Below is output from the run.
> >
> > DEBUG 3: Processing STAT file
> >
"/h/data/global/WXQC/data/met/data/filtered/point_stat_MEPS20KM_300000L_20160321_060000V.stat"
> > ... 3151 of 3157
> > DEBUG 3: Processing STAT file
> >
"/h/data/global/WXQC/data/met/data/filtered/point_stat_MEPS20KM_480000L_20160317_120000V.stat"
> > ... 3152 of 3157
> > DEBUG 3: Processing STAT file
> >
"/h/data/global/WXQC/data/met/data/filtered/point_stat_GALWEM_150000L_20160319_030000V.stat"
> > ..... 3153 of 3157
> > DEBUG 3: Processing STAT file
> >
"/h/data/global/WXQC/data/met/data/filtered/point_stat_GCWRF_330000L_20160401_090000V.stat"
> > ...... 3154 of 3157
> > DEBUG 3: Processing STAT file
> >
"/h/data/global/WXQC/data/met/data/filtered/point_stat_GCWRF_420000L_20160310_180000V.stat"
> > ...... 3155 of 3157
> > DEBUG 3: Processing STAT file
> >
"/h/data/global/WXQC/data/met/data/filtered/point_stat_GCWRF_210000L_20160313_210000V.stat"
> > ...... 3156 of 3157
> > DEBUG 3: Processing STAT file
> >
"/h/data/global/WXQC/data/met/data/filtered/point_stat_GALWEM_240000L_20160409_120000V.stat"
> > ..... 3157 of 3157
> > DEBUG 2: STAT Lines read = 3678048
> > DEBUG 2: STAT Lines retained = 0
> > DEBUG 4:
> > DEBUG 4: Initializing Job 1 to default job: "-model GALWEM
-fcst_lead
> > 120000 -fcst_init_beg 20160301_000000 -fcst_init_end
20160419_000000
> > -obs_thresh <8046 -line_type MPR -vif_flag 1 "
> > DEBUG 4:
> > DEBUG 4: Amending Job 1 with options: "-job aggregate_stat
> > -out_line_type CNT -dump_row
/h/data/global/WXQC/data/met/filter_job.stat"
> > DEBUG 4:
> > DEBUG 4: Amending Job 1 with command line options: "(nul)"
> > DEBUG 2:
> > DEBUG 2: Processing Job 1: -job aggregate_stat -model GALWEM
> > -fcst_lead
> > 120000 -fcst_init_beg 20160301_000000 -fcst_init_end
20160419_000000
> > -obs_thresh <8046 -line_type MPR -dump_row
> > /h/data/global/WXQC/data/met/filter_job.stat -out_line_type CNT
> > -out_alpha
> > 0.05000 -boot_interval 2 -boot_rep_prop 1.00000 -n_boot_rep 0
> > -boot_rng
> > mt19937 -rank_corr_flag 1 -vif_flag 1
> > DEBUG 1: Creating dump row output file
> > "/h/data/global/WXQC/data/met/filter_job.stat"
> > GSL_RNG_TYPE=mt19937
> > GSL_RNG_SEED=18446744073377294935
> > DEBUG 2: Computing output for 0 case(s).
> > WARNING:
> > WARNING: do_job_aggr_stat() -> no matching STAT lines found for
job:
> > -job aggregate_stat -model GALWEM -fcst_lead 120000 -fcst_init_beg
> > 20160301_000000 -fcst_init_end 20160419_000000 -obs_thresh <8046
> > -line_type MPR -dump_row
/h/data/global/WXQC/data/met/filter_job.stat
> > -out_line_type CNT -out_alpha 0.05000 -boot_interval 2
-boot_rep_prop
> > 1.00000 -n_boot_rep
> > 0 -boot_rng mt19937 -rank_corr_flag 1 -vif_flag 1
> > WARNING:
> > DEBUG 2: Job 1 used 0 out of 0 STAT lines.
> > ['GALWEM', '15', '20160301', '20160419', 'CNT']
> > ['/h/WXQC/met-5.1/bin/stat_analysis', '-lookin',
> > '/h/data/global/WXQC/data/met/data/filtered', '-out',
> > '/h/data/global/WXQC/data/met/summary/GALWEM_dust_15hr_cont_CNT',
> > '-config', '/h/WXQC/met-5
> >
> >
> >
> >
> >
> >
> >
>
>
> --
> Julie Prestopnik
> National Center for Atmospheric Research Research Applications
Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
>
>
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #76225] Stat Anal Issue
From: robert.craig.2 at us.af.mil
Time: Wed May 04 15:08:37 2016
Julie, So you did duplicate my results. Okay, I will wait until next
week.
Thanks
Bob
-----Original Message-----
From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
Sent: Wednesday, May 04, 2016 4:06 PM
To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
<robert.craig.2 at us.af.mil>
Subject: RE: [rt.rap.ucar.edu #76225] Stat Anal Issue
Actually, no. I got 0 in both cases.
Julie
On May 4, 2016 3:00 PM, "robert.craig.2 at us.af.mil via RT"
<met_help at ucar.edu>
wrote:
>
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=76225 >
>
> Julie, I take it you were able to get some lines in the .stat file
to
> be
used?
>
> Bob
>
> -----Original Message-----
> From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> Sent: Wednesday, May 04, 2016 2:15 PM
> To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
> <robert.craig.2 at us.af.mil>
> Subject: Re: [rt.rap.ucar.edu #76225] Stat Anal Issue
>
> Hi Bob. Unfortunately, John is on travel this week. I ran
> stat_analysis
using the data and config file that you uploaded, however, I am unable
to reproduce your results. I am not as familiar with stat_analysis as
John is. He should be able to help you, but unfortunately, it may not
be until next week. Thanks in advance for your patience.
>
> Julie
>
>
>
> On Wed, May 4, 2016 at 11:51 AM, robert.craig.2 at us.af.mil via RT <
met_help at ucar.edu> wrote:
>
> >
> > Wed May 04 11:51:50 2016: Request 76225 was acted upon.
> > Transaction: Ticket created by robert.craig.2 at us.af.mil
> > Queue: met_help
> > Subject: Stat Anal Issue
> > Owner: Nobody
> > Requestors: robert.craig.2 at us.af.mil
> > Status: new
> > Ticket <URL:
> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=76225
> > >
> >
> >
> > John, I am running a stat analysis job looking for MPR lines in
> > .stat files ( the config file is attached). When I run this with
> > the fcst_thresh and ob_thresh set to empty, everything runs fine
and
> > I get
output.
> > However, when I run the job with obs_thresh set to [<8046], I get
no
lines
> > returned. The .stat files it is reading has many cases where the
ob
value
> > is less than 8046 (visibility in meters). I included some on the
ftp
> > site. Below is output from the run.
> >
> > DEBUG 3: Processing STAT file
> >
"/h/data/global/WXQC/data/met/data/filtered/point_stat_MEPS20KM_300000L_20160321_060000V.stat"
> > ... 3151 of 3157
> > DEBUG 3: Processing STAT file
> >
"/h/data/global/WXQC/data/met/data/filtered/point_stat_MEPS20KM_480000L_20160317_120000V.stat"
> > ... 3152 of 3157
> > DEBUG 3: Processing STAT file
> >
"/h/data/global/WXQC/data/met/data/filtered/point_stat_GALWEM_150000L_20160319_030000V.stat"
> > ..... 3153 of 3157
> > DEBUG 3: Processing STAT file
> >
"/h/data/global/WXQC/data/met/data/filtered/point_stat_GCWRF_330000L_20160401_090000V.stat"
> > ...... 3154 of 3157
> > DEBUG 3: Processing STAT file
> >
"/h/data/global/WXQC/data/met/data/filtered/point_stat_GCWRF_420000L_20160310_180000V.stat"
> > ...... 3155 of 3157
> > DEBUG 3: Processing STAT file
> >
"/h/data/global/WXQC/data/met/data/filtered/point_stat_GCWRF_210000L_20160313_210000V.stat"
> > ...... 3156 of 3157
> > DEBUG 3: Processing STAT file
> >
"/h/data/global/WXQC/data/met/data/filtered/point_stat_GALWEM_240000L_20160409_120000V.stat"
> > ..... 3157 of 3157
> > DEBUG 2: STAT Lines read = 3678048
> > DEBUG 2: STAT Lines retained = 0
> > DEBUG 4:
> > DEBUG 4: Initializing Job 1 to default job: "-model GALWEM
> > -fcst_lead
> > 120000 -fcst_init_beg 20160301_000000 -fcst_init_end
20160419_000000
> > -obs_thresh <8046 -line_type MPR -vif_flag 1 "
> > DEBUG 4:
> > DEBUG 4: Amending Job 1 with options: "-job aggregate_stat
> > -out_line_type CNT -dump_row
/h/data/global/WXQC/data/met/filter_job.stat"
> > DEBUG 4:
> > DEBUG 4: Amending Job 1 with command line options: "(nul)"
> > DEBUG 2:
> > DEBUG 2: Processing Job 1: -job aggregate_stat -model GALWEM
> > -fcst_lead
> > 120000 -fcst_init_beg 20160301_000000 -fcst_init_end
20160419_000000
> > -obs_thresh <8046 -line_type MPR -dump_row
> > /h/data/global/WXQC/data/met/filter_job.stat -out_line_type CNT
> > -out_alpha
> > 0.05000 -boot_interval 2 -boot_rep_prop 1.00000 -n_boot_rep 0
> > -boot_rng
> > mt19937 -rank_corr_flag 1 -vif_flag 1 DEBUG 1: Creating dump row
> > output file "/h/data/global/WXQC/data/met/filter_job.stat"
> > GSL_RNG_TYPE=mt19937
> > GSL_RNG_SEED=18446744073377294935
> > DEBUG 2: Computing output for 0 case(s).
> > WARNING:
> > WARNING: do_job_aggr_stat() -> no matching STAT lines found for
job:
> > -job aggregate_stat -model GALWEM -fcst_lead 120000 -fcst_init_beg
> > 20160301_000000 -fcst_init_end 20160419_000000 -obs_thresh <8046
> > -line_type MPR -dump_row
> > /h/data/global/WXQC/data/met/filter_job.stat
> > -out_line_type CNT -out_alpha 0.05000 -boot_interval 2
> > -boot_rep_prop
> > 1.00000 -n_boot_rep
> > 0 -boot_rng mt19937 -rank_corr_flag 1 -vif_flag 1
> > WARNING:
> > DEBUG 2: Job 1 used 0 out of 0 STAT lines.
> > ['GALWEM', '15', '20160301', '20160419', 'CNT']
> > ['/h/WXQC/met-5.1/bin/stat_analysis', '-lookin',
> > '/h/data/global/WXQC/data/met/data/filtered', '-out',
> > '/h/data/global/WXQC/data/met/summary/GALWEM_dust_15hr_cont_CNT',
> > '-config', '/h/WXQC/met-5
> >
> >
> >
> >
> >
> >
> >
>
>
> --
> Julie Prestopnik
> National Center for Atmospheric Research Research Applications
> Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
>
>
------------------------------------------------
Subject: Stat Anal Issue
From: Julie Prestopnik
Time: Wed May 04 15:10:41 2016
Perhaps I misunderstood. I thought you got output when you had the
thresholds empty.
Julie
On May 4, 2016 3:08 PM, "robert.craig.2 at us.af.mil via RT"
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=76225 >
>
> Julie, So you did duplicate my results. Okay, I will wait until
next week.
>
> Thanks
> Bob
>
> -----Original Message-----
> From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> Sent: Wednesday, May 04, 2016 4:06 PM
> To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
<robert.craig.2 at us.af.mil>
> Subject: RE: [rt.rap.ucar.edu #76225] Stat Anal Issue
>
> Actually, no. I got 0 in both cases.
>
> Julie
>
> On May 4, 2016 3:00 PM, "robert.craig.2 at us.af.mil via RT" <
> met_help at ucar.edu>
> wrote:
>
> >
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=76225 >
> >
> > Julie, I take it you were able to get some lines in the .stat file
to
> > be
> used?
> >
> > Bob
> >
> > -----Original Message-----
> > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > Sent: Wednesday, May 04, 2016 2:15 PM
> > To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
> > <robert.craig.2 at us.af.mil>
> > Subject: Re: [rt.rap.ucar.edu #76225] Stat Anal Issue
> >
> > Hi Bob. Unfortunately, John is on travel this week. I ran
> > stat_analysis
> using the data and config file that you uploaded, however, I am
unable to
> reproduce your results. I am not as familiar with stat_analysis as
John
> is. He should be able to help you, but unfortunately, it may not be
until
> next week. Thanks in advance for your patience.
> >
> > Julie
> >
> >
> >
> > On Wed, May 4, 2016 at 11:51 AM, robert.craig.2 at us.af.mil via RT <
> met_help at ucar.edu> wrote:
> >
> > >
> > > Wed May 04 11:51:50 2016: Request 76225 was acted upon.
> > > Transaction: Ticket created by robert.craig.2 at us.af.mil
> > > Queue: met_help
> > > Subject: Stat Anal Issue
> > > Owner: Nobody
> > > Requestors: robert.craig.2 at us.af.mil
> > > Status: new
> > > Ticket <URL:
> > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=76225
> > > >
> > >
> > >
> > > John, I am running a stat analysis job looking for MPR lines in
> > > .stat files ( the config file is attached). When I run this
with
> > > the fcst_thresh and ob_thresh set to empty, everything runs fine
and
> > > I get
> output.
> > > However, when I run the job with obs_thresh set to [<8046], I
get no
> lines
> > > returned. The .stat files it is reading has many cases where
the ob
> value
> > > is less than 8046 (visibility in meters). I included some on
the ftp
> > > site. Below is output from the run.
> > >
> > > DEBUG 3: Processing STAT file
> > >
>
>
"/h/data/global/WXQC/data/met/data/filtered/point_stat_MEPS20KM_300000L_20160321_060000V.stat"
> > > ... 3151 of 3157
> > > DEBUG 3: Processing STAT file
> > >
>
>
"/h/data/global/WXQC/data/met/data/filtered/point_stat_MEPS20KM_480000L_20160317_120000V.stat"
> > > ... 3152 of 3157
> > > DEBUG 3: Processing STAT file
> > >
>
>
"/h/data/global/WXQC/data/met/data/filtered/point_stat_GALWEM_150000L_20160319_030000V.stat"
> > > ..... 3153 of 3157
> > > DEBUG 3: Processing STAT file
> > >
>
>
"/h/data/global/WXQC/data/met/data/filtered/point_stat_GCWRF_330000L_20160401_090000V.stat"
> > > ...... 3154 of 3157
> > > DEBUG 3: Processing STAT file
> > >
>
>
"/h/data/global/WXQC/data/met/data/filtered/point_stat_GCWRF_420000L_20160310_180000V.stat"
> > > ...... 3155 of 3157
> > > DEBUG 3: Processing STAT file
> > >
>
>
"/h/data/global/WXQC/data/met/data/filtered/point_stat_GCWRF_210000L_20160313_210000V.stat"
> > > ...... 3156 of 3157
> > > DEBUG 3: Processing STAT file
> > >
>
>
"/h/data/global/WXQC/data/met/data/filtered/point_stat_GALWEM_240000L_20160409_120000V.stat"
> > > ..... 3157 of 3157
> > > DEBUG 2: STAT Lines read = 3678048
> > > DEBUG 2: STAT Lines retained = 0
> > > DEBUG 4:
> > > DEBUG 4: Initializing Job 1 to default job: "-model GALWEM
> > > -fcst_lead
> > > 120000 -fcst_init_beg 20160301_000000 -fcst_init_end
20160419_000000
> > > -obs_thresh <8046 -line_type MPR -vif_flag 1 "
> > > DEBUG 4:
> > > DEBUG 4: Amending Job 1 with options: "-job aggregate_stat
> > > -out_line_type CNT -dump_row
> /h/data/global/WXQC/data/met/filter_job.stat"
> > > DEBUG 4:
> > > DEBUG 4: Amending Job 1 with command line options: "(nul)"
> > > DEBUG 2:
> > > DEBUG 2: Processing Job 1: -job aggregate_stat -model GALWEM
> > > -fcst_lead
> > > 120000 -fcst_init_beg 20160301_000000 -fcst_init_end
20160419_000000
> > > -obs_thresh <8046 -line_type MPR -dump_row
> > > /h/data/global/WXQC/data/met/filter_job.stat -out_line_type CNT
> > > -out_alpha
> > > 0.05000 -boot_interval 2 -boot_rep_prop 1.00000 -n_boot_rep 0
> > > -boot_rng
> > > mt19937 -rank_corr_flag 1 -vif_flag 1 DEBUG 1: Creating dump row
> > > output file "/h/data/global/WXQC/data/met/filter_job.stat"
> > > GSL_RNG_TYPE=mt19937
> > > GSL_RNG_SEED=18446744073377294935
> > > DEBUG 2: Computing output for 0 case(s).
> > > WARNING:
> > > WARNING: do_job_aggr_stat() -> no matching STAT lines found for
job:
> > > -job aggregate_stat -model GALWEM -fcst_lead 120000
-fcst_init_beg
> > > 20160301_000000 -fcst_init_end 20160419_000000 -obs_thresh <8046
> > > -line_type MPR -dump_row
> > > /h/data/global/WXQC/data/met/filter_job.stat
> > > -out_line_type CNT -out_alpha 0.05000 -boot_interval 2
> > > -boot_rep_prop
> > > 1.00000 -n_boot_rep
> > > 0 -boot_rng mt19937 -rank_corr_flag 1 -vif_flag 1
> > > WARNING:
> > > DEBUG 2: Job 1 used 0 out of 0 STAT lines.
> > > ['GALWEM', '15', '20160301', '20160419', 'CNT']
> > > ['/h/WXQC/met-5.1/bin/stat_analysis', '-lookin',
> > > '/h/data/global/WXQC/data/met/data/filtered', '-out',
> > >
'/h/data/global/WXQC/data/met/summary/GALWEM_dust_15hr_cont_CNT',
> > > '-config', '/h/WXQC/met-5
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> >
> >
> > --
> > Julie Prestopnik
> > National Center for Atmospheric Research Research Applications
> > Laboratory
> > Phone: 303.497.8399
> > Email: jpresto at ucar.edu
> >
> >
> >
>
>
>
>
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #76225] Stat Anal Issue
From: robert.craig.2 at us.af.mil
Time: Wed May 04 15:12:40 2016
No, I was not getting data when the threshold was set though there
seemed to be data below the threshold that should have been used.
Bob
-----Original Message-----
From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
Sent: Wednesday, May 04, 2016 4:11 PM
To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
<robert.craig.2 at us.af.mil>
Subject: RE: [rt.rap.ucar.edu #76225] Stat Anal Issue
Perhaps I misunderstood. I thought you got output when you had the
thresholds empty.
Julie
On May 4, 2016 3:08 PM, "robert.craig.2 at us.af.mil via RT"
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=76225 >
>
> Julie, So you did duplicate my results. Okay, I will wait until
next week.
>
> Thanks
> Bob
>
> -----Original Message-----
> From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> Sent: Wednesday, May 04, 2016 4:06 PM
> To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
> <robert.craig.2 at us.af.mil>
> Subject: RE: [rt.rap.ucar.edu #76225] Stat Anal Issue
>
> Actually, no. I got 0 in both cases.
>
> Julie
>
> On May 4, 2016 3:00 PM, "robert.craig.2 at us.af.mil via RT" <
> met_help at ucar.edu>
> wrote:
>
> >
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=76225 >
> >
> > Julie, I take it you were able to get some lines in the .stat file
> > to be
> used?
> >
> > Bob
> >
> > -----Original Message-----
> > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > Sent: Wednesday, May 04, 2016 2:15 PM
> > To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
> > <robert.craig.2 at us.af.mil>
> > Subject: Re: [rt.rap.ucar.edu #76225] Stat Anal Issue
> >
> > Hi Bob. Unfortunately, John is on travel this week. I ran
> > stat_analysis
> using the data and config file that you uploaded, however, I am
unable
> to reproduce your results. I am not as familiar with stat_analysis
as
> John is. He should be able to help you, but unfortunately, it may
not
> be until next week. Thanks in advance for your patience.
> >
> > Julie
> >
> >
> >
> > On Wed, May 4, 2016 at 11:51 AM, robert.craig.2 at us.af.mil via RT <
> met_help at ucar.edu> wrote:
> >
> > >
> > > Wed May 04 11:51:50 2016: Request 76225 was acted upon.
> > > Transaction: Ticket created by robert.craig.2 at us.af.mil
> > > Queue: met_help
> > > Subject: Stat Anal Issue
> > > Owner: Nobody
> > > Requestors: robert.craig.2 at us.af.mil
> > > Status: new
> > > Ticket <URL:
> > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=76225
> > > >
> > >
> > >
> > > John, I am running a stat analysis job looking for MPR lines in
> > > .stat files ( the config file is attached). When I run this
with
> > > the fcst_thresh and ob_thresh set to empty, everything runs fine
> > > and I get
> output.
> > > However, when I run the job with obs_thresh set to [<8046], I
get
> > > no
> lines
> > > returned. The .stat files it is reading has many cases where
the ob
> value
> > > is less than 8046 (visibility in meters). I included some on
the ftp
> > > site. Below is output from the run.
> > >
> > > DEBUG 3: Processing STAT file
> > >
>
>
"/h/data/global/WXQC/data/met/data/filtered/point_stat_MEPS20KM_300000L_20160321_060000V.stat"
> > > ... 3151 of 3157
> > > DEBUG 3: Processing STAT file
> > >
>
>
"/h/data/global/WXQC/data/met/data/filtered/point_stat_MEPS20KM_480000L_20160317_120000V.stat"
> > > ... 3152 of 3157
> > > DEBUG 3: Processing STAT file
> > >
>
>
"/h/data/global/WXQC/data/met/data/filtered/point_stat_GALWEM_150000L_20160319_030000V.stat"
> > > ..... 3153 of 3157
> > > DEBUG 3: Processing STAT file
> > >
>
>
"/h/data/global/WXQC/data/met/data/filtered/point_stat_GCWRF_330000L_20160401_090000V.stat"
> > > ...... 3154 of 3157
> > > DEBUG 3: Processing STAT file
> > >
>
>
"/h/data/global/WXQC/data/met/data/filtered/point_stat_GCWRF_420000L_20160310_180000V.stat"
> > > ...... 3155 of 3157
> > > DEBUG 3: Processing STAT file
> > >
>
>
"/h/data/global/WXQC/data/met/data/filtered/point_stat_GCWRF_210000L_20160313_210000V.stat"
> > > ...... 3156 of 3157
> > > DEBUG 3: Processing STAT file
> > >
>
>
"/h/data/global/WXQC/data/met/data/filtered/point_stat_GALWEM_240000L_20160409_120000V.stat"
> > > ..... 3157 of 3157
> > > DEBUG 2: STAT Lines read = 3678048
> > > DEBUG 2: STAT Lines retained = 0
> > > DEBUG 4:
> > > DEBUG 4: Initializing Job 1 to default job: "-model GALWEM
> > > -fcst_lead
> > > 120000 -fcst_init_beg 20160301_000000 -fcst_init_end
> > > 20160419_000000 -obs_thresh <8046 -line_type MPR -vif_flag 1 "
> > > DEBUG 4:
> > > DEBUG 4: Amending Job 1 with options: "-job aggregate_stat
> > > -out_line_type CNT -dump_row
> /h/data/global/WXQC/data/met/filter_job.stat"
> > > DEBUG 4:
> > > DEBUG 4: Amending Job 1 with command line options: "(nul)"
> > > DEBUG 2:
> > > DEBUG 2: Processing Job 1: -job aggregate_stat -model GALWEM
> > > -fcst_lead
> > > 120000 -fcst_init_beg 20160301_000000 -fcst_init_end
> > > 20160419_000000 -obs_thresh <8046 -line_type MPR -dump_row
> > > /h/data/global/WXQC/data/met/filter_job.stat -out_line_type CNT
> > > -out_alpha
> > > 0.05000 -boot_interval 2 -boot_rep_prop 1.00000 -n_boot_rep 0
> > > -boot_rng
> > > mt19937 -rank_corr_flag 1 -vif_flag 1 DEBUG 1: Creating dump row
> > > output file "/h/data/global/WXQC/data/met/filter_job.stat"
> > > GSL_RNG_TYPE=mt19937
> > > GSL_RNG_SEED=18446744073377294935
> > > DEBUG 2: Computing output for 0 case(s).
> > > WARNING:
> > > WARNING: do_job_aggr_stat() -> no matching STAT lines found for
job:
> > > -job aggregate_stat -model GALWEM -fcst_lead 120000
-fcst_init_beg
> > > 20160301_000000 -fcst_init_end 20160419_000000 -obs_thresh <8046
> > > -line_type MPR -dump_row
> > > /h/data/global/WXQC/data/met/filter_job.stat
> > > -out_line_type CNT -out_alpha 0.05000 -boot_interval 2
> > > -boot_rep_prop
> > > 1.00000 -n_boot_rep
> > > 0 -boot_rng mt19937 -rank_corr_flag 1 -vif_flag 1
> > > WARNING:
> > > DEBUG 2: Job 1 used 0 out of 0 STAT lines.
> > > ['GALWEM', '15', '20160301', '20160419', 'CNT']
> > > ['/h/WXQC/met-5.1/bin/stat_analysis', '-lookin',
> > > '/h/data/global/WXQC/data/met/data/filtered', '-out',
> > >
'/h/data/global/WXQC/data/met/summary/GALWEM_dust_15hr_cont_CNT',
> > > '-config', '/h/WXQC/met-5
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> >
> >
> > --
> > Julie Prestopnik
> > National Center for Atmospheric Research Research Applications
> > Laboratory
> > Phone: 303.497.8399
> > Email: jpresto at ucar.edu
> >
> >
> >
>
>
>
>
------------------------------------------------
Subject: Stat Anal Issue
From: John Halley Gotway
Time: Wed May 04 20:48:34 2016
Bob,
Good news. We can make this work. The problem is just a
misunderstanding
of how to filter the data. There are 3 options in play here... and I
suspect that the 3rd one is what you really need.
(1) The .stat data contains 21 header columns, two of which are
FCST_THRESH
and OBS_THRESH. These columns indicate the thresholds that were
applied
for the data in that line. For example, the CTC line contains counts
for a
2x2 contingency table the FCST_THRESH and OBS_THRESH columns indicate
the
thresholds used to define that table. The sample data you sent us
contains
a lot of matched pair data (MPR line type) and the FCST_THRESH and
OBS_THRESH columns contains NA because thresholds don't apply to the
MPR
line type.
In STAT-Analysis, the -fcst_thresh and -obs_thresh command line
options
(and config file options) are used to filter the corresponding
FCST_THRESH
and OBS_THRESH data columns. Since the MPR line type has NA in this,
these
are *NOT* what you want to use.
That's why "-obs_thresh <8046" results in 0 matching lines. The
OBS_THRESH
column contains NA in the MPR line type.
(2) STAT-Analysis has the ability to read MPR lines and compute
statistics. They could be used to compute continuous statistics,
which do
not require any threshold information... or used to compute
categorical
statistics which *DO* require output thresholds to be defined. The
-out_fcst_thresh and -out_obs_thresh job command options are used to
define
the output threshold which should be applied. For example, the
following
stat-analysis job would read MPR lines, threshold it, and compute
contingency table statistics:
stat_analysis -lookin *.stat -job aggregate_stat -line_type MPR
-out_line_type CTS -out_fcst_thresh lt8046 -out_obs_thresh lt8046
Again I suspect this is *NOT* what you're trying to do.
(3) Lastly, I suspect what you really want to do is what we call
"conditional verification"... read the MPR lines, keep only those
where the
OBS column is <8046, and compute continuous statistics using that
subset of
data. You do that using the "-column_thresh" job command option.
That
option requires a column name followed by a threshold. For example:
-column_thresh OBS lt8046
I ran the following job on the data you sent us:
stat_analysis -lookin *.stat -job aggregate_stat -line_type MPR
-out_line_type CNT -n_boot_rep 0 -rank_corr_flag false
That job uses 115443 MPR lines of data. When I add in the
-column_thresh
argument, the job uses only 42712 lines:
stat_analysis -lookin *.stat -job aggregate_stat -line_type MPR
-out_line_type CNT -n_boot_rep 0 -rank_corr_flag false -column_thresh
OBS
lt8046
So the "-column_thresh" option is used to define a numerical threshold
for
a column of data.
Some more info...
- Notice that I disabled bootstrapping (-n_boot_rep 0) and rank
correlation
stats (-rank_corr_flag false). Those can be very slow when processing
100K+ obs. Using the default settings will make your job run much
longer.
- Earlier versions of MET could only do conditional vx using STAT-
Analysis,
as you're doing. MET version 5.1 enables you to do this directly in
Point-Stat if you'd like. Look at "cnt_thresh" and "cnt_logic" config
file
options. These could be used to compute conditional continuous
statistics
and partial sums directly with Point-Stat.
Please let us know if you have more issues or questions about this.
Thanks,
John
On Wed, May 4, 2016 at 5:12 PM, robert.craig.2 at us.af.mil via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=76225 >
>
> No, I was not getting data when the threshold was set though there
seemed
> to be data below the threshold that should have been used.
>
> Bob
>
> -----Original Message-----
> From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> Sent: Wednesday, May 04, 2016 4:11 PM
> To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
<robert.craig.2 at us.af.mil>
> Subject: RE: [rt.rap.ucar.edu #76225] Stat Anal Issue
>
> Perhaps I misunderstood. I thought you got output when you had the
> thresholds empty.
>
> Julie
> On May 4, 2016 3:08 PM, "robert.craig.2 at us.af.mil via RT" <
> met_help at ucar.edu>
> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=76225 >
> >
> > Julie, So you did duplicate my results. Okay, I will wait until
next
> week.
> >
> > Thanks
> > Bob
> >
> > -----Original Message-----
> > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > Sent: Wednesday, May 04, 2016 4:06 PM
> > To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
> > <robert.craig.2 at us.af.mil>
> > Subject: RE: [rt.rap.ucar.edu #76225] Stat Anal Issue
> >
> > Actually, no. I got 0 in both cases.
> >
> > Julie
> >
> > On May 4, 2016 3:00 PM, "robert.craig.2 at us.af.mil via RT" <
> > met_help at ucar.edu>
> > wrote:
> >
> > >
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=76225 >
> > >
> > > Julie, I take it you were able to get some lines in the .stat
file
> > > to be
> > used?
> > >
> > > Bob
> > >
> > > -----Original Message-----
> > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > Sent: Wednesday, May 04, 2016 2:15 PM
> > > To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
> > > <robert.craig.2 at us.af.mil>
> > > Subject: Re: [rt.rap.ucar.edu #76225] Stat Anal Issue
> > >
> > > Hi Bob. Unfortunately, John is on travel this week. I ran
> > > stat_analysis
> > using the data and config file that you uploaded, however, I am
unable
> > to reproduce your results. I am not as familiar with
stat_analysis as
> > John is. He should be able to help you, but unfortunately, it may
not
> > be until next week. Thanks in advance for your patience.
> > >
> > > Julie
> > >
> > >
> > >
> > > On Wed, May 4, 2016 at 11:51 AM, robert.craig.2 at us.af.mil via RT
<
> > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > Wed May 04 11:51:50 2016: Request 76225 was acted upon.
> > > > Transaction: Ticket created by robert.craig.2 at us.af.mil
> > > > Queue: met_help
> > > > Subject: Stat Anal Issue
> > > > Owner: Nobody
> > > > Requestors: robert.craig.2 at us.af.mil
> > > > Status: new
> > > > Ticket <URL:
> > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=76225
> > > > >
> > > >
> > > >
> > > > John, I am running a stat analysis job looking for MPR lines
in
> > > > .stat files ( the config file is attached). When I run this
with
> > > > the fcst_thresh and ob_thresh set to empty, everything runs
fine
> > > > and I get
> > output.
> > > > However, when I run the job with obs_thresh set to [<8046], I
get
> > > > no
> > lines
> > > > returned. The .stat files it is reading has many cases where
the ob
> > value
> > > > is less than 8046 (visibility in meters). I included some on
the
> ftp
> > > > site. Below is output from the run.
> > > >
> > > > DEBUG 3: Processing STAT file
> > > >
> >
> >
>
"/h/data/global/WXQC/data/met/data/filtered/point_stat_MEPS20KM_300000L_20160321_060000V.stat"
> > > > ... 3151 of 3157
> > > > DEBUG 3: Processing STAT file
> > > >
> >
> >
>
"/h/data/global/WXQC/data/met/data/filtered/point_stat_MEPS20KM_480000L_20160317_120000V.stat"
> > > > ... 3152 of 3157
> > > > DEBUG 3: Processing STAT file
> > > >
> >
> >
>
"/h/data/global/WXQC/data/met/data/filtered/point_stat_GALWEM_150000L_20160319_030000V.stat"
> > > > ..... 3153 of 3157
> > > > DEBUG 3: Processing STAT file
> > > >
> >
> >
>
"/h/data/global/WXQC/data/met/data/filtered/point_stat_GCWRF_330000L_20160401_090000V.stat"
> > > > ...... 3154 of 3157
> > > > DEBUG 3: Processing STAT file
> > > >
> >
> >
>
"/h/data/global/WXQC/data/met/data/filtered/point_stat_GCWRF_420000L_20160310_180000V.stat"
> > > > ...... 3155 of 3157
> > > > DEBUG 3: Processing STAT file
> > > >
> >
> >
>
"/h/data/global/WXQC/data/met/data/filtered/point_stat_GCWRF_210000L_20160313_210000V.stat"
> > > > ...... 3156 of 3157
> > > > DEBUG 3: Processing STAT file
> > > >
> >
> >
>
"/h/data/global/WXQC/data/met/data/filtered/point_stat_GALWEM_240000L_20160409_120000V.stat"
> > > > ..... 3157 of 3157
> > > > DEBUG 2: STAT Lines read = 3678048
> > > > DEBUG 2: STAT Lines retained = 0
> > > > DEBUG 4:
> > > > DEBUG 4: Initializing Job 1 to default job: "-model GALWEM
> > > > -fcst_lead
> > > > 120000 -fcst_init_beg 20160301_000000 -fcst_init_end
> > > > 20160419_000000 -obs_thresh <8046 -line_type MPR -vif_flag 1 "
> > > > DEBUG 4:
> > > > DEBUG 4: Amending Job 1 with options: "-job aggregate_stat
> > > > -out_line_type CNT -dump_row
> > /h/data/global/WXQC/data/met/filter_job.stat"
> > > > DEBUG 4:
> > > > DEBUG 4: Amending Job 1 with command line options: "(nul)"
> > > > DEBUG 2:
> > > > DEBUG 2: Processing Job 1: -job aggregate_stat -model GALWEM
> > > > -fcst_lead
> > > > 120000 -fcst_init_beg 20160301_000000 -fcst_init_end
> > > > 20160419_000000 -obs_thresh <8046 -line_type MPR -dump_row
> > > > /h/data/global/WXQC/data/met/filter_job.stat -out_line_type
CNT
> > > > -out_alpha
> > > > 0.05000 -boot_interval 2 -boot_rep_prop 1.00000 -n_boot_rep 0
> > > > -boot_rng
> > > > mt19937 -rank_corr_flag 1 -vif_flag 1 DEBUG 1: Creating dump
row
> > > > output file "/h/data/global/WXQC/data/met/filter_job.stat"
> > > > GSL_RNG_TYPE=mt19937
> > > > GSL_RNG_SEED=18446744073377294935
> > > > DEBUG 2: Computing output for 0 case(s).
> > > > WARNING:
> > > > WARNING: do_job_aggr_stat() -> no matching STAT lines found
for job:
> > > > -job aggregate_stat -model GALWEM -fcst_lead 120000
-fcst_init_beg
> > > > 20160301_000000 -fcst_init_end 20160419_000000 -obs_thresh
<8046
> > > > -line_type MPR -dump_row
> > > > /h/data/global/WXQC/data/met/filter_job.stat
> > > > -out_line_type CNT -out_alpha 0.05000 -boot_interval 2
> > > > -boot_rep_prop
> > > > 1.00000 -n_boot_rep
> > > > 0 -boot_rng mt19937 -rank_corr_flag 1 -vif_flag 1
> > > > WARNING:
> > > > DEBUG 2: Job 1 used 0 out of 0 STAT lines.
> > > > ['GALWEM', '15', '20160301', '20160419', 'CNT']
> > > > ['/h/WXQC/met-5.1/bin/stat_analysis', '-lookin',
> > > > '/h/data/global/WXQC/data/met/data/filtered', '-out',
> > > >
'/h/data/global/WXQC/data/met/summary/GALWEM_dust_15hr_cont_CNT',
> > > > '-config', '/h/WXQC/met-5
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > >
> > >
> > > --
> > > Julie Prestopnik
> > > National Center for Atmospheric Research Research Applications
> > > Laboratory
> > > Phone: 303.497.8399
> > > Email: jpresto at ucar.edu
> > >
> > >
> > >
> >
> >
> >
> >
>
>
>
>
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #76225] Stat Anal Issue
From: robert.craig.2 at us.af.mil
Time: Thu May 05 06:50:17 2016
Thanks John, that’s is what I needed.
-----Original Message-----
From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
Sent: Wednesday, May 04, 2016 9:49 PM
To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
<robert.craig.2 at us.af.mil>
Subject: Re: [rt.rap.ucar.edu #76225] Stat Anal Issue
Bob,
Good news. We can make this work. The problem is just a
misunderstanding of how to filter the data. There are 3 options in
play here... and I suspect that the 3rd one is what you really need.
(1) The .stat data contains 21 header columns, two of which are
FCST_THRESH and OBS_THRESH. These columns indicate the thresholds
that were applied for the data in that line. For example, the CTC
line contains counts for a
2x2 contingency table the FCST_THRESH and OBS_THRESH columns indicate
the thresholds used to define that table. The sample data you sent us
contains a lot of matched pair data (MPR line type) and the
FCST_THRESH and OBS_THRESH columns contains NA because thresholds
don't apply to the MPR line type.
In STAT-Analysis, the -fcst_thresh and -obs_thresh command line
options (and config file options) are used to filter the corresponding
FCST_THRESH and OBS_THRESH data columns. Since the MPR line type has
NA in this, these are *NOT* what you want to use.
That's why "-obs_thresh <8046" results in 0 matching lines. The
OBS_THRESH column contains NA in the MPR line type.
(2) STAT-Analysis has the ability to read MPR lines and compute
statistics. They could be used to compute continuous statistics,
which do not require any threshold information... or used to compute
categorical statistics which *DO* require output thresholds to be
defined. The -out_fcst_thresh and -out_obs_thresh job command options
are used to define the output threshold which should be applied. For
example, the following stat-analysis job would read MPR lines,
threshold it, and compute contingency table statistics:
stat_analysis -lookin *.stat -job aggregate_stat -line_type MPR
-out_line_type CTS -out_fcst_thresh lt8046 -out_obs_thresh lt8046
Again I suspect this is *NOT* what you're trying to do.
(3) Lastly, I suspect what you really want to do is what we call
"conditional verification"... read the MPR lines, keep only those
where the OBS column is <8046, and compute continuous statistics using
that subset of data. You do that using the "-column_thresh" job
command option. That option requires a column name followed by a
threshold. For example:
-column_thresh OBS lt8046
I ran the following job on the data you sent us:
stat_analysis -lookin *.stat -job aggregate_stat -line_type MPR
-out_line_type CNT -n_boot_rep 0 -rank_corr_flag false
That job uses 115443 MPR lines of data. When I add in the
-column_thresh argument, the job uses only 42712 lines:
stat_analysis -lookin *.stat -job aggregate_stat -line_type MPR
-out_line_type CNT -n_boot_rep 0 -rank_corr_flag false -column_thresh
OBS
lt8046
So the "-column_thresh" option is used to define a numerical threshold
for a column of data.
Some more info...
- Notice that I disabled bootstrapping (-n_boot_rep 0) and rank
correlation stats (-rank_corr_flag false). Those can be very slow
when processing
100K+ obs. Using the default settings will make your job run much
longer.
- Earlier versions of MET could only do conditional vx using STAT-
Analysis, as you're doing. MET version 5.1 enables you to do this
directly in Point-Stat if you'd like. Look at "cnt_thresh" and
"cnt_logic" config file options. These could be used to compute
conditional continuous statistics and partial sums directly with
Point-Stat.
Please let us know if you have more issues or questions about this.
Thanks,
John
On Wed, May 4, 2016 at 5:12 PM, robert.craig.2 at us.af.mil via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=76225 >
>
> No, I was not getting data when the threshold was set though there
> seemed to be data below the threshold that should have been used.
>
> Bob
>
> -----Original Message-----
> From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> Sent: Wednesday, May 04, 2016 4:11 PM
> To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
> <robert.craig.2 at us.af.mil>
> Subject: RE: [rt.rap.ucar.edu #76225] Stat Anal Issue
>
> Perhaps I misunderstood. I thought you got output when you had the
> thresholds empty.
>
> Julie
> On May 4, 2016 3:08 PM, "robert.craig.2 at us.af.mil via RT" <
> met_help at ucar.edu>
> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=76225 >
> >
> > Julie, So you did duplicate my results. Okay, I will wait until
> > next
> week.
> >
> > Thanks
> > Bob
> >
> > -----Original Message-----
> > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > Sent: Wednesday, May 04, 2016 4:06 PM
> > To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
> > <robert.craig.2 at us.af.mil>
> > Subject: RE: [rt.rap.ucar.edu #76225] Stat Anal Issue
> >
> > Actually, no. I got 0 in both cases.
> >
> > Julie
> >
> > On May 4, 2016 3:00 PM, "robert.craig.2 at us.af.mil via RT" <
> > met_help at ucar.edu>
> > wrote:
> >
> > >
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=76225 >
> > >
> > > Julie, I take it you were able to get some lines in the .stat
file
> > > to be
> > used?
> > >
> > > Bob
> > >
> > > -----Original Message-----
> > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > Sent: Wednesday, May 04, 2016 2:15 PM
> > > To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
> > > <robert.craig.2 at us.af.mil>
> > > Subject: Re: [rt.rap.ucar.edu #76225] Stat Anal Issue
> > >
> > > Hi Bob. Unfortunately, John is on travel this week. I ran
> > > stat_analysis
> > using the data and config file that you uploaded, however, I am
> > unable to reproduce your results. I am not as familiar with
> > stat_analysis as John is. He should be able to help you, but
> > unfortunately, it may not be until next week. Thanks in advance
for your patience.
> > >
> > > Julie
> > >
> > >
> > >
> > > On Wed, May 4, 2016 at 11:51 AM, robert.craig.2 at us.af.mil via RT
<
> > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > Wed May 04 11:51:50 2016: Request 76225 was acted upon.
> > > > Transaction: Ticket created by robert.craig.2 at us.af.mil
> > > > Queue: met_help
> > > > Subject: Stat Anal Issue
> > > > Owner: Nobody
> > > > Requestors: robert.craig.2 at us.af.mil
> > > > Status: new
> > > > Ticket <URL:
> > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=76225
> > > > >
> > > >
> > > >
> > > > John, I am running a stat analysis job looking for MPR lines
in
> > > > .stat files ( the config file is attached). When I run this
> > > > with the fcst_thresh and ob_thresh set to empty, everything
runs
> > > > fine and I get
> > output.
> > > > However, when I run the job with obs_thresh set to [<8046], I
> > > > get no
> > lines
> > > > returned. The .stat files it is reading has many cases where
the ob
> > value
> > > > is less than 8046 (visibility in meters). I included some on
the
> ftp
> > > > site. Below is output from the run.
> > > >
> > > > DEBUG 3: Processing STAT file
> > > >
> >
> >
>
"/h/data/global/WXQC/data/met/data/filtered/point_stat_MEPS20KM_300000L_20160321_060000V.stat"
> > > > ... 3151 of 3157
> > > > DEBUG 3: Processing STAT file
> > > >
> >
> >
>
"/h/data/global/WXQC/data/met/data/filtered/point_stat_MEPS20KM_480000L_20160317_120000V.stat"
> > > > ... 3152 of 3157
> > > > DEBUG 3: Processing STAT file
> > > >
> >
> >
>
"/h/data/global/WXQC/data/met/data/filtered/point_stat_GALWEM_150000L_20160319_030000V.stat"
> > > > ..... 3153 of 3157
> > > > DEBUG 3: Processing STAT file
> > > >
> >
> >
>
"/h/data/global/WXQC/data/met/data/filtered/point_stat_GCWRF_330000L_20160401_090000V.stat"
> > > > ...... 3154 of 3157
> > > > DEBUG 3: Processing STAT file
> > > >
> >
> >
>
"/h/data/global/WXQC/data/met/data/filtered/point_stat_GCWRF_420000L_20160310_180000V.stat"
> > > > ...... 3155 of 3157
> > > > DEBUG 3: Processing STAT file
> > > >
> >
> >
>
"/h/data/global/WXQC/data/met/data/filtered/point_stat_GCWRF_210000L_20160313_210000V.stat"
> > > > ...... 3156 of 3157
> > > > DEBUG 3: Processing STAT file
> > > >
> >
> >
>
"/h/data/global/WXQC/data/met/data/filtered/point_stat_GALWEM_240000L_20160409_120000V.stat"
> > > > ..... 3157 of 3157
> > > > DEBUG 2: STAT Lines read = 3678048
> > > > DEBUG 2: STAT Lines retained = 0 DEBUG 4:
> > > > DEBUG 4: Initializing Job 1 to default job: "-model GALWEM
> > > > -fcst_lead
> > > > 120000 -fcst_init_beg 20160301_000000 -fcst_init_end
> > > > 20160419_000000 -obs_thresh <8046 -line_type MPR -vif_flag 1 "
> > > > DEBUG 4:
> > > > DEBUG 4: Amending Job 1 with options: "-job aggregate_stat
> > > > -out_line_type CNT -dump_row
> > /h/data/global/WXQC/data/met/filter_job.stat"
> > > > DEBUG 4:
> > > > DEBUG 4: Amending Job 1 with command line options: "(nul)"
> > > > DEBUG 2:
> > > > DEBUG 2: Processing Job 1: -job aggregate_stat -model GALWEM
> > > > -fcst_lead
> > > > 120000 -fcst_init_beg 20160301_000000 -fcst_init_end
> > > > 20160419_000000 -obs_thresh <8046 -line_type MPR -dump_row
> > > > /h/data/global/WXQC/data/met/filter_job.stat -out_line_type
CNT
> > > > -out_alpha
> > > > 0.05000 -boot_interval 2 -boot_rep_prop 1.00000 -n_boot_rep 0
> > > > -boot_rng
> > > > mt19937 -rank_corr_flag 1 -vif_flag 1 DEBUG 1: Creating dump
row
> > > > output file "/h/data/global/WXQC/data/met/filter_job.stat"
> > > > GSL_RNG_TYPE=mt19937
> > > > GSL_RNG_SEED=18446744073377294935 DEBUG 2: Computing output
for
> > > > 0 case(s).
> > > > WARNING:
> > > > WARNING: do_job_aggr_stat() -> no matching STAT lines found
for job:
> > > > -job aggregate_stat -model GALWEM -fcst_lead 120000
> > > > -fcst_init_beg
> > > > 20160301_000000 -fcst_init_end 20160419_000000 -obs_thresh
<8046
> > > > -line_type MPR -dump_row
> > > > /h/data/global/WXQC/data/met/filter_job.stat
> > > > -out_line_type CNT -out_alpha 0.05000 -boot_interval 2
> > > > -boot_rep_prop
> > > > 1.00000 -n_boot_rep
> > > > 0 -boot_rng mt19937 -rank_corr_flag 1 -vif_flag 1
> > > > WARNING:
> > > > DEBUG 2: Job 1 used 0 out of 0 STAT lines.
> > > > ['GALWEM', '15', '20160301', '20160419', 'CNT']
> > > > ['/h/WXQC/met-5.1/bin/stat_analysis', '-lookin',
> > > > '/h/data/global/WXQC/data/met/data/filtered', '-out',
> > > >
'/h/data/global/WXQC/data/met/summary/GALWEM_dust_15hr_cont_CNT'
> > > > ,
> > > > '-config', '/h/WXQC/met-5
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > >
> > >
> > > --
> > > Julie Prestopnik
> > > National Center for Atmospheric Research Research Applications
> > > Laboratory
> > > Phone: 303.497.8399
> > > Email: jpresto at ucar.edu
> > >
> > >
> > >
> >
> >
> >
> >
>
>
>
>
------------------------------------------------
More information about the Met_help
mailing list