[Met_help] [rt.rap.ucar.edu #78785] History for Rank in ORANK lines
John Halley Gotway via RT
met_help at ucar.edu
Thu Dec 1 15:12:01 MST 2016
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Question for the experts, what is the definition of RANK in the ORANK lines? If the observation is below all the ensemble members, is it's rank 0 or 1? I ask this because I have been getting the following error and have been trying to pin it down.
DEBUG 4:
DEBUG 4: Initializing Job 1 to default job: "-job aggregate_stat -model galwem_t47b -fcst_valid_beg 20160815_000000 -fcst_valid_end 20161030_000000 -interp_pnts 1 -line_type ORANK -by FCST_VAR -by FCST_LEAD -by INTERP_PNTS -dump_row /h/data/global/WXQC/data/met/filter_jobgalwem_t47b.stat -out_line_type RHIST "
DEBUG 4:
DEBUG 4: Amending Job 1 with options: "-job aggregate_stat -line_type ORANK -out_line_type RHIST -fcst_valid_beg 20160815 -fcst_valid_end 20161030 -by FCST_VAR -by FCST_LEAD -by INTERP_PNTS -interp_pnts 1 -model galwem_t47b -dump_row /h/data/global/WXQC/data/met/filter_jobgalwem_t47b.stat"
DEBUG 4:
DEBUG 4: Amending Job 1 with command line options: "-job aggregate_stat -line_type ORANK -out_line_type RHIST -fcst_valid_beg 20160815 -fcst_valid_end 20161030 -by FCST_VAR -by FCST_LEAD -by INTERP_PNTS -interp_pnts 1 -model galwem_t47b -dump_row /h/data/global/WXQC/data/met/filter_jobgalwem_t47b.stat"
DEBUG 2:
DEBUG 2: Processing Job 1: -job aggregate_stat -model galwem_t47b -fcst_valid_beg 20160815_000000 -fcst_valid_end 20161030_000000 -interp_pnts 1 -line_type ORANK -by FCST_VAR -by FCST_LEAD -by INTERP_PNTS -dump_row /h/data/global/WXQC/data/met/filter_jobgalwem_t47b.stat -out_line_type RHIST
DEBUG 1: Creating dump row output file "/h/data/global/WXQC/data/met/filter_jobgalwem_t47b.stat"
GSL_RNG_TYPE=mt19937
GSL_RNG_SEED=785202520
ERROR :
ERROR : NumArray::operator[](int) const -> range check error
Thanks
Bob Craig
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: Rank in ORANK lines
From: John Halley Gotway
Time: Tue Nov 29 12:35:37 2016
Bob,
If you have N ensemble members, the rank of the observation will range
from
1 to N+1. 1 means that the observation value is below all of the
ensemble
values. N+1 means that it's above all of them.
If possible, please send me a sample data file and stat_analysis job
which
replicates the error you're getting. My first guess is that maybe it
has
to do with different versions. Perhaps the data was generated with an
older version of MET and you're running a newer version of
stat_analysis?
Maybe we failed to make it backward compatible when we intended to? I
can
see the version listed in the data you send me, but please tell me the
version of stat_analysis you're running.
Thanks,
John Halley Gotway
On Tue, Nov 29, 2016 at 12:21 PM, robert.craig.2 at us.af.mil via RT <
met_help at ucar.edu> wrote:
>
> Tue Nov 29 12:21:38 2016: Request 78785 was acted upon.
> Transaction: Ticket created by robert.craig.2 at us.af.mil
> Queue: met_help
> Subject: Rank in ORANK lines
> Owner: Nobody
> Requestors: robert.craig.2 at us.af.mil
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=78785 >
>
>
> Question for the experts, what is the definition of RANK in the
ORANK
> lines? If the observation is below all the ensemble members, is
it's rank
> 0 or 1? I ask this because I have been getting the following error
and
> have been trying to pin it down.
>
> DEBUG 4:
> DEBUG 4: Initializing Job 1 to default job: "-job aggregate_stat
-model
> galwem_t47b -fcst_valid_beg 20160815_000000 -fcst_valid_end
20161030_000000
> -interp_pnts 1 -line_type ORANK -by FCST_VAR -by FCST_LEAD -by
INTERP_PNTS
> -dump_row /h/data/global/WXQC/data/met/filter_jobgalwem_t47b.stat
> -out_line_type RHIST "
> DEBUG 4:
> DEBUG 4: Amending Job 1 with options: "-job aggregate_stat
-line_type
> ORANK -out_line_type RHIST -fcst_valid_beg 20160815 -fcst_valid_end
> 20161030 -by FCST_VAR -by FCST_LEAD -by INTERP_PNTS -interp_pnts 1
-model
> galwem_t47b -dump_row /h/data/global/WXQC/data/met/
> filter_jobgalwem_t47b.stat"
> DEBUG 4:
> DEBUG 4: Amending Job 1 with command line options: "-job
aggregate_stat
> -line_type ORANK -out_line_type RHIST -fcst_valid_beg 20160815
> -fcst_valid_end 20161030 -by FCST_VAR -by FCST_LEAD -by INTERP_PNTS
> -interp_pnts 1 -model galwem_t47b -dump_row
/h/data/global/WXQC/data/met/
> filter_jobgalwem_t47b.stat"
> DEBUG 2:
> DEBUG 2: Processing Job 1: -job aggregate_stat -model galwem_t47b
> -fcst_valid_beg 20160815_000000 -fcst_valid_end 20161030_000000
> -interp_pnts 1 -line_type ORANK -by FCST_VAR -by FCST_LEAD -by
INTERP_PNTS
> -dump_row /h/data/global/WXQC/data/met/filter_jobgalwem_t47b.stat
> -out_line_type RHIST
> DEBUG 1: Creating dump row output file
"/h/data/global/WXQC/data/met/
> filter_jobgalwem_t47b.stat"
> GSL_RNG_TYPE=mt19937
> GSL_RNG_SEED=785202520
> ERROR :
> ERROR : NumArray::operator[](int) const -> range check error
>
> Thanks
>
> Bob Craig
>
>
>
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #78785] Rank in ORANK lines
From: robert.craig.2 at us.af.mil
Time: Tue Nov 29 12:40:58 2016
Thanks, now that I know the proper rank terminology, let me fix my
code an run again. If the error persists, I will send you the
pertinent files.
Bob
-----Original Message-----
From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
Sent: Tuesday, November 29, 2016 1:36 PM
To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
<robert.craig.2 at us.af.mil>
Subject: Re: [rt.rap.ucar.edu #78785] Rank in ORANK lines
Bob,
If you have N ensemble members, the rank of the observation will range
from
1 to N+1. 1 means that the observation value is below all of the
ensemble values. N+1 means that it's above all of them.
If possible, please send me a sample data file and stat_analysis job
which replicates the error you're getting. My first guess is that
maybe it has to do with different versions. Perhaps the data was
generated with an older version of MET and you're running a newer
version of stat_analysis?
Maybe we failed to make it backward compatible when we intended to? I
can see the version listed in the data you send me, but please tell me
the version of stat_analysis you're running.
Thanks,
John Halley Gotway
On Tue, Nov 29, 2016 at 12:21 PM, robert.craig.2 at us.af.mil via RT <
met_help at ucar.edu> wrote:
>
> Tue Nov 29 12:21:38 2016: Request 78785 was acted upon.
> Transaction: Ticket created by robert.craig.2 at us.af.mil
> Queue: met_help
> Subject: Rank in ORANK lines
> Owner: Nobody
> Requestors: robert.craig.2 at us.af.mil
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=78785
> >
>
>
> Question for the experts, what is the definition of RANK in the
ORANK
> lines? If the observation is below all the ensemble members, is
it's
> rank
> 0 or 1? I ask this because I have been getting the following error
> and have been trying to pin it down.
>
> DEBUG 4:
> DEBUG 4: Initializing Job 1 to default job: "-job aggregate_stat
> -model galwem_t47b -fcst_valid_beg 20160815_000000 -fcst_valid_end
> 20161030_000000 -interp_pnts 1 -line_type ORANK -by FCST_VAR -by
> FCST_LEAD -by INTERP_PNTS -dump_row
> /h/data/global/WXQC/data/met/filter_jobgalwem_t47b.stat
> -out_line_type RHIST "
> DEBUG 4:
> DEBUG 4: Amending Job 1 with options: "-job aggregate_stat
-line_type
> ORANK -out_line_type RHIST -fcst_valid_beg 20160815 -fcst_valid_end
> 20161030 -by FCST_VAR -by FCST_LEAD -by INTERP_PNTS -interp_pnts 1
> -model galwem_t47b -dump_row /h/data/global/WXQC/data/met/
> filter_jobgalwem_t47b.stat"
> DEBUG 4:
> DEBUG 4: Amending Job 1 with command line options: "-job
> aggregate_stat -line_type ORANK -out_line_type RHIST -fcst_valid_beg
> 20160815 -fcst_valid_end 20161030 -by FCST_VAR -by FCST_LEAD -by
> INTERP_PNTS -interp_pnts 1 -model galwem_t47b -dump_row
> /h/data/global/WXQC/data/met/ filter_jobgalwem_t47b.stat"
> DEBUG 2:
> DEBUG 2: Processing Job 1: -job aggregate_stat -model galwem_t47b
> -fcst_valid_beg 20160815_000000 -fcst_valid_end 20161030_000000
> -interp_pnts 1 -line_type ORANK -by FCST_VAR -by FCST_LEAD -by
> INTERP_PNTS -dump_row
> /h/data/global/WXQC/data/met/filter_jobgalwem_t47b.stat
> -out_line_type RHIST
> DEBUG 1: Creating dump row output file
"/h/data/global/WXQC/data/met/
> filter_jobgalwem_t47b.stat"
> GSL_RNG_TYPE=mt19937
> GSL_RNG_SEED=785202520
> ERROR :
> ERROR : NumArray::operator[](int) const -> range check error
>
> Thanks
>
> Bob Craig
>
>
>
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #78785] Rank in ORANK lines
From: robert.craig.2 at us.af.mil
Time: Tue Nov 29 13:30:39 2016
Hi John, I fixed the ranks but am still getting the error so I sent
the ORANK files I was reading to the ftp site. The command I am
running is below:
['/h/WXQC/met-5.1/bin/stat_analysis', '-lookin',
'/h/data/global/WXQC/data/met/mdlob_pairs/TT', '-out',
'/h/data/global/WXQC/data/met/summary/wrf_t47b_121_TT_RHIST', '-
tmp_dir', '/h/data/global/WXQC/data/met/tmp', '-job aggregate_stat',
'-line_type ORANK', '-out_line_type RHIST', '-fcst_valid_beg
20160815', '-fcst_valid_end 20160816', '-by FCST_VAR', '-by
FCST_LEAD', '-by INTERP_PNTS', '-interp_pnts ', '121', '-model',
'wrf_t47b', '-dump_row
/h/data/global/WXQC/data/met/filter_jobwrf_t47b.stat', '-v', '6']
The error I get is below:
DEBUG 3: Processing STAT file
"/h/data/global/WXQC/data/met/mdlob_pairs/TT/point_stat_9_P_TT_galwem_t47b_240000L_20161012_000000V.stat"
..... 4578 of 4578
DEBUG 2: STAT Lines read = 513405
DEBUG 2: STAT Lines retained = 1368
DEBUG 4:
DEBUG 4: Initializing Job 1 to default job: "-job aggregate_stat
-model wrf_t47b -fcst_valid_beg 20160815_000000 -fcst_valid_end
20160816_000000 -interp_pnts 121 -line_type ORANK -by FCST_VAR -by
FCST_LEAD -by INTERP_PNTS -dump_row
/h/data/global/WXQC/data/met/filter_jobwrf_t47b.stat -out_line_type
RHIST "
DEBUG 4:
DEBUG 4: Amending Job 1 with options: "-job aggregate_stat -line_type
ORANK -out_line_type RHIST -fcst_valid_beg 20160815 -fcst_valid_end
20160816 -by FCST_VAR -by FCST_LEAD -by INTERP_PNTS -interp_pnts 121
-model wrf_t47b -dump_row
/h/data/global/WXQC/data/met/filter_jobwrf_t47b.stat"
DEBUG 4:
DEBUG 4: Amending Job 1 with command line options: "-job
aggregate_stat -line_type ORANK -out_line_type RHIST -fcst_valid_beg
20160815 -fcst_valid_end 20160816 -by FCST_VAR -by FCST_LEAD -by
INTERP_PNTS -interp_pnts 121 -model wrf_t47b -dump_row
/h/data/global/WXQC/data/met/filter_jobwrf_t47b.stat"
DEBUG 2:
DEBUG 2: Processing Job 1: -job aggregate_stat -model wrf_t47b
-fcst_valid_beg 20160815_000000 -fcst_valid_end 20160816_000000
-interp_pnts 121 -line_type ORANK -by FCST_VAR -by FCST_LEAD -by
INTERP_PNTS -dump_row
/h/data/global/WXQC/data/met/filter_jobwrf_t47b.stat -out_line_type
RHIST
DEBUG 1: Creating dump row output file
"/h/data/global/WXQC/data/met/filter_jobwrf_t47b.stat"
GSL_RNG_TYPE=mt19937
GSL_RNG_SEED=1306803544
ERROR :
ERROR : NumArray::operator[](int) const -> range check error
ERROR :
Also, another question, normally the CRPS calculation is supposed to
revert to MAE if you only have one member (a deterministic model).
When I one for just one member the CRPS will be NA. If it doesn't
revert then I will calculate the MAE using stat_anal on MPR file.
Thanks
Bob Craig
-----Original Message-----
From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
Sent: Tuesday, November 29, 2016 1:36 PM
To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
<robert.craig.2 at us.af.mil>
Subject: Re: [rt.rap.ucar.edu #78785] Rank in ORANK lines
Bob,
If you have N ensemble members, the rank of the observation will range
from
1 to N+1. 1 means that the observation value is below all of the
ensemble values. N+1 means that it's above all of them.
If possible, please send me a sample data file and stat_analysis job
which replicates the error you're getting. My first guess is that
maybe it has to do with different versions. Perhaps the data was
generated with an older version of MET and you're running a newer
version of stat_analysis?
Maybe we failed to make it backward compatible when we intended to? I
can see the version listed in the data you send me, but please tell me
the version of stat_analysis you're running.
Thanks,
John Halley Gotway
On Tue, Nov 29, 2016 at 12:21 PM, robert.craig.2 at us.af.mil via RT <
met_help at ucar.edu> wrote:
>
> Tue Nov 29 12:21:38 2016: Request 78785 was acted upon.
> Transaction: Ticket created by robert.craig.2 at us.af.mil
> Queue: met_help
> Subject: Rank in ORANK lines
> Owner: Nobody
> Requestors: robert.craig.2 at us.af.mil
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=78785
> >
>
>
> Question for the experts, what is the definition of RANK in the
ORANK
> lines? If the observation is below all the ensemble members, is
it's
> rank
> 0 or 1? I ask this because I have been getting the following error
> and have been trying to pin it down.
>
> DEBUG 4:
> DEBUG 4: Initializing Job 1 to default job: "-job aggregate_stat
> -model galwem_t47b -fcst_valid_beg 20160815_000000 -fcst_valid_end
> 20161030_000000 -interp_pnts 1 -line_type ORANK -by FCST_VAR -by
> FCST_LEAD -by INTERP_PNTS -dump_row
> /h/data/global/WXQC/data/met/filter_jobgalwem_t47b.stat
> -out_line_type RHIST "
> DEBUG 4:
> DEBUG 4: Amending Job 1 with options: "-job aggregate_stat
-line_type
> ORANK -out_line_type RHIST -fcst_valid_beg 20160815 -fcst_valid_end
> 20161030 -by FCST_VAR -by FCST_LEAD -by INTERP_PNTS -interp_pnts 1
> -model galwem_t47b -dump_row /h/data/global/WXQC/data/met/
> filter_jobgalwem_t47b.stat"
> DEBUG 4:
> DEBUG 4: Amending Job 1 with command line options: "-job
> aggregate_stat -line_type ORANK -out_line_type RHIST -fcst_valid_beg
> 20160815 -fcst_valid_end 20161030 -by FCST_VAR -by FCST_LEAD -by
> INTERP_PNTS -interp_pnts 1 -model galwem_t47b -dump_row
> /h/data/global/WXQC/data/met/ filter_jobgalwem_t47b.stat"
> DEBUG 2:
> DEBUG 2: Processing Job 1: -job aggregate_stat -model galwem_t47b
> -fcst_valid_beg 20160815_000000 -fcst_valid_end 20161030_000000
> -interp_pnts 1 -line_type ORANK -by FCST_VAR -by FCST_LEAD -by
> INTERP_PNTS -dump_row
> /h/data/global/WXQC/data/met/filter_jobgalwem_t47b.stat
> -out_line_type RHIST
> DEBUG 1: Creating dump row output file
"/h/data/global/WXQC/data/met/
> filter_jobgalwem_t47b.stat"
> GSL_RNG_TYPE=mt19937
> GSL_RNG_SEED=785202520
> ERROR :
> ERROR : NumArray::operator[](int) const -> range check error
>
> Thanks
>
> Bob Craig
>
>
>
------------------------------------------------
Subject: Rank in ORANK lines
From: John Halley Gotway
Time: Tue Nov 29 14:31:12 2016
Bob,
I believe that error is still being caused by your use of the 0 as a
rank.
Take a look on line number 85 of this file:
point_stat_121_P_TT_wrf_t47b_060000L_20160815_060000V.stat
The RANK column is assigned a value of 0. Probably should be 1 I
suppose.
But actually all the ensemble values on that line look bad. For 2m
temperature they're all set to a value of 0, which in kelvin would be
very
cold!
John
On Tue, Nov 29, 2016 at 1:30 PM, robert.craig.2 at us.af.mil via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=78785 >
>
> Hi John, I fixed the ranks but am still getting the error so I sent
the
> ORANK files I was reading to the ftp site. The command I am
running is
> below:
>
> ['/h/WXQC/met-5.1/bin/stat_analysis', '-lookin',
> '/h/data/global/WXQC/data/met/mdlob_pairs/TT', '-out',
> '/h/data/global/WXQC/data/met/summary/wrf_t47b_121_TT_RHIST', '-
tmp_dir',
> '/h/data/global/WXQC/data/met/tmp', '-job aggregate_stat', '-
line_type
> ORANK', '-out_line_type RHIST', '-fcst_valid_beg 20160815',
> '-fcst_valid_end 20160816', '-by FCST_VAR', '-by FCST_LEAD', '-by
> INTERP_PNTS', '-interp_pnts ', '121', '-model', 'wrf_t47b', '-
dump_row
> /h/data/global/WXQC/data/met/filter_jobwrf_t47b.stat', '-v', '6']
>
> The error I get is below:
>
> DEBUG 3: Processing STAT file "/h/data/global/WXQC/data/met/
>
mdlob_pairs/TT/point_stat_9_P_TT_galwem_t47b_240000L_20161012_000000V.stat"
> ..... 4578 of 4578
> DEBUG 2: STAT Lines read = 513405
> DEBUG 2: STAT Lines retained = 1368
> DEBUG 4:
> DEBUG 4: Initializing Job 1 to default job: "-job aggregate_stat
-model
> wrf_t47b -fcst_valid_beg 20160815_000000 -fcst_valid_end
20160816_000000
> -interp_pnts 121 -line_type ORANK -by FCST_VAR -by FCST_LEAD -by
> INTERP_PNTS -dump_row
/h/data/global/WXQC/data/met/filter_jobwrf_t47b.stat
> -out_line_type RHIST "
> DEBUG 4:
> DEBUG 4: Amending Job 1 with options: "-job aggregate_stat
-line_type
> ORANK -out_line_type RHIST -fcst_valid_beg 20160815 -fcst_valid_end
> 20160816 -by FCST_VAR -by FCST_LEAD -by INTERP_PNTS -interp_pnts
121
> -model wrf_t47b -dump_row /h/data/global/WXQC/data/met/
> filter_jobwrf_t47b.stat"
> DEBUG 4:
> DEBUG 4: Amending Job 1 with command line options: "-job
aggregate_stat
> -line_type ORANK -out_line_type RHIST -fcst_valid_beg 20160815
> -fcst_valid_end 20160816 -by FCST_VAR -by FCST_LEAD -by INTERP_PNTS
> -interp_pnts 121 -model wrf_t47b -dump_row
/h/data/global/WXQC/data/met/
> filter_jobwrf_t47b.stat"
> DEBUG 2:
> DEBUG 2: Processing Job 1: -job aggregate_stat -model wrf_t47b
> -fcst_valid_beg 20160815_000000 -fcst_valid_end 20160816_000000
> -interp_pnts 121 -line_type ORANK -by FCST_VAR -by FCST_LEAD -by
> INTERP_PNTS -dump_row
/h/data/global/WXQC/data/met/filter_jobwrf_t47b.stat
> -out_line_type RHIST
> DEBUG 1: Creating dump row output file
"/h/data/global/WXQC/data/met/
> filter_jobwrf_t47b.stat"
> GSL_RNG_TYPE=mt19937
> GSL_RNG_SEED=1306803544
> ERROR :
> ERROR : NumArray::operator[](int) const -> range check error
> ERROR :
>
> Also, another question, normally the CRPS calculation is supposed to
> revert to MAE if you only have one member (a deterministic model).
When I
> one for just one member the CRPS will be NA. If it doesn't revert
then I
> will calculate the MAE using stat_anal on MPR file.
>
> Thanks
> Bob Craig
>
> -----Original Message-----
> From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> Sent: Tuesday, November 29, 2016 1:36 PM
> To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
<robert.craig.2 at us.af.mil>
> Subject: Re: [rt.rap.ucar.edu #78785] Rank in ORANK lines
>
> Bob,
>
> If you have N ensemble members, the rank of the observation will
range from
> 1 to N+1. 1 means that the observation value is below all of the
ensemble
> values. N+1 means that it's above all of them.
>
> If possible, please send me a sample data file and stat_analysis job
which
> replicates the error you're getting. My first guess is that maybe
it has
> to do with different versions. Perhaps the data was generated with
an
> older version of MET and you're running a newer version of
stat_analysis?
> Maybe we failed to make it backward compatible when we intended to?
I can
> see the version listed in the data you send me, but please tell me
the
> version of stat_analysis you're running.
>
> Thanks,
> John Halley Gotway
>
> On Tue, Nov 29, 2016 at 12:21 PM, robert.craig.2 at us.af.mil via RT <
> met_help at ucar.edu> wrote:
>
> >
> > Tue Nov 29 12:21:38 2016: Request 78785 was acted upon.
> > Transaction: Ticket created by robert.craig.2 at us.af.mil
> > Queue: met_help
> > Subject: Rank in ORANK lines
> > Owner: Nobody
> > Requestors: robert.craig.2 at us.af.mil
> > Status: new
> > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=78785
> > >
> >
> >
> > Question for the experts, what is the definition of RANK in the
ORANK
> > lines? If the observation is below all the ensemble members, is
it's
> > rank
> > 0 or 1? I ask this because I have been getting the following
error
> > and have been trying to pin it down.
> >
> > DEBUG 4:
> > DEBUG 4: Initializing Job 1 to default job: "-job aggregate_stat
> > -model galwem_t47b -fcst_valid_beg 20160815_000000 -fcst_valid_end
> > 20161030_000000 -interp_pnts 1 -line_type ORANK -by FCST_VAR -by
> > FCST_LEAD -by INTERP_PNTS -dump_row
> > /h/data/global/WXQC/data/met/filter_jobgalwem_t47b.stat
> > -out_line_type RHIST "
> > DEBUG 4:
> > DEBUG 4: Amending Job 1 with options: "-job aggregate_stat
-line_type
> > ORANK -out_line_type RHIST -fcst_valid_beg 20160815
-fcst_valid_end
> > 20161030 -by FCST_VAR -by FCST_LEAD -by INTERP_PNTS -interp_pnts
1
> > -model galwem_t47b -dump_row /h/data/global/WXQC/data/met/
> > filter_jobgalwem_t47b.stat"
> > DEBUG 4:
> > DEBUG 4: Amending Job 1 with command line options: "-job
> > aggregate_stat -line_type ORANK -out_line_type RHIST
-fcst_valid_beg
> > 20160815 -fcst_valid_end 20161030 -by FCST_VAR -by FCST_LEAD -by
> > INTERP_PNTS -interp_pnts 1 -model galwem_t47b -dump_row
> > /h/data/global/WXQC/data/met/ filter_jobgalwem_t47b.stat"
> > DEBUG 2:
> > DEBUG 2: Processing Job 1: -job aggregate_stat -model galwem_t47b
> > -fcst_valid_beg 20160815_000000 -fcst_valid_end 20161030_000000
> > -interp_pnts 1 -line_type ORANK -by FCST_VAR -by FCST_LEAD -by
> > INTERP_PNTS -dump_row
> > /h/data/global/WXQC/data/met/filter_jobgalwem_t47b.stat
> > -out_line_type RHIST
> > DEBUG 1: Creating dump row output file
"/h/data/global/WXQC/data/met/
> > filter_jobgalwem_t47b.stat"
> > GSL_RNG_TYPE=mt19937
> > GSL_RNG_SEED=785202520
> > ERROR :
> > ERROR : NumArray::operator[](int) const -> range check error
> >
> > Thanks
> >
> > Bob Craig
> >
> >
> >
>
>
>
>
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #78785] Rank in ORANK lines
From: robert.craig.2 at us.af.mil
Time: Tue Nov 29 14:57:42 2016
Okay, thanks. I should never assume all my data is good. I will fix
and try again.
Bob
-----Original Message-----
From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
Sent: Tuesday, November 29, 2016 3:31 PM
To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
<robert.craig.2 at us.af.mil>
Subject: Re: [rt.rap.ucar.edu #78785] Rank in ORANK lines
Bob,
I believe that error is still being caused by your use of the 0 as a
rank.
Take a look on line number 85 of this file:
point_stat_121_P_TT_wrf_t47b_060000L_20160815_060000V.stat
The RANK column is assigned a value of 0. Probably should be 1 I
suppose.
But actually all the ensemble values on that line look bad. For 2m
temperature they're all set to a value of 0, which in kelvin would be
very cold!
John
On Tue, Nov 29, 2016 at 1:30 PM, robert.craig.2 at us.af.mil via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=78785 >
>
> Hi John, I fixed the ranks but am still getting the error so I sent
> the ORANK files I was reading to the ftp site. The command I am
> running is
> below:
>
> ['/h/WXQC/met-5.1/bin/stat_analysis', '-lookin',
> '/h/data/global/WXQC/data/met/mdlob_pairs/TT', '-out',
> '/h/data/global/WXQC/data/met/summary/wrf_t47b_121_TT_RHIST',
> '-tmp_dir', '/h/data/global/WXQC/data/met/tmp', '-job
aggregate_stat',
> '-line_type ORANK', '-out_line_type RHIST', '-fcst_valid_beg
> 20160815', '-fcst_valid_end 20160816', '-by FCST_VAR', '-by
> FCST_LEAD', '-by INTERP_PNTS', '-interp_pnts ', '121', '-model',
> 'wrf_t47b', '-dump_row
> /h/data/global/WXQC/data/met/filter_jobwrf_t47b.stat', '-v', '6']
>
> The error I get is below:
>
> DEBUG 3: Processing STAT file "/h/data/global/WXQC/data/met/
>
mdlob_pairs/TT/point_stat_9_P_TT_galwem_t47b_240000L_20161012_000000V.stat"
> ..... 4578 of 4578
> DEBUG 2: STAT Lines read = 513405
> DEBUG 2: STAT Lines retained = 1368
> DEBUG 4:
> DEBUG 4: Initializing Job 1 to default job: "-job aggregate_stat
> -model wrf_t47b -fcst_valid_beg 20160815_000000 -fcst_valid_end
> 20160816_000000 -interp_pnts 121 -line_type ORANK -by FCST_VAR -by
> FCST_LEAD -by INTERP_PNTS -dump_row
> /h/data/global/WXQC/data/met/filter_jobwrf_t47b.stat
> -out_line_type RHIST "
> DEBUG 4:
> DEBUG 4: Amending Job 1 with options: "-job aggregate_stat
-line_type
> ORANK -out_line_type RHIST -fcst_valid_beg 20160815 -fcst_valid_end
> 20160816 -by FCST_VAR -by FCST_LEAD -by INTERP_PNTS -interp_pnts
121
> -model wrf_t47b -dump_row /h/data/global/WXQC/data/met/
> filter_jobwrf_t47b.stat"
> DEBUG 4:
> DEBUG 4: Amending Job 1 with command line options: "-job
> aggregate_stat -line_type ORANK -out_line_type RHIST -fcst_valid_beg
> 20160815 -fcst_valid_end 20160816 -by FCST_VAR -by FCST_LEAD -by
> INTERP_PNTS -interp_pnts 121 -model wrf_t47b -dump_row
> /h/data/global/WXQC/data/met/ filter_jobwrf_t47b.stat"
> DEBUG 2:
> DEBUG 2: Processing Job 1: -job aggregate_stat -model wrf_t47b
> -fcst_valid_beg 20160815_000000 -fcst_valid_end 20160816_000000
> -interp_pnts 121 -line_type ORANK -by FCST_VAR -by FCST_LEAD -by
> INTERP_PNTS -dump_row
> /h/data/global/WXQC/data/met/filter_jobwrf_t47b.stat
> -out_line_type RHIST
> DEBUG 1: Creating dump row output file
"/h/data/global/WXQC/data/met/
> filter_jobwrf_t47b.stat"
> GSL_RNG_TYPE=mt19937
> GSL_RNG_SEED=1306803544
> ERROR :
> ERROR : NumArray::operator[](int) const -> range check error ERROR
:
>
> Also, another question, normally the CRPS calculation is supposed to
> revert to MAE if you only have one member (a deterministic model).
When I
> one for just one member the CRPS will be NA. If it doesn't revert
> then I will calculate the MAE using stat_anal on MPR file.
>
> Thanks
> Bob Craig
>
> -----Original Message-----
> From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> Sent: Tuesday, November 29, 2016 1:36 PM
> To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
> <robert.craig.2 at us.af.mil>
> Subject: Re: [rt.rap.ucar.edu #78785] Rank in ORANK lines
>
> Bob,
>
> If you have N ensemble members, the rank of the observation will
range
> from
> 1 to N+1. 1 means that the observation value is below all of the
> ensemble values. N+1 means that it's above all of them.
>
> If possible, please send me a sample data file and stat_analysis job
> which replicates the error you're getting. My first guess is that
> maybe it has to do with different versions. Perhaps the data was
> generated with an older version of MET and you're running a newer
version of stat_analysis?
> Maybe we failed to make it backward compatible when we intended to?
I
> can see the version listed in the data you send me, but please tell
me
> the version of stat_analysis you're running.
>
> Thanks,
> John Halley Gotway
>
> On Tue, Nov 29, 2016 at 12:21 PM, robert.craig.2 at us.af.mil via RT <
> met_help at ucar.edu> wrote:
>
> >
> > Tue Nov 29 12:21:38 2016: Request 78785 was acted upon.
> > Transaction: Ticket created by robert.craig.2 at us.af.mil
> > Queue: met_help
> > Subject: Rank in ORANK lines
> > Owner: Nobody
> > Requestors: robert.craig.2 at us.af.mil
> > Status: new
> > Ticket <URL:
> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=78785
> > >
> >
> >
> > Question for the experts, what is the definition of RANK in the
> > ORANK lines? If the observation is below all the ensemble
members,
> > is it's rank
> > 0 or 1? I ask this because I have been getting the following
error
> > and have been trying to pin it down.
> >
> > DEBUG 4:
> > DEBUG 4: Initializing Job 1 to default job: "-job aggregate_stat
> > -model galwem_t47b -fcst_valid_beg 20160815_000000 -fcst_valid_end
> > 20161030_000000 -interp_pnts 1 -line_type ORANK -by FCST_VAR -by
> > FCST_LEAD -by INTERP_PNTS -dump_row
> > /h/data/global/WXQC/data/met/filter_jobgalwem_t47b.stat
> > -out_line_type RHIST "
> > DEBUG 4:
> > DEBUG 4: Amending Job 1 with options: "-job aggregate_stat
> > -line_type ORANK -out_line_type RHIST -fcst_valid_beg 20160815
> > -fcst_valid_end
> > 20161030 -by FCST_VAR -by FCST_LEAD -by INTERP_PNTS -interp_pnts
1
> > -model galwem_t47b -dump_row /h/data/global/WXQC/data/met/
> > filter_jobgalwem_t47b.stat"
> > DEBUG 4:
> > DEBUG 4: Amending Job 1 with command line options: "-job
> > aggregate_stat -line_type ORANK -out_line_type RHIST
-fcst_valid_beg
> > 20160815 -fcst_valid_end 20161030 -by FCST_VAR -by FCST_LEAD -by
> > INTERP_PNTS -interp_pnts 1 -model galwem_t47b -dump_row
> > /h/data/global/WXQC/data/met/ filter_jobgalwem_t47b.stat"
> > DEBUG 2:
> > DEBUG 2: Processing Job 1: -job aggregate_stat -model galwem_t47b
> > -fcst_valid_beg 20160815_000000 -fcst_valid_end 20161030_000000
> > -interp_pnts 1 -line_type ORANK -by FCST_VAR -by FCST_LEAD -by
> > INTERP_PNTS -dump_row
> > /h/data/global/WXQC/data/met/filter_jobgalwem_t47b.stat
> > -out_line_type RHIST
> > DEBUG 1: Creating dump row output file
> > "/h/data/global/WXQC/data/met/ filter_jobgalwem_t47b.stat"
> > GSL_RNG_TYPE=mt19937
> > GSL_RNG_SEED=785202520
> > ERROR :
> > ERROR : NumArray::operator[](int) const -> range check error
> >
> > Thanks
> >
> > Bob Craig
> >
> >
> >
>
>
>
>
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #78785] Rank in ORANK lines
From: robert.craig.2 at us.af.mil
Time: Wed Nov 30 08:24:35 2016
John, Now that I have removed the bad ensemble data and corrected an
error in my rank calculation, I am getting CRPS values that seem way
to high. It was my understanding that CRPS is in the units of the
field we are verifying, in this case temperature in Celsius. I have
placed the ORANK files on the ftp server - ignore the files with P_TT
in them, sent by mistake. The only field I didn't fill out in the
ORANK file is the PIT. Is this required for the CRPS calculation? If
so, what is the formula for PIT? Looking at the ORANK data the ranks
now look correct based on the information you sent yesterday. Below
is the command line I am running.
['/h/WXQC/met-5.1/bin/stat_analysis', '-lookin',
'/h/data/global/WXQC/data/met/mdlob_pairs/TT', '-out',
'/h/data/global/WXQC/data/met/summary/wrf_t47b_121_TT_RHIST', '-
tmp_dir', '/h/data/global/WXQC/data/met/tmp', '-job aggregate_stat',
'-line_type ORANK', '-out_line_type RHIST', '-fcst_valid_beg
20160815', '-fcst_valid_end 20160816', '-by FCST_VAR', '-by
FCST_LEAD', '-by INTERP_PNTS', '-interp_pnts ', '121', '-model',
'wrf_t47b', '-dump_row
/h/data/global/WXQC/data/met/filter_jobwrf_t47b.stat', '-v', '6']
Below is the output form stat_analysis by forecast hour.
JOB_LIST: -job aggregate_stat -model wrf_t47b -fcst_valid_beg
20160815_000000 -fcst_valid_end 20160816_000000 -interp_pnts 121
-line_type ORANK -by FCST_VAR -by FCST_LEAD -by INTERP_PNTS -dump_row
/h/data/global/WXQC/data/met/filter_jobwrf_t47b.stat -out_line_type
RHIST
COL_NAME: FCST_VAR FCST_LEAD INTERP_PNTS TOTAL CRPS IGN
N_RANK CRPSS RANK_1 RANK_2 RANK_3 RANK_4 RANK_5 RANK_6 RANK_7 RANK_8
RANK_9 RANK_10 RANK_11 RANK_12 RANK_13 RANK_14 RANK_15 RANK_16
RANK_17 RANK_18 RANK_19 RANK_20 RANK_21 RANK_22 RANK_23 RANK_24
RANK_25 RANK_26 RANK_27 RANK_28 RANK_29 RANK_30 RANK_31 RANK_32
RANK_33 RANK_34 RANK_35 RANK_36 RANK_37 RANK_38 RANK_39 RANK_40
RANK_41 R
ANK_42 RANK_43 RANK_44 RANK_45 RANK_46 RANK_47 RANK_48 RANK_49 RANK_50
RANK_51 RANK_52 RANK_53 RANK_54 RANK_55 RANK_56 RANK_57 RANK_58
RANK_59 RANK_60 RANK_61 RANK_62 RANK_63 RANK_64 RANK_65 RANK_66 RAN
K_67 RANK_68 RANK_69 RANK_70 RANK_71 RANK_72 RANK_73 RANK_74 RANK_75
RANK_76 RANK_77 RANK_78 RANK_79 RANK_80 RANK_81 RANK_82 RANK_83
RANK_84 RANK_85 RANK_86 RANK_87 RANK_88 RANK_89 RANK_90 RANK_91 RANK_
92 RANK_93 RANK_94 RANK_95 RANK_96 RANK_97 RANK_98 RANK_99 RANK_100
RANK_101 RANK_102 RANK_103 RANK_104 RANK_105 RANK_106 RANK_107
RANK_108 RANK_109 RANK_110 RANK_111 RANK_112 RANK_113 RANK_114
RANK_115
RANK_116 RANK_117 RANK_118 RANK_119 RANK_120 RANK_121 RANK_122
RHIST: TMP 060000 121 224 231.4896 7892135.33761
122 NA 19 0 3 0 0 1 0 0
0 1 1 0 0 0 1 1
0 0 1 1 0 2 0 0
0 0 0 0 0 1 1 0 0
0 0 0 0 0 0 1 1
1 0 2 0 0 0 0 0 1
0 2 0 1 0 0 0 1 0
1 0 0 2 1 0 0
1 0 0 3 0 1 0 0 0
0 1 0 1 1 0 1 0 1
0 0 2 0 1 1 0
0 0 1 0 1 1 1 0 1
0 2 1 2 1 1 1 1
1 1 1 1 2 1 4
1 3 5 2 3 0 124
RHIST: TMP 120000 121 224 185.16815 6460135.18147
122 NA 21 0 0 0 1 0 1 0
0 1 1 1 0 0 0 0
1 0 0 0 1 0 2 0
0 0 0 0 2 1 0 2 0
0 1 0 0 1 0 0 1
1 1 0 1 1 2 0 3 1
0 0 0 1 0 1 1 0 2
1 1 2 2 0 0 1
0 0 0 1 0 0 0 0 0
1 1 0 1 1 0 1 1 1
2 0 0 0 1 1 0
2 1 1 1 0 3 0 2 1
1 0 3 0 2 1 1 0
0 0 2 3 0 1 4
4 0 2 3 4 0 110
RHIST: TMP 180000 121 112 185.11536 3640251.9495
122 NA 12 2 0 0 0 1 1 0
0 0 0 0 2 1 0 0
0 0 1 1 0 0 0 0
0 0 0 2 0 0 0 1 1
0 0 1 0 0 1 0 1
1 0 0 0 0 1 0 0 1
0 0 0 0 0 1 0 0 0
0 0 0 1 0 2 1
0 1 1 1 0 0 0 0 0
0 1 1 0 0 1 1 0 1
0 0 0 0 1 0 2
1 0 0 2 0 0 0 0 2
0 1 1 0 1 0 0 0
0 0 0 0 1 2 1
2 1 1 1 2 0 46
RHIST: TMP 240000 121 112 185.20195 4773966.85648
122 NA 11 0 0 0 0 1 0 1
0 1 0 1 0 0 0 0
1 0 0 1 0 0 0 0
0 0 0 0 0 1 0 0 0
1 0 0 0 0 0 1 0
0 1 0 0 0 0 1 0 0
0 0 1 0 0 0 0 0 0
1 0 1 0 0 0 0
0 1 0 0 1 1 1 0 0
0 1 0 1 0 0 0 0 0
1 0 0 1 0 0 0
0 0 0 0 0 0 0 0 1
0 1 1 0 1 0 1 1
0 0 2 0 0 1 1
0 1 2 0 3 0 63
Thanks
Bob Craig
-----Original Message-----
From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
Sent: Tuesday, November 29, 2016 3:31 PM
To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
<robert.craig.2 at us.af.mil>
Subject: Re: [rt.rap.ucar.edu #78785] Rank in ORANK lines
Bob,
I believe that error is still being caused by your use of the 0 as a
rank.
Take a look on line number 85 of this file:
point_stat_121_P_TT_wrf_t47b_060000L_20160815_060000V.stat
The RANK column is assigned a value of 0. Probably should be 1 I
suppose.
But actually all the ensemble values on that line look bad. For 2m
temperature they're all set to a value of 0, which in kelvin would be
very cold!
John
On Tue, Nov 29, 2016 at 1:30 PM, robert.craig.2 at us.af.mil via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=78785 >
>
> Hi John, I fixed the ranks but am still getting the error so I sent
> the ORANK files I was reading to the ftp site. The command I am
> running is
> below:
>
> ['/h/WXQC/met-5.1/bin/stat_analysis', '-lookin',
> '/h/data/global/WXQC/data/met/mdlob_pairs/TT', '-out',
> '/h/data/global/WXQC/data/met/summary/wrf_t47b_121_TT_RHIST',
> '-tmp_dir', '/h/data/global/WXQC/data/met/tmp', '-job
aggregate_stat',
> '-line_type ORANK', '-out_line_type RHIST', '-fcst_valid_beg
> 20160815', '-fcst_valid_end 20160816', '-by FCST_VAR', '-by
> FCST_LEAD', '-by INTERP_PNTS', '-interp_pnts ', '121', '-model',
> 'wrf_t47b', '-dump_row
> /h/data/global/WXQC/data/met/filter_jobwrf_t47b.stat', '-v', '6']
>
> The error I get is below:
>
> DEBUG 3: Processing STAT file "/h/data/global/WXQC/data/met/
>
mdlob_pairs/TT/point_stat_9_P_TT_galwem_t47b_240000L_20161012_000000V.stat"
> ..... 4578 of 4578
> DEBUG 2: STAT Lines read = 513405
> DEBUG 2: STAT Lines retained = 1368
> DEBUG 4:
> DEBUG 4: Initializing Job 1 to default job: "-job aggregate_stat
> -model wrf_t47b -fcst_valid_beg 20160815_000000 -fcst_valid_end
> 20160816_000000 -interp_pnts 121 -line_type ORANK -by FCST_VAR -by
> FCST_LEAD -by INTERP_PNTS -dump_row
> /h/data/global/WXQC/data/met/filter_jobwrf_t47b.stat
> -out_line_type RHIST "
> DEBUG 4:
> DEBUG 4: Amending Job 1 with options: "-job aggregate_stat
-line_type
> ORANK -out_line_type RHIST -fcst_valid_beg 20160815 -fcst_valid_end
> 20160816 -by FCST_VAR -by FCST_LEAD -by INTERP_PNTS -interp_pnts
121
> -model wrf_t47b -dump_row /h/data/global/WXQC/data/met/
> filter_jobwrf_t47b.stat"
> DEBUG 4:
> DEBUG 4: Amending Job 1 with command line options: "-job
> aggregate_stat -line_type ORANK -out_line_type RHIST -fcst_valid_beg
> 20160815 -fcst_valid_end 20160816 -by FCST_VAR -by FCST_LEAD -by
> INTERP_PNTS -interp_pnts 121 -model wrf_t47b -dump_row
> /h/data/global/WXQC/data/met/ filter_jobwrf_t47b.stat"
> DEBUG 2:
> DEBUG 2: Processing Job 1: -job aggregate_stat -model wrf_t47b
> -fcst_valid_beg 20160815_000000 -fcst_valid_end 20160816_000000
> -interp_pnts 121 -line_type ORANK -by FCST_VAR -by FCST_LEAD -by
> INTERP_PNTS -dump_row
> /h/data/global/WXQC/data/met/filter_jobwrf_t47b.stat
> -out_line_type RHIST
> DEBUG 1: Creating dump row output file
"/h/data/global/WXQC/data/met/
> filter_jobwrf_t47b.stat"
> GSL_RNG_TYPE=mt19937
> GSL_RNG_SEED=1306803544
> ERROR :
> ERROR : NumArray::operator[](int) const -> range check error ERROR
:
>
> Also, another question, normally the CRPS calculation is supposed to
> revert to MAE if you only have one member (a deterministic model).
When I
> one for just one member the CRPS will be NA. If it doesn't revert
> then I will calculate the MAE using stat_anal on MPR file.
>
> Thanks
> Bob Craig
>
> -----Original Message-----
> From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> Sent: Tuesday, November 29, 2016 1:36 PM
> To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
> <robert.craig.2 at us.af.mil>
> Subject: Re: [rt.rap.ucar.edu #78785] Rank in ORANK lines
>
> Bob,
>
> If you have N ensemble members, the rank of the observation will
range
> from
> 1 to N+1. 1 means that the observation value is below all of the
> ensemble values. N+1 means that it's above all of them.
>
> If possible, please send me a sample data file and stat_analysis job
> which replicates the error you're getting. My first guess is that
> maybe it has to do with different versions. Perhaps the data was
> generated with an older version of MET and you're running a newer
version of stat_analysis?
> Maybe we failed to make it backward compatible when we intended to?
I
> can see the version listed in the data you send me, but please tell
me
> the version of stat_analysis you're running.
>
> Thanks,
> John Halley Gotway
>
> On Tue, Nov 29, 2016 at 12:21 PM, robert.craig.2 at us.af.mil via RT <
> met_help at ucar.edu> wrote:
>
> >
> > Tue Nov 29 12:21:38 2016: Request 78785 was acted upon.
> > Transaction: Ticket created by robert.craig.2 at us.af.mil
> > Queue: met_help
> > Subject: Rank in ORANK lines
> > Owner: Nobody
> > Requestors: robert.craig.2 at us.af.mil
> > Status: new
> > Ticket <URL:
> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=78785
> > >
> >
> >
> > Question for the experts, what is the definition of RANK in the
> > ORANK lines? If the observation is below all the ensemble
members,
> > is it's rank
> > 0 or 1? I ask this because I have been getting the following
error
> > and have been trying to pin it down.
> >
> > DEBUG 4:
> > DEBUG 4: Initializing Job 1 to default job: "-job aggregate_stat
> > -model galwem_t47b -fcst_valid_beg 20160815_000000 -fcst_valid_end
> > 20161030_000000 -interp_pnts 1 -line_type ORANK -by FCST_VAR -by
> > FCST_LEAD -by INTERP_PNTS -dump_row
> > /h/data/global/WXQC/data/met/filter_jobgalwem_t47b.stat
> > -out_line_type RHIST "
> > DEBUG 4:
> > DEBUG 4: Amending Job 1 with options: "-job aggregate_stat
> > -line_type ORANK -out_line_type RHIST -fcst_valid_beg 20160815
> > -fcst_valid_end
> > 20161030 -by FCST_VAR -by FCST_LEAD -by INTERP_PNTS -interp_pnts
1
> > -model galwem_t47b -dump_row /h/data/global/WXQC/data/met/
> > filter_jobgalwem_t47b.stat"
> > DEBUG 4:
> > DEBUG 4: Amending Job 1 with command line options: "-job
> > aggregate_stat -line_type ORANK -out_line_type RHIST
-fcst_valid_beg
> > 20160815 -fcst_valid_end 20161030 -by FCST_VAR -by FCST_LEAD -by
> > INTERP_PNTS -interp_pnts 1 -model galwem_t47b -dump_row
> > /h/data/global/WXQC/data/met/ filter_jobgalwem_t47b.stat"
> > DEBUG 2:
> > DEBUG 2: Processing Job 1: -job aggregate_stat -model galwem_t47b
> > -fcst_valid_beg 20160815_000000 -fcst_valid_end 20161030_000000
> > -interp_pnts 1 -line_type ORANK -by FCST_VAR -by FCST_LEAD -by
> > INTERP_PNTS -dump_row
> > /h/data/global/WXQC/data/met/filter_jobgalwem_t47b.stat
> > -out_line_type RHIST
> > DEBUG 1: Creating dump row output file
> > "/h/data/global/WXQC/data/met/ filter_jobgalwem_t47b.stat"
> > GSL_RNG_TYPE=mt19937
> > GSL_RNG_SEED=785202520
> > ERROR :
> > ERROR : NumArray::operator[](int) const -> range check error
> >
> > Thanks
> >
> > Bob Craig
> >
> >
> >
>
>
>
>
------------------------------------------------
Subject: Rank in ORANK lines
From: John Halley Gotway
Time: Thu Dec 01 14:43:56 2016
Bob,
Thanks for sending that sample data.
I ran the stat_analysis job you described, but for only the 6-hour
lead
time and then read the "-dump_row" output into R:
R
d =
read.table("/h/data/global/WXQC/data/met/filter_jobwrf_t47b.stat",
skip=1, header=FALSE)
d[,29]
I dumped out the 29th column which contains the observation value and
saw 5
instances of this value: -10272.20
I suspect that is a bad data value that you don't intend to include in
your
dataset?
So I added the following command line argument to skip over those
lines:
-fcst_thresh OBS ge-100
That says... look in the OBS column of the ORANK input line type and
only
keep lines where OBS >=-100.
That yielded much more reasonable CRPS values. So I'd suggest using
"-fcst_thresh" to set a reasonable range for your data and make sure
your
CRPS values look right. And then circle back to figure out why you're
getting -10272.20 showing up as an observation value.
Thanks,
John
On Wed, Nov 30, 2016 at 8:24 AM, robert.craig.2 at us.af.mil via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=78785 >
>
> John, Now that I have removed the bad ensemble data and corrected an
error
> in my rank calculation, I am getting CRPS values that seem way to
high.
> It was my understanding that CRPS is in the units of the field we
are
> verifying, in this case temperature in Celsius. I have placed the
ORANK
> files on the ftp server - ignore the files with P_TT in them, sent
by
> mistake. The only field I didn't fill out in the ORANK file is the
PIT.
> Is this required for the CRPS calculation? If so, what is the
formula for
> PIT? Looking at the ORANK data the ranks now look correct based on
the
> information you sent yesterday. Below is the command line I am
running.
>
> ['/h/WXQC/met-5.1/bin/stat_analysis', '-lookin',
> '/h/data/global/WXQC/data/met/mdlob_pairs/TT', '-out',
> '/h/data/global/WXQC/data/met/summary/wrf_t47b_121_TT_RHIST', '-
tmp_dir',
> '/h/data/global/WXQC/data/met/tmp', '-job aggregate_stat', '-
line_type
> ORANK', '-out_line_type RHIST', '-fcst_valid_beg 20160815',
> '-fcst_valid_end 20160816', '-by FCST_VAR', '-by FCST_LEAD', '-by
> INTERP_PNTS', '-interp_pnts ', '121', '-model', 'wrf_t47b', '-
dump_row
> /h/data/global/WXQC/data/met/filter_jobwrf_t47b.stat', '-v', '6']
>
> Below is the output form stat_analysis by forecast hour.
>
> JOB_LIST: -job aggregate_stat -model wrf_t47b -fcst_valid_beg
> 20160815_000000 -fcst_valid_end 20160816_000000 -interp_pnts 121
-line_type
> ORANK -by FCST_VAR -by FCST_LEAD -by INTERP_PNTS -dump_row
> /h/data/global/WXQC/data/met/filter_jobwrf_t47b.stat -out_line_type
RHIST
> COL_NAME: FCST_VAR FCST_LEAD INTERP_PNTS TOTAL CRPS
IGN
> N_RANK CRPSS RANK_1 RANK_2 RANK_3 RANK_4 RANK_5 RANK_6 RANK_7 RANK_8
RANK_9
> RANK_10 RANK_11 RANK_12 RANK_13 RANK_14 RANK_15 RANK_16
> RANK_17 RANK_18 RANK_19 RANK_20 RANK_21 RANK_22 RANK_23 RANK_24
RANK_25
> RANK_26 RANK_27 RANK_28 RANK_29 RANK_30 RANK_31 RANK_32 RANK_33
RANK_34
> RANK_35 RANK_36 RANK_37 RANK_38 RANK_39 RANK_40 RANK_41 R
> ANK_42 RANK_43 RANK_44 RANK_45 RANK_46 RANK_47 RANK_48 RANK_49
RANK_50
> RANK_51 RANK_52 RANK_53 RANK_54 RANK_55 RANK_56 RANK_57 RANK_58
RANK_59
> RANK_60 RANK_61 RANK_62 RANK_63 RANK_64 RANK_65 RANK_66 RAN
> K_67 RANK_68 RANK_69 RANK_70 RANK_71 RANK_72 RANK_73 RANK_74 RANK_75
> RANK_76 RANK_77 RANK_78 RANK_79 RANK_80 RANK_81 RANK_82 RANK_83
RANK_84
> RANK_85 RANK_86 RANK_87 RANK_88 RANK_89 RANK_90 RANK_91 RANK_
> 92 RANK_93 RANK_94 RANK_95 RANK_96 RANK_97 RANK_98 RANK_99 RANK_100
> RANK_101 RANK_102 RANK_103 RANK_104 RANK_105 RANK_106 RANK_107
RANK_108
> RANK_109 RANK_110 RANK_111 RANK_112 RANK_113 RANK_114 RANK_115
> RANK_116 RANK_117 RANK_118 RANK_119 RANK_120 RANK_121 RANK_122
> RHIST: TMP 060000 121 224 231.4896
7892135.33761
> 122 NA 19 0 3 0 0 1 0 0
0
> 1 1 0 0 0 1 1
> 0 0 1 1 0 2 0 0
0
> 0 0 0 0 1 1 0 0
0
> 0 0 0 0 0 1 1
> 1 0 2 0 0 0 0 0
1
> 0 2 0 1 0 0 0 1 0
> 1 0 0 2 1 0 0
> 1 0 0 3 0 1 0 0 0
> 0 1 0 1 1 0 1 0 1
0
> 0 2 0 1 1 0
> 0 0 1 0 1 1 1 0 1
> 0 2 1 2 1 1 1 1
1
> 1 1 1 2 1 4
> 1 3 5 2 3 0 124
> RHIST: TMP 120000 121 224 185.16815
6460135.18147
> 122 NA 21 0 0 0 1 0 1 0
0
> 1 1 1 0 0 0 0
> 1 0 0 0 1 0 2 0
0
> 0 0 0 2 1 0 2 0
0
> 1 0 0 1 0 0 1
> 1 1 0 1 1 2 0 3
1
> 0 0 0 1 0 1 1 0 2
> 1 1 2 2 0 0 1
> 0 0 0 1 0 0 0 0 0
> 1 1 0 1 1 0 1 1 1
2
> 0 0 0 1 1 0
> 2 1 1 1 0 3 0 2 1
> 1 0 3 0 2 1 1 0
0
> 0 2 3 0 1 4
> 4 0 2 3 4 0 110
> RHIST: TMP 180000 121 112 185.11536
3640251.9495
> 122 NA 12 2 0 0 0 1 1 0
0
> 0 0 0 2 1 0 0
> 0 0 1 1 0 0 0 0
0
> 0 0 2 0 0 0 1 1
0
> 0 1 0 0 1 0 1
> 1 0 0 0 0 1 0 0
1
> 0 0 0 0 0 1 0 0 0
> 0 0 0 1 0 2 1
> 0 1 1 1 0 0 0 0 0
> 0 1 1 0 0 1 1 0 1
0
> 0 0 0 1 0 2
> 1 0 0 2 0 0 0 0 2
> 0 1 1 0 1 0 0 0
0
> 0 0 0 1 2 1
> 2 1 1 1 2 0 46
> RHIST: TMP 240000 121 112 185.20195
4773966.85648
> 122 NA 11 0 0 0 0 1 0 1
0
> 1 0 1 0 0 0 0
> 1 0 0 1 0 0 0 0
0
> 0 0 0 0 1 0 0 0
1
> 0 0 0 0 0 1 0
> 0 1 0 0 0 0 1 0
0
> 0 0 1 0 0 0 0 0 0
> 1 0 1 0 0 0 0
> 0 1 0 0 1 1 1 0 0
> 0 1 0 1 0 0 0 0 0
1
> 0 0 1 0 0 0
> 0 0 0 0 0 0 0 0 1
> 0 1 1 0 1 0 1 1
0
> 0 2 0 0 1 1
> 0 1 2 0 3 0 63
>
> Thanks
> Bob Craig
>
>
> -----Original Message-----
> From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> Sent: Tuesday, November 29, 2016 3:31 PM
> To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
<robert.craig.2 at us.af.mil>
> Subject: Re: [rt.rap.ucar.edu #78785] Rank in ORANK lines
>
> Bob,
>
> I believe that error is still being caused by your use of the 0 as a
rank.
> Take a look on line number 85 of this file:
> point_stat_121_P_TT_wrf_t47b_060000L_20160815_060000V.stat
>
> The RANK column is assigned a value of 0. Probably should be 1 I
suppose.
>
> But actually all the ensemble values on that line look bad. For 2m
> temperature they're all set to a value of 0, which in kelvin would
be very
> cold!
>
> John
>
> On Tue, Nov 29, 2016 at 1:30 PM, robert.craig.2 at us.af.mil via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=78785 >
> >
> > Hi John, I fixed the ranks but am still getting the error so I
sent
> > the ORANK files I was reading to the ftp site. The command I am
> > running is
> > below:
> >
> > ['/h/WXQC/met-5.1/bin/stat_analysis', '-lookin',
> > '/h/data/global/WXQC/data/met/mdlob_pairs/TT', '-out',
> > '/h/data/global/WXQC/data/met/summary/wrf_t47b_121_TT_RHIST',
> > '-tmp_dir', '/h/data/global/WXQC/data/met/tmp', '-job
aggregate_stat',
> > '-line_type ORANK', '-out_line_type RHIST', '-fcst_valid_beg
> > 20160815', '-fcst_valid_end 20160816', '-by FCST_VAR', '-by
> > FCST_LEAD', '-by INTERP_PNTS', '-interp_pnts ', '121', '-model',
> > 'wrf_t47b', '-dump_row
> > /h/data/global/WXQC/data/met/filter_jobwrf_t47b.stat', '-v', '6']
> >
> > The error I get is below:
> >
> > DEBUG 3: Processing STAT file "/h/data/global/WXQC/data/met/
> > mdlob_pairs/TT/point_stat_9_P_TT_galwem_t47b_240000L_
> 20161012_000000V.stat"
> > ..... 4578 of 4578
> > DEBUG 2: STAT Lines read = 513405
> > DEBUG 2: STAT Lines retained = 1368
> > DEBUG 4:
> > DEBUG 4: Initializing Job 1 to default job: "-job aggregate_stat
> > -model wrf_t47b -fcst_valid_beg 20160815_000000 -fcst_valid_end
> > 20160816_000000 -interp_pnts 121 -line_type ORANK -by FCST_VAR -by
> > FCST_LEAD -by INTERP_PNTS -dump_row
> > /h/data/global/WXQC/data/met/filter_jobwrf_t47b.stat
> > -out_line_type RHIST "
> > DEBUG 4:
> > DEBUG 4: Amending Job 1 with options: "-job aggregate_stat
-line_type
> > ORANK -out_line_type RHIST -fcst_valid_beg 20160815
-fcst_valid_end
> > 20160816 -by FCST_VAR -by FCST_LEAD -by INTERP_PNTS -interp_pnts
121
> > -model wrf_t47b -dump_row /h/data/global/WXQC/data/met/
> > filter_jobwrf_t47b.stat"
> > DEBUG 4:
> > DEBUG 4: Amending Job 1 with command line options: "-job
> > aggregate_stat -line_type ORANK -out_line_type RHIST
-fcst_valid_beg
> > 20160815 -fcst_valid_end 20160816 -by FCST_VAR -by FCST_LEAD -by
> > INTERP_PNTS -interp_pnts 121 -model wrf_t47b -dump_row
> > /h/data/global/WXQC/data/met/ filter_jobwrf_t47b.stat"
> > DEBUG 2:
> > DEBUG 2: Processing Job 1: -job aggregate_stat -model wrf_t47b
> > -fcst_valid_beg 20160815_000000 -fcst_valid_end 20160816_000000
> > -interp_pnts 121 -line_type ORANK -by FCST_VAR -by FCST_LEAD -by
> > INTERP_PNTS -dump_row
> > /h/data/global/WXQC/data/met/filter_jobwrf_t47b.stat
> > -out_line_type RHIST
> > DEBUG 1: Creating dump row output file
"/h/data/global/WXQC/data/met/
> > filter_jobwrf_t47b.stat"
> > GSL_RNG_TYPE=mt19937
> > GSL_RNG_SEED=1306803544
> > ERROR :
> > ERROR : NumArray::operator[](int) const -> range check error
ERROR :
> >
> > Also, another question, normally the CRPS calculation is supposed
to
> > revert to MAE if you only have one member (a deterministic model).
> When I
> > one for just one member the CRPS will be NA. If it doesn't revert
> > then I will calculate the MAE using stat_anal on MPR file.
> >
> > Thanks
> > Bob Craig
> >
> > -----Original Message-----
> > From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> > Sent: Tuesday, November 29, 2016 1:36 PM
> > To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
> > <robert.craig.2 at us.af.mil>
> > Subject: Re: [rt.rap.ucar.edu #78785] Rank in ORANK lines
> >
> > Bob,
> >
> > If you have N ensemble members, the rank of the observation will
range
> > from
> > 1 to N+1. 1 means that the observation value is below all of the
> > ensemble values. N+1 means that it's above all of them.
> >
> > If possible, please send me a sample data file and stat_analysis
job
> > which replicates the error you're getting. My first guess is that
> > maybe it has to do with different versions. Perhaps the data was
> > generated with an older version of MET and you're running a newer
> version of stat_analysis?
> > Maybe we failed to make it backward compatible when we intended
to? I
> > can see the version listed in the data you send me, but please
tell me
> > the version of stat_analysis you're running.
> >
> > Thanks,
> > John Halley Gotway
> >
> > On Tue, Nov 29, 2016 at 12:21 PM, robert.craig.2 at us.af.mil via RT
<
> > met_help at ucar.edu> wrote:
> >
> > >
> > > Tue Nov 29 12:21:38 2016: Request 78785 was acted upon.
> > > Transaction: Ticket created by robert.craig.2 at us.af.mil
> > > Queue: met_help
> > > Subject: Rank in ORANK lines
> > > Owner: Nobody
> > > Requestors: robert.craig.2 at us.af.mil
> > > Status: new
> > > Ticket <URL:
> > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=78785
> > > >
> > >
> > >
> > > Question for the experts, what is the definition of RANK in the
> > > ORANK lines? If the observation is below all the ensemble
members,
> > > is it's rank
> > > 0 or 1? I ask this because I have been getting the following
error
> > > and have been trying to pin it down.
> > >
> > > DEBUG 4:
> > > DEBUG 4: Initializing Job 1 to default job: "-job aggregate_stat
> > > -model galwem_t47b -fcst_valid_beg 20160815_000000
-fcst_valid_end
> > > 20161030_000000 -interp_pnts 1 -line_type ORANK -by FCST_VAR -by
> > > FCST_LEAD -by INTERP_PNTS -dump_row
> > > /h/data/global/WXQC/data/met/filter_jobgalwem_t47b.stat
> > > -out_line_type RHIST "
> > > DEBUG 4:
> > > DEBUG 4: Amending Job 1 with options: "-job aggregate_stat
> > > -line_type ORANK -out_line_type RHIST -fcst_valid_beg 20160815
> > > -fcst_valid_end
> > > 20161030 -by FCST_VAR -by FCST_LEAD -by INTERP_PNTS -interp_pnts
1
> > > -model galwem_t47b -dump_row /h/data/global/WXQC/data/met/
> > > filter_jobgalwem_t47b.stat"
> > > DEBUG 4:
> > > DEBUG 4: Amending Job 1 with command line options: "-job
> > > aggregate_stat -line_type ORANK -out_line_type RHIST
-fcst_valid_beg
> > > 20160815 -fcst_valid_end 20161030 -by FCST_VAR -by FCST_LEAD -by
> > > INTERP_PNTS -interp_pnts 1 -model galwem_t47b -dump_row
> > > /h/data/global/WXQC/data/met/ filter_jobgalwem_t47b.stat"
> > > DEBUG 2:
> > > DEBUG 2: Processing Job 1: -job aggregate_stat -model
galwem_t47b
> > > -fcst_valid_beg 20160815_000000 -fcst_valid_end 20161030_000000
> > > -interp_pnts 1 -line_type ORANK -by FCST_VAR -by FCST_LEAD -by
> > > INTERP_PNTS -dump_row
> > > /h/data/global/WXQC/data/met/filter_jobgalwem_t47b.stat
> > > -out_line_type RHIST
> > > DEBUG 1: Creating dump row output file
> > > "/h/data/global/WXQC/data/met/ filter_jobgalwem_t47b.stat"
> > > GSL_RNG_TYPE=mt19937
> > > GSL_RNG_SEED=785202520
> > > ERROR :
> > > ERROR : NumArray::operator[](int) const -> range check error
> > >
> > > Thanks
> > >
> > > Bob Craig
> > >
> > >
> > >
> >
> >
> >
> >
>
>
>
>
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #78785] Rank in ORANK lines
From: robert.craig.2 at us.af.mil
Time: Thu Dec 01 14:47:40 2016
I am generating the data in the ORANK file using the HiRA technique,
so I will check the obs and add the filter.
thanks
-----Original Message-----
From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
Sent: Thursday, December 01, 2016 3:44 PM
To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
<robert.craig.2 at us.af.mil>
Subject: Re: [rt.rap.ucar.edu #78785] Rank in ORANK lines
Bob,
Thanks for sending that sample data.
I ran the stat_analysis job you described, but for only the 6-hour
lead time and then read the "-dump_row" output into R:
R
d =
read.table("/h/data/global/WXQC/data/met/filter_jobwrf_t47b.stat",
skip=1, header=FALSE)
d[,29]
I dumped out the 29th column which contains the observation value and
saw 5 instances of this value: -10272.20
I suspect that is a bad data value that you don't intend to include in
your dataset?
So I added the following command line argument to skip over those
lines:
-fcst_thresh OBS ge-100
That says... look in the OBS column of the ORANK input line type and
only keep lines where OBS >=-100.
That yielded much more reasonable CRPS values. So I'd suggest using
"-fcst_thresh" to set a reasonable range for your data and make sure
your CRPS values look right. And then circle back to figure out why
you're getting -10272.20 showing up as an observation value.
Thanks,
John
On Wed, Nov 30, 2016 at 8:24 AM, robert.craig.2 at us.af.mil via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=78785 >
>
> John, Now that I have removed the bad ensemble data and corrected an
> error in my rank calculation, I am getting CRPS values that seem way
to high.
> It was my understanding that CRPS is in the units of the field we
are
> verifying, in this case temperature in Celsius. I have placed the
ORANK
> files on the ftp server - ignore the files with P_TT in them, sent
by
> mistake. The only field I didn't fill out in the ORANK file is the
PIT.
> Is this required for the CRPS calculation? If so, what is the
formula for
> PIT? Looking at the ORANK data the ranks now look correct based on
the
> information you sent yesterday. Below is the command line I am
running.
>
> ['/h/WXQC/met-5.1/bin/stat_analysis', '-lookin',
> '/h/data/global/WXQC/data/met/mdlob_pairs/TT', '-out',
> '/h/data/global/WXQC/data/met/summary/wrf_t47b_121_TT_RHIST',
> '-tmp_dir', '/h/data/global/WXQC/data/met/tmp', '-job
aggregate_stat',
> '-line_type ORANK', '-out_line_type RHIST', '-fcst_valid_beg
> 20160815', '-fcst_valid_end 20160816', '-by FCST_VAR', '-by
> FCST_LEAD', '-by INTERP_PNTS', '-interp_pnts ', '121', '-model',
> 'wrf_t47b', '-dump_row
> /h/data/global/WXQC/data/met/filter_jobwrf_t47b.stat', '-v', '6']
>
> Below is the output form stat_analysis by forecast hour.
>
> JOB_LIST: -job aggregate_stat -model wrf_t47b -fcst_valid_beg
> 20160815_000000 -fcst_valid_end 20160816_000000 -interp_pnts 121
> -line_type ORANK -by FCST_VAR -by FCST_LEAD -by INTERP_PNTS
-dump_row
> /h/data/global/WXQC/data/met/filter_jobwrf_t47b.stat -out_line_type
RHIST
> COL_NAME: FCST_VAR FCST_LEAD INTERP_PNTS TOTAL CRPS
IGN
> N_RANK CRPSS RANK_1 RANK_2 RANK_3 RANK_4 RANK_5 RANK_6 RANK_7 RANK_8
> RANK_9
> RANK_10 RANK_11 RANK_12 RANK_13 RANK_14 RANK_15 RANK_16
> RANK_17 RANK_18 RANK_19 RANK_20 RANK_21 RANK_22 RANK_23 RANK_24
> RANK_25
> RANK_26 RANK_27 RANK_28 RANK_29 RANK_30 RANK_31 RANK_32 RANK_33
> RANK_34
> RANK_35 RANK_36 RANK_37 RANK_38 RANK_39 RANK_40 RANK_41 R
> ANK_42 RANK_43 RANK_44 RANK_45 RANK_46 RANK_47 RANK_48 RANK_49
RANK_50
> RANK_51 RANK_52 RANK_53 RANK_54 RANK_55 RANK_56 RANK_57 RANK_58
> RANK_59
> RANK_60 RANK_61 RANK_62 RANK_63 RANK_64 RANK_65 RANK_66 RAN
> K_67 RANK_68 RANK_69 RANK_70 RANK_71 RANK_72 RANK_73 RANK_74 RANK_75
> RANK_76 RANK_77 RANK_78 RANK_79 RANK_80 RANK_81 RANK_82 RANK_83
> RANK_84
> RANK_85 RANK_86 RANK_87 RANK_88 RANK_89 RANK_90 RANK_91 RANK_
> 92 RANK_93 RANK_94 RANK_95 RANK_96 RANK_97 RANK_98 RANK_99 RANK_100
> RANK_101 RANK_102 RANK_103 RANK_104 RANK_105 RANK_106 RANK_107
> RANK_108
> RANK_109 RANK_110 RANK_111 RANK_112 RANK_113 RANK_114 RANK_115
> RANK_116 RANK_117 RANK_118 RANK_119 RANK_120 RANK_121 RANK_122
> RHIST: TMP 060000 121 224 231.4896
7892135.33761
> 122 NA 19 0 3 0 0 1 0 0
0
> 1 1 0 0 0 1 1
> 0 0 1 1 0 2 0 0
0
> 0 0 0 0 1 1 0 0
0
> 0 0 0 0 0 1 1
> 1 0 2 0 0 0 0 0
1
> 0 2 0 1 0 0 0 1 0
> 1 0 0 2 1 0 0
> 1 0 0 3 0 1 0 0 0
> 0 1 0 1 1 0 1 0 1
0
> 0 2 0 1 1 0
> 0 0 1 0 1 1 1 0 1
> 0 2 1 2 1 1 1 1
1
> 1 1 1 2 1 4
> 1 3 5 2 3 0 124
> RHIST: TMP 120000 121 224 185.16815
6460135.18147
> 122 NA 21 0 0 0 1 0 1 0
0
> 1 1 1 0 0 0 0
> 1 0 0 0 1 0 2 0
0
> 0 0 0 2 1 0 2 0
0
> 1 0 0 1 0 0 1
> 1 1 0 1 1 2 0 3
1
> 0 0 0 1 0 1 1 0 2
> 1 1 2 2 0 0 1
> 0 0 0 1 0 0 0 0 0
> 1 1 0 1 1 0 1 1 1
2
> 0 0 0 1 1 0
> 2 1 1 1 0 3 0 2 1
> 1 0 3 0 2 1 1 0
0
> 0 2 3 0 1 4
> 4 0 2 3 4 0 110
> RHIST: TMP 180000 121 112 185.11536
3640251.9495
> 122 NA 12 2 0 0 0 1 1 0
0
> 0 0 0 2 1 0 0
> 0 0 1 1 0 0 0 0
0
> 0 0 2 0 0 0 1 1
0
> 0 1 0 0 1 0 1
> 1 0 0 0 0 1 0 0
1
> 0 0 0 0 0 1 0 0 0
> 0 0 0 1 0 2 1
> 0 1 1 1 0 0 0 0 0
> 0 1 1 0 0 1 1 0 1
0
> 0 0 0 1 0 2
> 1 0 0 2 0 0 0 0 2
> 0 1 1 0 1 0 0 0
0
> 0 0 0 1 2 1
> 2 1 1 1 2 0 46
> RHIST: TMP 240000 121 112 185.20195
4773966.85648
> 122 NA 11 0 0 0 0 1 0 1
0
> 1 0 1 0 0 0 0
> 1 0 0 1 0 0 0 0
0
> 0 0 0 0 1 0 0 0
1
> 0 0 0 0 0 1 0
> 0 1 0 0 0 0 1 0
0
> 0 0 1 0 0 0 0 0 0
> 1 0 1 0 0 0 0
> 0 1 0 0 1 1 1 0 0
> 0 1 0 1 0 0 0 0 0
1
> 0 0 1 0 0 0
> 0 0 0 0 0 0 0 0 1
> 0 1 1 0 1 0 1 1
0
> 0 2 0 0 1 1
> 0 1 2 0 3 0 63
>
> Thanks
> Bob Craig
>
>
> -----Original Message-----
> From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> Sent: Tuesday, November 29, 2016 3:31 PM
> To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
> <robert.craig.2 at us.af.mil>
> Subject: Re: [rt.rap.ucar.edu #78785] Rank in ORANK lines
>
> Bob,
>
> I believe that error is still being caused by your use of the 0 as a
rank.
> Take a look on line number 85 of this file:
> point_stat_121_P_TT_wrf_t47b_060000L_20160815_060000V.stat
>
> The RANK column is assigned a value of 0. Probably should be 1 I
suppose.
>
> But actually all the ensemble values on that line look bad. For 2m
> temperature they're all set to a value of 0, which in kelvin would
be
> very cold!
>
> John
>
> On Tue, Nov 29, 2016 at 1:30 PM, robert.craig.2 at us.af.mil via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=78785 >
> >
> > Hi John, I fixed the ranks but am still getting the error so I
sent
> > the ORANK files I was reading to the ftp site. The command I am
> > running is
> > below:
> >
> > ['/h/WXQC/met-5.1/bin/stat_analysis', '-lookin',
> > '/h/data/global/WXQC/data/met/mdlob_pairs/TT', '-out',
> > '/h/data/global/WXQC/data/met/summary/wrf_t47b_121_TT_RHIST',
> > '-tmp_dir', '/h/data/global/WXQC/data/met/tmp', '-job
> > aggregate_stat', '-line_type ORANK', '-out_line_type RHIST',
> > '-fcst_valid_beg 20160815', '-fcst_valid_end 20160816', '-by
> > FCST_VAR', '-by FCST_LEAD', '-by INTERP_PNTS', '-interp_pnts ',
> > '121', '-model', 'wrf_t47b', '-dump_row
> > /h/data/global/WXQC/data/met/filter_jobwrf_t47b.stat', '-v', '6']
> >
> > The error I get is below:
> >
> > DEBUG 3: Processing STAT file "/h/data/global/WXQC/data/met/
> > mdlob_pairs/TT/point_stat_9_P_TT_galwem_t47b_240000L_
> 20161012_000000V.stat"
> > ..... 4578 of 4578
> > DEBUG 2: STAT Lines read = 513405
> > DEBUG 2: STAT Lines retained = 1368
> > DEBUG 4:
> > DEBUG 4: Initializing Job 1 to default job: "-job aggregate_stat
> > -model wrf_t47b -fcst_valid_beg 20160815_000000 -fcst_valid_end
> > 20160816_000000 -interp_pnts 121 -line_type ORANK -by FCST_VAR -by
> > FCST_LEAD -by INTERP_PNTS -dump_row
> > /h/data/global/WXQC/data/met/filter_jobwrf_t47b.stat
> > -out_line_type RHIST "
> > DEBUG 4:
> > DEBUG 4: Amending Job 1 with options: "-job aggregate_stat
> > -line_type ORANK -out_line_type RHIST -fcst_valid_beg 20160815
> > -fcst_valid_end
> > 20160816 -by FCST_VAR -by FCST_LEAD -by INTERP_PNTS -interp_pnts
> > 121 -model wrf_t47b -dump_row /h/data/global/WXQC/data/met/
> > filter_jobwrf_t47b.stat"
> > DEBUG 4:
> > DEBUG 4: Amending Job 1 with command line options: "-job
> > aggregate_stat -line_type ORANK -out_line_type RHIST
-fcst_valid_beg
> > 20160815 -fcst_valid_end 20160816 -by FCST_VAR -by FCST_LEAD -by
> > INTERP_PNTS -interp_pnts 121 -model wrf_t47b -dump_row
> > /h/data/global/WXQC/data/met/ filter_jobwrf_t47b.stat"
> > DEBUG 2:
> > DEBUG 2: Processing Job 1: -job aggregate_stat -model wrf_t47b
> > -fcst_valid_beg 20160815_000000 -fcst_valid_end 20160816_000000
> > -interp_pnts 121 -line_type ORANK -by FCST_VAR -by FCST_LEAD -by
> > INTERP_PNTS -dump_row
> > /h/data/global/WXQC/data/met/filter_jobwrf_t47b.stat
> > -out_line_type RHIST
> > DEBUG 1: Creating dump row output file
> > "/h/data/global/WXQC/data/met/ filter_jobwrf_t47b.stat"
> > GSL_RNG_TYPE=mt19937
> > GSL_RNG_SEED=1306803544
> > ERROR :
> > ERROR : NumArray::operator[](int) const -> range check error
ERROR :
> >
> > Also, another question, normally the CRPS calculation is supposed
to
> > revert to MAE if you only have one member (a deterministic model).
> When I
> > one for just one member the CRPS will be NA. If it doesn't revert
> > then I will calculate the MAE using stat_anal on MPR file.
> >
> > Thanks
> > Bob Craig
> >
> > -----Original Message-----
> > From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> > Sent: Tuesday, November 29, 2016 1:36 PM
> > To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
> > <robert.craig.2 at us.af.mil>
> > Subject: Re: [rt.rap.ucar.edu #78785] Rank in ORANK lines
> >
> > Bob,
> >
> > If you have N ensemble members, the rank of the observation will
> > range from
> > 1 to N+1. 1 means that the observation value is below all of the
> > ensemble values. N+1 means that it's above all of them.
> >
> > If possible, please send me a sample data file and stat_analysis
job
> > which replicates the error you're getting. My first guess is that
> > maybe it has to do with different versions. Perhaps the data was
> > generated with an older version of MET and you're running a newer
> version of stat_analysis?
> > Maybe we failed to make it backward compatible when we intended
to?
> > I can see the version listed in the data you send me, but please
> > tell me the version of stat_analysis you're running.
> >
> > Thanks,
> > John Halley Gotway
> >
> > On Tue, Nov 29, 2016 at 12:21 PM, robert.craig.2 at us.af.mil via RT
<
> > met_help at ucar.edu> wrote:
> >
> > >
> > > Tue Nov 29 12:21:38 2016: Request 78785 was acted upon.
> > > Transaction: Ticket created by robert.craig.2 at us.af.mil
> > > Queue: met_help
> > > Subject: Rank in ORANK lines
> > > Owner: Nobody
> > > Requestors: robert.craig.2 at us.af.mil
> > > Status: new
> > > Ticket <URL:
> > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=78785
> > > >
> > >
> > >
> > > Question for the experts, what is the definition of RANK in the
> > > ORANK lines? If the observation is below all the ensemble
> > > members, is it's rank
> > > 0 or 1? I ask this because I have been getting the following
> > > error and have been trying to pin it down.
> > >
> > > DEBUG 4:
> > > DEBUG 4: Initializing Job 1 to default job: "-job aggregate_stat
> > > -model galwem_t47b -fcst_valid_beg 20160815_000000
-fcst_valid_end
> > > 20161030_000000 -interp_pnts 1 -line_type ORANK -by FCST_VAR -by
> > > FCST_LEAD -by INTERP_PNTS -dump_row
> > > /h/data/global/WXQC/data/met/filter_jobgalwem_t47b.stat
> > > -out_line_type RHIST "
> > > DEBUG 4:
> > > DEBUG 4: Amending Job 1 with options: "-job aggregate_stat
> > > -line_type ORANK -out_line_type RHIST -fcst_valid_beg 20160815
> > > -fcst_valid_end
> > > 20161030 -by FCST_VAR -by FCST_LEAD -by INTERP_PNTS -interp_pnts
> > > 1 -model galwem_t47b -dump_row /h/data/global/WXQC/data/met/
> > > filter_jobgalwem_t47b.stat"
> > > DEBUG 4:
> > > DEBUG 4: Amending Job 1 with command line options: "-job
> > > aggregate_stat -line_type ORANK -out_line_type RHIST
> > > -fcst_valid_beg
> > > 20160815 -fcst_valid_end 20161030 -by FCST_VAR -by FCST_LEAD -by
> > > INTERP_PNTS -interp_pnts 1 -model galwem_t47b -dump_row
> > > /h/data/global/WXQC/data/met/ filter_jobgalwem_t47b.stat"
> > > DEBUG 2:
> > > DEBUG 2: Processing Job 1: -job aggregate_stat -model
galwem_t47b
> > > -fcst_valid_beg 20160815_000000 -fcst_valid_end 20161030_000000
> > > -interp_pnts 1 -line_type ORANK -by FCST_VAR -by FCST_LEAD -by
> > > INTERP_PNTS -dump_row
> > > /h/data/global/WXQC/data/met/filter_jobgalwem_t47b.stat
> > > -out_line_type RHIST
> > > DEBUG 1: Creating dump row output file
> > > "/h/data/global/WXQC/data/met/ filter_jobgalwem_t47b.stat"
> > > GSL_RNG_TYPE=mt19937
> > > GSL_RNG_SEED=785202520
> > > ERROR :
> > > ERROR : NumArray::operator[](int) const -> range check error
> > >
> > > Thanks
> > >
> > > Bob Craig
> > >
> > >
> > >
> >
> >
> >
> >
>
>
>
>
------------------------------------------------
More information about the Met_help
mailing list