[Met_help] [rt.rap.ucar.edu #84937] History for combined wind radii verification

John Halley Gotway via RT met_help at ucar.edu
Tue May 1 15:56:44 MDT 2018


----------------------------------------------------------------
  Initial Request
----------------------------------------------------------------

Hi John,

Is there a way to verify the average wind radii error for all storm
quadrants together? In tc_stat I tried to use something like:

-column abs(ANW_WIND_34-BNW_WIND_34)+abs(ANE_WIND_34-BNE_WIND_34)....

But this doesn't seem to work. Is there another way to do this using
tc_stat?

Thanks,
Andy

-- 
Andrew Penny
Hurricane Model Diagnostician
SRG / National Hurricane Center
11691 SW 17th Street
Miami, FL 33165-2149
phone: 305.229.4457
email: andrew.penny at noaa.gov


----------------------------------------------------------------
  Complete Ticket History
----------------------------------------------------------------

Subject: combined wind radii verification
From: John Halley Gotway
Time: Mon Apr 30 16:27:26 2018

Andy,

No, I don't think there currently is.  The closest thing is running "-
job
summary -column wind" in tc_stat.  Listed below is a sample job and
the
output I get from it.  This is a short-cut for having to type out all
of
those quadrant manually.  Take a look at the first 3 output lines for
the
"AAL_WIND minus BAL_WIND".  There are columns in the ATCF format for
wind
over "all quadrants", but I've never actually seen it used in
practice.
Since it's NA in the tc_pairs output, you get NA in the tc_stat
output.

It sounds like you really just want to combine all 4 of the 34 kt wind
radii into a "group" and then dump distribution of errors for that
group.
No, there's currently no support for that in tc_stat.

Thanks,
John

[johnhg at number5]%  bin/tc_stat -lookin
/var/autofs/mnt/dakota_d3/projects/MET/MET_regression/NB20180430/test_output_rev5432/tc_pairs/alal2010.tcst
-job summary -line_type TCMPR -column WIND

DEBUG 1: [Source 1] Lookin:
/var/autofs/mnt/dakota_d3/projects/MET/MET_regression/NB20180430/test_output_rev5432/tc_pairs/alal2010.tcst
DEBUG 2:
DEBUG 2: Processing Job 1: -job summary -line_type TCMPR -column WIND
-out_alpha 0.05000
JOB_LIST: -job summary -line_type TCMPR -column WIND -out_alpha
0.05000
COL_NAME:                       COLUMN TOTAL VALID     MEAN  MEAN_NCL
MEAN_NCU    STDEV MIN  P10   P25  P50   P75   P90 MAX   IQR RANGE  SUM
 SUMMARY: ABS(AAL_WIND_34-BAL_WIND_34)  1814     0 NA        NA
NA       NA        NA NA   NA    NA   NA     NA    NA NA       NA   NA
 SUMMARY: ABS(AAL_WIND_50-BAL_WIND_50)  1814     0 NA        NA
NA       NA        NA NA   NA    NA   NA     NA    NA NA       NA   NA
 SUMMARY: ABS(AAL_WIND_64-BAL_WIND_64)  1814     0 NA        NA
NA       NA        NA NA   NA    NA   NA     NA    NA NA       NA   NA
 SUMMARY: ABS(ANE_WIND_34-BNE_WIND_34)  1814    34 38.88235  27.44379
50.32092 34.03008   0  2   13.75 25.5 58.75  81.6 141 45      141 1322
 SUMMARY: ABS(ANE_WIND_50-BNE_WIND_50)  1814    14 17.64286   1.47993
33.80578 27.99343   0  0    1.25  6   14     46.9 100 12.75   100  247
 SUMMARY: ABS(ANE_WIND_64-BNE_WIND_64)  1814     3  6       -17.69716
29.69716  9.53939   0  0.2  0.5   1    9     13.8  17  8.5     17   18
 SUMMARY: ABS(ANW_WIND_34-BNW_WIND_34)  1814    29 42.7931   24.15329
61.43292 49.00319   0  0.8  5    17   78    119   192 73      192 1241
 SUMMARY: ABS(ANW_WIND_50-BNW_WIND_50)  1814    12 16.41667   1.84099
30.99235 22.94047   0  0    0     9   21.75  37.5  76 21.75    76  197
 SUMMARY: ABS(ANW_WIND_64-BNW_WIND_64)  1814     5 10.4      -6.03974
26.83974 13.24009   0  0    0     7   13     24.4  32 13       32   52
 SUMMARY: ABS(ASE_WIND_34-BSE_WIND_34)  1814    34 44.32353  30.24519
58.40187 41.88348   0  0    5    39.5 70.75  92.8 149 65.75   149 1507
 SUMMARY: ABS(ASE_WIND_50-BSE_WIND_50)  1814    16 15.375     7.82946
22.92054 14.16039   0  0    0.75 17   28.5   33.5  38 27.75    38  246
 SUMMARY: ABS(ASE_WIND_64-BSE_WIND_64)  1814     3  6.33333 -20.9168
33.58347 10.96966   0  0    0     0    9.5   15.2  19  9.5     19   19
 SUMMARY: ABS(ASW_WIND_34-BSW_WIND_34)  1814    28 43.42857  22.50514
64.352   53.95981   0  0    2.5  24   65.75 117.9 220 63.25   220 1216
 SUMMARY: ABS(ASW_WIND_50-BSW_WIND_50)  1814    17  9.11765   1.80139
16.4339  14.22973   0  0    0     4   13     15    59 13       59  155
 SUMMARY: ABS(ASW_WIND_64-BSW_WIND_64)  1814     3 13.66667 -45.13625
72.46959 23.67136   0  0    0     0   20.5   32.8  41 20.5     41   41

DEBUG 2: Job 1 used 1814 out of 1814 lines read.

On Mon, Apr 30, 2018 at 2:33 PM, Andrew Penny - NOAA Affiliate via RT
<
met_help at ucar.edu> wrote:

>
> Mon Apr 30 14:33:55 2018: Request 84937 was acted upon.
> Transaction: Ticket created by andrew.penny at noaa.gov
>        Queue: met_help
>      Subject: combined wind radii verification
>        Owner: Nobody
>   Requestors: andrew.penny at noaa.gov
>       Status: new
>  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=84937 >
>
>
> Hi John,
>
> Is there a way to verify the average wind radii error for all storm
> quadrants together? In tc_stat I tried to use something like:
>
> -column abs(ANW_WIND_34-BNW_WIND_34)+abs(ANE_WIND_34-
BNE_WIND_34)....
>
> But this doesn't seem to work. Is there another way to do this using
> tc_stat?
>
> Thanks,
> Andy
>
> --
> Andrew Penny
> Hurricane Model Diagnostician
> SRG / National Hurricane Center
> 11691 SW 17th Street
> Miami, FL 33165-2149
> phone: 305.229.4457
> email: andrew.penny at noaa.gov
>
>

------------------------------------------------
Subject: combined wind radii verification
From: Andrew Penny - NOAA Affiliate
Time: Mon Apr 30 20:26:22 2018

Thanks for the reply John. I think it will be just as easy to compute
an
average of the error for all quadrants together after running tc_stat.
I
wasn't aware of the "WIND" shortcut. That will be helpful.

Take care,
Andy

On Mon, Apr 30, 2018 at 6:27 PM, John Halley Gotway via RT <
met_help at ucar.edu> wrote:

> Andy,
>
> No, I don't think there currently is.  The closest thing is running
"-job
> summary -column wind" in tc_stat.  Listed below is a sample job and
the
> output I get from it.  This is a short-cut for having to type out
all of
> those quadrant manually.  Take a look at the first 3 output lines
for the
> "AAL_WIND minus BAL_WIND".  There are columns in the ATCF format for
wind
> over "all quadrants", but I've never actually seen it used in
practice.
> Since it's NA in the tc_pairs output, you get NA in the tc_stat
output.
>
> It sounds like you really just want to combine all 4 of the 34 kt
wind
> radii into a "group" and then dump distribution of errors for that
group.
> No, there's currently no support for that in tc_stat.
>
> Thanks,
> John
>
> [johnhg at number5]%  bin/tc_stat -lookin
> /var/autofs/mnt/dakota_d3/projects/MET/MET_regression/
> NB20180430/test_output_rev5432/tc_pairs/alal2010.tcst
> -job summary -line_type TCMPR -column WIND
>
> DEBUG 1: [Source 1] Lookin:
> /var/autofs/mnt/dakota_d3/projects/MET/MET_regression/
> NB20180430/test_output_rev5432/tc_pairs/alal2010.tcst
> DEBUG 2:
> DEBUG 2: Processing Job 1: -job summary -line_type TCMPR -column
WIND
> -out_alpha 0.05000
> JOB_LIST: -job summary -line_type TCMPR -column WIND -out_alpha
0.05000
> COL_NAME:                       COLUMN TOTAL VALID     MEAN
MEAN_NCL
> MEAN_NCU    STDEV MIN  P10   P25  P50   P75   P90 MAX   IQR RANGE
SUM
>  SUMMARY: ABS(AAL_WIND_34-BAL_WIND_34)  1814     0 NA        NA
> NA       NA        NA NA   NA    NA   NA     NA    NA NA       NA
NA
>  SUMMARY: ABS(AAL_WIND_50-BAL_WIND_50)  1814     0 NA        NA
> NA       NA        NA NA   NA    NA   NA     NA    NA NA       NA
NA
>  SUMMARY: ABS(AAL_WIND_64-BAL_WIND_64)  1814     0 NA        NA
> NA       NA        NA NA   NA    NA   NA     NA    NA NA       NA
NA
>  SUMMARY: ABS(ANE_WIND_34-BNE_WIND_34)  1814    34 38.88235
27.44379
> 50.32092 34.03008   0  2   13.75 25.5 58.75  81.6 141 45      141
1322
>  SUMMARY: ABS(ANE_WIND_50-BNE_WIND_50)  1814    14 17.64286
1.47993
> 33.80578 27.99343   0  0    1.25  6   14     46.9 100 12.75   100
247
>  SUMMARY: ABS(ANE_WIND_64-BNE_WIND_64)  1814     3  6
-17.69716
> 29.69716  9.53939   0  0.2  0.5   1    9     13.8  17  8.5     17
18
>  SUMMARY: ABS(ANW_WIND_34-BNW_WIND_34)  1814    29 42.7931
24.15329
> 61.43292 49.00319   0  0.8  5    17   78    119   192 73      192
1241
>  SUMMARY: ABS(ANW_WIND_50-BNW_WIND_50)  1814    12 16.41667
1.84099
> 30.99235 22.94047   0  0    0     9   21.75  37.5  76 21.75    76
197
>  SUMMARY: ABS(ANW_WIND_64-BNW_WIND_64)  1814     5 10.4
-6.03974
> 26.83974 13.24009   0  0    0     7   13     24.4  32 13       32
52
>  SUMMARY: ABS(ASE_WIND_34-BSE_WIND_34)  1814    34 44.32353
30.24519
> 58.40187 41.88348   0  0    5    39.5 70.75  92.8 149 65.75   149
1507
>  SUMMARY: ABS(ASE_WIND_50-BSE_WIND_50)  1814    16 15.375
7.82946
> 22.92054 14.16039   0  0    0.75 17   28.5   33.5  38 27.75    38
246
>  SUMMARY: ABS(ASE_WIND_64-BSE_WIND_64)  1814     3  6.33333 -20.9168
> 33.58347 10.96966   0  0    0     0    9.5   15.2  19  9.5     19
19
>  SUMMARY: ABS(ASW_WIND_34-BSW_WIND_34)  1814    28 43.42857
22.50514
> 64.352   53.95981   0  0    2.5  24   65.75 117.9 220 63.25   220
1216
>  SUMMARY: ABS(ASW_WIND_50-BSW_WIND_50)  1814    17  9.11765
1.80139
> 16.4339  14.22973   0  0    0     4   13     15    59 13       59
155
>  SUMMARY: ABS(ASW_WIND_64-BSW_WIND_64)  1814     3 13.66667
-45.13625
> 72.46959 23.67136   0  0    0     0   20.5   32.8  41 20.5     41
41
>
> DEBUG 2: Job 1 used 1814 out of 1814 lines read.
>
> On Mon, Apr 30, 2018 at 2:33 PM, Andrew Penny - NOAA Affiliate via
RT <
> met_help at ucar.edu> wrote:
>
> >
> > Mon Apr 30 14:33:55 2018: Request 84937 was acted upon.
> > Transaction: Ticket created by andrew.penny at noaa.gov
> >        Queue: met_help
> >      Subject: combined wind radii verification
> >        Owner: Nobody
> >   Requestors: andrew.penny at noaa.gov
> >       Status: new
> >  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=84937 >
> >
> >
> > Hi John,
> >
> > Is there a way to verify the average wind radii error for all
storm
> > quadrants together? In tc_stat I tried to use something like:
> >
> > -column abs(ANW_WIND_34-BNW_WIND_34)+abs(ANE_WIND_34-
BNE_WIND_34)....
> >
> > But this doesn't seem to work. Is there another way to do this
using
> > tc_stat?
> >
> > Thanks,
> > Andy
> >
> > --
> > Andrew Penny
> > Hurricane Model Diagnostician
> > SRG / National Hurricane Center
> > 11691 SW 17th Street
> > Miami, FL 33165-2149
> > phone: 305.229.4457
> > email: andrew.penny at noaa.gov
> >
> >
>
>


--
Andrew Penny
Hurricane Model Diagnostician
SRG / National Hurricane Center
11691 SW 17th Street
Miami, FL 33165-2149
phone: 305.229.4457
email: andrew.penny at noaa.gov

------------------------------------------------
Subject: combined wind radii verification
From: John Halley Gotway
Time: Tue May 01 11:31:46 2018

Andy,

We're proposing some new development work to NHC for MET-TC for next
year.
In order to what what you requested, one idea would be adding a
"-column_union TRUE/FALSE" option to tc_stat.  That would trigger
logic to
do compute summary info on the union of requested columns rather than
processing them separately.

I've been thinking about it, and can't think of another good example
in MET
where you'd want to combine multiple columns together in the analysis.
But
the 4 quadrants of the wind radii you pointed out certainly make
sense.

Do you think it's worth including this feature in the work we propose
to
NHC?  Would you find it useful in the long run?

Thanks,
John

On Mon, Apr 30, 2018 at 8:26 PM, Andrew Penny - NOAA Affiliate via RT
<
met_help at ucar.edu> wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=84937 >
>
> Thanks for the reply John. I think it will be just as easy to
compute an
> average of the error for all quadrants together after running
tc_stat. I
> wasn't aware of the "WIND" shortcut. That will be helpful.
>
> Take care,
> Andy
>
> On Mon, Apr 30, 2018 at 6:27 PM, John Halley Gotway via RT <
> met_help at ucar.edu> wrote:
>
> > Andy,
> >
> > No, I don't think there currently is.  The closest thing is
running "-job
> > summary -column wind" in tc_stat.  Listed below is a sample job
and the
> > output I get from it.  This is a short-cut for having to type out
all of
> > those quadrant manually.  Take a look at the first 3 output lines
for the
> > "AAL_WIND minus BAL_WIND".  There are columns in the ATCF format
for wind
> > over "all quadrants", but I've never actually seen it used in
practice.
> > Since it's NA in the tc_pairs output, you get NA in the tc_stat
output.
> >
> > It sounds like you really just want to combine all 4 of the 34 kt
wind
> > radii into a "group" and then dump distribution of errors for that
group.
> > No, there's currently no support for that in tc_stat.
> >
> > Thanks,
> > John
> >
> > [johnhg at number5]%  bin/tc_stat -lookin
> > /var/autofs/mnt/dakota_d3/projects/MET/MET_regression/
> > NB20180430/test_output_rev5432/tc_pairs/alal2010.tcst
> > -job summary -line_type TCMPR -column WIND
> >
> > DEBUG 1: [Source 1] Lookin:
> > /var/autofs/mnt/dakota_d3/projects/MET/MET_regression/
> > NB20180430/test_output_rev5432/tc_pairs/alal2010.tcst
> > DEBUG 2:
> > DEBUG 2: Processing Job 1: -job summary -line_type TCMPR -column
WIND
> > -out_alpha 0.05000
> > JOB_LIST: -job summary -line_type TCMPR -column WIND -out_alpha
0.05000
> > COL_NAME:                       COLUMN TOTAL VALID     MEAN
MEAN_NCL
> > MEAN_NCU    STDEV MIN  P10   P25  P50   P75   P90 MAX   IQR RANGE
SUM
> >  SUMMARY: ABS(AAL_WIND_34-BAL_WIND_34)  1814     0 NA        NA
> > NA       NA        NA NA   NA    NA   NA     NA    NA NA       NA
NA
> >  SUMMARY: ABS(AAL_WIND_50-BAL_WIND_50)  1814     0 NA        NA
> > NA       NA        NA NA   NA    NA   NA     NA    NA NA       NA
NA
> >  SUMMARY: ABS(AAL_WIND_64-BAL_WIND_64)  1814     0 NA        NA
> > NA       NA        NA NA   NA    NA   NA     NA    NA NA       NA
NA
> >  SUMMARY: ABS(ANE_WIND_34-BNE_WIND_34)  1814    34 38.88235
27.44379
> > 50.32092 34.03008   0  2   13.75 25.5 58.75  81.6 141 45      141
1322
> >  SUMMARY: ABS(ANE_WIND_50-BNE_WIND_50)  1814    14 17.64286
1.47993
> > 33.80578 27.99343   0  0    1.25  6   14     46.9 100 12.75   100
247
> >  SUMMARY: ABS(ANE_WIND_64-BNE_WIND_64)  1814     3  6
-17.69716
> > 29.69716  9.53939   0  0.2  0.5   1    9     13.8  17  8.5     17
18
> >  SUMMARY: ABS(ANW_WIND_34-BNW_WIND_34)  1814    29 42.7931
24.15329
> > 61.43292 49.00319   0  0.8  5    17   78    119   192 73      192
1241
> >  SUMMARY: ABS(ANW_WIND_50-BNW_WIND_50)  1814    12 16.41667
1.84099
> > 30.99235 22.94047   0  0    0     9   21.75  37.5  76 21.75    76
197
> >  SUMMARY: ABS(ANW_WIND_64-BNW_WIND_64)  1814     5 10.4
-6.03974
> > 26.83974 13.24009   0  0    0     7   13     24.4  32 13       32
52
> >  SUMMARY: ABS(ASE_WIND_34-BSE_WIND_34)  1814    34 44.32353
30.24519
> > 58.40187 41.88348   0  0    5    39.5 70.75  92.8 149 65.75   149
1507
> >  SUMMARY: ABS(ASE_WIND_50-BSE_WIND_50)  1814    16 15.375
7.82946
> > 22.92054 14.16039   0  0    0.75 17   28.5   33.5  38 27.75    38
246
> >  SUMMARY: ABS(ASE_WIND_64-BSE_WIND_64)  1814     3  6.33333
-20.9168
> > 33.58347 10.96966   0  0    0     0    9.5   15.2  19  9.5     19
19
> >  SUMMARY: ABS(ASW_WIND_34-BSW_WIND_34)  1814    28 43.42857
22.50514
> > 64.352   53.95981   0  0    2.5  24   65.75 117.9 220 63.25   220
1216
> >  SUMMARY: ABS(ASW_WIND_50-BSW_WIND_50)  1814    17  9.11765
1.80139
> > 16.4339  14.22973   0  0    0     4   13     15    59 13       59
155
> >  SUMMARY: ABS(ASW_WIND_64-BSW_WIND_64)  1814     3 13.66667
-45.13625
> > 72.46959 23.67136   0  0    0     0   20.5   32.8  41 20.5     41
41
> >
> > DEBUG 2: Job 1 used 1814 out of 1814 lines read.
> >
> > On Mon, Apr 30, 2018 at 2:33 PM, Andrew Penny - NOAA Affiliate via
RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > Mon Apr 30 14:33:55 2018: Request 84937 was acted upon.
> > > Transaction: Ticket created by andrew.penny at noaa.gov
> > >        Queue: met_help
> > >      Subject: combined wind radii verification
> > >        Owner: Nobody
> > >   Requestors: andrew.penny at noaa.gov
> > >       Status: new
> > >  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=84937
> >
> > >
> > >
> > > Hi John,
> > >
> > > Is there a way to verify the average wind radii error for all
storm
> > > quadrants together? In tc_stat I tried to use something like:
> > >
> > > -column abs(ANW_WIND_34-BNW_WIND_34)+abs(ANE_WIND_34-
BNE_WIND_34)....
> > >
> > > But this doesn't seem to work. Is there another way to do this
using
> > > tc_stat?
> > >
> > > Thanks,
> > > Andy
> > >
> > > --
> > > Andrew Penny
> > > Hurricane Model Diagnostician
> > > SRG / National Hurricane Center
> > > 11691 SW 17th Street
> > > Miami, FL 33165-2149
> > > phone: 305.229.4457
> > > email: andrew.penny at noaa.gov
> > >
> > >
> >
> >
>
>
> --
> Andrew Penny
> Hurricane Model Diagnostician
> SRG / National Hurricane Center
> 11691 SW 17th Street
> Miami, FL 33165-2149
> phone: 305.229.4457
> email: andrew.penny at noaa.gov
>
>

------------------------------------------------
Subject: combined wind radii verification
From: Andrew Penny - NOAA Affiliate
Time: Tue May 01 12:52:28 2018

Hi John,

Yes, I think that would be useful. However, besides the wind radii
example,
I can't think of another use for it at the moment... but that could
change.
Another option would be to just add a column for the average 34-kt,
50-kt,
and 64-kt wind radii. But having the ability to combine fields would
add
more flexibility down the road.

One thing that could be changed is how tc_pairs handles AVNI/GFSI. In
our
verification code at NHC, the user can request either AVNI or GFSI and
the
code will read in AVNI. In tc_pairs, GFSI needs to be requested in
order to
read in AVNI, otherwise it won't find it (i.e., requesting AVNI will
return
nothing). It would be good if the behavior was similar.

As always, thanks for your help!
Andy



On Tue, May 1, 2018 at 5:31 PM, John Halley Gotway via RT
<met_help at ucar.edu
> wrote:

> Andy,
>
> We're proposing some new development work to NHC for MET-TC for next
year.
> In order to what what you requested, one idea would be adding a
> "-column_union TRUE/FALSE" option to tc_stat.  That would trigger
logic to
> do compute summary info on the union of requested columns rather
than
> processing them separately.
>
> I've been thinking about it, and can't think of another good example
in MET
> where you'd want to combine multiple columns together in the
analysis.  But
> the 4 quadrants of the wind radii you pointed out certainly make
sense.
>
> Do you think it's worth including this feature in the work we
propose to
> NHC?  Would you find it useful in the long run?
>
> Thanks,
> John
>
> On Mon, Apr 30, 2018 at 8:26 PM, Andrew Penny - NOAA Affiliate via
RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=84937 >
> >
> > Thanks for the reply John. I think it will be just as easy to
compute an
> > average of the error for all quadrants together after running
tc_stat. I
> > wasn't aware of the "WIND" shortcut. That will be helpful.
> >
> > Take care,
> > Andy
> >
> > On Mon, Apr 30, 2018 at 6:27 PM, John Halley Gotway via RT <
> > met_help at ucar.edu> wrote:
> >
> > > Andy,
> > >
> > > No, I don't think there currently is.  The closest thing is
running
> "-job
> > > summary -column wind" in tc_stat.  Listed below is a sample job
and the
> > > output I get from it.  This is a short-cut for having to type
out all
> of
> > > those quadrant manually.  Take a look at the first 3 output
lines for
> the
> > > "AAL_WIND minus BAL_WIND".  There are columns in the ATCF format
for
> wind
> > > over "all quadrants", but I've never actually seen it used in
practice.
> > > Since it's NA in the tc_pairs output, you get NA in the tc_stat
output.
> > >
> > > It sounds like you really just want to combine all 4 of the 34
kt wind
> > > radii into a "group" and then dump distribution of errors for
that
> group.
> > > No, there's currently no support for that in tc_stat.
> > >
> > > Thanks,
> > > John
> > >
> > > [johnhg at number5]%  bin/tc_stat -lookin
> > > /var/autofs/mnt/dakota_d3/projects/MET/MET_regression/
> > > NB20180430/test_output_rev5432/tc_pairs/alal2010.tcst
> > > -job summary -line_type TCMPR -column WIND
> > >
> > > DEBUG 1: [Source 1] Lookin:
> > > /var/autofs/mnt/dakota_d3/projects/MET/MET_regression/
> > > NB20180430/test_output_rev5432/tc_pairs/alal2010.tcst
> > > DEBUG 2:
> > > DEBUG 2: Processing Job 1: -job summary -line_type TCMPR -column
WIND
> > > -out_alpha 0.05000
> > > JOB_LIST: -job summary -line_type TCMPR -column WIND -out_alpha
0.05000
> > > COL_NAME:                       COLUMN TOTAL VALID     MEAN
MEAN_NCL
> > > MEAN_NCU    STDEV MIN  P10   P25  P50   P75   P90 MAX   IQR
RANGE  SUM
> > >  SUMMARY: ABS(AAL_WIND_34-BAL_WIND_34)  1814     0 NA        NA
> > > NA       NA        NA NA   NA    NA   NA     NA    NA NA
NA   NA
> > >  SUMMARY: ABS(AAL_WIND_50-BAL_WIND_50)  1814     0 NA        NA
> > > NA       NA        NA NA   NA    NA   NA     NA    NA NA
NA   NA
> > >  SUMMARY: ABS(AAL_WIND_64-BAL_WIND_64)  1814     0 NA        NA
> > > NA       NA        NA NA   NA    NA   NA     NA    NA NA
NA   NA
> > >  SUMMARY: ABS(ANE_WIND_34-BNE_WIND_34)  1814    34 38.88235
27.44379
> > > 50.32092 34.03008   0  2   13.75 25.5 58.75  81.6 141 45
141 1322
> > >  SUMMARY: ABS(ANE_WIND_50-BNE_WIND_50)  1814    14 17.64286
1.47993
> > > 33.80578 27.99343   0  0    1.25  6   14     46.9 100 12.75
100  247
> > >  SUMMARY: ABS(ANE_WIND_64-BNE_WIND_64)  1814     3  6
-17.69716
> > > 29.69716  9.53939   0  0.2  0.5   1    9     13.8  17  8.5
17   18
> > >  SUMMARY: ABS(ANW_WIND_34-BNW_WIND_34)  1814    29 42.7931
24.15329
> > > 61.43292 49.00319   0  0.8  5    17   78    119   192 73
192 1241
> > >  SUMMARY: ABS(ANW_WIND_50-BNW_WIND_50)  1814    12 16.41667
1.84099
> > > 30.99235 22.94047   0  0    0     9   21.75  37.5  76 21.75
76  197
> > >  SUMMARY: ABS(ANW_WIND_64-BNW_WIND_64)  1814     5 10.4
-6.03974
> > > 26.83974 13.24009   0  0    0     7   13     24.4  32 13
32   52
> > >  SUMMARY: ABS(ASE_WIND_34-BSE_WIND_34)  1814    34 44.32353
30.24519
> > > 58.40187 41.88348   0  0    5    39.5 70.75  92.8 149 65.75
149 1507
> > >  SUMMARY: ABS(ASE_WIND_50-BSE_WIND_50)  1814    16 15.375
7.82946
> > > 22.92054 14.16039   0  0    0.75 17   28.5   33.5  38 27.75
38  246
> > >  SUMMARY: ABS(ASE_WIND_64-BSE_WIND_64)  1814     3  6.33333
-20.9168
> > > 33.58347 10.96966   0  0    0     0    9.5   15.2  19  9.5
19   19
> > >  SUMMARY: ABS(ASW_WIND_34-BSW_WIND_34)  1814    28 43.42857
22.50514
> > > 64.352   53.95981   0  0    2.5  24   65.75 117.9 220 63.25
220 1216
> > >  SUMMARY: ABS(ASW_WIND_50-BSW_WIND_50)  1814    17  9.11765
1.80139
> > > 16.4339  14.22973   0  0    0     4   13     15    59 13
59  155
> > >  SUMMARY: ABS(ASW_WIND_64-BSW_WIND_64)  1814     3 13.66667
-45.13625
> > > 72.46959 23.67136   0  0    0     0   20.5   32.8  41 20.5
41   41
> > >
> > > DEBUG 2: Job 1 used 1814 out of 1814 lines read.
> > >
> > > On Mon, Apr 30, 2018 at 2:33 PM, Andrew Penny - NOAA Affiliate
via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > Mon Apr 30 14:33:55 2018: Request 84937 was acted upon.
> > > > Transaction: Ticket created by andrew.penny at noaa.gov
> > > >        Queue: met_help
> > > >      Subject: combined wind radii verification
> > > >        Owner: Nobody
> > > >   Requestors: andrew.penny at noaa.gov
> > > >       Status: new
> > > >  Ticket <URL: https://rt.rap.ucar.edu/rt/
> Ticket/Display.html?id=84937
> > >
> > > >
> > > >
> > > > Hi John,
> > > >
> > > > Is there a way to verify the average wind radii error for all
storm
> > > > quadrants together? In tc_stat I tried to use something like:
> > > >
> > > > -column abs(ANW_WIND_34-BNW_WIND_34)+abs(ANE_WIND_34-
BNE_WIND_34)..
> ..
> > > >
> > > > But this doesn't seem to work. Is there another way to do this
using
> > > > tc_stat?
> > > >
> > > > Thanks,
> > > > Andy
> > > >
> > > > --
> > > > Andrew Penny
> > > > Hurricane Model Diagnostician
> > > > SRG / National Hurricane Center
> > > > 11691 SW 17th Street
> > > > Miami, FL 33165-2149
> > > > phone: 305.229.4457
> > > > email: andrew.penny at noaa.gov
> > > >
> > > >
> > >
> > >
> >
> >
> > --
> > Andrew Penny
> > Hurricane Model Diagnostician
> > SRG / National Hurricane Center
> > 11691 SW 17th Street
> > Miami, FL 33165-2149
> > phone: 305.229.4457
> > email: andrew.penny at noaa.gov
> >
> >
>
>


--
Andrew Penny
Hurricane Model Diagnostician
SRG / National Hurricane Center
11691 SW 17th Street
Miami, FL 33165-2149
phone: 305.229.4457
email: andrew.penny at noaa.gov

------------------------------------------------
Subject: combined wind radii verification
From: John Halley Gotway
Time: Tue May 01 15:53:25 2018

Andy,

Thanks for the suggestion about making the MET-TC logic consistent
with
that being used at NHC.  I used these issues to define 2 new
development
tasks in our issue tracking system.  Hopefully we'll be able to
leverage
some NHC funding to tackle these.

I'll go ahead and resolve this ticket, but we may eventually have more
questions for you to make sure we get the GFSI/AVNI logic correct.

Thanks,
John

On Tue, May 1, 2018 at 12:52 PM, Andrew Penny - NOAA Affiliate via RT
<
met_help at ucar.edu> wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=84937 >
>
> Hi John,
>
> Yes, I think that would be useful. However, besides the wind radii
example,
> I can't think of another use for it at the moment... but that could
change.
> Another option would be to just add a column for the average 34-kt,
50-kt,
> and 64-kt wind radii. But having the ability to combine fields would
add
> more flexibility down the road.
>
> One thing that could be changed is how tc_pairs handles AVNI/GFSI.
In our
> verification code at NHC, the user can request either AVNI or GFSI
and the
> code will read in AVNI. In tc_pairs, GFSI needs to be requested in
order to
> read in AVNI, otherwise it won't find it (i.e., requesting AVNI will
return
> nothing). It would be good if the behavior was similar.
>
> As always, thanks for your help!
> Andy
>
>
>
> On Tue, May 1, 2018 at 5:31 PM, John Halley Gotway via RT <
> met_help at ucar.edu
> > wrote:
>
> > Andy,
> >
> > We're proposing some new development work to NHC for MET-TC for
next
> year.
> > In order to what what you requested, one idea would be adding a
> > "-column_union TRUE/FALSE" option to tc_stat.  That would trigger
logic
> to
> > do compute summary info on the union of requested columns rather
than
> > processing them separately.
> >
> > I've been thinking about it, and can't think of another good
example in
> MET
> > where you'd want to combine multiple columns together in the
analysis.
> But
> > the 4 quadrants of the wind radii you pointed out certainly make
sense.
> >
> > Do you think it's worth including this feature in the work we
propose to
> > NHC?  Would you find it useful in the long run?
> >
> > Thanks,
> > John
> >
> > On Mon, Apr 30, 2018 at 8:26 PM, Andrew Penny - NOAA Affiliate via
RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=84937 >
> > >
> > > Thanks for the reply John. I think it will be just as easy to
compute
> an
> > > average of the error for all quadrants together after running
tc_stat.
> I
> > > wasn't aware of the "WIND" shortcut. That will be helpful.
> > >
> > > Take care,
> > > Andy
> > >
> > > On Mon, Apr 30, 2018 at 6:27 PM, John Halley Gotway via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > > Andy,
> > > >
> > > > No, I don't think there currently is.  The closest thing is
running
> > "-job
> > > > summary -column wind" in tc_stat.  Listed below is a sample
job and
> the
> > > > output I get from it.  This is a short-cut for having to type
out all
> > of
> > > > those quadrant manually.  Take a look at the first 3 output
lines for
> > the
> > > > "AAL_WIND minus BAL_WIND".  There are columns in the ATCF
format for
> > wind
> > > > over "all quadrants", but I've never actually seen it used in
> practice.
> > > > Since it's NA in the tc_pairs output, you get NA in the
tc_stat
> output.
> > > >
> > > > It sounds like you really just want to combine all 4 of the 34
kt
> wind
> > > > radii into a "group" and then dump distribution of errors for
that
> > group.
> > > > No, there's currently no support for that in tc_stat.
> > > >
> > > > Thanks,
> > > > John
> > > >
> > > > [johnhg at number5]%  bin/tc_stat -lookin
> > > > /var/autofs/mnt/dakota_d3/projects/MET/MET_regression/
> > > > NB20180430/test_output_rev5432/tc_pairs/alal2010.tcst
> > > > -job summary -line_type TCMPR -column WIND
> > > >
> > > > DEBUG 1: [Source 1] Lookin:
> > > > /var/autofs/mnt/dakota_d3/projects/MET/MET_regression/
> > > > NB20180430/test_output_rev5432/tc_pairs/alal2010.tcst
> > > > DEBUG 2:
> > > > DEBUG 2: Processing Job 1: -job summary -line_type TCMPR
-column WIND
> > > > -out_alpha 0.05000
> > > > JOB_LIST: -job summary -line_type TCMPR -column WIND
-out_alpha
> 0.05000
> > > > COL_NAME:                       COLUMN TOTAL VALID     MEAN
MEAN_NCL
> > > > MEAN_NCU    STDEV MIN  P10   P25  P50   P75   P90 MAX   IQR
RANGE
> SUM
> > > >  SUMMARY: ABS(AAL_WIND_34-BAL_WIND_34)  1814     0 NA
NA
> > > > NA       NA        NA NA   NA    NA   NA     NA    NA NA
NA
>  NA
> > > >  SUMMARY: ABS(AAL_WIND_50-BAL_WIND_50)  1814     0 NA
NA
> > > > NA       NA        NA NA   NA    NA   NA     NA    NA NA
NA
>  NA
> > > >  SUMMARY: ABS(AAL_WIND_64-BAL_WIND_64)  1814     0 NA
NA
> > > > NA       NA        NA NA   NA    NA   NA     NA    NA NA
NA
>  NA
> > > >  SUMMARY: ABS(ANE_WIND_34-BNE_WIND_34)  1814    34 38.88235
27.44379
> > > > 50.32092 34.03008   0  2   13.75 25.5 58.75  81.6 141 45
141
> 1322
> > > >  SUMMARY: ABS(ANE_WIND_50-BNE_WIND_50)  1814    14 17.64286
1.47993
> > > > 33.80578 27.99343   0  0    1.25  6   14     46.9 100 12.75
100
> 247
> > > >  SUMMARY: ABS(ANE_WIND_64-BNE_WIND_64)  1814     3  6
-17.69716
> > > > 29.69716  9.53939   0  0.2  0.5   1    9     13.8  17  8.5
17
>  18
> > > >  SUMMARY: ABS(ANW_WIND_34-BNW_WIND_34)  1814    29 42.7931
24.15329
> > > > 61.43292 49.00319   0  0.8  5    17   78    119   192 73
192
> 1241
> > > >  SUMMARY: ABS(ANW_WIND_50-BNW_WIND_50)  1814    12 16.41667
1.84099
> > > > 30.99235 22.94047   0  0    0     9   21.75  37.5  76 21.75
76
> 197
> > > >  SUMMARY: ABS(ANW_WIND_64-BNW_WIND_64)  1814     5 10.4
-6.03974
> > > > 26.83974 13.24009   0  0    0     7   13     24.4  32 13
32
>  52
> > > >  SUMMARY: ABS(ASE_WIND_34-BSE_WIND_34)  1814    34 44.32353
30.24519
> > > > 58.40187 41.88348   0  0    5    39.5 70.75  92.8 149 65.75
149
> 1507
> > > >  SUMMARY: ABS(ASE_WIND_50-BSE_WIND_50)  1814    16 15.375
7.82946
> > > > 22.92054 14.16039   0  0    0.75 17   28.5   33.5  38 27.75
38
> 246
> > > >  SUMMARY: ABS(ASE_WIND_64-BSE_WIND_64)  1814     3  6.33333
-20.9168
> > > > 33.58347 10.96966   0  0    0     0    9.5   15.2  19  9.5
19
>  19
> > > >  SUMMARY: ABS(ASW_WIND_34-BSW_WIND_34)  1814    28 43.42857
22.50514
> > > > 64.352   53.95981   0  0    2.5  24   65.75 117.9 220 63.25
220
> 1216
> > > >  SUMMARY: ABS(ASW_WIND_50-BSW_WIND_50)  1814    17  9.11765
1.80139
> > > > 16.4339  14.22973   0  0    0     4   13     15    59 13
59
> 155
> > > >  SUMMARY: ABS(ASW_WIND_64-BSW_WIND_64)  1814     3 13.66667
-45.13625
> > > > 72.46959 23.67136   0  0    0     0   20.5   32.8  41 20.5
41
>  41
> > > >
> > > > DEBUG 2: Job 1 used 1814 out of 1814 lines read.
> > > >
> > > > On Mon, Apr 30, 2018 at 2:33 PM, Andrew Penny - NOAA Affiliate
via
> RT <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > > >
> > > > > Mon Apr 30 14:33:55 2018: Request 84937 was acted upon.
> > > > > Transaction: Ticket created by andrew.penny at noaa.gov
> > > > >        Queue: met_help
> > > > >      Subject: combined wind radii verification
> > > > >        Owner: Nobody
> > > > >   Requestors: andrew.penny at noaa.gov
> > > > >       Status: new
> > > > >  Ticket <URL: https://rt.rap.ucar.edu/rt/
> > Ticket/Display.html?id=84937
> > > >
> > > > >
> > > > >
> > > > > Hi John,
> > > > >
> > > > > Is there a way to verify the average wind radii error for
all storm
> > > > > quadrants together? In tc_stat I tried to use something
like:
> > > > >
> > > > > -column abs(ANW_WIND_34-BNW_WIND_34)+
> abs(ANE_WIND_34-BNE_WIND_34)..
> > ..
> > > > >
> > > > > But this doesn't seem to work. Is there another way to do
this
> using
> > > > > tc_stat?
> > > > >
> > > > > Thanks,
> > > > > Andy
> > > > >
> > > > > --
> > > > > Andrew Penny
> > > > > Hurricane Model Diagnostician
> > > > > SRG / National Hurricane Center
> > > > > 11691 SW 17th Street
> > > > > Miami, FL 33165-2149
> > > > > phone: 305.229.4457
> > > > > email: andrew.penny at noaa.gov
> > > > >
> > > > >
> > > >
> > > >
> > >
> > >
> > > --
> > > Andrew Penny
> > > Hurricane Model Diagnostician
> > > SRG / National Hurricane Center
> > > 11691 SW 17th Street
> > > Miami, FL 33165-2149
> > > phone: 305.229.4457
> > > email: andrew.penny at noaa.gov
> > >
> > >
> >
> >
>
>
> --
> Andrew Penny
> Hurricane Model Diagnostician
> SRG / National Hurricane Center
> 11691 SW 17th Street
> Miami, FL 33165-2149
> phone: 305.229.4457
> email: andrew.penny at noaa.gov
>
>

------------------------------------------------


More information about the Met_help mailing list