[Met_help] [rt.rap.ucar.edu #86172] History for Question on AC in MET Inbox
John Halley Gotway via RT
met_help at ucar.edu
Tue Jul 9 12:03:25 MDT 2019
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
met-help,
I'm currently working to replace our legacy code that computes anomaly correlation with MET and had a quick question for you. I've come to realize that there are two possible places to grab AC from in MET, either the score itself from the CNT output or the partial sums from SAL1L2. My question is, if I were to compare an AC score from the CNT output to one computed from the SAL1L2 sums, would they be analogous? I would assume that this is the case, but I know that there was difficulty in getting the AC calculations to match those at EMC so I wanted to double check with you before proceeding.
Thanks!
Jeff
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: Question on AC in MET Inbox
From: John Halley Gotway
Time: Thu Jul 12 12:44:42 2018
Jeff,
I decided to move your question over to met_help because I figured the
answer may be of general interest...
Yes, the anomaly correlation value reported in the CNT line type
should be identical to what can be computed from the SAL1L2 partial
sums. To demonstrate, I've attached 3 files:
(1) point_stat_..._cnt.txt contains the anomaly correlation values
computed by Point-Stat in the "ANOM_CORR" column.
(2) point_stat_..._sal1l2.txt contains the corresponding partial sums.
(3) stat_analysis_sal1l2_to_cnt.txt contains the output of running the
following stat_analysis job:
stat_analysis \
-lookin
point_stat_GFS_CLIMO_1.0DEG_120000L_20120409_120000V_sal1l2.txt \
-job aggregate_stat -line_type SAL1L2 -out_line_type CNT \
-by FCST_VAR,FCST_LEAD,DESC \
-out_stat stat_analysis_sal1l2_to_cnt.txt
Comparing the ANOM_CORR column between the Point-Stat and STAT-
Analysis output, you see that you get the same result:
cat point_stat_GFS_CLIMO_1.0DEG_120000L_20120409_120000V_cnt.txt | awk
'{print $100}'
cat stat_analysis_sal1l2_to_cnt.txt | awk '{print $100}'
ANOM_CORR
0.40376
0.40376
0.40376
0.97753
0.71647
0.46991
0.64622
When METViewer plots this statistic, it aggregates the SAL1L2 lines
and derives anomaly correlation from the aggregated sums.
Hope this helps clarify.
Thanks,
John
------------------------------------------------
Subject: point_stat_GFS_CLIMO_1.0DEG_120000L_20120409_120000V_cnt.txt
From: John Halley Gotway
Time: Thu Jul 12 12:44:42 2018
VERSION MODEL DESC FCST_LEAD FCST_VALID_BEG FCST_VALID_END
OBS_LEAD OBS_VALID_BEG OBS_VALID_END FCST_VAR FCST_LEV OBS_VAR
OBS_LEV OBTYPE VX_MASK INTERP_MTHD INTERP_PNTS FCST_THRESH OBS_THRESH
COV_THRESH ALPHA LINE_TYPE TOTAL FBAR FBAR_NCL FBAR_NCU
FBAR_BCL FBAR_BCU FSTDEV FSTDEV_NCL FSTDEV_NCU FSTDEV_BCL
FSTDEV_BCU OBAR OBAR_NCL OBAR_NCU OBAR_BCL OBAR_BCU OSTDEV
OSTDEV_NCL OSTDEV_NCU OSTDEV_BCL OSTDEV_BCU PR_CORR PR_CORR_NCL
PR_CORR_NCU PR_CORR_BCL PR_CORR_BCU SP_CORR KT_CORR RANKS FRANK_TIES
ORANK_TIES ME ME_NCL ME_NCU ME_BCL ME_BCU ESTDEV
ESTDEV_NCL ESTDEV_NCU ESTDEV_BCL ESTDEV_BCU MBIAS MBIAS_BCL
MBIAS_BCU MAE MAE_BCL MAE_BCU MSE MSE_BCL MSE_BCU BCMSE
BCMSE_BCL BCMSE_BCU RMSE RMSE_BCL RMSE_BCU E10 E10_BCL
E10_BCU E25 E25_BCL E25_BCU E50 E50_BCL E50_BCU E75
E75_BCL E75_BCU E90 E90_BCL E90_BCU EIQR EIQR_BCL EIQR_BCU MAD
MAD_BCL MAD_BCU ANOM_CORR ANOM_CORR_NCL ANOM_CORR_NCU ANOM_CORR_BCL
ANOM_CORR_BCU ME2 ME2_BCL ME2_BCU MSESS MSESS_BCL MSESS_BCU
RMSFA RMSFA_BCL RMSFA_BCU RMSOA RMSOA_BCL RMSOA_BCU
V7.1 GFS KELVIN 120000 20120409_120000 20120409_120000
000000 20120409_103000 20120409_133000 TMP Z2 TMP Z2
ADPSFC CONUS NEAREST 1 NA NA NA
0.05 CNT 3407 280.59034 280.40839 280.7723 280.4005
280.76126 5.4188 5.29313 5.55063 5.29732 5.53456 280.1559
279.95311 280.35868 279.95 280.35242 6.03914 5.89908 6.18606
5.91842 6.16271 0.86595 0.85729 0.87411 0.85743
0.87414 0.86852 0.68961 3407 3156 3180 0.43445 0.33283
0.53607 0.3294 0.53759 3.02632 2.95613 3.09994 2.94519
3.10578 1.00155 1.00118 1.00192 2.39324 2.32695 2.45782 9.34466
8.84088 9.86663 9.15592 8.6716 9.64303 3.0569 2.97336
3.14112 -3.24999 -3.44999 -3.04999 -1.64999 -1.74999 -1.45001 0.35
0.25 0.45001 2.35 2.15001 2.45001 4.44999 4.25 4.65001
3.99999 3.8 4.1 1.99999 1.9 2.00002 0.40376
0.37526 0.43149 0.37339 0.43154 0.18874 0.1085
0.28901 0.74378 0.72829 0.7583 2.24896 2.17687 2.31468
3.19931 3.1188 3.27561
V7.1 GFS CELCIUS 120000 20120409_120000 20120409_120000
000000 20120409_103000 20120409_133000 TMP Z2 TMP Z2
ADPSFC CONUS NEAREST 1 NA NA NA
0.05 CNT 3407 7.44034 7.25839 7.6223 7.25465
7.61224 5.4188 5.29313 5.55063 5.28976 5.53639 7.0059
6.80311 7.20868 6.80761 7.21028 6.03914 5.89908 6.18606
5.9237 6.14825 0.86595 0.85729 0.87411 0.85756
0.87374 0.86852 0.68961 3407 3156 3180 0.43445 0.33283
0.53607 0.33543 0.54016 3.02632 2.95613 3.09994 2.95113
3.10004 1.06201 1.04685 1.07759 2.39324 2.33227 2.45422 9.34466
8.89191 9.83296 9.15592 8.70663 9.60741 3.0569 2.98193
3.13575 -3.24999 -3.45001 -3.04999 -1.64999 -1.74999 -1.45001 0.35
0.25 0.45001 2.35 2.15001 2.45001 4.44999 4.25 4.65001
3.99999 3.8 4.1 1.99999 1.9 2.00001 0.40376
0.37526 0.43149 0.3761 0.43237 0.18874 0.11252
0.29177 0.74378 0.72818 0.7576 2.24896 2.18296 2.31486
3.19931 3.12281 3.27656
V7.1 GFS FAHRENHEIT 120000 20120409_120000 20120409_120000
000000 20120409_103000 20120409_133000 TMP Z2 TMP Z2
ADPSFC CONUS NEAREST 1 NA NA NA
0.05 CNT 3407 45.39262 45.0651 45.72014 45.06364
45.69629 9.75384 9.52763 9.99113 9.53788 9.97228 44.61061
44.2456 44.97563 44.24423 44.95992 10.87045 10.61834 11.1349
10.65436 11.08974 0.86595 0.85729 0.87411 0.85759
0.87361 0.86852 0.68961 3407 3156 3180 0.78201 0.59909
0.96492 0.58978 0.96526 5.44737 5.32104 5.5799 5.30579
5.58207 1.01753 1.01317 1.02175 4.30782 4.1928 4.41625 30.27671
28.69799 31.83235 29.66518 28.14318 31.15039 5.50243 5.35705
5.64202 -5.84999 -6.20999 -5.48999 -2.96998 -3.14999 -2.61001 0.63
0.45 0.81001 4.23001 3.87002 4.41001 8.00998 7.64998 8.37001
7.19998 6.84 7.38 3.59999 3.42 3.60003 0.40376
0.37526 0.43149 0.37516 0.43274 0.61153 0.34784
0.93172 0.74378 0.72805 0.7573 4.04813 3.92272 4.1547
5.75876 5.61368 5.90157
V7.1 GFS NA 120000 20120409_120000 20120409_120000
000000 20120409_103000 20120409_133000 TMP P500 TMP
P500 ADPUPA CONUS NEAREST 1 NA NA
NA 0.05 CNT 68 253.70735 252.45461 254.96009
252.49114 254.91632 5.27068 4.50963 6.34353 4.38855
5.95327 253.60441 252.30967 254.89916 252.30291 254.86776 5.44743
4.66085 6.55625 4.4724 6.17271 0.99104 0.98547
0.99448 0.98592 0.99462 0.98405 0.91186 68 8
17 0.10294 -0.072656 0.27854 -0.070662 0.27647 0.73879 0.63211
0.88917 0.58541 0.87649 1.00041 0.99972 1.00109 0.54706
0.43824 0.66478 0.54838 0.34338 0.78756 0.53779 0.33767
0.75693 0.74053 0.58599 0.88745 -0.68 -1.15 -0.41 -0.27501
-0.57501 -0.07501 0.1 -0.050006 0.25 0.54999 0.25001 0.64999
0.98001 0.58 1.54999 0.825 0.525 1.02502 0.44999 0.29999
0.50001 0.97753 0.96372 0.98612 0.96497
0.98701 0.010597 1.9e-05 0.076436 0.98152 0.97133 0.98856
3.53129 2.85115 4.21481 3.64002 2.90776 4.39855
V7.1 GFS NA 120000 20120409_120000 20120409_120000
000000 20120409_103000 20120409_133000 UGRD Z10 UGRD Z10
ADPSFC CONUS NEAREST 1 NA NA NA
0.05 CNT 3387 1.69799 1.61054 1.78544 1.61216
1.78352 2.59668 2.53629 2.66005 2.51353 2.68369 1.28922
1.21027 1.36818 1.20757 1.37217 2.34447 2.28994 2.40167
2.2696 2.41677 0.73294 0.71696 0.74816 0.71465
0.74961 0.71583 0.54592 3387 2684 3260 0.40877 0.34745
0.47009 0.34688 0.4681 1.82077 1.77842 1.8652 1.76442
1.87572 1.31707 1.26313 1.37495 1.43975 1.39837 1.48026 3.48131
3.27422 3.68743 3.31422 3.11225 3.5173 1.86583 1.80948
1.92027 -1.76 -1.87 -1.68 -0.7 -0.78013 -0.63 0.42
0.35 0.5 1.55 1.48 1.61 2.67 2.53 2.78 2.25
2.17 2.34 1.13 1.09 1.17 0.71647 0.69967
0.73248 0.69791 0.73247 0.16709 0.12033 0.21912
0.36663 0.32126 0.40935 2.90004 2.81001 2.99112 2.54406
2.45821 2.6271
V7.1 GFS NA 120000 20120409_120000 20120409_120000
000000 20120409_103000 20120409_133000 VGRD Z10 VGRD Z10
ADPSFC CONUS NEAREST 1 NA NA NA
0.05 CNT 3387 -0.4241 -0.48456 -0.36363 -0.48793
-0.36641 1.7953 1.75354 1.8391 1.74729 1.842 -0.29076
-0.34593 -0.23559 -0.34651 -0.23758 1.63818 1.60007 1.67815
1.57395 1.70198 0.50893 0.48354 0.53347 0.48486
0.53367 0.50331 0.37395 3387 2804 3270 -0.13334 -0.19082
-0.075856 -0.19488 -0.07922 1.7068 1.6671 1.74844 1.66217
1.75145 1.45858 1.24987 1.74975 1.36403 1.33056 1.39834 2.93007
2.78696 3.08417 2.91229 2.76199 3.06668 1.71175 1.66942
1.75618 -2.22 -2.3001 -2.15995 -1.33 -1.41 -1.26 -0.22
-0.3 -0.15 1.02 0.92 1.09 1.914 1.8239 2.04
2.35 2.26 2.43 1.17 1.13 1.22 0.46991
0.44325 0.49575 0.44221 0.49612 0.017779 0.006276
0.037979 -0.091835 -0.17832 -0.012817 1.75054 1.71183 1.79445
1.69574 1.62914 1.76314
V7.1 GFS NA 120000 20120409_120000 20120409_120000
000000 20120409_103000 20120409_133000 WIND Z10 WIND Z10
ADPSFC CONUS NEAREST 1 NA NA NA
0.05 CNT 3387 3.1261 3.06535 3.18685 3.06324
3.19479 1.804 1.76204 1.84802 1.7161 1.89345 2.19298
2.1168 2.26916 2.12026 2.2702 2.26201 2.2094 2.31721
2.1927 2.32934 0.61768 0.5964 0.63808 0.59328
0.64036 0.58485 0.43099 3387 2094 3285 0.93312 0.87166
0.99458 0.86656 0.99386 1.82484 1.7824 1.86937 1.76247
1.88489 1.4255 1.38504 1.46286 1.64639 1.60373 1.68741 4.19978
3.99391 4.41366 3.32907 3.10538 3.55176 2.04934 1.99848
2.10087 -1.28131 -1.44697 -1.14962 -0.098334 -0.16399 -0.0079161
1.1121 1.02541 1.17745 2.13957 2.06972 2.19401 2.94002 2.8849
3.06382 2.2379 2.15888 2.31087 1.09936 1.05375 1.14103 0.64622
0.62616 0.66541 0.62507 0.66677 0.87071 0.75093
0.98775 0.1792 0.13104 0.22841 2.97949 2.89248 3.06676
2.71779 2.63441 2.80056
------------------------------------------------
Subject: stat_analysis_sal1l2_to_cnt.txt
From: John Halley Gotway
Time: Thu Jul 12 12:44:42 2018
VERSION MODEL DESC FCST_LEAD FCST_VALID_BEG FCST_VALID_END
OBS_LEAD OBS_VALID_BEG OBS_VALID_END FCST_VAR FCST_LEV OBS_VAR
OBS_LEV OBTYPE VX_MASK INTERP_MTHD INTERP_PNTS FCST_THRESH OBS_THRESH
COV_THRESH ALPHA LINE_TYPE TOTAL FBAR FBAR_NCL FBAR_NCU FBAR_BCL
FBAR_BCU FSTDEV FSTDEV_NCL FSTDEV_NCU FSTDEV_BCL FSTDEV_BCU OBAR
OBAR_NCL OBAR_NCU OBAR_BCL OBAR_BCU OSTDEV OSTDEV_NCL OSTDEV_NCU
OSTDEV_BCL OSTDEV_BCU PR_CORR PR_CORR_NCL PR_CORR_NCU PR_CORR_BCL
PR_CORR_BCU SP_CORR KT_CORR RANKS FRANK_TIES ORANK_TIES ME
ME_NCL ME_NCU ME_BCL ME_BCU ESTDEV ESTDEV_NCL ESTDEV_NCU
ESTDEV_BCL ESTDEV_BCU MBIAS MBIAS_BCL MBIAS_BCU MAE MAE_BCL
MAE_BCU MSE MSE_BCL MSE_BCU BCMSE BCMSE_BCL BCMSE_BCU RMSE
RMSE_BCL RMSE_BCU E10 E10_BCL E10_BCU E25 E25_BCL E25_BCU E50 E50_BCL
E50_BCU E75 E75_BCL E75_BCU E90 E90_BCL E90_BCU EIQR EIQR_BCL EIQR_BCU
MAD MAD_BCL MAD_BCU ANOM_CORR ANOM_CORR_NCL ANOM_CORR_NCU
ANOM_CORR_BCL ANOM_CORR_BCU ME2 ME2_BCL ME2_BCU MSESS
MSESS_BCL MSESS_BCU RMSFA RMSFA_BCL RMSFA_BCU RMSOA RMSOA_BCL
RMSOA_BCU
V7.1 GFS CELCIUS 120000 20120409_120000 20120409_120000
000000 20120409_103000 20120409_133000 TMP Z2 TMP Z2
ADPSFC CONUS NEAREST 1 NA NA NA
0.05 CNT 3407 0.77283 0.7019 0.84376 NA NA
2.11231 2.06332 2.1637 NA NA 0.33838 0.23154
0.44522 NA NA 3.18183 3.10804 3.25924 NA
NA NA NA NA NA NA NA
NA 0 0 0 0.43445 0.33283 0.53607 NA
NA 3.02632 2.95613 3.09994 NA NA 2.28391
NA NA 2.39324 NA NA 9.34466 NA NA 9.15591
NA NA 3.0569 NA NA NA NA NA NA NA
NA NA NA NA NA NA NA NA NA NA NA
NA NA NA NA NA 0.40376 0.37526 0.43149
NA NA 0.18875 NA NA 0.076984 NA
NA 2.24896 NA NA 3.19931 NA NA
V7.1 GFS FAHRENHEIT 120000 20120409_120000 20120409_120000
000000 20120409_103000 20120409_133000 TMP Z2 TMP Z2
ADPSFC CONUS NEAREST 1 NA NA NA
0.05 CNT 3407 1.39109 1.26342 1.51876 NA NA
3.80217 3.71399 3.89466 NA NA 0.60908 0.41677
0.80139 NA NA 5.7273 5.59447 5.86663 NA
NA NA NA NA NA NA NA
NA 0 0 0 0.78201 0.5991 0.96492 NA
NA 5.44737 5.32104 5.5799 NA NA 2.28392
NA NA 4.30782 NA NA 30.27672 NA NA 29.66518
NA NA 5.50243 NA NA NA NA NA NA NA
NA NA NA NA NA NA NA NA NA NA NA
NA NA NA NA NA 0.40376 0.37526 0.43149
NA NA 0.61154 NA NA 0.076983 NA
NA 4.04813 NA NA 5.75876 NA NA
V7.1 GFS KELVIN 120000 20120409_120000 20120409_120000
000000 20120409_103000 20120409_133000 TMP Z2 TMP Z2
ADPSFC CONUS NEAREST 1 NA NA NA
0.05 CNT 3407 0.77283 0.7019 0.84376 NA NA
2.11231 2.06332 2.1637 NA NA 0.33838 0.23154
0.44522 NA NA 3.18183 3.10804 3.25924 NA
NA NA NA NA NA NA NA
NA 0 0 0 0.43445 0.33283 0.53607 NA
NA 3.02632 2.95613 3.09994 NA NA 2.28391
NA NA 2.39324 NA NA 9.34466 NA NA 9.15591
NA NA 3.0569 NA NA NA NA NA NA NA
NA NA NA NA NA NA NA NA NA NA NA
NA NA NA NA NA 0.40376 0.37526 0.43149
NA NA 0.18875 NA NA 0.076984 NA
NA 2.24896 NA NA 3.19931 NA NA
V7.1 GFS NA 120000 20120409_120000 20120409_120000
000000 20120409_103000 20120409_133000 TMP P500 TMP
P500 ADPUPA CONUS NEAREST 1 NA NA
NA 0.05 CNT 68 -0.96801 -1.78118 -0.15484 NA
NA 3.42127 2.92726 4.11767 NA NA -1.07096
-1.90398 -0.23794 NA NA 3.50477 2.9987 4.21817
NA NA NA NA NA NA NA
NA NA 0 0 0 0.10295 -0.072646 0.27855
NA NA 0.73879 0.63211 0.88917 NA NA 0.90387
NA NA 0.54706 NA NA 0.54838 NA NA 0.53778
NA NA 0.74053 NA NA NA NA NA NA NA
NA NA NA NA NA NA NA NA NA NA NA
NA NA NA NA NA 0.97753 0.96372 0.98612
NA NA 0.010599 NA NA 0.95536 NA
NA 3.53129 NA NA 3.64002 NA NA
V7.1 GFS NA 120000 20120409_120000 20120409_120000
000000 20120409_103000 20120409_133000 UGRD Z10 UGRD Z10
ADPSFC CONUS NEAREST 1 NA NA NA
0.05 CNT 3387 1.46908 1.38486 1.5533 NA NA
2.50077 2.44261 2.56179 NA NA 1.06031 0.98242
1.1382 NA NA 2.31291 2.25912 2.36935 NA
NA NA NA NA NA NA NA
NA 0 0 0 0.40877 0.34745 0.47009 NA
NA 1.82077 1.77842 1.8652 NA NA 1.38552
NA NA 1.43975 NA NA 3.48132 NA NA 3.31423
NA NA 1.86583 NA NA NA NA NA NA NA
NA NA NA NA NA NA NA NA NA NA NA
NA NA NA NA NA 0.71647 0.69967 0.73247
NA NA 0.16709 NA NA 0.34923 NA
NA 2.90004 NA NA 2.54406 NA NA
V7.1 GFS NA 120000 20120409_120000 20120409_120000
000000 20120409_103000 20120409_133000 VGRD Z10 VGRD Z10
ADPSFC CONUS NEAREST 1 NA NA NA
0.05 CNT 3387 -0.53432 -0.59047 -0.47817 NA NA
1.66725 1.62847 1.70793 NA NA -0.40098 -0.45648
-0.34548 NA NA 1.64789 1.60956 1.6881 NA
NA NA NA NA NA NA NA
NA 0 0 0 -0.13334 -0.19082 -0.075859 NA
NA 1.7068 1.6671 1.74844 NA NA 1.33254
NA NA 1.36403 NA NA 2.93007 NA NA 2.91229
NA NA 1.71174 NA NA NA NA NA NA NA
NA NA NA NA NA NA NA NA NA NA NA
NA NA NA NA NA 0.46991 0.44325 0.49575
NA NA 0.01778 NA NA -0.078998 NA
NA 1.75054 NA NA 1.69574 NA NA
V7.1 GFS NA 120000 20120409_120000 20120409_120000
000000 20120409_103000 20120409_133000 WIND Z10 WIND Z10
ADPSFC CONUS NEAREST 1 NA NA NA
0.05 CNT 3387 2.31171 2.2484 2.37502 NA NA
1.88 1.83627 1.92587 NA NA 1.37859 1.2997
1.45748 NA NA 2.34253 2.28805 2.3997 NA
NA NA NA NA NA NA NA
NA 0 0 0 0.93312 0.87166 0.99458 NA
NA 1.82484 1.7824 1.86937 NA NA 1.67687
NA NA 1.64639 NA NA 4.19978 NA NA 3.32907
NA NA 2.04934 NA NA NA NA NA NA NA
NA NA NA NA NA NA NA NA NA NA NA
NA NA NA NA NA 0.64622 0.62616 0.66541
NA NA 0.87071 NA NA 0.23466 NA
NA 2.97949 NA NA 2.71779 NA NA
------------------------------------------------
More information about the Met_help
mailing list