[Met_help] [rt.rap.ucar.edu #86172] History for Question on AC in MET Inbox

John Halley Gotway via RT met_help at ucar.edu
Tue Jul 9 12:03:25 MDT 2019


----------------------------------------------------------------
  Initial Request
----------------------------------------------------------------

met-help,

I'm currently working to replace our legacy code that computes anomaly correlation with MET and had a quick question for you. I've come to realize that there are two possible places to grab AC from in MET, either the score itself from the CNT output or the partial sums from SAL1L2. My question is, if I were to compare an AC score from the CNT output to one computed from the SAL1L2 sums, would they be analogous? I would assume that this is the case, but I know that there was difficulty in getting the AC calculations to match those at EMC so I wanted to double check with you before proceeding.

Thanks!

Jeff

----------------------------------------------------------------
  Complete Ticket History
----------------------------------------------------------------

Subject: Question on AC in MET Inbox
From: John Halley Gotway
Time: Thu Jul 12 12:44:42 2018

Jeff,

I decided to move your question over to met_help because I figured the
answer may be of general interest...

Yes, the anomaly correlation value reported in the CNT line type
should be identical to what can be computed from the SAL1L2 partial
sums.  To demonstrate, I've attached 3 files:

(1) point_stat_..._cnt.txt contains the anomaly correlation values
computed by Point-Stat in the "ANOM_CORR" column.
(2) point_stat_..._sal1l2.txt contains the corresponding partial sums.
(3) stat_analysis_sal1l2_to_cnt.txt contains the output of running the
following stat_analysis job:

stat_analysis \
-lookin
point_stat_GFS_CLIMO_1.0DEG_120000L_20120409_120000V_sal1l2.txt \
-job aggregate_stat -line_type SAL1L2 -out_line_type CNT \
-by FCST_VAR,FCST_LEAD,DESC \
-out_stat stat_analysis_sal1l2_to_cnt.txt

Comparing the ANOM_CORR column between the Point-Stat and STAT-
Analysis output, you see that you get the same result:

cat point_stat_GFS_CLIMO_1.0DEG_120000L_20120409_120000V_cnt.txt | awk
'{print $100}'
cat stat_analysis_sal1l2_to_cnt.txt | awk '{print $100}'

ANOM_CORR
0.40376
0.40376
0.40376
0.97753
0.71647
0.46991
0.64622

When METViewer plots this statistic, it aggregates the SAL1L2 lines
and derives anomaly correlation from the aggregated sums.

Hope this helps clarify.

Thanks,
John

------------------------------------------------
Subject: point_stat_GFS_CLIMO_1.0DEG_120000L_20120409_120000V_cnt.txt
From: John Halley Gotway
Time: Thu Jul 12 12:44:42 2018

VERSION MODEL DESC       FCST_LEAD FCST_VALID_BEG  FCST_VALID_END
OBS_LEAD OBS_VALID_BEG   OBS_VALID_END   FCST_VAR FCST_LEV OBS_VAR
OBS_LEV OBTYPE VX_MASK INTERP_MTHD INTERP_PNTS FCST_THRESH OBS_THRESH
COV_THRESH ALPHA LINE_TYPE TOTAL FBAR      FBAR_NCL  FBAR_NCU
FBAR_BCL  FBAR_BCU  FSTDEV  FSTDEV_NCL FSTDEV_NCU FSTDEV_BCL
FSTDEV_BCU OBAR      OBAR_NCL  OBAR_NCU  OBAR_BCL  OBAR_BCU  OSTDEV
OSTDEV_NCL OSTDEV_NCU OSTDEV_BCL OSTDEV_BCU PR_CORR PR_CORR_NCL
PR_CORR_NCU PR_CORR_BCL PR_CORR_BCU SP_CORR KT_CORR RANKS FRANK_TIES
ORANK_TIES ME       ME_NCL    ME_NCU    ME_BCL    ME_BCU   ESTDEV
ESTDEV_NCL ESTDEV_NCU ESTDEV_BCL ESTDEV_BCU MBIAS   MBIAS_BCL
MBIAS_BCU MAE     MAE_BCL MAE_BCU MSE      MSE_BCL  MSE_BCU  BCMSE
BCMSE_BCL BCMSE_BCU RMSE    RMSE_BCL RMSE_BCU E10      E10_BCL
E10_BCU  E25       E25_BCL  E25_BCU    E50     E50_BCL   E50_BCU  E75
E75_BCL E75_BCU E90     E90_BCL E90_BCU EIQR    EIQR_BCL EIQR_BCU MAD
MAD_BCL MAD_BCU ANOM_CORR ANOM_CORR_NCL ANOM_CORR_NCU ANOM_CORR_BCL
ANOM_CORR_BCU ME2      ME2_BCL  ME2_BCU  MSESS     MSESS_BCL MSESS_BCU
RMSFA   RMSFA_BCL RMSFA_BCU RMSOA   RMSOA_BCL RMSOA_BCU
V7.1    GFS   KELVIN     120000    20120409_120000 20120409_120000
000000   20120409_103000 20120409_133000 TMP      Z2       TMP     Z2
ADPSFC CONUS   NEAREST     1           NA          NA         NA
0.05  CNT        3407 280.59034 280.40839 280.7723  280.4005
280.76126 5.4188     5.29313    5.55063    5.29732    5.53456 280.1559
279.95311 280.35868 279.95    280.35242  6.03914    5.89908    6.18606
5.91842    6.16271 0.86595     0.85729     0.87411     0.85743
0.87414 0.86852 0.68961  3407       3156       3180  0.43445  0.33283
0.53607   0.3294    0.53759 3.02632    2.95613    3.09994    2.94519
3.10578 1.00155   1.00118   1.00192 2.39324 2.32695 2.45782  9.34466
8.84088  9.86663  9.15592   8.6716    9.64303 3.0569   2.97336
3.14112 -3.24999 -3.44999 -3.04999 -1.64999  -1.74999 -1.45001    0.35
0.25      0.45001 2.35    2.15001 2.45001 4.44999 4.25    4.65001
3.99999  3.8      4.1     1.99999 1.9     2.00002   0.40376
0.37526       0.43149       0.37339       0.43154 0.18874  0.1085
0.28901   0.74378    0.72829  0.7583   2.24896   2.17687   2.31468
3.19931   3.1188    3.27561
V7.1    GFS   CELCIUS    120000    20120409_120000 20120409_120000
000000   20120409_103000 20120409_133000 TMP      Z2       TMP     Z2
ADPSFC CONUS   NEAREST     1           NA          NA         NA
0.05  CNT        3407   7.44034   7.25839   7.6223    7.25465
7.61224 5.4188     5.29313    5.55063    5.28976    5.53639   7.0059
6.80311   7.20868   6.80761   7.21028  6.03914    5.89908    6.18606
5.9237     6.14825 0.86595     0.85729     0.87411     0.85756
0.87374 0.86852 0.68961  3407       3156       3180  0.43445  0.33283
0.53607   0.33543   0.54016 3.02632    2.95613    3.09994    2.95113
3.10004 1.06201   1.04685   1.07759 2.39324 2.33227 2.45422  9.34466
8.89191  9.83296  9.15592   8.70663   9.60741 3.0569   2.98193
3.13575 -3.24999 -3.45001 -3.04999 -1.64999  -1.74999 -1.45001    0.35
0.25      0.45001 2.35    2.15001 2.45001 4.44999 4.25    4.65001
3.99999  3.8      4.1     1.99999 1.9     2.00001   0.40376
0.37526       0.43149       0.3761        0.43237 0.18874  0.11252
0.29177   0.74378    0.72818  0.7576   2.24896   2.18296   2.31486
3.19931   3.12281   3.27656
V7.1    GFS   FAHRENHEIT 120000    20120409_120000 20120409_120000
000000   20120409_103000 20120409_133000 TMP      Z2       TMP     Z2
ADPSFC CONUS   NEAREST     1           NA          NA         NA
0.05  CNT        3407  45.39262  45.0651   45.72014  45.06364
45.69629 9.75384    9.52763    9.99113    9.53788    9.97228  44.61061
44.2456   44.97563  44.24423  44.95992 10.87045   10.61834   11.1349
10.65436   11.08974 0.86595     0.85729     0.87411     0.85759
0.87361 0.86852 0.68961  3407       3156       3180  0.78201  0.59909
0.96492   0.58978   0.96526 5.44737    5.32104    5.5799     5.30579
5.58207 1.01753   1.01317   1.02175 4.30782 4.1928  4.41625 30.27671
28.69799 31.83235 29.66518  28.14318  31.15039 5.50243  5.35705
5.64202 -5.84999 -6.20999 -5.48999 -2.96998  -3.14999 -2.61001    0.63
0.45      0.81001 4.23001 3.87002 4.41001 8.00998 7.64998 8.37001
7.19998  6.84     7.38    3.59999 3.42    3.60003   0.40376
0.37526       0.43149       0.37516       0.43274 0.61153  0.34784
0.93172   0.74378    0.72805  0.7573   4.04813   3.92272   4.1547
5.75876   5.61368   5.90157
V7.1    GFS   NA         120000    20120409_120000 20120409_120000
000000   20120409_103000 20120409_133000 TMP      P500     TMP
P500    ADPUPA CONUS   NEAREST     1           NA          NA
NA         0.05  CNT          68 253.70735 252.45461 254.96009
252.49114 254.91632 5.27068    4.50963    6.34353    4.38855
5.95327 253.60441 252.30967 254.89916 252.30291 254.86776  5.44743
4.66085    6.55625    4.4724     6.17271 0.99104     0.98547
0.99448     0.98592     0.99462 0.98405 0.91186    68          8
17  0.10294 -0.072656  0.27854  -0.070662  0.27647 0.73879    0.63211
0.88917    0.58541    0.87649 1.00041   0.99972   1.00109 0.54706
0.43824 0.66478  0.54838  0.34338  0.78756  0.53779   0.33767
0.75693 0.74053  0.58599  0.88745 -0.68    -1.15    -0.41    -0.27501
-0.57501 -0.07501    0.1    -0.050006  0.25    0.54999 0.25001 0.64999
0.98001 0.58    1.54999 0.825    0.525    1.02502 0.44999 0.29999
0.50001   0.97753       0.96372       0.98612       0.96497
0.98701 0.010597 1.9e-05  0.076436  0.98152    0.97133  0.98856
3.53129   2.85115   4.21481 3.64002   2.90776   4.39855
V7.1    GFS   NA         120000    20120409_120000 20120409_120000
000000   20120409_103000 20120409_133000 UGRD     Z10      UGRD    Z10
ADPSFC CONUS   NEAREST     1           NA          NA         NA
0.05  CNT        3387   1.69799   1.61054   1.78544   1.61216
1.78352 2.59668    2.53629    2.66005    2.51353    2.68369   1.28922
1.21027   1.36818   1.20757   1.37217  2.34447    2.28994    2.40167
2.2696     2.41677 0.73294     0.71696     0.74816     0.71465
0.74961 0.71583 0.54592  3387       2684       3260  0.40877  0.34745
0.47009   0.34688   0.4681  1.82077    1.77842    1.8652     1.76442
1.87572 1.31707   1.26313   1.37495 1.43975 1.39837 1.48026  3.48131
3.27422  3.68743  3.31422   3.11225   3.5173  1.86583  1.80948
1.92027 -1.76    -1.87    -1.68    -0.7      -0.78013 -0.63       0.42
0.35      0.5     1.55    1.48    1.61    2.67    2.53    2.78    2.25
2.17     2.34    1.13    1.09    1.17      0.71647       0.69967
0.73248       0.69791       0.73247 0.16709  0.12033  0.21912
0.36663    0.32126  0.40935  2.90004   2.81001   2.99112 2.54406
2.45821   2.6271
V7.1    GFS   NA         120000    20120409_120000 20120409_120000
000000   20120409_103000 20120409_133000 VGRD     Z10      VGRD    Z10
ADPSFC CONUS   NEAREST     1           NA          NA         NA
0.05  CNT        3387  -0.4241   -0.48456  -0.36363  -0.48793
-0.36641 1.7953     1.75354    1.8391     1.74729    1.842    -0.29076
-0.34593  -0.23559  -0.34651  -0.23758  1.63818    1.60007    1.67815
1.57395    1.70198 0.50893     0.48354     0.53347     0.48486
0.53367 0.50331 0.37395  3387       2804       3270 -0.13334 -0.19082
-0.075856 -0.19488  -0.07922 1.7068     1.6671     1.74844    1.66217
1.75145 1.45858   1.24987   1.74975 1.36403 1.33056 1.39834  2.93007
2.78696  3.08417  2.91229   2.76199   3.06668 1.71175  1.66942
1.75618 -2.22    -2.3001  -2.15995 -1.33     -1.41    -1.26      -0.22
-0.3      -0.15    1.02    0.92    1.09    1.914   1.8239  2.04
2.35     2.26     2.43    1.17    1.13    1.22      0.46991
0.44325       0.49575       0.44221       0.49612 0.017779 0.006276
0.037979 -0.091835  -0.17832 -0.012817 1.75054   1.71183   1.79445
1.69574   1.62914   1.76314
V7.1    GFS   NA         120000    20120409_120000 20120409_120000
000000   20120409_103000 20120409_133000 WIND     Z10      WIND    Z10
ADPSFC CONUS   NEAREST     1           NA          NA         NA
0.05  CNT        3387   3.1261    3.06535   3.18685   3.06324
3.19479 1.804      1.76204    1.84802    1.7161     1.89345   2.19298
2.1168    2.26916   2.12026   2.2702   2.26201    2.2094     2.31721
2.1927     2.32934 0.61768     0.5964      0.63808     0.59328
0.64036 0.58485 0.43099  3387       2094       3285  0.93312  0.87166
0.99458   0.86656   0.99386 1.82484    1.7824     1.86937    1.76247
1.88489 1.4255    1.38504   1.46286 1.64639 1.60373 1.68741  4.19978
3.99391  4.41366  3.32907   3.10538   3.55176 2.04934  1.99848
2.10087 -1.28131 -1.44697 -1.14962 -0.098334 -0.16399 -0.0079161
1.1121  1.02541   1.17745 2.13957 2.06972 2.19401 2.94002 2.8849
3.06382 2.2379   2.15888  2.31087 1.09936 1.05375 1.14103   0.64622
0.62616       0.66541       0.62507       0.66677 0.87071  0.75093
0.98775   0.1792     0.13104  0.22841  2.97949   2.89248   3.06676
2.71779   2.63441   2.80056

------------------------------------------------
Subject: stat_analysis_sal1l2_to_cnt.txt
From: John Halley Gotway
Time: Thu Jul 12 12:44:42 2018

VERSION MODEL DESC       FCST_LEAD FCST_VALID_BEG  FCST_VALID_END
OBS_LEAD OBS_VALID_BEG   OBS_VALID_END   FCST_VAR FCST_LEV OBS_VAR
OBS_LEV OBTYPE VX_MASK INTERP_MTHD INTERP_PNTS FCST_THRESH OBS_THRESH
COV_THRESH ALPHA LINE_TYPE TOTAL FBAR     FBAR_NCL FBAR_NCU FBAR_BCL
FBAR_BCU FSTDEV  FSTDEV_NCL FSTDEV_NCU FSTDEV_BCL FSTDEV_BCU OBAR
OBAR_NCL OBAR_NCU OBAR_BCL OBAR_BCU OSTDEV  OSTDEV_NCL OSTDEV_NCU
OSTDEV_BCL OSTDEV_BCU PR_CORR PR_CORR_NCL PR_CORR_NCU PR_CORR_BCL
PR_CORR_BCU SP_CORR KT_CORR RANKS FRANK_TIES ORANK_TIES ME
ME_NCL    ME_NCU    ME_BCL ME_BCU ESTDEV  ESTDEV_NCL ESTDEV_NCU
ESTDEV_BCL ESTDEV_BCU MBIAS   MBIAS_BCL MBIAS_BCU MAE     MAE_BCL
MAE_BCU MSE      MSE_BCL MSE_BCU BCMSE    BCMSE_BCL BCMSE_BCU RMSE
RMSE_BCL RMSE_BCU E10 E10_BCL E10_BCU E25 E25_BCL E25_BCU E50 E50_BCL
E50_BCU E75 E75_BCL E75_BCU E90 E90_BCL E90_BCU EIQR EIQR_BCL EIQR_BCU
MAD MAD_BCL MAD_BCU ANOM_CORR ANOM_CORR_NCL ANOM_CORR_NCU
ANOM_CORR_BCL ANOM_CORR_BCU ME2      ME2_BCL ME2_BCU MSESS
MSESS_BCL MSESS_BCU RMSFA   RMSFA_BCL RMSFA_BCU RMSOA   RMSOA_BCL
RMSOA_BCU
V7.1    GFS   CELCIUS    120000    20120409_120000 20120409_120000
000000   20120409_103000 20120409_133000 TMP      Z2       TMP     Z2
ADPSFC CONUS   NEAREST     1           NA          NA         NA
0.05  CNT        3407  0.77283  0.7019   0.84376       NA       NA
2.11231    2.06332    2.1637          NA         NA  0.33838  0.23154
0.44522       NA       NA 3.18183    3.10804    3.25924         NA
NA      NA          NA          NA          NA          NA      NA
NA     0          0          0  0.43445  0.33283   0.53607      NA
NA 3.02632    2.95613    3.09994         NA         NA 2.28391
NA        NA 2.39324      NA      NA  9.34466      NA      NA  9.15591
NA        NA 3.0569        NA       NA  NA      NA      NA  NA      NA
NA  NA      NA      NA  NA      NA      NA  NA      NA      NA   NA
NA       NA  NA      NA      NA   0.40376       0.37526       0.43149
NA            NA 0.18875       NA      NA  0.076984        NA
NA 2.24896        NA        NA 3.19931        NA        NA
V7.1    GFS   FAHRENHEIT 120000    20120409_120000 20120409_120000
000000   20120409_103000 20120409_133000 TMP      Z2       TMP     Z2
ADPSFC CONUS   NEAREST     1           NA          NA         NA
0.05  CNT        3407  1.39109  1.26342  1.51876       NA       NA
3.80217    3.71399    3.89466         NA         NA  0.60908  0.41677
0.80139       NA       NA 5.7273     5.59447    5.86663         NA
NA      NA          NA          NA          NA          NA      NA
NA     0          0          0  0.78201  0.5991    0.96492      NA
NA 5.44737    5.32104    5.5799          NA         NA 2.28392
NA        NA 4.30782      NA      NA 30.27672      NA      NA 29.66518
NA        NA 5.50243       NA       NA  NA      NA      NA  NA      NA
NA  NA      NA      NA  NA      NA      NA  NA      NA      NA   NA
NA       NA  NA      NA      NA   0.40376       0.37526       0.43149
NA            NA 0.61154       NA      NA  0.076983        NA
NA 4.04813        NA        NA 5.75876        NA        NA
V7.1    GFS   KELVIN     120000    20120409_120000 20120409_120000
000000   20120409_103000 20120409_133000 TMP      Z2       TMP     Z2
ADPSFC CONUS   NEAREST     1           NA          NA         NA
0.05  CNT        3407  0.77283  0.7019   0.84376       NA       NA
2.11231    2.06332    2.1637          NA         NA  0.33838  0.23154
0.44522       NA       NA 3.18183    3.10804    3.25924         NA
NA      NA          NA          NA          NA          NA      NA
NA     0          0          0  0.43445  0.33283   0.53607      NA
NA 3.02632    2.95613    3.09994         NA         NA 2.28391
NA        NA 2.39324      NA      NA  9.34466      NA      NA  9.15591
NA        NA 3.0569        NA       NA  NA      NA      NA  NA      NA
NA  NA      NA      NA  NA      NA      NA  NA      NA      NA   NA
NA       NA  NA      NA      NA   0.40376       0.37526       0.43149
NA            NA 0.18875       NA      NA  0.076984        NA
NA 2.24896        NA        NA 3.19931        NA        NA
V7.1    GFS   NA         120000    20120409_120000 20120409_120000
000000   20120409_103000 20120409_133000 TMP      P500     TMP
P500    ADPUPA CONUS   NEAREST     1           NA          NA
NA         0.05  CNT          68 -0.96801 -1.78118 -0.15484       NA
NA 3.42127    2.92726    4.11767         NA         NA -1.07096
-1.90398 -0.23794       NA       NA 3.50477    2.9987     4.21817
NA         NA      NA          NA          NA          NA          NA
NA      NA     0          0          0  0.10295 -0.072646  0.27855
NA     NA 0.73879    0.63211    0.88917         NA         NA 0.90387
NA        NA 0.54706      NA      NA  0.54838      NA      NA  0.53778
NA        NA 0.74053       NA       NA  NA      NA      NA  NA      NA
NA  NA      NA      NA  NA      NA      NA  NA      NA      NA   NA
NA       NA  NA      NA      NA   0.97753       0.96372       0.98612
NA            NA 0.010599      NA      NA  0.95536         NA
NA 3.53129        NA        NA 3.64002        NA        NA
V7.1    GFS   NA         120000    20120409_120000 20120409_120000
000000   20120409_103000 20120409_133000 UGRD     Z10      UGRD    Z10
ADPSFC CONUS   NEAREST     1           NA          NA         NA
0.05  CNT        3387  1.46908  1.38486  1.5533        NA       NA
2.50077    2.44261    2.56179         NA         NA  1.06031  0.98242
1.1382        NA       NA 2.31291    2.25912    2.36935         NA
NA      NA          NA          NA          NA          NA      NA
NA     0          0          0  0.40877  0.34745   0.47009      NA
NA 1.82077    1.77842    1.8652          NA         NA 1.38552
NA        NA 1.43975      NA      NA  3.48132      NA      NA  3.31423
NA        NA 1.86583       NA       NA  NA      NA      NA  NA      NA
NA  NA      NA      NA  NA      NA      NA  NA      NA      NA   NA
NA       NA  NA      NA      NA   0.71647       0.69967       0.73247
NA            NA 0.16709       NA      NA  0.34923         NA
NA 2.90004        NA        NA 2.54406        NA        NA
V7.1    GFS   NA         120000    20120409_120000 20120409_120000
000000   20120409_103000 20120409_133000 VGRD     Z10      VGRD    Z10
ADPSFC CONUS   NEAREST     1           NA          NA         NA
0.05  CNT        3387 -0.53432 -0.59047 -0.47817       NA       NA
1.66725    1.62847    1.70793         NA         NA -0.40098 -0.45648
-0.34548       NA       NA 1.64789    1.60956    1.6881          NA
NA      NA          NA          NA          NA          NA      NA
NA     0          0          0 -0.13334 -0.19082  -0.075859     NA
NA 1.7068     1.6671     1.74844         NA         NA 1.33254
NA        NA 1.36403      NA      NA  2.93007      NA      NA  2.91229
NA        NA 1.71174       NA       NA  NA      NA      NA  NA      NA
NA  NA      NA      NA  NA      NA      NA  NA      NA      NA   NA
NA       NA  NA      NA      NA   0.46991       0.44325       0.49575
NA            NA 0.01778       NA      NA -0.078998        NA
NA 1.75054        NA        NA 1.69574        NA        NA
V7.1    GFS   NA         120000    20120409_120000 20120409_120000
000000   20120409_103000 20120409_133000 WIND     Z10      WIND    Z10
ADPSFC CONUS   NEAREST     1           NA          NA         NA
0.05  CNT        3387  2.31171  2.2484   2.37502       NA       NA
1.88       1.83627    1.92587         NA         NA  1.37859  1.2997
1.45748       NA       NA 2.34253    2.28805    2.3997          NA
NA      NA          NA          NA          NA          NA      NA
NA     0          0          0  0.93312  0.87166   0.99458      NA
NA 1.82484    1.7824     1.86937         NA         NA 1.67687
NA        NA 1.64639      NA      NA  4.19978      NA      NA  3.32907
NA        NA 2.04934       NA       NA  NA      NA      NA  NA      NA
NA  NA      NA      NA  NA      NA      NA  NA      NA      NA   NA
NA       NA  NA      NA      NA   0.64622       0.62616       0.66541
NA            NA 0.87071       NA      NA  0.23466         NA
NA 2.97949        NA        NA 2.71779        NA        NA

------------------------------------------------


More information about the Met_help mailing list