[Met_help] [rt.rap.ucar.edu #90254] History for ANOM_CORR=NA for an Ensemble netcdf data
John Halley Gotway via RT
met_help at ucar.edu
Fri May 17 14:41:49 MDT 2019
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
I am spinning my wheels on generating Anomaly Correlation for ensemble data. I
only see that I can get ANOM_CORR via the grid_stat tool. I am using the
climatology data from NCEP-1.0deg, and have tried many different config
settings to generate a value. I have included the command I am executing,
parts of the Config file, the output I keep generating for _cnt.txt file, and
debug indicating the processing of continuous stats and partial sums.
I just get ANOM_CORR = NA. The _sal1l2 and _val1l2 are just getting headers
and no values, so I do not think I am processing the climatology.
What do I need to check to ensure climatology processes, and how to make sure
I can generate a value for ANOM_CORR ?
Thanks,
Glen
---------------------------------------
INPUT
grid_stat navgem_ens_geopht_pre_0500_2016121500_120_001.nc
verifecmwf_geopht_pre_0500_2016122000.nc EnsembleStatConfigACOR
---------------------------------------
The parts of the CONFIG I think are needed to be set for ANOM_CORR
//
// Verification grid
// May be set separately in each "field" entry
//
regrid = {
to_grid = "G003";
method = NEAREST;
width = 1;
vld_thresh = 0.5;
shape = SQUARE;
}
//
// Forecast and observation fields to be verified
//
fcst = {
field = [
{
name = "geopht_pre_0500.0";
level = [ "(*,*)" ];
cat_thresh = [ >5400., >=5500. ];
}
];
}
obs = fcst;
//
// Climatology mean data
//
climo_mean = {
file_name = [
"/radsm_npp/unified_verif/data/climo_emc_ncep_noaa/one_deg_daily_global/cmean_1d.19791217",
"/radsm_npp/unified_verif/data/climo_emc_ncep_noaa/one_deg_daily_global/cmean_1d.19791218",
"/radsm_npp/unified_verif/data/climo_emc_ncep_noaa/one_deg_daily_global/cmean_1d.19791219",
"/radsm_npp/unified_verif/data/climo_emc_ncep_noaa/one_deg_daily_global/cmean_1d.19791215",
"/radsm_npp/unified_verif/data/climo_emc_ncep_noaa/one_deg_daily_global/cmean_1d.19791216",
"/radsm_npp/unified_verif/data/climo_emc_ncep_noaa/one_deg_daily_global/cmean_1d.19791217",
"/radsm_npp/unified_verif/data/climo_emc_ncep_noaa/one_deg_daily_global/cmean_1d.19791218",
"/radsm_npp/unified_verif/data/climo_emc_ncep_noaa/one_deg_daily_global/cmean_1d.19791219",
"/radsm_npp/unified_verif/data/climo_emc_ncep_noaa/one_deg_daily_global/cmean_1d.19791220",
"/radsm_npp/unified_verif/data/climo_emc_ncep_noaa/one_deg_daily_global/cmean_1d.19791221",
"/radsm_npp/unified_verif/data/climo_emc_ncep_noaa/one_deg_daily_global/cmean_1d.19791222",
"/radsm_npp/unified_verif/data/climo_emc_ncep_noaa/one_deg_daily_global/cmean_1d.19791223",
"/radsm_npp/unified_verif/data/climo_emc_ncep_noaa/one_deg_daily_global/cmean_1d.19791224",
"/radsm_npp/unified_verif/data/climo_emc_ncep_noaa/one_deg_daily_global/cmean_1d.19791225",
"/radsm_npp/unified_verif/data/climo_emc_ncep_noaa/one_deg_daily_global/cmean_1d.19791226",
"/radsm_npp/unified_verif/data/climo_emc_ncep_noaa/one_deg_daily_global/cmean_1d.19791227"
];
field = [
{
name = "geopht_pre_0500.0";
level = ["P500"];
cat_thresh = [ >5400., >=5500. ];
}
];
regrid = {
method = NEAREST;
width = 1;
vld_thresh = 0.5;
}
time_interp_method = DW_MEAN;
match_month = FALSE;
match_day = TRUE;
time_step = 21600;
}
// climo_stdev = climo_mean;
climo_cdf_bins = 1;
//
// Statistical output types
//
output_stats = {
cnt = ["ANOM_CORR"];
}
output_flag = {
ecnt = BOTH;
cnt = BOTH;
sal1l2 = BOTH;
val1l2 = BOTH;
rhist = NONE;
phist = NONE;
orank = NONE;
ssvar = BOTH;
relp = NONE;
}
////////////////////////////////////////////////////////////////////////////////
//
// Ensemble product output types
//
ensemble_flag = {
latlon = FALSE;
mean = TRUE;
stdev = TRUE;
minus = FALSE;
plus = FALSE;
min = FALSE;
max = FALSE;
range = FALSE;
vld_count = FALSE;
frequency = FALSE;
rank = FALSE;
weight = FALSE;
}
//
// NetCDF matched pairs output file
// May be set separately in each "obs.field" entry
//
nc_pairs_flag = {
latlon = TRUE;
raw = TRUE;
diff = TRUE;
climo = TRUE;
weight = TRUE;
nbrhd = TRUE;
fourier = FALSE;
gradient = FALSE;
apply_mask = TRUE;
}
---------------------------------------
OUTPUT
grid_stat_1200000L_20161220_000000V_cnt.txt
VERSION MODEL DESC FCST_LEAD FCST_VALID_BEG FCST_VALID_END OBS_LEAD
OBS_VALID_BEG OBS_VALID_END FCST_VAR FCST_LEV OBS_VAR
OBS_LEV OBTYPE VX_MASK INTERP_MTHD INTERP_PNTS FCST_THRESH OBS_THRESH
COV_THRESH ALPHA LINE_TYPE TOTAL FBAR FBAR_NCL FBAR_NCU FBAR_BCL
FBAR_BCU FSTDEV FSTDEV_NCL FSTDEV_NCU FSTDEV_BCL FSTDEV_BCU OBAR
OBAR_NCL OBAR_NCU OBAR_BCL OBAR_BCU OSTDEV OSTDEV_NCL OSTDEV_NCU
OSTDEV_BCL OSTDEV_BCU PR_CORR PR_CORR_NCL PR_CORR_NCU PR_CORR_BCL PR_CORR_BCU
SP_CORR KT_CORR RANKS FRANK_TIES ORANK_TIES ME ME_NCL ME_NCU
ME_BCL ME_BCU ESTDEV ESTDEV_NCL ESTDEV_NCU ESTDEV_BCL ESTDEV_BCU MBIAS
MBIAS_BCL MBIAS_BCU MAE MAE_BCL MAE_BCU MSE MSE_BCL MSE_BCU BCMSE
BCMSE_BCL BCMSE_BCU RMSE RMSE_BCL RMSE_BCU E10 E10_BCL E10_BCU E25
E25_BCL E25_BCU E50 E50_BCL E50_BCU E75 E75_BCL E75_BCU E90
E90_BCL E90_BCU EIQR EIQR_BCL EIQR_BCU MAD MAD_BCL MAD_BCU ANOM_CORR
ANOM_CORR_NCL ANOM_CORR_NCU ANOM_CORR_BCL ANOM_CORR_BCU ME2 ME2_BCL
ME2_BCU MSESS MSESS_BCL MSESS_BCU RMSFA RMSFA_BCL RMSFA_BCU RMSOA RMSOA_BCL
RMSOA_BCU
V8.0 NAVGEM NA 1200000 20161220_000000 20161220_000000 000000
20161220_000000 20161220_000000 geopht_pre_0500.0 pre_0500.0 geopht_pre_0500.0
pre_0500.0 ECANL G003 NEAREST 1 NA NA NA
0.05 CNT 65160 5481.31271 5478.73185 5483.89358 NA NA
336.13049 334.31545 337.96548 NA NA 5498.7581 5496.16194
5501.35426 NA NA 338.12276 336.29697 339.96863 NA
NA 0.92422 0.92309 0.92533 NA NA NA NA
0 0 0 -17.44539 -18.45324 -16.43753 NA NA 131.26261
130.55382 131.97919 NA NA 0.99683 NA NA
85.91487 NA NA 17533.95011 NA NA 17229.60853 NA
NA 132.41582 NA NA -159.68584 NA NA -68.53455 NA
NA -15.0686 NA NA 24.87842 NA NA 115.36714 NA NA
93.41296 NA NA 47.0498 NA NA NA NA
NA NA NA 304.34158 NA NA 0.84663 NA
NA NA NA NA NA NA NA
DEBUG
DEBUG 2: Processing geopht_pre_0500.0(*,*) versus geopht_pre_0500.0(*,*), for
smoothing method NEAREST(1), over region G003, using 65160 pairs.
DEBUG 2: Computing Continuous Statistics.
DEBUG 2: Computing Scalar Partial Sums.
--
Mr. Glen CARL
NRL Monterey Contractor SAIC/0cog, Bldg 704 Rm 133, Code 7532
831.325.6269
glen.carl.ctr at nrlmry.navy.mil
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: ANOM_CORR=NA for an Ensemble netcdf data
From: John Halley Gotway
Time: Fri May 17 13:27:06 2019
Hi Glen,
If you read through the log messages generated by Grid-Stat closely,
it
should give you some info about what climo data it has found and is
reading. In addition, you can increase the logging verbosity level on
the
command line from it's default value of 2 to 3 or 4, like this "-v 3".
That may print more log messages related to climo.
But ultimately, you're having trouble getting Grid-Stat to use the
climo
data. Looking at the config file settings you sent I see that you're
requesting a variable named "geopht_pre_0500.0". But using wgrib to
inventory those files (*wgrib cmean_1d.19790905 | grep
geopht_pre_0500.0*),
no variable by that name exists!
Whenever using a new dataset in MET for the first time, I always
advise
folks to run it through plot_data_plane first to figure out how to
access
the data and see what it looks like. Based on the variable name, I
assume
you want geopotential height at 500 mb. Using wgrib, I see variables
named
"HGT" and I see 500 mb level data:
*wgrib cmean_1d.19790905 | grep HGT | grep "500 mb"*
3:317822:d=79090500:HGT:kpds5=7:kpds6=100:kpds7=500:TR=51:P1=0:P2=0:TimeU=1:500
mb:0-0hr product:ave at 1yr:NAve=31
23:2388326:d=79090506:HGT:kpds5=7:kpds6=100:kpds7=500:TR=51:P1=0:P2=0:TimeU=1:500
mb:0-0hr product:ave at 1yr:NAve=31
43:4458830:d=79090512:HGT:kpds5=7:kpds6=100:kpds7=500:TR=51:P1=0:P2=0:TimeU=1:500
mb:0-0hr product:ave at 1yr:NAve=31
63:6529334:d=79090518:HGT:kpds5=7:kpds6=100:kpds7=500:TR=51:P1=0:P2=0:TimeU=1:500
mb:0-0hr product:ave at 1yr:NAve=31
So let's plot one of those:
*met-8.1/bin/plot_data_plane cmean_1d.19790905 hgt_p500.ps
<http://hgt_p500.ps> 'name="HGT"; level="P500";'*
A PNG of the resulting image is attached.
So now you just need to edit your config file to request "HGT" at
"P500",
like this:
*climo_mean = {*
*...*
* field = [ { name = "HGT"; level = ["P500"]; } ];*
*}*
Does that make sense?
John
On Fri, May 17, 2019 at 12:31 PM Carl, Mr. Glen, Contractor, Code 7532
via
RT <met_help at ucar.edu> wrote:
>
> Fri May 17 12:30:44 2019: Request 90254 was acted upon.
> Transaction: Ticket created by glen.carl.ctr at nrlmry.navy.mil
> Queue: met_help
> Subject: ANOM_CORR=NA for an Ensemble netcdf data
> Owner: Nobody
> Requestors: glen.carl.ctr at nrlmry.navy.mil
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=90254 >
>
>
> I am spinning my wheels on generating Anomaly Correlation for
ensemble
> data. I
> only see that I can get ANOM_CORR via the grid_stat tool. I am using
the
> climatology data from NCEP-1.0deg, and have tried many different
config
> settings to generate a value. I have included the command I am
executing,
> parts of the Config file, the output I keep generating for _cnt.txt
file,
> and
> debug indicating the processing of continuous stats and partial
sums.
>
> I just get ANOM_CORR = NA. The _sal1l2 and _val1l2 are just getting
> headers
> and no values, so I do not think I am processing the climatology.
>
> What do I need to check to ensure climatology processes, and how to
make
> sure
> I can generate a value for ANOM_CORR ?
>
> Thanks,
> Glen
>
>
> ---------------------------------------
> INPUT
> grid_stat navgem_ens_geopht_pre_0500_2016121500_120_001.nc
> verifecmwf_geopht_pre_0500_2016122000.nc EnsembleStatConfigACOR
>
> ---------------------------------------
> The parts of the CONFIG I think are needed to be set for ANOM_CORR
> //
> // Verification grid
> // May be set separately in each "field" entry
> //
> regrid = {
> to_grid = "G003";
> method = NEAREST;
> width = 1;
> vld_thresh = 0.5;
> shape = SQUARE;
> }
> //
> // Forecast and observation fields to be verified
> //
> fcst = {
> field = [
> {
> name = "geopht_pre_0500.0";
> level = [ "(*,*)" ];
> cat_thresh = [ >5400., >=5500. ];
> }
> ];
> }
> obs = fcst;
>
> //
> // Climatology mean data
> //
> climo_mean = {
>
> file_name = [
>
>
"/radsm_npp/unified_verif/data/climo_emc_ncep_noaa/one_deg_daily_global/cmean_1d.19791217",
>
>
"/radsm_npp/unified_verif/data/climo_emc_ncep_noaa/one_deg_daily_global/cmean_1d.19791218",
>
>
"/radsm_npp/unified_verif/data/climo_emc_ncep_noaa/one_deg_daily_global/cmean_1d.19791219",
>
>
"/radsm_npp/unified_verif/data/climo_emc_ncep_noaa/one_deg_daily_global/cmean_1d.19791215",
>
>
"/radsm_npp/unified_verif/data/climo_emc_ncep_noaa/one_deg_daily_global/cmean_1d.19791216",
>
>
"/radsm_npp/unified_verif/data/climo_emc_ncep_noaa/one_deg_daily_global/cmean_1d.19791217",
>
>
"/radsm_npp/unified_verif/data/climo_emc_ncep_noaa/one_deg_daily_global/cmean_1d.19791218",
>
>
"/radsm_npp/unified_verif/data/climo_emc_ncep_noaa/one_deg_daily_global/cmean_1d.19791219",
>
>
"/radsm_npp/unified_verif/data/climo_emc_ncep_noaa/one_deg_daily_global/cmean_1d.19791220",
>
>
"/radsm_npp/unified_verif/data/climo_emc_ncep_noaa/one_deg_daily_global/cmean_1d.19791221",
>
>
"/radsm_npp/unified_verif/data/climo_emc_ncep_noaa/one_deg_daily_global/cmean_1d.19791222",
>
>
"/radsm_npp/unified_verif/data/climo_emc_ncep_noaa/one_deg_daily_global/cmean_1d.19791223",
>
>
"/radsm_npp/unified_verif/data/climo_emc_ncep_noaa/one_deg_daily_global/cmean_1d.19791224",
>
>
"/radsm_npp/unified_verif/data/climo_emc_ncep_noaa/one_deg_daily_global/cmean_1d.19791225",
>
>
"/radsm_npp/unified_verif/data/climo_emc_ncep_noaa/one_deg_daily_global/cmean_1d.19791226",
>
>
"/radsm_npp/unified_verif/data/climo_emc_ncep_noaa/one_deg_daily_global/cmean_1d.19791227"
>
> ];
> field = [
> {
> name = "geopht_pre_0500.0";
> level = ["P500"];
> cat_thresh = [ >5400., >=5500. ];
> }
> ];
>
> regrid = {
> method = NEAREST;
> width = 1;
> vld_thresh = 0.5;
> }
>
> time_interp_method = DW_MEAN;
> match_month = FALSE;
> match_day = TRUE;
> time_step = 21600;
> }
>
> // climo_stdev = climo_mean;
>
> climo_cdf_bins = 1;
>
> //
> // Statistical output types
> //
> output_stats = {
> cnt = ["ANOM_CORR"];
> }
>
> output_flag = {
> ecnt = BOTH;
> cnt = BOTH;
> sal1l2 = BOTH;
> val1l2 = BOTH;
> rhist = NONE;
> phist = NONE;
> orank = NONE;
> ssvar = BOTH;
> relp = NONE;
> }
>
>
>
////////////////////////////////////////////////////////////////////////////////
>
> //
> // Ensemble product output types
> //
> ensemble_flag = {
> latlon = FALSE;
> mean = TRUE;
> stdev = TRUE;
> minus = FALSE;
> plus = FALSE;
> min = FALSE;
> max = FALSE;
> range = FALSE;
> vld_count = FALSE;
> frequency = FALSE;
> rank = FALSE;
> weight = FALSE;
> }
> //
> // NetCDF matched pairs output file
> // May be set separately in each "obs.field" entry
> //
> nc_pairs_flag = {
> latlon = TRUE;
> raw = TRUE;
> diff = TRUE;
> climo = TRUE;
> weight = TRUE;
> nbrhd = TRUE;
> fourier = FALSE;
> gradient = FALSE;
> apply_mask = TRUE;
> }
>
> ---------------------------------------
> OUTPUT
> grid_stat_1200000L_20161220_000000V_cnt.txt
>
> VERSION MODEL DESC FCST_LEAD FCST_VALID_BEG FCST_VALID_END
OBS_LEAD
> OBS_VALID_BEG OBS_VALID_END FCST_VAR FCST_LEV OBS_VAR
> OBS_LEV OBTYPE VX_MASK INTERP_MTHD INTERP_PNTS FCST_THRESH
OBS_THRESH
> COV_THRESH ALPHA LINE_TYPE TOTAL FBAR FBAR_NCL FBAR_NCU
FBAR_BCL
> FBAR_BCU FSTDEV FSTDEV_NCL FSTDEV_NCU FSTDEV_BCL FSTDEV_BCU OBAR
> OBAR_NCL OBAR_NCU OBAR_BCL OBAR_BCU OSTDEV OSTDEV_NCL
OSTDEV_NCU
> OSTDEV_BCL OSTDEV_BCU PR_CORR PR_CORR_NCL PR_CORR_NCU PR_CORR_BCL
> PR_CORR_BCU
> SP_CORR KT_CORR RANKS FRANK_TIES ORANK_TIES ME ME_NCL
ME_NCU
> ME_BCL ME_BCU ESTDEV ESTDEV_NCL ESTDEV_NCU ESTDEV_BCL ESTDEV_BCU
MBIAS
> MBIAS_BCL MBIAS_BCU MAE MAE_BCL MAE_BCU MSE MSE_BCL
MSE_BCU
> BCMSE
> BCMSE_BCL BCMSE_BCU RMSE RMSE_BCL RMSE_BCU E10 E10_BCL
E10_BCU
> E25
> E25_BCL E25_BCU E50 E50_BCL E50_BCU E75 E75_BCL E75_BCU
E90
> E90_BCL E90_BCU EIQR EIQR_BCL EIQR_BCU MAD MAD_BCL MAD_BCU
> ANOM_CORR
> ANOM_CORR_NCL ANOM_CORR_NCU ANOM_CORR_BCL ANOM_CORR_BCU ME2
ME2_BCL
> ME2_BCU MSESS MSESS_BCL MSESS_BCU RMSFA RMSFA_BCL RMSFA_BCU RMSOA
> RMSOA_BCL
> RMSOA_BCU
> V8.0 NAVGEM NA 1200000 20161220_000000 20161220_000000 000000
> 20161220_000000 20161220_000000 geopht_pre_0500.0 pre_0500.0
> geopht_pre_0500.0
> pre_0500.0 ECANL G003 NEAREST 1 NA NA
> NA
> 0.05 CNT 65160 5481.31271 5478.73185 5483.89358 NA
NA
> 336.13049 334.31545 337.96548 NA NA 5498.7581
5496.16194
> 5501.35426 NA NA 338.12276 336.29697 339.96863
NA
> NA 0.92422 0.92309 0.92533 NA NA NA
NA
> 0 0 0 -17.44539 -18.45324 -16.43753 NA NA
> 131.26261
> 130.55382 131.97919 NA NA 0.99683 NA
NA
> 85.91487 NA NA 17533.95011 NA NA 17229.60853
NA
> NA 132.41582 NA NA -159.68584 NA NA -68.53455
> NA
> NA -15.0686 NA NA 24.87842 NA NA 115.36714
NA
> NA
> 93.41296 NA NA 47.0498 NA NA NA
NA
> NA NA NA 304.34158 NA NA 0.84663
NA
> NA NA NA NA NA NA NA
>
>
> DEBUG
> DEBUG 2: Processing geopht_pre_0500.0(*,*) versus
geopht_pre_0500.0(*,*),
> for
> smoothing method NEAREST(1), over region G003, using 65160 pairs.
> DEBUG 2: Computing Continuous Statistics.
> DEBUG 2: Computing Scalar Partial Sums.
>
> --
> Mr. Glen CARL
> NRL Monterey Contractor SAIC/0cog, Bldg 704 Rm 133, Code 7532
> 831.325.6269
> glen.carl.ctr at nrlmry.navy.mil
>
>
>
------------------------------------------------
Subject: ANOM_CORR=NA for an Ensemble netcdf data
From: Carl, Mr. Glen, Contractor, Code 7532
Time: Fri May 17 13:34:19 2019
Thank you so much. We now have an ANOM_CORR=0.77905 for the config.
Well, I wish I could have figured this out myself, however, I did
learn more
about MET in the process.
Thanks,
Glen
-----Original Message-----
From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
Sent: Friday, May 17, 2019 12:27 PM
To: Carl, Mr. Glen, Contractor, Code 7532
Subject: Re: [rt.rap.ucar.edu #90254] ANOM_CORR=NA for an Ensemble
netcdf data
Hi Glen,
If you read through the log messages generated by Grid-Stat closely,
it should
give you some info about what climo data it has found and is reading.
In
addition, you can increase the logging verbosity level on the command
line
from it's default value of 2 to 3 or 4, like this "-v 3".
That may print more log messages related to climo.
But ultimately, you're having trouble getting Grid-Stat to use the
climo data.
Looking at the config file settings you sent I see that you're
requesting a
variable named "geopht_pre_0500.0". But using wgrib to inventory
those files
(*wgrib cmean_1d.19790905 | grep geopht_pre_0500.0*), no variable by
that name
exists!
Whenever using a new dataset in MET for the first time, I always
advise folks
to run it through plot_data_plane first to figure out how to access
the data
and see what it looks like. Based on the variable name, I assume you
want
geopotential height at 500 mb. Using wgrib, I see variables named
"HGT" and I
see 500 mb level data:
*wgrib cmean_1d.19790905 | grep HGT | grep "500 mb"*
3:317822:d=79090500:HGT:kpds5=7:kpds6=100:kpds7=500:TR=51:P1=0:P2=0:TimeU=1:500
mb:0-0hr product:ave at 1yr:NAve=31
23:2388326:d=79090506:HGT:kpds5=7:kpds6=100:kpds7=500:TR=51:P1=0:P2=0:TimeU=1:500
mb:0-0hr product:ave at 1yr:NAve=31
43:4458830:d=79090512:HGT:kpds5=7:kpds6=100:kpds7=500:TR=51:P1=0:P2=0:TimeU=1:500
mb:0-0hr product:ave at 1yr:NAve=31
63:6529334:d=79090518:HGT:kpds5=7:kpds6=100:kpds7=500:TR=51:P1=0:P2=0:TimeU=1:500
mb:0-0hr product:ave at 1yr:NAve=31
So let's plot one of those:
*met-8.1/bin/plot_data_plane cmean_1d.19790905 hgt_p500.ps
<http://hgt_p500.ps> 'name="HGT"; level="P500";'*
A PNG of the resulting image is attached.
So now you just need to edit your config file to request "HGT" at
"P500", like
this:
*climo_mean = {*
*...*
* field = [ { name = "HGT"; level = ["P500"]; } ];*
*}*
Does that make sense?
John
On Fri, May 17, 2019 at 12:31 PM Carl, Mr. Glen, Contractor, Code 7532
via RT
<met_help at ucar.edu> wrote:
>
> Fri May 17 12:30:44 2019: Request 90254 was acted upon.
> Transaction: Ticket created by glen.carl.ctr at nrlmry.navy.mil
> Queue: met_help
> Subject: ANOM_CORR=NA for an Ensemble netcdf data
> Owner: Nobody
> Requestors: glen.carl.ctr at nrlmry.navy.mil
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=90254
> >
>
>
> I am spinning my wheels on generating Anomaly Correlation for
ensemble
> data. I only see that I can get ANOM_CORR via the grid_stat tool. I
am
> using the climatology data from NCEP-1.0deg, and have tried many
> different config settings to generate a value. I have included the
> command I am executing, parts of the Config file, the output I keep
> generating for _cnt.txt file, and debug indicating the processing of
> continuous stats and partial sums.
>
> I just get ANOM_CORR = NA. The _sal1l2 and _val1l2 are just getting
> headers and no values, so I do not think I am processing the
> climatology.
>
> What do I need to check to ensure climatology processes, and how to
> make sure I can generate a value for ANOM_CORR ?
>
> Thanks,
> Glen
>
>
> ---------------------------------------
> INPUT
> grid_stat navgem_ens_geopht_pre_0500_2016121500_120_001.nc
> verifecmwf_geopht_pre_0500_2016122000.nc EnsembleStatConfigACOR
>
> ---------------------------------------
> The parts of the CONFIG I think are needed to be set for ANOM_CORR
//
> // Verification grid // May be set separately in each "field" entry
//
> regrid = {
> to_grid = "G003";
> method = NEAREST;
> width = 1;
> vld_thresh = 0.5;
> shape = SQUARE;
> }
> //
> // Forecast and observation fields to be verified // fcst = {
> field = [
> {
> name = "geopht_pre_0500.0";
> level = [ "(*,*)" ];
> cat_thresh = [ >5400., >=5500. ];
> }
> ];
> }
> obs = fcst;
>
> //
> // Climatology mean data
> //
> climo_mean = {
>
> file_name = [
>
>
"/radsm_npp/unified_verif/data/climo_emc_ncep_noaa/one_deg_daily_globa
> l/cmean_1d.19791217",
>
>
>
"/radsm_npp/unified_verif/data/climo_emc_ncep_noaa/one_deg_daily_globa
> l/cmean_1d.19791218",
>
>
>
"/radsm_npp/unified_verif/data/climo_emc_ncep_noaa/one_deg_daily_globa
> l/cmean_1d.19791219",
>
>
>
"/radsm_npp/unified_verif/data/climo_emc_ncep_noaa/one_deg_daily_globa
> l/cmean_1d.19791215",
>
>
>
"/radsm_npp/unified_verif/data/climo_emc_ncep_noaa/one_deg_daily_globa
> l/cmean_1d.19791216",
>
>
>
"/radsm_npp/unified_verif/data/climo_emc_ncep_noaa/one_deg_daily_globa
> l/cmean_1d.19791217",
>
>
>
"/radsm_npp/unified_verif/data/climo_emc_ncep_noaa/one_deg_daily_globa
> l/cmean_1d.19791218",
>
>
>
"/radsm_npp/unified_verif/data/climo_emc_ncep_noaa/one_deg_daily_globa
> l/cmean_1d.19791219",
>
>
>
"/radsm_npp/unified_verif/data/climo_emc_ncep_noaa/one_deg_daily_globa
> l/cmean_1d.19791220",
>
>
>
"/radsm_npp/unified_verif/data/climo_emc_ncep_noaa/one_deg_daily_globa
> l/cmean_1d.19791221",
>
>
>
"/radsm_npp/unified_verif/data/climo_emc_ncep_noaa/one_deg_daily_globa
> l/cmean_1d.19791222",
>
>
>
"/radsm_npp/unified_verif/data/climo_emc_ncep_noaa/one_deg_daily_globa
> l/cmean_1d.19791223",
>
>
>
"/radsm_npp/unified_verif/data/climo_emc_ncep_noaa/one_deg_daily_globa
> l/cmean_1d.19791224",
>
>
>
"/radsm_npp/unified_verif/data/climo_emc_ncep_noaa/one_deg_daily_globa
> l/cmean_1d.19791225",
>
>
>
"/radsm_npp/unified_verif/data/climo_emc_ncep_noaa/one_deg_daily_globa
> l/cmean_1d.19791226",
>
>
>
"/radsm_npp/unified_verif/data/climo_emc_ncep_noaa/one_deg_daily_global/cmean_1d.19791227"
>
> ];
> field = [
> {
> name = "geopht_pre_0500.0";
> level = ["P500"];
> cat_thresh = [ >5400., >=5500. ];
> }
> ];
>
> regrid = {
> method = NEAREST;
> width = 1;
> vld_thresh = 0.5;
> }
>
> time_interp_method = DW_MEAN;
> match_month = FALSE;
> match_day = TRUE;
> time_step = 21600;
> }
>
> // climo_stdev = climo_mean;
>
> climo_cdf_bins = 1;
>
> //
> // Statistical output types
> //
> output_stats = {
> cnt = ["ANOM_CORR"];
> }
>
> output_flag = {
> ecnt = BOTH;
> cnt = BOTH;
> sal1l2 = BOTH;
> val1l2 = BOTH;
> rhist = NONE;
> phist = NONE;
> orank = NONE;
> ssvar = BOTH;
> relp = NONE;
> }
>
>
>
//////////////////////////////////////////////////////////////////////
> //////////
>
> //
> // Ensemble product output types
> //
> ensemble_flag = {
> latlon = FALSE;
> mean = TRUE;
> stdev = TRUE;
> minus = FALSE;
> plus = FALSE;
> min = FALSE;
> max = FALSE;
> range = FALSE;
> vld_count = FALSE;
> frequency = FALSE;
> rank = FALSE;
> weight = FALSE;
> }
> //
> // NetCDF matched pairs output file
> // May be set separately in each "obs.field" entry // nc_pairs_flag
=
> {
> latlon = TRUE;
> raw = TRUE;
> diff = TRUE;
> climo = TRUE;
> weight = TRUE;
> nbrhd = TRUE;
> fourier = FALSE;
> gradient = FALSE;
> apply_mask = TRUE;
> }
>
> ---------------------------------------
> OUTPUT
> grid_stat_1200000L_20161220_000000V_cnt.txt
>
> VERSION MODEL DESC FCST_LEAD FCST_VALID_BEG FCST_VALID_END
OBS_LEAD
> OBS_VALID_BEG OBS_VALID_END FCST_VAR FCST_LEV OBS_VAR
> OBS_LEV OBTYPE VX_MASK INTERP_MTHD INTERP_PNTS FCST_THRESH
OBS_THRESH
> COV_THRESH ALPHA LINE_TYPE TOTAL FBAR FBAR_NCL FBAR_NCU
FBAR_BCL
> FBAR_BCU FSTDEV FSTDEV_NCL FSTDEV_NCU FSTDEV_BCL FSTDEV_BCU OBAR
> OBAR_NCL OBAR_NCU OBAR_BCL OBAR_BCU OSTDEV OSTDEV_NCL
OSTDEV_NCU
> OSTDEV_BCL OSTDEV_BCU PR_CORR PR_CORR_NCL PR_CORR_NCU PR_CORR_BCL
> PR_CORR_BCU
> SP_CORR KT_CORR RANKS FRANK_TIES ORANK_TIES ME ME_NCL
ME_NCU
> ME_BCL ME_BCU ESTDEV ESTDEV_NCL ESTDEV_NCU ESTDEV_BCL ESTDEV_BCU
MBIAS
> MBIAS_BCL MBIAS_BCU MAE MAE_BCL MAE_BCU MSE MSE_BCL
MSE_BCU
> BCMSE
> BCMSE_BCL BCMSE_BCU RMSE RMSE_BCL RMSE_BCU E10 E10_BCL
E10_BCU
> E25
> E25_BCL E25_BCU E50 E50_BCL E50_BCU E75 E75_BCL E75_BCU
E90
> E90_BCL E90_BCU EIQR EIQR_BCL EIQR_BCU MAD MAD_BCL MAD_BCU
> ANOM_CORR
> ANOM_CORR_NCL ANOM_CORR_NCU ANOM_CORR_BCL ANOM_CORR_BCU ME2
ME2_BCL
> ME2_BCU MSESS MSESS_BCL MSESS_BCU RMSFA RMSFA_BCL RMSFA_BCU RMSOA
> RMSOA_BCL
> RMSOA_BCU
> V8.0 NAVGEM NA 1200000 20161220_000000 20161220_000000 000000
> 20161220_000000 20161220_000000 geopht_pre_0500.0 pre_0500.0
> geopht_pre_0500.0
> pre_0500.0 ECANL G003 NEAREST 1 NA NA
> NA
> 0.05 CNT 65160 5481.31271 5478.73185 5483.89358 NA
NA
> 336.13049 334.31545 337.96548 NA NA 5498.7581
5496.16194
> 5501.35426 NA NA 338.12276 336.29697 339.96863
NA
> NA 0.92422 0.92309 0.92533 NA NA NA
NA
> 0 0 0 -17.44539 -18.45324 -16.43753 NA NA
> 131.26261
> 130.55382 131.97919 NA NA 0.99683 NA
NA
> 85.91487 NA NA 17533.95011 NA NA 17229.60853
NA
> NA 132.41582 NA NA -159.68584 NA NA -68.53455
> NA
> NA -15.0686 NA NA 24.87842 NA NA 115.36714
NA
> NA
> 93.41296 NA NA 47.0498 NA NA NA
NA
> NA NA NA 304.34158 NA NA 0.84663
NA
> NA NA NA NA NA NA NA
>
>
> DEBUG
> DEBUG 2: Processing geopht_pre_0500.0(*,*) versus
> geopht_pre_0500.0(*,*), for smoothing method NEAREST(1), over region
> G003, using 65160 pairs.
> DEBUG 2: Computing Continuous Statistics.
> DEBUG 2: Computing Scalar Partial Sums.
>
> --
> Mr. Glen CARL
> NRL Monterey Contractor SAIC/0cog, Bldg 704 Rm 133, Code 7532
> 831.325.6269
> glen.carl.ctr at nrlmry.navy.mil
>
>
>
------------------------------------------------
More information about the Met_help
mailing list