[Met_help] [rt.rap.ucar.edu #56157] History for obs_field ensemble_stat error
John Halley Gotway via RT
met_help at ucar.edu
Wed May 2 10:19:34 MDT 2012
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
I get the following error when I attempt to run ensemble_stat with a
netcdf gridded observation file:
>*ensemble_stat 20 .*/e0100_2012042100-2012042600_aod.nc
./e0200_2012042100-2012042600_aod.nc
./e0300_2012042100-2012042600_aod.nc
./e0400_2012042100-2012042600_aod.nc
./e0500_2012042100-2012042600_aod.nc
./e0600_2012042100-2012042600_aod.nc
./e0700_2012042100-2012042600_aod.nc
./e0800_2012042100-2012042600_aod.nc
./e0900_2012042100-2012042600_aod.nc
./e1000_2012042100-2012042600_aod.nc
./e1100_2012042100-2012042600_aod.nc
./e1200_2012042100-2012042600_aod.nc
./e1300_2012042100-2012042600_aod.nc
./e1400_2012042100-2012042600_aod.nc
./e1500_2012042100-2012042600_aod.nc
./e1600_2012042100-2012042600_aod.nc
./e1700_2012042100-2012042600_aod.nc
./e1800_2012042100-2012042600_aod.nc
./e1900_2012042100-2012042600_aod.nc
./e2000_2012042100-2012042600_aod.nc
*NAAPS_total_ensemble_stat_config.6488 -ens_valid 20120426_00 -grid_obs
modis_2012042600_obsnew.nc -outdir
/shared/aerosol_maud2/users/sessions/products/MET/2012042100/ENSEMBLE_STAT_OUT*
DEBUG 1: Default Config File:
/shared/aerosol_heck2/users/sessions/_METv3.1/data/config/EnsembleStatConfig_default
DEBUG 1: User Config File: NAAPS_total_ensemble_stat_config.6488
ERROR :
ERROR : str_to_prob_info() -> problems parsing the string "*,*".
ERROR :
If I try leaving obs_field[] = [] blank, I get:
>*ensemble_stat 20 *./e0100_2012042100-2012042600_aod.nc
./e0200_2012042100-2012042600_aod.nc
./e0300_2012042100-2012042600_aod.nc
./e0400_2012042100-2012042600_aod.nc
./e0500_2012042100-2012042600_aod.nc
./e0600_2012042100-2012042600_aod.nc
./e0700_2012042100-2012042600_aod.nc
./e0800_2012042100-2012042600_aod.nc
./e0900_2012042100-2012042600_aod.nc
./e1000_2012042100-2012042600_aod.nc
./e1100_2012042100-2012042600_aod.nc
./e1200_2012042100-2012042600_aod.nc
./e1300_2012042100-2012042600_aod.nc
./e1400_2012042100-2012042600_aod.nc
./e1500_2012042100-2012042600_aod.nc
./e1600_2012042100-2012042600_aod.nc
./e1700_2012042100-2012042600_aod.nc
./e1800_2012042100-2012042600_aod.nc
./e1900_2012042100-2012042600_aod.nc
./e2000_2012042100-2012042600_aod.nc*
NAAPS_total_ensemble_stat_config.6488 -ens_valid 20120426_00 -grid_obs
modis_2012042600_obsnew.nc -outdir
/shared/aerosol_maud2/users/sessions/products/MET/2012042100/ENSEMBLE_STAT_OUT*
DEBUG 1: Default Config File:
/shared/aerosol_heck2/users/sessions/_METv3.1/data/config/EnsembleStatConfig_default
DEBUG 1: User Config File: NAAPS_total_ensemble_stat_config.6488
ERROR :
ERROR : EnsembleStatConfInfo::process_config() -> When the forecast
file is not GRIB1, "obs_field" cannot be blank. You must specify the
verifying observations following the GRIB1 convention.
ERROR :
Here is the top of my configuration file:
model = "NAAPS";
ens_field[] = [ "total_aod(*,*)" ];
ens_thresh[] = [ "ge0.0" ];
vld_ens_thresh = 1.0;
vld_data_thresh = 1.0;
fcst_field[] = [ "total_aod(*,*)" ];
obs_field[] = [ "total_aod(*,*)" ];
And metadata on a sample ensemble and obs file:
>ncdump -h e0100_2012042100-2012042600_aod.nc
netcdf e0100_2012042100-2012042600_aod {
dimensions:
lon = 360 ;
lat = 180 ;
variables:
float total_aod(lat, lon) ;
total_aod:name = "total_AOD" ;
total_aod:long_name = "total aerosol optical depth" ;
total_aod:level = "column" ;
total_aod:units = " " ;
total_aod:valid_time_ut = 1335398400 ;
total_aod:init_time_ut = 1334966400 ;
total_aod:accum_time = 0 ;
// global attributes:
:MET_version = "V3.1" ;
:Projection = "LatLon" ;
:lat_ll = -89.5 ;
:lon_ll = -179.5 ;
:delta_lat = "1.0 degrees" ;
:delta_lon = "1.0 degrees" ;
:Nlon = "360 grid_points" ;
:Nlat = "180 grid_points" ;
}
>ncdump -h modis_2012042600_obsnew.nc
netcdf modis_2012042600_obsnew {
dimensions:
lon = 360 ;
lat = 180 ;
variables:
float total_aod(lat, lon) ;
total_aod:name = "TOTAL_AOD" ;
total_aod:long_name = "modis total aerosol optical depth" ;
total_aod:src_dir =
"/shared/aerosol_ops2/modis_obsnew_1d6h/landocean/terraaqua/" ;
total_aod:level = "column" ;
total_aod:units = " " ;
total_aod:valid_time_ut = 1335398400 ;
total_aod:accum_time = 0 ;
// global attributes:
:MET_version = "V3.1" ;
:Projection = "LatLon" ;
:lat_ll = -89.5 ;
:lon_ll = -179.5 ;
:delta_lat = "1.0 degrees" ;
:delta_lon = "1.0 degrees" ;
:Nlon = "360 grid_points" ;
:Nlat = "180 grid_points" ;
}
In the ensemble_stat documentation, it doesn't seem to indicate that
observations need to be in GRIB1 format, but the only way to get the
tool to run at all is to either leave fcst_field blank, or throw in a
dummy GRIB accumulation period in obs_field. The latter eventually
results in an error after the basic statistics are computer. Any ideas
what I'm messing up here?
--
Walter R. Sessions
Atmospheric Scientist
CSC Contractor
Aerosol and Radiation Section
Naval Research Laboratory
Of.831.656.4061
Ce.407.319.8639
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #56157] obs_field ensemble_stat error
From: John Halley Gotway
Time: Mon Apr 30 14:33:13 2012
Hello Walter,
After a brief review of the code, it appears you have likely
identified a
short-coming in the Ensemble-Stat tool. I will take a look at this in
more detail and try to get back to you tomorrow about a possible patch
or
work-around.
Thanks for letting us know about this issue.
John Halley Gotway
met_help at ucar.edu
>
> Mon Apr 30 10:29:16 2012: Request 56157 was acted upon.
> Transaction: Ticket created by walter.sessions.ctr at nrlmry.navy.mil
> Queue: met_help
> Subject: obs_field ensemble_stat error
> Owner: Nobody
> Requestors: walter.sessions.ctr at nrlmry.navy.mil
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=56157 >
>
>
> I get the following error when I attempt to run ensemble_stat with
a
> netcdf gridded observation file:
>
> >*ensemble_stat 20 .*/e0100_2012042100-2012042600_aod.nc
> ./e0200_2012042100-2012042600_aod.nc
> ./e0300_2012042100-2012042600_aod.nc
> ./e0400_2012042100-2012042600_aod.nc
> ./e0500_2012042100-2012042600_aod.nc
> ./e0600_2012042100-2012042600_aod.nc
> ./e0700_2012042100-2012042600_aod.nc
> ./e0800_2012042100-2012042600_aod.nc
> ./e0900_2012042100-2012042600_aod.nc
> ./e1000_2012042100-2012042600_aod.nc
> ./e1100_2012042100-2012042600_aod.nc
> ./e1200_2012042100-2012042600_aod.nc
> ./e1300_2012042100-2012042600_aod.nc
> ./e1400_2012042100-2012042600_aod.nc
> ./e1500_2012042100-2012042600_aod.nc
> ./e1600_2012042100-2012042600_aod.nc
> ./e1700_2012042100-2012042600_aod.nc
> ./e1800_2012042100-2012042600_aod.nc
> ./e1900_2012042100-2012042600_aod.nc
> ./e2000_2012042100-2012042600_aod.nc
> *NAAPS_total_ensemble_stat_config.6488 -ens_valid 20120426_00
-grid_obs
> modis_2012042600_obsnew.nc -outdir
>
/shared/aerosol_maud2/users/sessions/products/MET/2012042100/ENSEMBLE_STAT_OUT*
> DEBUG 1: Default Config File:
>
/shared/aerosol_heck2/users/sessions/_METv3.1/data/config/EnsembleStatConfig_default
> DEBUG 1: User Config File: NAAPS_total_ensemble_stat_config.6488
> ERROR :
> ERROR : str_to_prob_info() -> problems parsing the string "*,*".
> ERROR :
>
>
>
>
>
> If I try leaving obs_field[] = [] blank, I get:
>
> >*ensemble_stat 20 *./e0100_2012042100-2012042600_aod.nc
> ./e0200_2012042100-2012042600_aod.nc
> ./e0300_2012042100-2012042600_aod.nc
> ./e0400_2012042100-2012042600_aod.nc
> ./e0500_2012042100-2012042600_aod.nc
> ./e0600_2012042100-2012042600_aod.nc
> ./e0700_2012042100-2012042600_aod.nc
> ./e0800_2012042100-2012042600_aod.nc
> ./e0900_2012042100-2012042600_aod.nc
> ./e1000_2012042100-2012042600_aod.nc
> ./e1100_2012042100-2012042600_aod.nc
> ./e1200_2012042100-2012042600_aod.nc
> ./e1300_2012042100-2012042600_aod.nc
> ./e1400_2012042100-2012042600_aod.nc
> ./e1500_2012042100-2012042600_aod.nc
> ./e1600_2012042100-2012042600_aod.nc
> ./e1700_2012042100-2012042600_aod.nc
> ./e1800_2012042100-2012042600_aod.nc
> ./e1900_2012042100-2012042600_aod.nc
> ./e2000_2012042100-2012042600_aod.nc*
> NAAPS_total_ensemble_stat_config.6488 -ens_valid 20120426_00
-grid_obs
> modis_2012042600_obsnew.nc -outdir
>
/shared/aerosol_maud2/users/sessions/products/MET/2012042100/ENSEMBLE_STAT_OUT*
> DEBUG 1: Default Config File:
>
/shared/aerosol_heck2/users/sessions/_METv3.1/data/config/EnsembleStatConfig_default
> DEBUG 1: User Config File: NAAPS_total_ensemble_stat_config.6488
> ERROR :
> ERROR : EnsembleStatConfInfo::process_config() -> When the forecast
> file is not GRIB1, "obs_field" cannot be blank. You must specify
the
> verifying observations following the GRIB1 convention.
> ERROR :
>
>
>
>
>
> Here is the top of my configuration file:
>
> model = "NAAPS";
> ens_field[] = [ "total_aod(*,*)" ];
> ens_thresh[] = [ "ge0.0" ];
> vld_ens_thresh = 1.0;
> vld_data_thresh = 1.0;
> fcst_field[] = [ "total_aod(*,*)" ];
> obs_field[] = [ "total_aod(*,*)" ];
>
>
>
>
> And metadata on a sample ensemble and obs file:
>
> >ncdump -h e0100_2012042100-2012042600_aod.nc
> netcdf e0100_2012042100-2012042600_aod {
> dimensions:
> lon = 360 ;
> lat = 180 ;
> variables:
> float total_aod(lat, lon) ;
> total_aod:name = "total_AOD" ;
> total_aod:long_name = "total aerosol optical depth"
;
> total_aod:level = "column" ;
> total_aod:units = " " ;
> total_aod:valid_time_ut = 1335398400 ;
> total_aod:init_time_ut = 1334966400 ;
> total_aod:accum_time = 0 ;
>
>
> // global attributes:
> :MET_version = "V3.1" ;
> :Projection = "LatLon" ;
> :lat_ll = -89.5 ;
> :lon_ll = -179.5 ;
> :delta_lat = "1.0 degrees" ;
> :delta_lon = "1.0 degrees" ;
> :Nlon = "360 grid_points" ;
> :Nlat = "180 grid_points" ;
> }
>
> >ncdump -h modis_2012042600_obsnew.nc
> netcdf modis_2012042600_obsnew {
> dimensions:
> lon = 360 ;
> lat = 180 ;
> variables:
> float total_aod(lat, lon) ;
> total_aod:name = "TOTAL_AOD" ;
> total_aod:long_name = "modis total aerosol optical
depth"
> ;
> total_aod:src_dir =
> "/shared/aerosol_ops2/modis_obsnew_1d6h/landocean/terraaqua/" ;
> total_aod:level = "column" ;
> total_aod:units = " " ;
> total_aod:valid_time_ut = 1335398400 ;
> total_aod:accum_time = 0 ;
>
> // global attributes:
> :MET_version = "V3.1" ;
> :Projection = "LatLon" ;
> :lat_ll = -89.5 ;
> :lon_ll = -179.5 ;
> :delta_lat = "1.0 degrees" ;
> :delta_lon = "1.0 degrees" ;
> :Nlon = "360 grid_points" ;
> :Nlat = "180 grid_points" ;
> }
>
>
>
>
> In the ensemble_stat documentation, it doesn't seem to indicate that
> observations need to be in GRIB1 format, but the only way to get the
> tool to run at all is to either leave fcst_field blank, or throw in
a
> dummy GRIB accumulation period in obs_field. The latter eventually
> results in an error after the basic statistics are computer. Any
ideas
> what I'm messing up here?
>
> --
> Walter R. Sessions
> Atmospheric Scientist
> CSC Contractor
> Aerosol and Radiation Section
> Naval Research Laboratory
> Of.831.656.4061
> Ce.407.319.8639
>
>
------------------------------------------------
Subject: obs_field ensemble_stat error
From: John Halley Gotway
Time: Tue May 01 08:37:05 2012
Walter,
OK, I've worked up a patch that will enable Ensemble-Stat to be run in
the way you'd like. This was of course how we intended Ensemble-Stat
to work, but there was a flaw in the logic in the library
code that prevented it from working properly.
Ensemble-Stat is a bit tricky though. It can handle gridded and/or
point observations. However, if you're using point obs, you need to
set the "obs_field" parameter following GRIB conventions (e.g.
APCP/A12 to mean observations of 12-hourly accumulated precip). For
this reason, you wouldn't be able to run Ensemble-Stat using gridded
NetCDF observations and point observations in the same run.
You'd need to do it in two separate runs with changes to the
"obs_field" setting in the config file.
I've attached a tar file containing the proposed patch. Please apply
this patch to your build of MET (see instructions at the top of this
page:
http://www.dtcenter.org/met/users/support/known_issues/METv3.1/index.php)
and rerun your data. Then please let me know if the patched code
works for you as expected. If so, I'll post the changes to
the website to distribute to other MET users.
Thanks again for pointing out this short-coming in the MET code.
John Halley Gotway
met_help at ucar.edu
On 04/30/2012 02:33 PM, John Halley Gotway wrote:
> Hello Walter,
>
> After a brief review of the code, it appears you have likely
identified a
> short-coming in the Ensemble-Stat tool. I will take a look at this
in
> more detail and try to get back to you tomorrow about a possible
patch or
> work-around.
>
> Thanks for letting us know about this issue.
>
> John Halley Gotway
> met_help at ucar.edu
>
>>
>> Mon Apr 30 10:29:16 2012: Request 56157 was acted upon.
>> Transaction: Ticket created by walter.sessions.ctr at nrlmry.navy.mil
>> Queue: met_help
>> Subject: obs_field ensemble_stat error
>> Owner: Nobody
>> Requestors: walter.sessions.ctr at nrlmry.navy.mil
>> Status: new
>> Ticket<URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=56157>
>>
>>
>> I get the following error when I attempt to run ensemble_stat
with a
>> netcdf gridded observation file:
>>
>> >*ensemble_stat 20 .*/e0100_2012042100-2012042600_aod.nc
>> ./e0200_2012042100-2012042600_aod.nc
>> ./e0300_2012042100-2012042600_aod.nc
>> ./e0400_2012042100-2012042600_aod.nc
>> ./e0500_2012042100-2012042600_aod.nc
>> ./e0600_2012042100-2012042600_aod.nc
>> ./e0700_2012042100-2012042600_aod.nc
>> ./e0800_2012042100-2012042600_aod.nc
>> ./e0900_2012042100-2012042600_aod.nc
>> ./e1000_2012042100-2012042600_aod.nc
>> ./e1100_2012042100-2012042600_aod.nc
>> ./e1200_2012042100-2012042600_aod.nc
>> ./e1300_2012042100-2012042600_aod.nc
>> ./e1400_2012042100-2012042600_aod.nc
>> ./e1500_2012042100-2012042600_aod.nc
>> ./e1600_2012042100-2012042600_aod.nc
>> ./e1700_2012042100-2012042600_aod.nc
>> ./e1800_2012042100-2012042600_aod.nc
>> ./e1900_2012042100-2012042600_aod.nc
>> ./e2000_2012042100-2012042600_aod.nc
>> *NAAPS_total_ensemble_stat_config.6488 -ens_valid 20120426_00
-grid_obs
>> modis_2012042600_obsnew.nc -outdir
>>
/shared/aerosol_maud2/users/sessions/products/MET/2012042100/ENSEMBLE_STAT_OUT*
>> DEBUG 1: Default Config File:
>>
/shared/aerosol_heck2/users/sessions/_METv3.1/data/config/EnsembleStatConfig_default
>> DEBUG 1: User Config File: NAAPS_total_ensemble_stat_config.6488
>> ERROR :
>> ERROR : str_to_prob_info() -> problems parsing the string "*,*".
>> ERROR :
>>
>>
>>
>>
>>
>> If I try leaving obs_field[] = [] blank, I get:
>>
>> >*ensemble_stat 20 *./e0100_2012042100-2012042600_aod.nc
>> ./e0200_2012042100-2012042600_aod.nc
>> ./e0300_2012042100-2012042600_aod.nc
>> ./e0400_2012042100-2012042600_aod.nc
>> ./e0500_2012042100-2012042600_aod.nc
>> ./e0600_2012042100-2012042600_aod.nc
>> ./e0700_2012042100-2012042600_aod.nc
>> ./e0800_2012042100-2012042600_aod.nc
>> ./e0900_2012042100-2012042600_aod.nc
>> ./e1000_2012042100-2012042600_aod.nc
>> ./e1100_2012042100-2012042600_aod.nc
>> ./e1200_2012042100-2012042600_aod.nc
>> ./e1300_2012042100-2012042600_aod.nc
>> ./e1400_2012042100-2012042600_aod.nc
>> ./e1500_2012042100-2012042600_aod.nc
>> ./e1600_2012042100-2012042600_aod.nc
>> ./e1700_2012042100-2012042600_aod.nc
>> ./e1800_2012042100-2012042600_aod.nc
>> ./e1900_2012042100-2012042600_aod.nc
>> ./e2000_2012042100-2012042600_aod.nc*
>> NAAPS_total_ensemble_stat_config.6488 -ens_valid 20120426_00
-grid_obs
>> modis_2012042600_obsnew.nc -outdir
>>
/shared/aerosol_maud2/users/sessions/products/MET/2012042100/ENSEMBLE_STAT_OUT*
>> DEBUG 1: Default Config File:
>>
/shared/aerosol_heck2/users/sessions/_METv3.1/data/config/EnsembleStatConfig_default
>> DEBUG 1: User Config File: NAAPS_total_ensemble_stat_config.6488
>> ERROR :
>> ERROR : EnsembleStatConfInfo::process_config() -> When the
forecast
>> file is not GRIB1, "obs_field" cannot be blank. You must specify
the
>> verifying observations following the GRIB1 convention.
>> ERROR :
>>
>>
>>
>>
>>
>> Here is the top of my configuration file:
>>
>> model = "NAAPS";
>> ens_field[] = [ "total_aod(*,*)" ];
>> ens_thresh[] = [ "ge0.0" ];
>> vld_ens_thresh = 1.0;
>> vld_data_thresh = 1.0;
>> fcst_field[] = [ "total_aod(*,*)" ];
>> obs_field[] = [ "total_aod(*,*)" ];
>>
>>
>>
>>
>> And metadata on a sample ensemble and obs file:
>>
>> >ncdump -h e0100_2012042100-2012042600_aod.nc
>> netcdf e0100_2012042100-2012042600_aod {
>> dimensions:
>> lon = 360 ;
>> lat = 180 ;
>> variables:
>> float total_aod(lat, lon) ;
>> total_aod:name = "total_AOD" ;
>> total_aod:long_name = "total aerosol optical
depth" ;
>> total_aod:level = "column" ;
>> total_aod:units = " " ;
>> total_aod:valid_time_ut = 1335398400 ;
>> total_aod:init_time_ut = 1334966400 ;
>> total_aod:accum_time = 0 ;
>>
>>
>> // global attributes:
>> :MET_version = "V3.1" ;
>> :Projection = "LatLon" ;
>> :lat_ll = -89.5 ;
>> :lon_ll = -179.5 ;
>> :delta_lat = "1.0 degrees" ;
>> :delta_lon = "1.0 degrees" ;
>> :Nlon = "360 grid_points" ;
>> :Nlat = "180 grid_points" ;
>> }
>>
>> >ncdump -h modis_2012042600_obsnew.nc
>> netcdf modis_2012042600_obsnew {
>> dimensions:
>> lon = 360 ;
>> lat = 180 ;
>> variables:
>> float total_aod(lat, lon) ;
>> total_aod:name = "TOTAL_AOD" ;
>> total_aod:long_name = "modis total aerosol
optical depth"
>> ;
>> total_aod:src_dir =
>> "/shared/aerosol_ops2/modis_obsnew_1d6h/landocean/terraaqua/" ;
>> total_aod:level = "column" ;
>> total_aod:units = " " ;
>> total_aod:valid_time_ut = 1335398400 ;
>> total_aod:accum_time = 0 ;
>>
>> // global attributes:
>> :MET_version = "V3.1" ;
>> :Projection = "LatLon" ;
>> :lat_ll = -89.5 ;
>> :lon_ll = -179.5 ;
>> :delta_lat = "1.0 degrees" ;
>> :delta_lon = "1.0 degrees" ;
>> :Nlon = "360 grid_points" ;
>> :Nlat = "180 grid_points" ;
>> }
>>
>>
>>
>>
>> In the ensemble_stat documentation, it doesn't seem to indicate
that
>> observations need to be in GRIB1 format, but the only way to get
the
>> tool to run at all is to either leave fcst_field blank, or throw in
a
>> dummy GRIB accumulation period in obs_field. The latter eventually
>> results in an error after the basic statistics are computer. Any
ideas
>> what I'm messing up here?
>>
>> --
>> Walter R. Sessions
>> Atmospheric Scientist
>> CSC Contractor
>> Aerosol and Radiation Section
>> Naval Research Laboratory
>> Of.831.656.4061
>> Ce.407.319.8639
>>
>>
>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #56157] obs_field ensemble_stat error
From: Walter Sessions
Time: Tue May 01 18:10:04 2012
It ran - thanks!
Walter R. Sessions
Atmospheric Scientist
CSC Contractor
Aerosol and Radiation Section
Naval Research Laboratory
Of.831.656.4061
Ce.407.319.8639
On 05/01/2012 07:37 AM, John Halley Gotway via RT wrote:
> Walter,
>
> OK, I've worked up a patch that will enable Ensemble-Stat to be run
in the way you'd like. This was of course how we intended Ensemble-
Stat to work, but there was a flaw in the logic in the library
> code that prevented it from working properly.
>
> Ensemble-Stat is a bit tricky though. It can handle gridded and/or
point observations. However, if you're using point obs, you need to
set the "obs_field" parameter following GRIB conventions (e.g.
> APCP/A12 to mean observations of 12-hourly accumulated precip). For
this reason, you wouldn't be able to run Ensemble-Stat using gridded
NetCDF observations and point observations in the same run.
> You'd need to do it in two separate runs with changes to the
"obs_field" setting in the config file.
>
> I've attached a tar file containing the proposed patch. Please
apply this patch to your build of MET (see instructions at the top of
this page:
>
http://www.dtcenter.org/met/users/support/known_issues/METv3.1/index.php)
and rerun your data. Then please let me know if the patched code
works for you as expected. If so, I'll post the changes to
> the website to distribute to other MET users.
>
> Thanks again for pointing out this short-coming in the MET code.
>
> John Halley Gotway
> met_help at ucar.edu
>
> On 04/30/2012 02:33 PM, John Halley Gotway wrote:
>> Hello Walter,
>>
>> After a brief review of the code, it appears you have likely
identified a
>> short-coming in the Ensemble-Stat tool. I will take a look at this
in
>> more detail and try to get back to you tomorrow about a possible
patch or
>> work-around.
>>
>> Thanks for letting us know about this issue.
>>
>> John Halley Gotway
>> met_help at ucar.edu
>>
>>> Mon Apr 30 10:29:16 2012: Request 56157 was acted upon.
>>> Transaction: Ticket created by walter.sessions.ctr at nrlmry.navy.mil
>>> Queue: met_help
>>> Subject: obs_field ensemble_stat error
>>> Owner: Nobody
>>> Requestors: walter.sessions.ctr at nrlmry.navy.mil
>>> Status: new
>>> Ticket<URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=56157>
>>>
>>>
>>> I get the following error when I attempt to run ensemble_stat
with a
>>> netcdf gridded observation file:
>>>
>>> >*ensemble_stat 20 .*/e0100_2012042100-2012042600_aod.nc
>>> ./e0200_2012042100-2012042600_aod.nc
>>> ./e0300_2012042100-2012042600_aod.nc
>>> ./e0400_2012042100-2012042600_aod.nc
>>> ./e0500_2012042100-2012042600_aod.nc
>>> ./e0600_2012042100-2012042600_aod.nc
>>> ./e0700_2012042100-2012042600_aod.nc
>>> ./e0800_2012042100-2012042600_aod.nc
>>> ./e0900_2012042100-2012042600_aod.nc
>>> ./e1000_2012042100-2012042600_aod.nc
>>> ./e1100_2012042100-2012042600_aod.nc
>>> ./e1200_2012042100-2012042600_aod.nc
>>> ./e1300_2012042100-2012042600_aod.nc
>>> ./e1400_2012042100-2012042600_aod.nc
>>> ./e1500_2012042100-2012042600_aod.nc
>>> ./e1600_2012042100-2012042600_aod.nc
>>> ./e1700_2012042100-2012042600_aod.nc
>>> ./e1800_2012042100-2012042600_aod.nc
>>> ./e1900_2012042100-2012042600_aod.nc
>>> ./e2000_2012042100-2012042600_aod.nc
>>> *NAAPS_total_ensemble_stat_config.6488 -ens_valid 20120426_00
-grid_obs
>>> modis_2012042600_obsnew.nc -outdir
>>>
/shared/aerosol_maud2/users/sessions/products/MET/2012042100/ENSEMBLE_STAT_OUT*
>>> DEBUG 1: Default Config File:
>>>
/shared/aerosol_heck2/users/sessions/_METv3.1/data/config/EnsembleStatConfig_default
>>> DEBUG 1: User Config File: NAAPS_total_ensemble_stat_config.6488
>>> ERROR :
>>> ERROR : str_to_prob_info() -> problems parsing the string
"*,*".
>>> ERROR :
>>>
>>>
>>>
>>>
>>>
>>> If I try leaving obs_field[] = [] blank, I get:
>>>
>>> >*ensemble_stat 20 *./e0100_2012042100-2012042600_aod.nc
>>> ./e0200_2012042100-2012042600_aod.nc
>>> ./e0300_2012042100-2012042600_aod.nc
>>> ./e0400_2012042100-2012042600_aod.nc
>>> ./e0500_2012042100-2012042600_aod.nc
>>> ./e0600_2012042100-2012042600_aod.nc
>>> ./e0700_2012042100-2012042600_aod.nc
>>> ./e0800_2012042100-2012042600_aod.nc
>>> ./e0900_2012042100-2012042600_aod.nc
>>> ./e1000_2012042100-2012042600_aod.nc
>>> ./e1100_2012042100-2012042600_aod.nc
>>> ./e1200_2012042100-2012042600_aod.nc
>>> ./e1300_2012042100-2012042600_aod.nc
>>> ./e1400_2012042100-2012042600_aod.nc
>>> ./e1500_2012042100-2012042600_aod.nc
>>> ./e1600_2012042100-2012042600_aod.nc
>>> ./e1700_2012042100-2012042600_aod.nc
>>> ./e1800_2012042100-2012042600_aod.nc
>>> ./e1900_2012042100-2012042600_aod.nc
>>> ./e2000_2012042100-2012042600_aod.nc*
>>> NAAPS_total_ensemble_stat_config.6488 -ens_valid 20120426_00
-grid_obs
>>> modis_2012042600_obsnew.nc -outdir
>>>
/shared/aerosol_maud2/users/sessions/products/MET/2012042100/ENSEMBLE_STAT_OUT*
>>> DEBUG 1: Default Config File:
>>>
/shared/aerosol_heck2/users/sessions/_METv3.1/data/config/EnsembleStatConfig_default
>>> DEBUG 1: User Config File: NAAPS_total_ensemble_stat_config.6488
>>> ERROR :
>>> ERROR : EnsembleStatConfInfo::process_config() -> When the
forecast
>>> file is not GRIB1, "obs_field" cannot be blank. You must specify
the
>>> verifying observations following the GRIB1 convention.
>>> ERROR :
>>>
>>>
>>>
>>>
>>>
>>> Here is the top of my configuration file:
>>>
>>> model = "NAAPS";
>>> ens_field[] = [ "total_aod(*,*)" ];
>>> ens_thresh[] = [ "ge0.0" ];
>>> vld_ens_thresh = 1.0;
>>> vld_data_thresh = 1.0;
>>> fcst_field[] = [ "total_aod(*,*)" ];
>>> obs_field[] = [ "total_aod(*,*)" ];
>>>
>>>
>>>
>>>
>>> And metadata on a sample ensemble and obs file:
>>>
>>> >ncdump -h e0100_2012042100-2012042600_aod.nc
>>> netcdf e0100_2012042100-2012042600_aod {
>>> dimensions:
>>> lon = 360 ;
>>> lat = 180 ;
>>> variables:
>>> float total_aod(lat, lon) ;
>>> total_aod:name = "total_AOD" ;
>>> total_aod:long_name = "total aerosol optical
depth" ;
>>> total_aod:level = "column" ;
>>> total_aod:units = " " ;
>>> total_aod:valid_time_ut = 1335398400 ;
>>> total_aod:init_time_ut = 1334966400 ;
>>> total_aod:accum_time = 0 ;
>>>
>>>
>>> // global attributes:
>>> :MET_version = "V3.1" ;
>>> :Projection = "LatLon" ;
>>> :lat_ll = -89.5 ;
>>> :lon_ll = -179.5 ;
>>> :delta_lat = "1.0 degrees" ;
>>> :delta_lon = "1.0 degrees" ;
>>> :Nlon = "360 grid_points" ;
>>> :Nlat = "180 grid_points" ;
>>> }
>>>
>>> >ncdump -h modis_2012042600_obsnew.nc
>>> netcdf modis_2012042600_obsnew {
>>> dimensions:
>>> lon = 360 ;
>>> lat = 180 ;
>>> variables:
>>> float total_aod(lat, lon) ;
>>> total_aod:name = "TOTAL_AOD" ;
>>> total_aod:long_name = "modis total aerosol
optical depth"
>>> ;
>>> total_aod:src_dir =
>>> "/shared/aerosol_ops2/modis_obsnew_1d6h/landocean/terraaqua/" ;
>>> total_aod:level = "column" ;
>>> total_aod:units = " " ;
>>> total_aod:valid_time_ut = 1335398400 ;
>>> total_aod:accum_time = 0 ;
>>>
>>> // global attributes:
>>> :MET_version = "V3.1" ;
>>> :Projection = "LatLon" ;
>>> :lat_ll = -89.5 ;
>>> :lon_ll = -179.5 ;
>>> :delta_lat = "1.0 degrees" ;
>>> :delta_lon = "1.0 degrees" ;
>>> :Nlon = "360 grid_points" ;
>>> :Nlat = "180 grid_points" ;
>>> }
>>>
>>>
>>>
>>>
>>> In the ensemble_stat documentation, it doesn't seem to indicate
that
>>> observations need to be in GRIB1 format, but the only way to get
the
>>> tool to run at all is to either leave fcst_field blank, or throw
in a
>>> dummy GRIB accumulation period in obs_field. The latter
eventually
>>> results in an error after the basic statistics are computer. Any
ideas
>>> what I'm messing up here?
>>>
>>> --
>>> Walter R. Sessions
>>> Atmospheric Scientist
>>> CSC Contractor
>>> Aerosol and Radiation Section
>>> Naval Research Laboratory
>>> Of.831.656.4061
>>> Ce.407.319.8639
>>>
>>>
------------------------------------------------
More information about the Met_help
mailing list