[Met_help] [rt.rap.ucar.edu #72945] History for Point Stat, GriB and NetCDF confusion
John Halley Gotway via RT
met_help at ucar.edu
Wed Aug 19 14:56:49 MDT 2015
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Hi,
I'm trying to run point_stat with the following:
Forecast is a single GriB 1 precipitation field (APCP).
Observations are the sum of 24 Stage IV Precipitation Analyses, all 1 hourly amounts in NetCDF. They were summed using pcp_combine. The resulting summation file has the variable name 'APCP_24'.
I set in my point_stat config file the following:
fcst = {
wind_thresh = [ NA ];
field = [
{
name = "APCP";
level = "L0";
cat_thresh = [ >=0.0 ];
}
];
};
obs = {
field = [
{
name = "APCP_24";
level = "A24";
cat_thresh = [ >=0.0 ];
}
];
};
But I get the following error:
ERROR : VarInfoGrib::set_dict() - unrecognized GRIB1 field abbreviation 'APCP_24' for table version 2
I realize APCP_24 isn't in the GriB 1 table, but the variable name comes from pcp_combine so I don't think I have power to change it.
Can I only run point_stat if both model and obs are called "APCP" in their respective files? If they can be different, how do I handle it?
More information which may be helpful:
GriB header for my forecast data:
rec 1:0:date 2015073100 APCP kpds5=61 kpds6=1 kpds7=0 levels=(0,0) grid=255 sfc 24-0hr fcst:ave at 1yr: bitmap: 624213 undef
APCP=Total precipitation [kg/m^2]
timerange 133 P1 24 P2 0 TimeU 1 nx 1440 ny 600 GDS grid 0 num_in_ave 0 missing 0
center 57 subcenter 2 process 89 Table 128 scan: WE:SN winds(N/S)
latlon: lat -59.875000 to 89.875000 by 0.250000 nxny 864000
long -179.875000 to 179.875000 by 0.250000, (1440 x 600) scan 64 mode 128 bdsgrid 1
min/max data 0 220 num bits 15 BDS_Ref 0 DecScale 2 BinScale 0
NetCDF header for my observation data:
netcdf NCEP.20150731_00_24h_8km_sum {
dimensions:
lat = 360 ;
lon = 720 ;
variables:
float lat(lat, lon) ;
lat:long_name = "latitude" ;
lat:units = "degrees_north" ;
lat:standard_name = "latitude" ;
float lon(lat, lon) ;
lon:long_name = "longitude" ;
lon:units = "degrees_east" ;
lon:standard_name = "longitude" ;
float APCP_24(lat, lon) ;
APCP_24:name = "APCP_24" ;
APCP_24:long_name = "Total precipitation" ;
APCP_24:level = "A24" ;
APCP_24:units = "kg/m^2" ;
APCP_24:_FillValue = -9999.f ;
APCP_24:init_time = "20150731_000000" ;
APCP_24:init_time_ut = 1438300800 ;
APCP_24:valid_time = "20150731_000000" ;
APCP_24:valid_time_ut = 1438300800 ;
APCP_24:accum_time = "240000" ;
APCP_24:accum_time_sec = 86400 ;
// global attributes:
:FileOrigins = "File /h/data/global/WXQC/data/met/lis/NCEP.20150731_00_24h_8km_sum.nc generated 20150811_195735 UTC on host dev8dlsn1 by the MET pcp_combine tool" ;
:MET_version = "V4.1" ;
:MET_tool = "pcp_combine" ;
:RunCommand = "Sum: 24 files with accumulations of 010000." ;
:Projection = "LatLon" ;
:lat_ll = "-89.750000 degrees_north" ;
:lon_ll = "0.250000 degrees_east" ;
:delta_lat = "0.500000 degrees" ;
:delta_lon = "0.500000 degrees" ;
:Nlat = "360 grid_points" ;
:Nlon = "720 grid_points" ;
Thanks,
Matt
// SIGNED //
Matthew C. Sittel
University Corporation for Atmospheric Research
16 WS/WXN, 557 WW, Offutt AFB, NE
matthew.sittel.ctr at us.af.mil
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: Point Stat, GriB and NetCDF confusion
From: Julie Prestopnik
Time: Tue Aug 11 14:26:14 2015
Hi Matt.
I think what might be going on here is that you may need to specify
the
information for the observation field as if it was in a GRIB file. I
know
this sounds confusing, but it is a bit of legacy behavior. Try
replacing
this with what you currently have for "obs" in your configuration
file:
obs = {
wind_thresh = [ NA ];
message_type = [ "ADPSFC" ];
field = [
{
name = "APCP";
level = [ "A24" ];
cat_thresh = [ >=0.0 ];
}
];
};
If you still have trouble, could you please upload your data and
config
file to our FTP site using the instructions here:
http://www.dtcenter.org/met/users/support/met_help.php#ftp
Then, I can take a closer look.
Thanks,
Julie
On Tue, Aug 11, 2015 at 2:00 PM, SITTEL, MATTHEW C CTR USAF AFWA 16
WS/WXN
via RT <met_help at ucar.edu> wrote:
>
> Tue Aug 11 14:00:29 2015: Request 72945 was acted upon.
> Transaction: Ticket created by matthew.sittel.ctr at us.af.mil
> Queue: met_help
> Subject: Point Stat, GriB and NetCDF confusion
> Owner: Nobody
> Requestors: matthew.sittel.ctr at us.af.mil
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=72945 >
>
>
> Hi,
>
> I'm trying to run point_stat with the following:
>
> Forecast is a single GriB 1 precipitation field (APCP).
> Observations are the sum of 24 Stage IV Precipitation Analyses, all
1
> hourly amounts in NetCDF. They were summed using pcp_combine. The
> resulting summation file has the variable name 'APCP_24'.
>
> I set in my point_stat config file the following:
>
> fcst = {
> wind_thresh = [ NA ];
>
> field = [
> {
> name = "APCP";
> level = "L0";
> cat_thresh = [ >=0.0 ];
> }
> ];
>
> };
>
> obs = {
> field = [
> {
> name = "APCP_24";
> level = "A24";
> cat_thresh = [ >=0.0 ];
> }
> ];
> };
>
> But I get the following error:
>
> ERROR : VarInfoGrib::set_dict() - unrecognized GRIB1 field
abbreviation
> 'APCP_24' for table version 2
>
> I realize APCP_24 isn't in the GriB 1 table, but the variable name
comes
> from pcp_combine so I don't think I have power to change it.
>
> Can I only run point_stat if both model and obs are called "APCP" in
their
> respective files? If they can be different, how do I handle it?
>
> More information which may be helpful:
>
> GriB header for my forecast data:
>
> rec 1:0:date 2015073100 APCP kpds5=61 kpds6=1 kpds7=0 levels=(0,0)
> grid=255 sfc 24-0hr fcst:ave at 1yr: bitmap: 624213 undef
> APCP=Total precipitation [kg/m^2]
> timerange 133 P1 24 P2 0 TimeU 1 nx 1440 ny 600 GDS grid 0
num_in_ave 0
> missing 0
> center 57 subcenter 2 process 89 Table 128 scan: WE:SN winds(N/S)
> latlon: lat -59.875000 to 89.875000 by 0.250000 nxny 864000
> long -179.875000 to 179.875000 by 0.250000, (1440 x 600)
scan 64
> mode 128 bdsgrid 1
> min/max data 0 220 num bits 15 BDS_Ref 0 DecScale 2 BinScale 0
>
> NetCDF header for my observation data:
>
> netcdf NCEP.20150731_00_24h_8km_sum {
> dimensions:
> lat = 360 ;
> lon = 720 ;
> variables:
> float lat(lat, lon) ;
> lat:long_name = "latitude" ;
> lat:units = "degrees_north" ;
> lat:standard_name = "latitude" ;
> float lon(lat, lon) ;
> lon:long_name = "longitude" ;
> lon:units = "degrees_east" ;
> lon:standard_name = "longitude" ;
> float APCP_24(lat, lon) ;
> APCP_24:name = "APCP_24" ;
> APCP_24:long_name = "Total precipitation" ;
> APCP_24:level = "A24" ;
> APCP_24:units = "kg/m^2" ;
> APCP_24:_FillValue = -9999.f ;
> APCP_24:init_time = "20150731_000000" ;
> APCP_24:init_time_ut = 1438300800 ;
> APCP_24:valid_time = "20150731_000000" ;
> APCP_24:valid_time_ut = 1438300800 ;
> APCP_24:accum_time = "240000" ;
> APCP_24:accum_time_sec = 86400 ;
>
> // global attributes:
> :FileOrigins = "File
/h/data/global/WXQC/data/met/lis/
> NCEP.20150731_00_24h_8km_sum.nc generated 20150811_195735 UTC on
host
> dev8dlsn1 by the MET pcp_combine tool" ;
> :MET_version = "V4.1" ;
> :MET_tool = "pcp_combine" ;
> :RunCommand = "Sum: 24 files with accumulations of
> 010000." ;
> :Projection = "LatLon" ;
> :lat_ll = "-89.750000 degrees_north" ;
> :lon_ll = "0.250000 degrees_east" ;
> :delta_lat = "0.500000 degrees" ;
> :delta_lon = "0.500000 degrees" ;
> :Nlat = "360 grid_points" ;
> :Nlon = "720 grid_points" ;
>
> Thanks,
> Matt
>
> // SIGNED //
> Matthew C. Sittel
> University Corporation for Atmospheric Research
> 16 WS/WXN, 557 WW, Offutt AFB, NE
> matthew.sittel.ctr at us.af.mil
>
>
>
>
>
--
Julie Prestopnik
National Center for Atmospheric Research
Research Applications Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #72945] Point Stat, GriB and NetCDF confusion
From: SITTEL, MATTHEW C CTR USAF AFWA 16 WS/WXN
Time: Tue Aug 11 14:36:37 2015
Hi Julie,
That didn't work.
I put my NetCDF summed file (the observation file), GriB 1 model data
(ends in TP.9999) and the config file I am using.
I am wondering now if I'm just confused... can you use pcp_combine to
sum up NetCDF files and use its result as observation data, or only
model data?
Thanks,
Matt
-----Original Message-----
From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
Sent: Tuesday, August 11, 2015 3:26 PM
To: SITTEL, MATTHEW C CTR USAF AFMC AFLCMC/HBAW-OL
Subject: Re: [rt.rap.ucar.edu #72945] Point Stat, GriB and NetCDF
confusion
Hi Matt.
I think what might be going on here is that you may need to specify
the information for the observation field as if it was in a GRIB file.
I know this sounds confusing, but it is a bit of legacy behavior. Try
replacing this with what you currently have for "obs" in your
configuration file:
obs = {
wind_thresh = [ NA ];
message_type = [ "ADPSFC" ];
field = [
{
name = "APCP";
level = [ "A24" ];
cat_thresh = [ >=0.0 ];
}
];
};
If you still have trouble, could you please upload your data and
config file to our FTP site using the instructions here:
http://www.dtcenter.org/met/users/support/met_help.php#ftp
Then, I can take a closer look.
Thanks,
Julie
On Tue, Aug 11, 2015 at 2:00 PM, SITTEL, MATTHEW C CTR USAF AFWA 16
WS/WXN via RT <met_help at ucar.edu> wrote:
>
> Tue Aug 11 14:00:29 2015: Request 72945 was acted upon.
> Transaction: Ticket created by matthew.sittel.ctr at us.af.mil
> Queue: met_help
> Subject: Point Stat, GriB and NetCDF confusion
> Owner: Nobody
> Requestors: matthew.sittel.ctr at us.af.mil
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=72945
> >
>
>
> Hi,
>
> I'm trying to run point_stat with the following:
>
> Forecast is a single GriB 1 precipitation field (APCP).
> Observations are the sum of 24 Stage IV Precipitation Analyses, all
1
> hourly amounts in NetCDF. They were summed using pcp_combine. The
> resulting summation file has the variable name 'APCP_24'.
>
> I set in my point_stat config file the following:
>
> fcst = {
> wind_thresh = [ NA ];
>
> field = [
> {
> name = "APCP";
> level = "L0";
> cat_thresh = [ >=0.0 ];
> }
> ];
>
> };
>
> obs = {
> field = [
> {
> name = "APCP_24";
> level = "A24";
> cat_thresh = [ >=0.0 ];
> }
> ];
> };
>
> But I get the following error:
>
> ERROR : VarInfoGrib::set_dict() - unrecognized GRIB1 field
> abbreviation 'APCP_24' for table version 2
>
> I realize APCP_24 isn't in the GriB 1 table, but the variable name
> comes from pcp_combine so I don't think I have power to change it.
>
> Can I only run point_stat if both model and obs are called "APCP" in
their
> respective files? If they can be different, how do I handle it?
>
> More information which may be helpful:
>
> GriB header for my forecast data:
>
> rec 1:0:date 2015073100 APCP kpds5=61 kpds6=1 kpds7=0 levels=(0,0)
> grid=255 sfc 24-0hr fcst:ave at 1yr: bitmap: 624213 undef
> APCP=Total precipitation [kg/m^2]
> timerange 133 P1 24 P2 0 TimeU 1 nx 1440 ny 600 GDS grid 0
> num_in_ave 0 missing 0
> center 57 subcenter 2 process 89 Table 128 scan: WE:SN winds(N/S)
> latlon: lat -59.875000 to 89.875000 by 0.250000 nxny 864000
> long -179.875000 to 179.875000 by 0.250000, (1440 x 600)
> scan 64 mode 128 bdsgrid 1
> min/max data 0 220 num bits 15 BDS_Ref 0 DecScale 2 BinScale 0
>
> NetCDF header for my observation data:
>
> netcdf NCEP.20150731_00_24h_8km_sum {
> dimensions:
> lat = 360 ;
> lon = 720 ;
> variables:
> float lat(lat, lon) ;
> lat:long_name = "latitude" ;
> lat:units = "degrees_north" ;
> lat:standard_name = "latitude" ;
> float lon(lat, lon) ;
> lon:long_name = "longitude" ;
> lon:units = "degrees_east" ;
> lon:standard_name = "longitude" ;
> float APCP_24(lat, lon) ;
> APCP_24:name = "APCP_24" ;
> APCP_24:long_name = "Total precipitation" ;
> APCP_24:level = "A24" ;
> APCP_24:units = "kg/m^2" ;
> APCP_24:_FillValue = -9999.f ;
> APCP_24:init_time = "20150731_000000" ;
> APCP_24:init_time_ut = 1438300800 ;
> APCP_24:valid_time = "20150731_000000" ;
> APCP_24:valid_time_ut = 1438300800 ;
> APCP_24:accum_time = "240000" ;
> APCP_24:accum_time_sec = 86400 ;
>
> // global attributes:
> :FileOrigins = "File
/h/data/global/WXQC/data/met/lis/
> NCEP.20150731_00_24h_8km_sum.nc generated 20150811_195735 UTC on
host
> dev8dlsn1 by the MET pcp_combine tool" ;
> :MET_version = "V4.1" ;
> :MET_tool = "pcp_combine" ;
> :RunCommand = "Sum: 24 files with accumulations of
> 010000." ;
> :Projection = "LatLon" ;
> :lat_ll = "-89.750000 degrees_north" ;
> :lon_ll = "0.250000 degrees_east" ;
> :delta_lat = "0.500000 degrees" ;
> :delta_lon = "0.500000 degrees" ;
> :Nlat = "360 grid_points" ;
> :Nlon = "720 grid_points" ;
>
> Thanks,
> Matt
>
> // SIGNED //
> Matthew C. Sittel
> University Corporation for Atmospheric Research
> 16 WS/WXN, 557 WW, Offutt AFB, NE
> matthew.sittel.ctr at us.af.mil
>
>
>
>
>
--
Julie Prestopnik
National Center for Atmospheric Research Research Applications
Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #72945] Point Stat, GriB and NetCDF confusion
From: SITTEL, MATTHEW C CTR USAF AFWA 16 WS/WXN
Time: Wed Aug 12 14:29:23 2015
Hi Julie,
Hopefully the files I pushed yesterday afternoon made it without
incident. I have tried some other things today like modifying the
GriB table but I still haven't found a solution.
If you need anything else from me that would help you, please let me
know.
Thanks,
Matt
-----Original Message-----
From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
Sent: Tuesday, August 11, 2015 3:26 PM
To: SITTEL, MATTHEW C CTR USAF AFMC AFLCMC/HBAW-OL
Subject: Re: [rt.rap.ucar.edu #72945] Point Stat, GriB and NetCDF
confusion
Hi Matt.
I think what might be going on here is that you may need to specify
the information for the observation field as if it was in a GRIB file.
I know this sounds confusing, but it is a bit of legacy behavior. Try
replacing this with what you currently have for "obs" in your
configuration file:
obs = {
wind_thresh = [ NA ];
message_type = [ "ADPSFC" ];
field = [
{
name = "APCP";
level = [ "A24" ];
cat_thresh = [ >=0.0 ];
}
];
};
If you still have trouble, could you please upload your data and
config file to our FTP site using the instructions here:
http://www.dtcenter.org/met/users/support/met_help.php#ftp
Then, I can take a closer look.
Thanks,
Julie
On Tue, Aug 11, 2015 at 2:00 PM, SITTEL, MATTHEW C CTR USAF AFWA 16
WS/WXN via RT <met_help at ucar.edu> wrote:
>
> Tue Aug 11 14:00:29 2015: Request 72945 was acted upon.
> Transaction: Ticket created by matthew.sittel.ctr at us.af.mil
> Queue: met_help
> Subject: Point Stat, GriB and NetCDF confusion
> Owner: Nobody
> Requestors: matthew.sittel.ctr at us.af.mil
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=72945
> >
>
>
> Hi,
>
> I'm trying to run point_stat with the following:
>
> Forecast is a single GriB 1 precipitation field (APCP).
> Observations are the sum of 24 Stage IV Precipitation Analyses, all
1
> hourly amounts in NetCDF. They were summed using pcp_combine. The
> resulting summation file has the variable name 'APCP_24'.
>
> I set in my point_stat config file the following:
>
> fcst = {
> wind_thresh = [ NA ];
>
> field = [
> {
> name = "APCP";
> level = "L0";
> cat_thresh = [ >=0.0 ];
> }
> ];
>
> };
>
> obs = {
> field = [
> {
> name = "APCP_24";
> level = "A24";
> cat_thresh = [ >=0.0 ];
> }
> ];
> };
>
> But I get the following error:
>
> ERROR : VarInfoGrib::set_dict() - unrecognized GRIB1 field
> abbreviation 'APCP_24' for table version 2
>
> I realize APCP_24 isn't in the GriB 1 table, but the variable name
> comes from pcp_combine so I don't think I have power to change it.
>
> Can I only run point_stat if both model and obs are called "APCP" in
their
> respective files? If they can be different, how do I handle it?
>
> More information which may be helpful:
>
> GriB header for my forecast data:
>
> rec 1:0:date 2015073100 APCP kpds5=61 kpds6=1 kpds7=0 levels=(0,0)
> grid=255 sfc 24-0hr fcst:ave at 1yr: bitmap: 624213 undef
> APCP=Total precipitation [kg/m^2]
> timerange 133 P1 24 P2 0 TimeU 1 nx 1440 ny 600 GDS grid 0
> num_in_ave 0 missing 0
> center 57 subcenter 2 process 89 Table 128 scan: WE:SN winds(N/S)
> latlon: lat -59.875000 to 89.875000 by 0.250000 nxny 864000
> long -179.875000 to 179.875000 by 0.250000, (1440 x 600)
> scan 64 mode 128 bdsgrid 1
> min/max data 0 220 num bits 15 BDS_Ref 0 DecScale 2 BinScale 0
>
> NetCDF header for my observation data:
>
> netcdf NCEP.20150731_00_24h_8km_sum {
> dimensions:
> lat = 360 ;
> lon = 720 ;
> variables:
> float lat(lat, lon) ;
> lat:long_name = "latitude" ;
> lat:units = "degrees_north" ;
> lat:standard_name = "latitude" ;
> float lon(lat, lon) ;
> lon:long_name = "longitude" ;
> lon:units = "degrees_east" ;
> lon:standard_name = "longitude" ;
> float APCP_24(lat, lon) ;
> APCP_24:name = "APCP_24" ;
> APCP_24:long_name = "Total precipitation" ;
> APCP_24:level = "A24" ;
> APCP_24:units = "kg/m^2" ;
> APCP_24:_FillValue = -9999.f ;
> APCP_24:init_time = "20150731_000000" ;
> APCP_24:init_time_ut = 1438300800 ;
> APCP_24:valid_time = "20150731_000000" ;
> APCP_24:valid_time_ut = 1438300800 ;
> APCP_24:accum_time = "240000" ;
> APCP_24:accum_time_sec = 86400 ;
>
> // global attributes:
> :FileOrigins = "File
/h/data/global/WXQC/data/met/lis/
> NCEP.20150731_00_24h_8km_sum.nc generated 20150811_195735 UTC on
host
> dev8dlsn1 by the MET pcp_combine tool" ;
> :MET_version = "V4.1" ;
> :MET_tool = "pcp_combine" ;
> :RunCommand = "Sum: 24 files with accumulations of
> 010000." ;
> :Projection = "LatLon" ;
> :lat_ll = "-89.750000 degrees_north" ;
> :lon_ll = "0.250000 degrees_east" ;
> :delta_lat = "0.500000 degrees" ;
> :delta_lon = "0.500000 degrees" ;
> :Nlat = "360 grid_points" ;
> :Nlon = "720 grid_points" ;
>
> Thanks,
> Matt
>
> // SIGNED //
> Matthew C. Sittel
> University Corporation for Atmospheric Research
> 16 WS/WXN, 557 WW, Offutt AFB, NE
> matthew.sittel.ctr at us.af.mil
>
>
>
>
>
--
Julie Prestopnik
National Center for Atmospheric Research Research Applications
Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
------------------------------------------------
Subject: Point Stat, GriB and NetCDF confusion
From: Julie Prestopnik
Time: Wed Aug 12 15:13:41 2015
Hi Matt. I received your files. Unfortunately, I do not yet have a
solution for you. We are working on the problem and hope to get back
to you
later this week.
Julie
On Wed, Aug 12, 2015 at 2:29 PM, SITTEL, MATTHEW C CTR USAF AFWA 16
WS/WXN
via RT <met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=72945 >
>
> Hi Julie,
>
> Hopefully the files I pushed yesterday afternoon made it without
> incident. I have tried some other things today like modifying the
GriB
> table but I still haven't found a solution.
>
> If you need anything else from me that would help you, please let me
know.
>
> Thanks,
> Matt
>
> -----Original Message-----
> From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> Sent: Tuesday, August 11, 2015 3:26 PM
> To: SITTEL, MATTHEW C CTR USAF AFMC AFLCMC/HBAW-OL
> Subject: Re: [rt.rap.ucar.edu #72945] Point Stat, GriB and NetCDF
> confusion
>
> Hi Matt.
>
> I think what might be going on here is that you may need to specify
the
> information for the observation field as if it was in a GRIB file.
I know
> this sounds confusing, but it is a bit of legacy behavior. Try
replacing
> this with what you currently have for "obs" in your configuration
file:
>
> obs = {
> wind_thresh = [ NA ];
> message_type = [ "ADPSFC" ];
> field = [
> {
> name = "APCP";
> level = [ "A24" ];
> cat_thresh = [ >=0.0 ];
> }
> ];
> };
>
> If you still have trouble, could you please upload your data and
config
> file to our FTP site using the instructions here:
>
> http://www.dtcenter.org/met/users/support/met_help.php#ftp
>
> Then, I can take a closer look.
>
> Thanks,
> Julie
>
> On Tue, Aug 11, 2015 at 2:00 PM, SITTEL, MATTHEW C CTR USAF AFWA 16
WS/WXN
> via RT <met_help at ucar.edu> wrote:
>
> >
> > Tue Aug 11 14:00:29 2015: Request 72945 was acted upon.
> > Transaction: Ticket created by matthew.sittel.ctr at us.af.mil
> > Queue: met_help
> > Subject: Point Stat, GriB and NetCDF confusion
> > Owner: Nobody
> > Requestors: matthew.sittel.ctr at us.af.mil
> > Status: new
> > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=72945
> > >
> >
> >
> > Hi,
> >
> > I'm trying to run point_stat with the following:
> >
> > Forecast is a single GriB 1 precipitation field (APCP).
> > Observations are the sum of 24 Stage IV Precipitation Analyses,
all 1
> > hourly amounts in NetCDF. They were summed using pcp_combine.
The
> > resulting summation file has the variable name 'APCP_24'.
> >
> > I set in my point_stat config file the following:
> >
> > fcst = {
> > wind_thresh = [ NA ];
> >
> > field = [
> > {
> > name = "APCP";
> > level = "L0";
> > cat_thresh = [ >=0.0 ];
> > }
> > ];
> >
> > };
> >
> > obs = {
> > field = [
> > {
> > name = "APCP_24";
> > level = "A24";
> > cat_thresh = [ >=0.0 ];
> > }
> > ];
> > };
> >
> > But I get the following error:
> >
> > ERROR : VarInfoGrib::set_dict() - unrecognized GRIB1 field
> > abbreviation 'APCP_24' for table version 2
> >
> > I realize APCP_24 isn't in the GriB 1 table, but the variable name
> > comes from pcp_combine so I don't think I have power to change it.
> >
> > Can I only run point_stat if both model and obs are called "APCP"
in
> their
> > respective files? If they can be different, how do I handle it?
> >
> > More information which may be helpful:
> >
> > GriB header for my forecast data:
> >
> > rec 1:0:date 2015073100 APCP kpds5=61 kpds6=1 kpds7=0 levels=(0,0)
> > grid=255 sfc 24-0hr fcst:ave at 1yr: bitmap: 624213 undef
> > APCP=Total precipitation [kg/m^2]
> > timerange 133 P1 24 P2 0 TimeU 1 nx 1440 ny 600 GDS grid 0
> > num_in_ave 0 missing 0
> > center 57 subcenter 2 process 89 Table 128 scan: WE:SN
winds(N/S)
> > latlon: lat -59.875000 to 89.875000 by 0.250000 nxny 864000
> > long -179.875000 to 179.875000 by 0.250000, (1440 x 600)
> > scan 64 mode 128 bdsgrid 1
> > min/max data 0 220 num bits 15 BDS_Ref 0 DecScale 2 BinScale
0
> >
> > NetCDF header for my observation data:
> >
> > netcdf NCEP.20150731_00_24h_8km_sum {
> > dimensions:
> > lat = 360 ;
> > lon = 720 ;
> > variables:
> > float lat(lat, lon) ;
> > lat:long_name = "latitude" ;
> > lat:units = "degrees_north" ;
> > lat:standard_name = "latitude" ;
> > float lon(lat, lon) ;
> > lon:long_name = "longitude" ;
> > lon:units = "degrees_east" ;
> > lon:standard_name = "longitude" ;
> > float APCP_24(lat, lon) ;
> > APCP_24:name = "APCP_24" ;
> > APCP_24:long_name = "Total precipitation" ;
> > APCP_24:level = "A24" ;
> > APCP_24:units = "kg/m^2" ;
> > APCP_24:_FillValue = -9999.f ;
> > APCP_24:init_time = "20150731_000000" ;
> > APCP_24:init_time_ut = 1438300800 ;
> > APCP_24:valid_time = "20150731_000000" ;
> > APCP_24:valid_time_ut = 1438300800 ;
> > APCP_24:accum_time = "240000" ;
> > APCP_24:accum_time_sec = 86400 ;
> >
> > // global attributes:
> > :FileOrigins = "File
/h/data/global/WXQC/data/met/lis/
> > NCEP.20150731_00_24h_8km_sum.nc generated 20150811_195735 UTC on
host
> > dev8dlsn1 by the MET pcp_combine tool" ;
> > :MET_version = "V4.1" ;
> > :MET_tool = "pcp_combine" ;
> > :RunCommand = "Sum: 24 files with accumulations of
> > 010000." ;
> > :Projection = "LatLon" ;
> > :lat_ll = "-89.750000 degrees_north" ;
> > :lon_ll = "0.250000 degrees_east" ;
> > :delta_lat = "0.500000 degrees" ;
> > :delta_lon = "0.500000 degrees" ;
> > :Nlat = "360 grid_points" ;
> > :Nlon = "720 grid_points" ;
> >
> > Thanks,
> > Matt
> >
> > // SIGNED //
> > Matthew C. Sittel
> > University Corporation for Atmospheric Research
> > 16 WS/WXN, 557 WW, Offutt AFB, NE
> > matthew.sittel.ctr at us.af.mil
> >
> >
> >
> >
> >
>
>
> --
> Julie Prestopnik
> National Center for Atmospheric Research Research Applications
Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
>
>
>
--
Julie Prestopnik
National Center for Atmospheric Research
Research Applications Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
------------------------------------------------
Subject: Point Stat, GriB and NetCDF confusion
From: Julie Prestopnik
Time: Thu Aug 13 10:11:23 2015
Hi Matt. Some of our team is on vacation and won't be back until next
week, as opposed to later this week. We'll keep working on a solution
and
will let you know as soon as we have one.
Thanks for your patience.
Julie
On Wed, Aug 12, 2015 at 3:13 PM, Julie Prestopnik <jpresto at ucar.edu>
wrote:
> Hi Matt. I received your files. Unfortunately, I do not yet have a
> solution for you. We are working on the problem and hope to get back
to you
> later this week.
>
> Julie
>
> On Wed, Aug 12, 2015 at 2:29 PM, SITTEL, MATTHEW C CTR USAF AFWA 16
WS/WXN
> via RT <met_help at ucar.edu> wrote:
>
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=72945 >
>>
>> Hi Julie,
>>
>> Hopefully the files I pushed yesterday afternoon made it without
>> incident. I have tried some other things today like modifying the
GriB
>> table but I still haven't found a solution.
>>
>> If you need anything else from me that would help you, please let
me know.
>>
>> Thanks,
>> Matt
>>
>> -----Original Message-----
>> From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
>> Sent: Tuesday, August 11, 2015 3:26 PM
>> To: SITTEL, MATTHEW C CTR USAF AFMC AFLCMC/HBAW-OL
>> Subject: Re: [rt.rap.ucar.edu #72945] Point Stat, GriB and NetCDF
>> confusion
>>
>> Hi Matt.
>>
>> I think what might be going on here is that you may need to specify
the
>> information for the observation field as if it was in a GRIB file.
I know
>> this sounds confusing, but it is a bit of legacy behavior. Try
replacing
>> this with what you currently have for "obs" in your configuration
file:
>>
>> obs = {
>> wind_thresh = [ NA ];
>> message_type = [ "ADPSFC" ];
>> field = [
>> {
>> name = "APCP";
>> level = [ "A24" ];
>> cat_thresh = [ >=0.0 ];
>> }
>> ];
>> };
>>
>> If you still have trouble, could you please upload your data and
config
>> file to our FTP site using the instructions here:
>>
>> http://www.dtcenter.org/met/users/support/met_help.php#ftp
>>
>> Then, I can take a closer look.
>>
>> Thanks,
>> Julie
>>
>> On Tue, Aug 11, 2015 at 2:00 PM, SITTEL, MATTHEW C CTR USAF AFWA 16
>> WS/WXN via RT <met_help at ucar.edu> wrote:
>>
>> >
>> > Tue Aug 11 14:00:29 2015: Request 72945 was acted upon.
>> > Transaction: Ticket created by matthew.sittel.ctr at us.af.mil
>> > Queue: met_help
>> > Subject: Point Stat, GriB and NetCDF confusion
>> > Owner: Nobody
>> > Requestors: matthew.sittel.ctr at us.af.mil
>> > Status: new
>> > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=72945
>> > >
>> >
>> >
>> > Hi,
>> >
>> > I'm trying to run point_stat with the following:
>> >
>> > Forecast is a single GriB 1 precipitation field (APCP).
>> > Observations are the sum of 24 Stage IV Precipitation Analyses,
all 1
>> > hourly amounts in NetCDF. They were summed using pcp_combine.
The
>> > resulting summation file has the variable name 'APCP_24'.
>> >
>> > I set in my point_stat config file the following:
>> >
>> > fcst = {
>> > wind_thresh = [ NA ];
>> >
>> > field = [
>> > {
>> > name = "APCP";
>> > level = "L0";
>> > cat_thresh = [ >=0.0 ];
>> > }
>> > ];
>> >
>> > };
>> >
>> > obs = {
>> > field = [
>> > {
>> > name = "APCP_24";
>> > level = "A24";
>> > cat_thresh = [ >=0.0 ];
>> > }
>> > ];
>> > };
>> >
>> > But I get the following error:
>> >
>> > ERROR : VarInfoGrib::set_dict() - unrecognized GRIB1 field
>> > abbreviation 'APCP_24' for table version 2
>> >
>> > I realize APCP_24 isn't in the GriB 1 table, but the variable
name
>> > comes from pcp_combine so I don't think I have power to change
it.
>> >
>> > Can I only run point_stat if both model and obs are called "APCP"
in
>> their
>> > respective files? If they can be different, how do I handle it?
>> >
>> > More information which may be helpful:
>> >
>> > GriB header for my forecast data:
>> >
>> > rec 1:0:date 2015073100 APCP kpds5=61 kpds6=1 kpds7=0
levels=(0,0)
>> > grid=255 sfc 24-0hr fcst:ave at 1yr: bitmap: 624213 undef
>> > APCP=Total precipitation [kg/m^2]
>> > timerange 133 P1 24 P2 0 TimeU 1 nx 1440 ny 600 GDS grid 0
>> > num_in_ave 0 missing 0
>> > center 57 subcenter 2 process 89 Table 128 scan: WE:SN
winds(N/S)
>> > latlon: lat -59.875000 to 89.875000 by 0.250000 nxny 864000
>> > long -179.875000 to 179.875000 by 0.250000, (1440 x
600)
>> > scan 64 mode 128 bdsgrid 1
>> > min/max data 0 220 num bits 15 BDS_Ref 0 DecScale 2 BinScale
0
>> >
>> > NetCDF header for my observation data:
>> >
>> > netcdf NCEP.20150731_00_24h_8km_sum {
>> > dimensions:
>> > lat = 360 ;
>> > lon = 720 ;
>> > variables:
>> > float lat(lat, lon) ;
>> > lat:long_name = "latitude" ;
>> > lat:units = "degrees_north" ;
>> > lat:standard_name = "latitude" ;
>> > float lon(lat, lon) ;
>> > lon:long_name = "longitude" ;
>> > lon:units = "degrees_east" ;
>> > lon:standard_name = "longitude" ;
>> > float APCP_24(lat, lon) ;
>> > APCP_24:name = "APCP_24" ;
>> > APCP_24:long_name = "Total precipitation" ;
>> > APCP_24:level = "A24" ;
>> > APCP_24:units = "kg/m^2" ;
>> > APCP_24:_FillValue = -9999.f ;
>> > APCP_24:init_time = "20150731_000000" ;
>> > APCP_24:init_time_ut = 1438300800 ;
>> > APCP_24:valid_time = "20150731_000000" ;
>> > APCP_24:valid_time_ut = 1438300800 ;
>> > APCP_24:accum_time = "240000" ;
>> > APCP_24:accum_time_sec = 86400 ;
>> >
>> > // global attributes:
>> > :FileOrigins = "File
/h/data/global/WXQC/data/met/lis/
>> > NCEP.20150731_00_24h_8km_sum.nc generated 20150811_195735 UTC on
host
>> > dev8dlsn1 by the MET pcp_combine tool" ;
>> > :MET_version = "V4.1" ;
>> > :MET_tool = "pcp_combine" ;
>> > :RunCommand = "Sum: 24 files with accumulations
of
>> > 010000." ;
>> > :Projection = "LatLon" ;
>> > :lat_ll = "-89.750000 degrees_north" ;
>> > :lon_ll = "0.250000 degrees_east" ;
>> > :delta_lat = "0.500000 degrees" ;
>> > :delta_lon = "0.500000 degrees" ;
>> > :Nlat = "360 grid_points" ;
>> > :Nlon = "720 grid_points" ;
>> >
>> > Thanks,
>> > Matt
>> >
>> > // SIGNED //
>> > Matthew C. Sittel
>> > University Corporation for Atmospheric Research
>> > 16 WS/WXN, 557 WW, Offutt AFB, NE
>> > matthew.sittel.ctr at us.af.mil
>> >
>> >
>> >
>> >
>> >
>>
>>
>> --
>> Julie Prestopnik
>> National Center for Atmospheric Research Research Applications
Laboratory
>> Phone: 303.497.8399
>> Email: jpresto at ucar.edu
>>
>>
>>
>>
>
>
> --
> Julie Prestopnik
> National Center for Atmospheric Research
> Research Applications Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
--
Julie Prestopnik
National Center for Atmospheric Research
Research Applications Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #72945] Point Stat, GriB and NetCDF confusion
From: SITTEL, MATTHEW C CTR USAF AFWA 16 WS/WXN
Time: Thu Aug 13 10:58:14 2015
Okay-I'm off tomorrow anyway so it's fine. Thanks for all your
efforts! Have a great weekend.
Matt
-----Original Message-----
From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
Sent: Thursday, August 13, 2015 11:11 AM
To: SITTEL, MATTHEW C CTR USAF AFMC AFLCMC/HBAW-OL
Subject: Re: [rt.rap.ucar.edu #72945] Point Stat, GriB and NetCDF
confusion
Hi Matt. Some of our team is on vacation and won't be back until next
week, as opposed to later this week. We'll keep working on a solution
and will let you know as soon as we have one.
Thanks for your patience.
Julie
On Wed, Aug 12, 2015 at 3:13 PM, Julie Prestopnik <jpresto at ucar.edu>
wrote:
> Hi Matt. I received your files. Unfortunately, I do not yet have a
> solution for you. We are working on the problem and hope to get back
> to you later this week.
>
> Julie
>
> On Wed, Aug 12, 2015 at 2:29 PM, SITTEL, MATTHEW C CTR USAF AFWA 16
> WS/WXN via RT <met_help at ucar.edu> wrote:
>
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=72945 >
>>
>> Hi Julie,
>>
>> Hopefully the files I pushed yesterday afternoon made it without
>> incident. I have tried some other things today like modifying the
>> GriB table but I still haven't found a solution.
>>
>> If you need anything else from me that would help you, please let
me know.
>>
>> Thanks,
>> Matt
>>
>> -----Original Message-----
>> From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
>> Sent: Tuesday, August 11, 2015 3:26 PM
>> To: SITTEL, MATTHEW C CTR USAF AFMC AFLCMC/HBAW-OL
>> Subject: Re: [rt.rap.ucar.edu #72945] Point Stat, GriB and NetCDF
>> confusion
>>
>> Hi Matt.
>>
>> I think what might be going on here is that you may need to specify
>> the information for the observation field as if it was in a GRIB
>> file. I know this sounds confusing, but it is a bit of legacy
>> behavior. Try replacing this with what you currently have for
"obs" in your configuration file:
>>
>> obs = {
>> wind_thresh = [ NA ];
>> message_type = [ "ADPSFC" ];
>> field = [
>> {
>> name = "APCP";
>> level = [ "A24" ];
>> cat_thresh = [ >=0.0 ];
>> }
>> ];
>> };
>>
>> If you still have trouble, could you please upload your data and
>> config file to our FTP site using the instructions here:
>>
>> http://www.dtcenter.org/met/users/support/met_help.php#ftp
>>
>> Then, I can take a closer look.
>>
>> Thanks,
>> Julie
>>
>> On Tue, Aug 11, 2015 at 2:00 PM, SITTEL, MATTHEW C CTR USAF AFWA 16
>> WS/WXN via RT <met_help at ucar.edu> wrote:
>>
>> >
>> > Tue Aug 11 14:00:29 2015: Request 72945 was acted upon.
>> > Transaction: Ticket created by matthew.sittel.ctr at us.af.mil
>> > Queue: met_help
>> > Subject: Point Stat, GriB and NetCDF confusion
>> > Owner: Nobody
>> > Requestors: matthew.sittel.ctr at us.af.mil
>> > Status: new
>> > Ticket <URL:
>> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=72945
>> > >
>> >
>> >
>> > Hi,
>> >
>> > I'm trying to run point_stat with the following:
>> >
>> > Forecast is a single GriB 1 precipitation field (APCP).
>> > Observations are the sum of 24 Stage IV Precipitation Analyses,
all
>> > 1 hourly amounts in NetCDF. They were summed using pcp_combine.
>> > The resulting summation file has the variable name 'APCP_24'.
>> >
>> > I set in my point_stat config file the following:
>> >
>> > fcst = {
>> > wind_thresh = [ NA ];
>> >
>> > field = [
>> > {
>> > name = "APCP";
>> > level = "L0";
>> > cat_thresh = [ >=0.0 ];
>> > }
>> > ];
>> >
>> > };
>> >
>> > obs = {
>> > field = [
>> > {
>> > name = "APCP_24";
>> > level = "A24";
>> > cat_thresh = [ >=0.0 ];
>> > }
>> > ];
>> > };
>> >
>> > But I get the following error:
>> >
>> > ERROR : VarInfoGrib::set_dict() - unrecognized GRIB1 field
>> > abbreviation 'APCP_24' for table version 2
>> >
>> > I realize APCP_24 isn't in the GriB 1 table, but the variable
name
>> > comes from pcp_combine so I don't think I have power to change
it.
>> >
>> > Can I only run point_stat if both model and obs are called "APCP"
>> > in
>> their
>> > respective files? If they can be different, how do I handle it?
>> >
>> > More information which may be helpful:
>> >
>> > GriB header for my forecast data:
>> >
>> > rec 1:0:date 2015073100 APCP kpds5=61 kpds6=1 kpds7=0
levels=(0,0)
>> > grid=255 sfc 24-0hr fcst:ave at 1yr: bitmap: 624213 undef
>> > APCP=Total precipitation [kg/m^2]
>> > timerange 133 P1 24 P2 0 TimeU 1 nx 1440 ny 600 GDS grid 0
>> > num_in_ave 0 missing 0
>> > center 57 subcenter 2 process 89 Table 128 scan: WE:SN
winds(N/S)
>> > latlon: lat -59.875000 to 89.875000 by 0.250000 nxny 864000
>> > long -179.875000 to 179.875000 by 0.250000, (1440 x
600)
>> > scan 64 mode 128 bdsgrid 1
>> > min/max data 0 220 num bits 15 BDS_Ref 0 DecScale 2 BinScale
0
>> >
>> > NetCDF header for my observation data:
>> >
>> > netcdf NCEP.20150731_00_24h_8km_sum {
>> > dimensions:
>> > lat = 360 ;
>> > lon = 720 ;
>> > variables:
>> > float lat(lat, lon) ;
>> > lat:long_name = "latitude" ;
>> > lat:units = "degrees_north" ;
>> > lat:standard_name = "latitude" ;
>> > float lon(lat, lon) ;
>> > lon:long_name = "longitude" ;
>> > lon:units = "degrees_east" ;
>> > lon:standard_name = "longitude" ;
>> > float APCP_24(lat, lon) ;
>> > APCP_24:name = "APCP_24" ;
>> > APCP_24:long_name = "Total precipitation" ;
>> > APCP_24:level = "A24" ;
>> > APCP_24:units = "kg/m^2" ;
>> > APCP_24:_FillValue = -9999.f ;
>> > APCP_24:init_time = "20150731_000000" ;
>> > APCP_24:init_time_ut = 1438300800 ;
>> > APCP_24:valid_time = "20150731_000000" ;
>> > APCP_24:valid_time_ut = 1438300800 ;
>> > APCP_24:accum_time = "240000" ;
>> > APCP_24:accum_time_sec = 86400 ;
>> >
>> > // global attributes:
>> > :FileOrigins = "File
>> > /h/data/global/WXQC/data/met/lis/ NCEP.20150731_00_24h_8km_sum.nc
>> > generated 20150811_195735 UTC on host
>> > dev8dlsn1 by the MET pcp_combine tool" ;
>> > :MET_version = "V4.1" ;
>> > :MET_tool = "pcp_combine" ;
>> > :RunCommand = "Sum: 24 files with accumulations
of
>> > 010000." ;
>> > :Projection = "LatLon" ;
>> > :lat_ll = "-89.750000 degrees_north" ;
>> > :lon_ll = "0.250000 degrees_east" ;
>> > :delta_lat = "0.500000 degrees" ;
>> > :delta_lon = "0.500000 degrees" ;
>> > :Nlat = "360 grid_points" ;
>> > :Nlon = "720 grid_points" ;
>> >
>> > Thanks,
>> > Matt
>> >
>> > // SIGNED //
>> > Matthew C. Sittel
>> > University Corporation for Atmospheric Research
>> > 16 WS/WXN, 557 WW, Offutt AFB, NE
>> > matthew.sittel.ctr at us.af.mil
>> >
>> >
>> >
>> >
>> >
>>
>>
>> --
>> Julie Prestopnik
>> National Center for Atmospheric Research Research Applications
>> Laboratory
>> Phone: 303.497.8399
>> Email: jpresto at ucar.edu
>>
>>
>>
>>
>
>
> --
> Julie Prestopnik
> National Center for Atmospheric Research Research Applications
> Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
--
Julie Prestopnik
National Center for Atmospheric Research Research Applications
Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
------------------------------------------------
Subject: Point Stat, GriB and NetCDF confusion
From: John Halley Gotway
Time: Mon Aug 17 11:38:34 2015
Hello Matt,
This is John Halley Gotway. I was out of the office last week, but
hopefully we can get to the bottom of this now.
I retrieved the data you sent to use from our anonymous ftp site. I
see
that it's the NetCDF output of the pcp-combine tool (
NCEP.20150731_00_24h_8km_sum.nc), a GRIB1 file
(LIS.GLOBAL.00.24.TP.9999),
and a Point-Stat configuration file (lis_ST4_point_stat.cfg.default).
I
believe the problem here is that you're running the wrong tool.
Point-Stat
is used to compare a gridded forecast to the point observations.
However,
both your forecast and observation data are gridded. You should be
running
this data through the Grid-Stat tool to compute traditional and
neighborhood statistics.
I ran the following commands with your data and attached some output:
# Plot the LIS data, convert to png, and attached output
METv4.1/bin/plot_data_plane LIS.GLOBAL.00.24.TP.9999
LIS.GLOBAL.00.24.TP.9999.ps 'name="APCP"; level="A24";
convert -rotate 90 -background white -flatten
LIS.GLOBAL.00.24.TP.9999.ps
LIS.GLOBAL.00.24.TP.9999.png
# Plot the pcp_combine output, convert to png, and attached output
METv4.1/bin/plot_data_plane NCEP.20150731_00_24h_8km_sum.nc
NCEP.20150731_00_24h_8km_sum.ps 'name="APCP_24"; level="(*,*)";'
convert -rotate 90 -background white -flatten
NCEP.20150731_00_24h_8km_sum.ps NCEP.20150731_00_24h_8km_sum.png
# Run these through grid-stat, configuration file attached
METv4.1/bin/grid_stat LIS.GLOBAL.00.24.TP.9999
NCEP.20150731_00_24h_8km_sum.nc lis_ST4_grid_stat.cfg.default -outdir
out
-v 4
When I run this Grid-Stat command, I get the following error:
process_command_line() -> The forecast and observation grids do not
match:
Projection: Lat/Lon Nx: 1440 Ny: 600 lat_ll: -59.875 lon_ll: 179.875
delta_lat: 0.250 delta_lon: 0.250 != Projection: Lat/Lon Nx: 720 Ny:
360
lat_ll: -89.750 lon_ll: -0.250 delta_lat: 0.500 delta_lon: 0.500
This is telling you that these files aren't on the same grid. It
looks
like you've already regridded the Stage4 data to a global 1/2 degree
grid.
Presumably, you used copygb to do that. You just need to edit your
calls
to copygb to put it on the 1/4 degree global grid that LIS is using.
Hope that helps.
Thanks,
John
On Thu, Aug 13, 2015 at 10:58 AM, SITTEL, MATTHEW C CTR USAF AFWA 16
WS/WXN
via RT <met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=72945 >
>
> Okay-I'm off tomorrow anyway so it's fine. Thanks for all your
efforts!
> Have a great weekend.
>
> Matt
>
> -----Original Message-----
> From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> Sent: Thursday, August 13, 2015 11:11 AM
> To: SITTEL, MATTHEW C CTR USAF AFMC AFLCMC/HBAW-OL
> Subject: Re: [rt.rap.ucar.edu #72945] Point Stat, GriB and NetCDF
> confusion
>
> Hi Matt. Some of our team is on vacation and won't be back until
next
> week, as opposed to later this week. We'll keep working on a
solution and
> will let you know as soon as we have one.
>
> Thanks for your patience.
>
> Julie
>
> On Wed, Aug 12, 2015 at 3:13 PM, Julie Prestopnik <jpresto at ucar.edu>
> wrote:
>
> > Hi Matt. I received your files. Unfortunately, I do not yet have
a
> > solution for you. We are working on the problem and hope to get
back
> > to you later this week.
> >
> > Julie
> >
> > On Wed, Aug 12, 2015 at 2:29 PM, SITTEL, MATTHEW C CTR USAF AFWA
16
> > WS/WXN via RT <met_help at ucar.edu> wrote:
> >
> >>
> >> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=72945 >
> >>
> >> Hi Julie,
> >>
> >> Hopefully the files I pushed yesterday afternoon made it without
> >> incident. I have tried some other things today like modifying
the
> >> GriB table but I still haven't found a solution.
> >>
> >> If you need anything else from me that would help you, please let
me
> know.
> >>
> >> Thanks,
> >> Matt
> >>
> >> -----Original Message-----
> >> From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> >> Sent: Tuesday, August 11, 2015 3:26 PM
> >> To: SITTEL, MATTHEW C CTR USAF AFMC AFLCMC/HBAW-OL
> >> Subject: Re: [rt.rap.ucar.edu #72945] Point Stat, GriB and NetCDF
> >> confusion
> >>
> >> Hi Matt.
> >>
> >> I think what might be going on here is that you may need to
specify
> >> the information for the observation field as if it was in a GRIB
> >> file. I know this sounds confusing, but it is a bit of legacy
> >> behavior. Try replacing this with what you currently have for
"obs" in
> your configuration file:
> >>
> >> obs = {
> >> wind_thresh = [ NA ];
> >> message_type = [ "ADPSFC" ];
> >> field = [
> >> {
> >> name = "APCP";
> >> level = [ "A24" ];
> >> cat_thresh = [ >=0.0 ];
> >> }
> >> ];
> >> };
> >>
> >> If you still have trouble, could you please upload your data and
> >> config file to our FTP site using the instructions here:
> >>
> >> http://www.dtcenter.org/met/users/support/met_help.php#ftp
> >>
> >> Then, I can take a closer look.
> >>
> >> Thanks,
> >> Julie
> >>
> >> On Tue, Aug 11, 2015 at 2:00 PM, SITTEL, MATTHEW C CTR USAF AFWA
16
> >> WS/WXN via RT <met_help at ucar.edu> wrote:
> >>
> >> >
> >> > Tue Aug 11 14:00:29 2015: Request 72945 was acted upon.
> >> > Transaction: Ticket created by matthew.sittel.ctr at us.af.mil
> >> > Queue: met_help
> >> > Subject: Point Stat, GriB and NetCDF confusion
> >> > Owner: Nobody
> >> > Requestors: matthew.sittel.ctr at us.af.mil
> >> > Status: new
> >> > Ticket <URL:
> >> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=72945
> >> > >
> >> >
> >> >
> >> > Hi,
> >> >
> >> > I'm trying to run point_stat with the following:
> >> >
> >> > Forecast is a single GriB 1 precipitation field (APCP).
> >> > Observations are the sum of 24 Stage IV Precipitation Analyses,
all
> >> > 1 hourly amounts in NetCDF. They were summed using
pcp_combine.
> >> > The resulting summation file has the variable name 'APCP_24'.
> >> >
> >> > I set in my point_stat config file the following:
> >> >
> >> > fcst = {
> >> > wind_thresh = [ NA ];
> >> >
> >> > field = [
> >> > {
> >> > name = "APCP";
> >> > level = "L0";
> >> > cat_thresh = [ >=0.0 ];
> >> > }
> >> > ];
> >> >
> >> > };
> >> >
> >> > obs = {
> >> > field = [
> >> > {
> >> > name = "APCP_24";
> >> > level = "A24";
> >> > cat_thresh = [ >=0.0 ];
> >> > }
> >> > ];
> >> > };
> >> >
> >> > But I get the following error:
> >> >
> >> > ERROR : VarInfoGrib::set_dict() - unrecognized GRIB1 field
> >> > abbreviation 'APCP_24' for table version 2
> >> >
> >> > I realize APCP_24 isn't in the GriB 1 table, but the variable
name
> >> > comes from pcp_combine so I don't think I have power to change
it.
> >> >
> >> > Can I only run point_stat if both model and obs are called
"APCP"
> >> > in
> >> their
> >> > respective files? If they can be different, how do I handle
it?
> >> >
> >> > More information which may be helpful:
> >> >
> >> > GriB header for my forecast data:
> >> >
> >> > rec 1:0:date 2015073100 APCP kpds5=61 kpds6=1 kpds7=0
levels=(0,0)
> >> > grid=255 sfc 24-0hr fcst:ave at 1yr: bitmap: 624213 undef
> >> > APCP=Total precipitation [kg/m^2]
> >> > timerange 133 P1 24 P2 0 TimeU 1 nx 1440 ny 600 GDS grid 0
> >> > num_in_ave 0 missing 0
> >> > center 57 subcenter 2 process 89 Table 128 scan: WE:SN
winds(N/S)
> >> > latlon: lat -59.875000 to 89.875000 by 0.250000 nxny 864000
> >> > long -179.875000 to 179.875000 by 0.250000, (1440 x
600)
> >> > scan 64 mode 128 bdsgrid 1
> >> > min/max data 0 220 num bits 15 BDS_Ref 0 DecScale 2
BinScale 0
> >> >
> >> > NetCDF header for my observation data:
> >> >
> >> > netcdf NCEP.20150731_00_24h_8km_sum {
> >> > dimensions:
> >> > lat = 360 ;
> >> > lon = 720 ;
> >> > variables:
> >> > float lat(lat, lon) ;
> >> > lat:long_name = "latitude" ;
> >> > lat:units = "degrees_north" ;
> >> > lat:standard_name = "latitude" ;
> >> > float lon(lat, lon) ;
> >> > lon:long_name = "longitude" ;
> >> > lon:units = "degrees_east" ;
> >> > lon:standard_name = "longitude" ;
> >> > float APCP_24(lat, lon) ;
> >> > APCP_24:name = "APCP_24" ;
> >> > APCP_24:long_name = "Total precipitation" ;
> >> > APCP_24:level = "A24" ;
> >> > APCP_24:units = "kg/m^2" ;
> >> > APCP_24:_FillValue = -9999.f ;
> >> > APCP_24:init_time = "20150731_000000" ;
> >> > APCP_24:init_time_ut = 1438300800 ;
> >> > APCP_24:valid_time = "20150731_000000" ;
> >> > APCP_24:valid_time_ut = 1438300800 ;
> >> > APCP_24:accum_time = "240000" ;
> >> > APCP_24:accum_time_sec = 86400 ;
> >> >
> >> > // global attributes:
> >> > :FileOrigins = "File
> >> > /h/data/global/WXQC/data/met/lis/
NCEP.20150731_00_24h_8km_sum.nc
> >> > generated 20150811_195735 UTC on host
> >> > dev8dlsn1 by the MET pcp_combine tool" ;
> >> > :MET_version = "V4.1" ;
> >> > :MET_tool = "pcp_combine" ;
> >> > :RunCommand = "Sum: 24 files with accumulations
of
> >> > 010000." ;
> >> > :Projection = "LatLon" ;
> >> > :lat_ll = "-89.750000 degrees_north" ;
> >> > :lon_ll = "0.250000 degrees_east" ;
> >> > :delta_lat = "0.500000 degrees" ;
> >> > :delta_lon = "0.500000 degrees" ;
> >> > :Nlat = "360 grid_points" ;
> >> > :Nlon = "720 grid_points" ;
> >> >
> >> > Thanks,
> >> > Matt
> >> >
> >> > // SIGNED //
> >> > Matthew C. Sittel
> >> > University Corporation for Atmospheric Research
> >> > 16 WS/WXN, 557 WW, Offutt AFB, NE
> >> > matthew.sittel.ctr at us.af.mil
> >> >
> >> >
> >> >
> >> >
> >> >
> >>
> >>
> >> --
> >> Julie Prestopnik
> >> National Center for Atmospheric Research Research Applications
> >> Laboratory
> >> Phone: 303.497.8399
> >> Email: jpresto at ucar.edu
> >>
> >>
> >>
> >>
> >
> >
> > --
> > Julie Prestopnik
> > National Center for Atmospheric Research Research Applications
> > Laboratory
> > Phone: 303.497.8399
> > Email: jpresto at ucar.edu
> >
>
>
>
> --
> Julie Prestopnik
> National Center for Atmospheric Research Research Applications
Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
>
>
>
------------------------------------------------
Subject: Point Stat, GriB and NetCDF confusion
From: John Halley Gotway
Time: Mon Aug 17 11:39:07 2015
Forgot to attached that Grid-Stat config file last time.
John
On Mon, Aug 17, 2015 at 11:38 AM, John Halley Gotway <johnhg at ucar.edu>
wrote:
> Hello Matt,
>
> This is John Halley Gotway. I was out of the office last week, but
> hopefully we can get to the bottom of this now.
>
> I retrieved the data you sent to use from our anonymous ftp site. I
see
> that it's the NetCDF output of the pcp-combine tool (
> NCEP.20150731_00_24h_8km_sum.nc), a GRIB1 file
> (LIS.GLOBAL.00.24.TP.9999), and a Point-Stat configuration file
> (lis_ST4_point_stat.cfg.default). I believe the problem here is
that
> you're running the wrong tool. Point-Stat is used to compare a
gridded
> forecast to the point observations. However, both your forecast and
> observation data are gridded. You should be running this data
through the
> Grid-Stat tool to compute traditional and neighborhood statistics.
>
> I ran the following commands with your data and attached some
output:
>
> # Plot the LIS data, convert to png, and attached output
> METv4.1/bin/plot_data_plane LIS.GLOBAL.00.24.TP.9999
> LIS.GLOBAL.00.24.TP.9999.ps 'name="APCP"; level="A24";
> convert -rotate 90 -background white -flatten
LIS.GLOBAL.00.24.TP.9999.ps
> LIS.GLOBAL.00.24.TP.9999.png
>
> # Plot the pcp_combine output, convert to png, and attached output
> METv4.1/bin/plot_data_plane NCEP.20150731_00_24h_8km_sum.nc
> NCEP.20150731_00_24h_8km_sum.ps 'name="APCP_24"; level="(*,*)";'
> convert -rotate 90 -background white -flatten
> NCEP.20150731_00_24h_8km_sum.ps NCEP.20150731_00_24h_8km_sum.png
>
> # Run these through grid-stat, configuration file attached
> METv4.1/bin/grid_stat LIS.GLOBAL.00.24.TP.9999
> NCEP.20150731_00_24h_8km_sum.nc lis_ST4_grid_stat.cfg.default
-outdir out
> -v 4
>
> When I run this Grid-Stat command, I get the following error:
>
> process_command_line() -> The forecast and observation grids do not
match:
> Projection: Lat/Lon Nx: 1440 Ny: 600 lat_ll: -59.875 lon_ll: 179.875
> delta_lat: 0.250 delta_lon: 0.250 != Projection: Lat/Lon Nx: 720 Ny:
360
> lat_ll: -89.750 lon_ll: -0.250 delta_lat: 0.500 delta_lon: 0.500
>
>
> This is telling you that these files aren't on the same grid. It
looks
> like you've already regridded the Stage4 data to a global 1/2 degree
grid.
> Presumably, you used copygb to do that. You just need to edit your
calls
> to copygb to put it on the 1/4 degree global grid that LIS is using.
>
> Hope that helps.
>
> Thanks,
> John
>
>
> On Thu, Aug 13, 2015 at 10:58 AM, SITTEL, MATTHEW C CTR USAF AFWA 16
> WS/WXN via RT <met_help at ucar.edu> wrote:
>
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=72945 >
>>
>> Okay-I'm off tomorrow anyway so it's fine. Thanks for all your
efforts!
>> Have a great weekend.
>>
>> Matt
>>
>> -----Original Message-----
>> From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
>> Sent: Thursday, August 13, 2015 11:11 AM
>> To: SITTEL, MATTHEW C CTR USAF AFMC AFLCMC/HBAW-OL
>> Subject: Re: [rt.rap.ucar.edu #72945] Point Stat, GriB and NetCDF
>> confusion
>>
>> Hi Matt. Some of our team is on vacation and won't be back until
next
>> week, as opposed to later this week. We'll keep working on a
solution and
>> will let you know as soon as we have one.
>>
>> Thanks for your patience.
>>
>> Julie
>>
>> On Wed, Aug 12, 2015 at 3:13 PM, Julie Prestopnik
<jpresto at ucar.edu>
>> wrote:
>>
>> > Hi Matt. I received your files. Unfortunately, I do not yet
have a
>> > solution for you. We are working on the problem and hope to get
back
>> > to you later this week.
>> >
>> > Julie
>> >
>> > On Wed, Aug 12, 2015 at 2:29 PM, SITTEL, MATTHEW C CTR USAF AFWA
16
>> > WS/WXN via RT <met_help at ucar.edu> wrote:
>> >
>> >>
>> >> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=72945 >
>> >>
>> >> Hi Julie,
>> >>
>> >> Hopefully the files I pushed yesterday afternoon made it without
>> >> incident. I have tried some other things today like modifying
the
>> >> GriB table but I still haven't found a solution.
>> >>
>> >> If you need anything else from me that would help you, please
let me
>> know.
>> >>
>> >> Thanks,
>> >> Matt
>> >>
>> >> -----Original Message-----
>> >> From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
>> >> Sent: Tuesday, August 11, 2015 3:26 PM
>> >> To: SITTEL, MATTHEW C CTR USAF AFMC AFLCMC/HBAW-OL
>> >> Subject: Re: [rt.rap.ucar.edu #72945] Point Stat, GriB and
NetCDF
>> >> confusion
>> >>
>> >> Hi Matt.
>> >>
>> >> I think what might be going on here is that you may need to
specify
>> >> the information for the observation field as if it was in a GRIB
>> >> file. I know this sounds confusing, but it is a bit of legacy
>> >> behavior. Try replacing this with what you currently have for
"obs"
>> in your configuration file:
>> >>
>> >> obs = {
>> >> wind_thresh = [ NA ];
>> >> message_type = [ "ADPSFC" ];
>> >> field = [
>> >> {
>> >> name = "APCP";
>> >> level = [ "A24" ];
>> >> cat_thresh = [ >=0.0 ];
>> >> }
>> >> ];
>> >> };
>> >>
>> >> If you still have trouble, could you please upload your data and
>> >> config file to our FTP site using the instructions here:
>> >>
>> >> http://www.dtcenter.org/met/users/support/met_help.php#ftp
>> >>
>> >> Then, I can take a closer look.
>> >>
>> >> Thanks,
>> >> Julie
>> >>
>> >> On Tue, Aug 11, 2015 at 2:00 PM, SITTEL, MATTHEW C CTR USAF AFWA
16
>> >> WS/WXN via RT <met_help at ucar.edu> wrote:
>> >>
>> >> >
>> >> > Tue Aug 11 14:00:29 2015: Request 72945 was acted upon.
>> >> > Transaction: Ticket created by matthew.sittel.ctr at us.af.mil
>> >> > Queue: met_help
>> >> > Subject: Point Stat, GriB and NetCDF confusion
>> >> > Owner: Nobody
>> >> > Requestors: matthew.sittel.ctr at us.af.mil
>> >> > Status: new
>> >> > Ticket <URL:
>> >> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=72945
>> >> > >
>> >> >
>> >> >
>> >> > Hi,
>> >> >
>> >> > I'm trying to run point_stat with the following:
>> >> >
>> >> > Forecast is a single GriB 1 precipitation field (APCP).
>> >> > Observations are the sum of 24 Stage IV Precipitation
Analyses, all
>> >> > 1 hourly amounts in NetCDF. They were summed using
pcp_combine.
>> >> > The resulting summation file has the variable name 'APCP_24'.
>> >> >
>> >> > I set in my point_stat config file the following:
>> >> >
>> >> > fcst = {
>> >> > wind_thresh = [ NA ];
>> >> >
>> >> > field = [
>> >> > {
>> >> > name = "APCP";
>> >> > level = "L0";
>> >> > cat_thresh = [ >=0.0 ];
>> >> > }
>> >> > ];
>> >> >
>> >> > };
>> >> >
>> >> > obs = {
>> >> > field = [
>> >> > {
>> >> > name = "APCP_24";
>> >> > level = "A24";
>> >> > cat_thresh = [ >=0.0 ];
>> >> > }
>> >> > ];
>> >> > };
>> >> >
>> >> > But I get the following error:
>> >> >
>> >> > ERROR : VarInfoGrib::set_dict() - unrecognized GRIB1 field
>> >> > abbreviation 'APCP_24' for table version 2
>> >> >
>> >> > I realize APCP_24 isn't in the GriB 1 table, but the variable
name
>> >> > comes from pcp_combine so I don't think I have power to change
it.
>> >> >
>> >> > Can I only run point_stat if both model and obs are called
"APCP"
>> >> > in
>> >> their
>> >> > respective files? If they can be different, how do I handle
it?
>> >> >
>> >> > More information which may be helpful:
>> >> >
>> >> > GriB header for my forecast data:
>> >> >
>> >> > rec 1:0:date 2015073100 APCP kpds5=61 kpds6=1 kpds7=0
levels=(0,0)
>> >> > grid=255 sfc 24-0hr fcst:ave at 1yr: bitmap: 624213 undef
>> >> > APCP=Total precipitation [kg/m^2]
>> >> > timerange 133 P1 24 P2 0 TimeU 1 nx 1440 ny 600 GDS grid 0
>> >> > num_in_ave 0 missing 0
>> >> > center 57 subcenter 2 process 89 Table 128 scan: WE:SN
winds(N/S)
>> >> > latlon: lat -59.875000 to 89.875000 by 0.250000 nxny
864000
>> >> > long -179.875000 to 179.875000 by 0.250000, (1440 x
600)
>> >> > scan 64 mode 128 bdsgrid 1
>> >> > min/max data 0 220 num bits 15 BDS_Ref 0 DecScale 2
BinScale 0
>> >> >
>> >> > NetCDF header for my observation data:
>> >> >
>> >> > netcdf NCEP.20150731_00_24h_8km_sum {
>> >> > dimensions:
>> >> > lat = 360 ;
>> >> > lon = 720 ;
>> >> > variables:
>> >> > float lat(lat, lon) ;
>> >> > lat:long_name = "latitude" ;
>> >> > lat:units = "degrees_north" ;
>> >> > lat:standard_name = "latitude" ;
>> >> > float lon(lat, lon) ;
>> >> > lon:long_name = "longitude" ;
>> >> > lon:units = "degrees_east" ;
>> >> > lon:standard_name = "longitude" ;
>> >> > float APCP_24(lat, lon) ;
>> >> > APCP_24:name = "APCP_24" ;
>> >> > APCP_24:long_name = "Total precipitation" ;
>> >> > APCP_24:level = "A24" ;
>> >> > APCP_24:units = "kg/m^2" ;
>> >> > APCP_24:_FillValue = -9999.f ;
>> >> > APCP_24:init_time = "20150731_000000" ;
>> >> > APCP_24:init_time_ut = 1438300800 ;
>> >> > APCP_24:valid_time = "20150731_000000" ;
>> >> > APCP_24:valid_time_ut = 1438300800 ;
>> >> > APCP_24:accum_time = "240000" ;
>> >> > APCP_24:accum_time_sec = 86400 ;
>> >> >
>> >> > // global attributes:
>> >> > :FileOrigins = "File
>> >> > /h/data/global/WXQC/data/met/lis/
NCEP.20150731_00_24h_8km_sum.nc
>> >> > generated 20150811_195735 UTC on host
>> >> > dev8dlsn1 by the MET pcp_combine tool" ;
>> >> > :MET_version = "V4.1" ;
>> >> > :MET_tool = "pcp_combine" ;
>> >> > :RunCommand = "Sum: 24 files with
accumulations of
>> >> > 010000." ;
>> >> > :Projection = "LatLon" ;
>> >> > :lat_ll = "-89.750000 degrees_north" ;
>> >> > :lon_ll = "0.250000 degrees_east" ;
>> >> > :delta_lat = "0.500000 degrees" ;
>> >> > :delta_lon = "0.500000 degrees" ;
>> >> > :Nlat = "360 grid_points" ;
>> >> > :Nlon = "720 grid_points" ;
>> >> >
>> >> > Thanks,
>> >> > Matt
>> >> >
>> >> > // SIGNED //
>> >> > Matthew C. Sittel
>> >> > University Corporation for Atmospheric Research
>> >> > 16 WS/WXN, 557 WW, Offutt AFB, NE
>> >> > matthew.sittel.ctr at us.af.mil
>> >> >
>> >> >
>> >> >
>> >> >
>> >> >
>> >>
>> >>
>> >> --
>> >> Julie Prestopnik
>> >> National Center for Atmospheric Research Research Applications
>> >> Laboratory
>> >> Phone: 303.497.8399
>> >> Email: jpresto at ucar.edu
>> >>
>> >>
>> >>
>> >>
>> >
>> >
>> > --
>> > Julie Prestopnik
>> > National Center for Atmospheric Research Research Applications
>> > Laboratory
>> > Phone: 303.497.8399
>> > Email: jpresto at ucar.edu
>> >
>>
>>
>>
>> --
>> Julie Prestopnik
>> National Center for Atmospheric Research Research Applications
Laboratory
>> Phone: 303.497.8399
>> Email: jpresto at ucar.edu
>>
>>
>>
>>
>
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #72945] Point Stat, GriB and NetCDF confusion
From: SITTEL, MATTHEW C CTR USAF AFWA 16 WS/WXN
Time: Tue Aug 18 08:48:44 2015
Hi John,
Thanks for your help. I got it to work with grid_stat. I didn't even
see the oddity with the grid. But thanks to copygb I got everything
to match up.
The reason I was using point_stat, or trying to, was because I want
the model-obs pairs from the grid stat run in a format easily imported
by Excel. Is there a way to do that with grid_stat? What I ideally
want is the matched pair ("MPR") format from point_stat but have it
generated from grid_stat. Otherwise I have to figure out a method to
convert NetCDF to ASCII, something I have zero experience with.
Any advice on the above? I would sure appreciate it!
Matt
-----Original Message-----
From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
Sent: Monday, August 17, 2015 12:39 PM
To: SITTEL, MATTHEW C CTR USAF AFMC AFLCMC/HBAW-OL
Subject: Re: [rt.rap.ucar.edu #72945] Point Stat, GriB and NetCDF
confusion
Hello Matt,
This is John Halley Gotway. I was out of the office last week, but
hopefully we can get to the bottom of this now.
I retrieved the data you sent to use from our anonymous ftp site. I
see that it's the NetCDF output of the pcp-combine tool (
NCEP.20150731_00_24h_8km_sum.nc), a GRIB1 file
(LIS.GLOBAL.00.24.TP.9999), and a Point-Stat configuration file
(lis_ST4_point_stat.cfg.default). I believe the problem here is that
you're running the wrong tool. Point-Stat is used to compare a
gridded forecast to the point observations. However, both your
forecast and observation data are gridded. You should be running this
data through the Grid-Stat tool to compute traditional and
neighborhood statistics.
I ran the following commands with your data and attached some output:
# Plot the LIS data, convert to png, and attached output
METv4.1/bin/plot_data_plane LIS.GLOBAL.00.24.TP.9999
LIS.GLOBAL.00.24.TP.9999.ps 'name="APCP"; level="A24"; convert -rotate
90 -background white -flatten LIS.GLOBAL.00.24.TP.9999.ps
LIS.GLOBAL.00.24.TP.9999.png
# Plot the pcp_combine output, convert to png, and attached output
METv4.1/bin/plot_data_plane NCEP.20150731_00_24h_8km_sum.nc
NCEP.20150731_00_24h_8km_sum.ps 'name="APCP_24"; level="(*,*)";'
convert -rotate 90 -background white -flatten
NCEP.20150731_00_24h_8km_sum.ps NCEP.20150731_00_24h_8km_sum.png
# Run these through grid-stat, configuration file attached
METv4.1/bin/grid_stat LIS.GLOBAL.00.24.TP.9999
NCEP.20150731_00_24h_8km_sum.nc lis_ST4_grid_stat.cfg.default -outdir
out -v 4
When I run this Grid-Stat command, I get the following error:
process_command_line() -> The forecast and observation grids do not
match:
Projection: Lat/Lon Nx: 1440 Ny: 600 lat_ll: -59.875 lon_ll: 179.875
delta_lat: 0.250 delta_lon: 0.250 != Projection: Lat/Lon Nx: 720 Ny:
360
lat_ll: -89.750 lon_ll: -0.250 delta_lat: 0.500 delta_lon: 0.500
This is telling you that these files aren't on the same grid. It
looks like you've already regridded the Stage4 data to a global 1/2
degree grid.
Presumably, you used copygb to do that. You just need to edit your
calls to copygb to put it on the 1/4 degree global grid that LIS is
using.
Hope that helps.
Thanks,
John
On Thu, Aug 13, 2015 at 10:58 AM, SITTEL, MATTHEW C CTR USAF AFWA 16
WS/WXN via RT <met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=72945 >
>
> Okay-I'm off tomorrow anyway so it's fine. Thanks for all your
efforts!
> Have a great weekend.
>
> Matt
>
> -----Original Message-----
> From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> Sent: Thursday, August 13, 2015 11:11 AM
> To: SITTEL, MATTHEW C CTR USAF AFMC AFLCMC/HBAW-OL
> Subject: Re: [rt.rap.ucar.edu #72945] Point Stat, GriB and NetCDF
> confusion
>
> Hi Matt. Some of our team is on vacation and won't be back until
next
> week, as opposed to later this week. We'll keep working on a
solution
> and will let you know as soon as we have one.
>
> Thanks for your patience.
>
> Julie
>
> On Wed, Aug 12, 2015 at 3:13 PM, Julie Prestopnik <jpresto at ucar.edu>
> wrote:
>
> > Hi Matt. I received your files. Unfortunately, I do not yet have
a
> > solution for you. We are working on the problem and hope to get
back
> > to you later this week.
> >
> > Julie
> >
> > On Wed, Aug 12, 2015 at 2:29 PM, SITTEL, MATTHEW C CTR USAF AFWA
16
> > WS/WXN via RT <met_help at ucar.edu> wrote:
> >
> >>
> >> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=72945 >
> >>
> >> Hi Julie,
> >>
> >> Hopefully the files I pushed yesterday afternoon made it without
> >> incident. I have tried some other things today like modifying
the
> >> GriB table but I still haven't found a solution.
> >>
> >> If you need anything else from me that would help you, please let
> >> me
> know.
> >>
> >> Thanks,
> >> Matt
> >>
> >> -----Original Message-----
> >> From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> >> Sent: Tuesday, August 11, 2015 3:26 PM
> >> To: SITTEL, MATTHEW C CTR USAF AFMC AFLCMC/HBAW-OL
> >> Subject: Re: [rt.rap.ucar.edu #72945] Point Stat, GriB and NetCDF
> >> confusion
> >>
> >> Hi Matt.
> >>
> >> I think what might be going on here is that you may need to
specify
> >> the information for the observation field as if it was in a GRIB
> >> file. I know this sounds confusing, but it is a bit of legacy
> >> behavior. Try replacing this with what you currently have for
> >> "obs" in
> your configuration file:
> >>
> >> obs = {
> >> wind_thresh = [ NA ];
> >> message_type = [ "ADPSFC" ];
> >> field = [
> >> {
> >> name = "APCP";
> >> level = [ "A24" ];
> >> cat_thresh = [ >=0.0 ];
> >> }
> >> ];
> >> };
> >>
> >> If you still have trouble, could you please upload your data and
> >> config file to our FTP site using the instructions here:
> >>
> >> http://www.dtcenter.org/met/users/support/met_help.php#ftp
> >>
> >> Then, I can take a closer look.
> >>
> >> Thanks,
> >> Julie
> >>
> >> On Tue, Aug 11, 2015 at 2:00 PM, SITTEL, MATTHEW C CTR USAF AFWA
16
> >> WS/WXN via RT <met_help at ucar.edu> wrote:
> >>
> >> >
> >> > Tue Aug 11 14:00:29 2015: Request 72945 was acted upon.
> >> > Transaction: Ticket created by matthew.sittel.ctr at us.af.mil
> >> > Queue: met_help
> >> > Subject: Point Stat, GriB and NetCDF confusion
> >> > Owner: Nobody
> >> > Requestors: matthew.sittel.ctr at us.af.mil
> >> > Status: new
> >> > Ticket <URL:
> >> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=72945
> >> > >
> >> >
> >> >
> >> > Hi,
> >> >
> >> > I'm trying to run point_stat with the following:
> >> >
> >> > Forecast is a single GriB 1 precipitation field (APCP).
> >> > Observations are the sum of 24 Stage IV Precipitation Analyses,
> >> > all
> >> > 1 hourly amounts in NetCDF. They were summed using
pcp_combine.
> >> > The resulting summation file has the variable name 'APCP_24'.
> >> >
> >> > I set in my point_stat config file the following:
> >> >
> >> > fcst = {
> >> > wind_thresh = [ NA ];
> >> >
> >> > field = [
> >> > {
> >> > name = "APCP";
> >> > level = "L0";
> >> > cat_thresh = [ >=0.0 ];
> >> > }
> >> > ];
> >> >
> >> > };
> >> >
> >> > obs = {
> >> > field = [
> >> > {
> >> > name = "APCP_24";
> >> > level = "A24";
> >> > cat_thresh = [ >=0.0 ];
> >> > }
> >> > ];
> >> > };
> >> >
> >> > But I get the following error:
> >> >
> >> > ERROR : VarInfoGrib::set_dict() - unrecognized GRIB1 field
> >> > abbreviation 'APCP_24' for table version 2
> >> >
> >> > I realize APCP_24 isn't in the GriB 1 table, but the variable
> >> > name comes from pcp_combine so I don't think I have power to
change it.
> >> >
> >> > Can I only run point_stat if both model and obs are called
"APCP"
> >> > in
> >> their
> >> > respective files? If they can be different, how do I handle
it?
> >> >
> >> > More information which may be helpful:
> >> >
> >> > GriB header for my forecast data:
> >> >
> >> > rec 1:0:date 2015073100 APCP kpds5=61 kpds6=1 kpds7=0
> >> > levels=(0,0)
> >> > grid=255 sfc 24-0hr fcst:ave at 1yr: bitmap: 624213 undef
> >> > APCP=Total precipitation [kg/m^2]
> >> > timerange 133 P1 24 P2 0 TimeU 1 nx 1440 ny 600 GDS grid 0
> >> > num_in_ave 0 missing 0
> >> > center 57 subcenter 2 process 89 Table 128 scan: WE:SN
winds(N/S)
> >> > latlon: lat -59.875000 to 89.875000 by 0.250000 nxny 864000
> >> > long -179.875000 to 179.875000 by 0.250000, (1440 x
> >> > 600) scan 64 mode 128 bdsgrid 1
> >> > min/max data 0 220 num bits 15 BDS_Ref 0 DecScale 2
BinScale
> >> > 0
> >> >
> >> > NetCDF header for my observation data:
> >> >
> >> > netcdf NCEP.20150731_00_24h_8km_sum {
> >> > dimensions:
> >> > lat = 360 ;
> >> > lon = 720 ;
> >> > variables:
> >> > float lat(lat, lon) ;
> >> > lat:long_name = "latitude" ;
> >> > lat:units = "degrees_north" ;
> >> > lat:standard_name = "latitude" ;
> >> > float lon(lat, lon) ;
> >> > lon:long_name = "longitude" ;
> >> > lon:units = "degrees_east" ;
> >> > lon:standard_name = "longitude" ;
> >> > float APCP_24(lat, lon) ;
> >> > APCP_24:name = "APCP_24" ;
> >> > APCP_24:long_name = "Total precipitation" ;
> >> > APCP_24:level = "A24" ;
> >> > APCP_24:units = "kg/m^2" ;
> >> > APCP_24:_FillValue = -9999.f ;
> >> > APCP_24:init_time = "20150731_000000" ;
> >> > APCP_24:init_time_ut = 1438300800 ;
> >> > APCP_24:valid_time = "20150731_000000" ;
> >> > APCP_24:valid_time_ut = 1438300800 ;
> >> > APCP_24:accum_time = "240000" ;
> >> > APCP_24:accum_time_sec = 86400 ;
> >> >
> >> > // global attributes:
> >> > :FileOrigins = "File
> >> > /h/data/global/WXQC/data/met/lis/
NCEP.20150731_00_24h_8km_sum.nc
> >> > generated 20150811_195735 UTC on host
> >> > dev8dlsn1 by the MET pcp_combine tool" ;
> >> > :MET_version = "V4.1" ;
> >> > :MET_tool = "pcp_combine" ;
> >> > :RunCommand = "Sum: 24 files with accumulations
> >> > of 010000." ;
> >> > :Projection = "LatLon" ;
> >> > :lat_ll = "-89.750000 degrees_north" ;
> >> > :lon_ll = "0.250000 degrees_east" ;
> >> > :delta_lat = "0.500000 degrees" ;
> >> > :delta_lon = "0.500000 degrees" ;
> >> > :Nlat = "360 grid_points" ;
> >> > :Nlon = "720 grid_points" ;
> >> >
> >> > Thanks,
> >> > Matt
> >> >
> >> > // SIGNED //
> >> > Matthew C. Sittel
> >> > University Corporation for Atmospheric Research
> >> > 16 WS/WXN, 557 WW, Offutt AFB, NE matthew.sittel.ctr at us.af.mil
> >> >
> >> >
> >> >
> >> >
> >> >
> >>
> >>
> >> --
> >> Julie Prestopnik
> >> National Center for Atmospheric Research Research Applications
> >> Laboratory
> >> Phone: 303.497.8399
> >> Email: jpresto at ucar.edu
> >>
> >>
> >>
> >>
> >
> >
> > --
> > Julie Prestopnik
> > National Center for Atmospheric Research Research Applications
> > Laboratory
> > Phone: 303.497.8399
> > Email: jpresto at ucar.edu
> >
>
>
>
> --
> Julie Prestopnik
> National Center for Atmospheric Research Research Applications
Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
>
>
>
------------------------------------------------
Subject: Point Stat, GriB and NetCDF confusion
From: John Halley Gotway
Time: Tue Aug 18 15:53:42 2015
Matt,
I was working on a quick Rscript to dump the pairs from the NetCDF
matched
pairs file to ascii, but wasn't able to finish it today. I'll take a
look
tomorrow and get back to you.
John
On Tue, Aug 18, 2015 at 8:48 AM, SITTEL, MATTHEW C CTR USAF AFWA 16
WS/WXN
via RT <met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=72945 >
>
> Hi John,
>
> Thanks for your help. I got it to work with grid_stat. I didn't
even see
> the oddity with the grid. But thanks to copygb I got everything to
match
> up.
>
> The reason I was using point_stat, or trying to, was because I want
the
> model-obs pairs from the grid stat run in a format easily imported
by
> Excel. Is there a way to do that with grid_stat? What I ideally
want is
> the matched pair ("MPR") format from point_stat but have it
generated from
> grid_stat. Otherwise I have to figure out a method to convert
NetCDF to
> ASCII, something I have zero experience with.
>
> Any advice on the above? I would sure appreciate it!
>
> Matt
>
> -----Original Message-----
> From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> Sent: Monday, August 17, 2015 12:39 PM
> To: SITTEL, MATTHEW C CTR USAF AFMC AFLCMC/HBAW-OL
> Subject: Re: [rt.rap.ucar.edu #72945] Point Stat, GriB and NetCDF
> confusion
>
> Hello Matt,
>
> This is John Halley Gotway. I was out of the office last week, but
> hopefully we can get to the bottom of this now.
>
> I retrieved the data you sent to use from our anonymous ftp site. I
see
> that it's the NetCDF output of the pcp-combine tool (
> NCEP.20150731_00_24h_8km_sum.nc), a GRIB1 file
> (LIS.GLOBAL.00.24.TP.9999), and a Point-Stat configuration file
> (lis_ST4_point_stat.cfg.default). I believe the problem here is
that
> you're running the wrong tool. Point-Stat is used to compare a
gridded
> forecast to the point observations. However, both your forecast and
> observation data are gridded. You should be running this data
through the
> Grid-Stat tool to compute traditional and neighborhood statistics.
>
> I ran the following commands with your data and attached some
output:
>
> # Plot the LIS data, convert to png, and attached output
> METv4.1/bin/plot_data_plane LIS.GLOBAL.00.24.TP.9999
> LIS.GLOBAL.00.24.TP.9999.ps 'name="APCP"; level="A24"; convert
-rotate 90
> -background white -flatten LIS.GLOBAL.00.24.TP.9999.ps
> LIS.GLOBAL.00.24.TP.9999.png
>
> # Plot the pcp_combine output, convert to png, and attached output
> METv4.1/bin/plot_data_plane NCEP.20150731_00_24h_8km_sum.nc
> NCEP.20150731_00_24h_8km_sum.ps 'name="APCP_24"; level="(*,*)";'
> convert -rotate 90 -background white -flatten
> NCEP.20150731_00_24h_8km_sum.ps NCEP.20150731_00_24h_8km_sum.png
>
> # Run these through grid-stat, configuration file attached
> METv4.1/bin/grid_stat LIS.GLOBAL.00.24.TP.9999
> NCEP.20150731_00_24h_8km_sum.nc lis_ST4_grid_stat.cfg.default
-outdir out
> -v 4
>
> When I run this Grid-Stat command, I get the following error:
>
> process_command_line() -> The forecast and observation grids do not
match:
> Projection: Lat/Lon Nx: 1440 Ny: 600 lat_ll: -59.875 lon_ll: 179.875
> delta_lat: 0.250 delta_lon: 0.250 != Projection: Lat/Lon Nx: 720 Ny:
360
> lat_ll: -89.750 lon_ll: -0.250 delta_lat: 0.500 delta_lon: 0.500
>
>
> This is telling you that these files aren't on the same grid. It
looks
> like you've already regridded the Stage4 data to a global 1/2 degree
grid.
> Presumably, you used copygb to do that. You just need to edit your
calls
> to copygb to put it on the 1/4 degree global grid that LIS is using.
>
> Hope that helps.
>
> Thanks,
> John
>
>
> On Thu, Aug 13, 2015 at 10:58 AM, SITTEL, MATTHEW C CTR USAF AFWA 16
> WS/WXN via RT <met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=72945 >
> >
> > Okay-I'm off tomorrow anyway so it's fine. Thanks for all your
efforts!
> > Have a great weekend.
> >
> > Matt
> >
> > -----Original Message-----
> > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > Sent: Thursday, August 13, 2015 11:11 AM
> > To: SITTEL, MATTHEW C CTR USAF AFMC AFLCMC/HBAW-OL
> > Subject: Re: [rt.rap.ucar.edu #72945] Point Stat, GriB and NetCDF
> > confusion
> >
> > Hi Matt. Some of our team is on vacation and won't be back until
next
> > week, as opposed to later this week. We'll keep working on a
solution
> > and will let you know as soon as we have one.
> >
> > Thanks for your patience.
> >
> > Julie
> >
> > On Wed, Aug 12, 2015 at 3:13 PM, Julie Prestopnik
<jpresto at ucar.edu>
> > wrote:
> >
> > > Hi Matt. I received your files. Unfortunately, I do not yet
have a
> > > solution for you. We are working on the problem and hope to get
back
> > > to you later this week.
> > >
> > > Julie
> > >
> > > On Wed, Aug 12, 2015 at 2:29 PM, SITTEL, MATTHEW C CTR USAF AFWA
16
> > > WS/WXN via RT <met_help at ucar.edu> wrote:
> > >
> > >>
> > >> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=72945 >
> > >>
> > >> Hi Julie,
> > >>
> > >> Hopefully the files I pushed yesterday afternoon made it
without
> > >> incident. I have tried some other things today like modifying
the
> > >> GriB table but I still haven't found a solution.
> > >>
> > >> If you need anything else from me that would help you, please
let
> > >> me
> > know.
> > >>
> > >> Thanks,
> > >> Matt
> > >>
> > >> -----Original Message-----
> > >> From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > >> Sent: Tuesday, August 11, 2015 3:26 PM
> > >> To: SITTEL, MATTHEW C CTR USAF AFMC AFLCMC/HBAW-OL
> > >> Subject: Re: [rt.rap.ucar.edu #72945] Point Stat, GriB and
NetCDF
> > >> confusion
> > >>
> > >> Hi Matt.
> > >>
> > >> I think what might be going on here is that you may need to
specify
> > >> the information for the observation field as if it was in a
GRIB
> > >> file. I know this sounds confusing, but it is a bit of legacy
> > >> behavior. Try replacing this with what you currently have for
> > >> "obs" in
> > your configuration file:
> > >>
> > >> obs = {
> > >> wind_thresh = [ NA ];
> > >> message_type = [ "ADPSFC" ];
> > >> field = [
> > >> {
> > >> name = "APCP";
> > >> level = [ "A24" ];
> > >> cat_thresh = [ >=0.0 ];
> > >> }
> > >> ];
> > >> };
> > >>
> > >> If you still have trouble, could you please upload your data
and
> > >> config file to our FTP site using the instructions here:
> > >>
> > >> http://www.dtcenter.org/met/users/support/met_help.php#ftp
> > >>
> > >> Then, I can take a closer look.
> > >>
> > >> Thanks,
> > >> Julie
> > >>
> > >> On Tue, Aug 11, 2015 at 2:00 PM, SITTEL, MATTHEW C CTR USAF
AFWA 16
> > >> WS/WXN via RT <met_help at ucar.edu> wrote:
> > >>
> > >> >
> > >> > Tue Aug 11 14:00:29 2015: Request 72945 was acted upon.
> > >> > Transaction: Ticket created by matthew.sittel.ctr at us.af.mil
> > >> > Queue: met_help
> > >> > Subject: Point Stat, GriB and NetCDF confusion
> > >> > Owner: Nobody
> > >> > Requestors: matthew.sittel.ctr at us.af.mil
> > >> > Status: new
> > >> > Ticket <URL:
> > >> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=72945
> > >> > >
> > >> >
> > >> >
> > >> > Hi,
> > >> >
> > >> > I'm trying to run point_stat with the following:
> > >> >
> > >> > Forecast is a single GriB 1 precipitation field (APCP).
> > >> > Observations are the sum of 24 Stage IV Precipitation
Analyses,
> > >> > all
> > >> > 1 hourly amounts in NetCDF. They were summed using
pcp_combine.
> > >> > The resulting summation file has the variable name 'APCP_24'.
> > >> >
> > >> > I set in my point_stat config file the following:
> > >> >
> > >> > fcst = {
> > >> > wind_thresh = [ NA ];
> > >> >
> > >> > field = [
> > >> > {
> > >> > name = "APCP";
> > >> > level = "L0";
> > >> > cat_thresh = [ >=0.0 ];
> > >> > }
> > >> > ];
> > >> >
> > >> > };
> > >> >
> > >> > obs = {
> > >> > field = [
> > >> > {
> > >> > name = "APCP_24";
> > >> > level = "A24";
> > >> > cat_thresh = [ >=0.0 ];
> > >> > }
> > >> > ];
> > >> > };
> > >> >
> > >> > But I get the following error:
> > >> >
> > >> > ERROR : VarInfoGrib::set_dict() - unrecognized GRIB1 field
> > >> > abbreviation 'APCP_24' for table version 2
> > >> >
> > >> > I realize APCP_24 isn't in the GriB 1 table, but the variable
> > >> > name comes from pcp_combine so I don't think I have power to
change
> it.
> > >> >
> > >> > Can I only run point_stat if both model and obs are called
"APCP"
> > >> > in
> > >> their
> > >> > respective files? If they can be different, how do I handle
it?
> > >> >
> > >> > More information which may be helpful:
> > >> >
> > >> > GriB header for my forecast data:
> > >> >
> > >> > rec 1:0:date 2015073100 APCP kpds5=61 kpds6=1 kpds7=0
> > >> > levels=(0,0)
> > >> > grid=255 sfc 24-0hr fcst:ave at 1yr: bitmap: 624213 undef
> > >> > APCP=Total precipitation [kg/m^2]
> > >> > timerange 133 P1 24 P2 0 TimeU 1 nx 1440 ny 600 GDS grid 0
> > >> > num_in_ave 0 missing 0
> > >> > center 57 subcenter 2 process 89 Table 128 scan: WE:SN
winds(N/S)
> > >> > latlon: lat -59.875000 to 89.875000 by 0.250000 nxny
864000
> > >> > long -179.875000 to 179.875000 by 0.250000, (1440 x
> > >> > 600) scan 64 mode 128 bdsgrid 1
> > >> > min/max data 0 220 num bits 15 BDS_Ref 0 DecScale 2
BinScale
> > >> > 0
> > >> >
> > >> > NetCDF header for my observation data:
> > >> >
> > >> > netcdf NCEP.20150731_00_24h_8km_sum {
> > >> > dimensions:
> > >> > lat = 360 ;
> > >> > lon = 720 ;
> > >> > variables:
> > >> > float lat(lat, lon) ;
> > >> > lat:long_name = "latitude" ;
> > >> > lat:units = "degrees_north" ;
> > >> > lat:standard_name = "latitude" ;
> > >> > float lon(lat, lon) ;
> > >> > lon:long_name = "longitude" ;
> > >> > lon:units = "degrees_east" ;
> > >> > lon:standard_name = "longitude" ;
> > >> > float APCP_24(lat, lon) ;
> > >> > APCP_24:name = "APCP_24" ;
> > >> > APCP_24:long_name = "Total precipitation" ;
> > >> > APCP_24:level = "A24" ;
> > >> > APCP_24:units = "kg/m^2" ;
> > >> > APCP_24:_FillValue = -9999.f ;
> > >> > APCP_24:init_time = "20150731_000000" ;
> > >> > APCP_24:init_time_ut = 1438300800 ;
> > >> > APCP_24:valid_time = "20150731_000000" ;
> > >> > APCP_24:valid_time_ut = 1438300800 ;
> > >> > APCP_24:accum_time = "240000" ;
> > >> > APCP_24:accum_time_sec = 86400 ;
> > >> >
> > >> > // global attributes:
> > >> > :FileOrigins = "File
> > >> > /h/data/global/WXQC/data/met/lis/
NCEP.20150731_00_24h_8km_sum.nc
> > >> > generated 20150811_195735 UTC on host
> > >> > dev8dlsn1 by the MET pcp_combine tool" ;
> > >> > :MET_version = "V4.1" ;
> > >> > :MET_tool = "pcp_combine" ;
> > >> > :RunCommand = "Sum: 24 files with
accumulations
> > >> > of 010000." ;
> > >> > :Projection = "LatLon" ;
> > >> > :lat_ll = "-89.750000 degrees_north" ;
> > >> > :lon_ll = "0.250000 degrees_east" ;
> > >> > :delta_lat = "0.500000 degrees" ;
> > >> > :delta_lon = "0.500000 degrees" ;
> > >> > :Nlat = "360 grid_points" ;
> > >> > :Nlon = "720 grid_points" ;
> > >> >
> > >> > Thanks,
> > >> > Matt
> > >> >
> > >> > // SIGNED //
> > >> > Matthew C. Sittel
> > >> > University Corporation for Atmospheric Research
> > >> > 16 WS/WXN, 557 WW, Offutt AFB, NE
matthew.sittel.ctr at us.af.mil
> > >> >
> > >> >
> > >> >
> > >> >
> > >> >
> > >>
> > >>
> > >> --
> > >> Julie Prestopnik
> > >> National Center for Atmospheric Research Research Applications
> > >> Laboratory
> > >> Phone: 303.497.8399
> > >> Email: jpresto at ucar.edu
> > >>
> > >>
> > >>
> > >>
> > >
> > >
> > > --
> > > Julie Prestopnik
> > > National Center for Atmospheric Research Research Applications
> > > Laboratory
> > > Phone: 303.497.8399
> > > Email: jpresto at ucar.edu
> > >
> >
> >
> >
> > --
> > Julie Prestopnik
> > National Center for Atmospheric Research Research Applications
Laboratory
> > Phone: 303.497.8399
> > Email: jpresto at ucar.edu
> >
> >
> >
> >
>
>
>
>
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #72945] Point Stat, GriB and NetCDF confusion
From: SITTEL, MATTHEW C CTR USAF AFWA 16 WS/WXN
Time: Wed Aug 19 06:47:06 2015
Thanks John. I wrote one to format our binary data to the ASCII
format required for ingestion by MET, but NetCDF is one I'm less
familiar with.
All I need is simply lat, lon, model value, obs value (and just the
non-missing ones). Unless MET accepts the matched pairs in NetCDF
such that I can manipulate them (e.g., latitude band subsetting).
Matt
-----Original Message-----
From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
Sent: Tuesday, August 18, 2015 4:54 PM
To: SITTEL, MATTHEW C CTR USAF AFMC AFLCMC/HBAW-OL
Subject: Re: [rt.rap.ucar.edu #72945] Point Stat, GriB and NetCDF
confusion
Matt,
I was working on a quick Rscript to dump the pairs from the NetCDF
matched pairs file to ascii, but wasn't able to finish it today. I'll
take a look tomorrow and get back to you.
John
On Tue, Aug 18, 2015 at 8:48 AM, SITTEL, MATTHEW C CTR USAF AFWA 16
WS/WXN via RT <met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=72945 >
>
> Hi John,
>
> Thanks for your help. I got it to work with grid_stat. I didn't
even
> see the oddity with the grid. But thanks to copygb I got everything
> to match up.
>
> The reason I was using point_stat, or trying to, was because I want
> the model-obs pairs from the grid stat run in a format easily
imported
> by Excel. Is there a way to do that with grid_stat? What I ideally
> want is the matched pair ("MPR") format from point_stat but have it
> generated from grid_stat. Otherwise I have to figure out a method
to
> convert NetCDF to ASCII, something I have zero experience with.
>
> Any advice on the above? I would sure appreciate it!
>
> Matt
>
> -----Original Message-----
> From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> Sent: Monday, August 17, 2015 12:39 PM
> To: SITTEL, MATTHEW C CTR USAF AFMC AFLCMC/HBAW-OL
> Subject: Re: [rt.rap.ucar.edu #72945] Point Stat, GriB and NetCDF
> confusion
>
> Hello Matt,
>
> This is John Halley Gotway. I was out of the office last week, but
> hopefully we can get to the bottom of this now.
>
> I retrieved the data you sent to use from our anonymous ftp site. I
> see that it's the NetCDF output of the pcp-combine tool (
> NCEP.20150731_00_24h_8km_sum.nc), a GRIB1 file
> (LIS.GLOBAL.00.24.TP.9999), and a Point-Stat configuration file
> (lis_ST4_point_stat.cfg.default). I believe the problem here is
that
> you're running the wrong tool. Point-Stat is used to compare a
> gridded forecast to the point observations. However, both your
> forecast and observation data are gridded. You should be running
this
> data through the Grid-Stat tool to compute traditional and
neighborhood statistics.
>
> I ran the following commands with your data and attached some
output:
>
> # Plot the LIS data, convert to png, and attached output
> METv4.1/bin/plot_data_plane LIS.GLOBAL.00.24.TP.9999
> LIS.GLOBAL.00.24.TP.9999.ps 'name="APCP"; level="A24"; convert
-rotate
> 90 -background white -flatten LIS.GLOBAL.00.24.TP.9999.ps
> LIS.GLOBAL.00.24.TP.9999.png
>
> # Plot the pcp_combine output, convert to png, and attached output
> METv4.1/bin/plot_data_plane NCEP.20150731_00_24h_8km_sum.nc
> NCEP.20150731_00_24h_8km_sum.ps 'name="APCP_24"; level="(*,*)";'
> convert -rotate 90 -background white -flatten
> NCEP.20150731_00_24h_8km_sum.ps NCEP.20150731_00_24h_8km_sum.png
>
> # Run these through grid-stat, configuration file attached
> METv4.1/bin/grid_stat LIS.GLOBAL.00.24.TP.9999
> NCEP.20150731_00_24h_8km_sum.nc lis_ST4_grid_stat.cfg.default
-outdir
> out -v 4
>
> When I run this Grid-Stat command, I get the following error:
>
> process_command_line() -> The forecast and observation grids do not
match:
> Projection: Lat/Lon Nx: 1440 Ny: 600 lat_ll: -59.875 lon_ll: 179.875
> delta_lat: 0.250 delta_lon: 0.250 != Projection: Lat/Lon Nx: 720 Ny:
> 360
> lat_ll: -89.750 lon_ll: -0.250 delta_lat: 0.500 delta_lon: 0.500
>
>
> This is telling you that these files aren't on the same grid. It
> looks like you've already regridded the Stage4 data to a global 1/2
degree grid.
> Presumably, you used copygb to do that. You just need to edit your
> calls to copygb to put it on the 1/4 degree global grid that LIS is
using.
>
> Hope that helps.
>
> Thanks,
> John
>
>
> On Thu, Aug 13, 2015 at 10:58 AM, SITTEL, MATTHEW C CTR USAF AFWA 16
> WS/WXN via RT <met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=72945 >
> >
> > Okay-I'm off tomorrow anyway so it's fine. Thanks for all your
efforts!
> > Have a great weekend.
> >
> > Matt
> >
> > -----Original Message-----
> > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > Sent: Thursday, August 13, 2015 11:11 AM
> > To: SITTEL, MATTHEW C CTR USAF AFMC AFLCMC/HBAW-OL
> > Subject: Re: [rt.rap.ucar.edu #72945] Point Stat, GriB and NetCDF
> > confusion
> >
> > Hi Matt. Some of our team is on vacation and won't be back until
> > next week, as opposed to later this week. We'll keep working on a
> > solution and will let you know as soon as we have one.
> >
> > Thanks for your patience.
> >
> > Julie
> >
> > On Wed, Aug 12, 2015 at 3:13 PM, Julie Prestopnik
<jpresto at ucar.edu>
> > wrote:
> >
> > > Hi Matt. I received your files. Unfortunately, I do not yet
have
> > > a solution for you. We are working on the problem and hope to
get
> > > back to you later this week.
> > >
> > > Julie
> > >
> > > On Wed, Aug 12, 2015 at 2:29 PM, SITTEL, MATTHEW C CTR USAF AFWA
> > > 16 WS/WXN via RT <met_help at ucar.edu> wrote:
> > >
> > >>
> > >> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=72945 >
> > >>
> > >> Hi Julie,
> > >>
> > >> Hopefully the files I pushed yesterday afternoon made it
without
> > >> incident. I have tried some other things today like modifying
> > >> the GriB table but I still haven't found a solution.
> > >>
> > >> If you need anything else from me that would help you, please
let
> > >> me
> > know.
> > >>
> > >> Thanks,
> > >> Matt
> > >>
> > >> -----Original Message-----
> > >> From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > >> Sent: Tuesday, August 11, 2015 3:26 PM
> > >> To: SITTEL, MATTHEW C CTR USAF AFMC AFLCMC/HBAW-OL
> > >> Subject: Re: [rt.rap.ucar.edu #72945] Point Stat, GriB and
NetCDF
> > >> confusion
> > >>
> > >> Hi Matt.
> > >>
> > >> I think what might be going on here is that you may need to
> > >> specify the information for the observation field as if it was
in
> > >> a GRIB file. I know this sounds confusing, but it is a bit of
> > >> legacy behavior. Try replacing this with what you currently
have
> > >> for "obs" in
> > your configuration file:
> > >>
> > >> obs = {
> > >> wind_thresh = [ NA ];
> > >> message_type = [ "ADPSFC" ];
> > >> field = [
> > >> {
> > >> name = "APCP";
> > >> level = [ "A24" ];
> > >> cat_thresh = [ >=0.0 ];
> > >> }
> > >> ];
> > >> };
> > >>
> > >> If you still have trouble, could you please upload your data
and
> > >> config file to our FTP site using the instructions here:
> > >>
> > >> http://www.dtcenter.org/met/users/support/met_help.php#ftp
> > >>
> > >> Then, I can take a closer look.
> > >>
> > >> Thanks,
> > >> Julie
> > >>
> > >> On Tue, Aug 11, 2015 at 2:00 PM, SITTEL, MATTHEW C CTR USAF
AFWA
> > >> 16 WS/WXN via RT <met_help at ucar.edu> wrote:
> > >>
> > >> >
> > >> > Tue Aug 11 14:00:29 2015: Request 72945 was acted upon.
> > >> > Transaction: Ticket created by matthew.sittel.ctr at us.af.mil
> > >> > Queue: met_help
> > >> > Subject: Point Stat, GriB and NetCDF confusion
> > >> > Owner: Nobody
> > >> > Requestors: matthew.sittel.ctr at us.af.mil
> > >> > Status: new
> > >> > Ticket <URL:
> > >> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=72945
> > >> > >
> > >> >
> > >> >
> > >> > Hi,
> > >> >
> > >> > I'm trying to run point_stat with the following:
> > >> >
> > >> > Forecast is a single GriB 1 precipitation field (APCP).
> > >> > Observations are the sum of 24 Stage IV Precipitation
Analyses,
> > >> > all
> > >> > 1 hourly amounts in NetCDF. They were summed using
pcp_combine.
> > >> > The resulting summation file has the variable name 'APCP_24'.
> > >> >
> > >> > I set in my point_stat config file the following:
> > >> >
> > >> > fcst = {
> > >> > wind_thresh = [ NA ];
> > >> >
> > >> > field = [
> > >> > {
> > >> > name = "APCP";
> > >> > level = "L0";
> > >> > cat_thresh = [ >=0.0 ];
> > >> > }
> > >> > ];
> > >> >
> > >> > };
> > >> >
> > >> > obs = {
> > >> > field = [
> > >> > {
> > >> > name = "APCP_24";
> > >> > level = "A24";
> > >> > cat_thresh = [ >=0.0 ];
> > >> > }
> > >> > ];
> > >> > };
> > >> >
> > >> > But I get the following error:
> > >> >
> > >> > ERROR : VarInfoGrib::set_dict() - unrecognized GRIB1 field
> > >> > abbreviation 'APCP_24' for table version 2
> > >> >
> > >> > I realize APCP_24 isn't in the GriB 1 table, but the variable
> > >> > name comes from pcp_combine so I don't think I have power to
> > >> > change
> it.
> > >> >
> > >> > Can I only run point_stat if both model and obs are called
"APCP"
> > >> > in
> > >> their
> > >> > respective files? If they can be different, how do I handle
it?
> > >> >
> > >> > More information which may be helpful:
> > >> >
> > >> > GriB header for my forecast data:
> > >> >
> > >> > rec 1:0:date 2015073100 APCP kpds5=61 kpds6=1 kpds7=0
> > >> > levels=(0,0)
> > >> > grid=255 sfc 24-0hr fcst:ave at 1yr: bitmap: 624213 undef
> > >> > APCP=Total precipitation [kg/m^2]
> > >> > timerange 133 P1 24 P2 0 TimeU 1 nx 1440 ny 600 GDS grid 0
> > >> > num_in_ave 0 missing 0
> > >> > center 57 subcenter 2 process 89 Table 128 scan: WE:SN
winds(N/S)
> > >> > latlon: lat -59.875000 to 89.875000 by 0.250000 nxny
864000
> > >> > long -179.875000 to 179.875000 by 0.250000, (1440 x
> > >> > 600) scan 64 mode 128 bdsgrid 1
> > >> > min/max data 0 220 num bits 15 BDS_Ref 0 DecScale 2
> > >> > BinScale
> > >> > 0
> > >> >
> > >> > NetCDF header for my observation data:
> > >> >
> > >> > netcdf NCEP.20150731_00_24h_8km_sum {
> > >> > dimensions:
> > >> > lat = 360 ;
> > >> > lon = 720 ;
> > >> > variables:
> > >> > float lat(lat, lon) ;
> > >> > lat:long_name = "latitude" ;
> > >> > lat:units = "degrees_north" ;
> > >> > lat:standard_name = "latitude" ;
> > >> > float lon(lat, lon) ;
> > >> > lon:long_name = "longitude" ;
> > >> > lon:units = "degrees_east" ;
> > >> > lon:standard_name = "longitude" ;
> > >> > float APCP_24(lat, lon) ;
> > >> > APCP_24:name = "APCP_24" ;
> > >> > APCP_24:long_name = "Total precipitation" ;
> > >> > APCP_24:level = "A24" ;
> > >> > APCP_24:units = "kg/m^2" ;
> > >> > APCP_24:_FillValue = -9999.f ;
> > >> > APCP_24:init_time = "20150731_000000" ;
> > >> > APCP_24:init_time_ut = 1438300800 ;
> > >> > APCP_24:valid_time = "20150731_000000" ;
> > >> > APCP_24:valid_time_ut = 1438300800 ;
> > >> > APCP_24:accum_time = "240000" ;
> > >> > APCP_24:accum_time_sec = 86400 ;
> > >> >
> > >> > // global attributes:
> > >> > :FileOrigins = "File
> > >> > /h/data/global/WXQC/data/met/lis/
> > >> > NCEP.20150731_00_24h_8km_sum.nc generated 20150811_195735 UTC
> > >> > on host
> > >> > dev8dlsn1 by the MET pcp_combine tool" ;
> > >> > :MET_version = "V4.1" ;
> > >> > :MET_tool = "pcp_combine" ;
> > >> > :RunCommand = "Sum: 24 files with
accumulations
> > >> > of 010000." ;
> > >> > :Projection = "LatLon" ;
> > >> > :lat_ll = "-89.750000 degrees_north" ;
> > >> > :lon_ll = "0.250000 degrees_east" ;
> > >> > :delta_lat = "0.500000 degrees" ;
> > >> > :delta_lon = "0.500000 degrees" ;
> > >> > :Nlat = "360 grid_points" ;
> > >> > :Nlon = "720 grid_points" ;
> > >> >
> > >> > Thanks,
> > >> > Matt
> > >> >
> > >> > // SIGNED //
> > >> > Matthew C. Sittel
> > >> > University Corporation for Atmospheric Research
> > >> > 16 WS/WXN, 557 WW, Offutt AFB, NE
matthew.sittel.ctr at us.af.mil
> > >> >
> > >> >
> > >> >
> > >> >
> > >> >
> > >>
> > >>
> > >> --
> > >> Julie Prestopnik
> > >> National Center for Atmospheric Research Research Applications
> > >> Laboratory
> > >> Phone: 303.497.8399
> > >> Email: jpresto at ucar.edu
> > >>
> > >>
> > >>
> > >>
> > >
> > >
> > > --
> > > Julie Prestopnik
> > > National Center for Atmospheric Research Research Applications
> > > Laboratory
> > > Phone: 303.497.8399
> > > Email: jpresto at ucar.edu
> > >
> >
> >
> >
> > --
> > Julie Prestopnik
> > National Center for Atmospheric Research Research Applications
> > Laboratory
> > Phone: 303.497.8399
> > Email: jpresto at ucar.edu
> >
> >
> >
> >
>
>
>
>
------------------------------------------------
Subject: Point Stat, GriB and NetCDF confusion
From: John Halley Gotway
Time: Wed Aug 19 10:07:53 2015
Matt,
I've attached an Rscript that will hopefully do the trick for you.
It's
named "gspairs2mpr.R"... although it doesn't actually write a full MPR
line
as Point-Stat does yet - just lat, lon, fcst, and obs values. I've
also
attached a sample NetCDF output file. Here's how you run it:
Rscript gspairs2mpr.R
grid_stat_APCP_24_240000L_20050808_000000V_pairs.nc
By default, it'll write an output file named "mpr.txt" but you can
override
that with the "-out" option. Run this to see the usage:
Rscript gspairs2mpr.R
Please give this a shot and let me know how it goes. It's currently
writing space separated output but could easily write csv instead.
John
On Wed, Aug 19, 2015 at 6:47 AM, SITTEL, MATTHEW C CTR USAF AFWA 16
WS/WXN
via RT <met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=72945 >
>
> Thanks John. I wrote one to format our binary data to the ASCII
format
> required for ingestion by MET, but NetCDF is one I'm less familiar
with.
>
> All I need is simply lat, lon, model value, obs value (and just the
> non-missing ones). Unless MET accepts the matched pairs in NetCDF
such
> that I can manipulate them (e.g., latitude band subsetting).
>
> Matt
>
> -----Original Message-----
> From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> Sent: Tuesday, August 18, 2015 4:54 PM
> To: SITTEL, MATTHEW C CTR USAF AFMC AFLCMC/HBAW-OL
> Subject: Re: [rt.rap.ucar.edu #72945] Point Stat, GriB and NetCDF
> confusion
>
> Matt,
>
> I was working on a quick Rscript to dump the pairs from the NetCDF
matched
> pairs file to ascii, but wasn't able to finish it today. I'll take
a look
> tomorrow and get back to you.
>
> John
>
> On Tue, Aug 18, 2015 at 8:48 AM, SITTEL, MATTHEW C CTR USAF AFWA 16
WS/WXN
> via RT <met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=72945 >
> >
> > Hi John,
> >
> > Thanks for your help. I got it to work with grid_stat. I didn't
even
> > see the oddity with the grid. But thanks to copygb I got
everything
> > to match up.
> >
> > The reason I was using point_stat, or trying to, was because I
want
> > the model-obs pairs from the grid stat run in a format easily
imported
> > by Excel. Is there a way to do that with grid_stat? What I
ideally
> > want is the matched pair ("MPR") format from point_stat but have
it
> > generated from grid_stat. Otherwise I have to figure out a method
to
> > convert NetCDF to ASCII, something I have zero experience with.
> >
> > Any advice on the above? I would sure appreciate it!
> >
> > Matt
> >
> > -----Original Message-----
> > From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> > Sent: Monday, August 17, 2015 12:39 PM
> > To: SITTEL, MATTHEW C CTR USAF AFMC AFLCMC/HBAW-OL
> > Subject: Re: [rt.rap.ucar.edu #72945] Point Stat, GriB and NetCDF
> > confusion
> >
> > Hello Matt,
> >
> > This is John Halley Gotway. I was out of the office last week,
but
> > hopefully we can get to the bottom of this now.
> >
> > I retrieved the data you sent to use from our anonymous ftp site.
I
> > see that it's the NetCDF output of the pcp-combine tool (
> > NCEP.20150731_00_24h_8km_sum.nc), a GRIB1 file
> > (LIS.GLOBAL.00.24.TP.9999), and a Point-Stat configuration file
> > (lis_ST4_point_stat.cfg.default). I believe the problem here is
that
> > you're running the wrong tool. Point-Stat is used to compare a
> > gridded forecast to the point observations. However, both your
> > forecast and observation data are gridded. You should be running
this
> > data through the Grid-Stat tool to compute traditional and
neighborhood
> statistics.
> >
> > I ran the following commands with your data and attached some
output:
> >
> > # Plot the LIS data, convert to png, and attached output
> > METv4.1/bin/plot_data_plane LIS.GLOBAL.00.24.TP.9999
> > LIS.GLOBAL.00.24.TP.9999.ps 'name="APCP"; level="A24"; convert
-rotate
> > 90 -background white -flatten LIS.GLOBAL.00.24.TP.9999.ps
> > LIS.GLOBAL.00.24.TP.9999.png
> >
> > # Plot the pcp_combine output, convert to png, and attached output
> > METv4.1/bin/plot_data_plane NCEP.20150731_00_24h_8km_sum.nc
> > NCEP.20150731_00_24h_8km_sum.ps 'name="APCP_24"; level="(*,*)";'
> > convert -rotate 90 -background white -flatten
> > NCEP.20150731_00_24h_8km_sum.ps NCEP.20150731_00_24h_8km_sum.png
> >
> > # Run these through grid-stat, configuration file attached
> > METv4.1/bin/grid_stat LIS.GLOBAL.00.24.TP.9999
> > NCEP.20150731_00_24h_8km_sum.nc lis_ST4_grid_stat.cfg.default
-outdir
> > out -v 4
> >
> > When I run this Grid-Stat command, I get the following error:
> >
> > process_command_line() -> The forecast and observation grids do
not
> match:
> > Projection: Lat/Lon Nx: 1440 Ny: 600 lat_ll: -59.875 lon_ll:
179.875
> > delta_lat: 0.250 delta_lon: 0.250 != Projection: Lat/Lon Nx: 720
Ny:
> > 360
> > lat_ll: -89.750 lon_ll: -0.250 delta_lat: 0.500 delta_lon: 0.500
> >
> >
> > This is telling you that these files aren't on the same grid. It
> > looks like you've already regridded the Stage4 data to a global
1/2
> degree grid.
> > Presumably, you used copygb to do that. You just need to edit
your
> > calls to copygb to put it on the 1/4 degree global grid that LIS
is
> using.
> >
> > Hope that helps.
> >
> > Thanks,
> > John
> >
> >
> > On Thu, Aug 13, 2015 at 10:58 AM, SITTEL, MATTHEW C CTR USAF AFWA
16
> > WS/WXN via RT <met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=72945 >
> > >
> > > Okay-I'm off tomorrow anyway so it's fine. Thanks for all your
> efforts!
> > > Have a great weekend.
> > >
> > > Matt
> > >
> > > -----Original Message-----
> > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > Sent: Thursday, August 13, 2015 11:11 AM
> > > To: SITTEL, MATTHEW C CTR USAF AFMC AFLCMC/HBAW-OL
> > > Subject: Re: [rt.rap.ucar.edu #72945] Point Stat, GriB and
NetCDF
> > > confusion
> > >
> > > Hi Matt. Some of our team is on vacation and won't be back
until
> > > next week, as opposed to later this week. We'll keep working on
a
> > > solution and will let you know as soon as we have one.
> > >
> > > Thanks for your patience.
> > >
> > > Julie
> > >
> > > On Wed, Aug 12, 2015 at 3:13 PM, Julie Prestopnik
<jpresto at ucar.edu>
> > > wrote:
> > >
> > > > Hi Matt. I received your files. Unfortunately, I do not yet
have
> > > > a solution for you. We are working on the problem and hope to
get
> > > > back to you later this week.
> > > >
> > > > Julie
> > > >
> > > > On Wed, Aug 12, 2015 at 2:29 PM, SITTEL, MATTHEW C CTR USAF
AFWA
> > > > 16 WS/WXN via RT <met_help at ucar.edu> wrote:
> > > >
> > > >>
> > > >> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=72945
>
> > > >>
> > > >> Hi Julie,
> > > >>
> > > >> Hopefully the files I pushed yesterday afternoon made it
without
> > > >> incident. I have tried some other things today like
modifying
> > > >> the GriB table but I still haven't found a solution.
> > > >>
> > > >> If you need anything else from me that would help you, please
let
> > > >> me
> > > know.
> > > >>
> > > >> Thanks,
> > > >> Matt
> > > >>
> > > >> -----Original Message-----
> > > >> From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > >> Sent: Tuesday, August 11, 2015 3:26 PM
> > > >> To: SITTEL, MATTHEW C CTR USAF AFMC AFLCMC/HBAW-OL
> > > >> Subject: Re: [rt.rap.ucar.edu #72945] Point Stat, GriB and
NetCDF
> > > >> confusion
> > > >>
> > > >> Hi Matt.
> > > >>
> > > >> I think what might be going on here is that you may need to
> > > >> specify the information for the observation field as if it
was in
> > > >> a GRIB file. I know this sounds confusing, but it is a bit
of
> > > >> legacy behavior. Try replacing this with what you currently
have
> > > >> for "obs" in
> > > your configuration file:
> > > >>
> > > >> obs = {
> > > >> wind_thresh = [ NA ];
> > > >> message_type = [ "ADPSFC" ];
> > > >> field = [
> > > >> {
> > > >> name = "APCP";
> > > >> level = [ "A24" ];
> > > >> cat_thresh = [ >=0.0 ];
> > > >> }
> > > >> ];
> > > >> };
> > > >>
> > > >> If you still have trouble, could you please upload your data
and
> > > >> config file to our FTP site using the instructions here:
> > > >>
> > > >> http://www.dtcenter.org/met/users/support/met_help.php#ftp
> > > >>
> > > >> Then, I can take a closer look.
> > > >>
> > > >> Thanks,
> > > >> Julie
> > > >>
> > > >> On Tue, Aug 11, 2015 at 2:00 PM, SITTEL, MATTHEW C CTR USAF
AFWA
> > > >> 16 WS/WXN via RT <met_help at ucar.edu> wrote:
> > > >>
> > > >> >
> > > >> > Tue Aug 11 14:00:29 2015: Request 72945 was acted upon.
> > > >> > Transaction: Ticket created by matthew.sittel.ctr at us.af.mil
> > > >> > Queue: met_help
> > > >> > Subject: Point Stat, GriB and NetCDF confusion
> > > >> > Owner: Nobody
> > > >> > Requestors: matthew.sittel.ctr at us.af.mil
> > > >> > Status: new
> > > >> > Ticket <URL:
> > > >> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=72945
> > > >> > >
> > > >> >
> > > >> >
> > > >> > Hi,
> > > >> >
> > > >> > I'm trying to run point_stat with the following:
> > > >> >
> > > >> > Forecast is a single GriB 1 precipitation field (APCP).
> > > >> > Observations are the sum of 24 Stage IV Precipitation
Analyses,
> > > >> > all
> > > >> > 1 hourly amounts in NetCDF. They were summed using
pcp_combine.
> > > >> > The resulting summation file has the variable name
'APCP_24'.
> > > >> >
> > > >> > I set in my point_stat config file the following:
> > > >> >
> > > >> > fcst = {
> > > >> > wind_thresh = [ NA ];
> > > >> >
> > > >> > field = [
> > > >> > {
> > > >> > name = "APCP";
> > > >> > level = "L0";
> > > >> > cat_thresh = [ >=0.0 ];
> > > >> > }
> > > >> > ];
> > > >> >
> > > >> > };
> > > >> >
> > > >> > obs = {
> > > >> > field = [
> > > >> > {
> > > >> > name = "APCP_24";
> > > >> > level = "A24";
> > > >> > cat_thresh = [ >=0.0 ];
> > > >> > }
> > > >> > ];
> > > >> > };
> > > >> >
> > > >> > But I get the following error:
> > > >> >
> > > >> > ERROR : VarInfoGrib::set_dict() - unrecognized GRIB1 field
> > > >> > abbreviation 'APCP_24' for table version 2
> > > >> >
> > > >> > I realize APCP_24 isn't in the GriB 1 table, but the
variable
> > > >> > name comes from pcp_combine so I don't think I have power
to
> > > >> > change
> > it.
> > > >> >
> > > >> > Can I only run point_stat if both model and obs are called
"APCP"
> > > >> > in
> > > >> their
> > > >> > respective files? If they can be different, how do I
handle it?
> > > >> >
> > > >> > More information which may be helpful:
> > > >> >
> > > >> > GriB header for my forecast data:
> > > >> >
> > > >> > rec 1:0:date 2015073100 APCP kpds5=61 kpds6=1 kpds7=0
> > > >> > levels=(0,0)
> > > >> > grid=255 sfc 24-0hr fcst:ave at 1yr: bitmap: 624213 undef
> > > >> > APCP=Total precipitation [kg/m^2]
> > > >> > timerange 133 P1 24 P2 0 TimeU 1 nx 1440 ny 600 GDS grid
0
> > > >> > num_in_ave 0 missing 0
> > > >> > center 57 subcenter 2 process 89 Table 128 scan: WE:SN
> winds(N/S)
> > > >> > latlon: lat -59.875000 to 89.875000 by 0.250000 nxny
864000
> > > >> > long -179.875000 to 179.875000 by 0.250000, (1440
x
> > > >> > 600) scan 64 mode 128 bdsgrid 1
> > > >> > min/max data 0 220 num bits 15 BDS_Ref 0 DecScale 2
> > > >> > BinScale
> > > >> > 0
> > > >> >
> > > >> > NetCDF header for my observation data:
> > > >> >
> > > >> > netcdf NCEP.20150731_00_24h_8km_sum {
> > > >> > dimensions:
> > > >> > lat = 360 ;
> > > >> > lon = 720 ;
> > > >> > variables:
> > > >> > float lat(lat, lon) ;
> > > >> > lat:long_name = "latitude" ;
> > > >> > lat:units = "degrees_north" ;
> > > >> > lat:standard_name = "latitude" ;
> > > >> > float lon(lat, lon) ;
> > > >> > lon:long_name = "longitude" ;
> > > >> > lon:units = "degrees_east" ;
> > > >> > lon:standard_name = "longitude" ;
> > > >> > float APCP_24(lat, lon) ;
> > > >> > APCP_24:name = "APCP_24" ;
> > > >> > APCP_24:long_name = "Total precipitation" ;
> > > >> > APCP_24:level = "A24" ;
> > > >> > APCP_24:units = "kg/m^2" ;
> > > >> > APCP_24:_FillValue = -9999.f ;
> > > >> > APCP_24:init_time = "20150731_000000" ;
> > > >> > APCP_24:init_time_ut = 1438300800 ;
> > > >> > APCP_24:valid_time = "20150731_000000" ;
> > > >> > APCP_24:valid_time_ut = 1438300800 ;
> > > >> > APCP_24:accum_time = "240000" ;
> > > >> > APCP_24:accum_time_sec = 86400 ;
> > > >> >
> > > >> > // global attributes:
> > > >> > :FileOrigins = "File
> > > >> > /h/data/global/WXQC/data/met/lis/
> > > >> > NCEP.20150731_00_24h_8km_sum.nc generated 20150811_195735
UTC
> > > >> > on host
> > > >> > dev8dlsn1 by the MET pcp_combine tool" ;
> > > >> > :MET_version = "V4.1" ;
> > > >> > :MET_tool = "pcp_combine" ;
> > > >> > :RunCommand = "Sum: 24 files with
accumulations
> > > >> > of 010000." ;
> > > >> > :Projection = "LatLon" ;
> > > >> > :lat_ll = "-89.750000 degrees_north" ;
> > > >> > :lon_ll = "0.250000 degrees_east" ;
> > > >> > :delta_lat = "0.500000 degrees" ;
> > > >> > :delta_lon = "0.500000 degrees" ;
> > > >> > :Nlat = "360 grid_points" ;
> > > >> > :Nlon = "720 grid_points" ;
> > > >> >
> > > >> > Thanks,
> > > >> > Matt
> > > >> >
> > > >> > // SIGNED //
> > > >> > Matthew C. Sittel
> > > >> > University Corporation for Atmospheric Research
> > > >> > 16 WS/WXN, 557 WW, Offutt AFB, NE
matthew.sittel.ctr at us.af.mil
> > > >> >
> > > >> >
> > > >> >
> > > >> >
> > > >> >
> > > >>
> > > >>
> > > >> --
> > > >> Julie Prestopnik
> > > >> National Center for Atmospheric Research Research
Applications
> > > >> Laboratory
> > > >> Phone: 303.497.8399
> > > >> Email: jpresto at ucar.edu
> > > >>
> > > >>
> > > >>
> > > >>
> > > >
> > > >
> > > > --
> > > > Julie Prestopnik
> > > > National Center for Atmospheric Research Research Applications
> > > > Laboratory
> > > > Phone: 303.497.8399
> > > > Email: jpresto at ucar.edu
> > > >
> > >
> > >
> > >
> > > --
> > > Julie Prestopnik
> > > National Center for Atmospheric Research Research Applications
> > > Laboratory
> > > Phone: 303.497.8399
> > > Email: jpresto at ucar.edu
> > >
> > >
> > >
> > >
> >
> >
> >
> >
>
>
>
>
------------------------------------------------
Subject: Point Stat, GriB and NetCDF confusion
From: John Halley Gotway
Time: Wed Aug 19 10:08:35 2015
Also, forgot to mention that this requires the R ncdf package. If you
don't currently have that available, you'll need to install that R
package.
John
On Wed, Aug 19, 2015 at 10:07 AM, John Halley Gotway <johnhg at ucar.edu>
wrote:
> Matt,
>
> I've attached an Rscript that will hopefully do the trick for you.
It's
> named "gspairs2mpr.R"... although it doesn't actually write a full
MPR line
> as Point-Stat does yet - just lat, lon, fcst, and obs values. I've
also
> attached a sample NetCDF output file. Here's how you run it:
>
> Rscript gspairs2mpr.R
grid_stat_APCP_24_240000L_20050808_000000V_pairs.nc
>
> By default, it'll write an output file named "mpr.txt" but you can
> override that with the "-out" option. Run this to see the usage:
> Rscript gspairs2mpr.R
>
> Please give this a shot and let me know how it goes. It's currently
> writing space separated output but could easily write csv instead.
>
> John
>
> On Wed, Aug 19, 2015 at 6:47 AM, SITTEL, MATTHEW C CTR USAF AFWA 16
WS/WXN
> via RT <met_help at ucar.edu> wrote:
>
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=72945 >
>>
>> Thanks John. I wrote one to format our binary data to the ASCII
format
>> required for ingestion by MET, but NetCDF is one I'm less familiar
with.
>>
>> All I need is simply lat, lon, model value, obs value (and just the
>> non-missing ones). Unless MET accepts the matched pairs in NetCDF
such
>> that I can manipulate them (e.g., latitude band subsetting).
>>
>> Matt
>>
>> -----Original Message-----
>> From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
>> Sent: Tuesday, August 18, 2015 4:54 PM
>> To: SITTEL, MATTHEW C CTR USAF AFMC AFLCMC/HBAW-OL
>> Subject: Re: [rt.rap.ucar.edu #72945] Point Stat, GriB and NetCDF
>> confusion
>>
>> Matt,
>>
>> I was working on a quick Rscript to dump the pairs from the NetCDF
>> matched pairs file to ascii, but wasn't able to finish it today.
I'll take
>> a look tomorrow and get back to you.
>>
>> John
>>
>> On Tue, Aug 18, 2015 at 8:48 AM, SITTEL, MATTHEW C CTR USAF AFWA 16
>> WS/WXN via RT <met_help at ucar.edu> wrote:
>>
>> >
>> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=72945 >
>> >
>> > Hi John,
>> >
>> > Thanks for your help. I got it to work with grid_stat. I didn't
even
>> > see the oddity with the grid. But thanks to copygb I got
everything
>> > to match up.
>> >
>> > The reason I was using point_stat, or trying to, was because I
want
>> > the model-obs pairs from the grid stat run in a format easily
imported
>> > by Excel. Is there a way to do that with grid_stat? What I
ideally
>> > want is the matched pair ("MPR") format from point_stat but have
it
>> > generated from grid_stat. Otherwise I have to figure out a
method to
>> > convert NetCDF to ASCII, something I have zero experience with.
>> >
>> > Any advice on the above? I would sure appreciate it!
>> >
>> > Matt
>> >
>> > -----Original Message-----
>> > From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
>> > Sent: Monday, August 17, 2015 12:39 PM
>> > To: SITTEL, MATTHEW C CTR USAF AFMC AFLCMC/HBAW-OL
>> > Subject: Re: [rt.rap.ucar.edu #72945] Point Stat, GriB and NetCDF
>> > confusion
>> >
>> > Hello Matt,
>> >
>> > This is John Halley Gotway. I was out of the office last week,
but
>> > hopefully we can get to the bottom of this now.
>> >
>> > I retrieved the data you sent to use from our anonymous ftp site.
I
>> > see that it's the NetCDF output of the pcp-combine tool (
>> > NCEP.20150731_00_24h_8km_sum.nc), a GRIB1 file
>> > (LIS.GLOBAL.00.24.TP.9999), and a Point-Stat configuration file
>> > (lis_ST4_point_stat.cfg.default). I believe the problem here is
that
>> > you're running the wrong tool. Point-Stat is used to compare a
>> > gridded forecast to the point observations. However, both your
>> > forecast and observation data are gridded. You should be running
this
>> > data through the Grid-Stat tool to compute traditional and
neighborhood
>> statistics.
>> >
>> > I ran the following commands with your data and attached some
output:
>> >
>> > # Plot the LIS data, convert to png, and attached output
>> > METv4.1/bin/plot_data_plane LIS.GLOBAL.00.24.TP.9999
>> > LIS.GLOBAL.00.24.TP.9999.ps 'name="APCP"; level="A24"; convert
-rotate
>> > 90 -background white -flatten LIS.GLOBAL.00.24.TP.9999.ps
>> > LIS.GLOBAL.00.24.TP.9999.png
>> >
>> > # Plot the pcp_combine output, convert to png, and attached
output
>> > METv4.1/bin/plot_data_plane NCEP.20150731_00_24h_8km_sum.nc
>> > NCEP.20150731_00_24h_8km_sum.ps 'name="APCP_24"; level="(*,*)";'
>> > convert -rotate 90 -background white -flatten
>> > NCEP.20150731_00_24h_8km_sum.ps NCEP.20150731_00_24h_8km_sum.png
>> >
>> > # Run these through grid-stat, configuration file attached
>> > METv4.1/bin/grid_stat LIS.GLOBAL.00.24.TP.9999
>> > NCEP.20150731_00_24h_8km_sum.nc lis_ST4_grid_stat.cfg.default
-outdir
>> > out -v 4
>> >
>> > When I run this Grid-Stat command, I get the following error:
>> >
>> > process_command_line() -> The forecast and observation grids do
not
>> match:
>> > Projection: Lat/Lon Nx: 1440 Ny: 600 lat_ll: -59.875 lon_ll:
179.875
>> > delta_lat: 0.250 delta_lon: 0.250 != Projection: Lat/Lon Nx: 720
Ny:
>> > 360
>> > lat_ll: -89.750 lon_ll: -0.250 delta_lat: 0.500 delta_lon: 0.500
>> >
>> >
>> > This is telling you that these files aren't on the same grid. It
>> > looks like you've already regridded the Stage4 data to a global
1/2
>> degree grid.
>> > Presumably, you used copygb to do that. You just need to edit
your
>> > calls to copygb to put it on the 1/4 degree global grid that LIS
is
>> using.
>> >
>> > Hope that helps.
>> >
>> > Thanks,
>> > John
>> >
>> >
>> > On Thu, Aug 13, 2015 at 10:58 AM, SITTEL, MATTHEW C CTR USAF AFWA
16
>> > WS/WXN via RT <met_help at ucar.edu> wrote:
>> >
>> > >
>> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=72945 >
>> > >
>> > > Okay-I'm off tomorrow anyway so it's fine. Thanks for all your
>> efforts!
>> > > Have a great weekend.
>> > >
>> > > Matt
>> > >
>> > > -----Original Message-----
>> > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
>> > > Sent: Thursday, August 13, 2015 11:11 AM
>> > > To: SITTEL, MATTHEW C CTR USAF AFMC AFLCMC/HBAW-OL
>> > > Subject: Re: [rt.rap.ucar.edu #72945] Point Stat, GriB and
NetCDF
>> > > confusion
>> > >
>> > > Hi Matt. Some of our team is on vacation and won't be back
until
>> > > next week, as opposed to later this week. We'll keep working
on a
>> > > solution and will let you know as soon as we have one.
>> > >
>> > > Thanks for your patience.
>> > >
>> > > Julie
>> > >
>> > > On Wed, Aug 12, 2015 at 3:13 PM, Julie Prestopnik
<jpresto at ucar.edu>
>> > > wrote:
>> > >
>> > > > Hi Matt. I received your files. Unfortunately, I do not yet
have
>> > > > a solution for you. We are working on the problem and hope to
get
>> > > > back to you later this week.
>> > > >
>> > > > Julie
>> > > >
>> > > > On Wed, Aug 12, 2015 at 2:29 PM, SITTEL, MATTHEW C CTR USAF
AFWA
>> > > > 16 WS/WXN via RT <met_help at ucar.edu> wrote:
>> > > >
>> > > >>
>> > > >> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=72945 >
>> > > >>
>> > > >> Hi Julie,
>> > > >>
>> > > >> Hopefully the files I pushed yesterday afternoon made it
without
>> > > >> incident. I have tried some other things today like
modifying
>> > > >> the GriB table but I still haven't found a solution.
>> > > >>
>> > > >> If you need anything else from me that would help you,
please let
>> > > >> me
>> > > know.
>> > > >>
>> > > >> Thanks,
>> > > >> Matt
>> > > >>
>> > > >> -----Original Message-----
>> > > >> From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
>> > > >> Sent: Tuesday, August 11, 2015 3:26 PM
>> > > >> To: SITTEL, MATTHEW C CTR USAF AFMC AFLCMC/HBAW-OL
>> > > >> Subject: Re: [rt.rap.ucar.edu #72945] Point Stat, GriB and
NetCDF
>> > > >> confusion
>> > > >>
>> > > >> Hi Matt.
>> > > >>
>> > > >> I think what might be going on here is that you may need to
>> > > >> specify the information for the observation field as if it
was in
>> > > >> a GRIB file. I know this sounds confusing, but it is a bit
of
>> > > >> legacy behavior. Try replacing this with what you currently
have
>> > > >> for "obs" in
>> > > your configuration file:
>> > > >>
>> > > >> obs = {
>> > > >> wind_thresh = [ NA ];
>> > > >> message_type = [ "ADPSFC" ];
>> > > >> field = [
>> > > >> {
>> > > >> name = "APCP";
>> > > >> level = [ "A24" ];
>> > > >> cat_thresh = [ >=0.0 ];
>> > > >> }
>> > > >> ];
>> > > >> };
>> > > >>
>> > > >> If you still have trouble, could you please upload your data
and
>> > > >> config file to our FTP site using the instructions here:
>> > > >>
>> > > >> http://www.dtcenter.org/met/users/support/met_help.php#ftp
>> > > >>
>> > > >> Then, I can take a closer look.
>> > > >>
>> > > >> Thanks,
>> > > >> Julie
>> > > >>
>> > > >> On Tue, Aug 11, 2015 at 2:00 PM, SITTEL, MATTHEW C CTR USAF
AFWA
>> > > >> 16 WS/WXN via RT <met_help at ucar.edu> wrote:
>> > > >>
>> > > >> >
>> > > >> > Tue Aug 11 14:00:29 2015: Request 72945 was acted upon.
>> > > >> > Transaction: Ticket created by
matthew.sittel.ctr at us.af.mil
>> > > >> > Queue: met_help
>> > > >> > Subject: Point Stat, GriB and NetCDF confusion
>> > > >> > Owner: Nobody
>> > > >> > Requestors: matthew.sittel.ctr at us.af.mil
>> > > >> > Status: new
>> > > >> > Ticket <URL:
>> > > >> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=72945
>> > > >> > >
>> > > >> >
>> > > >> >
>> > > >> > Hi,
>> > > >> >
>> > > >> > I'm trying to run point_stat with the following:
>> > > >> >
>> > > >> > Forecast is a single GriB 1 precipitation field (APCP).
>> > > >> > Observations are the sum of 24 Stage IV Precipitation
Analyses,
>> > > >> > all
>> > > >> > 1 hourly amounts in NetCDF. They were summed using
pcp_combine.
>> > > >> > The resulting summation file has the variable name
'APCP_24'.
>> > > >> >
>> > > >> > I set in my point_stat config file the following:
>> > > >> >
>> > > >> > fcst = {
>> > > >> > wind_thresh = [ NA ];
>> > > >> >
>> > > >> > field = [
>> > > >> > {
>> > > >> > name = "APCP";
>> > > >> > level = "L0";
>> > > >> > cat_thresh = [ >=0.0 ];
>> > > >> > }
>> > > >> > ];
>> > > >> >
>> > > >> > };
>> > > >> >
>> > > >> > obs = {
>> > > >> > field = [
>> > > >> > {
>> > > >> > name = "APCP_24";
>> > > >> > level = "A24";
>> > > >> > cat_thresh = [ >=0.0 ];
>> > > >> > }
>> > > >> > ];
>> > > >> > };
>> > > >> >
>> > > >> > But I get the following error:
>> > > >> >
>> > > >> > ERROR : VarInfoGrib::set_dict() - unrecognized GRIB1
field
>> > > >> > abbreviation 'APCP_24' for table version 2
>> > > >> >
>> > > >> > I realize APCP_24 isn't in the GriB 1 table, but the
variable
>> > > >> > name comes from pcp_combine so I don't think I have power
to
>> > > >> > change
>> > it.
>> > > >> >
>> > > >> > Can I only run point_stat if both model and obs are called
"APCP"
>> > > >> > in
>> > > >> their
>> > > >> > respective files? If they can be different, how do I
handle it?
>> > > >> >
>> > > >> > More information which may be helpful:
>> > > >> >
>> > > >> > GriB header for my forecast data:
>> > > >> >
>> > > >> > rec 1:0:date 2015073100 APCP kpds5=61 kpds6=1 kpds7=0
>> > > >> > levels=(0,0)
>> > > >> > grid=255 sfc 24-0hr fcst:ave at 1yr: bitmap: 624213 undef
>> > > >> > APCP=Total precipitation [kg/m^2]
>> > > >> > timerange 133 P1 24 P2 0 TimeU 1 nx 1440 ny 600 GDS
grid 0
>> > > >> > num_in_ave 0 missing 0
>> > > >> > center 57 subcenter 2 process 89 Table 128 scan: WE:SN
>> winds(N/S)
>> > > >> > latlon: lat -59.875000 to 89.875000 by 0.250000 nxny
864000
>> > > >> > long -179.875000 to 179.875000 by 0.250000,
(1440 x
>> > > >> > 600) scan 64 mode 128 bdsgrid 1
>> > > >> > min/max data 0 220 num bits 15 BDS_Ref 0 DecScale 2
>> > > >> > BinScale
>> > > >> > 0
>> > > >> >
>> > > >> > NetCDF header for my observation data:
>> > > >> >
>> > > >> > netcdf NCEP.20150731_00_24h_8km_sum {
>> > > >> > dimensions:
>> > > >> > lat = 360 ;
>> > > >> > lon = 720 ;
>> > > >> > variables:
>> > > >> > float lat(lat, lon) ;
>> > > >> > lat:long_name = "latitude" ;
>> > > >> > lat:units = "degrees_north" ;
>> > > >> > lat:standard_name = "latitude" ;
>> > > >> > float lon(lat, lon) ;
>> > > >> > lon:long_name = "longitude" ;
>> > > >> > lon:units = "degrees_east" ;
>> > > >> > lon:standard_name = "longitude" ;
>> > > >> > float APCP_24(lat, lon) ;
>> > > >> > APCP_24:name = "APCP_24" ;
>> > > >> > APCP_24:long_name = "Total precipitation"
;
>> > > >> > APCP_24:level = "A24" ;
>> > > >> > APCP_24:units = "kg/m^2" ;
>> > > >> > APCP_24:_FillValue = -9999.f ;
>> > > >> > APCP_24:init_time = "20150731_000000" ;
>> > > >> > APCP_24:init_time_ut = 1438300800 ;
>> > > >> > APCP_24:valid_time = "20150731_000000" ;
>> > > >> > APCP_24:valid_time_ut = 1438300800 ;
>> > > >> > APCP_24:accum_time = "240000" ;
>> > > >> > APCP_24:accum_time_sec = 86400 ;
>> > > >> >
>> > > >> > // global attributes:
>> > > >> > :FileOrigins = "File
>> > > >> > /h/data/global/WXQC/data/met/lis/
>> > > >> > NCEP.20150731_00_24h_8km_sum.nc generated 20150811_195735
UTC
>> > > >> > on host
>> > > >> > dev8dlsn1 by the MET pcp_combine tool" ;
>> > > >> > :MET_version = "V4.1" ;
>> > > >> > :MET_tool = "pcp_combine" ;
>> > > >> > :RunCommand = "Sum: 24 files with
accumulations
>> > > >> > of 010000." ;
>> > > >> > :Projection = "LatLon" ;
>> > > >> > :lat_ll = "-89.750000 degrees_north" ;
>> > > >> > :lon_ll = "0.250000 degrees_east" ;
>> > > >> > :delta_lat = "0.500000 degrees" ;
>> > > >> > :delta_lon = "0.500000 degrees" ;
>> > > >> > :Nlat = "360 grid_points" ;
>> > > >> > :Nlon = "720 grid_points" ;
>> > > >> >
>> > > >> > Thanks,
>> > > >> > Matt
>> > > >> >
>> > > >> > // SIGNED //
>> > > >> > Matthew C. Sittel
>> > > >> > University Corporation for Atmospheric Research
>> > > >> > 16 WS/WXN, 557 WW, Offutt AFB, NE
matthew.sittel.ctr at us.af.mil
>> > > >> >
>> > > >> >
>> > > >> >
>> > > >> >
>> > > >> >
>> > > >>
>> > > >>
>> > > >> --
>> > > >> Julie Prestopnik
>> > > >> National Center for Atmospheric Research Research
Applications
>> > > >> Laboratory
>> > > >> Phone: 303.497.8399
>> > > >> Email: jpresto at ucar.edu
>> > > >>
>> > > >>
>> > > >>
>> > > >>
>> > > >
>> > > >
>> > > > --
>> > > > Julie Prestopnik
>> > > > National Center for Atmospheric Research Research
Applications
>> > > > Laboratory
>> > > > Phone: 303.497.8399
>> > > > Email: jpresto at ucar.edu
>> > > >
>> > >
>> > >
>> > >
>> > > --
>> > > Julie Prestopnik
>> > > National Center for Atmospheric Research Research Applications
>> > > Laboratory
>> > > Phone: 303.497.8399
>> > > Email: jpresto at ucar.edu
>> > >
>> > >
>> > >
>> > >
>> >
>> >
>> >
>> >
>>
>>
>>
>>
>
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #72945] Point Stat, GriB and NetCDF confusion
From: SITTEL, MATTHEW C CTR USAF AFWA 16 WS/WXN
Time: Wed Aug 19 11:37:36 2015
Thanks John.
I don't think R has ever been installed on our development system. I
doubt I can do this myself given our lack of control of anything on
our systems. So I'm not sure I'll be able to use this. I'm running
out of ideas.
Matt
-----Original Message-----
From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
Sent: Wednesday, August 19, 2015 11:08 AM
To: SITTEL, MATTHEW C CTR USAF AFMC AFLCMC/HBAW-OL
Subject: Re: [rt.rap.ucar.edu #72945] Point Stat, GriB and NetCDF
confusion
Matt,
I've attached an Rscript that will hopefully do the trick for you.
It's named "gspairs2mpr.R"... although it doesn't actually write a
full MPR line as Point-Stat does yet - just lat, lon, fcst, and obs
values. I've also attached a sample NetCDF output file. Here's how
you run it:
Rscript gspairs2mpr.R
grid_stat_APCP_24_240000L_20050808_000000V_pairs.nc
By default, it'll write an output file named "mpr.txt" but you can
override that with the "-out" option. Run this to see the usage:
Rscript gspairs2mpr.R
Please give this a shot and let me know how it goes. It's currently
writing space separated output but could easily write csv instead.
John
On Wed, Aug 19, 2015 at 6:47 AM, SITTEL, MATTHEW C CTR USAF AFWA 16
WS/WXN via RT <met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=72945 >
>
> Thanks John. I wrote one to format our binary data to the ASCII
> format required for ingestion by MET, but NetCDF is one I'm less
familiar with.
>
> All I need is simply lat, lon, model value, obs value (and just the
> non-missing ones). Unless MET accepts the matched pairs in NetCDF
> such that I can manipulate them (e.g., latitude band subsetting).
>
> Matt
>
> -----Original Message-----
> From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> Sent: Tuesday, August 18, 2015 4:54 PM
> To: SITTEL, MATTHEW C CTR USAF AFMC AFLCMC/HBAW-OL
> Subject: Re: [rt.rap.ucar.edu #72945] Point Stat, GriB and NetCDF
> confusion
>
> Matt,
>
> I was working on a quick Rscript to dump the pairs from the NetCDF
> matched pairs file to ascii, but wasn't able to finish it today.
I'll
> take a look tomorrow and get back to you.
>
> John
>
> On Tue, Aug 18, 2015 at 8:48 AM, SITTEL, MATTHEW C CTR USAF AFWA 16
> WS/WXN via RT <met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=72945 >
> >
> > Hi John,
> >
> > Thanks for your help. I got it to work with grid_stat. I didn't
> > even see the oddity with the grid. But thanks to copygb I got
> > everything to match up.
> >
> > The reason I was using point_stat, or trying to, was because I
want
> > the model-obs pairs from the grid stat run in a format easily
> > imported by Excel. Is there a way to do that with grid_stat?
What
> > I ideally want is the matched pair ("MPR") format from point_stat
> > but have it generated from grid_stat. Otherwise I have to figure
> > out a method to convert NetCDF to ASCII, something I have zero
experience with.
> >
> > Any advice on the above? I would sure appreciate it!
> >
> > Matt
> >
> > -----Original Message-----
> > From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> > Sent: Monday, August 17, 2015 12:39 PM
> > To: SITTEL, MATTHEW C CTR USAF AFMC AFLCMC/HBAW-OL
> > Subject: Re: [rt.rap.ucar.edu #72945] Point Stat, GriB and NetCDF
> > confusion
> >
> > Hello Matt,
> >
> > This is John Halley Gotway. I was out of the office last week,
but
> > hopefully we can get to the bottom of this now.
> >
> > I retrieved the data you sent to use from our anonymous ftp site.
I
> > see that it's the NetCDF output of the pcp-combine tool (
> > NCEP.20150731_00_24h_8km_sum.nc), a GRIB1 file
> > (LIS.GLOBAL.00.24.TP.9999), and a Point-Stat configuration file
> > (lis_ST4_point_stat.cfg.default). I believe the problem here is
> > that you're running the wrong tool. Point-Stat is used to compare
a
> > gridded forecast to the point observations. However, both your
> > forecast and observation data are gridded. You should be running
> > this data through the Grid-Stat tool to compute traditional and
> > neighborhood
> statistics.
> >
> > I ran the following commands with your data and attached some
output:
> >
> > # Plot the LIS data, convert to png, and attached output
> > METv4.1/bin/plot_data_plane LIS.GLOBAL.00.24.TP.9999
> > LIS.GLOBAL.00.24.TP.9999.ps 'name="APCP"; level="A24"; convert
> > -rotate
> > 90 -background white -flatten LIS.GLOBAL.00.24.TP.9999.ps
> > LIS.GLOBAL.00.24.TP.9999.png
> >
> > # Plot the pcp_combine output, convert to png, and attached output
> > METv4.1/bin/plot_data_plane NCEP.20150731_00_24h_8km_sum.nc
> > NCEP.20150731_00_24h_8km_sum.ps 'name="APCP_24"; level="(*,*)";'
> > convert -rotate 90 -background white -flatten
> > NCEP.20150731_00_24h_8km_sum.ps NCEP.20150731_00_24h_8km_sum.png
> >
> > # Run these through grid-stat, configuration file attached
> > METv4.1/bin/grid_stat LIS.GLOBAL.00.24.TP.9999
> > NCEP.20150731_00_24h_8km_sum.nc lis_ST4_grid_stat.cfg.default
> > -outdir out -v 4
> >
> > When I run this Grid-Stat command, I get the following error:
> >
> > process_command_line() -> The forecast and observation grids do
not
> match:
> > Projection: Lat/Lon Nx: 1440 Ny: 600 lat_ll: -59.875 lon_ll:
179.875
> > delta_lat: 0.250 delta_lon: 0.250 != Projection: Lat/Lon Nx: 720
Ny:
> > 360
> > lat_ll: -89.750 lon_ll: -0.250 delta_lat: 0.500 delta_lon: 0.500
> >
> >
> > This is telling you that these files aren't on the same grid. It
> > looks like you've already regridded the Stage4 data to a global
1/2
> degree grid.
> > Presumably, you used copygb to do that. You just need to edit
your
> > calls to copygb to put it on the 1/4 degree global grid that LIS
is
> using.
> >
> > Hope that helps.
> >
> > Thanks,
> > John
> >
> >
> > On Thu, Aug 13, 2015 at 10:58 AM, SITTEL, MATTHEW C CTR USAF AFWA
16
> > WS/WXN via RT <met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=72945 >
> > >
> > > Okay-I'm off tomorrow anyway so it's fine. Thanks for all your
> efforts!
> > > Have a great weekend.
> > >
> > > Matt
> > >
> > > -----Original Message-----
> > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > Sent: Thursday, August 13, 2015 11:11 AM
> > > To: SITTEL, MATTHEW C CTR USAF AFMC AFLCMC/HBAW-OL
> > > Subject: Re: [rt.rap.ucar.edu #72945] Point Stat, GriB and
NetCDF
> > > confusion
> > >
> > > Hi Matt. Some of our team is on vacation and won't be back
until
> > > next week, as opposed to later this week. We'll keep working on
a
> > > solution and will let you know as soon as we have one.
> > >
> > > Thanks for your patience.
> > >
> > > Julie
> > >
> > > On Wed, Aug 12, 2015 at 3:13 PM, Julie Prestopnik
> > > <jpresto at ucar.edu>
> > > wrote:
> > >
> > > > Hi Matt. I received your files. Unfortunately, I do not yet
> > > > have a solution for you. We are working on the problem and
hope
> > > > to get back to you later this week.
> > > >
> > > > Julie
> > > >
> > > > On Wed, Aug 12, 2015 at 2:29 PM, SITTEL, MATTHEW C CTR USAF
AFWA
> > > > 16 WS/WXN via RT <met_help at ucar.edu> wrote:
> > > >
> > > >>
> > > >> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=72945
>
> > > >>
> > > >> Hi Julie,
> > > >>
> > > >> Hopefully the files I pushed yesterday afternoon made it
> > > >> without incident. I have tried some other things today like
> > > >> modifying the GriB table but I still haven't found a
solution.
> > > >>
> > > >> If you need anything else from me that would help you, please
> > > >> let me
> > > know.
> > > >>
> > > >> Thanks,
> > > >> Matt
> > > >>
> > > >> -----Original Message-----
> > > >> From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > >> Sent: Tuesday, August 11, 2015 3:26 PM
> > > >> To: SITTEL, MATTHEW C CTR USAF AFMC AFLCMC/HBAW-OL
> > > >> Subject: Re: [rt.rap.ucar.edu #72945] Point Stat, GriB and
> > > >> NetCDF confusion
> > > >>
> > > >> Hi Matt.
> > > >>
> > > >> I think what might be going on here is that you may need to
> > > >> specify the information for the observation field as if it
was
> > > >> in a GRIB file. I know this sounds confusing, but it is a
bit
> > > >> of legacy behavior. Try replacing this with what you
currently
> > > >> have for "obs" in
> > > your configuration file:
> > > >>
> > > >> obs = {
> > > >> wind_thresh = [ NA ];
> > > >> message_type = [ "ADPSFC" ];
> > > >> field = [
> > > >> {
> > > >> name = "APCP";
> > > >> level = [ "A24" ];
> > > >> cat_thresh = [ >=0.0 ];
> > > >> }
> > > >> ];
> > > >> };
> > > >>
> > > >> If you still have trouble, could you please upload your data
> > > >> and config file to our FTP site using the instructions here:
> > > >>
> > > >> http://www.dtcenter.org/met/users/support/met_help.php#ftp
> > > >>
> > > >> Then, I can take a closer look.
> > > >>
> > > >> Thanks,
> > > >> Julie
> > > >>
> > > >> On Tue, Aug 11, 2015 at 2:00 PM, SITTEL, MATTHEW C CTR USAF
> > > >> AFWA
> > > >> 16 WS/WXN via RT <met_help at ucar.edu> wrote:
> > > >>
> > > >> >
> > > >> > Tue Aug 11 14:00:29 2015: Request 72945 was acted upon.
> > > >> > Transaction: Ticket created by matthew.sittel.ctr at us.af.mil
> > > >> > Queue: met_help
> > > >> > Subject: Point Stat, GriB and NetCDF confusion
> > > >> > Owner: Nobody
> > > >> > Requestors: matthew.sittel.ctr at us.af.mil
> > > >> > Status: new
> > > >> > Ticket <URL:
> > > >> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=72945
> > > >> > >
> > > >> >
> > > >> >
> > > >> > Hi,
> > > >> >
> > > >> > I'm trying to run point_stat with the following:
> > > >> >
> > > >> > Forecast is a single GriB 1 precipitation field (APCP).
> > > >> > Observations are the sum of 24 Stage IV Precipitation
> > > >> > Analyses, all
> > > >> > 1 hourly amounts in NetCDF. They were summed using
pcp_combine.
> > > >> > The resulting summation file has the variable name
'APCP_24'.
> > > >> >
> > > >> > I set in my point_stat config file the following:
> > > >> >
> > > >> > fcst = {
> > > >> > wind_thresh = [ NA ];
> > > >> >
> > > >> > field = [
> > > >> > {
> > > >> > name = "APCP";
> > > >> > level = "L0";
> > > >> > cat_thresh = [ >=0.0 ];
> > > >> > }
> > > >> > ];
> > > >> >
> > > >> > };
> > > >> >
> > > >> > obs = {
> > > >> > field = [
> > > >> > {
> > > >> > name = "APCP_24";
> > > >> > level = "A24";
> > > >> > cat_thresh = [ >=0.0 ];
> > > >> > }
> > > >> > ];
> > > >> > };
> > > >> >
> > > >> > But I get the following error:
> > > >> >
> > > >> > ERROR : VarInfoGrib::set_dict() - unrecognized GRIB1 field
> > > >> > abbreviation 'APCP_24' for table version 2
> > > >> >
> > > >> > I realize APCP_24 isn't in the GriB 1 table, but the
variable
> > > >> > name comes from pcp_combine so I don't think I have power
to
> > > >> > change
> > it.
> > > >> >
> > > >> > Can I only run point_stat if both model and obs are called
"APCP"
> > > >> > in
> > > >> their
> > > >> > respective files? If they can be different, how do I
handle it?
> > > >> >
> > > >> > More information which may be helpful:
> > > >> >
> > > >> > GriB header for my forecast data:
> > > >> >
> > > >> > rec 1:0:date 2015073100 APCP kpds5=61 kpds6=1 kpds7=0
> > > >> > levels=(0,0)
> > > >> > grid=255 sfc 24-0hr fcst:ave at 1yr: bitmap: 624213 undef
> > > >> > APCP=Total precipitation [kg/m^2]
> > > >> > timerange 133 P1 24 P2 0 TimeU 1 nx 1440 ny 600 GDS grid
0
> > > >> > num_in_ave 0 missing 0
> > > >> > center 57 subcenter 2 process 89 Table 128 scan: WE:SN
> winds(N/S)
> > > >> > latlon: lat -59.875000 to 89.875000 by 0.250000 nxny
864000
> > > >> > long -179.875000 to 179.875000 by 0.250000, (1440
x
> > > >> > 600) scan 64 mode 128 bdsgrid 1
> > > >> > min/max data 0 220 num bits 15 BDS_Ref 0 DecScale 2
> > > >> > BinScale
> > > >> > 0
> > > >> >
> > > >> > NetCDF header for my observation data:
> > > >> >
> > > >> > netcdf NCEP.20150731_00_24h_8km_sum {
> > > >> > dimensions:
> > > >> > lat = 360 ;
> > > >> > lon = 720 ;
> > > >> > variables:
> > > >> > float lat(lat, lon) ;
> > > >> > lat:long_name = "latitude" ;
> > > >> > lat:units = "degrees_north" ;
> > > >> > lat:standard_name = "latitude" ;
> > > >> > float lon(lat, lon) ;
> > > >> > lon:long_name = "longitude" ;
> > > >> > lon:units = "degrees_east" ;
> > > >> > lon:standard_name = "longitude" ;
> > > >> > float APCP_24(lat, lon) ;
> > > >> > APCP_24:name = "APCP_24" ;
> > > >> > APCP_24:long_name = "Total precipitation" ;
> > > >> > APCP_24:level = "A24" ;
> > > >> > APCP_24:units = "kg/m^2" ;
> > > >> > APCP_24:_FillValue = -9999.f ;
> > > >> > APCP_24:init_time = "20150731_000000" ;
> > > >> > APCP_24:init_time_ut = 1438300800 ;
> > > >> > APCP_24:valid_time = "20150731_000000" ;
> > > >> > APCP_24:valid_time_ut = 1438300800 ;
> > > >> > APCP_24:accum_time = "240000" ;
> > > >> > APCP_24:accum_time_sec = 86400 ;
> > > >> >
> > > >> > // global attributes:
> > > >> > :FileOrigins = "File
> > > >> > /h/data/global/WXQC/data/met/lis/
> > > >> > NCEP.20150731_00_24h_8km_sum.nc generated 20150811_195735
UTC
> > > >> > on host
> > > >> > dev8dlsn1 by the MET pcp_combine tool" ;
> > > >> > :MET_version = "V4.1" ;
> > > >> > :MET_tool = "pcp_combine" ;
> > > >> > :RunCommand = "Sum: 24 files with
> > > >> > accumulations of 010000." ;
> > > >> > :Projection = "LatLon" ;
> > > >> > :lat_ll = "-89.750000 degrees_north" ;
> > > >> > :lon_ll = "0.250000 degrees_east" ;
> > > >> > :delta_lat = "0.500000 degrees" ;
> > > >> > :delta_lon = "0.500000 degrees" ;
> > > >> > :Nlat = "360 grid_points" ;
> > > >> > :Nlon = "720 grid_points" ;
> > > >> >
> > > >> > Thanks,
> > > >> > Matt
> > > >> >
> > > >> > // SIGNED //
> > > >> > Matthew C. Sittel
> > > >> > University Corporation for Atmospheric Research
> > > >> > 16 WS/WXN, 557 WW, Offutt AFB, NE
> > > >> > matthew.sittel.ctr at us.af.mil
> > > >> >
> > > >> >
> > > >> >
> > > >> >
> > > >> >
> > > >>
> > > >>
> > > >> --
> > > >> Julie Prestopnik
> > > >> National Center for Atmospheric Research Research
Applications
> > > >> Laboratory
> > > >> Phone: 303.497.8399
> > > >> Email: jpresto at ucar.edu
> > > >>
> > > >>
> > > >>
> > > >>
> > > >
> > > >
> > > > --
> > > > Julie Prestopnik
> > > > National Center for Atmospheric Research Research Applications
> > > > Laboratory
> > > > Phone: 303.497.8399
> > > > Email: jpresto at ucar.edu
> > > >
> > >
> > >
> > >
> > > --
> > > Julie Prestopnik
> > > National Center for Atmospheric Research Research Applications
> > > Laboratory
> > > Phone: 303.497.8399
> > > Email: jpresto at ucar.edu
> > >
> > >
> > >
> > >
> >
> >
> >
> >
>
>
>
>
------------------------------------------------
Subject: Point Stat, GriB and NetCDF confusion
From: John Halley Gotway
Time: Wed Aug 19 14:10:13 2015
Matt,
Sorry I don't have a better solution for you.
I did finished updating the gspairs2mpr.R script to write complete MPR
lines. The output file can then be read into STAT-Analysis for
additional
subsetting and to convert the MPR data into whatever output statistic
type
you'd like.
For example, call STAT-Analysis compute continuous statistics, but
only for
latitudes between 30 and 35 degrees where the observation value is at
least
0.1:
stat_analysis -lookin mpr.txt \
-job aggregate_stat -line_type MPR -out_line_type CNT -by VX_MASK
-n_boot_rep 0 \
-column_min OBS_LAT 30 -column_max OBS_LAT 35 -column_min OBS
0.01
The updated version of that script is attached. If you're somehow
able to
get access to R, it would do the trick for you. If not, it just
depends on
what scripting tools are available to you.
John
On Wed, Aug 19, 2015 at 11:37 AM, SITTEL, MATTHEW C CTR USAF AFWA 16
WS/WXN
via RT <met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=72945 >
>
> Thanks John.
>
> I don't think R has ever been installed on our development system.
I
> doubt I can do this myself given our lack of control of anything on
our
> systems. So I'm not sure I'll be able to use this. I'm running out
of
> ideas.
>
> Matt
>
> -----Original Message-----
> From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> Sent: Wednesday, August 19, 2015 11:08 AM
> To: SITTEL, MATTHEW C CTR USAF AFMC AFLCMC/HBAW-OL
> Subject: Re: [rt.rap.ucar.edu #72945] Point Stat, GriB and NetCDF
> confusion
>
> Matt,
>
> I've attached an Rscript that will hopefully do the trick for you.
It's
> named "gspairs2mpr.R"... although it doesn't actually write a full
MPR line
> as Point-Stat does yet - just lat, lon, fcst, and obs values. I've
also
> attached a sample NetCDF output file. Here's how you run it:
>
> Rscript gspairs2mpr.R
grid_stat_APCP_24_240000L_20050808_000000V_pairs.nc
>
> By default, it'll write an output file named "mpr.txt" but you can
> override that with the "-out" option. Run this to see the usage:
> Rscript gspairs2mpr.R
>
> Please give this a shot and let me know how it goes. It's currently
> writing space separated output but could easily write csv instead.
>
> John
>
> On Wed, Aug 19, 2015 at 6:47 AM, SITTEL, MATTHEW C CTR USAF AFWA 16
WS/WXN
> via RT <met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=72945 >
> >
> > Thanks John. I wrote one to format our binary data to the ASCII
> > format required for ingestion by MET, but NetCDF is one I'm less
> familiar with.
> >
> > All I need is simply lat, lon, model value, obs value (and just
the
> > non-missing ones). Unless MET accepts the matched pairs in NetCDF
> > such that I can manipulate them (e.g., latitude band subsetting).
> >
> > Matt
> >
> > -----Original Message-----
> > From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> > Sent: Tuesday, August 18, 2015 4:54 PM
> > To: SITTEL, MATTHEW C CTR USAF AFMC AFLCMC/HBAW-OL
> > Subject: Re: [rt.rap.ucar.edu #72945] Point Stat, GriB and NetCDF
> > confusion
> >
> > Matt,
> >
> > I was working on a quick Rscript to dump the pairs from the NetCDF
> > matched pairs file to ascii, but wasn't able to finish it today.
I'll
> > take a look tomorrow and get back to you.
> >
> > John
> >
> > On Tue, Aug 18, 2015 at 8:48 AM, SITTEL, MATTHEW C CTR USAF AFWA
16
> > WS/WXN via RT <met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=72945 >
> > >
> > > Hi John,
> > >
> > > Thanks for your help. I got it to work with grid_stat. I
didn't
> > > even see the oddity with the grid. But thanks to copygb I got
> > > everything to match up.
> > >
> > > The reason I was using point_stat, or trying to, was because I
want
> > > the model-obs pairs from the grid stat run in a format easily
> > > imported by Excel. Is there a way to do that with grid_stat?
What
> > > I ideally want is the matched pair ("MPR") format from
point_stat
> > > but have it generated from grid_stat. Otherwise I have to
figure
> > > out a method to convert NetCDF to ASCII, something I have zero
> experience with.
> > >
> > > Any advice on the above? I would sure appreciate it!
> > >
> > > Matt
> > >
> > > -----Original Message-----
> > > From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> > > Sent: Monday, August 17, 2015 12:39 PM
> > > To: SITTEL, MATTHEW C CTR USAF AFMC AFLCMC/HBAW-OL
> > > Subject: Re: [rt.rap.ucar.edu #72945] Point Stat, GriB and
NetCDF
> > > confusion
> > >
> > > Hello Matt,
> > >
> > > This is John Halley Gotway. I was out of the office last week,
but
> > > hopefully we can get to the bottom of this now.
> > >
> > > I retrieved the data you sent to use from our anonymous ftp
site. I
> > > see that it's the NetCDF output of the pcp-combine tool (
> > > NCEP.20150731_00_24h_8km_sum.nc), a GRIB1 file
> > > (LIS.GLOBAL.00.24.TP.9999), and a Point-Stat configuration file
> > > (lis_ST4_point_stat.cfg.default). I believe the problem here is
> > > that you're running the wrong tool. Point-Stat is used to
compare a
> > > gridded forecast to the point observations. However, both your
> > > forecast and observation data are gridded. You should be
running
> > > this data through the Grid-Stat tool to compute traditional and
> > > neighborhood
> > statistics.
> > >
> > > I ran the following commands with your data and attached some
output:
> > >
> > > # Plot the LIS data, convert to png, and attached output
> > > METv4.1/bin/plot_data_plane LIS.GLOBAL.00.24.TP.9999
> > > LIS.GLOBAL.00.24.TP.9999.ps 'name="APCP"; level="A24"; convert
> > > -rotate
> > > 90 -background white -flatten LIS.GLOBAL.00.24.TP.9999.ps
> > > LIS.GLOBAL.00.24.TP.9999.png
> > >
> > > # Plot the pcp_combine output, convert to png, and attached
output
> > > METv4.1/bin/plot_data_plane NCEP.20150731_00_24h_8km_sum.nc
> > > NCEP.20150731_00_24h_8km_sum.ps 'name="APCP_24"; level="(*,*)";'
> > > convert -rotate 90 -background white -flatten
> > > NCEP.20150731_00_24h_8km_sum.ps NCEP.20150731_00_24h_8km_sum.png
> > >
> > > # Run these through grid-stat, configuration file attached
> > > METv4.1/bin/grid_stat LIS.GLOBAL.00.24.TP.9999
> > > NCEP.20150731_00_24h_8km_sum.nc lis_ST4_grid_stat.cfg.default
> > > -outdir out -v 4
> > >
> > > When I run this Grid-Stat command, I get the following error:
> > >
> > > process_command_line() -> The forecast and observation grids do
not
> > match:
> > > Projection: Lat/Lon Nx: 1440 Ny: 600 lat_ll: -59.875 lon_ll:
179.875
> > > delta_lat: 0.250 delta_lon: 0.250 != Projection: Lat/Lon Nx: 720
Ny:
> > > 360
> > > lat_ll: -89.750 lon_ll: -0.250 delta_lat: 0.500 delta_lon: 0.500
> > >
> > >
> > > This is telling you that these files aren't on the same grid.
It
> > > looks like you've already regridded the Stage4 data to a global
1/2
> > degree grid.
> > > Presumably, you used copygb to do that. You just need to edit
your
> > > calls to copygb to put it on the 1/4 degree global grid that LIS
is
> > using.
> > >
> > > Hope that helps.
> > >
> > > Thanks,
> > > John
> > >
> > >
> > > On Thu, Aug 13, 2015 at 10:58 AM, SITTEL, MATTHEW C CTR USAF
AFWA 16
> > > WS/WXN via RT <met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=72945
>
> > > >
> > > > Okay-I'm off tomorrow anyway so it's fine. Thanks for all
your
> > efforts!
> > > > Have a great weekend.
> > > >
> > > > Matt
> > > >
> > > > -----Original Message-----
> > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > Sent: Thursday, August 13, 2015 11:11 AM
> > > > To: SITTEL, MATTHEW C CTR USAF AFMC AFLCMC/HBAW-OL
> > > > Subject: Re: [rt.rap.ucar.edu #72945] Point Stat, GriB and
NetCDF
> > > > confusion
> > > >
> > > > Hi Matt. Some of our team is on vacation and won't be back
until
> > > > next week, as opposed to later this week. We'll keep working
on a
> > > > solution and will let you know as soon as we have one.
> > > >
> > > > Thanks for your patience.
> > > >
> > > > Julie
> > > >
> > > > On Wed, Aug 12, 2015 at 3:13 PM, Julie Prestopnik
> > > > <jpresto at ucar.edu>
> > > > wrote:
> > > >
> > > > > Hi Matt. I received your files. Unfortunately, I do not
yet
> > > > > have a solution for you. We are working on the problem and
hope
> > > > > to get back to you later this week.
> > > > >
> > > > > Julie
> > > > >
> > > > > On Wed, Aug 12, 2015 at 2:29 PM, SITTEL, MATTHEW C CTR USAF
AFWA
> > > > > 16 WS/WXN via RT <met_help at ucar.edu> wrote:
> > > > >
> > > > >>
> > > > >> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=72945 >
> > > > >>
> > > > >> Hi Julie,
> > > > >>
> > > > >> Hopefully the files I pushed yesterday afternoon made it
> > > > >> without incident. I have tried some other things today
like
> > > > >> modifying the GriB table but I still haven't found a
solution.
> > > > >>
> > > > >> If you need anything else from me that would help you,
please
> > > > >> let me
> > > > know.
> > > > >>
> > > > >> Thanks,
> > > > >> Matt
> > > > >>
> > > > >> -----Original Message-----
> > > > >> From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > >> Sent: Tuesday, August 11, 2015 3:26 PM
> > > > >> To: SITTEL, MATTHEW C CTR USAF AFMC AFLCMC/HBAW-OL
> > > > >> Subject: Re: [rt.rap.ucar.edu #72945] Point Stat, GriB and
> > > > >> NetCDF confusion
> > > > >>
> > > > >> Hi Matt.
> > > > >>
> > > > >> I think what might be going on here is that you may need to
> > > > >> specify the information for the observation field as if it
was
> > > > >> in a GRIB file. I know this sounds confusing, but it is a
bit
> > > > >> of legacy behavior. Try replacing this with what you
currently
> > > > >> have for "obs" in
> > > > your configuration file:
> > > > >>
> > > > >> obs = {
> > > > >> wind_thresh = [ NA ];
> > > > >> message_type = [ "ADPSFC" ];
> > > > >> field = [
> > > > >> {
> > > > >> name = "APCP";
> > > > >> level = [ "A24" ];
> > > > >> cat_thresh = [ >=0.0 ];
> > > > >> }
> > > > >> ];
> > > > >> };
> > > > >>
> > > > >> If you still have trouble, could you please upload your
data
> > > > >> and config file to our FTP site using the instructions
here:
> > > > >>
> > > > >> http://www.dtcenter.org/met/users/support/met_help.php#ftp
> > > > >>
> > > > >> Then, I can take a closer look.
> > > > >>
> > > > >> Thanks,
> > > > >> Julie
> > > > >>
> > > > >> On Tue, Aug 11, 2015 at 2:00 PM, SITTEL, MATTHEW C CTR USAF
> > > > >> AFWA
> > > > >> 16 WS/WXN via RT <met_help at ucar.edu> wrote:
> > > > >>
> > > > >> >
> > > > >> > Tue Aug 11 14:00:29 2015: Request 72945 was acted upon.
> > > > >> > Transaction: Ticket created by
matthew.sittel.ctr at us.af.mil
> > > > >> > Queue: met_help
> > > > >> > Subject: Point Stat, GriB and NetCDF confusion
> > > > >> > Owner: Nobody
> > > > >> > Requestors: matthew.sittel.ctr at us.af.mil
> > > > >> > Status: new
> > > > >> > Ticket <URL:
> > > > >> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=72945
> > > > >> > >
> > > > >> >
> > > > >> >
> > > > >> > Hi,
> > > > >> >
> > > > >> > I'm trying to run point_stat with the following:
> > > > >> >
> > > > >> > Forecast is a single GriB 1 precipitation field (APCP).
> > > > >> > Observations are the sum of 24 Stage IV Precipitation
> > > > >> > Analyses, all
> > > > >> > 1 hourly amounts in NetCDF. They were summed using
pcp_combine.
> > > > >> > The resulting summation file has the variable name
'APCP_24'.
> > > > >> >
> > > > >> > I set in my point_stat config file the following:
> > > > >> >
> > > > >> > fcst = {
> > > > >> > wind_thresh = [ NA ];
> > > > >> >
> > > > >> > field = [
> > > > >> > {
> > > > >> > name = "APCP";
> > > > >> > level = "L0";
> > > > >> > cat_thresh = [ >=0.0 ];
> > > > >> > }
> > > > >> > ];
> > > > >> >
> > > > >> > };
> > > > >> >
> > > > >> > obs = {
> > > > >> > field = [
> > > > >> > {
> > > > >> > name = "APCP_24";
> > > > >> > level = "A24";
> > > > >> > cat_thresh = [ >=0.0 ];
> > > > >> > }
> > > > >> > ];
> > > > >> > };
> > > > >> >
> > > > >> > But I get the following error:
> > > > >> >
> > > > >> > ERROR : VarInfoGrib::set_dict() - unrecognized GRIB1
field
> > > > >> > abbreviation 'APCP_24' for table version 2
> > > > >> >
> > > > >> > I realize APCP_24 isn't in the GriB 1 table, but the
variable
> > > > >> > name comes from pcp_combine so I don't think I have power
to
> > > > >> > change
> > > it.
> > > > >> >
> > > > >> > Can I only run point_stat if both model and obs are
called
> "APCP"
> > > > >> > in
> > > > >> their
> > > > >> > respective files? If they can be different, how do I
handle
> it?
> > > > >> >
> > > > >> > More information which may be helpful:
> > > > >> >
> > > > >> > GriB header for my forecast data:
> > > > >> >
> > > > >> > rec 1:0:date 2015073100 APCP kpds5=61 kpds6=1 kpds7=0
> > > > >> > levels=(0,0)
> > > > >> > grid=255 sfc 24-0hr fcst:ave at 1yr: bitmap: 624213 undef
> > > > >> > APCP=Total precipitation [kg/m^2]
> > > > >> > timerange 133 P1 24 P2 0 TimeU 1 nx 1440 ny 600 GDS
grid 0
> > > > >> > num_in_ave 0 missing 0
> > > > >> > center 57 subcenter 2 process 89 Table 128 scan: WE:SN
> > winds(N/S)
> > > > >> > latlon: lat -59.875000 to 89.875000 by 0.250000 nxny
864000
> > > > >> > long -179.875000 to 179.875000 by 0.250000,
(1440 x
> > > > >> > 600) scan 64 mode 128 bdsgrid 1
> > > > >> > min/max data 0 220 num bits 15 BDS_Ref 0 DecScale 2
> > > > >> > BinScale
> > > > >> > 0
> > > > >> >
> > > > >> > NetCDF header for my observation data:
> > > > >> >
> > > > >> > netcdf NCEP.20150731_00_24h_8km_sum {
> > > > >> > dimensions:
> > > > >> > lat = 360 ;
> > > > >> > lon = 720 ;
> > > > >> > variables:
> > > > >> > float lat(lat, lon) ;
> > > > >> > lat:long_name = "latitude" ;
> > > > >> > lat:units = "degrees_north" ;
> > > > >> > lat:standard_name = "latitude" ;
> > > > >> > float lon(lat, lon) ;
> > > > >> > lon:long_name = "longitude" ;
> > > > >> > lon:units = "degrees_east" ;
> > > > >> > lon:standard_name = "longitude" ;
> > > > >> > float APCP_24(lat, lon) ;
> > > > >> > APCP_24:name = "APCP_24" ;
> > > > >> > APCP_24:long_name = "Total precipitation"
;
> > > > >> > APCP_24:level = "A24" ;
> > > > >> > APCP_24:units = "kg/m^2" ;
> > > > >> > APCP_24:_FillValue = -9999.f ;
> > > > >> > APCP_24:init_time = "20150731_000000" ;
> > > > >> > APCP_24:init_time_ut = 1438300800 ;
> > > > >> > APCP_24:valid_time = "20150731_000000" ;
> > > > >> > APCP_24:valid_time_ut = 1438300800 ;
> > > > >> > APCP_24:accum_time = "240000" ;
> > > > >> > APCP_24:accum_time_sec = 86400 ;
> > > > >> >
> > > > >> > // global attributes:
> > > > >> > :FileOrigins = "File
> > > > >> > /h/data/global/WXQC/data/met/lis/
> > > > >> > NCEP.20150731_00_24h_8km_sum.nc generated 20150811_195735
UTC
> > > > >> > on host
> > > > >> > dev8dlsn1 by the MET pcp_combine tool" ;
> > > > >> > :MET_version = "V4.1" ;
> > > > >> > :MET_tool = "pcp_combine" ;
> > > > >> > :RunCommand = "Sum: 24 files with
> > > > >> > accumulations of 010000." ;
> > > > >> > :Projection = "LatLon" ;
> > > > >> > :lat_ll = "-89.750000 degrees_north" ;
> > > > >> > :lon_ll = "0.250000 degrees_east" ;
> > > > >> > :delta_lat = "0.500000 degrees" ;
> > > > >> > :delta_lon = "0.500000 degrees" ;
> > > > >> > :Nlat = "360 grid_points" ;
> > > > >> > :Nlon = "720 grid_points" ;
> > > > >> >
> > > > >> > Thanks,
> > > > >> > Matt
> > > > >> >
> > > > >> > // SIGNED //
> > > > >> > Matthew C. Sittel
> > > > >> > University Corporation for Atmospheric Research
> > > > >> > 16 WS/WXN, 557 WW, Offutt AFB, NE
> > > > >> > matthew.sittel.ctr at us.af.mil
> > > > >> >
> > > > >> >
> > > > >> >
> > > > >> >
> > > > >> >
> > > > >>
> > > > >>
> > > > >> --
> > > > >> Julie Prestopnik
> > > > >> National Center for Atmospheric Research Research
Applications
> > > > >> Laboratory
> > > > >> Phone: 303.497.8399
> > > > >> Email: jpresto at ucar.edu
> > > > >>
> > > > >>
> > > > >>
> > > > >>
> > > > >
> > > > >
> > > > > --
> > > > > Julie Prestopnik
> > > > > National Center for Atmospheric Research Research
Applications
> > > > > Laboratory
> > > > > Phone: 303.497.8399
> > > > > Email: jpresto at ucar.edu
> > > > >
> > > >
> > > >
> > > >
> > > > --
> > > > Julie Prestopnik
> > > > National Center for Atmospheric Research Research Applications
> > > > Laboratory
> > > > Phone: 303.497.8399
> > > > Email: jpresto at ucar.edu
> > > >
> > > >
> > > >
> > > >
> > >
> > >
> > >
> > >
> >
> >
> >
> >
>
>
>
>
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #72945] Point Stat, GriB and NetCDF confusion
From: SITTEL, MATTHEW C CTR USAF AFWA 16 WS/WXN
Time: Wed Aug 19 14:35:29 2015
Thanks again John-we found a work around using IDL. Better than
nothing, and far from elegant, but it does work. I had no idea IDL
had built in routines to read IDL. Bob Craig helped me on that.
I do appreciate your efforts just the same!
Matt
-----Original Message-----
From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
Sent: Wednesday, August 19, 2015 3:10 PM
To: SITTEL, MATTHEW C CTR USAF AFMC AFLCMC/HBAW-OL
Subject: Re: [rt.rap.ucar.edu #72945] Point Stat, GriB and NetCDF
confusion
Matt,
Sorry I don't have a better solution for you.
I did finished updating the gspairs2mpr.R script to write complete MPR
lines. The output file can then be read into STAT-Analysis for
additional subsetting and to convert the MPR data into whatever output
statistic type you'd like.
For example, call STAT-Analysis compute continuous statistics, but
only for latitudes between 30 and 35 degrees where the observation
value is at least
0.1:
stat_analysis -lookin mpr.txt \
-job aggregate_stat -line_type MPR -out_line_type CNT -by VX_MASK
-n_boot_rep 0 \
-column_min OBS_LAT 30 -column_max OBS_LAT 35 -column_min OBS
0.01
The updated version of that script is attached. If you're somehow
able to get access to R, it would do the trick for you. If not, it
just depends on what scripting tools are available to you.
John
On Wed, Aug 19, 2015 at 11:37 AM, SITTEL, MATTHEW C CTR USAF AFWA 16
WS/WXN via RT <met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=72945 >
>
> Thanks John.
>
> I don't think R has ever been installed on our development system.
I
> doubt I can do this myself given our lack of control of anything on
> our systems. So I'm not sure I'll be able to use this. I'm running
> out of ideas.
>
> Matt
>
> -----Original Message-----
> From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> Sent: Wednesday, August 19, 2015 11:08 AM
> To: SITTEL, MATTHEW C CTR USAF AFMC AFLCMC/HBAW-OL
> Subject: Re: [rt.rap.ucar.edu #72945] Point Stat, GriB and NetCDF
> confusion
>
> Matt,
>
> I've attached an Rscript that will hopefully do the trick for you.
> It's named "gspairs2mpr.R"... although it doesn't actually write a
> full MPR line as Point-Stat does yet - just lat, lon, fcst, and obs
> values. I've also attached a sample NetCDF output file. Here's how
you run it:
>
> Rscript gspairs2mpr.R
> grid_stat_APCP_24_240000L_20050808_000000V_pairs.nc
>
> By default, it'll write an output file named "mpr.txt" but you can
> override that with the "-out" option. Run this to see the usage:
> Rscript gspairs2mpr.R
>
> Please give this a shot and let me know how it goes. It's currently
> writing space separated output but could easily write csv instead.
>
> John
>
> On Wed, Aug 19, 2015 at 6:47 AM, SITTEL, MATTHEW C CTR USAF AFWA 16
> WS/WXN via RT <met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=72945 >
> >
> > Thanks John. I wrote one to format our binary data to the ASCII
> > format required for ingestion by MET, but NetCDF is one I'm less
> familiar with.
> >
> > All I need is simply lat, lon, model value, obs value (and just
the
> > non-missing ones). Unless MET accepts the matched pairs in NetCDF
> > such that I can manipulate them (e.g., latitude band subsetting).
> >
> > Matt
> >
> > -----Original Message-----
> > From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> > Sent: Tuesday, August 18, 2015 4:54 PM
> > To: SITTEL, MATTHEW C CTR USAF AFMC AFLCMC/HBAW-OL
> > Subject: Re: [rt.rap.ucar.edu #72945] Point Stat, GriB and NetCDF
> > confusion
> >
> > Matt,
> >
> > I was working on a quick Rscript to dump the pairs from the NetCDF
> > matched pairs file to ascii, but wasn't able to finish it today.
> > I'll take a look tomorrow and get back to you.
> >
> > John
> >
> > On Tue, Aug 18, 2015 at 8:48 AM, SITTEL, MATTHEW C CTR USAF AFWA
16
> > WS/WXN via RT <met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=72945 >
> > >
> > > Hi John,
> > >
> > > Thanks for your help. I got it to work with grid_stat. I
didn't
> > > even see the oddity with the grid. But thanks to copygb I got
> > > everything to match up.
> > >
> > > The reason I was using point_stat, or trying to, was because I
> > > want the model-obs pairs from the grid stat run in a format
easily
> > > imported by Excel. Is there a way to do that with grid_stat?
> > > What I ideally want is the matched pair ("MPR") format from
> > > point_stat but have it generated from grid_stat. Otherwise I
have
> > > to figure out a method to convert NetCDF to ASCII, something I
> > > have zero
> experience with.
> > >
> > > Any advice on the above? I would sure appreciate it!
> > >
> > > Matt
> > >
> > > -----Original Message-----
> > > From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> > > Sent: Monday, August 17, 2015 12:39 PM
> > > To: SITTEL, MATTHEW C CTR USAF AFMC AFLCMC/HBAW-OL
> > > Subject: Re: [rt.rap.ucar.edu #72945] Point Stat, GriB and
NetCDF
> > > confusion
> > >
> > > Hello Matt,
> > >
> > > This is John Halley Gotway. I was out of the office last week,
> > > but hopefully we can get to the bottom of this now.
> > >
> > > I retrieved the data you sent to use from our anonymous ftp
site.
> > > I see that it's the NetCDF output of the pcp-combine tool (
> > > NCEP.20150731_00_24h_8km_sum.nc), a GRIB1 file
> > > (LIS.GLOBAL.00.24.TP.9999), and a Point-Stat configuration file
> > > (lis_ST4_point_stat.cfg.default). I believe the problem here is
> > > that you're running the wrong tool. Point-Stat is used to
compare
> > > a gridded forecast to the point observations. However, both
your
> > > forecast and observation data are gridded. You should be
running
> > > this data through the Grid-Stat tool to compute traditional and
> > > neighborhood
> > statistics.
> > >
> > > I ran the following commands with your data and attached some
output:
> > >
> > > # Plot the LIS data, convert to png, and attached output
> > > METv4.1/bin/plot_data_plane LIS.GLOBAL.00.24.TP.9999
> > > LIS.GLOBAL.00.24.TP.9999.ps 'name="APCP"; level="A24"; convert
> > > -rotate
> > > 90 -background white -flatten LIS.GLOBAL.00.24.TP.9999.ps
> > > LIS.GLOBAL.00.24.TP.9999.png
> > >
> > > # Plot the pcp_combine output, convert to png, and attached
output
> > > METv4.1/bin/plot_data_plane NCEP.20150731_00_24h_8km_sum.nc
> > > NCEP.20150731_00_24h_8km_sum.ps 'name="APCP_24"; level="(*,*)";'
> > > convert -rotate 90 -background white -flatten
> > > NCEP.20150731_00_24h_8km_sum.ps NCEP.20150731_00_24h_8km_sum.png
> > >
> > > # Run these through grid-stat, configuration file attached
> > > METv4.1/bin/grid_stat LIS.GLOBAL.00.24.TP.9999
> > > NCEP.20150731_00_24h_8km_sum.nc lis_ST4_grid_stat.cfg.default
> > > -outdir out -v 4
> > >
> > > When I run this Grid-Stat command, I get the following error:
> > >
> > > process_command_line() -> The forecast and observation grids do
> > > not
> > match:
> > > Projection: Lat/Lon Nx: 1440 Ny: 600 lat_ll: -59.875 lon_ll:
> > > 179.875
> > > delta_lat: 0.250 delta_lon: 0.250 != Projection: Lat/Lon Nx: 720
Ny:
> > > 360
> > > lat_ll: -89.750 lon_ll: -0.250 delta_lat: 0.500 delta_lon: 0.500
> > >
> > >
> > > This is telling you that these files aren't on the same grid.
It
> > > looks like you've already regridded the Stage4 data to a global
> > > 1/2
> > degree grid.
> > > Presumably, you used copygb to do that. You just need to edit
> > > your calls to copygb to put it on the 1/4 degree global grid
that
> > > LIS is
> > using.
> > >
> > > Hope that helps.
> > >
> > > Thanks,
> > > John
> > >
> > >
> > > On Thu, Aug 13, 2015 at 10:58 AM, SITTEL, MATTHEW C CTR USAF
AFWA
> > > 16 WS/WXN via RT <met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=72945
>
> > > >
> > > > Okay-I'm off tomorrow anyway so it's fine. Thanks for all
your
> > efforts!
> > > > Have a great weekend.
> > > >
> > > > Matt
> > > >
> > > > -----Original Message-----
> > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > Sent: Thursday, August 13, 2015 11:11 AM
> > > > To: SITTEL, MATTHEW C CTR USAF AFMC AFLCMC/HBAW-OL
> > > > Subject: Re: [rt.rap.ucar.edu #72945] Point Stat, GriB and
> > > > NetCDF confusion
> > > >
> > > > Hi Matt. Some of our team is on vacation and won't be back
> > > > until next week, as opposed to later this week. We'll keep
> > > > working on a solution and will let you know as soon as we have
one.
> > > >
> > > > Thanks for your patience.
> > > >
> > > > Julie
> > > >
> > > > On Wed, Aug 12, 2015 at 3:13 PM, Julie Prestopnik
> > > > <jpresto at ucar.edu>
> > > > wrote:
> > > >
> > > > > Hi Matt. I received your files. Unfortunately, I do not
yet
> > > > > have a solution for you. We are working on the problem and
> > > > > hope to get back to you later this week.
> > > > >
> > > > > Julie
> > > > >
> > > > > On Wed, Aug 12, 2015 at 2:29 PM, SITTEL, MATTHEW C CTR USAF
> > > > > AFWA
> > > > > 16 WS/WXN via RT <met_help at ucar.edu> wrote:
> > > > >
> > > > >>
> > > > >> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=72945
> > > > >> >
> > > > >>
> > > > >> Hi Julie,
> > > > >>
> > > > >> Hopefully the files I pushed yesterday afternoon made it
> > > > >> without incident. I have tried some other things today
like
> > > > >> modifying the GriB table but I still haven't found a
solution.
> > > > >>
> > > > >> If you need anything else from me that would help you,
please
> > > > >> let me
> > > > know.
> > > > >>
> > > > >> Thanks,
> > > > >> Matt
> > > > >>
> > > > >> -----Original Message-----
> > > > >> From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > >> Sent: Tuesday, August 11, 2015 3:26 PM
> > > > >> To: SITTEL, MATTHEW C CTR USAF AFMC AFLCMC/HBAW-OL
> > > > >> Subject: Re: [rt.rap.ucar.edu #72945] Point Stat, GriB and
> > > > >> NetCDF confusion
> > > > >>
> > > > >> Hi Matt.
> > > > >>
> > > > >> I think what might be going on here is that you may need to
> > > > >> specify the information for the observation field as if it
> > > > >> was in a GRIB file. I know this sounds confusing, but it
is
> > > > >> a bit of legacy behavior. Try replacing this with what you
> > > > >> currently have for "obs" in
> > > > your configuration file:
> > > > >>
> > > > >> obs = {
> > > > >> wind_thresh = [ NA ];
> > > > >> message_type = [ "ADPSFC" ];
> > > > >> field = [
> > > > >> {
> > > > >> name = "APCP";
> > > > >> level = [ "A24" ];
> > > > >> cat_thresh = [ >=0.0 ];
> > > > >> }
> > > > >> ];
> > > > >> };
> > > > >>
> > > > >> If you still have trouble, could you please upload your
data
> > > > >> and config file to our FTP site using the instructions
here:
> > > > >>
> > > > >> http://www.dtcenter.org/met/users/support/met_help.php#ftp
> > > > >>
> > > > >> Then, I can take a closer look.
> > > > >>
> > > > >> Thanks,
> > > > >> Julie
> > > > >>
> > > > >> On Tue, Aug 11, 2015 at 2:00 PM, SITTEL, MATTHEW C CTR USAF
> > > > >> AFWA
> > > > >> 16 WS/WXN via RT <met_help at ucar.edu> wrote:
> > > > >>
> > > > >> >
> > > > >> > Tue Aug 11 14:00:29 2015: Request 72945 was acted upon.
> > > > >> > Transaction: Ticket created by
matthew.sittel.ctr at us.af.mil
> > > > >> > Queue: met_help
> > > > >> > Subject: Point Stat, GriB and NetCDF confusion
> > > > >> > Owner: Nobody
> > > > >> > Requestors: matthew.sittel.ctr at us.af.mil
> > > > >> > Status: new
> > > > >> > Ticket <URL:
> > > > >> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=72945
> > > > >> > >
> > > > >> >
> > > > >> >
> > > > >> > Hi,
> > > > >> >
> > > > >> > I'm trying to run point_stat with the following:
> > > > >> >
> > > > >> > Forecast is a single GriB 1 precipitation field (APCP).
> > > > >> > Observations are the sum of 24 Stage IV Precipitation
> > > > >> > Analyses, all
> > > > >> > 1 hourly amounts in NetCDF. They were summed using
pcp_combine.
> > > > >> > The resulting summation file has the variable name
'APCP_24'.
> > > > >> >
> > > > >> > I set in my point_stat config file the following:
> > > > >> >
> > > > >> > fcst = {
> > > > >> > wind_thresh = [ NA ];
> > > > >> >
> > > > >> > field = [
> > > > >> > {
> > > > >> > name = "APCP";
> > > > >> > level = "L0";
> > > > >> > cat_thresh = [ >=0.0 ];
> > > > >> > }
> > > > >> > ];
> > > > >> >
> > > > >> > };
> > > > >> >
> > > > >> > obs = {
> > > > >> > field = [
> > > > >> > {
> > > > >> > name = "APCP_24";
> > > > >> > level = "A24";
> > > > >> > cat_thresh = [ >=0.0 ];
> > > > >> > }
> > > > >> > ];
> > > > >> > };
> > > > >> >
> > > > >> > But I get the following error:
> > > > >> >
> > > > >> > ERROR : VarInfoGrib::set_dict() - unrecognized GRIB1
field
> > > > >> > abbreviation 'APCP_24' for table version 2
> > > > >> >
> > > > >> > I realize APCP_24 isn't in the GriB 1 table, but the
> > > > >> > variable name comes from pcp_combine so I don't think I
> > > > >> > have power to change
> > > it.
> > > > >> >
> > > > >> > Can I only run point_stat if both model and obs are
called
> "APCP"
> > > > >> > in
> > > > >> their
> > > > >> > respective files? If they can be different, how do I
handle
> it?
> > > > >> >
> > > > >> > More information which may be helpful:
> > > > >> >
> > > > >> > GriB header for my forecast data:
> > > > >> >
> > > > >> > rec 1:0:date 2015073100 APCP kpds5=61 kpds6=1 kpds7=0
> > > > >> > levels=(0,0)
> > > > >> > grid=255 sfc 24-0hr fcst:ave at 1yr: bitmap: 624213 undef
> > > > >> > APCP=Total precipitation [kg/m^2]
> > > > >> > timerange 133 P1 24 P2 0 TimeU 1 nx 1440 ny 600 GDS
grid
> > > > >> > 0 num_in_ave 0 missing 0
> > > > >> > center 57 subcenter 2 process 89 Table 128 scan: WE:SN
> > winds(N/S)
> > > > >> > latlon: lat -59.875000 to 89.875000 by 0.250000 nxny
864000
> > > > >> > long -179.875000 to 179.875000 by 0.250000,
(1440
> > > > >> > x
> > > > >> > 600) scan 64 mode 128 bdsgrid 1
> > > > >> > min/max data 0 220 num bits 15 BDS_Ref 0 DecScale 2
> > > > >> > BinScale
> > > > >> > 0
> > > > >> >
> > > > >> > NetCDF header for my observation data:
> > > > >> >
> > > > >> > netcdf NCEP.20150731_00_24h_8km_sum {
> > > > >> > dimensions:
> > > > >> > lat = 360 ;
> > > > >> > lon = 720 ;
> > > > >> > variables:
> > > > >> > float lat(lat, lon) ;
> > > > >> > lat:long_name = "latitude" ;
> > > > >> > lat:units = "degrees_north" ;
> > > > >> > lat:standard_name = "latitude" ;
> > > > >> > float lon(lat, lon) ;
> > > > >> > lon:long_name = "longitude" ;
> > > > >> > lon:units = "degrees_east" ;
> > > > >> > lon:standard_name = "longitude" ;
> > > > >> > float APCP_24(lat, lon) ;
> > > > >> > APCP_24:name = "APCP_24" ;
> > > > >> > APCP_24:long_name = "Total precipitation"
;
> > > > >> > APCP_24:level = "A24" ;
> > > > >> > APCP_24:units = "kg/m^2" ;
> > > > >> > APCP_24:_FillValue = -9999.f ;
> > > > >> > APCP_24:init_time = "20150731_000000" ;
> > > > >> > APCP_24:init_time_ut = 1438300800 ;
> > > > >> > APCP_24:valid_time = "20150731_000000" ;
> > > > >> > APCP_24:valid_time_ut = 1438300800 ;
> > > > >> > APCP_24:accum_time = "240000" ;
> > > > >> > APCP_24:accum_time_sec = 86400 ;
> > > > >> >
> > > > >> > // global attributes:
> > > > >> > :FileOrigins = "File
> > > > >> > /h/data/global/WXQC/data/met/lis/
> > > > >> > NCEP.20150731_00_24h_8km_sum.nc generated 20150811_195735
> > > > >> > UTC on host
> > > > >> > dev8dlsn1 by the MET pcp_combine tool" ;
> > > > >> > :MET_version = "V4.1" ;
> > > > >> > :MET_tool = "pcp_combine" ;
> > > > >> > :RunCommand = "Sum: 24 files with
> > > > >> > accumulations of 010000." ;
> > > > >> > :Projection = "LatLon" ;
> > > > >> > :lat_ll = "-89.750000 degrees_north" ;
> > > > >> > :lon_ll = "0.250000 degrees_east" ;
> > > > >> > :delta_lat = "0.500000 degrees" ;
> > > > >> > :delta_lon = "0.500000 degrees" ;
> > > > >> > :Nlat = "360 grid_points" ;
> > > > >> > :Nlon = "720 grid_points" ;
> > > > >> >
> > > > >> > Thanks,
> > > > >> > Matt
> > > > >> >
> > > > >> > // SIGNED //
> > > > >> > Matthew C. Sittel
> > > > >> > University Corporation for Atmospheric Research
> > > > >> > 16 WS/WXN, 557 WW, Offutt AFB, NE
> > > > >> > matthew.sittel.ctr at us.af.mil
> > > > >> >
> > > > >> >
> > > > >> >
> > > > >> >
> > > > >> >
> > > > >>
> > > > >>
> > > > >> --
> > > > >> Julie Prestopnik
> > > > >> National Center for Atmospheric Research Research
> > > > >> Applications Laboratory
> > > > >> Phone: 303.497.8399
> > > > >> Email: jpresto at ucar.edu
> > > > >>
> > > > >>
> > > > >>
> > > > >>
> > > > >
> > > > >
> > > > > --
> > > > > Julie Prestopnik
> > > > > National Center for Atmospheric Research Research
Applications
> > > > > Laboratory
> > > > > Phone: 303.497.8399
> > > > > Email: jpresto at ucar.edu
> > > > >
> > > >
> > > >
> > > >
> > > > --
> > > > Julie Prestopnik
> > > > National Center for Atmospheric Research Research Applications
> > > > Laboratory
> > > > Phone: 303.497.8399
> > > > Email: jpresto at ucar.edu
> > > >
> > > >
> > > >
> > > >
> > >
> > >
> > >
> > >
> >
> >
> >
> >
>
>
>
>
------------------------------------------------
More information about the Met_help
mailing list