[Met_help] [rt.rap.ucar.edu #82121] History for trouble with reading a grib file in point_stat
John Halley Gotway via RT
met_help at ucar.edu
Tue Oct 10 12:54:07 MDT 2017
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Hi,
I'm trying to use point_stat to obtain matches between ASCAT and our
oceanic grid Grib2 file. I had to first convert our oceanic grid to a
netCDF file, because of the way the is written originally. If you plot the
file with python straight from the grib2 file, the data is plotted the
wrong way around the globe, plotting the data on land instead of the
ocean. It doesn't do that when the data is plotted in GrADS. The lat/lons
are interpreted the correct way.
Anyway, I used this with command when I converted it to netCDF:
wgrib2 20170920_1655_ndfd_oceanic_2017092016.grb2 -match ':WIND:' -netcdf
20170920_1655_ndfd_oceanic_2017092016_WIND.nc
The attached plot is a python plot reading in the netCDF file, so, now it
is on the correct lat/lon grid. But, when I use point_stat, I get this:
/opt/MET6/met6.0/bin/point_stat
/opc_test/home/opc_test/data/met_verif/test_fcst_grids_to_nc/20170911_0455_ndfd_oceanic_2017091104_WIND.nc
/opc_test/home/opc_test/data/met_verif/GFS/data/hourly/2017091106/
uv_wind_pb_2017091106_07.nc
/opc_test/home/opc_test/data/met_verif/test_fcst_grids_to_nc/PointStatConfig_FCST_GRID_mask
-outdir /opc_test/home/opc_test/data/met_verif/test_fcst_grids_to_nc/ -v 4
DEBUG 1: Default Config File:
/opt/MET6/met6.0/share/met/config/PointStatConfig_default
DEBUG 1: User Config File:
/opc_test/home/opc_test/data/met_verif/test_fcst_grids_to_nc/PointStatConfig_FCST_GRID_mask
DEBUG 4: Met2dDataFileFactory::new_met_2d_data_file() -> created new
Met2dDataFile object of type "FileType_None".
ERROR :
ERROR : Trouble reading forecast file
"/opc_test/home/opc_test/data/met_verif/test_fcst_grids_to_nc/20170911_0455_ndfd_oceanic_2017091104_WIND.nc"
ERROR :
And, I think the problem is, that the missing values are denoted as "_", as
seen by part of the ncdump of the variable (WIND_surface) field:
_, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _,
_, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _,
_, _, _, _, 2.1, 2.1, 2.1, 2.1, 2.1, 1.5, 1.5, 1.5, 1.5, 1.5, 1.5, 1.5,
1.5, 1.5, 1.5, 2.1, 2.1, 2.1, 2.1, 2.1, 2.1, 2.1, 2.6, 2.6, 2.6, 2.6,
2.6, 2.6, 2.6, 3.1, 3.1, 3.1, 3.1, 3.1, 3.1, 3.1, 3.1, 3.1, 3.6, 3.6,
even though the missing field is:
WIND_surface:_FillValue = 9.999e+20f ;
So, any ideas on how to deal with the original grib2 file so I can use
point stat? Thanks in advance!
Roz
--
Rosalyn MacCracken
Support Scientist
Ocean Applilcations Branch
NOAA/NWS Ocean Prediction Center
NCWCP
5830 University Research Ct
College Park, MD 20740-3818
(p) 301-683-1551
rosalyn.maccracken at noaa.gov
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: trouble with reading a grib file in point_stat
From: John Halley Gotway
Time: Tue Sep 26 13:52:14 2017
Hello Roz,
Can you please send me the original GRIB2 file and I'll take a look?
Or just point me to sample file somewhere on the web?
You can post it to our anonymous ftp site following these
instructions:
http://www.dtcenter.org/met/users/support/met_help.php#ftp
Thanks,
John
On Tue, Sep 26, 2017 at 10:18 AM, Rosalyn MacCracken - NOAA Affiliate
via
RT <met_help at ucar.edu> wrote:
>
> Tue Sep 26 10:18:14 2017: Request 82121 was acted upon.
> Transaction: Ticket created by rosalyn.maccracken at noaa.gov
> Queue: met_help
> Subject: trouble with reading a grib file in point_stat
> Owner: Nobody
> Requestors: rosalyn.maccracken at noaa.gov
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82121 >
>
>
> Hi,
>
> I'm trying to use point_stat to obtain matches between ASCAT and our
> oceanic grid Grib2 file. I had to first convert our oceanic grid to
a
> netCDF file, because of the way the is written originally. If you
plot the
> file with python straight from the grib2 file, the data is plotted
the
> wrong way around the globe, plotting the data on land instead of the
> ocean. It doesn't do that when the data is plotted in GrADS. The
lat/lons
> are interpreted the correct way.
>
> Anyway, I used this with command when I converted it to netCDF:
> wgrib2 20170920_1655_ndfd_oceanic_2017092016.grb2 -match ':WIND:'
-netcdf
> 20170920_1655_ndfd_oceanic_2017092016_WIND.nc
>
> The attached plot is a python plot reading in the netCDF file, so,
now it
> is on the correct lat/lon grid. But, when I use point_stat, I get
this:
>
> /opt/MET6/met6.0/bin/point_stat
> /opc_test/home/opc_test/data/met_verif/test_fcst_grids_to_
> nc/20170911_0455_ndfd_oceanic_2017091104_WIND.nc
> /opc_test/home/opc_test/data/met_verif/GFS/data/hourly/2017091106/
> uv_wind_pb_2017091106_07.nc
> /opc_test/home/opc_test/data/met_verif/test_fcst_grids_to_
> nc/PointStatConfig_FCST_GRID_mask
> -outdir
/opc_test/home/opc_test/data/met_verif/test_fcst_grids_to_nc/ -v 4
> DEBUG 1: Default Config File:
> /opt/MET6/met6.0/share/met/config/PointStatConfig_default
> DEBUG 1: User Config File:
> /opc_test/home/opc_test/data/met_verif/test_fcst_grids_to_
> nc/PointStatConfig_FCST_GRID_mask
> DEBUG 4: Met2dDataFileFactory::new_met_2d_data_file() -> created new
> Met2dDataFile object of type "FileType_None".
> ERROR :
> ERROR : Trouble reading forecast file
> "/opc_test/home/opc_test/data/met_verif/test_fcst_grids_to_
> nc/20170911_0455_ndfd_oceanic_2017091104_WIND.nc"
> ERROR :
>
> And, I think the problem is, that the missing values are denoted as
"_", as
> seen by part of the ncdump of the variable (WIND_surface) field:
>
> _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _,
_, _,
> _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _,
_, _, _,
> _, _, _, _, 2.1, 2.1, 2.1, 2.1, 2.1, 1.5, 1.5, 1.5, 1.5, 1.5,
1.5, 1.5,
> 1.5, 1.5, 1.5, 2.1, 2.1, 2.1, 2.1, 2.1, 2.1, 2.1, 2.6, 2.6, 2.6,
2.6,
> 2.6, 2.6, 2.6, 3.1, 3.1, 3.1, 3.1, 3.1, 3.1, 3.1, 3.1, 3.1, 3.6,
3.6,
>
> even though the missing field is:
> WIND_surface:_FillValue = 9.999e+20f ;
>
> So, any ideas on how to deal with the original grib2 file so I can
use
> point stat? Thanks in advance!
>
> Roz
>
>
>
> --
> Rosalyn MacCracken
> Support Scientist
>
> Ocean Applilcations Branch
> NOAA/NWS Ocean Prediction Center
> NCWCP
> 5830 University Research Ct
> College Park, MD 20740-3818
>
> (p) 301-683-1551
> rosalyn.maccracken at noaa.gov
>
>
------------------------------------------------
Subject: trouble with reading a grib file in point_stat
From: Rosalyn MacCracken - NOAA Affiliate
Time: Tue Sep 26 14:55:34 2017
Hi John,
I'll have to send it tomorrow. I've already "left" and logged off for
the
day.
Roz
On Tue, Sep 26, 2017 at 3:52 PM, John Halley Gotway via RT <
met_help at ucar.edu> wrote:
> Hello Roz,
>
> Can you please send me the original GRIB2 file and I'll take a look?
>
> Or just point me to sample file somewhere on the web?
>
> You can post it to our anonymous ftp site following these
instructions:
> http://www.dtcenter.org/met/users/support/met_help.php#ftp
>
> Thanks,
> John
>
> On Tue, Sep 26, 2017 at 10:18 AM, Rosalyn MacCracken - NOAA
Affiliate via
> RT <met_help at ucar.edu> wrote:
>
> >
> > Tue Sep 26 10:18:14 2017: Request 82121 was acted upon.
> > Transaction: Ticket created by rosalyn.maccracken at noaa.gov
> > Queue: met_help
> > Subject: trouble with reading a grib file in point_stat
> > Owner: Nobody
> > Requestors: rosalyn.maccracken at noaa.gov
> > Status: new
> > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82121 >
> >
> >
> > Hi,
> >
> > I'm trying to use point_stat to obtain matches between ASCAT and
our
> > oceanic grid Grib2 file. I had to first convert our oceanic grid
to a
> > netCDF file, because of the way the is written originally. If you
plot
> the
> > file with python straight from the grib2 file, the data is plotted
the
> > wrong way around the globe, plotting the data on land instead of
the
> > ocean. It doesn't do that when the data is plotted in GrADS. The
> lat/lons
> > are interpreted the correct way.
> >
> > Anyway, I used this with command when I converted it to netCDF:
> > wgrib2 20170920_1655_ndfd_oceanic_2017092016.grb2 -match ':WIND:'
> -netcdf
> > 20170920_1655_ndfd_oceanic_2017092016_WIND.nc
> >
> > The attached plot is a python plot reading in the netCDF file, so,
now it
> > is on the correct lat/lon grid. But, when I use point_stat, I get
this:
> >
> > /opt/MET6/met6.0/bin/point_stat
> > /opc_test/home/opc_test/data/met_verif/test_fcst_grids_to_
> > nc/20170911_0455_ndfd_oceanic_2017091104_WIND.nc
> > /opc_test/home/opc_test/data/met_verif/GFS/data/hourly/2017091106/
> > uv_wind_pb_2017091106_07.nc
> > /opc_test/home/opc_test/data/met_verif/test_fcst_grids_to_
> > nc/PointStatConfig_FCST_GRID_mask
> > -outdir
/opc_test/home/opc_test/data/met_verif/test_fcst_grids_to_nc/
> -v 4
> > DEBUG 1: Default Config File:
> > /opt/MET6/met6.0/share/met/config/PointStatConfig_default
> > DEBUG 1: User Config File:
> > /opc_test/home/opc_test/data/met_verif/test_fcst_grids_to_
> > nc/PointStatConfig_FCST_GRID_mask
> > DEBUG 4: Met2dDataFileFactory::new_met_2d_data_file() -> created
new
> > Met2dDataFile object of type "FileType_None".
> > ERROR :
> > ERROR : Trouble reading forecast file
> > "/opc_test/home/opc_test/data/met_verif/test_fcst_grids_to_
> > nc/20170911_0455_ndfd_oceanic_2017091104_WIND.nc"
> > ERROR :
> >
> > And, I think the problem is, that the missing values are denoted
as "_",
> as
> > seen by part of the ncdump of the variable (WIND_surface) field:
> >
> > _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _,
_, _,
> > _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _,
_, _,
> _,
> > _, _, _, _, 2.1, 2.1, 2.1, 2.1, 2.1, 1.5, 1.5, 1.5, 1.5, 1.5,
1.5,
> 1.5,
> > 1.5, 1.5, 1.5, 2.1, 2.1, 2.1, 2.1, 2.1, 2.1, 2.1, 2.6, 2.6,
2.6, 2.6,
> > 2.6, 2.6, 2.6, 3.1, 3.1, 3.1, 3.1, 3.1, 3.1, 3.1, 3.1, 3.1,
3.6, 3.6,
> >
> > even though the missing field is:
> > WIND_surface:_FillValue = 9.999e+20f ;
> >
> > So, any ideas on how to deal with the original grib2 file so I can
use
> > point stat? Thanks in advance!
> >
> > Roz
> >
> >
> >
> > --
> > Rosalyn MacCracken
> > Support Scientist
> >
> > Ocean Applilcations Branch
> > NOAA/NWS Ocean Prediction Center
> > NCWCP
> > 5830 University Research Ct
> > College Park, MD 20740-3818
> >
> > (p) 301-683-1551
> > rosalyn.maccracken at noaa.gov
> >
> >
>
>
--
Rosalyn MacCracken
Support Scientist
Ocean Applilcations Branch
NOAA/NWS Ocean Prediction Center
NCWCP
5830 University Research Ct
College Park, MD 20740-3818
(p) 301-683-1551
rosalyn.maccracken at noaa.gov
------------------------------------------------
Subject: trouble with reading a grib file in point_stat
From: Rosalyn MacCracken - NOAA Affiliate
Time: Wed Sep 27 12:29:27 2017
Hi John,
I've put the oceanic grid file (Grib2) and the ASCAT netCDF file in my
ftp
directory (maccracken_data). I'm attaching the config file I'm using.
So,
for the Grib2 file, it was created at 10z, but, I'm actually matching
up
the lead=2 time period (12z), with the 12z ASCAT data.
Hopefully, it'll be an easy fix. :-)
Roz
On Tue, Sep 26, 2017 at 4:55 PM, Rosalyn MacCracken - NOAA Affiliate <
rosalyn.maccracken at noaa.gov> wrote:
> Hi John,
>
> I'll have to send it tomorrow. I've already "left" and logged off
for the
> day.
>
> Roz
>
> On Tue, Sep 26, 2017 at 3:52 PM, John Halley Gotway via RT <
> met_help at ucar.edu> wrote:
>
>> Hello Roz,
>>
>> Can you please send me the original GRIB2 file and I'll take a
look?
>>
>> Or just point me to sample file somewhere on the web?
>>
>> You can post it to our anonymous ftp site following these
instructions:
>> http://www.dtcenter.org/met/users/support/met_help.php#ftp
>>
>> Thanks,
>> John
>>
>> On Tue, Sep 26, 2017 at 10:18 AM, Rosalyn MacCracken - NOAA
Affiliate via
>> RT <met_help at ucar.edu> wrote:
>>
>> >
>> > Tue Sep 26 10:18:14 2017: Request 82121 was acted upon.
>> > Transaction: Ticket created by rosalyn.maccracken at noaa.gov
>> > Queue: met_help
>> > Subject: trouble with reading a grib file in point_stat
>> > Owner: Nobody
>> > Requestors: rosalyn.maccracken at noaa.gov
>> > Status: new
>> > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82121 >
>> >
>> >
>> > Hi,
>> >
>> > I'm trying to use point_stat to obtain matches between ASCAT and
our
>> > oceanic grid Grib2 file. I had to first convert our oceanic grid
to a
>> > netCDF file, because of the way the is written originally. If
you plot
>> the
>> > file with python straight from the grib2 file, the data is
plotted the
>> > wrong way around the globe, plotting the data on land instead of
the
>> > ocean. It doesn't do that when the data is plotted in GrADS.
The
>> lat/lons
>> > are interpreted the correct way.
>> >
>> > Anyway, I used this with command when I converted it to netCDF:
>> > wgrib2 20170920_1655_ndfd_oceanic_2017092016.grb2 -match ':WIND:'
>> -netcdf
>> > 20170920_1655_ndfd_oceanic_2017092016_WIND.nc
>> >
>> > The attached plot is a python plot reading in the netCDF file,
so, now
>> it
>> > is on the correct lat/lon grid. But, when I use point_stat, I
get this:
>> >
>> > /opt/MET6/met6.0/bin/point_stat
>> > /opc_test/home/opc_test/data/met_verif/test_fcst_grids_to_
>> > nc/20170911_0455_ndfd_oceanic_2017091104 <(201)%20709-
1104>_WIND.nc
>> > /opc_test/home/opc_test/data/met_verif/GFS/data/hourly/2017091106
>> <(201)%20709-1106>/
>> > uv_wind_pb_2017091106_07.nc
>> > /opc_test/home/opc_test/data/met_verif/test_fcst_grids_to_
>> > nc/PointStatConfig_FCST_GRID_mask
>> > -outdir
/opc_test/home/opc_test/data/met_verif/test_fcst_grids_to_nc/
>> -v 4
>> > DEBUG 1: Default Config File:
>> > /opt/MET6/met6.0/share/met/config/PointStatConfig_default
>> > DEBUG 1: User Config File:
>> > /opc_test/home/opc_test/data/met_verif/test_fcst_grids_to_
>> > nc/PointStatConfig_FCST_GRID_mask
>> > DEBUG 4: Met2dDataFileFactory::new_met_2d_data_file() -> created
new
>> > Met2dDataFile object of type "FileType_None".
>> > ERROR :
>> > ERROR : Trouble reading forecast file
>> > "/opc_test/home/opc_test/data/met_verif/test_fcst_grids_to_
>> > nc/20170911_0455_ndfd_oceanic_2017091104 <(201)%20709-
1104>_WIND.nc"
>> > ERROR :
>> >
>> > And, I think the problem is, that the missing values are denoted
as
>> "_", as
>> > seen by part of the ncdump of the variable (WIND_surface) field:
>> >
>> > _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _,
_, _, _,
>> > _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _,
_, _,
>> _, _,
>> > _, _, _, _, 2.1, 2.1, 2.1, 2.1, 2.1, 1.5, 1.5, 1.5, 1.5, 1.5,
1.5,
>> 1.5,
>> > 1.5, 1.5, 1.5, 2.1, 2.1, 2.1, 2.1, 2.1, 2.1, 2.1, 2.6, 2.6,
2.6,
>> 2.6,
>> > 2.6, 2.6, 2.6, 3.1, 3.1, 3.1, 3.1, 3.1, 3.1, 3.1, 3.1, 3.1,
3.6,
>> 3.6,
>> >
>> > even though the missing field is:
>> > WIND_surface:_FillValue = 9.999e+20f ;
>> >
>> > So, any ideas on how to deal with the original grib2 file so I
can use
>> > point stat? Thanks in advance!
>> >
>> > Roz
>> >
>> >
>> >
>> > --
>> > Rosalyn MacCracken
>> > Support Scientist
>> >
>> > Ocean Applilcations Branch
>> > NOAA/NWS Ocean Prediction Center
>> > NCWCP
>> > 5830 University Research Ct
>> > College Park, MD 20740-3818
>> >
>> > (p) 301-683-1551 <(301)%20683-1551>
>> > rosalyn.maccracken at noaa.gov
>> >
>> >
>>
>>
>
>
> --
> Rosalyn MacCracken
> Support Scientist
>
> Ocean Applilcations Branch
> NOAA/NWS Ocean Prediction Center
> NCWCP
> 5830 University Research Ct
> College Park, MD 20740-3818
>
> (p) 301-683-1551 <(301)%20683-1551>
> rosalyn.maccracken at noaa.gov
>
--
Rosalyn MacCracken
Support Scientist
Ocean Applilcations Branch
NOAA/NWS Ocean Prediction Center
NCWCP
5830 University Research Ct
College Park, MD 20740-3818
(p) 301-683-1551
rosalyn.maccracken at noaa.gov
------------------------------------------------
Subject: trouble with reading a grib file in point_stat
From: John Halley Gotway
Time: Wed Sep 27 12:41:40 2017
Roz,
OK, I just ran the following MET plot_data_plane command to plot the
2-hour
forecast of WIND (wind speed) from the GRIB2 file you sent:
met-6.0/bin/plot_data_plane \
20170911_1055_ndfd_oceanic_2017091110.grb2 \
wind_f02.ps \
'name="WIND"; level="Z0"; lead_time="02";' -v 3
Running at verbosity level 3 tells me that it's correctly plotting
record
number 100.
The resulting image is attached.
This looks like very reasonable data to me. There are real data
values
over Alaska and in the oceans surrounding, real values over Hawaii,
CONUS,
and some portions of the Atlantic and Pacific oceans. Everywhere else
contains a bad data value.
Do you see a problem in this data? If so, can you clarify what it is?
Thanks,
John
On Wed, Sep 27, 2017 at 12:29 PM, Rosalyn MacCracken - NOAA Affiliate
via
RT <met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82121 >
>
> Hi John,
>
> I've put the oceanic grid file (Grib2) and the ASCAT netCDF file in
my ftp
> directory (maccracken_data). I'm attaching the config file I'm
using. So,
> for the Grib2 file, it was created at 10z, but, I'm actually
matching up
> the lead=2 time period (12z), with the 12z ASCAT data.
>
> Hopefully, it'll be an easy fix. :-)
>
> Roz
>
> On Tue, Sep 26, 2017 at 4:55 PM, Rosalyn MacCracken - NOAA Affiliate
<
> rosalyn.maccracken at noaa.gov> wrote:
>
> > Hi John,
> >
> > I'll have to send it tomorrow. I've already "left" and logged off
for
> the
> > day.
> >
> > Roz
> >
> > On Tue, Sep 26, 2017 at 3:52 PM, John Halley Gotway via RT <
> > met_help at ucar.edu> wrote:
> >
> >> Hello Roz,
> >>
> >> Can you please send me the original GRIB2 file and I'll take a
look?
> >>
> >> Or just point me to sample file somewhere on the web?
> >>
> >> You can post it to our anonymous ftp site following these
instructions:
> >> http://www.dtcenter.org/met/users/support/met_help.php#ftp
> >>
> >> Thanks,
> >> John
> >>
> >> On Tue, Sep 26, 2017 at 10:18 AM, Rosalyn MacCracken - NOAA
Affiliate
> via
> >> RT <met_help at ucar.edu> wrote:
> >>
> >> >
> >> > Tue Sep 26 10:18:14 2017: Request 82121 was acted upon.
> >> > Transaction: Ticket created by rosalyn.maccracken at noaa.gov
> >> > Queue: met_help
> >> > Subject: trouble with reading a grib file in point_stat
> >> > Owner: Nobody
> >> > Requestors: rosalyn.maccracken at noaa.gov
> >> > Status: new
> >> > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82121
> >
> >> >
> >> >
> >> > Hi,
> >> >
> >> > I'm trying to use point_stat to obtain matches between ASCAT
and our
> >> > oceanic grid Grib2 file. I had to first convert our oceanic
grid to a
> >> > netCDF file, because of the way the is written originally. If
you
> plot
> >> the
> >> > file with python straight from the grib2 file, the data is
plotted the
> >> > wrong way around the globe, plotting the data on land instead
of the
> >> > ocean. It doesn't do that when the data is plotted in GrADS.
The
> >> lat/lons
> >> > are interpreted the correct way.
> >> >
> >> > Anyway, I used this with command when I converted it to netCDF:
> >> > wgrib2 20170920_1655_ndfd_oceanic_2017092016.grb2 -match
':WIND:'
> >> -netcdf
> >> > 20170920_1655_ndfd_oceanic_2017092016_WIND.nc
> >> >
> >> > The attached plot is a python plot reading in the netCDF file,
so, now
> >> it
> >> > is on the correct lat/lon grid. But, when I use point_stat, I
get
> this:
> >> >
> >> > /opt/MET6/met6.0/bin/point_stat
> >> > /opc_test/home/opc_test/data/met_verif/test_fcst_grids_to_
> >> > nc/20170911_0455_ndfd_oceanic_2017091104 <(201)%20709-
1104>_WIND.nc
> >> >
/opc_test/home/opc_test/data/met_verif/GFS/data/hourly/2017091106
> >> <(201)%20709-1106>/
> >> > uv_wind_pb_2017091106_07.nc
> >> > /opc_test/home/opc_test/data/met_verif/test_fcst_grids_to_
> >> > nc/PointStatConfig_FCST_GRID_mask
> >> > -outdir
/opc_test/home/opc_test/data/met_verif/test_fcst_grids_to_nc/
> >> -v 4
> >> > DEBUG 1: Default Config File:
> >> > /opt/MET6/met6.0/share/met/config/PointStatConfig_default
> >> > DEBUG 1: User Config File:
> >> > /opc_test/home/opc_test/data/met_verif/test_fcst_grids_to_
> >> > nc/PointStatConfig_FCST_GRID_mask
> >> > DEBUG 4: Met2dDataFileFactory::new_met_2d_data_file() ->
created new
> >> > Met2dDataFile object of type "FileType_None".
> >> > ERROR :
> >> > ERROR : Trouble reading forecast file
> >> > "/opc_test/home/opc_test/data/met_verif/test_fcst_grids_to_
> >> > nc/20170911_0455_ndfd_oceanic_2017091104 <(201)%20709-
1104>_WIND.nc"
> >> > ERROR :
> >> >
> >> > And, I think the problem is, that the missing values are
denoted as
> >> "_", as
> >> > seen by part of the ncdump of the variable (WIND_surface)
field:
> >> >
> >> > _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _,
_, _,
> _,
> >> > _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _,
_, _,
> >> _, _,
> >> > _, _, _, _, 2.1, 2.1, 2.1, 2.1, 2.1, 1.5, 1.5, 1.5, 1.5,
1.5, 1.5,
> >> 1.5,
> >> > 1.5, 1.5, 1.5, 2.1, 2.1, 2.1, 2.1, 2.1, 2.1, 2.1, 2.6, 2.6,
2.6,
> >> 2.6,
> >> > 2.6, 2.6, 2.6, 3.1, 3.1, 3.1, 3.1, 3.1, 3.1, 3.1, 3.1, 3.1,
3.6,
> >> 3.6,
> >> >
> >> > even though the missing field is:
> >> > WIND_surface:_FillValue = 9.999e+20f ;
> >> >
> >> > So, any ideas on how to deal with the original grib2 file so I
can use
> >> > point stat? Thanks in advance!
> >> >
> >> > Roz
> >> >
> >> >
> >> >
> >> > --
> >> > Rosalyn MacCracken
> >> > Support Scientist
> >> >
> >> > Ocean Applilcations Branch
> >> > NOAA/NWS Ocean Prediction Center
> >> > NCWCP
> >> > 5830 University Research Ct
> >> > College Park, MD 20740-3818
> >> >
> >> > (p) 301-683-1551 <(301)%20683-1551>
> >> > rosalyn.maccracken at noaa.gov
> >> >
> >> >
> >>
> >>
> >
> >
> > --
> > Rosalyn MacCracken
> > Support Scientist
> >
> > Ocean Applilcations Branch
> > NOAA/NWS Ocean Prediction Center
> > NCWCP
> > 5830 University Research Ct
> > College Park, MD 20740-3818
> >
> > (p) 301-683-1551 <(301)%20683-1551>
> > rosalyn.maccracken at noaa.gov
> >
>
>
>
> --
> Rosalyn MacCracken
> Support Scientist
>
> Ocean Applilcations Branch
> NOAA/NWS Ocean Prediction Center
> NCWCP
> 5830 University Research Ct
> College Park, MD 20740-3818
>
> (p) 301-683-1551
> rosalyn.maccracken at noaa.gov
>
>
------------------------------------------------
Subject: trouble with reading a grib file in point_stat
From: Rosalyn MacCracken - NOAA Affiliate
Time: Wed Sep 27 12:53:41 2017
You're plot looks like mine. I had to make a plot of that lead time,
but,
that is correct. It's those "bad values" that the point stat is
having
trouble with, I think.
What's plot_data_plane? Is that new?
Roz
On Wed, Sep 27, 2017 at 2:41 PM, John Halley Gotway via RT <
met_help at ucar.edu> wrote:
> Roz,
>
> OK, I just ran the following MET plot_data_plane command to plot the
2-hour
> forecast of WIND (wind speed) from the GRIB2 file you sent:
>
> met-6.0/bin/plot_data_plane \
> 20170911_1055_ndfd_oceanic_2017091110.grb2 \
> wind_f02.ps \
> 'name="WIND"; level="Z0"; lead_time="02";' -v 3
>
> Running at verbosity level 3 tells me that it's correctly plotting
record
> number 100.
>
> The resulting image is attached.
>
> This looks like very reasonable data to me. There are real data
values
> over Alaska and in the oceans surrounding, real values over Hawaii,
CONUS,
> and some portions of the Atlantic and Pacific oceans. Everywhere
else
> contains a bad data value.
>
> Do you see a problem in this data? If so, can you clarify what it
is?
>
> Thanks,
> John
>
> On Wed, Sep 27, 2017 at 12:29 PM, Rosalyn MacCracken - NOAA
Affiliate via
> RT <met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82121 >
> >
> > Hi John,
> >
> > I've put the oceanic grid file (Grib2) and the ASCAT netCDF file
in my
> ftp
> > directory (maccracken_data). I'm attaching the config file I'm
using.
> So,
> > for the Grib2 file, it was created at 10z, but, I'm actually
matching up
> > the lead=2 time period (12z), with the 12z ASCAT data.
> >
> > Hopefully, it'll be an easy fix. :-)
> >
> > Roz
> >
> > On Tue, Sep 26, 2017 at 4:55 PM, Rosalyn MacCracken - NOAA
Affiliate <
> > rosalyn.maccracken at noaa.gov> wrote:
> >
> > > Hi John,
> > >
> > > I'll have to send it tomorrow. I've already "left" and logged
off for
> > the
> > > day.
> > >
> > > Roz
> > >
> > > On Tue, Sep 26, 2017 at 3:52 PM, John Halley Gotway via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > >> Hello Roz,
> > >>
> > >> Can you please send me the original GRIB2 file and I'll take a
look?
> > >>
> > >> Or just point me to sample file somewhere on the web?
> > >>
> > >> You can post it to our anonymous ftp site following these
> instructions:
> > >> http://www.dtcenter.org/met/users/support/met_help.php#ftp
> > >>
> > >> Thanks,
> > >> John
> > >>
> > >> On Tue, Sep 26, 2017 at 10:18 AM, Rosalyn MacCracken - NOAA
Affiliate
> > via
> > >> RT <met_help at ucar.edu> wrote:
> > >>
> > >> >
> > >> > Tue Sep 26 10:18:14 2017: Request 82121 was acted upon.
> > >> > Transaction: Ticket created by rosalyn.maccracken at noaa.gov
> > >> > Queue: met_help
> > >> > Subject: trouble with reading a grib file in point_stat
> > >> > Owner: Nobody
> > >> > Requestors: rosalyn.maccracken at noaa.gov
> > >> > Status: new
> > >> > Ticket <URL: https://rt.rap.ucar.edu/rt/
> Ticket/Display.html?id=82121
> > >
> > >> >
> > >> >
> > >> > Hi,
> > >> >
> > >> > I'm trying to use point_stat to obtain matches between ASCAT
and our
> > >> > oceanic grid Grib2 file. I had to first convert our oceanic
grid
> to a
> > >> > netCDF file, because of the way the is written originally.
If you
> > plot
> > >> the
> > >> > file with python straight from the grib2 file, the data is
plotted
> the
> > >> > wrong way around the globe, plotting the data on land instead
of the
> > >> > ocean. It doesn't do that when the data is plotted in GrADS.
The
> > >> lat/lons
> > >> > are interpreted the correct way.
> > >> >
> > >> > Anyway, I used this with command when I converted it to
netCDF:
> > >> > wgrib2 20170920_1655_ndfd_oceanic_2017092016.grb2 -match
':WIND:'
> > >> -netcdf
> > >> > 20170920_1655_ndfd_oceanic_2017092016_WIND.nc
> > >> >
> > >> > The attached plot is a python plot reading in the netCDF
file, so,
> now
> > >> it
> > >> > is on the correct lat/lon grid. But, when I use point_stat,
I get
> > this:
> > >> >
> > >> > /opt/MET6/met6.0/bin/point_stat
> > >> > /opc_test/home/opc_test/data/met_verif/test_fcst_grids_to_
> > >> > nc/20170911_0455_ndfd_oceanic_2017091104 <(201)%20709-
1104>_WIND.nc
> > >> >
/opc_test/home/opc_test/data/met_verif/GFS/data/hourly/2017091106
> > >> <(201)%20709-1106>/
> > >> > uv_wind_pb_2017091106_07.nc
> > >> > /opc_test/home/opc_test/data/met_verif/test_fcst_grids_to_
> > >> > nc/PointStatConfig_FCST_GRID_mask
> > >> > -outdir
/opc_test/home/opc_test/data/met_verif/test_fcst_grids_to_
> nc/
> > >> -v 4
> > >> > DEBUG 1: Default Config File:
> > >> > /opt/MET6/met6.0/share/met/config/PointStatConfig_default
> > >> > DEBUG 1: User Config File:
> > >> > /opc_test/home/opc_test/data/met_verif/test_fcst_grids_to_
> > >> > nc/PointStatConfig_FCST_GRID_mask
> > >> > DEBUG 4: Met2dDataFileFactory::new_met_2d_data_file() ->
created
> new
> > >> > Met2dDataFile object of type "FileType_None".
> > >> > ERROR :
> > >> > ERROR : Trouble reading forecast file
> > >> > "/opc_test/home/opc_test/data/met_verif/test_fcst_grids_to_
> > >> > nc/20170911_0455_ndfd_oceanic_2017091104
> <(201)%20709-1104>_WIND.nc"
> > >> > ERROR :
> > >> >
> > >> > And, I think the problem is, that the missing values are
denoted as
> > >> "_", as
> > >> > seen by part of the ncdump of the variable (WIND_surface)
field:
> > >> >
> > >> > _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _,
_, _,
> _,
> > _,
> > >> > _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _,
_, _,
> _,
> > >> _, _,
> > >> > _, _, _, _, 2.1, 2.1, 2.1, 2.1, 2.1, 1.5, 1.5, 1.5, 1.5,
1.5,
> 1.5,
> > >> 1.5,
> > >> > 1.5, 1.5, 1.5, 2.1, 2.1, 2.1, 2.1, 2.1, 2.1, 2.1, 2.6,
2.6, 2.6,
> > >> 2.6,
> > >> > 2.6, 2.6, 2.6, 3.1, 3.1, 3.1, 3.1, 3.1, 3.1, 3.1, 3.1,
3.1, 3.6,
> > >> 3.6,
> > >> >
> > >> > even though the missing field is:
> > >> > WIND_surface:_FillValue = 9.999e+20f ;
> > >> >
> > >> > So, any ideas on how to deal with the original grib2 file so
I can
> use
> > >> > point stat? Thanks in advance!
> > >> >
> > >> > Roz
> > >> >
> > >> >
> > >> >
> > >> > --
> > >> > Rosalyn MacCracken
> > >> > Support Scientist
> > >> >
> > >> > Ocean Applilcations Branch
> > >> > NOAA/NWS Ocean Prediction Center
> > >> > NCWCP
> > >> > 5830 University Research Ct
> > >> > College Park, MD 20740-3818
> > >> >
> > >> > (p) 301-683-1551 <(301)%20683-1551>
> > >> > rosalyn.maccracken at noaa.gov
> > >> >
> > >> >
> > >>
> > >>
> > >
> > >
> > > --
> > > Rosalyn MacCracken
> > > Support Scientist
> > >
> > > Ocean Applilcations Branch
> > > NOAA/NWS Ocean Prediction Center
> > > NCWCP
> > > 5830 University Research Ct
> > > College Park, MD 20740-3818
> > >
> > > (p) 301-683-1551 <(301)%20683-1551>
> > > rosalyn.maccracken at noaa.gov
> > >
> >
> >
> >
> > --
> > Rosalyn MacCracken
> > Support Scientist
> >
> > Ocean Applilcations Branch
> > NOAA/NWS Ocean Prediction Center
> > NCWCP
> > 5830 University Research Ct
> > College Park, MD 20740-3818
> >
> > (p) 301-683-1551
> > rosalyn.maccracken at noaa.gov
> >
> >
>
>
--
Rosalyn MacCracken
Support Scientist
Ocean Applilcations Branch
NOAA/NWS Ocean Prediction Center
NCWCP
5830 University Research Ct
College Park, MD 20740-3818
(p) 301-683-1551
rosalyn.maccracken at noaa.gov
------------------------------------------------
Subject: trouble with reading a grib file in point_stat
From: John Halley Gotway
Time: Wed Sep 27 13:23:06 2017
Roz,
The plot_data_plane utility has been in MET since version 3.1 in 2012.
It's a little utility that reads a 2D field of data from a gridded
data
file and creates a postscript plot.
It's a very useful way of quickly and easily displaying how MET is
reading
your data.
When I run Point-Stat using the data/config file you sent, I get this
warning message:
WARNING: process_fcst_climo_files() -> no fields matching WIND/Z0
found in
file: 20170911_1055_ndfd_oceanic_2017091110.grb2
So Point-Stat isn't able to find a match for surface wind in the GRIB2
file. You're looking for a 3-hour forecast in that file, but it
doesn't
exist. Here's some wgrib2 output:
wgrib2 20170911_1055_ndfd_oceanic_2017091110.grb2 | grep WIND
100:30000082:d=2017091110:WIND:surface:2 hour fcst:
101:30498115:d=2017091110:WIND:surface:5 hour fcst:
102:30994930:d=2017091110:WIND:surface:8 hour fcst:
103:31484637:d=2017091110:WIND:surface:11 hour fcst:
104:31973373:d=2017091110:WIND:surface:14 hour fcst:
105:32463299:d=2017091110:WIND:surface:17 hour fcst:
So I switched the config file to look for the 2 hour lead time
instead, and
that produces 14,681 matched pairs:
DEBUG 2: Processing WIND/Z0 versus WIND/P1013, for observation type
ASCATW,
over region FULL, for interpolation method NEAREST(4), using 14681
pairs.
DEBUG 3: Number of matched pairs = 14681
Please try running the following command with the attached
configuration
file:
mkdir out
met-6.0/bin/point_stat \
20170911_1055_ndfd_oceanic_2017091110.grb2 \
uv_wind_pb_2017091112_12.nc \
PointStatConfig_FCST_GRID_mask \
-outdir out -v 4
Does that work any better?
Thanks,
John
On Wed, Sep 27, 2017 at 12:53 PM, Rosalyn MacCracken - NOAA Affiliate
via
RT <met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82121 >
>
> You're plot looks like mine. I had to make a plot of that lead
time, but,
> that is correct. It's those "bad values" that the point stat is
having
> trouble with, I think.
>
> What's plot_data_plane? Is that new?
>
> Roz
>
> On Wed, Sep 27, 2017 at 2:41 PM, John Halley Gotway via RT <
> met_help at ucar.edu> wrote:
>
> > Roz,
> >
> > OK, I just ran the following MET plot_data_plane command to plot
the
> 2-hour
> > forecast of WIND (wind speed) from the GRIB2 file you sent:
> >
> > met-6.0/bin/plot_data_plane \
> > 20170911_1055_ndfd_oceanic_2017091110.grb2 \
> > wind_f02.ps \
> > 'name="WIND"; level="Z0"; lead_time="02";' -v 3
> >
> > Running at verbosity level 3 tells me that it's correctly plotting
record
> > number 100.
> >
> > The resulting image is attached.
> >
> > This looks like very reasonable data to me. There are real data
values
> > over Alaska and in the oceans surrounding, real values over
Hawaii,
> CONUS,
> > and some portions of the Atlantic and Pacific oceans. Everywhere
else
> > contains a bad data value.
> >
> > Do you see a problem in this data? If so, can you clarify what it
is?
> >
> > Thanks,
> > John
> >
> > On Wed, Sep 27, 2017 at 12:29 PM, Rosalyn MacCracken - NOAA
Affiliate via
> > RT <met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82121 >
> > >
> > > Hi John,
> > >
> > > I've put the oceanic grid file (Grib2) and the ASCAT netCDF file
in my
> > ftp
> > > directory (maccracken_data). I'm attaching the config file I'm
using.
> > So,
> > > for the Grib2 file, it was created at 10z, but, I'm actually
matching
> up
> > > the lead=2 time period (12z), with the 12z ASCAT data.
> > >
> > > Hopefully, it'll be an easy fix. :-)
> > >
> > > Roz
> > >
> > > On Tue, Sep 26, 2017 at 4:55 PM, Rosalyn MacCracken - NOAA
Affiliate <
> > > rosalyn.maccracken at noaa.gov> wrote:
> > >
> > > > Hi John,
> > > >
> > > > I'll have to send it tomorrow. I've already "left" and logged
off
> for
> > > the
> > > > day.
> > > >
> > > > Roz
> > > >
> > > > On Tue, Sep 26, 2017 at 3:52 PM, John Halley Gotway via RT <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > >> Hello Roz,
> > > >>
> > > >> Can you please send me the original GRIB2 file and I'll take
a look?
> > > >>
> > > >> Or just point me to sample file somewhere on the web?
> > > >>
> > > >> You can post it to our anonymous ftp site following these
> > instructions:
> > > >> http://www.dtcenter.org/met/users/support/met_help.php#ftp
> > > >>
> > > >> Thanks,
> > > >> John
> > > >>
> > > >> On Tue, Sep 26, 2017 at 10:18 AM, Rosalyn MacCracken - NOAA
> Affiliate
> > > via
> > > >> RT <met_help at ucar.edu> wrote:
> > > >>
> > > >> >
> > > >> > Tue Sep 26 10:18:14 2017: Request 82121 was acted upon.
> > > >> > Transaction: Ticket created by rosalyn.maccracken at noaa.gov
> > > >> > Queue: met_help
> > > >> > Subject: trouble with reading a grib file in
point_stat
> > > >> > Owner: Nobody
> > > >> > Requestors: rosalyn.maccracken at noaa.gov
> > > >> > Status: new
> > > >> > Ticket <URL: https://rt.rap.ucar.edu/rt/
> > Ticket/Display.html?id=82121
> > > >
> > > >> >
> > > >> >
> > > >> > Hi,
> > > >> >
> > > >> > I'm trying to use point_stat to obtain matches between
ASCAT and
> our
> > > >> > oceanic grid Grib2 file. I had to first convert our
oceanic grid
> > to a
> > > >> > netCDF file, because of the way the is written originally.
If you
> > > plot
> > > >> the
> > > >> > file with python straight from the grib2 file, the data is
plotted
> > the
> > > >> > wrong way around the globe, plotting the data on land
instead of
> the
> > > >> > ocean. It doesn't do that when the data is plotted in
GrADS. The
> > > >> lat/lons
> > > >> > are interpreted the correct way.
> > > >> >
> > > >> > Anyway, I used this with command when I converted it to
netCDF:
> > > >> > wgrib2 20170920_1655_ndfd_oceanic_2017092016.grb2 -match
':WIND:'
> > > >> -netcdf
> > > >> > 20170920_1655_ndfd_oceanic_2017092016_WIND.nc
> > > >> >
> > > >> > The attached plot is a python plot reading in the netCDF
file, so,
> > now
> > > >> it
> > > >> > is on the correct lat/lon grid. But, when I use
point_stat, I get
> > > this:
> > > >> >
> > > >> > /opt/MET6/met6.0/bin/point_stat
> > > >> > /opc_test/home/opc_test/data/met_verif/test_fcst_grids_to_
> > > >> > nc/20170911_0455_ndfd_oceanic_2017091104
> <(201)%20709-1104>_WIND.nc
> > > >> >
/opc_test/home/opc_test/data/met_verif/GFS/data/hourly/2017091106
> > > >> <(201)%20709-1106>/
> > > >> > uv_wind_pb_2017091106_07.nc
> > > >> > /opc_test/home/opc_test/data/met_verif/test_fcst_grids_to_
> > > >> > nc/PointStatConfig_FCST_GRID_mask
> > > >> > -outdir /opc_test/home/opc_test/data/
> met_verif/test_fcst_grids_to_
> > nc/
> > > >> -v 4
> > > >> > DEBUG 1: Default Config File:
> > > >> > /opt/MET6/met6.0/share/met/config/PointStatConfig_default
> > > >> > DEBUG 1: User Config File:
> > > >> > /opc_test/home/opc_test/data/met_verif/test_fcst_grids_to_
> > > >> > nc/PointStatConfig_FCST_GRID_mask
> > > >> > DEBUG 4: Met2dDataFileFactory::new_met_2d_data_file() ->
created
> > new
> > > >> > Met2dDataFile object of type "FileType_None".
> > > >> > ERROR :
> > > >> > ERROR : Trouble reading forecast file
> > > >> > "/opc_test/home/opc_test/data/met_verif/test_fcst_grids_to_
> > > >> > nc/20170911_0455_ndfd_oceanic_2017091104
> > <(201)%20709-1104>_WIND.nc"
> > > >> > ERROR :
> > > >> >
> > > >> > And, I think the problem is, that the missing values are
denoted
> as
> > > >> "_", as
> > > >> > seen by part of the ncdump of the variable (WIND_surface)
field:
> > > >> >
> > > >> > _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _,
_, _, _,
> > _,
> > > _,
> > > >> > _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _,
_, _, _,
> > _,
> > > >> _, _,
> > > >> > _, _, _, _, 2.1, 2.1, 2.1, 2.1, 2.1, 1.5, 1.5, 1.5,
1.5, 1.5,
> > 1.5,
> > > >> 1.5,
> > > >> > 1.5, 1.5, 1.5, 2.1, 2.1, 2.1, 2.1, 2.1, 2.1, 2.1, 2.6,
2.6,
> 2.6,
> > > >> 2.6,
> > > >> > 2.6, 2.6, 2.6, 3.1, 3.1, 3.1, 3.1, 3.1, 3.1, 3.1, 3.1,
3.1,
> 3.6,
> > > >> 3.6,
> > > >> >
> > > >> > even though the missing field is:
> > > >> > WIND_surface:_FillValue = 9.999e+20f ;
> > > >> >
> > > >> > So, any ideas on how to deal with the original grib2 file
so I can
> > use
> > > >> > point stat? Thanks in advance!
> > > >> >
> > > >> > Roz
> > > >> >
> > > >> >
> > > >> >
> > > >> > --
> > > >> > Rosalyn MacCracken
> > > >> > Support Scientist
> > > >> >
> > > >> > Ocean Applilcations Branch
> > > >> > NOAA/NWS Ocean Prediction Center
> > > >> > NCWCP
> > > >> > 5830 University Research Ct
> > > >> > College Park, MD 20740-3818
> > > >> >
> > > >> > (p) 301-683-1551 <(301)%20683-1551>
> > > >> > rosalyn.maccracken at noaa.gov
> > > >> >
> > > >> >
> > > >>
> > > >>
> > > >
> > > >
> > > > --
> > > > Rosalyn MacCracken
> > > > Support Scientist
> > > >
> > > > Ocean Applilcations Branch
> > > > NOAA/NWS Ocean Prediction Center
> > > > NCWCP
> > > > 5830 University Research Ct
> > > > College Park, MD 20740-3818
> > > >
> > > > (p) 301-683-1551 <(301)%20683-1551>
> > > > rosalyn.maccracken at noaa.gov
> > > >
> > >
> > >
> > >
> > > --
> > > Rosalyn MacCracken
> > > Support Scientist
> > >
> > > Ocean Applilcations Branch
> > > NOAA/NWS Ocean Prediction Center
> > > NCWCP
> > > 5830 University Research Ct
> > > College Park, MD 20740-3818
> > >
> > > (p) 301-683-1551
> > > rosalyn.maccracken at noaa.gov
> > >
> > >
> >
> >
>
>
> --
> Rosalyn MacCracken
> Support Scientist
>
> Ocean Applilcations Branch
> NOAA/NWS Ocean Prediction Center
> NCWCP
> 5830 University Research Ct
> College Park, MD 20740-3818
>
> (p) 301-683-1551
> rosalyn.maccracken at noaa.gov
>
>
------------------------------------------------
Subject: trouble with reading a grib file in point_stat
From: Rosalyn MacCracken - NOAA Affiliate
Time: Wed Sep 27 13:52:53 2017
Ah, ok. So, you used the grib files straight up, and didn't convert
them.
And, that's because MET knows to put them on the same type of grid as
wgrib
and GrADS does, as shown in your picture. It's only python that
doesn't
know how to work with out oceanic grid files, but, I'm not using
python...I'm using MET. :-)
I think I had changed it to lead=3, because I had tried a different
file,
and changed the config file before I sent it to you. So, I used your
config file, and only got 142 matches:
Processing WIND/Z0 versus WIND/P1013, for observation type ASCATW,
over
region FULL, for interpolation method NEAREST(4), using 142 pairs.
I wonder what the difference is...I'm using the same files that you
have
listed above, with your config file. That's strange.
Roz
On Wed, Sep 27, 2017 at 3:23 PM, John Halley Gotway via RT <
met_help at ucar.edu> wrote:
> Roz,
>
> The plot_data_plane utility has been in MET since version 3.1 in
2012.
> It's a little utility that reads a 2D field of data from a gridded
data
> file and creates a postscript plot.
>
> It's a very useful way of quickly and easily displaying how MET is
reading
> your data.
>
> When I run Point-Stat using the data/config file you sent, I get
this
> warning message:
>
> WARNING: process_fcst_climo_files() -> no fields matching WIND/Z0
found in
> file: 20170911_1055_ndfd_oceanic_2017091110.grb2
>
> So Point-Stat isn't able to find a match for surface wind in the
GRIB2
> file. You're looking for a 3-hour forecast in that file, but it
doesn't
> exist. Here's some wgrib2 output:
>
> wgrib2 20170911_1055_ndfd_oceanic_2017091110.grb2 | grep WIND
> 100:30000082:d=2017091110:WIND:surface:2 hour fcst:
> 101:30498115:d=2017091110:WIND:surface:5 hour fcst:
> 102:30994930:d=2017091110:WIND:surface:8 hour fcst:
> 103:31484637:d=2017091110:WIND:surface:11 hour fcst:
> 104:31973373:d=2017091110:WIND:surface:14 hour fcst:
> 105:32463299:d=2017091110:WIND:surface:17 hour fcst:
>
> So I switched the config file to look for the 2 hour lead time
instead, and
> that produces 14,681 matched pairs:
>
> DEBUG 2: Processing WIND/Z0 versus WIND/P1013, for observation type
ASCATW,
> over region FULL, for interpolation method NEAREST(4), using 14681
pairs.
> DEBUG 3: Number of matched pairs = 14681
>
> Please try running the following command with the attached
configuration
> file:
>
> mkdir out
>
> met-6.0/bin/point_stat \
> 20170911_1055_ndfd_oceanic_2017091110.grb2 \
> uv_wind_pb_2017091112_12.nc \
> PointStatConfig_FCST_GRID_mask \
> -outdir out -v 4
>
> Does that work any better?
>
> Thanks,
> John
>
> On Wed, Sep 27, 2017 at 12:53 PM, Rosalyn MacCracken - NOAA
Affiliate via
> RT <met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82121 >
> >
> > You're plot looks like mine. I had to make a plot of that lead
time,
> but,
> > that is correct. It's those "bad values" that the point stat is
having
> > trouble with, I think.
> >
> > What's plot_data_plane? Is that new?
> >
> > Roz
> >
> > On Wed, Sep 27, 2017 at 2:41 PM, John Halley Gotway via RT <
> > met_help at ucar.edu> wrote:
> >
> > > Roz,
> > >
> > > OK, I just ran the following MET plot_data_plane command to plot
the
> > 2-hour
> > > forecast of WIND (wind speed) from the GRIB2 file you sent:
> > >
> > > met-6.0/bin/plot_data_plane \
> > > 20170911_1055_ndfd_oceanic_2017091110.grb2 \
> > > wind_f02.ps \
> > > 'name="WIND"; level="Z0"; lead_time="02";' -v 3
> > >
> > > Running at verbosity level 3 tells me that it's correctly
plotting
> record
> > > number 100.
> > >
> > > The resulting image is attached.
> > >
> > > This looks like very reasonable data to me. There are real data
values
> > > over Alaska and in the oceans surrounding, real values over
Hawaii,
> > CONUS,
> > > and some portions of the Atlantic and Pacific oceans.
Everywhere else
> > > contains a bad data value.
> > >
> > > Do you see a problem in this data? If so, can you clarify what
it is?
> > >
> > > Thanks,
> > > John
> > >
> > > On Wed, Sep 27, 2017 at 12:29 PM, Rosalyn MacCracken - NOAA
Affiliate
> via
> > > RT <met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82121
>
> > > >
> > > > Hi John,
> > > >
> > > > I've put the oceanic grid file (Grib2) and the ASCAT netCDF
file in
> my
> > > ftp
> > > > directory (maccracken_data). I'm attaching the config file
I'm
> using.
> > > So,
> > > > for the Grib2 file, it was created at 10z, but, I'm actually
matching
> > up
> > > > the lead=2 time period (12z), with the 12z ASCAT data.
> > > >
> > > > Hopefully, it'll be an easy fix. :-)
> > > >
> > > > Roz
> > > >
> > > > On Tue, Sep 26, 2017 at 4:55 PM, Rosalyn MacCracken - NOAA
Affiliate
> <
> > > > rosalyn.maccracken at noaa.gov> wrote:
> > > >
> > > > > Hi John,
> > > > >
> > > > > I'll have to send it tomorrow. I've already "left" and
logged off
> > for
> > > > the
> > > > > day.
> > > > >
> > > > > Roz
> > > > >
> > > > > On Tue, Sep 26, 2017 at 3:52 PM, John Halley Gotway via RT <
> > > > > met_help at ucar.edu> wrote:
> > > > >
> > > > >> Hello Roz,
> > > > >>
> > > > >> Can you please send me the original GRIB2 file and I'll
take a
> look?
> > > > >>
> > > > >> Or just point me to sample file somewhere on the web?
> > > > >>
> > > > >> You can post it to our anonymous ftp site following these
> > > instructions:
> > > > >>
http://www.dtcenter.org/met/users/support/met_help.php#ftp
> > > > >>
> > > > >> Thanks,
> > > > >> John
> > > > >>
> > > > >> On Tue, Sep 26, 2017 at 10:18 AM, Rosalyn MacCracken - NOAA
> > Affiliate
> > > > via
> > > > >> RT <met_help at ucar.edu> wrote:
> > > > >>
> > > > >> >
> > > > >> > Tue Sep 26 10:18:14 2017: Request 82121 was acted upon.
> > > > >> > Transaction: Ticket created by
rosalyn.maccracken at noaa.gov
> > > > >> > Queue: met_help
> > > > >> > Subject: trouble with reading a grib file in
point_stat
> > > > >> > Owner: Nobody
> > > > >> > Requestors: rosalyn.maccracken at noaa.gov
> > > > >> > Status: new
> > > > >> > Ticket <URL: https://rt.rap.ucar.edu/rt/
> > > Ticket/Display.html?id=82121
> > > > >
> > > > >> >
> > > > >> >
> > > > >> > Hi,
> > > > >> >
> > > > >> > I'm trying to use point_stat to obtain matches between
ASCAT and
> > our
> > > > >> > oceanic grid Grib2 file. I had to first convert our
oceanic
> grid
> > > to a
> > > > >> > netCDF file, because of the way the is written
originally. If
> you
> > > > plot
> > > > >> the
> > > > >> > file with python straight from the grib2 file, the data
is
> plotted
> > > the
> > > > >> > wrong way around the globe, plotting the data on land
instead of
> > the
> > > > >> > ocean. It doesn't do that when the data is plotted in
GrADS.
> The
> > > > >> lat/lons
> > > > >> > are interpreted the correct way.
> > > > >> >
> > > > >> > Anyway, I used this with command when I converted it to
netCDF:
> > > > >> > wgrib2 20170920_1655_ndfd_oceanic_2017092016.grb2 -match
> ':WIND:'
> > > > >> -netcdf
> > > > >> > 20170920_1655_ndfd_oceanic_2017092016_WIND.nc
> > > > >> >
> > > > >> > The attached plot is a python plot reading in the netCDF
file,
> so,
> > > now
> > > > >> it
> > > > >> > is on the correct lat/lon grid. But, when I use
point_stat, I
> get
> > > > this:
> > > > >> >
> > > > >> > /opt/MET6/met6.0/bin/point_stat
> > > > >> >
/opc_test/home/opc_test/data/met_verif/test_fcst_grids_to_
> > > > >> > nc/20170911_0455_ndfd_oceanic_2017091104
> > <(201)%20709-1104>_WIND.nc
> > > > >> > /opc_test/home/opc_test/data/met_verif/GFS/data/hourly/
> 2017091106
> > > > >> <(201)%20709-1106>/
> > > > >> > uv_wind_pb_2017091106_07.nc
> > > > >> >
/opc_test/home/opc_test/data/met_verif/test_fcst_grids_to_
> > > > >> > nc/PointStatConfig_FCST_GRID_mask
> > > > >> > -outdir /opc_test/home/opc_test/data/
> > met_verif/test_fcst_grids_to_
> > > nc/
> > > > >> -v 4
> > > > >> > DEBUG 1: Default Config File:
> > > > >> > /opt/MET6/met6.0/share/met/config/PointStatConfig_default
> > > > >> > DEBUG 1: User Config File:
> > > > >> >
/opc_test/home/opc_test/data/met_verif/test_fcst_grids_to_
> > > > >> > nc/PointStatConfig_FCST_GRID_mask
> > > > >> > DEBUG 4: Met2dDataFileFactory::new_met_2d_data_file() ->
> created
> > > new
> > > > >> > Met2dDataFile object of type "FileType_None".
> > > > >> > ERROR :
> > > > >> > ERROR : Trouble reading forecast file
> > > > >> >
"/opc_test/home/opc_test/data/met_verif/test_fcst_grids_to_
> > > > >> > nc/20170911_0455_ndfd_oceanic_2017091104
> > > <(201)%20709-1104>_WIND.nc"
> > > > >> > ERROR :
> > > > >> >
> > > > >> > And, I think the problem is, that the missing values are
denoted
> > as
> > > > >> "_", as
> > > > >> > seen by part of the ncdump of the variable (WIND_surface)
field:
> > > > >> >
> > > > >> > _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _,
_, _,
> _,
> > > _,
> > > > _,
> > > > >> > _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _,
_, _,
> _,
> > > _,
> > > > >> _, _,
> > > > >> > _, _, _, _, 2.1, 2.1, 2.1, 2.1, 2.1, 1.5, 1.5, 1.5,
1.5,
> 1.5,
> > > 1.5,
> > > > >> 1.5,
> > > > >> > 1.5, 1.5, 1.5, 2.1, 2.1, 2.1, 2.1, 2.1, 2.1, 2.1,
2.6, 2.6,
> > 2.6,
> > > > >> 2.6,
> > > > >> > 2.6, 2.6, 2.6, 3.1, 3.1, 3.1, 3.1, 3.1, 3.1, 3.1,
3.1, 3.1,
> > 3.6,
> > > > >> 3.6,
> > > > >> >
> > > > >> > even though the missing field is:
> > > > >> > WIND_surface:_FillValue = 9.999e+20f ;
> > > > >> >
> > > > >> > So, any ideas on how to deal with the original grib2 file
so I
> can
> > > use
> > > > >> > point stat? Thanks in advance!
> > > > >> >
> > > > >> > Roz
> > > > >> >
> > > > >> >
> > > > >> >
> > > > >> > --
> > > > >> > Rosalyn MacCracken
> > > > >> > Support Scientist
> > > > >> >
> > > > >> > Ocean Applilcations Branch
> > > > >> > NOAA/NWS Ocean Prediction Center
> > > > >> > NCWCP
> > > > >> > 5830 University Research Ct
> > > > >> > College Park, MD 20740-3818
> > > > >> >
> > > > >> > (p) 301-683-1551 <(301)%20683-1551>
> > > > >> > rosalyn.maccracken at noaa.gov
> > > > >> >
> > > > >> >
> > > > >>
> > > > >>
> > > > >
> > > > >
> > > > > --
> > > > > Rosalyn MacCracken
> > > > > Support Scientist
> > > > >
> > > > > Ocean Applilcations Branch
> > > > > NOAA/NWS Ocean Prediction Center
> > > > > NCWCP
> > > > > 5830 University Research Ct
> > > > > College Park, MD 20740-3818
> > > > >
> > > > > (p) 301-683-1551 <(301)%20683-1551>
> > > > > rosalyn.maccracken at noaa.gov
> > > > >
> > > >
> > > >
> > > >
> > > > --
> > > > Rosalyn MacCracken
> > > > Support Scientist
> > > >
> > > > Ocean Applilcations Branch
> > > > NOAA/NWS Ocean Prediction Center
> > > > NCWCP
> > > > 5830 University Research Ct
> > > > College Park, MD 20740-3818
> > > >
> > > > (p) 301-683-1551
> > > > rosalyn.maccracken at noaa.gov
> > > >
> > > >
> > >
> > >
> >
> >
> > --
> > Rosalyn MacCracken
> > Support Scientist
> >
> > Ocean Applilcations Branch
> > NOAA/NWS Ocean Prediction Center
> > NCWCP
> > 5830 University Research Ct
> > College Park, MD 20740-3818
> >
> > (p) 301-683-1551
> > rosalyn.maccracken at noaa.gov
> >
> >
>
>
--
Rosalyn MacCracken
Support Scientist
Ocean Applilcations Branch
NOAA/NWS Ocean Prediction Center
NCWCP
5830 University Research Ct
College Park, MD 20740-3818
(p) 301-683-1551
rosalyn.maccracken at noaa.gov
------------------------------------------------
Subject: trouble with reading a grib file in point_stat
From: John Halley Gotway
Time: Thu Sep 28 16:32:03 2017
Roz,
I re-ran the following command, including the "-log" option this time
to
write a log file. And I've attached that log file to the message.
met-6.0/bin/point_stat \
20170911_1055_ndfd_oceanic_2017091110 <(201)%20709-1110>.grb2 \
uv_wind_pb_2017091112_12.nc \
PointStatConfig_FCST_GRID_mask \
-outdir out -v 3 -log run_ps.log
The very important info from the log file are the reason counts for
why
observations were or were not used. Please run on your machine and
compare
the log files to see if there are any obvious differences.
Thanks,
John
On Wed, Sep 27, 2017 at 1:52 PM, Rosalyn MacCracken - NOAA Affiliate
via RT
<met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82121 >
>
> Ah, ok. So, you used the grib files straight up, and didn't convert
them.
> And, that's because MET knows to put them on the same type of grid
as wgrib
> and GrADS does, as shown in your picture. It's only python that
doesn't
> know how to work with out oceanic grid files, but, I'm not using
> python...I'm using MET. :-)
>
> I think I had changed it to lead=3, because I had tried a different
file,
> and changed the config file before I sent it to you. So, I used
your
> config file, and only got 142 matches:
>
> Processing WIND/Z0 versus WIND/P1013, for observation type ASCATW,
over
> region FULL, for interpolation method NEAREST(4), using 142 pairs.
>
> I wonder what the difference is...I'm using the same files that you
have
> listed above, with your config file. That's strange.
>
> Roz
>
> On Wed, Sep 27, 2017 at 3:23 PM, John Halley Gotway via RT <
> met_help at ucar.edu> wrote:
>
> > Roz,
> >
> > The plot_data_plane utility has been in MET since version 3.1 in
2012.
> > It's a little utility that reads a 2D field of data from a gridded
data
> > file and creates a postscript plot.
> >
> > It's a very useful way of quickly and easily displaying how MET is
> reading
> > your data.
> >
> > When I run Point-Stat using the data/config file you sent, I get
this
> > warning message:
> >
> > WARNING: process_fcst_climo_files() -> no fields matching WIND/Z0
found
> in
> > file: 20170911_1055_ndfd_oceanic_2017091110.grb2
> >
> > So Point-Stat isn't able to find a match for surface wind in the
GRIB2
> > file. You're looking for a 3-hour forecast in that file, but it
doesn't
> > exist. Here's some wgrib2 output:
> >
> > wgrib2 20170911_1055_ndfd_oceanic_2017091110.grb2 | grep WIND
> > 100:30000082:d=2017091110:WIND:surface:2 hour fcst:
> > 101:30498115:d=2017091110:WIND:surface:5 hour fcst:
> > 102:30994930:d=2017091110:WIND:surface:8 hour fcst:
> > 103:31484637:d=2017091110:WIND:surface:11 hour fcst:
> > 104:31973373:d=2017091110:WIND:surface:14 hour fcst:
> > 105:32463299:d=2017091110:WIND:surface:17 hour fcst:
> >
> > So I switched the config file to look for the 2 hour lead time
instead,
> and
> > that produces 14,681 matched pairs:
> >
> > DEBUG 2: Processing WIND/Z0 versus WIND/P1013, for observation
type
> ASCATW,
> > over region FULL, for interpolation method NEAREST(4), using 14681
pairs.
> > DEBUG 3: Number of matched pairs = 14681
> >
> > Please try running the following command with the attached
configuration
> > file:
> >
> > mkdir out
> >
> > met-6.0/bin/point_stat \
> > 20170911_1055_ndfd_oceanic_2017091110.grb2 \
> > uv_wind_pb_2017091112_12.nc \
> > PointStatConfig_FCST_GRID_mask \
> > -outdir out -v 4
> >
> > Does that work any better?
> >
> > Thanks,
> > John
> >
> > On Wed, Sep 27, 2017 at 12:53 PM, Rosalyn MacCracken - NOAA
Affiliate via
> > RT <met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82121 >
> > >
> > > You're plot looks like mine. I had to make a plot of that lead
time,
> > but,
> > > that is correct. It's those "bad values" that the point stat is
having
> > > trouble with, I think.
> > >
> > > What's plot_data_plane? Is that new?
> > >
> > > Roz
> > >
> > > On Wed, Sep 27, 2017 at 2:41 PM, John Halley Gotway via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > > Roz,
> > > >
> > > > OK, I just ran the following MET plot_data_plane command to
plot the
> > > 2-hour
> > > > forecast of WIND (wind speed) from the GRIB2 file you sent:
> > > >
> > > > met-6.0/bin/plot_data_plane \
> > > > 20170911_1055_ndfd_oceanic_2017091110.grb2 \
> > > > wind_f02.ps \
> > > > 'name="WIND"; level="Z0"; lead_time="02";' -v 3
> > > >
> > > > Running at verbosity level 3 tells me that it's correctly
plotting
> > record
> > > > number 100.
> > > >
> > > > The resulting image is attached.
> > > >
> > > > This looks like very reasonable data to me. There are real
data
> values
> > > > over Alaska and in the oceans surrounding, real values over
Hawaii,
> > > CONUS,
> > > > and some portions of the Atlantic and Pacific oceans.
Everywhere
> else
> > > > contains a bad data value.
> > > >
> > > > Do you see a problem in this data? If so, can you clarify
what it
> is?
> > > >
> > > > Thanks,
> > > > John
> > > >
> > > > On Wed, Sep 27, 2017 at 12:29 PM, Rosalyn MacCracken - NOAA
Affiliate
> > via
> > > > RT <met_help at ucar.edu> wrote:
> > > >
> > > > >
> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82121 >
> > > > >
> > > > > Hi John,
> > > > >
> > > > > I've put the oceanic grid file (Grib2) and the ASCAT netCDF
file in
> > my
> > > > ftp
> > > > > directory (maccracken_data). I'm attaching the config file
I'm
> > using.
> > > > So,
> > > > > for the Grib2 file, it was created at 10z, but, I'm actually
> matching
> > > up
> > > > > the lead=2 time period (12z), with the 12z ASCAT data.
> > > > >
> > > > > Hopefully, it'll be an easy fix. :-)
> > > > >
> > > > > Roz
> > > > >
> > > > > On Tue, Sep 26, 2017 at 4:55 PM, Rosalyn MacCracken - NOAA
> Affiliate
> > <
> > > > > rosalyn.maccracken at noaa.gov> wrote:
> > > > >
> > > > > > Hi John,
> > > > > >
> > > > > > I'll have to send it tomorrow. I've already "left" and
logged
> off
> > > for
> > > > > the
> > > > > > day.
> > > > > >
> > > > > > Roz
> > > > > >
> > > > > > On Tue, Sep 26, 2017 at 3:52 PM, John Halley Gotway via RT
<
> > > > > > met_help at ucar.edu> wrote:
> > > > > >
> > > > > >> Hello Roz,
> > > > > >>
> > > > > >> Can you please send me the original GRIB2 file and I'll
take a
> > look?
> > > > > >>
> > > > > >> Or just point me to sample file somewhere on the web?
> > > > > >>
> > > > > >> You can post it to our anonymous ftp site following these
> > > > instructions:
> > > > > >>
http://www.dtcenter.org/met/users/support/met_help.php#ftp
> > > > > >>
> > > > > >> Thanks,
> > > > > >> John
> > > > > >>
> > > > > >> On Tue, Sep 26, 2017 at 10:18 AM, Rosalyn MacCracken -
NOAA
> > > Affiliate
> > > > > via
> > > > > >> RT <met_help at ucar.edu> wrote:
> > > > > >>
> > > > > >> >
> > > > > >> > Tue Sep 26 10:18:14 2017: Request 82121 was acted upon.
> > > > > >> > Transaction: Ticket created by
rosalyn.maccracken at noaa.gov
> > > > > >> > Queue: met_help
> > > > > >> > Subject: trouble with reading a grib file in
point_stat
> > > > > >> > Owner: Nobody
> > > > > >> > Requestors: rosalyn.maccracken at noaa.gov
> > > > > >> > Status: new
> > > > > >> > Ticket <URL: https://rt.rap.ucar.edu/rt/
> > > > Ticket/Display.html?id=82121
> > > > > >
> > > > > >> >
> > > > > >> >
> > > > > >> > Hi,
> > > > > >> >
> > > > > >> > I'm trying to use point_stat to obtain matches between
ASCAT
> and
> > > our
> > > > > >> > oceanic grid Grib2 file. I had to first convert our
oceanic
> > grid
> > > > to a
> > > > > >> > netCDF file, because of the way the is written
originally. If
> > you
> > > > > plot
> > > > > >> the
> > > > > >> > file with python straight from the grib2 file, the data
is
> > plotted
> > > > the
> > > > > >> > wrong way around the globe, plotting the data on land
instead
> of
> > > the
> > > > > >> > ocean. It doesn't do that when the data is plotted in
GrADS.
> > The
> > > > > >> lat/lons
> > > > > >> > are interpreted the correct way.
> > > > > >> >
> > > > > >> > Anyway, I used this with command when I converted it to
> netCDF:
> > > > > >> > wgrib2 20170920_1655_ndfd_oceanic_2017092016.grb2
-match
> > ':WIND:'
> > > > > >> -netcdf
> > > > > >> > 20170920_1655_ndfd_oceanic_2017092016_WIND.nc
> > > > > >> >
> > > > > >> > The attached plot is a python plot reading in the
netCDF file,
> > so,
> > > > now
> > > > > >> it
> > > > > >> > is on the correct lat/lon grid. But, when I use
point_stat, I
> > get
> > > > > this:
> > > > > >> >
> > > > > >> > /opt/MET6/met6.0/bin/point_stat
> > > > > >> >
/opc_test/home/opc_test/data/met_verif/test_fcst_grids_to_
> > > > > >> > nc/20170911_0455_ndfd_oceanic_2017091104
> > > <(201)%20709-1104>_WIND.nc
> > > > > >> > /opc_test/home/opc_test/data/met_verif/GFS/data/hourly/
> > 2017091106
> > > > > >> <(201)%20709-1106>/
> > > > > >> > uv_wind_pb_2017091106_07.nc
> > > > > >> >
/opc_test/home/opc_test/data/met_verif/test_fcst_grids_to_
> > > > > >> > nc/PointStatConfig_FCST_GRID_mask
> > > > > >> > -outdir /opc_test/home/opc_test/data/
> > > met_verif/test_fcst_grids_to_
> > > > nc/
> > > > > >> -v 4
> > > > > >> > DEBUG 1: Default Config File:
> > > > > >> >
/opt/MET6/met6.0/share/met/config/PointStatConfig_default
> > > > > >> > DEBUG 1: User Config File:
> > > > > >> >
/opc_test/home/opc_test/data/met_verif/test_fcst_grids_to_
> > > > > >> > nc/PointStatConfig_FCST_GRID_mask
> > > > > >> > DEBUG 4: Met2dDataFileFactory::new_met_2d_data_file()
->
> > created
> > > > new
> > > > > >> > Met2dDataFile object of type "FileType_None".
> > > > > >> > ERROR :
> > > > > >> > ERROR : Trouble reading forecast file
> > > > > >> >
"/opc_test/home/opc_test/data/met_verif/test_fcst_grids_to_
> > > > > >> > nc/20170911_0455_ndfd_oceanic_2017091104
> > > > <(201)%20709-1104>_WIND.nc"
> > > > > >> > ERROR :
> > > > > >> >
> > > > > >> > And, I think the problem is, that the missing values
are
> denoted
> > > as
> > > > > >> "_", as
> > > > > >> > seen by part of the ncdump of the variable
(WIND_surface)
> field:
> > > > > >> >
> > > > > >> > _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _,
_, _,
> _,
> > _,
> > > > _,
> > > > > _,
> > > > > >> > _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _,
_, _,
> _,
> > _,
> > > > _,
> > > > > >> _, _,
> > > > > >> > _, _, _, _, 2.1, 2.1, 2.1, 2.1, 2.1, 1.5, 1.5, 1.5,
1.5,
> > 1.5,
> > > > 1.5,
> > > > > >> 1.5,
> > > > > >> > 1.5, 1.5, 1.5, 2.1, 2.1, 2.1, 2.1, 2.1, 2.1, 2.1,
2.6,
> 2.6,
> > > 2.6,
> > > > > >> 2.6,
> > > > > >> > 2.6, 2.6, 2.6, 3.1, 3.1, 3.1, 3.1, 3.1, 3.1, 3.1,
3.1,
> 3.1,
> > > 3.6,
> > > > > >> 3.6,
> > > > > >> >
> > > > > >> > even though the missing field is:
> > > > > >> > WIND_surface:_FillValue = 9.999e+20f ;
> > > > > >> >
> > > > > >> > So, any ideas on how to deal with the original grib2
file so I
> > can
> > > > use
> > > > > >> > point stat? Thanks in advance!
> > > > > >> >
> > > > > >> > Roz
> > > > > >> >
> > > > > >> >
> > > > > >> >
> > > > > >> > --
> > > > > >> > Rosalyn MacCracken
> > > > > >> > Support Scientist
> > > > > >> >
> > > > > >> > Ocean Applilcations Branch
> > > > > >> > NOAA/NWS Ocean Prediction Center
> > > > > >> > NCWCP
> > > > > >> > 5830 University Research Ct
> > > > > >> > College Park, MD 20740-3818
> > > > > >> >
> > > > > >> > (p) 301-683-1551 <(301)%20683-1551>
> > > > > >> > rosalyn.maccracken at noaa.gov
> > > > > >> >
> > > > > >> >
> > > > > >>
> > > > > >>
> > > > > >
> > > > > >
> > > > > > --
> > > > > > Rosalyn MacCracken
> > > > > > Support Scientist
> > > > > >
> > > > > > Ocean Applilcations Branch
> > > > > > NOAA/NWS Ocean Prediction Center
> > > > > > NCWCP
> > > > > > 5830 University Research Ct
> > > > > > College Park, MD 20740-3818
> > > > > >
> > > > > > (p) 301-683-1551 <(301)%20683-1551>
> > > > > > rosalyn.maccracken at noaa.gov
> > > > > >
> > > > >
> > > > >
> > > > >
> > > > > --
> > > > > Rosalyn MacCracken
> > > > > Support Scientist
> > > > >
> > > > > Ocean Applilcations Branch
> > > > > NOAA/NWS Ocean Prediction Center
> > > > > NCWCP
> > > > > 5830 University Research Ct
> > > > > College Park, MD 20740-3818
> > > > >
> > > > > (p) 301-683-1551
> > > > > rosalyn.maccracken at noaa.gov
> > > > >
> > > > >
> > > >
> > > >
> > >
> > >
> > > --
> > > Rosalyn MacCracken
> > > Support Scientist
> > >
> > > Ocean Applilcations Branch
> > > NOAA/NWS Ocean Prediction Center
> > > NCWCP
> > > 5830 University Research Ct
> > > College Park, MD 20740-3818
> > >
> > > (p) 301-683-1551
> > > rosalyn.maccracken at noaa.gov
> > >
> > >
> >
> >
>
>
> --
> Rosalyn MacCracken
> Support Scientist
>
> Ocean Applilcations Branch
> NOAA/NWS Ocean Prediction Center
> NCWCP
> 5830 University Research Ct
> College Park, MD 20740-3818
>
> (p) 301-683-1551
> rosalyn.maccracken at noaa.gov
>
>
------------------------------------------------
Subject: trouble with reading a grib file in point_stat
From: Rosalyn MacCracken - NOAA Affiliate
Time: Fri Sep 29 06:33:41 2017
Hi John,
Ok, my log is different than yours. I'm still only getting 142
matches. I
have a hunch that the computer is interpreting the grib file going the
wrong way around the globe, and those 142 matches are over the ocean
and
the rest are over the land. I'm attaching the logfile.
Any ideas of what it could be? I have no idea what could be making
our two
runs different.
Roz
On Thu, Sep 28, 2017 at 6:32 PM, John Halley Gotway via RT <
met_help at ucar.edu> wrote:
> Roz,
>
> I re-ran the following command, including the "-log" option this
time to
> write a log file. And I've attached that log file to the message.
>
> met-6.0/bin/point_stat \
> 20170911_1055_ndfd_oceanic_2017091110 <(201)%20709-1110>.grb2 \
> uv_wind_pb_2017091112_12.nc \
> PointStatConfig_FCST_GRID_mask \
> -outdir out -v 3 -log run_ps.log
>
> The very important info from the log file are the reason counts for
why
> observations were or were not used. Please run on your machine and
compare
> the log files to see if there are any obvious differences.
>
> Thanks,
> John
>
> On Wed, Sep 27, 2017 at 1:52 PM, Rosalyn MacCracken - NOAA Affiliate
via RT
> <met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82121 >
> >
> > Ah, ok. So, you used the grib files straight up, and didn't
convert
> them.
> > And, that's because MET knows to put them on the same type of grid
as
> wgrib
> > and GrADS does, as shown in your picture. It's only python that
doesn't
> > know how to work with out oceanic grid files, but, I'm not using
> > python...I'm using MET. :-)
> >
> > I think I had changed it to lead=3, because I had tried a
different file,
> > and changed the config file before I sent it to you. So, I used
your
> > config file, and only got 142 matches:
> >
> > Processing WIND/Z0 versus WIND/P1013, for observation type ASCATW,
over
> > region FULL, for interpolation method NEAREST(4), using 142 pairs.
> >
> > I wonder what the difference is...I'm using the same files that
you have
> > listed above, with your config file. That's strange.
> >
> > Roz
> >
> > On Wed, Sep 27, 2017 at 3:23 PM, John Halley Gotway via RT <
> > met_help at ucar.edu> wrote:
> >
> > > Roz,
> > >
> > > The plot_data_plane utility has been in MET since version 3.1 in
2012.
> > > It's a little utility that reads a 2D field of data from a
gridded data
> > > file and creates a postscript plot.
> > >
> > > It's a very useful way of quickly and easily displaying how MET
is
> > reading
> > > your data.
> > >
> > > When I run Point-Stat using the data/config file you sent, I get
this
> > > warning message:
> > >
> > > WARNING: process_fcst_climo_files() -> no fields matching
WIND/Z0 found
> > in
> > > file: 20170911_1055_ndfd_oceanic_2017091110.grb2
> > >
> > > So Point-Stat isn't able to find a match for surface wind in the
GRIB2
> > > file. You're looking for a 3-hour forecast in that file, but it
> doesn't
> > > exist. Here's some wgrib2 output:
> > >
> > > wgrib2 20170911_1055_ndfd_oceanic_2017091110.grb2 | grep WIND
> > > 100:30000082:d=2017091110:WIND:surface:2 hour fcst:
> > > 101:30498115:d=2017091110:WIND:surface:5 hour fcst:
> > > 102:30994930:d=2017091110:WIND:surface:8 hour fcst:
> > > 103:31484637:d=2017091110:WIND:surface:11 hour fcst:
> > > 104:31973373:d=2017091110:WIND:surface:14 hour fcst:
> > > 105:32463299:d=2017091110:WIND:surface:17 hour fcst:
> > >
> > > So I switched the config file to look for the 2 hour lead time
instead,
> > and
> > > that produces 14,681 matched pairs:
> > >
> > > DEBUG 2: Processing WIND/Z0 versus WIND/P1013, for observation
type
> > ASCATW,
> > > over region FULL, for interpolation method NEAREST(4), using
14681
> pairs.
> > > DEBUG 3: Number of matched pairs = 14681
> > >
> > > Please try running the following command with the attached
> configuration
> > > file:
> > >
> > > mkdir out
> > >
> > > met-6.0/bin/point_stat \
> > > 20170911_1055_ndfd_oceanic_2017091110.grb2 \
> > > uv_wind_pb_2017091112_12.nc \
> > > PointStatConfig_FCST_GRID_mask \
> > > -outdir out -v 4
> > >
> > > Does that work any better?
> > >
> > > Thanks,
> > > John
> > >
> > > On Wed, Sep 27, 2017 at 12:53 PM, Rosalyn MacCracken - NOAA
Affiliate
> via
> > > RT <met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82121
>
> > > >
> > > > You're plot looks like mine. I had to make a plot of that
lead time,
> > > but,
> > > > that is correct. It's those "bad values" that the point stat
is
> having
> > > > trouble with, I think.
> > > >
> > > > What's plot_data_plane? Is that new?
> > > >
> > > > Roz
> > > >
> > > > On Wed, Sep 27, 2017 at 2:41 PM, John Halley Gotway via RT <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > > > Roz,
> > > > >
> > > > > OK, I just ran the following MET plot_data_plane command to
plot
> the
> > > > 2-hour
> > > > > forecast of WIND (wind speed) from the GRIB2 file you sent:
> > > > >
> > > > > met-6.0/bin/plot_data_plane \
> > > > > 20170911_1055_ndfd_oceanic_2017091110.grb2 \
> > > > > wind_f02.ps \
> > > > > 'name="WIND"; level="Z0"; lead_time="02";' -v 3
> > > > >
> > > > > Running at verbosity level 3 tells me that it's correctly
plotting
> > > record
> > > > > number 100.
> > > > >
> > > > > The resulting image is attached.
> > > > >
> > > > > This looks like very reasonable data to me. There are real
data
> > values
> > > > > over Alaska and in the oceans surrounding, real values over
Hawaii,
> > > > CONUS,
> > > > > and some portions of the Atlantic and Pacific oceans.
Everywhere
> > else
> > > > > contains a bad data value.
> > > > >
> > > > > Do you see a problem in this data? If so, can you clarify
what it
> > is?
> > > > >
> > > > > Thanks,
> > > > > John
> > > > >
> > > > > On Wed, Sep 27, 2017 at 12:29 PM, Rosalyn MacCracken - NOAA
> Affiliate
> > > via
> > > > > RT <met_help at ucar.edu> wrote:
> > > > >
> > > > > >
> > > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82121 >
> > > > > >
> > > > > > Hi John,
> > > > > >
> > > > > > I've put the oceanic grid file (Grib2) and the ASCAT
netCDF file
> in
> > > my
> > > > > ftp
> > > > > > directory (maccracken_data). I'm attaching the config
file I'm
> > > using.
> > > > > So,
> > > > > > for the Grib2 file, it was created at 10z, but, I'm
actually
> > matching
> > > > up
> > > > > > the lead=2 time period (12z), with the 12z ASCAT data.
> > > > > >
> > > > > > Hopefully, it'll be an easy fix. :-)
> > > > > >
> > > > > > Roz
> > > > > >
> > > > > > On Tue, Sep 26, 2017 at 4:55 PM, Rosalyn MacCracken - NOAA
> > Affiliate
> > > <
> > > > > > rosalyn.maccracken at noaa.gov> wrote:
> > > > > >
> > > > > > > Hi John,
> > > > > > >
> > > > > > > I'll have to send it tomorrow. I've already "left" and
logged
> > off
> > > > for
> > > > > > the
> > > > > > > day.
> > > > > > >
> > > > > > > Roz
> > > > > > >
> > > > > > > On Tue, Sep 26, 2017 at 3:52 PM, John Halley Gotway via
RT <
> > > > > > > met_help at ucar.edu> wrote:
> > > > > > >
> > > > > > >> Hello Roz,
> > > > > > >>
> > > > > > >> Can you please send me the original GRIB2 file and I'll
take a
> > > look?
> > > > > > >>
> > > > > > >> Or just point me to sample file somewhere on the web?
> > > > > > >>
> > > > > > >> You can post it to our anonymous ftp site following
these
> > > > > instructions:
> > > > > > >>
http://www.dtcenter.org/met/users/support/met_help.php#ftp
> > > > > > >>
> > > > > > >> Thanks,
> > > > > > >> John
> > > > > > >>
> > > > > > >> On Tue, Sep 26, 2017 at 10:18 AM, Rosalyn MacCracken -
NOAA
> > > > Affiliate
> > > > > > via
> > > > > > >> RT <met_help at ucar.edu> wrote:
> > > > > > >>
> > > > > > >> >
> > > > > > >> > Tue Sep 26 10:18:14 2017: Request 82121 was acted
upon.
> > > > > > >> > Transaction: Ticket created by
rosalyn.maccracken at noaa.gov
> > > > > > >> > Queue: met_help
> > > > > > >> > Subject: trouble with reading a grib file in
point_stat
> > > > > > >> > Owner: Nobody
> > > > > > >> > Requestors: rosalyn.maccracken at noaa.gov
> > > > > > >> > Status: new
> > > > > > >> > Ticket <URL: https://rt.rap.ucar.edu/rt/
> > > > > Ticket/Display.html?id=82121
> > > > > > >
> > > > > > >> >
> > > > > > >> >
> > > > > > >> > Hi,
> > > > > > >> >
> > > > > > >> > I'm trying to use point_stat to obtain matches
between ASCAT
> > and
> > > > our
> > > > > > >> > oceanic grid Grib2 file. I had to first convert our
oceanic
> > > grid
> > > > > to a
> > > > > > >> > netCDF file, because of the way the is written
originally.
> If
> > > you
> > > > > > plot
> > > > > > >> the
> > > > > > >> > file with python straight from the grib2 file, the
data is
> > > plotted
> > > > > the
> > > > > > >> > wrong way around the globe, plotting the data on land
> instead
> > of
> > > > the
> > > > > > >> > ocean. It doesn't do that when the data is plotted
in
> GrADS.
> > > The
> > > > > > >> lat/lons
> > > > > > >> > are interpreted the correct way.
> > > > > > >> >
> > > > > > >> > Anyway, I used this with command when I converted it
to
> > netCDF:
> > > > > > >> > wgrib2 20170920_1655_ndfd_oceanic_2017092016.grb2
-match
> > > ':WIND:'
> > > > > > >> -netcdf
> > > > > > >> > 20170920_1655_ndfd_oceanic_2017092016_WIND.nc
> > > > > > >> >
> > > > > > >> > The attached plot is a python plot reading in the
netCDF
> file,
> > > so,
> > > > > now
> > > > > > >> it
> > > > > > >> > is on the correct lat/lon grid. But, when I use
> point_stat, I
> > > get
> > > > > > this:
> > > > > > >> >
> > > > > > >> > /opt/MET6/met6.0/bin/point_stat
> > > > > > >> >
/opc_test/home/opc_test/data/met_verif/test_fcst_grids_to_
> > > > > > >> > nc/20170911_0455_ndfd_oceanic_2017091104
> > > > <(201)%20709-1104>_WIND.nc
> > > > > > >> >
/opc_test/home/opc_test/data/met_verif/GFS/data/hourly/
> > > 2017091106
> > > > > > >> <(201)%20709-1106>/
> > > > > > >> > uv_wind_pb_2017091106_07.nc
> > > > > > >> >
/opc_test/home/opc_test/data/met_verif/test_fcst_grids_to_
> > > > > > >> > nc/PointStatConfig_FCST_GRID_mask
> > > > > > >> > -outdir /opc_test/home/opc_test/data/
> > > > met_verif/test_fcst_grids_to_
> > > > > nc/
> > > > > > >> -v 4
> > > > > > >> > DEBUG 1: Default Config File:
> > > > > > >> >
/opt/MET6/met6.0/share/met/config/PointStatConfig_default
> > > > > > >> > DEBUG 1: User Config File:
> > > > > > >> >
/opc_test/home/opc_test/data/met_verif/test_fcst_grids_to_
> > > > > > >> > nc/PointStatConfig_FCST_GRID_mask
> > > > > > >> > DEBUG 4: Met2dDataFileFactory::new_met_2d_data_file()
->
> > > created
> > > > > new
> > > > > > >> > Met2dDataFile object of type "FileType_None".
> > > > > > >> > ERROR :
> > > > > > >> > ERROR : Trouble reading forecast file
> > > > > > >> >
"/opc_test/home/opc_test/data/met_verif/test_fcst_grids_to_
> > > > > > >> > nc/20170911_0455_ndfd_oceanic_2017091104
> > > > > <(201)%20709-1104>_WIND.nc"
> > > > > > >> > ERROR :
> > > > > > >> >
> > > > > > >> > And, I think the problem is, that the missing values
are
> > denoted
> > > > as
> > > > > > >> "_", as
> > > > > > >> > seen by part of the ncdump of the variable
(WIND_surface)
> > field:
> > > > > > >> >
> > > > > > >> > _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _,
_, _, _,
> > _,
> > > _,
> > > > > _,
> > > > > > _,
> > > > > > >> > _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _,
_, _, _,
> > _,
> > > _,
> > > > > _,
> > > > > > >> _, _,
> > > > > > >> > _, _, _, _, 2.1, 2.1, 2.1, 2.1, 2.1, 1.5, 1.5,
1.5, 1.5,
> > > 1.5,
> > > > > 1.5,
> > > > > > >> 1.5,
> > > > > > >> > 1.5, 1.5, 1.5, 2.1, 2.1, 2.1, 2.1, 2.1, 2.1, 2.1,
2.6,
> > 2.6,
> > > > 2.6,
> > > > > > >> 2.6,
> > > > > > >> > 2.6, 2.6, 2.6, 3.1, 3.1, 3.1, 3.1, 3.1, 3.1, 3.1,
3.1,
> > 3.1,
> > > > 3.6,
> > > > > > >> 3.6,
> > > > > > >> >
> > > > > > >> > even though the missing field is:
> > > > > > >> > WIND_surface:_FillValue = 9.999e+20f ;
> > > > > > >> >
> > > > > > >> > So, any ideas on how to deal with the original grib2
file
> so I
> > > can
> > > > > use
> > > > > > >> > point stat? Thanks in advance!
> > > > > > >> >
> > > > > > >> > Roz
> > > > > > >> >
> > > > > > >> >
> > > > > > >> >
> > > > > > >> > --
> > > > > > >> > Rosalyn MacCracken
> > > > > > >> > Support Scientist
> > > > > > >> >
> > > > > > >> > Ocean Applilcations Branch
> > > > > > >> > NOAA/NWS Ocean Prediction Center
> > > > > > >> > NCWCP
> > > > > > >> > 5830 University Research Ct
> > > > > > >> > College Park, MD 20740-3818
> > > > > > >> >
> > > > > > >> > (p) 301-683-1551 <(301)%20683-1551>
> > > > > > >> > rosalyn.maccracken at noaa.gov
> > > > > > >> >
> > > > > > >> >
> > > > > > >>
> > > > > > >>
> > > > > > >
> > > > > > >
> > > > > > > --
> > > > > > > Rosalyn MacCracken
> > > > > > > Support Scientist
> > > > > > >
> > > > > > > Ocean Applilcations Branch
> > > > > > > NOAA/NWS Ocean Prediction Center
> > > > > > > NCWCP
> > > > > > > 5830 University Research Ct
> > > > > > > College Park, MD 20740-3818
> > > > > > >
> > > > > > > (p) 301-683-1551 <(301)%20683-1551>
> > > > > > > rosalyn.maccracken at noaa.gov
> > > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > > --
> > > > > > Rosalyn MacCracken
> > > > > > Support Scientist
> > > > > >
> > > > > > Ocean Applilcations Branch
> > > > > > NOAA/NWS Ocean Prediction Center
> > > > > > NCWCP
> > > > > > 5830 University Research Ct
> > > > > > College Park, MD 20740-3818
> > > > > >
> > > > > > (p) 301-683-1551
> > > > > > rosalyn.maccracken at noaa.gov
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > >
> > > >
> > > > --
> > > > Rosalyn MacCracken
> > > > Support Scientist
> > > >
> > > > Ocean Applilcations Branch
> > > > NOAA/NWS Ocean Prediction Center
> > > > NCWCP
> > > > 5830 University Research Ct
> > > > College Park, MD 20740-3818
> > > >
> > > > (p) 301-683-1551
> > > > rosalyn.maccracken at noaa.gov
> > > >
> > > >
> > >
> > >
> >
> >
> > --
> > Rosalyn MacCracken
> > Support Scientist
> >
> > Ocean Applilcations Branch
> > NOAA/NWS Ocean Prediction Center
> > NCWCP
> > 5830 University Research Ct
> > College Park, MD 20740-3818
> >
> > (p) 301-683-1551
> > rosalyn.maccracken at noaa.gov
> >
> >
>
>
--
Rosalyn MacCracken
Support Scientist
Ocean Applilcations Branch
NOAA/NWS Ocean Prediction Center
NCWCP
5830 University Research Ct
College Park, MD 20740-3818
(p) 301-683-1551
rosalyn.maccracken at noaa.gov
------------------------------------------------
Subject: trouble with reading a grib file in point_stat
From: Rosalyn MacCracken - NOAA Affiliate
Time: Fri Sep 29 06:33:41 2017
DEBUG 1: Default Config File:
/opt/MET6/met6.0/share/met/config/PointStatConfig_default
DEBUG 1: User Config File: PointStatConfig_FCST_GRID_mask
DEBUG 1: Forecast File: 20170911_1055_ndfd_oceanic_2017091110.grb2
DEBUG 1: Observation File: uv_wind_pb_2017091112_12.nc
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Reading data for WIND/Z0.
DEBUG 3: MetGrib2DataFile::data_plane_array() - Found exact match for
"WIND/Z0" in GRIB2 record 100 field 1 of GRIB2 file
"20170911_1055_ndfd_oceanic_2017091110.grb2"
DEBUG 3: Use the matching forecast and observation grids.
DEBUG 3: Grid Definition: Projection: Mercator Nx: 2517 Ny: 1793
Lat_LL_radians: -0.5309 Lon_LL_radians: -2.2673 Lat_UR_radians: 1.3964
Lon_UR_radians: -6.4701 Mx: 598.6453 M
y: 598.3257 Bx: -1357.3010 By: 333.7296
DEBUG 2: Processing masking regions.
DEBUG 3: Processing grid mask: FULL
DEBUG 2: For WIND/Z0 found 1 forecast levels and 0 climatology levels.
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Searching 275469 observations from 91823 messages.
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Processing WIND/Z0 versus WIND/P1013, for observation type
ASCATW, over region FULL, for interpolation method NEAREST(4), using
142 pairs.
DEBUG 3: Number of matched pairs = 142
DEBUG 3: Observations processed = 275469
DEBUG 3: Rejected: SID exclusion = 0
DEBUG 3: Rejected: GRIB code = 183646
DEBUG 3: Rejected: valid time = 0
DEBUG 3: Rejected: bad obs value = 0
DEBUG 3: Rejected: off the grid = 72562
DEBUG 3: Rejected: level mismatch = 0
DEBUG 3: Rejected: quality marker = 0
DEBUG 3: Rejected: message type = 0
DEBUG 3: Rejected: masking region = 0
DEBUG 3: Rejected: bad fcst value = 19119
DEBUG 3: Rejected: duplicates = 0
DEBUG 2: Computing Categorical Statistics.
DEBUG 2: Computing Multi-Category Statistics.
DEBUG 2: Computing Continuous Statistics.
DEBUG 2: Computing Scalar Partial Sums.
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 1: Output file: ./point_stat_mask_020000L_20170911_120000V.stat
DEBUG 1: Output file:
./point_stat_mask_020000L_20170911_120000V_ctc.txt
DEBUG 1: Output file:
./point_stat_mask_020000L_20170911_120000V_cts.txt
DEBUG 1: Output file:
./point_stat_mask_020000L_20170911_120000V_mctc.txt
DEBUG 1: Output file:
./point_stat_mask_020000L_20170911_120000V_mcts.txt
DEBUG 1: Output file:
./point_stat_mask_020000L_20170911_120000V_cnt.txt
DEBUG 1: Output file:
./point_stat_mask_020000L_20170911_120000V_sl1l2.txt
DEBUG 1: Output file:
./point_stat_mask_020000L_20170911_120000V_vl1l2.txt
DEBUG 1: Output file:
./point_stat_mask_020000L_20170911_120000V_mpr.txt
------------------------------------------------
Subject: trouble with reading a grib file in point_stat
From: John Halley Gotway
Time: Thu Oct 05 10:29:01 2017
Roz,
I apologize for the long delay in responding. I compared out two log
files
and see some odd differences. Listed below are my numbers followed by
yours:
DEBUG 3: Number of matched pairs = 14681 ---> 142
DEBUG 3: Rejected: off the grid = 31185 ---> 72562
DEBUG 3: Rejected: bad fcst value = 45957 ---> 19119
The grid definition listed in both of our log files is identical. So
why
would I have 31185 obs points off the grid while you have 72562?
I ran this data through the plot_point_obs utility:
met-6.0/bin/plot_point_obs \
uv_wind_pb_2017091112_12.nc \
uv_wind_pb_2017091112_12.ps \
-gc 32 -data_file 20170911_1055_ndfd_oceanic_2017091110.grb2
This creates a postscript image with a red dot everywhere that an
observation of wind speed (i.e. grib code = 32) occurs. The
-data_file
option tells it to plot the points on the verification grid we're
using.
Here are the log messages I see from plot_point_obs:
DEBUG 2: Retrieving grid from file:
20170911_1055_ndfd_oceanic_2017091110.grb2
DEBUG 1: Opening netCDF file: uv_wind_pb_2017091112_12.nc
DEBUG 2: Processing 275469 observations at 91823 locations.
DEBUG 2: Observation GRIB codes: 32
DEBUG 2: Observation message types: ALL
DEBUG 1: Creating postscript file: uv_wind_pb_2017091112_12.ps
DEBUG 2: Finished plotting 60597 locations.
DEBUG 2: Skipped 31226 locations off the grid.
And I've attached the resulting plot.
Note that if you increase the verbosity level to 3 (-v 3), you'll see
a
list of every single lat/lon location that is being plotted.
If your run those same commands, how does the output compare? Do you
see
any obvious problems?
Also, what machine are you running on? If someone from our team has
access
to it, perhaps we could debug directly on it.
Thanks,
John
On Fri, Sep 29, 2017 at 6:33 AM, Rosalyn MacCracken - NOAA Affiliate
via RT
<met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82121 >
>
> Hi John,
>
> Ok, my log is different than yours. I'm still only getting 142
matches. I
> have a hunch that the computer is interpreting the grib file going
the
> wrong way around the globe, and those 142 matches are over the ocean
and
> the rest are over the land. I'm attaching the logfile.
>
> Any ideas of what it could be? I have no idea what could be making
our two
> runs different.
>
> Roz
>
> On Thu, Sep 28, 2017 at 6:32 PM, John Halley Gotway via RT <
> met_help at ucar.edu> wrote:
>
> > Roz,
> >
> > I re-ran the following command, including the "-log" option this
time to
> > write a log file. And I've attached that log file to the message.
> >
> > met-6.0/bin/point_stat \
> > 20170911_1055_ndfd_oceanic_2017091110 <(201)%20709-1110>.grb2 \
> > uv_wind_pb_2017091112_12.nc \
> > PointStatConfig_FCST_GRID_mask \
> > -outdir out -v 3 -log run_ps.log
> >
> > The very important info from the log file are the reason counts
for why
> > observations were or were not used. Please run on your machine
and
> compare
> > the log files to see if there are any obvious differences.
> >
> > Thanks,
> > John
> >
> > On Wed, Sep 27, 2017 at 1:52 PM, Rosalyn MacCracken - NOAA
Affiliate via
> RT
> > <met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82121 >
> > >
> > > Ah, ok. So, you used the grib files straight up, and didn't
convert
> > them.
> > > And, that's because MET knows to put them on the same type of
grid as
> > wgrib
> > > and GrADS does, as shown in your picture. It's only python that
> doesn't
> > > know how to work with out oceanic grid files, but, I'm not using
> > > python...I'm using MET. :-)
> > >
> > > I think I had changed it to lead=3, because I had tried a
different
> file,
> > > and changed the config file before I sent it to you. So, I used
your
> > > config file, and only got 142 matches:
> > >
> > > Processing WIND/Z0 versus WIND/P1013, for observation type
ASCATW, over
> > > region FULL, for interpolation method NEAREST(4), using 142
pairs.
> > >
> > > I wonder what the difference is...I'm using the same files that
you
> have
> > > listed above, with your config file. That's strange.
> > >
> > > Roz
> > >
> > > On Wed, Sep 27, 2017 at 3:23 PM, John Halley Gotway via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > > Roz,
> > > >
> > > > The plot_data_plane utility has been in MET since version 3.1
in
> 2012.
> > > > It's a little utility that reads a 2D field of data from a
gridded
> data
> > > > file and creates a postscript plot.
> > > >
> > > > It's a very useful way of quickly and easily displaying how
MET is
> > > reading
> > > > your data.
> > > >
> > > > When I run Point-Stat using the data/config file you sent, I
get this
> > > > warning message:
> > > >
> > > > WARNING: process_fcst_climo_files() -> no fields matching
WIND/Z0
> found
> > > in
> > > > file: 20170911_1055_ndfd_oceanic_2017091110.grb2
> > > >
> > > > So Point-Stat isn't able to find a match for surface wind in
the
> GRIB2
> > > > file. You're looking for a 3-hour forecast in that file, but
it
> > doesn't
> > > > exist. Here's some wgrib2 output:
> > > >
> > > > wgrib2 20170911_1055_ndfd_oceanic_2017091110 <%28201%29%20709-
1110>.grb2
> | grep WIND
> > > > 100:30000082:d=2017091110 <%28201%29%20709-
1110>:WIND:surface:2
> hour fcst:
> > > > 101:30498115:d=2017091110 <%28201%29%20709-
1110>:WIND:surface:5
> hour fcst:
> > > > 102:30994930:d=2017091110 <%28201%29%20709-
1110>:WIND:surface:8
> hour fcst:
> > > > 103:31484637:d=2017091110 <%28201%29%20709-
1110>:WIND:surface:11
> hour fcst:
> > > > 104:31973373:d=2017091110 <%28201%29%20709-
1110>:WIND:surface:14
> hour fcst:
> > > > 105:32463299:d=2017091110 <%28201%29%20709-
1110>:WIND:surface:17
> hour fcst:
> > > >
> > > > So I switched the config file to look for the 2 hour lead time
> instead,
> > > and
> > > > that produces 14,681 matched pairs:
> > > >
> > > > DEBUG 2: Processing WIND/Z0 versus WIND/P1013, for observation
type
> > > ASCATW,
> > > > over region FULL, for interpolation method NEAREST(4), using
14681
> > pairs.
> > > > DEBUG 3: Number of matched pairs = 14681
> > > >
> > > > Please try running the following command with the attached
> > configuration
> > > > file:
> > > >
> > > > mkdir out
> > > >
> > > > met-6.0/bin/point_stat \
> > > > 20170911_1055_ndfd_oceanic_2017091110 <%28201%29%20709-
1110>.grb2 \
> > > > uv_wind_pb_2017091112_12.nc \
> > > > PointStatConfig_FCST_GRID_mask \
> > > > -outdir out -v 4
> > > >
> > > > Does that work any better?
> > > >
> > > > Thanks,
> > > > John
> > > >
> > > > On Wed, Sep 27, 2017 at 12:53 PM, Rosalyn MacCracken - NOAA
Affiliate
> > via
> > > > RT <met_help at ucar.edu> wrote:
> > > >
> > > > >
> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82121 >
> > > > >
> > > > > You're plot looks like mine. I had to make a plot of that
lead
> time,
> > > > but,
> > > > > that is correct. It's those "bad values" that the point
stat is
> > having
> > > > > trouble with, I think.
> > > > >
> > > > > What's plot_data_plane? Is that new?
> > > > >
> > > > > Roz
> > > > >
> > > > > On Wed, Sep 27, 2017 at 2:41 PM, John Halley Gotway via RT <
> > > > > met_help at ucar.edu> wrote:
> > > > >
> > > > > > Roz,
> > > > > >
> > > > > > OK, I just ran the following MET plot_data_plane command
to plot
> > the
> > > > > 2-hour
> > > > > > forecast of WIND (wind speed) from the GRIB2 file you
sent:
> > > > > >
> > > > > > met-6.0/bin/plot_data_plane \
> > > > > > 20170911_1055_ndfd_oceanic_2017091110.grb2 \
> > > > > > wind_f02.ps \
> > > > > > 'name="WIND"; level="Z0"; lead_time="02";' -v 3
> > > > > >
> > > > > > Running at verbosity level 3 tells me that it's correctly
> plotting
> > > > record
> > > > > > number 100.
> > > > > >
> > > > > > The resulting image is attached.
> > > > > >
> > > > > > This looks like very reasonable data to me. There are
real data
> > > values
> > > > > > over Alaska and in the oceans surrounding, real values
over
> Hawaii,
> > > > > CONUS,
> > > > > > and some portions of the Atlantic and Pacific oceans.
Everywhere
> > > else
> > > > > > contains a bad data value.
> > > > > >
> > > > > > Do you see a problem in this data? If so, can you clarify
what
> it
> > > is?
> > > > > >
> > > > > > Thanks,
> > > > > > John
> > > > > >
> > > > > > On Wed, Sep 27, 2017 at 12:29 PM, Rosalyn MacCracken -
NOAA
> > Affiliate
> > > > via
> > > > > > RT <met_help at ucar.edu> wrote:
> > > > > >
> > > > > > >
> > > > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82121
> >
> > > > > > >
> > > > > > > Hi John,
> > > > > > >
> > > > > > > I've put the oceanic grid file (Grib2) and the ASCAT
netCDF
> file
> > in
> > > > my
> > > > > > ftp
> > > > > > > directory (maccracken_data). I'm attaching the config
file I'm
> > > > using.
> > > > > > So,
> > > > > > > for the Grib2 file, it was created at 10z, but, I'm
actually
> > > matching
> > > > > up
> > > > > > > the lead=2 time period (12z), with the 12z ASCAT data.
> > > > > > >
> > > > > > > Hopefully, it'll be an easy fix. :-)
> > > > > > >
> > > > > > > Roz
> > > > > > >
> > > > > > > On Tue, Sep 26, 2017 at 4:55 PM, Rosalyn MacCracken -
NOAA
> > > Affiliate
> > > > <
> > > > > > > rosalyn.maccracken at noaa.gov> wrote:
> > > > > > >
> > > > > > > > Hi John,
> > > > > > > >
> > > > > > > > I'll have to send it tomorrow. I've already "left"
and
> logged
> > > off
> > > > > for
> > > > > > > the
> > > > > > > > day.
> > > > > > > >
> > > > > > > > Roz
> > > > > > > >
> > > > > > > > On Tue, Sep 26, 2017 at 3:52 PM, John Halley Gotway
via RT <
> > > > > > > > met_help at ucar.edu> wrote:
> > > > > > > >
> > > > > > > >> Hello Roz,
> > > > > > > >>
> > > > > > > >> Can you please send me the original GRIB2 file and
I'll
> take a
> > > > look?
> > > > > > > >>
> > > > > > > >> Or just point me to sample file somewhere on the web?
> > > > > > > >>
> > > > > > > >> You can post it to our anonymous ftp site following
these
> > > > > > instructions:
> > > > > > > >> http://www.dtcenter.org/met/us
> ers/support/met_help.php#ftp
> > > > > > > >>
> > > > > > > >> Thanks,
> > > > > > > >> John
> > > > > > > >>
> > > > > > > >> On Tue, Sep 26, 2017 at 10:18 AM, Rosalyn MacCracken
- NOAA
> > > > > Affiliate
> > > > > > > via
> > > > > > > >> RT <met_help at ucar.edu> wrote:
> > > > > > > >>
> > > > > > > >> >
> > > > > > > >> > Tue Sep 26 10:18:14 2017: Request 82121 was acted
upon.
> > > > > > > >> > Transaction: Ticket created by
> rosalyn.maccracken at noaa.gov
> > > > > > > >> > Queue: met_help
> > > > > > > >> > Subject: trouble with reading a grib file in
> point_stat
> > > > > > > >> > Owner: Nobody
> > > > > > > >> > Requestors: rosalyn.maccracken at noaa.gov
> > > > > > > >> > Status: new
> > > > > > > >> > Ticket <URL: https://rt.rap.ucar.edu/rt/
> > > > > > Ticket/Display.html?id=82121
> > > > > > > >
> > > > > > > >> >
> > > > > > > >> >
> > > > > > > >> > Hi,
> > > > > > > >> >
> > > > > > > >> > I'm trying to use point_stat to obtain matches
between
> ASCAT
> > > and
> > > > > our
> > > > > > > >> > oceanic grid Grib2 file. I had to first convert
our
> oceanic
> > > > grid
> > > > > > to a
> > > > > > > >> > netCDF file, because of the way the is written
originally.
> > If
> > > > you
> > > > > > > plot
> > > > > > > >> the
> > > > > > > >> > file with python straight from the grib2 file, the
data is
> > > > plotted
> > > > > > the
> > > > > > > >> > wrong way around the globe, plotting the data on
land
> > instead
> > > of
> > > > > the
> > > > > > > >> > ocean. It doesn't do that when the data is plotted
in
> > GrADS.
> > > > The
> > > > > > > >> lat/lons
> > > > > > > >> > are interpreted the correct way.
> > > > > > > >> >
> > > > > > > >> > Anyway, I used this with command when I converted
it to
> > > netCDF:
> > > > > > > >> > wgrib2 20170920_1655_ndfd_oceanic_2017092016.grb2
-match
> > > > ':WIND:'
> > > > > > > >> -netcdf
> > > > > > > >> > 20170920_1655_ndfd_oceanic_2017092016
> <%28201%29%20709-2016>_WIND.nc
> > > > > > > >> >
> > > > > > > >> > The attached plot is a python plot reading in the
netCDF
> > file,
> > > > so,
> > > > > > now
> > > > > > > >> it
> > > > > > > >> > is on the correct lat/lon grid. But, when I use
> > point_stat, I
> > > > get
> > > > > > > this:
> > > > > > > >> >
> > > > > > > >> > /opt/MET6/met6.0/bin/point_stat
> > > > > > > >> > /opc_test/home/opc_test/data/m
> et_verif/test_fcst_grids_to_
> > > > > > > >> > nc/20170911_0455_ndfd_oceanic_2017091104
> <%28201%29%20709-1104>
> > > > > <(201)%20709-1104>_WIND.nc
> > > > > > > >> >
/opc_test/home/opc_test/data/met_verif/GFS/data/hourly/
> > > > 2017091106 <%28201%29%20709-1106>
> > > > > > > >> <(201)%20709-1106>/
> > > > > > > >> > uv_wind_pb_2017091106_07.nc
> > > > > > > >> > /opc_test/home/opc_test/data/m
> et_verif/test_fcst_grids_to_
> > > > > > > >> > nc/PointStatConfig_FCST_GRID_mask
> > > > > > > >> > -outdir /opc_test/home/opc_test/data/
> > > > > met_verif/test_fcst_grids_to_
> > > > > > nc/
> > > > > > > >> -v 4
> > > > > > > >> > DEBUG 1: Default Config File:
> > > > > > > >> >
/opt/MET6/met6.0/share/met/config/PointStatConfig_default
> > > > > > > >> > DEBUG 1: User Config File:
> > > > > > > >> > /opc_test/home/opc_test/data/m
> et_verif/test_fcst_grids_to_
> > > > > > > >> > nc/PointStatConfig_FCST_GRID_mask
> > > > > > > >> > DEBUG 4:
Met2dDataFileFactory::new_met_2d_data_file() ->
> > > > created
> > > > > > new
> > > > > > > >> > Met2dDataFile object of type "FileType_None".
> > > > > > > >> > ERROR :
> > > > > > > >> > ERROR : Trouble reading forecast file
> > > > > > > >> > "/opc_test/home/opc_test/data/
> met_verif/test_fcst_grids_to_
> > > > > > > >> > nc/20170911_0455_ndfd_oceanic_2017091104
> <%28201%29%20709-1104>
> > > > > > <(201)%20709-1104>_WIND.nc"
> > > > > > > >> > ERROR :
> > > > > > > >> >
> > > > > > > >> > And, I think the problem is, that the missing
values are
> > > denoted
> > > > > as
> > > > > > > >> "_", as
> > > > > > > >> > seen by part of the ncdump of the variable
(WIND_surface)
> > > field:
> > > > > > > >> >
> > > > > > > >> > _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _,
_, _,
> _,
> > > _,
> > > > _,
> > > > > > _,
> > > > > > > _,
> > > > > > > >> > _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _,
_, _,
> _,
> > > _,
> > > > _,
> > > > > > _,
> > > > > > > >> _, _,
> > > > > > > >> > _, _, _, _, 2.1, 2.1, 2.1, 2.1, 2.1, 1.5, 1.5,
1.5,
> 1.5,
> > > > 1.5,
> > > > > > 1.5,
> > > > > > > >> 1.5,
> > > > > > > >> > 1.5, 1.5, 1.5, 2.1, 2.1, 2.1, 2.1, 2.1, 2.1,
2.1, 2.6,
> > > 2.6,
> > > > > 2.6,
> > > > > > > >> 2.6,
> > > > > > > >> > 2.6, 2.6, 2.6, 3.1, 3.1, 3.1, 3.1, 3.1, 3.1,
3.1, 3.1,
> > > 3.1,
> > > > > 3.6,
> > > > > > > >> 3.6,
> > > > > > > >> >
> > > > > > > >> > even though the missing field is:
> > > > > > > >> > WIND_surface:_FillValue = 9.999e+20f ;
> > > > > > > >> >
> > > > > > > >> > So, any ideas on how to deal with the original
grib2 file
> > so I
> > > > can
> > > > > > use
> > > > > > > >> > point stat? Thanks in advance!
> > > > > > > >> >
> > > > > > > >> > Roz
> > > > > > > >> >
> > > > > > > >> >
> > > > > > > >> >
> > > > > > > >> > --
> > > > > > > >> > Rosalyn MacCracken
> > > > > > > >> > Support Scientist
> > > > > > > >> >
> > > > > > > >> > Ocean Applilcations Branch
> > > > > > > >> > NOAA/NWS Ocean Prediction Center
> > > > > > > >> > NCWCP
> > > > > > > >> > 5830 University Research Ct
> > > > > > > >> > College Park, MD 20740-3818
> > > > > > > >> >
> > > > > > > >> > (p) 301-683-1551 <%28301%29%20683-1551>
> <(301)%20683-1551>
> > > > > > > >> > rosalyn.maccracken at noaa.gov
> > > > > > > >> >
> > > > > > > >> >
> > > > > > > >>
> > > > > > > >>
> > > > > > > >
> > > > > > > >
> > > > > > > > --
> > > > > > > > Rosalyn MacCracken
> > > > > > > > Support Scientist
> > > > > > > >
> > > > > > > > Ocean Applilcations Branch
> > > > > > > > NOAA/NWS Ocean Prediction Center
> > > > > > > > NCWCP
> > > > > > > > 5830 University Research Ct
> > > > > > > > College Park, MD 20740-3818
> > > > > > > >
> > > > > > > > (p) 301-683-1551 <(301)%20683-1551>
> > > > > > > > rosalyn.maccracken at noaa.gov
> > > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > --
> > > > > > > Rosalyn MacCracken
> > > > > > > Support Scientist
> > > > > > >
> > > > > > > Ocean Applilcations Branch
> > > > > > > NOAA/NWS Ocean Prediction Center
> > > > > > > NCWCP
> > > > > > > 5830 University Research Ct
> > > > > > > College Park, MD 20740-3818
> > > > > > >
> > > > > > > (p) 301-683-1551
> > > > > > > rosalyn.maccracken at noaa.gov
> > > > > > >
> > > > > > >
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > > > --
> > > > > Rosalyn MacCracken
> > > > > Support Scientist
> > > > >
> > > > > Ocean Applilcations Branch
> > > > > NOAA/NWS Ocean Prediction Center
> > > > > NCWCP
> > > > > 5830 University Research Ct
> > > > > College Park, MD 20740-3818
> > > > >
> > > > > (p) 301-683-1551
> > > > > rosalyn.maccracken at noaa.gov
> > > > >
> > > > >
> > > >
> > > >
> > >
> > >
> > > --
> > > Rosalyn MacCracken
> > > Support Scientist
> > >
> > > Ocean Applilcations Branch
> > > NOAA/NWS Ocean Prediction Center
> > > NCWCP
> > > 5830 University Research Ct
> > > College Park, MD 20740-3818
> > >
> > > (p) 301-683-1551
> > > rosalyn.maccracken at noaa.gov
> > >
> > >
> >
> >
>
>
> --
> Rosalyn MacCracken
> Support Scientist
>
> Ocean Applilcations Branch
> NOAA/NWS Ocean Prediction Center
> NCWCP
> 5830 University Research Ct
> College Park, MD 20740-3818
>
> (p) 301-683-1551
> rosalyn.maccracken at noaa.gov
>
>
------------------------------------------------
Subject: trouble with reading a grib file in point_stat
From: Rosalyn MacCracken - NOAA Affiliate
Time: Tue Oct 10 09:49:46 2017
Hi John,
That's ok that you didn't get back to me. I was on vacation last
week, so,
I wasn't working on anything. I've attached my image. It looks like
it
only plotted part of the image. Here's the output that I got when I
ran
the command you gave me:
/opt/MET6/met6.0/bin/plot_point_obs uv_wind_pb_2017091112_12.nc
uv_wind_pb_2017091112_12.ps -gc 32 -data_file
20170911_1055_ndfd_oceanic_2017091110.grb2
DEBUG 2: Retrieving grid from file:
20170911_1055_ndfd_oceanic_2017091110.grb2
DEBUG 1: Opening netCDF file: uv_wind_pb_2017091112_12.nc
DEBUG 2: Processing 275469 observations at 91823 locations.
DEBUG 2: Observation GRIB codes: 32
DEBUG 2: Observation message types: ALL
DEBUG 1: Creating postscript file: uv_wind_pb_2017091112_12.ps
DEBUG 2: Finished plotting 19236 locations.
DEBUG 2: Skipped 72587 locations off the grid.
So, it's obvious that I'm not plotting everything, and using
everything in
MET. I'm using an OPC machine, opc_test at vm-lnx7-opctest2. I doubt
you
have access to that. I would have to ask Fran about how you would get
access to that. I'll let you know what she says.
Roz
On Thu, Oct 5, 2017 at 12:29 PM, John Halley Gotway via RT <
met_help at ucar.edu> wrote:
> Roz,
>
> I apologize for the long delay in responding. I compared out two
log files
> and see some odd differences. Listed below are my numbers followed
by
> yours:
>
> DEBUG 3: Number of matched pairs = 14681 ---> 142
> DEBUG 3: Rejected: off the grid = 31185 ---> 72562
> DEBUG 3: Rejected: bad fcst value = 45957 ---> 19119
>
> The grid definition listed in both of our log files is identical.
So why
> would I have 31185 obs points off the grid while you have 72562?
>
> I ran this data through the plot_point_obs utility:
>
> met-6.0/bin/plot_point_obs \
> uv_wind_pb_2017091112_12.nc \
> uv_wind_pb_2017091112_12.ps \
> -gc 32 -data_file 20170911_1055_ndfd_oceanic_2017091110.grb2
>
> This creates a postscript image with a red dot everywhere that an
> observation of wind speed (i.e. grib code = 32) occurs. The
-data_file
> option tells it to plot the points on the verification grid we're
using.
>
> Here are the log messages I see from plot_point_obs:
> DEBUG 2: Retrieving grid from file:
> 20170911_1055_ndfd_oceanic_2017091110.grb2
> DEBUG 1: Opening netCDF file: uv_wind_pb_2017091112_12.nc
> DEBUG 2: Processing 275469 observations at 91823 locations.
> DEBUG 2: Observation GRIB codes: 32
> DEBUG 2: Observation message types: ALL
> DEBUG 1: Creating postscript file: uv_wind_pb_2017091112_12.ps
> DEBUG 2: Finished plotting 60597 locations.
> DEBUG 2: Skipped 31226 locations off the grid.
>
> And I've attached the resulting plot.
>
> Note that if you increase the verbosity level to 3 (-v 3), you'll
see a
> list of every single lat/lon location that is being plotted.
>
> If your run those same commands, how does the output compare? Do
you see
> any obvious problems?
>
> Also, what machine are you running on? If someone from our team has
access
> to it, perhaps we could debug directly on it.
>
> Thanks,
> John
>
>
> On Fri, Sep 29, 2017 at 6:33 AM, Rosalyn MacCracken - NOAA Affiliate
via RT
> <met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82121 >
> >
> > Hi John,
> >
> > Ok, my log is different than yours. I'm still only getting 142
> matches. I
> > have a hunch that the computer is interpreting the grib file going
the
> > wrong way around the globe, and those 142 matches are over the
ocean and
> > the rest are over the land. I'm attaching the logfile.
> >
> > Any ideas of what it could be? I have no idea what could be
making our
> two
> > runs different.
> >
> > Roz
> >
> > On Thu, Sep 28, 2017 at 6:32 PM, John Halley Gotway via RT <
> > met_help at ucar.edu> wrote:
> >
> > > Roz,
> > >
> > > I re-ran the following command, including the "-log" option this
time
> to
> > > write a log file. And I've attached that log file to the
message.
> > >
> > > met-6.0/bin/point_stat \
> > > 20170911_1055_ndfd_oceanic_2017091110 <(201)%20709-1110>.grb2 \
> > > uv_wind_pb_2017091112_12.nc \
> > > PointStatConfig_FCST_GRID_mask \
> > > -outdir out -v 3 -log run_ps.log
> > >
> > > The very important info from the log file are the reason counts
for why
> > > observations were or were not used. Please run on your machine
and
> > compare
> > > the log files to see if there are any obvious differences.
> > >
> > > Thanks,
> > > John
> > >
> > > On Wed, Sep 27, 2017 at 1:52 PM, Rosalyn MacCracken - NOAA
Affiliate
> via
> > RT
> > > <met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82121
>
> > > >
> > > > Ah, ok. So, you used the grib files straight up, and didn't
convert
> > > them.
> > > > And, that's because MET knows to put them on the same type of
grid as
> > > wgrib
> > > > and GrADS does, as shown in your picture. It's only python
that
> > doesn't
> > > > know how to work with out oceanic grid files, but, I'm not
using
> > > > python...I'm using MET. :-)
> > > >
> > > > I think I had changed it to lead=3, because I had tried a
different
> > file,
> > > > and changed the config file before I sent it to you. So, I
used your
> > > > config file, and only got 142 matches:
> > > >
> > > > Processing WIND/Z0 versus WIND/P1013, for observation type
ASCATW,
> over
> > > > region FULL, for interpolation method NEAREST(4), using 142
pairs.
> > > >
> > > > I wonder what the difference is...I'm using the same files
that you
> > have
> > > > listed above, with your config file. That's strange.
> > > >
> > > > Roz
> > > >
> > > > On Wed, Sep 27, 2017 at 3:23 PM, John Halley Gotway via RT <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > > > Roz,
> > > > >
> > > > > The plot_data_plane utility has been in MET since version
3.1 in
> > 2012.
> > > > > It's a little utility that reads a 2D field of data from a
gridded
> > data
> > > > > file and creates a postscript plot.
> > > > >
> > > > > It's a very useful way of quickly and easily displaying how
MET is
> > > > reading
> > > > > your data.
> > > > >
> > > > > When I run Point-Stat using the data/config file you sent, I
get
> this
> > > > > warning message:
> > > > >
> > > > > WARNING: process_fcst_climo_files() -> no fields matching
WIND/Z0
> > found
> > > > in
> > > > > file: 20170911_1055_ndfd_oceanic_2017091110.grb2
> > > > >
> > > > > So Point-Stat isn't able to find a match for surface wind in
the
> > GRIB2
> > > > > file. You're looking for a 3-hour forecast in that file,
but it
> > > doesn't
> > > > > exist. Here's some wgrib2 output:
> > > > >
> > > > > wgrib2 20170911_1055_ndfd_oceanic_2017091110
> <%28201%29%20709-1110>.grb2
> > | grep WIND
> > > > > 100:30000082:d=2017091110 <%28201%29%20709-
1110>:WIND:surface:2
> > hour fcst:
> > > > > 101:30498115:d=2017091110 <%28201%29%20709-
1110>:WIND:surface:5
> > hour fcst:
> > > > > 102:30994930:d=2017091110 <%28201%29%20709-
1110>:WIND:surface:8
> > hour fcst:
> > > > > 103:31484637:d=2017091110 <%28201%29%20709-
1110>:WIND:surface:11
> > hour fcst:
> > > > > 104:31973373:d=2017091110 <%28201%29%20709-
1110>:WIND:surface:14
> > hour fcst:
> > > > > 105:32463299:d=2017091110 <%28201%29%20709-
1110>:WIND:surface:17
> > hour fcst:
> > > > >
> > > > > So I switched the config file to look for the 2 hour lead
time
> > instead,
> > > > and
> > > > > that produces 14,681 matched pairs:
> > > > >
> > > > > DEBUG 2: Processing WIND/Z0 versus WIND/P1013, for
observation type
> > > > ASCATW,
> > > > > over region FULL, for interpolation method NEAREST(4), using
14681
> > > pairs.
> > > > > DEBUG 3: Number of matched pairs = 14681
> > > > >
> > > > > Please try running the following command with the attached
> > > configuration
> > > > > file:
> > > > >
> > > > > mkdir out
> > > > >
> > > > > met-6.0/bin/point_stat \
> > > > > 20170911_1055_ndfd_oceanic_2017091110 <%28201%29%20709-
1110>.grb2
> \
> > > > > uv_wind_pb_2017091112_12.nc \
> > > > > PointStatConfig_FCST_GRID_mask \
> > > > > -outdir out -v 4
> > > > >
> > > > > Does that work any better?
> > > > >
> > > > > Thanks,
> > > > > John
> > > > >
> > > > > On Wed, Sep 27, 2017 at 12:53 PM, Rosalyn MacCracken - NOAA
> Affiliate
> > > via
> > > > > RT <met_help at ucar.edu> wrote:
> > > > >
> > > > > >
> > > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82121 >
> > > > > >
> > > > > > You're plot looks like mine. I had to make a plot of that
lead
> > time,
> > > > > but,
> > > > > > that is correct. It's those "bad values" that the point
stat is
> > > having
> > > > > > trouble with, I think.
> > > > > >
> > > > > > What's plot_data_plane? Is that new?
> > > > > >
> > > > > > Roz
> > > > > >
> > > > > > On Wed, Sep 27, 2017 at 2:41 PM, John Halley Gotway via RT
<
> > > > > > met_help at ucar.edu> wrote:
> > > > > >
> > > > > > > Roz,
> > > > > > >
> > > > > > > OK, I just ran the following MET plot_data_plane command
to
> plot
> > > the
> > > > > > 2-hour
> > > > > > > forecast of WIND (wind speed) from the GRIB2 file you
sent:
> > > > > > >
> > > > > > > met-6.0/bin/plot_data_plane \
> > > > > > > 20170911_1055_ndfd_oceanic_2017091110.grb2 \
> > > > > > > wind_f02.ps \
> > > > > > > 'name="WIND"; level="Z0"; lead_time="02";' -v 3
> > > > > > >
> > > > > > > Running at verbosity level 3 tells me that it's
correctly
> > plotting
> > > > > record
> > > > > > > number 100.
> > > > > > >
> > > > > > > The resulting image is attached.
> > > > > > >
> > > > > > > This looks like very reasonable data to me. There are
real
> data
> > > > values
> > > > > > > over Alaska and in the oceans surrounding, real values
over
> > Hawaii,
> > > > > > CONUS,
> > > > > > > and some portions of the Atlantic and Pacific oceans.
> Everywhere
> > > > else
> > > > > > > contains a bad data value.
> > > > > > >
> > > > > > > Do you see a problem in this data? If so, can you
clarify what
> > it
> > > > is?
> > > > > > >
> > > > > > > Thanks,
> > > > > > > John
> > > > > > >
> > > > > > > On Wed, Sep 27, 2017 at 12:29 PM, Rosalyn MacCracken -
NOAA
> > > Affiliate
> > > > > via
> > > > > > > RT <met_help at ucar.edu> wrote:
> > > > > > >
> > > > > > > >
> > > > > > > > <URL: https://rt.rap.ucar.edu/rt/
> Ticket/Display.html?id=82121
> > >
> > > > > > > >
> > > > > > > > Hi John,
> > > > > > > >
> > > > > > > > I've put the oceanic grid file (Grib2) and the ASCAT
netCDF
> > file
> > > in
> > > > > my
> > > > > > > ftp
> > > > > > > > directory (maccracken_data). I'm attaching the config
file
> I'm
> > > > > using.
> > > > > > > So,
> > > > > > > > for the Grib2 file, it was created at 10z, but, I'm
actually
> > > > matching
> > > > > > up
> > > > > > > > the lead=2 time period (12z), with the 12z ASCAT data.
> > > > > > > >
> > > > > > > > Hopefully, it'll be an easy fix. :-)
> > > > > > > >
> > > > > > > > Roz
> > > > > > > >
> > > > > > > > On Tue, Sep 26, 2017 at 4:55 PM, Rosalyn MacCracken -
NOAA
> > > > Affiliate
> > > > > <
> > > > > > > > rosalyn.maccracken at noaa.gov> wrote:
> > > > > > > >
> > > > > > > > > Hi John,
> > > > > > > > >
> > > > > > > > > I'll have to send it tomorrow. I've already "left"
and
> > logged
> > > > off
> > > > > > for
> > > > > > > > the
> > > > > > > > > day.
> > > > > > > > >
> > > > > > > > > Roz
> > > > > > > > >
> > > > > > > > > On Tue, Sep 26, 2017 at 3:52 PM, John Halley Gotway
via RT
> <
> > > > > > > > > met_help at ucar.edu> wrote:
> > > > > > > > >
> > > > > > > > >> Hello Roz,
> > > > > > > > >>
> > > > > > > > >> Can you please send me the original GRIB2 file and
I'll
> > take a
> > > > > look?
> > > > > > > > >>
> > > > > > > > >> Or just point me to sample file somewhere on the
web?
> > > > > > > > >>
> > > > > > > > >> You can post it to our anonymous ftp site following
these
> > > > > > > instructions:
> > > > > > > > >> http://www.dtcenter.org/met/us
> > ers/support/met_help.php#ftp
> > > > > > > > >>
> > > > > > > > >> Thanks,
> > > > > > > > >> John
> > > > > > > > >>
> > > > > > > > >> On Tue, Sep 26, 2017 at 10:18 AM, Rosalyn
MacCracken -
> NOAA
> > > > > > Affiliate
> > > > > > > > via
> > > > > > > > >> RT <met_help at ucar.edu> wrote:
> > > > > > > > >>
> > > > > > > > >> >
> > > > > > > > >> > Tue Sep 26 10:18:14 2017: Request 82121 was acted
upon.
> > > > > > > > >> > Transaction: Ticket created by
> > rosalyn.maccracken at noaa.gov
> > > > > > > > >> > Queue: met_help
> > > > > > > > >> > Subject: trouble with reading a grib file in
> > point_stat
> > > > > > > > >> > Owner: Nobody
> > > > > > > > >> > Requestors: rosalyn.maccracken at noaa.gov
> > > > > > > > >> > Status: new
> > > > > > > > >> > Ticket <URL: https://rt.rap.ucar.edu/rt/
> > > > > > > Ticket/Display.html?id=82121
> > > > > > > > >
> > > > > > > > >> >
> > > > > > > > >> >
> > > > > > > > >> > Hi,
> > > > > > > > >> >
> > > > > > > > >> > I'm trying to use point_stat to obtain matches
between
> > ASCAT
> > > > and
> > > > > > our
> > > > > > > > >> > oceanic grid Grib2 file. I had to first convert
our
> > oceanic
> > > > > grid
> > > > > > > to a
> > > > > > > > >> > netCDF file, because of the way the is written
> originally.
> > > If
> > > > > you
> > > > > > > > plot
> > > > > > > > >> the
> > > > > > > > >> > file with python straight from the grib2 file,
the data
> is
> > > > > plotted
> > > > > > > the
> > > > > > > > >> > wrong way around the globe, plotting the data on
land
> > > instead
> > > > of
> > > > > > the
> > > > > > > > >> > ocean. It doesn't do that when the data is
plotted in
> > > GrADS.
> > > > > The
> > > > > > > > >> lat/lons
> > > > > > > > >> > are interpreted the correct way.
> > > > > > > > >> >
> > > > > > > > >> > Anyway, I used this with command when I converted
it to
> > > > netCDF:
> > > > > > > > >> > wgrib2 20170920_1655_ndfd_oceanic_2017092016.grb2
> -match
> > > > > ':WIND:'
> > > > > > > > >> -netcdf
> > > > > > > > >> > 20170920_1655_ndfd_oceanic_2017092016
> > <%28201%29%20709-2016>_WIND.nc
> > > > > > > > >> >
> > > > > > > > >> > The attached plot is a python plot reading in the
netCDF
> > > file,
> > > > > so,
> > > > > > > now
> > > > > > > > >> it
> > > > > > > > >> > is on the correct lat/lon grid. But, when I use
> > > point_stat, I
> > > > > get
> > > > > > > > this:
> > > > > > > > >> >
> > > > > > > > >> > /opt/MET6/met6.0/bin/point_stat
> > > > > > > > >> > /opc_test/home/opc_test/data/m
> > et_verif/test_fcst_grids_to_
> > > > > > > > >> > nc/20170911_0455_ndfd_oceanic_2017091104
> > <%28201%29%20709-1104>
> > > > > > <(201)%20709-1104>_WIND.nc
> > > > > > > > >> >
/opc_test/home/opc_test/data/met_verif/GFS/data/hourly/
> > > > > 2017091106 <%28201%29%20709-1106>
> > > > > > > > >> <(201)%20709-1106>/
> > > > > > > > >> > uv_wind_pb_2017091106_07.nc
> > > > > > > > >> > /opc_test/home/opc_test/data/m
> > et_verif/test_fcst_grids_to_
> > > > > > > > >> > nc/PointStatConfig_FCST_GRID_mask
> > > > > > > > >> > -outdir /opc_test/home/opc_test/data/
> > > > > > met_verif/test_fcst_grids_to_
> > > > > > > nc/
> > > > > > > > >> -v 4
> > > > > > > > >> > DEBUG 1: Default Config File:
> > > > > > > > >> > /opt/MET6/met6.0/share/met/
> config/PointStatConfig_default
> > > > > > > > >> > DEBUG 1: User Config File:
> > > > > > > > >> > /opc_test/home/opc_test/data/m
> > et_verif/test_fcst_grids_to_
> > > > > > > > >> > nc/PointStatConfig_FCST_GRID_mask
> > > > > > > > >> > DEBUG 4:
Met2dDataFileFactory::new_met_2d_data_file()
> ->
> > > > > created
> > > > > > > new
> > > > > > > > >> > Met2dDataFile object of type "FileType_None".
> > > > > > > > >> > ERROR :
> > > > > > > > >> > ERROR : Trouble reading forecast file
> > > > > > > > >> > "/opc_test/home/opc_test/data/
> > met_verif/test_fcst_grids_to_
> > > > > > > > >> > nc/20170911_0455_ndfd_oceanic_2017091104
> > <%28201%29%20709-1104>
> > > > > > > <(201)%20709-1104>_WIND.nc"
> > > > > > > > >> > ERROR :
> > > > > > > > >> >
> > > > > > > > >> > And, I think the problem is, that the missing
values are
> > > > denoted
> > > > > > as
> > > > > > > > >> "_", as
> > > > > > > > >> > seen by part of the ncdump of the variable
> (WIND_surface)
> > > > field:
> > > > > > > > >> >
> > > > > > > > >> > _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _,
_, _,
> _,
> > _,
> > > > _,
> > > > > _,
> > > > > > > _,
> > > > > > > > _,
> > > > > > > > >> > _, _, _, _, _, _, _, _, _, _, _, _, _, _, _,
_, _,
> _,
> > _,
> > > > _,
> > > > > _,
> > > > > > > _,
> > > > > > > > >> _, _,
> > > > > > > > >> > _, _, _, _, 2.1, 2.1, 2.1, 2.1, 2.1, 1.5,
1.5, 1.5,
> > 1.5,
> > > > > 1.5,
> > > > > > > 1.5,
> > > > > > > > >> 1.5,
> > > > > > > > >> > 1.5, 1.5, 1.5, 2.1, 2.1, 2.1, 2.1, 2.1, 2.1,
2.1,
> 2.6,
> > > > 2.6,
> > > > > > 2.6,
> > > > > > > > >> 2.6,
> > > > > > > > >> > 2.6, 2.6, 2.6, 3.1, 3.1, 3.1, 3.1, 3.1, 3.1,
3.1,
> 3.1,
> > > > 3.1,
> > > > > > 3.6,
> > > > > > > > >> 3.6,
> > > > > > > > >> >
> > > > > > > > >> > even though the missing field is:
> > > > > > > > >> > WIND_surface:_FillValue = 9.999e+20f ;
> > > > > > > > >> >
> > > > > > > > >> > So, any ideas on how to deal with the original
grib2
> file
> > > so I
> > > > > can
> > > > > > > use
> > > > > > > > >> > point stat? Thanks in advance!
> > > > > > > > >> >
> > > > > > > > >> > Roz
> > > > > > > > >> >
> > > > > > > > >> >
> > > > > > > > >> >
> > > > > > > > >> > --
> > > > > > > > >> > Rosalyn MacCracken
> > > > > > > > >> > Support Scientist
> > > > > > > > >> >
> > > > > > > > >> > Ocean Applilcations Branch
> > > > > > > > >> > NOAA/NWS Ocean Prediction Center
> > > > > > > > >> > NCWCP
> > > > > > > > >> > 5830 University Research Ct
> > > > > > > > >> > College Park, MD 20740-3818
> > > > > > > > >> >
> > > > > > > > >> > (p) 301-683-1551 <%28301%29%20683-1551>
> > <(301)%20683-1551>
> > > > > > > > >> > rosalyn.maccracken at noaa.gov
> > > > > > > > >> >
> > > > > > > > >> >
> > > > > > > > >>
> > > > > > > > >>
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > --
> > > > > > > > > Rosalyn MacCracken
> > > > > > > > > Support Scientist
> > > > > > > > >
> > > > > > > > > Ocean Applilcations Branch
> > > > > > > > > NOAA/NWS Ocean Prediction Center
> > > > > > > > > NCWCP
> > > > > > > > > 5830 University Research Ct
> > > > > > > > > College Park, MD 20740-3818
> > > > > > > > >
> > > > > > > > > (p) 301-683-1551 <(301)%20683-1551>
> > > > > > > > > rosalyn.maccracken at noaa.gov
> > > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > --
> > > > > > > > Rosalyn MacCracken
> > > > > > > > Support Scientist
> > > > > > > >
> > > > > > > > Ocean Applilcations Branch
> > > > > > > > NOAA/NWS Ocean Prediction Center
> > > > > > > > NCWCP
> > > > > > > > 5830 University Research Ct
> > > > > > > > College Park, MD 20740-3818
> > > > > > > >
> > > > > > > > (p) 301-683-1551
> > > > > > > > rosalyn.maccracken at noaa.gov
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > > >
> > > > > >
> > > > > >
> > > > > > --
> > > > > > Rosalyn MacCracken
> > > > > > Support Scientist
> > > > > >
> > > > > > Ocean Applilcations Branch
> > > > > > NOAA/NWS Ocean Prediction Center
> > > > > > NCWCP
> > > > > > 5830 University Research Ct
> > > > > > College Park, MD 20740-3818
> > > > > >
> > > > > > (p) 301-683-1551
> > > > > > rosalyn.maccracken at noaa.gov
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > >
> > > >
> > > > --
> > > > Rosalyn MacCracken
> > > > Support Scientist
> > > >
> > > > Ocean Applilcations Branch
> > > > NOAA/NWS Ocean Prediction Center
> > > > NCWCP
> > > > 5830 University Research Ct
> > > > College Park, MD 20740-3818
> > > >
> > > > (p) 301-683-1551
> > > > rosalyn.maccracken at noaa.gov
> > > >
> > > >
> > >
> > >
> >
> >
> > --
> > Rosalyn MacCracken
> > Support Scientist
> >
> > Ocean Applilcations Branch
> > NOAA/NWS Ocean Prediction Center
> > NCWCP
> > 5830 University Research Ct
> > College Park, MD 20740-3818
> >
> > (p) 301-683-1551
> > rosalyn.maccracken at noaa.gov
> >
> >
>
>
--
Rosalyn MacCracken
Support Scientist
Ocean Applilcations Branch
NOAA/NWS Ocean Prediction Center
NCWCP
5830 University Research Ct
College Park, MD 20740-3818
(p) 301-683-1551
rosalyn.maccracken at noaa.gov
------------------------------------------------
Subject: trouble with reading a grib file in point_stat
From: John Halley Gotway
Time: Tue Oct 10 12:07:33 2017
Roz,
OK, this is very good information. Looks like it's a problem with the
international date line.
The NDFD oceanic grid includes both sides of the the international
date
line. The version of met-6.0 I'm running handles it just fine. But
the
version you're running does not. It only includes points to the west
of
the international date line. And that completely explains why I got
so
many more matched pairs from Point-Stat than you did.
The next question question is why is this happening.
I tried rerunning plot_point_obs as originally released in met-6.0
with no
bug fixes... and I'm able to replicate your behavior!
So that's the solution. We just need to patch your build of met-6.0
to
include the latest set of bugfixes listed on this page:
https://dtcenter.org/met/users/support/known_issues/METv6.0/index.php
Specifically, I suspect this problem is fixed by the bugfix posted on
7/21/17:
*07/21/2017:* Fix Mercator grid support.
Glad we figured this out! Can you request that your sysadmin's
recompiled
with these patches?
Thanks,
John
On Tue, Oct 10, 2017 at 9:49 AM, Rosalyn MacCracken - NOAA Affiliate
via RT
<met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82121 >
>
> Hi John,
>
> That's ok that you didn't get back to me. I was on vacation last
week, so,
> I wasn't working on anything. I've attached my image. It looks
like it
> only plotted part of the image. Here's the output that I got when I
ran
> the command you gave me:
>
> /opt/MET6/met6.0/bin/plot_point_obs uv_wind_pb_2017091112_12.nc
> uv_wind_pb_2017091112_12.ps -gc 32 -data_file
> 20170911_1055_ndfd_oceanic_2017091110.grb2
> DEBUG 2: Retrieving grid from file:
> 20170911_1055_ndfd_oceanic_2017091110.grb2
> DEBUG 1: Opening netCDF file: uv_wind_pb_2017091112_12.nc
> DEBUG 2: Processing 275469 observations at 91823 locations.
> DEBUG 2: Observation GRIB codes: 32
> DEBUG 2: Observation message types: ALL
> DEBUG 1: Creating postscript file: uv_wind_pb_2017091112_12.ps
> DEBUG 2: Finished plotting 19236 locations.
> DEBUG 2: Skipped 72587 locations off the grid.
>
> So, it's obvious that I'm not plotting everything, and using
everything in
> MET. I'm using an OPC machine, opc_test at vm-lnx7-opctest2. I doubt
you
> have access to that. I would have to ask Fran about how you would
get
> access to that. I'll let you know what she says.
>
> Roz
>
> On Thu, Oct 5, 2017 at 12:29 PM, John Halley Gotway via RT <
> met_help at ucar.edu> wrote:
>
> > Roz,
> >
> > I apologize for the long delay in responding. I compared out two
log
> files
> > and see some odd differences. Listed below are my numbers
followed by
> > yours:
> >
> > DEBUG 3: Number of matched pairs = 14681 ---> 142
> > DEBUG 3: Rejected: off the grid = 31185 ---> 72562
> > DEBUG 3: Rejected: bad fcst value = 45957 ---> 19119
> >
> > The grid definition listed in both of our log files is identical.
So why
> > would I have 31185 obs points off the grid while you have 72562?
> >
> > I ran this data through the plot_point_obs utility:
> >
> > met-6.0/bin/plot_point_obs \
> > uv_wind_pb_2017091112_12.nc \
> > uv_wind_pb_2017091112_12.ps \
> > -gc 32 -data_file 20170911_1055_ndfd_oceanic_2017091110.grb2
> >
> > This creates a postscript image with a red dot everywhere that an
> > observation of wind speed (i.e. grib code = 32) occurs. The
-data_file
> > option tells it to plot the points on the verification grid we're
using.
> >
> > Here are the log messages I see from plot_point_obs:
> > DEBUG 2: Retrieving grid from file:
> > 20170911_1055_ndfd_oceanic_2017091110.grb2
> > DEBUG 1: Opening netCDF file: uv_wind_pb_2017091112_12.nc
> > DEBUG 2: Processing 275469 observations at 91823 locations.
> > DEBUG 2: Observation GRIB codes: 32
> > DEBUG 2: Observation message types: ALL
> > DEBUG 1: Creating postscript file: uv_wind_pb_2017091112_12.ps
> > DEBUG 2: Finished plotting 60597 locations.
> > DEBUG 2: Skipped 31226 locations off the grid.
> >
> > And I've attached the resulting plot.
> >
> > Note that if you increase the verbosity level to 3 (-v 3), you'll
see a
> > list of every single lat/lon location that is being plotted.
> >
> > If your run those same commands, how does the output compare? Do
you see
> > any obvious problems?
> >
> > Also, what machine are you running on? If someone from our team
has
> access
> > to it, perhaps we could debug directly on it.
> >
> > Thanks,
> > John
> >
> >
> > On Fri, Sep 29, 2017 at 6:33 AM, Rosalyn MacCracken - NOAA
Affiliate via
> RT
> > <met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82121 >
> > >
> > > Hi John,
> > >
> > > Ok, my log is different than yours. I'm still only getting 142
> > matches. I
> > > have a hunch that the computer is interpreting the grib file
going the
> > > wrong way around the globe, and those 142 matches are over the
ocean
> and
> > > the rest are over the land. I'm attaching the logfile.
> > >
> > > Any ideas of what it could be? I have no idea what could be
making our
> > two
> > > runs different.
> > >
> > > Roz
> > >
> > > On Thu, Sep 28, 2017 at 6:32 PM, John Halley Gotway via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > > Roz,
> > > >
> > > > I re-ran the following command, including the "-log" option
this time
> > to
> > > > write a log file. And I've attached that log file to the
message.
> > > >
> > > > met-6.0/bin/point_stat \
> > > > 20170911_1055_ndfd_oceanic_2017091110 <(201)%20709-1110>.grb2
\
> > > > uv_wind_pb_2017091112_12.nc \
> > > > PointStatConfig_FCST_GRID_mask \
> > > > -outdir out -v 3 -log run_ps.log
> > > >
> > > > The very important info from the log file are the reason
counts for
> why
> > > > observations were or were not used. Please run on your
machine and
> > > compare
> > > > the log files to see if there are any obvious differences.
> > > >
> > > > Thanks,
> > > > John
> > > >
> > > > On Wed, Sep 27, 2017 at 1:52 PM, Rosalyn MacCracken - NOAA
Affiliate
> > via
> > > RT
> > > > <met_help at ucar.edu> wrote:
> > > >
> > > > >
> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82121 >
> > > > >
> > > > > Ah, ok. So, you used the grib files straight up, and didn't
> convert
> > > > them.
> > > > > And, that's because MET knows to put them on the same type
of grid
> as
> > > > wgrib
> > > > > and GrADS does, as shown in your picture. It's only python
that
> > > doesn't
> > > > > know how to work with out oceanic grid files, but, I'm not
using
> > > > > python...I'm using MET. :-)
> > > > >
> > > > > I think I had changed it to lead=3, because I had tried a
different
> > > file,
> > > > > and changed the config file before I sent it to you. So, I
used
> your
> > > > > config file, and only got 142 matches:
> > > > >
> > > > > Processing WIND/Z0 versus WIND/P1013, for observation type
ASCATW,
> > over
> > > > > region FULL, for interpolation method NEAREST(4), using 142
pairs.
> > > > >
> > > > > I wonder what the difference is...I'm using the same files
that you
> > > have
> > > > > listed above, with your config file. That's strange.
> > > > >
> > > > > Roz
> > > > >
> > > > > On Wed, Sep 27, 2017 at 3:23 PM, John Halley Gotway via RT <
> > > > > met_help at ucar.edu> wrote:
> > > > >
> > > > > > Roz,
> > > > > >
> > > > > > The plot_data_plane utility has been in MET since version
3.1 in
> > > 2012.
> > > > > > It's a little utility that reads a 2D field of data from a
> gridded
> > > data
> > > > > > file and creates a postscript plot.
> > > > > >
> > > > > > It's a very useful way of quickly and easily displaying
how MET
> is
> > > > > reading
> > > > > > your data.
> > > > > >
> > > > > > When I run Point-Stat using the data/config file you sent,
I get
> > this
> > > > > > warning message:
> > > > > >
> > > > > > WARNING: process_fcst_climo_files() -> no fields matching
WIND/Z0
> > > found
> > > > > in
> > > > > > file: 20170911_1055_ndfd_oceanic_2017091110.grb2
> > > > > >
> > > > > > So Point-Stat isn't able to find a match for surface wind
in the
> > > GRIB2
> > > > > > file. You're looking for a 3-hour forecast in that file,
but it
> > > > doesn't
> > > > > > exist. Here's some wgrib2 output:
> > > > > >
> > > > > > wgrib2 20170911_1055_ndfd_oceanic_2017091110 <(201)%20709-
1110>
> > <%28201%29%20709-1110>.grb2
> > > | grep WIND
> > > > > > 100:30000082:d=2017091110 <%28201%29%20709-
1110>:WIND:surface:2
> > > hour fcst:
> > > > > > 101:30498115:d=2017091110 <(201)%20709-1110>
> <%28201%29%20709-1110>:WIND:surface:5
> > > hour fcst:
> > > > > > 102:30994930:d=2017091110 <(201)%20709-1110>
> <%28201%29%20709-1110>:WIND:surface:8
> > > hour fcst:
> > > > > > 103:31484637:d=2017091110 <(201)%20709-1110>
> <%28201%29%20709-1110>:WIND:surface:11
> > > hour fcst:
> > > > > > 104:31973373:d=2017091110 <(201)%20709-1110>
> <%28201%29%20709-1110>:WIND:surface:14
> > > hour fcst:
> > > > > > 105:32463299:d=2017091110 <(201)%20709-1110>
> <%28201%29%20709-1110>:WIND:surface:17
> > > hour fcst:
> > > > > >
> > > > > > So I switched the config file to look for the 2 hour lead
time
> > > instead,
> > > > > and
> > > > > > that produces 14,681 matched pairs:
> > > > > >
> > > > > > DEBUG 2: Processing WIND/Z0 versus WIND/P1013, for
observation
> type
> > > > > ASCATW,
> > > > > > over region FULL, for interpolation method NEAREST(4),
using
> 14681
> > > > pairs.
> > > > > > DEBUG 3: Number of matched pairs = 14681
> > > > > >
> > > > > > Please try running the following command with the attached
> > > > configuration
> > > > > > file:
> > > > > >
> > > > > > mkdir out
> > > > > >
> > > > > > met-6.0/bin/point_stat \
> > > > > > 20170911_1055_ndfd_oceanic_2017091110
> <%28201%29%20709-1110>.grb2
> > \
> > > > > > uv_wind_pb_2017091112_12.nc \
> > > > > > PointStatConfig_FCST_GRID_mask \
> > > > > > -outdir out -v 4
> > > > > >
> > > > > > Does that work any better?
> > > > > >
> > > > > > Thanks,
> > > > > > John
> > > > > >
> > > > > > On Wed, Sep 27, 2017 at 12:53 PM, Rosalyn MacCracken -
NOAA
> > Affiliate
> > > > via
> > > > > > RT <met_help at ucar.edu> wrote:
> > > > > >
> > > > > > >
> > > > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82121
> >
> > > > > > >
> > > > > > > You're plot looks like mine. I had to make a plot of
that lead
> > > time,
> > > > > > but,
> > > > > > > that is correct. It's those "bad values" that the point
stat
> is
> > > > having
> > > > > > > trouble with, I think.
> > > > > > >
> > > > > > > What's plot_data_plane? Is that new?
> > > > > > >
> > > > > > > Roz
> > > > > > >
> > > > > > > On Wed, Sep 27, 2017 at 2:41 PM, John Halley Gotway via
RT <
> > > > > > > met_help at ucar.edu> wrote:
> > > > > > >
> > > > > > > > Roz,
> > > > > > > >
> > > > > > > > OK, I just ran the following MET plot_data_plane
command to
> > plot
> > > > the
> > > > > > > 2-hour
> > > > > > > > forecast of WIND (wind speed) from the GRIB2 file you
sent:
> > > > > > > >
> > > > > > > > met-6.0/bin/plot_data_plane \
> > > > > > > > 20170911_1055_ndfd_oceanic_2017091110.grb2 \
> > > > > > > > wind_f02.ps \
> > > > > > > > 'name="WIND"; level="Z0"; lead_time="02";' -v 3
> > > > > > > >
> > > > > > > > Running at verbosity level 3 tells me that it's
correctly
> > > plotting
> > > > > > record
> > > > > > > > number 100.
> > > > > > > >
> > > > > > > > The resulting image is attached.
> > > > > > > >
> > > > > > > > This looks like very reasonable data to me. There are
real
> > data
> > > > > values
> > > > > > > > over Alaska and in the oceans surrounding, real values
over
> > > Hawaii,
> > > > > > > CONUS,
> > > > > > > > and some portions of the Atlantic and Pacific oceans.
> > Everywhere
> > > > > else
> > > > > > > > contains a bad data value.
> > > > > > > >
> > > > > > > > Do you see a problem in this data? If so, can you
clarify
> what
> > > it
> > > > > is?
> > > > > > > >
> > > > > > > > Thanks,
> > > > > > > > John
> > > > > > > >
> > > > > > > > On Wed, Sep 27, 2017 at 12:29 PM, Rosalyn MacCracken -
NOAA
> > > > Affiliate
> > > > > > via
> > > > > > > > RT <met_help at ucar.edu> wrote:
> > > > > > > >
> > > > > > > > >
> > > > > > > > > <URL: https://rt.rap.ucar.edu/rt/
> > Ticket/Display.html?id=82121
> > > >
> > > > > > > > >
> > > > > > > > > Hi John,
> > > > > > > > >
> > > > > > > > > I've put the oceanic grid file (Grib2) and the ASCAT
netCDF
> > > file
> > > > in
> > > > > > my
> > > > > > > > ftp
> > > > > > > > > directory (maccracken_data). I'm attaching the
config file
> > I'm
> > > > > > using.
> > > > > > > > So,
> > > > > > > > > for the Grib2 file, it was created at 10z, but, I'm
> actually
> > > > > matching
> > > > > > > up
> > > > > > > > > the lead=2 time period (12z), with the 12z ASCAT
data.
> > > > > > > > >
> > > > > > > > > Hopefully, it'll be an easy fix. :-)
> > > > > > > > >
> > > > > > > > > Roz
> > > > > > > > >
> > > > > > > > > On Tue, Sep 26, 2017 at 4:55 PM, Rosalyn MacCracken
- NOAA
> > > > > Affiliate
> > > > > > <
> > > > > > > > > rosalyn.maccracken at noaa.gov> wrote:
> > > > > > > > >
> > > > > > > > > > Hi John,
> > > > > > > > > >
> > > > > > > > > > I'll have to send it tomorrow. I've already
"left" and
> > > logged
> > > > > off
> > > > > > > for
> > > > > > > > > the
> > > > > > > > > > day.
> > > > > > > > > >
> > > > > > > > > > Roz
> > > > > > > > > >
> > > > > > > > > > On Tue, Sep 26, 2017 at 3:52 PM, John Halley
Gotway via
> RT
> > <
> > > > > > > > > > met_help at ucar.edu> wrote:
> > > > > > > > > >
> > > > > > > > > >> Hello Roz,
> > > > > > > > > >>
> > > > > > > > > >> Can you please send me the original GRIB2 file
and I'll
> > > take a
> > > > > > look?
> > > > > > > > > >>
> > > > > > > > > >> Or just point me to sample file somewhere on the
web?
> > > > > > > > > >>
> > > > > > > > > >> You can post it to our anonymous ftp site
following
> these
> > > > > > > > instructions:
> > > > > > > > > >> http://www.dtcenter.org/met/us
> > > ers/support/met_help.php#ftp
> > > > > > > > > >>
> > > > > > > > > >> Thanks,
> > > > > > > > > >> John
> > > > > > > > > >>
> > > > > > > > > >> On Tue, Sep 26, 2017 at 10:18 AM, Rosalyn
MacCracken -
> > NOAA
> > > > > > > Affiliate
> > > > > > > > > via
> > > > > > > > > >> RT <met_help at ucar.edu> wrote:
> > > > > > > > > >>
> > > > > > > > > >> >
> > > > > > > > > >> > Tue Sep 26 10:18:14 2017: Request 82121 was
acted
> upon.
> > > > > > > > > >> > Transaction: Ticket created by
> > > rosalyn.maccracken at noaa.gov
> > > > > > > > > >> > Queue: met_help
> > > > > > > > > >> > Subject: trouble with reading a grib file
in
> > > point_stat
> > > > > > > > > >> > Owner: Nobody
> > > > > > > > > >> > Requestors: rosalyn.maccracken at noaa.gov
> > > > > > > > > >> > Status: new
> > > > > > > > > >> > Ticket <URL: https://rt.rap.ucar.edu/rt/
> > > > > > > > Ticket/Display.html?id=82121
> > > > > > > > > >
> > > > > > > > > >> >
> > > > > > > > > >> >
> > > > > > > > > >> > Hi,
> > > > > > > > > >> >
> > > > > > > > > >> > I'm trying to use point_stat to obtain matches
between
> > > ASCAT
> > > > > and
> > > > > > > our
> > > > > > > > > >> > oceanic grid Grib2 file. I had to first
convert our
> > > oceanic
> > > > > > grid
> > > > > > > > to a
> > > > > > > > > >> > netCDF file, because of the way the is written
> > originally.
> > > > If
> > > > > > you
> > > > > > > > > plot
> > > > > > > > > >> the
> > > > > > > > > >> > file with python straight from the grib2 file,
the
> data
> > is
> > > > > > plotted
> > > > > > > > the
> > > > > > > > > >> > wrong way around the globe, plotting the data
on land
> > > > instead
> > > > > of
> > > > > > > the
> > > > > > > > > >> > ocean. It doesn't do that when the data is
plotted in
> > > > GrADS.
> > > > > > The
> > > > > > > > > >> lat/lons
> > > > > > > > > >> > are interpreted the correct way.
> > > > > > > > > >> >
> > > > > > > > > >> > Anyway, I used this with command when I
converted it
> to
> > > > > netCDF:
> > > > > > > > > >> > wgrib2
20170920_1655_ndfd_oceanic_2017092016.grb2
> > -match
> > > > > > ':WIND:'
> > > > > > > > > >> -netcdf
> > > > > > > > > >> > 20170920_1655_ndfd_oceanic_2017092016
> <(201)%20709-2016>
> > > <%28201%29%20709-2016>_WIND.nc
> > > > > > > > > >> >
> > > > > > > > > >> > The attached plot is a python plot reading in
the
> netCDF
> > > > file,
> > > > > > so,
> > > > > > > > now
> > > > > > > > > >> it
> > > > > > > > > >> > is on the correct lat/lon grid. But, when I
use
> > > > point_stat, I
> > > > > > get
> > > > > > > > > this:
> > > > > > > > > >> >
> > > > > > > > > >> > /opt/MET6/met6.0/bin/point_stat
> > > > > > > > > >> > /opc_test/home/opc_test/data/m
> > > et_verif/test_fcst_grids_to_
> > > > > > > > > >> > nc/20170911_0455_ndfd_oceanic_2017091104
> > > <%28201%29%20709-1104>
> > > > > > > <(201)%20709-1104>_WIND.nc
> > > > > > > > > >> > /opc_test/home/opc_test/data/m
> et_verif/GFS/data/hourly/
> > > > > > 2017091106 <%28201%29%20709-1106>
> > > > > > > > > >> <(201)%20709-1106>/
> > > > > > > > > >> > uv_wind_pb_2017091106_07.nc
> > > > > > > > > >> > /opc_test/home/opc_test/data/m
> > > et_verif/test_fcst_grids_to_
> > > > > > > > > >> > nc/PointStatConfig_FCST_GRID_mask
> > > > > > > > > >> > -outdir /opc_test/home/opc_test/data/
> > > > > > > met_verif/test_fcst_grids_to_
> > > > > > > > nc/
> > > > > > > > > >> -v 4
> > > > > > > > > >> > DEBUG 1: Default Config File:
> > > > > > > > > >> > /opt/MET6/met6.0/share/met/
> > config/PointStatConfig_default
> > > > > > > > > >> > DEBUG 1: User Config File:
> > > > > > > > > >> > /opc_test/home/opc_test/data/m
> > > et_verif/test_fcst_grids_to_
> > > > > > > > > >> > nc/PointStatConfig_FCST_GRID_mask
> > > > > > > > > >> > DEBUG 4:
Met2dDataFileFactory::new_met_2d_data_file()
> > ->
> > > > > > created
> > > > > > > > new
> > > > > > > > > >> > Met2dDataFile object of type "FileType_None".
> > > > > > > > > >> > ERROR :
> > > > > > > > > >> > ERROR : Trouble reading forecast file
> > > > > > > > > >> > "/opc_test/home/opc_test/data/
> > > met_verif/test_fcst_grids_to_
> > > > > > > > > >> > nc/20170911_0455_ndfd_oceanic_2017091104
> <(201)%20709-1104>
> > > <%28201%29%20709-1104>
> > > > > > > > <(201)%20709-1104>_WIND.nc"
> > > > > > > > > >> > ERROR :
> > > > > > > > > >> >
> > > > > > > > > >> > And, I think the problem is, that the missing
values
> are
> > > > > denoted
> > > > > > > as
> > > > > > > > > >> "_", as
> > > > > > > > > >> > seen by part of the ncdump of the variable
> > (WIND_surface)
> > > > > field:
> > > > > > > > > >> >
> > > > > > > > > >> > _, _, _, _, _, _, _, _, _, _, _, _, _, _, _,
_, _, _,
> > _,
> > > _,
> > > > > _,
> > > > > > _,
> > > > > > > > _,
> > > > > > > > > _,
> > > > > > > > > >> > _, _, _, _, _, _, _, _, _, _, _, _, _, _,
_, _, _,
> > _,
> > > _,
> > > > > _,
> > > > > > _,
> > > > > > > > _,
> > > > > > > > > >> _, _,
> > > > > > > > > >> > _, _, _, _, 2.1, 2.1, 2.1, 2.1, 2.1, 1.5,
1.5,
> 1.5,
> > > 1.5,
> > > > > > 1.5,
> > > > > > > > 1.5,
> > > > > > > > > >> 1.5,
> > > > > > > > > >> > 1.5, 1.5, 1.5, 2.1, 2.1, 2.1, 2.1, 2.1,
2.1, 2.1,
> > 2.6,
> > > > > 2.6,
> > > > > > > 2.6,
> > > > > > > > > >> 2.6,
> > > > > > > > > >> > 2.6, 2.6, 2.6, 3.1, 3.1, 3.1, 3.1, 3.1,
3.1, 3.1,
> > 3.1,
> > > > > 3.1,
> > > > > > > 3.6,
> > > > > > > > > >> 3.6,
> > > > > > > > > >> >
> > > > > > > > > >> > even though the missing field is:
> > > > > > > > > >> > WIND_surface:_FillValue = 9.999e+20f ;
> > > > > > > > > >> >
> > > > > > > > > >> > So, any ideas on how to deal with the original
grib2
> > file
> > > > so I
> > > > > > can
> > > > > > > > use
> > > > > > > > > >> > point stat? Thanks in advance!
> > > > > > > > > >> >
> > > > > > > > > >> > Roz
> > > > > > > > > >> >
> > > > > > > > > >> >
> > > > > > > > > >> >
> > > > > > > > > >> > --
> > > > > > > > > >> > Rosalyn MacCracken
> > > > > > > > > >> > Support Scientist
> > > > > > > > > >> >
> > > > > > > > > >> > Ocean Applilcations Branch
> > > > > > > > > >> > NOAA/NWS Ocean Prediction Center
> > > > > > > > > >> > NCWCP
> > > > > > > > > >> > 5830 University Research Ct
> > > > > > > > > >> > College Park, MD 20740-3818
> > > > > > > > > >> >
> > > > > > > > > >> > (p) 301-683-1551 <(301)%20683-1551>
> <%28301%29%20683-1551>
> > > <(301)%20683-1551>
> > > > > > > > > >> > rosalyn.maccracken at noaa.gov
> > > > > > > > > >> >
> > > > > > > > > >> >
> > > > > > > > > >>
> > > > > > > > > >>
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > --
> > > > > > > > > > Rosalyn MacCracken
> > > > > > > > > > Support Scientist
> > > > > > > > > >
> > > > > > > > > > Ocean Applilcations Branch
> > > > > > > > > > NOAA/NWS Ocean Prediction Center
> > > > > > > > > > NCWCP
> > > > > > > > > > 5830 University Research Ct
> > > > > > > > > > College Park, MD 20740-3818
> > > > > > > > > >
> > > > > > > > > > (p) 301-683-1551 <(301)%20683-1551> <(301)%20683-
1551>
> > > > > > > > > > rosalyn.maccracken at noaa.gov
> > > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > --
> > > > > > > > > Rosalyn MacCracken
> > > > > > > > > Support Scientist
> > > > > > > > >
> > > > > > > > > Ocean Applilcations Branch
> > > > > > > > > NOAA/NWS Ocean Prediction Center
> > > > > > > > > NCWCP
> > > > > > > > > 5830 University Research Ct
> > > > > > > > > College Park, MD 20740-3818
> > > > > > > > >
> > > > > > > > > (p) 301-683-1551 <(301)%20683-1551>
> > > > > > > > > rosalyn.maccracken at noaa.gov
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > --
> > > > > > > Rosalyn MacCracken
> > > > > > > Support Scientist
> > > > > > >
> > > > > > > Ocean Applilcations Branch
> > > > > > > NOAA/NWS Ocean Prediction Center
> > > > > > > NCWCP
> > > > > > > 5830 University Research Ct
> > > > > > > College Park, MD 20740-3818
> > > > > > >
> > > > > > > (p) 301-683-1551 <(301)%20683-1551>
> > > > > > > rosalyn.maccracken at noaa.gov
> > > > > > >
> > > > > > >
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > > > --
> > > > > Rosalyn MacCracken
> > > > > Support Scientist
> > > > >
> > > > > Ocean Applilcations Branch
> > > > > NOAA/NWS Ocean Prediction Center
> > > > > NCWCP
> > > > > 5830 University Research Ct
> > > > > College Park, MD 20740-3818
> > > > >
> > > > > (p) 301-683-1551 <(301)%20683-1551>
> > > > > rosalyn.maccracken at noaa.gov
> > > > >
> > > > >
> > > >
> > > >
> > >
> > >
> > > --
> > > Rosalyn MacCracken
> > > Support Scientist
> > >
> > > Ocean Applilcations Branch
> > > NOAA/NWS Ocean Prediction Center
> > > NCWCP
> > > 5830 University Research Ct
> > > College Park, MD 20740-3818
> > >
> > > (p) 301-683-1551 <(301)%20683-1551>
> > > rosalyn.maccracken at noaa.gov
> > >
> > >
> >
> >
>
>
> --
> Rosalyn MacCracken
> Support Scientist
>
> Ocean Applilcations Branch
> NOAA/NWS Ocean Prediction Center
> NCWCP
> 5830 University Research Ct
> College Park, MD 20740-3818
>
> (p) 301-683-1551 <(301)%20683-1551>
> rosalyn.maccracken at noaa.gov
>
>
------------------------------------------------
Subject: trouble with reading a grib file in point_stat
From: Rosalyn MacCracken - NOAA Affiliate
Time: Tue Oct 10 12:13:08 2017
Well, that certainly makes sense! I think I can get them to recompile
my
version with the bugfix, but, I'll have to coordinate with WPC, since
I
think we're sharing MET (somehow).
So, that makes me happy that you found this. It seems like an easy
fix. I
guess you can close this ticket for now, right?
Thanks for your help!
Roz
On Tue, Oct 10, 2017 at 2:07 PM, John Halley Gotway via RT <
met_help at ucar.edu> wrote:
> Roz,
>
> OK, this is very good information. Looks like it's a problem with
the
> international date line.
>
> The NDFD oceanic grid includes both sides of the the international
date
> line. The version of met-6.0 I'm running handles it just fine. But
the
> version you're running does not. It only includes points to the
west of
> the international date line. And that completely explains why I got
so
> many more matched pairs from Point-Stat than you did.
>
> The next question question is why is this happening.
>
> I tried rerunning plot_point_obs as originally released in met-6.0
with no
> bug fixes... and I'm able to replicate your behavior!
>
> So that's the solution. We just need to patch your build of met-6.0
to
> include the latest set of bugfixes listed on this page:
>
https://dtcenter.org/met/users/support/known_issues/METv6.0/index.php
>
> Specifically, I suspect this problem is fixed by the bugfix posted
on
> 7/21/17:
> *07/21/2017:* Fix Mercator grid support.
>
> Glad we figured this out! Can you request that your sysadmin's
recompiled
> with these patches?
>
> Thanks,
> John
>
>
> On Tue, Oct 10, 2017 at 9:49 AM, Rosalyn MacCracken - NOAA Affiliate
via RT
> <met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82121 >
> >
> > Hi John,
> >
> > That's ok that you didn't get back to me. I was on vacation last
week,
> so,
> > I wasn't working on anything. I've attached my image. It looks
like it
> > only plotted part of the image. Here's the output that I got when
I ran
> > the command you gave me:
> >
> > /opt/MET6/met6.0/bin/plot_point_obs uv_wind_pb_2017091112_12.nc
> > uv_wind_pb_2017091112_12.ps -gc 32 -data_file
> > 20170911_1055_ndfd_oceanic_2017091110.grb2
> > DEBUG 2: Retrieving grid from file:
> > 20170911_1055_ndfd_oceanic_2017091110.grb2
> > DEBUG 1: Opening netCDF file: uv_wind_pb_2017091112_12.nc
> > DEBUG 2: Processing 275469 observations at 91823 locations.
> > DEBUG 2: Observation GRIB codes: 32
> > DEBUG 2: Observation message types: ALL
> > DEBUG 1: Creating postscript file: uv_wind_pb_2017091112_12.ps
> > DEBUG 2: Finished plotting 19236 locations.
> > DEBUG 2: Skipped 72587 locations off the grid.
> >
> > So, it's obvious that I'm not plotting everything, and using
everything
> in
> > MET. I'm using an OPC machine, opc_test at vm-lnx7-opctest2. I
doubt you
> > have access to that. I would have to ask Fran about how you would
get
> > access to that. I'll let you know what she says.
> >
> > Roz
> >
> > On Thu, Oct 5, 2017 at 12:29 PM, John Halley Gotway via RT <
> > met_help at ucar.edu> wrote:
> >
> > > Roz,
> > >
> > > I apologize for the long delay in responding. I compared out
two log
> > files
> > > and see some odd differences. Listed below are my numbers
followed by
> > > yours:
> > >
> > > DEBUG 3: Number of matched pairs = 14681 ---> 142
> > > DEBUG 3: Rejected: off the grid = 31185 ---> 72562
> > > DEBUG 3: Rejected: bad fcst value = 45957 ---> 19119
> > >
> > > The grid definition listed in both of our log files is
identical. So
> why
> > > would I have 31185 obs points off the grid while you have 72562?
> > >
> > > I ran this data through the plot_point_obs utility:
> > >
> > > met-6.0/bin/plot_point_obs \
> > > uv_wind_pb_2017091112_12.nc \
> > > uv_wind_pb_2017091112_12.ps \
> > > -gc 32 -data_file 20170911_1055_ndfd_oceanic_2017091110.grb2
> > >
> > > This creates a postscript image with a red dot everywhere that
an
> > > observation of wind speed (i.e. grib code = 32) occurs. The
-data_file
> > > option tells it to plot the points on the verification grid
we're
> using.
> > >
> > > Here are the log messages I see from plot_point_obs:
> > > DEBUG 2: Retrieving grid from file:
> > > 20170911_1055_ndfd_oceanic_2017091110.grb2
> > > DEBUG 1: Opening netCDF file: uv_wind_pb_2017091112_12.nc
> > > DEBUG 2: Processing 275469 observations at 91823 locations.
> > > DEBUG 2: Observation GRIB codes: 32
> > > DEBUG 2: Observation message types: ALL
> > > DEBUG 1: Creating postscript file: uv_wind_pb_2017091112_12.ps
> > > DEBUG 2: Finished plotting 60597 locations.
> > > DEBUG 2: Skipped 31226 locations off the grid.
> > >
> > > And I've attached the resulting plot.
> > >
> > > Note that if you increase the verbosity level to 3 (-v 3),
you'll see a
> > > list of every single lat/lon location that is being plotted.
> > >
> > > If your run those same commands, how does the output compare?
Do you
> see
> > > any obvious problems?
> > >
> > > Also, what machine are you running on? If someone from our team
has
> > access
> > > to it, perhaps we could debug directly on it.
> > >
> > > Thanks,
> > > John
> > >
> > >
> > > On Fri, Sep 29, 2017 at 6:33 AM, Rosalyn MacCracken - NOAA
Affiliate
> via
> > RT
> > > <met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82121
>
> > > >
> > > > Hi John,
> > > >
> > > > Ok, my log is different than yours. I'm still only getting
142
> > > matches. I
> > > > have a hunch that the computer is interpreting the grib file
going
> the
> > > > wrong way around the globe, and those 142 matches are over the
ocean
> > and
> > > > the rest are over the land. I'm attaching the logfile.
> > > >
> > > > Any ideas of what it could be? I have no idea what could be
making
> our
> > > two
> > > > runs different.
> > > >
> > > > Roz
> > > >
> > > > On Thu, Sep 28, 2017 at 6:32 PM, John Halley Gotway via RT <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > > > Roz,
> > > > >
> > > > > I re-ran the following command, including the "-log" option
this
> time
> > > to
> > > > > write a log file. And I've attached that log file to the
message.
> > > > >
> > > > > met-6.0/bin/point_stat \
> > > > > 20170911_1055_ndfd_oceanic_2017091110 <(201)%20709-
1110>.grb2 \
> > > > > uv_wind_pb_2017091112_12.nc \
> > > > > PointStatConfig_FCST_GRID_mask \
> > > > > -outdir out -v 3 -log run_ps.log
> > > > >
> > > > > The very important info from the log file are the reason
counts for
> > why
> > > > > observations were or were not used. Please run on your
machine and
> > > > compare
> > > > > the log files to see if there are any obvious differences.
> > > > >
> > > > > Thanks,
> > > > > John
> > > > >
> > > > > On Wed, Sep 27, 2017 at 1:52 PM, Rosalyn MacCracken - NOAA
> Affiliate
> > > via
> > > > RT
> > > > > <met_help at ucar.edu> wrote:
> > > > >
> > > > > >
> > > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82121 >
> > > > > >
> > > > > > Ah, ok. So, you used the grib files straight up, and
didn't
> > convert
> > > > > them.
> > > > > > And, that's because MET knows to put them on the same type
of
> grid
> > as
> > > > > wgrib
> > > > > > and GrADS does, as shown in your picture. It's only
python that
> > > > doesn't
> > > > > > know how to work with out oceanic grid files, but, I'm not
using
> > > > > > python...I'm using MET. :-)
> > > > > >
> > > > > > I think I had changed it to lead=3, because I had tried a
> different
> > > > file,
> > > > > > and changed the config file before I sent it to you. So,
I used
> > your
> > > > > > config file, and only got 142 matches:
> > > > > >
> > > > > > Processing WIND/Z0 versus WIND/P1013, for observation type
> ASCATW,
> > > over
> > > > > > region FULL, for interpolation method NEAREST(4), using
142
> pairs.
> > > > > >
> > > > > > I wonder what the difference is...I'm using the same files
that
> you
> > > > have
> > > > > > listed above, with your config file. That's strange.
> > > > > >
> > > > > > Roz
> > > > > >
> > > > > > On Wed, Sep 27, 2017 at 3:23 PM, John Halley Gotway via RT
<
> > > > > > met_help at ucar.edu> wrote:
> > > > > >
> > > > > > > Roz,
> > > > > > >
> > > > > > > The plot_data_plane utility has been in MET since
version 3.1
> in
> > > > 2012.
> > > > > > > It's a little utility that reads a 2D field of data from
a
> > gridded
> > > > data
> > > > > > > file and creates a postscript plot.
> > > > > > >
> > > > > > > It's a very useful way of quickly and easily displaying
how MET
> > is
> > > > > > reading
> > > > > > > your data.
> > > > > > >
> > > > > > > When I run Point-Stat using the data/config file you
sent, I
> get
> > > this
> > > > > > > warning message:
> > > > > > >
> > > > > > > WARNING: process_fcst_climo_files() -> no fields
matching
> WIND/Z0
> > > > found
> > > > > > in
> > > > > > > file: 20170911_1055_ndfd_oceanic_2017091110.grb2
> > > > > > >
> > > > > > > So Point-Stat isn't able to find a match for surface
wind in
> the
> > > > GRIB2
> > > > > > > file. You're looking for a 3-hour forecast in that
file, but
> it
> > > > > doesn't
> > > > > > > exist. Here's some wgrib2 output:
> > > > > > >
> > > > > > > wgrib2 20170911_1055_ndfd_oceanic_2017091110
> <(201)%20709-1110>
> > > <%28201%29%20709-1110>.grb2
> > > > | grep WIND
> > > > > > > 100:30000082:d=2017091110 <%28201%29%20709-1110>:WIND:
> surface:2
> > > > hour fcst:
> > > > > > > 101:30498115:d=2017091110 <(201)%20709-1110>
> > <%28201%29%20709-1110>:WIND:surface:5
> > > > hour fcst:
> > > > > > > 102:30994930:d=2017091110 <(201)%20709-1110>
> > <%28201%29%20709-1110>:WIND:surface:8
> > > > hour fcst:
> > > > > > > 103:31484637:d=2017091110 <(201)%20709-1110>
> > <%28201%29%20709-1110>:WIND:surface:11
> > > > hour fcst:
> > > > > > > 104:31973373:d=2017091110 <(201)%20709-1110>
> > <%28201%29%20709-1110>:WIND:surface:14
> > > > hour fcst:
> > > > > > > 105:32463299:d=2017091110 <(201)%20709-1110>
> > <%28201%29%20709-1110>:WIND:surface:17
> > > > hour fcst:
> > > > > > >
> > > > > > > So I switched the config file to look for the 2 hour
lead time
> > > > instead,
> > > > > > and
> > > > > > > that produces 14,681 matched pairs:
> > > > > > >
> > > > > > > DEBUG 2: Processing WIND/Z0 versus WIND/P1013, for
observation
> > type
> > > > > > ASCATW,
> > > > > > > over region FULL, for interpolation method NEAREST(4),
using
> > 14681
> > > > > pairs.
> > > > > > > DEBUG 3: Number of matched pairs = 14681
> > > > > > >
> > > > > > > Please try running the following command with the
attached
> > > > > configuration
> > > > > > > file:
> > > > > > >
> > > > > > > mkdir out
> > > > > > >
> > > > > > > met-6.0/bin/point_stat \
> > > > > > > 20170911_1055_ndfd_oceanic_2017091110
> > <%28201%29%20709-1110>.grb2
> > > \
> > > > > > > uv_wind_pb_2017091112_12.nc \
> > > > > > > PointStatConfig_FCST_GRID_mask \
> > > > > > > -outdir out -v 4
> > > > > > >
> > > > > > > Does that work any better?
> > > > > > >
> > > > > > > Thanks,
> > > > > > > John
> > > > > > >
> > > > > > > On Wed, Sep 27, 2017 at 12:53 PM, Rosalyn MacCracken -
NOAA
> > > Affiliate
> > > > > via
> > > > > > > RT <met_help at ucar.edu> wrote:
> > > > > > >
> > > > > > > >
> > > > > > > > <URL: https://rt.rap.ucar.edu/rt/
> Ticket/Display.html?id=82121
> > >
> > > > > > > >
> > > > > > > > You're plot looks like mine. I had to make a plot of
that
> lead
> > > > time,
> > > > > > > but,
> > > > > > > > that is correct. It's those "bad values" that the
point stat
> > is
> > > > > having
> > > > > > > > trouble with, I think.
> > > > > > > >
> > > > > > > > What's plot_data_plane? Is that new?
> > > > > > > >
> > > > > > > > Roz
> > > > > > > >
> > > > > > > > On Wed, Sep 27, 2017 at 2:41 PM, John Halley Gotway
via RT <
> > > > > > > > met_help at ucar.edu> wrote:
> > > > > > > >
> > > > > > > > > Roz,
> > > > > > > > >
> > > > > > > > > OK, I just ran the following MET plot_data_plane
command to
> > > plot
> > > > > the
> > > > > > > > 2-hour
> > > > > > > > > forecast of WIND (wind speed) from the GRIB2 file
you sent:
> > > > > > > > >
> > > > > > > > > met-6.0/bin/plot_data_plane \
> > > > > > > > > 20170911_1055_ndfd_oceanic_2017091110.grb2 \
> > > > > > > > > wind_f02.ps \
> > > > > > > > > 'name="WIND"; level="Z0"; lead_time="02";' -v 3
> > > > > > > > >
> > > > > > > > > Running at verbosity level 3 tells me that it's
correctly
> > > > plotting
> > > > > > > record
> > > > > > > > > number 100.
> > > > > > > > >
> > > > > > > > > The resulting image is attached.
> > > > > > > > >
> > > > > > > > > This looks like very reasonable data to me. There
are real
> > > data
> > > > > > values
> > > > > > > > > over Alaska and in the oceans surrounding, real
values over
> > > > Hawaii,
> > > > > > > > CONUS,
> > > > > > > > > and some portions of the Atlantic and Pacific
oceans.
> > > Everywhere
> > > > > > else
> > > > > > > > > contains a bad data value.
> > > > > > > > >
> > > > > > > > > Do you see a problem in this data? If so, can you
clarify
> > what
> > > > it
> > > > > > is?
> > > > > > > > >
> > > > > > > > > Thanks,
> > > > > > > > > John
> > > > > > > > >
> > > > > > > > > On Wed, Sep 27, 2017 at 12:29 PM, Rosalyn MacCracken
- NOAA
> > > > > Affiliate
> > > > > > > via
> > > > > > > > > RT <met_help at ucar.edu> wrote:
> > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > <URL: https://rt.rap.ucar.edu/rt/
> > > Ticket/Display.html?id=82121
> > > > >
> > > > > > > > > >
> > > > > > > > > > Hi John,
> > > > > > > > > >
> > > > > > > > > > I've put the oceanic grid file (Grib2) and the
ASCAT
> netCDF
> > > > file
> > > > > in
> > > > > > > my
> > > > > > > > > ftp
> > > > > > > > > > directory (maccracken_data). I'm attaching the
config
> file
> > > I'm
> > > > > > > using.
> > > > > > > > > So,
> > > > > > > > > > for the Grib2 file, it was created at 10z, but,
I'm
> > actually
> > > > > > matching
> > > > > > > > up
> > > > > > > > > > the lead=2 time period (12z), with the 12z ASCAT
data.
> > > > > > > > > >
> > > > > > > > > > Hopefully, it'll be an easy fix. :-)
> > > > > > > > > >
> > > > > > > > > > Roz
> > > > > > > > > >
> > > > > > > > > > On Tue, Sep 26, 2017 at 4:55 PM, Rosalyn
MacCracken -
> NOAA
> > > > > > Affiliate
> > > > > > > <
> > > > > > > > > > rosalyn.maccracken at noaa.gov> wrote:
> > > > > > > > > >
> > > > > > > > > > > Hi John,
> > > > > > > > > > >
> > > > > > > > > > > I'll have to send it tomorrow. I've already
"left" and
> > > > logged
> > > > > > off
> > > > > > > > for
> > > > > > > > > > the
> > > > > > > > > > > day.
> > > > > > > > > > >
> > > > > > > > > > > Roz
> > > > > > > > > > >
> > > > > > > > > > > On Tue, Sep 26, 2017 at 3:52 PM, John Halley
Gotway via
> > RT
> > > <
> > > > > > > > > > > met_help at ucar.edu> wrote:
> > > > > > > > > > >
> > > > > > > > > > >> Hello Roz,
> > > > > > > > > > >>
> > > > > > > > > > >> Can you please send me the original GRIB2 file
and
> I'll
> > > > take a
> > > > > > > look?
> > > > > > > > > > >>
> > > > > > > > > > >> Or just point me to sample file somewhere on
the web?
> > > > > > > > > > >>
> > > > > > > > > > >> You can post it to our anonymous ftp site
following
> > these
> > > > > > > > > instructions:
> > > > > > > > > > >> http://www.dtcenter.org/met/us
> > > > ers/support/met_help.php#ftp
> > > > > > > > > > >>
> > > > > > > > > > >> Thanks,
> > > > > > > > > > >> John
> > > > > > > > > > >>
> > > > > > > > > > >> On Tue, Sep 26, 2017 at 10:18 AM, Rosalyn
MacCracken -
> > > NOAA
> > > > > > > > Affiliate
> > > > > > > > > > via
> > > > > > > > > > >> RT <met_help at ucar.edu> wrote:
> > > > > > > > > > >>
> > > > > > > > > > >> >
> > > > > > > > > > >> > Tue Sep 26 10:18:14 2017: Request 82121 was
acted
> > upon.
> > > > > > > > > > >> > Transaction: Ticket created by
> > > > rosalyn.maccracken at noaa.gov
> > > > > > > > > > >> > Queue: met_help
> > > > > > > > > > >> > Subject: trouble with reading a grib
file in
> > > > point_stat
> > > > > > > > > > >> > Owner: Nobody
> > > > > > > > > > >> > Requestors: rosalyn.maccracken at noaa.gov
> > > > > > > > > > >> > Status: new
> > > > > > > > > > >> > Ticket <URL: https://rt.rap.ucar.edu/rt/
> > > > > > > > > Ticket/Display.html?id=82121
> > > > > > > > > > >
> > > > > > > > > > >> >
> > > > > > > > > > >> >
> > > > > > > > > > >> > Hi,
> > > > > > > > > > >> >
> > > > > > > > > > >> > I'm trying to use point_stat to obtain
matches
> between
> > > > ASCAT
> > > > > > and
> > > > > > > > our
> > > > > > > > > > >> > oceanic grid Grib2 file. I had to first
convert our
> > > > oceanic
> > > > > > > grid
> > > > > > > > > to a
> > > > > > > > > > >> > netCDF file, because of the way the is
written
> > > originally.
> > > > > If
> > > > > > > you
> > > > > > > > > > plot
> > > > > > > > > > >> the
> > > > > > > > > > >> > file with python straight from the grib2
file, the
> > data
> > > is
> > > > > > > plotted
> > > > > > > > > the
> > > > > > > > > > >> > wrong way around the globe, plotting the data
on
> land
> > > > > instead
> > > > > > of
> > > > > > > > the
> > > > > > > > > > >> > ocean. It doesn't do that when the data is
plotted
> in
> > > > > GrADS.
> > > > > > > The
> > > > > > > > > > >> lat/lons
> > > > > > > > > > >> > are interpreted the correct way.
> > > > > > > > > > >> >
> > > > > > > > > > >> > Anyway, I used this with command when I
converted it
> > to
> > > > > > netCDF:
> > > > > > > > > > >> > wgrib2
20170920_1655_ndfd_oceanic_2017092016.grb2
> > > -match
> > > > > > > ':WIND:'
> > > > > > > > > > >> -netcdf
> > > > > > > > > > >> > 20170920_1655_ndfd_oceanic_2017092016
> > <(201)%20709-2016>
> > > > <%28201%29%20709-2016>_WIND.nc
> > > > > > > > > > >> >
> > > > > > > > > > >> > The attached plot is a python plot reading in
the
> > netCDF
> > > > > file,
> > > > > > > so,
> > > > > > > > > now
> > > > > > > > > > >> it
> > > > > > > > > > >> > is on the correct lat/lon grid. But, when I
use
> > > > > point_stat, I
> > > > > > > get
> > > > > > > > > > this:
> > > > > > > > > > >> >
> > > > > > > > > > >> > /opt/MET6/met6.0/bin/point_stat
> > > > > > > > > > >> > /opc_test/home/opc_test/data/m
> > > > et_verif/test_fcst_grids_to_
> > > > > > > > > > >> > nc/20170911_0455_ndfd_oceanic_2017091104
> > > > <%28201%29%20709-1104>
> > > > > > > > <(201)%20709-1104>_WIND.nc
> > > > > > > > > > >> > /opc_test/home/opc_test/data/m
> > et_verif/GFS/data/hourly/
> > > > > > > 2017091106 <%28201%29%20709-1106>
> > > > > > > > > > >> <(201)%20709-1106>/
> > > > > > > > > > >> > uv_wind_pb_2017091106_07.nc
> > > > > > > > > > >> > /opc_test/home/opc_test/data/m
> > > > et_verif/test_fcst_grids_to_
> > > > > > > > > > >> > nc/PointStatConfig_FCST_GRID_mask
> > > > > > > > > > >> > -outdir /opc_test/home/opc_test/data/
> > > > > > > > met_verif/test_fcst_grids_to_
> > > > > > > > > nc/
> > > > > > > > > > >> -v 4
> > > > > > > > > > >> > DEBUG 1: Default Config File:
> > > > > > > > > > >> > /opt/MET6/met6.0/share/met/
> > > config/PointStatConfig_default
> > > > > > > > > > >> > DEBUG 1: User Config File:
> > > > > > > > > > >> > /opc_test/home/opc_test/data/m
> > > > et_verif/test_fcst_grids_to_
> > > > > > > > > > >> > nc/PointStatConfig_FCST_GRID_mask
> > > > > > > > > > >> > DEBUG 4: Met2dDataFileFactory::new_met_
> 2d_data_file()
> > > ->
> > > > > > > created
> > > > > > > > > new
> > > > > > > > > > >> > Met2dDataFile object of type "FileType_None".
> > > > > > > > > > >> > ERROR :
> > > > > > > > > > >> > ERROR : Trouble reading forecast file
> > > > > > > > > > >> > "/opc_test/home/opc_test/data/
> > > > met_verif/test_fcst_grids_to_
> > > > > > > > > > >> > nc/20170911_0455_ndfd_oceanic_2017091104
> > <(201)%20709-1104>
> > > > <%28201%29%20709-1104>
> > > > > > > > > <(201)%20709-1104>_WIND.nc"
> > > > > > > > > > >> > ERROR :
> > > > > > > > > > >> >
> > > > > > > > > > >> > And, I think the problem is, that the missing
values
> > are
> > > > > > denoted
> > > > > > > > as
> > > > > > > > > > >> "_", as
> > > > > > > > > > >> > seen by part of the ncdump of the variable
> > > (WIND_surface)
> > > > > > field:
> > > > > > > > > > >> >
> > > > > > > > > > >> > _, _, _, _, _, _, _, _, _, _, _, _, _, _, _,
_, _,
> _,
> > > _,
> > > > _,
> > > > > > _,
> > > > > > > _,
> > > > > > > > > _,
> > > > > > > > > > _,
> > > > > > > > > > >> > _, _, _, _, _, _, _, _, _, _, _, _, _, _,
_, _,
> _,
> > > _,
> > > > _,
> > > > > > _,
> > > > > > > _,
> > > > > > > > > _,
> > > > > > > > > > >> _, _,
> > > > > > > > > > >> > _, _, _, _, 2.1, 2.1, 2.1, 2.1, 2.1, 1.5,
1.5,
> > 1.5,
> > > > 1.5,
> > > > > > > 1.5,
> > > > > > > > > 1.5,
> > > > > > > > > > >> 1.5,
> > > > > > > > > > >> > 1.5, 1.5, 1.5, 2.1, 2.1, 2.1, 2.1, 2.1,
2.1,
> 2.1,
> > > 2.6,
> > > > > > 2.6,
> > > > > > > > 2.6,
> > > > > > > > > > >> 2.6,
> > > > > > > > > > >> > 2.6, 2.6, 2.6, 3.1, 3.1, 3.1, 3.1, 3.1,
3.1,
> 3.1,
> > > 3.1,
> > > > > > 3.1,
> > > > > > > > 3.6,
> > > > > > > > > > >> 3.6,
> > > > > > > > > > >> >
> > > > > > > > > > >> > even though the missing field is:
> > > > > > > > > > >> > WIND_surface:_FillValue = 9.999e+20f ;
> > > > > > > > > > >> >
> > > > > > > > > > >> > So, any ideas on how to deal with the
original grib2
> > > file
> > > > > so I
> > > > > > > can
> > > > > > > > > use
> > > > > > > > > > >> > point stat? Thanks in advance!
> > > > > > > > > > >> >
> > > > > > > > > > >> > Roz
> > > > > > > > > > >> >
> > > > > > > > > > >> >
> > > > > > > > > > >> >
> > > > > > > > > > >> > --
> > > > > > > > > > >> > Rosalyn MacCracken
> > > > > > > > > > >> > Support Scientist
> > > > > > > > > > >> >
> > > > > > > > > > >> > Ocean Applilcations Branch
> > > > > > > > > > >> > NOAA/NWS Ocean Prediction Center
> > > > > > > > > > >> > NCWCP
> > > > > > > > > > >> > 5830 University Research Ct
> > > > > > > > > > >> > College Park, MD 20740-3818
> > > > > > > > > > >> >
> > > > > > > > > > >> > (p) 301-683-1551 <(301)%20683-1551>
> > <%28301%29%20683-1551>
> > > > <(301)%20683-1551>
> > > > > > > > > > >> > rosalyn.maccracken at noaa.gov
> > > > > > > > > > >> >
> > > > > > > > > > >> >
> > > > > > > > > > >>
> > > > > > > > > > >>
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > --
> > > > > > > > > > > Rosalyn MacCracken
> > > > > > > > > > > Support Scientist
> > > > > > > > > > >
> > > > > > > > > > > Ocean Applilcations Branch
> > > > > > > > > > > NOAA/NWS Ocean Prediction Center
> > > > > > > > > > > NCWCP
> > > > > > > > > > > 5830 University Research Ct
> > > > > > > > > > > College Park, MD 20740-3818
> > > > > > > > > > >
> > > > > > > > > > > (p) 301-683-1551 <(301)%20683-1551>
<(301)%20683-1551>
> > > > > > > > > > > rosalyn.maccracken at noaa.gov
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > --
> > > > > > > > > > Rosalyn MacCracken
> > > > > > > > > > Support Scientist
> > > > > > > > > >
> > > > > > > > > > Ocean Applilcations Branch
> > > > > > > > > > NOAA/NWS Ocean Prediction Center
> > > > > > > > > > NCWCP
> > > > > > > > > > 5830 University Research Ct
> > > > > > > > > > College Park, MD 20740-3818
> > > > > > > > > >
> > > > > > > > > > (p) 301-683-1551 <(301)%20683-1551>
> > > > > > > > > > rosalyn.maccracken at noaa.gov
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > --
> > > > > > > > Rosalyn MacCracken
> > > > > > > > Support Scientist
> > > > > > > >
> > > > > > > > Ocean Applilcations Branch
> > > > > > > > NOAA/NWS Ocean Prediction Center
> > > > > > > > NCWCP
> > > > > > > > 5830 University Research Ct
> > > > > > > > College Park, MD 20740-3818
> > > > > > > >
> > > > > > > > (p) 301-683-1551 <(301)%20683-1551>
> > > > > > > > rosalyn.maccracken at noaa.gov
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > > >
> > > > > >
> > > > > >
> > > > > > --
> > > > > > Rosalyn MacCracken
> > > > > > Support Scientist
> > > > > >
> > > > > > Ocean Applilcations Branch
> > > > > > NOAA/NWS Ocean Prediction Center
> > > > > > NCWCP
> > > > > > 5830 University Research Ct
> > > > > > College Park, MD 20740-3818
> > > > > >
> > > > > > (p) 301-683-1551 <(301)%20683-1551>
> > > > > > rosalyn.maccracken at noaa.gov
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > >
> > > >
> > > > --
> > > > Rosalyn MacCracken
> > > > Support Scientist
> > > >
> > > > Ocean Applilcations Branch
> > > > NOAA/NWS Ocean Prediction Center
> > > > NCWCP
> > > > 5830 University Research Ct
> > > > College Park, MD 20740-3818
> > > >
> > > > (p) 301-683-1551 <(301)%20683-1551>
> > > > rosalyn.maccracken at noaa.gov
> > > >
> > > >
> > >
> > >
> >
> >
> > --
> > Rosalyn MacCracken
> > Support Scientist
> >
> > Ocean Applilcations Branch
> > NOAA/NWS Ocean Prediction Center
> > NCWCP
> > 5830 University Research Ct
> > College Park, MD 20740-3818
> >
> > (p) 301-683-1551 <(301)%20683-1551>
> > rosalyn.maccracken at noaa.gov
> >
> >
>
>
--
Rosalyn MacCracken
Support Scientist
Ocean Applilcations Branch
NOAA/NWS Ocean Prediction Center
NCWCP
5830 University Research Ct
College Park, MD 20740-3818
(p) 301-683-1551
rosalyn.maccracken at noaa.gov
------------------------------------------------
More information about the Met_help
mailing list