[Met_help] [rt.rap.ucar.edu #83140] History for halp in file format with MET 5.2
John Halley Gotway via RT
met_help at ucar.edu
Tue Jul 9 12:04:04 MDT 2019
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Dear MET help desk,
I'm trying to use MET suite for some analysis using some regridded HRRR and
StageIV data.
The data has been given to me in netcdf format, already regridded. Every
kind of MET tool I'm trying to run on it, I got this error:
get_field() -> can't open data file "17039000000100.TP_1Hour.nc"
How can I solve the problem? if i try other files from the tutorial (both
netcdf and grib) they work. I attach the ncdump of my HRRR and StageIV
files. Let me know if you want me to attach the whole files.
Thank you in advance for your kind attention and cooperation,
Francesca
netcdf \17039000000100.TP_1Hour {
dimensions:
ygrid_0 = 1059 ;
xgrid_0 = 1799 ;
variables:
float gridlat_0(ygrid_0, xgrid_0) ;
gridlat_0:corners = 21.13812f, 21.14055f, 47.84219f, 47.83862f ;
gridlat_0:long_name = "latitude" ;
gridlat_0:grid_type = "Lambert Conformal (secant, tangent, conical or
bipolar)" ;
gridlat_0:units = "degrees_north" ;
gridlat_0:Latin2 = 38.5f ;
gridlat_0:Latin1 = 38.5f ;
gridlat_0:Dy = 3.f ;
gridlat_0:Dx = 3.f ;
gridlat_0:Lov = 262.5f ;
gridlat_0:Lo1 = 237.2805f ;
gridlat_0:La1 = 21.13812f ;
float gridlon_0(ygrid_0, xgrid_0) ;
gridlon_0:corners = -122.7195f, -72.28972f, -60.91719f, -134.0955f ;
gridlon_0:long_name = "longitude" ;
gridlon_0:grid_type = "Lambert Conformal (secant, tangent, conical or
bipolar)" ;
gridlon_0:units = "degrees_east" ;
gridlon_0:Latin2 = 38.5f ;
gridlon_0:Latin1 = 38.5f ;
gridlon_0:Dy = 3.f ;
gridlon_0:Dx = 3.f ;
gridlon_0:Lov = 262.5f ;
gridlon_0:Lo1 = 237.2805f ;
gridlon_0:La1 = 21.13812f ;
float APCP_P8_L1_GLC0_acc1h(ygrid_0, xgrid_0) ;
APCP_P8_L1_GLC0_acc1h:center = "US National Weather Service - NCEP (WMC)" ;
APCP_P8_L1_GLC0_acc1h:production_status = "Operational products" ;
APCP_P8_L1_GLC0_acc1h:long_name = "Total precipitation" ;
APCP_P8_L1_GLC0_acc1h:units = "kg m-2" ;
APCP_P8_L1_GLC0_acc1h:_FillValue = 1.e+20f ;
APCP_P8_L1_GLC0_acc1h:coordinates = "gridlat_0 gridlon_0" ;
APCP_P8_L1_GLC0_acc1h:grid_type = "Lambert Conformal can be secant or
tangent, conical or bipolar" ;
APCP_P8_L1_GLC0_acc1h:parameter_discipline_and_category = "Meteorological
products, Moisture" ;
APCP_P8_L1_GLC0_acc1h:parameter_template_discipline_category_number = 8, 0,
1, 8 ;
APCP_P8_L1_GLC0_acc1h:level_type = "Ground or water surface" ;
APCP_P8_L1_GLC0_acc1h:level = 0.f ;
APCP_P8_L1_GLC0_acc1h:type_of_statistical_processing = "Accumulation" ;
APCP_P8_L1_GLC0_acc1h:statistical_process_duration = "initial time to
forecast time" ;
APCP_P8_L1_GLC0_acc1h:forecast_time = 1 ;
APCP_P8_L1_GLC0_acc1h:forecast_time_units = "hours" ;
APCP_P8_L1_GLC0_acc1h:initial_time = "02/08/2017 (00:00)" ;
}
netcdf stageIV_2017020106 {
dimensions:
x = 1799 ;
y = 1059 ;
variables:
float precip(y, x) ;
precip:_FillValue = -999.f ;
float latitude(y, x) ;
float longitude(y, x) ;
// global attributes:
:title = "Observation interpolated grid" ;
:SW_corner_lat = 21.13799f ;
:SW_corner_lon = 237.28f ;
:NE_corner_lat = 47.84239f ;
:NE_corner_lon = 299.0825f ;
:MapProjection = "LambertConformal" ;
:YGridSpacing = 3000.f ;
:XGridSpacing = 3000.f ;
:Standard_lon = 262.5f ;
:Standard_lat = 38.5f ;
:ValidTime = "2017020106" ;
}
--
--
Francesca Viterbo, Ph.D.
Physical Sciences Division
NOAA Earth System Research Laboratory
R/PSD2, 325 Broadway
Boulder, CO 80305-3337
303-497-6702
francesca.viterbo at noaa.gov
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: halp in file format with MET 5.2
From: John Halley Gotway
Time: Tue Nov 28 13:09:59 2017
Francesca,
I see that you're having trouble reading NetCDF data into MET. There
are
many different flavors of NetCDF out there and MET only supports a few
of
them. They are...
- the NetCDF output of the wrf_interp utility
- the NetCDF output generated by other MET tools
- CF-compliant NetCDF files
Based on the ncdump output you sent, this data does not appear to fall
into
any of these categories.
What is the source of this data? If it really is HRRR and StageIV
data,
that should be available in GRIB1 or GRIB2 format.
Thanks,
John
On Tue, Nov 28, 2017 at 12:54 PM, francesca.viterbo at noaa.gov via RT <
met_help at ucar.edu> wrote:
>
> Tue Nov 28 12:54:11 2017: Request 83140 was acted upon.
> Transaction: Ticket created by francesca.viterbo at noaa.gov
> Queue: met_help
> Subject: halp in file format with MET 5.2
> Owner: Nobody
> Requestors: francesca.viterbo at noaa.gov
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=83140 >
>
>
> Dear MET help desk,
> I'm trying to use MET suite for some analysis using some regridded
HRRR and
> StageIV data.
> The data has been given to me in netcdf format, already regridded.
Every
> kind of MET tool I'm trying to run on it, I got this error:
>
> get_field() -> can't open data file "17039000000100.TP_1Hour.nc"
>
> How can I solve the problem? if i try other files from the tutorial
(both
> netcdf and grib) they work. I attach the ncdump of my HRRR and
StageIV
> files. Let me know if you want me to attach the whole files.
>
>
> Thank you in advance for your kind attention and cooperation,
>
> Francesca
>
>
> netcdf \17039000000100.TP_1Hour {
> dimensions:
> ygrid_0 = 1059 ;
> xgrid_0 = 1799 ;
> variables:
> float gridlat_0(ygrid_0, xgrid_0) ;
> gridlat_0:corners = 21.13812f, 21.14055f, 47.84219f, 47.83862f ;
> gridlat_0:long_name = "latitude" ;
> gridlat_0:grid_type = "Lambert Conformal (secant, tangent, conical
or
> bipolar)" ;
> gridlat_0:units = "degrees_north" ;
> gridlat_0:Latin2 = 38.5f ;
> gridlat_0:Latin1 = 38.5f ;
> gridlat_0:Dy = 3.f ;
> gridlat_0:Dx = 3.f ;
> gridlat_0:Lov = 262.5f ;
> gridlat_0:Lo1 = 237.2805f ;
> gridlat_0:La1 = 21.13812f ;
> float gridlon_0(ygrid_0, xgrid_0) ;
> gridlon_0:corners = -122.7195f, -72.28972f, -60.91719f, -134.0955f ;
> gridlon_0:long_name = "longitude" ;
> gridlon_0:grid_type = "Lambert Conformal (secant, tangent, conical
or
> bipolar)" ;
> gridlon_0:units = "degrees_east" ;
> gridlon_0:Latin2 = 38.5f ;
> gridlon_0:Latin1 = 38.5f ;
> gridlon_0:Dy = 3.f ;
> gridlon_0:Dx = 3.f ;
> gridlon_0:Lov = 262.5f ;
> gridlon_0:Lo1 = 237.2805f ;
> gridlon_0:La1 = 21.13812f ;
> float APCP_P8_L1_GLC0_acc1h(ygrid_0, xgrid_0) ;
> APCP_P8_L1_GLC0_acc1h:center = "US National Weather Service - NCEP
(WMC)" ;
> APCP_P8_L1_GLC0_acc1h:production_status = "Operational products" ;
> APCP_P8_L1_GLC0_acc1h:long_name = "Total precipitation" ;
> APCP_P8_L1_GLC0_acc1h:units = "kg m-2" ;
> APCP_P8_L1_GLC0_acc1h:_FillValue = 1.e+20f ;
> APCP_P8_L1_GLC0_acc1h:coordinates = "gridlat_0 gridlon_0" ;
> APCP_P8_L1_GLC0_acc1h:grid_type = "Lambert Conformal can be secant
or
> tangent, conical or bipolar" ;
> APCP_P8_L1_GLC0_acc1h:parameter_discipline_and_category =
"Meteorological
> products, Moisture" ;
> APCP_P8_L1_GLC0_acc1h:parameter_template_discipline_category_number
= 8,
> 0,
> 1, 8 ;
> APCP_P8_L1_GLC0_acc1h:level_type = "Ground or water surface" ;
> APCP_P8_L1_GLC0_acc1h:level = 0.f ;
> APCP_P8_L1_GLC0_acc1h:type_of_statistical_processing =
"Accumulation" ;
> APCP_P8_L1_GLC0_acc1h:statistical_process_duration = "initial time
to
> forecast time" ;
> APCP_P8_L1_GLC0_acc1h:forecast_time = 1 ;
> APCP_P8_L1_GLC0_acc1h:forecast_time_units = "hours" ;
> APCP_P8_L1_GLC0_acc1h:initial_time = "02/08/2017 (00:00)" ;
> }
>
> netcdf stageIV_2017020106 {
> dimensions:
> x = 1799 ;
> y = 1059 ;
> variables:
> float precip(y, x) ;
> precip:_FillValue = -999.f ;
> float latitude(y, x) ;
> float longitude(y, x) ;
>
> // global attributes:
> :title = "Observation interpolated grid" ;
> :SW_corner_lat = 21.13799f ;
> :SW_corner_lon = 237.28f ;
> :NE_corner_lat = 47.84239f ;
> :NE_corner_lon = 299.0825f ;
> :MapProjection = "LambertConformal" ;
> :YGridSpacing = 3000.f ;
> :XGridSpacing = 3000.f ;
> :Standard_lon = 262.5f ;
> :Standard_lat = 38.5f ;
> :ValidTime = "2017020106" ;
> }
>
> --
> --
> Francesca Viterbo, Ph.D.
> Physical Sciences Division
> NOAA Earth System Research Laboratory
> R/PSD2, 325 Broadway
> Boulder, CO 80305-3337
> 303-497-6702
> francesca.viterbo at noaa.gov
>
>
------------------------------------------------
Subject: halp in file format with MET 5.2
From: francesca.viterbo at noaa.gov
Time: Tue Nov 28 15:16:04 2017
Hi John,
thank you very much for your help. Yes, unfortunately my NETCDF
doesn't
belong to any of those categories you mentioned..
This are not original HRRR or Stage IV data, HRRR are already
regridded at
stage IV resolution. And because they are already in the NOAA shared
machine, I would prefer to use those.
Is there a way to change the global attributes in a way that MET likes
that, considering that I'm on a lambert conformal grid, with the Lat
and
Lon projection information as you see in the ncdump?
Thank you very much,
Francesca
On Tue, Nov 28, 2017 at 1:10 PM, John Halley Gotway via RT <
met_help at ucar.edu> wrote:
> Francesca,
>
> I see that you're having trouble reading NetCDF data into MET.
There are
> many different flavors of NetCDF out there and MET only supports a
few of
> them. They are...
> - the NetCDF output of the wrf_interp utility
> - the NetCDF output generated by other MET tools
> - CF-compliant NetCDF files
>
> Based on the ncdump output you sent, this data does not appear to
fall into
> any of these categories.
>
> What is the source of this data? If it really is HRRR and StageIV
data,
> that should be available in GRIB1 or GRIB2 format.
>
> Thanks,
> John
>
>
> On Tue, Nov 28, 2017 at 12:54 PM, francesca.viterbo at noaa.gov via RT
<
> met_help at ucar.edu> wrote:
>
> >
> > Tue Nov 28 12:54:11 2017: Request 83140 was acted upon.
> > Transaction: Ticket created by francesca.viterbo at noaa.gov
> > Queue: met_help
> > Subject: halp in file format with MET 5.2
> > Owner: Nobody
> > Requestors: francesca.viterbo at noaa.gov
> > Status: new
> > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=83140 >
> >
> >
> > Dear MET help desk,
> > I'm trying to use MET suite for some analysis using some regridded
HRRR
> and
> > StageIV data.
> > The data has been given to me in netcdf format, already regridded.
Every
> > kind of MET tool I'm trying to run on it, I got this error:
> >
> > get_field() -> can't open data file "17039000000100.TP_1Hour.nc"
> >
> > How can I solve the problem? if i try other files from the
tutorial
> (both
> > netcdf and grib) they work. I attach the ncdump of my HRRR and
StageIV
> > files. Let me know if you want me to attach the whole files.
> >
> >
> > Thank you in advance for your kind attention and cooperation,
> >
> > Francesca
> >
> >
> > netcdf \17039000000100.TP_1Hour {
> > dimensions:
> > ygrid_0 = 1059 ;
> > xgrid_0 = 1799 ;
> > variables:
> > float gridlat_0(ygrid_0, xgrid_0) ;
> > gridlat_0:corners = 21.13812f, 21.14055f, 47.84219f, 47.83862f ;
> > gridlat_0:long_name = "latitude" ;
> > gridlat_0:grid_type = "Lambert Conformal (secant, tangent, conical
or
> > bipolar)" ;
> > gridlat_0:units = "degrees_north" ;
> > gridlat_0:Latin2 = 38.5f ;
> > gridlat_0:Latin1 = 38.5f ;
> > gridlat_0:Dy = 3.f ;
> > gridlat_0:Dx = 3.f ;
> > gridlat_0:Lov = 262.5f ;
> > gridlat_0:Lo1 = 237.2805f ;
> > gridlat_0:La1 = 21.13812f ;
> > float gridlon_0(ygrid_0, xgrid_0) ;
> > gridlon_0:corners = -122.7195f, -72.28972f, -60.91719f, -134.0955f
;
> > gridlon_0:long_name = "longitude" ;
> > gridlon_0:grid_type = "Lambert Conformal (secant, tangent, conical
or
> > bipolar)" ;
> > gridlon_0:units = "degrees_east" ;
> > gridlon_0:Latin2 = 38.5f ;
> > gridlon_0:Latin1 = 38.5f ;
> > gridlon_0:Dy = 3.f ;
> > gridlon_0:Dx = 3.f ;
> > gridlon_0:Lov = 262.5f ;
> > gridlon_0:Lo1 = 237.2805f ;
> > gridlon_0:La1 = 21.13812f ;
> > float APCP_P8_L1_GLC0_acc1h(ygrid_0, xgrid_0) ;
> > APCP_P8_L1_GLC0_acc1h:center = "US National Weather Service - NCEP
> (WMC)" ;
> > APCP_P8_L1_GLC0_acc1h:production_status = "Operational products" ;
> > APCP_P8_L1_GLC0_acc1h:long_name = "Total precipitation" ;
> > APCP_P8_L1_GLC0_acc1h:units = "kg m-2" ;
> > APCP_P8_L1_GLC0_acc1h:_FillValue = 1.e+20f ;
> > APCP_P8_L1_GLC0_acc1h:coordinates = "gridlat_0 gridlon_0" ;
> > APCP_P8_L1_GLC0_acc1h:grid_type = "Lambert Conformal can be secant
or
> > tangent, conical or bipolar" ;
> > APCP_P8_L1_GLC0_acc1h:parameter_discipline_and_category =
> "Meteorological
> > products, Moisture" ;
> >
APCP_P8_L1_GLC0_acc1h:parameter_template_discipline_category_number =
8,
> > 0,
> > 1, 8 ;
> > APCP_P8_L1_GLC0_acc1h:level_type = "Ground or water surface" ;
> > APCP_P8_L1_GLC0_acc1h:level = 0.f ;
> > APCP_P8_L1_GLC0_acc1h:type_of_statistical_processing =
"Accumulation" ;
> > APCP_P8_L1_GLC0_acc1h:statistical_process_duration = "initial time
to
> > forecast time" ;
> > APCP_P8_L1_GLC0_acc1h:forecast_time = 1 ;
> > APCP_P8_L1_GLC0_acc1h:forecast_time_units = "hours" ;
> > APCP_P8_L1_GLC0_acc1h:initial_time = "02/08/2017 (00:00)" ;
> > }
> >
> > netcdf stageIV_2017020106 {
> > dimensions:
> > x = 1799 ;
> > y = 1059 ;
> > variables:
> > float precip(y, x) ;
> > precip:_FillValue = -999.f ;
> > float latitude(y, x) ;
> > float longitude(y, x) ;
> >
> > // global attributes:
> > :title = "Observation interpolated grid" ;
> > :SW_corner_lat = 21.13799f ;
> > :SW_corner_lon = 237.28f ;
> > :NE_corner_lat = 47.84239f ;
> > :NE_corner_lon = 299.0825f ;
> > :MapProjection = "LambertConformal" ;
> > :YGridSpacing = 3000.f ;
> > :XGridSpacing = 3000.f ;
> > :Standard_lon = 262.5f ;
> > :Standard_lat = 38.5f ;
> > :ValidTime = "2017020106" ;
> > }
> >
> > --
> > --
> > Francesca Viterbo, Ph.D.
> > Physical Sciences Division
> > NOAA Earth System Research Laboratory
> > R/PSD2, 325 Broadway
> > Boulder, CO 80305-3337
> > 303-497-6702
> > francesca.viterbo at noaa.gov
> >
> >
>
>
--
--
Francesca Viterbo, Ph.D.
Physical Sciences Division
NOAA Earth System Research Laboratory
R/PSD2, 325 Broadway
Boulder, CO 80305-3337
303-497-6702
francesca.viterbo at noaa.gov
------------------------------------------------
Subject: halp in file format with MET 5.2
From: francesca.viterbo at noaa.gov
Time: Wed Nov 29 12:40:55 2017
Hi John,
a quick update: If I try to add some global attributes to the file, it
seems to be read but if I run this command
/usr/local/met/bin/grid_stat 17039000000100.TP_1Hour.nc
17039000000100.TP_1Hour.nc GridStatConfig_24hr_rap_st4 -v 4
I have this error:
MetNcFile::data(NcVar *, const LongArray &, DataPlane &) const ->
star
found in bad slot
Ignore that I'm performing grid stat on the same file, but it only for
debug purposes.
Thank you,
Francesca
On Tue, Nov 28, 2017 at 3:16 PM, Francesca Viterbo - NOAA Affiliate <
francesca.viterbo at noaa.gov> wrote:
> Hi John,
> thank you very much for your help. Yes, unfortunately my NETCDF
doesn't
> belong to any of those categories you mentioned..
> This are not original HRRR or Stage IV data, HRRR are already
regridded at
> stage IV resolution. And because they are already in the NOAA shared
> machine, I would prefer to use those.
>
> Is there a way to change the global attributes in a way that MET
likes
> that, considering that I'm on a lambert conformal grid, with the Lat
and
> Lon projection information as you see in the ncdump?
>
> Thank you very much,
> Francesca
>
> On Tue, Nov 28, 2017 at 1:10 PM, John Halley Gotway via RT <
> met_help at ucar.edu> wrote:
>
>> Francesca,
>>
>> I see that you're having trouble reading NetCDF data into MET.
There are
>> many different flavors of NetCDF out there and MET only supports a
few of
>> them. They are...
>> - the NetCDF output of the wrf_interp utility
>> - the NetCDF output generated by other MET tools
>> - CF-compliant NetCDF files
>>
>> Based on the ncdump output you sent, this data does not appear to
fall
>> into
>> any of these categories.
>>
>> What is the source of this data? If it really is HRRR and StageIV
data,
>> that should be available in GRIB1 or GRIB2 format.
>>
>> Thanks,
>> John
>>
>>
>> On Tue, Nov 28, 2017 at 12:54 PM, francesca.viterbo at noaa.gov via RT
<
>> met_help at ucar.edu> wrote:
>>
>> >
>> > Tue Nov 28 12:54:11 2017: Request 83140 was acted upon.
>> > Transaction: Ticket created by francesca.viterbo at noaa.gov
>> > Queue: met_help
>> > Subject: halp in file format with MET 5.2
>> > Owner: Nobody
>> > Requestors: francesca.viterbo at noaa.gov
>> > Status: new
>> > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=83140 >
>> >
>> >
>> > Dear MET help desk,
>> > I'm trying to use MET suite for some analysis using some
regridded HRRR
>> and
>> > StageIV data.
>> > The data has been given to me in netcdf format, already
regridded. Every
>> > kind of MET tool I'm trying to run on it, I got this error:
>> >
>> > get_field() -> can't open data file "17039000000100.TP_1Hour.nc"
>> >
>> > How can I solve the problem? if i try other files from the
tutorial
>> (both
>> > netcdf and grib) they work. I attach the ncdump of my HRRR and
StageIV
>> > files. Let me know if you want me to attach the whole files.
>> >
>> >
>> > Thank you in advance for your kind attention and cooperation,
>> >
>> > Francesca
>> >
>> >
>> > netcdf \17039000000100.TP_1Hour {
>> > dimensions:
>> > ygrid_0 = 1059 ;
>> > xgrid_0 = 1799 ;
>> > variables:
>> > float gridlat_0(ygrid_0, xgrid_0) ;
>> > gridlat_0:corners = 21.13812f, 21.14055f, 47.84219f, 47.83862f ;
>> > gridlat_0:long_name = "latitude" ;
>> > gridlat_0:grid_type = "Lambert Conformal (secant, tangent,
conical or
>> > bipolar)" ;
>> > gridlat_0:units = "degrees_north" ;
>> > gridlat_0:Latin2 = 38.5f ;
>> > gridlat_0:Latin1 = 38.5f ;
>> > gridlat_0:Dy = 3.f ;
>> > gridlat_0:Dx = 3.f ;
>> > gridlat_0:Lov = 262.5f ;
>> > gridlat_0:Lo1 = 237.2805f ;
>> > gridlat_0:La1 = 21.13812f ;
>> > float gridlon_0(ygrid_0, xgrid_0) ;
>> > gridlon_0:corners = -122.7195f, -72.28972f, -60.91719f,
-134.0955f ;
>> > gridlon_0:long_name = "longitude" ;
>> > gridlon_0:grid_type = "Lambert Conformal (secant, tangent,
conical or
>> > bipolar)" ;
>> > gridlon_0:units = "degrees_east" ;
>> > gridlon_0:Latin2 = 38.5f ;
>> > gridlon_0:Latin1 = 38.5f ;
>> > gridlon_0:Dy = 3.f ;
>> > gridlon_0:Dx = 3.f ;
>> > gridlon_0:Lov = 262.5f ;
>> > gridlon_0:Lo1 = 237.2805f ;
>> > gridlon_0:La1 = 21.13812f ;
>> > float APCP_P8_L1_GLC0_acc1h(ygrid_0, xgrid_0) ;
>> > APCP_P8_L1_GLC0_acc1h:center = "US National Weather Service -
NCEP
>> (WMC)" ;
>> > APCP_P8_L1_GLC0_acc1h:production_status = "Operational products"
;
>> > APCP_P8_L1_GLC0_acc1h:long_name = "Total precipitation" ;
>> > APCP_P8_L1_GLC0_acc1h:units = "kg m-2" ;
>> > APCP_P8_L1_GLC0_acc1h:_FillValue = 1.e+20f ;
>> > APCP_P8_L1_GLC0_acc1h:coordinates = "gridlat_0 gridlon_0" ;
>> > APCP_P8_L1_GLC0_acc1h:grid_type = "Lambert Conformal can be
secant or
>> > tangent, conical or bipolar" ;
>> > APCP_P8_L1_GLC0_acc1h:parameter_discipline_and_category =
>> "Meteorological
>> > products, Moisture" ;
>> >
APCP_P8_L1_GLC0_acc1h:parameter_template_discipline_category_number =
>> 8,
>> > 0,
>> > 1, 8 ;
>> > APCP_P8_L1_GLC0_acc1h:level_type = "Ground or water surface" ;
>> > APCP_P8_L1_GLC0_acc1h:level = 0.f ;
>> > APCP_P8_L1_GLC0_acc1h:type_of_statistical_processing =
"Accumulation" ;
>> > APCP_P8_L1_GLC0_acc1h:statistical_process_duration = "initial
time to
>> > forecast time" ;
>> > APCP_P8_L1_GLC0_acc1h:forecast_time = 1 ;
>> > APCP_P8_L1_GLC0_acc1h:forecast_time_units = "hours" ;
>> > APCP_P8_L1_GLC0_acc1h:initial_time = "02/08/2017 (00:00)" ;
>> > }
>> >
>> > netcdf stageIV_2017020106 <(201)%20702-0106> {
>> > dimensions:
>> > x = 1799 ;
>> > y = 1059 ;
>> > variables:
>> > float precip(y, x) ;
>> > precip:_FillValue = -999.f ;
>> > float latitude(y, x) ;
>> > float longitude(y, x) ;
>> >
>> > // global attributes:
>> > :title = "Observation interpolated grid" ;
>> > :SW_corner_lat = 21.13799f ;
>> > :SW_corner_lon = 237.28f ;
>> > :NE_corner_lat = 47.84239f ;
>> > :NE_corner_lon = 299.0825f ;
>> > :MapProjection = "LambertConformal" ;
>> > :YGridSpacing = 3000.f ;
>> > :XGridSpacing = 3000.f ;
>> > :Standard_lon = 262.5f ;
>> > :Standard_lat = 38.5f ;
>> > :ValidTime = "2017020106 <(201)%20702-0106>" ;
>> > }
>> >
>> > --
>> > --
>> > Francesca Viterbo, Ph.D.
>> > Physical Sciences Division
>> > NOAA Earth System Research Laboratory
>> > R/PSD2, 325 Broadway
>> > Boulder, CO 80305-3337
>> > 303-497-6702 <(303)%20497-6702>
>> > francesca.viterbo at noaa.gov
>> >
>> >
>>
>>
>
>
> --
> --
> Francesca Viterbo, Ph.D.
> Physical Sciences Division
> NOAA Earth System Research Laboratory
> R/PSD2, 325 Broadway
> Boulder, CO 80305-3337
> 303-497-6702 <(303)%20497-6702>
> francesca.viterbo at noaa.gov
>
--
--
Francesca Viterbo, Ph.D.
Physical Sciences Division
NOAA Earth System Research Laboratory
R/PSD2, 325 Broadway
Boulder, CO 80305-3337
303-497-6702
francesca.viterbo at noaa.gov
------------------------------------------------
Subject: halp in file format with MET 5.2
From: John Halley Gotway
Time: Fri Dec 01 16:27:56 2017
Francesca,
Yes, you could reformat the NetCDF file to make MET be able to read
it.
However, I think you'll find it to be a real headache.
If you were to make it CF-compliant, you'd need to add a variable
which
defines the projection information with several attributes. And then
you'd
need to add the projection attribute to the variables which contain
your
data pointing it that new variable which defines the projection info.
And
you'd need to define the timing info in a CF-compliant way.
If you were to make it look like the NetCDF output of MET, you'd need
to
add several global variables to define the projection info, but then
rename
your existing dimensions to be name lat and lon.
I really do think you'll be able to make much quicker progress
operating on
the GRIB files themselves.
To demonstrate, I ran the following commands:
(1) Grab a recent HRRR file:
wget
ftp://ftp.ncep.noaa.gov/pub/data/nccf/com/hrrr/prod/hrrr.20171130/hrrr.t00z.wrfsfcf06.grib2
(2) Grab a verifying URMA analysis file:
wget
ftp://ftp.ncep.noaa.gov/pub/data/nccf/com/urma/prod/urma2p5.20171130/urma2p5.2017113006.pcp_06h.184.grb2
I chose these times for simplicity since they both contain 6 hour
accumulated precip. If the accumulation intervals didn't match, I
would
have needed to run one or both through pcp_combine to compute my
desired
accumulation interval.
Then I ran them through grid_stat using the attached config file and
this
command:
/usr/local/met-6.0/bin/grid_stat \
hrrr.t00z.wrfsfcf06.grib2 \
urma2p5.2017113006.pcp_06h.184.grb2 \
GridStatConfig_HRRR_vs_URMA \
-outdir out
I the Grid-Stat config file, I told it to regrid the HRRR data to the
URMA
domain using budget interpolation:
regrid = {
to_grid = OBS;
method = BUDGET;
width = 2;
vld_thresh = 0.5;
}
I also configured Grid-Stat to write a NetCDF matched pairs file,
which
include the difference field. And I ran the following plot_data_plane
command to plot the difference field for this data:
/usr/local/met-6.0/bin/plot_data_plane \
out/grid_stat_060000L_20171130_060000V_pairs.nc \
out/HRRR_minus_URMA.ps \
'name="DIFF_APCP_06_A06_APCP_06_A06_FULL"; level="(*,*)";' \
-color_table
/usr/local/met-
6.0/share/met/colortables/NCL_colortables/posneg_2.ctable \
-plot_range -2.54 2.54
And I've attached a PNG version of the PostScript plot that was
created.
This example is meant to demonstrate how using the automated
regridding
feature within MET can help you get up an running quickly as long as
you
use data formats that MET can already read.
Otherwise, I worry that you'll spend a lot time and frustration trying
to
format your NetCDF files exactly right. It's not impossible to do so,
but
will likely be time consuming.
Thanks,
John
On Wed, Nov 29, 2017 at 12:40 PM, francesca.viterbo at noaa.gov via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=83140 >
>
> Hi John,
> a quick update: If I try to add some global attributes to the file,
it
> seems to be read but if I run this command
>
> /usr/local/met/bin/grid_stat 17039000000100.TP_1Hour.nc
> 17039000000100.TP_1Hour.nc GridStatConfig_24hr_rap_st4 -v 4
>
> I have this error:
>
> MetNcFile::data(NcVar *, const LongArray &, DataPlane &) const ->
star
> found in bad slot
>
> Ignore that I'm performing grid stat on the same file, but it only
for
> debug purposes.
>
> Thank you,
> Francesca
>
> On Tue, Nov 28, 2017 at 3:16 PM, Francesca Viterbo - NOAA Affiliate
<
> francesca.viterbo at noaa.gov> wrote:
>
> > Hi John,
> > thank you very much for your help. Yes, unfortunately my NETCDF
doesn't
> > belong to any of those categories you mentioned..
> > This are not original HRRR or Stage IV data, HRRR are already
regridded
> at
> > stage IV resolution. And because they are already in the NOAA
shared
> > machine, I would prefer to use those.
> >
> > Is there a way to change the global attributes in a way that MET
likes
> > that, considering that I'm on a lambert conformal grid, with the
Lat and
> > Lon projection information as you see in the ncdump?
> >
> > Thank you very much,
> > Francesca
> >
> > On Tue, Nov 28, 2017 at 1:10 PM, John Halley Gotway via RT <
> > met_help at ucar.edu> wrote:
> >
> >> Francesca,
> >>
> >> I see that you're having trouble reading NetCDF data into MET.
There
> are
> >> many different flavors of NetCDF out there and MET only supports
a few
> of
> >> them. They are...
> >> - the NetCDF output of the wrf_interp utility
> >> - the NetCDF output generated by other MET tools
> >> - CF-compliant NetCDF files
> >>
> >> Based on the ncdump output you sent, this data does not appear to
fall
> >> into
> >> any of these categories.
> >>
> >> What is the source of this data? If it really is HRRR and
StageIV data,
> >> that should be available in GRIB1 or GRIB2 format.
> >>
> >> Thanks,
> >> John
> >>
> >>
> >> On Tue, Nov 28, 2017 at 12:54 PM, francesca.viterbo at noaa.gov via
RT <
> >> met_help at ucar.edu> wrote:
> >>
> >> >
> >> > Tue Nov 28 12:54:11 2017: Request 83140 was acted upon.
> >> > Transaction: Ticket created by francesca.viterbo at noaa.gov
> >> > Queue: met_help
> >> > Subject: halp in file format with MET 5.2
> >> > Owner: Nobody
> >> > Requestors: francesca.viterbo at noaa.gov
> >> > Status: new
> >> > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=83140
> >
> >> >
> >> >
> >> > Dear MET help desk,
> >> > I'm trying to use MET suite for some analysis using some
regridded
> HRRR
> >> and
> >> > StageIV data.
> >> > The data has been given to me in netcdf format, already
regridded.
> Every
> >> > kind of MET tool I'm trying to run on it, I got this error:
> >> >
> >> > get_field() -> can't open data file
"17039000000100.TP_1Hour.nc"
> >> >
> >> > How can I solve the problem? if i try other files from the
tutorial
> >> (both
> >> > netcdf and grib) they work. I attach the ncdump of my HRRR and
StageIV
> >> > files. Let me know if you want me to attach the whole files.
> >> >
> >> >
> >> > Thank you in advance for your kind attention and cooperation,
> >> >
> >> > Francesca
> >> >
> >> >
> >> > netcdf \17039000000100.TP_1Hour {
> >> > dimensions:
> >> > ygrid_0 = 1059 ;
> >> > xgrid_0 = 1799 ;
> >> > variables:
> >> > float gridlat_0(ygrid_0, xgrid_0) ;
> >> > gridlat_0:corners = 21.13812f, 21.14055f, 47.84219f, 47.83862f
;
> >> > gridlat_0:long_name = "latitude" ;
> >> > gridlat_0:grid_type = "Lambert Conformal (secant, tangent,
conical or
> >> > bipolar)" ;
> >> > gridlat_0:units = "degrees_north" ;
> >> > gridlat_0:Latin2 = 38.5f ;
> >> > gridlat_0:Latin1 = 38.5f ;
> >> > gridlat_0:Dy = 3.f ;
> >> > gridlat_0:Dx = 3.f ;
> >> > gridlat_0:Lov = 262.5f ;
> >> > gridlat_0:Lo1 = 237.2805f ;
> >> > gridlat_0:La1 = 21.13812f ;
> >> > float gridlon_0(ygrid_0, xgrid_0) ;
> >> > gridlon_0:corners = -122.7195f, -72.28972f, -60.91719f,
-134.0955f ;
> >> > gridlon_0:long_name = "longitude" ;
> >> > gridlon_0:grid_type = "Lambert Conformal (secant, tangent,
conical or
> >> > bipolar)" ;
> >> > gridlon_0:units = "degrees_east" ;
> >> > gridlon_0:Latin2 = 38.5f ;
> >> > gridlon_0:Latin1 = 38.5f ;
> >> > gridlon_0:Dy = 3.f ;
> >> > gridlon_0:Dx = 3.f ;
> >> > gridlon_0:Lov = 262.5f ;
> >> > gridlon_0:Lo1 = 237.2805f ;
> >> > gridlon_0:La1 = 21.13812f ;
> >> > float APCP_P8_L1_GLC0_acc1h(ygrid_0, xgrid_0) ;
> >> > APCP_P8_L1_GLC0_acc1h:center = "US National Weather Service -
NCEP
> >> (WMC)" ;
> >> > APCP_P8_L1_GLC0_acc1h:production_status = "Operational
products" ;
> >> > APCP_P8_L1_GLC0_acc1h:long_name = "Total precipitation" ;
> >> > APCP_P8_L1_GLC0_acc1h:units = "kg m-2" ;
> >> > APCP_P8_L1_GLC0_acc1h:_FillValue = 1.e+20f ;
> >> > APCP_P8_L1_GLC0_acc1h:coordinates = "gridlat_0 gridlon_0" ;
> >> > APCP_P8_L1_GLC0_acc1h:grid_type = "Lambert Conformal can be
secant or
> >> > tangent, conical or bipolar" ;
> >> > APCP_P8_L1_GLC0_acc1h:parameter_discipline_and_category =
> >> "Meteorological
> >> > products, Moisture" ;
> >> >
APCP_P8_L1_GLC0_acc1h:parameter_template_discipline_category_number =
> >> 8,
> >> > 0,
> >> > 1, 8 ;
> >> > APCP_P8_L1_GLC0_acc1h:level_type = "Ground or water surface" ;
> >> > APCP_P8_L1_GLC0_acc1h:level = 0.f ;
> >> > APCP_P8_L1_GLC0_acc1h:type_of_statistical_processing =
> "Accumulation" ;
> >> > APCP_P8_L1_GLC0_acc1h:statistical_process_duration = "initial
time to
> >> > forecast time" ;
> >> > APCP_P8_L1_GLC0_acc1h:forecast_time = 1 ;
> >> > APCP_P8_L1_GLC0_acc1h:forecast_time_units = "hours" ;
> >> > APCP_P8_L1_GLC0_acc1h:initial_time = "02/08/2017 (00:00)" ;
> >> > }
> >> >
> >> > netcdf stageIV_2017020106 <(201)%20702-0106> {
> >> > dimensions:
> >> > x = 1799 ;
> >> > y = 1059 ;
> >> > variables:
> >> > float precip(y, x) ;
> >> > precip:_FillValue = -999.f ;
> >> > float latitude(y, x) ;
> >> > float longitude(y, x) ;
> >> >
> >> > // global attributes:
> >> > :title = "Observation interpolated grid" ;
> >> > :SW_corner_lat = 21.13799f ;
> >> > :SW_corner_lon = 237.28f ;
> >> > :NE_corner_lat = 47.84239f ;
> >> > :NE_corner_lon = 299.0825f ;
> >> > :MapProjection = "LambertConformal" ;
> >> > :YGridSpacing = 3000.f ;
> >> > :XGridSpacing = 3000.f ;
> >> > :Standard_lon = 262.5f ;
> >> > :Standard_lat = 38.5f ;
> >> > :ValidTime = "2017020106 <(201)%20702-0106>" ;
> >> > }
> >> >
> >> > --
> >> > --
> >> > Francesca Viterbo, Ph.D.
> >> > Physical Sciences Division
> >> > NOAA Earth System Research Laboratory
> >> > R/PSD2, 325 Broadway
> >> > Boulder, CO 80305-3337
> >> > 303-497-6702 <(303)%20497-6702>
> >> > francesca.viterbo at noaa.gov
> >> >
> >> >
> >>
> >>
> >
> >
> > --
> > --
> > Francesca Viterbo, Ph.D.
> > Physical Sciences Division
> > NOAA Earth System Research Laboratory
> > R/PSD2, 325 Broadway
> > Boulder, CO 80305-3337
> > 303-497-6702 <(303)%20497-6702>
> > francesca.viterbo at noaa.gov
> >
>
>
>
> --
> --
> Francesca Viterbo, Ph.D.
> Physical Sciences Division
> NOAA Earth System Research Laboratory
> R/PSD2, 325 Broadway
> Boulder, CO 80305-3337
> 303-497-6702
> francesca.viterbo at noaa.gov
>
>
------------------------------------------------
More information about the Met_help
mailing list