[Met_help] [rt.rap.ucar.edu #91023] History for Problem with netcdf file?
John Halley Gotway via RT
met_help at ucar.edu
Mon Jul 15 09:56:39 MDT 2019
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
I am running MET6.0, Gridstat using neighborhood methods for QPF
verification, which I have done successfully many times with our model
output vs Stage 4 observed precip. I trying to verify HRRR output vs Stage
4, where I have converted the HRRR file to netcdf following all the
guidelines outlined in the MET user documentation, I believe. The HRRR
file seems to be accepted, but MET Gridstat seems to think there is no
data. Yet when I map the file independently it looks perfectly fine. From
my Google Drive find attached the forecast file (PRATEsfc6hrrr.nc), the
grib2 analysis file (ST4.2019050106.06h), the verification output generated
(MET6.0_out) and the config file that I am using (GridStatConfig_precip).
I would appreciate any assistance you could provide.
Thanks,
Bill Stern
UCAR/GFDL
MET6.0_out
<https://drive.google.com/a/ucar.edu/file/d/0B4UOhocf4VDjTG9USkZpeDJFYVQ2cFdRemxHb1hhZTZ2RW1j/view?usp=drive_web>
PRATEsfc6hrrr.nc
<https://drive.google.com/a/ucar.edu/file/d/0B4UOhocf4VDjU3NaYXBPaUg2T2FicU5GYkZPbURWcFBpdGp3/view?usp=drive_web>
ST4.2019050106.06h
<https://drive.google.com/a/ucar.edu/file/d/0B4UOhocf4VDjazVMTnZ5OXMyZHo0MTNjdFlYbDdXcHFPSlJz/view?usp=drive_web>
GridStatConfig_precip
<https://drive.google.com/a/ucar.edu/file/d/0B4UOhocf4VDjWXd3elZNV0pWR2ZFcHlnWlRsTmpaLV9icWln/view?usp=drive_web>
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: Problem with netcdf file?
From: Minna Win
Time: Fri Jul 12 13:45:16 2019
Hello Bill,
It looks like you are having issues running grid stat with HRRR data
you
converted to netcdf. I'm assigning this ticket to John Halley Gotway,
our
resident expert in this area. Please allow a few business days to
receive
a response to your issue.
Regards,
Minna
---------------
Minna Win
NCAR
Research Applications Lab
Phone: 303-497-8423
Fax: 303-497-8401
On Thu, Jul 11, 2019 at 11:55 PM William Stern via RT
<met_help at ucar.edu>
wrote:
>
> Thu Jul 11 17:54:59 2019: Request 91023 was acted upon.
> Transaction: Ticket created by wstern at ucar.edu
> Queue: met_help
> Subject: Problem with netcdf file?
> Owner: Nobody
> Requestors: wstern at ucar.edu
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=91023 >
>
>
> I am running MET6.0, Gridstat using neighborhood methods for QPF
> verification, which I have done successfully many times with our
model
> output vs Stage 4 observed precip. I trying to verify HRRR output
vs Stage
> 4, where I have converted the HRRR file to netcdf following all the
> guidelines outlined in the MET user documentation, I believe. The
HRRR
> file seems to be accepted, but MET Gridstat seems to think there is
no
> data. Yet when I map the file independently it looks perfectly
fine. From
> my Google Drive find attached the forecast file (PRATEsfc6hrrr.nc),
the
> grib2 analysis file (ST4.2019050106.06h), the verification output
generated
> (MET6.0_out) and the config file that I am using
(GridStatConfig_precip).
> I would appreciate any assistance you could provide.
>
> Thanks,
> Bill Stern
> UCAR/GFDL
>
>
>
> MET6.0_out
> <
>
https://drive.google.com/a/ucar.edu/file/d/0B4UOhocf4VDjTG9USkZpeDJFYVQ2cFdRemxHb1hhZTZ2RW1j/view?usp=drive_web
> >
>
> PRATEsfc6hrrr.nc
> <
>
https://drive.google.com/a/ucar.edu/file/d/0B4UOhocf4VDjU3NaYXBPaUg2T2FicU5GYkZPbURWcFBpdGp3/view?usp=drive_web
> >
>
> ST4.2019050106.06h
> <
>
https://drive.google.com/a/ucar.edu/file/d/0B4UOhocf4VDjazVMTnZ5OXMyZHo0MTNjdFlYbDdXcHFPSlJz/view?usp=drive_web
> >
>
> GridStatConfig_precip
> <
>
https://drive.google.com/a/ucar.edu/file/d/0B4UOhocf4VDjWXd3elZNV0pWR2ZFcHlnWlRsTmpaLV9icWln/view?usp=drive_web
> >
>
>
------------------------------------------------
Subject: Problem with netcdf file?
From: William Stern
Time: Fri Jul 12 14:05:47 2019
Thank you Minna. I will await John's insights.
Bill
On Fri, Jul 12, 2019 at 3:45 PM Minna Win via RT <met_help at ucar.edu>
wrote:
> Hello Bill,
>
> It looks like you are having issues running grid stat with HRRR data
you
> converted to netcdf. I'm assigning this ticket to John Halley
Gotway, our
> resident expert in this area. Please allow a few business days to
receive
> a response to your issue.
>
> Regards,
> Minna
> ---------------
> Minna Win
> NCAR
> Research Applications Lab
> Phone: 303-497-8423
> Fax: 303-497-8401
>
>
>
> On Thu, Jul 11, 2019 at 11:55 PM William Stern via RT
<met_help at ucar.edu>
> wrote:
>
> >
> > Thu Jul 11 17:54:59 2019: Request 91023 was acted upon.
> > Transaction: Ticket created by wstern at ucar.edu
> > Queue: met_help
> > Subject: Problem with netcdf file?
> > Owner: Nobody
> > Requestors: wstern at ucar.edu
> > Status: new
> > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=91023 >
> >
> >
> > I am running MET6.0, Gridstat using neighborhood methods for QPF
> > verification, which I have done successfully many times with our
model
> > output vs Stage 4 observed precip. I trying to verify HRRR output
vs
> Stage
> > 4, where I have converted the HRRR file to netcdf following all
the
> > guidelines outlined in the MET user documentation, I believe. The
HRRR
> > file seems to be accepted, but MET Gridstat seems to think there
is no
> > data. Yet when I map the file independently it looks perfectly
fine.
> From
> > my Google Drive find attached the forecast file
(PRATEsfc6hrrr.nc), the
> > grib2 analysis file (ST4.2019050106.06h), the verification output
> generated
> > (MET6.0_out) and the config file that I am using
(GridStatConfig_precip).
> > I would appreciate any assistance you could provide.
> >
> > Thanks,
> > Bill Stern
> > UCAR/GFDL
> >
> >
> >
> > MET6.0_out
> > <
> >
>
https://drive.google.com/a/ucar.edu/file/d/0B4UOhocf4VDjTG9USkZpeDJFYVQ2cFdRemxHb1hhZTZ2RW1j/view?usp=drive_web
> > >
> >
> > PRATEsfc6hrrr.nc
> > <
> >
>
https://drive.google.com/a/ucar.edu/file/d/0B4UOhocf4VDjU3NaYXBPaUg2T2FicU5GYkZPbURWcFBpdGp3/view?usp=drive_web
> > >
> >
> > ST4.2019050106.06h
> > <
> >
>
https://drive.google.com/a/ucar.edu/file/d/0B4UOhocf4VDjazVMTnZ5OXMyZHo0MTNjdFlYbDdXcHFPSlJz/view?usp=drive_web
> > >
> >
> > GridStatConfig_precip
> > <
> >
>
https://drive.google.com/a/ucar.edu/file/d/0B4UOhocf4VDjWXd3elZNV0pWR2ZFcHlnWlRsTmpaLV9icWln/view?usp=drive_web
> > >
> >
> >
>
>
------------------------------------------------
Subject: Problem with netcdf file?
From: John Halley Gotway
Time: Fri Jul 12 15:27:34 2019
Hi Bill,
I see you're having trouble with the Grid-Stat tool. Thanks for
sending
along the relevant data files. That helps a lot.
The short answer is that MET is getting confused by having multiple
"conventions" attributes in your NetCDF file:
*ncdump -h PRATEsfc6hrrr.nc | egrep -i ":convention"
:Conventions = "COARDS" ; :conventions = "CF-1.6" ;*
If you remove the first one, it'll all work as it should:
* ncatted -a Conventions,global,d,c,'' PRATEsfc6hrrr.nc
PRATEsfc6hrrr_mod.nc*
If, for whatever reason, you are not able to modify those NetCDF
files, you
can manually define the file type that should be used in the Grid-Stat
config file:
*fcst = { file_type = NETCDF_NCCF; field = [ { name
=
"${fcst_var}"; level = [ "${fcst_level}" ];
cat_thresh =
[ ${thresholds} ];*
* } ];}*
Running plot_data_plane to plot the file as-is results in an error:
*/usr/local/met-6.0/bin/plot_data_plane PRATEsfc6hrrr.nc
PRATEsfc6hrrr.ps
'name="PRATEsfc"; level="(0,*,*)";'*
*ERROR : Box::set_lrbt() -> width and/or height negative!*
But using the file_type option to explicitly specify the file type
makes it
work well:
*/usr/local/met-6.0/bin/plot_data_plane PRATEsfc6hrrr.nc
PRATEsfc6hrrr.ps
'name="PRATEsfc"; level="(0,*,*)"; file_type=NETCDF_NCCF;'*
And I've attached the resulting image.
One final detail to mention. Coincidentally, we updated the latest
bugfix
release of met (met-8.1.1) to interpret the COARDS conventions as
being
CF-compliant. So that version of MET processes this data with no
changes
required. Here's the GitHub issue which documents that change:
https://github.com/NCAR/MET/issues/1155
Hope that helps clarify.
Thanks,
John
On Fri, Jul 12, 2019 at 2:05 PM William Stern via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=91023 >
>
> Thank you Minna. I will await John's insights.
>
> Bill
>
> On Fri, Jul 12, 2019 at 3:45 PM Minna Win via RT <met_help at ucar.edu>
> wrote:
>
> > Hello Bill,
> >
> > It looks like you are having issues running grid stat with HRRR
data you
> > converted to netcdf. I'm assigning this ticket to John Halley
Gotway,
> our
> > resident expert in this area. Please allow a few business days to
> receive
> > a response to your issue.
> >
> > Regards,
> > Minna
> > ---------------
> > Minna Win
> > NCAR
> > Research Applications Lab
> > Phone: 303-497-8423
> > Fax: 303-497-8401
> >
> >
> >
> > On Thu, Jul 11, 2019 at 11:55 PM William Stern via RT
<met_help at ucar.edu
> >
> > wrote:
> >
> > >
> > > Thu Jul 11 17:54:59 2019: Request 91023 was acted upon.
> > > Transaction: Ticket created by wstern at ucar.edu
> > > Queue: met_help
> > > Subject: Problem with netcdf file?
> > > Owner: Nobody
> > > Requestors: wstern at ucar.edu
> > > Status: new
> > > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=91023
> >
> > >
> > >
> > > I am running MET6.0, Gridstat using neighborhood methods for QPF
> > > verification, which I have done successfully many times with our
model
> > > output vs Stage 4 observed precip. I trying to verify HRRR
output vs
> > Stage
> > > 4, where I have converted the HRRR file to netcdf following all
the
> > > guidelines outlined in the MET user documentation, I believe.
The HRRR
> > > file seems to be accepted, but MET Gridstat seems to think there
is no
> > > data. Yet when I map the file independently it looks perfectly
fine.
> > From
> > > my Google Drive find attached the forecast file
(PRATEsfc6hrrr.nc), the
> > > grib2 analysis file (ST4.2019050106.06h), the verification
output
> > generated
> > > (MET6.0_out) and the config file that I am using
> (GridStatConfig_precip).
> > > I would appreciate any assistance you could provide.
> > >
> > > Thanks,
> > > Bill Stern
> > > UCAR/GFDL
> > >
> > >
> > >
> > > MET6.0_out
> > > <
> > >
> >
>
https://drive.google.com/a/ucar.edu/file/d/0B4UOhocf4VDjTG9USkZpeDJFYVQ2cFdRemxHb1hhZTZ2RW1j/view?usp=drive_web
> > > >
> > >
> > > PRATEsfc6hrrr.nc
> > > <
> > >
> >
>
https://drive.google.com/a/ucar.edu/file/d/0B4UOhocf4VDjU3NaYXBPaUg2T2FicU5GYkZPbURWcFBpdGp3/view?usp=drive_web
> > > >
> > >
> > > ST4.2019050106.06h
> > > <
> > >
> >
>
https://drive.google.com/a/ucar.edu/file/d/0B4UOhocf4VDjazVMTnZ5OXMyZHo0MTNjdFlYbDdXcHFPSlJz/view?usp=drive_web
> > > >
> > >
> > > GridStatConfig_precip
> > > <
> > >
> >
>
https://drive.google.com/a/ucar.edu/file/d/0B4UOhocf4VDjWXd3elZNV0pWR2ZFcHlnWlRsTmpaLV9icWln/view?usp=drive_web
> > > >
> > >
> > >
> >
> >
>
>
------------------------------------------------
Subject: Problem with netcdf file?
From: William Stern
Time: Sat Jul 13 12:11:02 2019
Thanks very much John. Your fix solved my problem. For now I will
continue with MRT 6.0, but will explore moving to vers 8.1.1 for
future
work.
Best regards,
Bill
On Fri, Jul 12, 2019 at 5:27 PM John Halley Gotway via RT
<met_help at ucar.edu>
wrote:
> Hi Bill,
>
> I see you're having trouble with the Grid-Stat tool. Thanks for
sending
> along the relevant data files. That helps a lot.
>
> The short answer is that MET is getting confused by having multiple
> "conventions" attributes in your NetCDF file:
>
>
> *ncdump -h PRATEsfc6hrrr.nc | egrep -i ":convention"
> :Conventions = "COARDS" ; :conventions = "CF-1.6" ;*
>
> If you remove the first one, it'll all work as it should:
> * ncatted -a Conventions,global,d,c,'' PRATEsfc6hrrr.nc
> PRATEsfc6hrrr_mod.nc*
>
> If, for whatever reason, you are not able to modify those NetCDF
files, you
> can manually define the file type that should be used in the Grid-
Stat
> config file:
>
>
>
>
>
>
> *fcst = { file_type = NETCDF_NCCF; field = [ { name
=
> "${fcst_var}"; level = [ "${fcst_level}" ];
cat_thresh =
> [ ${thresholds} ];*
>
>
> * } ];}*
>
> Running plot_data_plane to plot the file as-is results in an error:
> */usr/local/met-6.0/bin/plot_data_plane PRATEsfc6hrrr.nc
PRATEsfc6hrrr.ps
> 'name="PRATEsfc"; level="(0,*,*)";'*
> *ERROR : Box::set_lrbt() -> width and/or height negative!*
>
> But using the file_type option to explicitly specify the file type
makes it
> work well:
> */usr/local/met-6.0/bin/plot_data_plane PRATEsfc6hrrr.nc
PRATEsfc6hrrr.ps
> 'name="PRATEsfc"; level="(0,*,*)"; file_type=NETCDF_NCCF;'*
> And I've attached the resulting image.
>
> One final detail to mention. Coincidentally, we updated the latest
bugfix
> release of met (met-8.1.1) to interpret the COARDS conventions as
being
> CF-compliant. So that version of MET processes this data with no
changes
> required. Here's the GitHub issue which documents that change:
> https://github.com/NCAR/MET/issues/1155
>
> Hope that helps clarify.
>
> Thanks,
> John
>
> On Fri, Jul 12, 2019 at 2:05 PM William Stern via RT
<met_help at ucar.edu>
> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=91023 >
> >
> > Thank you Minna. I will await John's insights.
> >
> > Bill
> >
> > On Fri, Jul 12, 2019 at 3:45 PM Minna Win via RT
<met_help at ucar.edu>
> > wrote:
> >
> > > Hello Bill,
> > >
> > > It looks like you are having issues running grid stat with HRRR
data
> you
> > > converted to netcdf. I'm assigning this ticket to John Halley
Gotway,
> > our
> > > resident expert in this area. Please allow a few business days
to
> > receive
> > > a response to your issue.
> > >
> > > Regards,
> > > Minna
> > > ---------------
> > > Minna Win
> > > NCAR
> > > Research Applications Lab
> > > Phone: 303-497-8423
> > > Fax: 303-497-8401
> > >
> > >
> > >
> > > On Thu, Jul 11, 2019 at 11:55 PM William Stern via RT <
> met_help at ucar.edu
> > >
> > > wrote:
> > >
> > > >
> > > > Thu Jul 11 17:54:59 2019: Request 91023 was acted upon.
> > > > Transaction: Ticket created by wstern at ucar.edu
> > > > Queue: met_help
> > > > Subject: Problem with netcdf file?
> > > > Owner: Nobody
> > > > Requestors: wstern at ucar.edu
> > > > Status: new
> > > > Ticket <URL:
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=91023
> > >
> > > >
> > > >
> > > > I am running MET6.0, Gridstat using neighborhood methods for
QPF
> > > > verification, which I have done successfully many times with
our
> model
> > > > output vs Stage 4 observed precip. I trying to verify HRRR
output vs
> > > Stage
> > > > 4, where I have converted the HRRR file to netcdf following
all the
> > > > guidelines outlined in the MET user documentation, I believe.
The
> HRRR
> > > > file seems to be accepted, but MET Gridstat seems to think
there is
> no
> > > > data. Yet when I map the file independently it looks
perfectly fine.
> > > From
> > > > my Google Drive find attached the forecast file
(PRATEsfc6hrrr.nc),
> the
> > > > grib2 analysis file (ST4.2019050106.06h), the verification
output
> > > generated
> > > > (MET6.0_out) and the config file that I am using
> > (GridStatConfig_precip).
> > > > I would appreciate any assistance you could provide.
> > > >
> > > > Thanks,
> > > > Bill Stern
> > > > UCAR/GFDL
> > > >
> > > >
> > > >
> > > > MET6.0_out
> > > > <
> > > >
> > >
> >
>
https://drive.google.com/a/ucar.edu/file/d/0B4UOhocf4VDjTG9USkZpeDJFYVQ2cFdRemxHb1hhZTZ2RW1j/view?usp=drive_web
> > > > >
> > > >
> > > > PRATEsfc6hrrr.nc
> > > > <
> > > >
> > >
> >
>
https://drive.google.com/a/ucar.edu/file/d/0B4UOhocf4VDjU3NaYXBPaUg2T2FicU5GYkZPbURWcFBpdGp3/view?usp=drive_web
> > > > >
> > > >
> > > > ST4.2019050106.06h
> > > > <
> > > >
> > >
> >
>
https://drive.google.com/a/ucar.edu/file/d/0B4UOhocf4VDjazVMTnZ5OXMyZHo0MTNjdFlYbDdXcHFPSlJz/view?usp=drive_web
> > > > >
> > > >
> > > > GridStatConfig_precip
> > > > <
> > > >
> > >
> >
>
https://drive.google.com/a/ucar.edu/file/d/0B4UOhocf4VDjWXd3elZNV0pWR2ZFcHlnWlRsTmpaLV9icWln/view?usp=drive_web
> > > > >
> > > >
> > > >
> > >
> > >
> >
> >
>
>
------------------------------------------------
More information about the Met_help
mailing list