[Met_help] [rt.rap.ucar.edu #77823] History for Trouble running radar NETCDF file for grid_stat verifiction
Julie Prestopnik via RT
met_help at ucar.edu
Wed Sep 14 12:54:37 MDT 2016
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Dear Met Help,
I've been trying to run MET using a radar NETCDF file, and an NMMB model forecast GRIB file, but the following error shows up:
DEBUG 1: Default Config File: /work/apps/pgi_14.10/SANDY/met-5.1/share/met/config/GridStatConfig_default
DEBUG 1: User Config File: GridStatConfig_dbz
ERROR :
ERROR : Trouble reading observation file "Hongqiao.Refl.20150602.s100000.e100500.attributes.nc"
ERROR :
We used two versions of the OBS file, one as it was, and the second with added "attributes". Still, the same error occurred. We are not sure on exactly how our NETCDF files need to be for MET to be able to read them. I searched the error message on the Guide and nothing showed up.
We can share the files to your FTP if you want to run them.
Any help will be greatly appreciated.
NOTE: We are using MET 5.1
Best Regards,
Jose
Jose M. Garcia-Rivera, PhD
Atmospheric Scientist
IM Systems Group
Rockville/College Park, MD
This e-mail, including attachments, may include confidential and/or proprietary information, and may be used only by the person or entity to which it is addressed. If the reader of this e-mail is not the intended recipient or his or her authorized agent, the reader is hereby notified that any dissemination, distribution or copying of this e-mail is prohibited. If you have received this e-mail in error, please notify the sender by replying to this message and delete this e-mail immediately.
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar NETCDF file for grid_stat verifiction
From: Julie Prestopnik
Time: Thu Sep 08 09:57:22 2016
Hi Jose.
I see that you are running MET 5.1, but are unsure of how the NetCDF
files should be formatted in order for GridStat to be able to read
them.
In order it use gridded NetCDF files in MET, you'll need to make them
look like the output of the pcp_combine tool.
Listed below is the header from one of the NetCDF files from
pcp_combine created by the METv5.1 test scripts. Here are the
required parts.
(1) dimensions should be named "lat" and "lon"
(2) the "lat" and "lon" variable are **NOT** required
(3) gridded variables (e.g. APCP_12) must use the "lat" and "lon"
dimensions
(4) gridded variables should include the attributes listed in the
example (for timing info, only the init_time_ut, valid_time_ut, and
accum_time_sec are actually used. "ut" stands for unix time, the
number of seconds since Jan 1, 1970).
(5) global attributes should include the grid/projection
information. This example shows how they're specified for a lambert
conformal projection. Let me know if you're using a different
projection and I'll send you an example.
I hope that helps get you going.
Julie
On Wed, Sep 7, 2016 at 3:15 PM, Jose Garcia-Rivera via RT
<met_help at ucar.edu> wrote:
>
> Wed Sep 07 15:15:39 2016: Request 77823 was acted upon.
> Transaction: Ticket created by GarciaJ at imsg.com
> Queue: met_help
> Subject: Trouble running radar NETCDF file for grid_stat
verifiction
> Owner: Nobody
> Requestors: GarciaJ at imsg.com
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
>
>
> Dear Met Help,
>
>
> I've been trying to run MET using a radar NETCDF file, and an NMMB
model forecast GRIB file, but the following error shows up:
>
>
> DEBUG 1: Default Config File: /work/apps/pgi_14.10/SANDY/met-
5.1/share/met/config/GridStatConfig_default
> DEBUG 1: User Config File: GridStatConfig_dbz
> ERROR :
> ERROR : Trouble reading observation file
"Hongqiao.Refl.20150602.s100000.e100500.attributes.nc"
> ERROR :
>
> We used two versions of the OBS file, one as it was, and the second
with added "attributes". Still, the same error occurred. We are not
sure on exactly how our NETCDF files need to be for MET to be able to
read them. I searched the error message on the Guide and nothing
showed up.
>
> We can share the files to your FTP if you want to run them.
>
> Any help will be greatly appreciated.
>
>
>
> NOTE: We are using MET 5.1
>
>
> Best Regards,
>
> Jose
>
>
>
>
> Jose M. Garcia-Rivera, PhD
>
> Atmospheric Scientist
>
> IM Systems Group
>
> Rockville/College Park, MD
>
> This e-mail, including attachments, may include confidential and/or
proprietary information, and may be used only by the person or entity
to which it is addressed. If the reader of this e-mail is not the
intended recipient or his or her authorized agent, the reader is
hereby notified that any dissemination, distribution or copying of
this e-mail is prohibited. If you have received this e-mail in error,
please notify the sender by replying to this message and delete this
e-mail immediately.
>
>
--
Julie Prestopnik
National Center for Atmospheric Research
Research Applications Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar NETCDF file for grid_stat verifiction
From: Jose Garcia-Rivera
Time: Thu Sep 08 10:36:31 2016
Dear Julie,
Thanks for the helpful response. Can I have an example file from the
pcp_combine tool for reference?
Best Regards,
Jose
________________________________________
From: Julie Prestopnik via RT <met_help at ucar.edu>
Sent: Thursday, September 8, 2016 11:57 AM
To: Jose Garcia-Rivera
Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar NETCDF
file for grid_stat verifiction
Hi Jose.
I see that you are running MET 5.1, but are unsure of how the NetCDF
files should be formatted in order for GridStat to be able to read
them.
In order it use gridded NetCDF files in MET, you'll need to make them
look like the output of the pcp_combine tool.
Listed below is the header from one of the NetCDF files from
pcp_combine created by the METv5.1 test scripts. Here are the
required parts.
(1) dimensions should be named "lat" and "lon"
(2) the "lat" and "lon" variable are **NOT** required
(3) gridded variables (e.g. APCP_12) must use the "lat" and "lon"
dimensions
(4) gridded variables should include the attributes listed in the
example (for timing info, only the init_time_ut, valid_time_ut, and
accum_time_sec are actually used. "ut" stands for unix time, the
number of seconds since Jan 1, 1970).
(5) global attributes should include the grid/projection
information. This example shows how they're specified for a lambert
conformal projection. Let me know if you're using a different
projection and I'll send you an example.
I hope that helps get you going.
Julie
On Wed, Sep 7, 2016 at 3:15 PM, Jose Garcia-Rivera via RT
<met_help at ucar.edu> wrote:
>
> Wed Sep 07 15:15:39 2016: Request 77823 was acted upon.
> Transaction: Ticket created by GarciaJ at imsg.com
> Queue: met_help
> Subject: Trouble running radar NETCDF file for grid_stat
verifiction
> Owner: Nobody
> Requestors: GarciaJ at imsg.com
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
>
>
> Dear Met Help,
>
>
> I've been trying to run MET using a radar NETCDF file, and an NMMB
model forecast GRIB file, but the following error shows up:
>
>
> DEBUG 1: Default Config File: /work/apps/pgi_14.10/SANDY/met-
5.1/share/met/config/GridStatConfig_default
> DEBUG 1: User Config File: GridStatConfig_dbz
> ERROR :
> ERROR : Trouble reading observation file
"Hongqiao.Refl.20150602.s100000.e100500.attributes.nc"
> ERROR :
>
> We used two versions of the OBS file, one as it was, and the second
with added "attributes". Still, the same error occurred. We are not
sure on exactly how our NETCDF files need to be for MET to be able to
read them. I searched the error message on the Guide and nothing
showed up.
>
> We can share the files to your FTP if you want to run them.
>
> Any help will be greatly appreciated.
>
>
>
> NOTE: We are using MET 5.1
>
>
> Best Regards,
>
> Jose
>
>
>
>
> Jose M. Garcia-Rivera, PhD
>
> Atmospheric Scientist
>
> IM Systems Group
>
> Rockville/College Park, MD
>
> This e-mail, including attachments, may include confidential and/or
proprietary information, and may be used only by the person or entity
to which it is addressed. If the reader of this e-mail is not the
intended recipient or his or her authorized agent, the reader is
hereby notified that any dissemination, distribution or copying of
this e-mail is prohibited. If you have received this e-mail in error,
please notify the sender by replying to this message and delete this
e-mail immediately.
>
>
--
Julie Prestopnik
National Center for Atmospheric Research
Research Applications Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
This e-mail, including attachments, may include confidential and/or
proprietary information, and may be used only by the person or entity
to which it is addressed. If the reader of this e-mail is not the
intended recipient or his or her authorized agent, the reader is
hereby notified that any dissemination, distribution or copying of
this e-mail is prohibited. If you have received this e-mail in error,
please notify the sender by replying to this message and delete this
e-mail immediately.
------------------------------------------------
Subject: Trouble running radar NETCDF file for grid_stat verifiction
From: Julie Prestopnik
Time: Thu Sep 08 10:58:55 2016
My apologies. I meant to attach the file in my last email. You can
find it attached to this one.
Thanks,
Julie
On Thu, Sep 8, 2016 at 10:36 AM, Jose Garcia-Rivera via RT
<met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
>
> Dear Julie,
>
> Thanks for the helpful response. Can I have an example file from the
pcp_combine tool for reference?
>
> Best Regards,
> Jose
> ________________________________________
> From: Julie Prestopnik via RT <met_help at ucar.edu>
> Sent: Thursday, September 8, 2016 11:57 AM
> To: Jose Garcia-Rivera
> Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar NETCDF
file for grid_stat verifiction
>
> Hi Jose.
>
> I see that you are running MET 5.1, but are unsure of how the NetCDF
> files should be formatted in order for GridStat to be able to read
> them.
>
> In order it use gridded NetCDF files in MET, you'll need to make
them
> look like the output of the pcp_combine tool.
>
> Listed below is the header from one of the NetCDF files from
> pcp_combine created by the METv5.1 test scripts. Here are the
> required parts.
>
> (1) dimensions should be named "lat" and "lon"
> (2) the "lat" and "lon" variable are **NOT** required
> (3) gridded variables (e.g. APCP_12) must use the "lat" and "lon"
dimensions
> (4) gridded variables should include the attributes listed in the
> example (for timing info, only the init_time_ut, valid_time_ut, and
> accum_time_sec are actually used. "ut" stands for unix time, the
> number of seconds since Jan 1, 1970).
> (5) global attributes should include the grid/projection
> information. This example shows how they're specified for a lambert
> conformal projection. Let me know if you're using a different
> projection and I'll send you an example.
>
> I hope that helps get you going.
>
> Julie
>
>
>
> On Wed, Sep 7, 2016 at 3:15 PM, Jose Garcia-Rivera via RT
> <met_help at ucar.edu> wrote:
>>
>> Wed Sep 07 15:15:39 2016: Request 77823 was acted upon.
>> Transaction: Ticket created by GarciaJ at imsg.com
>> Queue: met_help
>> Subject: Trouble running radar NETCDF file for grid_stat
verifiction
>> Owner: Nobody
>> Requestors: GarciaJ at imsg.com
>> Status: new
>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
>>
>>
>> Dear Met Help,
>>
>>
>> I've been trying to run MET using a radar NETCDF file, and an NMMB
model forecast GRIB file, but the following error shows up:
>>
>>
>> DEBUG 1: Default Config File: /work/apps/pgi_14.10/SANDY/met-
5.1/share/met/config/GridStatConfig_default
>> DEBUG 1: User Config File: GridStatConfig_dbz
>> ERROR :
>> ERROR : Trouble reading observation file
"Hongqiao.Refl.20150602.s100000.e100500.attributes.nc"
>> ERROR :
>>
>> We used two versions of the OBS file, one as it was, and the second
with added "attributes". Still, the same error occurred. We are not
sure on exactly how our NETCDF files need to be for MET to be able to
read them. I searched the error message on the Guide and nothing
showed up.
>>
>> We can share the files to your FTP if you want to run them.
>>
>> Any help will be greatly appreciated.
>>
>>
>>
>> NOTE: We are using MET 5.1
>>
>>
>> Best Regards,
>>
>> Jose
>>
>>
>>
>>
>> Jose M. Garcia-Rivera, PhD
>>
>> Atmospheric Scientist
>>
>> IM Systems Group
>>
>> Rockville/College Park, MD
>>
>> This e-mail, including attachments, may include confidential and/or
proprietary information, and may be used only by the person or entity
to which it is addressed. If the reader of this e-mail is not the
intended recipient or his or her authorized agent, the reader is
hereby notified that any dissemination, distribution or copying of
this e-mail is prohibited. If you have received this e-mail in error,
please notify the sender by replying to this message and delete this
e-mail immediately.
>>
>>
>
>
>
> --
> Julie Prestopnik
> National Center for Atmospheric Research
> Research Applications Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
>
> This e-mail, including attachments, may include confidential and/or
proprietary information, and may be used only by the person or entity
to which it is addressed. If the reader of this e-mail is not the
intended recipient or his or her authorized agent, the reader is
hereby notified that any dissemination, distribution or copying of
this e-mail is prohibited. If you have received this e-mail in error,
please notify the sender by replying to this message and delete this
e-mail immediately.
>
>
--
Julie Prestopnik
National Center for Atmospheric Research
Research Applications Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar NETCDF file for grid_stat verifiction
From: Jose Garcia-Rivera
Time: Thu Sep 08 12:10:43 2016
Dear Julie,
Thanks so much for the file. We haven't been able to work on it yet,
since we are fixing computer issues. One more question, do you have a
radar obs netcdf example file?
Best Regards,
Jose
From: Julie Prestopnik via RT <met_help at ucar.edu>
Sent: Thursday, September 8, 2016 12:58 PM
To: Jose Garcia-Rivera
Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar NETCDF
file for grid_stat verifiction
My apologies. I meant to attach the file in my last email. You can
find it attached to this one.
Thanks,
Julie
On Thu, Sep 8, 2016 at 10:36 AM, Jose Garcia-Rivera via RT
<met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
>
> Dear Julie,
>
> Thanks for the helpful response. Can I have an example file from the
pcp_combine tool for reference?
>
> Best Regards,
> Jose
> ________________________________________
> From: Julie Prestopnik via RT <met_help at ucar.edu>
> Sent: Thursday, September 8, 2016 11:57 AM
> To: Jose Garcia-Rivera
> Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar NETCDF
file for grid_stat verifiction
>
> Hi Jose.
>
> I see that you are running MET 5.1, but are unsure of how the NetCDF
> files should be formatted in order for GridStat to be able to read
> them.
>
> In order it use gridded NetCDF files in MET, you'll need to make
them
> look like the output of the pcp_combine tool.
>
> Listed below is the header from one of the NetCDF files from
> pcp_combine created by the METv5.1 test scripts. Here are the
> required parts.
>
> (1) dimensions should be named "lat" and "lon"
> (2) the "lat" and "lon" variable are **NOT** required
> (3) gridded variables (e.g. APCP_12) must use the "lat" and "lon"
dimensions
> (4) gridded variables should include the attributes listed in the
> example (for timing info, only the init_time_ut, valid_time_ut, and
> accum_time_sec are actually used. "ut" stands for unix time, the
> number of seconds since Jan 1, 1970).
> (5) global attributes should include the grid/projection
> information. This example shows how they're specified for a lambert
> conformal projection. Let me know if you're using a different
> projection and I'll send you an example.
>
> I hope that helps get you going.
>
> Julie
>
>
>
> On Wed, Sep 7, 2016 at 3:15 PM, Jose Garcia-Rivera via RT
> <met_help at ucar.edu> wrote:
>>
>> Wed Sep 07 15:15:39 2016: Request 77823 was acted upon.
>> Transaction: Ticket created by GarciaJ at imsg.com
>> Queue: met_help
>> Subject: Trouble running radar NETCDF file for grid_stat
verifiction
>> Owner: Nobody
>> Requestors: GarciaJ at imsg.com
>> Status: new
>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
>>
>>
>> Dear Met Help,
>>
>>
>> I've been trying to run MET using a radar NETCDF file, and an NMMB
model forecast GRIB file, but the following error shows up:
>>
>>
>> DEBUG 1: Default Config File: /work/apps/pgi_14.10/SANDY/met-
5.1/share/met/config/GridStatConfig_default
>> DEBUG 1: User Config File: GridStatConfig_dbz
>> ERROR :
>> ERROR : Trouble reading observation file
"Hongqiao.Refl.20150602.s100000.e100500.attributes.nc"
>> ERROR :
>>
>> We used two versions of the OBS file, one as it was, and the second
with added "attributes". Still, the same error occurred. We are not
sure on exactly how our NETCDF files need to be for MET to be able to
read them. I searched the error message on the Guide and nothing
showed up.
>>
>> We can share the files to your FTP if you want to run them.
>>
>> Any help will be greatly appreciated.
>>
>>
>>
>> NOTE: We are using MET 5.1
>>
>>
>> Best Regards,
>>
>> Jose
>>
>>
>>
>>
>> Jose M. Garcia-Rivera, PhD
>>
>> Atmospheric Scientist
>>
>> IM Systems Group
>>
>> Rockville/College Park, MD
>>
>> This e-mail, including attachments, may include confidential and/or
proprietary information, and may be used only by the person or entity
to which it is addressed. If the reader of this e-mail is not the
intended recipient or his or her authorized agent, the reader is
hereby notified that any dissemination, distribution or copying of
this e-mail is prohibited. If you have received this e-mail in error,
please notify the sender by replying to this message and delete this
e-mail immediately.
>>
>>
>
>
>
> --
> Julie Prestopnik
> National Center for Atmospheric Research
> Research Applications Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
>
> This e-mail, including attachments, may include confidential and/or
proprietary information, and may be used only by the person or entity
to which it is addressed. If the reader of this e-mail is not the
intended recipient or his or her authorized agent, the reader is
hereby notified that any dissemination, distribution or copying of
this e-mail is prohibited. If you have received this e-mail in error,
please notify the sender by replying to this message and delete this
e-mail immediately.
>
>
--
Julie Prestopnik
National Center for Atmospheric Research
Research Applications Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
This e-mail, including attachments, may include confidential and/or
proprietary information, and may be used only by the person or entity
to which it is addressed. If the reader of this e-mail is not the
intended recipient or his or her authorized agent, the reader is
hereby notified that any dissemination, distribution or copying of
this e-mail is prohibited. If you have received this e-mail in error,
please notify the sender by replying to this message and delete this
e-mail immediately.
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar NETCDF file for grid_stat verifiction
From: Julie Prestopnik
Time: Thu Sep 08 13:57:46 2016
Hi Jose.
Unfortunately, we do not have a radar obs netcdf example file. With
NetCDF, users have two choices:
--make it look like the NetCDF files that MET generates (i.e. the
output of pcp_combine) or
--put it into CF-compliant NetCDF
The variable can be named "radar_obs" or "precip" or anything you'd
like.
Julie
On Thu, Sep 8, 2016 at 12:10 PM, Jose Garcia-Rivera via RT
<met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
>
> Dear Julie,
>
> Thanks so much for the file. We haven't been able to work on it yet,
since we are fixing computer issues. One more question, do you have a
radar obs netcdf example file?
>
> Best Regards,
> Jose
>
> From: Julie Prestopnik via RT <met_help at ucar.edu>
> Sent: Thursday, September 8, 2016 12:58 PM
> To: Jose Garcia-Rivera
> Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar NETCDF
file for grid_stat verifiction
>
> My apologies. I meant to attach the file in my last email. You
can
> find it attached to this one.
>
> Thanks,
> Julie
>
> On Thu, Sep 8, 2016 at 10:36 AM, Jose Garcia-Rivera via RT
> <met_help at ucar.edu> wrote:
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
>>
>> Dear Julie,
>>
>> Thanks for the helpful response. Can I have an example file from
the pcp_combine tool for reference?
>>
>> Best Regards,
>> Jose
>> ________________________________________
>> From: Julie Prestopnik via RT <met_help at ucar.edu>
>> Sent: Thursday, September 8, 2016 11:57 AM
>> To: Jose Garcia-Rivera
>> Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar NETCDF
file for grid_stat verifiction
>>
>> Hi Jose.
>>
>> I see that you are running MET 5.1, but are unsure of how the
NetCDF
>> files should be formatted in order for GridStat to be able to read
>> them.
>>
>> In order it use gridded NetCDF files in MET, you'll need to make
them
>> look like the output of the pcp_combine tool.
>>
>> Listed below is the header from one of the NetCDF files from
>> pcp_combine created by the METv5.1 test scripts. Here are the
>> required parts.
>>
>> (1) dimensions should be named "lat" and "lon"
>> (2) the "lat" and "lon" variable are **NOT** required
>> (3) gridded variables (e.g. APCP_12) must use the "lat" and "lon"
dimensions
>> (4) gridded variables should include the attributes listed in the
>> example (for timing info, only the init_time_ut, valid_time_ut, and
>> accum_time_sec are actually used. "ut" stands for unix time, the
>> number of seconds since Jan 1, 1970).
>> (5) global attributes should include the grid/projection
>> information. This example shows how they're specified for a
lambert
>> conformal projection. Let me know if you're using a different
>> projection and I'll send you an example.
>>
>> I hope that helps get you going.
>>
>> Julie
>>
>>
>>
>> On Wed, Sep 7, 2016 at 3:15 PM, Jose Garcia-Rivera via RT
>> <met_help at ucar.edu> wrote:
>>>
>>> Wed Sep 07 15:15:39 2016: Request 77823 was acted upon.
>>> Transaction: Ticket created by GarciaJ at imsg.com
>>> Queue: met_help
>>> Subject: Trouble running radar NETCDF file for grid_stat
verifiction
>>> Owner: Nobody
>>> Requestors: GarciaJ at imsg.com
>>> Status: new
>>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
>>>
>>>
>>> Dear Met Help,
>>>
>>>
>>> I've been trying to run MET using a radar NETCDF file, and an NMMB
model forecast GRIB file, but the following error shows up:
>>>
>>>
>>> DEBUG 1: Default Config File: /work/apps/pgi_14.10/SANDY/met-
5.1/share/met/config/GridStatConfig_default
>>> DEBUG 1: User Config File: GridStatConfig_dbz
>>> ERROR :
>>> ERROR : Trouble reading observation file
"Hongqiao.Refl.20150602.s100000.e100500.attributes.nc"
>>> ERROR :
>>>
>>> We used two versions of the OBS file, one as it was, and the
second with added "attributes". Still, the same error occurred. We are
not sure on exactly how our NETCDF files need to be for MET to be able
to read them. I searched the error message on the Guide and nothing
showed up.
>>>
>>> We can share the files to your FTP if you want to run them.
>>>
>>> Any help will be greatly appreciated.
>>>
>>>
>>>
>>> NOTE: We are using MET 5.1
>>>
>>>
>>> Best Regards,
>>>
>>> Jose
>>>
>>>
>>>
>>>
>>> Jose M. Garcia-Rivera, PhD
>>>
>>> Atmospheric Scientist
>>>
>>> IM Systems Group
>>>
>>> Rockville/College Park, MD
>>>
>>> This e-mail, including attachments, may include confidential
and/or proprietary information, and may be used only by the person or
entity to which it is addressed. If the reader of this e-mail is not
the intended recipient or his or her authorized agent, the reader is
hereby notified that any dissemination, distribution or copying of
this e-mail is prohibited. If you have received this e-mail in error,
please notify the sender by replying to this message and delete this
e-mail immediately.
>>>
>>>
>>
>>
>>
>> --
>> Julie Prestopnik
>> National Center for Atmospheric Research
>> Research Applications Laboratory
>> Phone: 303.497.8399
>> Email: jpresto at ucar.edu
>>
>>
>> This e-mail, including attachments, may include confidential and/or
proprietary information, and may be used only by the person or entity
to which it is addressed. If the reader of this e-mail is not the
intended recipient or his or her authorized agent, the reader is
hereby notified that any dissemination, distribution or copying of
this e-mail is prohibited. If you have received this e-mail in error,
please notify the sender by replying to this message and delete this
e-mail immediately.
>>
>>
>
>
>
> --
> Julie Prestopnik
> National Center for Atmospheric Research
> Research Applications Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
> This e-mail, including attachments, may include confidential and/or
proprietary information, and may be used only by the person or entity
to which it is addressed. If the reader of this e-mail is not the
intended recipient or his or her authorized agent, the reader is
hereby notified that any dissemination, distribution or copying of
this e-mail is prohibited. If you have received this e-mail in error,
please notify the sender by replying to this message and delete this
e-mail immediately.
>
>
--
Julie Prestopnik
National Center for Atmospheric Research
Research Applications Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar NETCDF file for grid_stat verifiction
From: Jose Garcia-Rivera
Time: Thu Sep 08 15:25:19 2016
Dear Julie,
That's very good information, thanks. We've been working on this
issue, however the same error keeps showing up.
Can we get a Mercator projection example?
I was wondering if you could have a peek into our netcdf file, or run
an internal test to see what needs to be changed, or what may be
wrong. In the meantime, we continue working on trying to make the file
fit MET requirements.
Thanks for the help,
Jose
________________________________________
From: Julie Prestopnik via RT <met_help at ucar.edu>
Sent: Thursday, September 8, 2016 3:57 PM
To: Jose Garcia-Rivera
Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar NETCDF
file for grid_stat verifiction
Hi Jose.
Unfortunately, we do not have a radar obs netcdf example file. With
NetCDF, users have two choices:
--make it look like the NetCDF files that MET generates (i.e. the
output of pcp_combine) or
--put it into CF-compliant NetCDF
The variable can be named "radar_obs" or "precip" or anything you'd
like.
Julie
On Thu, Sep 8, 2016 at 12:10 PM, Jose Garcia-Rivera via RT
<met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
>
> Dear Julie,
>
> Thanks so much for the file. We haven't been able to work on it yet,
since we are fixing computer issues. One more question, do you have a
radar obs netcdf example file?
>
> Best Regards,
> Jose
>
> From: Julie Prestopnik via RT <met_help at ucar.edu>
> Sent: Thursday, September 8, 2016 12:58 PM
> To: Jose Garcia-Rivera
> Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar NETCDF
file for grid_stat verifiction
>
> My apologies. I meant to attach the file in my last email. You
can
> find it attached to this one.
>
> Thanks,
> Julie
>
> On Thu, Sep 8, 2016 at 10:36 AM, Jose Garcia-Rivera via RT
> <met_help at ucar.edu> wrote:
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
>>
>> Dear Julie,
>>
>> Thanks for the helpful response. Can I have an example file from
the pcp_combine tool for reference?
>>
>> Best Regards,
>> Jose
>> ________________________________________
>> From: Julie Prestopnik via RT <met_help at ucar.edu>
>> Sent: Thursday, September 8, 2016 11:57 AM
>> To: Jose Garcia-Rivera
>> Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar NETCDF
file for grid_stat verifiction
>>
>> Hi Jose.
>>
>> I see that you are running MET 5.1, but are unsure of how the
NetCDF
>> files should be formatted in order for GridStat to be able to read
>> them.
>>
>> In order it use gridded NetCDF files in MET, you'll need to make
them
>> look like the output of the pcp_combine tool.
>>
>> Listed below is the header from one of the NetCDF files from
>> pcp_combine created by the METv5.1 test scripts. Here are the
>> required parts.
>>
>> (1) dimensions should be named "lat" and "lon"
>> (2) the "lat" and "lon" variable are **NOT** required
>> (3) gridded variables (e.g. APCP_12) must use the "lat" and "lon"
dimensions
>> (4) gridded variables should include the attributes listed in the
>> example (for timing info, only the init_time_ut, valid_time_ut, and
>> accum_time_sec are actually used. "ut" stands for unix time, the
>> number of seconds since Jan 1, 1970).
>> (5) global attributes should include the grid/projection
>> information. This example shows how they're specified for a
lambert
>> conformal projection. Let me know if you're using a different
>> projection and I'll send you an example.
>>
>> I hope that helps get you going.
>>
>> Julie
>>
>>
>>
>> On Wed, Sep 7, 2016 at 3:15 PM, Jose Garcia-Rivera via RT
>> <met_help at ucar.edu> wrote:
>>>
>>> Wed Sep 07 15:15:39 2016: Request 77823 was acted upon.
>>> Transaction: Ticket created by GarciaJ at imsg.com
>>> Queue: met_help
>>> Subject: Trouble running radar NETCDF file for grid_stat
verifiction
>>> Owner: Nobody
>>> Requestors: GarciaJ at imsg.com
>>> Status: new
>>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
>>>
>>>
>>> Dear Met Help,
>>>
>>>
>>> I've been trying to run MET using a radar NETCDF file, and an NMMB
model forecast GRIB file, but the following error shows up:
>>>
>>>
>>> DEBUG 1: Default Config File: /work/apps/pgi_14.10/SANDY/met-
5.1/share/met/config/GridStatConfig_default
>>> DEBUG 1: User Config File: GridStatConfig_dbz
>>> ERROR :
>>> ERROR : Trouble reading observation file
"Hongqiao.Refl.20150602.s100000.e100500.attributes.nc"
>>> ERROR :
>>>
>>> We used two versions of the OBS file, one as it was, and the
second with added "attributes". Still, the same error occurred. We are
not sure on exactly how our NETCDF files need to be for MET to be able
to read them. I searched the error message on the Guide and nothing
showed up.
>>>
>>> We can share the files to your FTP if you want to run them.
>>>
>>> Any help will be greatly appreciated.
>>>
>>>
>>>
>>> NOTE: We are using MET 5.1
>>>
>>>
>>> Best Regards,
>>>
>>> Jose
>>>
>>>
>>>
>>>
>>> Jose M. Garcia-Rivera, PhD
>>>
>>> Atmospheric Scientist
>>>
>>> IM Systems Group
>>>
>>> Rockville/College Park, MD
>>>
>>> This e-mail, including attachments, may include confidential
and/or proprietary information, and may be used only by the person or
entity to which it is addressed. If the reader of this e-mail is not
the intended recipient or his or her authorized agent, the reader is
hereby notified that any dissemination, distribution or copying of
this e-mail is prohibited. If you have received this e-mail in error,
please notify the sender by replying to this message and delete this
e-mail immediately.
>>>
>>>
>>
>>
>>
>> --
>> Julie Prestopnik
>> National Center for Atmospheric Research
>> Research Applications Laboratory
>> Phone: 303.497.8399
>> Email: jpresto at ucar.edu
>>
>>
>> This e-mail, including attachments, may include confidential and/or
proprietary information, and may be used only by the person or entity
to which it is addressed. If the reader of this e-mail is not the
intended recipient or his or her authorized agent, the reader is
hereby notified that any dissemination, distribution or copying of
this e-mail is prohibited. If you have received this e-mail in error,
please notify the sender by replying to this message and delete this
e-mail immediately.
>>
>>
>
>
>
> --
> Julie Prestopnik
> National Center for Atmospheric Research
> Research Applications Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
> This e-mail, including attachments, may include confidential and/or
proprietary information, and may be used only by the person or entity
to which it is addressed. If the reader of this e-mail is not the
intended recipient or his or her authorized agent, the reader is
hereby notified that any dissemination, distribution or copying of
this e-mail is prohibited. If you have received this e-mail in error,
please notify the sender by replying to this message and delete this
e-mail immediately.
>
>
--
Julie Prestopnik
National Center for Atmospheric Research
Research Applications Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
This e-mail, including attachments, may include confidential and/or
proprietary information, and may be used only by the person or entity
to which it is addressed. If the reader of this e-mail is not the
intended recipient or his or her authorized agent, the reader is
hereby notified that any dissemination, distribution or copying of
this e-mail is prohibited. If you have received this e-mail in error,
please notify the sender by replying to this message and delete this
e-mail immediately.
------------------------------------------------
Subject: Trouble running radar NETCDF file for grid_stat verifiction
From: Julie Prestopnik
Time: Fri Sep 09 09:50:02 2016
Hi Jose. I have attached a Mercator projection example. If you're
still stuck, please post your data to our
anonymous FTP site following these instructions:
http://www.dtcenter.org/met/users/support/met_help.php#ftp
Thanks,
Julie
On Thu, Sep 8, 2016 at 3:25 PM, Jose Garcia-Rivera via RT
<met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
>
> Dear Julie,
>
> That's very good information, thanks. We've been working on this
issue, however the same error keeps showing up.
>
> Can we get a Mercator projection example?
>
> I was wondering if you could have a peek into our netcdf file, or
run an internal test to see what needs to be changed, or what may be
wrong. In the meantime, we continue working on trying to make the file
fit MET requirements.
>
> Thanks for the help,
> Jose
>
> ________________________________________
> From: Julie Prestopnik via RT <met_help at ucar.edu>
> Sent: Thursday, September 8, 2016 3:57 PM
> To: Jose Garcia-Rivera
> Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar NETCDF
file for grid_stat verifiction
>
> Hi Jose.
>
> Unfortunately, we do not have a radar obs netcdf example file. With
> NetCDF, users have two choices:
> --make it look like the NetCDF files that MET generates (i.e. the
> output of pcp_combine) or
> --put it into CF-compliant NetCDF
> The variable can be named "radar_obs" or "precip" or anything you'd
like.
>
> Julie
>
>
> On Thu, Sep 8, 2016 at 12:10 PM, Jose Garcia-Rivera via RT
> <met_help at ucar.edu> wrote:
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
>>
>> Dear Julie,
>>
>> Thanks so much for the file. We haven't been able to work on it
yet, since we are fixing computer issues. One more question, do you
have a radar obs netcdf example file?
>>
>> Best Regards,
>> Jose
>>
>> From: Julie Prestopnik via RT <met_help at ucar.edu>
>> Sent: Thursday, September 8, 2016 12:58 PM
>> To: Jose Garcia-Rivera
>> Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar NETCDF
file for grid_stat verifiction
>>
>> My apologies. I meant to attach the file in my last email. You
can
>> find it attached to this one.
>>
>> Thanks,
>> Julie
>>
>> On Thu, Sep 8, 2016 at 10:36 AM, Jose Garcia-Rivera via RT
>> <met_help at ucar.edu> wrote:
>>>
>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
>>>
>>> Dear Julie,
>>>
>>> Thanks for the helpful response. Can I have an example file from
the pcp_combine tool for reference?
>>>
>>> Best Regards,
>>> Jose
>>> ________________________________________
>>> From: Julie Prestopnik via RT <met_help at ucar.edu>
>>> Sent: Thursday, September 8, 2016 11:57 AM
>>> To: Jose Garcia-Rivera
>>> Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar NETCDF
file for grid_stat verifiction
>>>
>>> Hi Jose.
>>>
>>> I see that you are running MET 5.1, but are unsure of how the
NetCDF
>>> files should be formatted in order for GridStat to be able to read
>>> them.
>>>
>>> In order it use gridded NetCDF files in MET, you'll need to make
them
>>> look like the output of the pcp_combine tool.
>>>
>>> Listed below is the header from one of the NetCDF files from
>>> pcp_combine created by the METv5.1 test scripts. Here are the
>>> required parts.
>>>
>>> (1) dimensions should be named "lat" and "lon"
>>> (2) the "lat" and "lon" variable are **NOT** required
>>> (3) gridded variables (e.g. APCP_12) must use the "lat" and
"lon" dimensions
>>> (4) gridded variables should include the attributes listed in
the
>>> example (for timing info, only the init_time_ut, valid_time_ut,
and
>>> accum_time_sec are actually used. "ut" stands for unix time, the
>>> number of seconds since Jan 1, 1970).
>>> (5) global attributes should include the grid/projection
>>> information. This example shows how they're specified for a
lambert
>>> conformal projection. Let me know if you're using a different
>>> projection and I'll send you an example.
>>>
>>> I hope that helps get you going.
>>>
>>> Julie
>>>
>>>
>>>
>>> On Wed, Sep 7, 2016 at 3:15 PM, Jose Garcia-Rivera via RT
>>> <met_help at ucar.edu> wrote:
>>>>
>>>> Wed Sep 07 15:15:39 2016: Request 77823 was acted upon.
>>>> Transaction: Ticket created by GarciaJ at imsg.com
>>>> Queue: met_help
>>>> Subject: Trouble running radar NETCDF file for grid_stat
verifiction
>>>> Owner: Nobody
>>>> Requestors: GarciaJ at imsg.com
>>>> Status: new
>>>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
>>>>
>>>>
>>>> Dear Met Help,
>>>>
>>>>
>>>> I've been trying to run MET using a radar NETCDF file, and an
NMMB model forecast GRIB file, but the following error shows up:
>>>>
>>>>
>>>> DEBUG 1: Default Config File: /work/apps/pgi_14.10/SANDY/met-
5.1/share/met/config/GridStatConfig_default
>>>> DEBUG 1: User Config File: GridStatConfig_dbz
>>>> ERROR :
>>>> ERROR : Trouble reading observation file
"Hongqiao.Refl.20150602.s100000.e100500.attributes.nc"
>>>> ERROR :
>>>>
>>>> We used two versions of the OBS file, one as it was, and the
second with added "attributes". Still, the same error occurred. We are
not sure on exactly how our NETCDF files need to be for MET to be able
to read them. I searched the error message on the Guide and nothing
showed up.
>>>>
>>>> We can share the files to your FTP if you want to run them.
>>>>
>>>> Any help will be greatly appreciated.
>>>>
>>>>
>>>>
>>>> NOTE: We are using MET 5.1
>>>>
>>>>
>>>> Best Regards,
>>>>
>>>> Jose
>>>>
>>>>
>>>>
>>>>
>>>> Jose M. Garcia-Rivera, PhD
>>>>
>>>> Atmospheric Scientist
>>>>
>>>> IM Systems Group
>>>>
>>>> Rockville/College Park, MD
>>>>
>>>> This e-mail, including attachments, may include confidential
and/or proprietary information, and may be used only by the person or
entity to which it is addressed. If the reader of this e-mail is not
the intended recipient or his or her authorized agent, the reader is
hereby notified that any dissemination, distribution or copying of
this e-mail is prohibited. If you have received this e-mail in error,
please notify the sender by replying to this message and delete this
e-mail immediately.
>>>>
>>>>
>>>
>>>
>>>
>>> --
>>> Julie Prestopnik
>>> National Center for Atmospheric Research
>>> Research Applications Laboratory
>>> Phone: 303.497.8399
>>> Email: jpresto at ucar.edu
>>>
>>>
>>> This e-mail, including attachments, may include confidential
and/or proprietary information, and may be used only by the person or
entity to which it is addressed. If the reader of this e-mail is not
the intended recipient or his or her authorized agent, the reader is
hereby notified that any dissemination, distribution or copying of
this e-mail is prohibited. If you have received this e-mail in error,
please notify the sender by replying to this message and delete this
e-mail immediately.
>>>
>>>
>>
>>
>>
>> --
>> Julie Prestopnik
>> National Center for Atmospheric Research
>> Research Applications Laboratory
>> Phone: 303.497.8399
>> Email: jpresto at ucar.edu
>>
>> This e-mail, including attachments, may include confidential and/or
proprietary information, and may be used only by the person or entity
to which it is addressed. If the reader of this e-mail is not the
intended recipient or his or her authorized agent, the reader is
hereby notified that any dissemination, distribution or copying of
this e-mail is prohibited. If you have received this e-mail in error,
please notify the sender by replying to this message and delete this
e-mail immediately.
>>
>>
>
>
>
> --
> Julie Prestopnik
> National Center for Atmospheric Research
> Research Applications Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
>
> This e-mail, including attachments, may include confidential and/or
proprietary information, and may be used only by the person or entity
to which it is addressed. If the reader of this e-mail is not the
intended recipient or his or her authorized agent, the reader is
hereby notified that any dissemination, distribution or copying of
this e-mail is prohibited. If you have received this e-mail in error,
please notify the sender by replying to this message and delete this
e-mail immediately.
>
>
--
Julie Prestopnik
National Center for Atmospheric Research
Research Applications Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar NETCDF file for grid_stat verifiction
From: Jose Garcia-Rivera
Time: Fri Sep 09 10:38:54 2016
Dear Julie,
We used the Mercator example, and ours looks identical to yours. I
proceeded and put 4 files into your FTP server:
Model forecast file
Radar Obs file
Grid Stat Config file
domain.poly file
The files are under 'garcia_data'
Thanks so much for your help,
Jose
________________________________________
From: Julie Prestopnik via RT <met_help at ucar.edu>
Sent: Friday, September 9, 2016 11:50 AM
To: Jose Garcia-Rivera
Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar NETCDF
file for grid_stat verifiction
Hi Jose. I have attached a Mercator projection example. If you're
still stuck, please post your data to our
anonymous FTP site following these instructions:
http://www.dtcenter.org/met/users/support/met_help.php#ftp
Thanks,
Julie
On Thu, Sep 8, 2016 at 3:25 PM, Jose Garcia-Rivera via RT
<met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
>
> Dear Julie,
>
> That's very good information, thanks. We've been working on this
issue, however the same error keeps showing up.
>
> Can we get a Mercator projection example?
>
> I was wondering if you could have a peek into our netcdf file, or
run an internal test to see what needs to be changed, or what may be
wrong. In the meantime, we continue working on trying to make the file
fit MET requirements.
>
> Thanks for the help,
> Jose
>
> ________________________________________
> From: Julie Prestopnik via RT <met_help at ucar.edu>
> Sent: Thursday, September 8, 2016 3:57 PM
> To: Jose Garcia-Rivera
> Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar NETCDF
file for grid_stat verifiction
>
> Hi Jose.
>
> Unfortunately, we do not have a radar obs netcdf example file. With
> NetCDF, users have two choices:
> --make it look like the NetCDF files that MET generates (i.e. the
> output of pcp_combine) or
> --put it into CF-compliant NetCDF
> The variable can be named "radar_obs" or "precip" or anything you'd
like.
>
> Julie
>
>
> On Thu, Sep 8, 2016 at 12:10 PM, Jose Garcia-Rivera via RT
> <met_help at ucar.edu> wrote:
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
>>
>> Dear Julie,
>>
>> Thanks so much for the file. We haven't been able to work on it
yet, since we are fixing computer issues. One more question, do you
have a radar obs netcdf example file?
>>
>> Best Regards,
>> Jose
>>
>> From: Julie Prestopnik via RT <met_help at ucar.edu>
>> Sent: Thursday, September 8, 2016 12:58 PM
>> To: Jose Garcia-Rivera
>> Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar NETCDF
file for grid_stat verifiction
>>
>> My apologies. I meant to attach the file in my last email. You
can
>> find it attached to this one.
>>
>> Thanks,
>> Julie
>>
>> On Thu, Sep 8, 2016 at 10:36 AM, Jose Garcia-Rivera via RT
>> <met_help at ucar.edu> wrote:
>>>
>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
>>>
>>> Dear Julie,
>>>
>>> Thanks for the helpful response. Can I have an example file from
the pcp_combine tool for reference?
>>>
>>> Best Regards,
>>> Jose
>>> ________________________________________
>>> From: Julie Prestopnik via RT <met_help at ucar.edu>
>>> Sent: Thursday, September 8, 2016 11:57 AM
>>> To: Jose Garcia-Rivera
>>> Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar NETCDF
file for grid_stat verifiction
>>>
>>> Hi Jose.
>>>
>>> I see that you are running MET 5.1, but are unsure of how the
NetCDF
>>> files should be formatted in order for GridStat to be able to read
>>> them.
>>>
>>> In order it use gridded NetCDF files in MET, you'll need to make
them
>>> look like the output of the pcp_combine tool.
>>>
>>> Listed below is the header from one of the NetCDF files from
>>> pcp_combine created by the METv5.1 test scripts. Here are the
>>> required parts.
>>>
>>> (1) dimensions should be named "lat" and "lon"
>>> (2) the "lat" and "lon" variable are **NOT** required
>>> (3) gridded variables (e.g. APCP_12) must use the "lat" and
"lon" dimensions
>>> (4) gridded variables should include the attributes listed in
the
>>> example (for timing info, only the init_time_ut, valid_time_ut,
and
>>> accum_time_sec are actually used. "ut" stands for unix time, the
>>> number of seconds since Jan 1, 1970).
>>> (5) global attributes should include the grid/projection
>>> information. This example shows how they're specified for a
lambert
>>> conformal projection. Let me know if you're using a different
>>> projection and I'll send you an example.
>>>
>>> I hope that helps get you going.
>>>
>>> Julie
>>>
>>>
>>>
>>> On Wed, Sep 7, 2016 at 3:15 PM, Jose Garcia-Rivera via RT
>>> <met_help at ucar.edu> wrote:
>>>>
>>>> Wed Sep 07 15:15:39 2016: Request 77823 was acted upon.
>>>> Transaction: Ticket created by GarciaJ at imsg.com
>>>> Queue: met_help
>>>> Subject: Trouble running radar NETCDF file for grid_stat
verifiction
>>>> Owner: Nobody
>>>> Requestors: GarciaJ at imsg.com
>>>> Status: new
>>>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
>>>>
>>>>
>>>> Dear Met Help,
>>>>
>>>>
>>>> I've been trying to run MET using a radar NETCDF file, and an
NMMB model forecast GRIB file, but the following error shows up:
>>>>
>>>>
>>>> DEBUG 1: Default Config File: /work/apps/pgi_14.10/SANDY/met-
5.1/share/met/config/GridStatConfig_default
>>>> DEBUG 1: User Config File: GridStatConfig_dbz
>>>> ERROR :
>>>> ERROR : Trouble reading observation file
"Hongqiao.Refl.20150602.s100000.e100500.attributes.nc"
>>>> ERROR :
>>>>
>>>> We used two versions of the OBS file, one as it was, and the
second with added "attributes". Still, the same error occurred. We are
not sure on exactly how our NETCDF files need to be for MET to be able
to read them. I searched the error message on the Guide and nothing
showed up.
>>>>
>>>> We can share the files to your FTP if you want to run them.
>>>>
>>>> Any help will be greatly appreciated.
>>>>
>>>>
>>>>
>>>> NOTE: We are using MET 5.1
>>>>
>>>>
>>>> Best Regards,
>>>>
>>>> Jose
>>>>
>>>>
>>>>
>>>>
>>>> Jose M. Garcia-Rivera, PhD
>>>>
>>>> Atmospheric Scientist
>>>>
>>>> IM Systems Group
>>>>
>>>> Rockville/College Park, MD
>>>>
>>>> This e-mail, including attachments, may include confidential
and/or proprietary information, and may be used only by the person or
entity to which it is addressed. If the reader of this e-mail is not
the intended recipient or his or her authorized agent, the reader is
hereby notified that any dissemination, distribution or copying of
this e-mail is prohibited. If you have received this e-mail in error,
please notify the sender by replying to this message and delete this
e-mail immediately.
>>>>
>>>>
>>>
>>>
>>>
>>> --
>>> Julie Prestopnik
>>> National Center for Atmospheric Research
>>> Research Applications Laboratory
>>> Phone: 303.497.8399
>>> Email: jpresto at ucar.edu
>>>
>>>
>>> This e-mail, including attachments, may include confidential
and/or proprietary information, and may be used only by the person or
entity to which it is addressed. If the reader of this e-mail is not
the intended recipient or his or her authorized agent, the reader is
hereby notified that any dissemination, distribution or copying of
this e-mail is prohibited. If you have received this e-mail in error,
please notify the sender by replying to this message and delete this
e-mail immediately.
>>>
>>>
>>
>>
>>
>> --
>> Julie Prestopnik
>> National Center for Atmospheric Research
>> Research Applications Laboratory
>> Phone: 303.497.8399
>> Email: jpresto at ucar.edu
>>
>> This e-mail, including attachments, may include confidential and/or
proprietary information, and may be used only by the person or entity
to which it is addressed. If the reader of this e-mail is not the
intended recipient or his or her authorized agent, the reader is
hereby notified that any dissemination, distribution or copying of
this e-mail is prohibited. If you have received this e-mail in error,
please notify the sender by replying to this message and delete this
e-mail immediately.
>>
>>
>
>
>
> --
> Julie Prestopnik
> National Center for Atmospheric Research
> Research Applications Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
>
> This e-mail, including attachments, may include confidential and/or
proprietary information, and may be used only by the person or entity
to which it is addressed. If the reader of this e-mail is not the
intended recipient or his or her authorized agent, the reader is
hereby notified that any dissemination, distribution or copying of
this e-mail is prohibited. If you have received this e-mail in error,
please notify the sender by replying to this message and delete this
e-mail immediately.
>
>
--
Julie Prestopnik
National Center for Atmospheric Research
Research Applications Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
This e-mail, including attachments, may include confidential and/or
proprietary information, and may be used only by the person or entity
to which it is addressed. If the reader of this e-mail is not the
intended recipient or his or her authorized agent, the reader is
hereby notified that any dissemination, distribution or copying of
this e-mail is prohibited. If you have received this e-mail in error,
please notify the sender by replying to this message and delete this
e-mail immediately.
------------------------------------------------
Subject: Trouble running radar NETCDF file for grid_stat verifiction
From: Julie Prestopnik
Time: Fri Sep 09 11:09:26 2016
Hi Jose. Thank you for uploading your data. There were two important
things missing from your file.
I added:
REFC:name = "REFC" ;
under:
float REFC(lat, lon) ;
and I added:
:MET_version = "V5.1" ;
under // global attributes:
and was able to get a successful run of grid_stat.
I am attaching the file with the changes. Please give it a try and
let me
know if you get a successful run as well.
Thanks,
Julie
On Fri, Sep 9, 2016 at 10:38 AM, Jose Garcia-Rivera via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
>
> Dear Julie,
>
> We used the Mercator example, and ours looks identical to yours. I
> proceeded and put 4 files into your FTP server:
>
> Model forecast file
> Radar Obs file
> Grid Stat Config file
> domain.poly file
>
> The files are under 'garcia_data'
>
>
> Thanks so much for your help,
> Jose
> ________________________________________
> From: Julie Prestopnik via RT <met_help at ucar.edu>
> Sent: Friday, September 9, 2016 11:50 AM
> To: Jose Garcia-Rivera
> Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar NETCDF
file
> for grid_stat verifiction
>
> Hi Jose. I have attached a Mercator projection example. If you're
> still stuck, please post your data to our
> anonymous FTP site following these instructions:
> http://www.dtcenter.org/met/users/support/met_help.php#ftp
>
> Thanks,
> Julie
>
>
> On Thu, Sep 8, 2016 at 3:25 PM, Jose Garcia-Rivera via RT
> <met_help at ucar.edu> wrote:
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
> >
> > Dear Julie,
> >
> > That's very good information, thanks. We've been working on this
issue,
> however the same error keeps showing up.
> >
> > Can we get a Mercator projection example?
> >
> > I was wondering if you could have a peek into our netcdf file, or
run an
> internal test to see what needs to be changed, or what may be wrong.
In the
> meantime, we continue working on trying to make the file fit MET
> requirements.
> >
> > Thanks for the help,
> > Jose
> >
> > ________________________________________
> > From: Julie Prestopnik via RT <met_help at ucar.edu>
> > Sent: Thursday, September 8, 2016 3:57 PM
> > To: Jose Garcia-Rivera
> > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar NETCDF
file
> for grid_stat verifiction
> >
> > Hi Jose.
> >
> > Unfortunately, we do not have a radar obs netcdf example file.
With
> > NetCDF, users have two choices:
> > --make it look like the NetCDF files that MET generates (i.e. the
> > output of pcp_combine) or
> > --put it into CF-compliant NetCDF
> > The variable can be named "radar_obs" or "precip" or anything
you'd like.
> >
> > Julie
> >
> >
> > On Thu, Sep 8, 2016 at 12:10 PM, Jose Garcia-Rivera via RT
> > <met_help at ucar.edu> wrote:
> >>
> >> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
> >>
> >> Dear Julie,
> >>
> >> Thanks so much for the file. We haven't been able to work on it
yet,
> since we are fixing computer issues. One more question, do you have
a radar
> obs netcdf example file?
> >>
> >> Best Regards,
> >> Jose
> >>
> >> From: Julie Prestopnik via RT <met_help at ucar.edu>
> >> Sent: Thursday, September 8, 2016 12:58 PM
> >> To: Jose Garcia-Rivera
> >> Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar
NETCDF
> file for grid_stat verifiction
> >>
> >> My apologies. I meant to attach the file in my last email. You
can
> >> find it attached to this one.
> >>
> >> Thanks,
> >> Julie
> >>
> >> On Thu, Sep 8, 2016 at 10:36 AM, Jose Garcia-Rivera via RT
> >> <met_help at ucar.edu> wrote:
> >>>
> >>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
> >>>
> >>> Dear Julie,
> >>>
> >>> Thanks for the helpful response. Can I have an example file from
the
> pcp_combine tool for reference?
> >>>
> >>> Best Regards,
> >>> Jose
> >>> ________________________________________
> >>> From: Julie Prestopnik via RT <met_help at ucar.edu>
> >>> Sent: Thursday, September 8, 2016 11:57 AM
> >>> To: Jose Garcia-Rivera
> >>> Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar
NETCDF
> file for grid_stat verifiction
> >>>
> >>> Hi Jose.
> >>>
> >>> I see that you are running MET 5.1, but are unsure of how the
NetCDF
> >>> files should be formatted in order for GridStat to be able to
read
> >>> them.
> >>>
> >>> In order it use gridded NetCDF files in MET, you'll need to make
them
> >>> look like the output of the pcp_combine tool.
> >>>
> >>> Listed below is the header from one of the NetCDF files from
> >>> pcp_combine created by the METv5.1 test scripts. Here are the
> >>> required parts.
> >>>
> >>> (1) dimensions should be named "lat" and "lon"
> >>> (2) the "lat" and "lon" variable are **NOT** required
> >>> (3) gridded variables (e.g. APCP_12) must use the "lat" and
"lon"
> dimensions
> >>> (4) gridded variables should include the attributes listed in
the
> >>> example (for timing info, only the init_time_ut, valid_time_ut,
and
> >>> accum_time_sec are actually used. "ut" stands for unix time,
the
> >>> number of seconds since Jan 1, 1970).
> >>> (5) global attributes should include the grid/projection
> >>> information. This example shows how they're specified for a
lambert
> >>> conformal projection. Let me know if you're using a different
> >>> projection and I'll send you an example.
> >>>
> >>> I hope that helps get you going.
> >>>
> >>> Julie
> >>>
> >>>
> >>>
> >>> On Wed, Sep 7, 2016 at 3:15 PM, Jose Garcia-Rivera via RT
> >>> <met_help at ucar.edu> wrote:
> >>>>
> >>>> Wed Sep 07 15:15:39 2016: Request 77823 was acted upon.
> >>>> Transaction: Ticket created by GarciaJ at imsg.com
> >>>> Queue: met_help
> >>>> Subject: Trouble running radar NETCDF file for grid_stat
> verifiction
> >>>> Owner: Nobody
> >>>> Requestors: GarciaJ at imsg.com
> >>>> Status: new
> >>>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823
> >
> >>>>
> >>>>
> >>>> Dear Met Help,
> >>>>
> >>>>
> >>>> I've been trying to run MET using a radar NETCDF file, and an
NMMB
> model forecast GRIB file, but the following error shows up:
> >>>>
> >>>>
> >>>> DEBUG 1: Default Config File: /work/apps/pgi_14.10/SANDY/
> met-5.1/share/met/config/GridStatConfig_default
> >>>> DEBUG 1: User Config File: GridStatConfig_dbz
> >>>> ERROR :
> >>>> ERROR : Trouble reading observation file
"Hongqiao.Refl.20150602.
> s100000.e100500.attributes.nc"
> >>>> ERROR :
> >>>>
> >>>> We used two versions of the OBS file, one as it was, and the
second
> with added "attributes". Still, the same error occurred. We are not
sure on
> exactly how our NETCDF files need to be for MET to be able to read
them. I
> searched the error message on the Guide and nothing showed up.
> >>>>
> >>>> We can share the files to your FTP if you want to run them.
> >>>>
> >>>> Any help will be greatly appreciated.
> >>>>
> >>>>
> >>>>
> >>>> NOTE: We are using MET 5.1
> >>>>
> >>>>
> >>>> Best Regards,
> >>>>
> >>>> Jose
> >>>>
> >>>>
> >>>>
> >>>>
> >>>> Jose M. Garcia-Rivera, PhD
> >>>>
> >>>> Atmospheric Scientist
> >>>>
> >>>> IM Systems Group
> >>>>
> >>>> Rockville/College Park, MD
> >>>>
> >>>> This e-mail, including attachments, may include confidential
and/or
> proprietary information, and may be used only by the person or
entity to
> which it is addressed. If the reader of this e-mail is not the
intended
> recipient or his or her authorized agent, the reader is hereby
notified
> that any dissemination, distribution or copying of this e-mail is
> prohibited. If you have received this e-mail in error, please notify
the
> sender by replying to this message and delete this e-mail
immediately.
> >>>>
> >>>>
> >>>
> >>>
> >>>
> >>> --
> >>> Julie Prestopnik
> >>> National Center for Atmospheric Research
> >>> Research Applications Laboratory
> >>> Phone: 303.497.8399
> >>> Email: jpresto at ucar.edu
> >>>
> >>>
> >>> This e-mail, including attachments, may include confidential
and/or
> proprietary information, and may be used only by the person or
entity to
> which it is addressed. If the reader of this e-mail is not the
intended
> recipient or his or her authorized agent, the reader is hereby
notified
> that any dissemination, distribution or copying of this e-mail is
> prohibited. If you have received this e-mail in error, please notify
the
> sender by replying to this message and delete this e-mail
immediately.
> >>>
> >>>
> >>
> >>
> >>
> >> --
> >> Julie Prestopnik
> >> National Center for Atmospheric Research
> >> Research Applications Laboratory
> >> Phone: 303.497.8399
> >> Email: jpresto at ucar.edu
> >>
> >> This e-mail, including attachments, may include confidential
and/or
> proprietary information, and may be used only by the person or
entity to
> which it is addressed. If the reader of this e-mail is not the
intended
> recipient or his or her authorized agent, the reader is hereby
notified
> that any dissemination, distribution or copying of this e-mail is
> prohibited. If you have received this e-mail in error, please notify
the
> sender by replying to this message and delete this e-mail
immediately.
> >>
> >>
> >
> >
> >
> > --
> > Julie Prestopnik
> > National Center for Atmospheric Research
> > Research Applications Laboratory
> > Phone: 303.497.8399
> > Email: jpresto at ucar.edu
> >
> >
> > This e-mail, including attachments, may include confidential
and/or
> proprietary information, and may be used only by the person or
entity to
> which it is addressed. If the reader of this e-mail is not the
intended
> recipient or his or her authorized agent, the reader is hereby
notified
> that any dissemination, distribution or copying of this e-mail is
> prohibited. If you have received this e-mail in error, please notify
the
> sender by replying to this message and delete this e-mail
immediately.
> >
> >
>
>
>
> --
> Julie Prestopnik
> National Center for Atmospheric Research
> Research Applications Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
> This e-mail, including attachments, may include confidential and/or
> proprietary information, and may be used only by the person or
entity to
> which it is addressed. If the reader of this e-mail is not the
intended
> recipient or his or her authorized agent, the reader is hereby
notified
> that any dissemination, distribution or copying of this e-mail is
> prohibited. If you have received this e-mail in error, please notify
the
> sender by replying to this message and delete this e-mail
immediately.
>
>
>
--
Julie Prestopnik
National Center for Atmospheric Research
Research Applications Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar NETCDF file for grid_stat verifiction
From: Jose Garcia-Rivera
Time: Fri Sep 09 12:08:01 2016
Dear Julie,
The file that you modified worked. However, we did the changes you
made, and grid_stat continues to show the same error.
I've uploaded the file in the same FTP directory, named:
Hongqiao.Refl.20150602.s100000.e100500.attributes.nc
This is a file dump of our modified netcdf:
NCAR Command Language Version 6.3.0
The use of this software is governed by a License Agreement.
See http://www.ncl.ucar.edu/ for more details.
Variable: f
Type: file
filename: Hongqiao.Refl.20150602.s100000.e100500.attributes
path: Hongqiao.Refl.20150602.s100000.e100500.attributes.nc
Number of Attributes:8
MET_version : V5.1
Projection : Mercator
lat_ll : 3348550.177 degrees_north
lon_ll : 13120540.425 degrees_east
lat_ur : 4057346.9 degrees_north
lon_ur : 13891071.057 degrees_east
nx : 674
ny : 620
dimensions:
lon = 674
lat = 620
variables:
Variable: lat
Type: float
Total Size: 417880 values
1671520 bytes
Number of Dimensions: 2
Dimensions and sizes: [ 620 <lat> x 674 <lon> ]
Coordinates:
lat: [4057347..4057347]
lon: [1.312054e+07..1.388993e+07]
Number of Attributes: 2
units : degrees_north
standard_name : latitude
Variable: lon
Type: float
Total Size: 417880 values
1671520 bytes
Number of Dimensions: 2
Dimensions and sizes: [ 620 <lat> x 674 <lon> ]
Coordinates:
lat: [4057347..4057347]
lon: [1.312054e+07..1.388993e+07]
Number of Attributes: 2
units : degrees_east
standard_name : longitude
Variable: REFC
Type: float
Total Size: 417880 values
1671520 bytes
Number of Dimensions: 2
Dimensions and sizes: [ 620 <lat> x 674 <lon> ]
Coordinates:
lat: [4057347..4057347]
lon: [1.312054e+07..1.388993e+07]
Number of Attributes: 11
name : REFC
units : dbZ
parameter_table_version : 129
parameter_number : 212
level_indicator : 200
level : L0
long_name : MaxReflectivity
init_time : 20050807_000000
init_time_ut : 1123372800
valid_time : 20050807_120000
valid_time_ut : 1123416000
Best Regards,
Jose
________________________________________
From: Julie Prestopnik via RT <met_help at ucar.edu>
Sent: Friday, September 9, 2016 1:09 PM
To: Jose Garcia-Rivera
Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar NETCDF
file for grid_stat verifiction
Hi Jose. Thank you for uploading your data. There were two important
things missing from your file.
I added:
REFC:name = "REFC" ;
under:
float REFC(lat, lon) ;
and I added:
:MET_version = "V5.1" ;
under // global attributes:
and was able to get a successful run of grid_stat.
I am attaching the file with the changes. Please give it a try and
let me
know if you get a successful run as well.
Thanks,
Julie
On Fri, Sep 9, 2016 at 10:38 AM, Jose Garcia-Rivera via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
>
> Dear Julie,
>
> We used the Mercator example, and ours looks identical to yours. I
> proceeded and put 4 files into your FTP server:
>
> Model forecast file
> Radar Obs file
> Grid Stat Config file
> domain.poly file
>
> The files are under 'garcia_data'
>
>
> Thanks so much for your help,
> Jose
> ________________________________________
> From: Julie Prestopnik via RT <met_help at ucar.edu>
> Sent: Friday, September 9, 2016 11:50 AM
> To: Jose Garcia-Rivera
> Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar NETCDF
file
> for grid_stat verifiction
>
> Hi Jose. I have attached a Mercator projection example. If you're
> still stuck, please post your data to our
> anonymous FTP site following these instructions:
> http://www.dtcenter.org/met/users/support/met_help.php#ftp
>
> Thanks,
> Julie
>
>
> On Thu, Sep 8, 2016 at 3:25 PM, Jose Garcia-Rivera via RT
> <met_help at ucar.edu> wrote:
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
> >
> > Dear Julie,
> >
> > That's very good information, thanks. We've been working on this
issue,
> however the same error keeps showing up.
> >
> > Can we get a Mercator projection example?
> >
> > I was wondering if you could have a peek into our netcdf file, or
run an
> internal test to see what needs to be changed, or what may be wrong.
In the
> meantime, we continue working on trying to make the file fit MET
> requirements.
> >
> > Thanks for the help,
> > Jose
> >
> > ________________________________________
> > From: Julie Prestopnik via RT <met_help at ucar.edu>
> > Sent: Thursday, September 8, 2016 3:57 PM
> > To: Jose Garcia-Rivera
> > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar NETCDF
file
> for grid_stat verifiction
> >
> > Hi Jose.
> >
> > Unfortunately, we do not have a radar obs netcdf example file.
With
> > NetCDF, users have two choices:
> > --make it look like the NetCDF files that MET generates (i.e. the
> > output of pcp_combine) or
> > --put it into CF-compliant NetCDF
> > The variable can be named "radar_obs" or "precip" or anything
you'd like.
> >
> > Julie
> >
> >
> > On Thu, Sep 8, 2016 at 12:10 PM, Jose Garcia-Rivera via RT
> > <met_help at ucar.edu> wrote:
> >>
> >> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
> >>
> >> Dear Julie,
> >>
> >> Thanks so much for the file. We haven't been able to work on it
yet,
> since we are fixing computer issues. One more question, do you have
a radar
> obs netcdf example file?
> >>
> >> Best Regards,
> >> Jose
> >>
> >> From: Julie Prestopnik via RT <met_help at ucar.edu>
> >> Sent: Thursday, September 8, 2016 12:58 PM
> >> To: Jose Garcia-Rivera
> >> Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar
NETCDF
> file for grid_stat verifiction
> >>
> >> My apologies. I meant to attach the file in my last email. You
can
> >> find it attached to this one.
> >>
> >> Thanks,
> >> Julie
> >>
> >> On Thu, Sep 8, 2016 at 10:36 AM, Jose Garcia-Rivera via RT
> >> <met_help at ucar.edu> wrote:
> >>>
> >>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
> >>>
> >>> Dear Julie,
> >>>
> >>> Thanks for the helpful response. Can I have an example file from
the
> pcp_combine tool for reference?
> >>>
> >>> Best Regards,
> >>> Jose
> >>> ________________________________________
> >>> From: Julie Prestopnik via RT <met_help at ucar.edu>
> >>> Sent: Thursday, September 8, 2016 11:57 AM
> >>> To: Jose Garcia-Rivera
> >>> Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar
NETCDF
> file for grid_stat verifiction
> >>>
> >>> Hi Jose.
> >>>
> >>> I see that you are running MET 5.1, but are unsure of how the
NetCDF
> >>> files should be formatted in order for GridStat to be able to
read
> >>> them.
> >>>
> >>> In order it use gridded NetCDF files in MET, you'll need to make
them
> >>> look like the output of the pcp_combine tool.
> >>>
> >>> Listed below is the header from one of the NetCDF files from
> >>> pcp_combine created by the METv5.1 test scripts. Here are the
> >>> required parts.
> >>>
> >>> (1) dimensions should be named "lat" and "lon"
> >>> (2) the "lat" and "lon" variable are **NOT** required
> >>> (3) gridded variables (e.g. APCP_12) must use the "lat" and
"lon"
> dimensions
> >>> (4) gridded variables should include the attributes listed in
the
> >>> example (for timing info, only the init_time_ut, valid_time_ut,
and
> >>> accum_time_sec are actually used. "ut" stands for unix time,
the
> >>> number of seconds since Jan 1, 1970).
> >>> (5) global attributes should include the grid/projection
> >>> information. This example shows how they're specified for a
lambert
> >>> conformal projection. Let me know if you're using a different
> >>> projection and I'll send you an example.
> >>>
> >>> I hope that helps get you going.
> >>>
> >>> Julie
> >>>
> >>>
> >>>
> >>> On Wed, Sep 7, 2016 at 3:15 PM, Jose Garcia-Rivera via RT
> >>> <met_help at ucar.edu> wrote:
> >>>>
> >>>> Wed Sep 07 15:15:39 2016: Request 77823 was acted upon.
> >>>> Transaction: Ticket created by GarciaJ at imsg.com
> >>>> Queue: met_help
> >>>> Subject: Trouble running radar NETCDF file for grid_stat
> verifiction
> >>>> Owner: Nobody
> >>>> Requestors: GarciaJ at imsg.com
> >>>> Status: new
> >>>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823
> >
> >>>>
> >>>>
> >>>> Dear Met Help,
> >>>>
> >>>>
> >>>> I've been trying to run MET using a radar NETCDF file, and an
NMMB
> model forecast GRIB file, but the following error shows up:
> >>>>
> >>>>
> >>>> DEBUG 1: Default Config File: /work/apps/pgi_14.10/SANDY/
> met-5.1/share/met/config/GridStatConfig_default
> >>>> DEBUG 1: User Config File: GridStatConfig_dbz
> >>>> ERROR :
> >>>> ERROR : Trouble reading observation file
"Hongqiao.Refl.20150602.
> s100000.e100500.attributes.nc"
> >>>> ERROR :
> >>>>
> >>>> We used two versions of the OBS file, one as it was, and the
second
> with added "attributes". Still, the same error occurred. We are not
sure on
> exactly how our NETCDF files need to be for MET to be able to read
them. I
> searched the error message on the Guide and nothing showed up.
> >>>>
> >>>> We can share the files to your FTP if you want to run them.
> >>>>
> >>>> Any help will be greatly appreciated.
> >>>>
> >>>>
> >>>>
> >>>> NOTE: We are using MET 5.1
> >>>>
> >>>>
> >>>> Best Regards,
> >>>>
> >>>> Jose
> >>>>
> >>>>
> >>>>
> >>>>
> >>>> Jose M. Garcia-Rivera, PhD
> >>>>
> >>>> Atmospheric Scientist
> >>>>
> >>>> IM Systems Group
> >>>>
> >>>> Rockville/College Park, MD
> >>>>
> >>>> This e-mail, including attachments, may include confidential
and/or
> proprietary information, and may be used only by the person or
entity to
> which it is addressed. If the reader of this e-mail is not the
intended
> recipient or his or her authorized agent, the reader is hereby
notified
> that any dissemination, distribution or copying of this e-mail is
> prohibited. If you have received this e-mail in error, please notify
the
> sender by replying to this message and delete this e-mail
immediately.
> >>>>
> >>>>
> >>>
> >>>
> >>>
> >>> --
> >>> Julie Prestopnik
> >>> National Center for Atmospheric Research
> >>> Research Applications Laboratory
> >>> Phone: 303.497.8399
> >>> Email: jpresto at ucar.edu
> >>>
> >>>
> >>> This e-mail, including attachments, may include confidential
and/or
> proprietary information, and may be used only by the person or
entity to
> which it is addressed. If the reader of this e-mail is not the
intended
> recipient or his or her authorized agent, the reader is hereby
notified
> that any dissemination, distribution or copying of this e-mail is
> prohibited. If you have received this e-mail in error, please notify
the
> sender by replying to this message and delete this e-mail
immediately.
> >>>
> >>>
> >>
> >>
> >>
> >> --
> >> Julie Prestopnik
> >> National Center for Atmospheric Research
> >> Research Applications Laboratory
> >> Phone: 303.497.8399
> >> Email: jpresto at ucar.edu
> >>
> >> This e-mail, including attachments, may include confidential
and/or
> proprietary information, and may be used only by the person or
entity to
> which it is addressed. If the reader of this e-mail is not the
intended
> recipient or his or her authorized agent, the reader is hereby
notified
> that any dissemination, distribution or copying of this e-mail is
> prohibited. If you have received this e-mail in error, please notify
the
> sender by replying to this message and delete this e-mail
immediately.
> >>
> >>
> >
> >
> >
> > --
> > Julie Prestopnik
> > National Center for Atmospheric Research
> > Research Applications Laboratory
> > Phone: 303.497.8399
> > Email: jpresto at ucar.edu
> >
> >
> > This e-mail, including attachments, may include confidential
and/or
> proprietary information, and may be used only by the person or
entity to
> which it is addressed. If the reader of this e-mail is not the
intended
> recipient or his or her authorized agent, the reader is hereby
notified
> that any dissemination, distribution or copying of this e-mail is
> prohibited. If you have received this e-mail in error, please notify
the
> sender by replying to this message and delete this e-mail
immediately.
> >
> >
>
>
>
> --
> Julie Prestopnik
> National Center for Atmospheric Research
> Research Applications Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
> This e-mail, including attachments, may include confidential and/or
> proprietary information, and may be used only by the person or
entity to
> which it is addressed. If the reader of this e-mail is not the
intended
> recipient or his or her authorized agent, the reader is hereby
notified
> that any dissemination, distribution or copying of this e-mail is
> prohibited. If you have received this e-mail in error, please notify
the
> sender by replying to this message and delete this e-mail
immediately.
>
>
>
--
Julie Prestopnik
National Center for Atmospheric Research
Research Applications Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
This e-mail, including attachments, may include confidential and/or
proprietary information, and may be used only by the person or entity
to which it is addressed. If the reader of this e-mail is not the
intended recipient or his or her authorized agent, the reader is
hereby notified that any dissemination, distribution or copying of
this e-mail is prohibited. If you have received this e-mail in error,
please notify the sender by replying to this message and delete this
e-mail immediately.
------------------------------------------------
Subject: Trouble running radar NETCDF file for grid_stat verifiction
From: John Halley Gotway
Time: Fri Sep 09 12:17:38 2016
Hello Jose,
This is John Halley Gotway. I work with Julie on providing support
for MET.
I think there's a few pieces of info we're missing here.
(1) MET does not currently support the enhanced data model of NetCDF4.
It
only supports the classic data model... i.e. NetCDF3. In the next
version
of MET (6.0), due out next year, we'll be adding support for NetCDF4.
The
file you sent us in NetCDF4 but when Julie add those attributes she
may
have used ncdump/ncgen. And their output is NetCDF3. Try updating
your
NCL script to write a "classic" NetCDF file.
(2) Yes, the "MET_version" global attribute needs to be present. That
tells MET how to parse the grid information.
(3) I'm not sure that the variable "name" attribute is necessary, but
it
doesn't hurt.
(4) The biggest problem is in the definition of your Mercator grid:
:Projection = "Mercator" ;
:lat_ll = "3348550.177 degrees_north" ;
:lon_ll = "13120540.425 degrees_east" ;
:lat_ur = "4057346.9 degrees_north" ;
:lon_ur = "13891071.057 degrees_east" ;
Those don't look like very meaningful lat/lon values! Where did you
get
these numbers? Are they meant to match the grid defined in the GRIB
file
you sent us?
Thanks,
John
On Fri, Sep 9, 2016 at 12:08 PM, Jose Garcia-Rivera via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
>
> Dear Julie,
>
> The file that you modified worked. However, we did the changes you
made,
> and grid_stat continues to show the same error.
>
> I've uploaded the file in the same FTP directory, named:
> Hongqiao.Refl.20150602.s100000.e100500.attributes.nc
>
> This is a file dump of our modified netcdf:
>
> NCAR Command Language Version 6.3.0
> The use of this software is governed by a License Agreement.
> See http://www.ncl.ucar.edu/ for more details.
>
> Variable: f
> Type: file
> filename: Hongqiao.Refl.20150602.s100000.e100500.attributes
> path: Hongqiao.Refl.20150602.s100000.e100500.attributes.nc
> Number of Attributes:8
> MET_version : V5.1
> Projection : Mercator
> lat_ll : 3348550.177 degrees_north
> lon_ll : 13120540.425 degrees_east
> lat_ur : 4057346.9 degrees_north
> lon_ur : 13891071.057 degrees_east
> nx : 674
> ny : 620
>
> dimensions:
> lon = 674
> lat = 620
>
> variables:
> Variable: lat
> Type: float
> Total Size: 417880 values
> 1671520 bytes
> Number of Dimensions: 2
> Dimensions and sizes: [ 620 <lat> x 674 <lon> ]
> Coordinates:
> lat: [4057347..4057347]
> lon: [1.312054e+07..1.388993e+07]
> Number of Attributes: 2
> units : degrees_north
> standard_name : latitude
>
> Variable: lon
> Type: float
> Total Size: 417880 values
> 1671520 bytes
> Number of Dimensions: 2
> Dimensions and sizes: [ 620 <lat> x 674 <lon> ]
> Coordinates:
> lat: [4057347..4057347]
> lon: [1.312054e+07..1.388993e+07]
> Number of Attributes: 2
> units : degrees_east
> standard_name : longitude
>
> Variable: REFC
> Type: float
> Total Size: 417880 values
> 1671520 bytes
> Number of Dimensions: 2
> Dimensions and sizes: [ 620 <lat> x 674 <lon> ]
> Coordinates:
> lat: [4057347..4057347]
> lon: [1.312054e+07..1.388993e+07]
> Number of Attributes: 11
> name : REFC
> units : dbZ
> parameter_table_version : 129
> parameter_number : 212
> level_indicator : 200
> level : L0
> long_name : MaxReflectivity
> init_time : 20050807_000000
> init_time_ut : 1123372800
> valid_time : 20050807_120000
> valid_time_ut : 1123416000
>
>
>
> Best Regards,
> Jose
>
>
> ________________________________________
> From: Julie Prestopnik via RT <met_help at ucar.edu>
> Sent: Friday, September 9, 2016 1:09 PM
> To: Jose Garcia-Rivera
> Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar NETCDF
file
> for grid_stat verifiction
>
> Hi Jose. Thank you for uploading your data. There were two
important
> things missing from your file.
>
> I added:
>
> REFC:name = "REFC" ;
>
> under:
>
> float REFC(lat, lon) ;
>
> and I added:
>
> :MET_version = "V5.1" ;
>
> under // global attributes:
>
> and was able to get a successful run of grid_stat.
>
> I am attaching the file with the changes. Please give it a try and
let me
> know if you get a successful run as well.
>
> Thanks,
> Julie
>
> On Fri, Sep 9, 2016 at 10:38 AM, Jose Garcia-Rivera via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
> >
> > Dear Julie,
> >
> > We used the Mercator example, and ours looks identical to yours. I
> > proceeded and put 4 files into your FTP server:
> >
> > Model forecast file
> > Radar Obs file
> > Grid Stat Config file
> > domain.poly file
> >
> > The files are under 'garcia_data'
> >
> >
> > Thanks so much for your help,
> > Jose
> > ________________________________________
> > From: Julie Prestopnik via RT <met_help at ucar.edu>
> > Sent: Friday, September 9, 2016 11:50 AM
> > To: Jose Garcia-Rivera
> > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar NETCDF
file
> > for grid_stat verifiction
> >
> > Hi Jose. I have attached a Mercator projection example. If
you're
> > still stuck, please post your data to our
> > anonymous FTP site following these instructions:
> > http://www.dtcenter.org/met/users/support/met_help.php#ftp
> >
> > Thanks,
> > Julie
> >
> >
> > On Thu, Sep 8, 2016 at 3:25 PM, Jose Garcia-Rivera via RT
> > <met_help at ucar.edu> wrote:
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
> > >
> > > Dear Julie,
> > >
> > > That's very good information, thanks. We've been working on this
issue,
> > however the same error keeps showing up.
> > >
> > > Can we get a Mercator projection example?
> > >
> > > I was wondering if you could have a peek into our netcdf file,
or run
> an
> > internal test to see what needs to be changed, or what may be
wrong. In
> the
> > meantime, we continue working on trying to make the file fit MET
> > requirements.
> > >
> > > Thanks for the help,
> > > Jose
> > >
> > > ________________________________________
> > > From: Julie Prestopnik via RT <met_help at ucar.edu>
> > > Sent: Thursday, September 8, 2016 3:57 PM
> > > To: Jose Garcia-Rivera
> > > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar
NETCDF
> file
> > for grid_stat verifiction
> > >
> > > Hi Jose.
> > >
> > > Unfortunately, we do not have a radar obs netcdf example file.
With
> > > NetCDF, users have two choices:
> > > --make it look like the NetCDF files that MET generates (i.e.
the
> > > output of pcp_combine) or
> > > --put it into CF-compliant NetCDF
> > > The variable can be named "radar_obs" or "precip" or anything
you'd
> like.
> > >
> > > Julie
> > >
> > >
> > > On Thu, Sep 8, 2016 at 12:10 PM, Jose Garcia-Rivera via RT
> > > <met_help at ucar.edu> wrote:
> > >>
> > >> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
> > >>
> > >> Dear Julie,
> > >>
> > >> Thanks so much for the file. We haven't been able to work on it
yet,
> > since we are fixing computer issues. One more question, do you
have a
> radar
> > obs netcdf example file?
> > >>
> > >> Best Regards,
> > >> Jose
> > >>
> > >> From: Julie Prestopnik via RT <met_help at ucar.edu>
> > >> Sent: Thursday, September 8, 2016 12:58 PM
> > >> To: Jose Garcia-Rivera
> > >> Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar
NETCDF
> > file for grid_stat verifiction
> > >>
> > >> My apologies. I meant to attach the file in my last email.
You can
> > >> find it attached to this one.
> > >>
> > >> Thanks,
> > >> Julie
> > >>
> > >> On Thu, Sep 8, 2016 at 10:36 AM, Jose Garcia-Rivera via RT
> > >> <met_help at ucar.edu> wrote:
> > >>>
> > >>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823
>
> > >>>
> > >>> Dear Julie,
> > >>>
> > >>> Thanks for the helpful response. Can I have an example file
from the
> > pcp_combine tool for reference?
> > >>>
> > >>> Best Regards,
> > >>> Jose
> > >>> ________________________________________
> > >>> From: Julie Prestopnik via RT <met_help at ucar.edu>
> > >>> Sent: Thursday, September 8, 2016 11:57 AM
> > >>> To: Jose Garcia-Rivera
> > >>> Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar
NETCDF
> > file for grid_stat verifiction
> > >>>
> > >>> Hi Jose.
> > >>>
> > >>> I see that you are running MET 5.1, but are unsure of how the
NetCDF
> > >>> files should be formatted in order for GridStat to be able to
read
> > >>> them.
> > >>>
> > >>> In order it use gridded NetCDF files in MET, you'll need to
make them
> > >>> look like the output of the pcp_combine tool.
> > >>>
> > >>> Listed below is the header from one of the NetCDF files from
> > >>> pcp_combine created by the METv5.1 test scripts. Here are the
> > >>> required parts.
> > >>>
> > >>> (1) dimensions should be named "lat" and "lon"
> > >>> (2) the "lat" and "lon" variable are **NOT** required
> > >>> (3) gridded variables (e.g. APCP_12) must use the "lat" and
"lon"
> > dimensions
> > >>> (4) gridded variables should include the attributes listed
in the
> > >>> example (for timing info, only the init_time_ut,
valid_time_ut, and
> > >>> accum_time_sec are actually used. "ut" stands for unix time,
the
> > >>> number of seconds since Jan 1, 1970).
> > >>> (5) global attributes should include the grid/projection
> > >>> information. This example shows how they're specified for a
lambert
> > >>> conformal projection. Let me know if you're using a different
> > >>> projection and I'll send you an example.
> > >>>
> > >>> I hope that helps get you going.
> > >>>
> > >>> Julie
> > >>>
> > >>>
> > >>>
> > >>> On Wed, Sep 7, 2016 at 3:15 PM, Jose Garcia-Rivera via RT
> > >>> <met_help at ucar.edu> wrote:
> > >>>>
> > >>>> Wed Sep 07 15:15:39 2016: Request 77823 was acted upon.
> > >>>> Transaction: Ticket created by GarciaJ at imsg.com
> > >>>> Queue: met_help
> > >>>> Subject: Trouble running radar NETCDF file for grid_stat
> > verifiction
> > >>>> Owner: Nobody
> > >>>> Requestors: GarciaJ at imsg.com
> > >>>> Status: new
> > >>>> Ticket <URL: https://rt.rap.ucar.edu/rt/
> Ticket/Display.html?id=77823
> > >
> > >>>>
> > >>>>
> > >>>> Dear Met Help,
> > >>>>
> > >>>>
> > >>>> I've been trying to run MET using a radar NETCDF file, and an
NMMB
> > model forecast GRIB file, but the following error shows up:
> > >>>>
> > >>>>
> > >>>> DEBUG 1: Default Config File: /work/apps/pgi_14.10/SANDY/
> > met-5.1/share/met/config/GridStatConfig_default
> > >>>> DEBUG 1: User Config File: GridStatConfig_dbz
> > >>>> ERROR :
> > >>>> ERROR : Trouble reading observation file
"Hongqiao.Refl.20150602.
> > s100000.e100500.attributes.nc"
> > >>>> ERROR :
> > >>>>
> > >>>> We used two versions of the OBS file, one as it was, and the
second
> > with added "attributes". Still, the same error occurred. We are
not sure
> on
> > exactly how our NETCDF files need to be for MET to be able to read
them.
> I
> > searched the error message on the Guide and nothing showed up.
> > >>>>
> > >>>> We can share the files to your FTP if you want to run them.
> > >>>>
> > >>>> Any help will be greatly appreciated.
> > >>>>
> > >>>>
> > >>>>
> > >>>> NOTE: We are using MET 5.1
> > >>>>
> > >>>>
> > >>>> Best Regards,
> > >>>>
> > >>>> Jose
> > >>>>
> > >>>>
> > >>>>
> > >>>>
> > >>>> Jose M. Garcia-Rivera, PhD
> > >>>>
> > >>>> Atmospheric Scientist
> > >>>>
> > >>>> IM Systems Group
> > >>>>
> > >>>> Rockville/College Park, MD
> > >>>>
> > >>>> This e-mail, including attachments, may include confidential
and/or
> > proprietary information, and may be used only by the person or
entity to
> > which it is addressed. If the reader of this e-mail is not the
intended
> > recipient or his or her authorized agent, the reader is hereby
notified
> > that any dissemination, distribution or copying of this e-mail is
> > prohibited. If you have received this e-mail in error, please
notify the
> > sender by replying to this message and delete this e-mail
immediately.
> > >>>>
> > >>>>
> > >>>
> > >>>
> > >>>
> > >>> --
> > >>> Julie Prestopnik
> > >>> National Center for Atmospheric Research
> > >>> Research Applications Laboratory
> > >>> Phone: 303.497.8399
> > >>> Email: jpresto at ucar.edu
> > >>>
> > >>>
> > >>> This e-mail, including attachments, may include confidential
and/or
> > proprietary information, and may be used only by the person or
entity to
> > which it is addressed. If the reader of this e-mail is not the
intended
> > recipient or his or her authorized agent, the reader is hereby
notified
> > that any dissemination, distribution or copying of this e-mail is
> > prohibited. If you have received this e-mail in error, please
notify the
> > sender by replying to this message and delete this e-mail
immediately.
> > >>>
> > >>>
> > >>
> > >>
> > >>
> > >> --
> > >> Julie Prestopnik
> > >> National Center for Atmospheric Research
> > >> Research Applications Laboratory
> > >> Phone: 303.497.8399
> > >> Email: jpresto at ucar.edu
> > >>
> > >> This e-mail, including attachments, may include confidential
and/or
> > proprietary information, and may be used only by the person or
entity to
> > which it is addressed. If the reader of this e-mail is not the
intended
> > recipient or his or her authorized agent, the reader is hereby
notified
> > that any dissemination, distribution or copying of this e-mail is
> > prohibited. If you have received this e-mail in error, please
notify the
> > sender by replying to this message and delete this e-mail
immediately.
> > >>
> > >>
> > >
> > >
> > >
> > > --
> > > Julie Prestopnik
> > > National Center for Atmospheric Research
> > > Research Applications Laboratory
> > > Phone: 303.497.8399
> > > Email: jpresto at ucar.edu
> > >
> > >
> > > This e-mail, including attachments, may include confidential
and/or
> > proprietary information, and may be used only by the person or
entity to
> > which it is addressed. If the reader of this e-mail is not the
intended
> > recipient or his or her authorized agent, the reader is hereby
notified
> > that any dissemination, distribution or copying of this e-mail is
> > prohibited. If you have received this e-mail in error, please
notify the
> > sender by replying to this message and delete this e-mail
immediately.
> > >
> > >
> >
> >
> >
> > --
> > Julie Prestopnik
> > National Center for Atmospheric Research
> > Research Applications Laboratory
> > Phone: 303.497.8399
> > Email: jpresto at ucar.edu
> >
> > This e-mail, including attachments, may include confidential
and/or
> > proprietary information, and may be used only by the person or
entity to
> > which it is addressed. If the reader of this e-mail is not the
intended
> > recipient or his or her authorized agent, the reader is hereby
notified
> > that any dissemination, distribution or copying of this e-mail is
> > prohibited. If you have received this e-mail in error, please
notify the
> > sender by replying to this message and delete this e-mail
immediately.
> >
> >
> >
>
>
> --
> Julie Prestopnik
> National Center for Atmospheric Research
> Research Applications Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
> This e-mail, including attachments, may include confidential and/or
> proprietary information, and may be used only by the person or
entity to
> which it is addressed. If the reader of this e-mail is not the
intended
> recipient or his or her authorized agent, the reader is hereby
notified
> that any dissemination, distribution or copying of this e-mail is
> prohibited. If you have received this e-mail in error, please notify
the
> sender by replying to this message and delete this e-mail
immediately.
>
>
>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar NETCDF file for grid_stat verifiction
From: Jose Garcia-Rivera
Time: Fri Sep 09 12:43:03 2016
Hi John,
Glad to talk to you again. We did the proposed changes, and the error
keeps showing up.
I uploaded the new file as: RadarObsNEW.nc
Please try to run it and let me know what issues show up?
Thanks for the help,
Jose
________________________________________
From: John Halley Gotway via RT <met_help at ucar.edu>
Sent: Friday, September 9, 2016 2:17 PM
To: Jose Garcia-Rivera
Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar NETCDF
file for grid_stat verifiction
Hello Jose,
This is John Halley Gotway. I work with Julie on providing support
for MET.
I think there's a few pieces of info we're missing here.
(1) MET does not currently support the enhanced data model of NetCDF4.
It
only supports the classic data model... i.e. NetCDF3. In the next
version
of MET (6.0), due out next year, we'll be adding support for NetCDF4.
The
file you sent us in NetCDF4 but when Julie add those attributes she
may
have used ncdump/ncgen. And their output is NetCDF3. Try updating
your
NCL script to write a "classic" NetCDF file.
(2) Yes, the "MET_version" global attribute needs to be present. That
tells MET how to parse the grid information.
(3) I'm not sure that the variable "name" attribute is necessary, but
it
doesn't hurt.
(4) The biggest problem is in the definition of your Mercator grid:
:Projection = "Mercator" ;
:lat_ll = "3348550.177 degrees_north" ;
:lon_ll = "13120540.425 degrees_east" ;
:lat_ur = "4057346.9 degrees_north" ;
:lon_ur = "13891071.057 degrees_east" ;
Those don't look like very meaningful lat/lon values! Where did you
get
these numbers? Are they meant to match the grid defined in the GRIB
file
you sent us?
Thanks,
John
On Fri, Sep 9, 2016 at 12:08 PM, Jose Garcia-Rivera via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
>
> Dear Julie,
>
> The file that you modified worked. However, we did the changes you
made,
> and grid_stat continues to show the same error.
>
> I've uploaded the file in the same FTP directory, named:
> Hongqiao.Refl.20150602.s100000.e100500.attributes.nc
>
> This is a file dump of our modified netcdf:
>
> NCAR Command Language Version 6.3.0
> The use of this software is governed by a License Agreement.
> See http://www.ncl.ucar.edu/ for more details.
>
> Variable: f
> Type: file
> filename: Hongqiao.Refl.20150602.s100000.e100500.attributes
> path: Hongqiao.Refl.20150602.s100000.e100500.attributes.nc
> Number of Attributes:8
> MET_version : V5.1
> Projection : Mercator
> lat_ll : 3348550.177 degrees_north
> lon_ll : 13120540.425 degrees_east
> lat_ur : 4057346.9 degrees_north
> lon_ur : 13891071.057 degrees_east
> nx : 674
> ny : 620
>
> dimensions:
> lon = 674
> lat = 620
>
> variables:
> Variable: lat
> Type: float
> Total Size: 417880 values
> 1671520 bytes
> Number of Dimensions: 2
> Dimensions and sizes: [ 620 <lat> x 674 <lon> ]
> Coordinates:
> lat: [4057347..4057347]
> lon: [1.312054e+07..1.388993e+07]
> Number of Attributes: 2
> units : degrees_north
> standard_name : latitude
>
> Variable: lon
> Type: float
> Total Size: 417880 values
> 1671520 bytes
> Number of Dimensions: 2
> Dimensions and sizes: [ 620 <lat> x 674 <lon> ]
> Coordinates:
> lat: [4057347..4057347]
> lon: [1.312054e+07..1.388993e+07]
> Number of Attributes: 2
> units : degrees_east
> standard_name : longitude
>
> Variable: REFC
> Type: float
> Total Size: 417880 values
> 1671520 bytes
> Number of Dimensions: 2
> Dimensions and sizes: [ 620 <lat> x 674 <lon> ]
> Coordinates:
> lat: [4057347..4057347]
> lon: [1.312054e+07..1.388993e+07]
> Number of Attributes: 11
> name : REFC
> units : dbZ
> parameter_table_version : 129
> parameter_number : 212
> level_indicator : 200
> level : L0
> long_name : MaxReflectivity
> init_time : 20050807_000000
> init_time_ut : 1123372800
> valid_time : 20050807_120000
> valid_time_ut : 1123416000
>
>
>
> Best Regards,
> Jose
>
>
> ________________________________________
> From: Julie Prestopnik via RT <met_help at ucar.edu>
> Sent: Friday, September 9, 2016 1:09 PM
> To: Jose Garcia-Rivera
> Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar NETCDF
file
> for grid_stat verifiction
>
> Hi Jose. Thank you for uploading your data. There were two
important
> things missing from your file.
>
> I added:
>
> REFC:name = "REFC" ;
>
> under:
>
> float REFC(lat, lon) ;
>
> and I added:
>
> :MET_version = "V5.1" ;
>
> under // global attributes:
>
> and was able to get a successful run of grid_stat.
>
> I am attaching the file with the changes. Please give it a try and
let me
> know if you get a successful run as well.
>
> Thanks,
> Julie
>
> On Fri, Sep 9, 2016 at 10:38 AM, Jose Garcia-Rivera via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
> >
> > Dear Julie,
> >
> > We used the Mercator example, and ours looks identical to yours. I
> > proceeded and put 4 files into your FTP server:
> >
> > Model forecast file
> > Radar Obs file
> > Grid Stat Config file
> > domain.poly file
> >
> > The files are under 'garcia_data'
> >
> >
> > Thanks so much for your help,
> > Jose
> > ________________________________________
> > From: Julie Prestopnik via RT <met_help at ucar.edu>
> > Sent: Friday, September 9, 2016 11:50 AM
> > To: Jose Garcia-Rivera
> > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar NETCDF
file
> > for grid_stat verifiction
> >
> > Hi Jose. I have attached a Mercator projection example. If
you're
> > still stuck, please post your data to our
> > anonymous FTP site following these instructions:
> > http://www.dtcenter.org/met/users/support/met_help.php#ftp
> >
> > Thanks,
> > Julie
> >
> >
> > On Thu, Sep 8, 2016 at 3:25 PM, Jose Garcia-Rivera via RT
> > <met_help at ucar.edu> wrote:
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
> > >
> > > Dear Julie,
> > >
> > > That's very good information, thanks. We've been working on this
issue,
> > however the same error keeps showing up.
> > >
> > > Can we get a Mercator projection example?
> > >
> > > I was wondering if you could have a peek into our netcdf file,
or run
> an
> > internal test to see what needs to be changed, or what may be
wrong. In
> the
> > meantime, we continue working on trying to make the file fit MET
> > requirements.
> > >
> > > Thanks for the help,
> > > Jose
> > >
> > > ________________________________________
> > > From: Julie Prestopnik via RT <met_help at ucar.edu>
> > > Sent: Thursday, September 8, 2016 3:57 PM
> > > To: Jose Garcia-Rivera
> > > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar
NETCDF
> file
> > for grid_stat verifiction
> > >
> > > Hi Jose.
> > >
> > > Unfortunately, we do not have a radar obs netcdf example file.
With
> > > NetCDF, users have two choices:
> > > --make it look like the NetCDF files that MET generates (i.e.
the
> > > output of pcp_combine) or
> > > --put it into CF-compliant NetCDF
> > > The variable can be named "radar_obs" or "precip" or anything
you'd
> like.
> > >
> > > Julie
> > >
> > >
> > > On Thu, Sep 8, 2016 at 12:10 PM, Jose Garcia-Rivera via RT
> > > <met_help at ucar.edu> wrote:
> > >>
> > >> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
> > >>
> > >> Dear Julie,
> > >>
> > >> Thanks so much for the file. We haven't been able to work on it
yet,
> > since we are fixing computer issues. One more question, do you
have a
> radar
> > obs netcdf example file?
> > >>
> > >> Best Regards,
> > >> Jose
> > >>
> > >> From: Julie Prestopnik via RT <met_help at ucar.edu>
> > >> Sent: Thursday, September 8, 2016 12:58 PM
> > >> To: Jose Garcia-Rivera
> > >> Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar
NETCDF
> > file for grid_stat verifiction
> > >>
> > >> My apologies. I meant to attach the file in my last email.
You can
> > >> find it attached to this one.
> > >>
> > >> Thanks,
> > >> Julie
> > >>
> > >> On Thu, Sep 8, 2016 at 10:36 AM, Jose Garcia-Rivera via RT
> > >> <met_help at ucar.edu> wrote:
> > >>>
> > >>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823
>
> > >>>
> > >>> Dear Julie,
> > >>>
> > >>> Thanks for the helpful response. Can I have an example file
from the
> > pcp_combine tool for reference?
> > >>>
> > >>> Best Regards,
> > >>> Jose
> > >>> ________________________________________
> > >>> From: Julie Prestopnik via RT <met_help at ucar.edu>
> > >>> Sent: Thursday, September 8, 2016 11:57 AM
> > >>> To: Jose Garcia-Rivera
> > >>> Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar
NETCDF
> > file for grid_stat verifiction
> > >>>
> > >>> Hi Jose.
> > >>>
> > >>> I see that you are running MET 5.1, but are unsure of how the
NetCDF
> > >>> files should be formatted in order for GridStat to be able to
read
> > >>> them.
> > >>>
> > >>> In order it use gridded NetCDF files in MET, you'll need to
make them
> > >>> look like the output of the pcp_combine tool.
> > >>>
> > >>> Listed below is the header from one of the NetCDF files from
> > >>> pcp_combine created by the METv5.1 test scripts. Here are the
> > >>> required parts.
> > >>>
> > >>> (1) dimensions should be named "lat" and "lon"
> > >>> (2) the "lat" and "lon" variable are **NOT** required
> > >>> (3) gridded variables (e.g. APCP_12) must use the "lat" and
"lon"
> > dimensions
> > >>> (4) gridded variables should include the attributes listed
in the
> > >>> example (for timing info, only the init_time_ut,
valid_time_ut, and
> > >>> accum_time_sec are actually used. "ut" stands for unix time,
the
> > >>> number of seconds since Jan 1, 1970).
> > >>> (5) global attributes should include the grid/projection
> > >>> information. This example shows how they're specified for a
lambert
> > >>> conformal projection. Let me know if you're using a different
> > >>> projection and I'll send you an example.
> > >>>
> > >>> I hope that helps get you going.
> > >>>
> > >>> Julie
> > >>>
> > >>>
> > >>>
> > >>> On Wed, Sep 7, 2016 at 3:15 PM, Jose Garcia-Rivera via RT
> > >>> <met_help at ucar.edu> wrote:
> > >>>>
> > >>>> Wed Sep 07 15:15:39 2016: Request 77823 was acted upon.
> > >>>> Transaction: Ticket created by GarciaJ at imsg.com
> > >>>> Queue: met_help
> > >>>> Subject: Trouble running radar NETCDF file for grid_stat
> > verifiction
> > >>>> Owner: Nobody
> > >>>> Requestors: GarciaJ at imsg.com
> > >>>> Status: new
> > >>>> Ticket <URL: https://rt.rap.ucar.edu/rt/
> Ticket/Display.html?id=77823
> > >
> > >>>>
> > >>>>
> > >>>> Dear Met Help,
> > >>>>
> > >>>>
> > >>>> I've been trying to run MET using a radar NETCDF file, and an
NMMB
> > model forecast GRIB file, but the following error shows up:
> > >>>>
> > >>>>
> > >>>> DEBUG 1: Default Config File: /work/apps/pgi_14.10/SANDY/
> > met-5.1/share/met/config/GridStatConfig_default
> > >>>> DEBUG 1: User Config File: GridStatConfig_dbz
> > >>>> ERROR :
> > >>>> ERROR : Trouble reading observation file
"Hongqiao.Refl.20150602.
> > s100000.e100500.attributes.nc"
> > >>>> ERROR :
> > >>>>
> > >>>> We used two versions of the OBS file, one as it was, and the
second
> > with added "attributes". Still, the same error occurred. We are
not sure
> on
> > exactly how our NETCDF files need to be for MET to be able to read
them.
> I
> > searched the error message on the Guide and nothing showed up.
> > >>>>
> > >>>> We can share the files to your FTP if you want to run them.
> > >>>>
> > >>>> Any help will be greatly appreciated.
> > >>>>
> > >>>>
> > >>>>
> > >>>> NOTE: We are using MET 5.1
> > >>>>
> > >>>>
> > >>>> Best Regards,
> > >>>>
> > >>>> Jose
> > >>>>
> > >>>>
> > >>>>
> > >>>>
> > >>>> Jose M. Garcia-Rivera, PhD
> > >>>>
> > >>>> Atmospheric Scientist
> > >>>>
> > >>>> IM Systems Group
> > >>>>
> > >>>> Rockville/College Park, MD
> > >>>>
> > >>>> This e-mail, including attachments, may include confidential
and/or
> > proprietary information, and may be used only by the person or
entity to
> > which it is addressed. If the reader of this e-mail is not the
intended
> > recipient or his or her authorized agent, the reader is hereby
notified
> > that any dissemination, distribution or copying of this e-mail is
> > prohibited. If you have received this e-mail in error, please
notify the
> > sender by replying to this message and delete this e-mail
immediately.
> > >>>>
> > >>>>
> > >>>
> > >>>
> > >>>
> > >>> --
> > >>> Julie Prestopnik
> > >>> National Center for Atmospheric Research
> > >>> Research Applications Laboratory
> > >>> Phone: 303.497.8399
> > >>> Email: jpresto at ucar.edu
> > >>>
> > >>>
> > >>> This e-mail, including attachments, may include confidential
and/or
> > proprietary information, and may be used only by the person or
entity to
> > which it is addressed. If the reader of this e-mail is not the
intended
> > recipient or his or her authorized agent, the reader is hereby
notified
> > that any dissemination, distribution or copying of this e-mail is
> > prohibited. If you have received this e-mail in error, please
notify the
> > sender by replying to this message and delete this e-mail
immediately.
> > >>>
> > >>>
> > >>
> > >>
> > >>
> > >> --
> > >> Julie Prestopnik
> > >> National Center for Atmospheric Research
> > >> Research Applications Laboratory
> > >> Phone: 303.497.8399
> > >> Email: jpresto at ucar.edu
> > >>
> > >> This e-mail, including attachments, may include confidential
and/or
> > proprietary information, and may be used only by the person or
entity to
> > which it is addressed. If the reader of this e-mail is not the
intended
> > recipient or his or her authorized agent, the reader is hereby
notified
> > that any dissemination, distribution or copying of this e-mail is
> > prohibited. If you have received this e-mail in error, please
notify the
> > sender by replying to this message and delete this e-mail
immediately.
> > >>
> > >>
> > >
> > >
> > >
> > > --
> > > Julie Prestopnik
> > > National Center for Atmospheric Research
> > > Research Applications Laboratory
> > > Phone: 303.497.8399
> > > Email: jpresto at ucar.edu
> > >
> > >
> > > This e-mail, including attachments, may include confidential
and/or
> > proprietary information, and may be used only by the person or
entity to
> > which it is addressed. If the reader of this e-mail is not the
intended
> > recipient or his or her authorized agent, the reader is hereby
notified
> > that any dissemination, distribution or copying of this e-mail is
> > prohibited. If you have received this e-mail in error, please
notify the
> > sender by replying to this message and delete this e-mail
immediately.
> > >
> > >
> >
> >
> >
> > --
> > Julie Prestopnik
> > National Center for Atmospheric Research
> > Research Applications Laboratory
> > Phone: 303.497.8399
> > Email: jpresto at ucar.edu
> >
> > This e-mail, including attachments, may include confidential
and/or
> > proprietary information, and may be used only by the person or
entity to
> > which it is addressed. If the reader of this e-mail is not the
intended
> > recipient or his or her authorized agent, the reader is hereby
notified
> > that any dissemination, distribution or copying of this e-mail is
> > prohibited. If you have received this e-mail in error, please
notify the
> > sender by replying to this message and delete this e-mail
immediately.
> >
> >
> >
>
>
> --
> Julie Prestopnik
> National Center for Atmospheric Research
> Research Applications Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
> This e-mail, including attachments, may include confidential and/or
> proprietary information, and may be used only by the person or
entity to
> which it is addressed. If the reader of this e-mail is not the
intended
> recipient or his or her authorized agent, the reader is hereby
notified
> that any dissemination, distribution or copying of this e-mail is
> prohibited. If you have received this e-mail in error, please notify
the
> sender by replying to this message and delete this e-mail
immediately.
>
>
>
This e-mail, including attachments, may include confidential and/or
proprietary information, and may be used only by the person or entity
to which it is addressed. If the reader of this e-mail is not the
intended recipient or his or her authorized agent, the reader is
hereby notified that any dissemination, distribution or copying of
this e-mail is prohibited. If you have received this e-mail in error,
please notify the sender by replying to this message and delete this
e-mail immediately.
------------------------------------------------
Subject: Trouble running radar NETCDF file for grid_stat verifiction
From: Julie Prestopnik
Time: Fri Sep 09 14:07:12 2016
Hi Jose.
As John indicated the problem lies in that currently MET only supports
the
classic data model... i.e. NetCDF3, which the file RadarObsNEW.nc is
not.
Running "file RadarObsNEW.nc" shows that the file is not "NetCDF Data
Format data", but rather:
RadarObsNEW.nc: Hierarchical Data Format (version 5) data
You can create a NetCDF3 file when you create the file or you can use
the
"nccopy" command. However, "nccopy" didn't work with the
RadarObsNEW.nc
file, until we made some changes. We used "ncatted" to remove the "L"
from
the value of the following attributes: parameter_table_version,
parameter_number, level_indicator, nx, and ny. I'll paste in the
commands
that we used to create a NetCDF3 file, plot the data, and get a
successful
run from grid_stat.
# Update attributes to remove longs
/usr/local/nco/bin/ncatted \
-a parameter_table_version,REFC,o,f,129 \
-a parameter_number,REFC,o,f,212 \
-a level_indicator,REFC,o,f,200 \
-a nx,global,o,i,674 \
-a ny,global,o,i,620 \
RadarObsNEW.nc RadarObsNEW_mod.nc
# Convert from NC4 to NC3
/usr/local/netcdf/bin/nccopy -3 RadarObsNEW_mod.nc
RadarObsNEW_mod_v3.nc
# Regrid to global grid
/usr/local/met-5.2/bin/regrid_data_plane \
RadarObsNEW_mod_v3.nc G004 RadarObsNEW_mod_v3_G004.nc \
-field 'name="REFC"; level="(*,*)";'
# Plot the result
/usr/local/met-5.2/bin/plot_data_plane \
RadarObsNEW_mod_v3_G004.nc RadarObsNEW_mod_v3_G004.ps \
'name="REFC"; level="(*,*)";'
# Display plot
convert -rotate 90 -background white -flatten
RadarObsNEW_mod_v3_G004.ps
RadarObsNEW_mod_v3_G004.png
display RadarObsNEW_mod_v3_G004.png&
# Plot forecast REFC
/usr/local/met-5.2/bin/plot_data_plane \
ForecastFile.grb refc_fcst.ps \
'name="REFC"; level="L0"; GRIB1_ptv=129;'
# Display plot
convert -rotate 90 -background white -flatten refc_fcst.ps
refc_fcst.png
display refc_fcst.png&
# Run grid_stat
/usr/local/met-5.1/bin/grid_stat ForecastFile.grb
RadarObsNEW_mod_v3.nc
GridStatConfig_dbz -outdir out/
I have also attached the NetCDF3 file that we produced after using
ncatted
and nccopy.
Please let us know if you have any other questions.
Thanks,
Julie
On Fri, Sep 9, 2016 at 12:43 PM, Jose Garcia-Rivera via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
>
> Hi John,
>
> Glad to talk to you again. We did the proposed changes, and the
error
> keeps showing up.
>
> I uploaded the new file as: RadarObsNEW.nc
>
> Please try to run it and let me know what issues show up?
>
> Thanks for the help,
> Jose
> ________________________________________
> From: John Halley Gotway via RT <met_help at ucar.edu>
> Sent: Friday, September 9, 2016 2:17 PM
> To: Jose Garcia-Rivera
> Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar NETCDF
file
> for grid_stat verifiction
>
> Hello Jose,
>
> This is John Halley Gotway. I work with Julie on providing support
for
> MET.
>
> I think there's a few pieces of info we're missing here.
>
> (1) MET does not currently support the enhanced data model of
NetCDF4. It
> only supports the classic data model... i.e. NetCDF3. In the next
version
> of MET (6.0), due out next year, we'll be adding support for
NetCDF4. The
> file you sent us in NetCDF4 but when Julie add those attributes she
may
> have used ncdump/ncgen. And their output is NetCDF3. Try updating
your
> NCL script to write a "classic" NetCDF file.
>
> (2) Yes, the "MET_version" global attribute needs to be present.
That
> tells MET how to parse the grid information.
>
> (3) I'm not sure that the variable "name" attribute is necessary,
but it
> doesn't hurt.
>
> (4) The biggest problem is in the definition of your Mercator grid:
> :Projection = "Mercator" ;
> :lat_ll = "3348550.177 degrees_north" ;
> :lon_ll = "13120540.425 degrees_east" ;
> :lat_ur = "4057346.9 degrees_north" ;
> :lon_ur = "13891071.057 degrees_east" ;
>
> Those don't look like very meaningful lat/lon values! Where did you
get
> these numbers? Are they meant to match the grid defined in the GRIB
file
> you sent us?
>
> Thanks,
> John
>
> On Fri, Sep 9, 2016 at 12:08 PM, Jose Garcia-Rivera via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
> >
> > Dear Julie,
> >
> > The file that you modified worked. However, we did the changes you
made,
> > and grid_stat continues to show the same error.
> >
> > I've uploaded the file in the same FTP directory, named:
> > Hongqiao.Refl.20150602.s100000.e100500.attributes.nc
> >
> > This is a file dump of our modified netcdf:
> >
> > NCAR Command Language Version 6.3.0
> > The use of this software is governed by a License Agreement.
> > See http://www.ncl.ucar.edu/ for more details.
> >
> > Variable: f
> > Type: file
> > filename: Hongqiao.Refl.20150602.s100000.e100500.attributes
> > path: Hongqiao.Refl.20150602.s100000.e100500.attributes.nc
> > Number of Attributes:8
> > MET_version : V5.1
> > Projection : Mercator
> > lat_ll : 3348550.177 degrees_north
> > lon_ll : 13120540.425 degrees_east
> > lat_ur : 4057346.9 degrees_north
> > lon_ur : 13891071.057 degrees_east
> > nx : 674
> > ny : 620
> >
> > dimensions:
> > lon = 674
> > lat = 620
> >
> > variables:
> > Variable: lat
> > Type: float
> > Total Size: 417880 values
> > 1671520 bytes
> > Number of Dimensions: 2
> > Dimensions and sizes: [ 620 <lat> x 674 <lon> ]
> > Coordinates:
> > lat: [4057347..4057347]
> > lon: [1.312054e+07..1.388993e+07]
> > Number of Attributes: 2
> > units : degrees_north
> > standard_name : latitude
> >
> > Variable: lon
> > Type: float
> > Total Size: 417880 values
> > 1671520 bytes
> > Number of Dimensions: 2
> > Dimensions and sizes: [ 620 <lat> x 674 <lon> ]
> > Coordinates:
> > lat: [4057347..4057347]
> > lon: [1.312054e+07..1.388993e+07]
> > Number of Attributes: 2
> > units : degrees_east
> > standard_name : longitude
> >
> > Variable: REFC
> > Type: float
> > Total Size: 417880 values
> > 1671520 bytes
> > Number of Dimensions: 2
> > Dimensions and sizes: [ 620 <lat> x 674 <lon> ]
> > Coordinates:
> > lat: [4057347..4057347]
> > lon: [1.312054e+07..1.388993e+07]
> > Number of Attributes: 11
> > name : REFC
> > units : dbZ
> > parameter_table_version : 129
> > parameter_number : 212
> > level_indicator : 200
> > level : L0
> > long_name : MaxReflectivity
> > init_time : 20050807_000000
> > init_time_ut : 1123372800
> > valid_time : 20050807_120000
> > valid_time_ut : 1123416000
> >
> >
> >
> > Best Regards,
> > Jose
> >
> >
> > ________________________________________
> > From: Julie Prestopnik via RT <met_help at ucar.edu>
> > Sent: Friday, September 9, 2016 1:09 PM
> > To: Jose Garcia-Rivera
> > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar NETCDF
file
> > for grid_stat verifiction
> >
> > Hi Jose. Thank you for uploading your data. There were two
important
> > things missing from your file.
> >
> > I added:
> >
> > REFC:name = "REFC" ;
> >
> > under:
> >
> > float REFC(lat, lon) ;
> >
> > and I added:
> >
> > :MET_version = "V5.1" ;
> >
> > under // global attributes:
> >
> > and was able to get a successful run of grid_stat.
> >
> > I am attaching the file with the changes. Please give it a try
and let
> me
> > know if you get a successful run as well.
> >
> > Thanks,
> > Julie
> >
> > On Fri, Sep 9, 2016 at 10:38 AM, Jose Garcia-Rivera via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
> > >
> > > Dear Julie,
> > >
> > > We used the Mercator example, and ours looks identical to yours.
I
> > > proceeded and put 4 files into your FTP server:
> > >
> > > Model forecast file
> > > Radar Obs file
> > > Grid Stat Config file
> > > domain.poly file
> > >
> > > The files are under 'garcia_data'
> > >
> > >
> > > Thanks so much for your help,
> > > Jose
> > > ________________________________________
> > > From: Julie Prestopnik via RT <met_help at ucar.edu>
> > > Sent: Friday, September 9, 2016 11:50 AM
> > > To: Jose Garcia-Rivera
> > > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar
NETCDF
> file
> > > for grid_stat verifiction
> > >
> > > Hi Jose. I have attached a Mercator projection example. If
you're
> > > still stuck, please post your data to our
> > > anonymous FTP site following these instructions:
> > > http://www.dtcenter.org/met/users/support/met_help.php#ftp
> > >
> > > Thanks,
> > > Julie
> > >
> > >
> > > On Thu, Sep 8, 2016 at 3:25 PM, Jose Garcia-Rivera via RT
> > > <met_help at ucar.edu> wrote:
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823
>
> > > >
> > > > Dear Julie,
> > > >
> > > > That's very good information, thanks. We've been working on
this
> issue,
> > > however the same error keeps showing up.
> > > >
> > > > Can we get a Mercator projection example?
> > > >
> > > > I was wondering if you could have a peek into our netcdf file,
or run
> > an
> > > internal test to see what needs to be changed, or what may be
wrong. In
> > the
> > > meantime, we continue working on trying to make the file fit MET
> > > requirements.
> > > >
> > > > Thanks for the help,
> > > > Jose
> > > >
> > > > ________________________________________
> > > > From: Julie Prestopnik via RT <met_help at ucar.edu>
> > > > Sent: Thursday, September 8, 2016 3:57 PM
> > > > To: Jose Garcia-Rivera
> > > > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar
NETCDF
> > file
> > > for grid_stat verifiction
> > > >
> > > > Hi Jose.
> > > >
> > > > Unfortunately, we do not have a radar obs netcdf example file.
With
> > > > NetCDF, users have two choices:
> > > > --make it look like the NetCDF files that MET generates (i.e.
the
> > > > output of pcp_combine) or
> > > > --put it into CF-compliant NetCDF
> > > > The variable can be named "radar_obs" or "precip" or anything
you'd
> > like.
> > > >
> > > > Julie
> > > >
> > > >
> > > > On Thu, Sep 8, 2016 at 12:10 PM, Jose Garcia-Rivera via RT
> > > > <met_help at ucar.edu> wrote:
> > > >>
> > > >> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823
>
> > > >>
> > > >> Dear Julie,
> > > >>
> > > >> Thanks so much for the file. We haven't been able to work on
it yet,
> > > since we are fixing computer issues. One more question, do you
have a
> > radar
> > > obs netcdf example file?
> > > >>
> > > >> Best Regards,
> > > >> Jose
> > > >>
> > > >> From: Julie Prestopnik via RT <met_help at ucar.edu>
> > > >> Sent: Thursday, September 8, 2016 12:58 PM
> > > >> To: Jose Garcia-Rivera
> > > >> Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar
NETCDF
> > > file for grid_stat verifiction
> > > >>
> > > >> My apologies. I meant to attach the file in my last email.
You
> can
> > > >> find it attached to this one.
> > > >>
> > > >> Thanks,
> > > >> Julie
> > > >>
> > > >> On Thu, Sep 8, 2016 at 10:36 AM, Jose Garcia-Rivera via RT
> > > >> <met_help at ucar.edu> wrote:
> > > >>>
> > > >>> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
> > > >>>
> > > >>> Dear Julie,
> > > >>>
> > > >>> Thanks for the helpful response. Can I have an example file
from
> the
> > > pcp_combine tool for reference?
> > > >>>
> > > >>> Best Regards,
> > > >>> Jose
> > > >>> ________________________________________
> > > >>> From: Julie Prestopnik via RT <met_help at ucar.edu>
> > > >>> Sent: Thursday, September 8, 2016 11:57 AM
> > > >>> To: Jose Garcia-Rivera
> > > >>> Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar
NETCDF
> > > file for grid_stat verifiction
> > > >>>
> > > >>> Hi Jose.
> > > >>>
> > > >>> I see that you are running MET 5.1, but are unsure of how
the
> NetCDF
> > > >>> files should be formatted in order for GridStat to be able
to read
> > > >>> them.
> > > >>>
> > > >>> In order it use gridded NetCDF files in MET, you'll need to
make
> them
> > > >>> look like the output of the pcp_combine tool.
> > > >>>
> > > >>> Listed below is the header from one of the NetCDF files from
> > > >>> pcp_combine created by the METv5.1 test scripts. Here are
the
> > > >>> required parts.
> > > >>>
> > > >>> (1) dimensions should be named "lat" and "lon"
> > > >>> (2) the "lat" and "lon" variable are **NOT** required
> > > >>> (3) gridded variables (e.g. APCP_12) must use the "lat"
and "lon"
> > > dimensions
> > > >>> (4) gridded variables should include the attributes listed
in the
> > > >>> example (for timing info, only the init_time_ut,
valid_time_ut, and
> > > >>> accum_time_sec are actually used. "ut" stands for unix
time, the
> > > >>> number of seconds since Jan 1, 1970).
> > > >>> (5) global attributes should include the grid/projection
> > > >>> information. This example shows how they're specified for a
> lambert
> > > >>> conformal projection. Let me know if you're using a
different
> > > >>> projection and I'll send you an example.
> > > >>>
> > > >>> I hope that helps get you going.
> > > >>>
> > > >>> Julie
> > > >>>
> > > >>>
> > > >>>
> > > >>> On Wed, Sep 7, 2016 at 3:15 PM, Jose Garcia-Rivera via RT
> > > >>> <met_help at ucar.edu> wrote:
> > > >>>>
> > > >>>> Wed Sep 07 15:15:39 2016: Request 77823 was acted upon.
> > > >>>> Transaction: Ticket created by GarciaJ at imsg.com
> > > >>>> Queue: met_help
> > > >>>> Subject: Trouble running radar NETCDF file for
grid_stat
> > > verifiction
> > > >>>> Owner: Nobody
> > > >>>> Requestors: GarciaJ at imsg.com
> > > >>>> Status: new
> > > >>>> Ticket <URL: https://rt.rap.ucar.edu/rt/
> > Ticket/Display.html?id=77823
> > > >
> > > >>>>
> > > >>>>
> > > >>>> Dear Met Help,
> > > >>>>
> > > >>>>
> > > >>>> I've been trying to run MET using a radar NETCDF file, and
an NMMB
> > > model forecast GRIB file, but the following error shows up:
> > > >>>>
> > > >>>>
> > > >>>> DEBUG 1: Default Config File: /work/apps/pgi_14.10/SANDY/
> > > met-5.1/share/met/config/GridStatConfig_default
> > > >>>> DEBUG 1: User Config File: GridStatConfig_dbz
> > > >>>> ERROR :
> > > >>>> ERROR : Trouble reading observation file
"Hongqiao.Refl.20150602.
> > > s100000.e100500.attributes.nc"
> > > >>>> ERROR :
> > > >>>>
> > > >>>> We used two versions of the OBS file, one as it was, and
the
> second
> > > with added "attributes". Still, the same error occurred. We are
not
> sure
> > on
> > > exactly how our NETCDF files need to be for MET to be able to
read
> them.
> > I
> > > searched the error message on the Guide and nothing showed up.
> > > >>>>
> > > >>>> We can share the files to your FTP if you want to run them.
> > > >>>>
> > > >>>> Any help will be greatly appreciated.
> > > >>>>
> > > >>>>
> > > >>>>
> > > >>>> NOTE: We are using MET 5.1
> > > >>>>
> > > >>>>
> > > >>>> Best Regards,
> > > >>>>
> > > >>>> Jose
> > > >>>>
> > > >>>>
> > > >>>>
> > > >>>>
> > > >>>> Jose M. Garcia-Rivera, PhD
> > > >>>>
> > > >>>> Atmospheric Scientist
> > > >>>>
> > > >>>> IM Systems Group
> > > >>>>
> > > >>>> Rockville/College Park, MD
> > > >>>>
> > > >>>> This e-mail, including attachments, may include
confidential
> and/or
> > > proprietary information, and may be used only by the person or
entity
> to
> > > which it is addressed. If the reader of this e-mail is not the
intended
> > > recipient or his or her authorized agent, the reader is hereby
notified
> > > that any dissemination, distribution or copying of this e-mail
is
> > > prohibited. If you have received this e-mail in error, please
notify
> the
> > > sender by replying to this message and delete this e-mail
immediately.
> > > >>>>
> > > >>>>
> > > >>>
> > > >>>
> > > >>>
> > > >>> --
> > > >>> Julie Prestopnik
> > > >>> National Center for Atmospheric Research
> > > >>> Research Applications Laboratory
> > > >>> Phone: 303.497.8399
> > > >>> Email: jpresto at ucar.edu
> > > >>>
> > > >>>
> > > >>> This e-mail, including attachments, may include confidential
and/or
> > > proprietary information, and may be used only by the person or
entity
> to
> > > which it is addressed. If the reader of this e-mail is not the
intended
> > > recipient or his or her authorized agent, the reader is hereby
notified
> > > that any dissemination, distribution or copying of this e-mail
is
> > > prohibited. If you have received this e-mail in error, please
notify
> the
> > > sender by replying to this message and delete this e-mail
immediately.
> > > >>>
> > > >>>
> > > >>
> > > >>
> > > >>
> > > >> --
> > > >> Julie Prestopnik
> > > >> National Center for Atmospheric Research
> > > >> Research Applications Laboratory
> > > >> Phone: 303.497.8399
> > > >> Email: jpresto at ucar.edu
> > > >>
> > > >> This e-mail, including attachments, may include confidential
and/or
> > > proprietary information, and may be used only by the person or
entity
> to
> > > which it is addressed. If the reader of this e-mail is not the
intended
> > > recipient or his or her authorized agent, the reader is hereby
notified
> > > that any dissemination, distribution or copying of this e-mail
is
> > > prohibited. If you have received this e-mail in error, please
notify
> the
> > > sender by replying to this message and delete this e-mail
immediately.
> > > >>
> > > >>
> > > >
> > > >
> > > >
> > > > --
> > > > Julie Prestopnik
> > > > National Center for Atmospheric Research
> > > > Research Applications Laboratory
> > > > Phone: 303.497.8399
> > > > Email: jpresto at ucar.edu
> > > >
> > > >
> > > > This e-mail, including attachments, may include confidential
and/or
> > > proprietary information, and may be used only by the person or
entity
> to
> > > which it is addressed. If the reader of this e-mail is not the
intended
> > > recipient or his or her authorized agent, the reader is hereby
notified
> > > that any dissemination, distribution or copying of this e-mail
is
> > > prohibited. If you have received this e-mail in error, please
notify
> the
> > > sender by replying to this message and delete this e-mail
immediately.
> > > >
> > > >
> > >
> > >
> > >
> > > --
> > > Julie Prestopnik
> > > National Center for Atmospheric Research
> > > Research Applications Laboratory
> > > Phone: 303.497.8399
> > > Email: jpresto at ucar.edu
> > >
> > > This e-mail, including attachments, may include confidential
and/or
> > > proprietary information, and may be used only by the person or
entity
> to
> > > which it is addressed. If the reader of this e-mail is not the
intended
> > > recipient or his or her authorized agent, the reader is hereby
notified
> > > that any dissemination, distribution or copying of this e-mail
is
> > > prohibited. If you have received this e-mail in error, please
notify
> the
> > > sender by replying to this message and delete this e-mail
immediately.
> > >
> > >
> > >
> >
> >
> > --
> > Julie Prestopnik
> > National Center for Atmospheric Research
> > Research Applications Laboratory
> > Phone: 303.497.8399
> > Email: jpresto at ucar.edu
> >
> > This e-mail, including attachments, may include confidential
and/or
> > proprietary information, and may be used only by the person or
entity to
> > which it is addressed. If the reader of this e-mail is not the
intended
> > recipient or his or her authorized agent, the reader is hereby
notified
> > that any dissemination, distribution or copying of this e-mail is
> > prohibited. If you have received this e-mail in error, please
notify the
> > sender by replying to this message and delete this e-mail
immediately.
> >
> >
> >
>
> This e-mail, including attachments, may include confidential and/or
> proprietary information, and may be used only by the person or
entity to
> which it is addressed. If the reader of this e-mail is not the
intended
> recipient or his or her authorized agent, the reader is hereby
notified
> that any dissemination, distribution or copying of this e-mail is
> prohibited. If you have received this e-mail in error, please notify
the
> sender by replying to this message and delete this e-mail
immediately.
>
>
>
--
Julie Prestopnik
National Center for Atmospheric Research
Research Applications Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar NETCDF file for grid_stat verifiction
From: Jose Garcia-Rivera
Time: Fri Sep 09 15:25:44 2016
Dear Julie, John
It seems like we need NCO installed on our computer system (I'm not an
admin there). We put the request for installation, and will follow
your commands to convert the file to netCDF3. You're right, we wrote
the python script to produce a netCDF3, but it still gives a netCDF4!
Once we have NCO, we will work on modifying the file, and see if it
finally works. This will probably be done on Monday. Thank you so much
again for all the support and valuable information.
Best Regards,
Jose
________________________________________
From: Julie Prestopnik via RT <met_help at ucar.edu>
Sent: Friday, September 9, 2016 4:07 PM
To: Jose Garcia-Rivera
Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar NETCDF
file for grid_stat verifiction
Hi Jose.
As John indicated the problem lies in that currently MET only supports
the
classic data model... i.e. NetCDF3, which the file RadarObsNEW.nc is
not.
Running "file RadarObsNEW.nc" shows that the file is not "NetCDF Data
Format data", but rather:
RadarObsNEW.nc: Hierarchical Data Format (version 5) data
You can create a NetCDF3 file when you create the file or you can use
the
"nccopy" command. However, "nccopy" didn't work with the
RadarObsNEW.nc
file, until we made some changes. We used "ncatted" to remove the "L"
from
the value of the following attributes: parameter_table_version,
parameter_number, level_indicator, nx, and ny. I'll paste in the
commands
that we used to create a NetCDF3 file, plot the data, and get a
successful
run from grid_stat.
# Update attributes to remove longs
/usr/local/nco/bin/ncatted \
-a parameter_table_version,REFC,o,f,129 \
-a parameter_number,REFC,o,f,212 \
-a level_indicator,REFC,o,f,200 \
-a nx,global,o,i,674 \
-a ny,global,o,i,620 \
RadarObsNEW.nc RadarObsNEW_mod.nc
# Convert from NC4 to NC3
/usr/local/netcdf/bin/nccopy -3 RadarObsNEW_mod.nc
RadarObsNEW_mod_v3.nc
# Regrid to global grid
/usr/local/met-5.2/bin/regrid_data_plane \
RadarObsNEW_mod_v3.nc G004 RadarObsNEW_mod_v3_G004.nc \
-field 'name="REFC"; level="(*,*)";'
# Plot the result
/usr/local/met-5.2/bin/plot_data_plane \
RadarObsNEW_mod_v3_G004.nc RadarObsNEW_mod_v3_G004.ps \
'name="REFC"; level="(*,*)";'
# Display plot
convert -rotate 90 -background white -flatten
RadarObsNEW_mod_v3_G004.ps
RadarObsNEW_mod_v3_G004.png
display RadarObsNEW_mod_v3_G004.png&
# Plot forecast REFC
/usr/local/met-5.2/bin/plot_data_plane \
ForecastFile.grb refc_fcst.ps \
'name="REFC"; level="L0"; GRIB1_ptv=129;'
# Display plot
convert -rotate 90 -background white -flatten refc_fcst.ps
refc_fcst.png
display refc_fcst.png&
# Run grid_stat
/usr/local/met-5.1/bin/grid_stat ForecastFile.grb
RadarObsNEW_mod_v3.nc
GridStatConfig_dbz -outdir out/
I have also attached the NetCDF3 file that we produced after using
ncatted
and nccopy.
Please let us know if you have any other questions.
Thanks,
Julie
On Fri, Sep 9, 2016 at 12:43 PM, Jose Garcia-Rivera via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
>
> Hi John,
>
> Glad to talk to you again. We did the proposed changes, and the
error
> keeps showing up.
>
> I uploaded the new file as: RadarObsNEW.nc
>
> Please try to run it and let me know what issues show up?
>
> Thanks for the help,
> Jose
> ________________________________________
> From: John Halley Gotway via RT <met_help at ucar.edu>
> Sent: Friday, September 9, 2016 2:17 PM
> To: Jose Garcia-Rivera
> Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar NETCDF
file
> for grid_stat verifiction
>
> Hello Jose,
>
> This is John Halley Gotway. I work with Julie on providing support
for
> MET.
>
> I think there's a few pieces of info we're missing here.
>
> (1) MET does not currently support the enhanced data model of
NetCDF4. It
> only supports the classic data model... i.e. NetCDF3. In the next
version
> of MET (6.0), due out next year, we'll be adding support for
NetCDF4. The
> file you sent us in NetCDF4 but when Julie add those attributes she
may
> have used ncdump/ncgen. And their output is NetCDF3. Try updating
your
> NCL script to write a "classic" NetCDF file.
>
> (2) Yes, the "MET_version" global attribute needs to be present.
That
> tells MET how to parse the grid information.
>
> (3) I'm not sure that the variable "name" attribute is necessary,
but it
> doesn't hurt.
>
> (4) The biggest problem is in the definition of your Mercator grid:
> :Projection = "Mercator" ;
> :lat_ll = "3348550.177 degrees_north" ;
> :lon_ll = "13120540.425 degrees_east" ;
> :lat_ur = "4057346.9 degrees_north" ;
> :lon_ur = "13891071.057 degrees_east" ;
>
> Those don't look like very meaningful lat/lon values! Where did you
get
> these numbers? Are they meant to match the grid defined in the GRIB
file
> you sent us?
>
> Thanks,
> John
>
> On Fri, Sep 9, 2016 at 12:08 PM, Jose Garcia-Rivera via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
> >
> > Dear Julie,
> >
> > The file that you modified worked. However, we did the changes you
made,
> > and grid_stat continues to show the same error.
> >
> > I've uploaded the file in the same FTP directory, named:
> > Hongqiao.Refl.20150602.s100000.e100500.attributes.nc
> >
> > This is a file dump of our modified netcdf:
> >
> > NCAR Command Language Version 6.3.0
> > The use of this software is governed by a License Agreement.
> > See http://www.ncl.ucar.edu/ for more details.
> >
> > Variable: f
> > Type: file
> > filename: Hongqiao.Refl.20150602.s100000.e100500.attributes
> > path: Hongqiao.Refl.20150602.s100000.e100500.attributes.nc
> > Number of Attributes:8
> > MET_version : V5.1
> > Projection : Mercator
> > lat_ll : 3348550.177 degrees_north
> > lon_ll : 13120540.425 degrees_east
> > lat_ur : 4057346.9 degrees_north
> > lon_ur : 13891071.057 degrees_east
> > nx : 674
> > ny : 620
> >
> > dimensions:
> > lon = 674
> > lat = 620
> >
> > variables:
> > Variable: lat
> > Type: float
> > Total Size: 417880 values
> > 1671520 bytes
> > Number of Dimensions: 2
> > Dimensions and sizes: [ 620 <lat> x 674 <lon> ]
> > Coordinates:
> > lat: [4057347..4057347]
> > lon: [1.312054e+07..1.388993e+07]
> > Number of Attributes: 2
> > units : degrees_north
> > standard_name : latitude
> >
> > Variable: lon
> > Type: float
> > Total Size: 417880 values
> > 1671520 bytes
> > Number of Dimensions: 2
> > Dimensions and sizes: [ 620 <lat> x 674 <lon> ]
> > Coordinates:
> > lat: [4057347..4057347]
> > lon: [1.312054e+07..1.388993e+07]
> > Number of Attributes: 2
> > units : degrees_east
> > standard_name : longitude
> >
> > Variable: REFC
> > Type: float
> > Total Size: 417880 values
> > 1671520 bytes
> > Number of Dimensions: 2
> > Dimensions and sizes: [ 620 <lat> x 674 <lon> ]
> > Coordinates:
> > lat: [4057347..4057347]
> > lon: [1.312054e+07..1.388993e+07]
> > Number of Attributes: 11
> > name : REFC
> > units : dbZ
> > parameter_table_version : 129
> > parameter_number : 212
> > level_indicator : 200
> > level : L0
> > long_name : MaxReflectivity
> > init_time : 20050807_000000
> > init_time_ut : 1123372800
> > valid_time : 20050807_120000
> > valid_time_ut : 1123416000
> >
> >
> >
> > Best Regards,
> > Jose
> >
> >
> > ________________________________________
> > From: Julie Prestopnik via RT <met_help at ucar.edu>
> > Sent: Friday, September 9, 2016 1:09 PM
> > To: Jose Garcia-Rivera
> > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar NETCDF
file
> > for grid_stat verifiction
> >
> > Hi Jose. Thank you for uploading your data. There were two
important
> > things missing from your file.
> >
> > I added:
> >
> > REFC:name = "REFC" ;
> >
> > under:
> >
> > float REFC(lat, lon) ;
> >
> > and I added:
> >
> > :MET_version = "V5.1" ;
> >
> > under // global attributes:
> >
> > and was able to get a successful run of grid_stat.
> >
> > I am attaching the file with the changes. Please give it a try
and let
> me
> > know if you get a successful run as well.
> >
> > Thanks,
> > Julie
> >
> > On Fri, Sep 9, 2016 at 10:38 AM, Jose Garcia-Rivera via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
> > >
> > > Dear Julie,
> > >
> > > We used the Mercator example, and ours looks identical to yours.
I
> > > proceeded and put 4 files into your FTP server:
> > >
> > > Model forecast file
> > > Radar Obs file
> > > Grid Stat Config file
> > > domain.poly file
> > >
> > > The files are under 'garcia_data'
> > >
> > >
> > > Thanks so much for your help,
> > > Jose
> > > ________________________________________
> > > From: Julie Prestopnik via RT <met_help at ucar.edu>
> > > Sent: Friday, September 9, 2016 11:50 AM
> > > To: Jose Garcia-Rivera
> > > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar
NETCDF
> file
> > > for grid_stat verifiction
> > >
> > > Hi Jose. I have attached a Mercator projection example. If
you're
> > > still stuck, please post your data to our
> > > anonymous FTP site following these instructions:
> > > http://www.dtcenter.org/met/users/support/met_help.php#ftp
> > >
> > > Thanks,
> > > Julie
> > >
> > >
> > > On Thu, Sep 8, 2016 at 3:25 PM, Jose Garcia-Rivera via RT
> > > <met_help at ucar.edu> wrote:
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823
>
> > > >
> > > > Dear Julie,
> > > >
> > > > That's very good information, thanks. We've been working on
this
> issue,
> > > however the same error keeps showing up.
> > > >
> > > > Can we get a Mercator projection example?
> > > >
> > > > I was wondering if you could have a peek into our netcdf file,
or run
> > an
> > > internal test to see what needs to be changed, or what may be
wrong. In
> > the
> > > meantime, we continue working on trying to make the file fit MET
> > > requirements.
> > > >
> > > > Thanks for the help,
> > > > Jose
> > > >
> > > > ________________________________________
> > > > From: Julie Prestopnik via RT <met_help at ucar.edu>
> > > > Sent: Thursday, September 8, 2016 3:57 PM
> > > > To: Jose Garcia-Rivera
> > > > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar
NETCDF
> > file
> > > for grid_stat verifiction
> > > >
> > > > Hi Jose.
> > > >
> > > > Unfortunately, we do not have a radar obs netcdf example file.
With
> > > > NetCDF, users have two choices:
> > > > --make it look like the NetCDF files that MET generates (i.e.
the
> > > > output of pcp_combine) or
> > > > --put it into CF-compliant NetCDF
> > > > The variable can be named "radar_obs" or "precip" or anything
you'd
> > like.
> > > >
> > > > Julie
> > > >
> > > >
> > > > On Thu, Sep 8, 2016 at 12:10 PM, Jose Garcia-Rivera via RT
> > > > <met_help at ucar.edu> wrote:
> > > >>
> > > >> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823
>
> > > >>
> > > >> Dear Julie,
> > > >>
> > > >> Thanks so much for the file. We haven't been able to work on
it yet,
> > > since we are fixing computer issues. One more question, do you
have a
> > radar
> > > obs netcdf example file?
> > > >>
> > > >> Best Regards,
> > > >> Jose
> > > >>
> > > >> From: Julie Prestopnik via RT <met_help at ucar.edu>
> > > >> Sent: Thursday, September 8, 2016 12:58 PM
> > > >> To: Jose Garcia-Rivera
> > > >> Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar
NETCDF
> > > file for grid_stat verifiction
> > > >>
> > > >> My apologies. I meant to attach the file in my last email.
You
> can
> > > >> find it attached to this one.
> > > >>
> > > >> Thanks,
> > > >> Julie
> > > >>
> > > >> On Thu, Sep 8, 2016 at 10:36 AM, Jose Garcia-Rivera via RT
> > > >> <met_help at ucar.edu> wrote:
> > > >>>
> > > >>> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
> > > >>>
> > > >>> Dear Julie,
> > > >>>
> > > >>> Thanks for the helpful response. Can I have an example file
from
> the
> > > pcp_combine tool for reference?
> > > >>>
> > > >>> Best Regards,
> > > >>> Jose
> > > >>> ________________________________________
> > > >>> From: Julie Prestopnik via RT <met_help at ucar.edu>
> > > >>> Sent: Thursday, September 8, 2016 11:57 AM
> > > >>> To: Jose Garcia-Rivera
> > > >>> Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar
NETCDF
> > > file for grid_stat verifiction
> > > >>>
> > > >>> Hi Jose.
> > > >>>
> > > >>> I see that you are running MET 5.1, but are unsure of how
the
> NetCDF
> > > >>> files should be formatted in order for GridStat to be able
to read
> > > >>> them.
> > > >>>
> > > >>> In order it use gridded NetCDF files in MET, you'll need to
make
> them
> > > >>> look like the output of the pcp_combine tool.
> > > >>>
> > > >>> Listed below is the header from one of the NetCDF files from
> > > >>> pcp_combine created by the METv5.1 test scripts. Here are
the
> > > >>> required parts.
> > > >>>
> > > >>> (1) dimensions should be named "lat" and "lon"
> > > >>> (2) the "lat" and "lon" variable are **NOT** required
> > > >>> (3) gridded variables (e.g. APCP_12) must use the "lat"
and "lon"
> > > dimensions
> > > >>> (4) gridded variables should include the attributes listed
in the
> > > >>> example (for timing info, only the init_time_ut,
valid_time_ut, and
> > > >>> accum_time_sec are actually used. "ut" stands for unix
time, the
> > > >>> number of seconds since Jan 1, 1970).
> > > >>> (5) global attributes should include the grid/projection
> > > >>> information. This example shows how they're specified for a
> lambert
> > > >>> conformal projection. Let me know if you're using a
different
> > > >>> projection and I'll send you an example.
> > > >>>
> > > >>> I hope that helps get you going.
> > > >>>
> > > >>> Julie
> > > >>>
> > > >>>
> > > >>>
> > > >>> On Wed, Sep 7, 2016 at 3:15 PM, Jose Garcia-Rivera via RT
> > > >>> <met_help at ucar.edu> wrote:
> > > >>>>
> > > >>>> Wed Sep 07 15:15:39 2016: Request 77823 was acted upon.
> > > >>>> Transaction: Ticket created by GarciaJ at imsg.com
> > > >>>> Queue: met_help
> > > >>>> Subject: Trouble running radar NETCDF file for
grid_stat
> > > verifiction
> > > >>>> Owner: Nobody
> > > >>>> Requestors: GarciaJ at imsg.com
> > > >>>> Status: new
> > > >>>> Ticket <URL: https://rt.rap.ucar.edu/rt/
> > Ticket/Display.html?id=77823
> > > >
> > > >>>>
> > > >>>>
> > > >>>> Dear Met Help,
> > > >>>>
> > > >>>>
> > > >>>> I've been trying to run MET using a radar NETCDF file, and
an NMMB
> > > model forecast GRIB file, but the following error shows up:
> > > >>>>
> > > >>>>
> > > >>>> DEBUG 1: Default Config File: /work/apps/pgi_14.10/SANDY/
> > > met-5.1/share/met/config/GridStatConfig_default
> > > >>>> DEBUG 1: User Config File: GridStatConfig_dbz
> > > >>>> ERROR :
> > > >>>> ERROR : Trouble reading observation file
"Hongqiao.Refl.20150602.
> > > s100000.e100500.attributes.nc"
> > > >>>> ERROR :
> > > >>>>
> > > >>>> We used two versions of the OBS file, one as it was, and
the
> second
> > > with added "attributes". Still, the same error occurred. We are
not
> sure
> > on
> > > exactly how our NETCDF files need to be for MET to be able to
read
> them.
> > I
> > > searched the error message on the Guide and nothing showed up.
> > > >>>>
> > > >>>> We can share the files to your FTP if you want to run them.
> > > >>>>
> > > >>>> Any help will be greatly appreciated.
> > > >>>>
> > > >>>>
> > > >>>>
> > > >>>> NOTE: We are using MET 5.1
> > > >>>>
> > > >>>>
> > > >>>> Best Regards,
> > > >>>>
> > > >>>> Jose
> > > >>>>
> > > >>>>
> > > >>>>
> > > >>>>
> > > >>>> Jose M. Garcia-Rivera, PhD
> > > >>>>
> > > >>>> Atmospheric Scientist
> > > >>>>
> > > >>>> IM Systems Group
> > > >>>>
> > > >>>> Rockville/College Park, MD
> > > >>>>
> > > >>>> This e-mail, including attachments, may include
confidential
> and/or
> > > proprietary information, and may be used only by the person or
entity
> to
> > > which it is addressed. If the reader of this e-mail is not the
intended
> > > recipient or his or her authorized agent, the reader is hereby
notified
> > > that any dissemination, distribution or copying of this e-mail
is
> > > prohibited. If you have received this e-mail in error, please
notify
> the
> > > sender by replying to this message and delete this e-mail
immediately.
> > > >>>>
> > > >>>>
> > > >>>
> > > >>>
> > > >>>
> > > >>> --
> > > >>> Julie Prestopnik
> > > >>> National Center for Atmospheric Research
> > > >>> Research Applications Laboratory
> > > >>> Phone: 303.497.8399
> > > >>> Email: jpresto at ucar.edu
> > > >>>
> > > >>>
> > > >>> This e-mail, including attachments, may include confidential
and/or
> > > proprietary information, and may be used only by the person or
entity
> to
> > > which it is addressed. If the reader of this e-mail is not the
intended
> > > recipient or his or her authorized agent, the reader is hereby
notified
> > > that any dissemination, distribution or copying of this e-mail
is
> > > prohibited. If you have received this e-mail in error, please
notify
> the
> > > sender by replying to this message and delete this e-mail
immediately.
> > > >>>
> > > >>>
> > > >>
> > > >>
> > > >>
> > > >> --
> > > >> Julie Prestopnik
> > > >> National Center for Atmospheric Research
> > > >> Research Applications Laboratory
> > > >> Phone: 303.497.8399
> > > >> Email: jpresto at ucar.edu
> > > >>
> > > >> This e-mail, including attachments, may include confidential
and/or
> > > proprietary information, and may be used only by the person or
entity
> to
> > > which it is addressed. If the reader of this e-mail is not the
intended
> > > recipient or his or her authorized agent, the reader is hereby
notified
> > > that any dissemination, distribution or copying of this e-mail
is
> > > prohibited. If you have received this e-mail in error, please
notify
> the
> > > sender by replying to this message and delete this e-mail
immediately.
> > > >>
> > > >>
> > > >
> > > >
> > > >
> > > > --
> > > > Julie Prestopnik
> > > > National Center for Atmospheric Research
> > > > Research Applications Laboratory
> > > > Phone: 303.497.8399
> > > > Email: jpresto at ucar.edu
> > > >
> > > >
> > > > This e-mail, including attachments, may include confidential
and/or
> > > proprietary information, and may be used only by the person or
entity
> to
> > > which it is addressed. If the reader of this e-mail is not the
intended
> > > recipient or his or her authorized agent, the reader is hereby
notified
> > > that any dissemination, distribution or copying of this e-mail
is
> > > prohibited. If you have received this e-mail in error, please
notify
> the
> > > sender by replying to this message and delete this e-mail
immediately.
> > > >
> > > >
> > >
> > >
> > >
> > > --
> > > Julie Prestopnik
> > > National Center for Atmospheric Research
> > > Research Applications Laboratory
> > > Phone: 303.497.8399
> > > Email: jpresto at ucar.edu
> > >
> > > This e-mail, including attachments, may include confidential
and/or
> > > proprietary information, and may be used only by the person or
entity
> to
> > > which it is addressed. If the reader of this e-mail is not the
intended
> > > recipient or his or her authorized agent, the reader is hereby
notified
> > > that any dissemination, distribution or copying of this e-mail
is
> > > prohibited. If you have received this e-mail in error, please
notify
> the
> > > sender by replying to this message and delete this e-mail
immediately.
> > >
> > >
> > >
> >
> >
> > --
> > Julie Prestopnik
> > National Center for Atmospheric Research
> > Research Applications Laboratory
> > Phone: 303.497.8399
> > Email: jpresto at ucar.edu
> >
> > This e-mail, including attachments, may include confidential
and/or
> > proprietary information, and may be used only by the person or
entity to
> > which it is addressed. If the reader of this e-mail is not the
intended
> > recipient or his or her authorized agent, the reader is hereby
notified
> > that any dissemination, distribution or copying of this e-mail is
> > prohibited. If you have received this e-mail in error, please
notify the
> > sender by replying to this message and delete this e-mail
immediately.
> >
> >
> >
>
> This e-mail, including attachments, may include confidential and/or
> proprietary information, and may be used only by the person or
entity to
> which it is addressed. If the reader of this e-mail is not the
intended
> recipient or his or her authorized agent, the reader is hereby
notified
> that any dissemination, distribution or copying of this e-mail is
> prohibited. If you have received this e-mail in error, please notify
the
> sender by replying to this message and delete this e-mail
immediately.
>
>
>
--
Julie Prestopnik
National Center for Atmospheric Research
Research Applications Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
This e-mail, including attachments, may include confidential and/or
proprietary information, and may be used only by the person or entity
to which it is addressed. If the reader of this e-mail is not the
intended recipient or his or her authorized agent, the reader is
hereby notified that any dissemination, distribution or copying of
this e-mail is prohibited. If you have received this e-mail in error,
please notify the sender by replying to this message and delete this
e-mail immediately.
------------------------------------------------
Subject: Trouble running radar NETCDF file for grid_stat verifiction
From: Jose Garcia-Rivera
Time: Tue Sep 13 09:20:47 2016
Dear Julie, John
The commands worked fine. Thank you so much!
Now, there's something that is puzzling us. The radar data from the
grid_stat.nc output file seems to be flipped upside-down. I attached
the MET-produced OBS vs the original OBS. Is this an artifact of
grid_stat, or how can it be fixed?
Best Regards,
Jose
________________________________________
From: Julie Prestopnik via RT <met_help at ucar.edu>
Sent: Friday, September 9, 2016 4:07 PM
To: Jose Garcia-Rivera
Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar NETCDF
file for grid_stat verifiction
Hi Jose.
As John indicated the problem lies in that currently MET only supports
the
classic data model... i.e. NetCDF3, which the file RadarObsNEW.nc is
not.
Running "file RadarObsNEW.nc" shows that the file is not "NetCDF Data
Format data", but rather:
RadarObsNEW.nc: Hierarchical Data Format (version 5) data
You can create a NetCDF3 file when you create the file or you can use
the
"nccopy" command. However, "nccopy" didn't work with the
RadarObsNEW.nc
file, until we made some changes. We used "ncatted" to remove the "L"
from
the value of the following attributes: parameter_table_version,
parameter_number, level_indicator, nx, and ny. I'll paste in the
commands
that we used to create a NetCDF3 file, plot the data, and get a
successful
run from grid_stat.
# Update attributes to remove longs
/usr/local/nco/bin/ncatted \
-a parameter_table_version,REFC,o,f,129 \
-a parameter_number,REFC,o,f,212 \
-a level_indicator,REFC,o,f,200 \
-a nx,global,o,i,674 \
-a ny,global,o,i,620 \
RadarObsNEW.nc RadarObsNEW_mod.nc
# Convert from NC4 to NC3
/usr/local/netcdf/bin/nccopy -3 RadarObsNEW_mod.nc
RadarObsNEW_mod_v3.nc
# Regrid to global grid
/usr/local/met-5.2/bin/regrid_data_plane \
RadarObsNEW_mod_v3.nc G004 RadarObsNEW_mod_v3_G004.nc \
-field 'name="REFC"; level="(*,*)";'
# Plot the result
/usr/local/met-5.2/bin/plot_data_plane \
RadarObsNEW_mod_v3_G004.nc RadarObsNEW_mod_v3_G004.ps \
'name="REFC"; level="(*,*)";'
# Display plot
convert -rotate 90 -background white -flatten
RadarObsNEW_mod_v3_G004.ps
RadarObsNEW_mod_v3_G004.png
display RadarObsNEW_mod_v3_G004.png&
# Plot forecast REFC
/usr/local/met-5.2/bin/plot_data_plane \
ForecastFile.grb refc_fcst.ps \
'name="REFC"; level="L0"; GRIB1_ptv=129;'
# Display plot
convert -rotate 90 -background white -flatten refc_fcst.ps
refc_fcst.png
display refc_fcst.png&
# Run grid_stat
/usr/local/met-5.1/bin/grid_stat ForecastFile.grb
RadarObsNEW_mod_v3.nc
GridStatConfig_dbz -outdir out/
I have also attached the NetCDF3 file that we produced after using
ncatted
and nccopy.
Please let us know if you have any other questions.
Thanks,
Julie
On Fri, Sep 9, 2016 at 12:43 PM, Jose Garcia-Rivera via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
>
> Hi John,
>
> Glad to talk to you again. We did the proposed changes, and the
error
> keeps showing up.
>
> I uploaded the new file as: RadarObsNEW.nc
>
> Please try to run it and let me know what issues show up?
>
> Thanks for the help,
> Jose
> ________________________________________
> From: John Halley Gotway via RT <met_help at ucar.edu>
> Sent: Friday, September 9, 2016 2:17 PM
> To: Jose Garcia-Rivera
> Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar NETCDF
file
> for grid_stat verifiction
>
> Hello Jose,
>
> This is John Halley Gotway. I work with Julie on providing support
for
> MET.
>
> I think there's a few pieces of info we're missing here.
>
> (1) MET does not currently support the enhanced data model of
NetCDF4. It
> only supports the classic data model... i.e. NetCDF3. In the next
version
> of MET (6.0), due out next year, we'll be adding support for
NetCDF4. The
> file you sent us in NetCDF4 but when Julie add those attributes she
may
> have used ncdump/ncgen. And their output is NetCDF3. Try updating
your
> NCL script to write a "classic" NetCDF file.
>
> (2) Yes, the "MET_version" global attribute needs to be present.
That
> tells MET how to parse the grid information.
>
> (3) I'm not sure that the variable "name" attribute is necessary,
but it
> doesn't hurt.
>
> (4) The biggest problem is in the definition of your Mercator grid:
> :Projection = "Mercator" ;
> :lat_ll = "3348550.177 degrees_north" ;
> :lon_ll = "13120540.425 degrees_east" ;
> :lat_ur = "4057346.9 degrees_north" ;
> :lon_ur = "13891071.057 degrees_east" ;
>
> Those don't look like very meaningful lat/lon values! Where did you
get
> these numbers? Are they meant to match the grid defined in the GRIB
file
> you sent us?
>
> Thanks,
> John
>
> On Fri, Sep 9, 2016 at 12:08 PM, Jose Garcia-Rivera via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
> >
> > Dear Julie,
> >
> > The file that you modified worked. However, we did the changes you
made,
> > and grid_stat continues to show the same error.
> >
> > I've uploaded the file in the same FTP directory, named:
> > Hongqiao.Refl.20150602.s100000.e100500.attributes.nc
> >
> > This is a file dump of our modified netcdf:
> >
> > NCAR Command Language Version 6.3.0
> > The use of this software is governed by a License Agreement.
> > See http://www.ncl.ucar.edu/ for more details.
> >
> > Variable: f
> > Type: file
> > filename: Hongqiao.Refl.20150602.s100000.e100500.attributes
> > path: Hongqiao.Refl.20150602.s100000.e100500.attributes.nc
> > Number of Attributes:8
> > MET_version : V5.1
> > Projection : Mercator
> > lat_ll : 3348550.177 degrees_north
> > lon_ll : 13120540.425 degrees_east
> > lat_ur : 4057346.9 degrees_north
> > lon_ur : 13891071.057 degrees_east
> > nx : 674
> > ny : 620
> >
> > dimensions:
> > lon = 674
> > lat = 620
> >
> > variables:
> > Variable: lat
> > Type: float
> > Total Size: 417880 values
> > 1671520 bytes
> > Number of Dimensions: 2
> > Dimensions and sizes: [ 620 <lat> x 674 <lon> ]
> > Coordinates:
> > lat: [4057347..4057347]
> > lon: [1.312054e+07..1.388993e+07]
> > Number of Attributes: 2
> > units : degrees_north
> > standard_name : latitude
> >
> > Variable: lon
> > Type: float
> > Total Size: 417880 values
> > 1671520 bytes
> > Number of Dimensions: 2
> > Dimensions and sizes: [ 620 <lat> x 674 <lon> ]
> > Coordinates:
> > lat: [4057347..4057347]
> > lon: [1.312054e+07..1.388993e+07]
> > Number of Attributes: 2
> > units : degrees_east
> > standard_name : longitude
> >
> > Variable: REFC
> > Type: float
> > Total Size: 417880 values
> > 1671520 bytes
> > Number of Dimensions: 2
> > Dimensions and sizes: [ 620 <lat> x 674 <lon> ]
> > Coordinates:
> > lat: [4057347..4057347]
> > lon: [1.312054e+07..1.388993e+07]
> > Number of Attributes: 11
> > name : REFC
> > units : dbZ
> > parameter_table_version : 129
> > parameter_number : 212
> > level_indicator : 200
> > level : L0
> > long_name : MaxReflectivity
> > init_time : 20050807_000000
> > init_time_ut : 1123372800
> > valid_time : 20050807_120000
> > valid_time_ut : 1123416000
> >
> >
> >
> > Best Regards,
> > Jose
> >
> >
> > ________________________________________
> > From: Julie Prestopnik via RT <met_help at ucar.edu>
> > Sent: Friday, September 9, 2016 1:09 PM
> > To: Jose Garcia-Rivera
> > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar NETCDF
file
> > for grid_stat verifiction
> >
> > Hi Jose. Thank you for uploading your data. There were two
important
> > things missing from your file.
> >
> > I added:
> >
> > REFC:name = "REFC" ;
> >
> > under:
> >
> > float REFC(lat, lon) ;
> >
> > and I added:
> >
> > :MET_version = "V5.1" ;
> >
> > under // global attributes:
> >
> > and was able to get a successful run of grid_stat.
> >
> > I am attaching the file with the changes. Please give it a try
and let
> me
> > know if you get a successful run as well.
> >
> > Thanks,
> > Julie
> >
> > On Fri, Sep 9, 2016 at 10:38 AM, Jose Garcia-Rivera via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
> > >
> > > Dear Julie,
> > >
> > > We used the Mercator example, and ours looks identical to yours.
I
> > > proceeded and put 4 files into your FTP server:
> > >
> > > Model forecast file
> > > Radar Obs file
> > > Grid Stat Config file
> > > domain.poly file
> > >
> > > The files are under 'garcia_data'
> > >
> > >
> > > Thanks so much for your help,
> > > Jose
> > > ________________________________________
> > > From: Julie Prestopnik via RT <met_help at ucar.edu>
> > > Sent: Friday, September 9, 2016 11:50 AM
> > > To: Jose Garcia-Rivera
> > > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar
NETCDF
> file
> > > for grid_stat verifiction
> > >
> > > Hi Jose. I have attached a Mercator projection example. If
you're
> > > still stuck, please post your data to our
> > > anonymous FTP site following these instructions:
> > > http://www.dtcenter.org/met/users/support/met_help.php#ftp
> > >
> > > Thanks,
> > > Julie
> > >
> > >
> > > On Thu, Sep 8, 2016 at 3:25 PM, Jose Garcia-Rivera via RT
> > > <met_help at ucar.edu> wrote:
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823
>
> > > >
> > > > Dear Julie,
> > > >
> > > > That's very good information, thanks. We've been working on
this
> issue,
> > > however the same error keeps showing up.
> > > >
> > > > Can we get a Mercator projection example?
> > > >
> > > > I was wondering if you could have a peek into our netcdf file,
or run
> > an
> > > internal test to see what needs to be changed, or what may be
wrong. In
> > the
> > > meantime, we continue working on trying to make the file fit MET
> > > requirements.
> > > >
> > > > Thanks for the help,
> > > > Jose
> > > >
> > > > ________________________________________
> > > > From: Julie Prestopnik via RT <met_help at ucar.edu>
> > > > Sent: Thursday, September 8, 2016 3:57 PM
> > > > To: Jose Garcia-Rivera
> > > > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar
NETCDF
> > file
> > > for grid_stat verifiction
> > > >
> > > > Hi Jose.
> > > >
> > > > Unfortunately, we do not have a radar obs netcdf example file.
With
> > > > NetCDF, users have two choices:
> > > > --make it look like the NetCDF files that MET generates (i.e.
the
> > > > output of pcp_combine) or
> > > > --put it into CF-compliant NetCDF
> > > > The variable can be named "radar_obs" or "precip" or anything
you'd
> > like.
> > > >
> > > > Julie
> > > >
> > > >
> > > > On Thu, Sep 8, 2016 at 12:10 PM, Jose Garcia-Rivera via RT
> > > > <met_help at ucar.edu> wrote:
> > > >>
> > > >> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823
>
> > > >>
> > > >> Dear Julie,
> > > >>
> > > >> Thanks so much for the file. We haven't been able to work on
it yet,
> > > since we are fixing computer issues. One more question, do you
have a
> > radar
> > > obs netcdf example file?
> > > >>
> > > >> Best Regards,
> > > >> Jose
> > > >>
> > > >> From: Julie Prestopnik via RT <met_help at ucar.edu>
> > > >> Sent: Thursday, September 8, 2016 12:58 PM
> > > >> To: Jose Garcia-Rivera
> > > >> Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar
NETCDF
> > > file for grid_stat verifiction
> > > >>
> > > >> My apologies. I meant to attach the file in my last email.
You
> can
> > > >> find it attached to this one.
> > > >>
> > > >> Thanks,
> > > >> Julie
> > > >>
> > > >> On Thu, Sep 8, 2016 at 10:36 AM, Jose Garcia-Rivera via RT
> > > >> <met_help at ucar.edu> wrote:
> > > >>>
> > > >>> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
> > > >>>
> > > >>> Dear Julie,
> > > >>>
> > > >>> Thanks for the helpful response. Can I have an example file
from
> the
> > > pcp_combine tool for reference?
> > > >>>
> > > >>> Best Regards,
> > > >>> Jose
> > > >>> ________________________________________
> > > >>> From: Julie Prestopnik via RT <met_help at ucar.edu>
> > > >>> Sent: Thursday, September 8, 2016 11:57 AM
> > > >>> To: Jose Garcia-Rivera
> > > >>> Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar
NETCDF
> > > file for grid_stat verifiction
> > > >>>
> > > >>> Hi Jose.
> > > >>>
> > > >>> I see that you are running MET 5.1, but are unsure of how
the
> NetCDF
> > > >>> files should be formatted in order for GridStat to be able
to read
> > > >>> them.
> > > >>>
> > > >>> In order it use gridded NetCDF files in MET, you'll need to
make
> them
> > > >>> look like the output of the pcp_combine tool.
> > > >>>
> > > >>> Listed below is the header from one of the NetCDF files from
> > > >>> pcp_combine created by the METv5.1 test scripts. Here are
the
> > > >>> required parts.
> > > >>>
> > > >>> (1) dimensions should be named "lat" and "lon"
> > > >>> (2) the "lat" and "lon" variable are **NOT** required
> > > >>> (3) gridded variables (e.g. APCP_12) must use the "lat"
and "lon"
> > > dimensions
> > > >>> (4) gridded variables should include the attributes listed
in the
> > > >>> example (for timing info, only the init_time_ut,
valid_time_ut, and
> > > >>> accum_time_sec are actually used. "ut" stands for unix
time, the
> > > >>> number of seconds since Jan 1, 1970).
> > > >>> (5) global attributes should include the grid/projection
> > > >>> information. This example shows how they're specified for a
> lambert
> > > >>> conformal projection. Let me know if you're using a
different
> > > >>> projection and I'll send you an example.
> > > >>>
> > > >>> I hope that helps get you going.
> > > >>>
> > > >>> Julie
> > > >>>
> > > >>>
> > > >>>
> > > >>> On Wed, Sep 7, 2016 at 3:15 PM, Jose Garcia-Rivera via RT
> > > >>> <met_help at ucar.edu> wrote:
> > > >>>>
> > > >>>> Wed Sep 07 15:15:39 2016: Request 77823 was acted upon.
> > > >>>> Transaction: Ticket created by GarciaJ at imsg.com
> > > >>>> Queue: met_help
> > > >>>> Subject: Trouble running radar NETCDF file for
grid_stat
> > > verifiction
> > > >>>> Owner: Nobody
> > > >>>> Requestors: GarciaJ at imsg.com
> > > >>>> Status: new
> > > >>>> Ticket <URL: https://rt.rap.ucar.edu/rt/
> > Ticket/Display.html?id=77823
> > > >
> > > >>>>
> > > >>>>
> > > >>>> Dear Met Help,
> > > >>>>
> > > >>>>
> > > >>>> I've been trying to run MET using a radar NETCDF file, and
an NMMB
> > > model forecast GRIB file, but the following error shows up:
> > > >>>>
> > > >>>>
> > > >>>> DEBUG 1: Default Config File: /work/apps/pgi_14.10/SANDY/
> > > met-5.1/share/met/config/GridStatConfig_default
> > > >>>> DEBUG 1: User Config File: GridStatConfig_dbz
> > > >>>> ERROR :
> > > >>>> ERROR : Trouble reading observation file
"Hongqiao.Refl.20150602.
> > > s100000.e100500.attributes.nc"
> > > >>>> ERROR :
> > > >>>>
> > > >>>> We used two versions of the OBS file, one as it was, and
the
> second
> > > with added "attributes". Still, the same error occurred. We are
not
> sure
> > on
> > > exactly how our NETCDF files need to be for MET to be able to
read
> them.
> > I
> > > searched the error message on the Guide and nothing showed up.
> > > >>>>
> > > >>>> We can share the files to your FTP if you want to run them.
> > > >>>>
> > > >>>> Any help will be greatly appreciated.
> > > >>>>
> > > >>>>
> > > >>>>
> > > >>>> NOTE: We are using MET 5.1
> > > >>>>
> > > >>>>
> > > >>>> Best Regards,
> > > >>>>
> > > >>>> Jose
> > > >>>>
> > > >>>>
> > > >>>>
> > > >>>>
> > > >>>> Jose M. Garcia-Rivera, PhD
> > > >>>>
> > > >>>> Atmospheric Scientist
> > > >>>>
> > > >>>> IM Systems Group
> > > >>>>
> > > >>>> Rockville/College Park, MD
> > > >>>>
> > > >>>> This e-mail, including attachments, may include
confidential
> and/or
> > > proprietary information, and may be used only by the person or
entity
> to
> > > which it is addressed. If the reader of this e-mail is not the
intended
> > > recipient or his or her authorized agent, the reader is hereby
notified
> > > that any dissemination, distribution or copying of this e-mail
is
> > > prohibited. If you have received this e-mail in error, please
notify
> the
> > > sender by replying to this message and delete this e-mail
immediately.
> > > >>>>
> > > >>>>
> > > >>>
> > > >>>
> > > >>>
> > > >>> --
> > > >>> Julie Prestopnik
> > > >>> National Center for Atmospheric Research
> > > >>> Research Applications Laboratory
> > > >>> Phone: 303.497.8399
> > > >>> Email: jpresto at ucar.edu
> > > >>>
> > > >>>
> > > >>> This e-mail, including attachments, may include confidential
and/or
> > > proprietary information, and may be used only by the person or
entity
> to
> > > which it is addressed. If the reader of this e-mail is not the
intended
> > > recipient or his or her authorized agent, the reader is hereby
notified
> > > that any dissemination, distribution or copying of this e-mail
is
> > > prohibited. If you have received this e-mail in error, please
notify
> the
> > > sender by replying to this message and delete this e-mail
immediately.
> > > >>>
> > > >>>
> > > >>
> > > >>
> > > >>
> > > >> --
> > > >> Julie Prestopnik
> > > >> National Center for Atmospheric Research
> > > >> Research Applications Laboratory
> > > >> Phone: 303.497.8399
> > > >> Email: jpresto at ucar.edu
> > > >>
> > > >> This e-mail, including attachments, may include confidential
and/or
> > > proprietary information, and may be used only by the person or
entity
> to
> > > which it is addressed. If the reader of this e-mail is not the
intended
> > > recipient or his or her authorized agent, the reader is hereby
notified
> > > that any dissemination, distribution or copying of this e-mail
is
> > > prohibited. If you have received this e-mail in error, please
notify
> the
> > > sender by replying to this message and delete this e-mail
immediately.
> > > >>
> > > >>
> > > >
> > > >
> > > >
> > > > --
> > > > Julie Prestopnik
> > > > National Center for Atmospheric Research
> > > > Research Applications Laboratory
> > > > Phone: 303.497.8399
> > > > Email: jpresto at ucar.edu
> > > >
> > > >
> > > > This e-mail, including attachments, may include confidential
and/or
> > > proprietary information, and may be used only by the person or
entity
> to
> > > which it is addressed. If the reader of this e-mail is not the
intended
> > > recipient or his or her authorized agent, the reader is hereby
notified
> > > that any dissemination, distribution or copying of this e-mail
is
> > > prohibited. If you have received this e-mail in error, please
notify
> the
> > > sender by replying to this message and delete this e-mail
immediately.
> > > >
> > > >
> > >
> > >
> > >
> > > --
> > > Julie Prestopnik
> > > National Center for Atmospheric Research
> > > Research Applications Laboratory
> > > Phone: 303.497.8399
> > > Email: jpresto at ucar.edu
> > >
> > > This e-mail, including attachments, may include confidential
and/or
> > > proprietary information, and may be used only by the person or
entity
> to
> > > which it is addressed. If the reader of this e-mail is not the
intended
> > > recipient or his or her authorized agent, the reader is hereby
notified
> > > that any dissemination, distribution or copying of this e-mail
is
> > > prohibited. If you have received this e-mail in error, please
notify
> the
> > > sender by replying to this message and delete this e-mail
immediately.
> > >
> > >
> > >
> >
> >
> > --
> > Julie Prestopnik
> > National Center for Atmospheric Research
> > Research Applications Laboratory
> > Phone: 303.497.8399
> > Email: jpresto at ucar.edu
> >
> > This e-mail, including attachments, may include confidential
and/or
> > proprietary information, and may be used only by the person or
entity to
> > which it is addressed. If the reader of this e-mail is not the
intended
> > recipient or his or her authorized agent, the reader is hereby
notified
> > that any dissemination, distribution or copying of this e-mail is
> > prohibited. If you have received this e-mail in error, please
notify the
> > sender by replying to this message and delete this e-mail
immediately.
> >
> >
> >
>
> This e-mail, including attachments, may include confidential and/or
> proprietary information, and may be used only by the person or
entity to
> which it is addressed. If the reader of this e-mail is not the
intended
> recipient or his or her authorized agent, the reader is hereby
notified
> that any dissemination, distribution or copying of this e-mail is
> prohibited. If you have received this e-mail in error, please notify
the
> sender by replying to this message and delete this e-mail
immediately.
>
>
>
--
Julie Prestopnik
National Center for Atmospheric Research
Research Applications Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
This e-mail, including attachments, may include confidential and/or
proprietary information, and may be used only by the person or entity
to which it is addressed. If the reader of this e-mail is not the
intended recipient or his or her authorized agent, the reader is
hereby notified that any dissemination, distribution or copying of
this e-mail is prohibited. If you have received this e-mail in error,
please notify the sender by replying to this message and delete this
e-mail immediately.
------------------------------------------------
Subject: Trouble running radar NETCDF file for grid_stat verifiction
From: Julie Prestopnik
Time: Tue Sep 13 11:20:40 2016
Hi Jose.
When I plot the NetCDF3 obs file that we created using nccopy
(RadarObsNEW_mod_v3.nc) using plot_data_plane:
/usr/local/met-5.2/bin/plot_data_plane RadarObsNEW_mod_v3.nc
RadarObsNEW_mod_v3.ps 'name="REFC"; level="(*,*)";'
The resulting image, RadarObsNEW_mod_v3.ps (attached), appears to be
oriented in the same way as the met_OBS.png image that you attached,
so I
don't believe that grid_stat is doing anything to the data, but rather
that
the data was placed into the original NetCDF Obs data and needs to be
re-oriented there.
Please let me know if you find that is not the case. Please try
running
plot_data_plane on the data that produced the radar_OBS.png file and
see if
you get the same result.
Thanks,
Julie
On Tue, Sep 13, 2016 at 9:20 AM, Jose Garcia-Rivera via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
>
> Dear Julie, John
>
> The commands worked fine. Thank you so much!
>
> Now, there's something that is puzzling us. The radar data from the
> grid_stat.nc output file seems to be flipped upside-down. I attached
the
> MET-produced OBS vs the original OBS. Is this an artifact of
grid_stat, or
> how can it be fixed?
>
>
>
> Best Regards,
> Jose
>
> ________________________________________
> From: Julie Prestopnik via RT <met_help at ucar.edu>
> Sent: Friday, September 9, 2016 4:07 PM
> To: Jose Garcia-Rivera
> Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar NETCDF
file
> for grid_stat verifiction
>
> Hi Jose.
>
> As John indicated the problem lies in that currently MET only
supports the
> classic data model... i.e. NetCDF3, which the file RadarObsNEW.nc is
not.
>
> Running "file RadarObsNEW.nc" shows that the file is not "NetCDF
Data
> Format data", but rather:
>
> RadarObsNEW.nc: Hierarchical Data Format (version 5) data
>
> You can create a NetCDF3 file when you create the file or you can
use the
> "nccopy" command. However, "nccopy" didn't work with the
RadarObsNEW.nc
> file, until we made some changes. We used "ncatted" to remove the
"L" from
> the value of the following attributes: parameter_table_version,
> parameter_number, level_indicator, nx, and ny. I'll paste in the
commands
> that we used to create a NetCDF3 file, plot the data, and get a
successful
> run from grid_stat.
>
> # Update attributes to remove longs
> /usr/local/nco/bin/ncatted \
> -a parameter_table_version,REFC,o,f,129 \
> -a parameter_number,REFC,o,f,212 \
> -a level_indicator,REFC,o,f,200 \
> -a nx,global,o,i,674 \
> -a ny,global,o,i,620 \
> RadarObsNEW.nc RadarObsNEW_mod.nc
>
> # Convert from NC4 to NC3
> /usr/local/netcdf/bin/nccopy -3 RadarObsNEW_mod.nc
RadarObsNEW_mod_v3.nc
>
> # Regrid to global grid
> /usr/local/met-5.2/bin/regrid_data_plane \
> RadarObsNEW_mod_v3.nc G004 RadarObsNEW_mod_v3_G004.nc \
> -field 'name="REFC"; level="(*,*)";'
>
> # Plot the result
> /usr/local/met-5.2/bin/plot_data_plane \
> RadarObsNEW_mod_v3_G004.nc RadarObsNEW_mod_v3_G004.ps \
> 'name="REFC"; level="(*,*)";'
>
> # Display plot
> convert -rotate 90 -background white -flatten
RadarObsNEW_mod_v3_G004.ps
> RadarObsNEW_mod_v3_G004.png
> display RadarObsNEW_mod_v3_G004.png&
>
> # Plot forecast REFC
> /usr/local/met-5.2/bin/plot_data_plane \
> ForecastFile.grb refc_fcst.ps \
> 'name="REFC"; level="L0"; GRIB1_ptv=129;'
>
> # Display plot
> convert -rotate 90 -background white -flatten refc_fcst.ps
refc_fcst.png
> display refc_fcst.png&
>
> # Run grid_stat
> /usr/local/met-5.1/bin/grid_stat ForecastFile.grb
RadarObsNEW_mod_v3.nc
> GridStatConfig_dbz -outdir out/
>
> I have also attached the NetCDF3 file that we produced after using
ncatted
> and nccopy.
>
> Please let us know if you have any other questions.
>
> Thanks,
> Julie
>
>
> On Fri, Sep 9, 2016 at 12:43 PM, Jose Garcia-Rivera via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
> >
> > Hi John,
> >
> > Glad to talk to you again. We did the proposed changes, and the
error
> > keeps showing up.
> >
> > I uploaded the new file as: RadarObsNEW.nc
> >
> > Please try to run it and let me know what issues show up?
> >
> > Thanks for the help,
> > Jose
> > ________________________________________
> > From: John Halley Gotway via RT <met_help at ucar.edu>
> > Sent: Friday, September 9, 2016 2:17 PM
> > To: Jose Garcia-Rivera
> > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar NETCDF
file
> > for grid_stat verifiction
> >
> > Hello Jose,
> >
> > This is John Halley Gotway. I work with Julie on providing
support for
> > MET.
> >
> > I think there's a few pieces of info we're missing here.
> >
> > (1) MET does not currently support the enhanced data model of
NetCDF4.
> It
> > only supports the classic data model... i.e. NetCDF3. In the next
> version
> > of MET (6.0), due out next year, we'll be adding support for
NetCDF4.
> The
> > file you sent us in NetCDF4 but when Julie add those attributes
she may
> > have used ncdump/ncgen. And their output is NetCDF3. Try
updating your
> > NCL script to write a "classic" NetCDF file.
> >
> > (2) Yes, the "MET_version" global attribute needs to be present.
That
> > tells MET how to parse the grid information.
> >
> > (3) I'm not sure that the variable "name" attribute is necessary,
but it
> > doesn't hurt.
> >
> > (4) The biggest problem is in the definition of your Mercator
grid:
> > :Projection = "Mercator" ;
> > :lat_ll = "3348550.177 degrees_north" ;
> > :lon_ll = "13120540.425 degrees_east" ;
> > :lat_ur = "4057346.9 degrees_north" ;
> > :lon_ur = "13891071.057 degrees_east" ;
> >
> > Those don't look like very meaningful lat/lon values! Where did
you get
> > these numbers? Are they meant to match the grid defined in the
GRIB file
> > you sent us?
> >
> > Thanks,
> > John
> >
> > On Fri, Sep 9, 2016 at 12:08 PM, Jose Garcia-Rivera via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
> > >
> > > Dear Julie,
> > >
> > > The file that you modified worked. However, we did the changes
you
> made,
> > > and grid_stat continues to show the same error.
> > >
> > > I've uploaded the file in the same FTP directory, named:
> > > Hongqiao.Refl.20150602.s100000.e100500.attributes.nc
> > >
> > > This is a file dump of our modified netcdf:
> > >
> > > NCAR Command Language Version 6.3.0
> > > The use of this software is governed by a License Agreement.
> > > See http://www.ncl.ucar.edu/ for more details.
> > >
> > > Variable: f
> > > Type: file
> > > filename:
Hongqiao.Refl.20150602.s100000.e100500.attributes
> > > path: Hongqiao.Refl.20150602.s100000.e100500.attributes.nc
> > > Number of Attributes:8
> > > MET_version : V5.1
> > > Projection : Mercator
> > > lat_ll : 3348550.177 degrees_north
> > > lon_ll : 13120540.425 degrees_east
> > > lat_ur : 4057346.9 degrees_north
> > > lon_ur : 13891071.057 degrees_east
> > > nx : 674
> > > ny : 620
> > >
> > > dimensions:
> > > lon = 674
> > > lat = 620
> > >
> > > variables:
> > > Variable: lat
> > > Type: float
> > > Total Size: 417880 values
> > > 1671520 bytes
> > > Number of Dimensions: 2
> > > Dimensions and sizes: [ 620 <lat> x 674 <lon> ]
> > > Coordinates:
> > > lat: [4057347..4057347]
> > > lon: [1.312054e+07..1.388993e+07]
> > > Number of Attributes: 2
> > > units : degrees_north
> > > standard_name : latitude
> > >
> > > Variable: lon
> > > Type: float
> > > Total Size: 417880 values
> > > 1671520 bytes
> > > Number of Dimensions: 2
> > > Dimensions and sizes: [ 620 <lat> x 674 <lon> ]
> > > Coordinates:
> > > lat: [4057347..4057347]
> > > lon: [1.312054e+07..1.388993e+07]
> > > Number of Attributes: 2
> > > units : degrees_east
> > > standard_name : longitude
> > >
> > > Variable: REFC
> > > Type: float
> > > Total Size: 417880 values
> > > 1671520 bytes
> > > Number of Dimensions: 2
> > > Dimensions and sizes: [ 620 <lat> x 674 <lon> ]
> > > Coordinates:
> > > lat: [4057347..4057347]
> > > lon: [1.312054e+07..1.388993e+07]
> > > Number of Attributes: 11
> > > name : REFC
> > > units : dbZ
> > > parameter_table_version : 129
> > > parameter_number : 212
> > > level_indicator : 200
> > > level : L0
> > > long_name : MaxReflectivity
> > > init_time : 20050807_000000
> > > init_time_ut : 1123372800
> > > valid_time : 20050807_120000
> > > valid_time_ut : 1123416000
> > >
> > >
> > >
> > > Best Regards,
> > > Jose
> > >
> > >
> > > ________________________________________
> > > From: Julie Prestopnik via RT <met_help at ucar.edu>
> > > Sent: Friday, September 9, 2016 1:09 PM
> > > To: Jose Garcia-Rivera
> > > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar
NETCDF
> file
> > > for grid_stat verifiction
> > >
> > > Hi Jose. Thank you for uploading your data. There were two
important
> > > things missing from your file.
> > >
> > > I added:
> > >
> > > REFC:name = "REFC" ;
> > >
> > > under:
> > >
> > > float REFC(lat, lon) ;
> > >
> > > and I added:
> > >
> > > :MET_version = "V5.1" ;
> > >
> > > under // global attributes:
> > >
> > > and was able to get a successful run of grid_stat.
> > >
> > > I am attaching the file with the changes. Please give it a try
and let
> > me
> > > know if you get a successful run as well.
> > >
> > > Thanks,
> > > Julie
> > >
> > > On Fri, Sep 9, 2016 at 10:38 AM, Jose Garcia-Rivera via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823
>
> > > >
> > > > Dear Julie,
> > > >
> > > > We used the Mercator example, and ours looks identical to
yours. I
> > > > proceeded and put 4 files into your FTP server:
> > > >
> > > > Model forecast file
> > > > Radar Obs file
> > > > Grid Stat Config file
> > > > domain.poly file
> > > >
> > > > The files are under 'garcia_data'
> > > >
> > > >
> > > > Thanks so much for your help,
> > > > Jose
> > > > ________________________________________
> > > > From: Julie Prestopnik via RT <met_help at ucar.edu>
> > > > Sent: Friday, September 9, 2016 11:50 AM
> > > > To: Jose Garcia-Rivera
> > > > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar
NETCDF
> > file
> > > > for grid_stat verifiction
> > > >
> > > > Hi Jose. I have attached a Mercator projection example. If
you're
> > > > still stuck, please post your data to our
> > > > anonymous FTP site following these instructions:
> > > > http://www.dtcenter.org/met/users/support/met_help.php#ftp
> > > >
> > > > Thanks,
> > > > Julie
> > > >
> > > >
> > > > On Thu, Sep 8, 2016 at 3:25 PM, Jose Garcia-Rivera via RT
> > > > <met_help at ucar.edu> wrote:
> > > > >
> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
> > > > >
> > > > > Dear Julie,
> > > > >
> > > > > That's very good information, thanks. We've been working on
this
> > issue,
> > > > however the same error keeps showing up.
> > > > >
> > > > > Can we get a Mercator projection example?
> > > > >
> > > > > I was wondering if you could have a peek into our netcdf
file, or
> run
> > > an
> > > > internal test to see what needs to be changed, or what may be
wrong.
> In
> > > the
> > > > meantime, we continue working on trying to make the file fit
MET
> > > > requirements.
> > > > >
> > > > > Thanks for the help,
> > > > > Jose
> > > > >
> > > > > ________________________________________
> > > > > From: Julie Prestopnik via RT <met_help at ucar.edu>
> > > > > Sent: Thursday, September 8, 2016 3:57 PM
> > > > > To: Jose Garcia-Rivera
> > > > > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar
NETCDF
> > > file
> > > > for grid_stat verifiction
> > > > >
> > > > > Hi Jose.
> > > > >
> > > > > Unfortunately, we do not have a radar obs netcdf example
file.
> With
> > > > > NetCDF, users have two choices:
> > > > > --make it look like the NetCDF files that MET generates
(i.e. the
> > > > > output of pcp_combine) or
> > > > > --put it into CF-compliant NetCDF
> > > > > The variable can be named "radar_obs" or "precip" or
anything you'd
> > > like.
> > > > >
> > > > > Julie
> > > > >
> > > > >
> > > > > On Thu, Sep 8, 2016 at 12:10 PM, Jose Garcia-Rivera via RT
> > > > > <met_help at ucar.edu> wrote:
> > > > >>
> > > > >> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
> > > > >>
> > > > >> Dear Julie,
> > > > >>
> > > > >> Thanks so much for the file. We haven't been able to work
on it
> yet,
> > > > since we are fixing computer issues. One more question, do you
have a
> > > radar
> > > > obs netcdf example file?
> > > > >>
> > > > >> Best Regards,
> > > > >> Jose
> > > > >>
> > > > >> From: Julie Prestopnik via RT <met_help at ucar.edu>
> > > > >> Sent: Thursday, September 8, 2016 12:58 PM
> > > > >> To: Jose Garcia-Rivera
> > > > >> Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar
> NETCDF
> > > > file for grid_stat verifiction
> > > > >>
> > > > >> My apologies. I meant to attach the file in my last email.
You
> > can
> > > > >> find it attached to this one.
> > > > >>
> > > > >> Thanks,
> > > > >> Julie
> > > > >>
> > > > >> On Thu, Sep 8, 2016 at 10:36 AM, Jose Garcia-Rivera via RT
> > > > >> <met_help at ucar.edu> wrote:
> > > > >>>
> > > > >>> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
> > > > >>>
> > > > >>> Dear Julie,
> > > > >>>
> > > > >>> Thanks for the helpful response. Can I have an example
file from
> > the
> > > > pcp_combine tool for reference?
> > > > >>>
> > > > >>> Best Regards,
> > > > >>> Jose
> > > > >>> ________________________________________
> > > > >>> From: Julie Prestopnik via RT <met_help at ucar.edu>
> > > > >>> Sent: Thursday, September 8, 2016 11:57 AM
> > > > >>> To: Jose Garcia-Rivera
> > > > >>> Subject: Re: [rt.rap.ucar.edu #77823] Trouble running
radar
> NETCDF
> > > > file for grid_stat verifiction
> > > > >>>
> > > > >>> Hi Jose.
> > > > >>>
> > > > >>> I see that you are running MET 5.1, but are unsure of how
the
> > NetCDF
> > > > >>> files should be formatted in order for GridStat to be able
to
> read
> > > > >>> them.
> > > > >>>
> > > > >>> In order it use gridded NetCDF files in MET, you'll need
to make
> > them
> > > > >>> look like the output of the pcp_combine tool.
> > > > >>>
> > > > >>> Listed below is the header from one of the NetCDF files
from
> > > > >>> pcp_combine created by the METv5.1 test scripts. Here are
the
> > > > >>> required parts.
> > > > >>>
> > > > >>> (1) dimensions should be named "lat" and "lon"
> > > > >>> (2) the "lat" and "lon" variable are **NOT** required
> > > > >>> (3) gridded variables (e.g. APCP_12) must use the "lat"
and
> "lon"
> > > > dimensions
> > > > >>> (4) gridded variables should include the attributes
listed in
> the
> > > > >>> example (for timing info, only the init_time_ut,
valid_time_ut,
> and
> > > > >>> accum_time_sec are actually used. "ut" stands for unix
time, the
> > > > >>> number of seconds since Jan 1, 1970).
> > > > >>> (5) global attributes should include the grid/projection
> > > > >>> information. This example shows how they're specified for
a
> > lambert
> > > > >>> conformal projection. Let me know if you're using a
different
> > > > >>> projection and I'll send you an example.
> > > > >>>
> > > > >>> I hope that helps get you going.
> > > > >>>
> > > > >>> Julie
> > > > >>>
> > > > >>>
> > > > >>>
> > > > >>> On Wed, Sep 7, 2016 at 3:15 PM, Jose Garcia-Rivera via RT
> > > > >>> <met_help at ucar.edu> wrote:
> > > > >>>>
> > > > >>>> Wed Sep 07 15:15:39 2016: Request 77823 was acted upon.
> > > > >>>> Transaction: Ticket created by GarciaJ at imsg.com
> > > > >>>> Queue: met_help
> > > > >>>> Subject: Trouble running radar NETCDF file for
grid_stat
> > > > verifiction
> > > > >>>> Owner: Nobody
> > > > >>>> Requestors: GarciaJ at imsg.com
> > > > >>>> Status: new
> > > > >>>> Ticket <URL: https://rt.rap.ucar.edu/rt/
> > > Ticket/Display.html?id=77823
> > > > >
> > > > >>>>
> > > > >>>>
> > > > >>>> Dear Met Help,
> > > > >>>>
> > > > >>>>
> > > > >>>> I've been trying to run MET using a radar NETCDF file,
and an
> NMMB
> > > > model forecast GRIB file, but the following error shows up:
> > > > >>>>
> > > > >>>>
> > > > >>>> DEBUG 1: Default Config File: /work/apps/pgi_14.10/SANDY/
> > > > met-5.1/share/met/config/GridStatConfig_default
> > > > >>>> DEBUG 1: User Config File: GridStatConfig_dbz
> > > > >>>> ERROR :
> > > > >>>> ERROR : Trouble reading observation file
> "Hongqiao.Refl.20150602.
> > > > s100000.e100500.attributes.nc"
> > > > >>>> ERROR :
> > > > >>>>
> > > > >>>> We used two versions of the OBS file, one as it was, and
the
> > second
> > > > with added "attributes". Still, the same error occurred. We
are not
> > sure
> > > on
> > > > exactly how our NETCDF files need to be for MET to be able to
read
> > them.
> > > I
> > > > searched the error message on the Guide and nothing showed up.
> > > > >>>>
> > > > >>>> We can share the files to your FTP if you want to run
them.
> > > > >>>>
> > > > >>>> Any help will be greatly appreciated.
> > > > >>>>
> > > > >>>>
> > > > >>>>
> > > > >>>> NOTE: We are using MET 5.1
> > > > >>>>
> > > > >>>>
> > > > >>>> Best Regards,
> > > > >>>>
> > > > >>>> Jose
> > > > >>>>
> > > > >>>>
> > > > >>>>
> > > > >>>>
> > > > >>>> Jose M. Garcia-Rivera, PhD
> > > > >>>>
> > > > >>>> Atmospheric Scientist
> > > > >>>>
> > > > >>>> IM Systems Group
> > > > >>>>
> > > > >>>> Rockville/College Park, MD
> > > > >>>>
> > > > >>>> This e-mail, including attachments, may include
confidential
> > and/or
> > > > proprietary information, and may be used only by the person or
entity
> > to
> > > > which it is addressed. If the reader of this e-mail is not the
> intended
> > > > recipient or his or her authorized agent, the reader is hereby
> notified
> > > > that any dissemination, distribution or copying of this e-mail
is
> > > > prohibited. If you have received this e-mail in error, please
notify
> > the
> > > > sender by replying to this message and delete this e-mail
> immediately.
> > > > >>>>
> > > > >>>>
> > > > >>>
> > > > >>>
> > > > >>>
> > > > >>> --
> > > > >>> Julie Prestopnik
> > > > >>> National Center for Atmospheric Research
> > > > >>> Research Applications Laboratory
> > > > >>> Phone: 303.497.8399
> > > > >>> Email: jpresto at ucar.edu
> > > > >>>
> > > > >>>
> > > > >>> This e-mail, including attachments, may include
confidential
> and/or
> > > > proprietary information, and may be used only by the person or
entity
> > to
> > > > which it is addressed. If the reader of this e-mail is not the
> intended
> > > > recipient or his or her authorized agent, the reader is hereby
> notified
> > > > that any dissemination, distribution or copying of this e-mail
is
> > > > prohibited. If you have received this e-mail in error, please
notify
> > the
> > > > sender by replying to this message and delete this e-mail
> immediately.
> > > > >>>
> > > > >>>
> > > > >>
> > > > >>
> > > > >>
> > > > >> --
> > > > >> Julie Prestopnik
> > > > >> National Center for Atmospheric Research
> > > > >> Research Applications Laboratory
> > > > >> Phone: 303.497.8399
> > > > >> Email: jpresto at ucar.edu
> > > > >>
> > > > >> This e-mail, including attachments, may include
confidential
> and/or
> > > > proprietary information, and may be used only by the person or
entity
> > to
> > > > which it is addressed. If the reader of this e-mail is not the
> intended
> > > > recipient or his or her authorized agent, the reader is hereby
> notified
> > > > that any dissemination, distribution or copying of this e-mail
is
> > > > prohibited. If you have received this e-mail in error, please
notify
> > the
> > > > sender by replying to this message and delete this e-mail
> immediately.
> > > > >>
> > > > >>
> > > > >
> > > > >
> > > > >
> > > > > --
> > > > > Julie Prestopnik
> > > > > National Center for Atmospheric Research
> > > > > Research Applications Laboratory
> > > > > Phone: 303.497.8399
> > > > > Email: jpresto at ucar.edu
> > > > >
> > > > >
> > > > > This e-mail, including attachments, may include confidential
and/or
> > > > proprietary information, and may be used only by the person or
entity
> > to
> > > > which it is addressed. If the reader of this e-mail is not the
> intended
> > > > recipient or his or her authorized agent, the reader is hereby
> notified
> > > > that any dissemination, distribution or copying of this e-mail
is
> > > > prohibited. If you have received this e-mail in error, please
notify
> > the
> > > > sender by replying to this message and delete this e-mail
> immediately.
> > > > >
> > > > >
> > > >
> > > >
> > > >
> > > > --
> > > > Julie Prestopnik
> > > > National Center for Atmospheric Research
> > > > Research Applications Laboratory
> > > > Phone: 303.497.8399
> > > > Email: jpresto at ucar.edu
> > > >
> > > > This e-mail, including attachments, may include confidential
and/or
> > > > proprietary information, and may be used only by the person or
entity
> > to
> > > > which it is addressed. If the reader of this e-mail is not the
> intended
> > > > recipient or his or her authorized agent, the reader is hereby
> notified
> > > > that any dissemination, distribution or copying of this e-mail
is
> > > > prohibited. If you have received this e-mail in error, please
notify
> > the
> > > > sender by replying to this message and delete this e-mail
> immediately.
> > > >
> > > >
> > > >
> > >
> > >
> > > --
> > > Julie Prestopnik
> > > National Center for Atmospheric Research
> > > Research Applications Laboratory
> > > Phone: 303.497.8399
> > > Email: jpresto at ucar.edu
> > >
> > > This e-mail, including attachments, may include confidential
and/or
> > > proprietary information, and may be used only by the person or
entity
> to
> > > which it is addressed. If the reader of this e-mail is not the
intended
> > > recipient or his or her authorized agent, the reader is hereby
notified
> > > that any dissemination, distribution or copying of this e-mail
is
> > > prohibited. If you have received this e-mail in error, please
notify
> the
> > > sender by replying to this message and delete this e-mail
immediately.
> > >
> > >
> > >
> >
> > This e-mail, including attachments, may include confidential
and/or
> > proprietary information, and may be used only by the person or
entity to
> > which it is addressed. If the reader of this e-mail is not the
intended
> > recipient or his or her authorized agent, the reader is hereby
notified
> > that any dissemination, distribution or copying of this e-mail is
> > prohibited. If you have received this e-mail in error, please
notify the
> > sender by replying to this message and delete this e-mail
immediately.
> >
> >
> >
>
>
> --
> Julie Prestopnik
> National Center for Atmospheric Research
> Research Applications Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
> This e-mail, including attachments, may include confidential and/or
> proprietary information, and may be used only by the person or
entity to
> which it is addressed. If the reader of this e-mail is not the
intended
> recipient or his or her authorized agent, the reader is hereby
notified
> that any dissemination, distribution or copying of this e-mail is
> prohibited. If you have received this e-mail in error, please notify
the
> sender by replying to this message and delete this e-mail
immediately.
>
>
--
Julie Prestopnik
National Center for Atmospheric Research
Research Applications Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #77823] Trouble running radar NETCDF file for grid_stat verifiction
From: Jose Garcia-Rivera
Time: Tue Sep 13 11:53:58 2016
Hi Julie,
Thanks for checking out. The met_OBS.png is the output I got from
grid_stat. The correct file is radar_OBS.png plot. So, that may mean
that you are getting the same issue I got. Have you seen this
happening before?
Best Regards,
Jose
-----Original Message-----
From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
Sent: Tuesday, September 13, 2016 1:21 PM
To: Jose Garcia-Rivera
Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar NETCDF
file for grid_stat verifiction
Hi Jose.
When I plot the NetCDF3 obs file that we created using nccopy
(RadarObsNEW_mod_v3.nc) using plot_data_plane:
/usr/local/met-5.2/bin/plot_data_plane RadarObsNEW_mod_v3.nc
RadarObsNEW_mod_v3.ps 'name="REFC"; level="(*,*)";'
The resulting image, RadarObsNEW_mod_v3.ps (attached), appears to be
oriented in the same way as the met_OBS.png image that you attached,
so I don't believe that grid_stat is doing anything to the data, but
rather that the data was placed into the original NetCDF Obs data and
needs to be re-oriented there.
Please let me know if you find that is not the case. Please try
running plot_data_plane on the data that produced the radar_OBS.png
file and see if you get the same result.
Thanks,
Julie
On Tue, Sep 13, 2016 at 9:20 AM, Jose Garcia-Rivera via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
>
> Dear Julie, John
>
> The commands worked fine. Thank you so much!
>
> Now, there's something that is puzzling us. The radar data from the
> grid_stat.nc output file seems to be flipped upside-down. I attached
> the MET-produced OBS vs the original OBS. Is this an artifact of
> grid_stat, or how can it be fixed?
>
>
>
> Best Regards,
> Jose
>
> ________________________________________
> From: Julie Prestopnik via RT <met_help at ucar.edu>
> Sent: Friday, September 9, 2016 4:07 PM
> To: Jose Garcia-Rivera
> Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar NETCDF
> file for grid_stat verifiction
>
> Hi Jose.
>
> As John indicated the problem lies in that currently MET only
supports
> the classic data model... i.e. NetCDF3, which the file
RadarObsNEW.nc is not.
>
> Running "file RadarObsNEW.nc" shows that the file is not "NetCDF
Data
> Format data", but rather:
>
> RadarObsNEW.nc: Hierarchical Data Format (version 5) data
>
> You can create a NetCDF3 file when you create the file or you can
use
> the "nccopy" command. However, "nccopy" didn't work with the
> RadarObsNEW.nc file, until we made some changes. We used "ncatted"
to
> remove the "L" from the value of the following attributes:
> parameter_table_version, parameter_number, level_indicator, nx, and
> ny. I'll paste in the commands that we used to create a NetCDF3
file,
> plot the data, and get a successful run from grid_stat.
>
> # Update attributes to remove longs
> /usr/local/nco/bin/ncatted \
> -a parameter_table_version,REFC,o,f,129 \ -a
> parameter_number,REFC,o,f,212 \ -a level_indicator,REFC,o,f,200 \ -a
> nx,global,o,i,674 \ -a ny,global,o,i,620 \ RadarObsNEW.nc
> RadarObsNEW_mod.nc
>
> # Convert from NC4 to NC3
> /usr/local/netcdf/bin/nccopy -3 RadarObsNEW_mod.nc
> RadarObsNEW_mod_v3.nc
>
> # Regrid to global grid
> /usr/local/met-5.2/bin/regrid_data_plane \ RadarObsNEW_mod_v3.nc
G004
> RadarObsNEW_mod_v3_G004.nc \ -field 'name="REFC"; level="(*,*)";'
>
> # Plot the result
> /usr/local/met-5.2/bin/plot_data_plane \ RadarObsNEW_mod_v3_G004.nc
> RadarObsNEW_mod_v3_G004.ps \ 'name="REFC"; level="(*,*)";'
>
> # Display plot
> convert -rotate 90 -background white -flatten
> RadarObsNEW_mod_v3_G004.ps RadarObsNEW_mod_v3_G004.png display
> RadarObsNEW_mod_v3_G004.png&
>
> # Plot forecast REFC
> /usr/local/met-5.2/bin/plot_data_plane \ ForecastFile.grb
refc_fcst.ps
> \ 'name="REFC"; level="L0"; GRIB1_ptv=129;'
>
> # Display plot
> convert -rotate 90 -background white -flatten refc_fcst.ps
> refc_fcst.png display refc_fcst.png&
>
> # Run grid_stat
> /usr/local/met-5.1/bin/grid_stat ForecastFile.grb
> RadarObsNEW_mod_v3.nc GridStatConfig_dbz -outdir out/
>
> I have also attached the NetCDF3 file that we produced after using
> ncatted and nccopy.
>
> Please let us know if you have any other questions.
>
> Thanks,
> Julie
>
>
> On Fri, Sep 9, 2016 at 12:43 PM, Jose Garcia-Rivera via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
> >
> > Hi John,
> >
> > Glad to talk to you again. We did the proposed changes, and the
> > error keeps showing up.
> >
> > I uploaded the new file as: RadarObsNEW.nc
> >
> > Please try to run it and let me know what issues show up?
> >
> > Thanks for the help,
> > Jose
> > ________________________________________
> > From: John Halley Gotway via RT <met_help at ucar.edu>
> > Sent: Friday, September 9, 2016 2:17 PM
> > To: Jose Garcia-Rivera
> > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar NETCDF
> > file for grid_stat verifiction
> >
> > Hello Jose,
> >
> > This is John Halley Gotway. I work with Julie on providing
support
> > for MET.
> >
> > I think there's a few pieces of info we're missing here.
> >
> > (1) MET does not currently support the enhanced data model of
NetCDF4.
> It
> > only supports the classic data model... i.e. NetCDF3. In the next
> version
> > of MET (6.0), due out next year, we'll be adding support for
NetCDF4.
> The
> > file you sent us in NetCDF4 but when Julie add those attributes
she
> > may have used ncdump/ncgen. And their output is NetCDF3. Try
> > updating your NCL script to write a "classic" NetCDF file.
> >
> > (2) Yes, the "MET_version" global attribute needs to be present.
> > That tells MET how to parse the grid information.
> >
> > (3) I'm not sure that the variable "name" attribute is necessary,
> > but it doesn't hurt.
> >
> > (4) The biggest problem is in the definition of your Mercator
grid:
> > :Projection = "Mercator" ;
> > :lat_ll = "3348550.177 degrees_north" ;
> > :lon_ll = "13120540.425 degrees_east" ;
> > :lat_ur = "4057346.9 degrees_north" ;
> > :lon_ur = "13891071.057 degrees_east" ;
> >
> > Those don't look like very meaningful lat/lon values! Where did
you
> > get these numbers? Are they meant to match the grid defined in
the
> > GRIB file you sent us?
> >
> > Thanks,
> > John
> >
> > On Fri, Sep 9, 2016 at 12:08 PM, Jose Garcia-Rivera via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
> > >
> > > Dear Julie,
> > >
> > > The file that you modified worked. However, we did the changes
you
> made,
> > > and grid_stat continues to show the same error.
> > >
> > > I've uploaded the file in the same FTP directory, named:
> > > Hongqiao.Refl.20150602.s100000.e100500.attributes.nc
> > >
> > > This is a file dump of our modified netcdf:
> > >
> > > NCAR Command Language Version 6.3.0 The use of this software is
> > > governed by a License Agreement.
> > > See http://www.ncl.ucar.edu/ for more details.
> > >
> > > Variable: f
> > > Type: file
> > > filename:
Hongqiao.Refl.20150602.s100000.e100500.attributes
> > > path: Hongqiao.Refl.20150602.s100000.e100500.attributes.nc
> > > Number of Attributes:8
> > > MET_version : V5.1
> > > Projection : Mercator
> > > lat_ll : 3348550.177 degrees_north
> > > lon_ll : 13120540.425 degrees_east
> > > lat_ur : 4057346.9 degrees_north
> > > lon_ur : 13891071.057 degrees_east
> > > nx : 674
> > > ny : 620
> > >
> > > dimensions:
> > > lon = 674
> > > lat = 620
> > >
> > > variables:
> > > Variable: lat
> > > Type: float
> > > Total Size: 417880 values
> > > 1671520 bytes
> > > Number of Dimensions: 2
> > > Dimensions and sizes: [ 620 <lat> x 674 <lon> ]
> > > Coordinates:
> > > lat: [4057347..4057347]
> > > lon: [1.312054e+07..1.388993e+07]
> > > Number of Attributes: 2
> > > units : degrees_north
> > > standard_name : latitude
> > >
> > > Variable: lon
> > > Type: float
> > > Total Size: 417880 values
> > > 1671520 bytes
> > > Number of Dimensions: 2
> > > Dimensions and sizes: [ 620 <lat> x 674 <lon> ]
> > > Coordinates:
> > > lat: [4057347..4057347]
> > > lon: [1.312054e+07..1.388993e+07]
> > > Number of Attributes: 2
> > > units : degrees_east
> > > standard_name : longitude
> > >
> > > Variable: REFC
> > > Type: float
> > > Total Size: 417880 values
> > > 1671520 bytes
> > > Number of Dimensions: 2
> > > Dimensions and sizes: [ 620 <lat> x 674 <lon> ]
> > > Coordinates:
> > > lat: [4057347..4057347]
> > > lon: [1.312054e+07..1.388993e+07]
> > > Number of Attributes: 11
> > > name : REFC
> > > units : dbZ
> > > parameter_table_version : 129
> > > parameter_number : 212
> > > level_indicator : 200
> > > level : L0
> > > long_name : MaxReflectivity
> > > init_time : 20050807_000000
> > > init_time_ut : 1123372800
> > > valid_time : 20050807_120000
> > > valid_time_ut : 1123416000
> > >
> > >
> > >
> > > Best Regards,
> > > Jose
> > >
> > >
> > > ________________________________________
> > > From: Julie Prestopnik via RT <met_help at ucar.edu>
> > > Sent: Friday, September 9, 2016 1:09 PM
> > > To: Jose Garcia-Rivera
> > > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar
NETCDF
> file
> > > for grid_stat verifiction
> > >
> > > Hi Jose. Thank you for uploading your data. There were two
> > > important things missing from your file.
> > >
> > > I added:
> > >
> > > REFC:name = "REFC" ;
> > >
> > > under:
> > >
> > > float REFC(lat, lon) ;
> > >
> > > and I added:
> > >
> > > :MET_version = "V5.1" ;
> > >
> > > under // global attributes:
> > >
> > > and was able to get a successful run of grid_stat.
> > >
> > > I am attaching the file with the changes. Please give it a try
> > > and let
> > me
> > > know if you get a successful run as well.
> > >
> > > Thanks,
> > > Julie
> > >
> > > On Fri, Sep 9, 2016 at 10:38 AM, Jose Garcia-Rivera via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823
>
> > > >
> > > > Dear Julie,
> > > >
> > > > We used the Mercator example, and ours looks identical to
yours.
> > > > I proceeded and put 4 files into your FTP server:
> > > >
> > > > Model forecast file
> > > > Radar Obs file
> > > > Grid Stat Config file
> > > > domain.poly file
> > > >
> > > > The files are under 'garcia_data'
> > > >
> > > >
> > > > Thanks so much for your help,
> > > > Jose
> > > > ________________________________________
> > > > From: Julie Prestopnik via RT <met_help at ucar.edu>
> > > > Sent: Friday, September 9, 2016 11:50 AM
> > > > To: Jose Garcia-Rivera
> > > > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar
> > > > NETCDF
> > file
> > > > for grid_stat verifiction
> > > >
> > > > Hi Jose. I have attached a Mercator projection example. If
> > > > you're still stuck, please post your data to our anonymous FTP
> > > > site following these instructions:
> > > > http://www.dtcenter.org/met/users/support/met_help.php#ftp
> > > >
> > > > Thanks,
> > > > Julie
> > > >
> > > >
> > > > On Thu, Sep 8, 2016 at 3:25 PM, Jose Garcia-Rivera via RT
> > > > <met_help at ucar.edu> wrote:
> > > > >
> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823
> > > > > >
> > > > >
> > > > > Dear Julie,
> > > > >
> > > > > That's very good information, thanks. We've been working on
> > > > > this
> > issue,
> > > > however the same error keeps showing up.
> > > > >
> > > > > Can we get a Mercator projection example?
> > > > >
> > > > > I was wondering if you could have a peek into our netcdf
file,
> > > > > or
> run
> > > an
> > > > internal test to see what needs to be changed, or what may be
wrong.
> In
> > > the
> > > > meantime, we continue working on trying to make the file fit
MET
> > > > requirements.
> > > > >
> > > > > Thanks for the help,
> > > > > Jose
> > > > >
> > > > > ________________________________________
> > > > > From: Julie Prestopnik via RT <met_help at ucar.edu>
> > > > > Sent: Thursday, September 8, 2016 3:57 PM
> > > > > To: Jose Garcia-Rivera
> > > > > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar
> > > > > NETCDF
> > > file
> > > > for grid_stat verifiction
> > > > >
> > > > > Hi Jose.
> > > > >
> > > > > Unfortunately, we do not have a radar obs netcdf example
file.
> With
> > > > > NetCDF, users have two choices:
> > > > > --make it look like the NetCDF files that MET generates
(i.e.
> > > > > the output of pcp_combine) or --put it into CF-compliant
> > > > > NetCDF The variable can be named "radar_obs" or "precip" or
> > > > > anything you'd
> > > like.
> > > > >
> > > > > Julie
> > > > >
> > > > >
> > > > > On Thu, Sep 8, 2016 at 12:10 PM, Jose Garcia-Rivera via RT
> > > > > <met_help at ucar.edu> wrote:
> > > > >>
> > > > >> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823
> > > > >> >
> > > > >>
> > > > >> Dear Julie,
> > > > >>
> > > > >> Thanks so much for the file. We haven't been able to work
on
> > > > >> it
> yet,
> > > > since we are fixing computer issues. One more question, do you
> > > > have a
> > > radar
> > > > obs netcdf example file?
> > > > >>
> > > > >> Best Regards,
> > > > >> Jose
> > > > >>
> > > > >> From: Julie Prestopnik via RT <met_help at ucar.edu>
> > > > >> Sent: Thursday, September 8, 2016 12:58 PM
> > > > >> To: Jose Garcia-Rivera
> > > > >> Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar
> NETCDF
> > > > file for grid_stat verifiction
> > > > >>
> > > > >> My apologies. I meant to attach the file in my last email.
You
> > can
> > > > >> find it attached to this one.
> > > > >>
> > > > >> Thanks,
> > > > >> Julie
> > > > >>
> > > > >> On Thu, Sep 8, 2016 at 10:36 AM, Jose Garcia-Rivera via RT
> > > > >> <met_help at ucar.edu> wrote:
> > > > >>>
> > > > >>> <URL:
> > > > >>> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
> > > > >>>
> > > > >>> Dear Julie,
> > > > >>>
> > > > >>> Thanks for the helpful response. Can I have an example
file
> > > > >>> from
> > the
> > > > pcp_combine tool for reference?
> > > > >>>
> > > > >>> Best Regards,
> > > > >>> Jose
> > > > >>> ________________________________________
> > > > >>> From: Julie Prestopnik via RT <met_help at ucar.edu>
> > > > >>> Sent: Thursday, September 8, 2016 11:57 AM
> > > > >>> To: Jose Garcia-Rivera
> > > > >>> Subject: Re: [rt.rap.ucar.edu #77823] Trouble running
radar
> NETCDF
> > > > file for grid_stat verifiction
> > > > >>>
> > > > >>> Hi Jose.
> > > > >>>
> > > > >>> I see that you are running MET 5.1, but are unsure of how
> > > > >>> the
> > NetCDF
> > > > >>> files should be formatted in order for GridStat to be able
> > > > >>> to
> read
> > > > >>> them.
> > > > >>>
> > > > >>> In order it use gridded NetCDF files in MET, you'll need
to
> > > > >>> make
> > them
> > > > >>> look like the output of the pcp_combine tool.
> > > > >>>
> > > > >>> Listed below is the header from one of the NetCDF files
from
> > > > >>> pcp_combine created by the METv5.1 test scripts. Here are
> > > > >>> the required parts.
> > > > >>>
> > > > >>> (1) dimensions should be named "lat" and "lon"
> > > > >>> (2) the "lat" and "lon" variable are **NOT** required
> > > > >>> (3) gridded variables (e.g. APCP_12) must use the "lat"
> > > > >>> and
> "lon"
> > > > dimensions
> > > > >>> (4) gridded variables should include the attributes
listed
> > > > >>> in
> the
> > > > >>> example (for timing info, only the init_time_ut,
> > > > >>> valid_time_ut,
> and
> > > > >>> accum_time_sec are actually used. "ut" stands for unix
> > > > >>> time, the number of seconds since Jan 1, 1970).
> > > > >>> (5) global attributes should include the grid/projection
> > > > >>> information. This example shows how they're specified for
a
> > lambert
> > > > >>> conformal projection. Let me know if you're using a
> > > > >>> different projection and I'll send you an example.
> > > > >>>
> > > > >>> I hope that helps get you going.
> > > > >>>
> > > > >>> Julie
> > > > >>>
> > > > >>>
> > > > >>>
> > > > >>> On Wed, Sep 7, 2016 at 3:15 PM, Jose Garcia-Rivera via RT
> > > > >>> <met_help at ucar.edu> wrote:
> > > > >>>>
> > > > >>>> Wed Sep 07 15:15:39 2016: Request 77823 was acted upon.
> > > > >>>> Transaction: Ticket created by GarciaJ at imsg.com
> > > > >>>> Queue: met_help
> > > > >>>> Subject: Trouble running radar NETCDF file for
> > > > >>>> grid_stat
> > > > verifiction
> > > > >>>> Owner: Nobody
> > > > >>>> Requestors: GarciaJ at imsg.com
> > > > >>>> Status: new
> > > > >>>> Ticket <URL: https://rt.rap.ucar.edu/rt/
> > > Ticket/Display.html?id=77823
> > > > >
> > > > >>>>
> > > > >>>>
> > > > >>>> Dear Met Help,
> > > > >>>>
> > > > >>>>
> > > > >>>> I've been trying to run MET using a radar NETCDF file,
and
> > > > >>>> an
> NMMB
> > > > model forecast GRIB file, but the following error shows up:
> > > > >>>>
> > > > >>>>
> > > > >>>> DEBUG 1: Default Config File: /work/apps/pgi_14.10/SANDY/
> > > > met-5.1/share/met/config/GridStatConfig_default
> > > > >>>> DEBUG 1: User Config File: GridStatConfig_dbz ERROR :
> > > > >>>> ERROR : Trouble reading observation file
> "Hongqiao.Refl.20150602.
> > > > s100000.e100500.attributes.nc"
> > > > >>>> ERROR :
> > > > >>>>
> > > > >>>> We used two versions of the OBS file, one as it was, and
> > > > >>>> the
> > second
> > > > with added "attributes". Still, the same error occurred. We
are
> > > > not
> > sure
> > > on
> > > > exactly how our NETCDF files need to be for MET to be able to
> > > > read
> > them.
> > > I
> > > > searched the error message on the Guide and nothing showed up.
> > > > >>>>
> > > > >>>> We can share the files to your FTP if you want to run
them.
> > > > >>>>
> > > > >>>> Any help will be greatly appreciated.
> > > > >>>>
> > > > >>>>
> > > > >>>>
> > > > >>>> NOTE: We are using MET 5.1
> > > > >>>>
> > > > >>>>
> > > > >>>> Best Regards,
> > > > >>>>
> > > > >>>> Jose
> > > > >>>>
> > > > >>>>
> > > > >>>>
> > > > >>>>
> > > > >>>> Jose M. Garcia-Rivera, PhD
> > > > >>>>
> > > > >>>> Atmospheric Scientist
> > > > >>>>
> > > > >>>> IM Systems Group
> > > > >>>>
> > > > >>>> Rockville/College Park, MD
> > > > >>>>
> > > > >>>> This e-mail, including attachments, may include
> > > > >>>> confidential
> > and/or
> > > > proprietary information, and may be used only by the person or
> > > > entity
> > to
> > > > which it is addressed. If the reader of this e-mail is not the
> intended
> > > > recipient or his or her authorized agent, the reader is hereby
> notified
> > > > that any dissemination, distribution or copying of this e-mail
> > > > is prohibited. If you have received this e-mail in error,
please
> > > > notify
> > the
> > > > sender by replying to this message and delete this e-mail
> immediately.
> > > > >>>>
> > > > >>>>
> > > > >>>
> > > > >>>
> > > > >>>
> > > > >>> --
> > > > >>> Julie Prestopnik
> > > > >>> National Center for Atmospheric Research Research
> > > > >>> Applications Laboratory
> > > > >>> Phone: 303.497.8399
> > > > >>> Email: jpresto at ucar.edu
> > > > >>>
> > > > >>>
> > > > >>> This e-mail, including attachments, may include
confidential
> and/or
> > > > proprietary information, and may be used only by the person or
> > > > entity
> > to
> > > > which it is addressed. If the reader of this e-mail is not the
> intended
> > > > recipient or his or her authorized agent, the reader is hereby
> notified
> > > > that any dissemination, distribution or copying of this e-mail
> > > > is prohibited. If you have received this e-mail in error,
please
> > > > notify
> > the
> > > > sender by replying to this message and delete this e-mail
> immediately.
> > > > >>>
> > > > >>>
> > > > >>
> > > > >>
> > > > >>
> > > > >> --
> > > > >> Julie Prestopnik
> > > > >> National Center for Atmospheric Research Research
> > > > >> Applications Laboratory
> > > > >> Phone: 303.497.8399
> > > > >> Email: jpresto at ucar.edu
> > > > >>
> > > > >> This e-mail, including attachments, may include
confidential
> and/or
> > > > proprietary information, and may be used only by the person or
> > > > entity
> > to
> > > > which it is addressed. If the reader of this e-mail is not the
> intended
> > > > recipient or his or her authorized agent, the reader is hereby
> notified
> > > > that any dissemination, distribution or copying of this e-mail
> > > > is prohibited. If you have received this e-mail in error,
please
> > > > notify
> > the
> > > > sender by replying to this message and delete this e-mail
> immediately.
> > > > >>
> > > > >>
> > > > >
> > > > >
> > > > >
> > > > > --
> > > > > Julie Prestopnik
> > > > > National Center for Atmospheric Research Research
Applications
> > > > > Laboratory
> > > > > Phone: 303.497.8399
> > > > > Email: jpresto at ucar.edu
> > > > >
> > > > >
> > > > > This e-mail, including attachments, may include confidential
> > > > > and/or
> > > > proprietary information, and may be used only by the person or
> > > > entity
> > to
> > > > which it is addressed. If the reader of this e-mail is not the
> intended
> > > > recipient or his or her authorized agent, the reader is hereby
> notified
> > > > that any dissemination, distribution or copying of this e-mail
> > > > is prohibited. If you have received this e-mail in error,
please
> > > > notify
> > the
> > > > sender by replying to this message and delete this e-mail
> immediately.
> > > > >
> > > > >
> > > >
> > > >
> > > >
> > > > --
> > > > Julie Prestopnik
> > > > National Center for Atmospheric Research Research Applications
> > > > Laboratory
> > > > Phone: 303.497.8399
> > > > Email: jpresto at ucar.edu
> > > >
> > > > This e-mail, including attachments, may include confidential
> > > > and/or proprietary information, and may be used only by the
> > > > person or entity
> > to
> > > > which it is addressed. If the reader of this e-mail is not the
> intended
> > > > recipient or his or her authorized agent, the reader is hereby
> notified
> > > > that any dissemination, distribution or copying of this e-mail
> > > > is prohibited. If you have received this e-mail in error,
please
> > > > notify
> > the
> > > > sender by replying to this message and delete this e-mail
> immediately.
> > > >
> > > >
> > > >
> > >
> > >
> > > --
> > > Julie Prestopnik
> > > National Center for Atmospheric Research Research Applications
> > > Laboratory
> > > Phone: 303.497.8399
> > > Email: jpresto at ucar.edu
> > >
> > > This e-mail, including attachments, may include confidential
> > > and/or proprietary information, and may be used only by the
person
> > > or entity
> to
> > > which it is addressed. If the reader of this e-mail is not the
> > > intended recipient or his or her authorized agent, the reader is
> > > hereby notified that any dissemination, distribution or copying
of
> > > this e-mail is prohibited. If you have received this e-mail in
> > > error, please notify
> the
> > > sender by replying to this message and delete this e-mail
immediately.
> > >
> > >
> > >
> >
> > This e-mail, including attachments, may include confidential
and/or
> > proprietary information, and may be used only by the person or
> > entity to which it is addressed. If the reader of this e-mail is
not
> > the intended recipient or his or her authorized agent, the reader
is
> > hereby notified that any dissemination, distribution or copying of
> > this e-mail is prohibited. If you have received this e-mail in
> > error, please notify the sender by replying to this message and
delete this e-mail immediately.
> >
> >
> >
>
>
> --
> Julie Prestopnik
> National Center for Atmospheric Research Research Applications
> Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
> This e-mail, including attachments, may include confidential and/or
> proprietary information, and may be used only by the person or
entity
> to which it is addressed. If the reader of this e-mail is not the
> intended recipient or his or her authorized agent, the reader is
> hereby notified that any dissemination, distribution or copying of
> this e-mail is prohibited. If you have received this e-mail in
error,
> please notify the sender by replying to this message and delete this
e-mail immediately.
>
>
--
Julie Prestopnik
National Center for Atmospheric Research Research Applications
Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
This e-mail, including attachments, may include confidential and/or
proprietary information, and may be used only by the person or entity
to which it is addressed. If the reader of this e-mail is not the
intended recipient or his or her authorized agent, the reader is
hereby notified that any dissemination, distribution or copying of
this e-mail is prohibited. If you have received this e-mail in error,
please notify the sender by replying to this message and delete this
e-mail immediately.
------------------------------------------------
Subject: Trouble running radar NETCDF file for grid_stat verifiction
From: Julie Prestopnik
Time: Tue Sep 13 11:59:18 2016
Hi Jose.
When I ran plot_data_plane on the input observation file,
RadarObsNEW_mod_v3.nc, I produced the image I sent you, which looked
similar to the met_OBS.png file that you sent me in that it was
flipped
upside-down. So, I produced a similar image pre-grid_stat, using the
raw
observation file.
How did you produce your radar_OBS.png plot? Could you please try
running
plot_data_plane on the radar observation file and see if you get the
same
output we do? I suspect the problem lies in the way the radar NetCDF
file
is being written.
Thanks,
Julie
On Tue, Sep 13, 2016 at 11:53 AM, Jose Garcia-Rivera via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
>
> Hi Julie,
>
> Thanks for checking out. The met_OBS.png is the output I got from
> grid_stat. The correct file is radar_OBS.png plot. So, that may mean
that
> you are getting the same issue I got. Have you seen this happening
before?
>
> Best Regards,
> Jose
>
>
>
> -----Original Message-----
> From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> Sent: Tuesday, September 13, 2016 1:21 PM
> To: Jose Garcia-Rivera
> Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar NETCDF
file
> for grid_stat verifiction
>
> Hi Jose.
>
> When I plot the NetCDF3 obs file that we created using nccopy
> (RadarObsNEW_mod_v3.nc) using plot_data_plane:
>
> /usr/local/met-5.2/bin/plot_data_plane RadarObsNEW_mod_v3.nc
> RadarObsNEW_mod_v3.ps 'name="REFC"; level="(*,*)";'
>
> The resulting image, RadarObsNEW_mod_v3.ps (attached), appears to be
> oriented in the same way as the met_OBS.png image that you attached,
so I
> don't believe that grid_stat is doing anything to the data, but
rather that
> the data was placed into the original NetCDF Obs data and needs to
be
> re-oriented there.
>
> Please let me know if you find that is not the case. Please try
running
> plot_data_plane on the data that produced the radar_OBS.png file and
see if
> you get the same result.
>
> Thanks,
> Julie
>
> On Tue, Sep 13, 2016 at 9:20 AM, Jose Garcia-Rivera via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
> >
> > Dear Julie, John
> >
> > The commands worked fine. Thank you so much!
> >
> > Now, there's something that is puzzling us. The radar data from
the
> > grid_stat.nc output file seems to be flipped upside-down. I
attached
> > the MET-produced OBS vs the original OBS. Is this an artifact of
> > grid_stat, or how can it be fixed?
> >
> >
> >
> > Best Regards,
> > Jose
> >
> > ________________________________________
> > From: Julie Prestopnik via RT <met_help at ucar.edu>
> > Sent: Friday, September 9, 2016 4:07 PM
> > To: Jose Garcia-Rivera
> > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar NETCDF
> > file for grid_stat verifiction
> >
> > Hi Jose.
> >
> > As John indicated the problem lies in that currently MET only
supports
> > the classic data model... i.e. NetCDF3, which the file
RadarObsNEW.nc is
> not.
> >
> > Running "file RadarObsNEW.nc" shows that the file is not "NetCDF
Data
> > Format data", but rather:
> >
> > RadarObsNEW.nc: Hierarchical Data Format (version 5) data
> >
> > You can create a NetCDF3 file when you create the file or you can
use
> > the "nccopy" command. However, "nccopy" didn't work with the
> > RadarObsNEW.nc file, until we made some changes. We used
"ncatted" to
> > remove the "L" from the value of the following attributes:
> > parameter_table_version, parameter_number, level_indicator, nx,
and
> > ny. I'll paste in the commands that we used to create a NetCDF3
file,
> > plot the data, and get a successful run from grid_stat.
> >
> > # Update attributes to remove longs
> > /usr/local/nco/bin/ncatted \
> > -a parameter_table_version,REFC,o,f,129 \ -a
> > parameter_number,REFC,o,f,212 \ -a level_indicator,REFC,o,f,200 \
-a
> > nx,global,o,i,674 \ -a ny,global,o,i,620 \ RadarObsNEW.nc
> > RadarObsNEW_mod.nc
> >
> > # Convert from NC4 to NC3
> > /usr/local/netcdf/bin/nccopy -3 RadarObsNEW_mod.nc
> > RadarObsNEW_mod_v3.nc
> >
> > # Regrid to global grid
> > /usr/local/met-5.2/bin/regrid_data_plane \ RadarObsNEW_mod_v3.nc
G004
> > RadarObsNEW_mod_v3_G004.nc \ -field 'name="REFC"; level="(*,*)";'
> >
> > # Plot the result
> > /usr/local/met-5.2/bin/plot_data_plane \
RadarObsNEW_mod_v3_G004.nc
> > RadarObsNEW_mod_v3_G004.ps \ 'name="REFC"; level="(*,*)";'
> >
> > # Display plot
> > convert -rotate 90 -background white -flatten
> > RadarObsNEW_mod_v3_G004.ps RadarObsNEW_mod_v3_G004.png display
> > RadarObsNEW_mod_v3_G004.png&
> >
> > # Plot forecast REFC
> > /usr/local/met-5.2/bin/plot_data_plane \ ForecastFile.grb
refc_fcst.ps
> > \ 'name="REFC"; level="L0"; GRIB1_ptv=129;'
> >
> > # Display plot
> > convert -rotate 90 -background white -flatten refc_fcst.ps
> > refc_fcst.png display refc_fcst.png&
> >
> > # Run grid_stat
> > /usr/local/met-5.1/bin/grid_stat ForecastFile.grb
> > RadarObsNEW_mod_v3.nc GridStatConfig_dbz -outdir out/
> >
> > I have also attached the NetCDF3 file that we produced after using
> > ncatted and nccopy.
> >
> > Please let us know if you have any other questions.
> >
> > Thanks,
> > Julie
> >
> >
> > On Fri, Sep 9, 2016 at 12:43 PM, Jose Garcia-Rivera via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
> > >
> > > Hi John,
> > >
> > > Glad to talk to you again. We did the proposed changes, and the
> > > error keeps showing up.
> > >
> > > I uploaded the new file as: RadarObsNEW.nc
> > >
> > > Please try to run it and let me know what issues show up?
> > >
> > > Thanks for the help,
> > > Jose
> > > ________________________________________
> > > From: John Halley Gotway via RT <met_help at ucar.edu>
> > > Sent: Friday, September 9, 2016 2:17 PM
> > > To: Jose Garcia-Rivera
> > > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar
NETCDF
> > > file for grid_stat verifiction
> > >
> > > Hello Jose,
> > >
> > > This is John Halley Gotway. I work with Julie on providing
support
> > > for MET.
> > >
> > > I think there's a few pieces of info we're missing here.
> > >
> > > (1) MET does not currently support the enhanced data model of
NetCDF4.
> > It
> > > only supports the classic data model... i.e. NetCDF3. In the
next
> > version
> > > of MET (6.0), due out next year, we'll be adding support for
NetCDF4.
> > The
> > > file you sent us in NetCDF4 but when Julie add those attributes
she
> > > may have used ncdump/ncgen. And their output is NetCDF3. Try
> > > updating your NCL script to write a "classic" NetCDF file.
> > >
> > > (2) Yes, the "MET_version" global attribute needs to be present.
> > > That tells MET how to parse the grid information.
> > >
> > > (3) I'm not sure that the variable "name" attribute is
necessary,
> > > but it doesn't hurt.
> > >
> > > (4) The biggest problem is in the definition of your Mercator
grid:
> > > :Projection = "Mercator" ;
> > > :lat_ll = "3348550.177 degrees_north" ;
> > > :lon_ll = "13120540.425 degrees_east" ;
> > > :lat_ur = "4057346.9 degrees_north" ;
> > > :lon_ur = "13891071.057 degrees_east" ;
> > >
> > > Those don't look like very meaningful lat/lon values! Where did
you
> > > get these numbers? Are they meant to match the grid defined in
the
> > > GRIB file you sent us?
> > >
> > > Thanks,
> > > John
> > >
> > > On Fri, Sep 9, 2016 at 12:08 PM, Jose Garcia-Rivera via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823
>
> > > >
> > > > Dear Julie,
> > > >
> > > > The file that you modified worked. However, we did the changes
you
> > made,
> > > > and grid_stat continues to show the same error.
> > > >
> > > > I've uploaded the file in the same FTP directory, named:
> > > > Hongqiao.Refl.20150602.s100000.e100500.attributes.nc
> > > >
> > > > This is a file dump of our modified netcdf:
> > > >
> > > > NCAR Command Language Version 6.3.0 The use of this software
is
> > > > governed by a License Agreement.
> > > > See http://www.ncl.ucar.edu/ for more details.
> > > >
> > > > Variable: f
> > > > Type: file
> > > > filename:
Hongqiao.Refl.20150602.s100000.e100500.attributes
> > > > path: Hongqiao.Refl.20150602.s100000.e100500.attributes.nc
> > > > Number of Attributes:8
> > > > MET_version : V5.1
> > > > Projection : Mercator
> > > > lat_ll : 3348550.177 degrees_north
> > > > lon_ll : 13120540.425 degrees_east
> > > > lat_ur : 4057346.9 degrees_north
> > > > lon_ur : 13891071.057 degrees_east
> > > > nx : 674
> > > > ny : 620
> > > >
> > > > dimensions:
> > > > lon = 674
> > > > lat = 620
> > > >
> > > > variables:
> > > > Variable: lat
> > > > Type: float
> > > > Total Size: 417880 values
> > > > 1671520 bytes
> > > > Number of Dimensions: 2
> > > > Dimensions and sizes: [ 620 <lat> x 674 <lon> ]
> > > > Coordinates:
> > > > lat: [4057347..4057347]
> > > > lon: [1.312054e+07..1.388993e+07]
> > > > Number of Attributes: 2
> > > > units : degrees_north
> > > > standard_name : latitude
> > > >
> > > > Variable: lon
> > > > Type: float
> > > > Total Size: 417880 values
> > > > 1671520 bytes
> > > > Number of Dimensions: 2
> > > > Dimensions and sizes: [ 620 <lat> x 674 <lon> ]
> > > > Coordinates:
> > > > lat: [4057347..4057347]
> > > > lon: [1.312054e+07..1.388993e+07]
> > > > Number of Attributes: 2
> > > > units : degrees_east
> > > > standard_name : longitude
> > > >
> > > > Variable: REFC
> > > > Type: float
> > > > Total Size: 417880 values
> > > > 1671520 bytes
> > > > Number of Dimensions: 2
> > > > Dimensions and sizes: [ 620 <lat> x 674 <lon> ]
> > > > Coordinates:
> > > > lat: [4057347..4057347]
> > > > lon: [1.312054e+07..1.388993e+07]
> > > > Number of Attributes: 11
> > > > name : REFC
> > > > units : dbZ
> > > > parameter_table_version : 129
> > > > parameter_number : 212
> > > > level_indicator : 200
> > > > level : L0
> > > > long_name : MaxReflectivity
> > > > init_time : 20050807_000000
> > > > init_time_ut : 1123372800
> > > > valid_time : 20050807_120000
> > > > valid_time_ut : 1123416000
> > > >
> > > >
> > > >
> > > > Best Regards,
> > > > Jose
> > > >
> > > >
> > > > ________________________________________
> > > > From: Julie Prestopnik via RT <met_help at ucar.edu>
> > > > Sent: Friday, September 9, 2016 1:09 PM
> > > > To: Jose Garcia-Rivera
> > > > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar
NETCDF
> > file
> > > > for grid_stat verifiction
> > > >
> > > > Hi Jose. Thank you for uploading your data. There were two
> > > > important things missing from your file.
> > > >
> > > > I added:
> > > >
> > > > REFC:name = "REFC" ;
> > > >
> > > > under:
> > > >
> > > > float REFC(lat, lon) ;
> > > >
> > > > and I added:
> > > >
> > > > :MET_version = "V5.1" ;
> > > >
> > > > under // global attributes:
> > > >
> > > > and was able to get a successful run of grid_stat.
> > > >
> > > > I am attaching the file with the changes. Please give it a
try
> > > > and let
> > > me
> > > > know if you get a successful run as well.
> > > >
> > > > Thanks,
> > > > Julie
> > > >
> > > > On Fri, Sep 9, 2016 at 10:38 AM, Jose Garcia-Rivera via RT <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > > >
> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
> > > > >
> > > > > Dear Julie,
> > > > >
> > > > > We used the Mercator example, and ours looks identical to
yours.
> > > > > I proceeded and put 4 files into your FTP server:
> > > > >
> > > > > Model forecast file
> > > > > Radar Obs file
> > > > > Grid Stat Config file
> > > > > domain.poly file
> > > > >
> > > > > The files are under 'garcia_data'
> > > > >
> > > > >
> > > > > Thanks so much for your help,
> > > > > Jose
> > > > > ________________________________________
> > > > > From: Julie Prestopnik via RT <met_help at ucar.edu>
> > > > > Sent: Friday, September 9, 2016 11:50 AM
> > > > > To: Jose Garcia-Rivera
> > > > > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar
> > > > > NETCDF
> > > file
> > > > > for grid_stat verifiction
> > > > >
> > > > > Hi Jose. I have attached a Mercator projection example. If
> > > > > you're still stuck, please post your data to our anonymous
FTP
> > > > > site following these instructions:
> > > > >
http://www.dtcenter.org/met/users/support/met_help.php#ftp
> > > > >
> > > > > Thanks,
> > > > > Julie
> > > > >
> > > > >
> > > > > On Thu, Sep 8, 2016 at 3:25 PM, Jose Garcia-Rivera via RT
> > > > > <met_help at ucar.edu> wrote:
> > > > > >
> > > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823
> > > > > > >
> > > > > >
> > > > > > Dear Julie,
> > > > > >
> > > > > > That's very good information, thanks. We've been working
on
> > > > > > this
> > > issue,
> > > > > however the same error keeps showing up.
> > > > > >
> > > > > > Can we get a Mercator projection example?
> > > > > >
> > > > > > I was wondering if you could have a peek into our netcdf
file,
> > > > > > or
> > run
> > > > an
> > > > > internal test to see what needs to be changed, or what may
be
> wrong.
> > In
> > > > the
> > > > > meantime, we continue working on trying to make the file fit
MET
> > > > > requirements.
> > > > > >
> > > > > > Thanks for the help,
> > > > > > Jose
> > > > > >
> > > > > > ________________________________________
> > > > > > From: Julie Prestopnik via RT <met_help at ucar.edu>
> > > > > > Sent: Thursday, September 8, 2016 3:57 PM
> > > > > > To: Jose Garcia-Rivera
> > > > > > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running
radar
> > > > > > NETCDF
> > > > file
> > > > > for grid_stat verifiction
> > > > > >
> > > > > > Hi Jose.
> > > > > >
> > > > > > Unfortunately, we do not have a radar obs netcdf example
file.
> > With
> > > > > > NetCDF, users have two choices:
> > > > > > --make it look like the NetCDF files that MET generates
(i.e.
> > > > > > the output of pcp_combine) or --put it into CF-compliant
> > > > > > NetCDF The variable can be named "radar_obs" or "precip"
or
> > > > > > anything you'd
> > > > like.
> > > > > >
> > > > > > Julie
> > > > > >
> > > > > >
> > > > > > On Thu, Sep 8, 2016 at 12:10 PM, Jose Garcia-Rivera via RT
> > > > > > <met_help at ucar.edu> wrote:
> > > > > >>
> > > > > >> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823
> > > > > >> >
> > > > > >>
> > > > > >> Dear Julie,
> > > > > >>
> > > > > >> Thanks so much for the file. We haven't been able to work
on
> > > > > >> it
> > yet,
> > > > > since we are fixing computer issues. One more question, do
you
> > > > > have a
> > > > radar
> > > > > obs netcdf example file?
> > > > > >>
> > > > > >> Best Regards,
> > > > > >> Jose
> > > > > >>
> > > > > >> From: Julie Prestopnik via RT <met_help at ucar.edu>
> > > > > >> Sent: Thursday, September 8, 2016 12:58 PM
> > > > > >> To: Jose Garcia-Rivera
> > > > > >> Subject: Re: [rt.rap.ucar.edu #77823] Trouble running
radar
> > NETCDF
> > > > > file for grid_stat verifiction
> > > > > >>
> > > > > >> My apologies. I meant to attach the file in my last
email.
> You
> > > can
> > > > > >> find it attached to this one.
> > > > > >>
> > > > > >> Thanks,
> > > > > >> Julie
> > > > > >>
> > > > > >> On Thu, Sep 8, 2016 at 10:36 AM, Jose Garcia-Rivera via
RT
> > > > > >> <met_help at ucar.edu> wrote:
> > > > > >>>
> > > > > >>> <URL:
> > > > > >>> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823
>
> > > > > >>>
> > > > > >>> Dear Julie,
> > > > > >>>
> > > > > >>> Thanks for the helpful response. Can I have an example
file
> > > > > >>> from
> > > the
> > > > > pcp_combine tool for reference?
> > > > > >>>
> > > > > >>> Best Regards,
> > > > > >>> Jose
> > > > > >>> ________________________________________
> > > > > >>> From: Julie Prestopnik via RT <met_help at ucar.edu>
> > > > > >>> Sent: Thursday, September 8, 2016 11:57 AM
> > > > > >>> To: Jose Garcia-Rivera
> > > > > >>> Subject: Re: [rt.rap.ucar.edu #77823] Trouble running
radar
> > NETCDF
> > > > > file for grid_stat verifiction
> > > > > >>>
> > > > > >>> Hi Jose.
> > > > > >>>
> > > > > >>> I see that you are running MET 5.1, but are unsure of
how
> > > > > >>> the
> > > NetCDF
> > > > > >>> files should be formatted in order for GridStat to be
able
> > > > > >>> to
> > read
> > > > > >>> them.
> > > > > >>>
> > > > > >>> In order it use gridded NetCDF files in MET, you'll need
to
> > > > > >>> make
> > > them
> > > > > >>> look like the output of the pcp_combine tool.
> > > > > >>>
> > > > > >>> Listed below is the header from one of the NetCDF files
from
> > > > > >>> pcp_combine created by the METv5.1 test scripts. Here
are
> > > > > >>> the required parts.
> > > > > >>>
> > > > > >>> (1) dimensions should be named "lat" and "lon"
> > > > > >>> (2) the "lat" and "lon" variable are **NOT** required
> > > > > >>> (3) gridded variables (e.g. APCP_12) must use the
"lat"
> > > > > >>> and
> > "lon"
> > > > > dimensions
> > > > > >>> (4) gridded variables should include the attributes
listed
> > > > > >>> in
> > the
> > > > > >>> example (for timing info, only the init_time_ut,
> > > > > >>> valid_time_ut,
> > and
> > > > > >>> accum_time_sec are actually used. "ut" stands for unix
> > > > > >>> time, the number of seconds since Jan 1, 1970).
> > > > > >>> (5) global attributes should include the
grid/projection
> > > > > >>> information. This example shows how they're specified
for a
> > > lambert
> > > > > >>> conformal projection. Let me know if you're using a
> > > > > >>> different projection and I'll send you an example.
> > > > > >>>
> > > > > >>> I hope that helps get you going.
> > > > > >>>
> > > > > >>> Julie
> > > > > >>>
> > > > > >>>
> > > > > >>>
> > > > > >>> On Wed, Sep 7, 2016 at 3:15 PM, Jose Garcia-Rivera via
RT
> > > > > >>> <met_help at ucar.edu> wrote:
> > > > > >>>>
> > > > > >>>> Wed Sep 07 15:15:39 2016: Request 77823 was acted upon.
> > > > > >>>> Transaction: Ticket created by GarciaJ at imsg.com
> > > > > >>>> Queue: met_help
> > > > > >>>> Subject: Trouble running radar NETCDF file for
> > > > > >>>> grid_stat
> > > > > verifiction
> > > > > >>>> Owner: Nobody
> > > > > >>>> Requestors: GarciaJ at imsg.com
> > > > > >>>> Status: new
> > > > > >>>> Ticket <URL: https://rt.rap.ucar.edu/rt/
> > > > Ticket/Display.html?id=77823
> > > > > >
> > > > > >>>>
> > > > > >>>>
> > > > > >>>> Dear Met Help,
> > > > > >>>>
> > > > > >>>>
> > > > > >>>> I've been trying to run MET using a radar NETCDF file,
and
> > > > > >>>> an
> > NMMB
> > > > > model forecast GRIB file, but the following error shows up:
> > > > > >>>>
> > > > > >>>>
> > > > > >>>> DEBUG 1: Default Config File:
/work/apps/pgi_14.10/SANDY/
> > > > > met-5.1/share/met/config/GridStatConfig_default
> > > > > >>>> DEBUG 1: User Config File: GridStatConfig_dbz ERROR :
> > > > > >>>> ERROR : Trouble reading observation file
> > "Hongqiao.Refl.20150602.
> > > > > s100000.e100500.attributes.nc"
> > > > > >>>> ERROR :
> > > > > >>>>
> > > > > >>>> We used two versions of the OBS file, one as it was,
and
> > > > > >>>> the
> > > second
> > > > > with added "attributes". Still, the same error occurred. We
are
> > > > > not
> > > sure
> > > > on
> > > > > exactly how our NETCDF files need to be for MET to be able
to
> > > > > read
> > > them.
> > > > I
> > > > > searched the error message on the Guide and nothing showed
up.
> > > > > >>>>
> > > > > >>>> We can share the files to your FTP if you want to run
them.
> > > > > >>>>
> > > > > >>>> Any help will be greatly appreciated.
> > > > > >>>>
> > > > > >>>>
> > > > > >>>>
> > > > > >>>> NOTE: We are using MET 5.1
> > > > > >>>>
> > > > > >>>>
> > > > > >>>> Best Regards,
> > > > > >>>>
> > > > > >>>> Jose
> > > > > >>>>
> > > > > >>>>
> > > > > >>>>
> > > > > >>>>
> > > > > >>>> Jose M. Garcia-Rivera, PhD
> > > > > >>>>
> > > > > >>>> Atmospheric Scientist
> > > > > >>>>
> > > > > >>>> IM Systems Group
> > > > > >>>>
> > > > > >>>> Rockville/College Park, MD
> > > > > >>>>
> > > > > >>>> This e-mail, including attachments, may include
> > > > > >>>> confidential
> > > and/or
> > > > > proprietary information, and may be used only by the person
or
> > > > > entity
> > > to
> > > > > which it is addressed. If the reader of this e-mail is not
the
> > intended
> > > > > recipient or his or her authorized agent, the reader is
hereby
> > notified
> > > > > that any dissemination, distribution or copying of this e-
mail
> > > > > is prohibited. If you have received this e-mail in error,
please
> > > > > notify
> > > the
> > > > > sender by replying to this message and delete this e-mail
> > immediately.
> > > > > >>>>
> > > > > >>>>
> > > > > >>>
> > > > > >>>
> > > > > >>>
> > > > > >>> --
> > > > > >>> Julie Prestopnik
> > > > > >>> National Center for Atmospheric Research Research
> > > > > >>> Applications Laboratory
> > > > > >>> Phone: 303.497.8399
> > > > > >>> Email: jpresto at ucar.edu
> > > > > >>>
> > > > > >>>
> > > > > >>> This e-mail, including attachments, may include
confidential
> > and/or
> > > > > proprietary information, and may be used only by the person
or
> > > > > entity
> > > to
> > > > > which it is addressed. If the reader of this e-mail is not
the
> > intended
> > > > > recipient or his or her authorized agent, the reader is
hereby
> > notified
> > > > > that any dissemination, distribution or copying of this e-
mail
> > > > > is prohibited. If you have received this e-mail in error,
please
> > > > > notify
> > > the
> > > > > sender by replying to this message and delete this e-mail
> > immediately.
> > > > > >>>
> > > > > >>>
> > > > > >>
> > > > > >>
> > > > > >>
> > > > > >> --
> > > > > >> Julie Prestopnik
> > > > > >> National Center for Atmospheric Research Research
> > > > > >> Applications Laboratory
> > > > > >> Phone: 303.497.8399
> > > > > >> Email: jpresto at ucar.edu
> > > > > >>
> > > > > >> This e-mail, including attachments, may include
confidential
> > and/or
> > > > > proprietary information, and may be used only by the person
or
> > > > > entity
> > > to
> > > > > which it is addressed. If the reader of this e-mail is not
the
> > intended
> > > > > recipient or his or her authorized agent, the reader is
hereby
> > notified
> > > > > that any dissemination, distribution or copying of this e-
mail
> > > > > is prohibited. If you have received this e-mail in error,
please
> > > > > notify
> > > the
> > > > > sender by replying to this message and delete this e-mail
> > immediately.
> > > > > >>
> > > > > >>
> > > > > >
> > > > > >
> > > > > >
> > > > > > --
> > > > > > Julie Prestopnik
> > > > > > National Center for Atmospheric Research Research
Applications
> > > > > > Laboratory
> > > > > > Phone: 303.497.8399
> > > > > > Email: jpresto at ucar.edu
> > > > > >
> > > > > >
> > > > > > This e-mail, including attachments, may include
confidential
> > > > > > and/or
> > > > > proprietary information, and may be used only by the person
or
> > > > > entity
> > > to
> > > > > which it is addressed. If the reader of this e-mail is not
the
> > intended
> > > > > recipient or his or her authorized agent, the reader is
hereby
> > notified
> > > > > that any dissemination, distribution or copying of this e-
mail
> > > > > is prohibited. If you have received this e-mail in error,
please
> > > > > notify
> > > the
> > > > > sender by replying to this message and delete this e-mail
> > immediately.
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > > >
> > > > > --
> > > > > Julie Prestopnik
> > > > > National Center for Atmospheric Research Research
Applications
> > > > > Laboratory
> > > > > Phone: 303.497.8399
> > > > > Email: jpresto at ucar.edu
> > > > >
> > > > > This e-mail, including attachments, may include confidential
> > > > > and/or proprietary information, and may be used only by the
> > > > > person or entity
> > > to
> > > > > which it is addressed. If the reader of this e-mail is not
the
> > intended
> > > > > recipient or his or her authorized agent, the reader is
hereby
> > notified
> > > > > that any dissemination, distribution or copying of this e-
mail
> > > > > is prohibited. If you have received this e-mail in error,
please
> > > > > notify
> > > the
> > > > > sender by replying to this message and delete this e-mail
> > immediately.
> > > > >
> > > > >
> > > > >
> > > >
> > > >
> > > > --
> > > > Julie Prestopnik
> > > > National Center for Atmospheric Research Research Applications
> > > > Laboratory
> > > > Phone: 303.497.8399
> > > > Email: jpresto at ucar.edu
> > > >
> > > > This e-mail, including attachments, may include confidential
> > > > and/or proprietary information, and may be used only by the
person
> > > > or entity
> > to
> > > > which it is addressed. If the reader of this e-mail is not the
> > > > intended recipient or his or her authorized agent, the reader
is
> > > > hereby notified that any dissemination, distribution or
copying of
> > > > this e-mail is prohibited. If you have received this e-mail in
> > > > error, please notify
> > the
> > > > sender by replying to this message and delete this e-mail
> immediately.
> > > >
> > > >
> > > >
> > >
> > > This e-mail, including attachments, may include confidential
and/or
> > > proprietary information, and may be used only by the person or
> > > entity to which it is addressed. If the reader of this e-mail is
not
> > > the intended recipient or his or her authorized agent, the
reader is
> > > hereby notified that any dissemination, distribution or copying
of
> > > this e-mail is prohibited. If you have received this e-mail in
> > > error, please notify the sender by replying to this message and
delete
> this e-mail immediately.
> > >
> > >
> > >
> >
> >
> > --
> > Julie Prestopnik
> > National Center for Atmospheric Research Research Applications
> > Laboratory
> > Phone: 303.497.8399
> > Email: jpresto at ucar.edu
> >
> > This e-mail, including attachments, may include confidential
and/or
> > proprietary information, and may be used only by the person or
entity
> > to which it is addressed. If the reader of this e-mail is not the
> > intended recipient or his or her authorized agent, the reader is
> > hereby notified that any dissemination, distribution or copying of
> > this e-mail is prohibited. If you have received this e-mail in
error,
> > please notify the sender by replying to this message and delete
this
> e-mail immediately.
> >
> >
>
>
> --
> Julie Prestopnik
> National Center for Atmospheric Research Research Applications
Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
> This e-mail, including attachments, may include confidential and/or
> proprietary information, and may be used only by the person or
entity to
> which it is addressed. If the reader of this e-mail is not the
intended
> recipient or his or her authorized agent, the reader is hereby
notified
> that any dissemination, distribution or copying of this e-mail is
> prohibited. If you have received this e-mail in error, please notify
the
> sender by replying to this message and delete this e-mail
immediately.
>
>
>
--
Julie Prestopnik
National Center for Atmospheric Research
Research Applications Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
------------------------------------------------
Subject: Trouble running radar NETCDF file for grid_stat verifiction
From: Jose Garcia-Rivera
Time: Tue Sep 13 12:45:20 2016
Dear Julie,
Yes, I got the same result as you running plot_data_plane. When I plot
the file directly using NCL, I got the correct image. When using
grid_stat and plot_data_plane the image went flipped. So there may be
an issue with the required configuration of the file for MET to
correctly read it. What do you think?
Attached is the output confirming your results.
Thanks,
Jose
-----Original Message-----
From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
Sent: Tuesday, September 13, 2016 1:59 PM
To: Jose Garcia-Rivera
Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar NETCDF
file for grid_stat verifiction
Hi Jose.
When I ran plot_data_plane on the input observation file,
RadarObsNEW_mod_v3.nc, I produced the image I sent you, which looked
similar to the met_OBS.png file that you sent me in that it was
flipped upside-down. So, I produced a similar image pre-grid_stat,
using the raw observation file.
How did you produce your radar_OBS.png plot? Could you please try
running plot_data_plane on the radar observation file and see if you
get the same output we do? I suspect the problem lies in the way the
radar NetCDF file is being written.
Thanks,
Julie
On Tue, Sep 13, 2016 at 11:53 AM, Jose Garcia-Rivera via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
>
> Hi Julie,
>
> Thanks for checking out. The met_OBS.png is the output I got from
> grid_stat. The correct file is radar_OBS.png plot. So, that may mean
> that you are getting the same issue I got. Have you seen this
happening before?
>
> Best Regards,
> Jose
>
>
>
> -----Original Message-----
> From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> Sent: Tuesday, September 13, 2016 1:21 PM
> To: Jose Garcia-Rivera
> Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar NETCDF
> file for grid_stat verifiction
>
> Hi Jose.
>
> When I plot the NetCDF3 obs file that we created using nccopy
> (RadarObsNEW_mod_v3.nc) using plot_data_plane:
>
> /usr/local/met-5.2/bin/plot_data_plane RadarObsNEW_mod_v3.nc
> RadarObsNEW_mod_v3.ps 'name="REFC"; level="(*,*)";'
>
> The resulting image, RadarObsNEW_mod_v3.ps (attached), appears to be
> oriented in the same way as the met_OBS.png image that you attached,
> so I don't believe that grid_stat is doing anything to the data, but
> rather that the data was placed into the original NetCDF Obs data
and
> needs to be re-oriented there.
>
> Please let me know if you find that is not the case. Please try
> running plot_data_plane on the data that produced the radar_OBS.png
> file and see if you get the same result.
>
> Thanks,
> Julie
>
> On Tue, Sep 13, 2016 at 9:20 AM, Jose Garcia-Rivera via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
> >
> > Dear Julie, John
> >
> > The commands worked fine. Thank you so much!
> >
> > Now, there's something that is puzzling us. The radar data from
the
> > grid_stat.nc output file seems to be flipped upside-down. I
attached
> > the MET-produced OBS vs the original OBS. Is this an artifact of
> > grid_stat, or how can it be fixed?
> >
> >
> >
> > Best Regards,
> > Jose
> >
> > ________________________________________
> > From: Julie Prestopnik via RT <met_help at ucar.edu>
> > Sent: Friday, September 9, 2016 4:07 PM
> > To: Jose Garcia-Rivera
> > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar NETCDF
> > file for grid_stat verifiction
> >
> > Hi Jose.
> >
> > As John indicated the problem lies in that currently MET only
> > supports the classic data model... i.e. NetCDF3, which the file
> > RadarObsNEW.nc is
> not.
> >
> > Running "file RadarObsNEW.nc" shows that the file is not "NetCDF
> > Data Format data", but rather:
> >
> > RadarObsNEW.nc: Hierarchical Data Format (version 5) data
> >
> > You can create a NetCDF3 file when you create the file or you can
> > use the "nccopy" command. However, "nccopy" didn't work with the
> > RadarObsNEW.nc file, until we made some changes. We used
"ncatted"
> > to remove the "L" from the value of the following attributes:
> > parameter_table_version, parameter_number, level_indicator, nx,
and
> > ny. I'll paste in the commands that we used to create a NetCDF3
> > file, plot the data, and get a successful run from grid_stat.
> >
> > # Update attributes to remove longs
> > /usr/local/nco/bin/ncatted \
> > -a parameter_table_version,REFC,o,f,129 \ -a
> > parameter_number,REFC,o,f,212 \ -a level_indicator,REFC,o,f,200 \
-a
> > nx,global,o,i,674 \ -a ny,global,o,i,620 \ RadarObsNEW.nc
> > RadarObsNEW_mod.nc
> >
> > # Convert from NC4 to NC3
> > /usr/local/netcdf/bin/nccopy -3 RadarObsNEW_mod.nc
> > RadarObsNEW_mod_v3.nc
> >
> > # Regrid to global grid
> > /usr/local/met-5.2/bin/regrid_data_plane \ RadarObsNEW_mod_v3.nc
> > G004 RadarObsNEW_mod_v3_G004.nc \ -field 'name="REFC";
level="(*,*)";'
> >
> > # Plot the result
> > /usr/local/met-5.2/bin/plot_data_plane \
RadarObsNEW_mod_v3_G004.nc
> > RadarObsNEW_mod_v3_G004.ps \ 'name="REFC"; level="(*,*)";'
> >
> > # Display plot
> > convert -rotate 90 -background white -flatten
> > RadarObsNEW_mod_v3_G004.ps RadarObsNEW_mod_v3_G004.png display
> > RadarObsNEW_mod_v3_G004.png&
> >
> > # Plot forecast REFC
> > /usr/local/met-5.2/bin/plot_data_plane \ ForecastFile.grb
> > refc_fcst.ps \ 'name="REFC"; level="L0"; GRIB1_ptv=129;'
> >
> > # Display plot
> > convert -rotate 90 -background white -flatten refc_fcst.ps
> > refc_fcst.png display refc_fcst.png&
> >
> > # Run grid_stat
> > /usr/local/met-5.1/bin/grid_stat ForecastFile.grb
> > RadarObsNEW_mod_v3.nc GridStatConfig_dbz -outdir out/
> >
> > I have also attached the NetCDF3 file that we produced after using
> > ncatted and nccopy.
> >
> > Please let us know if you have any other questions.
> >
> > Thanks,
> > Julie
> >
> >
> > On Fri, Sep 9, 2016 at 12:43 PM, Jose Garcia-Rivera via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
> > >
> > > Hi John,
> > >
> > > Glad to talk to you again. We did the proposed changes, and the
> > > error keeps showing up.
> > >
> > > I uploaded the new file as: RadarObsNEW.nc
> > >
> > > Please try to run it and let me know what issues show up?
> > >
> > > Thanks for the help,
> > > Jose
> > > ________________________________________
> > > From: John Halley Gotway via RT <met_help at ucar.edu>
> > > Sent: Friday, September 9, 2016 2:17 PM
> > > To: Jose Garcia-Rivera
> > > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar
NETCDF
> > > file for grid_stat verifiction
> > >
> > > Hello Jose,
> > >
> > > This is John Halley Gotway. I work with Julie on providing
> > > support for MET.
> > >
> > > I think there's a few pieces of info we're missing here.
> > >
> > > (1) MET does not currently support the enhanced data model of
NetCDF4.
> > It
> > > only supports the classic data model... i.e. NetCDF3. In the
next
> > version
> > > of MET (6.0), due out next year, we'll be adding support for
NetCDF4.
> > The
> > > file you sent us in NetCDF4 but when Julie add those attributes
> > > she may have used ncdump/ncgen. And their output is NetCDF3.
Try
> > > updating your NCL script to write a "classic" NetCDF file.
> > >
> > > (2) Yes, the "MET_version" global attribute needs to be present.
> > > That tells MET how to parse the grid information.
> > >
> > > (3) I'm not sure that the variable "name" attribute is
necessary,
> > > but it doesn't hurt.
> > >
> > > (4) The biggest problem is in the definition of your Mercator
grid:
> > > :Projection = "Mercator" ;
> > > :lat_ll = "3348550.177 degrees_north" ;
> > > :lon_ll = "13120540.425 degrees_east" ;
> > > :lat_ur = "4057346.9 degrees_north" ;
> > > :lon_ur = "13891071.057 degrees_east" ;
> > >
> > > Those don't look like very meaningful lat/lon values! Where did
> > > you get these numbers? Are they meant to match the grid defined
> > > in the GRIB file you sent us?
> > >
> > > Thanks,
> > > John
> > >
> > > On Fri, Sep 9, 2016 at 12:08 PM, Jose Garcia-Rivera via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823
>
> > > >
> > > > Dear Julie,
> > > >
> > > > The file that you modified worked. However, we did the changes
> > > > you
> > made,
> > > > and grid_stat continues to show the same error.
> > > >
> > > > I've uploaded the file in the same FTP directory, named:
> > > > Hongqiao.Refl.20150602.s100000.e100500.attributes.nc
> > > >
> > > > This is a file dump of our modified netcdf:
> > > >
> > > > NCAR Command Language Version 6.3.0 The use of this software
is
> > > > governed by a License Agreement.
> > > > See http://www.ncl.ucar.edu/ for more details.
> > > >
> > > > Variable: f
> > > > Type: file
> > > > filename:
Hongqiao.Refl.20150602.s100000.e100500.attributes
> > > > path: Hongqiao.Refl.20150602.s100000.e100500.attributes.nc
> > > > Number of Attributes:8
> > > > MET_version : V5.1
> > > > Projection : Mercator
> > > > lat_ll : 3348550.177 degrees_north
> > > > lon_ll : 13120540.425 degrees_east
> > > > lat_ur : 4057346.9 degrees_north
> > > > lon_ur : 13891071.057 degrees_east
> > > > nx : 674
> > > > ny : 620
> > > >
> > > > dimensions:
> > > > lon = 674
> > > > lat = 620
> > > >
> > > > variables:
> > > > Variable: lat
> > > > Type: float
> > > > Total Size: 417880 values
> > > > 1671520 bytes
> > > > Number of Dimensions: 2
> > > > Dimensions and sizes: [ 620 <lat> x 674 <lon> ]
> > > > Coordinates:
> > > > lat: [4057347..4057347]
> > > > lon: [1.312054e+07..1.388993e+07]
> > > > Number of Attributes: 2
> > > > units : degrees_north
> > > > standard_name : latitude
> > > >
> > > > Variable: lon
> > > > Type: float
> > > > Total Size: 417880 values
> > > > 1671520 bytes
> > > > Number of Dimensions: 2
> > > > Dimensions and sizes: [ 620 <lat> x 674 <lon> ]
> > > > Coordinates:
> > > > lat: [4057347..4057347]
> > > > lon: [1.312054e+07..1.388993e+07]
> > > > Number of Attributes: 2
> > > > units : degrees_east
> > > > standard_name : longitude
> > > >
> > > > Variable: REFC
> > > > Type: float
> > > > Total Size: 417880 values
> > > > 1671520 bytes
> > > > Number of Dimensions: 2
> > > > Dimensions and sizes: [ 620 <lat> x 674 <lon> ]
> > > > Coordinates:
> > > > lat: [4057347..4057347]
> > > > lon: [1.312054e+07..1.388993e+07]
> > > > Number of Attributes: 11
> > > > name : REFC
> > > > units : dbZ
> > > > parameter_table_version : 129
> > > > parameter_number : 212
> > > > level_indicator : 200
> > > > level : L0
> > > > long_name : MaxReflectivity
> > > > init_time : 20050807_000000
> > > > init_time_ut : 1123372800
> > > > valid_time : 20050807_120000
> > > > valid_time_ut : 1123416000
> > > >
> > > >
> > > >
> > > > Best Regards,
> > > > Jose
> > > >
> > > >
> > > > ________________________________________
> > > > From: Julie Prestopnik via RT <met_help at ucar.edu>
> > > > Sent: Friday, September 9, 2016 1:09 PM
> > > > To: Jose Garcia-Rivera
> > > > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar
> > > > NETCDF
> > file
> > > > for grid_stat verifiction
> > > >
> > > > Hi Jose. Thank you for uploading your data. There were two
> > > > important things missing from your file.
> > > >
> > > > I added:
> > > >
> > > > REFC:name = "REFC" ;
> > > >
> > > > under:
> > > >
> > > > float REFC(lat, lon) ;
> > > >
> > > > and I added:
> > > >
> > > > :MET_version = "V5.1" ;
> > > >
> > > > under // global attributes:
> > > >
> > > > and was able to get a successful run of grid_stat.
> > > >
> > > > I am attaching the file with the changes. Please give it a
try
> > > > and let
> > > me
> > > > know if you get a successful run as well.
> > > >
> > > > Thanks,
> > > > Julie
> > > >
> > > > On Fri, Sep 9, 2016 at 10:38 AM, Jose Garcia-Rivera via RT <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > > >
> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823
> > > > > >
> > > > >
> > > > > Dear Julie,
> > > > >
> > > > > We used the Mercator example, and ours looks identical to
yours.
> > > > > I proceeded and put 4 files into your FTP server:
> > > > >
> > > > > Model forecast file
> > > > > Radar Obs file
> > > > > Grid Stat Config file
> > > > > domain.poly file
> > > > >
> > > > > The files are under 'garcia_data'
> > > > >
> > > > >
> > > > > Thanks so much for your help,
> > > > > Jose
> > > > > ________________________________________
> > > > > From: Julie Prestopnik via RT <met_help at ucar.edu>
> > > > > Sent: Friday, September 9, 2016 11:50 AM
> > > > > To: Jose Garcia-Rivera
> > > > > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar
> > > > > NETCDF
> > > file
> > > > > for grid_stat verifiction
> > > > >
> > > > > Hi Jose. I have attached a Mercator projection example. If
> > > > > you're still stuck, please post your data to our anonymous
FTP
> > > > > site following these instructions:
> > > > >
http://www.dtcenter.org/met/users/support/met_help.php#ftp
> > > > >
> > > > > Thanks,
> > > > > Julie
> > > > >
> > > > >
> > > > > On Thu, Sep 8, 2016 at 3:25 PM, Jose Garcia-Rivera via RT
> > > > > <met_help at ucar.edu> wrote:
> > > > > >
> > > > > > <URL:
> > > > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823
> > > > > > >
> > > > > >
> > > > > > Dear Julie,
> > > > > >
> > > > > > That's very good information, thanks. We've been working
on
> > > > > > this
> > > issue,
> > > > > however the same error keeps showing up.
> > > > > >
> > > > > > Can we get a Mercator projection example?
> > > > > >
> > > > > > I was wondering if you could have a peek into our netcdf
> > > > > > file, or
> > run
> > > > an
> > > > > internal test to see what needs to be changed, or what may
be
> wrong.
> > In
> > > > the
> > > > > meantime, we continue working on trying to make the file fit
> > > > > MET requirements.
> > > > > >
> > > > > > Thanks for the help,
> > > > > > Jose
> > > > > >
> > > > > > ________________________________________
> > > > > > From: Julie Prestopnik via RT <met_help at ucar.edu>
> > > > > > Sent: Thursday, September 8, 2016 3:57 PM
> > > > > > To: Jose Garcia-Rivera
> > > > > > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running
radar
> > > > > > NETCDF
> > > > file
> > > > > for grid_stat verifiction
> > > > > >
> > > > > > Hi Jose.
> > > > > >
> > > > > > Unfortunately, we do not have a radar obs netcdf example
file.
> > With
> > > > > > NetCDF, users have two choices:
> > > > > > --make it look like the NetCDF files that MET generates
(i.e.
> > > > > > the output of pcp_combine) or --put it into CF-compliant
> > > > > > NetCDF The variable can be named "radar_obs" or "precip"
or
> > > > > > anything you'd
> > > > like.
> > > > > >
> > > > > > Julie
> > > > > >
> > > > > >
> > > > > > On Thu, Sep 8, 2016 at 12:10 PM, Jose Garcia-Rivera via RT
> > > > > > <met_help at ucar.edu> wrote:
> > > > > >>
> > > > > >> <URL:
> > > > > >> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823
> > > > > >> >
> > > > > >>
> > > > > >> Dear Julie,
> > > > > >>
> > > > > >> Thanks so much for the file. We haven't been able to work
> > > > > >> on it
> > yet,
> > > > > since we are fixing computer issues. One more question, do
you
> > > > > have a
> > > > radar
> > > > > obs netcdf example file?
> > > > > >>
> > > > > >> Best Regards,
> > > > > >> Jose
> > > > > >>
> > > > > >> From: Julie Prestopnik via RT <met_help at ucar.edu>
> > > > > >> Sent: Thursday, September 8, 2016 12:58 PM
> > > > > >> To: Jose Garcia-Rivera
> > > > > >> Subject: Re: [rt.rap.ucar.edu #77823] Trouble running
radar
> > NETCDF
> > > > > file for grid_stat verifiction
> > > > > >>
> > > > > >> My apologies. I meant to attach the file in my last
email.
> You
> > > can
> > > > > >> find it attached to this one.
> > > > > >>
> > > > > >> Thanks,
> > > > > >> Julie
> > > > > >>
> > > > > >> On Thu, Sep 8, 2016 at 10:36 AM, Jose Garcia-Rivera via
RT
> > > > > >> <met_help at ucar.edu> wrote:
> > > > > >>>
> > > > > >>> <URL:
> > > > > >>> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823
>
> > > > > >>>
> > > > > >>> Dear Julie,
> > > > > >>>
> > > > > >>> Thanks for the helpful response. Can I have an example
> > > > > >>> file from
> > > the
> > > > > pcp_combine tool for reference?
> > > > > >>>
> > > > > >>> Best Regards,
> > > > > >>> Jose
> > > > > >>> ________________________________________
> > > > > >>> From: Julie Prestopnik via RT <met_help at ucar.edu>
> > > > > >>> Sent: Thursday, September 8, 2016 11:57 AM
> > > > > >>> To: Jose Garcia-Rivera
> > > > > >>> Subject: Re: [rt.rap.ucar.edu #77823] Trouble running
> > > > > >>> radar
> > NETCDF
> > > > > file for grid_stat verifiction
> > > > > >>>
> > > > > >>> Hi Jose.
> > > > > >>>
> > > > > >>> I see that you are running MET 5.1, but are unsure of
how
> > > > > >>> the
> > > NetCDF
> > > > > >>> files should be formatted in order for GridStat to be
able
> > > > > >>> to
> > read
> > > > > >>> them.
> > > > > >>>
> > > > > >>> In order it use gridded NetCDF files in MET, you'll need
> > > > > >>> to make
> > > them
> > > > > >>> look like the output of the pcp_combine tool.
> > > > > >>>
> > > > > >>> Listed below is the header from one of the NetCDF files
> > > > > >>> from pcp_combine created by the METv5.1 test scripts.
> > > > > >>> Here are the required parts.
> > > > > >>>
> > > > > >>> (1) dimensions should be named "lat" and "lon"
> > > > > >>> (2) the "lat" and "lon" variable are **NOT** required
> > > > > >>> (3) gridded variables (e.g. APCP_12) must use the
"lat"
> > > > > >>> and
> > "lon"
> > > > > dimensions
> > > > > >>> (4) gridded variables should include the attributes
> > > > > >>> listed in
> > the
> > > > > >>> example (for timing info, only the init_time_ut,
> > > > > >>> valid_time_ut,
> > and
> > > > > >>> accum_time_sec are actually used. "ut" stands for unix
> > > > > >>> time, the number of seconds since Jan 1, 1970).
> > > > > >>> (5) global attributes should include the
grid/projection
> > > > > >>> information. This example shows how they're specified
for
> > > > > >>> a
> > > lambert
> > > > > >>> conformal projection. Let me know if you're using a
> > > > > >>> different projection and I'll send you an example.
> > > > > >>>
> > > > > >>> I hope that helps get you going.
> > > > > >>>
> > > > > >>> Julie
> > > > > >>>
> > > > > >>>
> > > > > >>>
> > > > > >>> On Wed, Sep 7, 2016 at 3:15 PM, Jose Garcia-Rivera via
RT
> > > > > >>> <met_help at ucar.edu> wrote:
> > > > > >>>>
> > > > > >>>> Wed Sep 07 15:15:39 2016: Request 77823 was acted upon.
> > > > > >>>> Transaction: Ticket created by GarciaJ at imsg.com
> > > > > >>>> Queue: met_help
> > > > > >>>> Subject: Trouble running radar NETCDF file for
> > > > > >>>> grid_stat
> > > > > verifiction
> > > > > >>>> Owner: Nobody
> > > > > >>>> Requestors: GarciaJ at imsg.com
> > > > > >>>> Status: new
> > > > > >>>> Ticket <URL: https://rt.rap.ucar.edu/rt/
> > > > Ticket/Display.html?id=77823
> > > > > >
> > > > > >>>>
> > > > > >>>>
> > > > > >>>> Dear Met Help,
> > > > > >>>>
> > > > > >>>>
> > > > > >>>> I've been trying to run MET using a radar NETCDF file,
> > > > > >>>> and an
> > NMMB
> > > > > model forecast GRIB file, but the following error shows up:
> > > > > >>>>
> > > > > >>>>
> > > > > >>>> DEBUG 1: Default Config File:
/work/apps/pgi_14.10/SANDY/
> > > > > met-5.1/share/met/config/GridStatConfig_default
> > > > > >>>> DEBUG 1: User Config File: GridStatConfig_dbz ERROR :
> > > > > >>>> ERROR : Trouble reading observation file
> > "Hongqiao.Refl.20150602.
> > > > > s100000.e100500.attributes.nc"
> > > > > >>>> ERROR :
> > > > > >>>>
> > > > > >>>> We used two versions of the OBS file, one as it was,
and
> > > > > >>>> the
> > > second
> > > > > with added "attributes". Still, the same error occurred. We
> > > > > are not
> > > sure
> > > > on
> > > > > exactly how our NETCDF files need to be for MET to be able
to
> > > > > read
> > > them.
> > > > I
> > > > > searched the error message on the Guide and nothing showed
up.
> > > > > >>>>
> > > > > >>>> We can share the files to your FTP if you want to run
them.
> > > > > >>>>
> > > > > >>>> Any help will be greatly appreciated.
> > > > > >>>>
> > > > > >>>>
> > > > > >>>>
> > > > > >>>> NOTE: We are using MET 5.1
> > > > > >>>>
> > > > > >>>>
> > > > > >>>> Best Regards,
> > > > > >>>>
> > > > > >>>> Jose
> > > > > >>>>
> > > > > >>>>
> > > > > >>>>
> > > > > >>>>
> > > > > >>>> Jose M. Garcia-Rivera, PhD
> > > > > >>>>
> > > > > >>>> Atmospheric Scientist
> > > > > >>>>
> > > > > >>>> IM Systems Group
> > > > > >>>>
> > > > > >>>> Rockville/College Park, MD
> > > > > >>>>
> > > > > >>>> This e-mail, including attachments, may include
> > > > > >>>> confidential
> > > and/or
> > > > > proprietary information, and may be used only by the person
or
> > > > > entity
> > > to
> > > > > which it is addressed. If the reader of this e-mail is not
the
> > intended
> > > > > recipient or his or her authorized agent, the reader is
hereby
> > notified
> > > > > that any dissemination, distribution or copying of this e-
mail
> > > > > is prohibited. If you have received this e-mail in error,
> > > > > please notify
> > > the
> > > > > sender by replying to this message and delete this e-mail
> > immediately.
> > > > > >>>>
> > > > > >>>>
> > > > > >>>
> > > > > >>>
> > > > > >>>
> > > > > >>> --
> > > > > >>> Julie Prestopnik
> > > > > >>> National Center for Atmospheric Research Research
> > > > > >>> Applications Laboratory
> > > > > >>> Phone: 303.497.8399
> > > > > >>> Email: jpresto at ucar.edu
> > > > > >>>
> > > > > >>>
> > > > > >>> This e-mail, including attachments, may include
> > > > > >>> confidential
> > and/or
> > > > > proprietary information, and may be used only by the person
or
> > > > > entity
> > > to
> > > > > which it is addressed. If the reader of this e-mail is not
the
> > intended
> > > > > recipient or his or her authorized agent, the reader is
hereby
> > notified
> > > > > that any dissemination, distribution or copying of this e-
mail
> > > > > is prohibited. If you have received this e-mail in error,
> > > > > please notify
> > > the
> > > > > sender by replying to this message and delete this e-mail
> > immediately.
> > > > > >>>
> > > > > >>>
> > > > > >>
> > > > > >>
> > > > > >>
> > > > > >> --
> > > > > >> Julie Prestopnik
> > > > > >> National Center for Atmospheric Research Research
> > > > > >> Applications Laboratory
> > > > > >> Phone: 303.497.8399
> > > > > >> Email: jpresto at ucar.edu
> > > > > >>
> > > > > >> This e-mail, including attachments, may include
> > > > > >> confidential
> > and/or
> > > > > proprietary information, and may be used only by the person
or
> > > > > entity
> > > to
> > > > > which it is addressed. If the reader of this e-mail is not
the
> > intended
> > > > > recipient or his or her authorized agent, the reader is
hereby
> > notified
> > > > > that any dissemination, distribution or copying of this e-
mail
> > > > > is prohibited. If you have received this e-mail in error,
> > > > > please notify
> > > the
> > > > > sender by replying to this message and delete this e-mail
> > immediately.
> > > > > >>
> > > > > >>
> > > > > >
> > > > > >
> > > > > >
> > > > > > --
> > > > > > Julie Prestopnik
> > > > > > National Center for Atmospheric Research Research
> > > > > > Applications Laboratory
> > > > > > Phone: 303.497.8399
> > > > > > Email: jpresto at ucar.edu
> > > > > >
> > > > > >
> > > > > > This e-mail, including attachments, may include
confidential
> > > > > > and/or
> > > > > proprietary information, and may be used only by the person
or
> > > > > entity
> > > to
> > > > > which it is addressed. If the reader of this e-mail is not
the
> > intended
> > > > > recipient or his or her authorized agent, the reader is
hereby
> > notified
> > > > > that any dissemination, distribution or copying of this e-
mail
> > > > > is prohibited. If you have received this e-mail in error,
> > > > > please notify
> > > the
> > > > > sender by replying to this message and delete this e-mail
> > immediately.
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > > >
> > > > > --
> > > > > Julie Prestopnik
> > > > > National Center for Atmospheric Research Research
Applications
> > > > > Laboratory
> > > > > Phone: 303.497.8399
> > > > > Email: jpresto at ucar.edu
> > > > >
> > > > > This e-mail, including attachments, may include confidential
> > > > > and/or proprietary information, and may be used only by the
> > > > > person or entity
> > > to
> > > > > which it is addressed. If the reader of this e-mail is not
the
> > intended
> > > > > recipient or his or her authorized agent, the reader is
hereby
> > notified
> > > > > that any dissemination, distribution or copying of this e-
mail
> > > > > is prohibited. If you have received this e-mail in error,
> > > > > please notify
> > > the
> > > > > sender by replying to this message and delete this e-mail
> > immediately.
> > > > >
> > > > >
> > > > >
> > > >
> > > >
> > > > --
> > > > Julie Prestopnik
> > > > National Center for Atmospheric Research Research Applications
> > > > Laboratory
> > > > Phone: 303.497.8399
> > > > Email: jpresto at ucar.edu
> > > >
> > > > This e-mail, including attachments, may include confidential
> > > > and/or proprietary information, and may be used only by the
> > > > person or entity
> > to
> > > > which it is addressed. If the reader of this e-mail is not the
> > > > intended recipient or his or her authorized agent, the reader
is
> > > > hereby notified that any dissemination, distribution or
copying
> > > > of this e-mail is prohibited. If you have received this e-mail
> > > > in error, please notify
> > the
> > > > sender by replying to this message and delete this e-mail
> immediately.
> > > >
> > > >
> > > >
> > >
> > > This e-mail, including attachments, may include confidential
> > > and/or proprietary information, and may be used only by the
person
> > > or entity to which it is addressed. If the reader of this e-mail
> > > is not the intended recipient or his or her authorized agent,
the
> > > reader is hereby notified that any dissemination, distribution
or
> > > copying of this e-mail is prohibited. If you have received this
> > > e-mail in error, please notify the sender by replying to this
> > > message and delete
> this e-mail immediately.
> > >
> > >
> > >
> >
> >
> > --
> > Julie Prestopnik
> > National Center for Atmospheric Research Research Applications
> > Laboratory
> > Phone: 303.497.8399
> > Email: jpresto at ucar.edu
> >
> > This e-mail, including attachments, may include confidential
and/or
> > proprietary information, and may be used only by the person or
> > entity to which it is addressed. If the reader of this e-mail is
not
> > the intended recipient or his or her authorized agent, the reader
is
> > hereby notified that any dissemination, distribution or copying of
> > this e-mail is prohibited. If you have received this e-mail in
> > error, please notify the sender by replying to this message and
> > delete this
> e-mail immediately.
> >
> >
>
>
> --
> Julie Prestopnik
> National Center for Atmospheric Research Research Applications
> Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
> This e-mail, including attachments, may include confidential and/or
> proprietary information, and may be used only by the person or
entity
> to which it is addressed. If the reader of this e-mail is not the
> intended recipient or his or her authorized agent, the reader is
> hereby notified that any dissemination, distribution or copying of
> this e-mail is prohibited. If you have received this e-mail in
error,
> please notify the sender by replying to this message and delete this
e-mail immediately.
>
>
>
--
Julie Prestopnik
National Center for Atmospheric Research Research Applications
Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
This e-mail, including attachments, may include confidential and/or
proprietary information, and may be used only by the person or entity
to which it is addressed. If the reader of this e-mail is not the
intended recipient or his or her authorized agent, the reader is
hereby notified that any dissemination, distribution or copying of
this e-mail is prohibited. If you have received this e-mail in error,
please notify the sender by replying to this message and delete this
e-mail immediately.
------------------------------------------------
Subject: Trouble running radar NETCDF file for grid_stat verifiction
From: John Halley Gotway
Time: Tue Sep 13 14:26:35 2016
Hello Jose,
This is John Halley Gotway. Thought I'd jump in on this one.
I see that you're getting different results when plotting your radar
NetCDF
file via MET (plot_data_plane) and NCL. The MET data is upside-down
relative to the NCL plot.
I suspect the difference is this... When NCL reads that data, it also
reads
the lat and lon variables to place your data on the earth. When MET
reads
the data, it does not. Instead, it just reads the data values in the
order
they're written in the NetCDF file and uses the mapping information
defined
in the global attributes to place the data on earth.
Looking at the your NetCDF I see that the first point is the upper-
left
corner. And MET is expecting the first point to be the lower-left
corner. MET is expecting the data to be packed as lower-left to
upper-right.
I believe that's the source of the discrepancy. And really there's no
way
in the grid projection information to tell MET to flip the data. It's
just
a short-coming of the simplistic way of reading/writing this NetCDF
data.
Hope that helps clarify.
Thanks,
John
On Tue, Sep 13, 2016 at 12:45 PM, Jose Garcia-Rivera via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
>
> Dear Julie,
>
> Yes, I got the same result as you running plot_data_plane. When I
plot the
> file directly using NCL, I got the correct image. When using
grid_stat and
> plot_data_plane the image went flipped. So there may be an issue
with the
> required configuration of the file for MET to correctly read it.
What do
> you think?
>
> Attached is the output confirming your results.
>
> Thanks,
> Jose,
>
> Just
>
> On Tue, Sep 13, 2016 at 12:45 PM, Jose Garcia-Rivera via RT <
> met_help at ucar.edu> wrote:
>
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
>>
>> Dear Julie,
>>
>> Yes, I got the same result as you running plot_data_plane. When I
plot
>> the file directly using NCL, I got the correct image. When using
grid_stat
>> and plot_data_plane the image went flipped. So there may be an
issue with
>> the required configuration of the file for MET to correctly read
it. What
>> do you think?
>>
>> Attached is the output confirming your results.
>>
>> Thanks,
>> Jose
>>
>> -----Original Message-----
>> From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
>> Sent: Tuesday, September 13, 2016 1:59 PM
>> To: Jose Garcia-Rivera
>> Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar NETCDF
file
>> for grid_stat verifiction
>>
>> Hi Jose.
>>
>> When I ran plot_data_plane on the input observation file,
>> RadarObsNEW_mod_v3.nc, I produced the image I sent you, which
looked
>> similar to the met_OBS.png file that you sent me in that it was
flipped
>> upside-down. So, I produced a similar image pre-grid_stat, using
the raw
>> observation file.
>>
>> How did you produce your radar_OBS.png plot? Could you please try
>> running plot_data_plane on the radar observation file and see if
you get
>> the same output we do? I suspect the problem lies in the way the
radar
>> NetCDF file is being written.
>>
>> Thanks,
>> Julie
>>
>>
>>
>> On Tue, Sep 13, 2016 at 11:53 AM, Jose Garcia-Rivera via RT <
>> met_help at ucar.edu> wrote:
>>
>> >
>> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
>> >
>> > Hi Julie,
>> >
>> > Thanks for checking out. The met_OBS.png is the output I got from
>> > grid_stat. The correct file is radar_OBS.png plot. So, that may
mean
>> > that you are getting the same issue I got. Have you seen this
happening
>> before?
>> >
>> > Best Regards,
>> > Jose
>> >
>> >
>> >
>> > -----Original Message-----
>> > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
>> > Sent: Tuesday, September 13, 2016 1:21 PM
>> > To: Jose Garcia-Rivera
>> > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar
NETCDF
>> > file for grid_stat verifiction
>> >
>> > Hi Jose.
>> >
>> > When I plot the NetCDF3 obs file that we created using nccopy
>> > (RadarObsNEW_mod_v3.nc) using plot_data_plane:
>> >
>> > /usr/local/met-5.2/bin/plot_data_plane RadarObsNEW_mod_v3.nc
>> > RadarObsNEW_mod_v3.ps 'name="REFC"; level="(*,*)";'
>> >
>> > The resulting image, RadarObsNEW_mod_v3.ps (attached), appears to
be
>> > oriented in the same way as the met_OBS.png image that you
attached,
>> > so I don't believe that grid_stat is doing anything to the data,
but
>> > rather that the data was placed into the original NetCDF Obs data
and
>> > needs to be re-oriented there.
>> >
>> > Please let me know if you find that is not the case. Please try
>> > running plot_data_plane on the data that produced the
radar_OBS.png
>> > file and see if you get the same result.
>> >
>> > Thanks,
>> > Julie
>> >
>> > On Tue, Sep 13, 2016 at 9:20 AM, Jose Garcia-Rivera via RT <
>> > met_help at ucar.edu> wrote:
>> >
>> > >
>> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
>> > >
>> > > Dear Julie, John
>> > >
>> > > The commands worked fine. Thank you so much!
>> > >
>> > > Now, there's something that is puzzling us. The radar data from
the
>> > > grid_stat.nc output file seems to be flipped upside-down. I
attached
>> > > the MET-produced OBS vs the original OBS. Is this an artifact
of
>> > > grid_stat, or how can it be fixed?
>> > >
>> > >
>> > >
>> > > Best Regards,
>> > > Jose
>> > >
>> > > ________________________________________
>> > > From: Julie Prestopnik via RT <met_help at ucar.edu>
>> > > Sent: Friday, September 9, 2016 4:07 PM
>> > > To: Jose Garcia-Rivera
>> > > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar
NETCDF
>> > > file for grid_stat verifiction
>> > >
>> > > Hi Jose.
>> > >
>> > > As John indicated the problem lies in that currently MET only
>> > > supports the classic data model... i.e. NetCDF3, which the file
>> > > RadarObsNEW.nc is
>> > not.
>> > >
>> > > Running "file RadarObsNEW.nc" shows that the file is not
"NetCDF
>> > > Data Format data", but rather:
>> > >
>> > > RadarObsNEW.nc: Hierarchical Data Format (version 5) data
>> > >
>> > > You can create a NetCDF3 file when you create the file or you
can
>> > > use the "nccopy" command. However, "nccopy" didn't work with
the
>> > > RadarObsNEW.nc file, until we made some changes. We used
"ncatted"
>> > > to remove the "L" from the value of the following attributes:
>> > > parameter_table_version, parameter_number, level_indicator, nx,
and
>> > > ny. I'll paste in the commands that we used to create a
NetCDF3
>> > > file, plot the data, and get a successful run from grid_stat.
>> > >
>> > > # Update attributes to remove longs
>> > > /usr/local/nco/bin/ncatted \
>> > > -a parameter_table_version,REFC,o,f,129 \ -a
>> > > parameter_number,REFC,o,f,212 \ -a level_indicator,REFC,o,f,200
\ -a
>> > > nx,global,o,i,674 \ -a ny,global,o,i,620 \ RadarObsNEW.nc
>> > > RadarObsNEW_mod.nc
>> > >
>> > > # Convert from NC4 to NC3
>> > > /usr/local/netcdf/bin/nccopy -3 RadarObsNEW_mod.nc
>> > > RadarObsNEW_mod_v3.nc
>> > >
>> > > # Regrid to global grid
>> > > /usr/local/met-5.2/bin/regrid_data_plane \
RadarObsNEW_mod_v3.nc
>> > > G004 RadarObsNEW_mod_v3_G004.nc \ -field 'name="REFC";
level="(*,*)";'
>> > >
>> > > # Plot the result
>> > > /usr/local/met-5.2/bin/plot_data_plane \
RadarObsNEW_mod_v3_G004.nc
>> > > RadarObsNEW_mod_v3_G004.ps \ 'name="REFC"; level="(*,*)";'
>> > >
>> > > # Display plot
>> > > convert -rotate 90 -background white -flatten
>> > > RadarObsNEW_mod_v3_G004.ps RadarObsNEW_mod_v3_G004.png display
>> > > RadarObsNEW_mod_v3_G004.png&
>> > >
>> > > # Plot forecast REFC
>> > > /usr/local/met-5.2/bin/plot_data_plane \ ForecastFile.grb
>> > > refc_fcst.ps \ 'name="REFC"; level="L0"; GRIB1_ptv=129;'
>> > >
>> > > # Display plot
>> > > convert -rotate 90 -background white -flatten refc_fcst.ps
>> > > refc_fcst.png display refc_fcst.png&
>> > >
>> > > # Run grid_stat
>> > > /usr/local/met-5.1/bin/grid_stat ForecastFile.grb
>> > > RadarObsNEW_mod_v3.nc GridStatConfig_dbz -outdir out/
>> > >
>> > > I have also attached the NetCDF3 file that we produced after
using
>> > > ncatted and nccopy.
>> > >
>> > > Please let us know if you have any other questions.
>> > >
>> > > Thanks,
>> > > Julie
>> > >
>> > >
>> > > On Fri, Sep 9, 2016 at 12:43 PM, Jose Garcia-Rivera via RT <
>> > > met_help at ucar.edu> wrote:
>> > >
>> > > >
>> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823
>
>> > > >
>> > > > Hi John,
>> > > >
>> > > > Glad to talk to you again. We did the proposed changes, and
the
>> > > > error keeps showing up.
>> > > >
>> > > > I uploaded the new file as: RadarObsNEW.nc
>> > > >
>> > > > Please try to run it and let me know what issues show up?
>> > > >
>> > > > Thanks for the help,
>> > > > Jose
>> > > > ________________________________________
>> > > > From: John Halley Gotway via RT <met_help at ucar.edu>
>> > > > Sent: Friday, September 9, 2016 2:17 PM
>> > > > To: Jose Garcia-Rivera
>> > > > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar
NETCDF
>> > > > file for grid_stat verifiction
>> > > >
>> > > > Hello Jose,
>> > > >
>> > > > This is John Halley Gotway. I work with Julie on providing
>> > > > support for MET.
>> > > >
>> > > > I think there's a few pieces of info we're missing here.
>> > > >
>> > > > (1) MET does not currently support the enhanced data model of
>> NetCDF4.
>> > > It
>> > > > only supports the classic data model... i.e. NetCDF3. In the
next
>> > > version
>> > > > of MET (6.0), due out next year, we'll be adding support for
>> NetCDF4.
>> > > The
>> > > > file you sent us in NetCDF4 but when Julie add those
attributes
>> > > > she may have used ncdump/ncgen. And their output is NetCDF3.
Try
>> > > > updating your NCL script to write a "classic" NetCDF file.
>> > > >
>> > > > (2) Yes, the "MET_version" global attribute needs to be
present.
>> > > > That tells MET how to parse the grid information.
>> > > >
>> > > > (3) I'm not sure that the variable "name" attribute is
necessary,
>> > > > but it doesn't hurt.
>> > > >
>> > > > (4) The biggest problem is in the definition of your Mercator
grid:
>> > > > :Projection = "Mercator" ;
>> > > > :lat_ll = "3348550.177 degrees_north" ;
>> > > > :lon_ll = "13120540.425 degrees_east" ;
>> > > > :lat_ur = "4057346.9 degrees_north" ;
>> > > > :lon_ur = "13891071.057 degrees_east" ;
>> > > >
>> > > > Those don't look like very meaningful lat/lon values! Where
did
>> > > > you get these numbers? Are they meant to match the grid
defined
>> > > > in the GRIB file you sent us?
>> > > >
>> > > > Thanks,
>> > > > John
>> > > >
>> > > > On Fri, Sep 9, 2016 at 12:08 PM, Jose Garcia-Rivera via RT <
>> > > > met_help at ucar.edu> wrote:
>> > > >
>> > > > >
>> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
>> > > > >
>> > > > > Dear Julie,
>> > > > >
>> > > > > The file that you modified worked. However, we did the
changes
>> > > > > you
>> > > made,
>> > > > > and grid_stat continues to show the same error.
>> > > > >
>> > > > > I've uploaded the file in the same FTP directory, named:
>> > > > > Hongqiao.Refl.20150602.s100000.e100500.attributes.nc
>> > > > >
>> > > > > This is a file dump of our modified netcdf:
>> > > > >
>> > > > > NCAR Command Language Version 6.3.0 The use of this
software is
>> > > > > governed by a License Agreement.
>> > > > > See http://www.ncl.ucar.edu/ for more details.
>> > > > >
>> > > > > Variable: f
>> > > > > Type: file
>> > > > > filename:
Hongqiao.Refl.20150602.s100000.e100500.attributes
>> > > > > path:
Hongqiao.Refl.20150602.s100000.e100500.attributes.nc
>> > > > > Number of Attributes:8
>> > > > > MET_version : V5.1
>> > > > > Projection : Mercator
>> > > > > lat_ll : 3348550.177 degrees_north
>> > > > > lon_ll : 13120540.425 degrees_east
>> > > > > lat_ur : 4057346.9 degrees_north
>> > > > > lon_ur : 13891071.057 degrees_east
>> > > > > nx : 674
>> > > > > ny : 620
>> > > > >
>> > > > > dimensions:
>> > > > > lon = 674
>> > > > > lat = 620
>> > > > >
>> > > > > variables:
>> > > > > Variable: lat
>> > > > > Type: float
>> > > > > Total Size: 417880 values
>> > > > > 1671520 bytes
>> > > > > Number of Dimensions: 2
>> > > > > Dimensions and sizes: [ 620 <lat> x 674 <lon> ]
>> > > > > Coordinates:
>> > > > > lat: [4057347..4057347]
>> > > > > lon: [1.312054e+07..1.388993e+07]
>> > > > > Number of Attributes: 2
>> > > > > units : degrees_north
>> > > > > standard_name : latitude
>> > > > >
>> > > > > Variable: lon
>> > > > > Type: float
>> > > > > Total Size: 417880 values
>> > > > > 1671520 bytes
>> > > > > Number of Dimensions: 2
>> > > > > Dimensions and sizes: [ 620 <lat> x 674 <lon> ]
>> > > > > Coordinates:
>> > > > > lat: [4057347..4057347]
>> > > > > lon: [1.312054e+07..1.388993e+07]
>> > > > > Number of Attributes: 2
>> > > > > units : degrees_east
>> > > > > standard_name : longitude
>> > > > >
>> > > > > Variable: REFC
>> > > > > Type: float
>> > > > > Total Size: 417880 values
>> > > > > 1671520 bytes
>> > > > > Number of Dimensions: 2
>> > > > > Dimensions and sizes: [ 620 <lat> x 674 <lon> ]
>> > > > > Coordinates:
>> > > > > lat: [4057347..4057347]
>> > > > > lon: [1.312054e+07..1.388993e+07]
>> > > > > Number of Attributes: 11
>> > > > > name : REFC
>> > > > > units : dbZ
>> > > > > parameter_table_version : 129
>> > > > > parameter_number : 212
>> > > > > level_indicator : 200
>> > > > > level : L0
>> > > > > long_name : MaxReflectivity
>> > > > > init_time : 20050807_000000
>> > > > > init_time_ut : 1123372800
>> > > > > valid_time : 20050807_120000
>> > > > > valid_time_ut : 1123416000
>> > > > >
>> > > > >
>> > > > >
>> > > > > Best Regards,
>> > > > > Jose
>> > > > >
>> > > > >
>> > > > > ________________________________________
>> > > > > From: Julie Prestopnik via RT <met_help at ucar.edu>
>> > > > > Sent: Friday, September 9, 2016 1:09 PM
>> > > > > To: Jose Garcia-Rivera
>> > > > > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar
>> > > > > NETCDF
>> > > file
>> > > > > for grid_stat verifiction
>> > > > >
>> > > > > Hi Jose. Thank you for uploading your data. There were
two
>> > > > > important things missing from your file.
>> > > > >
>> > > > > I added:
>> > > > >
>> > > > > REFC:name = "REFC" ;
>> > > > >
>> > > > > under:
>> > > > >
>> > > > > float REFC(lat, lon) ;
>> > > > >
>> > > > > and I added:
>> > > > >
>> > > > > :MET_version = "V5.1" ;
>> > > > >
>> > > > > under // global attributes:
>> > > > >
>> > > > > and was able to get a successful run of grid_stat.
>> > > > >
>> > > > > I am attaching the file with the changes. Please give it a
try
>> > > > > and let
>> > > > me
>> > > > > know if you get a successful run as well.
>> > > > >
>> > > > > Thanks,
>> > > > > Julie
>> > > > >
>> > > > > On Fri, Sep 9, 2016 at 10:38 AM, Jose Garcia-Rivera via RT
<
>> > > > > met_help at ucar.edu> wrote:
>> > > > >
>> > > > > >
>> > > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823
>> > > > > > >
>> > > > > >
>> > > > > > Dear Julie,
>> > > > > >
>> > > > > > We used the Mercator example, and ours looks identical to
yours.
>> > > > > > I proceeded and put 4 files into your FTP server:
>> > > > > >
>> > > > > > Model forecast file
>> > > > > > Radar Obs file
>> > > > > > Grid Stat Config file
>> > > > > > domain.poly file
>> > > > > >
>> > > > > > The files are under 'garcia_data'
>> > > > > >
>> > > > > >
>> > > > > > Thanks so much for your help,
>> > > > > > Jose
>> > > > > > ________________________________________
>> > > > > > From: Julie Prestopnik via RT <met_help at ucar.edu>
>> > > > > > Sent: Friday, September 9, 2016 11:50 AM
>> > > > > > To: Jose Garcia-Rivera
>> > > > > > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running
radar
>> > > > > > NETCDF
>> > > > file
>> > > > > > for grid_stat verifiction
>> > > > > >
>> > > > > > Hi Jose. I have attached a Mercator projection example.
If
>> > > > > > you're still stuck, please post your data to our
anonymous FTP
>> > > > > > site following these instructions:
>> > > > > >
http://www.dtcenter.org/met/users/support/met_help.php#ftp
>> > > > > >
>> > > > > > Thanks,
>> > > > > > Julie
>> > > > > >
>> > > > > >
>> > > > > > On Thu, Sep 8, 2016 at 3:25 PM, Jose Garcia-Rivera via RT
>> > > > > > <met_help at ucar.edu> wrote:
>> > > > > > >
>> > > > > > > <URL:
>> > > > > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823
>> > > > > > > >
>> > > > > > >
>> > > > > > > Dear Julie,
>> > > > > > >
>> > > > > > > That's very good information, thanks. We've been
working on
>> > > > > > > this
>> > > > issue,
>> > > > > > however the same error keeps showing up.
>> > > > > > >
>> > > > > > > Can we get a Mercator projection example?
>> > > > > > >
>> > > > > > > I was wondering if you could have a peek into our
netcdf
>> > > > > > > file, or
>> > > run
>> > > > > an
>> > > > > > internal test to see what needs to be changed, or what
may be
>> > wrong.
>> > > In
>> > > > > the
>> > > > > > meantime, we continue working on trying to make the file
fit
>> > > > > > MET requirements.
>> > > > > > >
>> > > > > > > Thanks for the help,
>> > > > > > > Jose
>> > > > > > >
>> > > > > > > ________________________________________
>> > > > > > > From: Julie Prestopnik via RT <met_help at ucar.edu>
>> > > > > > > Sent: Thursday, September 8, 2016 3:57 PM
>> > > > > > > To: Jose Garcia-Rivera
>> > > > > > > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running
radar
>> > > > > > > NETCDF
>> > > > > file
>> > > > > > for grid_stat verifiction
>> > > > > > >
>> > > > > > > Hi Jose.
>> > > > > > >
>> > > > > > > Unfortunately, we do not have a radar obs netcdf
example file.
>> > > With
>> > > > > > > NetCDF, users have two choices:
>> > > > > > > --make it look like the NetCDF files that MET generates
(i.e.
>> > > > > > > the output of pcp_combine) or --put it into CF-
compliant
>> > > > > > > NetCDF The variable can be named "radar_obs" or
"precip" or
>> > > > > > > anything you'd
>> > > > > like.
>> > > > > > >
>> > > > > > > Julie
>> > > > > > >
>> > > > > > >
>> > > > > > > On Thu, Sep 8, 2016 at 12:10 PM, Jose Garcia-Rivera via
RT
>> > > > > > > <met_help at ucar.edu> wrote:
>> > > > > > >>
>> > > > > > >> <URL:
>> > > > > > >>
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823
>> > > > > > >> >
>> > > > > > >>
>> > > > > > >> Dear Julie,
>> > > > > > >>
>> > > > > > >> Thanks so much for the file. We haven't been able to
work
>> > > > > > >> on it
>> > > yet,
>> > > > > > since we are fixing computer issues. One more question,
do you
>> > > > > > have a
>> > > > > radar
>> > > > > > obs netcdf example file?
>> > > > > > >>
>> > > > > > >> Best Regards,
>> > > > > > >> Jose
>> > > > > > >>
>> > > > > > >> From: Julie Prestopnik via RT <met_help at ucar.edu>
>> > > > > > >> Sent: Thursday, September 8, 2016 12:58 PM
>> > > > > > >> To: Jose Garcia-Rivera
>> > > > > > >> Subject: Re: [rt.rap.ucar.edu #77823] Trouble running
radar
>> > > NETCDF
>> > > > > > file for grid_stat verifiction
>> > > > > > >>
>> > > > > > >> My apologies. I meant to attach the file in my last
email.
>> > You
>> > > > can
>> > > > > > >> find it attached to this one.
>> > > > > > >>
>> > > > > > >> Thanks,
>> > > > > > >> Julie
>> > > > > > >>
>> > > > > > >> On Thu, Sep 8, 2016 at 10:36 AM, Jose Garcia-Rivera
via RT
>> > > > > > >> <met_help at ucar.edu> wrote:
>> > > > > > >>>
>> > > > > > >>> <URL:
>> > > > > > >>>
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
>> > > > > > >>>
>> > > > > > >>> Dear Julie,
>> > > > > > >>>
>> > > > > > >>> Thanks for the helpful response. Can I have an
example
>> > > > > > >>> file from
>> > > > the
>> > > > > > pcp_combine tool for reference?
>> > > > > > >>>
>> > > > > > >>> Best Regards,
>> > > > > > >>> Jose
>> > > > > > >>> ________________________________________
>> > > > > > >>> From: Julie Prestopnik via RT <met_help at ucar.edu>
>> > > > > > >>> Sent: Thursday, September 8, 2016 11:57 AM
>> > > > > > >>> To: Jose Garcia-Rivera
>> > > > > > >>> Subject: Re: [rt.rap.ucar.edu #77823] Trouble running
>> > > > > > >>> radar
>> > > NETCDF
>> > > > > > file for grid_stat verifiction
>> > > > > > >>>
>> > > > > > >>> Hi Jose.
>> > > > > > >>>
>> > > > > > >>> I see that you are running MET 5.1, but are unsure of
how
>> > > > > > >>> the
>> > > > NetCDF
>> > > > > > >>> files should be formatted in order for GridStat to be
able
>> > > > > > >>> to
>> > > read
>> > > > > > >>> them.
>> > > > > > >>>
>> > > > > > >>> In order it use gridded NetCDF files in MET, you'll
need
>> > > > > > >>> to make
>> > > > them
>> > > > > > >>> look like the output of the pcp_combine tool.
>> > > > > > >>>
>> > > > > > >>> Listed below is the header from one of the NetCDF
files
>> > > > > > >>> from pcp_combine created by the METv5.1 test scripts.
>> > > > > > >>> Here are the required parts.
>> > > > > > >>>
>> > > > > > >>> (1) dimensions should be named "lat" and "lon"
>> > > > > > >>> (2) the "lat" and "lon" variable are **NOT**
required
>> > > > > > >>> (3) gridded variables (e.g. APCP_12) must use the
"lat"
>> > > > > > >>> and
>> > > "lon"
>> > > > > > dimensions
>> > > > > > >>> (4) gridded variables should include the attributes
>> > > > > > >>> listed in
>> > > the
>> > > > > > >>> example (for timing info, only the init_time_ut,
>> > > > > > >>> valid_time_ut,
>> > > and
>> > > > > > >>> accum_time_sec are actually used. "ut" stands for
unix
>> > > > > > >>> time, the number of seconds since Jan 1, 1970).
>> > > > > > >>> (5) global attributes should include the
grid/projection
>> > > > > > >>> information. This example shows how they're
specified for
>> > > > > > >>> a
>> > > > lambert
>> > > > > > >>> conformal projection. Let me know if you're using a
>> > > > > > >>> different projection and I'll send you an example.
>> > > > > > >>>
>> > > > > > >>> I hope that helps get you going.
>> > > > > > >>>
>> > > > > > >>> Julie
>> > > > > > >>>
>> > > > > > >>>
>> > > > > > >>>
>> > > > > > >>> On Wed, Sep 7, 2016 at 3:15 PM, Jose Garcia-Rivera
via RT
>> > > > > > >>> <met_help at ucar.edu> wrote:
>> > > > > > >>>>
>> > > > > > >>>> Wed Sep 07 15:15:39 2016: Request 77823 was acted
upon.
>> > > > > > >>>> Transaction: Ticket created by GarciaJ at imsg.com
>> > > > > > >>>> Queue: met_help
>> > > > > > >>>> Subject: Trouble running radar NETCDF file for
>> > > > > > >>>> grid_stat
>> > > > > > verifiction
>> > > > > > >>>> Owner: Nobody
>> > > > > > >>>> Requestors: GarciaJ at imsg.com
>> > > > > > >>>> Status: new
>> > > > > > >>>> Ticket <URL: https://rt.rap.ucar.edu/rt/
>> > > > > Ticket/Display.html?id=77823
>> > > > > > >
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>> Dear Met Help,
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>> I've been trying to run MET using a radar NETCDF
file,
>> > > > > > >>>> and an
>> > > NMMB
>> > > > > > model forecast GRIB file, but the following error shows
up:
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>> DEBUG 1: Default Config File:
/work/apps/pgi_14.10/SANDY/
>> > > > > > met-5.1/share/met/config/GridStatConfig_default
>> > > > > > >>>> DEBUG 1: User Config File: GridStatConfig_dbz ERROR
:
>> > > > > > >>>> ERROR : Trouble reading observation file
>> > > "Hongqiao.Refl.20150602.
>> > > > > > s100000.e100500.attributes.nc"
>> > > > > > >>>> ERROR :
>> > > > > > >>>>
>> > > > > > >>>> We used two versions of the OBS file, one as it was,
and
>> > > > > > >>>> the
>> > > > second
>> > > > > > with added "attributes". Still, the same error occurred.
We
>> > > > > > are not
>> > > > sure
>> > > > > on
>> > > > > > exactly how our NETCDF files need to be for MET to be
able to
>> > > > > > read
>> > > > them.
>> > > > > I
>> > > > > > searched the error message on the Guide and nothing
showed up.
>> > > > > > >>>>
>> > > > > > >>>> We can share the files to your FTP if you want to
run them.
>> > > > > > >>>>
>> > > > > > >>>> Any help will be greatly appreciated.
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>> NOTE: We are using MET 5.1
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>> Best Regards,
>> > > > > > >>>>
>> > > > > > >>>> Jose
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>> Jose M. Garcia-Rivera, PhD
>> > > > > > >>>>
>> > > > > > >>>> Atmospheric Scientist
>> > > > > > >>>>
>> > > > > > >>>> IM Systems Group
>> > > > > > >>>>
>> > > > > > >>>> Rockville/College Park, MD
>> > > > > > >>>>
>> > > > > > >>>> This e-mail, including attachments, may include
>> > > > > > >>>> confidential
>> > > > and/or
>> > > > > > proprietary information, and may be used only by the
person or
>> > > > > > entity
>> > > > to
>> > > > > > which it is addressed. If the reader of this e-mail is
not the
>> > > intended
>> > > > > > recipient or his or her authorized agent, the reader is
hereby
>> > > notified
>> > > > > > that any dissemination, distribution or copying of this
e-mail
>> > > > > > is prohibited. If you have received this e-mail in error,
>> > > > > > please notify
>> > > > the
>> > > > > > sender by replying to this message and delete this e-mail
>> > > immediately.
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>
>> > > > > > >>>
>> > > > > > >>>
>> > > > > > >>> --
>> > > > > > >>> Julie Prestopnik
>> > > > > > >>> National Center for Atmospheric Research Research
>> > > > > > >>> Applications Laboratory
>> > > > > > >>> Phone: 303.497.8399
>> > > > > > >>> Email: jpresto at ucar.edu
>> > > > > > >>>
>> > > > > > >>>
>> > > > > > >>> This e-mail, including attachments, may include
>> > > > > > >>> confidential
>> > > and/or
>> > > > > > proprietary information, and may be used only by the
person or
>> > > > > > entity
>> > > > to
>> > > > > > which it is addressed. If the reader of this e-mail is
not the
>> > > intended
>> > > > > > recipient or his or her authorized agent, the reader is
hereby
>> > > notified
>> > > > > > that any dissemination, distribution or copying of this
e-mail
>> > > > > > is prohibited. If you have received this e-mail in error,
>> > > > > > please notify
>> > > > the
>> > > > > > sender by replying to this message and delete this e-mail
>> > > immediately.
>> > > > > > >>>
>> > > > > > >>>
>> > > > > > >>
>> > > > > > >>
>> > > > > > >>
>> > > > > > >> --
>> > > > > > >> Julie Prestopnik
>> > > > > > >> National Center for Atmospheric Research Research
>> > > > > > >> Applications Laboratory
>> > > > > > >> Phone: 303.497.8399
>> > > > > > >> Email: jpresto at ucar.edu
>> > > > > > >>
>> > > > > > >> This e-mail, including attachments, may include
>> > > > > > >> confidential
>> > > and/or
>> > > > > > proprietary information, and may be used only by the
person or
>> > > > > > entity
>> > > > to
>> > > > > > which it is addressed. If the reader of this e-mail is
not the
>> > > intended
>> > > > > > recipient or his or her authorized agent, the reader is
hereby
>> > > notified
>> > > > > > that any dissemination, distribution or copying of this
e-mail
>> > > > > > is prohibited. If you have received this e-mail in error,
>> > > > > > please notify
>> > > > the
>> > > > > > sender by replying to this message and delete this e-mail
>> > > immediately.
>> > > > > > >>
>> > > > > > >>
>> > > > > > >
>> > > > > > >
>> > > > > > >
>> > > > > > > --
>> > > > > > > Julie Prestopnik
>> > > > > > > National Center for Atmospheric Research Research
>> > > > > > > Applications Laboratory
>> > > > > > > Phone: 303.497.8399
>> > > > > > > Email: jpresto at ucar.edu
>> > > > > > >
>> > > > > > >
>> > > > > > > This e-mail, including attachments, may include
confidential
>> > > > > > > and/or
>> > > > > > proprietary information, and may be used only by the
person or
>> > > > > > entity
>> > > > to
>> > > > > > which it is addressed. If the reader of this e-mail is
not the
>> > > intended
>> > > > > > recipient or his or her authorized agent, the reader is
hereby
>> > > notified
>> > > > > > that any dissemination, distribution or copying of this
e-mail
>> > > > > > is prohibited. If you have received this e-mail in error,
>> > > > > > please notify
>> > > > the
>> > > > > > sender by replying to this message and delete this e-mail
>> > > immediately.
>> > > > > > >
>> > > > > > >
>> > > > > >
>> > > > > >
>> > > > > >
>> > > > > > --
>> > > > > > Julie Prestopnik
>> > > > > > National Center for Atmospheric Research Research
Applications
>> > > > > > Laboratory
>> > > > > > Phone: 303.497.8399
>> > > > > > Email: jpresto at ucar.edu
>> > > > > >
>> > > > > > This e-mail, including attachments, may include
confidential
>> > > > > > and/or proprietary information, and may be used only by
the
>> > > > > > person or entity
>> > > > to
>> > > > > > which it is addressed. If the reader of this e-mail is
not the
>> > > intended
>> > > > > > recipient or his or her authorized agent, the reader is
hereby
>> > > notified
>> > > > > > that any dissemination, distribution or copying of this
e-mail
>> > > > > > is prohibited. If you have received this e-mail in error,
>> > > > > > please notify
>> > > > the
>> > > > > > sender by replying to this message and delete this e-mail
>> > > immediately.
>> > > > > >
>> > > > > >
>> > > > > >
>> > > > >
>> > > > >
>> > > > > --
>> > > > > Julie Prestopnik
>> > > > > National Center for Atmospheric Research Research
Applications
>> > > > > Laboratory
>> > > > > Phone: 303.497.8399
>> > > > > Email: jpresto at ucar.edu
>> > > > >
>> > > > > This e-mail, including attachments, may include
confidential
>> > > > > and/or proprietary information, and may be used only by the
>> > > > > person or entity
>> > > to
>> > > > > which it is addressed. If the reader of this e-mail is not
the
>> > > > > intended recipient or his or her authorized agent, the
reader is
>> > > > > hereby notified that any dissemination, distribution or
copying
>> > > > > of this e-mail is prohibited. If you have received this e-
mail
>> > > > > in error, please notify
>> > > the
>> > > > > sender by replying to this message and delete this e-mail
>> > immediately.
>> > > > >
>> > > > >
>> > > > >
>> > > >
>> > > > This e-mail, including attachments, may include confidential
>> > > > and/or proprietary information, and may be used only by the
person
>> > > > or entity to which it is addressed. If the reader of this e-
mail
>> > > > is not the intended recipient or his or her authorized agent,
the
>> > > > reader is hereby notified that any dissemination,
distribution or
>> > > > copying of this e-mail is prohibited. If you have received
this
>> > > > e-mail in error, please notify the sender by replying to this
>> > > > message and delete
>> > this e-mail immediately.
>> > > >
>> > > >
>> > > >
>> > >
>> > >
>> > > --
>> > > Julie Prestopnik
>> > > National Center for Atmospheric Research Research Applications
>> > > Laboratory
>> > > Phone: 303.497.8399
>> > > Email: jpresto at ucar.edu
>> > >
>> > > This e-mail, including attachments, may include confidential
and/or
>> > > proprietary information, and may be used only by the person or
>> > > entity to which it is addressed. If the reader of this e-mail
is not
>> > > the intended recipient or his or her authorized agent, the
reader is
>> > > hereby notified that any dissemination, distribution or copying
of
>> > > this e-mail is prohibited. If you have received this e-mail in
>> > > error, please notify the sender by replying to this message and
>> > > delete this
>> > e-mail immediately.
>> > >
>> > >
>> >
>> >
>> > --
>> > Julie Prestopnik
>> > National Center for Atmospheric Research Research Applications
>> > Laboratory
>> > Phone: 303.497.8399
>> > Email: jpresto at ucar.edu
>> >
>> > This e-mail, including attachments, may include confidential
and/or
>> > proprietary information, and may be used only by the person or
entity
>> > to which it is addressed. If the reader of this e-mail is not the
>> > intended recipient or his or her authorized agent, the reader is
>> > hereby notified that any dissemination, distribution or copying
of
>> > this e-mail is prohibited. If you have received this e-mail in
error,
>> > please notify the sender by replying to this message and delete
this
>> e-mail immediately.
>> >
>> >
>> >
>>
>>
>> --
>> Julie Prestopnik
>> National Center for Atmospheric Research Research Applications
Laboratory
>> Phone: 303.497.8399
>> Email: jpresto at ucar.edu
>>
>> This e-mail, including attachments, may include confidential and/or
>> proprietary information, and may be used only by the person or
entity to
>> which it is addressed. If the reader of this e-mail is not the
intended
>> recipient or his or her authorized agent, the reader is hereby
notified
>> that any dissemination, distribution or copying of this e-mail is
>> prohibited. If you have received this e-mail in error, please
notify the
>> sender by replying to this message and delete this e-mail
immediately.
>>
>>
> Jose
>
> -----Original Message-----
> From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> Sent: Tuesday, September 13, 2016 1:59 PM
> To: Jose Garcia-Rivera
> Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar NETCDF
file
> for grid_stat verifiction
>
> Hi Jose.
>
> When I ran plot_data_plane on the input observation file,
> RadarObsNEW_mod_v3.nc, I produced the image I sent you, which looked
> similar to the met_OBS.png file that you sent me in that it was
flipped
> upside-down. So, I produced a similar image pre-grid_stat, using
the raw
> observation file.
>
> How did you produce your radar_OBS.png plot? Could you please try
running
> plot_data_plane on the radar observation file and see if you get the
same
> output we do? I suspect the problem lies in the way the radar
NetCDF file
> is being written.
>
> Thanks,
> Julie
>
>
>
> On Tue, Sep 13, 2016 at 11:53 AM, Jose Garcia-Rivera via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
> >
> > Hi Julie,
> >
> > Thanks for checking out. The met_OBS.png is the output I got from
> > grid_stat. The correct file is radar_OBS.png plot. So, that may
mean
> > that you are getting the same issue I got. Have you seen this
happening
> before?
> >
> > Best Regards,
> > Jose
> >
> >
> >
> > -----Original Message-----
> > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > Sent: Tuesday, September 13, 2016 1:21 PM
> > To: Jose Garcia-Rivera
> > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar NETCDF
> > file for grid_stat verifiction
> >
> > Hi Jose.
> >
> > When I plot the NetCDF3 obs file that we created using nccopy
> > (RadarObsNEW_mod_v3.nc) using plot_data_plane:
> >
> > /usr/local/met-5.2/bin/plot_data_plane RadarObsNEW_mod_v3.nc
> > RadarObsNEW_mod_v3.ps 'name="REFC"; level="(*,*)";'
> >
> > The resulting image, RadarObsNEW_mod_v3.ps (attached), appears to
be
> > oriented in the same way as the met_OBS.png image that you
attached,
> > so I don't believe that grid_stat is doing anything to the data,
but
> > rather that the data was placed into the original NetCDF Obs data
and
> > needs to be re-oriented there.
> >
> > Please let me know if you find that is not the case. Please try
> > running plot_data_plane on the data that produced the
radar_OBS.png
> > file and see if you get the same result.
> >
> > Thanks,
> > Julie
> >
> > On Tue, Sep 13, 2016 at 9:20 AM, Jose Garcia-Rivera via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
> > >
> > > Dear Julie, John
> > >
> > > The commands worked fine. Thank you so much!
> > >
> > > Now, there's something that is puzzling us. The radar data from
the
> > > grid_stat.nc output file seems to be flipped upside-down. I
attached
> > > the MET-produced OBS vs the original OBS. Is this an artifact of
> > > grid_stat, or how can it be fixed?
> > >
> > >
> > >
> > > Best Regards,
> > > Jose
> > >
> > > ________________________________________
> > > From: Julie Prestopnik via RT <met_help at ucar.edu>
> > > Sent: Friday, September 9, 2016 4:07 PM
> > > To: Jose Garcia-Rivera
> > > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar
NETCDF
> > > file for grid_stat verifiction
> > >
> > > Hi Jose.
> > >
> > > As John indicated the problem lies in that currently MET only
> > > supports the classic data model... i.e. NetCDF3, which the file
> > > RadarObsNEW.nc is
> > not.
> > >
> > > Running "file RadarObsNEW.nc" shows that the file is not "NetCDF
> > > Data Format data", but rather:
> > >
> > > RadarObsNEW.nc: Hierarchical Data Format (version 5) data
> > >
> > > You can create a NetCDF3 file when you create the file or you
can
> > > use the "nccopy" command. However, "nccopy" didn't work with
the
> > > RadarObsNEW.nc file, until we made some changes. We used
"ncatted"
> > > to remove the "L" from the value of the following attributes:
> > > parameter_table_version, parameter_number, level_indicator, nx,
and
> > > ny. I'll paste in the commands that we used to create a NetCDF3
> > > file, plot the data, and get a successful run from grid_stat.
> > >
> > > # Update attributes to remove longs
> > > /usr/local/nco/bin/ncatted \
> > > -a parameter_table_version,REFC,o,f,129 \ -a
> > > parameter_number,REFC,o,f,212 \ -a level_indicator,REFC,o,f,200
\ -a
> > > nx,global,o,i,674 \ -a ny,global,o,i,620 \ RadarObsNEW.nc
> > > RadarObsNEW_mod.nc
> > >
> > > # Convert from NC4 to NC3
> > > /usr/local/netcdf/bin/nccopy -3 RadarObsNEW_mod.nc
> > > RadarObsNEW_mod_v3.nc
> > >
> > > # Regrid to global grid
> > > /usr/local/met-5.2/bin/regrid_data_plane \ RadarObsNEW_mod_v3.nc
> > > G004 RadarObsNEW_mod_v3_G004.nc \ -field 'name="REFC";
level="(*,*)";'
> > >
> > > # Plot the result
> > > /usr/local/met-5.2/bin/plot_data_plane \
RadarObsNEW_mod_v3_G004.nc
> > > RadarObsNEW_mod_v3_G004.ps \ 'name="REFC"; level="(*,*)";'
> > >
> > > # Display plot
> > > convert -rotate 90 -background white -flatten
> > > RadarObsNEW_mod_v3_G004.ps RadarObsNEW_mod_v3_G004.png display
> > > RadarObsNEW_mod_v3_G004.png&
> > >
> > > # Plot forecast REFC
> > > /usr/local/met-5.2/bin/plot_data_plane \ ForecastFile.grb
> > > refc_fcst.ps \ 'name="REFC"; level="L0"; GRIB1_ptv=129;'
> > >
> > > # Display plot
> > > convert -rotate 90 -background white -flatten refc_fcst.ps
> > > refc_fcst.png display refc_fcst.png&
> > >
> > > # Run grid_stat
> > > /usr/local/met-5.1/bin/grid_stat ForecastFile.grb
> > > RadarObsNEW_mod_v3.nc GridStatConfig_dbz -outdir out/
> > >
> > > I have also attached the NetCDF3 file that we produced after
using
> > > ncatted and nccopy.
> > >
> > > Please let us know if you have any other questions.
> > >
> > > Thanks,
> > > Julie
> > >
> > >
> > > On Fri, Sep 9, 2016 at 12:43 PM, Jose Garcia-Rivera via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823
>
> > > >
> > > > Hi John,
> > > >
> > > > Glad to talk to you again. We did the proposed changes, and
the
> > > > error keeps showing up.
> > > >
> > > > I uploaded the new file as: RadarObsNEW.nc
> > > >
> > > > Please try to run it and let me know what issues show up?
> > > >
> > > > Thanks for the help,
> > > > Jose
> > > > ________________________________________
> > > > From: John Halley Gotway via RT <met_help at ucar.edu>
> > > > Sent: Friday, September 9, 2016 2:17 PM
> > > > To: Jose Garcia-Rivera
> > > > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar
NETCDF
> > > > file for grid_stat verifiction
> > > >
> > > > Hello Jose,
> > > >
> > > > This is John Halley Gotway. I work with Julie on providing
> > > > support for MET.
> > > >
> > > > I think there's a few pieces of info we're missing here.
> > > >
> > > > (1) MET does not currently support the enhanced data model of
> NetCDF4.
> > > It
> > > > only supports the classic data model... i.e. NetCDF3. In the
next
> > > version
> > > > of MET (6.0), due out next year, we'll be adding support for
NetCDF4.
> > > The
> > > > file you sent us in NetCDF4 but when Julie add those
attributes
> > > > she may have used ncdump/ncgen. And their output is NetCDF3.
Try
> > > > updating your NCL script to write a "classic" NetCDF file.
> > > >
> > > > (2) Yes, the "MET_version" global attribute needs to be
present.
> > > > That tells MET how to parse the grid information.
> > > >
> > > > (3) I'm not sure that the variable "name" attribute is
necessary,
> > > > but it doesn't hurt.
> > > >
> > > > (4) The biggest problem is in the definition of your Mercator
grid:
> > > > :Projection = "Mercator" ;
> > > > :lat_ll = "3348550.177 degrees_north" ;
> > > > :lon_ll = "13120540.425 degrees_east" ;
> > > > :lat_ur = "4057346.9 degrees_north" ;
> > > > :lon_ur = "13891071.057 degrees_east" ;
> > > >
> > > > Those don't look like very meaningful lat/lon values! Where
did
> > > > you get these numbers? Are they meant to match the grid
defined
> > > > in the GRIB file you sent us?
> > > >
> > > > Thanks,
> > > > John
> > > >
> > > > On Fri, Sep 9, 2016 at 12:08 PM, Jose Garcia-Rivera via RT <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > > >
> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
> > > > >
> > > > > Dear Julie,
> > > > >
> > > > > The file that you modified worked. However, we did the
changes
> > > > > you
> > > made,
> > > > > and grid_stat continues to show the same error.
> > > > >
> > > > > I've uploaded the file in the same FTP directory, named:
> > > > > Hongqiao.Refl.20150602.s100000.e100500.attributes.nc
> > > > >
> > > > > This is a file dump of our modified netcdf:
> > > > >
> > > > > NCAR Command Language Version 6.3.0 The use of this
software is
> > > > > governed by a License Agreement.
> > > > > See http://www.ncl.ucar.edu/ for more details.
> > > > >
> > > > > Variable: f
> > > > > Type: file
> > > > > filename:
Hongqiao.Refl.20150602.s100000.e100500.attributes
> > > > > path: Hongqiao.Refl.20150602.s100000.e100500.attributes.nc
> > > > > Number of Attributes:8
> > > > > MET_version : V5.1
> > > > > Projection : Mercator
> > > > > lat_ll : 3348550.177 degrees_north
> > > > > lon_ll : 13120540.425 degrees_east
> > > > > lat_ur : 4057346.9 degrees_north
> > > > > lon_ur : 13891071.057 degrees_east
> > > > > nx : 674
> > > > > ny : 620
> > > > >
> > > > > dimensions:
> > > > > lon = 674
> > > > > lat = 620
> > > > >
> > > > > variables:
> > > > > Variable: lat
> > > > > Type: float
> > > > > Total Size: 417880 values
> > > > > 1671520 bytes
> > > > > Number of Dimensions: 2
> > > > > Dimensions and sizes: [ 620 <lat> x 674 <lon> ]
> > > > > Coordinates:
> > > > > lat: [4057347..4057347]
> > > > > lon: [1.312054e+07..1.388993e+07]
> > > > > Number of Attributes: 2
> > > > > units : degrees_north
> > > > > standard_name : latitude
> > > > >
> > > > > Variable: lon
> > > > > Type: float
> > > > > Total Size: 417880 values
> > > > > 1671520 bytes
> > > > > Number of Dimensions: 2
> > > > > Dimensions and sizes: [ 620 <lat> x 674 <lon> ]
> > > > > Coordinates:
> > > > > lat: [4057347..4057347]
> > > > > lon: [1.312054e+07..1.388993e+07]
> > > > > Number of Attributes: 2
> > > > > units : degrees_east
> > > > > standard_name : longitude
> > > > >
> > > > > Variable: REFC
> > > > > Type: float
> > > > > Total Size: 417880 values
> > > > > 1671520 bytes
> > > > > Number of Dimensions: 2
> > > > > Dimensions and sizes: [ 620 <lat> x 674 <lon> ]
> > > > > Coordinates:
> > > > > lat: [4057347..4057347]
> > > > > lon: [1.312054e+07..1.388993e+07]
> > > > > Number of Attributes: 11
> > > > > name : REFC
> > > > > units : dbZ
> > > > > parameter_table_version : 129
> > > > > parameter_number : 212
> > > > > level_indicator : 200
> > > > > level : L0
> > > > > long_name : MaxReflectivity
> > > > > init_time : 20050807_000000
> > > > > init_time_ut : 1123372800
> > > > > valid_time : 20050807_120000
> > > > > valid_time_ut : 1123416000
> > > > >
> > > > >
> > > > >
> > > > > Best Regards,
> > > > > Jose
> > > > >
> > > > >
> > > > > ________________________________________
> > > > > From: Julie Prestopnik via RT <met_help at ucar.edu>
> > > > > Sent: Friday, September 9, 2016 1:09 PM
> > > > > To: Jose Garcia-Rivera
> > > > > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar
> > > > > NETCDF
> > > file
> > > > > for grid_stat verifiction
> > > > >
> > > > > Hi Jose. Thank you for uploading your data. There were two
> > > > > important things missing from your file.
> > > > >
> > > > > I added:
> > > > >
> > > > > REFC:name = "REFC" ;
> > > > >
> > > > > under:
> > > > >
> > > > > float REFC(lat, lon) ;
> > > > >
> > > > > and I added:
> > > > >
> > > > > :MET_version = "V5.1" ;
> > > > >
> > > > > under // global attributes:
> > > > >
> > > > > and was able to get a successful run of grid_stat.
> > > > >
> > > > > I am attaching the file with the changes. Please give it a
try
> > > > > and let
> > > > me
> > > > > know if you get a successful run as well.
> > > > >
> > > > > Thanks,
> > > > > Julie
> > > > >
> > > > > On Fri, Sep 9, 2016 at 10:38 AM, Jose Garcia-Rivera via RT <
> > > > > met_help at ucar.edu> wrote:
> > > > >
> > > > > >
> > > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823
> > > > > > >
> > > > > >
> > > > > > Dear Julie,
> > > > > >
> > > > > > We used the Mercator example, and ours looks identical to
yours.
> > > > > > I proceeded and put 4 files into your FTP server:
> > > > > >
> > > > > > Model forecast file
> > > > > > Radar Obs file
> > > > > > Grid Stat Config file
> > > > > > domain.poly file
> > > > > >
> > > > > > The files are under 'garcia_data'
> > > > > >
> > > > > >
> > > > > > Thanks so much for your help,
> > > > > > Jose
> > > > > > ________________________________________
> > > > > > From: Julie Prestopnik via RT <met_help at ucar.edu>
> > > > > > Sent: Friday, September 9, 2016 11:50 AM
> > > > > > To: Jose Garcia-Rivera
> > > > > > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running
radar
> > > > > > NETCDF
> > > > file
> > > > > > for grid_stat verifiction
> > > > > >
> > > > > > Hi Jose. I have attached a Mercator projection example.
If
> > > > > > you're still stuck, please post your data to our anonymous
FTP
> > > > > > site following these instructions:
> > > > > >
http://www.dtcenter.org/met/users/support/met_help.php#ftp
> > > > > >
> > > > > > Thanks,
> > > > > > Julie
> > > > > >
> > > > > >
> > > > > > On Thu, Sep 8, 2016 at 3:25 PM, Jose Garcia-Rivera via RT
> > > > > > <met_help at ucar.edu> wrote:
> > > > > > >
> > > > > > > <URL:
> > > > > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823
> > > > > > > >
> > > > > > >
> > > > > > > Dear Julie,
> > > > > > >
> > > > > > > That's very good information, thanks. We've been working
on
> > > > > > > this
> > > > issue,
> > > > > > however the same error keeps showing up.
> > > > > > >
> > > > > > > Can we get a Mercator projection example?
> > > > > > >
> > > > > > > I was wondering if you could have a peek into our netcdf
> > > > > > > file, or
> > > run
> > > > > an
> > > > > > internal test to see what needs to be changed, or what may
be
> > wrong.
> > > In
> > > > > the
> > > > > > meantime, we continue working on trying to make the file
fit
> > > > > > MET requirements.
> > > > > > >
> > > > > > > Thanks for the help,
> > > > > > > Jose
> > > > > > >
> > > > > > > ________________________________________
> > > > > > > From: Julie Prestopnik via RT <met_help at ucar.edu>
> > > > > > > Sent: Thursday, September 8, 2016 3:57 PM
> > > > > > > To: Jose Garcia-Rivera
> > > > > > > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running
radar
> > > > > > > NETCDF
> > > > > file
> > > > > > for grid_stat verifiction
> > > > > > >
> > > > > > > Hi Jose.
> > > > > > >
> > > > > > > Unfortunately, we do not have a radar obs netcdf example
file.
> > > With
> > > > > > > NetCDF, users have two choices:
> > > > > > > --make it look like the NetCDF files that MET generates
(i.e.
> > > > > > > the output of pcp_combine) or --put it into CF-compliant
> > > > > > > NetCDF The variable can be named "radar_obs" or "precip"
or
> > > > > > > anything you'd
> > > > > like.
> > > > > > >
> > > > > > > Julie
> > > > > > >
> > > > > > >
> > > > > > > On Thu, Sep 8, 2016 at 12:10 PM, Jose Garcia-Rivera via
RT
> > > > > > > <met_help at ucar.edu> wrote:
> > > > > > >>
> > > > > > >> <URL:
> > > > > > >> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823
> > > > > > >> >
> > > > > > >>
> > > > > > >> Dear Julie,
> > > > > > >>
> > > > > > >> Thanks so much for the file. We haven't been able to
work
> > > > > > >> on it
> > > yet,
> > > > > > since we are fixing computer issues. One more question, do
you
> > > > > > have a
> > > > > radar
> > > > > > obs netcdf example file?
> > > > > > >>
> > > > > > >> Best Regards,
> > > > > > >> Jose
> > > > > > >>
> > > > > > >> From: Julie Prestopnik via RT <met_help at ucar.edu>
> > > > > > >> Sent: Thursday, September 8, 2016 12:58 PM
> > > > > > >> To: Jose Garcia-Rivera
> > > > > > >> Subject: Re: [rt.rap.ucar.edu #77823] Trouble running
radar
> > > NETCDF
> > > > > > file for grid_stat verifiction
> > > > > > >>
> > > > > > >> My apologies. I meant to attach the file in my last
email.
> > You
> > > > can
> > > > > > >> find it attached to this one.
> > > > > > >>
> > > > > > >> Thanks,
> > > > > > >> Julie
> > > > > > >>
> > > > > > >> On Thu, Sep 8, 2016 at 10:36 AM, Jose Garcia-Rivera via
RT
> > > > > > >> <met_help at ucar.edu> wrote:
> > > > > > >>>
> > > > > > >>> <URL:
> > > > > > >>>
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
> > > > > > >>>
> > > > > > >>> Dear Julie,
> > > > > > >>>
> > > > > > >>> Thanks for the helpful response. Can I have an example
> > > > > > >>> file from
> > > > the
> > > > > > pcp_combine tool for reference?
> > > > > > >>>
> > > > > > >>> Best Regards,
> > > > > > >>> Jose
> > > > > > >>> ________________________________________
> > > > > > >>> From: Julie Prestopnik via RT <met_help at ucar.edu>
> > > > > > >>> Sent: Thursday, September 8, 2016 11:57 AM
> > > > > > >>> To: Jose Garcia-Rivera
> > > > > > >>> Subject: Re: [rt.rap.ucar.edu #77823] Trouble running
> > > > > > >>> radar
> > > NETCDF
> > > > > > file for grid_stat verifiction
> > > > > > >>>
> > > > > > >>> Hi Jose.
> > > > > > >>>
> > > > > > >>> I see that you are running MET 5.1, but are unsure of
how
> > > > > > >>> the
> > > > NetCDF
> > > > > > >>> files should be formatted in order for GridStat to be
able
> > > > > > >>> to
> > > read
> > > > > > >>> them.
> > > > > > >>>
> > > > > > >>> In order it use gridded NetCDF files in MET, you'll
need
> > > > > > >>> to make
> > > > them
> > > > > > >>> look like the output of the pcp_combine tool.
> > > > > > >>>
> > > > > > >>> Listed below is the header from one of the NetCDF
files
> > > > > > >>> from pcp_combine created by the METv5.1 test scripts.
> > > > > > >>> Here are the required parts.
> > > > > > >>>
> > > > > > >>> (1) dimensions should be named "lat" and "lon"
> > > > > > >>> (2) the "lat" and "lon" variable are **NOT**
required
> > > > > > >>> (3) gridded variables (e.g. APCP_12) must use the
"lat"
> > > > > > >>> and
> > > "lon"
> > > > > > dimensions
> > > > > > >>> (4) gridded variables should include the attributes
> > > > > > >>> listed in
> > > the
> > > > > > >>> example (for timing info, only the init_time_ut,
> > > > > > >>> valid_time_ut,
> > > and
> > > > > > >>> accum_time_sec are actually used. "ut" stands for
unix
> > > > > > >>> time, the number of seconds since Jan 1, 1970).
> > > > > > >>> (5) global attributes should include the
grid/projection
> > > > > > >>> information. This example shows how they're specified
for
> > > > > > >>> a
> > > > lambert
> > > > > > >>> conformal projection. Let me know if you're using a
> > > > > > >>> different projection and I'll send you an example.
> > > > > > >>>
> > > > > > >>> I hope that helps get you going.
> > > > > > >>>
> > > > > > >>> Julie
> > > > > > >>>
> > > > > > >>>
> > > > > > >>>
> > > > > > >>> On Wed, Sep 7, 2016 at 3:15 PM, Jose Garcia-Rivera via
RT
> > > > > > >>> <met_help at ucar.edu> wrote:
> > > > > > >>>>
> > > > > > >>>> Wed Sep 07 15:15:39 2016: Request 77823 was acted
upon.
> > > > > > >>>> Transaction: Ticket created by GarciaJ at imsg.com
> > > > > > >>>> Queue: met_help
> > > > > > >>>> Subject: Trouble running radar NETCDF file for
> > > > > > >>>> grid_stat
> > > > > > verifiction
> > > > > > >>>> Owner: Nobody
> > > > > > >>>> Requestors: GarciaJ at imsg.com
> > > > > > >>>> Status: new
> > > > > > >>>> Ticket <URL: https://rt.rap.ucar.edu/rt/
> > > > > Ticket/Display.html?id=77823
> > > > > > >
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>> Dear Met Help,
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>> I've been trying to run MET using a radar NETCDF
file,
> > > > > > >>>> and an
> > > NMMB
> > > > > > model forecast GRIB file, but the following error shows
up:
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>> DEBUG 1: Default Config File:
/work/apps/pgi_14.10/SANDY/
> > > > > > met-5.1/share/met/config/GridStatConfig_default
> > > > > > >>>> DEBUG 1: User Config File: GridStatConfig_dbz ERROR
:
> > > > > > >>>> ERROR : Trouble reading observation file
> > > "Hongqiao.Refl.20150602.
> > > > > > s100000.e100500.attributes.nc"
> > > > > > >>>> ERROR :
> > > > > > >>>>
> > > > > > >>>> We used two versions of the OBS file, one as it was,
and
> > > > > > >>>> the
> > > > second
> > > > > > with added "attributes". Still, the same error occurred.
We
> > > > > > are not
> > > > sure
> > > > > on
> > > > > > exactly how our NETCDF files need to be for MET to be able
to
> > > > > > read
> > > > them.
> > > > > I
> > > > > > searched the error message on the Guide and nothing showed
up.
> > > > > > >>>>
> > > > > > >>>> We can share the files to your FTP if you want to run
them.
> > > > > > >>>>
> > > > > > >>>> Any help will be greatly appreciated.
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>> NOTE: We are using MET 5.1
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>> Best Regards,
> > > > > > >>>>
> > > > > > >>>> Jose
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>> Jose M. Garcia-Rivera, PhD
> > > > > > >>>>
> > > > > > >>>> Atmospheric Scientist
> > > > > > >>>>
> > > > > > >>>> IM Systems Group
> > > > > > >>>>
> > > > > > >>>> Rockville/College Park, MD
> > > > > > >>>>
> > > > > > >>>> This e-mail, including attachments, may include
> > > > > > >>>> confidential
> > > > and/or
> > > > > > proprietary information, and may be used only by the
person or
> > > > > > entity
> > > > to
> > > > > > which it is addressed. If the reader of this e-mail is not
the
> > > intended
> > > > > > recipient or his or her authorized agent, the reader is
hereby
> > > notified
> > > > > > that any dissemination, distribution or copying of this e-
mail
> > > > > > is prohibited. If you have received this e-mail in error,
> > > > > > please notify
> > > > the
> > > > > > sender by replying to this message and delete this e-mail
> > > immediately.
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>
> > > > > > >>>
> > > > > > >>>
> > > > > > >>> --
> > > > > > >>> Julie Prestopnik
> > > > > > >>> National Center for Atmospheric Research Research
> > > > > > >>> Applications Laboratory
> > > > > > >>> Phone: 303.497.8399
> > > > > > >>> Email: jpresto at ucar.edu
> > > > > > >>>
> > > > > > >>>
> > > > > > >>> This e-mail, including attachments, may include
> > > > > > >>> confidential
> > > and/or
> > > > > > proprietary information, and may be used only by the
person or
> > > > > > entity
> > > > to
> > > > > > which it is addressed. If the reader of this e-mail is not
the
> > > intended
> > > > > > recipient or his or her authorized agent, the reader is
hereby
> > > notified
> > > > > > that any dissemination, distribution or copying of this e-
mail
> > > > > > is prohibited. If you have received this e-mail in error,
> > > > > > please notify
> > > > the
> > > > > > sender by replying to this message and delete this e-mail
> > > immediately.
> > > > > > >>>
> > > > > > >>>
> > > > > > >>
> > > > > > >>
> > > > > > >>
> > > > > > >> --
> > > > > > >> Julie Prestopnik
> > > > > > >> National Center for Atmospheric Research Research
> > > > > > >> Applications Laboratory
> > > > > > >> Phone: 303.497.8399
> > > > > > >> Email: jpresto at ucar.edu
> > > > > > >>
> > > > > > >> This e-mail, including attachments, may include
> > > > > > >> confidential
> > > and/or
> > > > > > proprietary information, and may be used only by the
person or
> > > > > > entity
> > > > to
> > > > > > which it is addressed. If the reader of this e-mail is not
the
> > > intended
> > > > > > recipient or his or her authorized agent, the reader is
hereby
> > > notified
> > > > > > that any dissemination, distribution or copying of this e-
mail
> > > > > > is prohibited. If you have received this e-mail in error,
> > > > > > please notify
> > > > the
> > > > > > sender by replying to this message and delete this e-mail
> > > immediately.
> > > > > > >>
> > > > > > >>
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > --
> > > > > > > Julie Prestopnik
> > > > > > > National Center for Atmospheric Research Research
> > > > > > > Applications Laboratory
> > > > > > > Phone: 303.497.8399
> > > > > > > Email: jpresto at ucar.edu
> > > > > > >
> > > > > > >
> > > > > > > This e-mail, including attachments, may include
confidential
> > > > > > > and/or
> > > > > > proprietary information, and may be used only by the
person or
> > > > > > entity
> > > > to
> > > > > > which it is addressed. If the reader of this e-mail is not
the
> > > intended
> > > > > > recipient or his or her authorized agent, the reader is
hereby
> > > notified
> > > > > > that any dissemination, distribution or copying of this e-
mail
> > > > > > is prohibited. If you have received this e-mail in error,
> > > > > > please notify
> > > > the
> > > > > > sender by replying to this message and delete this e-mail
> > > immediately.
> > > > > > >
> > > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > > --
> > > > > > Julie Prestopnik
> > > > > > National Center for Atmospheric Research Research
Applications
> > > > > > Laboratory
> > > > > > Phone: 303.497.8399
> > > > > > Email: jpresto at ucar.edu
> > > > > >
> > > > > > This e-mail, including attachments, may include
confidential
> > > > > > and/or proprietary information, and may be used only by
the
> > > > > > person or entity
> > > > to
> > > > > > which it is addressed. If the reader of this e-mail is not
the
> > > intended
> > > > > > recipient or his or her authorized agent, the reader is
hereby
> > > notified
> > > > > > that any dissemination, distribution or copying of this e-
mail
> > > > > > is prohibited. If you have received this e-mail in error,
> > > > > > please notify
> > > > the
> > > > > > sender by replying to this message and delete this e-mail
> > > immediately.
> > > > > >
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > > > --
> > > > > Julie Prestopnik
> > > > > National Center for Atmospheric Research Research
Applications
> > > > > Laboratory
> > > > > Phone: 303.497.8399
> > > > > Email: jpresto at ucar.edu
> > > > >
> > > > > This e-mail, including attachments, may include confidential
> > > > > and/or proprietary information, and may be used only by the
> > > > > person or entity
> > > to
> > > > > which it is addressed. If the reader of this e-mail is not
the
> > > > > intended recipient or his or her authorized agent, the
reader is
> > > > > hereby notified that any dissemination, distribution or
copying
> > > > > of this e-mail is prohibited. If you have received this e-
mail
> > > > > in error, please notify
> > > the
> > > > > sender by replying to this message and delete this e-mail
> > immediately.
> > > > >
> > > > >
> > > > >
> > > >
> > > > This e-mail, including attachments, may include confidential
> > > > and/or proprietary information, and may be used only by the
person
> > > > or entity to which it is addressed. If the reader of this e-
mail
> > > > is not the intended recipient or his or her authorized agent,
the
> > > > reader is hereby notified that any dissemination, distribution
or
> > > > copying of this e-mail is prohibited. If you have received
this
> > > > e-mail in error, please notify the sender by replying to this
> > > > message and delete
> > this e-mail immediately.
> > > >
> > > >
> > > >
> > >
> > >
> > > --
> > > Julie Prestopnik
> > > National Center for Atmospheric Research Research Applications
> > > Laboratory
> > > Phone: 303.497.8399
> > > Email: jpresto at ucar.edu
> > >
> > > This e-mail, including attachments, may include confidential
and/or
> > > proprietary information, and may be used only by the person or
> > > entity to which it is addressed. If the reader of this e-mail is
not
> > > the intended recipient or his or her authorized agent, the
reader is
> > > hereby notified that any dissemination, distribution or copying
of
> > > this e-mail is prohibited. If you have received this e-mail in
> > > error, please notify the sender by replying to this message and
> > > delete this
> > e-mail immediately.
> > >
> > >
> >
> >
> > --
> > Julie Prestopnik
> > National Center for Atmospheric Research Research Applications
> > Laboratory
> > Phone: 303.497.8399
> > Email: jpresto at ucar.edu
> >
> > This e-mail, including attachments, may include confidential
and/or
> > proprietary information, and may be used only by the person or
entity
> > to which it is addressed. If the reader of this e-mail is not the
> > intended recipient or his or her authorized agent, the reader is
> > hereby notified that any dissemination, distribution or copying of
> > this e-mail is prohibited. If you have received this e-mail in
error,
> > please notify the sender by replying to this message and delete
this
> e-mail immediately.
> >
> >
> >
>
>
> --
> Julie Prestopnik
> National Center for Atmospheric Research Research Applications
Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
> This e-mail, including attachments, may include confidential and/or
> proprietary information, and may be used only by the person or
entity to
> which it is addressed. If the reader of this e-mail is not the
intended
> recipient or his or her authorized agent, the reader is hereby
notified
> that any dissemination, distribution or copying of this e-mail is
> prohibited. If you have received this e-mail in error, please notify
the
> sender by replying to this message and delete this e-mail
immediately.
>
>
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #77823] Trouble running radar NETCDF file for grid_stat verifiction
From: Jose Garcia-Rivera
Time: Wed Sep 14 12:48:15 2016
Dear John, Julie
We solved the issue thanks to your great insights! As you mentioned,
we had to flip our array to correctly put the initial indexes in the
lower-left corner of the file. Thanks again for all the support. We'll
keep you posted if any further issues arise.
Best Regards,
Jose
-----Original Message-----
From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
Sent: Tuesday, September 13, 2016 4:27 PM
To: Jose Garcia-Rivera <GarciaJ at imsg.com>
Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar NETCDF
file for grid_stat verifiction
Hello Jose,
This is John Halley Gotway. Thought I'd jump in on this one.
I see that you're getting different results when plotting your radar
NetCDF
file via MET (plot_data_plane) and NCL. The MET data is upside-down
relative to the NCL plot.
I suspect the difference is this... When NCL reads that data, it also
reads
the lat and lon variables to place your data on the earth. When MET
reads
the data, it does not. Instead, it just reads the data values in the
order
they're written in the NetCDF file and uses the mapping information
defined
in the global attributes to place the data on earth.
Looking at the your NetCDF I see that the first point is the upper-
left
corner. And MET is expecting the first point to be the lower-left
corner. MET is expecting the data to be packed as lower-left to
upper-right.
I believe that's the source of the discrepancy. And really there's no
way
in the grid projection information to tell MET to flip the data. It's
just
a short-coming of the simplistic way of reading/writing this NetCDF
data.
Hope that helps clarify.
Thanks,
John
On Tue, Sep 13, 2016 at 12:45 PM, Jose Garcia-Rivera via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
>
> Dear Julie,
>
> Yes, I got the same result as you running plot_data_plane. When I
plot the
> file directly using NCL, I got the correct image. When using
grid_stat and
> plot_data_plane the image went flipped. So there may be an issue
with the
> required configuration of the file for MET to correctly read it.
What do
> you think?
>
> Attached is the output confirming your results.
>
> Thanks,
> Jose,
>
> Just
>
> On Tue, Sep 13, 2016 at 12:45 PM, Jose Garcia-Rivera via RT <
> met_help at ucar.edu> wrote:
>
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
>>
>> Dear Julie,
>>
>> Yes, I got the same result as you running plot_data_plane. When I
plot
>> the file directly using NCL, I got the correct image. When using
grid_stat
>> and plot_data_plane the image went flipped. So there may be an
issue with
>> the required configuration of the file for MET to correctly read
it. What
>> do you think?
>>
>> Attached is the output confirming your results.
>>
>> Thanks,
>> Jose
>>
>> -----Original Message-----
>> From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
>> Sent: Tuesday, September 13, 2016 1:59 PM
>> To: Jose Garcia-Rivera
>> Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar NETCDF
file
>> for grid_stat verifiction
>>
>> Hi Jose.
>>
>> When I ran plot_data_plane on the input observation file,
>> RadarObsNEW_mod_v3.nc, I produced the image I sent you, which
looked
>> similar to the met_OBS.png file that you sent me in that it was
flipped
>> upside-down. So, I produced a similar image pre-grid_stat, using
the raw
>> observation file.
>>
>> How did you produce your radar_OBS.png plot? Could you please try
>> running plot_data_plane on the radar observation file and see if
you get
>> the same output we do? I suspect the problem lies in the way the
radar
>> NetCDF file is being written.
>>
>> Thanks,
>> Julie
>>
>>
>>
>> On Tue, Sep 13, 2016 at 11:53 AM, Jose Garcia-Rivera via RT <
>> met_help at ucar.edu> wrote:
>>
>> >
>> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
>> >
>> > Hi Julie,
>> >
>> > Thanks for checking out. The met_OBS.png is the output I got from
>> > grid_stat. The correct file is radar_OBS.png plot. So, that may
mean
>> > that you are getting the same issue I got. Have you seen this
happening
>> before?
>> >
>> > Best Regards,
>> > Jose
>> >
>> >
>> >
>> > -----Original Message-----
>> > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
>> > Sent: Tuesday, September 13, 2016 1:21 PM
>> > To: Jose Garcia-Rivera
>> > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar
NETCDF
>> > file for grid_stat verifiction
>> >
>> > Hi Jose.
>> >
>> > When I plot the NetCDF3 obs file that we created using nccopy
>> > (RadarObsNEW_mod_v3.nc) using plot_data_plane:
>> >
>> > /usr/local/met-5.2/bin/plot_data_plane RadarObsNEW_mod_v3.nc
>> > RadarObsNEW_mod_v3.ps 'name="REFC"; level="(*,*)";'
>> >
>> > The resulting image, RadarObsNEW_mod_v3.ps (attached), appears to
be
>> > oriented in the same way as the met_OBS.png image that you
attached,
>> > so I don't believe that grid_stat is doing anything to the data,
but
>> > rather that the data was placed into the original NetCDF Obs data
and
>> > needs to be re-oriented there.
>> >
>> > Please let me know if you find that is not the case. Please try
>> > running plot_data_plane on the data that produced the
radar_OBS.png
>> > file and see if you get the same result.
>> >
>> > Thanks,
>> > Julie
>> >
>> > On Tue, Sep 13, 2016 at 9:20 AM, Jose Garcia-Rivera via RT <
>> > met_help at ucar.edu> wrote:
>> >
>> > >
>> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
>> > >
>> > > Dear Julie, John
>> > >
>> > > The commands worked fine. Thank you so much!
>> > >
>> > > Now, there's something that is puzzling us. The radar data from
the
>> > > grid_stat.nc output file seems to be flipped upside-down. I
attached
>> > > the MET-produced OBS vs the original OBS. Is this an artifact
of
>> > > grid_stat, or how can it be fixed?
>> > >
>> > >
>> > >
>> > > Best Regards,
>> > > Jose
>> > >
>> > > ________________________________________
>> > > From: Julie Prestopnik via RT <met_help at ucar.edu>
>> > > Sent: Friday, September 9, 2016 4:07 PM
>> > > To: Jose Garcia-Rivera
>> > > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar
NETCDF
>> > > file for grid_stat verifiction
>> > >
>> > > Hi Jose.
>> > >
>> > > As John indicated the problem lies in that currently MET only
>> > > supports the classic data model... i.e. NetCDF3, which the file
>> > > RadarObsNEW.nc is
>> > not.
>> > >
>> > > Running "file RadarObsNEW.nc" shows that the file is not
"NetCDF
>> > > Data Format data", but rather:
>> > >
>> > > RadarObsNEW.nc: Hierarchical Data Format (version 5) data
>> > >
>> > > You can create a NetCDF3 file when you create the file or you
can
>> > > use the "nccopy" command. However, "nccopy" didn't work with
the
>> > > RadarObsNEW.nc file, until we made some changes. We used
"ncatted"
>> > > to remove the "L" from the value of the following attributes:
>> > > parameter_table_version, parameter_number, level_indicator, nx,
and
>> > > ny. I'll paste in the commands that we used to create a
NetCDF3
>> > > file, plot the data, and get a successful run from grid_stat.
>> > >
>> > > # Update attributes to remove longs
>> > > /usr/local/nco/bin/ncatted \
>> > > -a parameter_table_version,REFC,o,f,129 \ -a
>> > > parameter_number,REFC,o,f,212 \ -a level_indicator,REFC,o,f,200
\ -a
>> > > nx,global,o,i,674 \ -a ny,global,o,i,620 \ RadarObsNEW.nc
>> > > RadarObsNEW_mod.nc
>> > >
>> > > # Convert from NC4 to NC3
>> > > /usr/local/netcdf/bin/nccopy -3 RadarObsNEW_mod.nc
>> > > RadarObsNEW_mod_v3.nc
>> > >
>> > > # Regrid to global grid
>> > > /usr/local/met-5.2/bin/regrid_data_plane \
RadarObsNEW_mod_v3.nc
>> > > G004 RadarObsNEW_mod_v3_G004.nc \ -field 'name="REFC";
level="(*,*)";'
>> > >
>> > > # Plot the result
>> > > /usr/local/met-5.2/bin/plot_data_plane \
RadarObsNEW_mod_v3_G004.nc
>> > > RadarObsNEW_mod_v3_G004.ps \ 'name="REFC"; level="(*,*)";'
>> > >
>> > > # Display plot
>> > > convert -rotate 90 -background white -flatten
>> > > RadarObsNEW_mod_v3_G004.ps RadarObsNEW_mod_v3_G004.png display
>> > > RadarObsNEW_mod_v3_G004.png&
>> > >
>> > > # Plot forecast REFC
>> > > /usr/local/met-5.2/bin/plot_data_plane \ ForecastFile.grb
>> > > refc_fcst.ps \ 'name="REFC"; level="L0"; GRIB1_ptv=129;'
>> > >
>> > > # Display plot
>> > > convert -rotate 90 -background white -flatten refc_fcst.ps
>> > > refc_fcst.png display refc_fcst.png&
>> > >
>> > > # Run grid_stat
>> > > /usr/local/met-5.1/bin/grid_stat ForecastFile.grb
>> > > RadarObsNEW_mod_v3.nc GridStatConfig_dbz -outdir out/
>> > >
>> > > I have also attached the NetCDF3 file that we produced after
using
>> > > ncatted and nccopy.
>> > >
>> > > Please let us know if you have any other questions.
>> > >
>> > > Thanks,
>> > > Julie
>> > >
>> > >
>> > > On Fri, Sep 9, 2016 at 12:43 PM, Jose Garcia-Rivera via RT <
>> > > met_help at ucar.edu> wrote:
>> > >
>> > > >
>> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823
>
>> > > >
>> > > > Hi John,
>> > > >
>> > > > Glad to talk to you again. We did the proposed changes, and
the
>> > > > error keeps showing up.
>> > > >
>> > > > I uploaded the new file as: RadarObsNEW.nc
>> > > >
>> > > > Please try to run it and let me know what issues show up?
>> > > >
>> > > > Thanks for the help,
>> > > > Jose
>> > > > ________________________________________
>> > > > From: John Halley Gotway via RT <met_help at ucar.edu>
>> > > > Sent: Friday, September 9, 2016 2:17 PM
>> > > > To: Jose Garcia-Rivera
>> > > > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar
NETCDF
>> > > > file for grid_stat verifiction
>> > > >
>> > > > Hello Jose,
>> > > >
>> > > > This is John Halley Gotway. I work with Julie on providing
>> > > > support for MET.
>> > > >
>> > > > I think there's a few pieces of info we're missing here.
>> > > >
>> > > > (1) MET does not currently support the enhanced data model of
>> NetCDF4.
>> > > It
>> > > > only supports the classic data model... i.e. NetCDF3. In the
next
>> > > version
>> > > > of MET (6.0), due out next year, we'll be adding support for
>> NetCDF4.
>> > > The
>> > > > file you sent us in NetCDF4 but when Julie add those
attributes
>> > > > she may have used ncdump/ncgen. And their output is NetCDF3.
Try
>> > > > updating your NCL script to write a "classic" NetCDF file.
>> > > >
>> > > > (2) Yes, the "MET_version" global attribute needs to be
present.
>> > > > That tells MET how to parse the grid information.
>> > > >
>> > > > (3) I'm not sure that the variable "name" attribute is
necessary,
>> > > > but it doesn't hurt.
>> > > >
>> > > > (4) The biggest problem is in the definition of your Mercator
grid:
>> > > > :Projection = "Mercator" ;
>> > > > :lat_ll = "3348550.177 degrees_north" ;
>> > > > :lon_ll = "13120540.425 degrees_east" ;
>> > > > :lat_ur = "4057346.9 degrees_north" ;
>> > > > :lon_ur = "13891071.057 degrees_east" ;
>> > > >
>> > > > Those don't look like very meaningful lat/lon values! Where
did
>> > > > you get these numbers? Are they meant to match the grid
defined
>> > > > in the GRIB file you sent us?
>> > > >
>> > > > Thanks,
>> > > > John
>> > > >
>> > > > On Fri, Sep 9, 2016 at 12:08 PM, Jose Garcia-Rivera via RT <
>> > > > met_help at ucar.edu> wrote:
>> > > >
>> > > > >
>> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
>> > > > >
>> > > > > Dear Julie,
>> > > > >
>> > > > > The file that you modified worked. However, we did the
changes
>> > > > > you
>> > > made,
>> > > > > and grid_stat continues to show the same error.
>> > > > >
>> > > > > I've uploaded the file in the same FTP directory, named:
>> > > > > Hongqiao.Refl.20150602.s100000.e100500.attributes.nc
>> > > > >
>> > > > > This is a file dump of our modified netcdf:
>> > > > >
>> > > > > NCAR Command Language Version 6.3.0 The use of this
software is
>> > > > > governed by a License Agreement.
>> > > > > See http://www.ncl.ucar.edu/ for more details.
>> > > > >
>> > > > > Variable: f
>> > > > > Type: file
>> > > > > filename:
Hongqiao.Refl.20150602.s100000.e100500.attributes
>> > > > > path:
Hongqiao.Refl.20150602.s100000.e100500.attributes.nc
>> > > > > Number of Attributes:8
>> > > > > MET_version : V5.1
>> > > > > Projection : Mercator
>> > > > > lat_ll : 3348550.177 degrees_north
>> > > > > lon_ll : 13120540.425 degrees_east
>> > > > > lat_ur : 4057346.9 degrees_north
>> > > > > lon_ur : 13891071.057 degrees_east
>> > > > > nx : 674
>> > > > > ny : 620
>> > > > >
>> > > > > dimensions:
>> > > > > lon = 674
>> > > > > lat = 620
>> > > > >
>> > > > > variables:
>> > > > > Variable: lat
>> > > > > Type: float
>> > > > > Total Size: 417880 values
>> > > > > 1671520 bytes
>> > > > > Number of Dimensions: 2
>> > > > > Dimensions and sizes: [ 620 <lat> x 674 <lon> ]
>> > > > > Coordinates:
>> > > > > lat: [4057347..4057347]
>> > > > > lon: [1.312054e+07..1.388993e+07]
>> > > > > Number of Attributes: 2
>> > > > > units : degrees_north
>> > > > > standard_name : latitude
>> > > > >
>> > > > > Variable: lon
>> > > > > Type: float
>> > > > > Total Size: 417880 values
>> > > > > 1671520 bytes
>> > > > > Number of Dimensions: 2
>> > > > > Dimensions and sizes: [ 620 <lat> x 674 <lon> ]
>> > > > > Coordinates:
>> > > > > lat: [4057347..4057347]
>> > > > > lon: [1.312054e+07..1.388993e+07]
>> > > > > Number of Attributes: 2
>> > > > > units : degrees_east
>> > > > > standard_name : longitude
>> > > > >
>> > > > > Variable: REFC
>> > > > > Type: float
>> > > > > Total Size: 417880 values
>> > > > > 1671520 bytes
>> > > > > Number of Dimensions: 2
>> > > > > Dimensions and sizes: [ 620 <lat> x 674 <lon> ]
>> > > > > Coordinates:
>> > > > > lat: [4057347..4057347]
>> > > > > lon: [1.312054e+07..1.388993e+07]
>> > > > > Number of Attributes: 11
>> > > > > name : REFC
>> > > > > units : dbZ
>> > > > > parameter_table_version : 129
>> > > > > parameter_number : 212
>> > > > > level_indicator : 200
>> > > > > level : L0
>> > > > > long_name : MaxReflectivity
>> > > > > init_time : 20050807_000000
>> > > > > init_time_ut : 1123372800
>> > > > > valid_time : 20050807_120000
>> > > > > valid_time_ut : 1123416000
>> > > > >
>> > > > >
>> > > > >
>> > > > > Best Regards,
>> > > > > Jose
>> > > > >
>> > > > >
>> > > > > ________________________________________
>> > > > > From: Julie Prestopnik via RT <met_help at ucar.edu>
>> > > > > Sent: Friday, September 9, 2016 1:09 PM
>> > > > > To: Jose Garcia-Rivera
>> > > > > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar
>> > > > > NETCDF
>> > > file
>> > > > > for grid_stat verifiction
>> > > > >
>> > > > > Hi Jose. Thank you for uploading your data. There were
two
>> > > > > important things missing from your file.
>> > > > >
>> > > > > I added:
>> > > > >
>> > > > > REFC:name = "REFC" ;
>> > > > >
>> > > > > under:
>> > > > >
>> > > > > float REFC(lat, lon) ;
>> > > > >
>> > > > > and I added:
>> > > > >
>> > > > > :MET_version = "V5.1" ;
>> > > > >
>> > > > > under // global attributes:
>> > > > >
>> > > > > and was able to get a successful run of grid_stat.
>> > > > >
>> > > > > I am attaching the file with the changes. Please give it a
try
>> > > > > and let
>> > > > me
>> > > > > know if you get a successful run as well.
>> > > > >
>> > > > > Thanks,
>> > > > > Julie
>> > > > >
>> > > > > On Fri, Sep 9, 2016 at 10:38 AM, Jose Garcia-Rivera via RT
<
>> > > > > met_help at ucar.edu> wrote:
>> > > > >
>> > > > > >
>> > > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823
>> > > > > > >
>> > > > > >
>> > > > > > Dear Julie,
>> > > > > >
>> > > > > > We used the Mercator example, and ours looks identical to
yours.
>> > > > > > I proceeded and put 4 files into your FTP server:
>> > > > > >
>> > > > > > Model forecast file
>> > > > > > Radar Obs file
>> > > > > > Grid Stat Config file
>> > > > > > domain.poly file
>> > > > > >
>> > > > > > The files are under 'garcia_data'
>> > > > > >
>> > > > > >
>> > > > > > Thanks so much for your help,
>> > > > > > Jose
>> > > > > > ________________________________________
>> > > > > > From: Julie Prestopnik via RT <met_help at ucar.edu>
>> > > > > > Sent: Friday, September 9, 2016 11:50 AM
>> > > > > > To: Jose Garcia-Rivera
>> > > > > > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running
radar
>> > > > > > NETCDF
>> > > > file
>> > > > > > for grid_stat verifiction
>> > > > > >
>> > > > > > Hi Jose. I have attached a Mercator projection example.
If
>> > > > > > you're still stuck, please post your data to our
anonymous FTP
>> > > > > > site following these instructions:
>> > > > > >
http://www.dtcenter.org/met/users/support/met_help.php#ftp
>> > > > > >
>> > > > > > Thanks,
>> > > > > > Julie
>> > > > > >
>> > > > > >
>> > > > > > On Thu, Sep 8, 2016 at 3:25 PM, Jose Garcia-Rivera via RT
>> > > > > > <met_help at ucar.edu> wrote:
>> > > > > > >
>> > > > > > > <URL:
>> > > > > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823
>> > > > > > > >
>> > > > > > >
>> > > > > > > Dear Julie,
>> > > > > > >
>> > > > > > > That's very good information, thanks. We've been
working on
>> > > > > > > this
>> > > > issue,
>> > > > > > however the same error keeps showing up.
>> > > > > > >
>> > > > > > > Can we get a Mercator projection example?
>> > > > > > >
>> > > > > > > I was wondering if you could have a peek into our
netcdf
>> > > > > > > file, or
>> > > run
>> > > > > an
>> > > > > > internal test to see what needs to be changed, or what
may be
>> > wrong.
>> > > In
>> > > > > the
>> > > > > > meantime, we continue working on trying to make the file
fit
>> > > > > > MET requirements.
>> > > > > > >
>> > > > > > > Thanks for the help,
>> > > > > > > Jose
>> > > > > > >
>> > > > > > > ________________________________________
>> > > > > > > From: Julie Prestopnik via RT <met_help at ucar.edu>
>> > > > > > > Sent: Thursday, September 8, 2016 3:57 PM
>> > > > > > > To: Jose Garcia-Rivera
>> > > > > > > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running
radar
>> > > > > > > NETCDF
>> > > > > file
>> > > > > > for grid_stat verifiction
>> > > > > > >
>> > > > > > > Hi Jose.
>> > > > > > >
>> > > > > > > Unfortunately, we do not have a radar obs netcdf
example file.
>> > > With
>> > > > > > > NetCDF, users have two choices:
>> > > > > > > --make it look like the NetCDF files that MET generates
(i.e.
>> > > > > > > the output of pcp_combine) or --put it into CF-
compliant
>> > > > > > > NetCDF The variable can be named "radar_obs" or
"precip" or
>> > > > > > > anything you'd
>> > > > > like.
>> > > > > > >
>> > > > > > > Julie
>> > > > > > >
>> > > > > > >
>> > > > > > > On Thu, Sep 8, 2016 at 12:10 PM, Jose Garcia-Rivera via
RT
>> > > > > > > <met_help at ucar.edu> wrote:
>> > > > > > >>
>> > > > > > >> <URL:
>> > > > > > >>
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823
>> > > > > > >> >
>> > > > > > >>
>> > > > > > >> Dear Julie,
>> > > > > > >>
>> > > > > > >> Thanks so much for the file. We haven't been able to
work
>> > > > > > >> on it
>> > > yet,
>> > > > > > since we are fixing computer issues. One more question,
do you
>> > > > > > have a
>> > > > > radar
>> > > > > > obs netcdf example file?
>> > > > > > >>
>> > > > > > >> Best Regards,
>> > > > > > >> Jose
>> > > > > > >>
>> > > > > > >> From: Julie Prestopnik via RT <met_help at ucar.edu>
>> > > > > > >> Sent: Thursday, September 8, 2016 12:58 PM
>> > > > > > >> To: Jose Garcia-Rivera
>> > > > > > >> Subject: Re: [rt.rap.ucar.edu #77823] Trouble running
radar
>> > > NETCDF
>> > > > > > file for grid_stat verifiction
>> > > > > > >>
>> > > > > > >> My apologies. I meant to attach the file in my last
email.
>> > You
>> > > > can
>> > > > > > >> find it attached to this one.
>> > > > > > >>
>> > > > > > >> Thanks,
>> > > > > > >> Julie
>> > > > > > >>
>> > > > > > >> On Thu, Sep 8, 2016 at 10:36 AM, Jose Garcia-Rivera
via RT
>> > > > > > >> <met_help at ucar.edu> wrote:
>> > > > > > >>>
>> > > > > > >>> <URL:
>> > > > > > >>>
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
>> > > > > > >>>
>> > > > > > >>> Dear Julie,
>> > > > > > >>>
>> > > > > > >>> Thanks for the helpful response. Can I have an
example
>> > > > > > >>> file from
>> > > > the
>> > > > > > pcp_combine tool for reference?
>> > > > > > >>>
>> > > > > > >>> Best Regards,
>> > > > > > >>> Jose
>> > > > > > >>> ________________________________________
>> > > > > > >>> From: Julie Prestopnik via RT <met_help at ucar.edu>
>> > > > > > >>> Sent: Thursday, September 8, 2016 11:57 AM
>> > > > > > >>> To: Jose Garcia-Rivera
>> > > > > > >>> Subject: Re: [rt.rap.ucar.edu #77823] Trouble running
>> > > > > > >>> radar
>> > > NETCDF
>> > > > > > file for grid_stat verifiction
>> > > > > > >>>
>> > > > > > >>> Hi Jose.
>> > > > > > >>>
>> > > > > > >>> I see that you are running MET 5.1, but are unsure of
how
>> > > > > > >>> the
>> > > > NetCDF
>> > > > > > >>> files should be formatted in order for GridStat to be
able
>> > > > > > >>> to
>> > > read
>> > > > > > >>> them.
>> > > > > > >>>
>> > > > > > >>> In order it use gridded NetCDF files in MET, you'll
need
>> > > > > > >>> to make
>> > > > them
>> > > > > > >>> look like the output of the pcp_combine tool.
>> > > > > > >>>
>> > > > > > >>> Listed below is the header from one of the NetCDF
files
>> > > > > > >>> from pcp_combine created by the METv5.1 test scripts.
>> > > > > > >>> Here are the required parts.
>> > > > > > >>>
>> > > > > > >>> (1) dimensions should be named "lat" and "lon"
>> > > > > > >>> (2) the "lat" and "lon" variable are **NOT**
required
>> > > > > > >>> (3) gridded variables (e.g. APCP_12) must use the
"lat"
>> > > > > > >>> and
>> > > "lon"
>> > > > > > dimensions
>> > > > > > >>> (4) gridded variables should include the attributes
>> > > > > > >>> listed in
>> > > the
>> > > > > > >>> example (for timing info, only the init_time_ut,
>> > > > > > >>> valid_time_ut,
>> > > and
>> > > > > > >>> accum_time_sec are actually used. "ut" stands for
unix
>> > > > > > >>> time, the number of seconds since Jan 1, 1970).
>> > > > > > >>> (5) global attributes should include the
grid/projection
>> > > > > > >>> information. This example shows how they're
specified for
>> > > > > > >>> a
>> > > > lambert
>> > > > > > >>> conformal projection. Let me know if you're using a
>> > > > > > >>> different projection and I'll send you an example.
>> > > > > > >>>
>> > > > > > >>> I hope that helps get you going.
>> > > > > > >>>
>> > > > > > >>> Julie
>> > > > > > >>>
>> > > > > > >>>
>> > > > > > >>>
>> > > > > > >>> On Wed, Sep 7, 2016 at 3:15 PM, Jose Garcia-Rivera
via RT
>> > > > > > >>> <met_help at ucar.edu> wrote:
>> > > > > > >>>>
>> > > > > > >>>> Wed Sep 07 15:15:39 2016: Request 77823 was acted
upon.
>> > > > > > >>>> Transaction: Ticket created by GarciaJ at imsg.com
>> > > > > > >>>> Queue: met_help
>> > > > > > >>>> Subject: Trouble running radar NETCDF file for
>> > > > > > >>>> grid_stat
>> > > > > > verifiction
>> > > > > > >>>> Owner: Nobody
>> > > > > > >>>> Requestors: GarciaJ at imsg.com
>> > > > > > >>>> Status: new
>> > > > > > >>>> Ticket <URL: https://rt.rap.ucar.edu/rt/
>> > > > > Ticket/Display.html?id=77823
>> > > > > > >
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>> Dear Met Help,
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>> I've been trying to run MET using a radar NETCDF
file,
>> > > > > > >>>> and an
>> > > NMMB
>> > > > > > model forecast GRIB file, but the following error shows
up:
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>> DEBUG 1: Default Config File:
/work/apps/pgi_14.10/SANDY/
>> > > > > > met-5.1/share/met/config/GridStatConfig_default
>> > > > > > >>>> DEBUG 1: User Config File: GridStatConfig_dbz ERROR
:
>> > > > > > >>>> ERROR : Trouble reading observation file
>> > > "Hongqiao.Refl.20150602.
>> > > > > > s100000.e100500.attributes.nc"
>> > > > > > >>>> ERROR :
>> > > > > > >>>>
>> > > > > > >>>> We used two versions of the OBS file, one as it was,
and
>> > > > > > >>>> the
>> > > > second
>> > > > > > with added "attributes". Still, the same error occurred.
We
>> > > > > > are not
>> > > > sure
>> > > > > on
>> > > > > > exactly how our NETCDF files need to be for MET to be
able to
>> > > > > > read
>> > > > them.
>> > > > > I
>> > > > > > searched the error message on the Guide and nothing
showed up.
>> > > > > > >>>>
>> > > > > > >>>> We can share the files to your FTP if you want to
run them.
>> > > > > > >>>>
>> > > > > > >>>> Any help will be greatly appreciated.
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>> NOTE: We are using MET 5.1
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>> Best Regards,
>> > > > > > >>>>
>> > > > > > >>>> Jose
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>> Jose M. Garcia-Rivera, PhD
>> > > > > > >>>>
>> > > > > > >>>> Atmospheric Scientist
>> > > > > > >>>>
>> > > > > > >>>> IM Systems Group
>> > > > > > >>>>
>> > > > > > >>>> Rockville/College Park, MD
>> > > > > > >>>>
>> > > > > > >>>> This e-mail, including attachments, may include
>> > > > > > >>>> confidential
>> > > > and/or
>> > > > > > proprietary information, and may be used only by the
person or
>> > > > > > entity
>> > > > to
>> > > > > > which it is addressed. If the reader of this e-mail is
not the
>> > > intended
>> > > > > > recipient or his or her authorized agent, the reader is
hereby
>> > > notified
>> > > > > > that any dissemination, distribution or copying of this
e-mail
>> > > > > > is prohibited. If you have received this e-mail in error,
>> > > > > > please notify
>> > > > the
>> > > > > > sender by replying to this message and delete this e-mail
>> > > immediately.
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>
>> > > > > > >>>
>> > > > > > >>>
>> > > > > > >>> --
>> > > > > > >>> Julie Prestopnik
>> > > > > > >>> National Center for Atmospheric Research Research
>> > > > > > >>> Applications Laboratory
>> > > > > > >>> Phone: 303.497.8399
>> > > > > > >>> Email: jpresto at ucar.edu
>> > > > > > >>>
>> > > > > > >>>
>> > > > > > >>> This e-mail, including attachments, may include
>> > > > > > >>> confidential
>> > > and/or
>> > > > > > proprietary information, and may be used only by the
person or
>> > > > > > entity
>> > > > to
>> > > > > > which it is addressed. If the reader of this e-mail is
not the
>> > > intended
>> > > > > > recipient or his or her authorized agent, the reader is
hereby
>> > > notified
>> > > > > > that any dissemination, distribution or copying of this
e-mail
>> > > > > > is prohibited. If you have received this e-mail in error,
>> > > > > > please notify
>> > > > the
>> > > > > > sender by replying to this message and delete this e-mail
>> > > immediately.
>> > > > > > >>>
>> > > > > > >>>
>> > > > > > >>
>> > > > > > >>
>> > > > > > >>
>> > > > > > >> --
>> > > > > > >> Julie Prestopnik
>> > > > > > >> National Center for Atmospheric Research Research
>> > > > > > >> Applications Laboratory
>> > > > > > >> Phone: 303.497.8399
>> > > > > > >> Email: jpresto at ucar.edu
>> > > > > > >>
>> > > > > > >> This e-mail, including attachments, may include
>> > > > > > >> confidential
>> > > and/or
>> > > > > > proprietary information, and may be used only by the
person or
>> > > > > > entity
>> > > > to
>> > > > > > which it is addressed. If the reader of this e-mail is
not the
>> > > intended
>> > > > > > recipient or his or her authorized agent, the reader is
hereby
>> > > notified
>> > > > > > that any dissemination, distribution or copying of this
e-mail
>> > > > > > is prohibited. If you have received this e-mail in error,
>> > > > > > please notify
>> > > > the
>> > > > > > sender by replying to this message and delete this e-mail
>> > > immediately.
>> > > > > > >>
>> > > > > > >>
>> > > > > > >
>> > > > > > >
>> > > > > > >
>> > > > > > > --
>> > > > > > > Julie Prestopnik
>> > > > > > > National Center for Atmospheric Research Research
>> > > > > > > Applications Laboratory
>> > > > > > > Phone: 303.497.8399
>> > > > > > > Email: jpresto at ucar.edu
>> > > > > > >
>> > > > > > >
>> > > > > > > This e-mail, including attachments, may include
confidential
>> > > > > > > and/or
>> > > > > > proprietary information, and may be used only by the
person or
>> > > > > > entity
>> > > > to
>> > > > > > which it is addressed. If the reader of this e-mail is
not the
>> > > intended
>> > > > > > recipient or his or her authorized agent, the reader is
hereby
>> > > notified
>> > > > > > that any dissemination, distribution or copying of this
e-mail
>> > > > > > is prohibited. If you have received this e-mail in error,
>> > > > > > please notify
>> > > > the
>> > > > > > sender by replying to this message and delete this e-mail
>> > > immediately.
>> > > > > > >
>> > > > > > >
>> > > > > >
>> > > > > >
>> > > > > >
>> > > > > > --
>> > > > > > Julie Prestopnik
>> > > > > > National Center for Atmospheric Research Research
Applications
>> > > > > > Laboratory
>> > > > > > Phone: 303.497.8399
>> > > > > > Email: jpresto at ucar.edu
>> > > > > >
>> > > > > > This e-mail, including attachments, may include
confidential
>> > > > > > and/or proprietary information, and may be used only by
the
>> > > > > > person or entity
>> > > > to
>> > > > > > which it is addressed. If the reader of this e-mail is
not the
>> > > intended
>> > > > > > recipient or his or her authorized agent, the reader is
hereby
>> > > notified
>> > > > > > that any dissemination, distribution or copying of this
e-mail
>> > > > > > is prohibited. If you have received this e-mail in error,
>> > > > > > please notify
>> > > > the
>> > > > > > sender by replying to this message and delete this e-mail
>> > > immediately.
>> > > > > >
>> > > > > >
>> > > > > >
>> > > > >
>> > > > >
>> > > > > --
>> > > > > Julie Prestopnik
>> > > > > National Center for Atmospheric Research Research
Applications
>> > > > > Laboratory
>> > > > > Phone: 303.497.8399
>> > > > > Email: jpresto at ucar.edu
>> > > > >
>> > > > > This e-mail, including attachments, may include
confidential
>> > > > > and/or proprietary information, and may be used only by the
>> > > > > person or entity
>> > > to
>> > > > > which it is addressed. If the reader of this e-mail is not
the
>> > > > > intended recipient or his or her authorized agent, the
reader is
>> > > > > hereby notified that any dissemination, distribution or
copying
>> > > > > of this e-mail is prohibited. If you have received this e-
mail
>> > > > > in error, please notify
>> > > the
>> > > > > sender by replying to this message and delete this e-mail
>> > immediately.
>> > > > >
>> > > > >
>> > > > >
>> > > >
>> > > > This e-mail, including attachments, may include confidential
>> > > > and/or proprietary information, and may be used only by the
person
>> > > > or entity to which it is addressed. If the reader of this e-
mail
>> > > > is not the intended recipient or his or her authorized agent,
the
>> > > > reader is hereby notified that any dissemination,
distribution or
>> > > > copying of this e-mail is prohibited. If you have received
this
>> > > > e-mail in error, please notify the sender by replying to this
>> > > > message and delete
>> > this e-mail immediately.
>> > > >
>> > > >
>> > > >
>> > >
>> > >
>> > > --
>> > > Julie Prestopnik
>> > > National Center for Atmospheric Research Research Applications
>> > > Laboratory
>> > > Phone: 303.497.8399
>> > > Email: jpresto at ucar.edu
>> > >
>> > > This e-mail, including attachments, may include confidential
and/or
>> > > proprietary information, and may be used only by the person or
>> > > entity to which it is addressed. If the reader of this e-mail
is not
>> > > the intended recipient or his or her authorized agent, the
reader is
>> > > hereby notified that any dissemination, distribution or copying
of
>> > > this e-mail is prohibited. If you have received this e-mail in
>> > > error, please notify the sender by replying to this message and
>> > > delete this
>> > e-mail immediately.
>> > >
>> > >
>> >
>> >
>> > --
>> > Julie Prestopnik
>> > National Center for Atmospheric Research Research Applications
>> > Laboratory
>> > Phone: 303.497.8399
>> > Email: jpresto at ucar.edu
>> >
>> > This e-mail, including attachments, may include confidential
and/or
>> > proprietary information, and may be used only by the person or
entity
>> > to which it is addressed. If the reader of this e-mail is not the
>> > intended recipient or his or her authorized agent, the reader is
>> > hereby notified that any dissemination, distribution or copying
of
>> > this e-mail is prohibited. If you have received this e-mail in
error,
>> > please notify the sender by replying to this message and delete
this
>> e-mail immediately.
>> >
>> >
>> >
>>
>>
>> --
>> Julie Prestopnik
>> National Center for Atmospheric Research Research Applications
Laboratory
>> Phone: 303.497.8399
>> Email: jpresto at ucar.edu
>>
>> This e-mail, including attachments, may include confidential and/or
>> proprietary information, and may be used only by the person or
entity to
>> which it is addressed. If the reader of this e-mail is not the
intended
>> recipient or his or her authorized agent, the reader is hereby
notified
>> that any dissemination, distribution or copying of this e-mail is
>> prohibited. If you have received this e-mail in error, please
notify the
>> sender by replying to this message and delete this e-mail
immediately.
>>
>>
> Jose
>
> -----Original Message-----
> From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> Sent: Tuesday, September 13, 2016 1:59 PM
> To: Jose Garcia-Rivera
> Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar NETCDF
file
> for grid_stat verifiction
>
> Hi Jose.
>
> When I ran plot_data_plane on the input observation file,
> RadarObsNEW_mod_v3.nc, I produced the image I sent you, which looked
> similar to the met_OBS.png file that you sent me in that it was
flipped
> upside-down. So, I produced a similar image pre-grid_stat, using
the raw
> observation file.
>
> How did you produce your radar_OBS.png plot? Could you please try
running
> plot_data_plane on the radar observation file and see if you get the
same
> output we do? I suspect the problem lies in the way the radar
NetCDF file
> is being written.
>
> Thanks,
> Julie
>
>
>
> On Tue, Sep 13, 2016 at 11:53 AM, Jose Garcia-Rivera via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
> >
> > Hi Julie,
> >
> > Thanks for checking out. The met_OBS.png is the output I got from
> > grid_stat. The correct file is radar_OBS.png plot. So, that may
mean
> > that you are getting the same issue I got. Have you seen this
happening
> before?
> >
> > Best Regards,
> > Jose
> >
> >
> >
> > -----Original Message-----
> > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > Sent: Tuesday, September 13, 2016 1:21 PM
> > To: Jose Garcia-Rivera
> > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar NETCDF
> > file for grid_stat verifiction
> >
> > Hi Jose.
> >
> > When I plot the NetCDF3 obs file that we created using nccopy
> > (RadarObsNEW_mod_v3.nc) using plot_data_plane:
> >
> > /usr/local/met-5.2/bin/plot_data_plane RadarObsNEW_mod_v3.nc
> > RadarObsNEW_mod_v3.ps 'name="REFC"; level="(*,*)";'
> >
> > The resulting image, RadarObsNEW_mod_v3.ps (attached), appears to
be
> > oriented in the same way as the met_OBS.png image that you
attached,
> > so I don't believe that grid_stat is doing anything to the data,
but
> > rather that the data was placed into the original NetCDF Obs data
and
> > needs to be re-oriented there.
> >
> > Please let me know if you find that is not the case. Please try
> > running plot_data_plane on the data that produced the
radar_OBS.png
> > file and see if you get the same result.
> >
> > Thanks,
> > Julie
> >
> > On Tue, Sep 13, 2016 at 9:20 AM, Jose Garcia-Rivera via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
> > >
> > > Dear Julie, John
> > >
> > > The commands worked fine. Thank you so much!
> > >
> > > Now, there's something that is puzzling us. The radar data from
the
> > > grid_stat.nc output file seems to be flipped upside-down. I
attached
> > > the MET-produced OBS vs the original OBS. Is this an artifact of
> > > grid_stat, or how can it be fixed?
> > >
> > >
> > >
> > > Best Regards,
> > > Jose
> > >
> > > ________________________________________
> > > From: Julie Prestopnik via RT <met_help at ucar.edu>
> > > Sent: Friday, September 9, 2016 4:07 PM
> > > To: Jose Garcia-Rivera
> > > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar
NETCDF
> > > file for grid_stat verifiction
> > >
> > > Hi Jose.
> > >
> > > As John indicated the problem lies in that currently MET only
> > > supports the classic data model... i.e. NetCDF3, which the file
> > > RadarObsNEW.nc is
> > not.
> > >
> > > Running "file RadarObsNEW.nc" shows that the file is not "NetCDF
> > > Data Format data", but rather:
> > >
> > > RadarObsNEW.nc: Hierarchical Data Format (version 5) data
> > >
> > > You can create a NetCDF3 file when you create the file or you
can
> > > use the "nccopy" command. However, "nccopy" didn't work with
the
> > > RadarObsNEW.nc file, until we made some changes. We used
"ncatted"
> > > to remove the "L" from the value of the following attributes:
> > > parameter_table_version, parameter_number, level_indicator, nx,
and
> > > ny. I'll paste in the commands that we used to create a NetCDF3
> > > file, plot the data, and get a successful run from grid_stat.
> > >
> > > # Update attributes to remove longs
> > > /usr/local/nco/bin/ncatted \
> > > -a parameter_table_version,REFC,o,f,129 \ -a
> > > parameter_number,REFC,o,f,212 \ -a level_indicator,REFC,o,f,200
\ -a
> > > nx,global,o,i,674 \ -a ny,global,o,i,620 \ RadarObsNEW.nc
> > > RadarObsNEW_mod.nc
> > >
> > > # Convert from NC4 to NC3
> > > /usr/local/netcdf/bin/nccopy -3 RadarObsNEW_mod.nc
> > > RadarObsNEW_mod_v3.nc
> > >
> > > # Regrid to global grid
> > > /usr/local/met-5.2/bin/regrid_data_plane \ RadarObsNEW_mod_v3.nc
> > > G004 RadarObsNEW_mod_v3_G004.nc \ -field 'name="REFC";
level="(*,*)";'
> > >
> > > # Plot the result
> > > /usr/local/met-5.2/bin/plot_data_plane \
RadarObsNEW_mod_v3_G004.nc
> > > RadarObsNEW_mod_v3_G004.ps \ 'name="REFC"; level="(*,*)";'
> > >
> > > # Display plot
> > > convert -rotate 90 -background white -flatten
> > > RadarObsNEW_mod_v3_G004.ps RadarObsNEW_mod_v3_G004.png display
> > > RadarObsNEW_mod_v3_G004.png&
> > >
> > > # Plot forecast REFC
> > > /usr/local/met-5.2/bin/plot_data_plane \ ForecastFile.grb
> > > refc_fcst.ps \ 'name="REFC"; level="L0"; GRIB1_ptv=129;'
> > >
> > > # Display plot
> > > convert -rotate 90 -background white -flatten refc_fcst.ps
> > > refc_fcst.png display refc_fcst.png&
> > >
> > > # Run grid_stat
> > > /usr/local/met-5.1/bin/grid_stat ForecastFile.grb
> > > RadarObsNEW_mod_v3.nc GridStatConfig_dbz -outdir out/
> > >
> > > I have also attached the NetCDF3 file that we produced after
using
> > > ncatted and nccopy.
> > >
> > > Please let us know if you have any other questions.
> > >
> > > Thanks,
> > > Julie
> > >
> > >
> > > On Fri, Sep 9, 2016 at 12:43 PM, Jose Garcia-Rivera via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823
>
> > > >
> > > > Hi John,
> > > >
> > > > Glad to talk to you again. We did the proposed changes, and
the
> > > > error keeps showing up.
> > > >
> > > > I uploaded the new file as: RadarObsNEW.nc
> > > >
> > > > Please try to run it and let me know what issues show up?
> > > >
> > > > Thanks for the help,
> > > > Jose
> > > > ________________________________________
> > > > From: John Halley Gotway via RT <met_help at ucar.edu>
> > > > Sent: Friday, September 9, 2016 2:17 PM
> > > > To: Jose Garcia-Rivera
> > > > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar
NETCDF
> > > > file for grid_stat verifiction
> > > >
> > > > Hello Jose,
> > > >
> > > > This is John Halley Gotway. I work with Julie on providing
> > > > support for MET.
> > > >
> > > > I think there's a few pieces of info we're missing here.
> > > >
> > > > (1) MET does not currently support the enhanced data model of
> NetCDF4.
> > > It
> > > > only supports the classic data model... i.e. NetCDF3. In the
next
> > > version
> > > > of MET (6.0), due out next year, we'll be adding support for
NetCDF4.
> > > The
> > > > file you sent us in NetCDF4 but when Julie add those
attributes
> > > > she may have used ncdump/ncgen. And their output is NetCDF3.
Try
> > > > updating your NCL script to write a "classic" NetCDF file.
> > > >
> > > > (2) Yes, the "MET_version" global attribute needs to be
present.
> > > > That tells MET how to parse the grid information.
> > > >
> > > > (3) I'm not sure that the variable "name" attribute is
necessary,
> > > > but it doesn't hurt.
> > > >
> > > > (4) The biggest problem is in the definition of your Mercator
grid:
> > > > :Projection = "Mercator" ;
> > > > :lat_ll = "3348550.177 degrees_north" ;
> > > > :lon_ll = "13120540.425 degrees_east" ;
> > > > :lat_ur = "4057346.9 degrees_north" ;
> > > > :lon_ur = "13891071.057 degrees_east" ;
> > > >
> > > > Those don't look like very meaningful lat/lon values! Where
did
> > > > you get these numbers? Are they meant to match the grid
defined
> > > > in the GRIB file you sent us?
> > > >
> > > > Thanks,
> > > > John
> > > >
> > > > On Fri, Sep 9, 2016 at 12:08 PM, Jose Garcia-Rivera via RT <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > > >
> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
> > > > >
> > > > > Dear Julie,
> > > > >
> > > > > The file that you modified worked. However, we did the
changes
> > > > > you
> > > made,
> > > > > and grid_stat continues to show the same error.
> > > > >
> > > > > I've uploaded the file in the same FTP directory, named:
> > > > > Hongqiao.Refl.20150602.s100000.e100500.attributes.nc
> > > > >
> > > > > This is a file dump of our modified netcdf:
> > > > >
> > > > > NCAR Command Language Version 6.3.0 The use of this
software is
> > > > > governed by a License Agreement.
> > > > > See http://www.ncl.ucar.edu/ for more details.
> > > > >
> > > > > Variable: f
> > > > > Type: file
> > > > > filename:
Hongqiao.Refl.20150602.s100000.e100500.attributes
> > > > > path: Hongqiao.Refl.20150602.s100000.e100500.attributes.nc
> > > > > Number of Attributes:8
> > > > > MET_version : V5.1
> > > > > Projection : Mercator
> > > > > lat_ll : 3348550.177 degrees_north
> > > > > lon_ll : 13120540.425 degrees_east
> > > > > lat_ur : 4057346.9 degrees_north
> > > > > lon_ur : 13891071.057 degrees_east
> > > > > nx : 674
> > > > > ny : 620
> > > > >
> > > > > dimensions:
> > > > > lon = 674
> > > > > lat = 620
> > > > >
> > > > > variables:
> > > > > Variable: lat
> > > > > Type: float
> > > > > Total Size: 417880 values
> > > > > 1671520 bytes
> > > > > Number of Dimensions: 2
> > > > > Dimensions and sizes: [ 620 <lat> x 674 <lon> ]
> > > > > Coordinates:
> > > > > lat: [4057347..4057347]
> > > > > lon: [1.312054e+07..1.388993e+07]
> > > > > Number of Attributes: 2
> > > > > units : degrees_north
> > > > > standard_name : latitude
> > > > >
> > > > > Variable: lon
> > > > > Type: float
> > > > > Total Size: 417880 values
> > > > > 1671520 bytes
> > > > > Number of Dimensions: 2
> > > > > Dimensions and sizes: [ 620 <lat> x 674 <lon> ]
> > > > > Coordinates:
> > > > > lat: [4057347..4057347]
> > > > > lon: [1.312054e+07..1.388993e+07]
> > > > > Number of Attributes: 2
> > > > > units : degrees_east
> > > > > standard_name : longitude
> > > > >
> > > > > Variable: REFC
> > > > > Type: float
> > > > > Total Size: 417880 values
> > > > > 1671520 bytes
> > > > > Number of Dimensions: 2
> > > > > Dimensions and sizes: [ 620 <lat> x 674 <lon> ]
> > > > > Coordinates:
> > > > > lat: [4057347..4057347]
> > > > > lon: [1.312054e+07..1.388993e+07]
> > > > > Number of Attributes: 11
> > > > > name : REFC
> > > > > units : dbZ
> > > > > parameter_table_version : 129
> > > > > parameter_number : 212
> > > > > level_indicator : 200
> > > > > level : L0
> > > > > long_name : MaxReflectivity
> > > > > init_time : 20050807_000000
> > > > > init_time_ut : 1123372800
> > > > > valid_time : 20050807_120000
> > > > > valid_time_ut : 1123416000
> > > > >
> > > > >
> > > > >
> > > > > Best Regards,
> > > > > Jose
> > > > >
> > > > >
> > > > > ________________________________________
> > > > > From: Julie Prestopnik via RT <met_help at ucar.edu>
> > > > > Sent: Friday, September 9, 2016 1:09 PM
> > > > > To: Jose Garcia-Rivera
> > > > > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar
> > > > > NETCDF
> > > file
> > > > > for grid_stat verifiction
> > > > >
> > > > > Hi Jose. Thank you for uploading your data. There were two
> > > > > important things missing from your file.
> > > > >
> > > > > I added:
> > > > >
> > > > > REFC:name = "REFC" ;
> > > > >
> > > > > under:
> > > > >
> > > > > float REFC(lat, lon) ;
> > > > >
> > > > > and I added:
> > > > >
> > > > > :MET_version = "V5.1" ;
> > > > >
> > > > > under // global attributes:
> > > > >
> > > > > and was able to get a successful run of grid_stat.
> > > > >
> > > > > I am attaching the file with the changes. Please give it a
try
> > > > > and let
> > > > me
> > > > > know if you get a successful run as well.
> > > > >
> > > > > Thanks,
> > > > > Julie
> > > > >
> > > > > On Fri, Sep 9, 2016 at 10:38 AM, Jose Garcia-Rivera via RT <
> > > > > met_help at ucar.edu> wrote:
> > > > >
> > > > > >
> > > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823
> > > > > > >
> > > > > >
> > > > > > Dear Julie,
> > > > > >
> > > > > > We used the Mercator example, and ours looks identical to
yours.
> > > > > > I proceeded and put 4 files into your FTP server:
> > > > > >
> > > > > > Model forecast file
> > > > > > Radar Obs file
> > > > > > Grid Stat Config file
> > > > > > domain.poly file
> > > > > >
> > > > > > The files are under 'garcia_data'
> > > > > >
> > > > > >
> > > > > > Thanks so much for your help,
> > > > > > Jose
> > > > > > ________________________________________
> > > > > > From: Julie Prestopnik via RT <met_help at ucar.edu>
> > > > > > Sent: Friday, September 9, 2016 11:50 AM
> > > > > > To: Jose Garcia-Rivera
> > > > > > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running
radar
> > > > > > NETCDF
> > > > file
> > > > > > for grid_stat verifiction
> > > > > >
> > > > > > Hi Jose. I have attached a Mercator projection example.
If
> > > > > > you're still stuck, please post your data to our anonymous
FTP
> > > > > > site following these instructions:
> > > > > >
http://www.dtcenter.org/met/users/support/met_help.php#ftp
> > > > > >
> > > > > > Thanks,
> > > > > > Julie
> > > > > >
> > > > > >
> > > > > > On Thu, Sep 8, 2016 at 3:25 PM, Jose Garcia-Rivera via RT
> > > > > > <met_help at ucar.edu> wrote:
> > > > > > >
> > > > > > > <URL:
> > > > > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823
> > > > > > > >
> > > > > > >
> > > > > > > Dear Julie,
> > > > > > >
> > > > > > > That's very good information, thanks. We've been working
on
> > > > > > > this
> > > > issue,
> > > > > > however the same error keeps showing up.
> > > > > > >
> > > > > > > Can we get a Mercator projection example?
> > > > > > >
> > > > > > > I was wondering if you could have a peek into our netcdf
> > > > > > > file, or
> > > run
> > > > > an
> > > > > > internal test to see what needs to be changed, or what may
be
> > wrong.
> > > In
> > > > > the
> > > > > > meantime, we continue working on trying to make the file
fit
> > > > > > MET requirements.
> > > > > > >
> > > > > > > Thanks for the help,
> > > > > > > Jose
> > > > > > >
> > > > > > > ________________________________________
> > > > > > > From: Julie Prestopnik via RT <met_help at ucar.edu>
> > > > > > > Sent: Thursday, September 8, 2016 3:57 PM
> > > > > > > To: Jose Garcia-Rivera
> > > > > > > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running
radar
> > > > > > > NETCDF
> > > > > file
> > > > > > for grid_stat verifiction
> > > > > > >
> > > > > > > Hi Jose.
> > > > > > >
> > > > > > > Unfortunately, we do not have a radar obs netcdf example
file.
> > > With
> > > > > > > NetCDF, users have two choices:
> > > > > > > --make it look like the NetCDF files that MET generates
(i.e.
> > > > > > > the output of pcp_combine) or --put it into CF-compliant
> > > > > > > NetCDF The variable can be named "radar_obs" or "precip"
or
> > > > > > > anything you'd
> > > > > like.
> > > > > > >
> > > > > > > Julie
> > > > > > >
> > > > > > >
> > > > > > > On Thu, Sep 8, 2016 at 12:10 PM, Jose Garcia-Rivera via
RT
> > > > > > > <met_help at ucar.edu> wrote:
> > > > > > >>
> > > > > > >> <URL:
> > > > > > >> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823
> > > > > > >> >
> > > > > > >>
> > > > > > >> Dear Julie,
> > > > > > >>
> > > > > > >> Thanks so much for the file. We haven't been able to
work
> > > > > > >> on it
> > > yet,
> > > > > > since we are fixing computer issues. One more question, do
you
> > > > > > have a
> > > > > radar
> > > > > > obs netcdf example file?
> > > > > > >>
> > > > > > >> Best Regards,
> > > > > > >> Jose
> > > > > > >>
> > > > > > >> From: Julie Prestopnik via RT <met_help at ucar.edu>
> > > > > > >> Sent: Thursday, September 8, 2016 12:58 PM
> > > > > > >> To: Jose Garcia-Rivera
> > > > > > >> Subject: Re: [rt.rap.ucar.edu #77823] Trouble running
radar
> > > NETCDF
> > > > > > file for grid_stat verifiction
> > > > > > >>
> > > > > > >> My apologies. I meant to attach the file in my last
email.
> > You
> > > > can
> > > > > > >> find it attached to this one.
> > > > > > >>
> > > > > > >> Thanks,
> > > > > > >> Julie
> > > > > > >>
> > > > > > >> On Thu, Sep 8, 2016 at 10:36 AM, Jose Garcia-Rivera via
RT
> > > > > > >> <met_help at ucar.edu> wrote:
> > > > > > >>>
> > > > > > >>> <URL:
> > > > > > >>>
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
> > > > > > >>>
> > > > > > >>> Dear Julie,
> > > > > > >>>
> > > > > > >>> Thanks for the helpful response. Can I have an example
> > > > > > >>> file from
> > > > the
> > > > > > pcp_combine tool for reference?
> > > > > > >>>
> > > > > > >>> Best Regards,
> > > > > > >>> Jose
> > > > > > >>> ________________________________________
> > > > > > >>> From: Julie Prestopnik via RT <met_help at ucar.edu>
> > > > > > >>> Sent: Thursday, September 8, 2016 11:57 AM
> > > > > > >>> To: Jose Garcia-Rivera
> > > > > > >>> Subject: Re: [rt.rap.ucar.edu #77823] Trouble running
> > > > > > >>> radar
> > > NETCDF
> > > > > > file for grid_stat verifiction
> > > > > > >>>
> > > > > > >>> Hi Jose.
> > > > > > >>>
> > > > > > >>> I see that you are running MET 5.1, but are unsure of
how
> > > > > > >>> the
> > > > NetCDF
> > > > > > >>> files should be formatted in order for GridStat to be
able
> > > > > > >>> to
> > > read
> > > > > > >>> them.
> > > > > > >>>
> > > > > > >>> In order it use gridded NetCDF files in MET, you'll
need
> > > > > > >>> to make
> > > > them
> > > > > > >>> look like the output of the pcp_combine tool.
> > > > > > >>>
> > > > > > >>> Listed below is the header from one of the NetCDF
files
> > > > > > >>> from pcp_combine created by the METv5.1 test scripts.
> > > > > > >>> Here are the required parts.
> > > > > > >>>
> > > > > > >>> (1) dimensions should be named "lat" and "lon"
> > > > > > >>> (2) the "lat" and "lon" variable are **NOT**
required
> > > > > > >>> (3) gridded variables (e.g. APCP_12) must use the
"lat"
> > > > > > >>> and
> > > "lon"
> > > > > > dimensions
> > > > > > >>> (4) gridded variables should include the attributes
> > > > > > >>> listed in
> > > the
> > > > > > >>> example (for timing info, only the init_time_ut,
> > > > > > >>> valid_time_ut,
> > > and
> > > > > > >>> accum_time_sec are actually used. "ut" stands for
unix
> > > > > > >>> time, the number of seconds since Jan 1, 1970).
> > > > > > >>> (5) global attributes should include the
grid/projection
> > > > > > >>> information. This example shows how they're specified
for
> > > > > > >>> a
> > > > lambert
> > > > > > >>> conformal projection. Let me know if you're using a
> > > > > > >>> different projection and I'll send you an example.
> > > > > > >>>
> > > > > > >>> I hope that helps get you going.
> > > > > > >>>
> > > > > > >>> Julie
> > > > > > >>>
> > > > > > >>>
> > > > > > >>>
> > > > > > >>> On Wed, Sep 7, 2016 at 3:15 PM, Jose Garcia-Rivera via
RT
> > > > > > >>> <met_help at ucar.edu> wrote:
> > > > > > >>>>
> > > > > > >>>> Wed Sep 07 15:15:39 2016: Request 77823 was acted
upon.
> > > > > > >>>> Transaction: Ticket created by GarciaJ at imsg.com
> > > > > > >>>> Queue: met_help
> > > > > > >>>> Subject: Trouble running radar NETCDF file for
> > > > > > >>>> grid_stat
> > > > > > verifiction
> > > > > > >>>> Owner: Nobody
> > > > > > >>>> Requestors: GarciaJ at imsg.com
> > > > > > >>>> Status: new
> > > > > > >>>> Ticket <URL: https://rt.rap.ucar.edu/rt/
> > > > > Ticket/Display.html?id=77823
> > > > > > >
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>> Dear Met Help,
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>> I've been trying to run MET using a radar NETCDF
file,
> > > > > > >>>> and an
> > > NMMB
> > > > > > model forecast GRIB file, but the following error shows
up:
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>> DEBUG 1: Default Config File:
/work/apps/pgi_14.10/SANDY/
> > > > > > met-5.1/share/met/config/GridStatConfig_default
> > > > > > >>>> DEBUG 1: User Config File: GridStatConfig_dbz ERROR
:
> > > > > > >>>> ERROR : Trouble reading observation file
> > > "Hongqiao.Refl.20150602.
> > > > > > s100000.e100500.attributes.nc"
> > > > > > >>>> ERROR :
> > > > > > >>>>
> > > > > > >>>> We used two versions of the OBS file, one as it was,
and
> > > > > > >>>> the
> > > > second
> > > > > > with added "attributes". Still, the same error occurred.
We
> > > > > > are not
> > > > sure
> > > > > on
> > > > > > exactly how our NETCDF files need to be for MET to be able
to
> > > > > > read
> > > > them.
> > > > > I
> > > > > > searched the error message on the Guide and nothing showed
up.
> > > > > > >>>>
> > > > > > >>>> We can share the files to your FTP if you want to run
them.
> > > > > > >>>>
> > > > > > >>>> Any help will be greatly appreciated.
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>> NOTE: We are using MET 5.1
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>> Best Regards,
> > > > > > >>>>
> > > > > > >>>> Jose
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>> Jose M. Garcia-Rivera, PhD
> > > > > > >>>>
> > > > > > >>>> Atmospheric Scientist
> > > > > > >>>>
> > > > > > >>>> IM Systems Group
> > > > > > >>>>
> > > > > > >>>> Rockville/College Park, MD
> > > > > > >>>>
> > > > > > >>>> This e-mail, including attachments, may include
> > > > > > >>>> confidential
> > > > and/or
> > > > > > proprietary information, and may be used only by the
person or
> > > > > > entity
> > > > to
> > > > > > which it is addressed. If the reader of this e-mail is not
the
> > > intended
> > > > > > recipient or his or her authorized agent, the reader is
hereby
> > > notified
> > > > > > that any dissemination, distribution or copying of this e-
mail
> > > > > > is prohibited. If you have received this e-mail in error,
> > > > > > please notify
> > > > the
> > > > > > sender by replying to this message and delete this e-mail
> > > immediately.
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>
> > > > > > >>>
> > > > > > >>>
> > > > > > >>> --
> > > > > > >>> Julie Prestopnik
> > > > > > >>> National Center for Atmospheric Research Research
> > > > > > >>> Applications Laboratory
> > > > > > >>> Phone: 303.497.8399
> > > > > > >>> Email: jpresto at ucar.edu
> > > > > > >>>
> > > > > > >>>
> > > > > > >>> This e-mail, including attachments, may include
> > > > > > >>> confidential
> > > and/or
> > > > > > proprietary information, and may be used only by the
person or
> > > > > > entity
> > > > to
> > > > > > which it is addressed. If the reader of this e-mail is not
the
> > > intended
> > > > > > recipient or his or her authorized agent, the reader is
hereby
> > > notified
> > > > > > that any dissemination, distribution or copying of this e-
mail
> > > > > > is prohibited. If you have received this e-mail in error,
> > > > > > please notify
> > > > the
> > > > > > sender by replying to this message and delete this e-mail
> > > immediately.
> > > > > > >>>
> > > > > > >>>
> > > > > > >>
> > > > > > >>
> > > > > > >>
> > > > > > >> --
> > > > > > >> Julie Prestopnik
> > > > > > >> National Center for Atmospheric Research Research
> > > > > > >> Applications Laboratory
> > > > > > >> Phone: 303.497.8399
> > > > > > >> Email: jpresto at ucar.edu
> > > > > > >>
> > > > > > >> This e-mail, including attachments, may include
> > > > > > >> confidential
> > > and/or
> > > > > > proprietary information, and may be used only by the
person or
> > > > > > entity
> > > > to
> > > > > > which it is addressed. If the reader of this e-mail is not
the
> > > intended
> > > > > > recipient or his or her authorized agent, the reader is
hereby
> > > notified
> > > > > > that any dissemination, distribution or copying of this e-
mail
> > > > > > is prohibited. If you have received this e-mail in error,
> > > > > > please notify
> > > > the
> > > > > > sender by replying to this message and delete this e-mail
> > > immediately.
> > > > > > >>
> > > > > > >>
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > --
> > > > > > > Julie Prestopnik
> > > > > > > National Center for Atmospheric Research Research
> > > > > > > Applications Laboratory
> > > > > > > Phone: 303.497.8399
> > > > > > > Email: jpresto at ucar.edu
> > > > > > >
> > > > > > >
> > > > > > > This e-mail, including attachments, may include
confidential
> > > > > > > and/or
> > > > > > proprietary information, and may be used only by the
person or
> > > > > > entity
> > > > to
> > > > > > which it is addressed. If the reader of this e-mail is not
the
> > > intended
> > > > > > recipient or his or her authorized agent, the reader is
hereby
> > > notified
> > > > > > that any dissemination, distribution or copying of this e-
mail
> > > > > > is prohibited. If you have received this e-mail in error,
> > > > > > please notify
> > > > the
> > > > > > sender by replying to this message and delete this e-mail
> > > immediately.
> > > > > > >
> > > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > > --
> > > > > > Julie Prestopnik
> > > > > > National Center for Atmospheric Research Research
Applications
> > > > > > Laboratory
> > > > > > Phone: 303.497.8399
> > > > > > Email: jpresto at ucar.edu
> > > > > >
> > > > > > This e-mail, including attachments, may include
confidential
> > > > > > and/or proprietary information, and may be used only by
the
> > > > > > person or entity
> > > > to
> > > > > > which it is addressed. If the reader of this e-mail is not
the
> > > intended
> > > > > > recipient or his or her authorized agent, the reader is
hereby
> > > notified
> > > > > > that any dissemination, distribution or copying of this e-
mail
> > > > > > is prohibited. If you have received this e-mail in error,
> > > > > > please notify
> > > > the
> > > > > > sender by replying to this message and delete this e-mail
> > > immediately.
> > > > > >
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > > > --
> > > > > Julie Prestopnik
> > > > > National Center for Atmospheric Research Research
Applications
> > > > > Laboratory
> > > > > Phone: 303.497.8399
> > > > > Email: jpresto at ucar.edu
> > > > >
> > > > > This e-mail, including attachments, may include confidential
> > > > > and/or proprietary information, and may be used only by the
> > > > > person or entity
> > > to
> > > > > which it is addressed. If the reader of this e-mail is not
the
> > > > > intended recipient or his or her authorized agent, the
reader is
> > > > > hereby notified that any dissemination, distribution or
copying
> > > > > of this e-mail is prohibited. If you have received this e-
mail
> > > > > in error, please notify
> > > the
> > > > > sender by replying to this message and delete this e-mail
> > immediately.
> > > > >
> > > > >
> > > > >
> > > >
> > > > This e-mail, including attachments, may include confidential
> > > > and/or proprietary information, and may be used only by the
person
> > > > or entity to which it is addressed. If the reader of this e-
mail
> > > > is not the intended recipient or his or her authorized agent,
the
> > > > reader is hereby notified that any dissemination, distribution
or
> > > > copying of this e-mail is prohibited. If you have received
this
> > > > e-mail in error, please notify the sender by replying to this
> > > > message and delete
> > this e-mail immediately.
> > > >
> > > >
> > > >
> > >
> > >
> > > --
> > > Julie Prestopnik
> > > National Center for Atmospheric Research Research Applications
> > > Laboratory
> > > Phone: 303.497.8399
> > > Email: jpresto at ucar.edu
> > >
> > > This e-mail, including attachments, may include confidential
and/or
> > > proprietary information, and may be used only by the person or
> > > entity to which it is addressed. If the reader of this e-mail is
not
> > > the intended recipient or his or her authorized agent, the
reader is
> > > hereby notified that any dissemination, distribution or copying
of
> > > this e-mail is prohibited. If you have received this e-mail in
> > > error, please notify the sender by replying to this message and
> > > delete this
> > e-mail immediately.
> > >
> > >
> >
> >
> > --
> > Julie Prestopnik
> > National Center for Atmospheric Research Research Applications
> > Laboratory
> > Phone: 303.497.8399
> > Email: jpresto at ucar.edu
> >
> > This e-mail, including attachments, may include confidential
and/or
> > proprietary information, and may be used only by the person or
entity
> > to which it is addressed. If the reader of this e-mail is not the
> > intended recipient or his or her authorized agent, the reader is
> > hereby notified that any dissemination, distribution or copying of
> > this e-mail is prohibited. If you have received this e-mail in
error,
> > please notify the sender by replying to this message and delete
this
> e-mail immediately.
> >
> >
> >
>
>
> --
> Julie Prestopnik
> National Center for Atmospheric Research Research Applications
Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
> This e-mail, including attachments, may include confidential and/or
> proprietary information, and may be used only by the person or
entity to
> which it is addressed. If the reader of this e-mail is not the
intended
> recipient or his or her authorized agent, the reader is hereby
notified
> that any dissemination, distribution or copying of this e-mail is
> prohibited. If you have received this e-mail in error, please notify
the
> sender by replying to this message and delete this e-mail
immediately.
>
>
This e-mail, including attachments, may include confidential and/or
proprietary information, and may be used only by the person or entity
to which it is addressed. If the reader of this e-mail is not the
intended recipient or his or her authorized agent, the reader is
hereby notified that any dissemination, distribution or copying of
this e-mail is prohibited. If you have received this e-mail in error,
please notify the sender by replying to this message and delete this
e-mail immediately.
------------------------------------------------
Subject: Trouble running radar NETCDF file for grid_stat verifiction
From: Julie Prestopnik
Time: Wed Sep 14 12:54:10 2016
Great, Jose! I'm glad to hear that you solved the issue. I'll go
ahead
and close this ticket, but please don't hesitate to write with any
other
questions.
Thanks,
Julie
On Wed, Sep 14, 2016 at 12:48 PM, Jose Garcia-Rivera via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
>
> Dear John, Julie
>
> We solved the issue thanks to your great insights! As you mentioned,
we
> had to flip our array to correctly put the initial indexes in the
> lower-left corner of the file. Thanks again for all the support.
We'll keep
> you posted if any further issues arise.
>
> Best Regards,
> Jose
>
> -----Original Message-----
> From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> Sent: Tuesday, September 13, 2016 4:27 PM
> To: Jose Garcia-Rivera <GarciaJ at imsg.com>
> Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar NETCDF
file
> for grid_stat verifiction
>
> Hello Jose,
>
> This is John Halley Gotway. Thought I'd jump in on this one.
>
> I see that you're getting different results when plotting your radar
NetCDF
> file via MET (plot_data_plane) and NCL. The MET data is upside-down
> relative to the NCL plot.
>
> I suspect the difference is this... When NCL reads that data, it
also reads
> the lat and lon variables to place your data on the earth. When MET
reads
> the data, it does not. Instead, it just reads the data values in
the order
> they're written in the NetCDF file and uses the mapping information
defined
> in the global attributes to place the data on earth.
>
> Looking at the your NetCDF I see that the first point is the upper-
left
> corner. And MET is expecting the first point to be the lower-left
> corner. MET is expecting the data to be packed as lower-left to
> upper-right.
>
> I believe that's the source of the discrepancy. And really there's
no way
> in the grid projection information to tell MET to flip the data.
It's just
> a short-coming of the simplistic way of reading/writing this NetCDF
data.
>
> Hope that helps clarify.
>
> Thanks,
> John
>
> On Tue, Sep 13, 2016 at 12:45 PM, Jose Garcia-Rivera via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
> >
> > Dear Julie,
> >
> > Yes, I got the same result as you running plot_data_plane. When I
plot
> the
> > file directly using NCL, I got the correct image. When using
grid_stat
> and
> > plot_data_plane the image went flipped. So there may be an issue
with the
> > required configuration of the file for MET to correctly read it.
What do
> > you think?
> >
> > Attached is the output confirming your results.
> >
> > Thanks,
> > Jose,
> >
> > Just
> >
> > On Tue, Sep 13, 2016 at 12:45 PM, Jose Garcia-Rivera via RT <
> > met_help at ucar.edu> wrote:
> >
> >>
> >> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
> >>
> >> Dear Julie,
> >>
> >> Yes, I got the same result as you running plot_data_plane. When I
plot
> >> the file directly using NCL, I got the correct image. When using
> grid_stat
> >> and plot_data_plane the image went flipped. So there may be an
issue
> with
> >> the required configuration of the file for MET to correctly read
it.
> What
> >> do you think?
> >>
> >> Attached is the output confirming your results.
> >>
> >> Thanks,
> >> Jose
> >>
> >> -----Original Message-----
> >> From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> >> Sent: Tuesday, September 13, 2016 1:59 PM
> >> To: Jose Garcia-Rivera
> >> Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar
NETCDF file
> >> for grid_stat verifiction
> >>
> >> Hi Jose.
> >>
> >> When I ran plot_data_plane on the input observation file,
> >> RadarObsNEW_mod_v3.nc, I produced the image I sent you, which
looked
> >> similar to the met_OBS.png file that you sent me in that it was
flipped
> >> upside-down. So, I produced a similar image pre-grid_stat, using
the
> raw
> >> observation file.
> >>
> >> How did you produce your radar_OBS.png plot? Could you please
try
> >> running plot_data_plane on the radar observation file and see if
you get
> >> the same output we do? I suspect the problem lies in the way the
radar
> >> NetCDF file is being written.
> >>
> >> Thanks,
> >> Julie
> >>
> >>
> >>
> >> On Tue, Sep 13, 2016 at 11:53 AM, Jose Garcia-Rivera via RT <
> >> met_help at ucar.edu> wrote:
> >>
> >> >
> >> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
> >> >
> >> > Hi Julie,
> >> >
> >> > Thanks for checking out. The met_OBS.png is the output I got
from
> >> > grid_stat. The correct file is radar_OBS.png plot. So, that may
mean
> >> > that you are getting the same issue I got. Have you seen this
> happening
> >> before?
> >> >
> >> > Best Regards,
> >> > Jose
> >> >
> >> >
> >> >
> >> > -----Original Message-----
> >> > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> >> > Sent: Tuesday, September 13, 2016 1:21 PM
> >> > To: Jose Garcia-Rivera
> >> > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar
NETCDF
> >> > file for grid_stat verifiction
> >> >
> >> > Hi Jose.
> >> >
> >> > When I plot the NetCDF3 obs file that we created using nccopy
> >> > (RadarObsNEW_mod_v3.nc) using plot_data_plane:
> >> >
> >> > /usr/local/met-5.2/bin/plot_data_plane RadarObsNEW_mod_v3.nc
> >> > RadarObsNEW_mod_v3.ps 'name="REFC"; level="(*,*)";'
> >> >
> >> > The resulting image, RadarObsNEW_mod_v3.ps (attached), appears
to be
> >> > oriented in the same way as the met_OBS.png image that you
attached,
> >> > so I don't believe that grid_stat is doing anything to the
data, but
> >> > rather that the data was placed into the original NetCDF Obs
data and
> >> > needs to be re-oriented there.
> >> >
> >> > Please let me know if you find that is not the case. Please
try
> >> > running plot_data_plane on the data that produced the
radar_OBS.png
> >> > file and see if you get the same result.
> >> >
> >> > Thanks,
> >> > Julie
> >> >
> >> > On Tue, Sep 13, 2016 at 9:20 AM, Jose Garcia-Rivera via RT <
> >> > met_help at ucar.edu> wrote:
> >> >
> >> > >
> >> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823
>
> >> > >
> >> > > Dear Julie, John
> >> > >
> >> > > The commands worked fine. Thank you so much!
> >> > >
> >> > > Now, there's something that is puzzling us. The radar data
from the
> >> > > grid_stat.nc output file seems to be flipped upside-down. I
> attached
> >> > > the MET-produced OBS vs the original OBS. Is this an artifact
of
> >> > > grid_stat, or how can it be fixed?
> >> > >
> >> > >
> >> > >
> >> > > Best Regards,
> >> > > Jose
> >> > >
> >> > > ________________________________________
> >> > > From: Julie Prestopnik via RT <met_help at ucar.edu>
> >> > > Sent: Friday, September 9, 2016 4:07 PM
> >> > > To: Jose Garcia-Rivera
> >> > > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar
NETCDF
> >> > > file for grid_stat verifiction
> >> > >
> >> > > Hi Jose.
> >> > >
> >> > > As John indicated the problem lies in that currently MET only
> >> > > supports the classic data model... i.e. NetCDF3, which the
file
> >> > > RadarObsNEW.nc is
> >> > not.
> >> > >
> >> > > Running "file RadarObsNEW.nc" shows that the file is not
"NetCDF
> >> > > Data Format data", but rather:
> >> > >
> >> > > RadarObsNEW.nc: Hierarchical Data Format (version 5) data
> >> > >
> >> > > You can create a NetCDF3 file when you create the file or you
can
> >> > > use the "nccopy" command. However, "nccopy" didn't work with
the
> >> > > RadarObsNEW.nc file, until we made some changes. We used
"ncatted"
> >> > > to remove the "L" from the value of the following attributes:
> >> > > parameter_table_version, parameter_number, level_indicator,
nx, and
> >> > > ny. I'll paste in the commands that we used to create a
NetCDF3
> >> > > file, plot the data, and get a successful run from grid_stat.
> >> > >
> >> > > # Update attributes to remove longs
> >> > > /usr/local/nco/bin/ncatted \
> >> > > -a parameter_table_version,REFC,o,f,129 \ -a
> >> > > parameter_number,REFC,o,f,212 \ -a
level_indicator,REFC,o,f,200 \ -a
> >> > > nx,global,o,i,674 \ -a ny,global,o,i,620 \ RadarObsNEW.nc
> >> > > RadarObsNEW_mod.nc
> >> > >
> >> > > # Convert from NC4 to NC3
> >> > > /usr/local/netcdf/bin/nccopy -3 RadarObsNEW_mod.nc
> >> > > RadarObsNEW_mod_v3.nc
> >> > >
> >> > > # Regrid to global grid
> >> > > /usr/local/met-5.2/bin/regrid_data_plane \
RadarObsNEW_mod_v3.nc
> >> > > G004 RadarObsNEW_mod_v3_G004.nc \ -field 'name="REFC";
> level="(*,*)";'
> >> > >
> >> > > # Plot the result
> >> > > /usr/local/met-5.2/bin/plot_data_plane \
RadarObsNEW_mod_v3_G004.nc
> >> > > RadarObsNEW_mod_v3_G004.ps \ 'name="REFC"; level="(*,*)";'
> >> > >
> >> > > # Display plot
> >> > > convert -rotate 90 -background white -flatten
> >> > > RadarObsNEW_mod_v3_G004.ps RadarObsNEW_mod_v3_G004.png
display
> >> > > RadarObsNEW_mod_v3_G004.png&
> >> > >
> >> > > # Plot forecast REFC
> >> > > /usr/local/met-5.2/bin/plot_data_plane \ ForecastFile.grb
> >> > > refc_fcst.ps \ 'name="REFC"; level="L0"; GRIB1_ptv=129;'
> >> > >
> >> > > # Display plot
> >> > > convert -rotate 90 -background white -flatten refc_fcst.ps
> >> > > refc_fcst.png display refc_fcst.png&
> >> > >
> >> > > # Run grid_stat
> >> > > /usr/local/met-5.1/bin/grid_stat ForecastFile.grb
> >> > > RadarObsNEW_mod_v3.nc GridStatConfig_dbz -outdir out/
> >> > >
> >> > > I have also attached the NetCDF3 file that we produced after
using
> >> > > ncatted and nccopy.
> >> > >
> >> > > Please let us know if you have any other questions.
> >> > >
> >> > > Thanks,
> >> > > Julie
> >> > >
> >> > >
> >> > > On Fri, Sep 9, 2016 at 12:43 PM, Jose Garcia-Rivera via RT <
> >> > > met_help at ucar.edu> wrote:
> >> > >
> >> > > >
> >> > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
> >> > > >
> >> > > > Hi John,
> >> > > >
> >> > > > Glad to talk to you again. We did the proposed changes,
and the
> >> > > > error keeps showing up.
> >> > > >
> >> > > > I uploaded the new file as: RadarObsNEW.nc
> >> > > >
> >> > > > Please try to run it and let me know what issues show up?
> >> > > >
> >> > > > Thanks for the help,
> >> > > > Jose
> >> > > > ________________________________________
> >> > > > From: John Halley Gotway via RT <met_help at ucar.edu>
> >> > > > Sent: Friday, September 9, 2016 2:17 PM
> >> > > > To: Jose Garcia-Rivera
> >> > > > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar
> NETCDF
> >> > > > file for grid_stat verifiction
> >> > > >
> >> > > > Hello Jose,
> >> > > >
> >> > > > This is John Halley Gotway. I work with Julie on providing
> >> > > > support for MET.
> >> > > >
> >> > > > I think there's a few pieces of info we're missing here.
> >> > > >
> >> > > > (1) MET does not currently support the enhanced data model
of
> >> NetCDF4.
> >> > > It
> >> > > > only supports the classic data model... i.e. NetCDF3. In
the next
> >> > > version
> >> > > > of MET (6.0), due out next year, we'll be adding support
for
> >> NetCDF4.
> >> > > The
> >> > > > file you sent us in NetCDF4 but when Julie add those
attributes
> >> > > > she may have used ncdump/ncgen. And their output is
NetCDF3. Try
> >> > > > updating your NCL script to write a "classic" NetCDF file.
> >> > > >
> >> > > > (2) Yes, the "MET_version" global attribute needs to be
present.
> >> > > > That tells MET how to parse the grid information.
> >> > > >
> >> > > > (3) I'm not sure that the variable "name" attribute is
necessary,
> >> > > > but it doesn't hurt.
> >> > > >
> >> > > > (4) The biggest problem is in the definition of your
Mercator
> grid:
> >> > > > :Projection = "Mercator" ;
> >> > > > :lat_ll = "3348550.177 degrees_north" ;
> >> > > > :lon_ll = "13120540.425 degrees_east" ;
> >> > > > :lat_ur = "4057346.9 degrees_north" ;
> >> > > > :lon_ur = "13891071.057 degrees_east" ;
> >> > > >
> >> > > > Those don't look like very meaningful lat/lon values!
Where did
> >> > > > you get these numbers? Are they meant to match the grid
defined
> >> > > > in the GRIB file you sent us?
> >> > > >
> >> > > > Thanks,
> >> > > > John
> >> > > >
> >> > > > On Fri, Sep 9, 2016 at 12:08 PM, Jose Garcia-Rivera via RT
<
> >> > > > met_help at ucar.edu> wrote:
> >> > > >
> >> > > > >
> >> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
> >> > > > >
> >> > > > > Dear Julie,
> >> > > > >
> >> > > > > The file that you modified worked. However, we did the
changes
> >> > > > > you
> >> > > made,
> >> > > > > and grid_stat continues to show the same error.
> >> > > > >
> >> > > > > I've uploaded the file in the same FTP directory, named:
> >> > > > > Hongqiao.Refl.20150602.s100000.e100500.attributes.nc
> >> > > > >
> >> > > > > This is a file dump of our modified netcdf:
> >> > > > >
> >> > > > > NCAR Command Language Version 6.3.0 The use of this
software is
> >> > > > > governed by a License Agreement.
> >> > > > > See http://www.ncl.ucar.edu/ for more details.
> >> > > > >
> >> > > > > Variable: f
> >> > > > > Type: file
> >> > > > > filename: Hongqiao.Refl.20150602.
> s100000.e100500.attributes
> >> > > > > path:
Hongqiao.Refl.20150602.s100000.e100500.attributes.nc
> >> > > > > Number of Attributes:8
> >> > > > > MET_version : V5.1
> >> > > > > Projection : Mercator
> >> > > > > lat_ll : 3348550.177 degrees_north
> >> > > > > lon_ll : 13120540.425 degrees_east
> >> > > > > lat_ur : 4057346.9 degrees_north
> >> > > > > lon_ur : 13891071.057 degrees_east
> >> > > > > nx : 674
> >> > > > > ny : 620
> >> > > > >
> >> > > > > dimensions:
> >> > > > > lon = 674
> >> > > > > lat = 620
> >> > > > >
> >> > > > > variables:
> >> > > > > Variable: lat
> >> > > > > Type: float
> >> > > > > Total Size: 417880 values
> >> > > > > 1671520 bytes
> >> > > > > Number of Dimensions: 2
> >> > > > > Dimensions and sizes: [ 620 <lat> x 674 <lon> ]
> >> > > > > Coordinates:
> >> > > > > lat: [4057347..4057347]
> >> > > > > lon: [1.312054e+07..1.388993e+07]
> >> > > > > Number of Attributes: 2
> >> > > > > units : degrees_north
> >> > > > > standard_name : latitude
> >> > > > >
> >> > > > > Variable: lon
> >> > > > > Type: float
> >> > > > > Total Size: 417880 values
> >> > > > > 1671520 bytes
> >> > > > > Number of Dimensions: 2
> >> > > > > Dimensions and sizes: [ 620 <lat> x 674 <lon> ]
> >> > > > > Coordinates:
> >> > > > > lat: [4057347..4057347]
> >> > > > > lon: [1.312054e+07..1.388993e+07]
> >> > > > > Number of Attributes: 2
> >> > > > > units : degrees_east
> >> > > > > standard_name : longitude
> >> > > > >
> >> > > > > Variable: REFC
> >> > > > > Type: float
> >> > > > > Total Size: 417880 values
> >> > > > > 1671520 bytes
> >> > > > > Number of Dimensions: 2
> >> > > > > Dimensions and sizes: [ 620 <lat> x 674 <lon> ]
> >> > > > > Coordinates:
> >> > > > > lat: [4057347..4057347]
> >> > > > > lon: [1.312054e+07..1.388993e+07]
> >> > > > > Number of Attributes: 11
> >> > > > > name : REFC
> >> > > > > units : dbZ
> >> > > > > parameter_table_version : 129
> >> > > > > parameter_number : 212
> >> > > > > level_indicator : 200
> >> > > > > level : L0
> >> > > > > long_name : MaxReflectivity
> >> > > > > init_time : 20050807_000000
> >> > > > > init_time_ut : 1123372800
> >> > > > > valid_time : 20050807_120000
> >> > > > > valid_time_ut : 1123416000
> >> > > > >
> >> > > > >
> >> > > > >
> >> > > > > Best Regards,
> >> > > > > Jose
> >> > > > >
> >> > > > >
> >> > > > > ________________________________________
> >> > > > > From: Julie Prestopnik via RT <met_help at ucar.edu>
> >> > > > > Sent: Friday, September 9, 2016 1:09 PM
> >> > > > > To: Jose Garcia-Rivera
> >> > > > > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running
radar
> >> > > > > NETCDF
> >> > > file
> >> > > > > for grid_stat verifiction
> >> > > > >
> >> > > > > Hi Jose. Thank you for uploading your data. There were
two
> >> > > > > important things missing from your file.
> >> > > > >
> >> > > > > I added:
> >> > > > >
> >> > > > > REFC:name = "REFC" ;
> >> > > > >
> >> > > > > under:
> >> > > > >
> >> > > > > float REFC(lat, lon) ;
> >> > > > >
> >> > > > > and I added:
> >> > > > >
> >> > > > > :MET_version = "V5.1" ;
> >> > > > >
> >> > > > > under // global attributes:
> >> > > > >
> >> > > > > and was able to get a successful run of grid_stat.
> >> > > > >
> >> > > > > I am attaching the file with the changes. Please give it
a try
> >> > > > > and let
> >> > > > me
> >> > > > > know if you get a successful run as well.
> >> > > > >
> >> > > > > Thanks,
> >> > > > > Julie
> >> > > > >
> >> > > > > On Fri, Sep 9, 2016 at 10:38 AM, Jose Garcia-Rivera via
RT <
> >> > > > > met_help at ucar.edu> wrote:
> >> > > > >
> >> > > > > >
> >> > > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823
> >> > > > > > >
> >> > > > > >
> >> > > > > > Dear Julie,
> >> > > > > >
> >> > > > > > We used the Mercator example, and ours looks identical
to
> yours.
> >> > > > > > I proceeded and put 4 files into your FTP server:
> >> > > > > >
> >> > > > > > Model forecast file
> >> > > > > > Radar Obs file
> >> > > > > > Grid Stat Config file
> >> > > > > > domain.poly file
> >> > > > > >
> >> > > > > > The files are under 'garcia_data'
> >> > > > > >
> >> > > > > >
> >> > > > > > Thanks so much for your help,
> >> > > > > > Jose
> >> > > > > > ________________________________________
> >> > > > > > From: Julie Prestopnik via RT <met_help at ucar.edu>
> >> > > > > > Sent: Friday, September 9, 2016 11:50 AM
> >> > > > > > To: Jose Garcia-Rivera
> >> > > > > > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running
radar
> >> > > > > > NETCDF
> >> > > > file
> >> > > > > > for grid_stat verifiction
> >> > > > > >
> >> > > > > > Hi Jose. I have attached a Mercator projection
example. If
> >> > > > > > you're still stuck, please post your data to our
anonymous FTP
> >> > > > > > site following these instructions:
> >> > > > > >
http://www.dtcenter.org/met/users/support/met_help.php#ftp
> >> > > > > >
> >> > > > > > Thanks,
> >> > > > > > Julie
> >> > > > > >
> >> > > > > >
> >> > > > > > On Thu, Sep 8, 2016 at 3:25 PM, Jose Garcia-Rivera via
RT
> >> > > > > > <met_help at ucar.edu> wrote:
> >> > > > > > >
> >> > > > > > > <URL:
> >> > > > > > >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823
> >> > > > > > > >
> >> > > > > > >
> >> > > > > > > Dear Julie,
> >> > > > > > >
> >> > > > > > > That's very good information, thanks. We've been
working on
> >> > > > > > > this
> >> > > > issue,
> >> > > > > > however the same error keeps showing up.
> >> > > > > > >
> >> > > > > > > Can we get a Mercator projection example?
> >> > > > > > >
> >> > > > > > > I was wondering if you could have a peek into our
netcdf
> >> > > > > > > file, or
> >> > > run
> >> > > > > an
> >> > > > > > internal test to see what needs to be changed, or what
may be
> >> > wrong.
> >> > > In
> >> > > > > the
> >> > > > > > meantime, we continue working on trying to make the
file fit
> >> > > > > > MET requirements.
> >> > > > > > >
> >> > > > > > > Thanks for the help,
> >> > > > > > > Jose
> >> > > > > > >
> >> > > > > > > ________________________________________
> >> > > > > > > From: Julie Prestopnik via RT <met_help at ucar.edu>
> >> > > > > > > Sent: Thursday, September 8, 2016 3:57 PM
> >> > > > > > > To: Jose Garcia-Rivera
> >> > > > > > > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running
radar
> >> > > > > > > NETCDF
> >> > > > > file
> >> > > > > > for grid_stat verifiction
> >> > > > > > >
> >> > > > > > > Hi Jose.
> >> > > > > > >
> >> > > > > > > Unfortunately, we do not have a radar obs netcdf
example
> file.
> >> > > With
> >> > > > > > > NetCDF, users have two choices:
> >> > > > > > > --make it look like the NetCDF files that MET
generates
> (i.e.
> >> > > > > > > the output of pcp_combine) or --put it into CF-
compliant
> >> > > > > > > NetCDF The variable can be named "radar_obs" or
"precip" or
> >> > > > > > > anything you'd
> >> > > > > like.
> >> > > > > > >
> >> > > > > > > Julie
> >> > > > > > >
> >> > > > > > >
> >> > > > > > > On Thu, Sep 8, 2016 at 12:10 PM, Jose Garcia-Rivera
via RT
> >> > > > > > > <met_help at ucar.edu> wrote:
> >> > > > > > >>
> >> > > > > > >> <URL:
> >> > > > > > >>
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823
> >> > > > > > >> >
> >> > > > > > >>
> >> > > > > > >> Dear Julie,
> >> > > > > > >>
> >> > > > > > >> Thanks so much for the file. We haven't been able to
work
> >> > > > > > >> on it
> >> > > yet,
> >> > > > > > since we are fixing computer issues. One more question,
do you
> >> > > > > > have a
> >> > > > > radar
> >> > > > > > obs netcdf example file?
> >> > > > > > >>
> >> > > > > > >> Best Regards,
> >> > > > > > >> Jose
> >> > > > > > >>
> >> > > > > > >> From: Julie Prestopnik via RT <met_help at ucar.edu>
> >> > > > > > >> Sent: Thursday, September 8, 2016 12:58 PM
> >> > > > > > >> To: Jose Garcia-Rivera
> >> > > > > > >> Subject: Re: [rt.rap.ucar.edu #77823] Trouble
running
> radar
> >> > > NETCDF
> >> > > > > > file for grid_stat verifiction
> >> > > > > > >>
> >> > > > > > >> My apologies. I meant to attach the file in my last
email.
> >> > You
> >> > > > can
> >> > > > > > >> find it attached to this one.
> >> > > > > > >>
> >> > > > > > >> Thanks,
> >> > > > > > >> Julie
> >> > > > > > >>
> >> > > > > > >> On Thu, Sep 8, 2016 at 10:36 AM, Jose Garcia-Rivera
via RT
> >> > > > > > >> <met_help at ucar.edu> wrote:
> >> > > > > > >>>
> >> > > > > > >>> <URL:
> >> > > > > > >>>
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
> >> > > > > > >>>
> >> > > > > > >>> Dear Julie,
> >> > > > > > >>>
> >> > > > > > >>> Thanks for the helpful response. Can I have an
example
> >> > > > > > >>> file from
> >> > > > the
> >> > > > > > pcp_combine tool for reference?
> >> > > > > > >>>
> >> > > > > > >>> Best Regards,
> >> > > > > > >>> Jose
> >> > > > > > >>> ________________________________________
> >> > > > > > >>> From: Julie Prestopnik via RT <met_help at ucar.edu>
> >> > > > > > >>> Sent: Thursday, September 8, 2016 11:57 AM
> >> > > > > > >>> To: Jose Garcia-Rivera
> >> > > > > > >>> Subject: Re: [rt.rap.ucar.edu #77823] Trouble
running
> >> > > > > > >>> radar
> >> > > NETCDF
> >> > > > > > file for grid_stat verifiction
> >> > > > > > >>>
> >> > > > > > >>> Hi Jose.
> >> > > > > > >>>
> >> > > > > > >>> I see that you are running MET 5.1, but are unsure
of how
> >> > > > > > >>> the
> >> > > > NetCDF
> >> > > > > > >>> files should be formatted in order for GridStat to
be able
> >> > > > > > >>> to
> >> > > read
> >> > > > > > >>> them.
> >> > > > > > >>>
> >> > > > > > >>> In order it use gridded NetCDF files in MET, you'll
need
> >> > > > > > >>> to make
> >> > > > them
> >> > > > > > >>> look like the output of the pcp_combine tool.
> >> > > > > > >>>
> >> > > > > > >>> Listed below is the header from one of the NetCDF
files
> >> > > > > > >>> from pcp_combine created by the METv5.1 test
scripts.
> >> > > > > > >>> Here are the required parts.
> >> > > > > > >>>
> >> > > > > > >>> (1) dimensions should be named "lat" and "lon"
> >> > > > > > >>> (2) the "lat" and "lon" variable are **NOT**
required
> >> > > > > > >>> (3) gridded variables (e.g. APCP_12) must use the
"lat"
> >> > > > > > >>> and
> >> > > "lon"
> >> > > > > > dimensions
> >> > > > > > >>> (4) gridded variables should include the
attributes
> >> > > > > > >>> listed in
> >> > > the
> >> > > > > > >>> example (for timing info, only the init_time_ut,
> >> > > > > > >>> valid_time_ut,
> >> > > and
> >> > > > > > >>> accum_time_sec are actually used. "ut" stands for
unix
> >> > > > > > >>> time, the number of seconds since Jan 1, 1970).
> >> > > > > > >>> (5) global attributes should include the
grid/projection
> >> > > > > > >>> information. This example shows how they're
specified for
> >> > > > > > >>> a
> >> > > > lambert
> >> > > > > > >>> conformal projection. Let me know if you're using
a
> >> > > > > > >>> different projection and I'll send you an example.
> >> > > > > > >>>
> >> > > > > > >>> I hope that helps get you going.
> >> > > > > > >>>
> >> > > > > > >>> Julie
> >> > > > > > >>>
> >> > > > > > >>>
> >> > > > > > >>>
> >> > > > > > >>> On Wed, Sep 7, 2016 at 3:15 PM, Jose Garcia-Rivera
via RT
> >> > > > > > >>> <met_help at ucar.edu> wrote:
> >> > > > > > >>>>
> >> > > > > > >>>> Wed Sep 07 15:15:39 2016: Request 77823 was acted
upon.
> >> > > > > > >>>> Transaction: Ticket created by GarciaJ at imsg.com
> >> > > > > > >>>> Queue: met_help
> >> > > > > > >>>> Subject: Trouble running radar NETCDF file
for
> >> > > > > > >>>> grid_stat
> >> > > > > > verifiction
> >> > > > > > >>>> Owner: Nobody
> >> > > > > > >>>> Requestors: GarciaJ at imsg.com
> >> > > > > > >>>> Status: new
> >> > > > > > >>>> Ticket <URL: https://rt.rap.ucar.edu/rt/
> >> > > > > Ticket/Display.html?id=77823
> >> > > > > > >
> >> > > > > > >>>>
> >> > > > > > >>>>
> >> > > > > > >>>> Dear Met Help,
> >> > > > > > >>>>
> >> > > > > > >>>>
> >> > > > > > >>>> I've been trying to run MET using a radar NETCDF
file,
> >> > > > > > >>>> and an
> >> > > NMMB
> >> > > > > > model forecast GRIB file, but the following error shows
up:
> >> > > > > > >>>>
> >> > > > > > >>>>
> >> > > > > > >>>> DEBUG 1: Default Config File:
/work/apps/pgi_14.10/SANDY/
> >> > > > > > met-5.1/share/met/config/GridStatConfig_default
> >> > > > > > >>>> DEBUG 1: User Config File: GridStatConfig_dbz
ERROR :
> >> > > > > > >>>> ERROR : Trouble reading observation file
> >> > > "Hongqiao.Refl.20150602.
> >> > > > > > s100000.e100500.attributes.nc"
> >> > > > > > >>>> ERROR :
> >> > > > > > >>>>
> >> > > > > > >>>> We used two versions of the OBS file, one as it
was, and
> >> > > > > > >>>> the
> >> > > > second
> >> > > > > > with added "attributes". Still, the same error
occurred. We
> >> > > > > > are not
> >> > > > sure
> >> > > > > on
> >> > > > > > exactly how our NETCDF files need to be for MET to be
able to
> >> > > > > > read
> >> > > > them.
> >> > > > > I
> >> > > > > > searched the error message on the Guide and nothing
showed up.
> >> > > > > > >>>>
> >> > > > > > >>>> We can share the files to your FTP if you want to
run
> them.
> >> > > > > > >>>>
> >> > > > > > >>>> Any help will be greatly appreciated.
> >> > > > > > >>>>
> >> > > > > > >>>>
> >> > > > > > >>>>
> >> > > > > > >>>> NOTE: We are using MET 5.1
> >> > > > > > >>>>
> >> > > > > > >>>>
> >> > > > > > >>>> Best Regards,
> >> > > > > > >>>>
> >> > > > > > >>>> Jose
> >> > > > > > >>>>
> >> > > > > > >>>>
> >> > > > > > >>>>
> >> > > > > > >>>>
> >> > > > > > >>>> Jose M. Garcia-Rivera, PhD
> >> > > > > > >>>>
> >> > > > > > >>>> Atmospheric Scientist
> >> > > > > > >>>>
> >> > > > > > >>>> IM Systems Group
> >> > > > > > >>>>
> >> > > > > > >>>> Rockville/College Park, MD
> >> > > > > > >>>>
> >> > > > > > >>>> This e-mail, including attachments, may include
> >> > > > > > >>>> confidential
> >> > > > and/or
> >> > > > > > proprietary information, and may be used only by the
person or
> >> > > > > > entity
> >> > > > to
> >> > > > > > which it is addressed. If the reader of this e-mail is
not the
> >> > > intended
> >> > > > > > recipient or his or her authorized agent, the reader is
hereby
> >> > > notified
> >> > > > > > that any dissemination, distribution or copying of this
e-mail
> >> > > > > > is prohibited. If you have received this e-mail in
error,
> >> > > > > > please notify
> >> > > > the
> >> > > > > > sender by replying to this message and delete this e-
mail
> >> > > immediately.
> >> > > > > > >>>>
> >> > > > > > >>>>
> >> > > > > > >>>
> >> > > > > > >>>
> >> > > > > > >>>
> >> > > > > > >>> --
> >> > > > > > >>> Julie Prestopnik
> >> > > > > > >>> National Center for Atmospheric Research Research
> >> > > > > > >>> Applications Laboratory
> >> > > > > > >>> Phone: 303.497.8399
> >> > > > > > >>> Email: jpresto at ucar.edu
> >> > > > > > >>>
> >> > > > > > >>>
> >> > > > > > >>> This e-mail, including attachments, may include
> >> > > > > > >>> confidential
> >> > > and/or
> >> > > > > > proprietary information, and may be used only by the
person or
> >> > > > > > entity
> >> > > > to
> >> > > > > > which it is addressed. If the reader of this e-mail is
not the
> >> > > intended
> >> > > > > > recipient or his or her authorized agent, the reader is
hereby
> >> > > notified
> >> > > > > > that any dissemination, distribution or copying of this
e-mail
> >> > > > > > is prohibited. If you have received this e-mail in
error,
> >> > > > > > please notify
> >> > > > the
> >> > > > > > sender by replying to this message and delete this e-
mail
> >> > > immediately.
> >> > > > > > >>>
> >> > > > > > >>>
> >> > > > > > >>
> >> > > > > > >>
> >> > > > > > >>
> >> > > > > > >> --
> >> > > > > > >> Julie Prestopnik
> >> > > > > > >> National Center for Atmospheric Research Research
> >> > > > > > >> Applications Laboratory
> >> > > > > > >> Phone: 303.497.8399
> >> > > > > > >> Email: jpresto at ucar.edu
> >> > > > > > >>
> >> > > > > > >> This e-mail, including attachments, may include
> >> > > > > > >> confidential
> >> > > and/or
> >> > > > > > proprietary information, and may be used only by the
person or
> >> > > > > > entity
> >> > > > to
> >> > > > > > which it is addressed. If the reader of this e-mail is
not the
> >> > > intended
> >> > > > > > recipient or his or her authorized agent, the reader is
hereby
> >> > > notified
> >> > > > > > that any dissemination, distribution or copying of this
e-mail
> >> > > > > > is prohibited. If you have received this e-mail in
error,
> >> > > > > > please notify
> >> > > > the
> >> > > > > > sender by replying to this message and delete this e-
mail
> >> > > immediately.
> >> > > > > > >>
> >> > > > > > >>
> >> > > > > > >
> >> > > > > > >
> >> > > > > > >
> >> > > > > > > --
> >> > > > > > > Julie Prestopnik
> >> > > > > > > National Center for Atmospheric Research Research
> >> > > > > > > Applications Laboratory
> >> > > > > > > Phone: 303.497.8399
> >> > > > > > > Email: jpresto at ucar.edu
> >> > > > > > >
> >> > > > > > >
> >> > > > > > > This e-mail, including attachments, may include
confidential
> >> > > > > > > and/or
> >> > > > > > proprietary information, and may be used only by the
person or
> >> > > > > > entity
> >> > > > to
> >> > > > > > which it is addressed. If the reader of this e-mail is
not the
> >> > > intended
> >> > > > > > recipient or his or her authorized agent, the reader is
hereby
> >> > > notified
> >> > > > > > that any dissemination, distribution or copying of this
e-mail
> >> > > > > > is prohibited. If you have received this e-mail in
error,
> >> > > > > > please notify
> >> > > > the
> >> > > > > > sender by replying to this message and delete this e-
mail
> >> > > immediately.
> >> > > > > > >
> >> > > > > > >
> >> > > > > >
> >> > > > > >
> >> > > > > >
> >> > > > > > --
> >> > > > > > Julie Prestopnik
> >> > > > > > National Center for Atmospheric Research Research
Applications
> >> > > > > > Laboratory
> >> > > > > > Phone: 303.497.8399
> >> > > > > > Email: jpresto at ucar.edu
> >> > > > > >
> >> > > > > > This e-mail, including attachments, may include
confidential
> >> > > > > > and/or proprietary information, and may be used only by
the
> >> > > > > > person or entity
> >> > > > to
> >> > > > > > which it is addressed. If the reader of this e-mail is
not the
> >> > > intended
> >> > > > > > recipient or his or her authorized agent, the reader is
hereby
> >> > > notified
> >> > > > > > that any dissemination, distribution or copying of this
e-mail
> >> > > > > > is prohibited. If you have received this e-mail in
error,
> >> > > > > > please notify
> >> > > > the
> >> > > > > > sender by replying to this message and delete this e-
mail
> >> > > immediately.
> >> > > > > >
> >> > > > > >
> >> > > > > >
> >> > > > >
> >> > > > >
> >> > > > > --
> >> > > > > Julie Prestopnik
> >> > > > > National Center for Atmospheric Research Research
Applications
> >> > > > > Laboratory
> >> > > > > Phone: 303.497.8399
> >> > > > > Email: jpresto at ucar.edu
> >> > > > >
> >> > > > > This e-mail, including attachments, may include
confidential
> >> > > > > and/or proprietary information, and may be used only by
the
> >> > > > > person or entity
> >> > > to
> >> > > > > which it is addressed. If the reader of this e-mail is
not the
> >> > > > > intended recipient or his or her authorized agent, the
reader is
> >> > > > > hereby notified that any dissemination, distribution or
copying
> >> > > > > of this e-mail is prohibited. If you have received this
e-mail
> >> > > > > in error, please notify
> >> > > the
> >> > > > > sender by replying to this message and delete this e-mail
> >> > immediately.
> >> > > > >
> >> > > > >
> >> > > > >
> >> > > >
> >> > > > This e-mail, including attachments, may include
confidential
> >> > > > and/or proprietary information, and may be used only by the
person
> >> > > > or entity to which it is addressed. If the reader of this
e-mail
> >> > > > is not the intended recipient or his or her authorized
agent, the
> >> > > > reader is hereby notified that any dissemination,
distribution or
> >> > > > copying of this e-mail is prohibited. If you have received
this
> >> > > > e-mail in error, please notify the sender by replying to
this
> >> > > > message and delete
> >> > this e-mail immediately.
> >> > > >
> >> > > >
> >> > > >
> >> > >
> >> > >
> >> > > --
> >> > > Julie Prestopnik
> >> > > National Center for Atmospheric Research Research
Applications
> >> > > Laboratory
> >> > > Phone: 303.497.8399
> >> > > Email: jpresto at ucar.edu
> >> > >
> >> > > This e-mail, including attachments, may include confidential
and/or
> >> > > proprietary information, and may be used only by the person
or
> >> > > entity to which it is addressed. If the reader of this e-mail
is not
> >> > > the intended recipient or his or her authorized agent, the
reader is
> >> > > hereby notified that any dissemination, distribution or
copying of
> >> > > this e-mail is prohibited. If you have received this e-mail
in
> >> > > error, please notify the sender by replying to this message
and
> >> > > delete this
> >> > e-mail immediately.
> >> > >
> >> > >
> >> >
> >> >
> >> > --
> >> > Julie Prestopnik
> >> > National Center for Atmospheric Research Research Applications
> >> > Laboratory
> >> > Phone: 303.497.8399
> >> > Email: jpresto at ucar.edu
> >> >
> >> > This e-mail, including attachments, may include confidential
and/or
> >> > proprietary information, and may be used only by the person or
entity
> >> > to which it is addressed. If the reader of this e-mail is not
the
> >> > intended recipient or his or her authorized agent, the reader
is
> >> > hereby notified that any dissemination, distribution or copying
of
> >> > this e-mail is prohibited. If you have received this e-mail in
error,
> >> > please notify the sender by replying to this message and delete
this
> >> e-mail immediately.
> >> >
> >> >
> >> >
> >>
> >>
> >> --
> >> Julie Prestopnik
> >> National Center for Atmospheric Research Research Applications
> Laboratory
> >> Phone: 303.497.8399
> >> Email: jpresto at ucar.edu
> >>
> >> This e-mail, including attachments, may include confidential
and/or
> >> proprietary information, and may be used only by the person or
entity to
> >> which it is addressed. If the reader of this e-mail is not the
intended
> >> recipient or his or her authorized agent, the reader is hereby
notified
> >> that any dissemination, distribution or copying of this e-mail is
> >> prohibited. If you have received this e-mail in error, please
notify the
> >> sender by replying to this message and delete this e-mail
immediately.
> >>
> >>
> > Jose
> >
> > -----Original Message-----
> > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > Sent: Tuesday, September 13, 2016 1:59 PM
> > To: Jose Garcia-Rivera
> > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar NETCDF
file
> > for grid_stat verifiction
> >
> > Hi Jose.
> >
> > When I ran plot_data_plane on the input observation file,
> > RadarObsNEW_mod_v3.nc, I produced the image I sent you, which
looked
> > similar to the met_OBS.png file that you sent me in that it was
flipped
> > upside-down. So, I produced a similar image pre-grid_stat, using
the raw
> > observation file.
> >
> > How did you produce your radar_OBS.png plot? Could you please try
> running
> > plot_data_plane on the radar observation file and see if you get
the same
> > output we do? I suspect the problem lies in the way the radar
NetCDF
> file
> > is being written.
> >
> > Thanks,
> > Julie
> >
> >
> >
> > On Tue, Sep 13, 2016 at 11:53 AM, Jose Garcia-Rivera via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
> > >
> > > Hi Julie,
> > >
> > > Thanks for checking out. The met_OBS.png is the output I got
from
> > > grid_stat. The correct file is radar_OBS.png plot. So, that may
mean
> > > that you are getting the same issue I got. Have you seen this
happening
> > before?
> > >
> > > Best Regards,
> > > Jose
> > >
> > >
> > >
> > > -----Original Message-----
> > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > Sent: Tuesday, September 13, 2016 1:21 PM
> > > To: Jose Garcia-Rivera
> > > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar
NETCDF
> > > file for grid_stat verifiction
> > >
> > > Hi Jose.
> > >
> > > When I plot the NetCDF3 obs file that we created using nccopy
> > > (RadarObsNEW_mod_v3.nc) using plot_data_plane:
> > >
> > > /usr/local/met-5.2/bin/plot_data_plane RadarObsNEW_mod_v3.nc
> > > RadarObsNEW_mod_v3.ps 'name="REFC"; level="(*,*)";'
> > >
> > > The resulting image, RadarObsNEW_mod_v3.ps (attached), appears
to be
> > > oriented in the same way as the met_OBS.png image that you
attached,
> > > so I don't believe that grid_stat is doing anything to the data,
but
> > > rather that the data was placed into the original NetCDF Obs
data and
> > > needs to be re-oriented there.
> > >
> > > Please let me know if you find that is not the case. Please try
> > > running plot_data_plane on the data that produced the
radar_OBS.png
> > > file and see if you get the same result.
> > >
> > > Thanks,
> > > Julie
> > >
> > > On Tue, Sep 13, 2016 at 9:20 AM, Jose Garcia-Rivera via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823
>
> > > >
> > > > Dear Julie, John
> > > >
> > > > The commands worked fine. Thank you so much!
> > > >
> > > > Now, there's something that is puzzling us. The radar data
from the
> > > > grid_stat.nc output file seems to be flipped upside-down. I
attached
> > > > the MET-produced OBS vs the original OBS. Is this an artifact
of
> > > > grid_stat, or how can it be fixed?
> > > >
> > > >
> > > >
> > > > Best Regards,
> > > > Jose
> > > >
> > > > ________________________________________
> > > > From: Julie Prestopnik via RT <met_help at ucar.edu>
> > > > Sent: Friday, September 9, 2016 4:07 PM
> > > > To: Jose Garcia-Rivera
> > > > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar
NETCDF
> > > > file for grid_stat verifiction
> > > >
> > > > Hi Jose.
> > > >
> > > > As John indicated the problem lies in that currently MET only
> > > > supports the classic data model... i.e. NetCDF3, which the
file
> > > > RadarObsNEW.nc is
> > > not.
> > > >
> > > > Running "file RadarObsNEW.nc" shows that the file is not
"NetCDF
> > > > Data Format data", but rather:
> > > >
> > > > RadarObsNEW.nc: Hierarchical Data Format (version 5) data
> > > >
> > > > You can create a NetCDF3 file when you create the file or you
can
> > > > use the "nccopy" command. However, "nccopy" didn't work with
the
> > > > RadarObsNEW.nc file, until we made some changes. We used
"ncatted"
> > > > to remove the "L" from the value of the following attributes:
> > > > parameter_table_version, parameter_number, level_indicator,
nx, and
> > > > ny. I'll paste in the commands that we used to create a
NetCDF3
> > > > file, plot the data, and get a successful run from grid_stat.
> > > >
> > > > # Update attributes to remove longs
> > > > /usr/local/nco/bin/ncatted \
> > > > -a parameter_table_version,REFC,o,f,129 \ -a
> > > > parameter_number,REFC,o,f,212 \ -a
level_indicator,REFC,o,f,200 \ -a
> > > > nx,global,o,i,674 \ -a ny,global,o,i,620 \ RadarObsNEW.nc
> > > > RadarObsNEW_mod.nc
> > > >
> > > > # Convert from NC4 to NC3
> > > > /usr/local/netcdf/bin/nccopy -3 RadarObsNEW_mod.nc
> > > > RadarObsNEW_mod_v3.nc
> > > >
> > > > # Regrid to global grid
> > > > /usr/local/met-5.2/bin/regrid_data_plane \
RadarObsNEW_mod_v3.nc
> > > > G004 RadarObsNEW_mod_v3_G004.nc \ -field 'name="REFC";
> level="(*,*)";'
> > > >
> > > > # Plot the result
> > > > /usr/local/met-5.2/bin/plot_data_plane \
RadarObsNEW_mod_v3_G004.nc
> > > > RadarObsNEW_mod_v3_G004.ps \ 'name="REFC"; level="(*,*)";'
> > > >
> > > > # Display plot
> > > > convert -rotate 90 -background white -flatten
> > > > RadarObsNEW_mod_v3_G004.ps RadarObsNEW_mod_v3_G004.png display
> > > > RadarObsNEW_mod_v3_G004.png&
> > > >
> > > > # Plot forecast REFC
> > > > /usr/local/met-5.2/bin/plot_data_plane \ ForecastFile.grb
> > > > refc_fcst.ps \ 'name="REFC"; level="L0"; GRIB1_ptv=129;'
> > > >
> > > > # Display plot
> > > > convert -rotate 90 -background white -flatten refc_fcst.ps
> > > > refc_fcst.png display refc_fcst.png&
> > > >
> > > > # Run grid_stat
> > > > /usr/local/met-5.1/bin/grid_stat ForecastFile.grb
> > > > RadarObsNEW_mod_v3.nc GridStatConfig_dbz -outdir out/
> > > >
> > > > I have also attached the NetCDF3 file that we produced after
using
> > > > ncatted and nccopy.
> > > >
> > > > Please let us know if you have any other questions.
> > > >
> > > > Thanks,
> > > > Julie
> > > >
> > > >
> > > > On Fri, Sep 9, 2016 at 12:43 PM, Jose Garcia-Rivera via RT <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > > >
> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
> > > > >
> > > > > Hi John,
> > > > >
> > > > > Glad to talk to you again. We did the proposed changes, and
the
> > > > > error keeps showing up.
> > > > >
> > > > > I uploaded the new file as: RadarObsNEW.nc
> > > > >
> > > > > Please try to run it and let me know what issues show up?
> > > > >
> > > > > Thanks for the help,
> > > > > Jose
> > > > > ________________________________________
> > > > > From: John Halley Gotway via RT <met_help at ucar.edu>
> > > > > Sent: Friday, September 9, 2016 2:17 PM
> > > > > To: Jose Garcia-Rivera
> > > > > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running radar
NETCDF
> > > > > file for grid_stat verifiction
> > > > >
> > > > > Hello Jose,
> > > > >
> > > > > This is John Halley Gotway. I work with Julie on providing
> > > > > support for MET.
> > > > >
> > > > > I think there's a few pieces of info we're missing here.
> > > > >
> > > > > (1) MET does not currently support the enhanced data model
of
> > NetCDF4.
> > > > It
> > > > > only supports the classic data model... i.e. NetCDF3. In
the next
> > > > version
> > > > > of MET (6.0), due out next year, we'll be adding support for
> NetCDF4.
> > > > The
> > > > > file you sent us in NetCDF4 but when Julie add those
attributes
> > > > > she may have used ncdump/ncgen. And their output is
NetCDF3. Try
> > > > > updating your NCL script to write a "classic" NetCDF file.
> > > > >
> > > > > (2) Yes, the "MET_version" global attribute needs to be
present.
> > > > > That tells MET how to parse the grid information.
> > > > >
> > > > > (3) I'm not sure that the variable "name" attribute is
necessary,
> > > > > but it doesn't hurt.
> > > > >
> > > > > (4) The biggest problem is in the definition of your
Mercator grid:
> > > > > :Projection = "Mercator" ;
> > > > > :lat_ll = "3348550.177 degrees_north" ;
> > > > > :lon_ll = "13120540.425 degrees_east" ;
> > > > > :lat_ur = "4057346.9 degrees_north" ;
> > > > > :lon_ur = "13891071.057 degrees_east" ;
> > > > >
> > > > > Those don't look like very meaningful lat/lon values! Where
did
> > > > > you get these numbers? Are they meant to match the grid
defined
> > > > > in the GRIB file you sent us?
> > > > >
> > > > > Thanks,
> > > > > John
> > > > >
> > > > > On Fri, Sep 9, 2016 at 12:08 PM, Jose Garcia-Rivera via RT <
> > > > > met_help at ucar.edu> wrote:
> > > > >
> > > > > >
> > > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
> > > > > >
> > > > > > Dear Julie,
> > > > > >
> > > > > > The file that you modified worked. However, we did the
changes
> > > > > > you
> > > > made,
> > > > > > and grid_stat continues to show the same error.
> > > > > >
> > > > > > I've uploaded the file in the same FTP directory, named:
> > > > > > Hongqiao.Refl.20150602.s100000.e100500.attributes.nc
> > > > > >
> > > > > > This is a file dump of our modified netcdf:
> > > > > >
> > > > > > NCAR Command Language Version 6.3.0 The use of this
software is
> > > > > > governed by a License Agreement.
> > > > > > See http://www.ncl.ucar.edu/ for more details.
> > > > > >
> > > > > > Variable: f
> > > > > > Type: file
> > > > > > filename: Hongqiao.Refl.20150602.
> s100000.e100500.attributes
> > > > > > path:
Hongqiao.Refl.20150602.s100000.e100500.attributes.nc
> > > > > > Number of Attributes:8
> > > > > > MET_version : V5.1
> > > > > > Projection : Mercator
> > > > > > lat_ll : 3348550.177 degrees_north
> > > > > > lon_ll : 13120540.425 degrees_east
> > > > > > lat_ur : 4057346.9 degrees_north
> > > > > > lon_ur : 13891071.057 degrees_east
> > > > > > nx : 674
> > > > > > ny : 620
> > > > > >
> > > > > > dimensions:
> > > > > > lon = 674
> > > > > > lat = 620
> > > > > >
> > > > > > variables:
> > > > > > Variable: lat
> > > > > > Type: float
> > > > > > Total Size: 417880 values
> > > > > > 1671520 bytes
> > > > > > Number of Dimensions: 2
> > > > > > Dimensions and sizes: [ 620 <lat> x 674 <lon> ]
> > > > > > Coordinates:
> > > > > > lat: [4057347..4057347]
> > > > > > lon: [1.312054e+07..1.388993e+07]
> > > > > > Number of Attributes: 2
> > > > > > units : degrees_north
> > > > > > standard_name : latitude
> > > > > >
> > > > > > Variable: lon
> > > > > > Type: float
> > > > > > Total Size: 417880 values
> > > > > > 1671520 bytes
> > > > > > Number of Dimensions: 2
> > > > > > Dimensions and sizes: [ 620 <lat> x 674 <lon> ]
> > > > > > Coordinates:
> > > > > > lat: [4057347..4057347]
> > > > > > lon: [1.312054e+07..1.388993e+07]
> > > > > > Number of Attributes: 2
> > > > > > units : degrees_east
> > > > > > standard_name : longitude
> > > > > >
> > > > > > Variable: REFC
> > > > > > Type: float
> > > > > > Total Size: 417880 values
> > > > > > 1671520 bytes
> > > > > > Number of Dimensions: 2
> > > > > > Dimensions and sizes: [ 620 <lat> x 674 <lon> ]
> > > > > > Coordinates:
> > > > > > lat: [4057347..4057347]
> > > > > > lon: [1.312054e+07..1.388993e+07]
> > > > > > Number of Attributes: 11
> > > > > > name : REFC
> > > > > > units : dbZ
> > > > > > parameter_table_version : 129
> > > > > > parameter_number : 212
> > > > > > level_indicator : 200
> > > > > > level : L0
> > > > > > long_name : MaxReflectivity
> > > > > > init_time : 20050807_000000
> > > > > > init_time_ut : 1123372800
> > > > > > valid_time : 20050807_120000
> > > > > > valid_time_ut : 1123416000
> > > > > >
> > > > > >
> > > > > >
> > > > > > Best Regards,
> > > > > > Jose
> > > > > >
> > > > > >
> > > > > > ________________________________________
> > > > > > From: Julie Prestopnik via RT <met_help at ucar.edu>
> > > > > > Sent: Friday, September 9, 2016 1:09 PM
> > > > > > To: Jose Garcia-Rivera
> > > > > > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running
radar
> > > > > > NETCDF
> > > > file
> > > > > > for grid_stat verifiction
> > > > > >
> > > > > > Hi Jose. Thank you for uploading your data. There were
two
> > > > > > important things missing from your file.
> > > > > >
> > > > > > I added:
> > > > > >
> > > > > > REFC:name = "REFC" ;
> > > > > >
> > > > > > under:
> > > > > >
> > > > > > float REFC(lat, lon) ;
> > > > > >
> > > > > > and I added:
> > > > > >
> > > > > > :MET_version = "V5.1" ;
> > > > > >
> > > > > > under // global attributes:
> > > > > >
> > > > > > and was able to get a successful run of grid_stat.
> > > > > >
> > > > > > I am attaching the file with the changes. Please give it
a try
> > > > > > and let
> > > > > me
> > > > > > know if you get a successful run as well.
> > > > > >
> > > > > > Thanks,
> > > > > > Julie
> > > > > >
> > > > > > On Fri, Sep 9, 2016 at 10:38 AM, Jose Garcia-Rivera via RT
<
> > > > > > met_help at ucar.edu> wrote:
> > > > > >
> > > > > > >
> > > > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823
> > > > > > > >
> > > > > > >
> > > > > > > Dear Julie,
> > > > > > >
> > > > > > > We used the Mercator example, and ours looks identical
to
> yours.
> > > > > > > I proceeded and put 4 files into your FTP server:
> > > > > > >
> > > > > > > Model forecast file
> > > > > > > Radar Obs file
> > > > > > > Grid Stat Config file
> > > > > > > domain.poly file
> > > > > > >
> > > > > > > The files are under 'garcia_data'
> > > > > > >
> > > > > > >
> > > > > > > Thanks so much for your help,
> > > > > > > Jose
> > > > > > > ________________________________________
> > > > > > > From: Julie Prestopnik via RT <met_help at ucar.edu>
> > > > > > > Sent: Friday, September 9, 2016 11:50 AM
> > > > > > > To: Jose Garcia-Rivera
> > > > > > > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running
radar
> > > > > > > NETCDF
> > > > > file
> > > > > > > for grid_stat verifiction
> > > > > > >
> > > > > > > Hi Jose. I have attached a Mercator projection example.
If
> > > > > > > you're still stuck, please post your data to our
anonymous FTP
> > > > > > > site following these instructions:
> > > > > > >
http://www.dtcenter.org/met/users/support/met_help.php#ftp
> > > > > > >
> > > > > > > Thanks,
> > > > > > > Julie
> > > > > > >
> > > > > > >
> > > > > > > On Thu, Sep 8, 2016 at 3:25 PM, Jose Garcia-Rivera via
RT
> > > > > > > <met_help at ucar.edu> wrote:
> > > > > > > >
> > > > > > > > <URL:
> > > > > > > >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823
> > > > > > > > >
> > > > > > > >
> > > > > > > > Dear Julie,
> > > > > > > >
> > > > > > > > That's very good information, thanks. We've been
working on
> > > > > > > > this
> > > > > issue,
> > > > > > > however the same error keeps showing up.
> > > > > > > >
> > > > > > > > Can we get a Mercator projection example?
> > > > > > > >
> > > > > > > > I was wondering if you could have a peek into our
netcdf
> > > > > > > > file, or
> > > > run
> > > > > > an
> > > > > > > internal test to see what needs to be changed, or what
may be
> > > wrong.
> > > > In
> > > > > > the
> > > > > > > meantime, we continue working on trying to make the file
fit
> > > > > > > MET requirements.
> > > > > > > >
> > > > > > > > Thanks for the help,
> > > > > > > > Jose
> > > > > > > >
> > > > > > > > ________________________________________
> > > > > > > > From: Julie Prestopnik via RT <met_help at ucar.edu>
> > > > > > > > Sent: Thursday, September 8, 2016 3:57 PM
> > > > > > > > To: Jose Garcia-Rivera
> > > > > > > > Subject: Re: [rt.rap.ucar.edu #77823] Trouble running
radar
> > > > > > > > NETCDF
> > > > > > file
> > > > > > > for grid_stat verifiction
> > > > > > > >
> > > > > > > > Hi Jose.
> > > > > > > >
> > > > > > > > Unfortunately, we do not have a radar obs netcdf
example
> file.
> > > > With
> > > > > > > > NetCDF, users have two choices:
> > > > > > > > --make it look like the NetCDF files that MET
generates (i.e.
> > > > > > > > the output of pcp_combine) or --put it into CF-
compliant
> > > > > > > > NetCDF The variable can be named "radar_obs" or
"precip" or
> > > > > > > > anything you'd
> > > > > > like.
> > > > > > > >
> > > > > > > > Julie
> > > > > > > >
> > > > > > > >
> > > > > > > > On Thu, Sep 8, 2016 at 12:10 PM, Jose Garcia-Rivera
via RT
> > > > > > > > <met_help at ucar.edu> wrote:
> > > > > > > >>
> > > > > > > >> <URL:
> > > > > > > >>
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823
> > > > > > > >> >
> > > > > > > >>
> > > > > > > >> Dear Julie,
> > > > > > > >>
> > > > > > > >> Thanks so much for the file. We haven't been able to
work
> > > > > > > >> on it
> > > > yet,
> > > > > > > since we are fixing computer issues. One more question,
do you
> > > > > > > have a
> > > > > > radar
> > > > > > > obs netcdf example file?
> > > > > > > >>
> > > > > > > >> Best Regards,
> > > > > > > >> Jose
> > > > > > > >>
> > > > > > > >> From: Julie Prestopnik via RT <met_help at ucar.edu>
> > > > > > > >> Sent: Thursday, September 8, 2016 12:58 PM
> > > > > > > >> To: Jose Garcia-Rivera
> > > > > > > >> Subject: Re: [rt.rap.ucar.edu #77823] Trouble running
radar
> > > > NETCDF
> > > > > > > file for grid_stat verifiction
> > > > > > > >>
> > > > > > > >> My apologies. I meant to attach the file in my last
email.
> > > You
> > > > > can
> > > > > > > >> find it attached to this one.
> > > > > > > >>
> > > > > > > >> Thanks,
> > > > > > > >> Julie
> > > > > > > >>
> > > > > > > >> On Thu, Sep 8, 2016 at 10:36 AM, Jose Garcia-Rivera
via RT
> > > > > > > >> <met_help at ucar.edu> wrote:
> > > > > > > >>>
> > > > > > > >>> <URL:
> > > > > > > >>>
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77823 >
> > > > > > > >>>
> > > > > > > >>> Dear Julie,
> > > > > > > >>>
> > > > > > > >>> Thanks for the helpful response. Can I have an
example
> > > > > > > >>> file from
> > > > > the
> > > > > > > pcp_combine tool for reference?
> > > > > > > >>>
> > > > > > > >>> Best Regards,
> > > > > > > >>> Jose
> > > > > > > >>> ________________________________________
> > > > > > > >>> From: Julie Prestopnik via RT <met_help at ucar.edu>
> > > > > > > >>> Sent: Thursday, September 8, 2016 11:57 AM
> > > > > > > >>> To: Jose Garcia-Rivera
> > > > > > > >>> Subject: Re: [rt.rap.ucar.edu #77823] Trouble
running
> > > > > > > >>> radar
> > > > NETCDF
> > > > > > > file for grid_stat verifiction
> > > > > > > >>>
> > > > > > > >>> Hi Jose.
> > > > > > > >>>
> > > > > > > >>> I see that you are running MET 5.1, but are unsure
of how
> > > > > > > >>> the
> > > > > NetCDF
> > > > > > > >>> files should be formatted in order for GridStat to
be able
> > > > > > > >>> to
> > > > read
> > > > > > > >>> them.
> > > > > > > >>>
> > > > > > > >>> In order it use gridded NetCDF files in MET, you'll
need
> > > > > > > >>> to make
> > > > > them
> > > > > > > >>> look like the output of the pcp_combine tool.
> > > > > > > >>>
> > > > > > > >>> Listed below is the header from one of the NetCDF
files
> > > > > > > >>> from pcp_combine created by the METv5.1 test
scripts.
> > > > > > > >>> Here are the required parts.
> > > > > > > >>>
> > > > > > > >>> (1) dimensions should be named "lat" and "lon"
> > > > > > > >>> (2) the "lat" and "lon" variable are **NOT**
required
> > > > > > > >>> (3) gridded variables (e.g. APCP_12) must use the
"lat"
> > > > > > > >>> and
> > > > "lon"
> > > > > > > dimensions
> > > > > > > >>> (4) gridded variables should include the
attributes
> > > > > > > >>> listed in
> > > > the
> > > > > > > >>> example (for timing info, only the init_time_ut,
> > > > > > > >>> valid_time_ut,
> > > > and
> > > > > > > >>> accum_time_sec are actually used. "ut" stands for
unix
> > > > > > > >>> time, the number of seconds since Jan 1, 1970).
> > > > > > > >>> (5) global attributes should include the
grid/projection
> > > > > > > >>> information. This example shows how they're
specified for
> > > > > > > >>> a
> > > > > lambert
> > > > > > > >>> conformal projection. Let me know if you're using a
> > > > > > > >>> different projection and I'll send you an example.
> > > > > > > >>>
> > > > > > > >>> I hope that helps get you going.
> > > > > > > >>>
> > > > > > > >>> Julie
> > > > > > > >>>
> > > > > > > >>>
> > > > > > > >>>
> > > > > > > >>> On Wed, Sep 7, 2016 at 3:15 PM, Jose Garcia-Rivera
via RT
> > > > > > > >>> <met_help at ucar.edu> wrote:
> > > > > > > >>>>
> > > > > > > >>>> Wed Sep 07 15:15:39 2016: Request 77823 was acted
upon.
> > > > > > > >>>> Transaction: Ticket created by GarciaJ at imsg.com
> > > > > > > >>>> Queue: met_help
> > > > > > > >>>> Subject: Trouble running radar NETCDF file for
> > > > > > > >>>> grid_stat
> > > > > > > verifiction
> > > > > > > >>>> Owner: Nobody
> > > > > > > >>>> Requestors: GarciaJ at imsg.com
> > > > > > > >>>> Status: new
> > > > > > > >>>> Ticket <URL: https://rt.rap.ucar.edu/rt/
> > > > > > Ticket/Display.html?id=77823
> > > > > > > >
> > > > > > > >>>>
> > > > > > > >>>>
> > > > > > > >>>> Dear Met Help,
> > > > > > > >>>>
> > > > > > > >>>>
> > > > > > > >>>> I've been trying to run MET using a radar NETCDF
file,
> > > > > > > >>>> and an
> > > > NMMB
> > > > > > > model forecast GRIB file, but the following error shows
up:
> > > > > > > >>>>
> > > > > > > >>>>
> > > > > > > >>>> DEBUG 1: Default Config File:
/work/apps/pgi_14.10/SANDY/
> > > > > > > met-5.1/share/met/config/GridStatConfig_default
> > > > > > > >>>> DEBUG 1: User Config File: GridStatConfig_dbz ERROR
:
> > > > > > > >>>> ERROR : Trouble reading observation file
> > > > "Hongqiao.Refl.20150602.
> > > > > > > s100000.e100500.attributes.nc"
> > > > > > > >>>> ERROR :
> > > > > > > >>>>
> > > > > > > >>>> We used two versions of the OBS file, one as it
was, and
> > > > > > > >>>> the
> > > > > second
> > > > > > > with added "attributes". Still, the same error occurred.
We
> > > > > > > are not
> > > > > sure
> > > > > > on
> > > > > > > exactly how our NETCDF files need to be for MET to be
able to
> > > > > > > read
> > > > > them.
> > > > > > I
> > > > > > > searched the error message on the Guide and nothing
showed up.
> > > > > > > >>>>
> > > > > > > >>>> We can share the files to your FTP if you want to
run
> them.
> > > > > > > >>>>
> > > > > > > >>>> Any help will be greatly appreciated.
> > > > > > > >>>>
> > > > > > > >>>>
> > > > > > > >>>>
> > > > > > > >>>> NOTE: We are using MET 5.1
> > > > > > > >>>>
> > > > > > > >>>>
> > > > > > > >>>> Best Regards,
> > > > > > > >>>>
> > > > > > > >>>> Jose
> > > > > > > >>>>
> > > > > > > >>>>
> > > > > > > >>>>
> > > > > > > >>>>
> > > > > > > >>>> Jose M. Garcia-Rivera, PhD
> > > > > > > >>>>
> > > > > > > >>>> Atmospheric Scientist
> > > > > > > >>>>
> > > > > > > >>>> IM Systems Group
> > > > > > > >>>>
> > > > > > > >>>> Rockville/College Park, MD
> > > > > > > >>>>
> > > > > > > >>>> This e-mail, including attachments, may include
> > > > > > > >>>> confidential
> > > > > and/or
> > > > > > > proprietary information, and may be used only by the
person or
> > > > > > > entity
> > > > > to
> > > > > > > which it is addressed. If the reader of this e-mail is
not the
> > > > intended
> > > > > > > recipient or his or her authorized agent, the reader is
hereby
> > > > notified
> > > > > > > that any dissemination, distribution or copying of this
e-mail
> > > > > > > is prohibited. If you have received this e-mail in
error,
> > > > > > > please notify
> > > > > the
> > > > > > > sender by replying to this message and delete this e-
mail
> > > > immediately.
> > > > > > > >>>>
> > > > > > > >>>>
> > > > > > > >>>
> > > > > > > >>>
> > > > > > > >>>
> > > > > > > >>> --
> > > > > > > >>> Julie Prestopnik
> > > > > > > >>> National Center for Atmospheric Research Research
> > > > > > > >>> Applications Laboratory
> > > > > > > >>> Phone: 303.497.8399
> > > > > > > >>> Email: jpresto at ucar.edu
> > > > > > > >>>
> > > > > > > >>>
> > > > > > > >>> This e-mail, including attachments, may include
> > > > > > > >>> confidential
> > > > and/or
> > > > > > > proprietary information, and may be used only by the
person or
> > > > > > > entity
> > > > > to
> > > > > > > which it is addressed. If the reader of this e-mail is
not the
> > > > intended
> > > > > > > recipient or his or her authorized agent, the reader is
hereby
> > > > notified
> > > > > > > that any dissemination, distribution or copying of this
e-mail
> > > > > > > is prohibited. If you have received this e-mail in
error,
> > > > > > > please notify
> > > > > the
> > > > > > > sender by replying to this message and delete this e-
mail
> > > > immediately.
> > > > > > > >>>
> > > > > > > >>>
> > > > > > > >>
> > > > > > > >>
> > > > > > > >>
> > > > > > > >> --
> > > > > > > >> Julie Prestopnik
> > > > > > > >> National Center for Atmospheric Research Research
> > > > > > > >> Applications Laboratory
> > > > > > > >> Phone: 303.497.8399
> > > > > > > >> Email: jpresto at ucar.edu
> > > > > > > >>
> > > > > > > >> This e-mail, including attachments, may include
> > > > > > > >> confidential
> > > > and/or
> > > > > > > proprietary information, and may be used only by the
person or
> > > > > > > entity
> > > > > to
> > > > > > > which it is addressed. If the reader of this e-mail is
not the
> > > > intended
> > > > > > > recipient or his or her authorized agent, the reader is
hereby
> > > > notified
> > > > > > > that any dissemination, distribution or copying of this
e-mail
> > > > > > > is prohibited. If you have received this e-mail in
error,
> > > > > > > please notify
> > > > > the
> > > > > > > sender by replying to this message and delete this e-
mail
> > > > immediately.
> > > > > > > >>
> > > > > > > >>
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > --
> > > > > > > > Julie Prestopnik
> > > > > > > > National Center for Atmospheric Research Research
> > > > > > > > Applications Laboratory
> > > > > > > > Phone: 303.497.8399
> > > > > > > > Email: jpresto at ucar.edu
> > > > > > > >
> > > > > > > >
> > > > > > > > This e-mail, including attachments, may include
confidential
> > > > > > > > and/or
> > > > > > > proprietary information, and may be used only by the
person or
> > > > > > > entity
> > > > > to
> > > > > > > which it is addressed. If the reader of this e-mail is
not the
> > > > intended
> > > > > > > recipient or his or her authorized agent, the reader is
hereby
> > > > notified
> > > > > > > that any dissemination, distribution or copying of this
e-mail
> > > > > > > is prohibited. If you have received this e-mail in
error,
> > > > > > > please notify
> > > > > the
> > > > > > > sender by replying to this message and delete this e-
mail
> > > > immediately.
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > --
> > > > > > > Julie Prestopnik
> > > > > > > National Center for Atmospheric Research Research
Applications
> > > > > > > Laboratory
> > > > > > > Phone: 303.497.8399
> > > > > > > Email: jpresto at ucar.edu
> > > > > > >
> > > > > > > This e-mail, including attachments, may include
confidential
> > > > > > > and/or proprietary information, and may be used only by
the
> > > > > > > person or entity
> > > > > to
> > > > > > > which it is addressed. If the reader of this e-mail is
not the
> > > > intended
> > > > > > > recipient or his or her authorized agent, the reader is
hereby
> > > > notified
> > > > > > > that any dissemination, distribution or copying of this
e-mail
> > > > > > > is prohibited. If you have received this e-mail in
error,
> > > > > > > please notify
> > > > > the
> > > > > > > sender by replying to this message and delete this e-
mail
> > > > immediately.
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > >
> > > > > >
> > > > > > --
> > > > > > Julie Prestopnik
> > > > > > National Center for Atmospheric Research Research
Applications
> > > > > > Laboratory
> > > > > > Phone: 303.497.8399
> > > > > > Email: jpresto at ucar.edu
> > > > > >
> > > > > > This e-mail, including attachments, may include
confidential
> > > > > > and/or proprietary information, and may be used only by
the
> > > > > > person or entity
> > > > to
> > > > > > which it is addressed. If the reader of this e-mail is not
the
> > > > > > intended recipient or his or her authorized agent, the
reader is
> > > > > > hereby notified that any dissemination, distribution or
copying
> > > > > > of this e-mail is prohibited. If you have received this e-
mail
> > > > > > in error, please notify
> > > > the
> > > > > > sender by replying to this message and delete this e-mail
> > > immediately.
> > > > > >
> > > > > >
> > > > > >
> > > > >
> > > > > This e-mail, including attachments, may include confidential
> > > > > and/or proprietary information, and may be used only by the
person
> > > > > or entity to which it is addressed. If the reader of this e-
mail
> > > > > is not the intended recipient or his or her authorized
agent, the
> > > > > reader is hereby notified that any dissemination,
distribution or
> > > > > copying of this e-mail is prohibited. If you have received
this
> > > > > e-mail in error, please notify the sender by replying to
this
> > > > > message and delete
> > > this e-mail immediately.
> > > > >
> > > > >
> > > > >
> > > >
> > > >
> > > > --
> > > > Julie Prestopnik
> > > > National Center for Atmospheric Research Research Applications
> > > > Laboratory
> > > > Phone: 303.497.8399
> > > > Email: jpresto at ucar.edu
> > > >
> > > > This e-mail, including attachments, may include confidential
and/or
> > > > proprietary information, and may be used only by the person or
> > > > entity to which it is addressed. If the reader of this e-mail
is not
> > > > the intended recipient or his or her authorized agent, the
reader is
> > > > hereby notified that any dissemination, distribution or
copying of
> > > > this e-mail is prohibited. If you have received this e-mail in
> > > > error, please notify the sender by replying to this message
and
> > > > delete this
> > > e-mail immediately.
> > > >
> > > >
> > >
> > >
> > > --
> > > Julie Prestopnik
> > > National Center for Atmospheric Research Research Applications
> > > Laboratory
> > > Phone: 303.497.8399
> > > Email: jpresto at ucar.edu
> > >
> > > This e-mail, including attachments, may include confidential
and/or
> > > proprietary information, and may be used only by the person or
entity
> > > to which it is addressed. If the reader of this e-mail is not
the
> > > intended recipient or his or her authorized agent, the reader is
> > > hereby notified that any dissemination, distribution or copying
of
> > > this e-mail is prohibited. If you have received this e-mail in
error,
> > > please notify the sender by replying to this message and delete
this
> > e-mail immediately.
> > >
> > >
> > >
> >
> >
> > --
> > Julie Prestopnik
> > National Center for Atmospheric Research Research Applications
Laboratory
> > Phone: 303.497.8399
> > Email: jpresto at ucar.edu
> >
> > This e-mail, including attachments, may include confidential
and/or
> > proprietary information, and may be used only by the person or
entity to
> > which it is addressed. If the reader of this e-mail is not the
intended
> > recipient or his or her authorized agent, the reader is hereby
notified
> > that any dissemination, distribution or copying of this e-mail is
> > prohibited. If you have received this e-mail in error, please
notify the
> > sender by replying to this message and delete this e-mail
immediately.
> >
> >
>
> This e-mail, including attachments, may include confidential and/or
> proprietary information, and may be used only by the person or
entity to
> which it is addressed. If the reader of this e-mail is not the
intended
> recipient or his or her authorized agent, the reader is hereby
notified
> that any dissemination, distribution or copying of this e-mail is
> prohibited. If you have received this e-mail in error, please notify
the
> sender by replying to this message and delete this e-mail
immediately.
>
>
>
--
Julie Prestopnik
National Center for Atmospheric Research
Research Applications Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
------------------------------------------------
More information about the Met_help
mailing list