[Met_help] [rt.rap.ucar.edu #41229] History for Re: MET version 3.0 release
RAL HelpDesk {for John Halley Gotway}
met_help at ucar.edu
Mon Oct 11 15:52:58 MDT 2010
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Hello, Thank you for your staff's great work.
Here, I have a question on the usage of METs.
To conduct Grid verification, a Grid observation in GRIB format is
needed. My question is how to obtain this GRIB file. Generally, the
observations with automatic weather stations network can be used to
generate grid field with spatial interpolation. However, the
conversion from general grid format (e.g. Surfer grid format, GeoTiff,
etc.) to GRIB is really a labor work. Do you have any suggestion or
tool for this GRIB file generation? Thanks.
---------------------------------------
Weimin WANG Ph.D
On Fri, Oct 1, 2010 at 7:32 AM, Tressa Fowler <tressa at ucar.edu> wrote:
>
> The MET development team at the DTC is pleased to announce the release of
> the MET version 3.0 verification package. It is available for download from
> the MET Users web page:
>
> http://www.dtcenter.org/met/users/index.php
>
> MET v3.0 incorporates some major new features. The new Ensemble-Stat tool
> preprocesses sets of forecasts into ensemble forecasts, including mean,
> spread, and probability. When observations are included, it will also derive
> ensemble statistics such as rank histogram and continuous ranked probability
> score. When accumulating statistics over time, users can now adjust the
> confidence intervals to account for serial correlation. To assist our WRF
> ARW users, MET v3.0 can read the netCDF output from the pinterp
> postprocessor. Multi-category, e.g. 3x3, contingency tables are now
> supported, along with appropriate skill scores.
>
> A new tools directory is also included in the software. One tool will plot
> point observations from the MET preprocessing tools. Users wishing to
> perform cloud verification using the Air Force Weather Agency’s World Wide
> Merged Cloud Analysis (WWMCA) product for verification will find two new
> tools for their use. One creates plots of the WWMCA total cloud amount,
> while the other will interpolate the WWMCA onto any grid or map projection,
> allowing WWMCA to be matched to the cloud forecast of interest.
>
> We hope that MET v3.0 enhances your WRF verification efforts. Please send
> any comments to met_help at ucar.edu .
>
> Thank you,
>
> The MET development team
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #41229] Re: MET version 3.0 release
From: John Halley Gotway
Time: Fri Oct 01 08:51:17 2010
Weimin,
Generally, the availability of your observations will drive the type
of verification you're able to perform. If you have point
observations at stations, we'd suggest using the Point-Stat tool to
verify your forecasts against those point observations.
However, there are many more verification methods that are available
when verifying against gridded observations than point observations.
If you'd like to go through the process of interpolating
point data onto a grid, you're welcome to. However, there are not any
tools in MET that will help you perform that step. Regarding the
output file format, you're right that writing GRIB files can be
rather tedious. Instead of that, you could easily write a NetCDF file
that looks like one of the NetCDF files that the MET tools create.
For example, take a look at the NetCDF output of the
PCP-Combine tool. If you make your NetCDF file look similar to that,
the other MET tools will be able to read it. If you decide to go that
route, I could help you with the specifics of what exactly
your file will need to contain.
Thanks,
John Halley Gotway
met_help at ucar.edu
RAL HelpDesk {for Weimin Wang} wrote:
> Fri Oct 01 01:03:00 2010: Request 41229 was acted upon.
> Transaction: Ticket created by wmwang at gmail.com
> Queue: met_help
> Subject: Re: MET version 3.0 release
> Owner: Nobody
> Requestors: wmwang at gmail.com
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=41229 >
>
>
> Hello, Thank you for your staff's great work.
>
> Here, I have a question on the usage of METs.
>
> To conduct Grid verification, a Grid observation in GRIB format is
> needed. My question is how to obtain this GRIB file. Generally, the
> observations with automatic weather stations network can be used to
> generate grid field with spatial interpolation. However, the
> conversion from general grid format (e.g. Surfer grid format,
GeoTiff,
> etc.) to GRIB is really a labor work. Do you have any suggestion or
> tool for this GRIB file generation? Thanks.
>
> ---------------------------------------
> Weimin WANG Ph.D
>
>
>
> On Fri, Oct 1, 2010 at 7:32 AM, Tressa Fowler <tressa at ucar.edu>
wrote:
>> The MET development team at the DTC is pleased to announce the
release of
>> the MET version 3.0 verification package. It is available for
download from
>> the MET Users web page:
>>
>> http://www.dtcenter.org/met/users/index.php
>>
>> MET v3.0 incorporates some major new features. The new Ensemble-
Stat tool
>> preprocesses sets of forecasts into ensemble forecasts, including
mean,
>> spread, and probability. When observations are included, it will
also derive
>> ensemble statistics such as rank histogram and continuous ranked
probability
>> score. When accumulating statistics over time, users can now adjust
the
>> confidence intervals to account for serial correlation. To assist
our WRF
>> ARW users, MET v3.0 can read the netCDF output from the pinterp
>> postprocessor. Multi-category, e.g. 3x3, contingency tables are now
>> supported, along with appropriate skill scores.
>>
>> A new tools directory is also included in the software. One tool
will plot
>> point observations from the MET preprocessing tools. Users wishing
to
>> perform cloud verification using the Air Force Weather Agency’s
World Wide
>> Merged Cloud Analysis (WWMCA) product for verification will find
two new
>> tools for their use. One creates plots of the WWMCA total cloud
amount,
>> while the other will interpolate the WWMCA onto any grid or map
projection,
>> allowing WWMCA to be matched to the cloud forecast of interest.
>>
>> We hope that MET v3.0 enhances your WRF verification efforts.
Please send
>> any comments to met_help at ucar.edu .
>>
>> Thank you,
>>
>> The MET development team
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #41229] Re: MET version 3.0 release
From: Weimin Wang
Time: Fri Oct 01 18:15:02 2010
John,
That's great if Grid-Stat can accept NetCDF format. Would you please
give further details on the definition of NetCDF format required by
Grid-Stat? Maybe I could take a try to convert my Surfer grid file to
NetCDF file.
---------------------------------------
Weimin WANG Ph.D
On Fri, Oct 1, 2010 at 10:51 PM, RAL HelpDesk {for John Halley Gotway}
<met_help at ucar.edu> wrote:
> Weimin,
>
> Generally, the availability of your observations will drive the type
of verification you're able to perform. If you have point
observations at stations, we'd suggest using the Point-Stat tool to
> verify your forecasts against those point observations.
>
> However, there are many more verification methods that are available
when verifying against gridded observations than point observations.
If you'd like to go through the process of interpolating
> point data onto a grid, you're welcome to. However, there are not
any tools in MET that will help you perform that step. Regarding the
output file format, you're right that writing GRIB files can be
> rather tedious. Instead of that, you could easily write a NetCDF
file that looks like one of the NetCDF files that the MET tools
create. For example, take a look at the NetCDF output of the
> PCP-Combine tool. If you make your NetCDF file look similar to
that, the other MET tools will be able to read it. If you decide to
go that route, I could help you with the specifics of what exactly
> your file will need to contain.
>
> Thanks,
> John Halley Gotway
> met_help at ucar.edu
>
> RAL HelpDesk {for Weimin Wang} wrote:
>> Fri Oct 01 01:03:00 2010: Request 41229 was acted upon.
>> Transaction: Ticket created by wmwang at gmail.com
>> Queue: met_help
>> Subject: Re: MET version 3.0 release
>> Owner: Nobody
>> Requestors: wmwang at gmail.com
>> Status: new
>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=41229 >
>>
>>
>> Hello, Thank you for your staff's great work.
>>
>> Here, I have a question on the usage of METs.
>>
>> To conduct Grid verification, a Grid observation in GRIB format is
>> needed. My question is how to obtain this GRIB file. Generally, the
>> observations with automatic weather stations network can be used to
>> generate grid field with spatial interpolation. However, the
>> conversion from general grid format (e.g. Surfer grid format,
GeoTiff,
>> etc.) to GRIB is really a labor work. Do you have any suggestion or
>> tool for this GRIB file generation? Thanks.
>>
>> ---------------------------------------
>> Weimin WANG Ph.D
>>
>>
>>
>> On Fri, Oct 1, 2010 at 7:32 AM, Tressa Fowler <tressa at ucar.edu>
wrote:
>>> The MET development team at the DTC is pleased to announce the
release of
>>> the MET version 3.0 verification package. It is available for
download from
>>> the MET Users web page:
>>>
>>> http://www.dtcenter.org/met/users/index.php
>>>
>>> MET v3.0 incorporates some major new features. The new Ensemble-
Stat tool
>>> preprocesses sets of forecasts into ensemble forecasts, including
mean,
>>> spread, and probability. When observations are included, it will
also derive
>>> ensemble statistics such as rank histogram and continuous ranked
probability
>>> score. When accumulating statistics over time, users can now
adjust the
>>> confidence intervals to account for serial correlation. To assist
our WRF
>>> ARW users, MET v3.0 can read the netCDF output from the pinterp
>>> postprocessor. Multi-category, e.g. 3x3, contingency tables are
now
>>> supported, along with appropriate skill scores.
>>>
>>> A new tools directory is also included in the software. One tool
will plot
>>> point observations from the MET preprocessing tools. Users wishing
to
>>> perform cloud verification using the Air Force Weather Agency’s
World Wide
>>> Merged Cloud Analysis (WWMCA) product for verification will find
two new
>>> tools for their use. One creates plots of the WWMCA total cloud
amount,
>>> while the other will interpolate the WWMCA onto any grid or map
projection,
>>> allowing WWMCA to be matched to the cloud forecast of interest.
>>>
>>> We hope that MET v3.0 enhances your WRF verification efforts.
Please send
>>> any comments to met_help at ucar.edu .
>>>
>>> Thank you,
>>>
>>> The MET development team
>
>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #41229] Re: MET version 3.0 release
From: John Halley Gotway
Time: Mon Oct 04 13:42:49 2010
Weimin,
Listed below is the header of one of the NetCDF files that is
generated by the PCP-Combine test script. Try to make your NetCDF
file look similar to this structure in the following ways:
(1) Dimensions: make sure the "lat" and "lon" dimensions are defined
and indicate the size of the grid.
(2) Variables: You don't need to define the "lat" and "lon" variables.
MET doesn't actually use them. We just write them out so that the
NetCDF files can be plotted nicely using tools like IDV. In
this example, the "APCP_12" variable contains the data of interest.
You can name the variable whatever you like, but it should be of type
"float" and contain the "lat" and "lon" dimensions. You can
actually use additional dimensions too - perhaps a third one for
height if you'd like.
(3) Variable attributes: MET will try to read variable attributes for:
- "valid_time_ut" is the valid time listed in unix time (seconds
since 1970).
- "init_time_ut" is the model initialization time in unix time.
- "level" is a string defining the level information for this data
- when the MET tools read this data, it'll extract the level attribute
and write it out in the "FCST_LEV" column in the MET output
files.
- "units" just defines the units for the data.
- "accum_time_sec" defines the accumulation interval. This makes
sense for precip, but for other variables like TMP, just write it out
as zero.
(4) Global attributes:
- Set the "MET_version" global attribute to "V3.0". That tells the
code how to parse the grid information.
- The last big part is the projection information, starting with
"Projection" and ending with "ny" in our example. If you're able to
send me a GRIB file that's already on the grid you're using,
I'd be able to take a look at it and tell you exactly what attributes
to set here.
Hope that helps get you started.
Thanks,
John
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
ncdump -h
/d1/johnhg/MET/MET_releases/METv3.0/out/pcp_combine/sample_fcst_12L_2005080712V_12A.nc
netcdf sample_fcst_12L_2005080712V_12A {
dimensions:
lat = 129 ;
lon = 185 ;
variables:
float lat(lat, lon) ;
lat:long_name = "latitude" ;
lat:units = "degrees_north" ;
lat:standard_name = "latitude" ;
float lon(lat, lon) ;
lon:long_name = "longitude" ;
lon:units = "degrees_east" ;
lon:standard_name = "longitude" ;
float APCP_12(lat, lon) ;
APCP_12:name = "APCP" ;
APCP_12:long_name = "Total precipitation" ;
APCP_12:level = "A12" ;
APCP_12:units = "kg/m^2" ;
APCP_12:grib_code = 61 ;
APCP_12:_FillValue = -9999.f ;
APCP_12:init_time = "20050807_000000" ;
APCP_12:init_time_ut = 1123372800 ;
APCP_12:valid_time = "20050807_120000" ;
APCP_12:valid_time_ut = 1123416000 ;
APCP_12:accum_time = "120000" ;
APCP_12:accum_time_sec = 43200 ;
// global attributes:
:FileOrigins = "File
../out/pcp_combine/sample_fcst_12L_2005080712V_12A.nc generated
20100930_223347 UTC on host rambler by the MET pcp_combine tool" ;
:MET_version = "V3.0" ;
:MET_tool = "pcp_combine" ;
:RunCommand = "Sum: 4 files with accumulations of
030000." ;
:Projection = "Lambert Conformal" ;
:scale_lat_1 = "25.000000" ;
:scale_lat_2 = "25.000000" ;
:lat_pin = "12.190000" ;
:lon_pin = "-133.459000" ;
:x_pin = "0.000000" ;
:y_pin = "0.000000" ;
:lon_orient = "-95.000000" ;
:d_km = "40.635000" ;
:r_km = "6367.470000" ;
:nx = "185" ;
:ny = "129 grid_points" ;
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
RAL HelpDesk {for Weimin Wang} wrote:
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=41229 >
>
> John,
>
> That's great if Grid-Stat can accept NetCDF format. Would you please
> give further details on the definition of NetCDF format required by
> Grid-Stat? Maybe I could take a try to convert my Surfer grid file
to
> NetCDF file.
>
> ---------------------------------------
> Weimin WANG Ph.D
>
>
>
> On Fri, Oct 1, 2010 at 10:51 PM, RAL HelpDesk {for John Halley
Gotway}
> <met_help at ucar.edu> wrote:
>> Weimin,
>>
>> Generally, the availability of your observations will drive the
type of verification you're able to perform. If you have point
observations at stations, we'd suggest using the Point-Stat tool to
>> verify your forecasts against those point observations.
>>
>> However, there are many more verification methods that are
available when verifying against gridded observations than point
observations. If you'd like to go through the process of
interpolating
>> point data onto a grid, you're welcome to. However, there are not
any tools in MET that will help you perform that step. Regarding the
output file format, you're right that writing GRIB files can be
>> rather tedious. Instead of that, you could easily write a NetCDF
file that looks like one of the NetCDF files that the MET tools
create. For example, take a look at the NetCDF output of the
>> PCP-Combine tool. If you make your NetCDF file look similar to
that, the other MET tools will be able to read it. If you decide to
go that route, I could help you with the specifics of what exactly
>> your file will need to contain.
>>
>> Thanks,
>> John Halley Gotway
>> met_help at ucar.edu
>>
>> RAL HelpDesk {for Weimin Wang} wrote:
>>> Fri Oct 01 01:03:00 2010: Request 41229 was acted upon.
>>> Transaction: Ticket created by wmwang at gmail.com
>>> Queue: met_help
>>> Subject: Re: MET version 3.0 release
>>> Owner: Nobody
>>> Requestors: wmwang at gmail.com
>>> Status: new
>>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=41229 >
>>>
>>>
>>> Hello, Thank you for your staff's great work.
>>>
>>> Here, I have a question on the usage of METs.
>>>
>>> To conduct Grid verification, a Grid observation in GRIB format is
>>> needed. My question is how to obtain this GRIB file. Generally,
the
>>> observations with automatic weather stations network can be used
to
>>> generate grid field with spatial interpolation. However, the
>>> conversion from general grid format (e.g. Surfer grid format,
GeoTiff,
>>> etc.) to GRIB is really a labor work. Do you have any suggestion
or
>>> tool for this GRIB file generation? Thanks.
>>>
>>> ---------------------------------------
>>> Weimin WANG Ph.D
>>>
>>>
>>>
>>> On Fri, Oct 1, 2010 at 7:32 AM, Tressa Fowler <tressa at ucar.edu>
wrote:
>>>> The MET development team at the DTC is pleased to announce the
release of
>>>> the MET version 3.0 verification package. It is available for
download from
>>>> the MET Users web page:
>>>>
>>>> http://www.dtcenter.org/met/users/index.php
>>>>
>>>> MET v3.0 incorporates some major new features. The new Ensemble-
Stat tool
>>>> preprocesses sets of forecasts into ensemble forecasts, including
mean,
>>>> spread, and probability. When observations are included, it will
also derive
>>>> ensemble statistics such as rank histogram and continuous ranked
probability
>>>> score. When accumulating statistics over time, users can now
adjust the
>>>> confidence intervals to account for serial correlation. To assist
our WRF
>>>> ARW users, MET v3.0 can read the netCDF output from the pinterp
>>>> postprocessor. Multi-category, e.g. 3x3, contingency tables are
now
>>>> supported, along with appropriate skill scores.
>>>>
>>>> A new tools directory is also included in the software. One tool
will plot
>>>> point observations from the MET preprocessing tools. Users
wishing to
>>>> perform cloud verification using the Air Force Weather Agency’s
World Wide
>>>> Merged Cloud Analysis (WWMCA) product for verification will find
two new
>>>> tools for their use. One creates plots of the WWMCA total cloud
amount,
>>>> while the other will interpolate the WWMCA onto any grid or map
projection,
>>>> allowing WWMCA to be matched to the cloud forecast of interest.
>>>>
>>>> We hope that MET v3.0 enhances your WRF verification efforts.
Please send
>>>> any comments to met_help at ucar.edu .
>>>>
>>>> Thank you,
>>>>
>>>> The MET development team
>>
------------------------------------------------
More information about the Met_help
mailing list