[Met_help] [rt.rap.ucar.edu #52096] History for Errors using "point_stat" with MADIS data.... [see also rt.rap.ucar.edu #51743]
John Halley Gotway via RT
met_help at ucar.edu
Mon Dec 19 13:41:59 MST 2011
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Good afternoon,
First, thank you for your help with my previous query (see subject line).
Now, I have a question re "point_stat".
Some background. I am attempting to use MET v3.0.1 to verify WRF forecast
10m winds.
Forecast model data: WRF.grib (GRIB 1 output, produced by the
WRFPOSTPROC software converting the WRF NetCDF output).
Observation files: MADIS metar, raob NetCDF files (NOTE: These
files are *NOT* converted using madis2nc. These files are exactly as found
on the MADIS FTP site)
Metar: 2011 12 12 00 "metar00.nc"
2011 12 12 01 "metar01.nc"
Raob: 2011 12 12 00 "raob00.nc"
2011 12 12 01 "raob01.nc"
Point_Stat Config file: See attached (modelled on the default
point_stat config file supplied in the MET v3.0.1 software distribution)
Other: As a test of using "point_stat", the forecast being, end times are
as follows:
Forecast Begin: 2011 12 12 00 (00Z,
Dec. 12, 2011)
Forecast End: 2011 12 12 01 (01Z,
Dec. 12, 2011)
Output of running "point_stat":
.../bin/point_stat ./WRF.grib metar00.nc ./WRF_PBL_TEST -point_obs
metar01.nc -point_obs raob00.nc -point_obs raob01.nc -obs_valid_beg
20111212_00 -obs_valid_end 20111212_01
GSL_RNG_TYPE=mt19937
GSL_RNG_SEED=75754318
Forecast File: ./WRF.grib
Climatology File: none
Configuration File: ./WRF_PBL_TEST
Observation File: metar00.nc
Observation File: metar01.nc
Observation File: raob00.nc
Observation File: raob01.nc
--------------------------------------------------------------------------------
Reading records for WIND/Z10.
For WIND/Z10 found 1 forecast levels and 0 climatology levels.
--------------------------------------------------------------------------------
NetCDF: Invalid dimension ID or name
As a newcomer to using MET, I'm not sure how to debug the error above. (I
have completed the on-line MET tutorial...)
To help, I have also attached the output of
ncdump -h metar00.nc (See file METAR_NetCDF_File)
Can someone give me some advice how best to configure and use "point_stat"?
Best regards,
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #52096] Errors using "point_stat" with MADIS data.... [see also rt.rap.ucar.edu #51743]
From: John Halley Gotway
Time: Fri Dec 16 12:01:28 2011
John,
I'd say the answer lies in the question you posed :) In order for
Point-Stat to read the MADIS observations, you'll first need to
convert them using the madis2nc tool. However, I do agree that the
error message you're getting from Point-Stat is completely useless.
Actually, that's an error from a NetCDF library function we're
calling. We've learned that we need to do a better job of wrapping
calls to NetCDF library functions since they tend to error out with
very unhelpful messages.
The madis2nc tool has not yet been officially released. It'll be
included in the next release. But if you'd like to download a beta
version of it and run it with METv3.0.1, I'd be happy to send that
to you. If so, you can retrieve it from here:
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/METv3.0.1_madis2nc_20110801.tar.gz
(1) Put that tar file in the top-level METv3.0.1 directory and untar
it.
(2) In the top-level Makefile, be sure that "DISABLE_TOOLS =
0".
(3) Rebuild MET and look for bin/madis2nc.
Then just run madis2nc with no arguments to see the usage statement.
Currently, only RAOB and METAR observation types are supported.
Give that a shot and please let us know how it goes.
Also, if you haven't recently retrieved the latest set of patches,
that's always a good idea:
http://www.dtcenter.org/met/users/support/known_issues/METv3.0.1/index.php
Thanks,
John Halley Gotway
On 12/16/2011 11:33 AM, John Filipkowski via RT wrote:
>
> Fri Dec 16 11:33:34 2011: Request 52096 was acted upon.
> Transaction: Ticket created by jfilipkowski at oceansltd.com
> Queue: met_help
> Subject: Errors using "point_stat" with MADIS data.... [see
also rt.rap.ucar.edu #51743]
> Owner: Nobody
> Requestors: jfilipkowski at oceansltd.com
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=52096 >
>
>
> Good afternoon,
>
> First, thank you for your help with my previous query (see subject
line).
>
> Now, I have a question re "point_stat".
>
> Some background. I am attempting to use MET v3.0.1 to verify WRF
forecast
> 10m winds.
>
> Forecast model data: WRF.grib (GRIB 1 output, produced by the
> WRFPOSTPROC software converting the WRF NetCDF output).
>
> Observation files: MADIS metar, raob NetCDF files (NOTE:
These
> files are *NOT* converted using madis2nc. These files are exactly as
found
> on the MADIS FTP site)
> Metar: 2011 12 12 00 "metar00.nc"
> 2011 12 12 01
"metar01.nc"
> Raob: 2011 12 12 00 "raob00.nc"
> 2011 12 12 01
"raob01.nc"
>
> Point_Stat Config file: See attached (modelled on the default
> point_stat config file supplied in the MET v3.0.1 software
distribution)
>
> Other: As a test of using "point_stat", the forecast being, end
times are
> as follows:
> Forecast Begin: 2011 12 12 00
(00Z,
> Dec. 12, 2011)
> Forecast End: 2011 12 12 01
(01Z,
> Dec. 12, 2011)
>
> Output of running "point_stat":
>
> .../bin/point_stat ./WRF.grib metar00.nc ./WRF_PBL_TEST
-point_obs
> metar01.nc -point_obs raob00.nc -point_obs raob01.nc -obs_valid_beg
> 20111212_00 -obs_valid_end 20111212_01
> GSL_RNG_TYPE=mt19937
> GSL_RNG_SEED=75754318
> Forecast File: ./WRF.grib
> Climatology File: none
> Configuration File: ./WRF_PBL_TEST
> Observation File: metar00.nc
> Observation File: metar01.nc
> Observation File: raob00.nc
> Observation File: raob01.nc
>
>
--------------------------------------------------------------------------------
>
> Reading records for WIND/Z10.
> For WIND/Z10 found 1 forecast levels and 0 climatology levels.
>
>
--------------------------------------------------------------------------------
>
> NetCDF: Invalid dimension ID or name
>
>
>
> As a newcomer to using MET, I'm not sure how to debug the error
above. (I
> have completed the on-line MET tutorial...)
>
> To help, I have also attached the output of
>
> ncdump -h metar00.nc (See file
METAR_NetCDF_File)
>
> Can someone give me some advice how best to configure and use
"point_stat"?
>
> Best regards,
>
>
>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #52096] Errors using "point_stat" with MADIS data.... [see also rt.rap.ucar.edu #51743]
From: John Filipkowski
Time: Sat Dec 17 15:07:22 2011
Hi,
Thanks! I'm getting point_stat to work properly now...
...As perhaps a favour, can you point me to some relevant books on
statistic for meteorology? I'm a bit rusty with this, and it's a bit
of a
steep learning curve to interpret the output from "point_stat" and
"met_stat"
Cheers,
----- Original Message -----
From: "John Halley Gotway via RT" <met_help at ucar.edu>
To: <jfilipkowski at oceansltd.com>
Cc: <jzupan at oceansltd.com>
Sent: Friday, December 16, 2011 7:01 PM
Subject: Re: [rt.rap.ucar.edu #52096] Errors using "point_stat" with
MADIS
data.... [see also rt.rap.ucar.edu #51743]
> John,
>
> I'd say the answer lies in the question you posed :) In order for
> Point-Stat to read the MADIS observations, you'll first need to
convert
> them using the madis2nc tool. However, I do agree that the
> error message you're getting from Point-Stat is completely useless.
> Actually, that's an error from a NetCDF library function we're
calling.
> We've learned that we need to do a better job of wrapping
> calls to NetCDF library functions since they tend to error out with
very
> unhelpful messages.
>
> The madis2nc tool has not yet been officially released. It'll be
included
> in the next release. But if you'd like to download a beta version
of it
> and run it with METv3.0.1, I'd be happy to send that
> to you. If so, you can retrieve it from here:
>
>
>
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/METv3.0.1_madis2nc_20110801.tar.gz
>
> (1) Put that tar file in the top-level METv3.0.1 directory and untar
it.
> (2) In the top-level Makefile, be sure that "DISABLE_TOOLS =
0".
> (3) Rebuild MET and look for bin/madis2nc.
>
> Then just run madis2nc with no arguments to see the usage statement.
> Currently, only RAOB and METAR observation types are supported.
>
> Give that a shot and please let us know how it goes.
>
> Also, if you haven't recently retrieved the latest set of patches,
that's
> always a good idea:
>
>
http://www.dtcenter.org/met/users/support/known_issues/METv3.0.1/index.php
>
> Thanks,
> John Halley Gotway
>
> On 12/16/2011 11:33 AM, John Filipkowski via RT wrote:
>>
>> Fri Dec 16 11:33:34 2011: Request 52096 was acted upon.
>> Transaction: Ticket created by jfilipkowski at oceansltd.com
>> Queue: met_help
>> Subject: Errors using "point_stat" with MADIS data.... [see
also
>> rt.rap.ucar.edu #51743]
>> Owner: Nobody
>> Requestors: jfilipkowski at oceansltd.com
>> Status: new
>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=52096 >
>>
>>
>> Good afternoon,
>>
>> First, thank you for your help with my previous query (see subject
>> line).
>>
>> Now, I have a question re "point_stat".
>>
>> Some background. I am attempting to use MET v3.0.1 to verify WRF
>> forecast
>> 10m winds.
>>
>> Forecast model data: WRF.grib (GRIB 1 output, produced by
the
>> WRFPOSTPROC software converting the WRF NetCDF output).
>>
>> Observation files: MADIS metar, raob NetCDF files (NOTE:
These
>> files are *NOT* converted using madis2nc. These files are exactly
as
>> found
>> on the MADIS FTP site)
>> Metar: 2011 12 12 00 "metar00.nc"
>> 2011 12 12 01
"metar01.nc"
>> Raob: 2011 12 12 00 "raob00.nc"
>> 2011 12 12 01
"raob01.nc"
>>
>> Point_Stat Config file: See attached (modelled on the
default
>> point_stat config file supplied in the MET v3.0.1 software
distribution)
>>
>> Other: As a test of using "point_stat", the forecast being, end
times
>> are
>> as follows:
>> Forecast Begin: 2011 12 12 00
(00Z,
>> Dec. 12, 2011)
>> Forecast End: 2011 12 12 01
>> (01Z,
>> Dec. 12, 2011)
>>
>> Output of running "point_stat":
>>
>> .../bin/point_stat ./WRF.grib metar00.nc ./WRF_PBL_TEST
-point_obs
>> metar01.nc -point_obs raob00.nc -point_obs raob01.nc
-obs_valid_beg
>> 20111212_00 -obs_valid_end 20111212_01
>> GSL_RNG_TYPE=mt19937
>> GSL_RNG_SEED=75754318
>> Forecast File: ./WRF.grib
>> Climatology File: none
>> Configuration File: ./WRF_PBL_TEST
>> Observation File: metar00.nc
>> Observation File: metar01.nc
>> Observation File: raob00.nc
>> Observation File: raob01.nc
>>
>>
--------------------------------------------------------------------------------
>>
>> Reading records for WIND/Z10.
>> For WIND/Z10 found 1 forecast levels and 0 climatology levels.
>>
>>
--------------------------------------------------------------------------------
>>
>> NetCDF: Invalid dimension ID or name
>>
>>
>>
>> As a newcomer to using MET, I'm not sure how to debug the error
above.
>> (I
>> have completed the on-line MET tutorial...)
>>
>> To help, I have also attached the output of
>>
>> ncdump -h metar00.nc (See file
METAR_NetCDF_File)
>>
>> Can someone give me some advice how best to configure and use
>> "point_stat"?
>>
>> Best regards,
>>
>>
>>
>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #52096] Errors using "point_stat" with MADIS data.... [see also rt.rap.ucar.edu #51743]
From: John Halley Gotway
Time: Mon Dec 19 13:41:25 2011
John,
Yes, good point. Often the easy part is getting statistics out of the
software, while the difficult part is making sense of them. And it's
always best to look at more than one statistic to get the
whole story. There are a few references listed on our website here:
http://www.dtcenter.org/met/users/links.php
I have a copy of the second one listed (Wilks) in my office to which I
typically refer.
You may find the MET online tutorial to be helpful:
http://www.dtcenter.org/met/users/support/online_tutorial/METv3.0/index.php
And you may find the slides from our most recent tutorial to be
helpful. In particular, the first talk on "Introduction to
Verification" may be of use.
http://www.dtcenter.org/met/users/docs/presentations/MET_Tutorial_20110627/index.php
If you have specific questions about interpreting the statistical
output from MET, you can write us at MET-Help. We'll just assign that
ticket to the statistician on our team. If more questions
arise, please send a new email message rather than just responding to
this one so that we can handle it as a new ticket.
Hope that helps.
Thanks,
John
On 12/17/2011 03:07 PM, John Filipkowski via RT wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=52096 >
>
> Hi,
>
> Thanks! I'm getting point_stat to work properly now...
>
> ...As perhaps a favour, can you point me to some relevant books
on
> statistic for meteorology? I'm a bit rusty with this, and it's a bit
of a
> steep learning curve to interpret the output from "point_stat" and
> "met_stat"
>
> Cheers,
> ----- Original Message -----
> From: "John Halley Gotway via RT" <met_help at ucar.edu>
> To: <jfilipkowski at oceansltd.com>
> Cc: <jzupan at oceansltd.com>
> Sent: Friday, December 16, 2011 7:01 PM
> Subject: Re: [rt.rap.ucar.edu #52096] Errors using "point_stat" with
MADIS
> data.... [see also rt.rap.ucar.edu #51743]
>
>
>> John,
>>
>> I'd say the answer lies in the question you posed :) In order for
>> Point-Stat to read the MADIS observations, you'll first need to
convert
>> them using the madis2nc tool. However, I do agree that the
>> error message you're getting from Point-Stat is completely useless.
>> Actually, that's an error from a NetCDF library function we're
calling.
>> We've learned that we need to do a better job of wrapping
>> calls to NetCDF library functions since they tend to error out with
very
>> unhelpful messages.
>>
>> The madis2nc tool has not yet been officially released. It'll be
included
>> in the next release. But if you'd like to download a beta version
of it
>> and run it with METv3.0.1, I'd be happy to send that
>> to you. If so, you can retrieve it from here:
>>
>>
>>
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/METv3.0.1_madis2nc_20110801.tar.gz
>>
>> (1) Put that tar file in the top-level METv3.0.1 directory and
untar it.
>> (2) In the top-level Makefile, be sure that "DISABLE_TOOLS
= 0".
>> (3) Rebuild MET and look for bin/madis2nc.
>>
>> Then just run madis2nc with no arguments to see the usage
statement.
>> Currently, only RAOB and METAR observation types are supported.
>>
>> Give that a shot and please let us know how it goes.
>>
>> Also, if you haven't recently retrieved the latest set of patches,
that's
>> always a good idea:
>>
>>
http://www.dtcenter.org/met/users/support/known_issues/METv3.0.1/index.php
>>
>> Thanks,
>> John Halley Gotway
>>
>> On 12/16/2011 11:33 AM, John Filipkowski via RT wrote:
>>>
>>> Fri Dec 16 11:33:34 2011: Request 52096 was acted upon.
>>> Transaction: Ticket created by jfilipkowski at oceansltd.com
>>> Queue: met_help
>>> Subject: Errors using "point_stat" with MADIS data.... [see
also
>>> rt.rap.ucar.edu #51743]
>>> Owner: Nobody
>>> Requestors: jfilipkowski at oceansltd.com
>>> Status: new
>>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=52096 >
>>>
>>>
>>> Good afternoon,
>>>
>>> First, thank you for your help with my previous query (see
subject
>>> line).
>>>
>>> Now, I have a question re "point_stat".
>>>
>>> Some background. I am attempting to use MET v3.0.1 to verify WRF
>>> forecast
>>> 10m winds.
>>>
>>> Forecast model data: WRF.grib (GRIB 1 output, produced by
the
>>> WRFPOSTPROC software converting the WRF NetCDF output).
>>>
>>> Observation files: MADIS metar, raob NetCDF files
(NOTE: These
>>> files are *NOT* converted using madis2nc. These files are exactly
as
>>> found
>>> on the MADIS FTP site)
>>> Metar: 2011 12 12 00 "metar00.nc"
>>> 2011 12 12 01
"metar01.nc"
>>> Raob: 2011 12 12 00 "raob00.nc"
>>> 2011 12 12 01
"raob01.nc"
>>>
>>> Point_Stat Config file: See attached (modelled on the
default
>>> point_stat config file supplied in the MET v3.0.1 software
distribution)
>>>
>>> Other: As a test of using "point_stat", the forecast being, end
times
>>> are
>>> as follows:
>>> Forecast Begin: 2011 12 12 00
(00Z,
>>> Dec. 12, 2011)
>>> Forecast End: 2011 12 12 01
>>> (01Z,
>>> Dec. 12, 2011)
>>>
>>> Output of running "point_stat":
>>>
>>> .../bin/point_stat ./WRF.grib metar00.nc ./WRF_PBL_TEST
-point_obs
>>> metar01.nc -point_obs raob00.nc -point_obs raob01.nc
-obs_valid_beg
>>> 20111212_00 -obs_valid_end 20111212_01
>>> GSL_RNG_TYPE=mt19937
>>> GSL_RNG_SEED=75754318
>>> Forecast File: ./WRF.grib
>>> Climatology File: none
>>> Configuration File: ./WRF_PBL_TEST
>>> Observation File: metar00.nc
>>> Observation File: metar01.nc
>>> Observation File: raob00.nc
>>> Observation File: raob01.nc
>>>
>>>
--------------------------------------------------------------------------------
>>>
>>> Reading records for WIND/Z10.
>>> For WIND/Z10 found 1 forecast levels and 0 climatology levels.
>>>
>>>
--------------------------------------------------------------------------------
>>>
>>> NetCDF: Invalid dimension ID or name
>>>
>>>
>>>
>>> As a newcomer to using MET, I'm not sure how to debug the error
above.
>>> (I
>>> have completed the on-line MET tutorial...)
>>>
>>> To help, I have also attached the output of
>>>
>>> ncdump -h metar00.nc (See file
METAR_NetCDF_File)
>>>
>>> Can someone give me some advice how best to configure and use
>>> "point_stat"?
>>>
>>> Best regards,
>>>
>>>
>>>
>>
>
------------------------------------------------
More information about the Met_help
mailing list