[Met_help] [rt.rap.ucar.edu #51743] History for Seeking information regarding "ascii2nc" for use in converting METAR, MANMAR observations into NetCDF format.
John Halley Gotway via RT
met_help at ucar.edu
Tue Dec 13 09:07:53 MST 2011
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Good afternoon,
Rather than reinvent the wheel, I'm looking for software which can be used to convert METAR, MANMAR observations into NetCDF format.... Does the ASCII2NC software do this?
Best regards,
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #51743] Seeking information regarding "ascii2nc" for use in converting METAR, MANMAR observations into NetCDF format.
From: John Halley Gotway
Time: Tue Nov 29 14:24:25 2011
John,
The answer to your question is no, the ASCII2NC tool does not directly
support METAR, MANMAR observations. The only ASCII format currently
supported is the 10-column format described in the usage
statement and the MET User's Guide. I have not worked with ASCII
METAR data directly - but it may be possible to write a script to
convert it into that 10-column format.
A new tool called MADIS2NC will be available in the next release that
reformats a subset of NetCDF MADIS observation types into a format
that MET can read. Not sure if that'd be of use to you or not.
Hope that helps clarify.
Thanks,
John Halley Gotway
On 11/29/2011 12:09 PM, John Filipkowski via RT wrote:
>
> Tue Nov 29 12:09:21 2011: Request 51743 was acted upon.
> Transaction: Ticket created by jfilipkowski at oceansltd.com
> Queue: met_help
> Subject: Seeking information regarding "ascii2nc" for use in
converting METAR, MANMAR observations into NetCDF format.
> Owner: Nobody
> Requestors: jfilipkowski at oceansltd.com
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=51743 >
>
>
> Good afternoon,
>
> Rather than reinvent the wheel, I'm looking for software which can
be used to convert METAR, MANMAR observations into NetCDF format....
Does the ASCII2NC software do this?
>
> Best regards,
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #51743] Seeking information regarding "ascii2nc" for use in converting METAR, MANMAR observations into NetCDF format.
From: John Filipkowski
Time: Tue Nov 29 14:58:57 2011
Hi,
Thanks for getting back to me on this. As MADIS is a good source of
met
obs, madis2nc looks quite interesting. Is there a way of getting a
beta
copy of this software?
Best regards,
----- Original Message -----
From: "John Halley Gotway via RT" <met_help at ucar.edu>
To: <jfilipkowski at oceansltd.com>
Cc: <jzupan at oceansltd.com>
Sent: Tuesday, November 29, 2011 9:24 PM
Subject: Re: [rt.rap.ucar.edu #51743] Seeking information regarding
"ascii2nc" for use in converting METAR, MANMAR observations into
NetCDF
format.
> John,
>
> The answer to your question is no, the ASCII2NC tool does not
directly
> support METAR, MANMAR observations. The only ASCII format currently
> supported is the 10-column format described in the usage
> statement and the MET User's Guide. I have not worked with ASCII
METAR
> data directly - but it may be possible to write a script to convert
it
> into that 10-column format.
>
> A new tool called MADIS2NC will be available in the next release
that
> reformats a subset of NetCDF MADIS observation types into a format
that
> MET can read. Not sure if that'd be of use to you or not.
>
> Hope that helps clarify.
>
> Thanks,
> John Halley Gotway
>
>
>
> On 11/29/2011 12:09 PM, John Filipkowski via RT wrote:
>>
>> Tue Nov 29 12:09:21 2011: Request 51743 was acted upon.
>> Transaction: Ticket created by jfilipkowski at oceansltd.com
>> Queue: met_help
>> Subject: Seeking information regarding "ascii2nc" for use in
>> converting METAR, MANMAR observations into NetCDF format.
>> Owner: Nobody
>> Requestors: jfilipkowski at oceansltd.com
>> Status: new
>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=51743 >
>>
>>
>> Good afternoon,
>>
>> Rather than reinvent the wheel, I'm looking for software which
can be
>> used to convert METAR, MANMAR observations into NetCDF format....
Does
>> the ASCII2NC software do this?
>>
>> Best regards,
>
------------------------------------------------
Subject: Seeking information regarding "ascii2nc" for use in converting METAR, MANMAR observations into NetCDF format.
From: John Halley Gotway
Time: Thu Dec 01 13:19:12 2011
John,
Sorry for the delay in getting back to you. Sure - we're happy to
provide a beta version for you to try out. There are many different
flavors of MADIS observation types, and the current version of
the madis2nc tool only supports RAOB and METAR type MADIS files.
Those were the ones needed by some of our internal projects which paid
for the development.
Down the road, we plan to add support for the additional MADIS obs
type.
I've attached a tar file to this message. To build the tool, please
do the following:
(1) Place the tar file in the top-level METv3.0.1 directory.
(2) Untar/unzip it:
tar -xvzf METv3.0.1_madis2nc_20110801.tar.gz
(3) In the top-level Makefile, ensure that disable tools is set to 0:
DISABLE_TOOLS = 0
(4) Rebuild MET:
make clean
make
(5) Look for madis2nc in the bin directory:
ls bin/madis2nc
Now would also be a good time to ensure that you have the latest set
of patches:
http://www.dtcenter.org/met/users/support/known_issues/METv3.0.1/index.php
Just execute "madis2nc" with no arguments to see the usage statement.
Hopefully, it's straight-forward, but let us know if questions arise.
Thanks,
John
On 11/29/2011 02:58 PM, John Filipkowski via RT wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=51743 >
>
> Hi,
>
> Thanks for getting back to me on this. As MADIS is a good source
of met
> obs, madis2nc looks quite interesting. Is there a way of getting a
beta
> copy of this software?
>
> Best regards,
>
> ----- Original Message -----
> From: "John Halley Gotway via RT" <met_help at ucar.edu>
> To: <jfilipkowski at oceansltd.com>
> Cc: <jzupan at oceansltd.com>
> Sent: Tuesday, November 29, 2011 9:24 PM
> Subject: Re: [rt.rap.ucar.edu #51743] Seeking information regarding
> "ascii2nc" for use in converting METAR, MANMAR observations into
NetCDF
> format.
>
>
>> John,
>>
>> The answer to your question is no, the ASCII2NC tool does not
directly
>> support METAR, MANMAR observations. The only ASCII format
currently
>> supported is the 10-column format described in the usage
>> statement and the MET User's Guide. I have not worked with ASCII
METAR
>> data directly - but it may be possible to write a script to convert
it
>> into that 10-column format.
>>
>> A new tool called MADIS2NC will be available in the next release
that
>> reformats a subset of NetCDF MADIS observation types into a format
that
>> MET can read. Not sure if that'd be of use to you or not.
>>
>> Hope that helps clarify.
>>
>> Thanks,
>> John Halley Gotway
>>
>>
>>
>> On 11/29/2011 12:09 PM, John Filipkowski via RT wrote:
>>>
>>> Tue Nov 29 12:09:21 2011: Request 51743 was acted upon.
>>> Transaction: Ticket created by jfilipkowski at oceansltd.com
>>> Queue: met_help
>>> Subject: Seeking information regarding "ascii2nc" for use in
>>> converting METAR, MANMAR observations into NetCDF format.
>>> Owner: Nobody
>>> Requestors: jfilipkowski at oceansltd.com
>>> Status: new
>>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=51743 >
>>>
>>>
>>> Good afternoon,
>>>
>>> Rather than reinvent the wheel, I'm looking for software which
can be
>>> used to convert METAR, MANMAR observations into NetCDF format....
Does
>>> the ASCII2NC software do this?
>>>
>>> Best regards,
>>
>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #51743] Seeking information regarding "ascii2nc" for use in converting METAR, MANMAR observations into NetCDF format.
From: John Filipkowski
Time: Fri Dec 02 06:20:56 2011
Thanks! I'll have a look...
Cheers,
----- Original Message -----
From: "John Halley Gotway via RT" <met_help at ucar.edu>
To: <jfilipkowski at oceansltd.com>
Cc: <jzupan at oceansltd.com>
Sent: Thursday, December 01, 2011 8:19 PM
Subject: Re: [rt.rap.ucar.edu #51743] Seeking information regarding
"ascii2nc" for use in converting METAR, MANMAR observations into
NetCDF
format.
> John,
>
> Sorry for the delay in getting back to you. Sure - we're happy to
provide
> a beta version for you to try out. There are many different flavors
of
> MADIS observation types, and the current version of
> the madis2nc tool only supports RAOB and METAR type MADIS files.
Those
> were the ones needed by some of our internal projects which paid for
the
> development.
>
> Down the road, we plan to add support for the additional MADIS obs
type.
>
> I've attached a tar file to this message. To build the tool, please
do
> the following:
> (1) Place the tar file in the top-level METv3.0.1 directory.
> (2) Untar/unzip it:
> tar -xvzf METv3.0.1_madis2nc_20110801.tar.gz
> (3) In the top-level Makefile, ensure that disable tools is set to
0:
> DISABLE_TOOLS = 0
> (4) Rebuild MET:
> make clean
> make
> (5) Look for madis2nc in the bin directory:
> ls bin/madis2nc
>
> Now would also be a good time to ensure that you have the latest set
of
> patches:
>
>
http://www.dtcenter.org/met/users/support/known_issues/METv3.0.1/index.php
>
> Just execute "madis2nc" with no arguments to see the usage
statement.
> Hopefully, it's straight-forward, but let us know if questions
arise.
>
> Thanks,
> John
>
> On 11/29/2011 02:58 PM, John Filipkowski via RT wrote:
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=51743 >
>>
>> Hi,
>>
>> Thanks for getting back to me on this. As MADIS is a good source
of
>> met
>> obs, madis2nc looks quite interesting. Is there a way of getting a
beta
>> copy of this software?
>>
>> Best regards,
>>
>> ----- Original Message -----
>> From: "John Halley Gotway via RT" <met_help at ucar.edu>
>> To: <jfilipkowski at oceansltd.com>
>> Cc: <jzupan at oceansltd.com>
>> Sent: Tuesday, November 29, 2011 9:24 PM
>> Subject: Re: [rt.rap.ucar.edu #51743] Seeking information regarding
>> "ascii2nc" for use in converting METAR, MANMAR observations into
NetCDF
>> format.
>>
>>
>>> John,
>>>
>>> The answer to your question is no, the ASCII2NC tool does not
directly
>>> support METAR, MANMAR observations. The only ASCII format
currently
>>> supported is the 10-column format described in the usage
>>> statement and the MET User's Guide. I have not worked with ASCII
METAR
>>> data directly - but it may be possible to write a script to
convert it
>>> into that 10-column format.
>>>
>>> A new tool called MADIS2NC will be available in the next release
that
>>> reformats a subset of NetCDF MADIS observation types into a format
that
>>> MET can read. Not sure if that'd be of use to you or not.
>>>
>>> Hope that helps clarify.
>>>
>>> Thanks,
>>> John Halley Gotway
>>>
>>>
>>>
>>> On 11/29/2011 12:09 PM, John Filipkowski via RT wrote:
>>>>
>>>> Tue Nov 29 12:09:21 2011: Request 51743 was acted upon.
>>>> Transaction: Ticket created by jfilipkowski at oceansltd.com
>>>> Queue: met_help
>>>> Subject: Seeking information regarding "ascii2nc" for use in
>>>> converting METAR, MANMAR observations into NetCDF format.
>>>> Owner: Nobody
>>>> Requestors: jfilipkowski at oceansltd.com
>>>> Status: new
>>>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=51743 >
>>>>
>>>>
>>>> Good afternoon,
>>>>
>>>> Rather than reinvent the wheel, I'm looking for software which
can be
>>>> used to convert METAR, MANMAR observations into NetCDF format....
Does
>>>> the ASCII2NC software do this?
>>>>
>>>> Best regards,
>>>
>>
>
>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #51743] Seeking information regarding "ascii2nc" for use in converting METAR, MANMAR observations into NetCDF format.... follow-up...
From: John Filipkowski
Time: Sat Dec 03 11:40:58 2011
Hi,
Thanks for your help.
I've downloaded and complied "madis2nc" successfully, and before I
proceed
any further I have one or two questions...
First, I'm trying to do the following:
- Write MANMAR data to NetCDF format (Done, by writing a
perl
script to retrieve selected MANMAR data and call "ascii2nc" to produce
a
NetCDF file.)
- Use "madis2nc" to retrieve RAOB, METAR data from MADIS NetCDF
files.
- Use the NetCDF files created above and WRF output data (either
GRIB1
for NetCDF output files) with "grid_stat", or "point_stat" for model
evaluation.
For the above, for the observations (MANMAR, METAR, RAOB) do I need
to
combine several NetCDF files in to one for "grid_stat", and
"point_stat"?
Do "ascii2nc" or "madis2nc" have this capability?
Best regards,
----- Original Message -----
From: "John Halley Gotway via RT" <met_help at ucar.edu>
To: <jfilipkowski at oceansltd.com>
Cc: <jzupan at oceansltd.com>
Sent: Thursday, December 01, 2011 8:19 PM
Subject: Re: [rt.rap.ucar.edu #51743] Seeking information regarding
"ascii2nc" for use in converting METAR, MANMAR observations into
NetCDF
format.
> John,
>
> Sorry for the delay in getting back to you. Sure - we're happy to
provide
> a beta version for you to try out. There are many different flavors
of
> MADIS observation types, and the current version of
> the madis2nc tool only supports RAOB and METAR type MADIS files.
Those
> were the ones needed by some of our internal projects which paid for
the
> development.
>
> Down the road, we plan to add support for the additional MADIS obs
type.
>
> I've attached a tar file to this message. To build the tool, please
do
> the following:
> (1) Place the tar file in the top-level METv3.0.1 directory.
> (2) Untar/unzip it:
> tar -xvzf METv3.0.1_madis2nc_20110801.tar.gz
> (3) In the top-level Makefile, ensure that disable tools is set to
0:
> DISABLE_TOOLS = 0
> (4) Rebuild MET:
> make clean
> make
> (5) Look for madis2nc in the bin directory:
> ls bin/madis2nc
>
> Now would also be a good time to ensure that you have the latest set
of
> patches:
>
>
http://www.dtcenter.org/met/users/support/known_issues/METv3.0.1/index.php
>
> Just execute "madis2nc" with no arguments to see the usage
statement.
> Hopefully, it's straight-forward, but let us know if questions
arise.
>
> Thanks,
> John
>
> On 11/29/2011 02:58 PM, John Filipkowski via RT wrote:
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=51743 >
>>
>> Hi,
>>
>> Thanks for getting back to me on this. As MADIS is a good source
of
>> met
>> obs, madis2nc looks quite interesting. Is there a way of getting a
beta
>> copy of this software?
>>
>> Best regards,
>>
>> ----- Original Message -----
>> From: "John Halley Gotway via RT" <met_help at ucar.edu>
>> To: <jfilipkowski at oceansltd.com>
>> Cc: <jzupan at oceansltd.com>
>> Sent: Tuesday, November 29, 2011 9:24 PM
>> Subject: Re: [rt.rap.ucar.edu #51743] Seeking information regarding
>> "ascii2nc" for use in converting METAR, MANMAR observations into
NetCDF
>> format.
>>
>>
>>> John,
>>>
>>> The answer to your question is no, the ASCII2NC tool does not
directly
>>> support METAR, MANMAR observations. The only ASCII format
currently
>>> supported is the 10-column format described in the usage
>>> statement and the MET User's Guide. I have not worked with ASCII
METAR
>>> data directly - but it may be possible to write a script to
convert it
>>> into that 10-column format.
>>>
>>> A new tool called MADIS2NC will be available in the next release
that
>>> reformats a subset of NetCDF MADIS observation types into a format
that
>>> MET can read. Not sure if that'd be of use to you or not.
>>>
>>> Hope that helps clarify.
>>>
>>> Thanks,
>>> John Halley Gotway
>>>
>>>
>>>
>>> On 11/29/2011 12:09 PM, John Filipkowski via RT wrote:
>>>>
>>>> Tue Nov 29 12:09:21 2011: Request 51743 was acted upon.
>>>> Transaction: Ticket created by jfilipkowski at oceansltd.com
>>>> Queue: met_help
>>>> Subject: Seeking information regarding "ascii2nc" for use in
>>>> converting METAR, MANMAR observations into NetCDF format.
>>>> Owner: Nobody
>>>> Requestors: jfilipkowski at oceansltd.com
>>>> Status: new
>>>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=51743 >
>>>>
>>>>
>>>> Good afternoon,
>>>>
>>>> Rather than reinvent the wheel, I'm looking for software which
can be
>>>> used to convert METAR, MANMAR observations into NetCDF format....
Does
>>>> the ASCII2NC software do this?
>>>>
>>>> Best regards,
>>>
>>
>
>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #51743] Seeking information regarding "ascii2nc" for use in converting METAR, MANMAR observations into NetCDF format.... follow-up...
From: John Halley Gotway
Time: Mon Dec 05 09:23:34 2011
John,
Those steps sound sensible to me. Regarding the post-processing of
your WRF output, I'd suggest using the Unified PostProcessor (UPP)
which writes it's output in GRIB format. The other option is the
pinterp tool for WRF-ARW data which writes it output in a modified
NetCDF format. While MET is able to read that data, it's support for
GRIB is much better. So I'd suggest running UPP instead of
pinterp.
To answer your question - no you do not need to combine multiple
NetCDF point observation files into a single NetCDF file. When you
run Point-Stat, you are required to pass in a single NetCDF point
observation file, but additional files may be passed in using the "-
point_obs" command line option.
You also asked about doing this for Grid-Stat, but remember, you only
run Grid-Stat when verifying against gridded observations. You only
mention point observations in your email, so you'll only be
using Point-Stat and not Grid-Stat.
Hope that helps.
John
On 12/03/2011 11:40 AM, John Filipkowski via RT wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=51743 >
>
> Hi,
>
> Thanks for your help.
>
> I've downloaded and complied "madis2nc" successfully, and before I
proceed
> any further I have one or two questions...
>
> First, I'm trying to do the following:
>
> - Write MANMAR data to NetCDF format (Done, by writing a
perl
> script to retrieve selected MANMAR data and call "ascii2nc" to
produce a
> NetCDF file.)
>
> - Use "madis2nc" to retrieve RAOB, METAR data from MADIS NetCDF
files.
>
> - Use the NetCDF files created above and WRF output data (either
GRIB1
> for NetCDF output files) with "grid_stat", or "point_stat" for
model
> evaluation.
>
> For the above, for the observations (MANMAR, METAR, RAOB) do I need
to
> combine several NetCDF files in to one for "grid_stat", and
"point_stat"?
> Do "ascii2nc" or "madis2nc" have this capability?
>
> Best regards,
>
> ----- Original Message -----
> From: "John Halley Gotway via RT" <met_help at ucar.edu>
> To: <jfilipkowski at oceansltd.com>
> Cc: <jzupan at oceansltd.com>
> Sent: Thursday, December 01, 2011 8:19 PM
> Subject: Re: [rt.rap.ucar.edu #51743] Seeking information regarding
> "ascii2nc" for use in converting METAR, MANMAR observations into
NetCDF
> format.
>
>
>> John,
>>
>> Sorry for the delay in getting back to you. Sure - we're happy to
provide
>> a beta version for you to try out. There are many different
flavors of
>> MADIS observation types, and the current version of
>> the madis2nc tool only supports RAOB and METAR type MADIS files.
Those
>> were the ones needed by some of our internal projects which paid
for the
>> development.
>>
>> Down the road, we plan to add support for the additional MADIS obs
type.
>>
>> I've attached a tar file to this message. To build the tool,
please do
>> the following:
>> (1) Place the tar file in the top-level METv3.0.1 directory.
>> (2) Untar/unzip it:
>> tar -xvzf METv3.0.1_madis2nc_20110801.tar.gz
>> (3) In the top-level Makefile, ensure that disable tools is set to
0:
>> DISABLE_TOOLS = 0
>> (4) Rebuild MET:
>> make clean
>> make
>> (5) Look for madis2nc in the bin directory:
>> ls bin/madis2nc
>>
>> Now would also be a good time to ensure that you have the latest
set of
>> patches:
>>
>>
http://www.dtcenter.org/met/users/support/known_issues/METv3.0.1/index.php
>>
>> Just execute "madis2nc" with no arguments to see the usage
statement.
>> Hopefully, it's straight-forward, but let us know if questions
arise.
>>
>> Thanks,
>> John
>>
>> On 11/29/2011 02:58 PM, John Filipkowski via RT wrote:
>>>
>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=51743 >
>>>
>>> Hi,
>>>
>>> Thanks for getting back to me on this. As MADIS is a good
source of
>>> met
>>> obs, madis2nc looks quite interesting. Is there a way of getting
a beta
>>> copy of this software?
>>>
>>> Best regards,
>>>
>>> ----- Original Message -----
>>> From: "John Halley Gotway via RT" <met_help at ucar.edu>
>>> To: <jfilipkowski at oceansltd.com>
>>> Cc: <jzupan at oceansltd.com>
>>> Sent: Tuesday, November 29, 2011 9:24 PM
>>> Subject: Re: [rt.rap.ucar.edu #51743] Seeking information
regarding
>>> "ascii2nc" for use in converting METAR, MANMAR observations into
NetCDF
>>> format.
>>>
>>>
>>>> John,
>>>>
>>>> The answer to your question is no, the ASCII2NC tool does not
directly
>>>> support METAR, MANMAR observations. The only ASCII format
currently
>>>> supported is the 10-column format described in the usage
>>>> statement and the MET User's Guide. I have not worked with ASCII
METAR
>>>> data directly - but it may be possible to write a script to
convert it
>>>> into that 10-column format.
>>>>
>>>> A new tool called MADIS2NC will be available in the next release
that
>>>> reformats a subset of NetCDF MADIS observation types into a
format that
>>>> MET can read. Not sure if that'd be of use to you or not.
>>>>
>>>> Hope that helps clarify.
>>>>
>>>> Thanks,
>>>> John Halley Gotway
>>>>
>>>>
>>>>
>>>> On 11/29/2011 12:09 PM, John Filipkowski via RT wrote:
>>>>>
>>>>> Tue Nov 29 12:09:21 2011: Request 51743 was acted upon.
>>>>> Transaction: Ticket created by jfilipkowski at oceansltd.com
>>>>> Queue: met_help
>>>>> Subject: Seeking information regarding "ascii2nc" for use
in
>>>>> converting METAR, MANMAR observations into NetCDF format.
>>>>> Owner: Nobody
>>>>> Requestors: jfilipkowski at oceansltd.com
>>>>> Status: new
>>>>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=51743 >
>>>>>
>>>>>
>>>>> Good afternoon,
>>>>>
>>>>> Rather than reinvent the wheel, I'm looking for software which
can be
>>>>> used to convert METAR, MANMAR observations into NetCDF
format.... Does
>>>>> the ASCII2NC software do this?
>>>>>
>>>>> Best regards,
>>>>
>>>
>>
>>
>
------------------------------------------------
More information about the Met_help
mailing list