[Met_help] [rt.rap.ucar.edu #46055] History for metar from MADIS
RAL HelpDesk {for John Halley Gotway}
met_help at ucar.edu
Tue Apr 19 08:47:51 MDT 2011
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Hi,
I'm trying to convert some metar obs from MADIS from netcdf format into the
ascii format required for input into the ascii2nc tool in MET.
I came across the following link:
http://mailman.ucar.edu/pipermail/met_help/2010-March/001159.html
I wonder, rather than trying to reinvent the wheel, if any progress was made
on the madis2nc / awips2nc tools mentioned has been made? I am assuming that
several MET users out there are using MADIS? Other than the email list, is
there a forum which connects MET users?
Thanks,
Jason
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #46055] metar from MADIS
From: John Halley Gotway
Time: Thu Apr 14 09:45:59 2011
Jason,
I found a version of the madis2nc code that was written for
compatibility with METv2.0. I'll take a look and see if it needs to
be updated at all for use with METv3.0. Could you please send me one
of the MADIS NetCDF files you're trying to use? I'll use that for
testing to make sure it works OK, and will hopefully be able to send
you some code to try out.
Thanks,
John Halley Gotway
met_help at ucar.edu
On 04/11/2011 07:51 PM, RAL HelpDesk {for jason marsh} wrote:
>
> Mon Apr 11 19:51:05 2011: Request 46055 was acted upon.
> Transaction: Ticket created by marshj77 at gmail.com
> Queue: met_help
> Subject: metar from MADIS
> Owner: Nobody
> Requestors: marshj77 at gmail.com
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46055 >
>
>
> Hi,
> I'm trying to convert some metar obs from MADIS from netcdf format
into the
> ascii format required for input into the ascii2nc tool in MET.
> I came across the following link:
> http://mailman.ucar.edu/pipermail/met_help/2010-March/001159.html
>
> I wonder, rather than trying to reinvent the wheel, if any progress
was made
> on the madis2nc / awips2nc tools mentioned has been made? I am
assuming that
> several MET users out there are using MADIS? Other than the email
list, is
> there a forum which connects MET users?
>
> Thanks,
> Jason
------------------------------------------------
Subject: metar from MADIS
From: jason marsh
Time: Thu Apr 14 19:21:40 2011
John,
The metar netcdf files are ~12Mb - do you want it emailed, or is ftp
better?
Thanks,
Jason
On Thu, Apr 14, 2011 at 5:45 AM, RAL HelpDesk {for John Halley Gotway}
<
met_help at ucar.edu> wrote:
> Jason,
>
> I found a version of the madis2nc code that was written for
compatibility
> with METv2.0. I'll take a look and see if it needs to be updated at
all for
> use with METv3.0. Could you please send me one
> of the MADIS NetCDF files you're trying to use? I'll use that for
testing
> to make sure it works OK, and will hopefully be able to send you
some code
> to try out.
>
> Thanks,
> John Halley Gotway
> met_help at ucar.edu
>
> On 04/11/2011 07:51 PM, RAL HelpDesk {for jason marsh} wrote:
> >
> > Mon Apr 11 19:51:05 2011: Request 46055 was acted upon.
> > Transaction: Ticket created by marshj77 at gmail.com
> > Queue: met_help
> > Subject: metar from MADIS
> > Owner: Nobody
> > Requestors: marshj77 at gmail.com
> > Status: new
> > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46055 >
> >
> >
> > Hi,
> > I'm trying to convert some metar obs from MADIS from netcdf format
into
> the
> > ascii format required for input into the ascii2nc tool in MET.
> > I came across the following link:
> > http://mailman.ucar.edu/pipermail/met_help/2010-March/001159.html
> >
> > I wonder, rather than trying to reinvent the wheel, if any
progress was
> made
> > on the madis2nc / awips2nc tools mentioned has been made? I am
assuming
> that
> > several MET users out there are using MADIS? Other than the email
list,
> is
> > there a forum which connects MET users?
> >
> > Thanks,
> > Jason
>
>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #46055] metar from MADIS
From: John Halley Gotway
Time: Thu Apr 14 22:32:42 2011
Jason,
Just posting it to our ftp site would be good. You can follow the
directions here:
http://www.dtcenter.org/met/users/support/met_help.php#ftp
And please write to let me know when it's there.
Thanks,
John
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46055 >
>
> John,
> The metar netcdf files are ~12Mb - do you want it emailed, or is ftp
> better?
> Thanks,
> Jason
>
> On Thu, Apr 14, 2011 at 5:45 AM, RAL HelpDesk {for John Halley
Gotway} <
> met_help at ucar.edu> wrote:
>
>> Jason,
>>
>> I found a version of the madis2nc code that was written for
>> compatibility
>> with METv2.0. I'll take a look and see if it needs to be updated
at all
>> for
>> use with METv3.0. Could you please send me one
>> of the MADIS NetCDF files you're trying to use? I'll use that for
>> testing
>> to make sure it works OK, and will hopefully be able to send you
some
>> code
>> to try out.
>>
>> Thanks,
>> John Halley Gotway
>> met_help at ucar.edu
>>
>> On 04/11/2011 07:51 PM, RAL HelpDesk {for jason marsh} wrote:
>> >
>> > Mon Apr 11 19:51:05 2011: Request 46055 was acted upon.
>> > Transaction: Ticket created by marshj77 at gmail.com
>> > Queue: met_help
>> > Subject: metar from MADIS
>> > Owner: Nobody
>> > Requestors: marshj77 at gmail.com
>> > Status: new
>> > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46055
>> >
>> >
>> >
>> > Hi,
>> > I'm trying to convert some metar obs from MADIS from netcdf
format
>> into
>> the
>> > ascii format required for input into the ascii2nc tool in MET.
>> > I came across the following link:
>> > http://mailman.ucar.edu/pipermail/met_help/2010-March/001159.html
>> >
>> > I wonder, rather than trying to reinvent the wheel, if any
progress
>> was
>> made
>> > on the madis2nc / awips2nc tools mentioned has been made? I am
>> assuming
>> that
>> > several MET users out there are using MADIS? Other than the email
>> list,
>> is
>> > there a forum which connects MET users?
>> >
>> > Thanks,
>> > Jason
>>
>>
>
------------------------------------------------
Subject: metar from MADIS
From: jason marsh
Time: Fri Apr 15 18:35:14 2011
John,
I've uploaded the file under
*incoming/irap/met_help/marsh*
Thanks,
Jason
On Thu, Apr 14, 2011 at 6:32 PM, RAL HelpDesk {for John Halley Gotway}
<
met_help at ucar.edu> wrote:
> Jason,
>
> Just posting it to our ftp site would be good. You can follow the
> directions here:
> http://www.dtcenter.org/met/users/support/met_help.php#ftp
>
> And please write to let me know when it's there.
>
> Thanks,
> John
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46055 >
> >
> > John,
> > The metar netcdf files are ~12Mb - do you want it emailed, or is
ftp
> > better?
> > Thanks,
> > Jason
> >
> > On Thu, Apr 14, 2011 at 5:45 AM, RAL HelpDesk {for John Halley
Gotway} <
> > met_help at ucar.edu> wrote:
> >
> >> Jason,
> >>
> >> I found a version of the madis2nc code that was written for
> >> compatibility
> >> with METv2.0. I'll take a look and see if it needs to be updated
at all
> >> for
> >> use with METv3.0. Could you please send me one
> >> of the MADIS NetCDF files you're trying to use? I'll use that
for
> >> testing
> >> to make sure it works OK, and will hopefully be able to send you
some
> >> code
> >> to try out.
> >>
> >> Thanks,
> >> John Halley Gotway
> >> met_help at ucar.edu
> >>
> >> On 04/11/2011 07:51 PM, RAL HelpDesk {for jason marsh} wrote:
> >> >
> >> > Mon Apr 11 19:51:05 2011: Request 46055 was acted upon.
> >> > Transaction: Ticket created by marshj77 at gmail.com
> >> > Queue: met_help
> >> > Subject: metar from MADIS
> >> > Owner: Nobody
> >> > Requestors: marshj77 at gmail.com
> >> > Status: new
> >> > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46055
> >> >
> >> >
> >> >
> >> > Hi,
> >> > I'm trying to convert some metar obs from MADIS from netcdf
format
> >> into
> >> the
> >> > ascii format required for input into the ascii2nc tool in MET.
> >> > I came across the following link:
> >> > http://mailman.ucar.edu/pipermail/met_help/2010-
March/001159.html
> >> >
> >> > I wonder, rather than trying to reinvent the wheel, if any
progress
> >> was
> >> made
> >> > on the madis2nc / awips2nc tools mentioned has been made? I am
> >> assuming
> >> that
> >> > several MET users out there are using MADIS? Other than the
email
> >> list,
> >> is
> >> > there a forum which connects MET users?
> >> >
> >> > Thanks,
> >> > Jason
> >>
> >>
> >
>
>
>
>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #46055] metar from MADIS
From: John Halley Gotway
Time: Mon Apr 18 12:15:34 2011
Jason,
I'm trying to run the data you sent through the version of madis2nc I
received from the other user. However, the code is erroring out when
processing the times in the input NetCDF file.
Specifically, the times stored in the "timeObs" variable. Try running
the following commands (ncdump doesn't like file names beginning with
a number):
cp 20110413_0000 madis_20110413_0000.nc
ncdump -v timeObs madis_20110413_0000.nc
The units for the timeObs variable are supposed to be seconds since
1/1/1970 - a.k.a. unixtime. But the values listed in there do not
look like unixtimes. I don't know how familiar you are with
unixtime, but the following command tells you the current unixtime:
date +%s
Here's info on the timeObs variable from the NetCDF header:
double timeObs(recNum) ;
timeObs:long_name = "time of observation" ;
timeObs:units = "seconds since 1970-1-1 00:00:00.0" ;
timeObs:_FillValue = 1.79769313486232e+308 ;
timeObs:standard_name = "time" ;
:timeVariables = "timeObs" ;
Any idea what's going on here?
Thanks,
John
On 04/15/2011 06:35 PM, RAL HelpDesk {for jason marsh} wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46055 >
>
> John,
> I've uploaded the file under
>
> *incoming/irap/met_help/marsh*
>
> Thanks,
> Jason
>
>
> On Thu, Apr 14, 2011 at 6:32 PM, RAL HelpDesk {for John Halley
Gotway} <
> met_help at ucar.edu> wrote:
>
>> Jason,
>>
>> Just posting it to our ftp site would be good. You can follow the
>> directions here:
>> http://www.dtcenter.org/met/users/support/met_help.php#ftp
>>
>> And please write to let me know when it's there.
>>
>> Thanks,
>> John
>>>
>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46055 >
>>>
>>> John,
>>> The metar netcdf files are ~12Mb - do you want it emailed, or is
ftp
>>> better?
>>> Thanks,
>>> Jason
>>>
>>> On Thu, Apr 14, 2011 at 5:45 AM, RAL HelpDesk {for John Halley
Gotway} <
>>> met_help at ucar.edu> wrote:
>>>
>>>> Jason,
>>>>
>>>> I found a version of the madis2nc code that was written for
>>>> compatibility
>>>> with METv2.0. I'll take a look and see if it needs to be updated
at all
>>>> for
>>>> use with METv3.0. Could you please send me one
>>>> of the MADIS NetCDF files you're trying to use? I'll use that
for
>>>> testing
>>>> to make sure it works OK, and will hopefully be able to send you
some
>>>> code
>>>> to try out.
>>>>
>>>> Thanks,
>>>> John Halley Gotway
>>>> met_help at ucar.edu
>>>>
>>>> On 04/11/2011 07:51 PM, RAL HelpDesk {for jason marsh} wrote:
>>>>>
>>>>> Mon Apr 11 19:51:05 2011: Request 46055 was acted upon.
>>>>> Transaction: Ticket created by marshj77 at gmail.com
>>>>> Queue: met_help
>>>>> Subject: metar from MADIS
>>>>> Owner: Nobody
>>>>> Requestors: marshj77 at gmail.com
>>>>> Status: new
>>>>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46055
>>>>>
>>>>>
>>>>>
>>>>> Hi,
>>>>> I'm trying to convert some metar obs from MADIS from netcdf
format
>>>> into
>>>> the
>>>>> ascii format required for input into the ascii2nc tool in MET.
>>>>> I came across the following link:
>>>>> http://mailman.ucar.edu/pipermail/met_help/2010-
March/001159.html
>>>>>
>>>>> I wonder, rather than trying to reinvent the wheel, if any
progress
>>>> was
>>>> made
>>>>> on the madis2nc / awips2nc tools mentioned has been made? I am
>>>> assuming
>>>> that
>>>>> several MET users out there are using MADIS? Other than the
email
>>>> list,
>>>> is
>>>>> there a forum which connects MET users?
>>>>>
>>>>> Thanks,
>>>>> Jason
>>>>
>>>>
>>>
>>
>>
>>
>>
------------------------------------------------
Subject: metar from MADIS
From: jason marsh
Time: Mon Apr 18 13:17:04 2011
John,
Not sure what's going on here?
When I issue those commands, ncdump gives me a string of times:
1302652020, 1302652200..... 1302655440, 1302655440
Further more, with
ncks -s '%f\n' -C -v timeObs madis_20110413_0000.nc >
time_madis_20110413_0000.nc
while read line
do date -ud @$line +'%Y%m%d_%H%M%S'
done < time_madis_20110413_0000.nc > timeObs
The timeObs file contains a list of times in the format
YYYYMMDD_HHMMSS
Not sure why the code would have a problem? Unless the file is being
corrupted during the ftp perhaps?? I have zipped and uploaded another
file
(different date) for you to test with, in the same directory (i
ncoming/irap/met_help/marsh).
Thanks,
Jason
On Mon, Apr 18, 2011 at 8:15 AM, RAL HelpDesk {for John Halley Gotway}
<
met_help at ucar.edu> wrote:
> Jason,
>
> I'm trying to run the data you sent through the version of madis2nc
I
> received from the other user. However, the code is erroring out
when
> processing the times in the input NetCDF file.
> Specifically, the times stored in the "timeObs" variable. Try
running the
> following commands (ncdump doesn't like file names beginning with a
number):
>
> cp 20110413_0000 madis_20110413_0000.nc
> ncdump -v timeObs madis_20110413_0000.nc
>
> The units for the timeObs variable are supposed to be seconds since
> 1/1/1970 - a.k.a. unixtime. But the values listed in there do not
look like
> unixtimes. I don't know how familiar you are with
> unixtime, but the following command tells you the current unixtime:
>
> date +%s
>
> Here's info on the timeObs variable from the NetCDF header:
> double timeObs(recNum) ;
> timeObs:long_name = "time of observation" ;
> timeObs:units = "seconds since 1970-1-1 00:00:00.0" ;
> timeObs:_FillValue = 1.79769313486232e+308 ;
> timeObs:standard_name = "time" ;
> :timeVariables = "timeObs" ;
>
> Any idea what's going on here?
>
> Thanks,
> John
>
>
> On 04/15/2011 06:35 PM, RAL HelpDesk {for jason marsh} wrote:
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46055 >
> >
> > John,
> > I've uploaded the file under
> >
> > *incoming/irap/met_help/marsh*
> >
> > Thanks,
> > Jason
> >
> >
> > On Thu, Apr 14, 2011 at 6:32 PM, RAL HelpDesk {for John Halley
Gotway} <
> > met_help at ucar.edu> wrote:
> >
> >> Jason,
> >>
> >> Just posting it to our ftp site would be good. You can follow
the
> >> directions here:
> >> http://www.dtcenter.org/met/users/support/met_help.php#ftp
> >>
> >> And please write to let me know when it's there.
> >>
> >> Thanks,
> >> John
> >>>
> >>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46055 >
> >>>
> >>> John,
> >>> The metar netcdf files are ~12Mb - do you want it emailed, or is
ftp
> >>> better?
> >>> Thanks,
> >>> Jason
> >>>
> >>> On Thu, Apr 14, 2011 at 5:45 AM, RAL HelpDesk {for John Halley
Gotway}
> <
> >>> met_help at ucar.edu> wrote:
> >>>
> >>>> Jason,
> >>>>
> >>>> I found a version of the madis2nc code that was written for
> >>>> compatibility
> >>>> with METv2.0. I'll take a look and see if it needs to be
updated at
> all
> >>>> for
> >>>> use with METv3.0. Could you please send me one
> >>>> of the MADIS NetCDF files you're trying to use? I'll use that
for
> >>>> testing
> >>>> to make sure it works OK, and will hopefully be able to send
you some
> >>>> code
> >>>> to try out.
> >>>>
> >>>> Thanks,
> >>>> John Halley Gotway
> >>>> met_help at ucar.edu
> >>>>
> >>>> On 04/11/2011 07:51 PM, RAL HelpDesk {for jason marsh} wrote:
> >>>>>
> >>>>> Mon Apr 11 19:51:05 2011: Request 46055 was acted upon.
> >>>>> Transaction: Ticket created by marshj77 at gmail.com
> >>>>> Queue: met_help
> >>>>> Subject: metar from MADIS
> >>>>> Owner: Nobody
> >>>>> Requestors: marshj77 at gmail.com
> >>>>> Status: new
> >>>>> Ticket <URL:
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46055
> >>>>>
> >>>>>
> >>>>>
> >>>>> Hi,
> >>>>> I'm trying to convert some metar obs from MADIS from netcdf
format
> >>>> into
> >>>> the
> >>>>> ascii format required for input into the ascii2nc tool in MET.
> >>>>> I came across the following link:
> >>>>> http://mailman.ucar.edu/pipermail/met_help/2010-
March/001159.html
> >>>>>
> >>>>> I wonder, rather than trying to reinvent the wheel, if any
progress
> >>>> was
> >>>> made
> >>>>> on the madis2nc / awips2nc tools mentioned has been made? I am
> >>>> assuming
> >>>> that
> >>>>> several MET users out there are using MADIS? Other than the
email
> >>>> list,
> >>>> is
> >>>>> there a forum which connects MET users?
> >>>>>
> >>>>> Thanks,
> >>>>> Jason
> >>>>
> >>>>
> >>>
> >>
> >>
> >>
> >>
>
>
------------------------------------------------
Subject: metar from MADIS
From: John Halley Gotway
Time: Mon Apr 18 14:56:16 2011
Jason,
Good news. I do think that original ftp file was corrupted somehow.
When I ran with the new data you sent, it all worked as expected. I
was able to reformat the MADIS NetCDF data and use it in a
run of Point-Stat.
I looked closer at the code and see that this really only supports
MADIS data that contains METARS. Specifically, it looks for this
global attribute:
title = "MADIS - Meteorological Surface - METAR"
And that happens to be the sample data you sent me. If we add better
support for this in future releases of MET, we'll add in support for
the other MADIS data types.
I've attached the a tar file containing the madis2nc code for
METv3.0.1. Please perform the following steps:
cd METv3.0.1
mv /path/to/METv3.0.1_madis2nc_beta.tar.gz .
tar -xvzf METv3.0.1_madis2nc_beta.tar.gz
And then try rebuilding MET. The madis2nc executable should appear in
the bin directory.
Please note that I can't make any claims on the accuracy of this code.
It's contributed code at this point that we have spent little to no
time testing. So please use it at your own risk.
Thanks and I hope this helps.
Just let me know if you have any questions.
Thanks,
John
On 04/18/2011 12:15 PM, John Halley Gotway wrote:
> Jason,
>
> I'm trying to run the data you sent through the version of madis2nc
I received from the other user. However, the code is erroring out
when processing the times in the input NetCDF file.
> Specifically, the times stored in the "timeObs" variable. Try
running the following commands (ncdump doesn't like file names
beginning with a number):
>
> cp 20110413_0000 madis_20110413_0000.nc
> ncdump -v timeObs madis_20110413_0000.nc
>
> The units for the timeObs variable are supposed to be seconds since
1/1/1970 - a.k.a. unixtime. But the values listed in there do not
look like unixtimes. I don't know how familiar you are with
> unixtime, but the following command tells you the current unixtime:
>
> date +%s
>
> Here's info on the timeObs variable from the NetCDF header:
> double timeObs(recNum) ;
> timeObs:long_name = "time of observation" ;
> timeObs:units = "seconds since 1970-1-1 00:00:00.0"
;
> timeObs:_FillValue = 1.79769313486232e+308 ;
> timeObs:standard_name = "time" ;
> :timeVariables = "timeObs" ;
>
> Any idea what's going on here?
>
> Thanks,
> John
>
>
> On 04/15/2011 06:35 PM, RAL HelpDesk {for jason marsh} wrote:
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46055 >
>>
>> John,
>> I've uploaded the file under
>>
>> *incoming/irap/met_help/marsh*
>>
>> Thanks,
>> Jason
>>
>>
>> On Thu, Apr 14, 2011 at 6:32 PM, RAL HelpDesk {for John Halley
Gotway} <
>> met_help at ucar.edu> wrote:
>>
>>> Jason,
>>>
>>> Just posting it to our ftp site would be good. You can follow the
>>> directions here:
>>> http://www.dtcenter.org/met/users/support/met_help.php#ftp
>>>
>>> And please write to let me know when it's there.
>>>
>>> Thanks,
>>> John
>>>>
>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46055 >
>>>>
>>>> John,
>>>> The metar netcdf files are ~12Mb - do you want it emailed, or is
ftp
>>>> better?
>>>> Thanks,
>>>> Jason
>>>>
>>>> On Thu, Apr 14, 2011 at 5:45 AM, RAL HelpDesk {for John Halley
Gotway} <
>>>> met_help at ucar.edu> wrote:
>>>>
>>>>> Jason,
>>>>>
>>>>> I found a version of the madis2nc code that was written for
>>>>> compatibility
>>>>> with METv2.0. I'll take a look and see if it needs to be
updated at all
>>>>> for
>>>>> use with METv3.0. Could you please send me one
>>>>> of the MADIS NetCDF files you're trying to use? I'll use that
for
>>>>> testing
>>>>> to make sure it works OK, and will hopefully be able to send you
some
>>>>> code
>>>>> to try out.
>>>>>
>>>>> Thanks,
>>>>> John Halley Gotway
>>>>> met_help at ucar.edu
>>>>>
>>>>> On 04/11/2011 07:51 PM, RAL HelpDesk {for jason marsh} wrote:
>>>>>>
>>>>>> Mon Apr 11 19:51:05 2011: Request 46055 was acted upon.
>>>>>> Transaction: Ticket created by marshj77 at gmail.com
>>>>>> Queue: met_help
>>>>>> Subject: metar from MADIS
>>>>>> Owner: Nobody
>>>>>> Requestors: marshj77 at gmail.com
>>>>>> Status: new
>>>>>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46055
>>>>>>
>>>>>>
>>>>>>
>>>>>> Hi,
>>>>>> I'm trying to convert some metar obs from MADIS from netcdf
format
>>>>> into
>>>>> the
>>>>>> ascii format required for input into the ascii2nc tool in MET.
>>>>>> I came across the following link:
>>>>>> http://mailman.ucar.edu/pipermail/met_help/2010-
March/001159.html
>>>>>>
>>>>>> I wonder, rather than trying to reinvent the wheel, if any
progress
>>>>> was
>>>>> made
>>>>>> on the madis2nc / awips2nc tools mentioned has been made? I am
>>>>> assuming
>>>>> that
>>>>>> several MET users out there are using MADIS? Other than the
email
>>>>> list,
>>>>> is
>>>>>> there a forum which connects MET users?
>>>>>>
>>>>>> Thanks,
>>>>>> Jason
>>>>>
>>>>>
>>>>
>>>
>>>
>>>
>>>
------------------------------------------------
Subject: metar from MADIS
From: jason marsh
Time: Mon Apr 18 17:23:35 2011
John,
Thanks for all your help!
I've installed the tool and it appears to be working well so far. I'll
play
around with it over the next few days and let you know if anything
comes up.
Thanks again,
Jason
On Mon, Apr 18, 2011 at 10:56 AM, RAL HelpDesk {for John Halley
Gotway} <
met_help at ucar.edu> wrote:
> Jason,
>
> Good news. I do think that original ftp file was corrupted somehow.
When
> I ran with the new data you sent, it all worked as expected. I was
able to
> reformat the MADIS NetCDF data and use it in a
> run of Point-Stat.
>
> I looked closer at the code and see that this really only supports
MADIS
> data that contains METARS. Specifically, it looks for this global
> attribute:
> title = "MADIS - Meteorological Surface - METAR"
>
> And that happens to be the sample data you sent me. If we add
better
> support for this in future releases of MET, we'll add in support for
the
> other MADIS data types.
>
> I've attached the a tar file containing the madis2nc code for
METv3.0.1.
> Please perform the following steps:
> cd METv3.0.1
> mv /path/to/METv3.0.1_madis2nc_beta.tar.gz .
> tar -xvzf METv3.0.1_madis2nc_beta.tar.gz
>
> And then try rebuilding MET. The madis2nc executable should appear
in the
> bin directory.
>
> Please note that I can't make any claims on the accuracy of this
code.
> It's contributed code at this point that we have spent little to no
time
> testing. So please use it at your own risk.
>
> Thanks and I hope this helps.
>
> Just let me know if you have any questions.
>
> Thanks,
> John
>
>
>
> On 04/18/2011 12:15 PM, John Halley Gotway wrote:
> > Jason,
> >
> > I'm trying to run the data you sent through the version of
madis2nc I
> received from the other user. However, the code is erroring out
when
> processing the times in the input NetCDF file.
> > Specifically, the times stored in the "timeObs" variable. Try
running
> the following commands (ncdump doesn't like file names beginning
with a
> number):
> >
> > cp 20110413_0000 madis_20110413_0000.nc
> > ncdump -v timeObs madis_20110413_0000.nc
> >
> > The units for the timeObs variable are supposed to be seconds
since
> 1/1/1970 - a.k.a. unixtime. But the values listed in there do not
look like
> unixtimes. I don't know how familiar you are with
> > unixtime, but the following command tells you the current
unixtime:
> >
> > date +%s
> >
> > Here's info on the timeObs variable from the NetCDF header:
> > double timeObs(recNum) ;
> > timeObs:long_name = "time of observation" ;
> > timeObs:units = "seconds since 1970-1-1
00:00:00.0" ;
> > timeObs:_FillValue = 1.79769313486232e+308 ;
> > timeObs:standard_name = "time" ;
> > :timeVariables = "timeObs" ;
> >
> > Any idea what's going on here?
> >
> > Thanks,
> > John
> >
> >
> > On 04/15/2011 06:35 PM, RAL HelpDesk {for jason marsh} wrote:
> >>
> >> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46055 >
> >>
> >> John,
> >> I've uploaded the file under
> >>
> >> *incoming/irap/met_help/marsh*
> >>
> >> Thanks,
> >> Jason
> >>
> >>
> >> On Thu, Apr 14, 2011 at 6:32 PM, RAL HelpDesk {for John Halley
Gotway} <
> >> met_help at ucar.edu> wrote:
> >>
> >>> Jason,
> >>>
> >>> Just posting it to our ftp site would be good. You can follow
the
> >>> directions here:
> >>> http://www.dtcenter.org/met/users/support/met_help.php#ftp
> >>>
> >>> And please write to let me know when it's there.
> >>>
> >>> Thanks,
> >>> John
> >>>>
> >>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46055 >
> >>>>
> >>>> John,
> >>>> The metar netcdf files are ~12Mb - do you want it emailed, or
is ftp
> >>>> better?
> >>>> Thanks,
> >>>> Jason
> >>>>
> >>>> On Thu, Apr 14, 2011 at 5:45 AM, RAL HelpDesk {for John Halley
Gotway}
> <
> >>>> met_help at ucar.edu> wrote:
> >>>>
> >>>>> Jason,
> >>>>>
> >>>>> I found a version of the madis2nc code that was written for
> >>>>> compatibility
> >>>>> with METv2.0. I'll take a look and see if it needs to be
updated at
> all
> >>>>> for
> >>>>> use with METv3.0. Could you please send me one
> >>>>> of the MADIS NetCDF files you're trying to use? I'll use that
for
> >>>>> testing
> >>>>> to make sure it works OK, and will hopefully be able to send
you some
> >>>>> code
> >>>>> to try out.
> >>>>>
> >>>>> Thanks,
> >>>>> John Halley Gotway
> >>>>> met_help at ucar.edu
> >>>>>
> >>>>> On 04/11/2011 07:51 PM, RAL HelpDesk {for jason marsh} wrote:
> >>>>>>
> >>>>>> Mon Apr 11 19:51:05 2011: Request 46055 was acted upon.
> >>>>>> Transaction: Ticket created by marshj77 at gmail.com
> >>>>>> Queue: met_help
> >>>>>> Subject: metar from MADIS
> >>>>>> Owner: Nobody
> >>>>>> Requestors: marshj77 at gmail.com
> >>>>>> Status: new
> >>>>>> Ticket <URL:
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46055
> >>>>>>
> >>>>>>
> >>>>>>
> >>>>>> Hi,
> >>>>>> I'm trying to convert some metar obs from MADIS from netcdf
format
> >>>>> into
> >>>>> the
> >>>>>> ascii format required for input into the ascii2nc tool in
MET.
> >>>>>> I came across the following link:
> >>>>>> http://mailman.ucar.edu/pipermail/met_help/2010-
March/001159.html
> >>>>>>
> >>>>>> I wonder, rather than trying to reinvent the wheel, if any
progress
> >>>>> was
> >>>>> made
> >>>>>> on the madis2nc / awips2nc tools mentioned has been made? I
am
> >>>>> assuming
> >>>>> that
> >>>>>> several MET users out there are using MADIS? Other than the
email
> >>>>> list,
> >>>>> is
> >>>>>> there a forum which connects MET users?
> >>>>>>
> >>>>>> Thanks,
> >>>>>> Jason
> >>>>>
> >>>>>
> >>>>
> >>>
> >>>
> >>>
> >>>
>
>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #46055] metar from MADIS
From: John Halley Gotway
Time: Tue Apr 19 08:47:44 2011
Jason,
Great. I'll go ahead and resolve that ticket. Just let us know if
any more issues arise in your use of MET.
Thanks,
John
On 04/18/2011 05:23 PM, RAL HelpDesk {for jason marsh} wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46055 >
>
> John,
> Thanks for all your help!
> I've installed the tool and it appears to be working well so far.
I'll play
> around with it over the next few days and let you know if anything
comes up.
> Thanks again,
> Jason
>
>
> On Mon, Apr 18, 2011 at 10:56 AM, RAL HelpDesk {for John Halley
Gotway} <
> met_help at ucar.edu> wrote:
>
>> Jason,
>>
>> Good news. I do think that original ftp file was corrupted
somehow. When
>> I ran with the new data you sent, it all worked as expected. I was
able to
>> reformat the MADIS NetCDF data and use it in a
>> run of Point-Stat.
>>
>> I looked closer at the code and see that this really only supports
MADIS
>> data that contains METARS. Specifically, it looks for this global
>> attribute:
>> title = "MADIS - Meteorological Surface - METAR"
>>
>> And that happens to be the sample data you sent me. If we add
better
>> support for this in future releases of MET, we'll add in support
for the
>> other MADIS data types.
>>
>> I've attached the a tar file containing the madis2nc code for
METv3.0.1.
>> Please perform the following steps:
>> cd METv3.0.1
>> mv /path/to/METv3.0.1_madis2nc_beta.tar.gz .
>> tar -xvzf METv3.0.1_madis2nc_beta.tar.gz
>>
>> And then try rebuilding MET. The madis2nc executable should appear
in the
>> bin directory.
>>
>> Please note that I can't make any claims on the accuracy of this
code.
>> It's contributed code at this point that we have spent little to
no time
>> testing. So please use it at your own risk.
>>
>> Thanks and I hope this helps.
>>
>> Just let me know if you have any questions.
>>
>> Thanks,
>> John
>>
>>
>>
>> On 04/18/2011 12:15 PM, John Halley Gotway wrote:
>>> Jason,
>>>
>>> I'm trying to run the data you sent through the version of
madis2nc I
>> received from the other user. However, the code is erroring out
when
>> processing the times in the input NetCDF file.
>>> Specifically, the times stored in the "timeObs" variable. Try
running
>> the following commands (ncdump doesn't like file names beginning
with a
>> number):
>>>
>>> cp 20110413_0000 madis_20110413_0000.nc
>>> ncdump -v timeObs madis_20110413_0000.nc
>>>
>>> The units for the timeObs variable are supposed to be seconds
since
>> 1/1/1970 - a.k.a. unixtime. But the values listed in there do not
look like
>> unixtimes. I don't know how familiar you are with
>>> unixtime, but the following command tells you the current
unixtime:
>>>
>>> date +%s
>>>
>>> Here's info on the timeObs variable from the NetCDF header:
>>> double timeObs(recNum) ;
>>> timeObs:long_name = "time of observation" ;
>>> timeObs:units = "seconds since 1970-1-1
00:00:00.0" ;
>>> timeObs:_FillValue = 1.79769313486232e+308 ;
>>> timeObs:standard_name = "time" ;
>>> :timeVariables = "timeObs" ;
>>>
>>> Any idea what's going on here?
>>>
>>> Thanks,
>>> John
>>>
>>>
>>> On 04/15/2011 06:35 PM, RAL HelpDesk {for jason marsh} wrote:
>>>>
>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46055 >
>>>>
>>>> John,
>>>> I've uploaded the file under
>>>>
>>>> *incoming/irap/met_help/marsh*
>>>>
>>>> Thanks,
>>>> Jason
>>>>
>>>>
>>>> On Thu, Apr 14, 2011 at 6:32 PM, RAL HelpDesk {for John Halley
Gotway} <
>>>> met_help at ucar.edu> wrote:
>>>>
>>>>> Jason,
>>>>>
>>>>> Just posting it to our ftp site would be good. You can follow
the
>>>>> directions here:
>>>>> http://www.dtcenter.org/met/users/support/met_help.php#ftp
>>>>>
>>>>> And please write to let me know when it's there.
>>>>>
>>>>> Thanks,
>>>>> John
>>>>>>
>>>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46055 >
>>>>>>
>>>>>> John,
>>>>>> The metar netcdf files are ~12Mb - do you want it emailed, or
is ftp
>>>>>> better?
>>>>>> Thanks,
>>>>>> Jason
>>>>>>
>>>>>> On Thu, Apr 14, 2011 at 5:45 AM, RAL HelpDesk {for John Halley
Gotway}
>> <
>>>>>> met_help at ucar.edu> wrote:
>>>>>>
>>>>>>> Jason,
>>>>>>>
>>>>>>> I found a version of the madis2nc code that was written for
>>>>>>> compatibility
>>>>>>> with METv2.0. I'll take a look and see if it needs to be
updated at
>> all
>>>>>>> for
>>>>>>> use with METv3.0. Could you please send me one
>>>>>>> of the MADIS NetCDF files you're trying to use? I'll use that
for
>>>>>>> testing
>>>>>>> to make sure it works OK, and will hopefully be able to send
you some
>>>>>>> code
>>>>>>> to try out.
>>>>>>>
>>>>>>> Thanks,
>>>>>>> John Halley Gotway
>>>>>>> met_help at ucar.edu
>>>>>>>
>>>>>>> On 04/11/2011 07:51 PM, RAL HelpDesk {for jason marsh} wrote:
>>>>>>>>
>>>>>>>> Mon Apr 11 19:51:05 2011: Request 46055 was acted upon.
>>>>>>>> Transaction: Ticket created by marshj77 at gmail.com
>>>>>>>> Queue: met_help
>>>>>>>> Subject: metar from MADIS
>>>>>>>> Owner: Nobody
>>>>>>>> Requestors: marshj77 at gmail.com
>>>>>>>> Status: new
>>>>>>>> Ticket <URL:
>> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46055
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> Hi,
>>>>>>>> I'm trying to convert some metar obs from MADIS from netcdf
format
>>>>>>> into
>>>>>>> the
>>>>>>>> ascii format required for input into the ascii2nc tool in
MET.
>>>>>>>> I came across the following link:
>>>>>>>> http://mailman.ucar.edu/pipermail/met_help/2010-
March/001159.html
>>>>>>>>
>>>>>>>> I wonder, rather than trying to reinvent the wheel, if any
progress
>>>>>>> was
>>>>>>> made
>>>>>>>> on the madis2nc / awips2nc tools mentioned has been made? I
am
>>>>>>> assuming
>>>>>>> that
>>>>>>>> several MET users out there are using MADIS? Other than the
email
>>>>>>> list,
>>>>>>> is
>>>>>>>> there a forum which connects MET users?
>>>>>>>>
>>>>>>>> Thanks,
>>>>>>>> Jason
>>>>>>>
>>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>
>>
------------------------------------------------
More information about the Met_help
mailing list