[Met_help] [rt.rap.ucar.edu #49759] History for MET not reading LAPS TPW files
John Halley Gotway via RT
met_help at ucar.edu
Wed Oct 19 09:40:35 MDT 2011
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
John,
I am now trying to use point_stat to verify a LAPS lh4 (total precipitable water) NetCDF file against a GPSMet PW file generated by ascii2nc. The data are store in NetCDF variable 'tpw'. However, point_stat reports it cannot read an (unspecified) NetCDF attribute (instead of a variable). See output below.
> ratchet:~/MET > point_stat 112642200.lh4 gpsmet.1126422_1126506_MET.nc PointStatConfig -outdir /home/fab/holub/MET
> GSL_RNG_TYPE=mt19937
> GSL_RNG_SEED=2006874958
> Forecast File: 112642200.lh4
> Climatology File: none
> Configuration File: PointStatConfig
> Observation File: gpsmet.1126422_1126506_MET.nc
>
> --------------------------------------------------------------------------------
>
> Reading records for tpw(0,*,*).
> NetCDF: Attribute not found
> ratchet:~/MET >
Data files have been uploaded onto the FTP server in /incoming/irap/met_help/holub_data. So presumably fcst_field[] = [ "tpw(0,*,*)" ] is not the correct way to specify which NetCDF variable to use. Any insight will be appreciated.
Thanks!
--Kirk
*********************************************************************************
* Kirk L. Holub *
* NOAA Earth System Research Laboratory * Global Systems Division *
* 325 Broadway * Forecast Applications Branch *
* Bldg 33/2B135/x6642 * 303-497-6642 (W) 303-748-7262 (FAX) *
* Boulder, CO 80305-3328 * 303-748-6390 (Cell) *
* *
******************************* Disclaimer **********************************
* *
* The contents of this message are mine personally and do not reflect any *
* position of the United States of America (US), or the US Department of *
* Commerce, or the National Oceanic and Atmospheric Administration (NOAA). *
* *
*********************************************************************************
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #49759] MET not reading LAPS TPW files
From: John Halley Gotway
Time: Thu Sep 22 15:08:35 2011
Kirk,
I'm actually working with Ed Tollerud to figure out how we'd like to
verify fields like total precipitable water for the Hydromet Testbed
this winter over the pacific northwest. I'm guessing you're
working with Ed, but not sure.
The bad news is that MET cannot read the NetCDF LAPS output files
directly. We don't have general support in MET for CF-compliant
NetCDF files yet. Currently, MET can only read the NetCDF output of
the WRF-ARW pinterp tool and the NetCDF format that it writes for its
own internal use.
The LAPS files could probably be amended to enable MET to read them.
That'd involve adding some global attributes to define the grid on
which the data resides, and adding some variable attributes to
specify the timing info. If you are working with Ed on this, I'd
suggest coordinating with him to figure out how best to proceed. It'd
take me a bit, but I could probably work up a script to modify
the NetCDF LAPS files to get MET reading them.
Thanks,
John
On 09/22/2011 02:58 PM, RAL HelpDesk {for Kirk Holub} wrote:
>
> Thu Sep 22 14:58:07 2011: Request 49759 was acted upon.
> Transaction: Ticket created by Kirk.L.Holub at noaa.gov
> Queue: met_help
> Subject: MET not reading LAPS TPW files
> Owner: Nobody
> Requestors: Kirk.L.Holub at noaa.gov
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=49759 >
>
>
> John,
>
> I am now trying to use point_stat to verify a LAPS lh4 (total
precipitable water) NetCDF file against a GPSMet PW file generated by
ascii2nc. The data are store in NetCDF variable 'tpw'. However,
point_stat reports it cannot read an (unspecified) NetCDF attribute
(instead of a variable). See output below.
>
>> ratchet:~/MET > point_stat 112642200.lh4
gpsmet.1126422_1126506_MET.nc PointStatConfig -outdir
/home/fab/holub/MET
>> GSL_RNG_TYPE=mt19937
>> GSL_RNG_SEED=2006874958
>> Forecast File: 112642200.lh4
>> Climatology File: none
>> Configuration File: PointStatConfig
>> Observation File: gpsmet.1126422_1126506_MET.nc
>>
>>
--------------------------------------------------------------------------------
>>
>> Reading records for tpw(0,*,*).
>> NetCDF: Attribute not found
>> ratchet:~/MET >
>
> Data files have been uploaded onto the FTP server in
/incoming/irap/met_help/holub_data. So presumably fcst_field[] = [
"tpw(0,*,*)" ] is not the correct way to specify which NetCDF variable
to use. Any insight will be appreciated.
>
> Thanks!
>
> --Kirk
>
>
*********************************************************************************
> * Kirk L. Holub
*
> * NOAA Earth System Research Laboratory * Global Systems Division
*
> * 325 Broadway * Forecast Applications
Branch *
> * Bldg 33/2B135/x6642 * 303-497-6642 (W) 303-
748-7262 (FAX) *
> * Boulder, CO 80305-3328 * 303-748-6390 (Cell)
*
> *
*
> ******************************* Disclaimer
**********************************
> *
*
> * The contents of this message are mine personally and do not
reflect any *
> * position of the United States of America (US), or the US
Department of *
> * Commerce, or the National Oceanic and Atmospheric
Administration (NOAA). *
> *
*
>
*********************************************************************************
>
>
------------------------------------------------
Subject: MET not reading LAPS TPW files
From: Kirk Holub
Time: Thu Sep 22 15:34:32 2011
John,
Yes, I am working with Ed/Paula/Stanislav on this task.
I suspected MET would not directly support LAPS NetCDF files.
Fortunately a tool to convert LAPS to GRIB is being worked on by the
LAPS folks.
If you can provide what would be needed to make the LAPS files
readable by MET I make take a crack at this.
--Kirk
On Sep 22, 2011, at 3:08 PM, RAL HelpDesk {for John Halley Gotway}
wrote:
> Kirk,
>
> I'm actually working with Ed Tollerud to figure out how we'd like to
verify fields like total precipitable water for the Hydromet Testbed
this winter over the pacific northwest. I'm guessing you're
> working with Ed, but not sure.
>
> The bad news is that MET cannot read the NetCDF LAPS output files
directly. We don't have general support in MET for CF-compliant
NetCDF files yet. Currently, MET can only read the NetCDF output of
> the WRF-ARW pinterp tool and the NetCDF format that it writes for
its own internal use.
>
> The LAPS files could probably be amended to enable MET to read them.
That'd involve adding some global attributes to define the grid on
which the data resides, and adding some variable attributes to
> specify the timing info. If you are working with Ed on this, I'd
suggest coordinating with him to figure out how best to proceed. It'd
take me a bit, but I could probably work up a script to modify
> the NetCDF LAPS files to get MET reading them.
>
> Thanks,
> John
>
> On 09/22/2011 02:58 PM, RAL HelpDesk {for Kirk Holub} wrote:
>>
>> Thu Sep 22 14:58:07 2011: Request 49759 was acted upon.
>> Transaction: Ticket created by Kirk.L.Holub at noaa.gov
>> Queue: met_help
>> Subject: MET not reading LAPS TPW files
>> Owner: Nobody
>> Requestors: Kirk.L.Holub at noaa.gov
>> Status: new
>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=49759 >
>>
>>
>> John,
>>
>> I am now trying to use point_stat to verify a LAPS lh4 (total
precipitable water) NetCDF file against a GPSMet PW file generated by
ascii2nc. The data are store in NetCDF variable 'tpw'. However,
point_stat reports it cannot read an (unspecified) NetCDF attribute
(instead of a variable). See output below.
>>
>>> ratchet:~/MET > point_stat 112642200.lh4
gpsmet.1126422_1126506_MET.nc PointStatConfig -outdir
/home/fab/holub/MET
>>> GSL_RNG_TYPE=mt19937
>>> GSL_RNG_SEED=2006874958
>>> Forecast File: 112642200.lh4
>>> Climatology File: none
>>> Configuration File: PointStatConfig
>>> Observation File: gpsmet.1126422_1126506_MET.nc
>>>
>>>
--------------------------------------------------------------------------------
>>>
>>> Reading records for tpw(0,*,*).
>>> NetCDF: Attribute not found
>>> ratchet:~/MET >
>>
>> Data files have been uploaded onto the FTP server in
/incoming/irap/met_help/holub_data. So presumably fcst_field[] = [
"tpw(0,*,*)" ] is not the correct way to specify which NetCDF variable
to use. Any insight will be appreciated.
>>
>> Thanks!
>>
>> --Kirk
>>
>>
*********************************************************************************
>> * Kirk L. Holub
*
>> * NOAA Earth System Research Laboratory * Global Systems Division
*
>> * 325 Broadway * Forecast Applications
Branch *
>> * Bldg 33/2B135/x6642 * 303-497-6642 (W) 303-
748-7262 (FAX) *
>> * Boulder, CO 80305-3328 * 303-748-6390 (Cell)
*
>> *
*
>> ******************************* Disclaimer
**********************************
>> *
*
>> * The contents of this message are mine personally and do not
reflect any *
>> * position of the United States of America (US), or the US
Department of *
>> * Commerce, or the National Oceanic and Atmospheric
Administration (NOAA). *
>> *
*
>>
*********************************************************************************
>>
>>
>
*********************************************************************************
* Kirk L. Holub
*
* NOAA Earth System Research Laboratory * Global Systems Division
*
* 325 Broadway * Forecast Applications Branch
*
* Bldg 33/2B135/x6642 * 303-497-6642 (W) 303-748-
7262 (FAX) *
* Boulder, CO 80305-3328 * 303-748-6390 (Cell)
*
*
*
******************************* Disclaimer
**********************************
*
*
* The contents of this message are mine personally and do not
reflect any *
* position of the United States of America (US), or the US
Department of *
* Commerce, or the National Oceanic and Atmospheric Administration
(NOAA). *
*
*
*********************************************************************************
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #49759] MET not reading LAPS TPW files
From: John Halley Gotway
Time: Fri Sep 23 10:19:12 2011
Kirk,
OK, I played around with your data to get MET to read it and run it
through Point-Stat. This is not an elegant solution - it's just a
brute force hardcoding of things in your LAPS NetCDF file. Here
are the key points to make:
(1) First, please retrieve the following tar file:
ftp.rap.ucar.edu/incoming/irap/met_help/holub_data/for_kirk.tar.gz
And untar it.
(2) In there, please look in the script "run_ps.sh". You'll see
several steps listed out in there:
- I used R to modify your NetCDF file. In order to run this R
script, you'll need the "RNetCDF" package installed for your instance
of R.
- Instead of calling the message type "GPSIPW", call it "ADPSFC".
There's some logic embedded in Point-Stat for that message type that
says - just use all of the observations of this message type
regardless of the "level" value that's defined for them. Since TPW is
defined at the surface or for a whole column of air (not sure which),
using ADPSFC makes it simpler.
- Call ASCII2NC to reformat those point obs into NetCDF.
- Call Point-Stat to do the verification. I modified the
PointStatConfig file to verify against ADPSFC instead of GPSIPW.
Hopefully, this will help get you going. In the long run, I'd like to
either get LAPS output into GRIB format, or enhance MET to read NetCDF
CF-compliant data directly.
Hope that helps.
John
On 09/22/2011 03:34 PM, RAL HelpDesk {for Kirk Holub} wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=49759 >
>
> John,
>
> Yes, I am working with Ed/Paula/Stanislav on this task.
>
> I suspected MET would not directly support LAPS NetCDF files.
Fortunately a tool to convert LAPS to GRIB is being worked on by the
LAPS folks.
>
> If you can provide what would be needed to make the LAPS files
readable by MET I make take a crack at this.
>
> --Kirk
>
> On Sep 22, 2011, at 3:08 PM, RAL HelpDesk {for John Halley Gotway}
wrote:
>
>> Kirk,
>>
>> I'm actually working with Ed Tollerud to figure out how we'd like
to verify fields like total precipitable water for the Hydromet
Testbed this winter over the pacific northwest. I'm guessing you're
>> working with Ed, but not sure.
>>
>> The bad news is that MET cannot read the NetCDF LAPS output files
directly. We don't have general support in MET for CF-compliant
NetCDF files yet. Currently, MET can only read the NetCDF output of
>> the WRF-ARW pinterp tool and the NetCDF format that it writes for
its own internal use.
>>
>> The LAPS files could probably be amended to enable MET to read
them. That'd involve adding some global attributes to define the grid
on which the data resides, and adding some variable attributes to
>> specify the timing info. If you are working with Ed on this, I'd
suggest coordinating with him to figure out how best to proceed. It'd
take me a bit, but I could probably work up a script to modify
>> the NetCDF LAPS files to get MET reading them.
>>
>> Thanks,
>> John
>>
>> On 09/22/2011 02:58 PM, RAL HelpDesk {for Kirk Holub} wrote:
>>>
>>> Thu Sep 22 14:58:07 2011: Request 49759 was acted upon.
>>> Transaction: Ticket created by Kirk.L.Holub at noaa.gov
>>> Queue: met_help
>>> Subject: MET not reading LAPS TPW files
>>> Owner: Nobody
>>> Requestors: Kirk.L.Holub at noaa.gov
>>> Status: new
>>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=49759 >
>>>
>>>
>>> John,
>>>
>>> I am now trying to use point_stat to verify a LAPS lh4 (total
precipitable water) NetCDF file against a GPSMet PW file generated by
ascii2nc. The data are store in NetCDF variable 'tpw'. However,
point_stat reports it cannot read an (unspecified) NetCDF attribute
(instead of a variable). See output below.
>>>
>>>> ratchet:~/MET > point_stat 112642200.lh4
gpsmet.1126422_1126506_MET.nc PointStatConfig -outdir
/home/fab/holub/MET
>>>> GSL_RNG_TYPE=mt19937
>>>> GSL_RNG_SEED=2006874958
>>>> Forecast File: 112642200.lh4
>>>> Climatology File: none
>>>> Configuration File: PointStatConfig
>>>> Observation File: gpsmet.1126422_1126506_MET.nc
>>>>
>>>>
--------------------------------------------------------------------------------
>>>>
>>>> Reading records for tpw(0,*,*).
>>>> NetCDF: Attribute not found
>>>> ratchet:~/MET >
>>>
>>> Data files have been uploaded onto the FTP server in
/incoming/irap/met_help/holub_data. So presumably fcst_field[] = [
"tpw(0,*,*)" ] is not the correct way to specify which NetCDF variable
to use. Any insight will be appreciated.
>>>
>>> Thanks!
>>>
>>> --Kirk
>>>
>>>
*********************************************************************************
>>> * Kirk L. Holub
*
>>> * NOAA Earth System Research Laboratory * Global Systems Division
*
>>> * 325 Broadway * Forecast Applications
Branch *
>>> * Bldg 33/2B135/x6642 * 303-497-6642 (W) 303-
748-7262 (FAX) *
>>> * Boulder, CO 80305-3328 * 303-748-6390 (Cell)
*
>>> *
*
>>> ******************************* Disclaimer
**********************************
>>> *
*
>>> * The contents of this message are mine personally and do not
reflect any *
>>> * position of the United States of America (US), or the US
Department of *
>>> * Commerce, or the National Oceanic and Atmospheric
Administration (NOAA). *
>>> *
*
>>>
*********************************************************************************
>>>
>>>
>>
>
>
*********************************************************************************
> * Kirk L. Holub
*
> * NOAA Earth System Research Laboratory * Global Systems Division
*
> * 325 Broadway * Forecast Applications
Branch *
> * Bldg 33/2B135/x6642 * 303-497-6642 (W) 303-
748-7262 (FAX) *
> * Boulder, CO 80305-3328 * 303-748-6390 (Cell)
*
> *
*
> ******************************* Disclaimer
**********************************
> *
*
> * The contents of this message are mine personally and do not
reflect any *
> * position of the United States of America (US), or the US
Department of *
> * Commerce, or the National Oceanic and Atmospheric
Administration (NOAA). *
> *
*
>
*********************************************************************************
>
>
------------------------------------------------
More information about the Met_help
mailing list