[Met_help] [rt.rap.ucar.edu #56967] History for Help i try to use MET to verify data precipitation model from weather radar
Paul Oldenburg via RT
met_help at ucar.edu
Tue Jul 3 08:09:03 MDT 2012
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
To: Developmental Testbed Center - MET
Hello,
My name is Sebastian Paez, i am doing my master thesis at the University of Stuttgart. I am generating a precipitation forecast model based
on radar images (as 3darrays) from the DWD (German Weather Service). I want to use MET to verify my models with observations from DWD.
The information from DWD is provided as HFD5 file, which I transformed to NetCDF3 format using the pacakge NetCDF-python.
I installed MET and run the tutorial without big problems. But when i want to use my .nc files I got this error:
Met2dDataFileFactory::new_met_2d_data_file() -> unsupported gridded data file type "4"
Could you tell me if it's possible to use MET with my data. I am attaching to this e-mail my .nc file in case you wanna check it.
I hope you can help me to figure out if it's worth to continue with trying with MET as verification tool.
Thanks in advance
Sebastian Paez
WAREM - University of Stuttgart
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #56967] Help i try to use MET to verify data precipitation model from weather radar
From: Paul Oldenburg
Time: Wed Jun 13 12:51:06 2012
Sabastian,
MET can only read gridded model data that is in one of three formats:
GRIB, pinterp NetCDF and MET NetCDF. The last two
formats are basically special NetCDF formats with specific naming
conventions and certain variables and attributes
defined. In your case, I think converting your data to the last
format, MET NetCDF, would be the easiest route. We use
the statistical scripting language R (http://www.r-project.org/) with
the NetCDF library
(http://cran.r-project.org/web/packages/ncdf/index.html) to process
NetCDF data. There is a script available on our
website
(http://www.dtcenter.org/met/users/downloads/Rscripts/trmm2nc.R) that
uses these tools to convert precipitation
data in a text file into MET NetCDF. You could modify that script and
use it to convert your NetCDF data.
I think this approach would be the easiest way for you to verify your
model data using MET. Whether or not you choose
to do so probably depends on how well acquainted you are with R and
what your alternatives are. If you have another
means of reading and writing NetCDF files (for example
http://www.unidata.ucar.edu/software/netcdf-java/), that is also
a possible route. You can see examples of the MET NetCDF file format
by inspecting the files created by the MET tool
pcp_combine when you run the test scripts. They can be found in
$MET_BASE/out/pcp_combine, where $MET_BASE is the
directory where MET was built on your system. The goal of conversion
is to mimic the format of these files.
The model data file you sent seems to have bad data (all 9.96921e+36)
for the only variable present, r_adv. I'm sorry
for such a long and complicated answer. Let me know if you have any
questions. Good luck.
Paul
On 06/13/2012 06:53 AM, Sebastian Paez via RT wrote:
>
> Wed Jun 13 06:53:52 2012: Request 56967 was acted upon.
> Transaction: Ticket created by sebastian_paez at hotmail.com
> Queue: met_help
> Subject: Help i try to use MET to verify data precipitation
model from weather radar
> Owner: Nobody
> Requestors: sebastian_paez at hotmail.com
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=56967 >
>
>
>
> To: Developmental Testbed Center - MET
>
> Hello,
>
> My name is Sebastian Paez, i am doing my master thesis at the
University of Stuttgart. I am generating a precipitation forecast
model based
> on radar images (as 3darrays) from the DWD (German Weather Service).
I want to use MET to verify my models with observations from DWD.
> The information from DWD is provided as HFD5 file, which I
transformed to NetCDF3 format using the pacakge NetCDF-python.
>
> I installed MET and run the tutorial without big problems. But when
i want to use my .nc files I got this error:
>
>
>
> Met2dDataFileFactory::new_met_2d_data_file() -> unsupported
gridded data file type "4"
>
>
>
> Could you tell me if it's possible to use MET with my data. I am
attaching to this e-mail my .nc file in case you wanna check it.
>
> I hope you can help me to figure out if it's worth to continue with
trying with MET as verification tool.
>
> Thanks in advance
>
> Sebastian Paez
> WAREM - University of Stuttgart
>
>
------------------------------------------------
Subject: Help i try to use MET to verify data precipitation model from weather radar
From: Sebastian Paez
Time: Thu Jun 14 10:10:09 2012
Paul,
I created a .nc file with all attributes as you mentioned and it
worked.Now, my information is from Germany and therefore my
precipitation data use the "Polar Stereographic Projection" in
difference with the Lambert Conformal I used in the file I created.
Can you tell me the attributes related to the "
Polar Stereographic Projection" that should be included in the .nc
file or if you have an example file using
" Polar Stereographic Projection" can you send it to me?
I am attaching the file I created and that worked in MET with Lambert
Conformal Projection.
Thanks again for your help
Sebastian
> Subject: Re: [rt.rap.ucar.edu #56967] Help i try to use MET to
verify data precipitation model from weather radar
> From: met_help at ucar.edu
> To: sebastian_paez at hotmail.com
> Date: Wed, 13 Jun 2012 12:51:07 -0600
>
> Sabastian,
>
> MET can only read gridded model data that is in one of three
formats: GRIB, pinterp NetCDF and MET NetCDF. The last two
> formats are basically special NetCDF formats with specific naming
conventions and certain variables and attributes
> defined. In your case, I think converting your data to the last
format, MET NetCDF, would be the easiest route. We use
> the statistical scripting language R (http://www.r-project.org/)
with the NetCDF library
> (http://cran.r-project.org/web/packages/ncdf/index.html) to process
NetCDF data. There is a script available on our
> website
(http://www.dtcenter.org/met/users/downloads/Rscripts/trmm2nc.R) that
uses these tools to convert precipitation
> data in a text file into MET NetCDF. You could modify that script
and use it to convert your NetCDF data.
>
> I think this approach would be the easiest way for you to verify
your model data using MET. Whether or not you choose
> to do so probably depends on how well acquainted you are with R and
what your alternatives are. If you have another
> means of reading and writing NetCDF files (for example
http://www.unidata.ucar.edu/software/netcdf-java/), that is also
> a possible route. You can see examples of the MET NetCDF file
format by inspecting the files created by the MET tool
> pcp_combine when you run the test scripts. They can be found in
$MET_BASE/out/pcp_combine, where $MET_BASE is the
> directory where MET was built on your system. The goal of
conversion is to mimic the format of these files.
>
> The model data file you sent seems to have bad data (all
9.96921e+36) for the only variable present, r_adv. I'm sorry
> for such a long and complicated answer. Let me know if you have any
questions. Good luck.
>
> Paul
>
>
> On 06/13/2012 06:53 AM, Sebastian Paez via RT wrote:
> >
> > Wed Jun 13 06:53:52 2012: Request 56967 was acted upon.
> > Transaction: Ticket created by sebastian_paez at hotmail.com
> > Queue: met_help
> > Subject: Help i try to use MET to verify data precipitation
model from weather radar
> > Owner: Nobody
> > Requestors: sebastian_paez at hotmail.com
> > Status: new
> > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=56967 >
> >
> >
> >
> > To: Developmental Testbed Center - MET
> >
> > Hello,
> >
> > My name is Sebastian Paez, i am doing my master thesis at the
University of Stuttgart. I am generating a precipitation forecast
model based
> > on radar images (as 3darrays) from the DWD (German Weather
Service). I want to use MET to verify my models with observations from
DWD.
> > The information from DWD is provided as HFD5 file, which I
transformed to NetCDF3 format using the pacakge NetCDF-python.
> >
> > I installed MET and run the tutorial without big problems. But
when i want to use my .nc files I got this error:
> >
> >
> >
> > Met2dDataFileFactory::new_met_2d_data_file() -> unsupported
gridded data file type "4"
> >
> >
> >
> > Could you tell me if it's possible to use MET with my data. I am
attaching to this e-mail my .nc file in case you wanna check it.
> >
> > I hope you can help me to figure out if it's worth to continue
with trying with MET as verification tool.
> >
> > Thanks in advance
> >
> > Sebastian Paez
> > WAREM - University of Stuttgart
> >
> >
>
>
>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #56967] Help i try to use MET to verify data precipitation model from weather radar
From: Paul Oldenburg
Time: Tue Jun 19 11:38:47 2012
Sebastian,
You can see an example of a polar stereographic MET NetCDF file in the
test script output file:
$MET_BASE/out/ensemble_stat/ensemble_stat_20100101_120000V_ens.nc
where MET_BASE is set to the base directory where MET was installed on
your system. Note that you must run the
$MET_BASE/scripts/test_all.sh script to generate this output file.
Not all of the global attributes (see below) in that
file are projection-related, but I recommend that you include all of
them, anyway. Please let me know if you have any
questions.
Paul
// global attributes:
:FileOrigins = "File
../out/ensemble_stat/ensemble_stat_20100101_120000V_ens.nc generated
20120613_154116 UTC on host orval by the MET ensemble_stat tool" ;
:MET_version = "V4.0" ;
:MET_tool = "ensemble_stat" ;
:Projection = "Polar Stereographic" ;
:hemisphere = "N" ;
:scale_lat = "60.000000 degrees_north" ;
:lat_pin = "31.357000" ;
:lon_pin = "-129.770000" ;
:x_pin = "0.000000" ;
:y_pin = "0.000000" ;
:lon_orient = "-120.500000" ;
:d_km = "10.395000 km" ;
:r_km = "6371.200000 km" ;
:nx = "169" ;
:ny = "154" ;
}
On 06/14/2012 10:10 AM, Sebastian Paez via RT wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=56967 >
>
>
>
>
>
> Paul,
> I created a .nc file with all attributes as you mentioned and it
worked.Now, my information is from Germany and therefore my
precipitation data use the "Polar Stereographic Projection" in
difference with the Lambert Conformal I used in the file I created.
>
> Can you tell me the attributes related to the "
> Polar Stereographic Projection" that should be included in the .nc
file or if you have an example file using
> " Polar Stereographic Projection" can you send it to me?
> I am attaching the file I created and that worked in MET with
Lambert Conformal Projection.
> Thanks again for your help
>
> Sebastian
>
>> Subject: Re: [rt.rap.ucar.edu #56967] Help i try to use MET to
verify data precipitation model from weather radar
>> From: met_help at ucar.edu
>> To: sebastian_paez at hotmail.com
>> Date: Wed, 13 Jun 2012 12:51:07 -0600
>>
>> Sabastian,
>>
>> MET can only read gridded model data that is in one of three
formats: GRIB, pinterp NetCDF and MET NetCDF. The last two
>> formats are basically special NetCDF formats with specific naming
conventions and certain variables and attributes
>> defined. In your case, I think converting your data to the last
format, MET NetCDF, would be the easiest route. We use
>> the statistical scripting language R (http://www.r-project.org/)
with the NetCDF library
>> (http://cran.r-project.org/web/packages/ncdf/index.html) to process
NetCDF data. There is a script available on our
>> website
(http://www.dtcenter.org/met/users/downloads/Rscripts/trmm2nc.R) that
uses these tools to convert precipitation
>> data in a text file into MET NetCDF. You could modify that script
and use it to convert your NetCDF data.
>>
>> I think this approach would be the easiest way for you to verify
your model data using MET. Whether or not you choose
>> to do so probably depends on how well acquainted you are with R and
what your alternatives are. If you have another
>> means of reading and writing NetCDF files (for example
http://www.unidata.ucar.edu/software/netcdf-java/), that is also
>> a possible route. You can see examples of the MET NetCDF file
format by inspecting the files created by the MET tool
>> pcp_combine when you run the test scripts. They can be found in
$MET_BASE/out/pcp_combine, where $MET_BASE is the
>> directory where MET was built on your system. The goal of
conversion is to mimic the format of these files.
>>
>> The model data file you sent seems to have bad data (all
9.96921e+36) for the only variable present, r_adv. I'm sorry
>> for such a long and complicated answer. Let me know if you have
any questions. Good luck.
>>
>> Paul
>>
>>
>> On 06/13/2012 06:53 AM, Sebastian Paez via RT wrote:
>>>
>>> Wed Jun 13 06:53:52 2012: Request 56967 was acted upon.
>>> Transaction: Ticket created by sebastian_paez at hotmail.com
>>> Queue: met_help
>>> Subject: Help i try to use MET to verify data precipitation
model from weather radar
>>> Owner: Nobody
>>> Requestors: sebastian_paez at hotmail.com
>>> Status: new
>>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=56967 >
>>>
>>>
>>>
>>> To: Developmental Testbed Center - MET
>>>
>>> Hello,
>>>
>>> My name is Sebastian Paez, i am doing my master thesis at the
University of Stuttgart. I am generating a precipitation forecast
model based
>>> on radar images (as 3darrays) from the DWD (German Weather
Service). I want to use MET to verify my models with observations from
DWD.
>>> The information from DWD is provided as HFD5 file, which I
transformed to NetCDF3 format using the pacakge NetCDF-python.
>>>
>>> I installed MET and run the tutorial without big problems. But
when i want to use my .nc files I got this error:
>>>
>>>
>>>
>>> Met2dDataFileFactory::new_met_2d_data_file() -> unsupported
gridded data file type "4"
>>>
>>>
>>>
>>> Could you tell me if it's possible to use MET with my data. I am
attaching to this e-mail my .nc file in case you wanna check it.
>>>
>>> I hope you can help me to figure out if it's worth to continue
with trying with MET as verification tool.
>>>
>>> Thanks in advance
>>>
>>> Sebastian Paez
>>> WAREM - University of Stuttgart
>>>
>>>
>>
>>
>>
>
>
>
------------------------------------------------
More information about the Met_help
mailing list