[Met_help] [rt.rap.ucar.edu #62294] History for Error from gridstat
John Halley Gotway via RT
met_help at ucar.edu
Fri Mar 14 10:01:55 MDT 2014
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Hi
My name is Elelwani, I'm using MET for the first time. I'm using WRF data(grib format) for precipitation as my forecast and TRMM data(netcdf format) for observations. I'm trying to test this data using grid-stat and mode tools. I'm experiencing an error ie NetCDF: Attribute not found. Can you please assist.
Thank you in advance.
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #62294] Error from gridstat
From: John Halley Gotway
Time: Thu Jul 18 11:20:37 2013
Elewani,
I'd be happy to help you with the trouble you're having. But first, I
need you to fill out the free registration on the MET website. Due to
international export control laws within the United
States, we're only able to offer direct support to registered users.
Please go to the following page, fill in your email address, and hit
enter:
http://www.dtcenter.org/met/users/downloads/index.php
You should be taken to the registration form. Please email me back
once you've registered and we can get going on your issue.
Thanks,
John Halley Gotway
met_help at ucar.edu
On 07/18/2013 07:44 AM, Elelwani Phaduli via RT wrote:
>
> Thu Jul 18 07:44:53 2013: Request 62294 was acted upon.
> Transaction: Ticket created by Elelwani.Phaduli at weathersa.co.za
> Queue: met_help
> Subject: Error from gridstat
> Owner: Nobody
> Requestors: Elelwani.Phaduli at weathersa.co.za
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=62294 >
>
>
>
> Hi
>
> My name is Elelwani, I'm using MET for the first time. I'm using WRF
data(grib format) for precipitation as my forecast and TRMM
data(netcdf format) for observations. I'm trying to test this data
using grid-stat and mode tools. I'm experiencing an error ie
NetCDF: Attribute not found. Can you please assist.
>
> Thank you in advance.
>
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #62294] Error from gridstat
From: Elelwani Phaduli
Time: Tue Aug 06 06:06:40 2013
Hi
I have filled the registration form.
-----Original Message-----
From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
Sent: Thursday, July 18, 2013 7:21 PM
To: Elelwani Phaduli
Subject: Re: [rt.rap.ucar.edu #62294] Error from gridstat
Elewani,
I'd be happy to help you with the trouble you're having. But first, I
need you to fill out the free registration on the MET website. Due to
international export control laws within the United States, we're only
able to offer direct support to registered users.
Please go to the following page, fill in your email address, and hit
enter:
http://www.dtcenter.org/met/users/downloads/index.php
You should be taken to the registration form. Please email me back
once you've registered and we can get going on your issue.
Thanks,
John Halley Gotway
met_help at ucar.edu
On 07/18/2013 07:44 AM, Elelwani Phaduli via RT wrote:
>
> Thu Jul 18 07:44:53 2013: Request 62294 was acted upon.
> Transaction: Ticket created by Elelwani.Phaduli at weathersa.co.za
> Queue: met_help
> Subject: Error from gridstat
> Owner: Nobody
> Requestors: Elelwani.Phaduli at weathersa.co.za
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=62294
> >
>
>
>
> Hi
>
> My name is Elelwani, I'm using MET for the first time. I'm using WRF
data(grib format) for precipitation as my forecast and TRMM
data(netcdf format) for observations. I'm trying to test this data
using grid-stat and mode tools. I'm experiencing an error ie
NetCDF: Attribute not found. Can you please assist.
>
> Thank you in advance.
>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #62294] Error from gridstat
From: John Halley Gotway
Time: Tue Aug 06 09:28:14 2013
Elewani,
Thanks for filling out the registration info. I see from your
original email that you're trying to compare WRF output in GRIB format
to TRMM data in NetCDF format. That error "NetCDF: Attribute not
found" means something's wrong with the NetCDF file you're passing to
Grid-Stat and MODE.
Could you please send me a sample WRF file (GRIB) and the TRMM NetCDF
file you're using? Also, please tell me what version of MET you're
using. You can send me data by posting it to our anonymous
ftp site, following these instructions:
http://www.dtcenter.org/met/users/support/met_help.php#ftp
Please write me back once you've put it there, and I'll grab it. I'll
run it here through the debugger to figure out exactly where the
problem is.
Thanks,
John Halley Gotway
met_help at ucar.edu
On 08/06/2013 06:06 AM, Elelwani Phaduli via RT wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=62294 >
>
> Hi
>
> I have filled the registration form.
>
>
> -----Original Message-----
> From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> Sent: Thursday, July 18, 2013 7:21 PM
> To: Elelwani Phaduli
> Subject: Re: [rt.rap.ucar.edu #62294] Error from gridstat
>
> Elewani,
>
> I'd be happy to help you with the trouble you're having. But first,
I need you to fill out the free registration on the MET website. Due
to international export control laws within the United States, we're
only able to offer direct support to registered users.
>
> Please go to the following page, fill in your email address, and hit
enter:
> http://www.dtcenter.org/met/users/downloads/index.php
>
> You should be taken to the registration form. Please email me back
once you've registered and we can get going on your issue.
>
> Thanks,
> John Halley Gotway
> met_help at ucar.edu
>
> On 07/18/2013 07:44 AM, Elelwani Phaduli via RT wrote:
>>
>> Thu Jul 18 07:44:53 2013: Request 62294 was acted upon.
>> Transaction: Ticket created by Elelwani.Phaduli at weathersa.co.za
>> Queue: met_help
>> Subject: Error from gridstat
>> Owner: Nobody
>> Requestors: Elelwani.Phaduli at weathersa.co.za
>> Status: new
>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=62294
>>>
>>
>>
>>
>> Hi
>>
>> My name is Elelwani, I'm using MET for the first time. I'm using
WRF data(grib format) for precipitation as my forecast and TRMM
data(netcdf format) for observations. I'm trying to test this data
using grid-stat and mode tools. I'm experiencing an error ie
NetCDF: Attribute not found. Can you please assist.
>>
>> Thank you in advance.
>>
>
>
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #62294] Error from gridstat
From: Elelwani Phaduli
Time: Tue Aug 27 02:36:50 2013
Hi
This is Elelwani from South Africa, I want to run point stat tool, is
it possible to run the tool without PREPBUFR formatted files. If not
is it possible for me to get the data for my region.
Thank you in advance.
-----Original Message-----
From: Elelwani Phaduli
Sent: Tuesday, August 06, 2013 2:06 PM
To: 'met_help at ucar.edu'
Subject: RE: [rt.rap.ucar.edu #62294] Error from gridstat
Hi
I have filled the registration form.
-----Original Message-----
From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
Sent: Thursday, July 18, 2013 7:21 PM
To: Elelwani Phaduli
Subject: Re: [rt.rap.ucar.edu #62294] Error from gridstat
Elewani,
I'd be happy to help you with the trouble you're having. But first, I
need you to fill out the free registration on the MET website. Due to
international export control laws within the United States, we're only
able to offer direct support to registered users.
Please go to the following page, fill in your email address, and hit
enter:
http://www.dtcenter.org/met/users/downloads/index.php
You should be taken to the registration form. Please email me back
once you've registered and we can get going on your issue.
Thanks,
John Halley Gotway
met_help at ucar.edu
On 07/18/2013 07:44 AM, Elelwani Phaduli via RT wrote:
>
> Thu Jul 18 07:44:53 2013: Request 62294 was acted upon.
> Transaction: Ticket created by Elelwani.Phaduli at weathersa.co.za
> Queue: met_help
> Subject: Error from gridstat
> Owner: Nobody
> Requestors: Elelwani.Phaduli at weathersa.co.za
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=62294
> >
>
>
>
> Hi
>
> My name is Elelwani, I'm using MET for the first time. I'm using WRF
data(grib format) for precipitation as my forecast and TRMM
data(netcdf format) for observations. I'm trying to test this data
using grid-stat and mode tools. I'm experiencing an error ie
NetCDF: Attribute not found. Can you please assist.
>
> Thank you in advance.
>
------------------------------------------------
Subject: Error from gridstat
From: John Halley Gotway
Time: Tue Aug 27 10:36:34 2013
Elewani,
The point-stat tool is used to compared a gridded forecast file to
point observations. Those point observations must be in a NetCDF
format that MET expects. In METv4.1, there are 3 tools which put
observations into the expected format: pb2nc, madis2nc, and ascii2nc.
Those tools take as input PREPBUFR files from NCEP, MADIS NetCDF
files, and ASCII point observations, respectively.
If you have observations available that you'd like to use for
verification, I'd suggest using the ASCII2NC tool. You could probably
reformat them into the 11 column format that ascii2nc expects and
then prepare the data for point-stat.
If you do not have observations available, then I'd suggest starting
with the GDAS PREPBUFR observations from NCEP. GDAS stands for Global
Data Assimilation System and should include observations
over South Africa. For example, here's the steps I followed to check
that:
(1) Retrieve a recent PREPBUFR file:
wget
http://nomads.ncep.noaa.gov/pub/data/nccf/com/gfs/prod/gdas.20130826/gdas1.t12z.prepbufr.nr
(2) Run it through pb2nc to convert it:
METv4.1/bin/pb2nc gdas1.t12z.prepbufr.nr gdas1.t12z.prepbufr.nc
PB2NCConfig
(3) Run plot_point_obs to show the location of the data:
METv4.1/bin/plot_point_obs gdas1.t12z.prepbufr.nc
gdas1.t12z.prepbufr.ps -dotsize 0.25
(4) Convert the output PostScript image to a png:
convert -rotate 90 gdas1.t12z.prepbufr.ps gdas1.t12z.prepbufr.png
I've attached the resulting image. As you can see, the GDAS data does
contain some observations over South Africa. There is one dot in the
plot for each lat/lon location containing an observation.
But this is a mixture of all observation types available in the
PREPBUFR file.
Hope that helps.
Thanks,
John Halley Gotway
met_help at ucar.edu
On 08/27/2013 02:36 AM, Elelwani Phaduli via RT wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=62294 >
>
> Hi
>
> This is Elelwani from South Africa, I want to run point stat tool,
is it possible to run the tool without PREPBUFR formatted files. If
not is it possible for me to get the data for my region.
>
> Thank you in advance.
>
>
> -----Original Message-----
> From: Elelwani Phaduli
> Sent: Tuesday, August 06, 2013 2:06 PM
> To: 'met_help at ucar.edu'
> Subject: RE: [rt.rap.ucar.edu #62294] Error from gridstat
>
> Hi
>
> I have filled the registration form.
>
>
> -----Original Message-----
> From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> Sent: Thursday, July 18, 2013 7:21 PM
> To: Elelwani Phaduli
> Subject: Re: [rt.rap.ucar.edu #62294] Error from gridstat
>
> Elewani,
>
> I'd be happy to help you with the trouble you're having. But first,
I need you to fill out the free registration on the MET website. Due
to international export control laws within the United States, we're
only able to offer direct support to registered users.
>
> Please go to the following page, fill in your email address, and hit
enter:
> http://www.dtcenter.org/met/users/downloads/index.php
>
> You should be taken to the registration form. Please email me back
once you've registered and we can get going on your issue.
>
> Thanks,
> John Halley Gotway
> met_help at ucar.edu
>
> On 07/18/2013 07:44 AM, Elelwani Phaduli via RT wrote:
>>
>> Thu Jul 18 07:44:53 2013: Request 62294 was acted upon.
>> Transaction: Ticket created by Elelwani.Phaduli at weathersa.co.za
>> Queue: met_help
>> Subject: Error from gridstat
>> Owner: Nobody
>> Requestors: Elelwani.Phaduli at weathersa.co.za
>> Status: new
>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=62294
>>>
>>
>>
>>
>> Hi
>>
>> My name is Elelwani, I'm using MET for the first time. I'm using
WRF data(grib format) for precipitation as my forecast and TRMM
data(netcdf format) for observations. I'm trying to test this data
using grid-stat and mode tools. I'm experiencing an error ie
NetCDF: Attribute not found. Can you please assist.
>>
>> Thank you in advance.
>>
>
>
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #62294] Error from gridstat
From: Elelwani Phaduli
Time: Thu Sep 05 06:08:37 2013
Hi, I’m trying to run point_stat tool using the data below but I get
the error "fcst" not defined in this scope!. I have loaded my files
via FTP to the directory called phaduli_data under
incoming/irap/met_help. Can you please debug for me to see what might
be the problem.
Files : 2013071518_arw_d01.grb
: sample_pb.nc
: PointStatConfig_default
DEBUG 1: Default Config File:
/home/verification/METv4.1/data/config/PointStatConfig_default
DEBUG 1: User Config File:
/home/elelwani/METv4.1/PointStatConfig_default
ERROR :
ERROR : do_assign_id() -> identifier "fcst" not defined in this
scope!
ERROR :
My other question is if I have model data(Unified Model) other than
WRF which is gridded using a different table, how can I convert my
data so that it can be accepted by the MET tools.
-----Original Message-----
From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
Sent: Tuesday, August 27, 2013 6:37 PM
To: Elelwani Phaduli
Subject: Re: [rt.rap.ucar.edu #62294] Error from gridstat
Elewani,
The point-stat tool is used to compared a gridded forecast file to
point observations. Those point observations must be in a NetCDF
format that MET expects. In METv4.1, there are 3 tools which put
observations into the expected format: pb2nc, madis2nc, and ascii2nc.
Those tools take as input PREPBUFR files from NCEP, MADIS NetCDF
files, and ASCII point observations, respectively.
If you have observations available that you'd like to use for
verification, I'd suggest using the ASCII2NC tool. You could probably
reformat them into the 11 column format that ascii2nc expects and then
prepare the data for point-stat.
If you do not have observations available, then I'd suggest starting
with the GDAS PREPBUFR observations from NCEP. GDAS stands for Global
Data Assimilation System and should include observations over South
Africa. For example, here's the steps I followed to check that:
(1) Retrieve a recent PREPBUFR file:
wget
http://nomads.ncep.noaa.gov/pub/data/nccf/com/gfs/prod/gdas.20130826/gdas1.t12z.prepbufr.nr
(2) Run it through pb2nc to convert it:
METv4.1/bin/pb2nc gdas1.t12z.prepbufr.nr gdas1.t12z.prepbufr.nc
PB2NCConfig
(3) Run plot_point_obs to show the location of the data:
METv4.1/bin/plot_point_obs gdas1.t12z.prepbufr.nc
gdas1.t12z.prepbufr.ps -dotsize 0.25
(4) Convert the output PostScript image to a png:
convert -rotate 90 gdas1.t12z.prepbufr.ps gdas1.t12z.prepbufr.png
I've attached the resulting image. As you can see, the GDAS data does
contain some observations over South Africa. There is one dot in the
plot for each lat/lon location containing an observation.
But this is a mixture of all observation types available in the
PREPBUFR file.
Hope that helps.
Thanks,
John Halley Gotway
met_help at ucar.edu
On 08/27/2013 02:36 AM, Elelwani Phaduli via RT wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=62294 >
>
> Hi
>
> This is Elelwani from South Africa, I want to run point stat tool,
is it possible to run the tool without PREPBUFR formatted files. If
not is it possible for me to get the data for my region.
>
> Thank you in advance.
>
>
> -----Original Message-----
> From: Elelwani Phaduli
> Sent: Tuesday, August 06, 2013 2:06 PM
> To: 'met_help at ucar.edu'
> Subject: RE: [rt.rap.ucar.edu #62294] Error from gridstat
>
> Hi
>
> I have filled the registration form.
>
>
> -----Original Message-----
> From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> Sent: Thursday, July 18, 2013 7:21 PM
> To: Elelwani Phaduli
> Subject: Re: [rt.rap.ucar.edu #62294] Error from gridstat
>
> Elewani,
>
> I'd be happy to help you with the trouble you're having. But first,
I need you to fill out the free registration on the MET website. Due
to international export control laws within the United States, we're
only able to offer direct support to registered users.
>
> Please go to the following page, fill in your email address, and hit
enter:
> http://www.dtcenter.org/met/users/downloads/index.php
>
> You should be taken to the registration form. Please email me back
once you've registered and we can get going on your issue.
>
> Thanks,
> John Halley Gotway
> met_help at ucar.edu
>
> On 07/18/2013 07:44 AM, Elelwani Phaduli via RT wrote:
>>
>> Thu Jul 18 07:44:53 2013: Request 62294 was acted upon.
>> Transaction: Ticket created by Elelwani.Phaduli at weathersa.co.za
>> Queue: met_help
>> Subject: Error from gridstat
>> Owner: Nobody
>> Requestors: Elelwani.Phaduli at weathersa.co.za
>> Status: new
>> Ticket <URL:
>> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=62294
>>>
>>
>>
>>
>> Hi
>>
>> My name is Elelwani, I'm using MET for the first time. I'm using
WRF data(grib format) for precipitation as my forecast and TRMM
data(netcdf format) for observations. I'm trying to test this data
using grid-stat and mode tools. I'm experiencing an error ie
NetCDF: Attribute not found. Can you please assist.
>>
>> Thank you in advance.
>>
>
>
------------------------------------------------
Subject: Error from gridstat
From: John Halley Gotway
Time: Thu Sep 05 09:55:37 2013
Elewani,
I pulled your data and see the problem. You've defined the "field"
parameter outside of the "fcst" dictionary setting. Instead, "field"
needs to be a member of the "fcst" dictionary. Take a look at
the attached version of the config file, and you'll see what I mean.
Next, I see that your forecast file contains 73 lead times, hourly
from lead time 0 to 72. When I reran with the updated config file,
Point-Stat was grouping together all of the lead times into a
single verification task, trying to do all 73 times at once. Instead,
I specified a single lead time using:
lead_time = "120000";
Then Point-Stat only tried to verify the 12-hour lead time. But I
still got 0 matched pairs. To figure out why, I reran Point-Stat with
the verbosity level set to 3 (-v 3), and here's what I see in
the output:
DEBUG 2: Processing TMP/Z2 versus TMP/Z2, for observation type ADPUPA,
over region FULL, for interpolation method UW_MEAN(1), using 0 pairs.
DEBUG 3: Number of matched pairs = 0
DEBUG 3: Observations processed = 290206
DEBUG 3: Rejected: GRIB code = 284729
DEBUG 3: Rejected: valid time = 5477
DEBUG 3: Rejected: bad obs value = 0
DEBUG 3: Rejected: off the grid = 0
DEBUG 3: Rejected: level mismatch = 0
DEBUG 3: Rejected: quality marker = 0
DEBUG 3: Rejected: message type = 0
DEBUG 3: Rejected: masking region = 0
DEBUG 3: Rejected: bad fcst value = 0
DEBUG 3: Rejected: duplicates = 0
We have 0 matches because of a mis-match in the forecast and
observation valid times. So let's look at those. Using wgrib to list
the forecast file, I see that it was initialized at 2013071518. So
the valid times are anywhere between that time and that time plus 72
hours. Using ncdump to list the NetCDF point observation file (ncdump
-v hdr_vld), I see that the valid times are between
20130826_103000 and 20130826_133000.
So it looks like your forecast and observation valid times are off by
about 1 1/2 months. So you should grab the observations that are
valid at the forecast time you'd like to evaluate and try again.
Hope that helps get you going.
Thanks,
John Halley Gotway
met_help at ucar.edu
On 09/05/2013 06:08 AM, Elelwani Phaduli via RT wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=62294 >
>
> Hi, I’m trying to run point_stat tool using the data below but I get
the error "fcst" not defined in this scope!. I have loaded my files
via FTP to the directory called phaduli_data under
incoming/irap/met_help. Can you please debug for me to see what might
be the problem.
>
> Files : 2013071518_arw_d01.grb
> : sample_pb.nc
> : PointStatConfig_default
>
> DEBUG 1: Default Config File:
/home/verification/METv4.1/data/config/PointStatConfig_default
> DEBUG 1: User Config File:
/home/elelwani/METv4.1/PointStatConfig_default
> ERROR :
> ERROR : do_assign_id() -> identifier "fcst" not defined in this
scope!
> ERROR :
>
> My other question is if I have model data(Unified Model) other than
WRF which is gridded using a different table, how can I convert my
data so that it can be accepted by the MET tools.
>
>
> -----Original Message-----
> From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> Sent: Tuesday, August 27, 2013 6:37 PM
> To: Elelwani Phaduli
> Subject: Re: [rt.rap.ucar.edu #62294] Error from gridstat
>
> Elewani,
>
> The point-stat tool is used to compared a gridded forecast file to
point observations. Those point observations must be in a NetCDF
format that MET expects. In METv4.1, there are 3 tools which put
observations into the expected format: pb2nc, madis2nc, and ascii2nc.
Those tools take as input PREPBUFR files from NCEP, MADIS NetCDF
files, and ASCII point observations, respectively.
>
> If you have observations available that you'd like to use for
verification, I'd suggest using the ASCII2NC tool. You could probably
reformat them into the 11 column format that ascii2nc expects and then
prepare the data for point-stat.
>
> If you do not have observations available, then I'd suggest starting
with the GDAS PREPBUFR observations from NCEP. GDAS stands for Global
Data Assimilation System and should include observations over South
Africa. For example, here's the steps I followed to check that:
>
> (1) Retrieve a recent PREPBUFR file:
> wget
http://nomads.ncep.noaa.gov/pub/data/nccf/com/gfs/prod/gdas.20130826/gdas1.t12z.prepbufr.nr
>
> (2) Run it through pb2nc to convert it:
> METv4.1/bin/pb2nc gdas1.t12z.prepbufr.nr gdas1.t12z.prepbufr.nc
PB2NCConfig
>
> (3) Run plot_point_obs to show the location of the data:
> METv4.1/bin/plot_point_obs gdas1.t12z.prepbufr.nc
gdas1.t12z.prepbufr.ps -dotsize 0.25
>
> (4) Convert the output PostScript image to a png:
> convert -rotate 90 gdas1.t12z.prepbufr.ps
gdas1.t12z.prepbufr.png
>
> I've attached the resulting image. As you can see, the GDAS data
does contain some observations over South Africa. There is one dot in
the plot for each lat/lon location containing an observation.
> But this is a mixture of all observation types available in the
PREPBUFR file.
>
> Hope that helps.
>
> Thanks,
> John Halley Gotway
> met_help at ucar.edu
>
> On 08/27/2013 02:36 AM, Elelwani Phaduli via RT wrote:
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=62294 >
>>
>> Hi
>>
>> This is Elelwani from South Africa, I want to run point stat tool,
is it possible to run the tool without PREPBUFR formatted files. If
not is it possible for me to get the data for my region.
>>
>> Thank you in advance.
>>
>>
>> -----Original Message-----
>> From: Elelwani Phaduli
>> Sent: Tuesday, August 06, 2013 2:06 PM
>> To: 'met_help at ucar.edu'
>> Subject: RE: [rt.rap.ucar.edu #62294] Error from gridstat
>>
>> Hi
>>
>> I have filled the registration form.
>>
>>
>> -----Original Message-----
>> From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
>> Sent: Thursday, July 18, 2013 7:21 PM
>> To: Elelwani Phaduli
>> Subject: Re: [rt.rap.ucar.edu #62294] Error from gridstat
>>
>> Elewani,
>>
>> I'd be happy to help you with the trouble you're having. But
first, I need you to fill out the free registration on the MET
website. Due to international export control laws within the United
States, we're only able to offer direct support to registered users.
>>
>> Please go to the following page, fill in your email address, and
hit enter:
>> http://www.dtcenter.org/met/users/downloads/index.php
>>
>> You should be taken to the registration form. Please email me back
once you've registered and we can get going on your issue.
>>
>> Thanks,
>> John Halley Gotway
>> met_help at ucar.edu
>>
>> On 07/18/2013 07:44 AM, Elelwani Phaduli via RT wrote:
>>>
>>> Thu Jul 18 07:44:53 2013: Request 62294 was acted upon.
>>> Transaction: Ticket created by Elelwani.Phaduli at weathersa.co.za
>>> Queue: met_help
>>> Subject: Error from gridstat
>>> Owner: Nobody
>>> Requestors: Elelwani.Phaduli at weathersa.co.za
>>> Status: new
>>> Ticket <URL:
>>> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=62294
>>>>
>>>
>>>
>>>
>>> Hi
>>>
>>> My name is Elelwani, I'm using MET for the first time. I'm using
WRF data(grib format) for precipitation as my forecast and TRMM
data(netcdf format) for observations. I'm trying to test this data
using grid-stat and mode tools. I'm experiencing an error ie
NetCDF: Attribute not found. Can you please assist.
>>>
>>> Thank you in advance.
>>>
>>
>>
>
>
------------------------------------------------
Subject: Error from gridstat
From: John Halley Gotway
Time: Thu Sep 05 09:55:37 2013
////////////////////////////////////////////////////////////////////////////////
//
// Point-Stat configuration file.
//
// For additional information, see the MET_BASE/data/config/README
file.
//
////////////////////////////////////////////////////////////////////////////////
//
// Output model name to be written
//
model = "WRF";
////////////////////////////////////////////////////////////////////////////////
//
// Forecast and observation fields to be verified
//
fcst = {
wind_thresh = [ >0.0, >=1.0, >=5.0, >=8.0 ];
message_type = [ "ADPUPA", "ADPSFC" ];
lead_time = "120000";
field = [
{
name = "TMP";
level = "Z2";
cat_thresh = [ >278, >283, >288 ];
},
{
name = "TMP";
level = "P750-850";
cat_thresh = [ >278 ];
},
{
name = "UGRD";
level = "Z10";
cat_thresh = [ >=5.0 ];
},
{
name = "VGRD";
level = "Z10";
cat_thresh = [ >=5.0 ];
}
];
};
obs = fcst;
////////////////////////////////////////////////////////////////////////////////
//
// Point observation time window
//
obs_window = {
beg = -5400;
end = 5400;
}
////////////////////////////////////////////////////////////////////////////////
//
// Verification masking regions
//
mask = {
grid = [ "FULL" ];
poly = [];
sid = [];
};
////////////////////////////////////////////////////////////////////////////////
//
// Confidence interval settings
//
ci_alpha = [ 0.05 ];
boot = {
interval = PCTILE;
rep_prop = 1.0;
n_rep = 1000;
rng = "mt19937";
seed = "";
};
////////////////////////////////////////////////////////////////////////////////
//
// Interpolation methods
//
interp = {
vld_thresh = 1.0;
type = [
{
method = UW_MEAN;
width = 1;
}
];
};
////////////////////////////////////////////////////////////////////////////////
//
// Statistical output types
//
output_flag = {
fho = BOTH;
ctc = BOTH;
cts = BOTH;
mctc = BOTH;
mcts = BOTH;
cnt = BOTH;
sl1l2 = BOTH;
sal1l2 = BOTH;
vl1l2 = BOTH;
val1l2 = BOTH;
pct = BOTH;
pstd = BOTH;
pjc = BOTH;
prc = BOTH;
mpr = BOTH;
};
////////////////////////////////////////////////////////////////////////////////
obs_quality = [];
duplicate_flag = NONE;
rank_corr_flag = TRUE;
tmp_dir = "/tmp";
output_prefix = "";
version = "V4.1";
////////////////////////////////////////////////////////////////////////////////
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #62294] Error from gridstat
From: John Halley Gotway
Time: Thu Sep 05 09:58:14 2013
Elewani,
Regarding the other data from the Unified Model - is it in GRIB format
but it just uses a different table? The GRIB1 table information that
MET uses can be found it
METv4.1/data/table_files/nceptab_flat.txt. If your Unified Model data
is in GRIB format, you should be able to use it in MET. But if the
variable names don't match what you'd expect, you may need to
modify that table file to get it to do what you'd like.
Hope that helps.
Thanks,
John
On 09/05/2013 06:08 AM, Elelwani Phaduli via RT wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=62294 >
>
> Hi, I’m trying to run point_stat tool using the data below but I get
the error "fcst" not defined in this scope!. I have loaded my files
via FTP to the directory called phaduli_data under
incoming/irap/met_help. Can you please debug for me to see what might
be the problem.
>
> Files : 2013071518_arw_d01.grb
> : sample_pb.nc
> : PointStatConfig_default
>
> DEBUG 1: Default Config File:
/home/verification/METv4.1/data/config/PointStatConfig_default
> DEBUG 1: User Config File:
/home/elelwani/METv4.1/PointStatConfig_default
> ERROR :
> ERROR : do_assign_id() -> identifier "fcst" not defined in this
scope!
> ERROR :
>
> My other question is if I have model data(Unified Model) other than
WRF which is gridded using a different table, how can I convert my
data so that it can be accepted by the MET tools.
>
>
> -----Original Message-----
> From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> Sent: Tuesday, August 27, 2013 6:37 PM
> To: Elelwani Phaduli
> Subject: Re: [rt.rap.ucar.edu #62294] Error from gridstat
>
> Elewani,
>
> The point-stat tool is used to compared a gridded forecast file to
point observations. Those point observations must be in a NetCDF
format that MET expects. In METv4.1, there are 3 tools which put
observations into the expected format: pb2nc, madis2nc, and ascii2nc.
Those tools take as input PREPBUFR files from NCEP, MADIS NetCDF
files, and ASCII point observations, respectively.
>
> If you have observations available that you'd like to use for
verification, I'd suggest using the ASCII2NC tool. You could probably
reformat them into the 11 column format that ascii2nc expects and then
prepare the data for point-stat.
>
> If you do not have observations available, then I'd suggest starting
with the GDAS PREPBUFR observations from NCEP. GDAS stands for Global
Data Assimilation System and should include observations over South
Africa. For example, here's the steps I followed to check that:
>
> (1) Retrieve a recent PREPBUFR file:
> wget
http://nomads.ncep.noaa.gov/pub/data/nccf/com/gfs/prod/gdas.20130826/gdas1.t12z.prepbufr.nr
>
> (2) Run it through pb2nc to convert it:
> METv4.1/bin/pb2nc gdas1.t12z.prepbufr.nr gdas1.t12z.prepbufr.nc
PB2NCConfig
>
> (3) Run plot_point_obs to show the location of the data:
> METv4.1/bin/plot_point_obs gdas1.t12z.prepbufr.nc
gdas1.t12z.prepbufr.ps -dotsize 0.25
>
> (4) Convert the output PostScript image to a png:
> convert -rotate 90 gdas1.t12z.prepbufr.ps
gdas1.t12z.prepbufr.png
>
> I've attached the resulting image. As you can see, the GDAS data
does contain some observations over South Africa. There is one dot in
the plot for each lat/lon location containing an observation.
> But this is a mixture of all observation types available in the
PREPBUFR file.
>
> Hope that helps.
>
> Thanks,
> John Halley Gotway
> met_help at ucar.edu
>
> On 08/27/2013 02:36 AM, Elelwani Phaduli via RT wrote:
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=62294 >
>>
>> Hi
>>
>> This is Elelwani from South Africa, I want to run point stat tool,
is it possible to run the tool without PREPBUFR formatted files. If
not is it possible for me to get the data for my region.
>>
>> Thank you in advance.
>>
>>
>> -----Original Message-----
>> From: Elelwani Phaduli
>> Sent: Tuesday, August 06, 2013 2:06 PM
>> To: 'met_help at ucar.edu'
>> Subject: RE: [rt.rap.ucar.edu #62294] Error from gridstat
>>
>> Hi
>>
>> I have filled the registration form.
>>
>>
>> -----Original Message-----
>> From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
>> Sent: Thursday, July 18, 2013 7:21 PM
>> To: Elelwani Phaduli
>> Subject: Re: [rt.rap.ucar.edu #62294] Error from gridstat
>>
>> Elewani,
>>
>> I'd be happy to help you with the trouble you're having. But
first, I need you to fill out the free registration on the MET
website. Due to international export control laws within the United
States, we're only able to offer direct support to registered users.
>>
>> Please go to the following page, fill in your email address, and
hit enter:
>> http://www.dtcenter.org/met/users/downloads/index.php
>>
>> You should be taken to the registration form. Please email me back
once you've registered and we can get going on your issue.
>>
>> Thanks,
>> John Halley Gotway
>> met_help at ucar.edu
>>
>> On 07/18/2013 07:44 AM, Elelwani Phaduli via RT wrote:
>>>
>>> Thu Jul 18 07:44:53 2013: Request 62294 was acted upon.
>>> Transaction: Ticket created by Elelwani.Phaduli at weathersa.co.za
>>> Queue: met_help
>>> Subject: Error from gridstat
>>> Owner: Nobody
>>> Requestors: Elelwani.Phaduli at weathersa.co.za
>>> Status: new
>>> Ticket <URL:
>>> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=62294
>>>>
>>>
>>>
>>>
>>> Hi
>>>
>>> My name is Elelwani, I'm using MET for the first time. I'm using
WRF data(grib format) for precipitation as my forecast and TRMM
data(netcdf format) for observations. I'm trying to test this data
using grid-stat and mode tools. I'm experiencing an error ie
NetCDF: Attribute not found. Can you please assist.
>>>
>>> Thank you in advance.
>>>
>>
>>
>
>
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #62294] Resolved: Error from gridstat
From: Elelwani Phaduli
Time: Thu Mar 13 05:44:16 2014
Greetings................
mask = {
grid = [ " " ];
poly = [ "/home/elelwani/METv4.1/SA.poly ",
"/home/elelwani/METv4.1/gen_poly_mask/SA_poly.nc",
"/home/elelwani/METv4.1/2013080100_nmm_d01.grib"];
};
I'm trying to use pbnc to select the South African Domain, but it
keeps giving me the whole globe. I think the problem is with the grid
= [ " " ]; above. What do you suggest I use, because I think the
other files in poly=[..................] are okay.
-----Original Message-----
From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
Sent: Monday, October 14, 2013 10:21 PM
To: Elelwani Phaduli
Subject: [rt.rap.ucar.edu #62294] Resolved: Error from gridstat
According to our records, your request has been resolved. If you have
any further questions or concerns, please respond to this message.
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #62294] Resolved: Error from gridstat
From: John Halley Gotway
Time: Thu Mar 13 10:46:23 2014
Elelwani,
I see that you're trying to configure the PB2NC tool to retain
observations over South Africa. The configuration setting you sent me
look problematic. For PB2NC, the "mask.grid" and "mask.poly"
settings should be single strings, but you're using array syntax. Try
the following instead:
mask = {
grid = "";
poly = "/home/elelwani/METv4.1/gen_poly_mask/SA.poly";
};
You don't need to select multiple ways of masking the data. You just
define a single masking region and only keep observations falling in
that region. Please give that a try, and then use the
"plot_point_obs" utility to see if PB2NC filtered out the observation
locations the way you expected. If not, please send the "SA.poly"
file to me, and I'll take a closer look.
Thanks,
John Halley Gotway
met_help at ucar.edu
On 03/13/2014 05:44 AM, Elelwani Phaduli via RT wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=62294 >
>
> Greetings................
>
>
> mask = {
> grid = [ " " ];
> poly = [ "/home/elelwani/METv4.1/SA.poly ",
> "/home/elelwani/METv4.1/gen_poly_mask/SA_poly.nc",
> "/home/elelwani/METv4.1/2013080100_nmm_d01.grib"];
> };
>
> I'm trying to use pbnc to select the South African Domain, but it
keeps giving me the whole globe. I think the problem is with the grid
= [ " " ]; above. What do you suggest I use, because I think the
other files in poly=[..................] are okay.
>
>
> -----Original Message-----
> From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> Sent: Monday, October 14, 2013 10:21 PM
> To: Elelwani Phaduli
> Subject: [rt.rap.ucar.edu #62294] Resolved: Error from gridstat
>
> According to our records, your request has been resolved. If you
have any further questions or concerns, please respond to this
message.
>
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #62294] Resolved: Error from gridstat
From: Elelwani Phaduli
Time: Fri Mar 14 05:53:40 2014
Thank you very much. I worked perfectly.
-----Original Message-----
From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
Sent: Thursday, March 13, 2014 6:46 PM
To: Elelwani Phaduli
Subject: Re: [rt.rap.ucar.edu #62294] Resolved: Error from gridstat
Elelwani,
I see that you're trying to configure the PB2NC tool to retain
observations over South Africa. The configuration setting you sent me
look problematic. For PB2NC, the "mask.grid" and "mask.poly"
settings should be single strings, but you're using array syntax. Try
the following instead:
mask = {
grid = "";
poly = "/home/elelwani/METv4.1/gen_poly_mask/SA.poly";
};
You don't need to select multiple ways of masking the data. You just
define a single masking region and only keep observations falling in
that region. Please give that a try, and then use the
"plot_point_obs" utility to see if PB2NC filtered out the observation
locations the way you expected. If not, please send the "SA.poly"
file to me, and I'll take a closer look.
Thanks,
John Halley Gotway
met_help at ucar.edu
On 03/13/2014 05:44 AM, Elelwani Phaduli via RT wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=62294 >
>
> Greetings................
>
>
> mask = {
> grid = [ " " ];
> poly = [ "/home/elelwani/METv4.1/SA.poly ",
> "/home/elelwani/METv4.1/gen_poly_mask/SA_poly.nc",
> "/home/elelwani/METv4.1/2013080100_nmm_d01.grib"];
> };
>
> I'm trying to use pbnc to select the South African Domain, but it
keeps giving me the whole globe. I think the problem is with the grid
= [ " " ]; above. What do you suggest I use, because I think the
other files in poly=[..................] are okay.
>
>
> -----Original Message-----
> From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> Sent: Monday, October 14, 2013 10:21 PM
> To: Elelwani Phaduli
> Subject: [rt.rap.ucar.edu #62294] Resolved: Error from gridstat
>
> According to our records, your request has been resolved. If you
have any further questions or concerns, please respond to this
message.
>
------------------------------------------------
More information about the Met_help
mailing list