[Met_help] [rt.rap.ucar.edu #58409] History for Point_stat UGRD, VGRD, WIND issues
John Halley Gotway via RT
met_help at ucar.edu
Tue Sep 25 08:04:50 MDT 2012
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Good afternoon,
I am having issues with UGRD and VGRD (and also WIND) when running
point_stat. For some reason, in the MPR and CNT output text files, UGRD and
VGRD forecast averages are the same, so likely they are being read as the
same variable from the forecast file (or something like that). However, the
observed average UGRD and VGRD values are different. When I look in the
actual GRIB forecast files, UGRD and VGRD at 10m are different.
Also (and likely related to this previous error), I am getting very high
averages and errors in average forecast derived WIND values.
Finally, over the domain I am verifying, I am getting different stations
when I run point_stat over one of my forecasts as compared to another
iteration of the same forecast. Specifically, in the MPR text file, KNEL is
included in the statistics for the RTG file but not in the statistics for
the regular file (although it looks like KBLM takes the place of KNEL in
the regular file).
I have included all necessary files in the seroka_data directory on your
ftp site so you can attempt to replicate my errors. I have also included
the MPR and CNT files so you can see the errors that I have encountered.
The listing of files in seroka_data are as follows:
gdas.18550.2012081318.nc
NJ.poly
point_stat_170000L_20120813_170000V_cnt.txt
point_stat_170000L_20120813_170000V_mpr.txt
PointStatConfig_winds
RUWRF_3km_2012081300_17_00.grb2
RUWRF_RTG_3km_2012081300_17_00.grb2
The calls to point_stat (with my directory structure) are as follows:
~/METv4.0/bin/point_stat \
/home/coolgroup/bpu/wrf/RUWRF/20120813/RUWRF_3km_2012081300_17:00.grb2 \
/home/seroka/data/prepbufr/gdas.18550.2012081318.nc \
data/config/PointStatConfig_winds \
-outdir out/point_stat/rutgers/aug13/NJ -v 2
~/METv4.0/bin/point_stat \
/home/coolgroup/bpu/wrf/RUWRF/20120813/RTG/RUWRF_RTG_3km_2012081300_17:00.grb2
\
/home/seroka/data/prepbufr/gdas.18550.2012081318.nc \
data/config/PointStatConfig_winds \
-outdir out/point_stat/rutgers/aug13/NJ -v 2
Any help would be greatly appreciated. Please let me know if you have any
questions.
Thanks,
Greg
---
Greg Seroka
Ph.D. Candidate
Coastal Ocean Observation Lab
Institute of Marine and Coastal Sciences
Rutgers University
Email: seroka at marine.rutgers.edu
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: Point_stat UGRD, VGRD, WIND issues
From: John Halley Gotway
Time: Mon Sep 24 09:04:24 2012
Greg,
First of all, good job paying close attention to your data and
noticing these issues. I've downloaded your data, and here are the
step I went through to debug it.
First, I used wgrib2 to figure out that records 457 and 458 contain
UGRD and VGRD at 10 meters:
[johnhg at rambler]% wgrib2 RUWRF_3km_2012081300_17_00.grb2 | grep "10 m
above"
457:42995235:d=2012081300:UGRD:10 m above ground:17 hour fcst:
458:43109623:d=2012081300:VGRD:10 m above ground:17 hour fcst:
508:45171242:d=2012081300:var discipline=0 center=7 local_table=1
parmcat=2 parm=245:10 m above ground:17 hour fcst:
509:45285027:d=2012081300:var discipline=0 center=7 local_table=1
parmcat=2 parm=249:10 m above ground:17 hour fcst:
510:45405039:d=2012081300:var discipline=0 center=7 local_table=1
parmcat=2 parm=250:10 m above ground:17 hour fcst:
511:45524354:d=2012081300:var discipline=0 center=7 local_table=1
parmcat=2 parm=248:10 m above ground:17 hour fcst:
I do see some other records at 10 meters that wgrib2 doesn't
recognize, but I'll leave them for now.
Second, I used the plot_data_plane tool to look at those fields. See
attached images. I actually had some trouble doing this because
plot_data_plane kept erroring out saying that it does not
recognize some of the record data. So I first used wgrib to extract
those records into a separate file before plotting them:
wgrib2 RUWRF_3km_2012081300_17_00.grb2 | egrep "UGRD|VGRD" > inv
wgrib2 RUWRF_3km_2012081300_17_00.grb2 -grib_out winds.grb2 -i <
inv
Those errors are changed to warnings in the next version of MET.
Next, I ran your Point-Stat command, but ran into the same errors I
got when I ran plot_data_plane. So I switched the input file to be
that winds subset: winds.grb2.
With that I was able to reproduce the issue you're seeing. When MET
reads U and V wind components, it automatically rotates them from
being grid-relative to earth-relative, so that they're comparable
with point observations. I suspect there's something going in that
rotation in the context of GRIB2.
I talked with the developer who added support to MET for GRIB2, and
he's taking a look at the issue.
He'll let you know when he's able to figure out what's going on.
Thanks for finding this issue!
John
On 09/21/2012 12:29 PM, Greg Seroka via RT wrote:
>
> Fri Sep 21 12:29:33 2012: Request 58409 was acted upon.
> Transaction: Ticket created by seroka at marine.rutgers.edu
> Queue: met_help
> Subject: Point_stat UGRD, VGRD, WIND issues
> Owner: Nobody
> Requestors: seroka at marine.rutgers.edu
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=58409 >
>
>
> Good afternoon,
>
> I am having issues with UGRD and VGRD (and also WIND) when running
> point_stat. For some reason, in the MPR and CNT output text files,
UGRD and
> VGRD forecast averages are the same, so likely they are being read
as the
> same variable from the forecast file (or something like that).
However, the
> observed average UGRD and VGRD values are different. When I look in
the
> actual GRIB forecast files, UGRD and VGRD at 10m are different.
>
> Also (and likely related to this previous error), I am getting very
high
> averages and errors in average forecast derived WIND values.
>
> Finally, over the domain I am verifying, I am getting different
stations
> when I run point_stat over one of my forecasts as compared to
another
> iteration of the same forecast. Specifically, in the MPR text file,
KNEL is
> included in the statistics for the RTG file but not in the
statistics for
> the regular file (although it looks like KBLM takes the place of
KNEL in
> the regular file).
>
> I have included all necessary files in the seroka_data directory on
your
> ftp site so you can attempt to replicate my errors. I have also
included
> the MPR and CNT files so you can see the errors that I have
encountered.
> The listing of files in seroka_data are as follows:
>
> gdas.18550.2012081318.nc
> NJ.poly
> point_stat_170000L_20120813_170000V_cnt.txt
> point_stat_170000L_20120813_170000V_mpr.txt
> PointStatConfig_winds
> RUWRF_3km_2012081300_17_00.grb2
> RUWRF_RTG_3km_2012081300_17_00.grb2
>
> The calls to point_stat (with my directory structure) are as
follows:
>
> ~/METv4.0/bin/point_stat \
>
/home/coolgroup/bpu/wrf/RUWRF/20120813/RUWRF_3km_2012081300_17:00.grb2
\
> /home/seroka/data/prepbufr/gdas.18550.2012081318.nc \
> data/config/PointStatConfig_winds \
> -outdir out/point_stat/rutgers/aug13/NJ -v 2
>
> ~/METv4.0/bin/point_stat \
>
/home/coolgroup/bpu/wrf/RUWRF/20120813/RTG/RUWRF_RTG_3km_2012081300_17:00.grb2
> \
> /home/seroka/data/prepbufr/gdas.18550.2012081318.nc \
> data/config/PointStatConfig_winds \
> -outdir out/point_stat/rutgers/aug13/NJ -v 2
>
> Any help would be greatly appreciated. Please let me know if you
have any
> questions.
>
> Thanks,
> Greg
>
>
> ---
> Greg Seroka
> Ph.D. Candidate
> Coastal Ocean Observation Lab
> Institute of Marine and Coastal Sciences
> Rutgers University
> Email: seroka at marine.rutgers.edu
>
------------------------------------------------
Subject: Point_stat UGRD, VGRD, WIND issues
From: Greg Seroka
Time: Mon Sep 24 14:29:44 2012
John,
No problem. I'll eagerly await to hear from the other developer
regarding
this wind rotation issue.
Thanks,
Greg
----
Greg Seroka
Ph.D. Candidate
Coastal Ocean Observation Lab
Institute of Marine and Coastal Sciences
Rutgers University
Email: seroka at marine.rutgers.edu
On Mon, Sep 24, 2012 at 11:04 AM, John Halley Gotway via RT <
met_help at ucar.edu> wrote:
> Greg,
>
> First of all, good job paying close attention to your data and
noticing
> these issues. I've downloaded your data, and here are the step I
went
> through to debug it.
>
> First, I used wgrib2 to figure out that records 457 and 458 contain
UGRD
> and VGRD at 10 meters:
>
> [johnhg at rambler]% wgrib2 RUWRF_3km_2012081300_17_00.grb2 | grep "10
m
> above"
> 457:42995235:d=2012081300:UGRD:10 m above ground:17 hour fcst:
> 458:43109623:d=2012081300:VGRD:10 m above ground:17 hour fcst:
> 508:45171242:d=2012081300:var discipline=0 center=7 local_table=1
> parmcat=2 parm=245:10 m above ground:17 hour fcst:
> 509:45285027:d=2012081300:var discipline=0 center=7 local_table=1
> parmcat=2 parm=249:10 m above ground:17 hour fcst:
> 510:45405039:d=2012081300:var discipline=0 center=7 local_table=1
> parmcat=2 parm=250:10 m above ground:17 hour fcst:
> 511:45524354:d=2012081300:var discipline=0 center=7 local_table=1
> parmcat=2 parm=248:10 m above ground:17 hour fcst:
>
> I do see some other records at 10 meters that wgrib2 doesn't
recognize,
> but I'll leave them for now.
>
> Second, I used the plot_data_plane tool to look at those fields.
See
> attached images. I actually had some trouble doing this because
> plot_data_plane kept erroring out saying that it does not
> recognize some of the record data. So I first used wgrib to extract
those
> records into a separate file before plotting them:
> wgrib2 RUWRF_3km_2012081300_17_00.grb2 | egrep "UGRD|VGRD" > inv
> wgrib2 RUWRF_3km_2012081300_17_00.grb2 -grib_out winds.grb2 -i <
inv
>
> Those errors are changed to warnings in the next version of MET.
>
> Next, I ran your Point-Stat command, but ran into the same errors I
got
> when I ran plot_data_plane. So I switched the input file to be that
winds
> subset: winds.grb2.
>
> With that I was able to reproduce the issue you're seeing. When MET
reads
> U and V wind components, it automatically rotates them from being
> grid-relative to earth-relative, so that they're comparable
> with point observations. I suspect there's something going in that
> rotation in the context of GRIB2.
>
> I talked with the developer who added support to MET for GRIB2, and
he's
> taking a look at the issue.
>
> He'll let you know when he's able to figure out what's going on.
>
> Thanks for finding this issue!
>
> John
>
> On 09/21/2012 12:29 PM, Greg Seroka via RT wrote:
> >
> > Fri Sep 21 12:29:33 2012: Request 58409 was acted upon.
> > Transaction: Ticket created by seroka at marine.rutgers.edu
> > Queue: met_help
> > Subject: Point_stat UGRD, VGRD, WIND issues
> > Owner: Nobody
> > Requestors: seroka at marine.rutgers.edu
> > Status: new
> > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=58409 >
> >
> >
> > Good afternoon,
> >
> > I am having issues with UGRD and VGRD (and also WIND) when running
> > point_stat. For some reason, in the MPR and CNT output text files,
UGRD
> and
> > VGRD forecast averages are the same, so likely they are being read
as the
> > same variable from the forecast file (or something like that).
However,
> the
> > observed average UGRD and VGRD values are different. When I look
in the
> > actual GRIB forecast files, UGRD and VGRD at 10m are different.
> >
> > Also (and likely related to this previous error), I am getting
very high
> > averages and errors in average forecast derived WIND values.
> >
> > Finally, over the domain I am verifying, I am getting different
stations
> > when I run point_stat over one of my forecasts as compared to
another
> > iteration of the same forecast. Specifically, in the MPR text
file, KNEL
> is
> > included in the statistics for the RTG file but not in the
statistics for
> > the regular file (although it looks like KBLM takes the place of
KNEL in
> > the regular file).
> >
> > I have included all necessary files in the seroka_data directory
on your
> > ftp site so you can attempt to replicate my errors. I have also
included
> > the MPR and CNT files so you can see the errors that I have
encountered.
> > The listing of files in seroka_data are as follows:
> >
> > gdas.18550.2012081318.nc
> > NJ.poly
> > point_stat_170000L_20120813_170000V_cnt.txt
> > point_stat_170000L_20120813_170000V_mpr.txt
> > PointStatConfig_winds
> > RUWRF_3km_2012081300_17_00.grb2
> > RUWRF_RTG_3km_2012081300_17_00.grb2
> >
> > The calls to point_stat (with my directory structure) are as
follows:
> >
> > ~/METv4.0/bin/point_stat \
> >
/home/coolgroup/bpu/wrf/RUWRF/20120813/RUWRF_3km_2012081300_17:00.grb2
> \
> > /home/seroka/data/prepbufr/gdas.18550.2012081318.nc \
> > data/config/PointStatConfig_winds \
> > -outdir out/point_stat/rutgers/aug13/NJ -v 2
> >
> > ~/METv4.0/bin/point_stat \
> >
/home/coolgroup/bpu/wrf/RUWRF/20120813/RTG/RUWRF_RTG_3km_2012081300
> _17:00.grb2
> > \
> > /home/seroka/data/prepbufr/gdas.18550.2012081318.nc \
> > data/config/PointStatConfig_winds \
> > -outdir out/point_stat/rutgers/aug13/NJ -v 2
> >
> > Any help would be greatly appreciated. Please let me know if you
have any
> > questions.
> >
> > Thanks,
> > Greg
> >
> >
> > ---
> > Greg Seroka
> > Ph.D. Candidate
> > Coastal Ocean Observation Lab
> > Institute of Marine and Coastal Sciences
> > Rutgers University
> > Email: seroka at marine.rutgers.edu
> >
>
>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #58409] Point_stat UGRD, VGRD, WIND issues
From: Paul Oldenburg
Time: Mon Sep 24 15:12:15 2012
Greg,
You found a rather important bug in the MET support for GRIB2, so I
appreciate your reporting the problem with duplicate
forecast field values. To address this problem, I pushed out a new
patch for MET that you can download and apply by
following the instructions on this site:
http://www.dtcenter.org/met/users/support/known_issues/METv4.0/index.php
As for the inconsistent inclusion of stations between the two model
data files, I am not able to reproduce this
behavior. I ran identical point_stat commands on each file, and while
the forecast values are different, the stations
included are the same. Furthermore, they are the same as the list of
stations that are included in the MPR file. Can
you please describe how to produce the differing list of stations?
Maybe I'm not understanding what the problem is.
Thanks,
Paul
On 09/24/2012 02:29 PM, Greg Seroka via RT wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=58409 >
>
> John,
>
> No problem. I'll eagerly await to hear from the other developer
regarding
> this wind rotation issue.
>
> Thanks,
> Greg
>
> ----
> Greg Seroka
> Ph.D. Candidate
> Coastal Ocean Observation Lab
> Institute of Marine and Coastal Sciences
> Rutgers University
> Email: seroka at marine.rutgers.edu
>
>
>
> On Mon, Sep 24, 2012 at 11:04 AM, John Halley Gotway via RT <
> met_help at ucar.edu> wrote:
>
>> Greg,
>>
>> First of all, good job paying close attention to your data and
noticing
>> these issues. I've downloaded your data, and here are the step I
went
>> through to debug it.
>>
>> First, I used wgrib2 to figure out that records 457 and 458 contain
UGRD
>> and VGRD at 10 meters:
>>
>> [johnhg at rambler]% wgrib2 RUWRF_3km_2012081300_17_00.grb2 | grep "10
m
>> above"
>> 457:42995235:d=2012081300:UGRD:10 m above ground:17 hour fcst:
>> 458:43109623:d=2012081300:VGRD:10 m above ground:17 hour fcst:
>> 508:45171242:d=2012081300:var discipline=0 center=7 local_table=1
>> parmcat=2 parm=245:10 m above ground:17 hour fcst:
>> 509:45285027:d=2012081300:var discipline=0 center=7 local_table=1
>> parmcat=2 parm=249:10 m above ground:17 hour fcst:
>> 510:45405039:d=2012081300:var discipline=0 center=7 local_table=1
>> parmcat=2 parm=250:10 m above ground:17 hour fcst:
>> 511:45524354:d=2012081300:var discipline=0 center=7 local_table=1
>> parmcat=2 parm=248:10 m above ground:17 hour fcst:
>>
>> I do see some other records at 10 meters that wgrib2 doesn't
recognize,
>> but I'll leave them for now.
>>
>> Second, I used the plot_data_plane tool to look at those fields.
See
>> attached images. I actually had some trouble doing this because
>> plot_data_plane kept erroring out saying that it does not
>> recognize some of the record data. So I first used wgrib to
extract those
>> records into a separate file before plotting them:
>> wgrib2 RUWRF_3km_2012081300_17_00.grb2 | egrep "UGRD|VGRD" >
inv
>> wgrib2 RUWRF_3km_2012081300_17_00.grb2 -grib_out winds.grb2 -i
< inv
>>
>> Those errors are changed to warnings in the next version of MET.
>>
>> Next, I ran your Point-Stat command, but ran into the same errors I
got
>> when I ran plot_data_plane. So I switched the input file to be
that winds
>> subset: winds.grb2.
>>
>> With that I was able to reproduce the issue you're seeing. When
MET reads
>> U and V wind components, it automatically rotates them from being
>> grid-relative to earth-relative, so that they're comparable
>> with point observations. I suspect there's something going in that
>> rotation in the context of GRIB2.
>>
>> I talked with the developer who added support to MET for GRIB2, and
he's
>> taking a look at the issue.
>>
>> He'll let you know when he's able to figure out what's going on.
>>
>> Thanks for finding this issue!
>>
>> John
>>
>> On 09/21/2012 12:29 PM, Greg Seroka via RT wrote:
>>>
>>> Fri Sep 21 12:29:33 2012: Request 58409 was acted upon.
>>> Transaction: Ticket created by seroka at marine.rutgers.edu
>>> Queue: met_help
>>> Subject: Point_stat UGRD, VGRD, WIND issues
>>> Owner: Nobody
>>> Requestors: seroka at marine.rutgers.edu
>>> Status: new
>>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=58409 >
>>>
>>>
>>> Good afternoon,
>>>
>>> I am having issues with UGRD and VGRD (and also WIND) when running
>>> point_stat. For some reason, in the MPR and CNT output text files,
UGRD
>> and
>>> VGRD forecast averages are the same, so likely they are being read
as the
>>> same variable from the forecast file (or something like that).
However,
>> the
>>> observed average UGRD and VGRD values are different. When I look
in the
>>> actual GRIB forecast files, UGRD and VGRD at 10m are different.
>>>
>>> Also (and likely related to this previous error), I am getting
very high
>>> averages and errors in average forecast derived WIND values.
>>>
>>> Finally, over the domain I am verifying, I am getting different
stations
>>> when I run point_stat over one of my forecasts as compared to
another
>>> iteration of the same forecast. Specifically, in the MPR text
file, KNEL
>> is
>>> included in the statistics for the RTG file but not in the
statistics for
>>> the regular file (although it looks like KBLM takes the place of
KNEL in
>>> the regular file).
>>>
>>> I have included all necessary files in the seroka_data directory
on your
>>> ftp site so you can attempt to replicate my errors. I have also
included
>>> the MPR and CNT files so you can see the errors that I have
encountered.
>>> The listing of files in seroka_data are as follows:
>>>
>>> gdas.18550.2012081318.nc
>>> NJ.poly
>>> point_stat_170000L_20120813_170000V_cnt.txt
>>> point_stat_170000L_20120813_170000V_mpr.txt
>>> PointStatConfig_winds
>>> RUWRF_3km_2012081300_17_00.grb2
>>> RUWRF_RTG_3km_2012081300_17_00.grb2
>>>
>>> The calls to point_stat (with my directory structure) are as
follows:
>>>
>>> ~/METv4.0/bin/point_stat \
>>>
/home/coolgroup/bpu/wrf/RUWRF/20120813/RUWRF_3km_2012081300_17:00.grb2
>> \
>>> /home/seroka/data/prepbufr/gdas.18550.2012081318.nc \
>>> data/config/PointStatConfig_winds \
>>> -outdir out/point_stat/rutgers/aug13/NJ -v 2
>>>
>>> ~/METv4.0/bin/point_stat \
>>>
/home/coolgroup/bpu/wrf/RUWRF/20120813/RTG/RUWRF_RTG_3km_2012081300
>> _17:00.grb2
>>> \
>>> /home/seroka/data/prepbufr/gdas.18550.2012081318.nc \
>>> data/config/PointStatConfig_winds \
>>> -outdir out/point_stat/rutgers/aug13/NJ -v 2
>>>
>>> Any help would be greatly appreciated. Please let me know if you
have any
>>> questions.
>>>
>>> Thanks,
>>> Greg
>>>
>>>
>>> ---
>>> Greg Seroka
>>> Ph.D. Candidate
>>> Coastal Ocean Observation Lab
>>> Institute of Marine and Coastal Sciences
>>> Rutgers University
>>> Email: seroka at marine.rutgers.edu
>>>
>>
>>
------------------------------------------------
Subject: Point_stat UGRD, VGRD, WIND issues
From: Greg Seroka
Time: Mon Sep 24 17:05:33 2012
Paul,
Thanks so much for fixing this problem and producing the patch. I have
downloaded the patch and rebuilt MET and it works like a charm.
As for the station issue, I have found I was mistaken in claiming this
error. For some reason I had thought I was looking at two of the same
file
but for different model runs, but I wasn't.
Maybe you're able to answer my last question: do you know what
MASKSTID
means in the station ID list (in the BUFR data file)? The only thing I
can
find online is that it is a current ship observation. I am hesitant to
include this in the validation scheme until I learn more about it.
Thank you,
Greg
---
Greg Seroka
Ph.D. Candidate
Coastal Ocean Observation Lab
Institute of Marine and Coastal Sciences
Rutgers University
Email: seroka at marine.rutgers.edu
On Mon, Sep 24, 2012 at 5:12 PM, Paul Oldenburg via RT
<met_help at ucar.edu>wrote:
> Greg,
>
> You found a rather important bug in the MET support for GRIB2, so I
> appreciate your reporting the problem with duplicate
> forecast field values. To address this problem, I pushed out a new
patch
> for MET that you can download and apply by
> following the instructions on this site:
>
>
http://www.dtcenter.org/met/users/support/known_issues/METv4.0/index.php
>
> As for the inconsistent inclusion of stations between the two model
data
> files, I am not able to reproduce this
> behavior. I ran identical point_stat commands on each file, and
while the
> forecast values are different, the stations
> included are the same. Furthermore, they are the same as the list
of
> stations that are included in the MPR file. Can
> you please describe how to produce the differing list of stations?
Maybe
> I'm not understanding what the problem is.
>
> Thanks,
>
> Paul
>
>
> On 09/24/2012 02:29 PM, Greg Seroka via RT wrote:
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=58409 >
> >
> > John,
> >
> > No problem. I'll eagerly await to hear from the other developer
regarding
> > this wind rotation issue.
> >
> > Thanks,
> > Greg
> >
> > ----
> > Greg Seroka
> > Ph.D. Candidate
> > Coastal Ocean Observation Lab
> > Institute of Marine and Coastal Sciences
> > Rutgers University
> > Email: seroka at marine.rutgers.edu
> >
> >
> >
> > On Mon, Sep 24, 2012 at 11:04 AM, John Halley Gotway via RT <
> > met_help at ucar.edu> wrote:
> >
> >> Greg,
> >>
> >> First of all, good job paying close attention to your data and
noticing
> >> these issues. I've downloaded your data, and here are the step I
went
> >> through to debug it.
> >>
> >> First, I used wgrib2 to figure out that records 457 and 458
contain UGRD
> >> and VGRD at 10 meters:
> >>
> >> [johnhg at rambler]% wgrib2 RUWRF_3km_2012081300_17_00.grb2 | grep
"10 m
> >> above"
> >> 457:42995235:d=2012081300:UGRD:10 m above ground:17 hour fcst:
> >> 458:43109623:d=2012081300:VGRD:10 m above ground:17 hour fcst:
> >> 508:45171242:d=2012081300:var discipline=0 center=7 local_table=1
> >> parmcat=2 parm=245:10 m above ground:17 hour fcst:
> >> 509:45285027:d=2012081300:var discipline=0 center=7 local_table=1
> >> parmcat=2 parm=249:10 m above ground:17 hour fcst:
> >> 510:45405039:d=2012081300:var discipline=0 center=7 local_table=1
> >> parmcat=2 parm=250:10 m above ground:17 hour fcst:
> >> 511:45524354:d=2012081300:var discipline=0 center=7 local_table=1
> >> parmcat=2 parm=248:10 m above ground:17 hour fcst:
> >>
> >> I do see some other records at 10 meters that wgrib2 doesn't
recognize,
> >> but I'll leave them for now.
> >>
> >> Second, I used the plot_data_plane tool to look at those fields.
See
> >> attached images. I actually had some trouble doing this because
> >> plot_data_plane kept erroring out saying that it does not
> >> recognize some of the record data. So I first used wgrib to
extract
> those
> >> records into a separate file before plotting them:
> >> wgrib2 RUWRF_3km_2012081300_17_00.grb2 | egrep "UGRD|VGRD" >
inv
> >> wgrib2 RUWRF_3km_2012081300_17_00.grb2 -grib_out winds.grb2
-i <
> inv
> >>
> >> Those errors are changed to warnings in the next version of MET.
> >>
> >> Next, I ran your Point-Stat command, but ran into the same errors
I got
> >> when I ran plot_data_plane. So I switched the input file to be
that
> winds
> >> subset: winds.grb2.
> >>
> >> With that I was able to reproduce the issue you're seeing. When
MET
> reads
> >> U and V wind components, it automatically rotates them from being
> >> grid-relative to earth-relative, so that they're comparable
> >> with point observations. I suspect there's something going in
that
> >> rotation in the context of GRIB2.
> >>
> >> I talked with the developer who added support to MET for GRIB2,
and he's
> >> taking a look at the issue.
> >>
> >> He'll let you know when he's able to figure out what's going on.
> >>
> >> Thanks for finding this issue!
> >>
> >> John
> >>
> >> On 09/21/2012 12:29 PM, Greg Seroka via RT wrote:
> >>>
> >>> Fri Sep 21 12:29:33 2012: Request 58409 was acted upon.
> >>> Transaction: Ticket created by seroka at marine.rutgers.edu
> >>> Queue: met_help
> >>> Subject: Point_stat UGRD, VGRD, WIND issues
> >>> Owner: Nobody
> >>> Requestors: seroka at marine.rutgers.edu
> >>> Status: new
> >>> Ticket <URL:
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=58409 >
> >>>
> >>>
> >>> Good afternoon,
> >>>
> >>> I am having issues with UGRD and VGRD (and also WIND) when
running
> >>> point_stat. For some reason, in the MPR and CNT output text
files, UGRD
> >> and
> >>> VGRD forecast averages are the same, so likely they are being
read as
> the
> >>> same variable from the forecast file (or something like that).
However,
> >> the
> >>> observed average UGRD and VGRD values are different. When I look
in the
> >>> actual GRIB forecast files, UGRD and VGRD at 10m are different.
> >>>
> >>> Also (and likely related to this previous error), I am getting
very
> high
> >>> averages and errors in average forecast derived WIND values.
> >>>
> >>> Finally, over the domain I am verifying, I am getting different
> stations
> >>> when I run point_stat over one of my forecasts as compared to
another
> >>> iteration of the same forecast. Specifically, in the MPR text
file,
> KNEL
> >> is
> >>> included in the statistics for the RTG file but not in the
statistics
> for
> >>> the regular file (although it looks like KBLM takes the place of
KNEL
> in
> >>> the regular file).
> >>>
> >>> I have included all necessary files in the seroka_data directory
on
> your
> >>> ftp site so you can attempt to replicate my errors. I have also
> included
> >>> the MPR and CNT files so you can see the errors that I have
> encountered.
> >>> The listing of files in seroka_data are as follows:
> >>>
> >>> gdas.18550.2012081318.nc
> >>> NJ.poly
> >>> point_stat_170000L_20120813_170000V_cnt.txt
> >>> point_stat_170000L_20120813_170000V_mpr.txt
> >>> PointStatConfig_winds
> >>> RUWRF_3km_2012081300_17_00.grb2
> >>> RUWRF_RTG_3km_2012081300_17_00.grb2
> >>>
> >>> The calls to point_stat (with my directory structure) are as
follows:
> >>>
> >>> ~/METv4.0/bin/point_stat \
> >>> /home/coolgroup/bpu/wrf/RUWRF/20120813/RUWRF_3km_2012081300
> _17:00.grb2
> >> \
> >>> /home/seroka/data/prepbufr/gdas.18550.2012081318.nc \
> >>> data/config/PointStatConfig_winds \
> >>> -outdir out/point_stat/rutgers/aug13/NJ -v 2
> >>>
> >>> ~/METv4.0/bin/point_stat \
> >>> /home/coolgroup/bpu/wrf/RUWRF/20120813/RTG/RUWRF_RTG_3km_
> 2012081300
> >> _17:00.grb2
> >>> \
> >>> /home/seroka/data/prepbufr/gdas.18550.2012081318.nc \
> >>> data/config/PointStatConfig_winds \
> >>> -outdir out/point_stat/rutgers/aug13/NJ -v 2
> >>>
> >>> Any help would be greatly appreciated. Please let me know if you
have
> any
> >>> questions.
> >>>
> >>> Thanks,
> >>> Greg
> >>>
> >>>
> >>> ---
> >>> Greg Seroka
> >>> Ph.D. Candidate
> >>> Coastal Ocean Observation Lab
> >>> Institute of Marine and Coastal Sciences
> >>> Rutgers University
> >>> Email: seroka at marine.rutgers.edu
> >>>
> >>
> >>
>
>
>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #58409] Point_stat UGRD, VGRD, WIND issues
From: Paul Oldenburg
Time: Tue Sep 25 08:00:19 2012
Greg,
I'm sorry we can't be more help decoding the meaning of MASKSTID, but
we're not familiar with its use. I googled "bufr
maskstid" and the first hit was some NCEP fortran with several
mentions of it in the comments, but these did not answer
the basic question. You might try to emailing the BUFRLIB helpdesk,
whose contact information is at the bottom of this
page: http://www.nco.ncep.noaa.gov/sib/decoders/BUFRLIB/. Good luck.
Paul
On 09/24/2012 05:05 PM, Greg Seroka via RT wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=58409 >
>
> Paul,
>
> Thanks so much for fixing this problem and producing the patch. I
have
> downloaded the patch and rebuilt MET and it works like a charm.
>
> As for the station issue, I have found I was mistaken in claiming
this
> error. For some reason I had thought I was looking at two of the
same file
> but for different model runs, but I wasn't.
>
> Maybe you're able to answer my last question: do you know what
MASKSTID
> means in the station ID list (in the BUFR data file)? The only thing
I can
> find online is that it is a current ship observation. I am hesitant
to
> include this in the validation scheme until I learn more about it.
>
> Thank you,
> Greg
>
> ---
> Greg Seroka
> Ph.D. Candidate
> Coastal Ocean Observation Lab
> Institute of Marine and Coastal Sciences
> Rutgers University
> Email: seroka at marine.rutgers.edu
>
>
>
> On Mon, Sep 24, 2012 at 5:12 PM, Paul Oldenburg via RT
<met_help at ucar.edu>wrote:
>
>> Greg,
>>
>> You found a rather important bug in the MET support for GRIB2, so I
>> appreciate your reporting the problem with duplicate
>> forecast field values. To address this problem, I pushed out a new
patch
>> for MET that you can download and apply by
>> following the instructions on this site:
>>
>>
http://www.dtcenter.org/met/users/support/known_issues/METv4.0/index.php
>>
>> As for the inconsistent inclusion of stations between the two model
data
>> files, I am not able to reproduce this
>> behavior. I ran identical point_stat commands on each file, and
while the
>> forecast values are different, the stations
>> included are the same. Furthermore, they are the same as the list
of
>> stations that are included in the MPR file. Can
>> you please describe how to produce the differing list of stations?
Maybe
>> I'm not understanding what the problem is.
>>
>> Thanks,
>>
>> Paul
>>
>>
>> On 09/24/2012 02:29 PM, Greg Seroka via RT wrote:
>>>
>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=58409 >
>>>
>>> John,
>>>
>>> No problem. I'll eagerly await to hear from the other developer
regarding
>>> this wind rotation issue.
>>>
>>> Thanks,
>>> Greg
>>>
>>> ----
>>> Greg Seroka
>>> Ph.D. Candidate
>>> Coastal Ocean Observation Lab
>>> Institute of Marine and Coastal Sciences
>>> Rutgers University
>>> Email: seroka at marine.rutgers.edu
>>>
>>>
>>>
>>> On Mon, Sep 24, 2012 at 11:04 AM, John Halley Gotway via RT <
>>> met_help at ucar.edu> wrote:
>>>
>>>> Greg,
>>>>
>>>> First of all, good job paying close attention to your data and
noticing
>>>> these issues. I've downloaded your data, and here are the step I
went
>>>> through to debug it.
>>>>
>>>> First, I used wgrib2 to figure out that records 457 and 458
contain UGRD
>>>> and VGRD at 10 meters:
>>>>
>>>> [johnhg at rambler]% wgrib2 RUWRF_3km_2012081300_17_00.grb2 | grep
"10 m
>>>> above"
>>>> 457:42995235:d=2012081300:UGRD:10 m above ground:17 hour fcst:
>>>> 458:43109623:d=2012081300:VGRD:10 m above ground:17 hour fcst:
>>>> 508:45171242:d=2012081300:var discipline=0 center=7 local_table=1
>>>> parmcat=2 parm=245:10 m above ground:17 hour fcst:
>>>> 509:45285027:d=2012081300:var discipline=0 center=7 local_table=1
>>>> parmcat=2 parm=249:10 m above ground:17 hour fcst:
>>>> 510:45405039:d=2012081300:var discipline=0 center=7 local_table=1
>>>> parmcat=2 parm=250:10 m above ground:17 hour fcst:
>>>> 511:45524354:d=2012081300:var discipline=0 center=7 local_table=1
>>>> parmcat=2 parm=248:10 m above ground:17 hour fcst:
>>>>
>>>> I do see some other records at 10 meters that wgrib2 doesn't
recognize,
>>>> but I'll leave them for now.
>>>>
>>>> Second, I used the plot_data_plane tool to look at those fields.
See
>>>> attached images. I actually had some trouble doing this because
>>>> plot_data_plane kept erroring out saying that it does not
>>>> recognize some of the record data. So I first used wgrib to
extract
>> those
>>>> records into a separate file before plotting them:
>>>> wgrib2 RUWRF_3km_2012081300_17_00.grb2 | egrep "UGRD|VGRD"
> inv
>>>> wgrib2 RUWRF_3km_2012081300_17_00.grb2 -grib_out winds.grb2
-i <
>> inv
>>>>
>>>> Those errors are changed to warnings in the next version of MET.
>>>>
>>>> Next, I ran your Point-Stat command, but ran into the same errors
I got
>>>> when I ran plot_data_plane. So I switched the input file to be
that
>> winds
>>>> subset: winds.grb2.
>>>>
>>>> With that I was able to reproduce the issue you're seeing. When
MET
>> reads
>>>> U and V wind components, it automatically rotates them from being
>>>> grid-relative to earth-relative, so that they're comparable
>>>> with point observations. I suspect there's something going in
that
>>>> rotation in the context of GRIB2.
>>>>
>>>> I talked with the developer who added support to MET for GRIB2,
and he's
>>>> taking a look at the issue.
>>>>
>>>> He'll let you know when he's able to figure out what's going on.
>>>>
>>>> Thanks for finding this issue!
>>>>
>>>> John
>>>>
>>>> On 09/21/2012 12:29 PM, Greg Seroka via RT wrote:
>>>>>
>>>>> Fri Sep 21 12:29:33 2012: Request 58409 was acted upon.
>>>>> Transaction: Ticket created by seroka at marine.rutgers.edu
>>>>> Queue: met_help
>>>>> Subject: Point_stat UGRD, VGRD, WIND issues
>>>>> Owner: Nobody
>>>>> Requestors: seroka at marine.rutgers.edu
>>>>> Status: new
>>>>> Ticket <URL:
>> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=58409 >
>>>>>
>>>>>
>>>>> Good afternoon,
>>>>>
>>>>> I am having issues with UGRD and VGRD (and also WIND) when
running
>>>>> point_stat. For some reason, in the MPR and CNT output text
files, UGRD
>>>> and
>>>>> VGRD forecast averages are the same, so likely they are being
read as
>> the
>>>>> same variable from the forecast file (or something like that).
However,
>>>> the
>>>>> observed average UGRD and VGRD values are different. When I look
in the
>>>>> actual GRIB forecast files, UGRD and VGRD at 10m are different.
>>>>>
>>>>> Also (and likely related to this previous error), I am getting
very
>> high
>>>>> averages and errors in average forecast derived WIND values.
>>>>>
>>>>> Finally, over the domain I am verifying, I am getting different
>> stations
>>>>> when I run point_stat over one of my forecasts as compared to
another
>>>>> iteration of the same forecast. Specifically, in the MPR text
file,
>> KNEL
>>>> is
>>>>> included in the statistics for the RTG file but not in the
statistics
>> for
>>>>> the regular file (although it looks like KBLM takes the place of
KNEL
>> in
>>>>> the regular file).
>>>>>
>>>>> I have included all necessary files in the seroka_data directory
on
>> your
>>>>> ftp site so you can attempt to replicate my errors. I have also
>> included
>>>>> the MPR and CNT files so you can see the errors that I have
>> encountered.
>>>>> The listing of files in seroka_data are as follows:
>>>>>
>>>>> gdas.18550.2012081318.nc
>>>>> NJ.poly
>>>>> point_stat_170000L_20120813_170000V_cnt.txt
>>>>> point_stat_170000L_20120813_170000V_mpr.txt
>>>>> PointStatConfig_winds
>>>>> RUWRF_3km_2012081300_17_00.grb2
>>>>> RUWRF_RTG_3km_2012081300_17_00.grb2
>>>>>
>>>>> The calls to point_stat (with my directory structure) are as
follows:
>>>>>
>>>>> ~/METv4.0/bin/point_stat \
>>>>> /home/coolgroup/bpu/wrf/RUWRF/20120813/RUWRF_3km_2012081300
>> _17:00.grb2
>>>> \
>>>>> /home/seroka/data/prepbufr/gdas.18550.2012081318.nc \
>>>>> data/config/PointStatConfig_winds \
>>>>> -outdir out/point_stat/rutgers/aug13/NJ -v 2
>>>>>
>>>>> ~/METv4.0/bin/point_stat \
>>>>> /home/coolgroup/bpu/wrf/RUWRF/20120813/RTG/RUWRF_RTG_3km_
>> 2012081300
>>>> _17:00.grb2
>>>>> \
>>>>> /home/seroka/data/prepbufr/gdas.18550.2012081318.nc \
>>>>> data/config/PointStatConfig_winds \
>>>>> -outdir out/point_stat/rutgers/aug13/NJ -v 2
>>>>>
>>>>> Any help would be greatly appreciated. Please let me know if you
have
>> any
>>>>> questions.
>>>>>
>>>>> Thanks,
>>>>> Greg
>>>>>
>>>>>
>>>>> ---
>>>>> Greg Seroka
>>>>> Ph.D. Candidate
>>>>> Coastal Ocean Observation Lab
>>>>> Institute of Marine and Coastal Sciences
>>>>> Rutgers University
>>>>> Email: seroka at marine.rutgers.edu
>>>>>
>>>>
>>>>
>>
>>
>>
------------------------------------------------
More information about the Met_help
mailing list