[Met_help] [rt.rap.ucar.edu #89196] History for Point Stat Error
John Halley Gotway via RT
met_help at ucar.edu
Wed Mar 6 14:03:23 MST 2019
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
I've run into a point stat error which I've never seen before (below). I was able to successfully run PB2NC for the obs files, but it's getting stuck while reading in the data.
My log file is here on Theia:
scratch3/BMC/det/beck/merit/MET/log/verif/FV3/2016011812/met/met_point_sfc_2016011812_000.log
If you have any suggestions, I'd be glad to hear them.
Thanks!
- Jeff
DEBUG 2: Reading data for VGRD/Z10.
DEBUG 2: For VGRD/Z10 found 1 forecast levels, 0 climatology mean levels, and 0 climatology standard deviation levels.
DEBUG 2:
DEBUG 2: --------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Reading data for WIND/Z10.
DEBUG 2: For WIND/Z10 found 1 forecast levels, 0 climatology mean levels, and 0 climatology standard deviation levels.
DEBUG 2:
DEBUG 2: --------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Reading data for PRMSL/Z0.
DEBUG 2: For PRMSL/Z0 found 1 forecast levels, 0 climatology mean levels, and 0 climatology standard deviation levels.
DEBUG 2:
DEBUG 2: --------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Searching 1334981 observations from 30812 messages.
ERROR :
ERROR : process_obs_file() -> for observation index 503, when computing VL1L2 and/or VAL1L2 vector winds each UGRD observation must be followed by a VGRD observation with the same header and at the same level.
ERROR :
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: Point Stat Error
From: John Halley Gotway
Time: Tue Mar 05 17:15:30 2019
Jeff,
I moved this question over to met-help...
Sorry it took me so long to get to this today! I copied it over to my
machine and was able to produce the same error message you're seeing.
Before getting to that, instead of using:
poly = [ "${MASKS}/CONUS.poly" ];
I'd recommend running CONUS.poly through gen_vx_mask to generate a 0/1
mask field for the current domain:
gen_vx_mask gfs.t12z.pgrb2.0p25.f000 CONUS.poly gfs_CONUS_mask.nc
And then set:
poly = [ "${MASKS}/gfs_CONUS_mask.nc" ];
That way, each time you run Point-Stat, you won't waste time
regenerating that mask field, and it'll run more efficiently.
OK, on to the problem at hand. I did some debugging and found the
problem. This is a problem in the code that requires a bugfix. There
is an assumption in MET that whenever we get a VGRD observation, it
was immediately preceeded by UGRD. That's what this error message is
complaining about... that assumption was violated.
This is observation that triggers this error:
ADPUPA 80035 20160118_120000 11.53 -72.93 4 XDR 1011
3.994926 NA 287.070000000
But that's not a VGRD observation! And you're right! Your NetCDF
file contains observations for 134 variables. You can see the list by
running:
ncdump -v obs_var prepbufr.ndas.20160118.t12z.nc
It just so happens that XDR is the 34-th entry in that list. And 34
is the GRIB code for the VGRD GRIB code abbreviation.
To put it simply, the logic for checking that U/V observations are in
the correct order is broken. And it was broken by our move from using
GRIB code abbreviations to observation variable names. I think it
hasn't shown up before because we haven't run PB2NC to extract more
than 34 variable types in the past.
So this is something we need to fix. Make sense?
If you need a short-term workaround, you could reconfigure PB2NC to
extract fewer than 34 observation types.
Sorry for the bug, but thanks for finding it!
John
------------------------------------------------
Subject: Point Stat Error
From: John Halley Gotway
Time: Wed Mar 06 10:40:21 2019
Jeff,
FYI, I have a bugfix for this issue you found. Just need to finish
testing it, posting it to the website, and then applying it on theia.
Thanks,
John
------------------------------------------------
Subject: Point Stat Error
From: jeff.beck at noaa.gov
Time: Wed Mar 06 10:47:36 2019
Hi John,
Thank you for tracking down this bug! We were about to reduce our
variables in the PB2NC step, but if you believe we won't need to do
that,
that's great! I was also wondering if we reordered the variables in
the
NetCDF file, whether that would get around the bug as well, but that
doesn't sound like it's necessary. I'll hold off for the bug fix.
Thanks again!
- Jeff
On Wed, Mar 6, 2019 at 10:40 AM John Halley Gotway via RT
<met_help at ucar.edu>
wrote:
> Jeff,
>
> FYI, I have a bugfix for this issue you found. Just need to finish
> testing it, posting it to the website, and then applying it on
theia.
>
> Thanks,
> John
>
------------------------------------------------
Subject: Point Stat Error
From: John Halley Gotway
Time: Wed Mar 06 11:14:16 2019
Jeff,
No, reordering the variables would not help. Reducing the number of
observation variables to less than 34 would help though.
John
On Wed, Mar 6, 2019 at 10:48 AM jeff.beck at noaa.gov via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=89196 >
>
> Hi John,
>
> Thank you for tracking down this bug! We were about to reduce our
> variables in the PB2NC step, but if you believe we won't need to do
that,
> that's great! I was also wondering if we reordered the variables in
the
> NetCDF file, whether that would get around the bug as well, but that
> doesn't sound like it's necessary. I'll hold off for the bug fix.
>
> Thanks again!
>
> - Jeff
>
> On Wed, Mar 6, 2019 at 10:40 AM John Halley Gotway via RT <
> met_help at ucar.edu>
> wrote:
>
> > Jeff,
> >
> > FYI, I have a bugfix for this issue you found. Just need to
finish
> > testing it, posting it to the website, and then applying it on
theia.
> >
> > Thanks,
> > John
> >
>
>
------------------------------------------------
Subject: Point Stat Error
From: John Halley Gotway
Time: Wed Mar 06 13:23:51 2019
Jeff,
Since Julie finished patching met-8.0 on theia, I'll resolve this
issue.
Thanks,
John
On Wed, Mar 6, 2019 at 11:14 AM John Halley Gotway <johnhg at ucar.edu>
wrote:
> Jeff,
>
> No, reordering the variables would not help. Reducing the number of
> observation variables to less than 34 would help though.
>
> John
>
> On Wed, Mar 6, 2019 at 10:48 AM jeff.beck at noaa.gov via RT <
> met_help at ucar.edu> wrote:
>
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=89196 >
>>
>> Hi John,
>>
>> Thank you for tracking down this bug! We were about to reduce our
>> variables in the PB2NC step, but if you believe we won't need to do
that,
>> that's great! I was also wondering if we reordered the variables
in the
>> NetCDF file, whether that would get around the bug as well, but
that
>> doesn't sound like it's necessary. I'll hold off for the bug fix.
>>
>> Thanks again!
>>
>> - Jeff
>>
>> On Wed, Mar 6, 2019 at 10:40 AM John Halley Gotway via RT <
>> met_help at ucar.edu>
>> wrote:
>>
>> > Jeff,
>> >
>> > FYI, I have a bugfix for this issue you found. Just need to
finish
>> > testing it, posting it to the website, and then applying it on
theia.
>> >
>> > Thanks,
>> > John
>> >
>>
>>
------------------------------------------------
Subject: Point Stat Error
From: jeff.beck at noaa.gov
Time: Wed Mar 06 13:57:50 2019
Sounds good. Thank you for your help with this!
- Jeff
On Wed, Mar 6, 2019 at 1:23 PM John Halley Gotway via RT
<met_help at ucar.edu>
wrote:
> Jeff,
>
> Since Julie finished patching met-8.0 on theia, I'll resolve this
issue.
>
> Thanks,
> John
>
> On Wed, Mar 6, 2019 at 11:14 AM John Halley Gotway <johnhg at ucar.edu>
> wrote:
>
> > Jeff,
> >
> > No, reordering the variables would not help. Reducing the number
of
> > observation variables to less than 34 would help though.
> >
> > John
> >
> > On Wed, Mar 6, 2019 at 10:48 AM jeff.beck at noaa.gov via RT <
> > met_help at ucar.edu> wrote:
> >
> >>
> >> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=89196 >
> >>
> >> Hi John,
> >>
> >> Thank you for tracking down this bug! We were about to reduce
our
> >> variables in the PB2NC step, but if you believe we won't need to
do
> that,
> >> that's great! I was also wondering if we reordered the variables
in the
> >> NetCDF file, whether that would get around the bug as well, but
that
> >> doesn't sound like it's necessary. I'll hold off for the bug
fix.
> >>
> >> Thanks again!
> >>
> >> - Jeff
> >>
> >> On Wed, Mar 6, 2019 at 10:40 AM John Halley Gotway via RT <
> >> met_help at ucar.edu>
> >> wrote:
> >>
> >> > Jeff,
> >> >
> >> > FYI, I have a bugfix for this issue you found. Just need to
finish
> >> > testing it, posting it to the website, and then applying it on
theia.
> >> >
> >> > Thanks,
> >> > John
> >> >
> >>
> >>
>
>
------------------------------------------------
More information about the Met_help
mailing list