[Met_help] [rt.rap.ucar.edu #74917] History for question about point-stat
John Halley Gotway via RT
met_help at ucar.edu
Fri Jan 29 14:50:19 MST 2016
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Dear Helpdesk,
I am running point_grid to compare WRF simulation with GDAS Prebufr
observations.
In config file, I choose ADPUPA and ADPSFC, levels are set to be Z02,
P1000, etc for temperature and Z10, P1000 etc for wind.
The results indicate that only ADPUPA is used for verification. No
ADPSFC is used and I cannot get any verification for surface data (T2,
U10, V10).
I am not sure what is the reason? If I also want to verify surface
variables, what should I do?
Thank you!
Ming
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: question about point-stat
From: John Halley Gotway
Time: Thu Jan 28 18:39:25 2016
Ming,
Can you please rerun your point-stat run using the "-v 4" command line
option to dump out more diagnostic info. Also use the "-log" option
to
redirect the output to a log file. Then send us the resulting log
file
along with your point-stat configuration file.
That'll help us diagnose it.
Thanks
John
On Thursday, January 28, 2016, chenming at ucar.edu via RT
<met_help at ucar.edu>
wrote:
>
> Thu Jan 28 17:38:40 2016: Request 74917 was acted upon.
> Transaction: Ticket created by chenming at ucar.edu <javascript:;>
> Queue: met_help
> Subject: question about point-stat
> Owner: Nobody
> Requestors: chenming at ucar.edu <javascript:;>
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=74917 >
>
>
> Dear Helpdesk,
>
> I am running point_grid to compare WRF simulation with GDAS Prebufr
> observations.
>
> In config file, I choose ADPUPA and ADPSFC, levels are set to be
Z02,
> P1000, etc for temperature and Z10, P1000 etc for wind.
>
> The results indicate that only ADPUPA is used for verification. No
> ADPSFC is used and I cannot get any verification for surface data
(T2,
> U10, V10).
>
> I am not sure what is the reason? If I also want to verify surface
> variables, what should I do?
>
> Thank you!
>
> Ming
>
>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #74917] question about point-stat
From: chenming at ucar.edu
Time: Fri Jan 29 11:21:53 2016
John,
Thanks for getting back to me quickly. I rerun point_stat.ksh with -v
4
option.
The config files, run script "point_stat_v37.ksh", and the resulting
log file "point_stat_v4.log" are saved at
/glade/scratch/chenming/MET/V37/dave3/point_stat/
Under the same directory I saved the results for each variable ( SPFH,
TMP, UGRD, and VGRD). All pressure level data is available but no T2
and
U10/V10 verification is performed. Do I miss something somewhere?
Thank you!
Ming
On 1/28/16 6:39 PM, John Halley Gotway via RT wrote:
> Ming,
>
> Can you please rerun your point-stat run using the "-v 4" command
line
> option to dump out more diagnostic info. Also use the "-log" option
to
> redirect the output to a log file. Then send us the resulting log
file
> along with your point-stat configuration file.
>
> That'll help us diagnose it.
>
> Thanks
> John
>
> On Thursday, January 28, 2016, chenming at ucar.edu via RT
<met_help at ucar.edu>
> wrote:
>
>> Thu Jan 28 17:38:40 2016: Request 74917 was acted upon.
>> Transaction: Ticket created by chenming at ucar.edu <javascript:;>
>> Queue: met_help
>> Subject: question about point-stat
>> Owner: Nobody
>> Requestors: chenming at ucar.edu <javascript:;>
>> Status: new
>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=74917 >
>>
>>
>> Dear Helpdesk,
>>
>> I am running point_grid to compare WRF simulation with GDAS Prebufr
>> observations.
>>
>> In config file, I choose ADPUPA and ADPSFC, levels are set to be
Z02,
>> P1000, etc for temperature and Z10, P1000 etc for wind.
>>
>> The results indicate that only ADPUPA is used for verification. No
>> ADPSFC is used and I cannot get any verification for surface data
(T2,
>> U10, V10).
>>
>> I am not sure what is the reason? If I also want to verify surface
>> variables, what should I do?
>>
>> Thank you!
>>
>> Ming
>>
>>
------------------------------------------------
Subject: question about point-stat
From: John Halley Gotway
Time: Fri Jan 29 12:39:16 2016
Ming,
Thanks for pointing me to your data on Yellowstone. If I understand
correctly, your question is why are you getting 0 matched pairs for 2-
m
temperature and 10-m winds?
Here's a relevant selection from you log file
(/glade/scratch/chenming/MET/V37/dave3/point_stat/point_stat_v4.log):
DEBUG 2: Processing TMP/Z2 versus TMP/Z2, for observation type ADPSFC,
over
region FULL, for interpolation method UW_MEAN(1), using 0 pairs.
DEBUG 3: Number of matched pairs = 0
DEBUG 3: Observations processed = 55779
DEBUG 3: Rejected: SID exclusion = 0
DEBUG 3: Rejected: GRIB code = 47106
DEBUG 3: Rejected: valid time = 0
DEBUG 3: Rejected: bad obs value = 0
DEBUG 3: Rejected: off the grid = 1004
DEBUG 3: Rejected: level mismatch = 6199
DEBUG 3: Rejected: quality marker = 0
DEBUG 3: Rejected: message type = 1470
DEBUG 3: Rejected: masking region = 0
DEBUG 3: Rejected: bad fcst value = 0
DEBUG 3: Rejected: duplicates = 0
This debug level 3 information lists counts for reasons why
observations
weren't used for this verification task. There is nothing obviously
wrong
here, which makes me wonder about the point observations you're using:
/glade/scratch/chenming/MET/pb2nc/2010060100_pb.nc
For whatever reason, the permissions are locked down on that file. So
I
used a different one instead:
/glade/scratch/chenming/MET/pb2nc/2010060200_pb.nc
I ran the plot_point_obs tool to plot the observation locations:
/glade/u/home/chenming/METv5.0/bin/plot_point_obs
/glade/scratch/chenming/MET/pb2nc/2010060200_pb.nc ~/2010060200_pb.ps
The resulting point contains 14592 points (Finished plotting 14592
locations).
Next, I subset to only temperature observations (-gc 11) at the
surface
(-msg_typ ADPSFC):
/glade/u/home/chenming/METv5.0/bin/plot_point_obs
/glade/scratch/chenming/MET/pb2nc/2010060200_pb.nc ~/2010060200_pb.ps
-gc
11 -msg_typ ADPSFC
And that plot contains 0 points (Finished plotting 0 locations)!!!
This tells me that there are 0 ADPSFC temperature observations in your
data
file. I'm not sure why not, but I'd suggest that you step back and
look at
your configuration for the PB2NC tool. Perhaps you didn't save the
surface
observation message types?
Looking closely at your observation file, you'll have ADPSFC
observations
for GRIB code 7, which is geopotential height.
Thanks,
John
On Fri, Jan 29, 2016 at 11:21 AM, chenming at ucar.edu via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=74917 >
>
> John,
>
> Thanks for getting back to me quickly. I rerun point_stat.ksh with
-v 4
> option.
>
> The config files, run script "point_stat_v37.ksh", and the
resulting
> log file "point_stat_v4.log" are saved at
> /glade/scratch/chenming/MET/V37/dave3/point_stat/
>
> Under the same directory I saved the results for each variable (
SPFH,
> TMP, UGRD, and VGRD). All pressure level data is available but no T2
and
> U10/V10 verification is performed. Do I miss something somewhere?
>
> Thank you!
>
> Ming
>
>
>
>
> On 1/28/16 6:39 PM, John Halley Gotway via RT wrote:
> > Ming,
> >
> > Can you please rerun your point-stat run using the "-v 4" command
line
> > option to dump out more diagnostic info. Also use the "-log"
option to
> > redirect the output to a log file. Then send us the resulting log
file
> > along with your point-stat configuration file.
> >
> > That'll help us diagnose it.
> >
> > Thanks
> > John
> >
> > On Thursday, January 28, 2016, chenming at ucar.edu via RT <
> met_help at ucar.edu>
> > wrote:
> >
> >> Thu Jan 28 17:38:40 2016: Request 74917 was acted upon.
> >> Transaction: Ticket created by chenming at ucar.edu <javascript:;>
> >> Queue: met_help
> >> Subject: question about point-stat
> >> Owner: Nobody
> >> Requestors: chenming at ucar.edu <javascript:;>
> >> Status: new
> >> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=74917
> >
> >>
> >>
> >> Dear Helpdesk,
> >>
> >> I am running point_grid to compare WRF simulation with GDAS
Prebufr
> >> observations.
> >>
> >> In config file, I choose ADPUPA and ADPSFC, levels are set to be
Z02,
> >> P1000, etc for temperature and Z10, P1000 etc for wind.
> >>
> >> The results indicate that only ADPUPA is used for verification.
No
> >> ADPSFC is used and I cannot get any verification for surface data
(T2,
> >> U10, V10).
> >>
> >> I am not sure what is the reason? If I also want to verify
surface
> >> variables, what should I do?
> >>
> >> Thank you!
> >>
> >> Ming
> >>
> >>
>
>
>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #74917] question about point-stat
From: chenming at ucar.edu
Time: Fri Jan 29 12:55:21 2016
John,
I copy the config file I used for running pb2nc at
/glade/scratch/chenming/MET/pb2nc/PB2NCConfig, in which I select 4
types
of observations ( ADPUPA, ADPSFC, SFCSHP, PROFLR).
The GDAS data is saved at /glade/scratch/chenming/MET/GDAS
Is there any possibility the GDAS data doesn't include ADPSFC
information? ( I am sorry I don't know how to read prebufr data).
I am running the entire month of 201006, and all the results have no
verification information for surface variables ( T2, U10, and V10).
Many thanks for helping!
Ming
On 1/29/16 12:39 PM, John Halley Gotway via RT wrote:
> Ming,
>
> Thanks for pointing me to your data on Yellowstone. If I understand
> correctly, your question is why are you getting 0 matched pairs for
2-m
> temperature and 10-m winds?
>
> Here's a relevant selection from you log file
>
(/glade/scratch/chenming/MET/V37/dave3/point_stat/point_stat_v4.log):
>
> DEBUG 2: Processing TMP/Z2 versus TMP/Z2, for observation type
ADPSFC, over
> region FULL, for interpolation method UW_MEAN(1), using 0 pairs.
> DEBUG 3: Number of matched pairs = 0
> DEBUG 3: Observations processed = 55779
> DEBUG 3: Rejected: SID exclusion = 0
> DEBUG 3: Rejected: GRIB code = 47106
> DEBUG 3: Rejected: valid time = 0
> DEBUG 3: Rejected: bad obs value = 0
> DEBUG 3: Rejected: off the grid = 1004
> DEBUG 3: Rejected: level mismatch = 6199
> DEBUG 3: Rejected: quality marker = 0
> DEBUG 3: Rejected: message type = 1470
> DEBUG 3: Rejected: masking region = 0
> DEBUG 3: Rejected: bad fcst value = 0
> DEBUG 3: Rejected: duplicates = 0
>
> This debug level 3 information lists counts for reasons why
observations
> weren't used for this verification task. There is nothing obviously
wrong
> here, which makes me wonder about the point observations you're
using:
> /glade/scratch/chenming/MET/pb2nc/2010060100_pb.nc
>
> For whatever reason, the permissions are locked down on that file.
So I
> used a different one instead:
> /glade/scratch/chenming/MET/pb2nc/2010060200_pb.nc
>
> I ran the plot_point_obs tool to plot the observation locations:
> /glade/u/home/chenming/METv5.0/bin/plot_point_obs
> /glade/scratch/chenming/MET/pb2nc/2010060200_pb.nc
~/2010060200_pb.ps
>
> The resulting point contains 14592 points (Finished plotting 14592
> locations).
>
> Next, I subset to only temperature observations (-gc 11) at the
surface
> (-msg_typ ADPSFC):
> /glade/u/home/chenming/METv5.0/bin/plot_point_obs
> /glade/scratch/chenming/MET/pb2nc/2010060200_pb.nc
~/2010060200_pb.ps -gc
> 11 -msg_typ ADPSFC
>
> And that plot contains 0 points (Finished plotting 0 locations)!!!
>
> This tells me that there are 0 ADPSFC temperature observations in
your data
> file. I'm not sure why not, but I'd suggest that you step back and
look at
> your configuration for the PB2NC tool. Perhaps you didn't save the
surface
> observation message types?
>
> Looking closely at your observation file, you'll have ADPSFC
observations
> for GRIB code 7, which is geopotential height.
>
> Thanks,
> John
>
>
>
> On Fri, Jan 29, 2016 at 11:21 AM, chenming at ucar.edu via RT <
> met_help at ucar.edu> wrote:
>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=74917 >
>>
>> John,
>>
>> Thanks for getting back to me quickly. I rerun point_stat.ksh with
-v 4
>> option.
>>
>> The config files, run script "point_stat_v37.ksh", and the
resulting
>> log file "point_stat_v4.log" are saved at
>> /glade/scratch/chenming/MET/V37/dave3/point_stat/
>>
>> Under the same directory I saved the results for each variable (
SPFH,
>> TMP, UGRD, and VGRD). All pressure level data is available but no
T2 and
>> U10/V10 verification is performed. Do I miss something somewhere?
>>
>> Thank you!
>>
>> Ming
>>
>>
>>
>>
>> On 1/28/16 6:39 PM, John Halley Gotway via RT wrote:
>>> Ming,
>>>
>>> Can you please rerun your point-stat run using the "-v 4" command
line
>>> option to dump out more diagnostic info. Also use the "-log"
option to
>>> redirect the output to a log file. Then send us the resulting log
file
>>> along with your point-stat configuration file.
>>>
>>> That'll help us diagnose it.
>>>
>>> Thanks
>>> John
>>>
>>> On Thursday, January 28, 2016, chenming at ucar.edu via RT <
>> met_help at ucar.edu>
>>> wrote:
>>>
>>>> Thu Jan 28 17:38:40 2016: Request 74917 was acted upon.
>>>> Transaction: Ticket created by chenming at ucar.edu <javascript:;>
>>>> Queue: met_help
>>>> Subject: question about point-stat
>>>> Owner: Nobody
>>>> Requestors: chenming at ucar.edu <javascript:;>
>>>> Status: new
>>>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=74917
>>>>
>>>> Dear Helpdesk,
>>>>
>>>> I am running point_grid to compare WRF simulation with GDAS
Prebufr
>>>> observations.
>>>>
>>>> In config file, I choose ADPUPA and ADPSFC, levels are set to be
Z02,
>>>> P1000, etc for temperature and Z10, P1000 etc for wind.
>>>>
>>>> The results indicate that only ADPUPA is used for verification.
No
>>>> ADPSFC is used and I cannot get any verification for surface data
(T2,
>>>> U10, V10).
>>>>
>>>> I am not sure what is the reason? If I also want to verify
surface
>>>> variables, what should I do?
>>>>
>>>> Thank you!
>>>>
>>>> Ming
>>>>
>>>>
>>
>>
------------------------------------------------
Subject: question about point-stat
From: John Halley Gotway
Time: Fri Jan 29 13:58:41 2016
Ming,
Ah, that explains it. Check the note at the bottom of this page about
surface obs in GDAS:
http://www.dtcenter.org/met/users/downloads/observation_data.php
Many surface obs are set to a quality marker of 9 in the GDAS dataset
to
prevent them being assimilated since they negatively affect the data
assimilation process.
The NDAS (North American) data assimilation does not have this issue.
If you'd like to continue using GDAS, modify the PB2NC configuration
file
like this:
quality_mark_thresh = 9;
Then, when you run Point-Stat, you could either use all quality
markers, or
only 1, 2, and 9 like this:
obs_quality = [ "1", "2", "9" ];
Make sense?
Thanks,
John
On Fri, Jan 29, 2016 at 12:55 PM, chenming at ucar.edu via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=74917 >
>
> John,
>
> I copy the config file I used for running pb2nc at
> /glade/scratch/chenming/MET/pb2nc/PB2NCConfig, in which I select 4
types
> of observations ( ADPUPA, ADPSFC, SFCSHP, PROFLR).
>
> The GDAS data is saved at /glade/scratch/chenming/MET/GDAS
>
> Is there any possibility the GDAS data doesn't include ADPSFC
> information? ( I am sorry I don't know how to read prebufr data).
>
> I am running the entire month of 201006, and all the results have no
> verification information for surface variables ( T2, U10, and V10).
>
> Many thanks for helping!
>
> Ming
>
> On 1/29/16 12:39 PM, John Halley Gotway via RT wrote:
> > Ming,
> >
> > Thanks for pointing me to your data on Yellowstone. If I
understand
> > correctly, your question is why are you getting 0 matched pairs
for 2-m
> > temperature and 10-m winds?
> >
> > Here's a relevant selection from you log file
> >
(/glade/scratch/chenming/MET/V37/dave3/point_stat/point_stat_v4.log):
> >
> > DEBUG 2: Processing TMP/Z2 versus TMP/Z2, for observation type
ADPSFC,
> over
> > region FULL, for interpolation method UW_MEAN(1), using 0 pairs.
> > DEBUG 3: Number of matched pairs = 0
> > DEBUG 3: Observations processed = 55779
> > DEBUG 3: Rejected: SID exclusion = 0
> > DEBUG 3: Rejected: GRIB code = 47106
> > DEBUG 3: Rejected: valid time = 0
> > DEBUG 3: Rejected: bad obs value = 0
> > DEBUG 3: Rejected: off the grid = 1004
> > DEBUG 3: Rejected: level mismatch = 6199
> > DEBUG 3: Rejected: quality marker = 0
> > DEBUG 3: Rejected: message type = 1470
> > DEBUG 3: Rejected: masking region = 0
> > DEBUG 3: Rejected: bad fcst value = 0
> > DEBUG 3: Rejected: duplicates = 0
> >
> > This debug level 3 information lists counts for reasons why
observations
> > weren't used for this verification task. There is nothing
obviously
> wrong
> > here, which makes me wonder about the point observations you're
using:
> > /glade/scratch/chenming/MET/pb2nc/2010060100_pb.nc
> >
> > For whatever reason, the permissions are locked down on that file.
So I
> > used a different one instead:
> > /glade/scratch/chenming/MET/pb2nc/2010060200_pb.nc
> >
> > I ran the plot_point_obs tool to plot the observation locations:
> > /glade/u/home/chenming/METv5.0/bin/plot_point_obs
> > /glade/scratch/chenming/MET/pb2nc/2010060200_pb.nc
~/2010060200_pb.ps
> >
> > The resulting point contains 14592 points (Finished plotting 14592
> > locations).
> >
> > Next, I subset to only temperature observations (-gc 11) at the
surface
> > (-msg_typ ADPSFC):
> > /glade/u/home/chenming/METv5.0/bin/plot_point_obs
> > /glade/scratch/chenming/MET/pb2nc/2010060200_pb.nc
~/2010060200_pb.ps
> -gc
> > 11 -msg_typ ADPSFC
> >
> > And that plot contains 0 points (Finished plotting 0 locations)!!!
> >
> > This tells me that there are 0 ADPSFC temperature observations in
your
> data
> > file. I'm not sure why not, but I'd suggest that you step back
and look
> at
> > your configuration for the PB2NC tool. Perhaps you didn't save
the
> surface
> > observation message types?
> >
> > Looking closely at your observation file, you'll have ADPSFC
observations
> > for GRIB code 7, which is geopotential height.
> >
> > Thanks,
> > John
> >
> >
> >
> > On Fri, Jan 29, 2016 at 11:21 AM, chenming at ucar.edu via RT <
> > met_help at ucar.edu> wrote:
> >
> >> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=74917 >
> >>
> >> John,
> >>
> >> Thanks for getting back to me quickly. I rerun point_stat.ksh
with -v 4
> >> option.
> >>
> >> The config files, run script "point_stat_v37.ksh", and the
resulting
> >> log file "point_stat_v4.log" are saved at
> >> /glade/scratch/chenming/MET/V37/dave3/point_stat/
> >>
> >> Under the same directory I saved the results for each variable (
SPFH,
> >> TMP, UGRD, and VGRD). All pressure level data is available but no
T2 and
> >> U10/V10 verification is performed. Do I miss something somewhere?
> >>
> >> Thank you!
> >>
> >> Ming
> >>
> >>
> >>
> >>
> >> On 1/28/16 6:39 PM, John Halley Gotway via RT wrote:
> >>> Ming,
> >>>
> >>> Can you please rerun your point-stat run using the "-v 4"
command line
> >>> option to dump out more diagnostic info. Also use the "-log"
option to
> >>> redirect the output to a log file. Then send us the resulting
log file
> >>> along with your point-stat configuration file.
> >>>
> >>> That'll help us diagnose it.
> >>>
> >>> Thanks
> >>> John
> >>>
> >>> On Thursday, January 28, 2016, chenming at ucar.edu via RT <
> >> met_help at ucar.edu>
> >>> wrote:
> >>>
> >>>> Thu Jan 28 17:38:40 2016: Request 74917 was acted upon.
> >>>> Transaction: Ticket created by chenming at ucar.edu <javascript:;>
> >>>> Queue: met_help
> >>>> Subject: question about point-stat
> >>>> Owner: Nobody
> >>>> Requestors: chenming at ucar.edu <javascript:;>
> >>>> Status: new
> >>>> Ticket <URL:
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=74917
> >>>>
> >>>> Dear Helpdesk,
> >>>>
> >>>> I am running point_grid to compare WRF simulation with GDAS
Prebufr
> >>>> observations.
> >>>>
> >>>> In config file, I choose ADPUPA and ADPSFC, levels are set to
be Z02,
> >>>> P1000, etc for temperature and Z10, P1000 etc for wind.
> >>>>
> >>>> The results indicate that only ADPUPA is used for verification.
No
> >>>> ADPSFC is used and I cannot get any verification for surface
data (T2,
> >>>> U10, V10).
> >>>>
> >>>> I am not sure what is the reason? If I also want to verify
surface
> >>>> variables, what should I do?
> >>>>
> >>>> Thank you!
> >>>>
> >>>> Ming
> >>>>
> >>>>
> >>
> >>
>
>
>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #74917] question about point-stat
From: chenming at ucar.edu
Time: Fri Jan 29 14:05:17 2016
John,
Yes that does make sense. I will follow your suggestions to rerun
pb2nc
and point_stat.
I still prefer to use GDAS since my model domain may be beyond North
America.
You are great! Many many thanks!
Ming
On 1/29/16 1:58 PM, John Halley Gotway via RT wrote:
> Ming,
>
> Ah, that explains it. Check the note at the bottom of this page
about
> surface obs in GDAS:
> http://www.dtcenter.org/met/users/downloads/observation_data.php
>
> Many surface obs are set to a quality marker of 9 in the GDAS
dataset to
> prevent them being assimilated since they negatively affect the data
> assimilation process.
>
> The NDAS (North American) data assimilation does not have this
issue.
>
> If you'd like to continue using GDAS, modify the PB2NC configuration
file
> like this:
> quality_mark_thresh = 9;
>
> Then, when you run Point-Stat, you could either use all quality
markers, or
> only 1, 2, and 9 like this:
> obs_quality = [ "1", "2", "9" ];
>
> Make sense?
>
> Thanks,
> John
>
>
>
> On Fri, Jan 29, 2016 at 12:55 PM, chenming at ucar.edu via RT <
> met_help at ucar.edu> wrote:
>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=74917 >
>>
>> John,
>>
>> I copy the config file I used for running pb2nc at
>> /glade/scratch/chenming/MET/pb2nc/PB2NCConfig, in which I select 4
types
>> of observations ( ADPUPA, ADPSFC, SFCSHP, PROFLR).
>>
>> The GDAS data is saved at /glade/scratch/chenming/MET/GDAS
>>
>> Is there any possibility the GDAS data doesn't include ADPSFC
>> information? ( I am sorry I don't know how to read prebufr data).
>>
>> I am running the entire month of 201006, and all the results have
no
>> verification information for surface variables ( T2, U10, and V10).
>>
>> Many thanks for helping!
>>
>> Ming
>>
>> On 1/29/16 12:39 PM, John Halley Gotway via RT wrote:
>>> Ming,
>>>
>>> Thanks for pointing me to your data on Yellowstone. If I
understand
>>> correctly, your question is why are you getting 0 matched pairs
for 2-m
>>> temperature and 10-m winds?
>>>
>>> Here's a relevant selection from you log file
>>>
(/glade/scratch/chenming/MET/V37/dave3/point_stat/point_stat_v4.log):
>>>
>>> DEBUG 2: Processing TMP/Z2 versus TMP/Z2, for observation type
ADPSFC,
>> over
>>> region FULL, for interpolation method UW_MEAN(1), using 0 pairs.
>>> DEBUG 3: Number of matched pairs = 0
>>> DEBUG 3: Observations processed = 55779
>>> DEBUG 3: Rejected: SID exclusion = 0
>>> DEBUG 3: Rejected: GRIB code = 47106
>>> DEBUG 3: Rejected: valid time = 0
>>> DEBUG 3: Rejected: bad obs value = 0
>>> DEBUG 3: Rejected: off the grid = 1004
>>> DEBUG 3: Rejected: level mismatch = 6199
>>> DEBUG 3: Rejected: quality marker = 0
>>> DEBUG 3: Rejected: message type = 1470
>>> DEBUG 3: Rejected: masking region = 0
>>> DEBUG 3: Rejected: bad fcst value = 0
>>> DEBUG 3: Rejected: duplicates = 0
>>>
>>> This debug level 3 information lists counts for reasons why
observations
>>> weren't used for this verification task. There is nothing
obviously
>> wrong
>>> here, which makes me wonder about the point observations you're
using:
>>> /glade/scratch/chenming/MET/pb2nc/2010060100_pb.nc
>>>
>>> For whatever reason, the permissions are locked down on that file.
So I
>>> used a different one instead:
>>> /glade/scratch/chenming/MET/pb2nc/2010060200_pb.nc
>>>
>>> I ran the plot_point_obs tool to plot the observation locations:
>>> /glade/u/home/chenming/METv5.0/bin/plot_point_obs
>>> /glade/scratch/chenming/MET/pb2nc/2010060200_pb.nc
~/2010060200_pb.ps
>>>
>>> The resulting point contains 14592 points (Finished plotting 14592
>>> locations).
>>>
>>> Next, I subset to only temperature observations (-gc 11) at the
surface
>>> (-msg_typ ADPSFC):
>>> /glade/u/home/chenming/METv5.0/bin/plot_point_obs
>>> /glade/scratch/chenming/MET/pb2nc/2010060200_pb.nc
~/2010060200_pb.ps
>> -gc
>>> 11 -msg_typ ADPSFC
>>>
>>> And that plot contains 0 points (Finished plotting 0 locations)!!!
>>>
>>> This tells me that there are 0 ADPSFC temperature observations in
your
>> data
>>> file. I'm not sure why not, but I'd suggest that you step back
and look
>> at
>>> your configuration for the PB2NC tool. Perhaps you didn't save
the
>> surface
>>> observation message types?
>>>
>>> Looking closely at your observation file, you'll have ADPSFC
observations
>>> for GRIB code 7, which is geopotential height.
>>>
>>> Thanks,
>>> John
>>>
>>>
>>>
>>> On Fri, Jan 29, 2016 at 11:21 AM, chenming at ucar.edu via RT <
>>> met_help at ucar.edu> wrote:
>>>
>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=74917 >
>>>>
>>>> John,
>>>>
>>>> Thanks for getting back to me quickly. I rerun point_stat.ksh
with -v 4
>>>> option.
>>>>
>>>> The config files, run script "point_stat_v37.ksh", and the
resulting
>>>> log file "point_stat_v4.log" are saved at
>>>> /glade/scratch/chenming/MET/V37/dave3/point_stat/
>>>>
>>>> Under the same directory I saved the results for each variable (
SPFH,
>>>> TMP, UGRD, and VGRD). All pressure level data is available but no
T2 and
>>>> U10/V10 verification is performed. Do I miss something somewhere?
>>>>
>>>> Thank you!
>>>>
>>>> Ming
>>>>
>>>>
>>>>
>>>>
>>>> On 1/28/16 6:39 PM, John Halley Gotway via RT wrote:
>>>>> Ming,
>>>>>
>>>>> Can you please rerun your point-stat run using the "-v 4"
command line
>>>>> option to dump out more diagnostic info. Also use the "-log"
option to
>>>>> redirect the output to a log file. Then send us the resulting
log file
>>>>> along with your point-stat configuration file.
>>>>>
>>>>> That'll help us diagnose it.
>>>>>
>>>>> Thanks
>>>>> John
>>>>>
>>>>> On Thursday, January 28, 2016, chenming at ucar.edu via RT <
>>>> met_help at ucar.edu>
>>>>> wrote:
>>>>>
>>>>>> Thu Jan 28 17:38:40 2016: Request 74917 was acted upon.
>>>>>> Transaction: Ticket created by chenming at ucar.edu <javascript:;>
>>>>>> Queue: met_help
>>>>>> Subject: question about point-stat
>>>>>> Owner: Nobody
>>>>>> Requestors: chenming at ucar.edu <javascript:;>
>>>>>> Status: new
>>>>>> Ticket <URL:
>> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=74917
>>>>>> Dear Helpdesk,
>>>>>>
>>>>>> I am running point_grid to compare WRF simulation with GDAS
Prebufr
>>>>>> observations.
>>>>>>
>>>>>> In config file, I choose ADPUPA and ADPSFC, levels are set to
be Z02,
>>>>>> P1000, etc for temperature and Z10, P1000 etc for wind.
>>>>>>
>>>>>> The results indicate that only ADPUPA is used for verification.
No
>>>>>> ADPSFC is used and I cannot get any verification for surface
data (T2,
>>>>>> U10, V10).
>>>>>>
>>>>>> I am not sure what is the reason? If I also want to verify
surface
>>>>>> variables, what should I do?
>>>>>>
>>>>>> Thank you!
>>>>>>
>>>>>> Ming
>>>>>>
>>>>>>
>>>>
>>
>>
------------------------------------------------
Subject: question about point-stat
From: John Halley Gotway
Time: Fri Jan 29 14:50:15 2016
Ming,
Great, glad that helped. I'll go ahead and resolve this ticket now.
Thanks,
John
On Fri, Jan 29, 2016 at 2:05 PM, chenming at ucar.edu via RT
<met_help at ucar.edu
> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=74917 >
>
> John,
>
> Yes that does make sense. I will follow your suggestions to rerun
pb2nc
> and point_stat.
>
> I still prefer to use GDAS since my model domain may be beyond North
> America.
>
> You are great! Many many thanks!
>
> Ming
>
> On 1/29/16 1:58 PM, John Halley Gotway via RT wrote:
> > Ming,
> >
> > Ah, that explains it. Check the note at the bottom of this page
about
> > surface obs in GDAS:
> >
http://www.dtcenter.org/met/users/downloads/observation_data.php
> >
> > Many surface obs are set to a quality marker of 9 in the GDAS
dataset to
> > prevent them being assimilated since they negatively affect the
data
> > assimilation process.
> >
> > The NDAS (North American) data assimilation does not have this
issue.
> >
> > If you'd like to continue using GDAS, modify the PB2NC
configuration file
> > like this:
> > quality_mark_thresh = 9;
> >
> > Then, when you run Point-Stat, you could either use all quality
markers,
> or
> > only 1, 2, and 9 like this:
> > obs_quality = [ "1", "2", "9" ];
> >
> > Make sense?
> >
> > Thanks,
> > John
> >
> >
> >
> > On Fri, Jan 29, 2016 at 12:55 PM, chenming at ucar.edu via RT <
> > met_help at ucar.edu> wrote:
> >
> >> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=74917 >
> >>
> >> John,
> >>
> >> I copy the config file I used for running pb2nc at
> >> /glade/scratch/chenming/MET/pb2nc/PB2NCConfig, in which I select
4 types
> >> of observations ( ADPUPA, ADPSFC, SFCSHP, PROFLR).
> >>
> >> The GDAS data is saved at /glade/scratch/chenming/MET/GDAS
> >>
> >> Is there any possibility the GDAS data doesn't include ADPSFC
> >> information? ( I am sorry I don't know how to read prebufr data).
> >>
> >> I am running the entire month of 201006, and all the results have
no
> >> verification information for surface variables ( T2, U10, and
V10).
> >>
> >> Many thanks for helping!
> >>
> >> Ming
> >>
> >> On 1/29/16 12:39 PM, John Halley Gotway via RT wrote:
> >>> Ming,
> >>>
> >>> Thanks for pointing me to your data on Yellowstone. If I
understand
> >>> correctly, your question is why are you getting 0 matched pairs
for 2-m
> >>> temperature and 10-m winds?
> >>>
> >>> Here's a relevant selection from you log file
> >>>
(/glade/scratch/chenming/MET/V37/dave3/point_stat/point_stat_v4.log):
> >>>
> >>> DEBUG 2: Processing TMP/Z2 versus TMP/Z2, for observation type
ADPSFC,
> >> over
> >>> region FULL, for interpolation method UW_MEAN(1), using 0 pairs.
> >>> DEBUG 3: Number of matched pairs = 0
> >>> DEBUG 3: Observations processed = 55779
> >>> DEBUG 3: Rejected: SID exclusion = 0
> >>> DEBUG 3: Rejected: GRIB code = 47106
> >>> DEBUG 3: Rejected: valid time = 0
> >>> DEBUG 3: Rejected: bad obs value = 0
> >>> DEBUG 3: Rejected: off the grid = 1004
> >>> DEBUG 3: Rejected: level mismatch = 6199
> >>> DEBUG 3: Rejected: quality marker = 0
> >>> DEBUG 3: Rejected: message type = 1470
> >>> DEBUG 3: Rejected: masking region = 0
> >>> DEBUG 3: Rejected: bad fcst value = 0
> >>> DEBUG 3: Rejected: duplicates = 0
> >>>
> >>> This debug level 3 information lists counts for reasons why
> observations
> >>> weren't used for this verification task. There is nothing
obviously
> >> wrong
> >>> here, which makes me wonder about the point observations you're
using:
> >>> /glade/scratch/chenming/MET/pb2nc/2010060100_pb.nc
> >>>
> >>> For whatever reason, the permissions are locked down on that
file. So
> I
> >>> used a different one instead:
> >>> /glade/scratch/chenming/MET/pb2nc/2010060200_pb.nc
> >>>
> >>> I ran the plot_point_obs tool to plot the observation locations:
> >>> /glade/u/home/chenming/METv5.0/bin/plot_point_obs
> >>> /glade/scratch/chenming/MET/pb2nc/2010060200_pb.nc
~/2010060200_pb.ps
> >>>
> >>> The resulting point contains 14592 points (Finished plotting
14592
> >>> locations).
> >>>
> >>> Next, I subset to only temperature observations (-gc 11) at the
surface
> >>> (-msg_typ ADPSFC):
> >>> /glade/u/home/chenming/METv5.0/bin/plot_point_obs
> >>> /glade/scratch/chenming/MET/pb2nc/2010060200_pb.nc
~/2010060200_pb.ps
> >> -gc
> >>> 11 -msg_typ ADPSFC
> >>>
> >>> And that plot contains 0 points (Finished plotting 0
locations)!!!
> >>>
> >>> This tells me that there are 0 ADPSFC temperature observations
in your
> >> data
> >>> file. I'm not sure why not, but I'd suggest that you step back
and
> look
> >> at
> >>> your configuration for the PB2NC tool. Perhaps you didn't save
the
> >> surface
> >>> observation message types?
> >>>
> >>> Looking closely at your observation file, you'll have ADPSFC
> observations
> >>> for GRIB code 7, which is geopotential height.
> >>>
> >>> Thanks,
> >>> John
> >>>
> >>>
> >>>
> >>> On Fri, Jan 29, 2016 at 11:21 AM, chenming at ucar.edu via RT <
> >>> met_help at ucar.edu> wrote:
> >>>
> >>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=74917 >
> >>>>
> >>>> John,
> >>>>
> >>>> Thanks for getting back to me quickly. I rerun point_stat.ksh
with -v
> 4
> >>>> option.
> >>>>
> >>>> The config files, run script "point_stat_v37.ksh", and the
resulting
> >>>> log file "point_stat_v4.log" are saved at
> >>>> /glade/scratch/chenming/MET/V37/dave3/point_stat/
> >>>>
> >>>> Under the same directory I saved the results for each variable
( SPFH,
> >>>> TMP, UGRD, and VGRD). All pressure level data is available but
no T2
> and
> >>>> U10/V10 verification is performed. Do I miss something
somewhere?
> >>>>
> >>>> Thank you!
> >>>>
> >>>> Ming
> >>>>
> >>>>
> >>>>
> >>>>
> >>>> On 1/28/16 6:39 PM, John Halley Gotway via RT wrote:
> >>>>> Ming,
> >>>>>
> >>>>> Can you please rerun your point-stat run using the "-v 4"
command
> line
> >>>>> option to dump out more diagnostic info. Also use the "-log"
option
> to
> >>>>> redirect the output to a log file. Then send us the resulting
log
> file
> >>>>> along with your point-stat configuration file.
> >>>>>
> >>>>> That'll help us diagnose it.
> >>>>>
> >>>>> Thanks
> >>>>> John
> >>>>>
> >>>>> On Thursday, January 28, 2016, chenming at ucar.edu via RT <
> >>>> met_help at ucar.edu>
> >>>>> wrote:
> >>>>>
> >>>>>> Thu Jan 28 17:38:40 2016: Request 74917 was acted upon.
> >>>>>> Transaction: Ticket created by chenming at ucar.edu
<javascript:;>
> >>>>>> Queue: met_help
> >>>>>> Subject: question about point-stat
> >>>>>> Owner: Nobody
> >>>>>> Requestors: chenming at ucar.edu <javascript:;>
> >>>>>> Status: new
> >>>>>> Ticket <URL:
> >> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=74917
> >>>>>> Dear Helpdesk,
> >>>>>>
> >>>>>> I am running point_grid to compare WRF simulation with GDAS
Prebufr
> >>>>>> observations.
> >>>>>>
> >>>>>> In config file, I choose ADPUPA and ADPSFC, levels are set to
be
> Z02,
> >>>>>> P1000, etc for temperature and Z10, P1000 etc for wind.
> >>>>>>
> >>>>>> The results indicate that only ADPUPA is used for
verification. No
> >>>>>> ADPSFC is used and I cannot get any verification for surface
data
> (T2,
> >>>>>> U10, V10).
> >>>>>>
> >>>>>> I am not sure what is the reason? If I also want to verify
surface
> >>>>>> variables, what should I do?
> >>>>>>
> >>>>>> Thank you!
> >>>>>>
> >>>>>> Ming
> >>>>>>
> >>>>>>
> >>>>
> >>
> >>
>
>
>
------------------------------------------------
More information about the Met_help
mailing list