[Met_help] [rt.rap.ucar.edu #69310] History for Different data point counts for the same geographical area
John Halley Gotway via RT
met_help at ucar.edu
Tue Oct 21 11:16:52 MDT 2014
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Good morning,
I am running MET v4.1 to perform some WRF model verification. I am running verification for two sets of WRF model data, using the same geographic polygon masks and for the same period of time for both sets. My methodology is to run the wrfout files through the Universal Post Processor, then take the resulting wrfprs* files and run them through point stat, then stat analysis, with the aim of producing monthly verification values. However, the number of data points that are being counted by stat analysis differ between one set of WRF data to another, but only in a few regions I studied and only over a few months of the total temporal window that I looked at. I have attempted to fix this problem by re-running the data and ensuring that the config files have the proper masks included, but there are still differences in the number of data points. I have attached a spreadsheet of the data that compares the two WRF data sets I studied for your review (please note columns G and!
H that indicate the number of data points counted). Do you know what would cause this problem and how it could be fixed?
Thanks,
Elliot Tardif
Elliot Tardif, Meteorologist II
NC DENR, Division of Air Quality
Planning Section, Attainment Planning Branch
1641 Mail Service Center
Raleigh, NC 27699-1641
Phone/Fax: 919-707-8483
Email: Elliot.Tardif at ncdenr.gov<mailto:Nick.Witcraft at ncdenr.gov>
Web : http://www.ncair.org<http://www.ncair.org/>
Email correspondence to and from this address is subject to the North Carolina Public Records Law and may be disclosed to third parties unless the content is exempt by statue or other regulation.
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: Different data point counts for the same geographical area
From: John Halley Gotway
Time: Wed Oct 08 09:46:59 2014
Elliot,
I see that you're wondering why there are differences in the number of
matched pairs of 2-m temperature used over the course of several
months
between two different runs of WRF. There is no obvious reason in the
MET
software why they would be different. I see that the counts in the
"total_datapoints" column are the same or higher than the counts in
the
"total_datapoints_old" column. I'd suggest picking a month where the
counts are different and stepping back through to identify the source
of
the problem.
You mentioned that you're running point_stat followed by
stat_analysis.
You could probably use stat-analysis to investigate this further. You
could run a job like this:
stat_analysis -lookin directory/with/point_stat/output \
-fcst_var TMP -fcst_lev Z2 \
-fcst_valid_beg 20110401_000000 -fcst_valid_end 20110430_230000 \
-job aggregate_stat -line_type MPR -out_line_type SL1L2 \
-by MODEL
Assuming you've kept the matched pair output and assuming you've used
2
different model names for the two different configurations of WRF,
that
should give you two output lines with counts summed over the whole
months.
Then rerun the job listed above, but add "-by FCST_VALID_BEG".
That'll
give you the same counts but split out for each valid time. You can
inspect the output counts to see when the differences show up. You
may
need to tweak the filtering options depending on how you ran
point_stat and
stored the output, but the basic idea should work.
One obvious possibility is perhaps some of the old-wrf runs are
missing,
causing fewer counts. Or perhaps the UPP runs aborted before creating
the
2-m temperature output GRIB records. I'd suggest looking date-by-
date,
find one that differs, and investigate further.
Hope that helps.
Thanks,
John Halley Gotway
met_help at ucar.edu
On Wed, Oct 8, 2014 at 9:29 AM, Tardif, Elliot M via RT
<met_help at ucar.edu>
wrote:
>
> Wed Oct 08 09:29:28 2014: Request 69310 was acted upon.
> Transaction: Ticket created by elliot.tardif at ncdenr.gov
> Queue: met_help
> Subject: Different data point counts for the same geographical
area
> Owner: Nobody
> Requestors: elliot.tardif at ncdenr.gov
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=69310 >
>
>
> Good morning,
>
> I am running MET v4.1 to perform some WRF model verification. I am
> running verification for two sets of WRF model data, using the same
> geographic polygon masks and for the same period of time for both
sets. My
> methodology is to run the wrfout files through the Universal Post
> Processor, then take the resulting wrfprs* files and run them
through point
> stat, then stat analysis, with the aim of producing monthly
verification
> values. However, the number of data points that are being counted
by stat
> analysis differ between one set of WRF data to another, but only in
a few
> regions I studied and only over a few months of the total temporal
window
> that I looked at. I have attempted to fix this problem by re-
running the
> data and ensuring that the config files have the proper masks
included, but
> there are still differences in the number of data points. I have
attached
> a spreadsheet of the data that compares the two WRF data sets I
studied for
> your review (please note columns G and!
> H that indicate the number of data points counted). Do you know
what
> would cause this problem and how it could be fixed?
>
> Thanks,
>
> Elliot Tardif
>
> Elliot Tardif, Meteorologist II
> NC DENR, Division of Air Quality
> Planning Section, Attainment Planning Branch
> 1641 Mail Service Center
> Raleigh, NC 27699-1641
> Phone/Fax: 919-707-8483
> Email: Elliot.Tardif at ncdenr.gov<mailto:Nick.Witcraft at ncdenr.gov>
> Web : http://www.ncair.org<http://www.ncair.org/>
>
> Email correspondence to and from this address is subject to the
North
> Carolina Public Records Law and may be disclosed to third parties
unless
> the content is exempt by statue or other regulation.
>
>
>
------------------------------------------------
Subject: Different data point counts for the same geographical area
From: Tardif, Elliot M
Time: Wed Oct 08 10:57:52 2014
Good afternoon John, thank you for your thoughts on this situation. I
also ran a second temporal verification that looked at each hour of
each month for each region of interest, and I pulled the file for
temperature verification the month of April for the MRPO region
(please see attached). This verification used the same point stat and
UPP files as the monthly effort with which the counts are different.
However, in this case, there are no differences in the count of data
points at any hour between the two WRF sets that I studied.
I am going to be out of the office from after lunch today through the
rest of this week, but when I return I will try the job command you've
given below to see if that solves the problem.
Thank you for your time and have a good afternoon!
Regards,
Elliot Tardif, Meteorologist II
NC DENR, Division of Air Quality
Planning Section, Attainment Planning Branch
1641 Mail Service Center
Raleigh, NC 27699-1641
Phone/Fax: 919-707-8483
Email: Elliot.Tardif at ncdenr.gov
Web : http://www.ncair.org
Email correspondence to and from this address is subject to the North
Carolina Public Records Law and may be disclosed to third parties
unless the content is exempt by statue or other regulation.
-----Original Message-----
From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
Sent: Wednesday, October 08, 2014 11:47 AM
To: Tardif, Elliot M
Subject: Re: [rt.rap.ucar.edu #69310] Different data point counts for
the same geographical area
Elliot,
I see that you're wondering why there are differences in the number of
matched pairs of 2-m temperature used over the course of several
months between two different runs of WRF. There is no obvious reason
in the MET software why they would be different. I see that the
counts in the "total_datapoints" column are the same or higher than
the counts in the "total_datapoints_old" column. I'd suggest picking
a month where the counts are different and stepping back through to
identify the source of the problem.
You mentioned that you're running point_stat followed by
stat_analysis.
You could probably use stat-analysis to investigate this further. You
could run a job like this:
stat_analysis -lookin directory/with/point_stat/output \
-fcst_var TMP -fcst_lev Z2 \
-fcst_valid_beg 20110401_000000 -fcst_valid_end 20110430_230000 \
-job aggregate_stat -line_type MPR -out_line_type SL1L2 \
-by MODEL
Assuming you've kept the matched pair output and assuming you've used
2 different model names for the two different configurations of WRF,
that should give you two output lines with counts summed over the
whole months.
Then rerun the job listed above, but add "-by FCST_VALID_BEG".
That'll give you the same counts but split out for each valid time.
You can inspect the output counts to see when the differences show up.
You may need to tweak the filtering options depending on how you ran
point_stat and stored the output, but the basic idea should work.
One obvious possibility is perhaps some of the old-wrf runs are
missing, causing fewer counts. Or perhaps the UPP runs aborted before
creating the 2-m temperature output GRIB records. I'd suggest looking
date-by-date, find one that differs, and investigate further.
Hope that helps.
Thanks,
John Halley Gotway
met_help at ucar.edu
On Wed, Oct 8, 2014 at 9:29 AM, Tardif, Elliot M via RT
<met_help at ucar.edu>
wrote:
>
> Wed Oct 08 09:29:28 2014: Request 69310 was acted upon.
> Transaction: Ticket created by elliot.tardif at ncdenr.gov
> Queue: met_help
> Subject: Different data point counts for the same geographical
area
> Owner: Nobody
> Requestors: elliot.tardif at ncdenr.gov
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=69310
> >
>
>
> Good morning,
>
> I am running MET v4.1 to perform some WRF model verification. I am
> running verification for two sets of WRF model data, using the same
> geographic polygon masks and for the same period of time for both
> sets. My methodology is to run the wrfout files through the
Universal
> Post Processor, then take the resulting wrfprs* files and run them
> through point stat, then stat analysis, with the aim of producing
> monthly verification values. However, the number of data points
that
> are being counted by stat analysis differ between one set of WRF
data
> to another, but only in a few regions I studied and only over a few
> months of the total temporal window that I looked at. I have
> attempted to fix this problem by re-running the data and ensuring
that
> the config files have the proper masks included, but there are still
> differences in the number of data points. I have attached a
> spreadsheet of the data that compares the two WRF data sets I
studied for your review (please note columns G and!
> H that indicate the number of data points counted). Do you know
> what would cause this problem and how it could be fixed?
>
> Thanks,
>
> Elliot Tardif
>
> Elliot Tardif, Meteorologist II
> NC DENR, Division of Air Quality
> Planning Section, Attainment Planning Branch
> 1641 Mail Service Center
> Raleigh, NC 27699-1641
> Phone/Fax: 919-707-8483
> Email: Elliot.Tardif at ncdenr.gov<mailto:Nick.Witcraft at ncdenr.gov>
> Web : http://www.ncair.org<http://www.ncair.org/>
>
> Email correspondence to and from this address is subject to the
North
> Carolina Public Records Law and may be disclosed to third parties
> unless the content is exempt by statue or other regulation.
>
>
>
------------------------------------------------
Subject: Different data point counts for the same geographical area
From: John Halley Gotway
Time: Wed Oct 08 13:14:40 2014
OK, sounds good. Hopefully digging into the details for a particular
month
will help explain the discrepancy.
Thanks,
John
On Wed, Oct 8, 2014 at 10:57 AM, Tardif, Elliot M via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=69310 >
>
> Good afternoon John, thank you for your thoughts on this situation.
I
> also ran a second temporal verification that looked at each hour of
each
> month for each region of interest, and I pulled the file for
temperature
> verification the month of April for the MRPO region (please see
attached).
> This verification used the same point stat and UPP files as the
monthly
> effort with which the counts are different. However, in this case,
there
> are no differences in the count of data points at any hour between
the two
> WRF sets that I studied.
>
> I am going to be out of the office from after lunch today through
the rest
> of this week, but when I return I will try the job command you've
given
> below to see if that solves the problem.
>
> Thank you for your time and have a good afternoon!
>
> Regards,
>
> Elliot Tardif, Meteorologist II
> NC DENR, Division of Air Quality
> Planning Section, Attainment Planning Branch
> 1641 Mail Service Center
> Raleigh, NC 27699-1641
> Phone/Fax: 919-707-8483
> Email: Elliot.Tardif at ncdenr.gov
> Web : http://www.ncair.org
>
> Email correspondence to and from this address is subject to the
North
> Carolina Public Records Law and may be disclosed to third parties
unless
> the content is exempt by statue or other regulation.
>
>
>
> -----Original Message-----
> From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> Sent: Wednesday, October 08, 2014 11:47 AM
> To: Tardif, Elliot M
> Subject: Re: [rt.rap.ucar.edu #69310] Different data point counts
for the
> same geographical area
>
> Elliot,
>
> I see that you're wondering why there are differences in the number
of
> matched pairs of 2-m temperature used over the course of several
months
> between two different runs of WRF. There is no obvious reason in
the MET
> software why they would be different. I see that the counts in the
> "total_datapoints" column are the same or higher than the counts in
the
> "total_datapoints_old" column. I'd suggest picking a month where
the
> counts are different and stepping back through to identify the
source of
> the problem.
>
> You mentioned that you're running point_stat followed by
stat_analysis.
> You could probably use stat-analysis to investigate this further.
You
> could run a job like this:
>
> stat_analysis -lookin directory/with/point_stat/output \
> -fcst_var TMP -fcst_lev Z2 \
> -fcst_valid_beg 20110401_000000 -fcst_valid_end 20110430_230000 \
> -job aggregate_stat -line_type MPR -out_line_type SL1L2 \
> -by MODEL
>
> Assuming you've kept the matched pair output and assuming you've
used 2
> different model names for the two different configurations of WRF,
that
> should give you two output lines with counts summed over the whole
months.
>
> Then rerun the job listed above, but add "-by FCST_VALID_BEG".
That'll
> give you the same counts but split out for each valid time. You can
> inspect the output counts to see when the differences show up. You
may
> need to tweak the filtering options depending on how you ran
point_stat and
> stored the output, but the basic idea should work.
>
> One obvious possibility is perhaps some of the old-wrf runs are
missing,
> causing fewer counts. Or perhaps the UPP runs aborted before
creating the
> 2-m temperature output GRIB records. I'd suggest looking date-by-
date,
> find one that differs, and investigate further.
>
> Hope that helps.
>
> Thanks,
> John Halley Gotway
> met_help at ucar.edu
>
>
> On Wed, Oct 8, 2014 at 9:29 AM, Tardif, Elliot M via RT
<met_help at ucar.edu
> >
> wrote:
>
> >
> > Wed Oct 08 09:29:28 2014: Request 69310 was acted upon.
> > Transaction: Ticket created by elliot.tardif at ncdenr.gov
> > Queue: met_help
> > Subject: Different data point counts for the same
geographical area
> > Owner: Nobody
> > Requestors: elliot.tardif at ncdenr.gov
> > Status: new
> > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=69310
> > >
> >
> >
> > Good morning,
> >
> > I am running MET v4.1 to perform some WRF model verification. I
am
> > running verification for two sets of WRF model data, using the
same
> > geographic polygon masks and for the same period of time for both
> > sets. My methodology is to run the wrfout files through the
Universal
> > Post Processor, then take the resulting wrfprs* files and run them
> > through point stat, then stat analysis, with the aim of producing
> > monthly verification values. However, the number of data points
that
> > are being counted by stat analysis differ between one set of WRF
data
> > to another, but only in a few regions I studied and only over a
few
> > months of the total temporal window that I looked at. I have
> > attempted to fix this problem by re-running the data and ensuring
that
> > the config files have the proper masks included, but there are
still
> > differences in the number of data points. I have attached a
> > spreadsheet of the data that compares the two WRF data sets I
studied
> for your review (please note columns G and!
> > H that indicate the number of data points counted). Do you know
> > what would cause this problem and how it could be fixed?
> >
> > Thanks,
> >
> > Elliot Tardif
> >
> > Elliot Tardif, Meteorologist II
> > NC DENR, Division of Air Quality
> > Planning Section, Attainment Planning Branch
> > 1641 Mail Service Center
> > Raleigh, NC 27699-1641
> > Phone/Fax: 919-707-8483
> > Email: Elliot.Tardif at ncdenr.gov<mailto:Nick.Witcraft at ncdenr.gov>
> > Web : http://www.ncair.org<http://www.ncair.org/>
> >
> > Email correspondence to and from this address is subject to the
North
> > Carolina Public Records Law and may be disclosed to third parties
> > unless the content is exempt by statue or other regulation.
> >
> >
> >
>
>
>
------------------------------------------------
More information about the Met_help
mailing list