[Met_help] [rt.rap.ucar.edu #93940] History for Differences in some ozone and PM max/ave verification
John Halley Gotway via RT
met_help at ucar.edu
Wed Apr 1 11:08:54 MDT 2020
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Hi, there,
I am trying to figure out why there are some differences in VSDB
verification of some of the max/average statistics compared with MET stats
using METplus. John and George had been the folks who had been helping me
with setting this up, and now I have results and while some of the stats
are very close (especially with the ozone max), things don't look so close
with PM.
I'm working on WCOSS and can either send in results or I can point you to
where the relevant items are.
Let's start by giving you the command that I use to run this stuff:
/meso/save/Perry.Shafran/METplus-3.0-beta1/ush/master_metplus.py -c
/meso/save/Perry.Shafran/METplus-3.0-beta1/parm/use_cases/grid_to_obs/grid_to_obs.conf
-c
/meso/save/Perry.Shafran/METplus-3.0-beta1/parm/use_cases/grid_to_obs/examples/conus_surface.conf
-c
/meso/save/Perry.Shafran/METplus-3.0-beta1/parm/use_cases/perry/pb2nc_pmmax.conf
-c
/meso/save/Perry.Shafran/METplus-3.0-beta1/parm/use_cases/perry/shared_aqmax.conf
-c
/meso/save/Perry.Shafran/METplus-3.0-beta1/parm/use_cases/perry/point_stat_pmmax.conf
-c
/meso/save/Perry.Shafran/METplus-3.0-beta1/parm/use_cases/perry/system_test.conf
The .stat files are
here: /meso/noscrub/Perry.Shafran/metplus3_test/pmmax/stat/pmmax, mainly we
can look at point_stat_FCST_ANOWPM_160000L_20200125_040000V.stat.
The log file is
here: /meso/noscrub/Perry.Shafran/metplus3_test/logs/master_metplus.log.20200127210512.
Relevant met_config files are
here: /meso/save/Perry.Shafran/METplus-3.0-beta1/parm/met_config.
I think once again, the main differences are in ob counts. For example
PMMAX:
Full domain (G148): VSDB 792 MET 835
NEC: VSDB 91 MET 105
SEC: VSDB 34 MET 37
NWC: VSDB 98 MET 105
PMAVE:
Full domain (G148): VSDB 852 MET 835
NEC: VSDB 105 MET 105 (exact match!!)
SEC: VSDB 52 MET 37
NWC: VSDB 101 MET 105
That the counts for MET are consistent between the MAX and the AVE seems to
suggest that the MET is probably more correct than VSDB in calculating
these. I'm just not sure why, but if you have any thoughts, that would be
great.
The ozone max seemed to be consistent, but I'll also check that out and if
there are issues I'll get back to you on that.
Thanks!
Perry
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: Differences in some ozone and PM max/ave verification
From: perry.shafran at noaa.gov
Time: Tue Jan 28 08:18:41 2020
OK, here's the info on Ozone max:
1-hr ozone
Full domain: VSDB 759 MET 789
NEC: VSDB 89 MET 97
SEC: VSDB 19 MET 20
NWC: VSDB 49 MET 49 (another exact match)
8-hr ozone:
Full domain: VSDB 759 MET 791
NEC: VSDB 96 MET 97
SEC: VSDB 19 MET 20
NWC: VSDB 50 MET 50
The individual domains seem closer for ozone, but the full domain has
some
discrepancies.
Thanks!
Perry
On Tue, Jan 28, 2020 at 9:55 AM met_help at ucar.edu via RT
<met_help at ucar.edu>
wrote:
>
> Greetings,
>
> This message has been automatically generated in response to the
creation
> of a trouble ticket regarding:
> "Differences in some ozone and PM max/ave verification",
> a summary of which appears below.
>
> There is no need to reply to this message right now. Your ticket
has been
> assigned an ID of [rt.rap.ucar.edu #93940].
>
> Please include the string:
>
> [rt.rap.ucar.edu #93940]
>
> in the subject line of all future correspondence about this issue.
To do
> so, you may reply to this message.
>
> For more information, please see:
>
> MET Online Tutorial:
>
https://www.dtcenter.org/met/users/support/online_tutorial/index.php
>
> MET Users Guide:
> https://www.dtcenter.org/met/users/docs/overview.php
>
> MET FAQs:
> https://www.dtcenter.org/met/users/support/faqs/index.php
>
> MET-Help Email Archive:
> http://mailman.ucar.edu/pipermail/met_help
>
> Thank you,
> met_help at ucar.edu
>
>
-------------------------------------------------------------------------
> Hi, there,
>
> I am trying to figure out why there are some differences in VSDB
> verification of some of the max/average statistics compared with MET
stats
> using METplus. John and George had been the folks who had been
helping me
> with setting this up, and now I have results and while some of the
stats
> are very close (especially with the ozone max), things don't look so
close
> with PM.
>
> I'm working on WCOSS and can either send in results or I can point
you to
> where the relevant items are.
>
> Let's start by giving you the command that I use to run this stuff:
>
> /meso/save/Perry.Shafran/METplus-3.0-beta1/ush/master_metplus.py -c
>
> /meso/save/Perry.Shafran/METplus-3.0-
beta1/parm/use_cases/grid_to_obs/grid_to_obs.conf
> -c
>
> /meso/save/Perry.Shafran/METplus-3.0-
beta1/parm/use_cases/grid_to_obs/examples/conus_surface.conf
> -c
>
> /meso/save/Perry.Shafran/METplus-3.0-
beta1/parm/use_cases/perry/pb2nc_pmmax.conf
> -c
>
> /meso/save/Perry.Shafran/METplus-3.0-
beta1/parm/use_cases/perry/shared_aqmax.conf
> -c
>
> /meso/save/Perry.Shafran/METplus-3.0-
beta1/parm/use_cases/perry/point_stat_pmmax.conf
> -c
>
> /meso/save/Perry.Shafran/METplus-3.0-
beta1/parm/use_cases/perry/system_test.conf
>
> The .stat files are
> here: /meso/noscrub/Perry.Shafran/metplus3_test/pmmax/stat/pmmax,
mainly we
> can look at point_stat_FCST_ANOWPM_160000L_20200125_040000V.stat.
>
> The log file is
> here:
>
/meso/noscrub/Perry.Shafran/metplus3_test/logs/master_metplus.log.20200127210512.
>
> Relevant met_config files are
> here: /meso/save/Perry.Shafran/METplus-3.0-beta1/parm/met_config.
>
> I think once again, the main differences are in ob counts. For
example
>
> PMMAX:
> Full domain (G148): VSDB 792 MET 835
> NEC: VSDB 91 MET 105
> SEC: VSDB 34 MET 37
> NWC: VSDB 98 MET 105
>
> PMAVE:
> Full domain (G148): VSDB 852 MET 835
> NEC: VSDB 105 MET 105 (exact match!!)
> SEC: VSDB 52 MET 37
> NWC: VSDB 101 MET 105
>
> That the counts for MET are consistent between the MAX and the AVE
seems to
> suggest that the MET is probably more correct than VSDB in
calculating
> these. I'm just not sure why, but if you have any thoughts, that
would be
> great.
>
> The ozone max seemed to be consistent, but I'll also check that out
and if
> there are issues I'll get back to you on that.
>
> Thanks!
>
> Perry
>
>
------------------------------------------------
Subject: Differences in some ozone and PM max/ave verification
From: John Halley Gotway
Time: Wed Apr 01 11:03:48 2020
Hi Perry,
I'm trying to clean up some old MET-Help tickets. This one about obs
count mismatches is still open.
With all the craziness of switching to working from home, I can't
remember all the details. Where does this issue stand? Did we ever
get the ob counts rectified?
Thanks,
John
------------------------------------------------
Subject: Differences in some ozone and PM max/ave verification
From: perry.shafran at noaa.gov
Time: Wed Apr 01 11:06:08 2020
Yes, this issue is resolved. Please close the issue.
Thanks!
Perry
On Wed, Apr 1, 2020 at 1:04 PM John Halley Gotway via RT
<met_help at ucar.edu>
wrote:
> Hi Perry,
>
> I'm trying to clean up some old MET-Help tickets. This one about
obs
> count mismatches is still open.
>
> With all the craziness of switching to working from home, I can't
remember
> all the details. Where does this issue stand? Did we ever get the
ob
> counts rectified?
>
> Thanks,
> John
>
------------------------------------------------
More information about the Met_help
mailing list