[Met_help] [rt.rap.ucar.edu #74210] History for application of ensemble_stat utility of MET
John Halley Gotway via RT
met_help at ucar.edu
Tue Jan 5 10:19:41 MST 2016
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Hi MET Help,
I am trying to get WRF verifications on monthly basis. I have hourly WRF-ARW outputs and observations. I have managed to do verification on hourly basis using MET tool. I need your help on several areas.
1. From reading the MET users archives, I understand that ensemble_stat utility of MET can be used to derive daily model and observation outputs from the hourly model and obs. Please guide me where and how to start on aggregating hourly model and obs into daily model and obs. Then, I am thinking to run point_stat on those daily datasets.
2. I have tried to run ensemble_stat, but no success. Obviously, I am trying it without a full understanding of command line specifications. Following is a segment of the ensemble_stat script that I have tried.
a. How to specify 24 WRF files in the command line other than literally listed as shown below?
b. I have hourly grid_obs, in this command line, how to specify all 24- grid_obs?
c. In general, this attempt was made for preparing daily datasets. I may have totally misunderstanding of purpose of the ensemble_stat utility.
Thank you for your devoted time and response. NTsengel
-------------------------
echo "*** Running Ensemble-Stat on APCP using GRIB forecasts, point observations, and gridded observations ***"
#$PATH/ensemble_stat \
# 24 ${FCS_DIR}/wrfprs_d01_1997-06-02_00 ${FCS_DIR}/wrfprs_d01_1997-06-02_01 \
# ${FCS_DIR}/wrfprs_d01_1997-06-02_02 ${FCS_DIR}/wrfprs_d01_1997-06-02_03 \
# ${FCS_DIR}/wrfprs_d01_1997-06-02_04 ${FCS_DIR}/wrfprs_d01_1997-06-02_05 \
# ${FCS_DIR}/wrfprs_d01_1997-06-02_06 ${FCS_DIR}/wrfprs_d01_1997-06-02_07 \
# ${FCS_DIR}/wrfprs_d01_1997-06-02_08 ${FCS_DIR}/wrfprs_d01_1997-06-02_09 \
# ${FCS_DIR}/wrfprs_d01_1997-06-02_10 ${FCS_DIR}/wrfprs_d01_1997-06-02_11 \
# ${FCS_DIR}/wrfprs_d01_1997-06-02_12 ${FCS_DIR}/wrfprs_d01_1997-06-02_13 \
# ${FCS_DIR}/wrfprs_d01_1997-06-02_14 ${FCS_DIR}/wrfprs_d01_1997-06-02_15 \
# ${FCS_DIR}/wrfprs_d01_1997-06-02_16 ${FCS_DIR}/wrfprs_d01_1997-06-02_17 \
# ${FCS_DIR}/wrfprs_d01_1997-06-02_18 ${FCS_DIR}/wrfprs_d01_1997-06-02_19 \
# ${FCS_DIR}/wrfprs_d01_1997-06-02_20 ${FCS_DIR}/wrfprs_d01_1997-06-02_21 \
# ${FCS_DIR}/wrfprs_d01_1997-06-02_22 ${FCS_DIR}/wrfprs_d01_1997-06-02_23 \
#
$PATH/ensemble_stat \
${FCS_DIR}/wrfprs_d01_1997-06-02_00 \
-grid_obs ${FCS_DIR}/ST2.19970602.00_lambert.grb \
${CONFIG_DIR}/EnsembleStatConfig_bio \
-outdir ${OUT_DIR}/ensemble_stat -v 10
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: application of ensemble_stat utility of MET
From: John Halley Gotway
Time: Mon Nov 30 12:46:08 2015
NTsengel,
I see that you're using MET to compute hourly gridded statistics.
Since
you have gridded forecast and observation files, I suspect that you
used
the Grid-Stat tool to compute those statistics. Grid-Stat computes
statistics by grouping together matched pairs (i.e. forecast and
observation pairs) over some geographic area. Once you have output
from
Grid-Stat for many times, you can run the STAT-Analysis tool to
aggregate
those results through time. For example, suppose you have contingency
table output lines (i.e. CTC lines) for many times computed over the
full
model domain using (for example) a threshold of >10 mm. You could
aggregate those results across many time by running this type of
STAT-Analysis job:
stat_analysis -lookin /path/to/grid_stat/output -job aggregate
-line_type
CTC -fcst_thresh gt10 -vx_mask FULL
Or you could aggregate them together AND derive the corresponding
statistics:
stat_analysis -lookin /path/to/grid_stat/output -job aggregate_stat
-line_type CTC -out_line_type CTS -fcst_thresh gt10 -vx_mask FULL
I see that you've been trying to run the Ensemble-Stat tool. Unless
you're
processing output from several ensemble members, that tool won't be
very
useful to you. Instead, I suspect that you're intending to run the
Series-Analysis tool. The Grid-Stat tool compute statistics over some
geographic area at a single point in time. The Series-Analysis tool
computes statistics at each individual grid point over multiple times.
You
pass Series-Analysis a list of forecast files and a list of
observation
files. It computes statistics at each grid point using the time
series of
values for that grid point. The output is a NetCDF file containing
one or
more output statistics (as specified by the config file). The intent
here
is to see the geographic distribution of statistics to see how the
model
performance varies over the domain.
Here's a link to the online tutorial about Series-Analysis:
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.0/series_analysis/index.php
Hopefully that helps.
Thanks,
John Halley Gotway
met_help at ucar.edu
On Wed, Nov 25, 2015 at 1:12 PM, Nergui, Tsengel via RT
<met_help at ucar.edu>
wrote:
>
> Wed Nov 25 13:12:21 2015: Request 74210 was acted upon.
> Transaction: Ticket created by tsengel.nergui at wsu.edu
> Queue: met_help
> Subject: application of ensemble_stat utility of MET
> Owner: Nobody
> Requestors: tsengel.nergui at wsu.edu
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=74210 >
>
>
> Hi MET Help,
>
> I am trying to get WRF verifications on monthly basis. I have hourly
> WRF-ARW outputs and observations. I have managed to do verification
on
> hourly basis using MET tool. I need your help on several areas.
>
>
> 1. From reading the MET users archives, I understand that
> ensemble_stat utility of MET can be used to derive daily model and
> observation outputs from the hourly model and obs. Please guide me
where
> and how to start on aggregating hourly model and obs into daily
model and
> obs. Then, I am thinking to run point_stat on those daily datasets.
>
>
> 2. I have tried to run ensemble_stat, but no success.
Obviously, I
> am trying it without a full understanding of command line
specifications.
> Following is a segment of the ensemble_stat script that I have
tried.
>
>
>
> a. How to specify 24 WRF files in the command line other than
> literally listed as shown below?
>
> b. I have hourly grid_obs, in this command line, how to specify
all
> 24- grid_obs?
>
> c. In general, this attempt was made for preparing daily
datasets. I
> may have totally misunderstanding of purpose of the ensemble_stat
utility.
>
>
> Thank you for your devoted time and response. NTsengel
>
> -------------------------
> echo "*** Running Ensemble-Stat on APCP using GRIB forecasts, point
> observations, and gridded observations ***"
> #$PATH/ensemble_stat \
> # 24 ${FCS_DIR}/wrfprs_d01_1997-06-02_00
> ${FCS_DIR}/wrfprs_d01_1997-06-02_01 \
> # ${FCS_DIR}/wrfprs_d01_1997-06-02_02
> ${FCS_DIR}/wrfprs_d01_1997-06-02_03 \
> # ${FCS_DIR}/wrfprs_d01_1997-06-02_04
> ${FCS_DIR}/wrfprs_d01_1997-06-02_05 \
> # ${FCS_DIR}/wrfprs_d01_1997-06-02_06
> ${FCS_DIR}/wrfprs_d01_1997-06-02_07 \
> # ${FCS_DIR}/wrfprs_d01_1997-06-02_08
> ${FCS_DIR}/wrfprs_d01_1997-06-02_09 \
> # ${FCS_DIR}/wrfprs_d01_1997-06-02_10
> ${FCS_DIR}/wrfprs_d01_1997-06-02_11 \
> # ${FCS_DIR}/wrfprs_d01_1997-06-02_12
> ${FCS_DIR}/wrfprs_d01_1997-06-02_13 \
> # ${FCS_DIR}/wrfprs_d01_1997-06-02_14
> ${FCS_DIR}/wrfprs_d01_1997-06-02_15 \
> # ${FCS_DIR}/wrfprs_d01_1997-06-02_16
> ${FCS_DIR}/wrfprs_d01_1997-06-02_17 \
> # ${FCS_DIR}/wrfprs_d01_1997-06-02_18
> ${FCS_DIR}/wrfprs_d01_1997-06-02_19 \
> # ${FCS_DIR}/wrfprs_d01_1997-06-02_20
> ${FCS_DIR}/wrfprs_d01_1997-06-02_21 \
> # ${FCS_DIR}/wrfprs_d01_1997-06-02_22
> ${FCS_DIR}/wrfprs_d01_1997-06-02_23 \
> #
> $PATH/ensemble_stat \
> ${FCS_DIR}/wrfprs_d01_1997-06-02_00 \
> -grid_obs ${FCS_DIR}/ST2.19970602.00_lambert.grb \
> ${CONFIG_DIR}/EnsembleStatConfig_bio \
> -outdir ${OUT_DIR}/ensemble_stat -v 10
>
>
>
>
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #74210] application of ensemble_stat utility of MET
From: Nergui, Tsengel
Time: Mon Jan 04 17:49:53 2016
Hi John,
I forgot to reply to you once I got your mail, which was very
informative and I will try using it. You can close the ticket as the
same day you had replied.
Thanks again, NTsengel
-----Original Message-----
From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
Sent: Monday, November 30, 2015 11:46 AM
To: Nergui, Tsengel
Subject: Re: [rt.rap.ucar.edu #74210] application of ensemble_stat
utility of MET
NTsengel,
I see that you're using MET to compute hourly gridded statistics.
Since you have gridded forecast and observation files, I suspect that
you used the Grid-Stat tool to compute those statistics. Grid-Stat
computes statistics by grouping together matched pairs (i.e. forecast
and observation pairs) over some geographic area. Once you have
output from Grid-Stat for many times, you can run the STAT-Analysis
tool to aggregate those results through time. For example, suppose
you have contingency table output lines (i.e. CTC lines) for many
times computed over the full model domain using (for example) a
threshold of >10 mm. You could aggregate those results across many
time by running this type of STAT-Analysis job:
stat_analysis -lookin /path/to/grid_stat/output -job aggregate
-line_type CTC -fcst_thresh gt10 -vx_mask FULL
Or you could aggregate them together AND derive the corresponding
statistics:
stat_analysis -lookin /path/to/grid_stat/output -job aggregate_stat
-line_type CTC -out_line_type CTS -fcst_thresh gt10 -vx_mask FULL
I see that you've been trying to run the Ensemble-Stat tool. Unless
you're processing output from several ensemble members, that tool
won't be very useful to you. Instead, I suspect that you're intending
to run the Series-Analysis tool. The Grid-Stat tool compute
statistics over some geographic area at a single point in time. The
Series-Analysis tool computes statistics at each individual grid point
over multiple times. You pass Series-Analysis a list of forecast
files and a list of observation files. It computes statistics at each
grid point using the time series of values for that grid point. The
output is a NetCDF file containing one or more output statistics (as
specified by the config file). The intent here is to see the
geographic distribution of statistics to see how the model performance
varies over the domain.
Here's a link to the online tutorial about Series-Analysis:
https://urldefense.proofpoint.com/v2/url?u=http-
3A__www.dtcenter.org_met_users_support_online-
5Ftutorial_METv5.0_series-
5Fanalysis_index.php&d=CwIDaQ&c=C3yme8gMkxg_ihJNXS06ZyWk4EJm8LdrrvxQb-
Je7sw&r=OUixJTR1U-
9NUyc8rj3XpGV38A03YgZoNOMgJhE5JYE&m=tO0caTp9H9Bs_Trzz0KNP1cMWeAQV6VqxJbPe5RZbas&s=0iaNp8W3RW4yQgw3pFayCqS5_NBZ3lO6lrvoBVDquz0&e=
Hopefully that helps.
Thanks,
John Halley Gotway
met_help at ucar.edu
On Wed, Nov 25, 2015 at 1:12 PM, Nergui, Tsengel via RT
<met_help at ucar.edu>
wrote:
>
> Wed Nov 25 13:12:21 2015: Request 74210 was acted upon.
> Transaction: Ticket created by tsengel.nergui at wsu.edu
> Queue: met_help
> Subject: application of ensemble_stat utility of MET
> Owner: Nobody
> Requestors: tsengel.nergui at wsu.edu
> Status: new
> Ticket
> <URL:https://urldefense.proofpoint.com/v2/url?u=https-
3A__rt.rap.ucar.
> edu_rt_Ticket_Display.html-3Fid-
3D74210&d=CwIDaQ&c=C3yme8gMkxg_ihJNXS0
> 6ZyWk4EJm8LdrrvxQb-Je7sw&r=OUixJTR1U-
9NUyc8rj3XpGV38A03YgZoNOMgJhE5JYE
> &m=tO0caTp9H9Bs_Trzz0KNP1cMWeAQV6VqxJbPe5RZbas&s=c-
Gi058jRCtlimgyM5EyV
> H05_8ofcMKCj7YX7EJr-cU&e= >
>
>
> Hi MET Help,
>
> I am trying to get WRF verifications on monthly basis. I have hourly
> WRF-ARW outputs and observations. I have managed to do verification
on
> hourly basis using MET tool. I need your help on several areas.
>
>
> 1. From reading the MET users archives, I understand that
> ensemble_stat utility of MET can be used to derive daily model and
> observation outputs from the hourly model and obs. Please guide me
> where and how to start on aggregating hourly model and obs into
daily
> model and obs. Then, I am thinking to run point_stat on those daily
datasets.
>
>
> 2. I have tried to run ensemble_stat, but no success.
Obviously, I
> am trying it without a full understanding of command line
specifications.
> Following is a segment of the ensemble_stat script that I have
tried.
>
>
>
> a. How to specify 24 WRF files in the command line other than
> literally listed as shown below?
>
> b. I have hourly grid_obs, in this command line, how to specify
all
> 24- grid_obs?
>
> c. In general, this attempt was made for preparing daily
datasets. I
> may have totally misunderstanding of purpose of the ensemble_stat
utility.
>
>
> Thank you for your devoted time and response. NTsengel
>
> -------------------------
> echo "*** Running Ensemble-Stat on APCP using GRIB forecasts, point
> observations, and gridded observations ***"
> #$PATH/ensemble_stat \
> # 24 ${FCS_DIR}/wrfprs_d01_1997-06-02_00
> ${FCS_DIR}/wrfprs_d01_1997-06-02_01 \
> # ${FCS_DIR}/wrfprs_d01_1997-06-02_02
> ${FCS_DIR}/wrfprs_d01_1997-06-02_03 \
> # ${FCS_DIR}/wrfprs_d01_1997-06-02_04
> ${FCS_DIR}/wrfprs_d01_1997-06-02_05 \
> # ${FCS_DIR}/wrfprs_d01_1997-06-02_06
> ${FCS_DIR}/wrfprs_d01_1997-06-02_07 \
> # ${FCS_DIR}/wrfprs_d01_1997-06-02_08
> ${FCS_DIR}/wrfprs_d01_1997-06-02_09 \
> # ${FCS_DIR}/wrfprs_d01_1997-06-02_10
> ${FCS_DIR}/wrfprs_d01_1997-06-02_11 \
> # ${FCS_DIR}/wrfprs_d01_1997-06-02_12
> ${FCS_DIR}/wrfprs_d01_1997-06-02_13 \
> # ${FCS_DIR}/wrfprs_d01_1997-06-02_14
> ${FCS_DIR}/wrfprs_d01_1997-06-02_15 \
> # ${FCS_DIR}/wrfprs_d01_1997-06-02_16
> ${FCS_DIR}/wrfprs_d01_1997-06-02_17 \
> # ${FCS_DIR}/wrfprs_d01_1997-06-02_18
> ${FCS_DIR}/wrfprs_d01_1997-06-02_19 \
> # ${FCS_DIR}/wrfprs_d01_1997-06-02_20
> ${FCS_DIR}/wrfprs_d01_1997-06-02_21 \
> # ${FCS_DIR}/wrfprs_d01_1997-06-02_22
> ${FCS_DIR}/wrfprs_d01_1997-06-02_23 \
> #
> $PATH/ensemble_stat \
> ${FCS_DIR}/wrfprs_d01_1997-06-02_00 \ -grid_obs
> ${FCS_DIR}/ST2.19970602.00_lambert.grb \
> ${CONFIG_DIR}/EnsembleStatConfig_bio \
> -outdir ${OUT_DIR}/ensemble_stat -v 10
>
>
>
>
------------------------------------------------
More information about the Met_help
mailing list