[Met_help] [rt.rap.ucar.edu #41633] History for Stat analysis aggregate stat
RAL HelpDesk {for John Halley Gotway}
met_help at ucar.edu
Fri Oct 29 13:31:41 MDT 2010
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Hello,
I am using point-stat to compare hourly LAPS analyses with hourly point
observations. I am generating matched pair output so that I can then
use stat analysis to aggregate the data in a number of ways. I would
like to generate CNT statistics for each of the variables of interest at
each hour of the day. Normally I would aggregate by lead time (when
evaluating model output) but since each analysis has a lead time of 0,
can I aggregate the data by the forecast valid time (fcst_valid_beg)?
Thank you for your help,
Jackie
Jackie Miller
Meteorologist
Vaisala Inc.
Phone +1 303 885 3251
Mobile +1 303 885 3251
www.vaisala.com
<https://exchange.ou.edu/owa/redir.aspx?C=b302bd7f7cb24f099b2eb70ba1b9bf
5f&URL=https%3a%2f%2fwebmail.vaisala.com%2fexchweb%2fbin%2fredir.asp%3fU
RL%3dhttp%3a%2f%2fwww.vaisala.com>
This electronic message contains a communication which is strictly
confidential and intended solely for the addressee(s). Any
non-addressee is prohibited from reading, disseminating, distributing,
or copying the communication contained herein. If you are in possession
of the communication in error, please immediately notify the sender via
an electronic response and destroy the original communication. Thank
you.
U.S. Export Restrictions & Disclaimer: Export of any technical
information contained in this email and/or its attachments is subject to
the export control laws and regulations of the U.S. Government and may
require a valid license or written approval prior to export.
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: Stat analysis aggregate stat
From: jackie.miller
Time: Wed Oct 20 09:28:00 2010
Jackie Miller
Meteorologist
Vaisala Inc.
Phone +1 303 885 3251
Mobile +1 303 885 3251
www.vaisala.com
<https://exchange.ou.edu/owa/redir.aspx?C=b302bd7f7cb24f099b2eb70ba1b9bf
5f&URL=https%3a%2f%2fwebmail.vaisala.com%2fexchweb%2fbin%2fredir.asp%3fU
RL%3dhttp%3a%2f%2fwww.vaisala.com>
This electronic message contains a communication which is strictly
confidential and intended solely for the addressee(s). Any
non-addressee is prohibited from reading, disseminating, distributing,
or copying the communication contained herein. If you are in
possession
of the communication in error, please immediately notify the sender
via
an electronic response and destroy the original communication. Thank
you.
U.S. Export Restrictions & Disclaimer: Export of any technical
information contained in this email and/or its attachments is subject
to
the export control laws and regulations of the U.S. Government and may
require a valid license or written approval prior to export.
________________________________
From:
Sent: Wednesday, October 20, 2010 10:17 AM
To: 'met_help at ucar.edu'
Subject: RE: [rt.rap.ucar.edu #41633] AutoReply: Stat analysis
aggregate
stat
A bit more information about the issue:
When I run aggregate stat and include as one of the conditions:
-fcst_valid_beg $fcstvalid
If I am trying aggregate all of the results valid at 21Z on Oct 19, I
open that output file and see that the JOB list looks correct:
JOB_LIST: -job aggregate_stat -fcst_valid_beg 20101019_210000
fcst_var WIND -interp_pnts 9 -line_type MPR .........
BUT in the matched pair file I see that results from 21, 22, and 23Z
were also included in the aggregation:
The 00Z output includes ALL hours of the day, the 01Z includes all but
00Z, the 02Z includes all but 00 and 01Z, etc. So the only output
file
that matches what I want is the 23Z aggregation. Do you have any idea
why this is happening?
Jackie Miller
Meteorologist
Vaisala Inc.
Phone +1 303 885 3251
Mobile +1 303 885 3251
www.vaisala.com
This electronic message contains a communication which is strictly
confidential and intended solely for the addressee(s). Any
non-addressee is prohibited from reading, disseminating, distributing,
or copying the communication contained herein. If you are in
possession
of the communication in error, please immediately notify the sender
via
an electronic response and destroy the original communication. Thank
you.
U.S. Export Restrictions & Disclaimer: Export of any technical
information contained in this email and/or its attachments is subject
to
the export control laws and regulations of the U.S. Government and may
require a valid license or written approval prior to export.
-----Original Message-----
From: RAL HelpDesk {for met_help at ucar.edu} [mailto:met_help at ucar.edu]
Sent: Wednesday, October 20, 2010 9:57 AM
To: Miller Jackie JCM
Subject: [rt.rap.ucar.edu #41633] AutoReply: Stat analysis aggregate
stat
Greetings,
This message has been automatically generated in response to the
creation of a trouble ticket regarding:
"Stat analysis aggregate stat",
a summary of which appears below.
There is no need to reply to this message right now. Your ticket has
been
assigned an ID of [rt.rap.ucar.edu #41633].
Please include the string:
[rt.rap.ucar.edu #41633]
in the subject line of all future correspondence about this issue. To
do
so,
you may reply to this message.
Thank you,
met_help at ucar.edu
------------------------------------------------------------------------
-
Hello,
I am using point-stat to compare hourly LAPS analyses with hourly
point
observations. I am generating matched pair output so that I can then
use stat analysis to aggregate the data in a number of ways. I would
like to generate CNT statistics for each of the variables of interest
at
each hour of the day. Normally I would aggregate by lead time (when
evaluating model output) but since each analysis has a lead time of 0,
can I aggregate the data by the forecast valid time (fcst_valid_beg)?
Thank you for your help,
Jackie
Jackie Miller
Meteorologist
Vaisala Inc.
Phone +1 303 885 3251
Mobile +1 303 885 3251
www.vaisala.com
<https://exchange.ou.edu/owa/redir.aspx?C=b302bd7f7cb24f099b2eb70ba1b9bf
5f&URL=https%3a%2f%2fwebmail.vaisala.com%2fexchweb%2fbin%2fredir.asp%3fU
RL%3dhttp%3a%2f%2fwww.vaisala.com>
This electronic message contains a communication which is strictly
confidential and intended solely for the addressee(s). Any
non-addressee is prohibited from reading, disseminating, distributing,
or copying the communication contained herein. If you are in
possession
of the communication in error, please immediately notify the sender
via
an electronic response and destroy the original communication. Thank
you.
U.S. Export Restrictions & Disclaimer: Export of any technical
information contained in this email and/or its attachments is subject
to
the export control laws and regulations of the U.S. Government and may
require a valid license or written approval prior to export.
------------------------------------------------
Subject: Re: FW: [rt.rap.ucar.edu #41633] AutoReply: Stat analysis aggregate stat
From: John Halley Gotway
Time: Wed Oct 20 09:50:22 2010
Jackie,
I think I know what's going on here.
The short answer is, try setting up your job command arguments using:
-fcst_valid_beg $fcstvalid -fcst_valid_end $fcstvalid
The long answer is this... Most of the job command arguments use the
following logic. If you specify more than one of the same arguments,
STAT-Analysis will operate on the union of those selections.
For example, if you were to select "-vx_mask EAST -vx_mask WEST",
STAT-Analysis would include any lines that have vx_mask set to EAST
*OR* WEST. The settings for beginning and ending times work a
little bit differently. You use them to define a time window, and
therefore can only use them once. Listed below are comments from the
STAT-Analysis config file. You'll see that the ones for
beginning and ending times can only be used once.
In your case, you set the beginning of the matching time window to be
21Z but you did not set the ending of the matching time window. 22Z
and 23Z are included because they come after 21Z. But 20Z
was not included because it comes before. If you set the beginning
and ending times to be the same, STAT-Analysis will only use those
times that exactly match your setting - which I believe is what
you want.
Hopefully, that helps clarify.
Thanks,
John
// "-model name"
// "-fcst_lead HHMMSS"
// "-obs_lead HHMMSS"
// "-fcst_valid_beg YYYYMMDD[_HH[MMSS]]" (use once)
// "-fcst_valid_end YYYYMMDD[_HH[MMSS]]" (use once)
// "-obs_valid_beg YYYYMMDD[_HH[MMSS]]" (use once)
// "-obs_valid_end YYYYMMDD[_HH[MMSS]]" (use once)
// "-fcst_init_beg YYYYMMDD[_HH[MMSS]]" (use once)
// "-fcst_init_end YYYYMMDD[_HH[MMSS]]" (use once)
// "-obs_init_beg YYYYMMDD[_HH[MMSS]]" (use once)
// "-obs_init_end YYYYMMDD[_HH[MMSS]]" (use once)
// "-fcst_init_hour HH[MMSS]"
// "-obs_init_hour HH[MMSS]"
// "-fcst_var name"
// "-obs_var name"
// "-fcst_lev name"
// "-obs_lev name"
// "-obtype name"
// "-vx_mask name"
// "-interp_mthd name"
// "-interp_pnts n"
// "-fcst_thresh t"
// "-obs_thresh t"
// "-cov_thresh t"
// "-alpha a"
// "-line_type type"
On 10/20/2010 09:28 AM, RAL HelpDesk {for jackie.miller} wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=41633 >
>
>
>
>
>
> Jackie Miller
> Meteorologist
>
> Vaisala Inc.
>
> Phone +1 303 885 3251
> Mobile +1 303 885 3251
> www.vaisala.com
>
<https://exchange.ou.edu/owa/redir.aspx?C=b302bd7f7cb24f099b2eb70ba1b9bf
>
5f&URL=https%3a%2f%2fwebmail.vaisala.com%2fexchweb%2fbin%2fredir.asp%3fU
> RL%3dhttp%3a%2f%2fwww.vaisala.com>
>
>
>
> This electronic message contains a communication which is strictly
> confidential and intended solely for the addressee(s). Any
> non-addressee is prohibited from reading, disseminating,
distributing,
> or copying the communication contained herein. If you are in
possession
> of the communication in error, please immediately notify the sender
via
> an electronic response and destroy the original communication.
Thank
> you.
>
>
>
> U.S. Export Restrictions & Disclaimer: Export of any technical
> information contained in this email and/or its attachments is
subject to
> the export control laws and regulations of the U.S. Government and
may
> require a valid license or written approval prior to export.
>
> ________________________________
>
> From:
> Sent: Wednesday, October 20, 2010 10:17 AM
> To: 'met_help at ucar.edu'
> Subject: RE: [rt.rap.ucar.edu #41633] AutoReply: Stat analysis
aggregate
> stat
>
>
>
> A bit more information about the issue:
>
>
>
> When I run aggregate stat and include as one of the conditions:
>
> -fcst_valid_beg $fcstvalid
>
>
>
> If I am trying aggregate all of the results valid at 21Z on Oct 19,
I
> open that output file and see that the JOB list looks correct:
>
> JOB_LIST: -job aggregate_stat -fcst_valid_beg 20101019_210000
> fcst_var WIND -interp_pnts 9 -line_type MPR .........
>
>
>
> BUT in the matched pair file I see that results from 21, 22, and 23Z
> were also included in the aggregation:
>
>
>
>
>
> The 00Z output includes ALL hours of the day, the 01Z includes all
but
> 00Z, the 02Z includes all but 00 and 01Z, etc. So the only output
file
> that matches what I want is the 23Z aggregation. Do you have any
idea
> why this is happening?
>
>
>
>
>
> Jackie Miller
>
> Meteorologist
>
> Vaisala Inc.
>
>
>
> Phone +1 303 885 3251
>
> Mobile +1 303 885 3251
>
> www.vaisala.com
>
>
>
> This electronic message contains a communication which is strictly
> confidential and intended solely for the addressee(s). Any
> non-addressee is prohibited from reading, disseminating,
distributing,
> or copying the communication contained herein. If you are in
possession
> of the communication in error, please immediately notify the sender
via
> an electronic response and destroy the original communication.
Thank
> you.
>
>
>
> U.S. Export Restrictions & Disclaimer: Export of any technical
> information contained in this email and/or its attachments is
subject to
> the export control laws and regulations of the U.S. Government and
may
> require a valid license or written approval prior to export.
>
> -----Original Message-----
> From: RAL HelpDesk {for met_help at ucar.edu}
[mailto:met_help at ucar.edu]
> Sent: Wednesday, October 20, 2010 9:57 AM
> To: Miller Jackie JCM
> Subject: [rt.rap.ucar.edu #41633] AutoReply: Stat analysis aggregate
> stat
>
>
>
> Greetings,
>
>
>
> This message has been automatically generated in response to the
>
> creation of a trouble ticket regarding:
>
> "Stat analysis aggregate stat",
>
> a summary of which appears below.
>
>
>
> There is no need to reply to this message right now. Your ticket
has
> been
>
> assigned an ID of [rt.rap.ucar.edu #41633].
>
>
>
> Please include the string:
>
>
>
> [rt.rap.ucar.edu #41633]
>
>
>
> in the subject line of all future correspondence about this issue.
To do
> so,
>
> you may reply to this message.
>
>
>
> Thank you,
>
> met_help at ucar.edu
>
>
>
>
------------------------------------------------------------------------
> -
>
> Hello,
>
>
>
>
>
>
>
> I am using point-stat to compare hourly LAPS analyses with hourly
point
>
> observations. I am generating matched pair output so that I can
then
>
> use stat analysis to aggregate the data in a number of ways. I
would
>
> like to generate CNT statistics for each of the variables of
interest at
>
> each hour of the day. Normally I would aggregate by lead time (when
>
> evaluating model output) but since each analysis has a lead time of
0,
>
> can I aggregate the data by the forecast valid time
(fcst_valid_beg)?
>
>
>
>
>
>
>
> Thank you for your help,
>
>
>
> Jackie
>
>
>
>
>
>
>
> Jackie Miller
>
> Meteorologist
>
>
>
> Vaisala Inc.
>
>
>
> Phone +1 303 885 3251
>
> Mobile +1 303 885 3251
>
> www.vaisala.com
>
>
<https://exchange.ou.edu/owa/redir.aspx?C=b302bd7f7cb24f099b2eb70ba1b9bf
>
>
5f&URL=https%3a%2f%2fwebmail.vaisala.com%2fexchweb%2fbin%2fredir.asp%3fU
>
> RL%3dhttp%3a%2f%2fwww.vaisala.com>
>
>
>
>
>
>
>
> This electronic message contains a communication which is strictly
>
> confidential and intended solely for the addressee(s). Any
>
> non-addressee is prohibited from reading, disseminating,
distributing,
>
> or copying the communication contained herein. If you are in
possession
>
> of the communication in error, please immediately notify the sender
via
>
> an electronic response and destroy the original communication.
Thank
>
> you.
>
>
>
>
>
>
>
> U.S. Export Restrictions & Disclaimer: Export of any technical
>
> information contained in this email and/or its attachments is
subject to
>
> the export control laws and regulations of the U.S. Government and
may
>
> require a valid license or written approval prior to export.
>
>
>
>
>
>
>
>
>
>
------------------------------------------------
More information about the Met_help
mailing list