[Met_help] [rt.rap.ucar.edu #70512] History for Request info about Ensemble-Stat (UNCLASSIFIED)

John Halley Gotway via RT met_help at ucar.edu
Mon Jan 26 15:37:50 MST 2015


----------------------------------------------------------------
  Initial Request
----------------------------------------------------------------

Classification: UNCLASSIFIED
Caveats: NONE

I have run Ensemble-Stat on a set of 12 WRF members with observations and
received the expected results with MET V4.1. I specified the SSVAR, RHIST,
and ORANK output which were output as 3 text files. I also have the .stat
file and the ens.nc file. Do you have references you may have used to select
the various statistics which appear in the output files? Can you tell me how
the ME, MAE and RMSE values in the SSVAR output were calculated? 

Thanks.

R/
John

Mr John W. Raby, Meteorologist
U.S. Army Research Laboratory
White Sands Missile Range, NM 88002
(575) 678-2004 DSN 258-2004
FAX (575) 678-1230 DSN 258-1230
Email: john.w.raby2.civ at mail.mil



Classification: UNCLASSIFIED
Caveats: NONE




----------------------------------------------------------------
  Complete Ticket History
----------------------------------------------------------------

Subject: Request info about Ensemble-Stat (UNCLASSIFIED)
From: Raby, John W USA CIV
Time: Mon Jan 26 12:52:23 2015

Classification: UNCLASSIFIED
Caveats: NONE

To clarify my question on calculation of the ME, MAE and RMSE, I want
to know
how the value from the ensemble was determined. Was the field which is
the
mean of the ensembles used for the forecast values to be input into
the
formulas for ME, MAE and RMSE?

Thanks.

R/
John


-----Original Message-----
From: met_help at ucar.edu via RT [mailto:met_help at ucar.edu]
Sent: Monday, January 26, 2015 12:23 PM
To: Raby, John W CIV USARMY ARL (US)
Subject: [rt.rap.ucar.edu #70512] AutoReply: Request info about
Ensemble-Stat
(UNCLASSIFIED)

Greetings,

This message has been automatically generated in response to the
creation of a
trouble ticket regarding:
	"Request info about Ensemble-Stat (UNCLASSIFIED)", a summary of which
appears
below.

There is no need to reply to this message right now.  Your ticket has
been
assigned an ID of [rt.rap.ucar.edu #70512].

Please include the string:

         [rt.rap.ucar.edu #70512]

in the subject line of all future correspondence about this issue. To
do so,
you may reply to this message.

                        Thank you,
                        met_help at ucar.edu

-------------------------------------------------------------------------
Classification: UNCLASSIFIED
Caveats: NONE

I have run Ensemble-Stat on a set of 12 WRF members with observations
and
received the expected results with MET V4.1. I specified the SSVAR,
RHIST, and
ORANK output which were output as 3 text files. I also have the .stat
file and
the ens.nc file. Do you have references you may have used to select
the
various statistics which appear in the output files? Can you tell me
how the
ME, MAE and RMSE values in the SSVAR output were calculated?

Thanks.

R/
John

Mr John W. Raby, Meteorologist
U.S. Army Research Laboratory
White Sands Missile Range, NM 88002
(575) 678-2004 DSN 258-2004
FAX (575) 678-1230 DSN 258-1230
Email: john.w.raby2.civ at mail.mil



Classification: UNCLASSIFIED
Caveats: NONE




Classification: UNCLASSIFIED
Caveats: NONE



------------------------------------------------
Subject: Request info about Ensemble-Stat (UNCLASSIFIED)
From: John Halley Gotway
Time: Mon Jan 26 13:32:39 2015

Hello John,

The SSVAR line type contains "spread-skill" information used in
creating
ensemble Spread-Skill plots.  The "spread" is the variance of the
ensemble
members while the "skill" is the partials sums followed by a handful
of
continuous statistics.  We include the partial sums columns (FBAR,
OBAR,
FOBAR, FFBAR, and OOBAR) so that we can later aggregate multiple cases
together and create a spread-skill plot for several cases combined.

You have two options for computing the "skill" part of it.
(1) You can use the "-ssvar_mean" command line option to pass the tool
ensemble mean fields that should be used when computing SSVAR.
(2) If you don't use the "-ssvar_mean" option, Ensemble-Stat will use
the
ensemble mean field that it computes using the ensemble members you
passed
to it.

The variance values are "binned" in the output with one SSVAR output
line
for each bin.  You control the width of those bins using the
"ens_ssvar_bin_size" configuration file option.

Does that clarify it?

Thanks,
John

On Mon, Jan 26, 2015 at 12:52 PM, Raby, John W USA CIV via RT <
met_help at ucar.edu> wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=70512 >
>
> Classification: UNCLASSIFIED
> Caveats: NONE
>
> To clarify my question on calculation of the ME, MAE and RMSE, I
want to
> know
> how the value from the ensemble was determined. Was the field which
is the
> mean of the ensembles used for the forecast values to be input into
the
> formulas for ME, MAE and RMSE?
>
> Thanks.
>
> R/
> John
>
>
> -----Original Message-----
> From: met_help at ucar.edu via RT [mailto:met_help at ucar.edu]
> Sent: Monday, January 26, 2015 12:23 PM
> To: Raby, John W CIV USARMY ARL (US)
> Subject: [rt.rap.ucar.edu #70512] AutoReply: Request info about
> Ensemble-Stat
> (UNCLASSIFIED)
>
> Greetings,
>
> This message has been automatically generated in response to the
creation
> of a
> trouble ticket regarding:
>         "Request info about Ensemble-Stat (UNCLASSIFIED)", a summary
of
> which appears
> below.
>
> There is no need to reply to this message right now.  Your ticket
has been
> assigned an ID of [rt.rap.ucar.edu #70512].
>
> Please include the string:
>
>          [rt.rap.ucar.edu #70512]
>
> in the subject line of all future correspondence about this issue.
To do
> so,
> you may reply to this message.
>
>                         Thank you,
>                         met_help at ucar.edu
>
>
-------------------------------------------------------------------------
> Classification: UNCLASSIFIED
> Caveats: NONE
>
> I have run Ensemble-Stat on a set of 12 WRF members with
observations and
> received the expected results with MET V4.1. I specified the SSVAR,
RHIST,
> and
> ORANK output which were output as 3 text files. I also have the
.stat file
> and
> the ens.nc file. Do you have references you may have used to select
the
> various statistics which appear in the output files? Can you tell me
how
> the
> ME, MAE and RMSE values in the SSVAR output were calculated?
>
> Thanks.
>
> R/
> John
>
> Mr John W. Raby, Meteorologist
> U.S. Army Research Laboratory
> White Sands Missile Range, NM 88002
> (575) 678-2004 DSN 258-2004
> FAX (575) 678-1230 DSN 258-1230
> Email: john.w.raby2.civ at mail.mil
>
>
>
> Classification: UNCLASSIFIED
> Caveats: NONE
>
>
>
>
> Classification: UNCLASSIFIED
> Caveats: NONE
>
>
>
>

------------------------------------------------
Subject: Request info about Ensemble-Stat (UNCLASSIFIED)
From: Raby, John W USA CIV
Time: Mon Jan 26 14:07:25 2015

Classification: UNCLASSIFIED
Caveats: NONE

John -

Your explanation clears up the specific question I had on calculating
the
continuous statistics. Also helpful was the info on -ssvar_mean
command line
option and the configuration file option to control the bin sizes.

Do you know of any references from the literature which were consulted
to
decide which statistics are generated by Ensemble-Stat in general? I'd
like to
read them to understand more about their use in actual studies.

Thanks.

R/
John

-----Original Message-----
From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
Sent: Monday, January 26, 2015 1:33 PM
To: Raby, John W CIV USARMY ARL (US)
Subject: Re: [rt.rap.ucar.edu #70512] AutoReply: Request info about
Ensemble-Stat (UNCLASSIFIED)

Hello John,

The SSVAR line type contains "spread-skill" information used in
creating
ensemble Spread-Skill plots.  The "spread" is the variance of the
ensemble
members while the "skill" is the partials sums followed by a handful
of
continuous statistics.  We include the partial sums columns (FBAR,
OBAR,
FOBAR, FFBAR, and OOBAR) so that we can later aggregate multiple cases
together and create a spread-skill plot for several cases combined.

You have two options for computing the "skill" part of it.
(1) You can use the "-ssvar_mean" command line option to pass the tool
ensemble mean fields that should be used when computing SSVAR.
(2) If you don't use the "-ssvar_mean" option, Ensemble-Stat will use
the
ensemble mean field that it computes using the ensemble members you
passed to
it.

The variance values are "binned" in the output with one SSVAR output
line for
each bin.  You control the width of those bins using the
"ens_ssvar_bin_size"
configuration file option.

Does that clarify it?

Thanks,
John

On Mon, Jan 26, 2015 at 12:52 PM, Raby, John W USA CIV via RT <
met_help at ucar.edu> wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=70512 >
>
> Classification: UNCLASSIFIED
> Caveats: NONE
>
> To clarify my question on calculation of the ME, MAE and RMSE, I
want
> to know how the value from the ensemble was determined. Was the
field
> which is the mean of the ensembles used for the forecast values to
be
> input into the formulas for ME, MAE and RMSE?
>
> Thanks.
>
> R/
> John
>
>
> -----Original Message-----
> From: met_help at ucar.edu via RT [mailto:met_help at ucar.edu]
> Sent: Monday, January 26, 2015 12:23 PM
> To: Raby, John W CIV USARMY ARL (US)
> Subject: [rt.rap.ucar.edu #70512] AutoReply: Request info about
> Ensemble-Stat
> (UNCLASSIFIED)
>
> Greetings,
>
> This message has been automatically generated in response to the
> creation of a trouble ticket regarding:
>         "Request info about Ensemble-Stat (UNCLASSIFIED)", a summary
> of which appears below.
>
> There is no need to reply to this message right now.  Your ticket
has
> been assigned an ID of [rt.rap.ucar.edu #70512].
>
> Please include the string:
>
>          [rt.rap.ucar.edu #70512]
>
> in the subject line of all future correspondence about this issue.
To
> do so, you may reply to this message.
>
>                         Thank you,
>                         met_help at ucar.edu
>
>
----------------------------------------------------------------------
> ---
> Classification: UNCLASSIFIED
> Caveats: NONE
>
> I have run Ensemble-Stat on a set of 12 WRF members with
observations
> and received the expected results with MET V4.1. I specified the
> SSVAR, RHIST, and ORANK output which were output as 3 text files. I
> also have the .stat file and the ens.nc file. Do you have references
> you may have used to select the various statistics which appear in
the
> output files? Can you tell me how the ME, MAE and RMSE values in the
> SSVAR output were calculated?
>
> Thanks.
>
> R/
> John
>
> Mr John W. Raby, Meteorologist
> U.S. Army Research Laboratory
> White Sands Missile Range, NM 88002
> (575) 678-2004 DSN 258-2004
> FAX (575) 678-1230 DSN 258-1230
> Email: john.w.raby2.civ at mail.mil
>
>
>
> Classification: UNCLASSIFIED
> Caveats: NONE
>
>
>
>
> Classification: UNCLASSIFIED
> Caveats: NONE
>
>
>
>


Classification: UNCLASSIFIED
Caveats: NONE



------------------------------------------------
Subject: Request info about Ensemble-Stat (UNCLASSIFIED)
From: John Halley Gotway
Time: Mon Jan 26 14:22:57 2015

John,

I don't have the information, so I reassigned this ticket to Tressa,
our
resident statistician.  Hopefully, she'll be able to pass along some
references.

Thanks,
John

On Mon, Jan 26, 2015 at 2:07 PM, Raby, John W USA CIV via RT <
met_help at ucar.edu> wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=70512 >
>
> Classification: UNCLASSIFIED
> Caveats: NONE
>
> John -
>
> Your explanation clears up the specific question I had on
calculating the
> continuous statistics. Also helpful was the info on -ssvar_mean
command
> line
> option and the configuration file option to control the bin sizes.
>
> Do you know of any references from the literature which were
consulted to
> decide which statistics are generated by Ensemble-Stat in general?
I'd
> like to
> read them to understand more about their use in actual studies.
>
> Thanks.
>
> R/
> John
>
> -----Original Message-----
> From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> Sent: Monday, January 26, 2015 1:33 PM
> To: Raby, John W CIV USARMY ARL (US)
> Subject: Re: [rt.rap.ucar.edu #70512] AutoReply: Request info about
> Ensemble-Stat (UNCLASSIFIED)
>
> Hello John,
>
> The SSVAR line type contains "spread-skill" information used in
creating
> ensemble Spread-Skill plots.  The "spread" is the variance of the
ensemble
> members while the "skill" is the partials sums followed by a handful
of
> continuous statistics.  We include the partial sums columns (FBAR,
OBAR,
> FOBAR, FFBAR, and OOBAR) so that we can later aggregate multiple
cases
> together and create a spread-skill plot for several cases combined.
>
> You have two options for computing the "skill" part of it.
> (1) You can use the "-ssvar_mean" command line option to pass the
tool
> ensemble mean fields that should be used when computing SSVAR.
> (2) If you don't use the "-ssvar_mean" option, Ensemble-Stat will
use the
> ensemble mean field that it computes using the ensemble members you
passed
> to
> it.
>
> The variance values are "binned" in the output with one SSVAR output
line
> for
> each bin.  You control the width of those bins using the
> "ens_ssvar_bin_size"
> configuration file option.
>
> Does that clarify it?
>
> Thanks,
> John
>
> On Mon, Jan 26, 2015 at 12:52 PM, Raby, John W USA CIV via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=70512 >
> >
> > Classification: UNCLASSIFIED
> > Caveats: NONE
> >
> > To clarify my question on calculation of the ME, MAE and RMSE, I
want
> > to know how the value from the ensemble was determined. Was the
field
> > which is the mean of the ensembles used for the forecast values to
be
> > input into the formulas for ME, MAE and RMSE?
> >
> > Thanks.
> >
> > R/
> > John
> >
> >
> > -----Original Message-----
> > From: met_help at ucar.edu via RT [mailto:met_help at ucar.edu]
> > Sent: Monday, January 26, 2015 12:23 PM
> > To: Raby, John W CIV USARMY ARL (US)
> > Subject: [rt.rap.ucar.edu #70512] AutoReply: Request info about
> > Ensemble-Stat
> > (UNCLASSIFIED)
> >
> > Greetings,
> >
> > This message has been automatically generated in response to the
> > creation of a trouble ticket regarding:
> >         "Request info about Ensemble-Stat (UNCLASSIFIED)", a
summary
> > of which appears below.
> >
> > There is no need to reply to this message right now.  Your ticket
has
> > been assigned an ID of [rt.rap.ucar.edu #70512].
> >
> > Please include the string:
> >
> >          [rt.rap.ucar.edu #70512]
> >
> > in the subject line of all future correspondence about this issue.
To
> > do so, you may reply to this message.
> >
> >                         Thank you,
> >                         met_help at ucar.edu
> >
> >
----------------------------------------------------------------------
> > ---
> > Classification: UNCLASSIFIED
> > Caveats: NONE
> >
> > I have run Ensemble-Stat on a set of 12 WRF members with
observations
> > and received the expected results with MET V4.1. I specified the
> > SSVAR, RHIST, and ORANK output which were output as 3 text files.
I
> > also have the .stat file and the ens.nc file. Do you have
references
> > you may have used to select the various statistics which appear in
the
> > output files? Can you tell me how the ME, MAE and RMSE values in
the
> > SSVAR output were calculated?
> >
> > Thanks.
> >
> > R/
> > John
> >
> > Mr John W. Raby, Meteorologist
> > U.S. Army Research Laboratory
> > White Sands Missile Range, NM 88002
> > (575) 678-2004 DSN 258-2004
> > FAX (575) 678-1230 DSN 258-1230
> > Email: john.w.raby2.civ at mail.mil
> >
> >
> >
> > Classification: UNCLASSIFIED
> > Caveats: NONE
> >
> >
> >
> >
> > Classification: UNCLASSIFIED
> > Caveats: NONE
> >
> >
> >
> >
>
>
> Classification: UNCLASSIFIED
> Caveats: NONE
>
>
>
>

------------------------------------------------
Subject: Request info about Ensemble-Stat (UNCLASSIFIED)
From: John Halley Gotway
Time: Mon Jan 26 15:26:44 2015

John,

Tressa is out of the office today, but I did run across a list of
references about ensemble verification in the slides from the MET
tutorial.  Please find that slide attached.

Thanks,
John

On Mon, Jan 26, 2015 at 2:22 PM, John Halley Gotway <johnhg at ucar.edu>
wrote:

> John,
>
> I don't have the information, so I reassigned this ticket to Tressa,
our
> resident statistician.  Hopefully, she'll be able to pass along some
> references.
>
> Thanks,
> John
>
> On Mon, Jan 26, 2015 at 2:07 PM, Raby, John W USA CIV via RT <
> met_help at ucar.edu> wrote:
>
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=70512 >
>>
>> Classification: UNCLASSIFIED
>> Caveats: NONE
>>
>> John -
>>
>> Your explanation clears up the specific question I had on
calculating the
>> continuous statistics. Also helpful was the info on -ssvar_mean
command
>> line
>> option and the configuration file option to control the bin sizes.
>>
>> Do you know of any references from the literature which were
consulted to
>> decide which statistics are generated by Ensemble-Stat in general?
I'd
>> like to
>> read them to understand more about their use in actual studies.
>>
>> Thanks.
>>
>> R/
>> John
>>
>> -----Original Message-----
>> From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
>> Sent: Monday, January 26, 2015 1:33 PM
>> To: Raby, John W CIV USARMY ARL (US)
>> Subject: Re: [rt.rap.ucar.edu #70512] AutoReply: Request info about
>> Ensemble-Stat (UNCLASSIFIED)
>>
>> Hello John,
>>
>> The SSVAR line type contains "spread-skill" information used in
creating
>> ensemble Spread-Skill plots.  The "spread" is the variance of the
ensemble
>> members while the "skill" is the partials sums followed by a
handful of
>> continuous statistics.  We include the partial sums columns (FBAR,
OBAR,
>> FOBAR, FFBAR, and OOBAR) so that we can later aggregate multiple
cases
>> together and create a spread-skill plot for several cases combined.
>>
>> You have two options for computing the "skill" part of it.
>> (1) You can use the "-ssvar_mean" command line option to pass the
tool
>> ensemble mean fields that should be used when computing SSVAR.
>> (2) If you don't use the "-ssvar_mean" option, Ensemble-Stat will
use the
>> ensemble mean field that it computes using the ensemble members you
>> passed to
>> it.
>>
>> The variance values are "binned" in the output with one SSVAR
output line
>> for
>> each bin.  You control the width of those bins using the
>> "ens_ssvar_bin_size"
>> configuration file option.
>>
>> Does that clarify it?
>>
>> Thanks,
>> John
>>
>> On Mon, Jan 26, 2015 at 12:52 PM, Raby, John W USA CIV via RT <
>> met_help at ucar.edu> wrote:
>>
>> >
>> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=70512 >
>> >
>> > Classification: UNCLASSIFIED
>> > Caveats: NONE
>> >
>> > To clarify my question on calculation of the ME, MAE and RMSE, I
want
>> > to know how the value from the ensemble was determined. Was the
field
>> > which is the mean of the ensembles used for the forecast values
to be
>> > input into the formulas for ME, MAE and RMSE?
>> >
>> > Thanks.
>> >
>> > R/
>> > John
>> >
>> >
>> > -----Original Message-----
>> > From: met_help at ucar.edu via RT [mailto:met_help at ucar.edu]
>> > Sent: Monday, January 26, 2015 12:23 PM
>> > To: Raby, John W CIV USARMY ARL (US)
>> > Subject: [rt.rap.ucar.edu #70512] AutoReply: Request info about
>> > Ensemble-Stat
>> > (UNCLASSIFIED)
>> >
>> > Greetings,
>> >
>> > This message has been automatically generated in response to the
>> > creation of a trouble ticket regarding:
>> >         "Request info about Ensemble-Stat (UNCLASSIFIED)", a
summary
>> > of which appears below.
>> >
>> > There is no need to reply to this message right now.  Your ticket
has
>> > been assigned an ID of [rt.rap.ucar.edu #70512].
>> >
>> > Please include the string:
>> >
>> >          [rt.rap.ucar.edu #70512]
>> >
>> > in the subject line of all future correspondence about this
issue. To
>> > do so, you may reply to this message.
>> >
>> >                         Thank you,
>> >                         met_help at ucar.edu
>> >
>> >
----------------------------------------------------------------------
>> > ---
>> > Classification: UNCLASSIFIED
>> > Caveats: NONE
>> >
>> > I have run Ensemble-Stat on a set of 12 WRF members with
observations
>> > and received the expected results with MET V4.1. I specified the
>> > SSVAR, RHIST, and ORANK output which were output as 3 text files.
I
>> > also have the .stat file and the ens.nc file. Do you have
references
>> > you may have used to select the various statistics which appear
in the
>> > output files? Can you tell me how the ME, MAE and RMSE values in
the
>> > SSVAR output were calculated?
>> >
>> > Thanks.
>> >
>> > R/
>> > John
>> >
>> > Mr John W. Raby, Meteorologist
>> > U.S. Army Research Laboratory
>> > White Sands Missile Range, NM 88002
>> > (575) 678-2004 DSN 258-2004
>> > FAX (575) 678-1230 DSN 258-1230
>> > Email: john.w.raby2.civ at mail.mil
>> >
>> >
>> >
>> > Classification: UNCLASSIFIED
>> > Caveats: NONE
>> >
>> >
>> >
>> >
>> > Classification: UNCLASSIFIED
>> > Caveats: NONE
>> >
>> >
>> >
>> >
>>
>>
>> Classification: UNCLASSIFIED
>> Caveats: NONE
>>
>>
>>
>>
>

------------------------------------------------
Subject: Request info about Ensemble-Stat (UNCLASSIFIED)
From: Raby, John W USA CIV
Time: Mon Jan 26 15:30:21 2015

Classification: UNCLASSIFIED
Caveats: NONE

John -

Thanks. This is what I was looking for. Contains journal articles and
text
refs.

R/
John


-----Original Message-----
From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
Sent: Monday, January 26, 2015 3:27 PM
To: Raby, John W CIV USARMY ARL (US)
Subject: Re: [rt.rap.ucar.edu #70512] AutoReply: Request info about
Ensemble-Stat (UNCLASSIFIED)

John,

Tressa is out of the office today, but I did run across a list of
references
about ensemble verification in the slides from the MET tutorial.
Please find
that slide attached.

Thanks,
John

On Mon, Jan 26, 2015 at 2:22 PM, John Halley Gotway <johnhg at ucar.edu>
wrote:

> John,
>
> I don't have the information, so I reassigned this ticket to Tressa,
> our resident statistician.  Hopefully, she'll be able to pass along
> some references.
>
> Thanks,
> John
>
> On Mon, Jan 26, 2015 at 2:07 PM, Raby, John W USA CIV via RT <
> met_help at ucar.edu> wrote:
>
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=70512 >
>>
>> Classification: UNCLASSIFIED
>> Caveats: NONE
>>
>> John -
>>
>> Your explanation clears up the specific question I had on
calculating
>> the continuous statistics. Also helpful was the info on -ssvar_mean
>> command line option and the configuration file option to control
the
>> bin sizes.
>>
>> Do you know of any references from the literature which were
>> consulted to decide which statistics are generated by Ensemble-Stat
>> in general? I'd like to read them to understand more about their
use
>> in actual studies.
>>
>> Thanks.
>>
>> R/
>> John
>>
>> -----Original Message-----
>> From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
>> Sent: Monday, January 26, 2015 1:33 PM
>> To: Raby, John W CIV USARMY ARL (US)
>> Subject: Re: [rt.rap.ucar.edu #70512] AutoReply: Request info about
>> Ensemble-Stat (UNCLASSIFIED)
>>
>> Hello John,
>>
>> The SSVAR line type contains "spread-skill" information used in
>> creating ensemble Spread-Skill plots.  The "spread" is the variance
>> of the ensemble members while the "skill" is the partials sums
>> followed by a handful of continuous statistics.  We include the
>> partial sums columns (FBAR, OBAR, FOBAR, FFBAR, and OOBAR) so that
we
>> can later aggregate multiple cases together and create a spread-
skill plot
>> for several cases combined.
>>
>> You have two options for computing the "skill" part of it.
>> (1) You can use the "-ssvar_mean" command line option to pass the
>> tool ensemble mean fields that should be used when computing SSVAR.
>> (2) If you don't use the "-ssvar_mean" option, Ensemble-Stat will
use
>> the ensemble mean field that it computes using the ensemble members
>> you passed to it.
>>
>> The variance values are "binned" in the output with one SSVAR
output
>> line for each bin.  You control the width of those bins using the
>> "ens_ssvar_bin_size"
>> configuration file option.
>>
>> Does that clarify it?
>>
>> Thanks,
>> John
>>
>> On Mon, Jan 26, 2015 at 12:52 PM, Raby, John W USA CIV via RT <
>> met_help at ucar.edu> wrote:
>>
>> >
>> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=70512 >
>> >
>> > Classification: UNCLASSIFIED
>> > Caveats: NONE
>> >
>> > To clarify my question on calculation of the ME, MAE and RMSE, I
>> > want to know how the value from the ensemble was determined. Was
>> > the field which is the mean of the ensembles used for the
forecast
>> > values to be input into the formulas for ME, MAE and RMSE?
>> >
>> > Thanks.
>> >
>> > R/
>> > John
>> >
>> >
>> > -----Original Message-----
>> > From: met_help at ucar.edu via RT [mailto:met_help at ucar.edu]
>> > Sent: Monday, January 26, 2015 12:23 PM
>> > To: Raby, John W CIV USARMY ARL (US)
>> > Subject: [rt.rap.ucar.edu #70512] AutoReply: Request info about
>> > Ensemble-Stat
>> > (UNCLASSIFIED)
>> >
>> > Greetings,
>> >
>> > This message has been automatically generated in response to the
>> > creation of a trouble ticket regarding:
>> >         "Request info about Ensemble-Stat (UNCLASSIFIED)", a
>> > summary of which appears below.
>> >
>> > There is no need to reply to this message right now.  Your ticket
>> > has been assigned an ID of [rt.rap.ucar.edu #70512].
>> >
>> > Please include the string:
>> >
>> >          [rt.rap.ucar.edu #70512]
>> >
>> > in the subject line of all future correspondence about this
issue.
>> > To do so, you may reply to this message.
>> >
>> >                         Thank you,
>> >                         met_help at ucar.edu
>> >
>> >
-------------------------------------------------------------------
>> > ---
>> > ---
>> > Classification: UNCLASSIFIED
>> > Caveats: NONE
>> >
>> > I have run Ensemble-Stat on a set of 12 WRF members with
>> > observations and received the expected results with MET V4.1. I
>> > specified the SSVAR, RHIST, and ORANK output which were output as
3
>> > text files. I also have the .stat file and the ens.nc file. Do
you
>> > have references you may have used to select the various
statistics
>> > which appear in the output files? Can you tell me how the ME, MAE
>> > and RMSE values in the SSVAR output were calculated?
>> >
>> > Thanks.
>> >
>> > R/
>> > John
>> >
>> > Mr John W. Raby, Meteorologist
>> > U.S. Army Research Laboratory
>> > White Sands Missile Range, NM 88002
>> > (575) 678-2004 DSN 258-2004
>> > FAX (575) 678-1230 DSN 258-1230
>> > Email: john.w.raby2.civ at mail.mil
>> >
>> >
>> >
>> > Classification: UNCLASSIFIED
>> > Caveats: NONE
>> >
>> >
>> >
>> >
>> > Classification: UNCLASSIFIED
>> > Caveats: NONE
>> >
>> >
>> >
>> >
>>
>>
>> Classification: UNCLASSIFIED
>> Caveats: NONE
>>
>>
>>
>>
>


Classification: UNCLASSIFIED
Caveats: NONE



------------------------------------------------


More information about the Met_help mailing list