[Met_help] [rt.rap.ucar.edu #61456] History for Stat_Analysis - filtering/aggregating by station ID

John Halley Gotway via RT met_help at ucar.edu
Fri May 24 10:30:37 MDT 2013


----------------------------------------------------------------
  Initial Request
----------------------------------------------------------------

Hi MET team

I have some Point Stat MPR output that I would like to calculate aggregated CNT scores per station for (73 stations).

I thought the easiest way to do this would be to build on my script that runs Stat Analysis command line jobs so that it would iterate through an array of station IDs. However, it doesn't seem that there is the option in Stat Analysis for specifying OBS_SID (or INDEX) as a filter option either in command line or config.

Is there any way to filter or aggregate jobs by station ID with Stat Analysis?
My best alternative option would be to manually filter (grep) my .stat file into one .stat file per station ID, then run Stat Analysis agg_stat once per file. Am hoping there is a way to just add it to the Stat Analysis job filter though!

Thanks
Malcolm


----------------------------------------------------------------
  Complete Ticket History
----------------------------------------------------------------

Subject: RE: [rt.rap.ucar.edu #61456] AutoReply: Stat_Analysis - filtering/aggregating by station ID 
From: Mr Malcolm Nunn
Time: Sun May 19 22:24:59 2013

Following up on my first email:
Just discovered the -column_str job command option in the v3.0 release
notes. Exactly what I was after, so problem solved!

Just FYI, noticed that -column_str, -column_min, -column_max and
-column_eq are described in the data/config/README but haven't been
added into the 4.0.1 User's Guide.

Thanks
Malcolm
________________________________________
From: met_help at ucar.edu via RT [met_help at ucar.edu]
Sent: 19 May 2013 15:06
To: Mr Malcolm Nunn
Subject: [rt.rap.ucar.edu #61456] AutoReply: Stat_Analysis -
filtering/aggregating by station ID

Greetings,

This message has been automatically generated in response to the
creation of a trouble ticket regarding:
        "Stat_Analysis - filtering/aggregating by station ID",
a summary of which appears below.

There is no need to reply to this message right now.  Your ticket has
been
assigned an ID of [rt.rap.ucar.edu #61456].

Please include the string:

         [rt.rap.ucar.edu #61456]

in the subject line of all future correspondence about this issue. To
do so,
you may reply to this message.

                        Thank you,
                        met_help at ucar.edu

-------------------------------------------------------------------------
Hi MET team

I have some Point Stat MPR output that I would like to calculate
aggregated CNT scores per station for (73 stations).

I thought the easiest way to do this would be to build on my script
that runs Stat Analysis command line jobs so that it would iterate
through an array of station IDs. However, it doesn't seem that there
is the option in Stat Analysis for specifying OBS_SID (or INDEX) as a
filter option either in command line or config.

Is there any way to filter or aggregate jobs by station ID with Stat
Analysis?
My best alternative option would be to manually filter (grep) my .stat
file into one .stat file per station ID, then run Stat Analysis
agg_stat once per file. Am hoping there is a way to just add it to the
Stat Analysis job filter though!

Thanks
Malcolm




------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #61456] AutoReply: Stat_Analysis - filtering/aggregating by station ID
From: John Halley Gotway
Time: Mon May 20 09:35:19 2013

Malcolm,

Great.  Glad you were able to figure it out.  I'll make sure we update
the user's guide with those options for the next release.

METv4.1 is due out in the coming weeks and will include a feature you
may find useful.  We've added a new option to STAT-Analysis to run
jobs "by case".  If you were to run your MPR->CNT
aggregate_stat job and use the "-by OBS_SID" option, you'd get output
for each unique entry in the the OBS_SID column.  So it'd basically do
the looping your script is doing.  Additionally, you could
use "-by OBS_SID" and "-by FCST_LEAD".  Then you'd get output for each
unique combination of station ID and lead time.

Thanks,
John Halley Gotway
met_help at ucar.edu

On 05/19/2013 10:24 PM, Mr Malcolm Nunn via RT wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=61456 >
>
> Following up on my first email:
> Just discovered the -column_str job command option in the v3.0
release notes. Exactly what I was after, so problem solved!
>
> Just FYI, noticed that -column_str, -column_min, -column_max and
-column_eq are described in the data/config/README but haven't been
added into the 4.0.1 User's Guide.
>
> Thanks
> Malcolm
> ________________________________________
> From: met_help at ucar.edu via RT [met_help at ucar.edu]
> Sent: 19 May 2013 15:06
> To: Mr Malcolm Nunn
> Subject: [rt.rap.ucar.edu #61456] AutoReply: Stat_Analysis -
filtering/aggregating by station ID
>
> Greetings,
>
> This message has been automatically generated in response to the
> creation of a trouble ticket regarding:
>          "Stat_Analysis - filtering/aggregating by station ID",
> a summary of which appears below.
>
> There is no need to reply to this message right now.  Your ticket
has been
> assigned an ID of [rt.rap.ucar.edu #61456].
>
> Please include the string:
>
>           [rt.rap.ucar.edu #61456]
>
> in the subject line of all future correspondence about this issue.
To do so,
> you may reply to this message.
>
>                          Thank you,
>                          met_help at ucar.edu
>
>
-------------------------------------------------------------------------
> Hi MET team
>
> I have some Point Stat MPR output that I would like to calculate
aggregated CNT scores per station for (73 stations).
>
> I thought the easiest way to do this would be to build on my script
that runs Stat Analysis command line jobs so that it would iterate
through an array of station IDs. However, it doesn't seem that there
is the option in Stat Analysis for specifying OBS_SID (or INDEX) as a
filter option either in command line or config.
>
> Is there any way to filter or aggregate jobs by station ID with Stat
Analysis?
> My best alternative option would be to manually filter (grep) my
.stat file into one .stat file per station ID, then run Stat Analysis
agg_stat once per file. Am hoping there is a way to just add it to the
Stat Analysis job filter though!
>
> Thanks
> Malcolm
>
>
>

------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #61456] AutoReply: Stat_Analysis - filtering/aggregating by station ID
From: Mr Malcolm Nunn
Time: Wed May 22 01:45:08 2013

Sounds very useful actually (will make my new script redundant
though!)
Looking forward to checking out the 4.1 release. Is there a list of
expected changes anywhere?

Cheers
Malcolm
________________________________________
From: John Halley Gotway via RT [met_help at ucar.edu]
Sent: 21 May 2013 01:35
To: Mr Malcolm Nunn
Cc: met_help at mailman.ucar.edu
Subject: Re: [rt.rap.ucar.edu #61456] AutoReply: Stat_Analysis -
filtering/aggregating by station ID

Malcolm,

Great.  Glad you were able to figure it out.  I'll make sure we update
the user's guide with those options for the next release.

METv4.1 is due out in the coming weeks and will include a feature you
may find useful.  We've added a new option to STAT-Analysis to run
jobs "by case".  If you were to run your MPR->CNT
aggregate_stat job and use the "-by OBS_SID" option, you'd get output
for each unique entry in the the OBS_SID column.  So it'd basically do
the looping your script is doing.  Additionally, you could
use "-by OBS_SID" and "-by FCST_LEAD".  Then you'd get output for each
unique combination of station ID and lead time.

Thanks,
John Halley Gotway
met_help at ucar.edu

On 05/19/2013 10:24 PM, Mr Malcolm Nunn via RT wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=61456 >
>
> Following up on my first email:
> Just discovered the -column_str job command option in the v3.0
release notes. Exactly what I was after, so problem solved!
>
> Just FYI, noticed that -column_str, -column_min, -column_max and
-column_eq are described in the data/config/README but haven't been
added into the 4.0.1 User's Guide.
>
> Thanks
> Malcolm
> ________________________________________
> From: met_help at ucar.edu via RT [met_help at ucar.edu]
> Sent: 19 May 2013 15:06
> To: Mr Malcolm Nunn
> Subject: [rt.rap.ucar.edu #61456] AutoReply: Stat_Analysis -
filtering/aggregating by station ID
>
> Greetings,
>
> This message has been automatically generated in response to the
> creation of a trouble ticket regarding:
>          "Stat_Analysis - filtering/aggregating by station ID",
> a summary of which appears below.
>
> There is no need to reply to this message right now.  Your ticket
has been
> assigned an ID of [rt.rap.ucar.edu #61456].
>
> Please include the string:
>
>           [rt.rap.ucar.edu #61456]
>
> in the subject line of all future correspondence about this issue.
To do so,
> you may reply to this message.
>
>                          Thank you,
>                          met_help at ucar.edu
>
>
-------------------------------------------------------------------------
> Hi MET team
>
> I have some Point Stat MPR output that I would like to calculate
aggregated CNT scores per station for (73 stations).
>
> I thought the easiest way to do this would be to build on my script
that runs Stat Analysis command line jobs so that it would iterate
through an array of station IDs. However, it doesn't seem that there
is the option in Stat Analysis for specifying OBS_SID (or INDEX) as a
filter option either in command line or config.
>
> Is there any way to filter or aggregate jobs by station ID with Stat
Analysis?
> My best alternative option would be to manually filter (grep) my
.stat file into one .stat file per station ID, then run Stat Analysis
agg_stat once per file. Am hoping there is a way to just add it to the
Stat Analysis job filter though!
>
> Thanks
> Malcolm
>
>
>




------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #61456] AutoReply: Stat_Analysis - filtering/aggregating by station ID
From: John Halley Gotway
Time: Wed May 22 09:26:56 2013

Here's the release notes for METv4.1 - I just posted them yesterday:
    http://www.dtcenter.org/met/users/support/release_notes/METv4.1_release_notes.php

The release should be ready in the next day or two.  We're just
finishing up the documentation.

Thanks,
John


On 05/22/2013 01:45 AM, Mr Malcolm Nunn via RT wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=61456 >
>
> Sounds very useful actually (will make my new script redundant
though!)
> Looking forward to checking out the 4.1 release. Is there a list of
expected changes anywhere?
>
> Cheers
> Malcolm
> ________________________________________
> From: John Halley Gotway via RT [met_help at ucar.edu]
> Sent: 21 May 2013 01:35
> To: Mr Malcolm Nunn
> Cc: met_help at mailman.ucar.edu
> Subject: Re: [rt.rap.ucar.edu #61456] AutoReply: Stat_Analysis -
filtering/aggregating by station ID
>
> Malcolm,
>
> Great.  Glad you were able to figure it out.  I'll make sure we
update the user's guide with those options for the next release.
>
> METv4.1 is due out in the coming weeks and will include a feature
you may find useful.  We've added a new option to STAT-Analysis to run
jobs "by case".  If you were to run your MPR->CNT
> aggregate_stat job and use the "-by OBS_SID" option, you'd get
output for each unique entry in the the OBS_SID column.  So it'd
basically do the looping your script is doing.  Additionally, you
could
> use "-by OBS_SID" and "-by FCST_LEAD".  Then you'd get output for
each unique combination of station ID and lead time.
>
> Thanks,
> John Halley Gotway
> met_help at ucar.edu
>
> On 05/19/2013 10:24 PM, Mr Malcolm Nunn via RT wrote:
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=61456 >
>>
>> Following up on my first email:
>> Just discovered the -column_str job command option in the v3.0
release notes. Exactly what I was after, so problem solved!
>>
>> Just FYI, noticed that -column_str, -column_min, -column_max and
-column_eq are described in the data/config/README but haven't been
added into the 4.0.1 User's Guide.
>>
>> Thanks
>> Malcolm
>> ________________________________________
>> From: met_help at ucar.edu via RT [met_help at ucar.edu]
>> Sent: 19 May 2013 15:06
>> To: Mr Malcolm Nunn
>> Subject: [rt.rap.ucar.edu #61456] AutoReply: Stat_Analysis -
filtering/aggregating by station ID
>>
>> Greetings,
>>
>> This message has been automatically generated in response to the
>> creation of a trouble ticket regarding:
>>           "Stat_Analysis - filtering/aggregating by station ID",
>> a summary of which appears below.
>>
>> There is no need to reply to this message right now.  Your ticket
has been
>> assigned an ID of [rt.rap.ucar.edu #61456].
>>
>> Please include the string:
>>
>>            [rt.rap.ucar.edu #61456]
>>
>> in the subject line of all future correspondence about this issue.
To do so,
>> you may reply to this message.
>>
>>                           Thank you,
>>                           met_help at ucar.edu
>>
>>
-------------------------------------------------------------------------
>> Hi MET team
>>
>> I have some Point Stat MPR output that I would like to calculate
aggregated CNT scores per station for (73 stations).
>>
>> I thought the easiest way to do this would be to build on my script
that runs Stat Analysis command line jobs so that it would iterate
through an array of station IDs. However, it doesn't seem that there
is the option in Stat Analysis for specifying OBS_SID (or INDEX) as a
filter option either in command line or config.
>>
>> Is there any way to filter or aggregate jobs by station ID with
Stat Analysis?
>> My best alternative option would be to manually filter (grep) my
.stat file into one .stat file per station ID, then run Stat Analysis
agg_stat once per file. Am hoping there is a way to just add it to the
Stat Analysis job filter though!
>>
>> Thanks
>> Malcolm
>>
>>
>>
>
>
>

------------------------------------------------


More information about the Met_help mailing list