[Met_help] [rt.rap.ucar.edu #78318] History for Timeseries Question

Wed Oct 19 10:45:56 MDT 2016

----------------------------------------------------------------
  Initial Request
----------------------------------------------------------------

John or Julie, I have a need to make a time series of a brier skill score for the entire domain for a several month period.  The data is stored in daily MPR stat files which contain model, ob, and climo data plus the other required fields.   Is there a way for statanal to generate an output file of daily results instead of the an aggregation of the entire time period into the output file?  Is there a "-by " option to do this.  Is there another way you recommend?

Thanks
Bob Craig

----------------------------------------------------------------
  Complete Ticket History
----------------------------------------------------------------

Subject: Timeseries Question
From: Julie Prestopnik
Time: Tue Oct 18 14:11:55 2016

Hi Bob.

You would basically need to run one job per day.  You can control
which
times are used either by what data you pass to the tool (i.e. using
dated
sub-directories) or by using the "-fcst_init_beg" and "-fcst_init_end"
arguments.

There is currently no way of using the "-by" option to do this easily.
But
that'd be an interesting extension for future work.

I hope this helps.

Julie

On Tue, Oct 18, 2016 at 1:28 PM, robert.craig.2 at us.af.mil via RT <
met_help at ucar.edu> wrote:

>
> Tue Oct 18 13:28:23 2016: Request 78318 was acted upon.
> Transaction: Ticket created by robert.craig.2 at us.af.mil
>        Queue: met_help
>      Subject: Timeseries Question
>        Owner: Nobody
>   Requestors: robert.craig.2 at us.af.mil
>       Status: new
>  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=78318 >
>
>
> John or Julie, I have a need to make a time series of a brier skill
score
> for the entire domain for a several month period.  The data is
stored in
> daily MPR stat files which contain model, ob, and climo data plus
the other
> required fields.   Is there a way for statanal to generate an output
file
> of daily results instead of the an aggregation of the entire time
period
> into the output file?  Is there a "-by " option to do this.  Is
there
> another way you recommend?
>
> Thanks
> Bob Craig
>
>
>

--
Julie Prestopnik
National Center for Atmospheric Research
Research Applications Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu

------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #78318] Timeseries Question
From: robert.craig.2 at us.af.mil
Time: Tue Oct 18 14:24:32 2016

Julie, The "-by" option would be quite helpful since I already have
daily MPR data.

Thanks
Bob

-----Original Message-----
From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
Sent: Tuesday, October 18, 2016 3:12 PM
To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
<robert.craig.2 at us.af.mil>
Cc: SITTEL, MATTHEW C CTR USAF AFMC AFLCMC/HBAW-OL
<matthew.sittel.ctr at us.af.mil>
Subject: Re: [rt.rap.ucar.edu #78318] Timeseries Question

Hi Bob.

You would basically need to run one job per day.  You can control
which times are used either by what data you pass to the tool (i.e.
using  dated
sub-directories) or by using the "-fcst_init_beg" and "-fcst_init_end"
arguments.

There is currently no way of using the "-by" option to do this easily.
But that'd be an interesting extension for future work.

I hope this helps.

Julie

On Tue, Oct 18, 2016 at 1:28 PM, robert.craig.2 at us.af.mil via RT <
met_help at ucar.edu> wrote:

>
> Tue Oct 18 13:28:23 2016: Request 78318 was acted upon.
> Transaction: Ticket created by robert.craig.2 at us.af.mil
>        Queue: met_help
>      Subject: Timeseries Question
>        Owner: Nobody
>   Requestors: robert.craig.2 at us.af.mil
>       Status: new
>  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=78318
> >
>
>
> John or Julie, I have a need to make a time series of a brier skill
> score for the entire domain for a several month period.  The data is
> stored in daily MPR stat files which contain model, ob, and climo
data plus the other
> required fields.   Is there a way for statanal to generate an output
file
> of daily results instead of the an aggregation of the entire time
> period into the output file?  Is there a "-by " option to do this.
Is
> there another way you recommend?
>
> Thanks
> Bob Craig
>
>
>

--
Julie Prestopnik
National Center for Atmospheric Research Research Applications
Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu

------------------------------------------------
Subject: Timeseries Question
From: John Halley Gotway
Time: Wed Oct 19 10:23:11 2016

Bob,

I talked to Julie about this and do think that currently you're stuck
with
running separate jobs for each day.  Of course, you'd obviously want
to
script this up rather than running it manually for each day.

But I had an idea of how me might enhance this in the future.  We
could add
an optional formatting option for the "-by" command... maybe something
like
this:
  -by fcst_init_beg(%Y%m%d)

That'd indicate that we want to read values from the FCST_INIT_BEG
column,
parse the time information, but then apply the specified formatting.
So
20160807_234516 becomes 20160807.  Essentially, we're truncating the
hours,
minutes, and seconds.

Specifying -by fcst_init_beg(%Y%m) would truncate the day number and
beyond.  Using -by fcst_init_beg(%Y) would only keep the year info
which
may be useful for climate information.

So this feature would allow you to *truncate* timing information, but
not
*round* to the nearest hour or day or year.  I would imagine that both
might be useful.    What do you think?

Thanks,
John

On Tue, Oct 18, 2016 at 2:24 PM, robert.craig.2 at us.af.mil via RT <
met_help at ucar.edu> wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=78318 >
>
> Julie, The "-by" option would be quite helpful since I already have
daily
> MPR data.
>
> Thanks
> Bob
>
> -----Original Message-----
> From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> Sent: Tuesday, October 18, 2016 3:12 PM
> To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
<robert.craig.2 at us.af.mil>
> Cc: SITTEL, MATTHEW C CTR USAF AFMC AFLCMC/HBAW-OL <
> matthew.sittel.ctr at us.af.mil>
> Subject: Re: [rt.rap.ucar.edu #78318] Timeseries Question
>
> Hi Bob.
>
> You would basically need to run one job per day.  You can control
which
> times are used either by what data you pass to the tool (i.e. using
dated
> sub-directories) or by using the "-fcst_init_beg" and "-
fcst_init_end"
> arguments.
>
> There is currently no way of using the "-by" option to do this
easily.
> But that'd be an interesting extension for future work.
>
> I hope this helps.
>
> Julie
>
> On Tue, Oct 18, 2016 at 1:28 PM, robert.craig.2 at us.af.mil via RT <
> met_help at ucar.edu> wrote:
>
> >
> > Tue Oct 18 13:28:23 2016: Request 78318 was acted upon.
> > Transaction: Ticket created by robert.craig.2 at us.af.mil
> >        Queue: met_help
> >      Subject: Timeseries Question
> >        Owner: Nobody
> >   Requestors: robert.craig.2 at us.af.mil
> >       Status: new
> >  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=78318
> > >
> >
> >
> > John or Julie, I have a need to make a time series of a brier
skill
> > score for the entire domain for a several month period.  The data
is
> > stored in daily MPR stat files which contain model, ob, and climo
data
> plus the other
> > required fields.   Is there a way for statanal to generate an
output file
> > of daily results instead of the an aggregation of the entire time
> > period into the output file?  Is there a "-by " option to do this.
Is
> > there another way you recommend?
> >
> > Thanks
> > Bob Craig
> >
> >
> >
>
>
> --
> Julie Prestopnik
> National Center for Atmospheric Research Research Applications
Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
>
>
>

------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #78318] Timeseries Question
From: robert.craig.2 at us.af.mil
Time: Wed Oct 19 10:30:30 2016

Those sound like good options to me.

Thanks

-----Original Message-----
From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
Sent: Wednesday, October 19, 2016 11:23 AM
To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
<robert.craig.2 at us.af.mil>
Cc: SITTEL, MATTHEW C CTR USAF AFMC AFLCMC/HBAW-OL
<matthew.sittel.ctr at us.af.mil>
Subject: Re: [rt.rap.ucar.edu #78318] Timeseries Question

Bob,

I talked to Julie about this and do think that currently you're stuck
with running separate jobs for each day.  Of course, you'd obviously
want to script this up rather than running it manually for each day.

But I had an idea of how me might enhance this in the future.  We
could add an optional formatting option for the "-by" command... maybe
something like
this:
  -by fcst_init_beg(%Y%m%d)

That'd indicate that we want to read values from the FCST_INIT_BEG
column, parse the time information, but then apply the specified
formatting.  So
20160807_234516 becomes 20160807.  Essentially, we're truncating the
hours, minutes, and seconds.

Specifying -by fcst_init_beg(%Y%m) would truncate the day number and
beyond.  Using -by fcst_init_beg(%Y) would only keep the year info
which may be useful for climate information.

So this feature would allow you to *truncate* timing information, but
not
*round* to the nearest hour or day or year.  I would imagine that both
might be useful.    What do you think?

Thanks,
John

On Tue, Oct 18, 2016 at 2:24 PM, robert.craig.2 at us.af.mil via RT <
met_help at ucar.edu> wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=78318 >
>
> Julie, The "-by" option would be quite helpful since I already have
> daily MPR data.
>
> Thanks
> Bob
>
> -----Original Message-----
> From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> Sent: Tuesday, October 18, 2016 3:12 PM
> To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
> <robert.craig.2 at us.af.mil>
> Cc: SITTEL, MATTHEW C CTR USAF AFMC AFLCMC/HBAW-OL <
> matthew.sittel.ctr at us.af.mil>
> Subject: Re: [rt.rap.ucar.edu #78318] Timeseries Question
>
> Hi Bob.
>
> You would basically need to run one job per day.  You can control
> which times are used either by what data you pass to the tool (i.e.
> using  dated
> sub-directories) or by using the "-fcst_init_beg" and "-
fcst_init_end"
> arguments.
>
> There is currently no way of using the "-by" option to do this
easily.
> But that'd be an interesting extension for future work.
>
> I hope this helps.
>
> Julie
>
> On Tue, Oct 18, 2016 at 1:28 PM, robert.craig.2 at us.af.mil via RT <
> met_help at ucar.edu> wrote:
>
> >
> > Tue Oct 18 13:28:23 2016: Request 78318 was acted upon.
> > Transaction: Ticket created by robert.craig.2 at us.af.mil
> >        Queue: met_help
> >      Subject: Timeseries Question
> >        Owner: Nobody
> >   Requestors: robert.craig.2 at us.af.mil
> >       Status: new
> >  Ticket <URL:
> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=78318
> > >
> >
> >
> > John or Julie, I have a need to make a time series of a brier
skill
> > score for the entire domain for a several month period.  The data
is
> > stored in daily MPR stat files which contain model, ob, and climo
> > data
> plus the other
> > required fields.   Is there a way for statanal to generate an
output file
> > of daily results instead of the an aggregation of the entire time
> > period into the output file?  Is there a "-by " option to do this.
> > Is there another way you recommend?
> >
> > Thanks
> > Bob Craig
> >
> >
> >
>
>
> --
> Julie Prestopnik
> National Center for Atmospheric Research Research Applications
> Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
>
>
>

------------------------------------------------