[Met_help] [rt.rap.ucar.edu #95192] History for running PB2NC outside of a loop

George McCabe via RT met_help at ucar.edu
Wed May 20 10:35:11 MDT 2020


----------------------------------------------------------------
  Initial Request
----------------------------------------------------------------

Hi, there,

This is another quick question.  Is there a way to run PB2NC outside of a
loop?  I am verifying a model with a valid time every hour of the day, and
I want to loop by valid time, but I don't want to run PB2NC inside the
loop.  Since the bufr file has data for every hour of the day, I just want
to run PB2NC just once and then loop by valid time.  How do I do that?

Thanks!

Perry


----------------------------------------------------------------
  Complete Ticket History
----------------------------------------------------------------

Subject: running PB2NC outside of a loop
From: George McCabe
Time: Thu May 07 12:08:16 2020

If I understand correctly, you should be able to set
PB2NC_SKIP_IF_OUTPUT_EXISTS and set the output filename to only
include
YYYYMMDD. For each loop iteration, it will see that the output already
exists and not run PB2NC. Is that what you mean?

On Thu, May 7, 2020 at 12:04 PM perry.shafran at noaa.gov via RT <
met_help at ucar.edu> wrote:

>
> Thu May 07 12:04:01 2020: Request 95192 was acted upon.
> Transaction: Ticket created by perry.shafran at noaa.gov
>        Queue: met_help
>      Subject: running PB2NC outside of a loop
>        Owner: Nobody
>   Requestors: perry.shafran at noaa.gov
>       Status: new
>  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95192 >
>
>
> Hi, there,
>
> This is another quick question.  Is there a way to run PB2NC outside
of a
> loop?  I am verifying a model with a valid time every hour of the
day, and
> I want to loop by valid time, but I don't want to run PB2NC inside
the
> loop.  Since the bufr file has data for every hour of the day, I
just want
> to run PB2NC just once and then loop by valid time.  How do I do
that?
>
> Thanks!
>
> Perry
>
>

--
George McCabe - Software Engineer III
National Center for Atmospheric Research
Research Applications Laboratory
303-497-2768
---
My working day may not be your working day. Please do not feel obliged
to
reply to this email outside of your normal working hours.

------------------------------------------------
Subject: running PB2NC outside of a loop
From: perry.shafran at noaa.gov
Time: Thu May 07 12:13:33 2020

Yes.  I think I have an idea how to do this, now I that I think about
it.
Currently, I write out the prepbufr file with a date/time stamp, but I
guess I don't need to do that.  If I wrote it out without a time
stamp, it
would only write out a file once.

Still, it would be good to be able to run PB2NC once and not bother
with
seeking out more files by being inside a loop.  Is there a way to run
PB2NC
without being in a loop iteration?

Thanks!

Perry

On Thu, May 7, 2020 at 2:08 PM George McCabe via RT
<met_help at ucar.edu>
wrote:

> If I understand correctly, you should be able to set
> PB2NC_SKIP_IF_OUTPUT_EXISTS and set the output filename to only
include
> YYYYMMDD. For each loop iteration, it will see that the output
already
> exists and not run PB2NC. Is that what you mean?
>
> On Thu, May 7, 2020 at 12:04 PM perry.shafran at noaa.gov via RT <
> met_help at ucar.edu> wrote:
>
> >
> > Thu May 07 12:04:01 2020: Request 95192 was acted upon.
> > Transaction: Ticket created by perry.shafran at noaa.gov
> >        Queue: met_help
> >      Subject: running PB2NC outside of a loop
> >        Owner: Nobody
> >   Requestors: perry.shafran at noaa.gov
> >       Status: new
> >  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95192 >
> >
> >
> > Hi, there,
> >
> > This is another quick question.  Is there a way to run PB2NC
outside of a
> > loop?  I am verifying a model with a valid time every hour of the
day,
> and
> > I want to loop by valid time, but I don't want to run PB2NC inside
the
> > loop.  Since the bufr file has data for every hour of the day, I
just
> want
> > to run PB2NC just once and then loop by valid time.  How do I do
that?
> >
> > Thanks!
> >
> > Perry
> >
> >
>
> --
> George McCabe - Software Engineer III
> National Center for Atmospheric Research
> Research Applications Laboratory
> 303-497-2768
> ---
> My working day may not be your working day. Please do not feel
obliged to
> reply to this email outside of your normal working hours.
>
>

------------------------------------------------
Subject: running PB2NC outside of a loop
From: George McCabe
Time: Thu May 07 12:26:49 2020

Currently, no. The looping applies to all wrappers specified. We have
discussed ways to have different intervals for different tools, but I
think
the logic would get very complicated very quickly. We have also
discussed
having an exclude list to skip certain hours, but that would also
apply to
all wrappers.

If we changed the logic for PB2NC to skip the forecast lead list and
just
process once per run time, that would skip a lot of necessary runs if
you
were looping by init time, because the valid time will change for each
forecast value.

I suppose we could set it up for PB2NC to skip the forecast lead list
if we
are running by valid time since those data should always be based on
valid
time. That seems to make sense to me. This is essentially accomplished
with
the SKIP_IF_OUTPUT_EXISTS logic, but if we skip the loop, then you
could
turn off SKIP_IF_OUTPUT_EXISTS to overwrite daily files if you needed
to.
I'll run it by John to see if he sees any issues with doing that.

On Thu, May 7, 2020 at 12:13 PM perry.shafran at noaa.gov via RT <
met_help at ucar.edu> wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95192 >
>
> Yes.  I think I have an idea how to do this, now I that I think
about it.
> Currently, I write out the prepbufr file with a date/time stamp, but
I
> guess I don't need to do that.  If I wrote it out without a time
stamp, it
> would only write out a file once.
>
> Still, it would be good to be able to run PB2NC once and not bother
with
> seeking out more files by being inside a loop.  Is there a way to
run PB2NC
> without being in a loop iteration?
>
> Thanks!
>
> Perry
>
> On Thu, May 7, 2020 at 2:08 PM George McCabe via RT
<met_help at ucar.edu>
> wrote:
>
> > If I understand correctly, you should be able to set
> > PB2NC_SKIP_IF_OUTPUT_EXISTS and set the output filename to only
include
> > YYYYMMDD. For each loop iteration, it will see that the output
already
> > exists and not run PB2NC. Is that what you mean?
> >
> > On Thu, May 7, 2020 at 12:04 PM perry.shafran at noaa.gov via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > Thu May 07 12:04:01 2020: Request 95192 was acted upon.
> > > Transaction: Ticket created by perry.shafran at noaa.gov
> > >        Queue: met_help
> > >      Subject: running PB2NC outside of a loop
> > >        Owner: Nobody
> > >   Requestors: perry.shafran at noaa.gov
> > >       Status: new
> > >  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95192
> >
> > >
> > >
> > > Hi, there,
> > >
> > > This is another quick question.  Is there a way to run PB2NC
outside
> of a
> > > loop?  I am verifying a model with a valid time every hour of
the day,
> > and
> > > I want to loop by valid time, but I don't want to run PB2NC
inside the
> > > loop.  Since the bufr file has data for every hour of the day, I
just
> > want
> > > to run PB2NC just once and then loop by valid time.  How do I do
that?
> > >
> > > Thanks!
> > >
> > > Perry
> > >
> > >
> >
> > --
> > George McCabe - Software Engineer III
> > National Center for Atmospheric Research
> > Research Applications Laboratory
> > 303-497-2768
> > ---
> > My working day may not be your working day. Please do not feel
obliged to
> > reply to this email outside of your normal working hours.
> >
> >
>
>

--
George McCabe - Software Engineer III
National Center for Atmospheric Research
Research Applications Laboratory
303-497-2768
---
My working day may not be your working day. Please do not feel obliged
to
reply to this email outside of your normal working hours.

------------------------------------------------
Subject: running PB2NC outside of a loop
From: perry.shafran at noaa.gov
Time: Thu May 07 12:31:12 2020

OK, thanks!  I'm OK with all of that.  You can then close this ticket,
and
I'll probably figure something else out.

Perry

On Thu, May 7, 2020 at 2:27 PM George McCabe via RT
<met_help at ucar.edu>
wrote:

> Currently, no. The looping applies to all wrappers specified. We
have
> discussed ways to have different intervals for different tools, but
I think
> the logic would get very complicated very quickly. We have also
discussed
> having an exclude list to skip certain hours, but that would also
apply to
> all wrappers.
>
> If we changed the logic for PB2NC to skip the forecast lead list and
just
> process once per run time, that would skip a lot of necessary runs
if you
> were looping by init time, because the valid time will change for
each
> forecast value.
>
> I suppose we could set it up for PB2NC to skip the forecast lead
list if we
> are running by valid time since those data should always be based on
valid
> time. That seems to make sense to me. This is essentially
accomplished with
> the SKIP_IF_OUTPUT_EXISTS logic, but if we skip the loop, then you
could
> turn off SKIP_IF_OUTPUT_EXISTS to overwrite daily files if you
needed to.
> I'll run it by John to see if he sees any issues with doing that.
>
> On Thu, May 7, 2020 at 12:13 PM perry.shafran at noaa.gov via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95192 >
> >
> > Yes.  I think I have an idea how to do this, now I that I think
about it.
> > Currently, I write out the prepbufr file with a date/time stamp,
but I
> > guess I don't need to do that.  If I wrote it out without a time
stamp,
> it
> > would only write out a file once.
> >
> > Still, it would be good to be able to run PB2NC once and not
bother with
> > seeking out more files by being inside a loop.  Is there a way to
run
> PB2NC
> > without being in a loop iteration?
> >
> > Thanks!
> >
> > Perry
> >
> > On Thu, May 7, 2020 at 2:08 PM George McCabe via RT
<met_help at ucar.edu>
> > wrote:
> >
> > > If I understand correctly, you should be able to set
> > > PB2NC_SKIP_IF_OUTPUT_EXISTS and set the output filename to only
include
> > > YYYYMMDD. For each loop iteration, it will see that the output
already
> > > exists and not run PB2NC. Is that what you mean?
> > >
> > > On Thu, May 7, 2020 at 12:04 PM perry.shafran at noaa.gov via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > Thu May 07 12:04:01 2020: Request 95192 was acted upon.
> > > > Transaction: Ticket created by perry.shafran at noaa.gov
> > > >        Queue: met_help
> > > >      Subject: running PB2NC outside of a loop
> > > >        Owner: Nobody
> > > >   Requestors: perry.shafran at noaa.gov
> > > >       Status: new
> > > >  Ticket <URL:
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95192
> > >
> > > >
> > > >
> > > > Hi, there,
> > > >
> > > > This is another quick question.  Is there a way to run PB2NC
outside
> > of a
> > > > loop?  I am verifying a model with a valid time every hour of
the
> day,
> > > and
> > > > I want to loop by valid time, but I don't want to run PB2NC
inside
> the
> > > > loop.  Since the bufr file has data for every hour of the day,
I just
> > > want
> > > > to run PB2NC just once and then loop by valid time.  How do I
do
> that?
> > > >
> > > > Thanks!
> > > >
> > > > Perry
> > > >
> > > >
> > >
> > > --
> > > George McCabe - Software Engineer III
> > > National Center for Atmospheric Research
> > > Research Applications Laboratory
> > > 303-497-2768
> > > ---
> > > My working day may not be your working day. Please do not feel
obliged
> to
> > > reply to this email outside of your normal working hours.
> > >
> > >
> >
> >
>
> --
> George McCabe - Software Engineer III
> National Center for Atmospheric Research
> Research Applications Laboratory
> 303-497-2768
> ---
> My working day may not be your working day. Please do not feel
obliged to
> reply to this email outside of your normal working hours.
>
>

------------------------------------------------


More information about the Met_help mailing list