[Met_help] [rt.rap.ucar.edu #75793] History for Question about Series Analysis Tool

[John Halley Gotway via RT]

----------------------------------------------------------------
  Initial Request
----------------------------------------------------------------

Hi,

I'm running the MET Series Analysis tool and have made the appropriate file
lists containing grib files from both an HWRF experiment and a GFS analysis
files. I have ensured that each file exists, but when I try to run MET, it
fails with errors because a random GFS anl file will not have a particular
field.

Is there a nicer way to handle this failure? Can MET somehow skip over this
single file and move on to the next one without failing? Do I have to
manually check each of the hundreds of files for the presence of the fields
before I can put them into my file lists in order to get past this issue?

Thanks,
Christina


----------------------------------------------------------------
  Complete Ticket History
----------------------------------------------------------------

Subject: Question about Series Analysis Tool
From: John Halley Gotway
Time: Thu Apr 07 20:01:55 2016

Christina,

If you can wait until Monday, I can take a look at your script for a
workaround.  Adding a few lines of code to check for the presence of
the
desired field(s) before adding it to the list should do the trick.

In the long run, we can think about updating series-analysis to more
gracefully handle missing data.

John

On Wednesday, April 6, 2016, christina.holt at noaa.gov via RT <
met_help at ucar.edu> wrote:

>
> Wed Apr 06 15:07:54 2016: Request 75793 was acted upon.
> Transaction: Ticket created by christina.holt at noaa.gov
<javascript:;>
>        Queue: met_help
>      Subject: Question about Series Analysis Tool
>        Owner: Nobody
>   Requestors: christina.holt at noaa.gov <javascript:;>
>       Status: new
>  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75793 >
>
>
> Hi,
>
> I'm running the MET Series Analysis tool and have made the
appropriate file
> lists containing grib files from both an HWRF experiment and a GFS
analysis
> files. I have ensured that each file exists, but when I try to run
MET, it
> fails with errors because a random GFS anl file will not have a
particular
> field.
>
> Is there a nicer way to handle this failure? Can MET somehow skip
over this
> single file and move on to the next one without failing? Do I have
to
> manually check each of the hundreds of files for the presence of the
fields
> before I can put them into my file lists in order to get past this
issue?
>
> Thanks,
> Christina
>
>

------------------------------------------------
Subject: Question about Series Analysis Tool
From: christina.holt at noaa.gov
Time: Fri Apr 08 08:41:13 2016

Hey John,

This is ultimately the solution I came up with last time I ran the
verification. It starts getting a bit unruly on the number of file
lists to
keep up with. I was just hoping maybe there was a more straightforward
way.

Thanks,
Christina

On Thu, Apr 7, 2016 at 8:01 PM, John Halley Gotway via RT
<met_help at ucar.edu
> wrote:

> Christina,
>
> If you can wait until Monday, I can take a look at your script for a
> workaround.  Adding a few lines of code to check for the presence of
the
> desired field(s) before adding it to the list should do the trick.
>
> In the long run, we can think about updating series-analysis to more
> gracefully handle missing data.
>
> John
>
> On Wednesday, April 6, 2016, christina.holt at noaa.gov via RT <
> met_help at ucar.edu> wrote:
>
> >
> > Wed Apr 06 15:07:54 2016: Request 75793 was acted upon.
> > Transaction: Ticket created by christina.holt at noaa.gov
<javascript:;>
> >        Queue: met_help
> >      Subject: Question about Series Analysis Tool
> >        Owner: Nobody
> >   Requestors: christina.holt at noaa.gov <javascript:;>
> >       Status: new
> >  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75793 >
> >
> >
> > Hi,
> >
> > I'm running the MET Series Analysis tool and have made the
appropriate
> file
> > lists containing grib files from both an HWRF experiment and a GFS
> analysis
> > files. I have ensured that each file exists, but when I try to run
MET,
> it
> > fails with errors because a random GFS anl file will not have a
> particular
> > field.
> >
> > Is there a nicer way to handle this failure? Can MET somehow skip
over
> this
> > single file and move on to the next one without failing? Do I have
to
> > manually check each of the hundreds of files for the presence of
the
> fields
> > before I can put them into my file lists in order to get past this
issue?
> >
> > Thanks,
> > Christina
> >
> >
>
>

------------------------------------------------
Subject: Question about Series Analysis Tool
From: John Halley Gotway
Time: Mon Apr 11 14:39:07 2016

Christina,

I agree, things get a lot messier when switching from test case data
to
realtime data with all of its missing data and issues.

We could certainly revisit the logic for the next release of MET to be
more
forgiving of missing data.

Is there anything I can do to help out at this point?

I realize that I do need to work on the cyclone-centric vx this week.

Thanks,
John

On Fri, Apr 8, 2016 at 8:41 AM, christina.holt at noaa.gov via RT <
met_help at ucar.edu> wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75793 >
>
> Hey John,
>
> This is ultimately the solution I came up with last time I ran the
> verification. It starts getting a bit unruly on the number of file
lists to
> keep up with. I was just hoping maybe there was a more
straightforward way.
>
> Thanks,
> Christina
>
> On Thu, Apr 7, 2016 at 8:01 PM, John Halley Gotway via RT <
> met_help at ucar.edu
> > wrote:
>
> > Christina,
> >
> > If you can wait until Monday, I can take a look at your script for
a
> > workaround.  Adding a few lines of code to check for the presence
of the
> > desired field(s) before adding it to the list should do the trick.
> >
> > In the long run, we can think about updating series-analysis to
more
> > gracefully handle missing data.
> >
> > John
> >
> > On Wednesday, April 6, 2016, christina.holt at noaa.gov via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > Wed Apr 06 15:07:54 2016: Request 75793 was acted upon.
> > > Transaction: Ticket created by christina.holt at noaa.gov
<javascript:;>
> > >        Queue: met_help
> > >      Subject: Question about Series Analysis Tool
> > >        Owner: Nobody
> > >   Requestors: christina.holt at noaa.gov <javascript:;>
> > >       Status: new
> > >  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75793
> >
> > >
> > >
> > > Hi,
> > >
> > > I'm running the MET Series Analysis tool and have made the
appropriate
> > file
> > > lists containing grib files from both an HWRF experiment and a
GFS
> > analysis
> > > files. I have ensured that each file exists, but when I try to
run MET,
> > it
> > > fails with errors because a random GFS anl file will not have a
> > particular
> > > field.
> > >
> > > Is there a nicer way to handle this failure? Can MET somehow
skip over
> > this
> > > single file and move on to the next one without failing? Do I
have to
> > > manually check each of the hundreds of files for the presence of
the
> > fields
> > > before I can put them into my file lists in order to get past
this
> issue?
> > >
> > > Thanks,
> > > Christina
> > >
> > >
> >
> >
>
>

------------------------------------------------