[Met_help] [rt.rap.ucar.edu #80331] History for out of memory error
Julie Prestopnik via RT
met_help at ucar.edu
Thu May 4 12:37:11 MDT 2017
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Hi, there,
I'm not sure why this happened, but I just started using MET to compare a
typical grib2 grid 218 (awphys) file vs. the prepbufr NetCDF file, and it
quickly reported that it was out of error. This is being done on gyre. Is
there something that I needed to add to the config file in order to run
this job?
point_stat /com2/nam/prod/nam.20170430/nam.t06z.awphys24.tm00.grib2
nam.t06z.pb.tm06.nc
/meso/save/Perry.Shafran/met_testing/tutorial/config/PointStatConfig_tutorial
-v 2
DEBUG 1: Default Config File:
/awc/noscrub/Julie.Prestopnik/met/6.0/share/met/config/PointStatConfig_default
DEBUG 1: User Config File:
/meso/save/Perry.Shafran/met_testing/tutorial/config/PointStatConfig_tutorial
ERROR :
ERROR : out of memory! Exiting!
ERROR :
18 (g14a1) /ptmpp2/Perry.Shafran/met_test
Thanks!
Perry
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: out of memory error
From: Julie Prestopnik
Time: Tue May 02 12:36:50 2017
Hi Perry. I'm sorry to hear that you are experiencing problems using
point_stat with MET. I will log into gyre to take a look and will
follow up
once I know more.
Thanks!
Julie
On Tue, May 2, 2017 at 11:19 AM, perry.shafran at noaa.gov via RT <
met_help at ucar.edu> wrote:
>
> Tue May 02 11:19:03 2017: Request 80331 was acted upon.
> Transaction: Ticket created by perry.shafran at noaa.gov
> Queue: met_help
> Subject: out of memory error
> Owner: Nobody
> Requestors: perry.shafran at noaa.gov
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80331 >
>
>
> Hi, there,
>
> I'm not sure why this happened, but I just started using MET to
compare a
> typical grib2 grid 218 (awphys) file vs. the prepbufr NetCDF file,
and it
> quickly reported that it was out of error. This is being done on
gyre. Is
> there something that I needed to add to the config file in order to
run
> this job?
>
> point_stat /com2/nam/prod/nam.20170430/nam.t06z.awphys24.tm00.grib2
> nam.t06z.pb.tm06.nc
> /meso/save/Perry.Shafran/met_testing/tutorial/config/
> PointStatConfig_tutorial
> -v 2
> DEBUG 1: Default Config File:
> /awc/noscrub/Julie.Prestopnik/met/6.0/share/met/config/
> PointStatConfig_default
> DEBUG 1: User Config File:
> /meso/save/Perry.Shafran/met_testing/tutorial/config/
> PointStatConfig_tutorial
> ERROR :
> ERROR : out of memory! Exiting!
> ERROR :
> 18 (g14a1) /ptmpp2/Perry.Shafran/met_test
>
> Thanks!
>
> Perry
>
>
------------------------------------------------
Subject: out of memory error
From: perry.shafran at noaa.gov
Time: Tue May 02 12:37:37 2017
Hi, Julie,
Thanks!
Perry
On Tue, May 2, 2017 at 2:36 PM, Julie Prestopnik via RT
<met_help at ucar.edu>
wrote:
> Hi Perry. I'm sorry to hear that you are experiencing problems
using
> point_stat with MET. I will log into gyre to take a look and will
follow up
> once I know more.
>
> Thanks!
>
> Julie
>
> On Tue, May 2, 2017 at 11:19 AM, perry.shafran at noaa.gov via RT <
> met_help at ucar.edu> wrote:
>
> >
> > Tue May 02 11:19:03 2017: Request 80331 was acted upon.
> > Transaction: Ticket created by perry.shafran at noaa.gov
> > Queue: met_help
> > Subject: out of memory error
> > Owner: Nobody
> > Requestors: perry.shafran at noaa.gov
> > Status: new
> > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80331 >
> >
> >
> > Hi, there,
> >
> > I'm not sure why this happened, but I just started using MET to
compare a
> > typical grib2 grid 218 (awphys) file vs. the prepbufr NetCDF file,
and it
> > quickly reported that it was out of error. This is being done on
gyre.
> Is
> > there something that I needed to add to the config file in order
to run
> > this job?
> >
> > point_stat
/com2/nam/prod/nam.20170430/nam.t06z.awphys24.tm00.grib2
> > nam.t06z.pb.tm06.nc
> > /meso/save/Perry.Shafran/met_testing/tutorial/config/
> > PointStatConfig_tutorial
> > -v 2
> > DEBUG 1: Default Config File:
> > /awc/noscrub/Julie.Prestopnik/met/6.0/share/met/config/
> > PointStatConfig_default
> > DEBUG 1: User Config File:
> > /meso/save/Perry.Shafran/met_testing/tutorial/config/
> > PointStatConfig_tutorial
> > ERROR :
> > ERROR : out of memory! Exiting!
> > ERROR :
> > 18 (g14a1) /ptmpp2/Perry.Shafran/met_test
> >
> > Thanks!
> >
> > Perry
> >
> >
>
>
------------------------------------------------
Subject: out of memory error
From: Julie Prestopnik
Time: Tue May 02 12:55:41 2017
Hi Perry.
Could you please provide me with the path to the obs file
nam.t06z.pb.tm06.nc?
Thanks!
Julie
On Tue, May 2, 2017 at 12:37 PM, perry.shafran at noaa.gov via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80331 >
>
> Hi, Julie,
>
> Thanks!
>
> Perry
>
> On Tue, May 2, 2017 at 2:36 PM, Julie Prestopnik via RT
<met_help at ucar.edu
> >
> wrote:
>
> > Hi Perry. I'm sorry to hear that you are experiencing problems
using
> > point_stat with MET. I will log into gyre to take a look and will
follow
> up
> > once I know more.
> >
> > Thanks!
> >
> > Julie
> >
> > On Tue, May 2, 2017 at 11:19 AM, perry.shafran at noaa.gov via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > Tue May 02 11:19:03 2017: Request 80331 was acted upon.
> > > Transaction: Ticket created by perry.shafran at noaa.gov
> > > Queue: met_help
> > > Subject: out of memory error
> > > Owner: Nobody
> > > Requestors: perry.shafran at noaa.gov
> > > Status: new
> > > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80331
> >
> > >
> > >
> > > Hi, there,
> > >
> > > I'm not sure why this happened, but I just started using MET to
> compare a
> > > typical grib2 grid 218 (awphys) file vs. the prepbufr NetCDF
file, and
> it
> > > quickly reported that it was out of error. This is being done
on gyre.
> > Is
> > > there something that I needed to add to the config file in order
to run
> > > this job?
> > >
> > > point_stat
/com2/nam/prod/nam.20170430/nam.t06z.awphys24.tm00.grib2
> > > nam.t06z.pb.tm06.nc
> > > /meso/save/Perry.Shafran/met_testing/tutorial/config/
> > > PointStatConfig_tutorial
> > > -v 2
> > > DEBUG 1: Default Config File:
> > > /awc/noscrub/Julie.Prestopnik/met/6.0/share/met/config/
> > > PointStatConfig_default
> > > DEBUG 1: User Config File:
> > > /meso/save/Perry.Shafran/met_testing/tutorial/config/
> > > PointStatConfig_tutorial
> > > ERROR :
> > > ERROR : out of memory! Exiting!
> > > ERROR :
> > > 18 (g14a1) /ptmpp2/Perry.Shafran/met_test
> > >
> > > Thanks!
> > >
> > > Perry
> > >
> > >
> >
> >
>
>
------------------------------------------------
Subject: out of memory error
From: perry.shafran at noaa.gov
Time: Tue May 02 12:57:00 2017
Hi, Julie,
It is here: /ptmpp2/Perry.Shafran/met_test.
Thanks!
Perry
On Tue, May 2, 2017 at 2:55 PM, Julie Prestopnik via RT
<met_help at ucar.edu>
wrote:
> Hi Perry.
>
> Could you please provide me with the path to the obs file
> nam.t06z.pb.tm06.nc?
>
> Thanks!
>
> Julie
>
> On Tue, May 2, 2017 at 12:37 PM, perry.shafran at noaa.gov via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80331 >
> >
> > Hi, Julie,
> >
> > Thanks!
> >
> > Perry
> >
> > On Tue, May 2, 2017 at 2:36 PM, Julie Prestopnik via RT <
> met_help at ucar.edu
> > >
> > wrote:
> >
> > > Hi Perry. I'm sorry to hear that you are experiencing problems
using
> > > point_stat with MET. I will log into gyre to take a look and
will
> follow
> > up
> > > once I know more.
> > >
> > > Thanks!
> > >
> > > Julie
> > >
> > > On Tue, May 2, 2017 at 11:19 AM, perry.shafran at noaa.gov via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > Tue May 02 11:19:03 2017: Request 80331 was acted upon.
> > > > Transaction: Ticket created by perry.shafran at noaa.gov
> > > > Queue: met_help
> > > > Subject: out of memory error
> > > > Owner: Nobody
> > > > Requestors: perry.shafran at noaa.gov
> > > > Status: new
> > > > Ticket <URL: https://rt.rap.ucar.edu/rt/
> Ticket/Display.html?id=80331
> > >
> > > >
> > > >
> > > > Hi, there,
> > > >
> > > > I'm not sure why this happened, but I just started using MET
to
> > compare a
> > > > typical grib2 grid 218 (awphys) file vs. the prepbufr NetCDF
file,
> and
> > it
> > > > quickly reported that it was out of error. This is being done
on
> gyre.
> > > Is
> > > > there something that I needed to add to the config file in
order to
> run
> > > > this job?
> > > >
> > > > point_stat
/com2/nam/prod/nam.20170430/nam.t06z.awphys24.tm00.grib2
> > > > nam.t06z.pb.tm06.nc
> > > > /meso/save/Perry.Shafran/met_testing/tutorial/config/
> > > > PointStatConfig_tutorial
> > > > -v 2
> > > > DEBUG 1: Default Config File:
> > > > /awc/noscrub/Julie.Prestopnik/met/6.0/share/met/config/
> > > > PointStatConfig_default
> > > > DEBUG 1: User Config File:
> > > > /meso/save/Perry.Shafran/met_testing/tutorial/config/
> > > > PointStatConfig_tutorial
> > > > ERROR :
> > > > ERROR : out of memory! Exiting!
> > > > ERROR :
> > > > 18 (g14a1) /ptmpp2/Perry.Shafran/met_test
> > > >
> > > > Thanks!
> > > >
> > > > Perry
> > > >
> > > >
> > >
> > >
> >
> >
>
>
------------------------------------------------
Subject: out of memory error
From: Julie Prestopnik
Time: Tue May 02 12:57:47 2017
Thank you!
On Tue, May 2, 2017 at 12:57 PM, perry.shafran at noaa.gov via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80331 >
>
> Hi, Julie,
>
> It is here: /ptmpp2/Perry.Shafran/met_test.
>
> Thanks!
>
> Perry
>
> On Tue, May 2, 2017 at 2:55 PM, Julie Prestopnik via RT
<met_help at ucar.edu
> >
> wrote:
>
> > Hi Perry.
> >
> > Could you please provide me with the path to the obs file
> > nam.t06z.pb.tm06.nc?
> >
> > Thanks!
> >
> > Julie
> >
> > On Tue, May 2, 2017 at 12:37 PM, perry.shafran at noaa.gov via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80331 >
> > >
> > > Hi, Julie,
> > >
> > > Thanks!
> > >
> > > Perry
> > >
> > > On Tue, May 2, 2017 at 2:36 PM, Julie Prestopnik via RT <
> > met_help at ucar.edu
> > > >
> > > wrote:
> > >
> > > > Hi Perry. I'm sorry to hear that you are experiencing
problems using
> > > > point_stat with MET. I will log into gyre to take a look and
will
> > follow
> > > up
> > > > once I know more.
> > > >
> > > > Thanks!
> > > >
> > > > Julie
> > > >
> > > > On Tue, May 2, 2017 at 11:19 AM, perry.shafran at noaa.gov via RT
<
> > > > met_help at ucar.edu> wrote:
> > > >
> > > > >
> > > > > Tue May 02 11:19:03 2017: Request 80331 was acted upon.
> > > > > Transaction: Ticket created by perry.shafran at noaa.gov
> > > > > Queue: met_help
> > > > > Subject: out of memory error
> > > > > Owner: Nobody
> > > > > Requestors: perry.shafran at noaa.gov
> > > > > Status: new
> > > > > Ticket <URL: https://rt.rap.ucar.edu/rt/
> > Ticket/Display.html?id=80331
> > > >
> > > > >
> > > > >
> > > > > Hi, there,
> > > > >
> > > > > I'm not sure why this happened, but I just started using MET
to
> > > compare a
> > > > > typical grib2 grid 218 (awphys) file vs. the prepbufr NetCDF
file,
> > and
> > > it
> > > > > quickly reported that it was out of error. This is being
done on
> > gyre.
> > > > Is
> > > > > there something that I needed to add to the config file in
order to
> > run
> > > > > this job?
> > > > >
> > > > > point_stat /com2/nam/prod/nam.20170430/
> nam.t06z.awphys24.tm00.grib2
> > > > > nam.t06z.pb.tm06.nc
> > > > > /meso/save/Perry.Shafran/met_testing/tutorial/config/
> > > > > PointStatConfig_tutorial
> > > > > -v 2
> > > > > DEBUG 1: Default Config File:
> > > > > /awc/noscrub/Julie.Prestopnik/met/6.0/share/met/config/
> > > > > PointStatConfig_default
> > > > > DEBUG 1: User Config File:
> > > > > /meso/save/Perry.Shafran/met_testing/tutorial/config/
> > > > > PointStatConfig_tutorial
> > > > > ERROR :
> > > > > ERROR : out of memory! Exiting!
> > > > > ERROR :
> > > > > 18 (g14a1) /ptmpp2/Perry.Shafran/met_test
> > > > >
> > > > > Thanks!
> > > > >
> > > > > Perry
> > > > >
> > > > >
> > > >
> > > >
> > >
> > >
> >
> >
>
>
------------------------------------------------
Subject: out of memory error
From: Julie Prestopnik
Time: Tue May 02 13:41:23 2017
Hi Perry. I believe I have solved the problem.
Please reload the met module:
module use /awc/noscrub/Julie.Prestopnik/modulefiles
module load met
and try running point_stat again.
I was able to reproduce your error, and then, after fixing it, I was
able
to get output from the command line argument you sent to me.
Please let me know how it goes.
Thanks,
Julie
On Tue, May 2, 2017 at 12:57 PM, Julie Prestopnik <jpresto at ucar.edu>
wrote:
> Thank you!
>
> On Tue, May 2, 2017 at 12:57 PM, perry.shafran at noaa.gov via RT <
> met_help at ucar.edu> wrote:
>
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80331 >
>>
>> Hi, Julie,
>>
>> It is here: /ptmpp2/Perry.Shafran/met_test.
>>
>> Thanks!
>>
>> Perry
>>
>> On Tue, May 2, 2017 at 2:55 PM, Julie Prestopnik via RT <
>> met_help at ucar.edu>
>> wrote:
>>
>> > Hi Perry.
>> >
>> > Could you please provide me with the path to the obs file
>> > nam.t06z.pb.tm06.nc?
>> >
>> > Thanks!
>> >
>> > Julie
>> >
>> > On Tue, May 2, 2017 at 12:37 PM, perry.shafran at noaa.gov via RT <
>> > met_help at ucar.edu> wrote:
>> >
>> > >
>> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80331 >
>> > >
>> > > Hi, Julie,
>> > >
>> > > Thanks!
>> > >
>> > > Perry
>> > >
>> > > On Tue, May 2, 2017 at 2:36 PM, Julie Prestopnik via RT <
>> > met_help at ucar.edu
>> > > >
>> > > wrote:
>> > >
>> > > > Hi Perry. I'm sorry to hear that you are experiencing
problems
>> using
>> > > > point_stat with MET. I will log into gyre to take a look and
will
>> > follow
>> > > up
>> > > > once I know more.
>> > > >
>> > > > Thanks!
>> > > >
>> > > > Julie
>> > > >
>> > > > On Tue, May 2, 2017 at 11:19 AM, perry.shafran at noaa.gov via
RT <
>> > > > met_help at ucar.edu> wrote:
>> > > >
>> > > > >
>> > > > > Tue May 02 11:19:03 2017: Request 80331 was acted upon.
>> > > > > Transaction: Ticket created by perry.shafran at noaa.gov
>> > > > > Queue: met_help
>> > > > > Subject: out of memory error
>> > > > > Owner: Nobody
>> > > > > Requestors: perry.shafran at noaa.gov
>> > > > > Status: new
>> > > > > Ticket <URL: https://rt.rap.ucar.edu/rt/
>> > Ticket/Display.html?id=80331
>> > > >
>> > > > >
>> > > > >
>> > > > > Hi, there,
>> > > > >
>> > > > > I'm not sure why this happened, but I just started using
MET to
>> > > compare a
>> > > > > typical grib2 grid 218 (awphys) file vs. the prepbufr
NetCDF file,
>> > and
>> > > it
>> > > > > quickly reported that it was out of error. This is being
done on
>> > gyre.
>> > > > Is
>> > > > > there something that I needed to add to the config file in
order
>> to
>> > run
>> > > > > this job?
>> > > > >
>> > > > > point_stat /com2/nam/prod/nam.20170430/na
>> m.t06z.awphys24.tm00.grib2
>> > > > > nam.t06z.pb.tm06.nc
>> > > > > /meso/save/Perry.Shafran/met_testing/tutorial/config/
>> > > > > PointStatConfig_tutorial
>> > > > > -v 2
>> > > > > DEBUG 1: Default Config File:
>> > > > > /awc/noscrub/Julie.Prestopnik/met/6.0/share/met/config/
>> > > > > PointStatConfig_default
>> > > > > DEBUG 1: User Config File:
>> > > > > /meso/save/Perry.Shafran/met_testing/tutorial/config/
>> > > > > PointStatConfig_tutorial
>> > > > > ERROR :
>> > > > > ERROR : out of memory! Exiting!
>> > > > > ERROR :
>> > > > > 18 (g14a1) /ptmpp2/Perry.Shafran/met_test
>> > > > >
>> > > > > Thanks!
>> > > > >
>> > > > > Perry
>> > > > >
>> > > > >
>> > > >
>> > > >
>> > >
>> > >
>> >
>> >
>>
>>
>
------------------------------------------------
Subject: out of memory error
From: perry.shafran at noaa.gov
Time: Tue May 02 13:44:18 2017
Hi, Julie,
Thanks! I got output as well.
Perry
On Tue, May 2, 2017 at 3:41 PM, Julie Prestopnik via RT
<met_help at ucar.edu>
wrote:
> Hi Perry. I believe I have solved the problem.
>
> Please reload the met module:
>
> module use /awc/noscrub/Julie.Prestopnik/modulefiles
> module load met
>
> and try running point_stat again.
>
> I was able to reproduce your error, and then, after fixing it, I was
able
> to get output from the command line argument you sent to me.
>
> Please let me know how it goes.
>
> Thanks,
>
> Julie
>
> On Tue, May 2, 2017 at 12:57 PM, Julie Prestopnik <jpresto at ucar.edu>
> wrote:
>
> > Thank you!
> >
> > On Tue, May 2, 2017 at 12:57 PM, perry.shafran at noaa.gov via RT <
> > met_help at ucar.edu> wrote:
> >
> >>
> >> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80331 >
> >>
> >> Hi, Julie,
> >>
> >> It is here: /ptmpp2/Perry.Shafran/met_test.
> >>
> >> Thanks!
> >>
> >> Perry
> >>
> >> On Tue, May 2, 2017 at 2:55 PM, Julie Prestopnik via RT <
> >> met_help at ucar.edu>
> >> wrote:
> >>
> >> > Hi Perry.
> >> >
> >> > Could you please provide me with the path to the obs file
> >> > nam.t06z.pb.tm06.nc?
> >> >
> >> > Thanks!
> >> >
> >> > Julie
> >> >
> >> > On Tue, May 2, 2017 at 12:37 PM, perry.shafran at noaa.gov via RT
<
> >> > met_help at ucar.edu> wrote:
> >> >
> >> > >
> >> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80331
>
> >> > >
> >> > > Hi, Julie,
> >> > >
> >> > > Thanks!
> >> > >
> >> > > Perry
> >> > >
> >> > > On Tue, May 2, 2017 at 2:36 PM, Julie Prestopnik via RT <
> >> > met_help at ucar.edu
> >> > > >
> >> > > wrote:
> >> > >
> >> > > > Hi Perry. I'm sorry to hear that you are experiencing
problems
> >> using
> >> > > > point_stat with MET. I will log into gyre to take a look
and will
> >> > follow
> >> > > up
> >> > > > once I know more.
> >> > > >
> >> > > > Thanks!
> >> > > >
> >> > > > Julie
> >> > > >
> >> > > > On Tue, May 2, 2017 at 11:19 AM, perry.shafran at noaa.gov via
RT <
> >> > > > met_help at ucar.edu> wrote:
> >> > > >
> >> > > > >
> >> > > > > Tue May 02 11:19:03 2017: Request 80331 was acted upon.
> >> > > > > Transaction: Ticket created by perry.shafran at noaa.gov
> >> > > > > Queue: met_help
> >> > > > > Subject: out of memory error
> >> > > > > Owner: Nobody
> >> > > > > Requestors: perry.shafran at noaa.gov
> >> > > > > Status: new
> >> > > > > Ticket <URL: https://rt.rap.ucar.edu/rt/
> >> > Ticket/Display.html?id=80331
> >> > > >
> >> > > > >
> >> > > > >
> >> > > > > Hi, there,
> >> > > > >
> >> > > > > I'm not sure why this happened, but I just started using
MET to
> >> > > compare a
> >> > > > > typical grib2 grid 218 (awphys) file vs. the prepbufr
NetCDF
> file,
> >> > and
> >> > > it
> >> > > > > quickly reported that it was out of error. This is being
done
> on
> >> > gyre.
> >> > > > Is
> >> > > > > there something that I needed to add to the config file
in order
> >> to
> >> > run
> >> > > > > this job?
> >> > > > >
> >> > > > > point_stat /com2/nam/prod/nam.20170430/na
> >> m.t06z.awphys24.tm00.grib2
> >> > > > > nam.t06z.pb.tm06.nc
> >> > > > > /meso/save/Perry.Shafran/met_testing/tutorial/config/
> >> > > > > PointStatConfig_tutorial
> >> > > > > -v 2
> >> > > > > DEBUG 1: Default Config File:
> >> > > > > /awc/noscrub/Julie.Prestopnik/met/6.0/share/met/config/
> >> > > > > PointStatConfig_default
> >> > > > > DEBUG 1: User Config File:
> >> > > > > /meso/save/Perry.Shafran/met_testing/tutorial/config/
> >> > > > > PointStatConfig_tutorial
> >> > > > > ERROR :
> >> > > > > ERROR : out of memory! Exiting!
> >> > > > > ERROR :
> >> > > > > 18 (g14a1) /ptmpp2/Perry.Shafran/met_test
> >> > > > >
> >> > > > > Thanks!
> >> > > > >
> >> > > > > Perry
> >> > > > >
> >> > > > >
> >> > > >
> >> > > >
> >> > >
> >> > >
> >> >
> >> >
> >>
> >>
> >
>
>
------------------------------------------------
Subject: out of memory error
From: Julie Prestopnik
Time: Tue May 02 13:51:07 2017
Great news! Thank you for helping us to work through these issues
with
our install on WCOSS. We appreciate it.
I will go ahead an close this ticket for now, but please submit a new
ticket if you encounter any other problems.
Thanks,
Julie
On Tue, May 2, 2017 at 1:44 PM, perry.shafran at noaa.gov via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80331 >
>
> Hi, Julie,
>
> Thanks! I got output as well.
>
> Perry
>
> On Tue, May 2, 2017 at 3:41 PM, Julie Prestopnik via RT
<met_help at ucar.edu
> >
> wrote:
>
> > Hi Perry. I believe I have solved the problem.
> >
> > Please reload the met module:
> >
> > module use /awc/noscrub/Julie.Prestopnik/modulefiles
> > module load met
> >
> > and try running point_stat again.
> >
> > I was able to reproduce your error, and then, after fixing it, I
was able
> > to get output from the command line argument you sent to me.
> >
> > Please let me know how it goes.
> >
> > Thanks,
> >
> > Julie
> >
> > On Tue, May 2, 2017 at 12:57 PM, Julie Prestopnik
<jpresto at ucar.edu>
> > wrote:
> >
> > > Thank you!
> > >
> > > On Tue, May 2, 2017 at 12:57 PM, perry.shafran at noaa.gov via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > >>
> > >> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80331 >
> > >>
> > >> Hi, Julie,
> > >>
> > >> It is here: /ptmpp2/Perry.Shafran/met_test.
> > >>
> > >> Thanks!
> > >>
> > >> Perry
> > >>
> > >> On Tue, May 2, 2017 at 2:55 PM, Julie Prestopnik via RT <
> > >> met_help at ucar.edu>
> > >> wrote:
> > >>
> > >> > Hi Perry.
> > >> >
> > >> > Could you please provide me with the path to the obs file
> > >> > nam.t06z.pb.tm06.nc?
> > >> >
> > >> > Thanks!
> > >> >
> > >> > Julie
> > >> >
> > >> > On Tue, May 2, 2017 at 12:37 PM, perry.shafran at noaa.gov via
RT <
> > >> > met_help at ucar.edu> wrote:
> > >> >
> > >> > >
> > >> > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80331 >
> > >> > >
> > >> > > Hi, Julie,
> > >> > >
> > >> > > Thanks!
> > >> > >
> > >> > > Perry
> > >> > >
> > >> > > On Tue, May 2, 2017 at 2:36 PM, Julie Prestopnik via RT <
> > >> > met_help at ucar.edu
> > >> > > >
> > >> > > wrote:
> > >> > >
> > >> > > > Hi Perry. I'm sorry to hear that you are experiencing
problems
> > >> using
> > >> > > > point_stat with MET. I will log into gyre to take a look
and
> will
> > >> > follow
> > >> > > up
> > >> > > > once I know more.
> > >> > > >
> > >> > > > Thanks!
> > >> > > >
> > >> > > > Julie
> > >> > > >
> > >> > > > On Tue, May 2, 2017 at 11:19 AM, perry.shafran at noaa.gov
via RT
> <
> > >> > > > met_help at ucar.edu> wrote:
> > >> > > >
> > >> > > > >
> > >> > > > > Tue May 02 11:19:03 2017: Request 80331 was acted upon.
> > >> > > > > Transaction: Ticket created by perry.shafran at noaa.gov
> > >> > > > > Queue: met_help
> > >> > > > > Subject: out of memory error
> > >> > > > > Owner: Nobody
> > >> > > > > Requestors: perry.shafran at noaa.gov
> > >> > > > > Status: new
> > >> > > > > Ticket <URL: https://rt.rap.ucar.edu/rt/
> > >> > Ticket/Display.html?id=80331
> > >> > > >
> > >> > > > >
> > >> > > > >
> > >> > > > > Hi, there,
> > >> > > > >
> > >> > > > > I'm not sure why this happened, but I just started
using MET
> to
> > >> > > compare a
> > >> > > > > typical grib2 grid 218 (awphys) file vs. the prepbufr
NetCDF
> > file,
> > >> > and
> > >> > > it
> > >> > > > > quickly reported that it was out of error. This is
being done
> > on
> > >> > gyre.
> > >> > > > Is
> > >> > > > > there something that I needed to add to the config file
in
> order
> > >> to
> > >> > run
> > >> > > > > this job?
> > >> > > > >
> > >> > > > > point_stat /com2/nam/prod/nam.20170430/na
> > >> m.t06z.awphys24.tm00.grib2
> > >> > > > > nam.t06z.pb.tm06.nc
> > >> > > > > /meso/save/Perry.Shafran/met_testing/tutorial/config/
> > >> > > > > PointStatConfig_tutorial
> > >> > > > > -v 2
> > >> > > > > DEBUG 1: Default Config File:
> > >> > > > > /awc/noscrub/Julie.Prestopnik/met/6.0/share/met/config/
> > >> > > > > PointStatConfig_default
> > >> > > > > DEBUG 1: User Config File:
> > >> > > > > /meso/save/Perry.Shafran/met_testing/tutorial/config/
> > >> > > > > PointStatConfig_tutorial
> > >> > > > > ERROR :
> > >> > > > > ERROR : out of memory! Exiting!
> > >> > > > > ERROR :
> > >> > > > > 18 (g14a1) /ptmpp2/Perry.Shafran/met_test
> > >> > > > >
> > >> > > > > Thanks!
> > >> > > > >
> > >> > > > > Perry
> > >> > > > >
> > >> > > > >
> > >> > > >
> > >> > > >
> > >> > >
> > >> > >
> > >> >
> > >> >
> > >>
> > >>
> > >
> >
> >
>
>
------------------------------------------------
Subject: out of memory error
From: perry.shafran at noaa.gov
Time: Tue May 02 13:51:32 2017
Hi, Julie,
New question. Why is it that in the output file
/ptmpp2/Perry.Shafran/met_test/point_stat_240000L_20170501_000000V.stat
that no column headers are listed after LINE_TYPE? There are lots of
columns after that one with no column header.
Thanks!
Perry
On Tue, May 2, 2017 at 3:44 PM, Perry Shafran - NOAA Affiliate <
perry.shafran at noaa.gov> wrote:
> Hi, Julie,
>
> Thanks! I got output as well.
>
> Perry
>
> On Tue, May 2, 2017 at 3:41 PM, Julie Prestopnik via RT
<met_help at ucar.edu
> > wrote:
>
>> Hi Perry. I believe I have solved the problem.
>>
>>
>> Please reload the met module:
>>
>> module use /awc/noscrub/Julie.Prestopnik/modulefiles
>> module load met
>>
>> and try running point_stat again.
>>
>> I was able to reproduce your error, and then, after fixing it, I
was able
>> to get output from the command line argument you sent to me.
>>
>> Please let me know how it goes.
>>
>> Thanks,
>>
>> Julie
>>
>> On Tue, May 2, 2017 at 12:57 PM, Julie Prestopnik
<jpresto at ucar.edu>
>> wrote:
>>
>> > Thank you!
>> >
>> > On Tue, May 2, 2017 at 12:57 PM, perry.shafran at noaa.gov via RT <
>> > met_help at ucar.edu> wrote:
>> >
>> >>
>> >> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80331 >
>> >>
>> >> Hi, Julie,
>> >>
>> >> It is here: /ptmpp2/Perry.Shafran/met_test.
>> >>
>> >> Thanks!
>> >>
>> >> Perry
>> >>
>> >> On Tue, May 2, 2017 at 2:55 PM, Julie Prestopnik via RT <
>> >> met_help at ucar.edu>
>> >> wrote:
>> >>
>> >> > Hi Perry.
>> >> >
>> >> > Could you please provide me with the path to the obs file
>> >> > nam.t06z.pb.tm06.nc?
>> >> >
>> >> > Thanks!
>> >> >
>> >> > Julie
>> >> >
>> >> > On Tue, May 2, 2017 at 12:37 PM, perry.shafran at noaa.gov via RT
<
>> >> > met_help at ucar.edu> wrote:
>> >> >
>> >> > >
>> >> > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80331 >
>> >> > >
>> >> > > Hi, Julie,
>> >> > >
>> >> > > Thanks!
>> >> > >
>> >> > > Perry
>> >> > >
>> >> > > On Tue, May 2, 2017 at 2:36 PM, Julie Prestopnik via RT <
>> >> > met_help at ucar.edu
>> >> > > >
>> >> > > wrote:
>> >> > >
>> >> > > > Hi Perry. I'm sorry to hear that you are experiencing
problems
>> >> using
>> >> > > > point_stat with MET. I will log into gyre to take a look
and will
>> >> > follow
>> >> > > up
>> >> > > > once I know more.
>> >> > > >
>> >> > > > Thanks!
>> >> > > >
>> >> > > > Julie
>> >> > > >
>> >> > > > On Tue, May 2, 2017 at 11:19 AM, perry.shafran at noaa.gov
via RT <
>> >> > > > met_help at ucar.edu> wrote:
>> >> > > >
>> >> > > > >
>> >> > > > > Tue May 02 11:19:03 2017: Request 80331 was acted upon.
>> >> > > > > Transaction: Ticket created by perry.shafran at noaa.gov
>> >> > > > > Queue: met_help
>> >> > > > > Subject: out of memory error
>> >> > > > > Owner: Nobody
>> >> > > > > Requestors: perry.shafran at noaa.gov
>> >> > > > > Status: new
>> >> > > > > Ticket <URL: https://rt.rap.ucar.edu/rt/
>> >> > Ticket/Display.html?id=80331
>> >> > > >
>> >> > > > >
>> >> > > > >
>> >> > > > > Hi, there,
>> >> > > > >
>> >> > > > > I'm not sure why this happened, but I just started using
MET to
>> >> > > compare a
>> >> > > > > typical grib2 grid 218 (awphys) file vs. the prepbufr
NetCDF
>> file,
>> >> > and
>> >> > > it
>> >> > > > > quickly reported that it was out of error. This is
being done
>> on
>> >> > gyre.
>> >> > > > Is
>> >> > > > > there something that I needed to add to the config file
in
>> order
>> >> to
>> >> > run
>> >> > > > > this job?
>> >> > > > >
>> >> > > > > point_stat /com2/nam/prod/nam.20170430/na
>> >> m.t06z.awphys24.tm00.grib2
>> >> > > > > nam.t06z.pb.tm06.nc
>> >> > > > > /meso/save/Perry.Shafran/met_testing/tutorial/config/
>> >> > > > > PointStatConfig_tutorial
>> >> > > > > -v 2
>> >> > > > > DEBUG 1: Default Config File:
>> >> > > > > /awc/noscrub/Julie.Prestopnik/met/6.0/share/met/config/
>> >> > > > > PointStatConfig_default
>> >> > > > > DEBUG 1: User Config File:
>> >> > > > > /meso/save/Perry.Shafran/met_testing/tutorial/config/
>> >> > > > > PointStatConfig_tutorial
>> >> > > > > ERROR :
>> >> > > > > ERROR : out of memory! Exiting!
>> >> > > > > ERROR :
>> >> > > > > 18 (g14a1) /ptmpp2/Perry.Shafran/met_test
>> >> > > > >
>> >> > > > > Thanks!
>> >> > > > >
>> >> > > > > Perry
>> >> > > > >
>> >> > > > >
>> >> > > >
>> >> > > >
>> >> > >
>> >> > >
>> >> >
>> >> >
>> >>
>> >>
>> >
>>
>>
>
------------------------------------------------
Subject: out of memory error
From: Julie Prestopnik
Time: Tue May 02 14:38:48 2017
Hi Perry.
Looking at your .stat file I see that there is no matched pair data.
I
reran point_stat using a verbosity level of 3 to show why data was
rejected.
Looking at TMP/Z2, we can see that some observations were rejected due
to
the GRIB code and then because of the valid time:
DEBUG 2: Processing TMP/Z2 versus TMP/Z2, for observation type ADPUPA,
over
region G212, for interpolation method NEAREST(1), using 0 pairs.
DEBUG 3: Number of matched pairs = 0
DEBUG 3: Observations processed = 66350
DEBUG 3: Rejected: SID exclusion = 0
DEBUG 3: Rejected: GRIB code = 53307
DEBUG 3: Rejected: valid time = 13043
DEBUG 3: Rejected: bad obs value = 0
DEBUG 3: Rejected: off the grid = 0
DEBUG 3: Rejected: level mismatch = 0
DEBUG 3: Rejected: quality marker = 0
DEBUG 3: Rejected: message type = 0
DEBUG 3: Rejected: masking region = 0
DEBUG 3: Rejected: bad fcst value = 0
DEBUG 3: Rejected: duplicates = 0
Then, running wgrib2 on your forecast file
module load grib_util/v1.0.3
$WGRIB2 -V /com2/nam/prod/nam.20170430/nam.t06z.awphys24.tm00.grib2
I can see a valid time of "2017050106":
321:47327586:vt=2017050106:2 m above ground:24 hour fcst:TMP
Temperature
[K]:
Then, running ncdump on your observation file
module load NetCDF
ncdump -v hdr_vld /ptmpp2/Perry.Shafran/met_test/nam.t06z.pb.tm06.nc
I see valid times centered around "20170501_000000".
So, it looks like there is a 6 hour offset with the data you want to
verify. If you're able to get the files that match up the valid time,
you
will likely see some output in your file.
I hope that answers your question. Please let us know if you need
anything
else.
Thanks,
Julie
On Tue, May 2, 2017 at 1:51 PM, perry.shafran at noaa.gov via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80331 >
>
> Hi, Julie,
>
> New question. Why is it that in the output file
>
/ptmpp2/Perry.Shafran/met_test/point_stat_240000L_20170501_000000V.stat
> that no column headers are listed after LINE_TYPE? There are lots
of
> columns after that one with no column header.
>
> Thanks!
>
> Perry
>
> On Tue, May 2, 2017 at 3:44 PM, Perry Shafran - NOAA Affiliate <
> perry.shafran at noaa.gov> wrote:
>
> > Hi, Julie,
> >
> > Thanks! I got output as well.
> >
> > Perry
> >
> > On Tue, May 2, 2017 at 3:41 PM, Julie Prestopnik via RT <
> met_help at ucar.edu
> > > wrote:
> >
> >> Hi Perry. I believe I have solved the problem.
> >>
> >>
> >> Please reload the met module:
> >>
> >> module use /awc/noscrub/Julie.Prestopnik/modulefiles
> >> module load met
> >>
> >> and try running point_stat again.
> >>
> >> I was able to reproduce your error, and then, after fixing it, I
was
> able
> >> to get output from the command line argument you sent to me.
> >>
> >> Please let me know how it goes.
> >>
> >> Thanks,
> >>
> >> Julie
> >>
> >> On Tue, May 2, 2017 at 12:57 PM, Julie Prestopnik
<jpresto at ucar.edu>
> >> wrote:
> >>
> >> > Thank you!
> >> >
> >> > On Tue, May 2, 2017 at 12:57 PM, perry.shafran at noaa.gov via RT
<
> >> > met_help at ucar.edu> wrote:
> >> >
> >> >>
> >> >> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80331
>
> >> >>
> >> >> Hi, Julie,
> >> >>
> >> >> It is here: /ptmpp2/Perry.Shafran/met_test.
> >> >>
> >> >> Thanks!
> >> >>
> >> >> Perry
> >> >>
> >> >> On Tue, May 2, 2017 at 2:55 PM, Julie Prestopnik via RT <
> >> >> met_help at ucar.edu>
> >> >> wrote:
> >> >>
> >> >> > Hi Perry.
> >> >> >
> >> >> > Could you please provide me with the path to the obs file
> >> >> > nam.t06z.pb.tm06.nc?
> >> >> >
> >> >> > Thanks!
> >> >> >
> >> >> > Julie
> >> >> >
> >> >> > On Tue, May 2, 2017 at 12:37 PM, perry.shafran at noaa.gov via
RT <
> >> >> > met_help at ucar.edu> wrote:
> >> >> >
> >> >> > >
> >> >> > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80331 >
> >> >> > >
> >> >> > > Hi, Julie,
> >> >> > >
> >> >> > > Thanks!
> >> >> > >
> >> >> > > Perry
> >> >> > >
> >> >> > > On Tue, May 2, 2017 at 2:36 PM, Julie Prestopnik via RT <
> >> >> > met_help at ucar.edu
> >> >> > > >
> >> >> > > wrote:
> >> >> > >
> >> >> > > > Hi Perry. I'm sorry to hear that you are experiencing
problems
> >> >> using
> >> >> > > > point_stat with MET. I will log into gyre to take a look
and
> will
> >> >> > follow
> >> >> > > up
> >> >> > > > once I know more.
> >> >> > > >
> >> >> > > > Thanks!
> >> >> > > >
> >> >> > > > Julie
> >> >> > > >
> >> >> > > > On Tue, May 2, 2017 at 11:19 AM, perry.shafran at noaa.gov
via
> RT <
> >> >> > > > met_help at ucar.edu> wrote:
> >> >> > > >
> >> >> > > > >
> >> >> > > > > Tue May 02 11:19:03 2017: Request 80331 was acted
upon.
> >> >> > > > > Transaction: Ticket created by perry.shafran at noaa.gov
> >> >> > > > > Queue: met_help
> >> >> > > > > Subject: out of memory error
> >> >> > > > > Owner: Nobody
> >> >> > > > > Requestors: perry.shafran at noaa.gov
> >> >> > > > > Status: new
> >> >> > > > > Ticket <URL: https://rt.rap.ucar.edu/rt/
> >> >> > Ticket/Display.html?id=80331
> >> >> > > >
> >> >> > > > >
> >> >> > > > >
> >> >> > > > > Hi, there,
> >> >> > > > >
> >> >> > > > > I'm not sure why this happened, but I just started
using MET
> to
> >> >> > > compare a
> >> >> > > > > typical grib2 grid 218 (awphys) file vs. the prepbufr
NetCDF
> >> file,
> >> >> > and
> >> >> > > it
> >> >> > > > > quickly reported that it was out of error. This is
being
> done
> >> on
> >> >> > gyre.
> >> >> > > > Is
> >> >> > > > > there something that I needed to add to the config
file in
> >> order
> >> >> to
> >> >> > run
> >> >> > > > > this job?
> >> >> > > > >
> >> >> > > > > point_stat /com2/nam/prod/nam.20170430/na
> >> >> m.t06z.awphys24.tm00.grib2
> >> >> > > > > nam.t06z.pb.tm06.nc
> >> >> > > > > /meso/save/Perry.Shafran/met_testing/tutorial/config/
> >> >> > > > > PointStatConfig_tutorial
> >> >> > > > > -v 2
> >> >> > > > > DEBUG 1: Default Config File:
> >> >> > > > >
/awc/noscrub/Julie.Prestopnik/met/6.0/share/met/config/
> >> >> > > > > PointStatConfig_default
> >> >> > > > > DEBUG 1: User Config File:
> >> >> > > > > /meso/save/Perry.Shafran/met_testing/tutorial/config/
> >> >> > > > > PointStatConfig_tutorial
> >> >> > > > > ERROR :
> >> >> > > > > ERROR : out of memory! Exiting!
> >> >> > > > > ERROR :
> >> >> > > > > 18 (g14a1) /ptmpp2/Perry.Shafran/met_test
> >> >> > > > >
> >> >> > > > > Thanks!
> >> >> > > > >
> >> >> > > > > Perry
> >> >> > > > >
> >> >> > > > >
> >> >> > > >
> >> >> > > >
> >> >> > >
> >> >> > >
> >> >> >
> >> >> >
> >> >>
> >> >>
> >> >
> >>
> >>
> >
>
>
------------------------------------------------
Subject: out of memory error
From: perry.shafran at noaa.gov
Time: Tue May 02 14:43:15 2017
Hi, Julie,
The first time I ran I mismatched the dates which is why there were no
matched pairs. However, the second time I ran it correctly and got
the
point_stat_240000L_20170501_000000V.stat file. There are indeed
matched
pairs there.
This is the 2nd running of point_stat:
point_stat /com2/nam/prod/nam.20170430/nam.t00z.awphys24.tm00.grib2
nam.t06z.pb.tm06.nc
/meso/save/Perry.Shafran/met_testing/tutorial/config/PointStatConfig_tutorial
-v 2
The result of this run is the point_stat_240000L_20170501_000000V.stat
file. It is this file that has the missing column headers.
Perry
On Tue, May 2, 2017 at 4:38 PM, Julie Prestopnik via RT
<met_help at ucar.edu>
wrote:
> Hi Perry.
>
> Looking at your .stat file I see that there is no matched pair data.
I
> reran point_stat using a verbosity level of 3 to show why data was
> rejected.
>
> Looking at TMP/Z2, we can see that some observations were rejected
due to
> the GRIB code and then because of the valid time:
>
> DEBUG 2: Processing TMP/Z2 versus TMP/Z2, for observation type
ADPUPA, over
> region G212, for interpolation method NEAREST(1), using 0 pairs.
> DEBUG 3: Number of matched pairs = 0
> DEBUG 3: Observations processed = 66350
> DEBUG 3: Rejected: SID exclusion = 0
> DEBUG 3: Rejected: GRIB code = 53307
> DEBUG 3: Rejected: valid time = 13043
> DEBUG 3: Rejected: bad obs value = 0
> DEBUG 3: Rejected: off the grid = 0
> DEBUG 3: Rejected: level mismatch = 0
> DEBUG 3: Rejected: quality marker = 0
> DEBUG 3: Rejected: message type = 0
> DEBUG 3: Rejected: masking region = 0
> DEBUG 3: Rejected: bad fcst value = 0
> DEBUG 3: Rejected: duplicates = 0
> Then, running wgrib2 on your forecast file
>
> module load grib_util/v1.0.3
> $WGRIB2 -V /com2/nam/prod/nam.20170430/nam.t06z.awphys24.tm00.grib2
>
> I can see a valid time of "2017050106":
>
> 321:47327586:vt=2017050106:2 m above ground:24 hour fcst:TMP
Temperature
> [K]:
>
> Then, running ncdump on your observation file
>
> module load NetCDF
> ncdump -v hdr_vld /ptmpp2/Perry.Shafran/met_test/nam.t06z.pb.tm06.nc
>
> I see valid times centered around "20170501_000000".
>
> So, it looks like there is a 6 hour offset with the data you want to
> verify. If you're able to get the files that match up the valid
time, you
> will likely see some output in your file.
>
> I hope that answers your question. Please let us know if you need
anything
> else.
>
> Thanks,
> Julie
>
>
> On Tue, May 2, 2017 at 1:51 PM, perry.shafran at noaa.gov via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80331 >
> >
> > Hi, Julie,
> >
> > New question. Why is it that in the output file
> >
/ptmpp2/Perry.Shafran/met_test/point_stat_240000L_20170501_000000V.stat
> > that no column headers are listed after LINE_TYPE? There are lots
of
> > columns after that one with no column header.
> >
> > Thanks!
> >
> > Perry
> >
> > On Tue, May 2, 2017 at 3:44 PM, Perry Shafran - NOAA Affiliate <
> > perry.shafran at noaa.gov> wrote:
> >
> > > Hi, Julie,
> > >
> > > Thanks! I got output as well.
> > >
> > > Perry
> > >
> > > On Tue, May 2, 2017 at 3:41 PM, Julie Prestopnik via RT <
> > met_help at ucar.edu
> > > > wrote:
> > >
> > >> Hi Perry. I believe I have solved the problem.
> > >>
> > >>
> > >> Please reload the met module:
> > >>
> > >> module use /awc/noscrub/Julie.Prestopnik/modulefiles
> > >> module load met
> > >>
> > >> and try running point_stat again.
> > >>
> > >> I was able to reproduce your error, and then, after fixing it,
I was
> > able
> > >> to get output from the command line argument you sent to me.
> > >>
> > >> Please let me know how it goes.
> > >>
> > >> Thanks,
> > >>
> > >> Julie
> > >>
> > >> On Tue, May 2, 2017 at 12:57 PM, Julie Prestopnik
<jpresto at ucar.edu>
> > >> wrote:
> > >>
> > >> > Thank you!
> > >> >
> > >> > On Tue, May 2, 2017 at 12:57 PM, perry.shafran at noaa.gov via
RT <
> > >> > met_help at ucar.edu> wrote:
> > >> >
> > >> >>
> > >> >> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80331 >
> > >> >>
> > >> >> Hi, Julie,
> > >> >>
> > >> >> It is here: /ptmpp2/Perry.Shafran/met_test.
> > >> >>
> > >> >> Thanks!
> > >> >>
> > >> >> Perry
> > >> >>
> > >> >> On Tue, May 2, 2017 at 2:55 PM, Julie Prestopnik via RT <
> > >> >> met_help at ucar.edu>
> > >> >> wrote:
> > >> >>
> > >> >> > Hi Perry.
> > >> >> >
> > >> >> > Could you please provide me with the path to the obs file
> > >> >> > nam.t06z.pb.tm06.nc?
> > >> >> >
> > >> >> > Thanks!
> > >> >> >
> > >> >> > Julie
> > >> >> >
> > >> >> > On Tue, May 2, 2017 at 12:37 PM, perry.shafran at noaa.gov
via RT <
> > >> >> > met_help at ucar.edu> wrote:
> > >> >> >
> > >> >> > >
> > >> >> > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80331
> >
> > >> >> > >
> > >> >> > > Hi, Julie,
> > >> >> > >
> > >> >> > > Thanks!
> > >> >> > >
> > >> >> > > Perry
> > >> >> > >
> > >> >> > > On Tue, May 2, 2017 at 2:36 PM, Julie Prestopnik via RT
<
> > >> >> > met_help at ucar.edu
> > >> >> > > >
> > >> >> > > wrote:
> > >> >> > >
> > >> >> > > > Hi Perry. I'm sorry to hear that you are experiencing
> problems
> > >> >> using
> > >> >> > > > point_stat with MET. I will log into gyre to take a
look and
> > will
> > >> >> > follow
> > >> >> > > up
> > >> >> > > > once I know more.
> > >> >> > > >
> > >> >> > > > Thanks!
> > >> >> > > >
> > >> >> > > > Julie
> > >> >> > > >
> > >> >> > > > On Tue, May 2, 2017 at 11:19 AM,
perry.shafran at noaa.gov via
> > RT <
> > >> >> > > > met_help at ucar.edu> wrote:
> > >> >> > > >
> > >> >> > > > >
> > >> >> > > > > Tue May 02 11:19:03 2017: Request 80331 was acted
upon.
> > >> >> > > > > Transaction: Ticket created by
perry.shafran at noaa.gov
> > >> >> > > > > Queue: met_help
> > >> >> > > > > Subject: out of memory error
> > >> >> > > > > Owner: Nobody
> > >> >> > > > > Requestors: perry.shafran at noaa.gov
> > >> >> > > > > Status: new
> > >> >> > > > > Ticket <URL: https://rt.rap.ucar.edu/rt/
> > >> >> > Ticket/Display.html?id=80331
> > >> >> > > >
> > >> >> > > > >
> > >> >> > > > >
> > >> >> > > > > Hi, there,
> > >> >> > > > >
> > >> >> > > > > I'm not sure why this happened, but I just started
using
> MET
> > to
> > >> >> > > compare a
> > >> >> > > > > typical grib2 grid 218 (awphys) file vs. the
prepbufr
> NetCDF
> > >> file,
> > >> >> > and
> > >> >> > > it
> > >> >> > > > > quickly reported that it was out of error. This is
being
> > done
> > >> on
> > >> >> > gyre.
> > >> >> > > > Is
> > >> >> > > > > there something that I needed to add to the config
file in
> > >> order
> > >> >> to
> > >> >> > run
> > >> >> > > > > this job?
> > >> >> > > > >
> > >> >> > > > > point_stat /com2/nam/prod/nam.20170430/na
> > >> >> m.t06z.awphys24.tm00.grib2
> > >> >> > > > > nam.t06z.pb.tm06.nc
> > >> >> > > > >
/meso/save/Perry.Shafran/met_testing/tutorial/config/
> > >> >> > > > > PointStatConfig_tutorial
> > >> >> > > > > -v 2
> > >> >> > > > > DEBUG 1: Default Config File:
> > >> >> > > > >
/awc/noscrub/Julie.Prestopnik/met/6.0/share/met/config/
> > >> >> > > > > PointStatConfig_default
> > >> >> > > > > DEBUG 1: User Config File:
> > >> >> > > > >
/meso/save/Perry.Shafran/met_testing/tutorial/config/
> > >> >> > > > > PointStatConfig_tutorial
> > >> >> > > > > ERROR :
> > >> >> > > > > ERROR : out of memory! Exiting!
> > >> >> > > > > ERROR :
> > >> >> > > > > 18 (g14a1) /ptmpp2/Perry.Shafran/met_test
> > >> >> > > > >
> > >> >> > > > > Thanks!
> > >> >> > > > >
> > >> >> > > > > Perry
> > >> >> > > > >
> > >> >> > > > >
> > >> >> > > >
> > >> >> > > >
> > >> >> > >
> > >> >> > >
> > >> >> >
> > >> >> >
> > >> >>
> > >> >>
> > >> >
> > >>
> > >>
> > >
> >
> >
>
>
------------------------------------------------
Subject: out of memory error
From: Julie Prestopnik
Time: Tue May 02 15:09:09 2017
I see. Thank you for explaining.
The .stat file only lists the first 22 column headers. To see the
data
sorted by line type, you will need to look in the optional ascii file
outputs that you selected (e.g. ctc, cts, mctc, mcts, cnt, sl1l2,
vl1l2).
This is explained in Section 3.3 of the MET User's Guide (for
reference):
http://www.dtcenter.org/met/users/docs/users_guide/MET_Users_Guide_v6.0.pdf
"The STAT format consists of tabular ASCII data that can be easily
read by
many analysis tools and software packages. MET produces STAT output
for the
Grid-Stat, Point-Stat, Ensemble-Stat and WaveletStat tools. STAT is a
specialized ASCII format containing one record on each line. However,
a
single STAT file may contain multiple line types. Several header
columns at
the beginning of each line remain the same for each line type.
However, the
remaining columns after the header change for each line type. STAT
files
can be difficult for a human to read as the quantities represented for
many
columns of data change from line to line.
For this reason, ASCII output is also available as an alternative for
the
Grid-Stat, Point-Stat, and WaveletStat tools. The ASCII files contain
exactly the same output as the STAT files but each STAT line type is
grouped into a single ASCII file with a column header row making the
output
more human-readable. The con figuration files control which line types
are
output and whether or not the optional ASCII files are generated."
I hope that better helps answer your question.
Kind regards,
Julie
On Tue, May 2, 2017 at 2:43 PM, perry.shafran at noaa.gov via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80331 >
>
> Hi, Julie,
>
> The first time I ran I mismatched the dates which is why there were
no
> matched pairs. However, the second time I ran it correctly and got
the
> point_stat_240000L_20170501_000000V.stat file. There are indeed
matched
> pairs there.
>
> This is the 2nd running of point_stat:
>
> point_stat /com2/nam/prod/nam.20170430/nam.t00z.awphys24.tm00.grib2
> nam.t06z.pb.tm06.nc
> /meso/save/Perry.Shafran/met_testing/tutorial/config/
> PointStatConfig_tutorial
> -v 2
>
> The result of this run is the
point_stat_240000L_20170501_000000V.stat
> file. It is this file that has the missing column headers.
>
> Perry
>
> On Tue, May 2, 2017 at 4:38 PM, Julie Prestopnik via RT
<met_help at ucar.edu
> >
> wrote:
>
> > Hi Perry.
> >
> > Looking at your .stat file I see that there is no matched pair
data. I
> > reran point_stat using a verbosity level of 3 to show why data was
> > rejected.
> >
> > Looking at TMP/Z2, we can see that some observations were rejected
due to
> > the GRIB code and then because of the valid time:
> >
> > DEBUG 2: Processing TMP/Z2 versus TMP/Z2, for observation type
ADPUPA,
> over
> > region G212, for interpolation method NEAREST(1), using 0 pairs.
> > DEBUG 3: Number of matched pairs = 0
> > DEBUG 3: Observations processed = 66350
> > DEBUG 3: Rejected: SID exclusion = 0
> > DEBUG 3: Rejected: GRIB code = 53307
> > DEBUG 3: Rejected: valid time = 13043
> > DEBUG 3: Rejected: bad obs value = 0
> > DEBUG 3: Rejected: off the grid = 0
> > DEBUG 3: Rejected: level mismatch = 0
> > DEBUG 3: Rejected: quality marker = 0
> > DEBUG 3: Rejected: message type = 0
> > DEBUG 3: Rejected: masking region = 0
> > DEBUG 3: Rejected: bad fcst value = 0
> > DEBUG 3: Rejected: duplicates = 0
> > Then, running wgrib2 on your forecast file
> >
> > module load grib_util/v1.0.3
> > $WGRIB2 -V
/com2/nam/prod/nam.20170430/nam.t06z.awphys24.tm00.grib2
> >
> > I can see a valid time of "2017050106":
> >
> > 321:47327586:vt=2017050106:2 m above ground:24 hour fcst:TMP
Temperature
> > [K]:
> >
> > Then, running ncdump on your observation file
> >
> > module load NetCDF
> > ncdump -v hdr_vld
/ptmpp2/Perry.Shafran/met_test/nam.t06z.pb.tm06.nc
> >
> > I see valid times centered around "20170501_000000".
> >
> > So, it looks like there is a 6 hour offset with the data you want
to
> > verify. If you're able to get the files that match up the valid
time,
> you
> > will likely see some output in your file.
> >
> > I hope that answers your question. Please let us know if you need
> anything
> > else.
> >
> > Thanks,
> > Julie
> >
> >
> > On Tue, May 2, 2017 at 1:51 PM, perry.shafran at noaa.gov via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80331 >
> > >
> > > Hi, Julie,
> > >
> > > New question. Why is it that in the output file
> > > /ptmpp2/Perry.Shafran/met_test/point_stat_240000L_
> 20170501_000000V.stat
> > > that no column headers are listed after LINE_TYPE? There are
lots of
> > > columns after that one with no column header.
> > >
> > > Thanks!
> > >
> > > Perry
> > >
> > > On Tue, May 2, 2017 at 3:44 PM, Perry Shafran - NOAA Affiliate <
> > > perry.shafran at noaa.gov> wrote:
> > >
> > > > Hi, Julie,
> > > >
> > > > Thanks! I got output as well.
> > > >
> > > > Perry
> > > >
> > > > On Tue, May 2, 2017 at 3:41 PM, Julie Prestopnik via RT <
> > > met_help at ucar.edu
> > > > > wrote:
> > > >
> > > >> Hi Perry. I believe I have solved the problem.
> > > >>
> > > >>
> > > >> Please reload the met module:
> > > >>
> > > >> module use /awc/noscrub/Julie.Prestopnik/modulefiles
> > > >> module load met
> > > >>
> > > >> and try running point_stat again.
> > > >>
> > > >> I was able to reproduce your error, and then, after fixing
it, I was
> > > able
> > > >> to get output from the command line argument you sent to me.
> > > >>
> > > >> Please let me know how it goes.
> > > >>
> > > >> Thanks,
> > > >>
> > > >> Julie
> > > >>
> > > >> On Tue, May 2, 2017 at 12:57 PM, Julie Prestopnik
<jpresto at ucar.edu
> >
> > > >> wrote:
> > > >>
> > > >> > Thank you!
> > > >> >
> > > >> > On Tue, May 2, 2017 at 12:57 PM, perry.shafran at noaa.gov via
RT <
> > > >> > met_help at ucar.edu> wrote:
> > > >> >
> > > >> >>
> > > >> >> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80331 >
> > > >> >>
> > > >> >> Hi, Julie,
> > > >> >>
> > > >> >> It is here: /ptmpp2/Perry.Shafran/met_test.
> > > >> >>
> > > >> >> Thanks!
> > > >> >>
> > > >> >> Perry
> > > >> >>
> > > >> >> On Tue, May 2, 2017 at 2:55 PM, Julie Prestopnik via RT <
> > > >> >> met_help at ucar.edu>
> > > >> >> wrote:
> > > >> >>
> > > >> >> > Hi Perry.
> > > >> >> >
> > > >> >> > Could you please provide me with the path to the obs
file
> > > >> >> > nam.t06z.pb.tm06.nc?
> > > >> >> >
> > > >> >> > Thanks!
> > > >> >> >
> > > >> >> > Julie
> > > >> >> >
> > > >> >> > On Tue, May 2, 2017 at 12:37 PM, perry.shafran at noaa.gov
via
> RT <
> > > >> >> > met_help at ucar.edu> wrote:
> > > >> >> >
> > > >> >> > >
> > > >> >> > > <URL: https://rt.rap.ucar.edu/rt/
> Ticket/Display.html?id=80331
> > >
> > > >> >> > >
> > > >> >> > > Hi, Julie,
> > > >> >> > >
> > > >> >> > > Thanks!
> > > >> >> > >
> > > >> >> > > Perry
> > > >> >> > >
> > > >> >> > > On Tue, May 2, 2017 at 2:36 PM, Julie Prestopnik via
RT <
> > > >> >> > met_help at ucar.edu
> > > >> >> > > >
> > > >> >> > > wrote:
> > > >> >> > >
> > > >> >> > > > Hi Perry. I'm sorry to hear that you are
experiencing
> > problems
> > > >> >> using
> > > >> >> > > > point_stat with MET. I will log into gyre to take a
look
> and
> > > will
> > > >> >> > follow
> > > >> >> > > up
> > > >> >> > > > once I know more.
> > > >> >> > > >
> > > >> >> > > > Thanks!
> > > >> >> > > >
> > > >> >> > > > Julie
> > > >> >> > > >
> > > >> >> > > > On Tue, May 2, 2017 at 11:19 AM,
perry.shafran at noaa.gov
> via
> > > RT <
> > > >> >> > > > met_help at ucar.edu> wrote:
> > > >> >> > > >
> > > >> >> > > > >
> > > >> >> > > > > Tue May 02 11:19:03 2017: Request 80331 was acted
upon.
> > > >> >> > > > > Transaction: Ticket created by
perry.shafran at noaa.gov
> > > >> >> > > > > Queue: met_help
> > > >> >> > > > > Subject: out of memory error
> > > >> >> > > > > Owner: Nobody
> > > >> >> > > > > Requestors: perry.shafran at noaa.gov
> > > >> >> > > > > Status: new
> > > >> >> > > > > Ticket <URL: https://rt.rap.ucar.edu/rt/
> > > >> >> > Ticket/Display.html?id=80331
> > > >> >> > > >
> > > >> >> > > > >
> > > >> >> > > > >
> > > >> >> > > > > Hi, there,
> > > >> >> > > > >
> > > >> >> > > > > I'm not sure why this happened, but I just started
using
> > MET
> > > to
> > > >> >> > > compare a
> > > >> >> > > > > typical grib2 grid 218 (awphys) file vs. the
prepbufr
> > NetCDF
> > > >> file,
> > > >> >> > and
> > > >> >> > > it
> > > >> >> > > > > quickly reported that it was out of error. This
is being
> > > done
> > > >> on
> > > >> >> > gyre.
> > > >> >> > > > Is
> > > >> >> > > > > there something that I needed to add to the config
file
> in
> > > >> order
> > > >> >> to
> > > >> >> > run
> > > >> >> > > > > this job?
> > > >> >> > > > >
> > > >> >> > > > > point_stat /com2/nam/prod/nam.20170430/na
> > > >> >> m.t06z.awphys24.tm00.grib2
> > > >> >> > > > > nam.t06z.pb.tm06.nc
> > > >> >> > > > >
/meso/save/Perry.Shafran/met_testing/tutorial/config/
> > > >> >> > > > > PointStatConfig_tutorial
> > > >> >> > > > > -v 2
> > > >> >> > > > > DEBUG 1: Default Config File:
> > > >> >> > > > >
/awc/noscrub/Julie.Prestopnik/met/6.0/share/met/config/
> > > >> >> > > > > PointStatConfig_default
> > > >> >> > > > > DEBUG 1: User Config File:
> > > >> >> > > > >
/meso/save/Perry.Shafran/met_testing/tutorial/config/
> > > >> >> > > > > PointStatConfig_tutorial
> > > >> >> > > > > ERROR :
> > > >> >> > > > > ERROR : out of memory! Exiting!
> > > >> >> > > > > ERROR :
> > > >> >> > > > > 18 (g14a1) /ptmpp2/Perry.Shafran/met_test
> > > >> >> > > > >
> > > >> >> > > > > Thanks!
> > > >> >> > > > >
> > > >> >> > > > > Perry
> > > >> >> > > > >
> > > >> >> > > > >
> > > >> >> > > >
> > > >> >> > > >
> > > >> >> > >
> > > >> >> > >
> > > >> >> >
> > > >> >> >
> > > >> >>
> > > >> >>
> > > >> >
> > > >>
> > > >>
> > > >
> > >
> > >
> >
> >
>
>
------------------------------------------------
Subject: out of memory error
From: perry.shafran at noaa.gov
Time: Wed May 03 11:34:01 2017
Hi, Julie,
OK, thanks! That made sense. I thought I remembered when John was
presenting the .stat output during the workshop that there were column
headers all the way across. I guess it was other files he was
showing.
Thanks!
Perry
On Tue, May 2, 2017 at 5:09 PM, Julie Prestopnik via RT
<met_help at ucar.edu>
wrote:
> I see. Thank you for explaining.
>
> The .stat file only lists the first 22 column headers. To see the
data
> sorted by line type, you will need to look in the optional ascii
file
> outputs that you selected (e.g. ctc, cts, mctc, mcts, cnt, sl1l2,
vl1l2).
>
> This is explained in Section 3.3 of the MET User's Guide (for
reference):
> http://www.dtcenter.org/met/users/docs/users_guide/MET_
> Users_Guide_v6.0.pdf
>
> "The STAT format consists of tabular ASCII data that can be easily
read by
> many analysis tools and software packages. MET produces STAT output
for the
> Grid-Stat, Point-Stat, Ensemble-Stat and WaveletStat tools. STAT is
a
> specialized ASCII format containing one record on each line.
However, a
> single STAT file may contain multiple line types. Several header
columns at
> the beginning of each line remain the same for each line type.
However, the
> remaining columns after the header change for each line type. STAT
files
> can be difficult for a human to read as the quantities represented
for many
> columns of data change from line to line.
>
> For this reason, ASCII output is also available as an alternative
for the
> Grid-Stat, Point-Stat, and WaveletStat tools. The ASCII files
contain
> exactly the same output as the STAT files but each STAT line type is
> grouped into a single ASCII file with a column header row making the
output
> more human-readable. The con figuration files control which line
types are
> output and whether or not the optional ASCII files are generated."
>
> I hope that better helps answer your question.
>
> Kind regards,
> Julie
>
> On Tue, May 2, 2017 at 2:43 PM, perry.shafran at noaa.gov via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80331 >
> >
> > Hi, Julie,
> >
> > The first time I ran I mismatched the dates which is why there
were no
> > matched pairs. However, the second time I ran it correctly and
got the
> > point_stat_240000L_20170501_000000V.stat file. There are indeed
matched
> > pairs there.
> >
> > This is the 2nd running of point_stat:
> >
> > point_stat
/com2/nam/prod/nam.20170430/nam.t00z.awphys24.tm00.grib2
> > nam.t06z.pb.tm06.nc
> > /meso/save/Perry.Shafran/met_testing/tutorial/config/
> > PointStatConfig_tutorial
> > -v 2
> >
> > The result of this run is the
point_stat_240000L_20170501_000000V.stat
> > file. It is this file that has the missing column headers.
> >
> > Perry
> >
> > On Tue, May 2, 2017 at 4:38 PM, Julie Prestopnik via RT <
> met_help at ucar.edu
> > >
> > wrote:
> >
> > > Hi Perry.
> > >
> > > Looking at your .stat file I see that there is no matched pair
data. I
> > > reran point_stat using a verbosity level of 3 to show why data
was
> > > rejected.
> > >
> > > Looking at TMP/Z2, we can see that some observations were
rejected due
> to
> > > the GRIB code and then because of the valid time:
> > >
> > > DEBUG 2: Processing TMP/Z2 versus TMP/Z2, for observation type
ADPUPA,
> > over
> > > region G212, for interpolation method NEAREST(1), using 0 pairs.
> > > DEBUG 3: Number of matched pairs = 0
> > > DEBUG 3: Observations processed = 66350
> > > DEBUG 3: Rejected: SID exclusion = 0
> > > DEBUG 3: Rejected: GRIB code = 53307
> > > DEBUG 3: Rejected: valid time = 13043
> > > DEBUG 3: Rejected: bad obs value = 0
> > > DEBUG 3: Rejected: off the grid = 0
> > > DEBUG 3: Rejected: level mismatch = 0
> > > DEBUG 3: Rejected: quality marker = 0
> > > DEBUG 3: Rejected: message type = 0
> > > DEBUG 3: Rejected: masking region = 0
> > > DEBUG 3: Rejected: bad fcst value = 0
> > > DEBUG 3: Rejected: duplicates = 0
> > > Then, running wgrib2 on your forecast file
> > >
> > > module load grib_util/v1.0.3
> > > $WGRIB2 -V
/com2/nam/prod/nam.20170430/nam.t06z.awphys24.tm00.grib2
> > >
> > > I can see a valid time of "2017050106":
> > >
> > > 321:47327586:vt=2017050106:2 m above ground:24 hour fcst:TMP
> Temperature
> > > [K]:
> > >
> > > Then, running ncdump on your observation file
> > >
> > > module load NetCDF
> > > ncdump -v hdr_vld
/ptmpp2/Perry.Shafran/met_test/nam.t06z.pb.tm06.nc
> > >
> > > I see valid times centered around "20170501_000000".
> > >
> > > So, it looks like there is a 6 hour offset with the data you
want to
> > > verify. If you're able to get the files that match up the valid
time,
> > you
> > > will likely see some output in your file.
> > >
> > > I hope that answers your question. Please let us know if you
need
> > anything
> > > else.
> > >
> > > Thanks,
> > > Julie
> > >
> > >
> > > On Tue, May 2, 2017 at 1:51 PM, perry.shafran at noaa.gov via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80331
>
> > > >
> > > > Hi, Julie,
> > > >
> > > > New question. Why is it that in the output file
> > > > /ptmpp2/Perry.Shafran/met_test/point_stat_240000L_
> > 20170501_000000V.stat
> > > > that no column headers are listed after LINE_TYPE? There are
lots of
> > > > columns after that one with no column header.
> > > >
> > > > Thanks!
> > > >
> > > > Perry
> > > >
> > > > On Tue, May 2, 2017 at 3:44 PM, Perry Shafran - NOAA Affiliate
<
> > > > perry.shafran at noaa.gov> wrote:
> > > >
> > > > > Hi, Julie,
> > > > >
> > > > > Thanks! I got output as well.
> > > > >
> > > > > Perry
> > > > >
> > > > > On Tue, May 2, 2017 at 3:41 PM, Julie Prestopnik via RT <
> > > > met_help at ucar.edu
> > > > > > wrote:
> > > > >
> > > > >> Hi Perry. I believe I have solved the problem.
> > > > >>
> > > > >>
> > > > >> Please reload the met module:
> > > > >>
> > > > >> module use /awc/noscrub/Julie.Prestopnik/modulefiles
> > > > >> module load met
> > > > >>
> > > > >> and try running point_stat again.
> > > > >>
> > > > >> I was able to reproduce your error, and then, after fixing
it, I
> was
> > > > able
> > > > >> to get output from the command line argument you sent to
me.
> > > > >>
> > > > >> Please let me know how it goes.
> > > > >>
> > > > >> Thanks,
> > > > >>
> > > > >> Julie
> > > > >>
> > > > >> On Tue, May 2, 2017 at 12:57 PM, Julie Prestopnik <
> jpresto at ucar.edu
> > >
> > > > >> wrote:
> > > > >>
> > > > >> > Thank you!
> > > > >> >
> > > > >> > On Tue, May 2, 2017 at 12:57 PM, perry.shafran at noaa.gov
via RT
> <
> > > > >> > met_help at ucar.edu> wrote:
> > > > >> >
> > > > >> >>
> > > > >> >> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80331
> >
> > > > >> >>
> > > > >> >> Hi, Julie,
> > > > >> >>
> > > > >> >> It is here: /ptmpp2/Perry.Shafran/met_test.
> > > > >> >>
> > > > >> >> Thanks!
> > > > >> >>
> > > > >> >> Perry
> > > > >> >>
> > > > >> >> On Tue, May 2, 2017 at 2:55 PM, Julie Prestopnik via RT
<
> > > > >> >> met_help at ucar.edu>
> > > > >> >> wrote:
> > > > >> >>
> > > > >> >> > Hi Perry.
> > > > >> >> >
> > > > >> >> > Could you please provide me with the path to the obs
file
> > > > >> >> > nam.t06z.pb.tm06.nc?
> > > > >> >> >
> > > > >> >> > Thanks!
> > > > >> >> >
> > > > >> >> > Julie
> > > > >> >> >
> > > > >> >> > On Tue, May 2, 2017 at 12:37 PM,
perry.shafran at noaa.gov via
> > RT <
> > > > >> >> > met_help at ucar.edu> wrote:
> > > > >> >> >
> > > > >> >> > >
> > > > >> >> > > <URL: https://rt.rap.ucar.edu/rt/
> > Ticket/Display.html?id=80331
> > > >
> > > > >> >> > >
> > > > >> >> > > Hi, Julie,
> > > > >> >> > >
> > > > >> >> > > Thanks!
> > > > >> >> > >
> > > > >> >> > > Perry
> > > > >> >> > >
> > > > >> >> > > On Tue, May 2, 2017 at 2:36 PM, Julie Prestopnik via
RT <
> > > > >> >> > met_help at ucar.edu
> > > > >> >> > > >
> > > > >> >> > > wrote:
> > > > >> >> > >
> > > > >> >> > > > Hi Perry. I'm sorry to hear that you are
experiencing
> > > problems
> > > > >> >> using
> > > > >> >> > > > point_stat with MET. I will log into gyre to take
a look
> > and
> > > > will
> > > > >> >> > follow
> > > > >> >> > > up
> > > > >> >> > > > once I know more.
> > > > >> >> > > >
> > > > >> >> > > > Thanks!
> > > > >> >> > > >
> > > > >> >> > > > Julie
> > > > >> >> > > >
> > > > >> >> > > > On Tue, May 2, 2017 at 11:19 AM,
perry.shafran at noaa.gov
> > via
> > > > RT <
> > > > >> >> > > > met_help at ucar.edu> wrote:
> > > > >> >> > > >
> > > > >> >> > > > >
> > > > >> >> > > > > Tue May 02 11:19:03 2017: Request 80331 was
acted upon.
> > > > >> >> > > > > Transaction: Ticket created by
perry.shafran at noaa.gov
> > > > >> >> > > > > Queue: met_help
> > > > >> >> > > > > Subject: out of memory error
> > > > >> >> > > > > Owner: Nobody
> > > > >> >> > > > > Requestors: perry.shafran at noaa.gov
> > > > >> >> > > > > Status: new
> > > > >> >> > > > > Ticket <URL: https://rt.rap.ucar.edu/rt/
> > > > >> >> > Ticket/Display.html?id=80331
> > > > >> >> > > >
> > > > >> >> > > > >
> > > > >> >> > > > >
> > > > >> >> > > > > Hi, there,
> > > > >> >> > > > >
> > > > >> >> > > > > I'm not sure why this happened, but I just
started
> using
> > > MET
> > > > to
> > > > >> >> > > compare a
> > > > >> >> > > > > typical grib2 grid 218 (awphys) file vs. the
prepbufr
> > > NetCDF
> > > > >> file,
> > > > >> >> > and
> > > > >> >> > > it
> > > > >> >> > > > > quickly reported that it was out of error. This
is
> being
> > > > done
> > > > >> on
> > > > >> >> > gyre.
> > > > >> >> > > > Is
> > > > >> >> > > > > there something that I needed to add to the
config file
> > in
> > > > >> order
> > > > >> >> to
> > > > >> >> > run
> > > > >> >> > > > > this job?
> > > > >> >> > > > >
> > > > >> >> > > > > point_stat /com2/nam/prod/nam.20170430/na
> > > > >> >> m.t06z.awphys24.tm00.grib2
> > > > >> >> > > > > nam.t06z.pb.tm06.nc
> > > > >> >> > > > >
/meso/save/Perry.Shafran/met_testing/tutorial/config/
> > > > >> >> > > > > PointStatConfig_tutorial
> > > > >> >> > > > > -v 2
> > > > >> >> > > > > DEBUG 1: Default Config File:
> > > > >> >> > > > > /awc/noscrub/Julie.Prestopnik/
> met/6.0/share/met/config/
> > > > >> >> > > > > PointStatConfig_default
> > > > >> >> > > > > DEBUG 1: User Config File:
> > > > >> >> > > > >
/meso/save/Perry.Shafran/met_testing/tutorial/config/
> > > > >> >> > > > > PointStatConfig_tutorial
> > > > >> >> > > > > ERROR :
> > > > >> >> > > > > ERROR : out of memory! Exiting!
> > > > >> >> > > > > ERROR :
> > > > >> >> > > > > 18 (g14a1) /ptmpp2/Perry.Shafran/met_test
> > > > >> >> > > > >
> > > > >> >> > > > > Thanks!
> > > > >> >> > > > >
> > > > >> >> > > > > Perry
> > > > >> >> > > > >
> > > > >> >> > > > >
> > > > >> >> > > >
> > > > >> >> > > >
> > > > >> >> > >
> > > > >> >> > >
> > > > >> >> >
> > > > >> >> >
> > > > >> >>
> > > > >> >>
> > > > >> >
> > > > >>
> > > > >>
> > > > >
> > > >
> > > >
> > >
> > >
> >
> >
>
>
------------------------------------------------
Subject: out of memory error
From: Julie Prestopnik
Time: Thu May 04 10:24:51 2017
Great! I'll go ahead and close this ticket for now. Please let us
know if
you encounter any other issues.
Julie
On Wed, May 3, 2017 at 11:34 AM, perry.shafran at noaa.gov via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80331 >
>
> Hi, Julie,
>
> OK, thanks! That made sense. I thought I remembered when John was
> presenting the .stat output during the workshop that there were
column
> headers all the way across. I guess it was other files he was
showing.
> Thanks!
>
> Perry
>
> On Tue, May 2, 2017 at 5:09 PM, Julie Prestopnik via RT
<met_help at ucar.edu
> >
> wrote:
>
> > I see. Thank you for explaining.
> >
> > The .stat file only lists the first 22 column headers. To see the
data
> > sorted by line type, you will need to look in the optional ascii
file
> > outputs that you selected (e.g. ctc, cts, mctc, mcts, cnt, sl1l2,
vl1l2).
> >
> > This is explained in Section 3.3 of the MET User's Guide (for
reference):
> > http://www.dtcenter.org/met/users/docs/users_guide/MET_
> > Users_Guide_v6.0.pdf
> >
> > "The STAT format consists of tabular ASCII data that can be easily
read
> by
> > many analysis tools and software packages. MET produces STAT
output for
> the
> > Grid-Stat, Point-Stat, Ensemble-Stat and WaveletStat tools. STAT
is a
> > specialized ASCII format containing one record on each line.
However, a
> > single STAT file may contain multiple line types. Several header
columns
> at
> > the beginning of each line remain the same for each line type.
However,
> the
> > remaining columns after the header change for each line type. STAT
files
> > can be difficult for a human to read as the quantities represented
for
> many
> > columns of data change from line to line.
> >
> > For this reason, ASCII output is also available as an alternative
for the
> > Grid-Stat, Point-Stat, and WaveletStat tools. The ASCII files
contain
> > exactly the same output as the STAT files but each STAT line type
is
> > grouped into a single ASCII file with a column header row making
the
> output
> > more human-readable. The con figuration files control which line
types
> are
> > output and whether or not the optional ASCII files are generated."
> >
> > I hope that better helps answer your question.
> >
> > Kind regards,
> > Julie
> >
> > On Tue, May 2, 2017 at 2:43 PM, perry.shafran at noaa.gov via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80331 >
> > >
> > > Hi, Julie,
> > >
> > > The first time I ran I mismatched the dates which is why there
were no
> > > matched pairs. However, the second time I ran it correctly and
got the
> > > point_stat_240000L_20170501_000000V.stat file. There are indeed
> matched
> > > pairs there.
> > >
> > > This is the 2nd running of point_stat:
> > >
> > > point_stat
/com2/nam/prod/nam.20170430/nam.t00z.awphys24.tm00.grib2
> > > nam.t06z.pb.tm06.nc
> > > /meso/save/Perry.Shafran/met_testing/tutorial/config/
> > > PointStatConfig_tutorial
> > > -v 2
> > >
> > > The result of this run is the
point_stat_240000L_20170501_000000V.stat
> > > file. It is this file that has the missing column headers.
> > >
> > > Perry
> > >
> > > On Tue, May 2, 2017 at 4:38 PM, Julie Prestopnik via RT <
> > met_help at ucar.edu
> > > >
> > > wrote:
> > >
> > > > Hi Perry.
> > > >
> > > > Looking at your .stat file I see that there is no matched pair
> data. I
> > > > reran point_stat using a verbosity level of 3 to show why data
was
> > > > rejected.
> > > >
> > > > Looking at TMP/Z2, we can see that some observations were
rejected
> due
> > to
> > > > the GRIB code and then because of the valid time:
> > > >
> > > > DEBUG 2: Processing TMP/Z2 versus TMP/Z2, for observation type
> ADPUPA,
> > > over
> > > > region G212, for interpolation method NEAREST(1), using 0
pairs.
> > > > DEBUG 3: Number of matched pairs = 0
> > > > DEBUG 3: Observations processed = 66350
> > > > DEBUG 3: Rejected: SID exclusion = 0
> > > > DEBUG 3: Rejected: GRIB code = 53307
> > > > DEBUG 3: Rejected: valid time = 13043
> > > > DEBUG 3: Rejected: bad obs value = 0
> > > > DEBUG 3: Rejected: off the grid = 0
> > > > DEBUG 3: Rejected: level mismatch = 0
> > > > DEBUG 3: Rejected: quality marker = 0
> > > > DEBUG 3: Rejected: message type = 0
> > > > DEBUG 3: Rejected: masking region = 0
> > > > DEBUG 3: Rejected: bad fcst value = 0
> > > > DEBUG 3: Rejected: duplicates = 0
> > > > Then, running wgrib2 on your forecast file
> > > >
> > > > module load grib_util/v1.0.3
> > > > $WGRIB2 -V
/com2/nam/prod/nam.20170430/nam.t06z.awphys24.tm00.grib2
> > > >
> > > > I can see a valid time of "2017050106":
> > > >
> > > > 321:47327586:vt=2017050106:2 m above ground:24 hour fcst:TMP
> > Temperature
> > > > [K]:
> > > >
> > > > Then, running ncdump on your observation file
> > > >
> > > > module load NetCDF
> > > > ncdump -v hdr_vld
/ptmpp2/Perry.Shafran/met_test/nam.t06z.pb.tm06.nc
> > > >
> > > > I see valid times centered around "20170501_000000".
> > > >
> > > > So, it looks like there is a 6 hour offset with the data you
want to
> > > > verify. If you're able to get the files that match up the
valid
> time,
> > > you
> > > > will likely see some output in your file.
> > > >
> > > > I hope that answers your question. Please let us know if you
need
> > > anything
> > > > else.
> > > >
> > > > Thanks,
> > > > Julie
> > > >
> > > >
> > > > On Tue, May 2, 2017 at 1:51 PM, perry.shafran at noaa.gov via RT
<
> > > > met_help at ucar.edu> wrote:
> > > >
> > > > >
> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80331 >
> > > > >
> > > > > Hi, Julie,
> > > > >
> > > > > New question. Why is it that in the output file
> > > > > /ptmpp2/Perry.Shafran/met_test/point_stat_240000L_
> > > 20170501_000000V.stat
> > > > > that no column headers are listed after LINE_TYPE? There
are lots
> of
> > > > > columns after that one with no column header.
> > > > >
> > > > > Thanks!
> > > > >
> > > > > Perry
> > > > >
> > > > > On Tue, May 2, 2017 at 3:44 PM, Perry Shafran - NOAA
Affiliate <
> > > > > perry.shafran at noaa.gov> wrote:
> > > > >
> > > > > > Hi, Julie,
> > > > > >
> > > > > > Thanks! I got output as well.
> > > > > >
> > > > > > Perry
> > > > > >
> > > > > > On Tue, May 2, 2017 at 3:41 PM, Julie Prestopnik via RT <
> > > > > met_help at ucar.edu
> > > > > > > wrote:
> > > > > >
> > > > > >> Hi Perry. I believe I have solved the problem.
> > > > > >>
> > > > > >>
> > > > > >> Please reload the met module:
> > > > > >>
> > > > > >> module use /awc/noscrub/Julie.Prestopnik/modulefiles
> > > > > >> module load met
> > > > > >>
> > > > > >> and try running point_stat again.
> > > > > >>
> > > > > >> I was able to reproduce your error, and then, after
fixing it, I
> > was
> > > > > able
> > > > > >> to get output from the command line argument you sent to
me.
> > > > > >>
> > > > > >> Please let me know how it goes.
> > > > > >>
> > > > > >> Thanks,
> > > > > >>
> > > > > >> Julie
> > > > > >>
> > > > > >> On Tue, May 2, 2017 at 12:57 PM, Julie Prestopnik <
> > jpresto at ucar.edu
> > > >
> > > > > >> wrote:
> > > > > >>
> > > > > >> > Thank you!
> > > > > >> >
> > > > > >> > On Tue, May 2, 2017 at 12:57 PM, perry.shafran at noaa.gov
via
> RT
> > <
> > > > > >> > met_help at ucar.edu> wrote:
> > > > > >> >
> > > > > >> >>
> > > > > >> >> <URL: https://rt.rap.ucar.edu/rt/
> Ticket/Display.html?id=80331
> > >
> > > > > >> >>
> > > > > >> >> Hi, Julie,
> > > > > >> >>
> > > > > >> >> It is here: /ptmpp2/Perry.Shafran/met_test.
> > > > > >> >>
> > > > > >> >> Thanks!
> > > > > >> >>
> > > > > >> >> Perry
> > > > > >> >>
> > > > > >> >> On Tue, May 2, 2017 at 2:55 PM, Julie Prestopnik via
RT <
> > > > > >> >> met_help at ucar.edu>
> > > > > >> >> wrote:
> > > > > >> >>
> > > > > >> >> > Hi Perry.
> > > > > >> >> >
> > > > > >> >> > Could you please provide me with the path to the obs
file
> > > > > >> >> > nam.t06z.pb.tm06.nc?
> > > > > >> >> >
> > > > > >> >> > Thanks!
> > > > > >> >> >
> > > > > >> >> > Julie
> > > > > >> >> >
> > > > > >> >> > On Tue, May 2, 2017 at 12:37 PM,
perry.shafran at noaa.gov
> via
> > > RT <
> > > > > >> >> > met_help at ucar.edu> wrote:
> > > > > >> >> >
> > > > > >> >> > >
> > > > > >> >> > > <URL: https://rt.rap.ucar.edu/rt/
> > > Ticket/Display.html?id=80331
> > > > >
> > > > > >> >> > >
> > > > > >> >> > > Hi, Julie,
> > > > > >> >> > >
> > > > > >> >> > > Thanks!
> > > > > >> >> > >
> > > > > >> >> > > Perry
> > > > > >> >> > >
> > > > > >> >> > > On Tue, May 2, 2017 at 2:36 PM, Julie Prestopnik
via RT <
> > > > > >> >> > met_help at ucar.edu
> > > > > >> >> > > >
> > > > > >> >> > > wrote:
> > > > > >> >> > >
> > > > > >> >> > > > Hi Perry. I'm sorry to hear that you are
experiencing
> > > > problems
> > > > > >> >> using
> > > > > >> >> > > > point_stat with MET. I will log into gyre to
take a
> look
> > > and
> > > > > will
> > > > > >> >> > follow
> > > > > >> >> > > up
> > > > > >> >> > > > once I know more.
> > > > > >> >> > > >
> > > > > >> >> > > > Thanks!
> > > > > >> >> > > >
> > > > > >> >> > > > Julie
> > > > > >> >> > > >
> > > > > >> >> > > > On Tue, May 2, 2017 at 11:19 AM,
> perry.shafran at noaa.gov
> > > via
> > > > > RT <
> > > > > >> >> > > > met_help at ucar.edu> wrote:
> > > > > >> >> > > >
> > > > > >> >> > > > >
> > > > > >> >> > > > > Tue May 02 11:19:03 2017: Request 80331 was
acted
> upon.
> > > > > >> >> > > > > Transaction: Ticket created by
> perry.shafran at noaa.gov
> > > > > >> >> > > > > Queue: met_help
> > > > > >> >> > > > > Subject: out of memory error
> > > > > >> >> > > > > Owner: Nobody
> > > > > >> >> > > > > Requestors: perry.shafran at noaa.gov
> > > > > >> >> > > > > Status: new
> > > > > >> >> > > > > Ticket <URL: https://rt.rap.ucar.edu/rt/
> > > > > >> >> > Ticket/Display.html?id=80331
> > > > > >> >> > > >
> > > > > >> >> > > > >
> > > > > >> >> > > > >
> > > > > >> >> > > > > Hi, there,
> > > > > >> >> > > > >
> > > > > >> >> > > > > I'm not sure why this happened, but I just
started
> > using
> > > > MET
> > > > > to
> > > > > >> >> > > compare a
> > > > > >> >> > > > > typical grib2 grid 218 (awphys) file vs. the
prepbufr
> > > > NetCDF
> > > > > >> file,
> > > > > >> >> > and
> > > > > >> >> > > it
> > > > > >> >> > > > > quickly reported that it was out of error.
This is
> > being
> > > > > done
> > > > > >> on
> > > > > >> >> > gyre.
> > > > > >> >> > > > Is
> > > > > >> >> > > > > there something that I needed to add to the
config
> file
> > > in
> > > > > >> order
> > > > > >> >> to
> > > > > >> >> > run
> > > > > >> >> > > > > this job?
> > > > > >> >> > > > >
> > > > > >> >> > > > > point_stat /com2/nam/prod/nam.20170430/na
> > > > > >> >> m.t06z.awphys24.tm00.grib2
> > > > > >> >> > > > > nam.t06z.pb.tm06.nc
> > > > > >> >> > > > > /meso/save/Perry.Shafran/met_
> testing/tutorial/config/
> > > > > >> >> > > > > PointStatConfig_tutorial
> > > > > >> >> > > > > -v 2
> > > > > >> >> > > > > DEBUG 1: Default Config File:
> > > > > >> >> > > > > /awc/noscrub/Julie.Prestopnik/
> > met/6.0/share/met/config/
> > > > > >> >> > > > > PointStatConfig_default
> > > > > >> >> > > > > DEBUG 1: User Config File:
> > > > > >> >> > > > > /meso/save/Perry.Shafran/met_
> testing/tutorial/config/
> > > > > >> >> > > > > PointStatConfig_tutorial
> > > > > >> >> > > > > ERROR :
> > > > > >> >> > > > > ERROR : out of memory! Exiting!
> > > > > >> >> > > > > ERROR :
> > > > > >> >> > > > > 18 (g14a1) /ptmpp2/Perry.Shafran/met_test
> > > > > >> >> > > > >
> > > > > >> >> > > > > Thanks!
> > > > > >> >> > > > >
> > > > > >> >> > > > > Perry
> > > > > >> >> > > > >
> > > > > >> >> > > > >
> > > > > >> >> > > >
> > > > > >> >> > > >
> > > > > >> >> > >
> > > > > >> >> > >
> > > > > >> >> >
> > > > > >> >> >
> > > > > >> >>
> > > > > >> >>
> > > > > >> >
> > > > > >>
> > > > > >>
> > > > > >
> > > > >
> > > > >
> > > >
> > > >
> > >
> > >
> >
> >
>
>
------------------------------------------------
More information about the Met_help
mailing list