[Met_help] [rt.rap.ucar.edu #75433] History for Issues converting PREPBUFR to NetCDF
Julie Prestopnik via RT
met_help at ucar.edu
Tue Jun 28 09:30:15 MDT 2016
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Dear Met Help,
Trying to convert a PREPBUFR file to NetCDF.
I used the default PB2NC configure file, and got the following:
[garciaj at login prepbufr_obs]$ ./pb2nc gdas1.t12z.prepbufr.nr gdas.20150820.t12z.nc PB2NCConfig_default
DEBUG 1: Default Config File: /work/apps/pgi_14.10/met-5.1/share/met/config/PB2NCConfig_default
DEBUG 1: User Config File: PB2NCConfig_default
DEBUG 1: Creating NetCDF File: gdas.20150820.t12z.nc
DEBUG 1: Processing PrepBufr File: gdas1.t12z.prepbufr.nr
DEBUG 1: Blocking PrepBufr file to: /tmp/tmp_pb2nc_blk_32144_0
WARNING:
WARNING: process_pbfile() -> No PrepBufr messages to process in file: gdas1.t12z.prepbufr.nr
WARNING:
ERROR :
ERROR : write_netcdf_hdr_data() -> No PrepBufr messages retained. Nothing to write.
ERROR :
Thanks in advance for the help,
Jose M. Garcia-Rivera, PhD
IM Systems Group
Rockville/College Park, MD
This e-mail, including attachments, may include confidential and/or proprietary information, and may be used only by the person or entity to which it is addressed. If the reader of this e-mail is not the intended recipient or his or her authorized agent, the reader is hereby notified that any dissemination, distribution or copying of this e-mail is prohibited. If you have received this e-mail in error, please notify the sender by replying to this message and delete this e-mail immediately.
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: Issues converting PREPBUFR to NetCDF
From: Julie Prestopnik
Time: Tue Mar 08 11:11:42 2016
Hi Jose. I'm sorry to hear that you are having problems converting a
PREPBUFR file to NetCDF.
Please upload your input files and configuration file to our anonymous
ftp
site as follows:
http://www.dtcenter.org/met/users/support/met_help.php
Then I can take a look and get back to you.
Thanks,
Julie
On Tue, Mar 8, 2016 at 11:01 AM, Jose Garcia-Rivera via RT <
met_help at ucar.edu> wrote:
>
> Tue Mar 08 11:01:25 2016: Request 75433 was acted upon.
> Transaction: Ticket created by GarciaJ at imsg.com
> Queue: met_help
> Subject: Issues converting PREPBUFR to NetCDF
> Owner: Nobody
> Requestors: GarciaJ at imsg.com
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
>
>
> Dear Met Help,
>
> Trying to convert a PREPBUFR file to NetCDF.
>
> I used the default PB2NC configure file, and got the following:
>
> [garciaj at login prepbufr_obs]$ ./pb2nc gdas1.t12z.prepbufr.nr
> gdas.20150820.t12z.nc PB2NCConfig_default
> DEBUG 1: Default Config File:
> /work/apps/pgi_14.10/met-5.1/share/met/config/PB2NCConfig_default
> DEBUG 1: User Config File: PB2NCConfig_default
> DEBUG 1: Creating NetCDF File: gdas.20150820.t12z.nc
> DEBUG 1: Processing PrepBufr File: gdas1.t12z.prepbufr.nr
> DEBUG 1: Blocking PrepBufr file to: /tmp/tmp_pb2nc_blk_32144_0
> WARNING:
> WARNING: process_pbfile() -> No PrepBufr messages to process in
file:
> gdas1.t12z.prepbufr.nr
> WARNING:
> ERROR :
> ERROR : write_netcdf_hdr_data() -> No PrepBufr messages retained.
> Nothing to write.
> ERROR :
>
>
> Thanks in advance for the help,
> Jose M. Garcia-Rivera, PhD
> IM Systems Group
> Rockville/College Park, MD
> This e-mail, including attachments, may include confidential and/or
> proprietary information, and may be used only by the person or
entity to
> which it is addressed. If the reader of this e-mail is not the
intended
> recipient or his or her authorized agent, the reader is hereby
notified
> that any dissemination, distribution or copying of this e-mail is
> prohibited. If you have received this e-mail in error, please notify
the
> sender by replying to this message and delete this e-mail
immediately.
>
>
--
Julie Prestopnik
National Center for Atmospheric Research
Research Applications Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to NetCDF
From: Jose Garcia-Rivera
Time: Tue Mar 08 11:29:58 2016
Dear Julie,
I just put the files in 'garcia_data'. I appreciate your help.
Best Regards,
Jose
-----Original Message-----
From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
Sent: Tuesday, March 08, 2016 1:12 PM
To: Jose Garcia-Rivera
Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to
NetCDF
Hi Jose. I'm sorry to hear that you are having problems converting a
PREPBUFR file to NetCDF.
Please upload your input files and configuration file to our anonymous
ftp site as follows:
http://www.dtcenter.org/met/users/support/met_help.php
Then I can take a look and get back to you.
Thanks,
Julie
On Tue, Mar 8, 2016 at 11:01 AM, Jose Garcia-Rivera via RT <
met_help at ucar.edu> wrote:
>
> Tue Mar 08 11:01:25 2016: Request 75433 was acted upon.
> Transaction: Ticket created by GarciaJ at imsg.com
> Queue: met_help
> Subject: Issues converting PREPBUFR to NetCDF
> Owner: Nobody
> Requestors: GarciaJ at imsg.com
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> >
>
>
> Dear Met Help,
>
> Trying to convert a PREPBUFR file to NetCDF.
>
> I used the default PB2NC configure file, and got the following:
>
> [garciaj at login prepbufr_obs]$ ./pb2nc gdas1.t12z.prepbufr.nr
> gdas.20150820.t12z.nc PB2NCConfig_default DEBUG 1: Default Config
> File:
> /work/apps/pgi_14.10/met-5.1/share/met/config/PB2NCConfig_default
> DEBUG 1: User Config File: PB2NCConfig_default
> DEBUG 1: Creating NetCDF File: gdas.20150820.t12z.nc
> DEBUG 1: Processing PrepBufr File: gdas1.t12z.prepbufr.nr
> DEBUG 1: Blocking PrepBufr file to: /tmp/tmp_pb2nc_blk_32144_0
> WARNING:
> WARNING: process_pbfile() -> No PrepBufr messages to process in
file:
> gdas1.t12z.prepbufr.nr
> WARNING:
> ERROR :
> ERROR : write_netcdf_hdr_data() -> No PrepBufr messages retained.
> Nothing to write.
> ERROR :
>
>
> Thanks in advance for the help,
> Jose M. Garcia-Rivera, PhD
> IM Systems Group
> Rockville/College Park, MD
> This e-mail, including attachments, may include confidential and/or
> proprietary information, and may be used only by the person or
entity
> to which it is addressed. If the reader of this e-mail is not the
> intended recipient or his or her authorized agent, the reader is
> hereby notified that any dissemination, distribution or copying of
> this e-mail is prohibited. If you have received this e-mail in
error,
> please notify the sender by replying to this message and delete this
e-mail immediately.
>
>
--
Julie Prestopnik
National Center for Atmospheric Research Research Applications
Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
This e-mail, including attachments, may include confidential and/or
proprietary information, and may be used only by the person or entity
to which it is addressed. If the reader of this e-mail is not the
intended recipient or his or her authorized agent, the reader is
hereby notified that any dissemination, distribution or copying of
this e-mail is prohibited. If you have received this e-mail in error,
please notify the sender by replying to this message and delete this
e-mail immediately.
------------------------------------------------
Subject: Issues converting PREPBUFR to NetCDF
From: Julie Prestopnik
Time: Tue Mar 08 15:28:10 2016
Hi Jose. Thank you for uploading the files. Unfortunately, I am
unable to
reproduce the error you are experiencing. I am wondering if you have
successfully used pb2nc before. As a check could you please run the
following in your met-5.1/ directory:
*make test >& make_test.log*
and then send me the make_test.log file?
Thanks,
Julie
On Tue, Mar 8, 2016 at 11:29 AM, Jose Garcia-Rivera via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
>
> Dear Julie,
>
> I just put the files in 'garcia_data'. I appreciate your help.
>
> Best Regards,
> Jose
>
> -----Original Message-----
> From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> Sent: Tuesday, March 08, 2016 1:12 PM
> To: Jose Garcia-Rivera
> Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to
NetCDF
>
> Hi Jose. I'm sorry to hear that you are having problems converting a
> PREPBUFR file to NetCDF.
>
> Please upload your input files and configuration file to our
anonymous ftp
> site as follows:
> http://www.dtcenter.org/met/users/support/met_help.php
>
> Then I can take a look and get back to you.
>
> Thanks,
> Julie
>
> On Tue, Mar 8, 2016 at 11:01 AM, Jose Garcia-Rivera via RT <
> met_help at ucar.edu> wrote:
>
> >
> > Tue Mar 08 11:01:25 2016: Request 75433 was acted upon.
> > Transaction: Ticket created by GarciaJ at imsg.com
> > Queue: met_help
> > Subject: Issues converting PREPBUFR to NetCDF
> > Owner: Nobody
> > Requestors: GarciaJ at imsg.com
> > Status: new
> > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > >
> >
> >
> > Dear Met Help,
> >
> > Trying to convert a PREPBUFR file to NetCDF.
> >
> > I used the default PB2NC configure file, and got the following:
> >
> > [garciaj at login prepbufr_obs]$ ./pb2nc gdas1.t12z.prepbufr.nr
> > gdas.20150820.t12z.nc PB2NCConfig_default DEBUG 1: Default Config
> > File:
> > /work/apps/pgi_14.10/met-5.1/share/met/config/PB2NCConfig_default
> > DEBUG 1: User Config File: PB2NCConfig_default
> > DEBUG 1: Creating NetCDF File: gdas.20150820.t12z.nc
> > DEBUG 1: Processing PrepBufr File: gdas1.t12z.prepbufr.nr
> > DEBUG 1: Blocking PrepBufr file to: /tmp/tmp_pb2nc_blk_32144_0
> > WARNING:
> > WARNING: process_pbfile() -> No PrepBufr messages to process in
file:
> > gdas1.t12z.prepbufr.nr
> > WARNING:
> > ERROR :
> > ERROR : write_netcdf_hdr_data() -> No PrepBufr messages retained.
> > Nothing to write.
> > ERROR :
> >
> >
> > Thanks in advance for the help,
> > Jose M. Garcia-Rivera, PhD
> > IM Systems Group
> > Rockville/College Park, MD
> > This e-mail, including attachments, may include confidential
and/or
> > proprietary information, and may be used only by the person or
entity
> > to which it is addressed. If the reader of this e-mail is not the
> > intended recipient or his or her authorized agent, the reader is
> > hereby notified that any dissemination, distribution or copying of
> > this e-mail is prohibited. If you have received this e-mail in
error,
> > please notify the sender by replying to this message and delete
this
> e-mail immediately.
> >
> >
>
>
> --
> Julie Prestopnik
> National Center for Atmospheric Research Research Applications
Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
> This e-mail, including attachments, may include confidential and/or
> proprietary information, and may be used only by the person or
entity to
> which it is addressed. If the reader of this e-mail is not the
intended
> recipient or his or her authorized agent, the reader is hereby
notified
> that any dissemination, distribution or copying of this e-mail is
> prohibited. If you have received this e-mail in error, please notify
the
> sender by replying to this message and delete this e-mail
immediately.
>
>
>
--
Julie Prestopnik
National Center for Atmospheric Research
Research Applications Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to NetCDF
From: Jose Garcia-Rivera
Time: Wed Mar 09 07:54:59 2016
Dear Julie,
Thanks for your help. I haven't run pb2nc before. I've run grid_stat
with no issues. I'm waiting for the cluster administrator to grant me
permission to run the test inside the MET directory. I'll get back to
you as soon as I get the log file.
Best Regards,
Jose
-----Original Message-----
From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
Sent: Tuesday, March 08, 2016 5:28 PM
To: Jose Garcia-Rivera
Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to
NetCDF
Hi Jose. Thank you for uploading the files. Unfortunately, I am
unable to reproduce the error you are experiencing. I am wondering if
you have successfully used pb2nc before. As a check could you please
run the following in your met-5.1/ directory:
*make test >& make_test.log*
and then send me the make_test.log file?
Thanks,
Julie
On Tue, Mar 8, 2016 at 11:29 AM, Jose Garcia-Rivera via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
>
> Dear Julie,
>
> I just put the files in 'garcia_data'. I appreciate your help.
>
> Best Regards,
> Jose
>
> -----Original Message-----
> From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> Sent: Tuesday, March 08, 2016 1:12 PM
> To: Jose Garcia-Rivera
> Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to
> NetCDF
>
> Hi Jose. I'm sorry to hear that you are having problems converting a
> PREPBUFR file to NetCDF.
>
> Please upload your input files and configuration file to our
anonymous
> ftp site as follows:
> http://www.dtcenter.org/met/users/support/met_help.php
>
> Then I can take a look and get back to you.
>
> Thanks,
> Julie
>
> On Tue, Mar 8, 2016 at 11:01 AM, Jose Garcia-Rivera via RT <
> met_help at ucar.edu> wrote:
>
> >
> > Tue Mar 08 11:01:25 2016: Request 75433 was acted upon.
> > Transaction: Ticket created by GarciaJ at imsg.com
> > Queue: met_help
> > Subject: Issues converting PREPBUFR to NetCDF
> > Owner: Nobody
> > Requestors: GarciaJ at imsg.com
> > Status: new
> > Ticket <URL:
> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > >
> >
> >
> > Dear Met Help,
> >
> > Trying to convert a PREPBUFR file to NetCDF.
> >
> > I used the default PB2NC configure file, and got the following:
> >
> > [garciaj at login prepbufr_obs]$ ./pb2nc gdas1.t12z.prepbufr.nr
> > gdas.20150820.t12z.nc PB2NCConfig_default DEBUG 1: Default Config
> > File:
> > /work/apps/pgi_14.10/met-5.1/share/met/config/PB2NCConfig_default
> > DEBUG 1: User Config File: PB2NCConfig_default
> > DEBUG 1: Creating NetCDF File: gdas.20150820.t12z.nc
> > DEBUG 1: Processing PrepBufr File: gdas1.t12z.prepbufr.nr
> > DEBUG 1: Blocking PrepBufr file to: /tmp/tmp_pb2nc_blk_32144_0
> > WARNING:
> > WARNING: process_pbfile() -> No PrepBufr messages to process in
file:
> > gdas1.t12z.prepbufr.nr
> > WARNING:
> > ERROR :
> > ERROR : write_netcdf_hdr_data() -> No PrepBufr messages retained.
> > Nothing to write.
> > ERROR :
> >
> >
> > Thanks in advance for the help,
> > Jose M. Garcia-Rivera, PhD
> > IM Systems Group
> > Rockville/College Park, MD
> > This e-mail, including attachments, may include confidential
and/or
> > proprietary information, and may be used only by the person or
> > entity to which it is addressed. If the reader of this e-mail is
not
> > the intended recipient or his or her authorized agent, the reader
is
> > hereby notified that any dissemination, distribution or copying of
> > this e-mail is prohibited. If you have received this e-mail in
> > error, please notify the sender by replying to this message and
> > delete this
> e-mail immediately.
> >
> >
>
>
> --
> Julie Prestopnik
> National Center for Atmospheric Research Research Applications
> Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
> This e-mail, including attachments, may include confidential and/or
> proprietary information, and may be used only by the person or
entity
> to which it is addressed. If the reader of this e-mail is not the
> intended recipient or his or her authorized agent, the reader is
> hereby notified that any dissemination, distribution or copying of
> this e-mail is prohibited. If you have received this e-mail in
error,
> please notify the sender by replying to this message and delete this
e-mail immediately.
>
>
>
--
Julie Prestopnik
National Center for Atmospheric Research Research Applications
Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
This e-mail, including attachments, may include confidential and/or
proprietary information, and may be used only by the person or entity
to which it is addressed. If the reader of this e-mail is not the
intended recipient or his or her authorized agent, the reader is
hereby notified that any dissemination, distribution or copying of
this e-mail is prohibited. If you have received this e-mail in error,
please notify the sender by replying to this message and delete this
e-mail immediately.
------------------------------------------------
Subject: Issues converting PREPBUFR to NetCDF
From: Jose Garcia-Rivera
Time: Wed Mar 09 10:22:08 2016
Dear Julie,
Attached is the test log file. It's showing the same issues on pb2nc
even with the sample files.
Best Regards,
Jose
-----Original Message-----
From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
Sent: Tuesday, March 08, 2016 5:28 PM
To: Jose Garcia-Rivera
Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to
NetCDF
Hi Jose. Thank you for uploading the files. Unfortunately, I am
unable to reproduce the error you are experiencing. I am wondering if
you have successfully used pb2nc before. As a check could you please
run the following in your met-5.1/ directory:
*make test >& make_test.log*
and then send me the make_test.log file?
Thanks,
Julie
On Tue, Mar 8, 2016 at 11:29 AM, Jose Garcia-Rivera via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
>
> Dear Julie,
>
> I just put the files in 'garcia_data'. I appreciate your help.
>
> Best Regards,
> Jose
>
> -----Original Message-----
> From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> Sent: Tuesday, March 08, 2016 1:12 PM
> To: Jose Garcia-Rivera
> Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to
> NetCDF
>
> Hi Jose. I'm sorry to hear that you are having problems converting a
> PREPBUFR file to NetCDF.
>
> Please upload your input files and configuration file to our
anonymous
> ftp site as follows:
> http://www.dtcenter.org/met/users/support/met_help.php
>
> Then I can take a look and get back to you.
>
> Thanks,
> Julie
>
> On Tue, Mar 8, 2016 at 11:01 AM, Jose Garcia-Rivera via RT <
> met_help at ucar.edu> wrote:
>
> >
> > Tue Mar 08 11:01:25 2016: Request 75433 was acted upon.
> > Transaction: Ticket created by GarciaJ at imsg.com
> > Queue: met_help
> > Subject: Issues converting PREPBUFR to NetCDF
> > Owner: Nobody
> > Requestors: GarciaJ at imsg.com
> > Status: new
> > Ticket <URL:
> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > >
> >
> >
> > Dear Met Help,
> >
> > Trying to convert a PREPBUFR file to NetCDF.
> >
> > I used the default PB2NC configure file, and got the following:
> >
> > [garciaj at login prepbufr_obs]$ ./pb2nc gdas1.t12z.prepbufr.nr
> > gdas.20150820.t12z.nc PB2NCConfig_default DEBUG 1: Default Config
> > File:
> > /work/apps/pgi_14.10/met-5.1/share/met/config/PB2NCConfig_default
> > DEBUG 1: User Config File: PB2NCConfig_default
> > DEBUG 1: Creating NetCDF File: gdas.20150820.t12z.nc
> > DEBUG 1: Processing PrepBufr File: gdas1.t12z.prepbufr.nr
> > DEBUG 1: Blocking PrepBufr file to: /tmp/tmp_pb2nc_blk_32144_0
> > WARNING:
> > WARNING: process_pbfile() -> No PrepBufr messages to process in
file:
> > gdas1.t12z.prepbufr.nr
> > WARNING:
> > ERROR :
> > ERROR : write_netcdf_hdr_data() -> No PrepBufr messages retained.
> > Nothing to write.
> > ERROR :
> >
> >
> > Thanks in advance for the help,
> > Jose M. Garcia-Rivera, PhD
> > IM Systems Group
> > Rockville/College Park, MD
> > This e-mail, including attachments, may include confidential
and/or
> > proprietary information, and may be used only by the person or
> > entity to which it is addressed. If the reader of this e-mail is
not
> > the intended recipient or his or her authorized agent, the reader
is
> > hereby notified that any dissemination, distribution or copying of
> > this e-mail is prohibited. If you have received this e-mail in
> > error, please notify the sender by replying to this message and
> > delete this
> e-mail immediately.
> >
> >
>
>
> --
> Julie Prestopnik
> National Center for Atmospheric Research Research Applications
> Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
> This e-mail, including attachments, may include confidential and/or
> proprietary information, and may be used only by the person or
entity
> to which it is addressed. If the reader of this e-mail is not the
> intended recipient or his or her authorized agent, the reader is
> hereby notified that any dissemination, distribution or copying of
> this e-mail is prohibited. If you have received this e-mail in
error,
> please notify the sender by replying to this message and delete this
e-mail immediately.
>
>
>
--
Julie Prestopnik
National Center for Atmospheric Research Research Applications
Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
This e-mail, including attachments, may include confidential and/or
proprietary information, and may be used only by the person or entity
to which it is addressed. If the reader of this e-mail is not the
intended recipient or his or her authorized agent, the reader is
hereby notified that any dissemination, distribution or copying of
this e-mail is prohibited. If you have received this e-mail in error,
please notify the sender by replying to this message and delete this
e-mail immediately.
------------------------------------------------
Subject: Issues converting PREPBUFR to NetCDF
From: Jose Garcia-Rivera
Time: Wed Mar 09 10:22:08 2016
nohup: ignoring input
./run_tests /work/apps/pgi_14.10/met-5.1/bin /work/apps/pgi_14.10/met-
5.1/share/met
PATH = /work/apps/pgi_14.10/met-5.1/bin
MET_BASE = /work/apps/pgi_14.10/met-5.1/share/met
*** Testing the Model Evaluation Tools Project ***
*** Testing Gen-Vx-Mask application ***
*** Running Gen-Vx-Mask to generate a polyline mask file for the
Continental United States ***
DEBUG 1: Input File:
../data/sample_fcst/2005080700/wrfprs_ruc13_24.tm00_G212
DEBUG 1: Mask File: /work/apps/pgi_14.10/met-
5.1/share/met/poly/CONUS.poly
DEBUG 2: Parsed Data Grid: Lambert Conformal (185 x 129)
DEBUG 2: Parsed Mask Polyline: CONUS containing 243 points
DEBUG 1: Output File: ../out/gen_vx_mask/CONUS_poly.nc
*** Running Gen-Vx-Mask to generate a circle mask file ***
DEBUG 1: Input File:
../data/sample_fcst/2005080700/wrfprs_ruc13_24.tm00_G212
DEBUG 1: Mask File: /work/apps/pgi_14.10/met-
5.1/share/met/poly/MLB_Stadiums.txt
DEBUG 2: Parsed Data Grid: Lambert Conformal (185 x 129)
DEBUG 2: Parsed Mask Polyline: MLB_Stadiums containing 30 points
DEBUG 1: Output File: ../out/gen_vx_mask/CONUS_circles.nc
*** Testing PCP-Combine application ***
*** Running PCP-Combine to combine 3-hourly APCP accumulation
forecasts into a single 12 hour accumulation forecast ***
DEBUG 1: [1] File
../data/sample_fcst/2005080700/wrfprs_ruc13_12.tm00_G212 matches valid
time of 20050807_120000
DEBUG 1: [2] File
../data/sample_fcst/2005080700/wrfprs_ruc13_09.tm00_G212 matches valid
time of 20050807_090000
DEBUG 1: [3] File
../data/sample_fcst/2005080700/wrfprs_ruc13_06.tm00_G212 matches valid
time of 20050807_060000
DEBUG 1: [4] File
../data/sample_fcst/2005080700/wrfprs_ruc13_03.tm00_G212 matches valid
time of 20050807_030000
DEBUG 1: [1] Reading input file:
../data/sample_fcst/2005080700/wrfprs_ruc13_12.tm00_G212
DEBUG 1: [2] Reading input file:
../data/sample_fcst/2005080700/wrfprs_ruc13_09.tm00_G212
DEBUG 1: [3] Reading input file:
../data/sample_fcst/2005080700/wrfprs_ruc13_06.tm00_G212
DEBUG 1: [4] Reading input file:
../data/sample_fcst/2005080700/wrfprs_ruc13_03.tm00_G212
DEBUG 1: Writing output file:
../out/pcp_combine/sample_fcst_12L_2005080712V_12A.nc
*** Running PCP-Combine to combine 3-hourly APCP accumulation
forecasts into a single 12 hour accumulation forecast ***
DEBUG 1: [1] File
../data/sample_fcst/2005080700/wrfprs_ruc13_24.tm00_G212 matches valid
time of 20050808_000000
DEBUG 1: [2] File
../data/sample_fcst/2005080700/wrfprs_ruc13_21.tm00_G212 matches valid
time of 20050807_210000
DEBUG 1: [3] File
../data/sample_fcst/2005080700/wrfprs_ruc13_18.tm00_G212 matches valid
time of 20050807_180000
DEBUG 1: [4] File
../data/sample_fcst/2005080700/wrfprs_ruc13_15.tm00_G212 matches valid
time of 20050807_150000
DEBUG 1: [1] Reading input file:
../data/sample_fcst/2005080700/wrfprs_ruc13_24.tm00_G212
DEBUG 1: [2] Reading input file:
../data/sample_fcst/2005080700/wrfprs_ruc13_21.tm00_G212
DEBUG 1: [3] Reading input file:
../data/sample_fcst/2005080700/wrfprs_ruc13_18.tm00_G212
DEBUG 1: [4] Reading input file:
../data/sample_fcst/2005080700/wrfprs_ruc13_15.tm00_G212
DEBUG 1: Writing output file:
../out/pcp_combine/sample_fcst_12L_2005080800V_12A.nc
*** Running PCP-Combine to combine 3-hourly APCP accumulation
forecasts into a single 24 hour accumulation forecast ***
DEBUG 1: [1] File
../data/sample_fcst/2005080700/wrfprs_ruc13_24.tm00_G212 matches valid
time of 20050808_000000
DEBUG 1: [2] File
../data/sample_fcst/2005080700/wrfprs_ruc13_21.tm00_G212 matches valid
time of 20050807_210000
DEBUG 1: [3] File
../data/sample_fcst/2005080700/wrfprs_ruc13_18.tm00_G212 matches valid
time of 20050807_180000
DEBUG 1: [4] File
../data/sample_fcst/2005080700/wrfprs_ruc13_15.tm00_G212 matches valid
time of 20050807_150000
DEBUG 1: [5] File
../data/sample_fcst/2005080700/wrfprs_ruc13_12.tm00_G212 matches valid
time of 20050807_120000
DEBUG 1: [6] File
../data/sample_fcst/2005080700/wrfprs_ruc13_09.tm00_G212 matches valid
time of 20050807_090000
DEBUG 1: [7] File
../data/sample_fcst/2005080700/wrfprs_ruc13_06.tm00_G212 matches valid
time of 20050807_060000
DEBUG 1: [8] File
../data/sample_fcst/2005080700/wrfprs_ruc13_03.tm00_G212 matches valid
time of 20050807_030000
DEBUG 1: [1] Reading input file:
../data/sample_fcst/2005080700/wrfprs_ruc13_24.tm00_G212
DEBUG 1: [2] Reading input file:
../data/sample_fcst/2005080700/wrfprs_ruc13_21.tm00_G212
DEBUG 1: [3] Reading input file:
../data/sample_fcst/2005080700/wrfprs_ruc13_18.tm00_G212
DEBUG 1: [4] Reading input file:
../data/sample_fcst/2005080700/wrfprs_ruc13_15.tm00_G212
DEBUG 1: [5] Reading input file:
../data/sample_fcst/2005080700/wrfprs_ruc13_12.tm00_G212
DEBUG 1: [6] Reading input file:
../data/sample_fcst/2005080700/wrfprs_ruc13_09.tm00_G212
DEBUG 1: [7] Reading input file:
../data/sample_fcst/2005080700/wrfprs_ruc13_06.tm00_G212
DEBUG 1: [8] Reading input file:
../data/sample_fcst/2005080700/wrfprs_ruc13_03.tm00_G212
DEBUG 1: Writing output file:
../out/pcp_combine/sample_fcst_24L_2005080800V_24A.nc
*** Running PCP-Combine to combine 1-hourly APCP accumulation
observations into a single 12 hour accumulation observation ***
DEBUG 1: [1] File ../data/sample_obs/ST2ml/ST2ml2005080712.Grb_G212
matches valid time of 20050807_120000
DEBUG 1: [2] File ../data/sample_obs/ST2ml/ST2ml2005080711.Grb_G212
matches valid time of 20050807_110000
DEBUG 1: [3] File ../data/sample_obs/ST2ml/ST2ml2005080710.Grb_G212
matches valid time of 20050807_100000
DEBUG 1: [4] File ../data/sample_obs/ST2ml/ST2ml2005080709.Grb_G212
matches valid time of 20050807_090000
DEBUG 1: [5] File ../data/sample_obs/ST2ml/ST2ml2005080708.Grb_G212
matches valid time of 20050807_080000
DEBUG 1: [6] File ../data/sample_obs/ST2ml/ST2ml2005080707.Grb_G212
matches valid time of 20050807_070000
DEBUG 1: [7] File ../data/sample_obs/ST2ml/ST2ml2005080706.Grb_G212
matches valid time of 20050807_060000
DEBUG 1: [8] File ../data/sample_obs/ST2ml/ST2ml2005080705.Grb_G212
matches valid time of 20050807_050000
DEBUG 1: [9] File ../data/sample_obs/ST2ml/ST2ml2005080704.Grb_G212
matches valid time of 20050807_040000
DEBUG 1: [10] File ../data/sample_obs/ST2ml/ST2ml2005080703.Grb_G212
matches valid time of 20050807_030000
DEBUG 1: [11] File ../data/sample_obs/ST2ml/ST2ml2005080702.Grb_G212
matches valid time of 20050807_020000
DEBUG 1: [12] File ../data/sample_obs/ST2ml/ST2ml2005080701.Grb_G212
matches valid time of 20050807_010000
DEBUG 1: [1] Reading input file:
../data/sample_obs/ST2ml/ST2ml2005080712.Grb_G212
DEBUG 1: [2] Reading input file:
../data/sample_obs/ST2ml/ST2ml2005080711.Grb_G212
DEBUG 1: [3] Reading input file:
../data/sample_obs/ST2ml/ST2ml2005080710.Grb_G212
DEBUG 1: [4] Reading input file:
../data/sample_obs/ST2ml/ST2ml2005080709.Grb_G212
DEBUG 1: [5] Reading input file:
../data/sample_obs/ST2ml/ST2ml2005080708.Grb_G212
DEBUG 1: [6] Reading input file:
../data/sample_obs/ST2ml/ST2ml2005080707.Grb_G212
DEBUG 1: [7] Reading input file:
../data/sample_obs/ST2ml/ST2ml2005080706.Grb_G212
DEBUG 1: [8] Reading input file:
../data/sample_obs/ST2ml/ST2ml2005080705.Grb_G212
DEBUG 1: [9] Reading input file:
../data/sample_obs/ST2ml/ST2ml2005080704.Grb_G212
DEBUG 1: [10] Reading input file:
../data/sample_obs/ST2ml/ST2ml2005080703.Grb_G212
DEBUG 1: [11] Reading input file:
../data/sample_obs/ST2ml/ST2ml2005080702.Grb_G212
DEBUG 1: [12] Reading input file:
../data/sample_obs/ST2ml/ST2ml2005080701.Grb_G212
DEBUG 1: Writing output file:
../out/pcp_combine/sample_obs_2005080712V_12A.nc
*** Running PCP-Combine to combine 1-hourly APCP accumulation
observations into a single 12 hour accumulation observation ***
DEBUG 1: [1] File ../data/sample_obs/ST2ml/ST2ml2005080800.Grb_G212
matches valid time of 20050808_000000
DEBUG 1: [2] File ../data/sample_obs/ST2ml/ST2ml2005080723.Grb_G212
matches valid time of 20050807_230000
DEBUG 1: [3] File ../data/sample_obs/ST2ml/ST2ml2005080722.Grb_G212
matches valid time of 20050807_220000
DEBUG 1: [4] File ../data/sample_obs/ST2ml/ST2ml2005080721.Grb_G212
matches valid time of 20050807_210000
DEBUG 1: [5] File ../data/sample_obs/ST2ml/ST2ml2005080720.Grb_G212
matches valid time of 20050807_200000
DEBUG 1: [6] File ../data/sample_obs/ST2ml/ST2ml2005080719.Grb_G212
matches valid time of 20050807_190000
DEBUG 1: [7] File ../data/sample_obs/ST2ml/ST2ml2005080718.Grb_G212
matches valid time of 20050807_180000
DEBUG 1: [8] File ../data/sample_obs/ST2ml/ST2ml2005080717.Grb_G212
matches valid time of 20050807_170000
DEBUG 1: [9] File ../data/sample_obs/ST2ml/ST2ml2005080716.Grb_G212
matches valid time of 20050807_160000
DEBUG 1: [10] File ../data/sample_obs/ST2ml/ST2ml2005080715.Grb_G212
matches valid time of 20050807_150000
DEBUG 1: [11] File ../data/sample_obs/ST2ml/ST2ml2005080714.Grb_G212
matches valid time of 20050807_140000
DEBUG 1: [12] File ../data/sample_obs/ST2ml/ST2ml2005080713.Grb_G212
matches valid time of 20050807_130000
DEBUG 1: [1] Reading input file:
../data/sample_obs/ST2ml/ST2ml2005080800.Grb_G212
DEBUG 1: [2] Reading input file:
../data/sample_obs/ST2ml/ST2ml2005080723.Grb_G212
DEBUG 1: [3] Reading input file:
../data/sample_obs/ST2ml/ST2ml2005080722.Grb_G212
DEBUG 1: [4] Reading input file:
../data/sample_obs/ST2ml/ST2ml2005080721.Grb_G212
DEBUG 1: [5] Reading input file:
../data/sample_obs/ST2ml/ST2ml2005080720.Grb_G212
DEBUG 1: [6] Reading input file:
../data/sample_obs/ST2ml/ST2ml2005080719.Grb_G212
DEBUG 1: [7] Reading input file:
../data/sample_obs/ST2ml/ST2ml2005080718.Grb_G212
DEBUG 1: [8] Reading input file:
../data/sample_obs/ST2ml/ST2ml2005080717.Grb_G212
DEBUG 1: [9] Reading input file:
../data/sample_obs/ST2ml/ST2ml2005080716.Grb_G212
DEBUG 1: [10] Reading input file:
../data/sample_obs/ST2ml/ST2ml2005080715.Grb_G212
DEBUG 1: [11] Reading input file:
../data/sample_obs/ST2ml/ST2ml2005080714.Grb_G212
DEBUG 1: [12] Reading input file:
../data/sample_obs/ST2ml/ST2ml2005080713.Grb_G212
DEBUG 1: Writing output file:
../out/pcp_combine/sample_obs_2005080800V_12A.nc
*** Running PCP-Combine to combine 1-hourly APCP accumulation
observations into a single 24 hour accumulation observation ***
DEBUG 1: [1] File ../data/sample_obs/ST2ml/ST2ml2005080800.Grb_G212
matches valid time of 20050808_000000
DEBUG 1: [2] File ../data/sample_obs/ST2ml/ST2ml2005080723.Grb_G212
matches valid time of 20050807_230000
DEBUG 1: [3] File ../data/sample_obs/ST2ml/ST2ml2005080722.Grb_G212
matches valid time of 20050807_220000
DEBUG 1: [4] File ../data/sample_obs/ST2ml/ST2ml2005080721.Grb_G212
matches valid time of 20050807_210000
DEBUG 1: [5] File ../data/sample_obs/ST2ml/ST2ml2005080720.Grb_G212
matches valid time of 20050807_200000
DEBUG 1: [6] File ../data/sample_obs/ST2ml/ST2ml2005080719.Grb_G212
matches valid time of 20050807_190000
DEBUG 1: [7] File ../data/sample_obs/ST2ml/ST2ml2005080718.Grb_G212
matches valid time of 20050807_180000
DEBUG 1: [8] File ../data/sample_obs/ST2ml/ST2ml2005080717.Grb_G212
matches valid time of 20050807_170000
DEBUG 1: [9] File ../data/sample_obs/ST2ml/ST2ml2005080716.Grb_G212
matches valid time of 20050807_160000
DEBUG 1: [10] File ../data/sample_obs/ST2ml/ST2ml2005080715.Grb_G212
matches valid time of 20050807_150000
DEBUG 1: [11] File ../data/sample_obs/ST2ml/ST2ml2005080714.Grb_G212
matches valid time of 20050807_140000
DEBUG 1: [12] File ../data/sample_obs/ST2ml/ST2ml2005080713.Grb_G212
matches valid time of 20050807_130000
DEBUG 1: [13] File ../data/sample_obs/ST2ml/ST2ml2005080712.Grb_G212
matches valid time of 20050807_120000
DEBUG 1: [14] File ../data/sample_obs/ST2ml/ST2ml2005080711.Grb_G212
matches valid time of 20050807_110000
DEBUG 1: [15] File ../data/sample_obs/ST2ml/ST2ml2005080710.Grb_G212
matches valid time of 20050807_100000
DEBUG 1: [16] File ../data/sample_obs/ST2ml/ST2ml2005080709.Grb_G212
matches valid time of 20050807_090000
DEBUG 1: [17] File ../data/sample_obs/ST2ml/ST2ml2005080708.Grb_G212
matches valid time of 20050807_080000
DEBUG 1: [18] File ../data/sample_obs/ST2ml/ST2ml2005080707.Grb_G212
matches valid time of 20050807_070000
DEBUG 1: [19] File ../data/sample_obs/ST2ml/ST2ml2005080706.Grb_G212
matches valid time of 20050807_060000
DEBUG 1: [20] File ../data/sample_obs/ST2ml/ST2ml2005080705.Grb_G212
matches valid time of 20050807_050000
DEBUG 1: [21] File ../data/sample_obs/ST2ml/ST2ml2005080704.Grb_G212
matches valid time of 20050807_040000
DEBUG 1: [22] File ../data/sample_obs/ST2ml/ST2ml2005080703.Grb_G212
matches valid time of 20050807_030000
DEBUG 1: [23] File ../data/sample_obs/ST2ml/ST2ml2005080702.Grb_G212
matches valid time of 20050807_020000
DEBUG 1: [24] File ../data/sample_obs/ST2ml/ST2ml2005080701.Grb_G212
matches valid time of 20050807_010000
DEBUG 1: [1] Reading input file:
../data/sample_obs/ST2ml/ST2ml2005080800.Grb_G212
DEBUG 1: [2] Reading input file:
../data/sample_obs/ST2ml/ST2ml2005080723.Grb_G212
DEBUG 1: [3] Reading input file:
../data/sample_obs/ST2ml/ST2ml2005080722.Grb_G212
DEBUG 1: [4] Reading input file:
../data/sample_obs/ST2ml/ST2ml2005080721.Grb_G212
DEBUG 1: [5] Reading input file:
../data/sample_obs/ST2ml/ST2ml2005080720.Grb_G212
DEBUG 1: [6] Reading input file:
../data/sample_obs/ST2ml/ST2ml2005080719.Grb_G212
DEBUG 1: [7] Reading input file:
../data/sample_obs/ST2ml/ST2ml2005080718.Grb_G212
DEBUG 1: [8] Reading input file:
../data/sample_obs/ST2ml/ST2ml2005080717.Grb_G212
DEBUG 1: [9] Reading input file:
../data/sample_obs/ST2ml/ST2ml2005080716.Grb_G212
DEBUG 1: [10] Reading input file:
../data/sample_obs/ST2ml/ST2ml2005080715.Grb_G212
DEBUG 1: [11] Reading input file:
../data/sample_obs/ST2ml/ST2ml2005080714.Grb_G212
DEBUG 1: [12] Reading input file:
../data/sample_obs/ST2ml/ST2ml2005080713.Grb_G212
DEBUG 1: [13] Reading input file:
../data/sample_obs/ST2ml/ST2ml2005080712.Grb_G212
DEBUG 1: [14] Reading input file:
../data/sample_obs/ST2ml/ST2ml2005080711.Grb_G212
DEBUG 1: [15] Reading input file:
../data/sample_obs/ST2ml/ST2ml2005080710.Grb_G212
DEBUG 1: [16] Reading input file:
../data/sample_obs/ST2ml/ST2ml2005080709.Grb_G212
DEBUG 1: [17] Reading input file:
../data/sample_obs/ST2ml/ST2ml2005080708.Grb_G212
DEBUG 1: [18] Reading input file:
../data/sample_obs/ST2ml/ST2ml2005080707.Grb_G212
DEBUG 1: [19] Reading input file:
../data/sample_obs/ST2ml/ST2ml2005080706.Grb_G212
DEBUG 1: [20] Reading input file:
../data/sample_obs/ST2ml/ST2ml2005080705.Grb_G212
DEBUG 1: [21] Reading input file:
../data/sample_obs/ST2ml/ST2ml2005080704.Grb_G212
DEBUG 1: [22] Reading input file:
../data/sample_obs/ST2ml/ST2ml2005080703.Grb_G212
DEBUG 1: [23] Reading input file:
../data/sample_obs/ST2ml/ST2ml2005080702.Grb_G212
DEBUG 1: [24] Reading input file:
../data/sample_obs/ST2ml/ST2ml2005080701.Grb_G212
DEBUG 1: Writing output file:
../out/pcp_combine/sample_obs_2005080800V_24A.nc
*** Testing MODE application ***
*** Running MODE on APCP using netCDF input for both forecast and
observation ***
DEBUG 1: Default Config File: /work/apps/pgi_14.10/met-
5.1/share/met/config/MODEConfig_default
DEBUG 1: Match Config File: config/MODEConfig_APCP_12
DEBUG 1: Merge Config File: config/MODEConfig_APCP_12
DEBUG 1: Forecast File:
../out/pcp_combine/sample_fcst_12L_2005080712V_12A.nc
DEBUG 1: Observation File:
../out/pcp_combine/sample_obs_2005080712V_12A.nc
DEBUG 1: Forecast Field: APCP_12 at A12
DEBUG 1: Observation Field: APCP_12 at A12
DEBUG 2: Identifying objects in the forecast and observation fields...
DEBUG 2: Computing contingency table statistics...
DEBUG 2: Identified: 7 forecast objects and 4 observation objects.
DEBUG 2: Performing merging (THRESH) in the forecast field.
DEBUG 2: Performing merging (THRESH) in the observation field.
DEBUG 2: Remaining: 7 forecast objects and 4 observation objects.
DEBUG 2: Performing matching (MERGE_BOTH) between the forecast and
observation fields.
DEBUG 1: Creating Fcst-Obs Object Statistics file:
../out/mode/mode_120000L_20050807_120000V_120000A_obj.txt
DEBUG 1: Creating Contingency Table Statistics file:
../out/mode/mode_120000L_20050807_120000V_120000A_cts.txt
DEBUG 1: Creating Object NetCDF file:
../out/mode/mode_120000L_20050807_120000V_120000A_obj.nc
DEBUG 1: Loading forecast raw color table: /work/apps/pgi_14.10/met-
5.1/share/met/colortables/met_default.ctable
DEBUG 1: Loading observation raw color table:
/work/apps/pgi_14.10/met-5.1/share/met/colortables/met_default.ctable
DEBUG 1: Creating postscript file:
../out/mode/mode_120000L_20050807_120000V_120000A.ps
*** Running MODE on APCP using a GRIB forecast and netCDF observation
***
DEBUG 1: Default Config File: /work/apps/pgi_14.10/met-
5.1/share/met/config/MODEConfig_default
DEBUG 1: Match Config File: config/MODEConfig_APCP_24
DEBUG 1: Merge Config File: config/MODEConfig_APCP_24
DEBUG 1: Forecast File:
../data/sample_fcst/2005080700/wrfprs_ruc13_24.tm00_G212
DEBUG 1: Observation File:
../out/pcp_combine/sample_obs_2005080800V_24A.nc
DEBUG 1: Forecast Field: APCP_24 at A24
DEBUG 1: Observation Field: APCP_24 at A24
DEBUG 2: Identifying objects in the forecast and observation fields...
DEBUG 2: Computing contingency table statistics...
DEBUG 2: Identified: 4 forecast objects and 6 observation objects.
DEBUG 2: Performing merging (NONE) in the forecast field.
DEBUG 2: Performing merging (NONE) in the observation field.
DEBUG 2: Remaining: 4 forecast objects and 6 observation objects.
DEBUG 2: Performing matching (MERGE_BOTH) between the forecast and
observation fields.
DEBUG 1: Creating Fcst-Obs Object Statistics file:
../out/mode/mode_240000L_20050808_000000V_240000A_obj.txt
DEBUG 1: Creating Contingency Table Statistics file:
../out/mode/mode_240000L_20050808_000000V_240000A_cts.txt
DEBUG 1: Creating Object NetCDF file:
../out/mode/mode_240000L_20050808_000000V_240000A_obj.nc
DEBUG 1: Loading forecast raw color table: /work/apps/pgi_14.10/met-
5.1/share/met/colortables/met_default.ctable
DEBUG 1: Loading observation raw color table:
/work/apps/pgi_14.10/met-5.1/share/met/colortables/met_default.ctable
DEBUG 1: Creating postscript file:
../out/mode/mode_240000L_20050808_000000V_240000A.ps
*** Running MODE on RH at 500mb using GRIB input for both forecast and
observation ***
DEBUG 1: Default Config File: /work/apps/pgi_14.10/met-
5.1/share/met/config/MODEConfig_default
DEBUG 1: Match Config File: config/MODEConfig_RH
DEBUG 1: Merge Config File: config/MODEConfig_RH
DEBUG 1: Forecast File:
../data/sample_fcst/2005080700/wrfprs_ruc13_12.tm00_G212
DEBUG 1: Observation File:
../data/sample_fcst/2005080712/wrfprs_ruc13_00.tm00_G212
DEBUG 1: Forecast Field: RH at P500
DEBUG 1: Observation Field: RH at P500
DEBUG 2: Identifying objects in the forecast and observation fields...
DEBUG 2: Computing contingency table statistics...
DEBUG 2: Identified: 8 forecast objects and 12 observation objects.
DEBUG 2: Performing merging (NONE) in the forecast field.
DEBUG 2: Performing merging (NONE) in the observation field.
DEBUG 2: Remaining: 8 forecast objects and 12 observation objects.
DEBUG 2: Performing matching (MERGE_BOTH) between the forecast and
observation fields.
DEBUG 1: Creating Fcst-Obs Object Statistics file:
../out/mode/mode_120000L_20050807_120000V_000000A_obj.txt
DEBUG 1: Creating Contingency Table Statistics file:
../out/mode/mode_120000L_20050807_120000V_000000A_cts.txt
DEBUG 1: Creating Object NetCDF file:
../out/mode/mode_120000L_20050807_120000V_000000A_obj.nc
DEBUG 1: Loading forecast raw color table: /work/apps/pgi_14.10/met-
5.1/share/met/colortables/mode_raw.ctable
DEBUG 1: Loading observation raw color table:
/work/apps/pgi_14.10/met-5.1/share/met/colortables/mode_raw.ctable
DEBUG 1: Creating postscript file:
../out/mode/mode_120000L_20050807_120000V_000000A.ps
*** Testing Grid-Stat application ***
*** Running Grid-Stat on APCP using netCDF input for both forecast and
observation ***
DEBUG 1: Default Config File: /work/apps/pgi_14.10/met-
5.1/share/met/config/GridStatConfig_default
DEBUG 1: User Config File: config/GridStatConfig_APCP_12
GSL_RNG_TYPE=mt19937
GSL_RNG_SEED=1
DEBUG 1: Forecast File:
../out/pcp_combine/sample_fcst_12L_2005080712V_12A.nc
DEBUG 1: Observation File:
../out/pcp_combine/sample_obs_2005080712V_12A.nc
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Processing APCP_12(*,*) versus APCP_12(*,*), for
interpolation method NEAREST(1), over region DTC165, using 2651 pairs.
DEBUG 2: Computing Categorical Statistics.
DEBUG 2: Computing Continuous Statistics.
DEBUG 2: Computing Scalar Partial Sums.
DEBUG 2: Processing APCP_12(*,*) versus APCP_12(*,*), for
interpolation method NEAREST(1), over region DTC166, using 3804 pairs.
DEBUG 2: Computing Categorical Statistics.
DEBUG 2: Computing Continuous Statistics.
DEBUG 2: Computing Scalar Partial Sums.
DEBUG 2: Processing APCP_12(*,*) versus APCP_12(*,*), for
interpolation method NEAREST(1), over region CONUS, using 5414 pairs.
DEBUG 2: Computing Categorical Statistics.
DEBUG 2: Computing Continuous Statistics.
DEBUG 2: Computing Scalar Partial Sums.
DEBUG 2: Processing APCP_12(*,*) versus APCP_12(*,*), for
interpolation method NEAREST(1), over region LMV, using 524 pairs.
DEBUG 2: Computing Categorical Statistics.
DEBUG 2: Computing Continuous Statistics.
DEBUG 2: Computing Scalar Partial Sums.
DEBUG 2: Processing APCP_12(*,*) versus APCP_12(*,*), for
interpolation method NBRHD(9), raw thresholds of >0.0 and >0.0, over
region LMV, using 2361 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing APCP_12(*,*) versus APCP_12(*,*), for
interpolation method NBRHD(9), raw thresholds of >0.0 and >0.0, over
region DTC165, using 3498 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing APCP_12(*,*) versus APCP_12(*,*), for
interpolation method NBRHD(9), raw thresholds of >0.0 and >0.0, over
region DTC166, using 5276 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing APCP_12(*,*) versus APCP_12(*,*), for
interpolation method NBRHD(9), raw thresholds of >0.0 and >0.0, over
region CONUS, using 524 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing APCP_12(*,*) versus APCP_12(*,*), for
interpolation method NBRHD(9), raw thresholds of >=5.0 and >=5.0, over
region LMV, using 2361 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing APCP_12(*,*) versus APCP_12(*,*), for
interpolation method NBRHD(9), raw thresholds of >=5.0 and >=5.0, over
region DTC165, using 3498 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing APCP_12(*,*) versus APCP_12(*,*), for
interpolation method NBRHD(9), raw thresholds of >=5.0 and >=5.0, over
region DTC166, using 5276 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing APCP_12(*,*) versus APCP_12(*,*), for
interpolation method NBRHD(9), raw thresholds of >=5.0 and >=5.0, over
region CONUS, using 524 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing APCP_12(*,*) versus APCP_12(*,*), for
interpolation method NBRHD(25), raw thresholds of >0.0 and >0.0, over
region LMV, using 2071 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing APCP_12(*,*) versus APCP_12(*,*), for
interpolation method NBRHD(25), raw thresholds of >0.0 and >0.0, over
region DTC165, using 3205 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing APCP_12(*,*) versus APCP_12(*,*), for
interpolation method NBRHD(25), raw thresholds of >0.0 and >0.0, over
region DTC166, using 5025 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing APCP_12(*,*) versus APCP_12(*,*), for
interpolation method NBRHD(25), raw thresholds of >0.0 and >0.0, over
region CONUS, using 524 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing APCP_12(*,*) versus APCP_12(*,*), for
interpolation method NBRHD(25), raw thresholds of >=5.0 and >=5.0,
over region LMV, using 2071 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing APCP_12(*,*) versus APCP_12(*,*), for
interpolation method NBRHD(25), raw thresholds of >=5.0 and >=5.0,
over region DTC165, using 3205 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing APCP_12(*,*) versus APCP_12(*,*), for
interpolation method NBRHD(25), raw thresholds of >=5.0 and >=5.0,
over region DTC166, using 5025 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing APCP_12(*,*) versus APCP_12(*,*), for
interpolation method NBRHD(25), raw thresholds of >=5.0 and >=5.0,
over region CONUS, using 524 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 1: Output file:
../out/grid_stat/grid_stat_APCP_12_120000L_20050807_120000V.stat
DEBUG 1: Output file:
../out/grid_stat/grid_stat_APCP_12_120000L_20050807_120000V_fho.txt
DEBUG 1: Output file:
../out/grid_stat/grid_stat_APCP_12_120000L_20050807_120000V_ctc.txt
DEBUG 1: Output file:
../out/grid_stat/grid_stat_APCP_12_120000L_20050807_120000V_cts.txt
DEBUG 1: Output file:
../out/grid_stat/grid_stat_APCP_12_120000L_20050807_120000V_cnt.txt
DEBUG 1: Output file:
../out/grid_stat/grid_stat_APCP_12_120000L_20050807_120000V_sl1l2.txt
DEBUG 1: Output file:
../out/grid_stat/grid_stat_APCP_12_120000L_20050807_120000V_vl1l2.txt
DEBUG 1: Output file:
../out/grid_stat/grid_stat_APCP_12_120000L_20050807_120000V_nbrctc.txt
DEBUG 1: Output file:
../out/grid_stat/grid_stat_APCP_12_120000L_20050807_120000V_nbrcts.txt
DEBUG 1: Output file:
../out/grid_stat/grid_stat_APCP_12_120000L_20050807_120000V_nbrcnt.txt
DEBUG 1: Output file:
../out/grid_stat/grid_stat_APCP_12_120000L_20050807_120000V_pairs.nc
*** Running Grid-Stat on POP using a GRIB forecast and netCDF
observation ***
DEBUG 1: Default Config File: /work/apps/pgi_14.10/met-
5.1/share/met/config/GridStatConfig_default
DEBUG 1: User Config File: config/GridStatConfig_POP_12
GSL_RNG_TYPE=mt19937
GSL_RNG_SEED=1
DEBUG 1: Forecast File:
../data/sample_fcst/2005080312/pop5km_2005080312F096.grib_G212
DEBUG 1: Observation File:
../out/pcp_combine/sample_obs_2005080800V_12A.nc
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Processing POP/L0 versus APCP_12(*,*), for interpolation
method NEAREST(1), over region DTC165, using 2698 pairs.
DEBUG 2: Computing Probabilistic Statistics.
DEBUG 2: Processing POP/L0 versus APCP_12(*,*), for interpolation
method NEAREST(1), over region DTC166, using 3807 pairs.
DEBUG 2: Computing Probabilistic Statistics.
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 1: Output file:
../out/grid_stat/grid_stat_POP_12_1080000L_20050808_000000V.stat
DEBUG 1: Output file:
../out/grid_stat/grid_stat_POP_12_1080000L_20050808_000000V_pct.txt
DEBUG 1: Output file:
../out/grid_stat/grid_stat_POP_12_1080000L_20050808_000000V_pstd.txt
DEBUG 1: Output file:
../out/grid_stat/grid_stat_POP_12_1080000L_20050808_000000V_pjc.txt
DEBUG 1: Output file:
../out/grid_stat/grid_stat_POP_12_1080000L_20050808_000000V_prc.txt
DEBUG 1: Output file:
../out/grid_stat/grid_stat_POP_12_1080000L_20050808_000000V_pairs.nc
*** Running Grid-Stat on APCP using a GRIB forecast and netCDF
observation ***
DEBUG 1: Default Config File: /work/apps/pgi_14.10/met-
5.1/share/met/config/GridStatConfig_default
DEBUG 1: User Config File: config/GridStatConfig_APCP_24
GSL_RNG_TYPE=mt19937
GSL_RNG_SEED=1
DEBUG 1: Forecast File:
../data/sample_fcst/2005080700/wrfprs_ruc13_24.tm00_G212
DEBUG 1: Observation File:
../out/pcp_combine/sample_obs_2005080800V_24A.nc
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Processing APCP/A24 versus APCP_24(*,*), for interpolation
method NEAREST(1), over region DTC165, using 2646 pairs.
DEBUG 2: Computing Categorical Statistics.
DEBUG 2: Computing Multi-Category Statistics.
DEBUG 2: Computing Continuous Statistics.
DEBUG 2: Computing Scalar Partial Sums.
DEBUG 2: Processing APCP/A24 versus APCP_24(*,*), for interpolation
method NEAREST(1), over region DTC166, using 3761 pairs.
DEBUG 2: Computing Categorical Statistics.
DEBUG 2: Computing Multi-Category Statistics.
DEBUG 2: Computing Continuous Statistics.
DEBUG 2: Computing Scalar Partial Sums.
DEBUG 2: Processing APCP/A24 versus APCP_24(*,*), for interpolation
method NEAREST(1), over region CONUS, using 5414 pairs.
DEBUG 2: Computing Categorical Statistics.
DEBUG 2: Computing Multi-Category Statistics.
DEBUG 2: Computing Continuous Statistics.
DEBUG 2: Computing Scalar Partial Sums.
DEBUG 2: Processing APCP/A24 versus APCP_24(*,*), for interpolation
method NEAREST(1), over region LMV, using 524 pairs.
DEBUG 2: Computing Categorical Statistics.
DEBUG 2: Computing Multi-Category Statistics.
DEBUG 2: Computing Continuous Statistics.
DEBUG 2: Computing Scalar Partial Sums.
DEBUG 2: Processing APCP/A24 versus APCP_24(*,*), for interpolation
method NBRHD(9), raw thresholds of >0.0 and >0.0, over region LMV,
using 2361 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing APCP/A24 versus APCP_24(*,*), for interpolation
method NBRHD(9), raw thresholds of >0.0 and >0.0, over region DTC165,
using 3463 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing APCP/A24 versus APCP_24(*,*), for interpolation
method NBRHD(9), raw thresholds of >0.0 and >0.0, over region DTC166,
using 5273 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing APCP/A24 versus APCP_24(*,*), for interpolation
method NBRHD(9), raw thresholds of >0.0 and >0.0, over region CONUS,
using 524 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing APCP/A24 versus APCP_24(*,*), for interpolation
method NBRHD(9), raw thresholds of >5.0 and >5.0, over region LMV,
using 2361 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing APCP/A24 versus APCP_24(*,*), for interpolation
method NBRHD(9), raw thresholds of >5.0 and >5.0, over region DTC165,
using 3463 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing APCP/A24 versus APCP_24(*,*), for interpolation
method NBRHD(9), raw thresholds of >5.0 and >5.0, over region DTC166,
using 5273 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing APCP/A24 versus APCP_24(*,*), for interpolation
method NBRHD(9), raw thresholds of >5.0 and >5.0, over region CONUS,
using 524 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing APCP/A24 versus APCP_24(*,*), for interpolation
method NBRHD(9), raw thresholds of >10.0 and >10.0, over region LMV,
using 2361 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing APCP/A24 versus APCP_24(*,*), for interpolation
method NBRHD(9), raw thresholds of >10.0 and >10.0, over region
DTC165, using 3463 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing APCP/A24 versus APCP_24(*,*), for interpolation
method NBRHD(9), raw thresholds of >10.0 and >10.0, over region
DTC166, using 5273 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing APCP/A24 versus APCP_24(*,*), for interpolation
method NBRHD(9), raw thresholds of >10.0 and >10.0, over region CONUS,
using 524 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing APCP/A24 versus APCP_24(*,*), for interpolation
method NBRHD(25), raw thresholds of >0.0 and >0.0, over region LMV,
using 2071 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing APCP/A24 versus APCP_24(*,*), for interpolation
method NBRHD(25), raw thresholds of >0.0 and >0.0, over region DTC165,
using 3178 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing APCP/A24 versus APCP_24(*,*), for interpolation
method NBRHD(25), raw thresholds of >0.0 and >0.0, over region DTC166,
using 5017 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing APCP/A24 versus APCP_24(*,*), for interpolation
method NBRHD(25), raw thresholds of >0.0 and >0.0, over region CONUS,
using 524 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing APCP/A24 versus APCP_24(*,*), for interpolation
method NBRHD(25), raw thresholds of >5.0 and >5.0, over region LMV,
using 2071 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing APCP/A24 versus APCP_24(*,*), for interpolation
method NBRHD(25), raw thresholds of >5.0 and >5.0, over region DTC165,
using 3178 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing APCP/A24 versus APCP_24(*,*), for interpolation
method NBRHD(25), raw thresholds of >5.0 and >5.0, over region DTC166,
using 5017 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing APCP/A24 versus APCP_24(*,*), for interpolation
method NBRHD(25), raw thresholds of >5.0 and >5.0, over region CONUS,
using 524 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing APCP/A24 versus APCP_24(*,*), for interpolation
method NBRHD(25), raw thresholds of >10.0 and >10.0, over region LMV,
using 2071 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing APCP/A24 versus APCP_24(*,*), for interpolation
method NBRHD(25), raw thresholds of >10.0 and >10.0, over region
DTC165, using 3178 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing APCP/A24 versus APCP_24(*,*), for interpolation
method NBRHD(25), raw thresholds of >10.0 and >10.0, over region
DTC166, using 5017 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing APCP/A24 versus APCP_24(*,*), for interpolation
method NBRHD(25), raw thresholds of >10.0 and >10.0, over region
CONUS, using 524 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 1: Output file:
../out/grid_stat/grid_stat_APCP_24_240000L_20050808_000000V.stat
DEBUG 1: Output file:
../out/grid_stat/grid_stat_APCP_24_240000L_20050808_000000V_fho.txt
DEBUG 1: Output file:
../out/grid_stat/grid_stat_APCP_24_240000L_20050808_000000V_ctc.txt
DEBUG 1: Output file:
../out/grid_stat/grid_stat_APCP_24_240000L_20050808_000000V_cts.txt
DEBUG 1: Output file:
../out/grid_stat/grid_stat_APCP_24_240000L_20050808_000000V_mctc.txt
DEBUG 1: Output file:
../out/grid_stat/grid_stat_APCP_24_240000L_20050808_000000V_mcts.txt
DEBUG 1: Output file:
../out/grid_stat/grid_stat_APCP_24_240000L_20050808_000000V_cnt.txt
DEBUG 1: Output file:
../out/grid_stat/grid_stat_APCP_24_240000L_20050808_000000V_sl1l2.txt
DEBUG 1: Output file:
../out/grid_stat/grid_stat_APCP_24_240000L_20050808_000000V_vl1l2.txt
DEBUG 1: Output file:
../out/grid_stat/grid_stat_APCP_24_240000L_20050808_000000V_nbrctc.txt
DEBUG 1: Output file:
../out/grid_stat/grid_stat_APCP_24_240000L_20050808_000000V_nbrcts.txt
DEBUG 1: Output file:
../out/grid_stat/grid_stat_APCP_24_240000L_20050808_000000V_nbrcnt.txt
DEBUG 1: Output file:
../out/grid_stat/grid_stat_APCP_24_240000L_20050808_000000V_pairs.nc
*** Running Grid-Stat using GRIB input for both forecast and
observation ***
DEBUG 1: Default Config File: /work/apps/pgi_14.10/met-
5.1/share/met/config/GridStatConfig_default
DEBUG 1: User Config File: config/GridStatConfig_all
GSL_RNG_TYPE=mt19937
GSL_RNG_SEED=1
DEBUG 1: Forecast File:
../data/sample_fcst/2005080700/wrfprs_ruc13_12.tm00_G212
DEBUG 1: Observation File:
../data/sample_fcst/2005080712/wrfprs_ruc13_00.tm00_G212
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Processing TMP/Z2 versus TMP/Z2, for interpolation method
NEAREST(1), over region DTC165, using 5558 pairs.
DEBUG 2: Computing Categorical Statistics.
DEBUG 2: Computing Continuous Statistics.
DEBUG 2: Computing Scalar Partial Sums.
DEBUG 2: Processing TMP/Z2 versus TMP/Z2, for interpolation method
NEAREST(1), over region DTC166, using 6862 pairs.
DEBUG 2: Computing Categorical Statistics.
DEBUG 2: Computing Continuous Statistics.
DEBUG 2: Computing Scalar Partial Sums.
DEBUG 2: Processing TMP/Z2 versus TMP/Z2, for interpolation method
NEAREST(1), over region CONUS, using 5479 pairs.
DEBUG 2: Computing Categorical Statistics.
DEBUG 2: Computing Continuous Statistics.
DEBUG 2: Computing Scalar Partial Sums.
DEBUG 2: Processing TMP/Z2 versus TMP/Z2, for interpolation method
NEAREST(1), over region LMV, using 524 pairs.
DEBUG 2: Computing Categorical Statistics.
DEBUG 2: Computing Continuous Statistics.
DEBUG 2: Computing Scalar Partial Sums.
DEBUG 2: Processing TMP/Z2 versus TMP/Z2, for interpolation method
NBRHD(9), raw thresholds of <300 and <300, over region LMV, using 5558
pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing TMP/Z2 versus TMP/Z2, for interpolation method
NBRHD(9), raw thresholds of <300 and <300, over region DTC165, using
6862 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing TMP/Z2 versus TMP/Z2, for interpolation method
NBRHD(9), raw thresholds of <300 and <300, over region DTC166, using
5479 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing TMP/Z2 versus TMP/Z2, for interpolation method
NBRHD(9), raw thresholds of <300 and <300, over region CONUS, using
524 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing TMP/Z2 versus TMP/Z2, for interpolation method
NBRHD(9), raw thresholds of >=300 and >=300, over region LMV, using
5558 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing TMP/Z2 versus TMP/Z2, for interpolation method
NBRHD(9), raw thresholds of >=300 and >=300, over region DTC165, using
6862 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing TMP/Z2 versus TMP/Z2, for interpolation method
NBRHD(9), raw thresholds of >=300 and >=300, over region DTC166, using
5479 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing TMP/Z2 versus TMP/Z2, for interpolation method
NBRHD(9), raw thresholds of >=300 and >=300, over region CONUS, using
524 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing TMP/Z2 versus TMP/Z2, for interpolation method
NBRHD(25), raw thresholds of <300 and <300, over region LMV, using
5558 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing TMP/Z2 versus TMP/Z2, for interpolation method
NBRHD(25), raw thresholds of <300 and <300, over region DTC165, using
6862 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing TMP/Z2 versus TMP/Z2, for interpolation method
NBRHD(25), raw thresholds of <300 and <300, over region DTC166, using
5479 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing TMP/Z2 versus TMP/Z2, for interpolation method
NBRHD(25), raw thresholds of <300 and <300, over region CONUS, using
524 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing TMP/Z2 versus TMP/Z2, for interpolation method
NBRHD(25), raw thresholds of >=300 and >=300, over region LMV, using
5558 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing TMP/Z2 versus TMP/Z2, for interpolation method
NBRHD(25), raw thresholds of >=300 and >=300, over region DTC165,
using 6862 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing TMP/Z2 versus TMP/Z2, for interpolation method
NBRHD(25), raw thresholds of >=300 and >=300, over region DTC166,
using 5479 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing TMP/Z2 versus TMP/Z2, for interpolation method
NBRHD(25), raw thresholds of >=300 and >=300, over region CONUS, using
524 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Processing RH/Z2 versus RH/Z2, for interpolation method
NEAREST(1), over region DTC165, using 5558 pairs.
DEBUG 2: Computing Categorical Statistics.
DEBUG 2: Computing Continuous Statistics.
DEBUG 2: Computing Scalar Partial Sums.
DEBUG 2: Processing RH/Z2 versus RH/Z2, for interpolation method
NEAREST(1), over region DTC166, using 6862 pairs.
DEBUG 2: Computing Categorical Statistics.
DEBUG 2: Computing Continuous Statistics.
DEBUG 2: Computing Scalar Partial Sums.
DEBUG 2: Processing RH/Z2 versus RH/Z2, for interpolation method
NEAREST(1), over region CONUS, using 5479 pairs.
DEBUG 2: Computing Categorical Statistics.
DEBUG 2: Computing Continuous Statistics.
DEBUG 2: Computing Scalar Partial Sums.
DEBUG 2: Processing RH/Z2 versus RH/Z2, for interpolation method
NEAREST(1), over region LMV, using 524 pairs.
DEBUG 2: Computing Categorical Statistics.
DEBUG 2: Computing Continuous Statistics.
DEBUG 2: Computing Scalar Partial Sums.
DEBUG 2: Processing RH/Z2 versus RH/Z2, for interpolation method
NBRHD(9), raw thresholds of >=80 and >=80, over region LMV, using 5558
pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing RH/Z2 versus RH/Z2, for interpolation method
NBRHD(9), raw thresholds of >=80 and >=80, over region DTC165, using
6862 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing RH/Z2 versus RH/Z2, for interpolation method
NBRHD(9), raw thresholds of >=80 and >=80, over region DTC166, using
5479 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing RH/Z2 versus RH/Z2, for interpolation method
NBRHD(9), raw thresholds of >=80 and >=80, over region CONUS, using
524 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing RH/Z2 versus RH/Z2, for interpolation method
NBRHD(25), raw thresholds of >=80 and >=80, over region LMV, using
5558 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing RH/Z2 versus RH/Z2, for interpolation method
NBRHD(25), raw thresholds of >=80 and >=80, over region DTC165, using
6862 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing RH/Z2 versus RH/Z2, for interpolation method
NBRHD(25), raw thresholds of >=80 and >=80, over region DTC166, using
5479 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing RH/Z2 versus RH/Z2, for interpolation method
NBRHD(25), raw thresholds of >=80 and >=80, over region CONUS, using
524 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Processing UGRD/Z10 versus UGRD/Z10, for interpolation method
NEAREST(1), over region DTC165, using 5558 pairs.
DEBUG 2: Computing Categorical Statistics.
DEBUG 2: Computing Continuous Statistics.
DEBUG 2: Processing UGRD/Z10 versus UGRD/Z10, for interpolation method
NEAREST(1), over region DTC166, using 6862 pairs.
DEBUG 2: Computing Categorical Statistics.
DEBUG 2: Computing Continuous Statistics.
DEBUG 2: Processing UGRD/Z10 versus UGRD/Z10, for interpolation method
NEAREST(1), over region CONUS, using 5479 pairs.
DEBUG 2: Computing Categorical Statistics.
DEBUG 2: Computing Continuous Statistics.
DEBUG 2: Processing UGRD/Z10 versus UGRD/Z10, for interpolation method
NEAREST(1), over region LMV, using 524 pairs.
DEBUG 2: Computing Categorical Statistics.
DEBUG 2: Computing Continuous Statistics.
DEBUG 2: Processing UGRD/Z10 versus UGRD/Z10, for interpolation method
NBRHD(9), raw thresholds of >=2 and >=2, over region LMV, using 5558
pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing UGRD/Z10 versus UGRD/Z10, for interpolation method
NBRHD(9), raw thresholds of >=2 and >=2, over region DTC165, using
6862 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing UGRD/Z10 versus UGRD/Z10, for interpolation method
NBRHD(9), raw thresholds of >=2 and >=2, over region DTC166, using
5479 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing UGRD/Z10 versus UGRD/Z10, for interpolation method
NBRHD(9), raw thresholds of >=2 and >=2, over region CONUS, using 524
pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing UGRD/Z10 versus UGRD/Z10, for interpolation method
NBRHD(9), raw thresholds of >=5 and >=5, over region LMV, using 5558
pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing UGRD/Z10 versus UGRD/Z10, for interpolation method
NBRHD(9), raw thresholds of >=5 and >=5, over region DTC165, using
6862 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing UGRD/Z10 versus UGRD/Z10, for interpolation method
NBRHD(9), raw thresholds of >=5 and >=5, over region DTC166, using
5479 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing UGRD/Z10 versus UGRD/Z10, for interpolation method
NBRHD(9), raw thresholds of >=5 and >=5, over region CONUS, using 524
pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing UGRD/Z10 versus UGRD/Z10, for interpolation method
NBRHD(25), raw thresholds of >=2 and >=2, over region LMV, using 5558
pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing UGRD/Z10 versus UGRD/Z10, for interpolation method
NBRHD(25), raw thresholds of >=2 and >=2, over region DTC165, using
6862 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing UGRD/Z10 versus UGRD/Z10, for interpolation method
NBRHD(25), raw thresholds of >=2 and >=2, over region DTC166, using
5479 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing UGRD/Z10 versus UGRD/Z10, for interpolation method
NBRHD(25), raw thresholds of >=2 and >=2, over region CONUS, using 524
pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing UGRD/Z10 versus UGRD/Z10, for interpolation method
NBRHD(25), raw thresholds of >=5 and >=5, over region LMV, using 5558
pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing UGRD/Z10 versus UGRD/Z10, for interpolation method
NBRHD(25), raw thresholds of >=5 and >=5, over region DTC165, using
6862 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing UGRD/Z10 versus UGRD/Z10, for interpolation method
NBRHD(25), raw thresholds of >=5 and >=5, over region DTC166, using
5479 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing UGRD/Z10 versus UGRD/Z10, for interpolation method
NBRHD(25), raw thresholds of >=5 and >=5, over region CONUS, using 524
pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Processing VGRD/Z10 versus VGRD/Z10, for interpolation method
NEAREST(1), over region DTC165, using 5558 pairs.
DEBUG 2: Computing Categorical Statistics.
DEBUG 2: Computing Continuous Statistics.
DEBUG 2: Processing VGRD/Z10 versus VGRD/Z10, for interpolation method
NEAREST(1), over region DTC166, using 6862 pairs.
DEBUG 2: Computing Categorical Statistics.
DEBUG 2: Computing Continuous Statistics.
DEBUG 2: Processing VGRD/Z10 versus VGRD/Z10, for interpolation method
NEAREST(1), over region CONUS, using 5479 pairs.
DEBUG 2: Computing Categorical Statistics.
DEBUG 2: Computing Continuous Statistics.
DEBUG 2: Processing VGRD/Z10 versus VGRD/Z10, for interpolation method
NEAREST(1), over region LMV, using 524 pairs.
DEBUG 2: Computing Categorical Statistics.
DEBUG 2: Computing Continuous Statistics.
DEBUG 2: Processing VGRD/Z10 versus VGRD/Z10, for interpolation method
NBRHD(9), raw thresholds of >=2 and >=2, over region LMV, using 5558
pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing VGRD/Z10 versus VGRD/Z10, for interpolation method
NBRHD(9), raw thresholds of >=2 and >=2, over region DTC165, using
6862 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing VGRD/Z10 versus VGRD/Z10, for interpolation method
NBRHD(9), raw thresholds of >=2 and >=2, over region DTC166, using
5479 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing VGRD/Z10 versus VGRD/Z10, for interpolation method
NBRHD(9), raw thresholds of >=2 and >=2, over region CONUS, using 524
pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing VGRD/Z10 versus VGRD/Z10, for interpolation method
NBRHD(9), raw thresholds of >=5 and >=5, over region LMV, using 5558
pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing VGRD/Z10 versus VGRD/Z10, for interpolation method
NBRHD(9), raw thresholds of >=5 and >=5, over region DTC165, using
6862 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing VGRD/Z10 versus VGRD/Z10, for interpolation method
NBRHD(9), raw thresholds of >=5 and >=5, over region DTC166, using
5479 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing VGRD/Z10 versus VGRD/Z10, for interpolation method
NBRHD(9), raw thresholds of >=5 and >=5, over region CONUS, using 524
pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing VGRD/Z10 versus VGRD/Z10, for interpolation method
NBRHD(25), raw thresholds of >=2 and >=2, over region LMV, using 5558
pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing VGRD/Z10 versus VGRD/Z10, for interpolation method
NBRHD(25), raw thresholds of >=2 and >=2, over region DTC165, using
6862 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing VGRD/Z10 versus VGRD/Z10, for interpolation method
NBRHD(25), raw thresholds of >=2 and >=2, over region DTC166, using
5479 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing VGRD/Z10 versus VGRD/Z10, for interpolation method
NBRHD(25), raw thresholds of >=2 and >=2, over region CONUS, using 524
pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing VGRD/Z10 versus VGRD/Z10, for interpolation method
NBRHD(25), raw thresholds of >=5 and >=5, over region LMV, using 5558
pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing VGRD/Z10 versus VGRD/Z10, for interpolation method
NBRHD(25), raw thresholds of >=5 and >=5, over region DTC165, using
6862 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing VGRD/Z10 versus VGRD/Z10, for interpolation method
NBRHD(25), raw thresholds of >=5 and >=5, over region DTC166, using
5479 pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2: Processing VGRD/Z10 versus VGRD/Z10, for interpolation method
NBRHD(25), raw thresholds of >=5 and >=5, over region CONUS, using 524
pairs.
DEBUG 2: Computing Neighborhood Categorical Statistics.
DEBUG 2: Computing Neighborhood Continuous Statistics.
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 1: Output file:
../out/grid_stat/grid_stat_120000L_20050807_120000V.stat
DEBUG 1: Output file:
../out/grid_stat/grid_stat_120000L_20050807_120000V_fho.txt
DEBUG 1: Output file:
../out/grid_stat/grid_stat_120000L_20050807_120000V_ctc.txt
DEBUG 1: Output file:
../out/grid_stat/grid_stat_120000L_20050807_120000V_cts.txt
DEBUG 1: Output file:
../out/grid_stat/grid_stat_120000L_20050807_120000V_cnt.txt
DEBUG 1: Output file:
../out/grid_stat/grid_stat_120000L_20050807_120000V_sl1l2.txt
DEBUG 1: Output file:
../out/grid_stat/grid_stat_120000L_20050807_120000V_vl1l2.txt
DEBUG 1: Output file:
../out/grid_stat/grid_stat_120000L_20050807_120000V_nbrctc.txt
DEBUG 1: Output file:
../out/grid_stat/grid_stat_120000L_20050807_120000V_nbrcts.txt
DEBUG 1: Output file:
../out/grid_stat/grid_stat_120000L_20050807_120000V_nbrcnt.txt
DEBUG 1: Output file:
../out/grid_stat/grid_stat_120000L_20050807_120000V_pairs.nc
*** Testing PB2NC application ***
*** Running PB2NC on a PREPBUFR file ***
DEBUG 1: Default Config File: /work/apps/pgi_14.10/met-
5.1/share/met/config/PB2NCConfig_default
DEBUG 1: User Config File: config/PB2NCConfig_G212
DEBUG 1: Creating NetCDF File: ../out/pb2nc/sample_pb.nc
DEBUG 1: Processing PrepBufr File:
../data/sample_obs/prepbufr/ndas.t00z.prepbufr.tm12.20070401.nr
DEBUG 1: Blocking PrepBufr file to: /tmp/tmp_pb2nc_blk_60651_0
WARNING:
WARNING: process_pbfile() -> No PrepBufr messages to process in file:
../data/sample_obs/prepbufr/ndas.t00z.prepbufr.tm12.20070401.nr
WARNING:
ERROR :
ERROR : write_netcdf_hdr_data() -> No PrepBufr messages retained.
Nothing to write.
ERROR :
*** Testing PLOT_POINT_OBS application ***
*** Running PLOT_POINT_OBS on a sample netCDF observation file ***
DEBUG 2: Using default global grid.
DEBUG 1: Opening netCDF file: ../out/pb2nc/sample_pb.nc
ERROR :
ERROR : main() -> trouble opening netCDF file
../out/pb2nc/sample_pb.nc
ERROR :
*** Testing ASCII2NC application ***
*** Running ASCII2NC to reformat ASCII point observations into NetCDF
***
DEBUG 1: Config File: /work/apps/pgi_14.10/met-
5.1/share/met/config/Ascii2NcConfig_default
DEBUG 2: Rejected 0 observations off the masking grid.
DEBUG 2: Rejected 0 observations outside the masking polyline.
DEBUG 2: Processing observations for 5 headers.
DEBUG 1: Creating NetCDF Observation file:
../out/ascii2nc/sample_ascii.nc
DEBUG 2: Finished processing 2140 observations for 5 headers.
*** Running ASCII2NC to reformat ASCII rain gauge observations into
NetCDF ***
DEBUG 1: Config File: /work/apps/pgi_14.10/met-
5.1/share/met/config/Ascii2NcConfig_default
DEBUG 2: Rejected 0 observations off the masking grid.
DEBUG 2: Rejected 0 observations outside the masking polyline.
DEBUG 2: Processing observations for 1836 headers.
DEBUG 1: Creating NetCDF Observation file:
../out/ascii2nc/precip24_2010010112.nc
DEBUG 2: Finished processing 1836 observations for 1836 headers.
*** Testing MADIS2NC application ***
*** Running MADIS2NC to reformat MADIS point observations into NetCDF
***
DEBUG 1: Reading MADIS File:
../data/sample_obs/madis/metar/metar_2012040912_F000.nc
DEBUG 1: Writing MET File: ../out/madis2nc/metar_2012040912_F000.nc
DEBUG 2: Processing METAR recs = 4000
DEBUG 2: Rejected recs based on masking grid = 0
DEBUG 2: Rejected recs based on masking poly = 0
DEBUG 2: Rejected based on fill value = 35746
DEBUG 2: Rejected based on quality control = 0
DEBUG 2: Total observations retained or derived = 27894
*** Testing Point-Stat application ***
*** Running Point-Stat on sample NAM data ***
DEBUG 1: Default Config File: /work/apps/pgi_14.10/met-
5.1/share/met/config/PointStatConfig_default
DEBUG 1: User Config File: config/PointStatConfig
GSL_RNG_TYPE=mt19937
GSL_RNG_SEED=1
DEBUG 1: Forecast File:
../data/sample_fcst/2007033000/nam.t00z.awip1236.tm00.20070330.grb
DEBUG 1: Observation File: ../out/pb2nc/sample_pb.nc
DEBUG 1: Observation File: ../out/ascii2nc/sample_ascii.nc
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Reading data for TMP/P900-750.
DEBUG 2: For TMP/P900-750 found 4 forecast levels and 0 climatology
levels.
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Reading data for UGRD/Z10.
DEBUG 2: For UGRD/Z10 found 1 forecast levels and 0 climatology
levels.
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Reading data for VGRD/Z10.
DEBUG 2: For VGRD/Z10 found 1 forecast levels and 0 climatology
levels.
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
WARNING:
WARNING: process_obs_file() -> can't open observation netCDF file:
../out/pb2nc/sample_pb.nc
WARNING:
DEBUG 2: Searching 2140 observations from 5 messages.
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Processing TMP/P900-750 versus TMP/P900-750, for observation
type ADPUPA, over region DTC165, for interpolation method NEAREST(1),
using 23 pairs.
DEBUG 2: Computing Categorical Statistics.
DEBUG 2: Computing Continuous Statistics.
DEBUG 2: Computing Scalar Partial Sums.
DEBUG 2: Processing TMP/P900-750 versus TMP/P900-750, for observation
type ADPUPA, over region DTC165, for interpolation method MEDIAN(9),
using 23 pairs.
DEBUG 2: Computing Categorical Statistics.
DEBUG 2: Computing Continuous Statistics.
DEBUG 2: Computing Scalar Partial Sums.
DEBUG 2: Processing TMP/P900-750 versus TMP/P900-750, for observation
type ADPUPA, over region DTC165, for interpolation method DW_MEAN(9),
using 23 pairs.
DEBUG 2: Computing Categorical Statistics.
DEBUG 2: Computing Continuous Statistics.
DEBUG 2: Computing Scalar Partial Sums.
DEBUG 2: Processing TMP/P900-750 versus TMP/P900-750, for observation
type ADPUPA, over region DTC166, for interpolation method NEAREST(1),
using 17 pairs.
DEBUG 2: Computing Categorical Statistics.
DEBUG 2: Computing Continuous Statistics.
DEBUG 2: Computing Scalar Partial Sums.
DEBUG 2: Processing TMP/P900-750 versus TMP/P900-750, for observation
type ADPUPA, over region DTC166, for interpolation method MEDIAN(9),
using 17 pairs.
DEBUG 2: Computing Categorical Statistics.
DEBUG 2: Computing Continuous Statistics.
DEBUG 2: Computing Scalar Partial Sums.
DEBUG 2: Processing TMP/P900-750 versus TMP/P900-750, for observation
type ADPUPA, over region DTC166, for interpolation method DW_MEAN(9),
using 17 pairs.
DEBUG 2: Computing Categorical Statistics.
DEBUG 2: Computing Continuous Statistics.
DEBUG 2: Computing Scalar Partial Sums.
DEBUG 2: Processing TMP/P900-750 versus TMP/P900-750, for observation
type ADPUPA, over region LMV, for interpolation method NEAREST(1),
using 0 pairs.
DEBUG 2: Processing TMP/P900-750 versus TMP/P900-750, for observation
type ADPUPA, over region LMV, for interpolation method MEDIAN(9),
using 0 pairs.
DEBUG 2: Processing TMP/P900-750 versus TMP/P900-750, for observation
type ADPUPA, over region LMV, for interpolation method DW_MEAN(9),
using 0 pairs.
DEBUG 2: Processing TMP/P900-750 versus TMP/P900-750, for observation
type ADPSFC, over region DTC165, for interpolation method NEAREST(1),
using 0 pairs.
DEBUG 2: Processing TMP/P900-750 versus TMP/P900-750, for observation
type ADPSFC, over region DTC165, for interpolation method MEDIAN(9),
using 0 pairs.
DEBUG 2: Processing TMP/P900-750 versus TMP/P900-750, for observation
type ADPSFC, over region DTC165, for interpolation method DW_MEAN(9),
using 0 pairs.
DEBUG 2: Processing TMP/P900-750 versus TMP/P900-750, for observation
type ADPSFC, over region DTC166, for interpolation method NEAREST(1),
using 0 pairs.
DEBUG 2: Processing TMP/P900-750 versus TMP/P900-750, for observation
type ADPSFC, over region DTC166, for interpolation method MEDIAN(9),
using 0 pairs.
DEBUG 2: Processing TMP/P900-750 versus TMP/P900-750, for observation
type ADPSFC, over region DTC166, for interpolation method DW_MEAN(9),
using 0 pairs.
DEBUG 2: Processing TMP/P900-750 versus TMP/P900-750, for observation
type ADPSFC, over region LMV, for interpolation method NEAREST(1),
using 0 pairs.
DEBUG 2: Processing TMP/P900-750 versus TMP/P900-750, for observation
type ADPSFC, over region LMV, for interpolation method MEDIAN(9),
using 0 pairs.
DEBUG 2: Processing TMP/P900-750 versus TMP/P900-750, for observation
type ADPSFC, over region LMV, for interpolation method DW_MEAN(9),
using 0 pairs.
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Processing UGRD/Z10 versus UGRD/Z10, for observation type
ADPUPA, over region DTC165, for interpolation method NEAREST(1), using
0 pairs.
DEBUG 2: Processing UGRD/Z10 versus UGRD/Z10, for observation type
ADPUPA, over region DTC165, for interpolation method MEDIAN(9), using
0 pairs.
DEBUG 2: Processing UGRD/Z10 versus UGRD/Z10, for observation type
ADPUPA, over region DTC165, for interpolation method DW_MEAN(9), using
0 pairs.
DEBUG 2: Processing UGRD/Z10 versus UGRD/Z10, for observation type
ADPUPA, over region DTC166, for interpolation method NEAREST(1), using
0 pairs.
DEBUG 2: Processing UGRD/Z10 versus UGRD/Z10, for observation type
ADPUPA, over region DTC166, for interpolation method MEDIAN(9), using
0 pairs.
DEBUG 2: Processing UGRD/Z10 versus UGRD/Z10, for observation type
ADPUPA, over region DTC166, for interpolation method DW_MEAN(9), using
0 pairs.
DEBUG 2: Processing UGRD/Z10 versus UGRD/Z10, for observation type
ADPUPA, over region LMV, for interpolation method NEAREST(1), using 0
pairs.
DEBUG 2: Processing UGRD/Z10 versus UGRD/Z10, for observation type
ADPUPA, over region LMV, for interpolation method MEDIAN(9), using 0
pairs.
DEBUG 2: Processing UGRD/Z10 versus UGRD/Z10, for observation type
ADPUPA, over region LMV, for interpolation method DW_MEAN(9), using 0
pairs.
DEBUG 2: Processing UGRD/Z10 versus UGRD/Z10, for observation type
ADPSFC, over region DTC165, for interpolation method NEAREST(1), using
0 pairs.
DEBUG 2: Processing UGRD/Z10 versus UGRD/Z10, for observation type
ADPSFC, over region DTC165, for interpolation method MEDIAN(9), using
0 pairs.
DEBUG 2: Processing UGRD/Z10 versus UGRD/Z10, for observation type
ADPSFC, over region DTC165, for interpolation method DW_MEAN(9), using
0 pairs.
DEBUG 2: Processing UGRD/Z10 versus UGRD/Z10, for observation type
ADPSFC, over region DTC166, for interpolation method NEAREST(1), using
0 pairs.
DEBUG 2: Processing UGRD/Z10 versus UGRD/Z10, for observation type
ADPSFC, over region DTC166, for interpolation method MEDIAN(9), using
0 pairs.
DEBUG 2: Processing UGRD/Z10 versus UGRD/Z10, for observation type
ADPSFC, over region DTC166, for interpolation method DW_MEAN(9), using
0 pairs.
DEBUG 2: Processing UGRD/Z10 versus UGRD/Z10, for observation type
ADPSFC, over region LMV, for interpolation method NEAREST(1), using 0
pairs.
DEBUG 2: Processing UGRD/Z10 versus UGRD/Z10, for observation type
ADPSFC, over region LMV, for interpolation method MEDIAN(9), using 0
pairs.
DEBUG 2: Processing UGRD/Z10 versus UGRD/Z10, for observation type
ADPSFC, over region LMV, for interpolation method DW_MEAN(9), using 0
pairs.
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Processing VGRD/Z10 versus VGRD/Z10, for observation type
ADPUPA, over region DTC165, for interpolation method NEAREST(1), using
0 pairs.
DEBUG 2: Processing VGRD/Z10 versus VGRD/Z10, for observation type
ADPUPA, over region DTC165, for interpolation method MEDIAN(9), using
0 pairs.
DEBUG 2: Processing VGRD/Z10 versus VGRD/Z10, for observation type
ADPUPA, over region DTC165, for interpolation method DW_MEAN(9), using
0 pairs.
DEBUG 2: Processing VGRD/Z10 versus VGRD/Z10, for observation type
ADPUPA, over region DTC166, for interpolation method NEAREST(1), using
0 pairs.
DEBUG 2: Processing VGRD/Z10 versus VGRD/Z10, for observation type
ADPUPA, over region DTC166, for interpolation method MEDIAN(9), using
0 pairs.
DEBUG 2: Processing VGRD/Z10 versus VGRD/Z10, for observation type
ADPUPA, over region DTC166, for interpolation method DW_MEAN(9), using
0 pairs.
DEBUG 2: Processing VGRD/Z10 versus VGRD/Z10, for observation type
ADPUPA, over region LMV, for interpolation method NEAREST(1), using 0
pairs.
DEBUG 2: Processing VGRD/Z10 versus VGRD/Z10, for observation type
ADPUPA, over region LMV, for interpolation method MEDIAN(9), using 0
pairs.
DEBUG 2: Processing VGRD/Z10 versus VGRD/Z10, for observation type
ADPUPA, over region LMV, for interpolation method DW_MEAN(9), using 0
pairs.
DEBUG 2: Processing VGRD/Z10 versus VGRD/Z10, for observation type
ADPSFC, over region DTC165, for interpolation method NEAREST(1), using
0 pairs.
DEBUG 2: Processing VGRD/Z10 versus VGRD/Z10, for observation type
ADPSFC, over region DTC165, for interpolation method MEDIAN(9), using
0 pairs.
DEBUG 2: Processing VGRD/Z10 versus VGRD/Z10, for observation type
ADPSFC, over region DTC165, for interpolation method DW_MEAN(9), using
0 pairs.
DEBUG 2: Processing VGRD/Z10 versus VGRD/Z10, for observation type
ADPSFC, over region DTC166, for interpolation method NEAREST(1), using
0 pairs.
DEBUG 2: Processing VGRD/Z10 versus VGRD/Z10, for observation type
ADPSFC, over region DTC166, for interpolation method MEDIAN(9), using
0 pairs.
DEBUG 2: Processing VGRD/Z10 versus VGRD/Z10, for observation type
ADPSFC, over region DTC166, for interpolation method DW_MEAN(9), using
0 pairs.
DEBUG 2: Processing VGRD/Z10 versus VGRD/Z10, for observation type
ADPSFC, over region LMV, for interpolation method NEAREST(1), using 0
pairs.
DEBUG 2: Processing VGRD/Z10 versus VGRD/Z10, for observation type
ADPSFC, over region LMV, for interpolation method MEDIAN(9), using 0
pairs.
DEBUG 2: Processing VGRD/Z10 versus VGRD/Z10, for observation type
ADPSFC, over region LMV, for interpolation method DW_MEAN(9), using 0
pairs.
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 1: Output file:
../out/point_stat/point_stat_360000L_20070331_120000V.stat
DEBUG 1: Output file:
../out/point_stat/point_stat_360000L_20070331_120000V_fho.txt
DEBUG 1: Output file:
../out/point_stat/point_stat_360000L_20070331_120000V_ctc.txt
DEBUG 1: Output file:
../out/point_stat/point_stat_360000L_20070331_120000V_cts.txt
DEBUG 1: Output file:
../out/point_stat/point_stat_360000L_20070331_120000V_cnt.txt
DEBUG 1: Output file:
../out/point_stat/point_stat_360000L_20070331_120000V_sl1l2.txt
DEBUG 1: Output file:
../out/point_stat/point_stat_360000L_20070331_120000V_sal1l2.txt
DEBUG 1: Output file:
../out/point_stat/point_stat_360000L_20070331_120000V_vl1l2.txt
DEBUG 1: Output file:
../out/point_stat/point_stat_360000L_20070331_120000V_val1l2.txt
DEBUG 1: Output file:
../out/point_stat/point_stat_360000L_20070331_120000V_mpr.txt
*** Testing Wavelet-Stat application ***
*** Running Wavelet-Stat on APCP using a GRIB forecast and netCDF
observation ***
DEBUG 1: Default Config File: /work/apps/pgi_14.10/met-
5.1/share/met/config/WaveletStatConfig_default
DEBUG 1: User Config File: config/WaveletStatConfig_APCP_12
DEBUG 1: Forecast File:
../data/sample_fcst/2005080700/wrfprs_ruc13_12.tm00_G212
DEBUG 1: Observation File:
../out/pcp_combine/sample_obs_2005080712V_12A.nc
DEBUG 2:
DEBUG 2: Tiling Method: Apply 1 tile(s) automatically computed with
dimension = 128 and lower-left (x, y) = (29.00000, 1.00000)
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Processing APCP/A12 versus APCP_12(*,*).
DEBUG 2: Forecast field: Replaced 9703 bad data values out of 23865
points with fill value of 0.
DEBUG 2: Observation field: Replaced 17405 bad data values out of
23865 points with fill value of 0.
DEBUG 2: Loading forecast raw color table: /work/apps/pgi_14.10/met-
5.1/share/met/colortables/met_default.ctable
DEBUG 2: Loading observation raw color table:
/work/apps/pgi_14.10/met-5.1/share/met/colortables/met_default.ctable
DEBUG 2: Loading wavelet color table: /work/apps/pgi_14.10/met-
5.1/share/met/colortables/NCL_colortables/BlWhRe.ctable
DEBUG 2: Retrieving data for tile 1 with dimension = 128 and lower-
left (x, y) = (29, 1)
DEBUG 2: Computing Intensity-Scale decomposition for APCP/A12 gt0.0
versus APCP_12(*,*) gt0.0.
DEBUG 2: Computing Intensity-Scale decomposition for APCP/A12 ge5.0
versus APCP_12(*,*) ge5.0.
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 1: Output file:
../out/wavelet_stat/wavelet_stat_120000L_20050807_120000V.stat
DEBUG 1: Output file:
../out/wavelet_stat/wavelet_stat_120000L_20050807_120000V_isc.txt
DEBUG 1: Output file:
../out/wavelet_stat/wavelet_stat_120000L_20050807_120000V.nc
DEBUG 1: Output file:
../out/wavelet_stat/wavelet_stat_120000L_20050807_120000V.ps
*** Running Wavelet-Stat on APCP using netCDF input for both forecast
and observation ***
DEBUG 1: Default Config File: /work/apps/pgi_14.10/met-
5.1/share/met/config/WaveletStatConfig_default
DEBUG 1: User Config File: config/WaveletStatConfig_APCP_12_NC
DEBUG 1: Forecast File:
../out/pcp_combine/sample_fcst_12L_2005080800V_12A.nc
DEBUG 1: Observation File:
../out/pcp_combine/sample_obs_2005080800V_12A.nc
DEBUG 2:
DEBUG 2: Tiling Method: Apply 1 tile(s) automatically computed with
dimension = 128 and lower-left (x, y) = (29.00000, 1.00000)
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Processing APCP_12(*,*) versus APCP_12(*,*).
DEBUG 2: Forecast field: Replaced 9703 bad data values out of 23865
points with fill value of 0.
DEBUG 2: Observation field: Replaced 17318 bad data values out of
23865 points with fill value of 0.
DEBUG 2: Loading forecast raw color table: /work/apps/pgi_14.10/met-
5.1/share/met/colortables/met_default.ctable
DEBUG 2: Loading observation raw color table:
/work/apps/pgi_14.10/met-5.1/share/met/colortables/met_default.ctable
DEBUG 2: Loading wavelet color table: /work/apps/pgi_14.10/met-
5.1/share/met/colortables/NCL_colortables/BlWhRe.ctable
DEBUG 2: Retrieving data for tile 1 with dimension = 128 and lower-
left (x, y) = (29, 1)
DEBUG 2: Computing Intensity-Scale decomposition for APCP_12(*,*)
gt0.0 versus APCP_12(*,*) gt0.0.
DEBUG 2: Computing Intensity-Scale decomposition for APCP_12(*,*)
ge5.0 versus APCP_12(*,*) ge5.0.
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 1: Output file:
../out/wavelet_stat/wavelet_stat_240000L_20050808_000000V.stat
DEBUG 1: Output file:
../out/wavelet_stat/wavelet_stat_240000L_20050808_000000V_isc.txt
DEBUG 1: Output file:
../out/wavelet_stat/wavelet_stat_240000L_20050808_000000V.nc
DEBUG 1: Output file:
../out/wavelet_stat/wavelet_stat_240000L_20050808_000000V.ps
*** Testing Ensemble-Stat application ***
*** Running Ensemble-Stat on APCP using GRIB forecasts, point
observations, and gridded observations ***
DEBUG 1: Default Config File: /work/apps/pgi_14.10/met-
5.1/share/met/config/EnsembleStatConfig_default
DEBUG 1: User Config File: config/EnsembleStatConfig
GSL_RNG_TYPE=mt19937
GSL_RNG_SEED=1
DEBUG 1: Ensemble Files[6]:
DEBUG 1: ../data/sample_fcst/2009123112/arw-fer-
gep1/d01_2009123112_02400.grib
DEBUG 1: ../data/sample_fcst/2009123112/arw-fer-
gep5/d01_2009123112_02400.grib
DEBUG 1: ../data/sample_fcst/2009123112/arw-sch-
gep2/d01_2009123112_02400.grib
DEBUG 1: ../data/sample_fcst/2009123112/arw-sch-
gep6/d01_2009123112_02400.grib
DEBUG 1: ../data/sample_fcst/2009123112/arw-tom-
gep3/d01_2009123112_02400.grib
DEBUG 1: ../data/sample_fcst/2009123112/arw-tom-
gep7/d01_2009123112_02400.grib
DEBUG 1: Gridded Observation Files[1]:
DEBUG 1: ../data/sample_obs/ST4/ST4.2010010112.24h
DEBUG 1: Point Observation Files[1]:
DEBUG 1: ../out/ascii2nc/precip24_2010010112.nc
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Processing ensemble field: APCP/A24
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Processing ensemble field: REFC/L0
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Processing ensemble field: UGRD/Z10
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Processing ensemble field: VGRD/Z10
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Processing ensemble field: WIND/Z10
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Processing point observation file:
../out/ascii2nc/precip24_2010010112.nc
DEBUG 2: Searching 1836 observations from 1836 header messages.
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Processing ensemble file: ../data/sample_fcst/2009123112/arw-
fer-gep1/d01_2009123112_02400.grib
DEBUG 2: For APCP/A24 found 1 forecast levels.
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Processing ensemble file: ../data/sample_fcst/2009123112/arw-
fer-gep5/d01_2009123112_02400.grib
DEBUG 2: For APCP/A24 found 1 forecast levels.
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Processing ensemble file: ../data/sample_fcst/2009123112/arw-
sch-gep2/d01_2009123112_02400.grib
DEBUG 2: For APCP/A24 found 1 forecast levels.
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Processing ensemble file: ../data/sample_fcst/2009123112/arw-
sch-gep6/d01_2009123112_02400.grib
DEBUG 2: For APCP/A24 found 1 forecast levels.
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Processing ensemble file: ../data/sample_fcst/2009123112/arw-
tom-gep3/d01_2009123112_02400.grib
DEBUG 2: For APCP/A24 found 1 forecast levels.
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Processing ensemble file: ../data/sample_fcst/2009123112/arw-
tom-gep7/d01_2009123112_02400.grib
DEBUG 2: For APCP/A24 found 1 forecast levels.
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Processing mean file:
../out/ensemble_stat/ensemble_stat_20100101_120000V_ens.nc
DEBUG 2: For APCP_24_A24_ENS_MEAN(*,*) found 1 forecast levels.
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Processing point verification APCP/A24 versus APCP/A24, for
observation type ADPSFC, over region FULL, for interpolation method
NEAREST(1), using 1125 pairs.
DEBUG 2: Processing point verification APCP/A24 versus APCP/A24, for
observation type ADPSFC, over region HUC4_1605, for interpolation
method NEAREST(1), using 35 pairs.
DEBUG 2: Processing point verification APCP/A24 versus APCP/A24, for
observation type ADPSFC, over region HUC4_1803, for interpolation
method NEAREST(1), using 64 pairs.
DEBUG 2: Processing point verification APCP/A24 versus APCP/A24, for
observation type ADPSFC, over region HUC4_1804, for interpolation
method NEAREST(1), using 79 pairs.
DEBUG 2: Processing point verification APCP/A24 versus APCP/A24, for
observation type ADPSFC, over region HUC4_1805, for interpolation
method NEAREST(1), using 45 pairs.
DEBUG 2: Processing point verification APCP/A24 versus APCP/A24, for
observation type ADPSFC, over region HUC4_1806, for interpolation
method NEAREST(1), using 78 pairs.
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Processing ensemble mean file:
../out/ensemble_stat/ensemble_stat_20100101_120000V_ens.nc
DEBUG 2: Processing gridded verification APCP/A24 versus APCP/A24, for
observation type MC_PCP, over region FULL, for interpolation method
NEAREST(1), using 15480 pairs.
DEBUG 2: Processing gridded verification APCP/A24 versus APCP/A24, for
observation type MC_PCP, over region HUC4_1605, for interpolation
method NEAREST(1), using 398 pairs.
DEBUG 2: Processing gridded verification APCP/A24 versus APCP/A24, for
observation type MC_PCP, over region HUC4_1803, for interpolation
method NEAREST(1), using 540 pairs.
DEBUG 2: Processing gridded verification APCP/A24 versus APCP/A24, for
observation type MC_PCP, over region HUC4_1804, for interpolation
method NEAREST(1), using 503 pairs.
DEBUG 2: Processing gridded verification APCP/A24 versus APCP/A24, for
observation type MC_PCP, over region HUC4_1805, for interpolation
method NEAREST(1), using 161 pairs.
DEBUG 2: Processing gridded verification APCP/A24 versus APCP/A24, for
observation type MC_PCP, over region HUC4_1806, for interpolation
method NEAREST(1), using 491 pairs.
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 1: Output file:
../out/ensemble_stat/ensemble_stat_20100101_120000V.stat
DEBUG 1: Output file:
../out/ensemble_stat/ensemble_stat_20100101_120000V_rhist.txt
DEBUG 1: Output file:
../out/ensemble_stat/ensemble_stat_20100101_120000V_phist.txt
DEBUG 1: Output file:
../out/ensemble_stat/ensemble_stat_20100101_120000V_orank.txt
DEBUG 1: Output file:
../out/ensemble_stat/ensemble_stat_20100101_120000V_ssvar.txt
DEBUG 1: Output file:
../out/ensemble_stat/ensemble_stat_20100101_120000V_ens.nc
DEBUG 1: Output file:
../out/ensemble_stat/ensemble_stat_20100101_120000V_orank.nc
*** Testing STAT-Analysis application ***
*** Running STAT-Analysis ***
DEBUG 1: Creating STAT-Analysis output file
"../out/stat_analysis/stat_analysis.out"
DEBUG 1: Default Config File: /work/apps/pgi_14.10/met-
5.1/share/met/config/STATAnalysisConfig_default
DEBUG 1: User Config File: config/STATAnalysisConfig
DEBUG 2: STAT Lines read = 8070
DEBUG 2: STAT Lines retained = 8070
DEBUG 2:
DEBUG 2: Processing Job 1: -job filter -vx_mask DTC165 -line_type
SL1L2 -dump_row ../out/stat_analysis/job_filter_SL1L2.stat
DEBUG 1: Creating dump row output file
"../out/stat_analysis/job_filter_SL1L2.stat"
DEBUG 2: Job 1 used 4 out of 8070 STAT lines.
DEBUG 2:
DEBUG 2: Processing Job 2: -job summary -fcst_var TMP -alpha 0.05000
-line_type CNT -column ME -dump_row
../out/stat_analysis/job_summary_ME.stat -out_alpha 0.05000
DEBUG 1: Creating dump row output file
"../out/stat_analysis/job_summary_ME.stat"
GSL_RNG_TYPE=mt19937
GSL_RNG_SEED=1
DEBUG 2: Computing output for 1 case(s).
DEBUG 2: Job 2 used 4 out of 8070 STAT lines.
DEBUG 2:
DEBUG 2: Processing Job 3: -job aggregate -fcst_var TMP -vx_mask
DTC165 -vx_mask DTC166 -line_type SL1L2 -dump_row
../out/stat_analysis/job_aggregate_SL1L2.stat
DEBUG 1: Creating dump row output file
"../out/stat_analysis/job_aggregate_SL1L2.stat"
DEBUG 2: Computing output for 1 case(s).
DEBUG 2: For case "(nul)", found 2 unique VX_MASK values:
DTC165,DTC166
DEBUG 2: Job 3 used 2 out of 8070 STAT lines.
DEBUG 2:
DEBUG 2: Processing Job 4: -job aggregate_stat -fcst_var TMP -vx_mask
DTC165 -vx_mask DTC166 -line_type SL1L2 -dump_row
../out/stat_analysis/job_aggregate_stat_SL1L2_CNT.stat -out_line_type
CNT -out_alpha 0.05000 -rank_corr_flag 1
DEBUG 1: Creating dump row output file
"../out/stat_analysis/job_aggregate_stat_SL1L2_CNT.stat"
GSL_RNG_TYPE=mt19937
GSL_RNG_SEED=1
DEBUG 2: Computing output for 1 case(s).
DEBUG 2: For case "(nul)", found 2 unique VX_MASK values:
DTC165,DTC166
DEBUG 2: Job 4 used 2 out of 8070 STAT lines.
DEBUG 2:
DEBUG 2: Processing Job 5: -job aggregate -fcst_var TMP -vx_mask
DTC165 -vx_mask DTC166 -fcst_thresh <300 -line_type FHO -dump_row
../out/stat_analysis/job_aggregate_FHO.stat
DEBUG 1: Creating dump row output file
"../out/stat_analysis/job_aggregate_FHO.stat"
DEBUG 2: Computing output for 1 case(s).
DEBUG 2: For case "(nul)", found 2 unique VX_MASK values:
DTC165,DTC166
DEBUG 2: Job 5 used 2 out of 8070 STAT lines.
DEBUG 2:
DEBUG 2: Processing Job 6: -job aggregate_stat -fcst_var TMP -vx_mask
DTC165 -vx_mask DTC166 -fcst_thresh <300 -line_type FHO -dump_row
../out/stat_analysis/job_aggregate_stat_FHO_CTS.stat -out_line_type
CTS -out_alpha 0.05000
DEBUG 1: Creating dump row output file
"../out/stat_analysis/job_aggregate_stat_FHO_CTS.stat"
GSL_RNG_TYPE=mt19937
GSL_RNG_SEED=1
DEBUG 2: Computing output for 1 case(s).
DEBUG 2: For case "(nul)", found 2 unique VX_MASK values:
DTC165,DTC166
DEBUG 2: Job 6 used 2 out of 8070 STAT lines.
DEBUG 2:
DEBUG 2: Processing Job 7: -job aggregate_stat -fcst_var APCP_24
-vx_mask DTC165 -vx_mask DTC166 -line_type MCTC -column_thresh N_CAT
=4 -dump_row ../out/stat_analysis/job_aggregate_stat_MCTC_MCTS.stat
-out_line_type MCTS -out_alpha 0.05000
DEBUG 1: Creating dump row output file
"../out/stat_analysis/job_aggregate_stat_MCTC_MCTS.stat"
GSL_RNG_TYPE=mt19937
GSL_RNG_SEED=1
DEBUG 2: Computing output for 1 case(s).
DEBUG 2: For case "(nul)", found 2 unique VX_MASK values:
DTC165,DTC166
DEBUG 2: Job 7 used 2 out of 8070 STAT lines.
DEBUG 2:
DEBUG 2: Processing Job 8: -job aggregate -vx_mask DTC165 -vx_mask
DTC166 -line_type PCT -dump_row
../out/stat_analysis/job_aggregate_PCT.stat
DEBUG 1: Creating dump row output file
"../out/stat_analysis/job_aggregate_PCT.stat"
DEBUG 2: Computing output for 1 case(s).
DEBUG 2: For case "(nul)", found 2 unique VX_MASK values:
DTC165,DTC166
DEBUG 2: Job 8 used 2 out of 8070 STAT lines.
DEBUG 2:
DEBUG 2: Processing Job 9: -job aggregate_stat -vx_mask DTC165
-vx_mask DTC166 -line_type PCT -dump_row
../out/stat_analysis/job_aggregate_stat_PCT_PSTD.stat -out_line_type
PSTD -out_alpha 0.05000
DEBUG 1: Creating dump row output file
"../out/stat_analysis/job_aggregate_stat_PCT_PSTD.stat"
GSL_RNG_TYPE=mt19937
GSL_RNG_SEED=1
DEBUG 2: Computing output for 1 case(s).
DEBUG 2: For case "(nul)", found 2 unique VX_MASK values:
DTC165,DTC166
DEBUG 2: Job 9 used 2 out of 8070 STAT lines.
DEBUG 2:
DEBUG 2: Processing Job 10: -job aggregate -fcst_var APCP_12 -vx_mask
TILE_TOT -fcst_thresh >0.0 -line_type ISC -dump_row
../out/stat_analysis/job_aggregate_ISC.stat
DEBUG 1: Creating dump row output file
"../out/stat_analysis/job_aggregate_ISC.stat"
DEBUG 2: Computing output for 1 case(s).
DEBUG 2: For case "(nul)", found 2 unique FCST_LEAD values:
240000,120000
DEBUG 2: Job 10 used 18 out of 8070 STAT lines.
DEBUG 2:
DEBUG 2: Processing Job 11: -job aggregate -obtype MC_PCP -vx_mask
HUC4_1605 -vx_mask HUC4_1803 -vx_mask HUC4_1804 -vx_mask HUC4_1805
-vx_mask HUC4_1806 -line_type RHIST -dump_row
../out/stat_analysis/job_aggregate_RHIST.stat
DEBUG 1: Creating dump row output file
"../out/stat_analysis/job_aggregate_RHIST.stat"
DEBUG 2: Computing output for 1 case(s).
DEBUG 2: For case "(nul)", found 5 unique VX_MASK values:
HUC4_1605,HUC4_1803,HUC4_1804,HUC4_1805,HUC4_1806
DEBUG 2: Job 11 used 5 out of 8070 STAT lines.
DEBUG 2:
DEBUG 2: Processing Job 12: -job aggregate_stat -obtype ADPSFC
-vx_mask HUC4_1605 -vx_mask HUC4_1803 -vx_mask HUC4_1804 -vx_mask
HUC4_1805 -vx_mask HUC4_1806 -line_type ORANK -dump_row
../out/stat_analysis/job_aggregate_stat_ORANK_RHIST.stat
-out_line_type RHIST
DEBUG 1: Creating dump row output file
"../out/stat_analysis/job_aggregate_stat_ORANK_RHIST.stat"
GSL_RNG_TYPE=mt19937
GSL_RNG_SEED=1
DEBUG 2: Computing output for 1 case(s).
DEBUG 2: For case "(nul)", found 5 unique VX_MASK values:
HUC4_1605,HUC4_1803,HUC4_1804,HUC4_1805,HUC4_1806
DEBUG 2: Job 12 used 301 out of 8070 STAT lines.
*** Testing MODE-Analysis application ***
*** Running MODE-Analysis to compute column summaries for simple
forecast objects ***
DEBUG 1: Default Config File: /work/apps/pgi_14.10/met-
5.1/share/met/config/MODEAnalysisConfig_default
DEBUG 1: User Config File: config/MODEAnalysisConfig
DEBUG 2: Total mode lines read = 24
DEBUG 2: Total mode lines kept = 7
*** Running MODE-Analysis to compute column summaries for simple
observation objects ***
DEBUG 1: Default Config File: /work/apps/pgi_14.10/met-
5.1/share/met/config/MODEAnalysisConfig_default
DEBUG 1: User Config File: config/MODEAnalysisConfig
DEBUG 2: Total mode lines read = 24
DEBUG 2: Total mode lines kept = 4
*** Running MODE-Analysis to summarize by case ***
DEBUG 2: Total mode lines read = 44
DEBUG 2: Total mode lines kept = 21
*** Testing PLOT_DATA_PLANE application ***
*** Running PLOT_DATA_PLANE on a sample GRIB1 gridded file ***
DEBUG 1: Opening data file:
../data/sample_fcst/2007033000/nam.t00z.awip1236.tm00.20070330.grb
DEBUG 1: Creating postscript file:
../out/plot_data_plane/nam.t00z.awip1236.tm00.20070330_TMPZ2.ps
*** Running PLOT_DATA_PLANE on a sample netCDF file ***
DEBUG 1: Opening data file:
../out/pcp_combine/sample_fcst_12L_2005080712V_12A.nc
DEBUG 1: Creating postscript file:
../out/plot_data_plane/sample_fcst_12L_2005080712V_12A_APCP12_NC_MET.ps
*** Finished Testing the Model Evaluation Tools Project ***
------------------------------------------------
Subject: Issues converting PREPBUFR to NetCDF
From: Julie Prestopnik
Time: Wed Mar 09 10:38:53 2016
Thank you, Jose! It looks like something went wrong during
compilation. I
suggest recompiling MET to see if we can get this issue resolved.
NCEP's
BUFRLIB is used by the pb2nc MET tool, and is a required external
library
for pb2nc. MET is not yet compatible with BUFRLIB version 11.0.0, so
we
suggest getting version 10.2.3. We are working on our online
tutorial for
METv.5.1, but in the meantime, I'll point you to our online tutorial
directions for installing BUFRLIB:
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.0/compilation/req_libs.php
It is also important to review the necessary environment variables to
set:
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.0/compilation/configure.php
For example,
"Set *$MET_BUFR* to point to the main BUFR directory, or set
*$MET_BUFRLIB*
to point to the directory with the BUFR library files. Because MET
doesn't
use any BUFR library include files, you don't need to specify
*$MET_BUFRINC*
."
Once you've installed the required libraries and set up your
environment
variables, you'll be ready to configure MET (instructions at the
bottom of
the last link above) and then compile and install MET (
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.0/compilation/compile.php).
After re-installing MET, please run "make test" again. If you still
encounter the same problem, please send me your *config.log* file and
your *make_install.log
*file. Please let me know if you have any questions.
Please let us know how it goes.
Thanks,
Julie
On Wed, Mar 9, 2016 at 10:22 AM, Jose Garcia-Rivera via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
>
> Dear Julie,
>
> Attached is the test log file. It's showing the same issues on pb2nc
even
> with the sample files.
>
> Best Regards,
> Jose
>
> -----Original Message-----
> From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> Sent: Tuesday, March 08, 2016 5:28 PM
> To: Jose Garcia-Rivera
> Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to
NetCDF
>
> Hi Jose. Thank you for uploading the files. Unfortunately, I am
unable
> to reproduce the error you are experiencing. I am wondering if you
have
> successfully used pb2nc before. As a check could you please run the
> following in your met-5.1/ directory:
>
> *make test >& make_test.log*
>
> and then send me the make_test.log file?
>
> Thanks,
> Julie
>
> On Tue, Mar 8, 2016 at 11:29 AM, Jose Garcia-Rivera via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> >
> > Dear Julie,
> >
> > I just put the files in 'garcia_data'. I appreciate your help.
> >
> > Best Regards,
> > Jose
> >
> > -----Original Message-----
> > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > Sent: Tuesday, March 08, 2016 1:12 PM
> > To: Jose Garcia-Rivera
> > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR
to
> > NetCDF
> >
> > Hi Jose. I'm sorry to hear that you are having problems converting
a
> > PREPBUFR file to NetCDF.
> >
> > Please upload your input files and configuration file to our
anonymous
> > ftp site as follows:
> > http://www.dtcenter.org/met/users/support/met_help.php
> >
> > Then I can take a look and get back to you.
> >
> > Thanks,
> > Julie
> >
> > On Tue, Mar 8, 2016 at 11:01 AM, Jose Garcia-Rivera via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > Tue Mar 08 11:01:25 2016: Request 75433 was acted upon.
> > > Transaction: Ticket created by GarciaJ at imsg.com
> > > Queue: met_help
> > > Subject: Issues converting PREPBUFR to NetCDF
> > > Owner: Nobody
> > > Requestors: GarciaJ at imsg.com
> > > Status: new
> > > Ticket <URL:
> > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > >
> > >
> > >
> > > Dear Met Help,
> > >
> > > Trying to convert a PREPBUFR file to NetCDF.
> > >
> > > I used the default PB2NC configure file, and got the following:
> > >
> > > [garciaj at login prepbufr_obs]$ ./pb2nc gdas1.t12z.prepbufr.nr
> > > gdas.20150820.t12z.nc PB2NCConfig_default DEBUG 1: Default
Config
> > > File:
> > > /work/apps/pgi_14.10/met-
5.1/share/met/config/PB2NCConfig_default
> > > DEBUG 1: User Config File: PB2NCConfig_default
> > > DEBUG 1: Creating NetCDF File: gdas.20150820.t12z.nc
> > > DEBUG 1: Processing PrepBufr File: gdas1.t12z.prepbufr.nr
> > > DEBUG 1: Blocking PrepBufr file to:
/tmp/tmp_pb2nc_blk_32144_0
> > > WARNING:
> > > WARNING: process_pbfile() -> No PrepBufr messages to process in
file:
> > > gdas1.t12z.prepbufr.nr
> > > WARNING:
> > > ERROR :
> > > ERROR : write_netcdf_hdr_data() -> No PrepBufr messages
retained.
> > > Nothing to write.
> > > ERROR :
> > >
> > >
> > > Thanks in advance for the help,
> > > Jose M. Garcia-Rivera, PhD
> > > IM Systems Group
> > > Rockville/College Park, MD
> > > This e-mail, including attachments, may include confidential
and/or
> > > proprietary information, and may be used only by the person or
> > > entity to which it is addressed. If the reader of this e-mail is
not
> > > the intended recipient or his or her authorized agent, the
reader is
> > > hereby notified that any dissemination, distribution or copying
of
> > > this e-mail is prohibited. If you have received this e-mail in
> > > error, please notify the sender by replying to this message and
> > > delete this
> > e-mail immediately.
> > >
> > >
> >
> >
> > --
> > Julie Prestopnik
> > National Center for Atmospheric Research Research Applications
> > Laboratory
> > Phone: 303.497.8399
> > Email: jpresto at ucar.edu
> >
> > This e-mail, including attachments, may include confidential
and/or
> > proprietary information, and may be used only by the person or
entity
> > to which it is addressed. If the reader of this e-mail is not the
> > intended recipient or his or her authorized agent, the reader is
> > hereby notified that any dissemination, distribution or copying of
> > this e-mail is prohibited. If you have received this e-mail in
error,
> > please notify the sender by replying to this message and delete
this
> e-mail immediately.
> >
> >
> >
>
>
> --
> Julie Prestopnik
> National Center for Atmospheric Research Research Applications
Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
> This e-mail, including attachments, may include confidential and/or
> proprietary information, and may be used only by the person or
entity to
> which it is addressed. If the reader of this e-mail is not the
intended
> recipient or his or her authorized agent, the reader is hereby
notified
> that any dissemination, distribution or copying of this e-mail is
> prohibited. If you have received this e-mail in error, please notify
the
> sender by replying to this message and delete this e-mail
immediately.
>
>
--
Julie Prestopnik
National Center for Atmospheric Research
Research Applications Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to NetCDF
From: Jose Garcia-Rivera
Time: Wed Mar 09 15:19:09 2016
Dear Julie,
Thank you so much for all the information. Unfortunately, I can't
compile directly. It has to be done by the administrator. However, I
forwarded this message to him, and will follow up on such task. I'll
keep you posted.
Best Regards,
Jose
-----Original Message-----
From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
Sent: Wednesday, March 09, 2016 12:39 PM
To: Jose Garcia-Rivera
Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to
NetCDF
Thank you, Jose! It looks like something went wrong during
compilation. I suggest recompiling MET to see if we can get this
issue resolved. NCEP's BUFRLIB is used by the pb2nc MET tool, and is
a required external library for pb2nc. MET is not yet compatible with
BUFRLIB version 11.0.0, so we
suggest getting version 10.2.3. We are working on our online
tutorial for
METv.5.1, but in the meantime, I'll point you to our online tutorial
directions for installing BUFRLIB:
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.0/compilation/req_libs.php
It is also important to review the necessary environment variables to
set:
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.0/compilation/configure.php
For example,
"Set *$MET_BUFR* to point to the main BUFR directory, or set
*$MET_BUFRLIB* to point to the directory with the BUFR library files.
Because MET doesn't use any BUFR library include files, you don't need
to specify *$MET_BUFRINC* ."
Once you've installed the required libraries and set up your
environment variables, you'll be ready to configure MET (instructions
at the bottom of the last link above) and then compile and install MET
(
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.0/compilation/compile.php).
After re-installing MET, please run "make test" again. If you still
encounter the same problem, please send me your *config.log* file and
your *make_install.log *file. Please let me know if you have any
questions.
Please let us know how it goes.
Thanks,
Julie
On Wed, Mar 9, 2016 at 10:22 AM, Jose Garcia-Rivera via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
>
> Dear Julie,
>
> Attached is the test log file. It's showing the same issues on pb2nc
> even with the sample files.
>
> Best Regards,
> Jose
>
> -----Original Message-----
> From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> Sent: Tuesday, March 08, 2016 5:28 PM
> To: Jose Garcia-Rivera
> Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to
> NetCDF
>
> Hi Jose. Thank you for uploading the files. Unfortunately, I am
> unable to reproduce the error you are experiencing. I am wondering
if
> you have successfully used pb2nc before. As a check could you
please
> run the following in your met-5.1/ directory:
>
> *make test >& make_test.log*
>
> and then send me the make_test.log file?
>
> Thanks,
> Julie
>
> On Tue, Mar 8, 2016 at 11:29 AM, Jose Garcia-Rivera via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> >
> > Dear Julie,
> >
> > I just put the files in 'garcia_data'. I appreciate your help.
> >
> > Best Regards,
> > Jose
> >
> > -----Original Message-----
> > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > Sent: Tuesday, March 08, 2016 1:12 PM
> > To: Jose Garcia-Rivera
> > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR
to
> > NetCDF
> >
> > Hi Jose. I'm sorry to hear that you are having problems converting
a
> > PREPBUFR file to NetCDF.
> >
> > Please upload your input files and configuration file to our
> > anonymous ftp site as follows:
> > http://www.dtcenter.org/met/users/support/met_help.php
> >
> > Then I can take a look and get back to you.
> >
> > Thanks,
> > Julie
> >
> > On Tue, Mar 8, 2016 at 11:01 AM, Jose Garcia-Rivera via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > Tue Mar 08 11:01:25 2016: Request 75433 was acted upon.
> > > Transaction: Ticket created by GarciaJ at imsg.com
> > > Queue: met_help
> > > Subject: Issues converting PREPBUFR to NetCDF
> > > Owner: Nobody
> > > Requestors: GarciaJ at imsg.com
> > > Status: new
> > > Ticket <URL:
> > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > >
> > >
> > >
> > > Dear Met Help,
> > >
> > > Trying to convert a PREPBUFR file to NetCDF.
> > >
> > > I used the default PB2NC configure file, and got the following:
> > >
> > > [garciaj at login prepbufr_obs]$ ./pb2nc gdas1.t12z.prepbufr.nr
> > > gdas.20150820.t12z.nc PB2NCConfig_default DEBUG 1: Default
Config
> > > File:
> > > /work/apps/pgi_14.10/met-
5.1/share/met/config/PB2NCConfig_default
> > > DEBUG 1: User Config File: PB2NCConfig_default
> > > DEBUG 1: Creating NetCDF File: gdas.20150820.t12z.nc
> > > DEBUG 1: Processing PrepBufr File: gdas1.t12z.prepbufr.nr
> > > DEBUG 1: Blocking PrepBufr file to:
/tmp/tmp_pb2nc_blk_32144_0
> > > WARNING:
> > > WARNING: process_pbfile() -> No PrepBufr messages to process in
file:
> > > gdas1.t12z.prepbufr.nr
> > > WARNING:
> > > ERROR :
> > > ERROR : write_netcdf_hdr_data() -> No PrepBufr messages
retained.
> > > Nothing to write.
> > > ERROR :
> > >
> > >
> > > Thanks in advance for the help,
> > > Jose M. Garcia-Rivera, PhD
> > > IM Systems Group
> > > Rockville/College Park, MD
> > > This e-mail, including attachments, may include confidential
> > > and/or proprietary information, and may be used only by the
person
> > > or entity to which it is addressed. If the reader of this e-mail
> > > is not the intended recipient or his or her authorized agent,
the
> > > reader is hereby notified that any dissemination, distribution
or
> > > copying of this e-mail is prohibited. If you have received this
> > > e-mail in error, please notify the sender by replying to this
> > > message and delete this
> > e-mail immediately.
> > >
> > >
> >
> >
> > --
> > Julie Prestopnik
> > National Center for Atmospheric Research Research Applications
> > Laboratory
> > Phone: 303.497.8399
> > Email: jpresto at ucar.edu
> >
> > This e-mail, including attachments, may include confidential
and/or
> > proprietary information, and may be used only by the person or
> > entity to which it is addressed. If the reader of this e-mail is
not
> > the intended recipient or his or her authorized agent, the reader
is
> > hereby notified that any dissemination, distribution or copying of
> > this e-mail is prohibited. If you have received this e-mail in
> > error, please notify the sender by replying to this message and
> > delete this
> e-mail immediately.
> >
> >
> >
>
>
> --
> Julie Prestopnik
> National Center for Atmospheric Research Research Applications
> Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
> This e-mail, including attachments, may include confidential and/or
> proprietary information, and may be used only by the person or
entity
> to which it is addressed. If the reader of this e-mail is not the
> intended recipient or his or her authorized agent, the reader is
> hereby notified that any dissemination, distribution or copying of
> this e-mail is prohibited. If you have received this e-mail in
error,
> please notify the sender by replying to this message and delete this
e-mail immediately.
>
>
--
Julie Prestopnik
National Center for Atmospheric Research Research Applications
Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
This e-mail, including attachments, may include confidential and/or
proprietary information, and may be used only by the person or entity
to which it is addressed. If the reader of this e-mail is not the
intended recipient or his or her authorized agent, the reader is
hereby notified that any dissemination, distribution or copying of
this e-mail is prohibited. If you have received this e-mail in error,
please notify the sender by replying to this message and delete this
e-mail immediately.
------------------------------------------------
Subject: Issues converting PREPBUFR to NetCDF
From: Jose Garcia-Rivera
Time: Thu Mar 10 12:20:27 2016
Dear Julie,
The administrator re-compiled MET following your instructions, and
says there's still trouble. He sent me the log files (attached). Is
there any other approach that might help?
Best Regards,
Jose
-----Original Message-----
From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
Sent: Wednesday, March 09, 2016 12:39 PM
To: Jose Garcia-Rivera
Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to
NetCDF
Thank you, Jose! It looks like something went wrong during
compilation. I suggest recompiling MET to see if we can get this
issue resolved. NCEP's BUFRLIB is used by the pb2nc MET tool, and is
a required external library for pb2nc. MET is not yet compatible with
BUFRLIB version 11.0.0, so we
suggest getting version 10.2.3. We are working on our online
tutorial for
METv.5.1, but in the meantime, I'll point you to our online tutorial
directions for installing BUFRLIB:
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.0/compilation/req_libs.php
It is also important to review the necessary environment variables to
set:
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.0/compilation/configure.php
For example,
"Set *$MET_BUFR* to point to the main BUFR directory, or set
*$MET_BUFRLIB* to point to the directory with the BUFR library files.
Because MET doesn't use any BUFR library include files, you don't need
to specify *$MET_BUFRINC* ."
Once you've installed the required libraries and set up your
environment variables, you'll be ready to configure MET (instructions
at the bottom of the last link above) and then compile and install MET
(
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.0/compilation/compile.php).
After re-installing MET, please run "make test" again. If you still
encounter the same problem, please send me your *config.log* file and
your *make_install.log *file. Please let me know if you have any
questions.
Please let us know how it goes.
Thanks,
Julie
On Wed, Mar 9, 2016 at 10:22 AM, Jose Garcia-Rivera via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
>
> Dear Julie,
>
> Attached is the test log file. It's showing the same issues on pb2nc
> even with the sample files.
>
> Best Regards,
> Jose
>
> -----Original Message-----
> From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> Sent: Tuesday, March 08, 2016 5:28 PM
> To: Jose Garcia-Rivera
> Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to
> NetCDF
>
> Hi Jose. Thank you for uploading the files. Unfortunately, I am
> unable to reproduce the error you are experiencing. I am wondering
if
> you have successfully used pb2nc before. As a check could you
please
> run the following in your met-5.1/ directory:
>
> *make test >& make_test.log*
>
> and then send me the make_test.log file?
>
> Thanks,
> Julie
>
> On Tue, Mar 8, 2016 at 11:29 AM, Jose Garcia-Rivera via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> >
> > Dear Julie,
> >
> > I just put the files in 'garcia_data'. I appreciate your help.
> >
> > Best Regards,
> > Jose
> >
> > -----Original Message-----
> > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > Sent: Tuesday, March 08, 2016 1:12 PM
> > To: Jose Garcia-Rivera
> > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR
to
> > NetCDF
> >
> > Hi Jose. I'm sorry to hear that you are having problems converting
a
> > PREPBUFR file to NetCDF.
> >
> > Please upload your input files and configuration file to our
> > anonymous ftp site as follows:
> > http://www.dtcenter.org/met/users/support/met_help.php
> >
> > Then I can take a look and get back to you.
> >
> > Thanks,
> > Julie
> >
> > On Tue, Mar 8, 2016 at 11:01 AM, Jose Garcia-Rivera via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > Tue Mar 08 11:01:25 2016: Request 75433 was acted upon.
> > > Transaction: Ticket created by GarciaJ at imsg.com
> > > Queue: met_help
> > > Subject: Issues converting PREPBUFR to NetCDF
> > > Owner: Nobody
> > > Requestors: GarciaJ at imsg.com
> > > Status: new
> > > Ticket <URL:
> > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > >
> > >
> > >
> > > Dear Met Help,
> > >
> > > Trying to convert a PREPBUFR file to NetCDF.
> > >
> > > I used the default PB2NC configure file, and got the following:
> > >
> > > [garciaj at login prepbufr_obs]$ ./pb2nc gdas1.t12z.prepbufr.nr
> > > gdas.20150820.t12z.nc PB2NCConfig_default DEBUG 1: Default
Config
> > > File:
> > > /work/apps/pgi_14.10/met-
5.1/share/met/config/PB2NCConfig_default
> > > DEBUG 1: User Config File: PB2NCConfig_default
> > > DEBUG 1: Creating NetCDF File: gdas.20150820.t12z.nc
> > > DEBUG 1: Processing PrepBufr File: gdas1.t12z.prepbufr.nr
> > > DEBUG 1: Blocking PrepBufr file to:
/tmp/tmp_pb2nc_blk_32144_0
> > > WARNING:
> > > WARNING: process_pbfile() -> No PrepBufr messages to process in
file:
> > > gdas1.t12z.prepbufr.nr
> > > WARNING:
> > > ERROR :
> > > ERROR : write_netcdf_hdr_data() -> No PrepBufr messages
retained.
> > > Nothing to write.
> > > ERROR :
> > >
> > >
> > > Thanks in advance for the help,
> > > Jose M. Garcia-Rivera, PhD
> > > IM Systems Group
> > > Rockville/College Park, MD
> > > This e-mail, including attachments, may include confidential
> > > and/or proprietary information, and may be used only by the
person
> > > or entity to which it is addressed. If the reader of this e-mail
> > > is not the intended recipient or his or her authorized agent,
the
> > > reader is hereby notified that any dissemination, distribution
or
> > > copying of this e-mail is prohibited. If you have received this
> > > e-mail in error, please notify the sender by replying to this
> > > message and delete this
> > e-mail immediately.
> > >
> > >
> >
> >
> > --
> > Julie Prestopnik
> > National Center for Atmospheric Research Research Applications
> > Laboratory
> > Phone: 303.497.8399
> > Email: jpresto at ucar.edu
> >
> > This e-mail, including attachments, may include confidential
and/or
> > proprietary information, and may be used only by the person or
> > entity to which it is addressed. If the reader of this e-mail is
not
> > the intended recipient or his or her authorized agent, the reader
is
> > hereby notified that any dissemination, distribution or copying of
> > this e-mail is prohibited. If you have received this e-mail in
> > error, please notify the sender by replying to this message and
> > delete this
> e-mail immediately.
> >
> >
> >
>
>
> --
> Julie Prestopnik
> National Center for Atmospheric Research Research Applications
> Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
> This e-mail, including attachments, may include confidential and/or
> proprietary information, and may be used only by the person or
entity
> to which it is addressed. If the reader of this e-mail is not the
> intended recipient or his or her authorized agent, the reader is
> hereby notified that any dissemination, distribution or copying of
> this e-mail is prohibited. If you have received this e-mail in
error,
> please notify the sender by replying to this message and delete this
e-mail immediately.
>
>
--
Julie Prestopnik
National Center for Atmospheric Research Research Applications
Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
This e-mail, including attachments, may include confidential and/or
proprietary information, and may be used only by the person or entity
to which it is addressed. If the reader of this e-mail is not the
intended recipient or his or her authorized agent, the reader is
hereby notified that any dissemination, distribution or copying of
this e-mail is prohibited. If you have received this e-mail in error,
please notify the sender by replying to this message and delete this
e-mail immediately.
------------------------------------------------
Subject: Issues converting PREPBUFR to NetCDF
From: Julie Prestopnik
Time: Thu Mar 10 14:20:26 2016
Hi Jose. Thank you for attaching the files.
Could you please send me a list of the files in
/work/apps/pgi_14.10/SANDY/bufrlib/lib?
Thank you!
Julie
On Thu, Mar 10, 2016 at 12:20 PM, Jose Garcia-Rivera via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
>
> Dear Julie,
>
> The administrator re-compiled MET following your instructions, and
says
> there's still trouble. He sent me the log files (attached). Is there
any
> other approach that might help?
>
> Best Regards,
> Jose
>
> -----Original Message-----
> From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> Sent: Wednesday, March 09, 2016 12:39 PM
> To: Jose Garcia-Rivera
> Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to
NetCDF
>
> Thank you, Jose! It looks like something went wrong during
compilation.
> I suggest recompiling MET to see if we can get this issue resolved.
NCEP's
> BUFRLIB is used by the pb2nc MET tool, and is a required external
library
> for pb2nc. MET is not yet compatible with BUFRLIB version 11.0.0,
so we
> suggest getting version 10.2.3. We are working on our online
tutorial for
> METv.5.1, but in the meantime, I'll point you to our online tutorial
> directions for installing BUFRLIB:
>
>
>
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.0/compilation/req_libs.php
>
> It is also important to review the necessary environment variables
to set:
>
>
>
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.0/compilation/configure.php
>
> For example,
>
> "Set *$MET_BUFR* to point to the main BUFR directory, or set
> *$MET_BUFRLIB* to point to the directory with the BUFR library
files.
> Because MET doesn't use any BUFR library include files, you don't
need to
> specify *$MET_BUFRINC* ."
>
> Once you've installed the required libraries and set up your
environment
> variables, you'll be ready to configure MET (instructions at the
bottom of
> the last link above) and then compile and install MET (
>
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.0/compilation/compile.php
> ).
> After re-installing MET, please run "make test" again. If you still
> encounter the same problem, please send me your *config.log* file
and your
> *make_install.log *file. Please let me know if you have any
questions.
>
> Please let us know how it goes.
>
> Thanks,
> Julie
>
>
>
>
> On Wed, Mar 9, 2016 at 10:22 AM, Jose Garcia-Rivera via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> >
> > Dear Julie,
> >
> > Attached is the test log file. It's showing the same issues on
pb2nc
> > even with the sample files.
> >
> > Best Regards,
> > Jose
> >
> > -----Original Message-----
> > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > Sent: Tuesday, March 08, 2016 5:28 PM
> > To: Jose Garcia-Rivera
> > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR
to
> > NetCDF
> >
> > Hi Jose. Thank you for uploading the files. Unfortunately, I am
> > unable to reproduce the error you are experiencing. I am
wondering if
> > you have successfully used pb2nc before. As a check could you
please
> > run the following in your met-5.1/ directory:
> >
> > *make test >& make_test.log*
> >
> > and then send me the make_test.log file?
> >
> > Thanks,
> > Julie
> >
> > On Tue, Mar 8, 2016 at 11:29 AM, Jose Garcia-Rivera via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> > >
> > > Dear Julie,
> > >
> > > I just put the files in 'garcia_data'. I appreciate your help.
> > >
> > > Best Regards,
> > > Jose
> > >
> > > -----Original Message-----
> > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > Sent: Tuesday, March 08, 2016 1:12 PM
> > > To: Jose Garcia-Rivera
> > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR
to
> > > NetCDF
> > >
> > > Hi Jose. I'm sorry to hear that you are having problems
converting a
> > > PREPBUFR file to NetCDF.
> > >
> > > Please upload your input files and configuration file to our
> > > anonymous ftp site as follows:
> > > http://www.dtcenter.org/met/users/support/met_help.php
> > >
> > > Then I can take a look and get back to you.
> > >
> > > Thanks,
> > > Julie
> > >
> > > On Tue, Mar 8, 2016 at 11:01 AM, Jose Garcia-Rivera via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > Tue Mar 08 11:01:25 2016: Request 75433 was acted upon.
> > > > Transaction: Ticket created by GarciaJ at imsg.com
> > > > Queue: met_help
> > > > Subject: Issues converting PREPBUFR to NetCDF
> > > > Owner: Nobody
> > > > Requestors: GarciaJ at imsg.com
> > > > Status: new
> > > > Ticket <URL:
> > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > >
> > > >
> > > >
> > > > Dear Met Help,
> > > >
> > > > Trying to convert a PREPBUFR file to NetCDF.
> > > >
> > > > I used the default PB2NC configure file, and got the
following:
> > > >
> > > > [garciaj at login prepbufr_obs]$ ./pb2nc gdas1.t12z.prepbufr.nr
> > > > gdas.20150820.t12z.nc PB2NCConfig_default DEBUG 1: Default
Config
> > > > File:
> > > > /work/apps/pgi_14.10/met-
5.1/share/met/config/PB2NCConfig_default
> > > > DEBUG 1: User Config File: PB2NCConfig_default
> > > > DEBUG 1: Creating NetCDF File: gdas.20150820.t12z.nc
> > > > DEBUG 1: Processing PrepBufr File: gdas1.t12z.prepbufr.nr
> > > > DEBUG 1: Blocking PrepBufr file to:
/tmp/tmp_pb2nc_blk_32144_0
> > > > WARNING:
> > > > WARNING: process_pbfile() -> No PrepBufr messages to process
in file:
> > > > gdas1.t12z.prepbufr.nr
> > > > WARNING:
> > > > ERROR :
> > > > ERROR : write_netcdf_hdr_data() -> No PrepBufr messages
retained.
> > > > Nothing to write.
> > > > ERROR :
> > > >
> > > >
> > > > Thanks in advance for the help,
> > > > Jose M. Garcia-Rivera, PhD
> > > > IM Systems Group
> > > > Rockville/College Park, MD
> > > > This e-mail, including attachments, may include confidential
> > > > and/or proprietary information, and may be used only by the
person
> > > > or entity to which it is addressed. If the reader of this e-
mail
> > > > is not the intended recipient or his or her authorized agent,
the
> > > > reader is hereby notified that any dissemination, distribution
or
> > > > copying of this e-mail is prohibited. If you have received
this
> > > > e-mail in error, please notify the sender by replying to this
> > > > message and delete this
> > > e-mail immediately.
> > > >
> > > >
> > >
> > >
> > > --
> > > Julie Prestopnik
> > > National Center for Atmospheric Research Research Applications
> > > Laboratory
> > > Phone: 303.497.8399
> > > Email: jpresto at ucar.edu
> > >
> > > This e-mail, including attachments, may include confidential
and/or
> > > proprietary information, and may be used only by the person or
> > > entity to which it is addressed. If the reader of this e-mail is
not
> > > the intended recipient or his or her authorized agent, the
reader is
> > > hereby notified that any dissemination, distribution or copying
of
> > > this e-mail is prohibited. If you have received this e-mail in
> > > error, please notify the sender by replying to this message and
> > > delete this
> > e-mail immediately.
> > >
> > >
> > >
> >
> >
> > --
> > Julie Prestopnik
> > National Center for Atmospheric Research Research Applications
> > Laboratory
> > Phone: 303.497.8399
> > Email: jpresto at ucar.edu
> >
> > This e-mail, including attachments, may include confidential
and/or
> > proprietary information, and may be used only by the person or
entity
> > to which it is addressed. If the reader of this e-mail is not the
> > intended recipient or his or her authorized agent, the reader is
> > hereby notified that any dissemination, distribution or copying of
> > this e-mail is prohibited. If you have received this e-mail in
error,
> > please notify the sender by replying to this message and delete
this
> e-mail immediately.
> >
> >
>
>
> --
> Julie Prestopnik
> National Center for Atmospheric Research Research Applications
Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
> This e-mail, including attachments, may include confidential and/or
> proprietary information, and may be used only by the person or
entity to
> which it is addressed. If the reader of this e-mail is not the
intended
> recipient or his or her authorized agent, the reader is hereby
notified
> that any dissemination, distribution or copying of this e-mail is
> prohibited. If you have received this e-mail in error, please notify
the
> sender by replying to this message and delete this e-mail
immediately.
>
>
--
Julie Prestopnik
National Center for Atmospheric Research
Research Applications Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to NetCDF
From: Jose Garcia-Rivera
Time: Thu Mar 10 14:23:17 2016
Dear Julie,
This is the only file on that location:
libbufr.a
Best Regards,
Jose
-----Original Message-----
From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
Sent: Thursday, March 10, 2016 4:20 PM
To: Jose Garcia-Rivera
Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to
NetCDF
Hi Jose. Thank you for attaching the files.
Could you please send me a list of the files in
/work/apps/pgi_14.10/SANDY/bufrlib/lib?
Thank you!
Julie
On Thu, Mar 10, 2016 at 12:20 PM, Jose Garcia-Rivera via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
>
> Dear Julie,
>
> The administrator re-compiled MET following your instructions, and
> says there's still trouble. He sent me the log files (attached). Is
> there any other approach that might help?
>
> Best Regards,
> Jose
>
> -----Original Message-----
> From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> Sent: Wednesday, March 09, 2016 12:39 PM
> To: Jose Garcia-Rivera
> Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to
> NetCDF
>
> Thank you, Jose! It looks like something went wrong during
compilation.
> I suggest recompiling MET to see if we can get this issue resolved.
> NCEP's BUFRLIB is used by the pb2nc MET tool, and is a required
> external library for pb2nc. MET is not yet compatible with BUFRLIB
version 11.0.0, so we
> suggest getting version 10.2.3. We are working on our online
tutorial for
> METv.5.1, but in the meantime, I'll point you to our online tutorial
> directions for installing BUFRLIB:
>
>
>
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.0/comp
> ilation/req_libs.php
>
> It is also important to review the necessary environment variables
to set:
>
>
>
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.0/comp
> ilation/configure.php
>
> For example,
>
> "Set *$MET_BUFR* to point to the main BUFR directory, or set
> *$MET_BUFRLIB* to point to the directory with the BUFR library
files.
> Because MET doesn't use any BUFR library include files, you don't
need
> to specify *$MET_BUFRINC* ."
>
> Once you've installed the required libraries and set up your
> environment variables, you'll be ready to configure MET
(instructions
> at the bottom of the last link above) and then compile and install
MET
> (
>
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.0/comp
> ilation/compile.php
> ).
> After re-installing MET, please run "make test" again. If you still
> encounter the same problem, please send me your *config.log* file
and
> your *make_install.log *file. Please let me know if you have any
questions.
>
> Please let us know how it goes.
>
> Thanks,
> Julie
>
>
>
>
> On Wed, Mar 9, 2016 at 10:22 AM, Jose Garcia-Rivera via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> >
> > Dear Julie,
> >
> > Attached is the test log file. It's showing the same issues on
pb2nc
> > even with the sample files.
> >
> > Best Regards,
> > Jose
> >
> > -----Original Message-----
> > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > Sent: Tuesday, March 08, 2016 5:28 PM
> > To: Jose Garcia-Rivera
> > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR
to
> > NetCDF
> >
> > Hi Jose. Thank you for uploading the files. Unfortunately, I am
> > unable to reproduce the error you are experiencing. I am
wondering
> > if you have successfully used pb2nc before. As a check could you
> > please run the following in your met-5.1/ directory:
> >
> > *make test >& make_test.log*
> >
> > and then send me the make_test.log file?
> >
> > Thanks,
> > Julie
> >
> > On Tue, Mar 8, 2016 at 11:29 AM, Jose Garcia-Rivera via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> > >
> > > Dear Julie,
> > >
> > > I just put the files in 'garcia_data'. I appreciate your help.
> > >
> > > Best Regards,
> > > Jose
> > >
> > > -----Original Message-----
> > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > Sent: Tuesday, March 08, 2016 1:12 PM
> > > To: Jose Garcia-Rivera
> > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR
> > > to NetCDF
> > >
> > > Hi Jose. I'm sorry to hear that you are having problems
converting
> > > a PREPBUFR file to NetCDF.
> > >
> > > Please upload your input files and configuration file to our
> > > anonymous ftp site as follows:
> > > http://www.dtcenter.org/met/users/support/met_help.php
> > >
> > > Then I can take a look and get back to you.
> > >
> > > Thanks,
> > > Julie
> > >
> > > On Tue, Mar 8, 2016 at 11:01 AM, Jose Garcia-Rivera via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > Tue Mar 08 11:01:25 2016: Request 75433 was acted upon.
> > > > Transaction: Ticket created by GarciaJ at imsg.com
> > > > Queue: met_help
> > > > Subject: Issues converting PREPBUFR to NetCDF
> > > > Owner: Nobody
> > > > Requestors: GarciaJ at imsg.com
> > > > Status: new
> > > > Ticket <URL:
> > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > >
> > > >
> > > >
> > > > Dear Met Help,
> > > >
> > > > Trying to convert a PREPBUFR file to NetCDF.
> > > >
> > > > I used the default PB2NC configure file, and got the
following:
> > > >
> > > > [garciaj at login prepbufr_obs]$ ./pb2nc gdas1.t12z.prepbufr.nr
> > > > gdas.20150820.t12z.nc PB2NCConfig_default DEBUG 1: Default
> > > > Config
> > > > File:
> > > > /work/apps/pgi_14.10/met-
5.1/share/met/config/PB2NCConfig_defaul
> > > > t DEBUG 1: User Config File: PB2NCConfig_default
> > > > DEBUG 1: Creating NetCDF File: gdas.20150820.t12z.nc
> > > > DEBUG 1: Processing PrepBufr File: gdas1.t12z.prepbufr.nr
> > > > DEBUG 1: Blocking PrepBufr file to:
/tmp/tmp_pb2nc_blk_32144_0
> > > > WARNING:
> > > > WARNING: process_pbfile() -> No PrepBufr messages to process
in file:
> > > > gdas1.t12z.prepbufr.nr
> > > > WARNING:
> > > > ERROR :
> > > > ERROR : write_netcdf_hdr_data() -> No PrepBufr messages
retained.
> > > > Nothing to write.
> > > > ERROR :
> > > >
> > > >
> > > > Thanks in advance for the help,
> > > > Jose M. Garcia-Rivera, PhD
> > > > IM Systems Group
> > > > Rockville/College Park, MD
> > > > This e-mail, including attachments, may include confidential
> > > > and/or proprietary information, and may be used only by the
> > > > person or entity to which it is addressed. If the reader of
this
> > > > e-mail is not the intended recipient or his or her authorized
> > > > agent, the reader is hereby notified that any dissemination,
> > > > distribution or copying of this e-mail is prohibited. If you
> > > > have received this e-mail in error, please notify the sender
by
> > > > replying to this message and delete this
> > > e-mail immediately.
> > > >
> > > >
> > >
> > >
> > > --
> > > Julie Prestopnik
> > > National Center for Atmospheric Research Research Applications
> > > Laboratory
> > > Phone: 303.497.8399
> > > Email: jpresto at ucar.edu
> > >
> > > This e-mail, including attachments, may include confidential
> > > and/or proprietary information, and may be used only by the
person
> > > or entity to which it is addressed. If the reader of this e-mail
> > > is not the intended recipient or his or her authorized agent,
the
> > > reader is hereby notified that any dissemination, distribution
or
> > > copying of this e-mail is prohibited. If you have received this
> > > e-mail in error, please notify the sender by replying to this
> > > message and delete this
> > e-mail immediately.
> > >
> > >
> > >
> >
> >
> > --
> > Julie Prestopnik
> > National Center for Atmospheric Research Research Applications
> > Laboratory
> > Phone: 303.497.8399
> > Email: jpresto at ucar.edu
> >
> > This e-mail, including attachments, may include confidential
and/or
> > proprietary information, and may be used only by the person or
> > entity to which it is addressed. If the reader of this e-mail is
not
> > the intended recipient or his or her authorized agent, the reader
is
> > hereby notified that any dissemination, distribution or copying of
> > this e-mail is prohibited. If you have received this e-mail in
> > error, please notify the sender by replying to this message and
> > delete this
> e-mail immediately.
> >
> >
>
>
> --
> Julie Prestopnik
> National Center for Atmospheric Research Research Applications
> Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
> This e-mail, including attachments, may include confidential and/or
> proprietary information, and may be used only by the person or
entity
> to which it is addressed. If the reader of this e-mail is not the
> intended recipient or his or her authorized agent, the reader is
> hereby notified that any dissemination, distribution or copying of
> this e-mail is prohibited. If you have received this e-mail in
error,
> please notify the sender by replying to this message and delete this
e-mail immediately.
>
>
--
Julie Prestopnik
National Center for Atmospheric Research Research Applications
Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
This e-mail, including attachments, may include confidential and/or
proprietary information, and may be used only by the person or entity
to which it is addressed. If the reader of this e-mail is not the
intended recipient or his or her authorized agent, the reader is
hereby notified that any dissemination, distribution or copying of
this e-mail is prohibited. If you have received this e-mail in error,
please notify the sender by replying to this message and delete this
e-mail immediately.
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to NetCDF
From: Jose Garcia-Rivera
Time: Fri Mar 11 14:02:12 2016
Dear Julie,
Any news regarding pb2nc? We're still unable to make it work.
Best Regards,
Jose
-----Original Message-----
From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
Sent: Thursday, March 10, 2016 4:20 PM
To: Jose Garcia-Rivera
Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to
NetCDF
Hi Jose. Thank you for attaching the files.
Could you please send me a list of the files in
/work/apps/pgi_14.10/SANDY/bufrlib/lib?
Thank you!
Julie
On Thu, Mar 10, 2016 at 12:20 PM, Jose Garcia-Rivera via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
>
> Dear Julie,
>
> The administrator re-compiled MET following your instructions, and
> says there's still trouble. He sent me the log files (attached). Is
> there any other approach that might help?
>
> Best Regards,
> Jose
>
> -----Original Message-----
> From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> Sent: Wednesday, March 09, 2016 12:39 PM
> To: Jose Garcia-Rivera
> Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to
> NetCDF
>
> Thank you, Jose! It looks like something went wrong during
compilation.
> I suggest recompiling MET to see if we can get this issue resolved.
> NCEP's BUFRLIB is used by the pb2nc MET tool, and is a required
> external library for pb2nc. MET is not yet compatible with BUFRLIB
version 11.0.0, so we
> suggest getting version 10.2.3. We are working on our online
tutorial for
> METv.5.1, but in the meantime, I'll point you to our online tutorial
> directions for installing BUFRLIB:
>
>
>
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.0/comp
> ilation/req_libs.php
>
> It is also important to review the necessary environment variables
to set:
>
>
>
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.0/comp
> ilation/configure.php
>
> For example,
>
> "Set *$MET_BUFR* to point to the main BUFR directory, or set
> *$MET_BUFRLIB* to point to the directory with the BUFR library
files.
> Because MET doesn't use any BUFR library include files, you don't
need
> to specify *$MET_BUFRINC* ."
>
> Once you've installed the required libraries and set up your
> environment variables, you'll be ready to configure MET
(instructions
> at the bottom of the last link above) and then compile and install
MET
> (
>
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.0/comp
> ilation/compile.php
> ).
> After re-installing MET, please run "make test" again. If you still
> encounter the same problem, please send me your *config.log* file
and
> your *make_install.log *file. Please let me know if you have any
questions.
>
> Please let us know how it goes.
>
> Thanks,
> Julie
>
>
>
>
> On Wed, Mar 9, 2016 at 10:22 AM, Jose Garcia-Rivera via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> >
> > Dear Julie,
> >
> > Attached is the test log file. It's showing the same issues on
pb2nc
> > even with the sample files.
> >
> > Best Regards,
> > Jose
> >
> > -----Original Message-----
> > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > Sent: Tuesday, March 08, 2016 5:28 PM
> > To: Jose Garcia-Rivera
> > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR
to
> > NetCDF
> >
> > Hi Jose. Thank you for uploading the files. Unfortunately, I am
> > unable to reproduce the error you are experiencing. I am
wondering
> > if you have successfully used pb2nc before. As a check could you
> > please run the following in your met-5.1/ directory:
> >
> > *make test >& make_test.log*
> >
> > and then send me the make_test.log file?
> >
> > Thanks,
> > Julie
> >
> > On Tue, Mar 8, 2016 at 11:29 AM, Jose Garcia-Rivera via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> > >
> > > Dear Julie,
> > >
> > > I just put the files in 'garcia_data'. I appreciate your help.
> > >
> > > Best Regards,
> > > Jose
> > >
> > > -----Original Message-----
> > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > Sent: Tuesday, March 08, 2016 1:12 PM
> > > To: Jose Garcia-Rivera
> > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR
> > > to NetCDF
> > >
> > > Hi Jose. I'm sorry to hear that you are having problems
converting
> > > a PREPBUFR file to NetCDF.
> > >
> > > Please upload your input files and configuration file to our
> > > anonymous ftp site as follows:
> > > http://www.dtcenter.org/met/users/support/met_help.php
> > >
> > > Then I can take a look and get back to you.
> > >
> > > Thanks,
> > > Julie
> > >
> > > On Tue, Mar 8, 2016 at 11:01 AM, Jose Garcia-Rivera via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > Tue Mar 08 11:01:25 2016: Request 75433 was acted upon.
> > > > Transaction: Ticket created by GarciaJ at imsg.com
> > > > Queue: met_help
> > > > Subject: Issues converting PREPBUFR to NetCDF
> > > > Owner: Nobody
> > > > Requestors: GarciaJ at imsg.com
> > > > Status: new
> > > > Ticket <URL:
> > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > >
> > > >
> > > >
> > > > Dear Met Help,
> > > >
> > > > Trying to convert a PREPBUFR file to NetCDF.
> > > >
> > > > I used the default PB2NC configure file, and got the
following:
> > > >
> > > > [garciaj at login prepbufr_obs]$ ./pb2nc gdas1.t12z.prepbufr.nr
> > > > gdas.20150820.t12z.nc PB2NCConfig_default DEBUG 1: Default
> > > > Config
> > > > File:
> > > > /work/apps/pgi_14.10/met-
5.1/share/met/config/PB2NCConfig_defaul
> > > > t DEBUG 1: User Config File: PB2NCConfig_default
> > > > DEBUG 1: Creating NetCDF File: gdas.20150820.t12z.nc
> > > > DEBUG 1: Processing PrepBufr File: gdas1.t12z.prepbufr.nr
> > > > DEBUG 1: Blocking PrepBufr file to:
/tmp/tmp_pb2nc_blk_32144_0
> > > > WARNING:
> > > > WARNING: process_pbfile() -> No PrepBufr messages to process
in file:
> > > > gdas1.t12z.prepbufr.nr
> > > > WARNING:
> > > > ERROR :
> > > > ERROR : write_netcdf_hdr_data() -> No PrepBufr messages
retained.
> > > > Nothing to write.
> > > > ERROR :
> > > >
> > > >
> > > > Thanks in advance for the help,
> > > > Jose M. Garcia-Rivera, PhD
> > > > IM Systems Group
> > > > Rockville/College Park, MD
> > > > This e-mail, including attachments, may include confidential
> > > > and/or proprietary information, and may be used only by the
> > > > person or entity to which it is addressed. If the reader of
this
> > > > e-mail is not the intended recipient or his or her authorized
> > > > agent, the reader is hereby notified that any dissemination,
> > > > distribution or copying of this e-mail is prohibited. If you
> > > > have received this e-mail in error, please notify the sender
by
> > > > replying to this message and delete this
> > > e-mail immediately.
> > > >
> > > >
> > >
> > >
> > > --
> > > Julie Prestopnik
> > > National Center for Atmospheric Research Research Applications
> > > Laboratory
> > > Phone: 303.497.8399
> > > Email: jpresto at ucar.edu
> > >
> > > This e-mail, including attachments, may include confidential
> > > and/or proprietary information, and may be used only by the
person
> > > or entity to which it is addressed. If the reader of this e-mail
> > > is not the intended recipient or his or her authorized agent,
the
> > > reader is hereby notified that any dissemination, distribution
or
> > > copying of this e-mail is prohibited. If you have received this
> > > e-mail in error, please notify the sender by replying to this
> > > message and delete this
> > e-mail immediately.
> > >
> > >
> > >
> >
> >
> > --
> > Julie Prestopnik
> > National Center for Atmospheric Research Research Applications
> > Laboratory
> > Phone: 303.497.8399
> > Email: jpresto at ucar.edu
> >
> > This e-mail, including attachments, may include confidential
and/or
> > proprietary information, and may be used only by the person or
> > entity to which it is addressed. If the reader of this e-mail is
not
> > the intended recipient or his or her authorized agent, the reader
is
> > hereby notified that any dissemination, distribution or copying of
> > this e-mail is prohibited. If you have received this e-mail in
> > error, please notify the sender by replying to this message and
> > delete this
> e-mail immediately.
> >
> >
>
>
> --
> Julie Prestopnik
> National Center for Atmospheric Research Research Applications
> Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
> This e-mail, including attachments, may include confidential and/or
> proprietary information, and may be used only by the person or
entity
> to which it is addressed. If the reader of this e-mail is not the
> intended recipient or his or her authorized agent, the reader is
> hereby notified that any dissemination, distribution or copying of
> this e-mail is prohibited. If you have received this e-mail in
error,
> please notify the sender by replying to this message and delete this
e-mail immediately.
>
>
--
Julie Prestopnik
National Center for Atmospheric Research Research Applications
Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
This e-mail, including attachments, may include confidential and/or
proprietary information, and may be used only by the person or entity
to which it is addressed. If the reader of this e-mail is not the
intended recipient or his or her authorized agent, the reader is
hereby notified that any dissemination, distribution or copying of
this e-mail is prohibited. If you have received this e-mail in error,
please notify the sender by replying to this message and delete this
e-mail immediately.
------------------------------------------------
Subject: Issues converting PREPBUFR to NetCDF
From: Julie Prestopnik
Time: Mon Mar 14 10:17:12 2016
Hi Jose. I apologize for the delayed response. I was out of the
office on
Friday. I'm going to try to figure out a solution and get back with
you
shortly.
Julie
On Fri, Mar 11, 2016 at 2:02 PM, Jose Garcia-Rivera via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
>
> Dear Julie,
>
> Any news regarding pb2nc? We're still unable to make it work.
>
> Best Regards,
> Jose
>
> -----Original Message-----
> From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> Sent: Thursday, March 10, 2016 4:20 PM
> To: Jose Garcia-Rivera
> Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to
NetCDF
>
> Hi Jose. Thank you for attaching the files.
>
> Could you please send me a list of the files in
> /work/apps/pgi_14.10/SANDY/bufrlib/lib?
>
> Thank you!
>
> Julie
>
>
> On Thu, Mar 10, 2016 at 12:20 PM, Jose Garcia-Rivera via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> >
> > Dear Julie,
> >
> > The administrator re-compiled MET following your instructions, and
> > says there's still trouble. He sent me the log files (attached).
Is
> > there any other approach that might help?
> >
> > Best Regards,
> > Jose
> >
> > -----Original Message-----
> > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > Sent: Wednesday, March 09, 2016 12:39 PM
> > To: Jose Garcia-Rivera
> > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR
to
> > NetCDF
> >
> > Thank you, Jose! It looks like something went wrong during
compilation.
> > I suggest recompiling MET to see if we can get this issue
resolved.
> > NCEP's BUFRLIB is used by the pb2nc MET tool, and is a required
> > external library for pb2nc. MET is not yet compatible with
BUFRLIB
> version 11.0.0, so we
> > suggest getting version 10.2.3. We are working on our online
tutorial
> for
> > METv.5.1, but in the meantime, I'll point you to our online
tutorial
> > directions for installing BUFRLIB:
> >
> >
> >
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.0/comp
> > ilation/req_libs.php
> >
> > It is also important to review the necessary environment variables
to
> set:
> >
> >
> >
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.0/comp
> > ilation/configure.php
> >
> > For example,
> >
> > "Set *$MET_BUFR* to point to the main BUFR directory, or set
> > *$MET_BUFRLIB* to point to the directory with the BUFR library
files.
> > Because MET doesn't use any BUFR library include files, you don't
need
> > to specify *$MET_BUFRINC* ."
> >
> > Once you've installed the required libraries and set up your
> > environment variables, you'll be ready to configure MET
(instructions
> > at the bottom of the last link above) and then compile and install
MET
> > (
> >
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.0/comp
> > ilation/compile.php
> > ).
> > After re-installing MET, please run "make test" again. If you
still
> > encounter the same problem, please send me your *config.log* file
and
> > your *make_install.log *file. Please let me know if you have any
> questions.
> >
> > Please let us know how it goes.
> >
> > Thanks,
> > Julie
> >
> >
> >
> >
> > On Wed, Mar 9, 2016 at 10:22 AM, Jose Garcia-Rivera via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> > >
> > > Dear Julie,
> > >
> > > Attached is the test log file. It's showing the same issues on
pb2nc
> > > even with the sample files.
> > >
> > > Best Regards,
> > > Jose
> > >
> > > -----Original Message-----
> > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > Sent: Tuesday, March 08, 2016 5:28 PM
> > > To: Jose Garcia-Rivera
> > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR
to
> > > NetCDF
> > >
> > > Hi Jose. Thank you for uploading the files. Unfortunately, I
am
> > > unable to reproduce the error you are experiencing. I am
wondering
> > > if you have successfully used pb2nc before. As a check could
you
> > > please run the following in your met-5.1/ directory:
> > >
> > > *make test >& make_test.log*
> > >
> > > and then send me the make_test.log file?
> > >
> > > Thanks,
> > > Julie
> > >
> > > On Tue, Mar 8, 2016 at 11:29 AM, Jose Garcia-Rivera via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
>
> > > >
> > > > Dear Julie,
> > > >
> > > > I just put the files in 'garcia_data'. I appreciate your help.
> > > >
> > > > Best Regards,
> > > > Jose
> > > >
> > > > -----Original Message-----
> > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > Sent: Tuesday, March 08, 2016 1:12 PM
> > > > To: Jose Garcia-Rivera
> > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
PREPBUFR
> > > > to NetCDF
> > > >
> > > > Hi Jose. I'm sorry to hear that you are having problems
converting
> > > > a PREPBUFR file to NetCDF.
> > > >
> > > > Please upload your input files and configuration file to our
> > > > anonymous ftp site as follows:
> > > > http://www.dtcenter.org/met/users/support/met_help.php
> > > >
> > > > Then I can take a look and get back to you.
> > > >
> > > > Thanks,
> > > > Julie
> > > >
> > > > On Tue, Mar 8, 2016 at 11:01 AM, Jose Garcia-Rivera via RT <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > > >
> > > > > Tue Mar 08 11:01:25 2016: Request 75433 was acted upon.
> > > > > Transaction: Ticket created by GarciaJ at imsg.com
> > > > > Queue: met_help
> > > > > Subject: Issues converting PREPBUFR to NetCDF
> > > > > Owner: Nobody
> > > > > Requestors: GarciaJ at imsg.com
> > > > > Status: new
> > > > > Ticket <URL:
> > > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > >
> > > > >
> > > > >
> > > > > Dear Met Help,
> > > > >
> > > > > Trying to convert a PREPBUFR file to NetCDF.
> > > > >
> > > > > I used the default PB2NC configure file, and got the
following:
> > > > >
> > > > > [garciaj at login prepbufr_obs]$ ./pb2nc gdas1.t12z.prepbufr.nr
> > > > > gdas.20150820.t12z.nc PB2NCConfig_default DEBUG 1: Default
> > > > > Config
> > > > > File:
> > > > > /work/apps/pgi_14.10/met-
5.1/share/met/config/PB2NCConfig_defaul
> > > > > t DEBUG 1: User Config File: PB2NCConfig_default
> > > > > DEBUG 1: Creating NetCDF File:
gdas.20150820.t12z.nc
> > > > > DEBUG 1: Processing PrepBufr File:
gdas1.t12z.prepbufr.nr
> > > > > DEBUG 1: Blocking PrepBufr file to:
/tmp/tmp_pb2nc_blk_32144_0
> > > > > WARNING:
> > > > > WARNING: process_pbfile() -> No PrepBufr messages to process
in
> file:
> > > > > gdas1.t12z.prepbufr.nr
> > > > > WARNING:
> > > > > ERROR :
> > > > > ERROR : write_netcdf_hdr_data() -> No PrepBufr messages
retained.
> > > > > Nothing to write.
> > > > > ERROR :
> > > > >
> > > > >
> > > > > Thanks in advance for the help,
> > > > > Jose M. Garcia-Rivera, PhD
> > > > > IM Systems Group
> > > > > Rockville/College Park, MD
> > > > > This e-mail, including attachments, may include confidential
> > > > > and/or proprietary information, and may be used only by the
> > > > > person or entity to which it is addressed. If the reader of
this
> > > > > e-mail is not the intended recipient or his or her
authorized
> > > > > agent, the reader is hereby notified that any dissemination,
> > > > > distribution or copying of this e-mail is prohibited. If you
> > > > > have received this e-mail in error, please notify the sender
by
> > > > > replying to this message and delete this
> > > > e-mail immediately.
> > > > >
> > > > >
> > > >
> > > >
> > > > --
> > > > Julie Prestopnik
> > > > National Center for Atmospheric Research Research Applications
> > > > Laboratory
> > > > Phone: 303.497.8399
> > > > Email: jpresto at ucar.edu
> > > >
> > > > This e-mail, including attachments, may include confidential
> > > > and/or proprietary information, and may be used only by the
person
> > > > or entity to which it is addressed. If the reader of this e-
mail
> > > > is not the intended recipient or his or her authorized agent,
the
> > > > reader is hereby notified that any dissemination, distribution
or
> > > > copying of this e-mail is prohibited. If you have received
this
> > > > e-mail in error, please notify the sender by replying to this
> > > > message and delete this
> > > e-mail immediately.
> > > >
> > > >
> > > >
> > >
> > >
> > > --
> > > Julie Prestopnik
> > > National Center for Atmospheric Research Research Applications
> > > Laboratory
> > > Phone: 303.497.8399
> > > Email: jpresto at ucar.edu
> > >
> > > This e-mail, including attachments, may include confidential
and/or
> > > proprietary information, and may be used only by the person or
> > > entity to which it is addressed. If the reader of this e-mail is
not
> > > the intended recipient or his or her authorized agent, the
reader is
> > > hereby notified that any dissemination, distribution or copying
of
> > > this e-mail is prohibited. If you have received this e-mail in
> > > error, please notify the sender by replying to this message and
> > > delete this
> > e-mail immediately.
> > >
> > >
> >
> >
> > --
> > Julie Prestopnik
> > National Center for Atmospheric Research Research Applications
> > Laboratory
> > Phone: 303.497.8399
> > Email: jpresto at ucar.edu
> >
> > This e-mail, including attachments, may include confidential
and/or
> > proprietary information, and may be used only by the person or
entity
> > to which it is addressed. If the reader of this e-mail is not the
> > intended recipient or his or her authorized agent, the reader is
> > hereby notified that any dissemination, distribution or copying of
> > this e-mail is prohibited. If you have received this e-mail in
error,
> > please notify the sender by replying to this message and delete
this
> e-mail immediately.
> >
> >
>
>
> --
> Julie Prestopnik
> National Center for Atmospheric Research Research Applications
Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
> This e-mail, including attachments, may include confidential and/or
> proprietary information, and may be used only by the person or
entity to
> which it is addressed. If the reader of this e-mail is not the
intended
> recipient or his or her authorized agent, the reader is hereby
notified
> that any dissemination, distribution or copying of this e-mail is
> prohibited. If you have received this e-mail in error, please notify
the
> sender by replying to this message and delete this e-mail
immediately.
>
>
>
--
Julie Prestopnik
National Center for Atmospheric Research
Research Applications Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to NetCDF
From: Jose Garcia-Rivera
Time: Mon Mar 14 13:06:43 2016
Dear Julie,
I got to convert my prepbufr file using a python script. However, I
have trouble running point_stat. Can I send you the files, to see if
you have the same issue?
This is what I got:
[garciaj at login prepbufr_obs]$ ./point_stat nmbprs_d01.06 test.nc
PointStatConfig_default
DEBUG 1: Default Config File: /work/apps/pgi_14.10/SANDY/met-
5.1/share/met/config/PointStatConfig_default
DEBUG 1: User Config File: PointStatConfig_default
GSL_RNG_TYPE=mt19937
GSL_RNG_SEED=18446744073425053526
DEBUG 1: Forecast File: nmbprs_d01.06
DEBUG 1: Observation File: test.nc
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Reading data for SPFH/P500.
DEBUG 2: For SPFH/P500 found 1 forecast levels and 0 climatology
levels.
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Reading data for TMP/P500.
DEBUG 2: For TMP/P500 found 1 forecast levels and 0 climatology
levels.
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Reading data for HGT/P500.
DEBUG 2: For HGT/P500 found 1 forecast levels and 0 climatology
levels.
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Reading data for UGRD/P500.
DEBUG 2: For UGRD/P500 found 1 forecast levels and 0 climatology
levels.
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Reading data for VGRD/P500.
DEBUG 2: For VGRD/P500 found 1 forecast levels and 0 climatology
levels.
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
WARNING:
WARNING: process_obs_file() -> can't open observation netCDF file:
test.nc
WARNING:
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Processing SPFH/P500 versus SPFH/P500, for observation type
ADPUPA, over region FULL, for interpolation method NEAREST(1), using 0
pairs.
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Processing TMP/P500 versus TMP/P500, for observation type
ADPUPA, over region FULL, for interpolation method NEAREST(1), using 0
pairs.
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Processing HGT/P500 versus HGT/P500, for observation type
ADPUPA, over region FULL, for interpolation method NEAREST(1), using 0
pairs.
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Processing UGRD/P500 versus UGRD/P500, for observation type
ADPUPA, over region FULL, for interpolation method NEAREST(1), using 0
pairs.
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Processing VGRD/P500 versus VGRD/P500, for observation type
ADPUPA, over region FULL, for interpolation method NEAREST(1), using 0
pairs.
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V.stat
DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_fho.txt
DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_ctc.txt
DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_cts.txt
DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_mctc.txt
DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_mcts.txt
DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_cnt.txt
DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_sl1l2.txt
DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_sal1l2.txt
DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_vl1l2.txt
DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_val1l2.txt
DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_pct.txt
DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_pstd.txt
DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_pjc.txt
DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_prc.txt
DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_mpr.txt
Thanks for the help,
Jose
-----Original Message-----
From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
Sent: Monday, March 14, 2016 12:17 PM
To: Jose Garcia-Rivera
Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to
NetCDF
Hi Jose. I apologize for the delayed response. I was out of the
office on Friday. I'm going to try to figure out a solution and get
back with you shortly.
Julie
On Fri, Mar 11, 2016 at 2:02 PM, Jose Garcia-Rivera via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
>
> Dear Julie,
>
> Any news regarding pb2nc? We're still unable to make it work.
>
> Best Regards,
> Jose
>
> -----Original Message-----
> From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> Sent: Thursday, March 10, 2016 4:20 PM
> To: Jose Garcia-Rivera
> Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to
> NetCDF
>
> Hi Jose. Thank you for attaching the files.
>
> Could you please send me a list of the files in
> /work/apps/pgi_14.10/SANDY/bufrlib/lib?
>
> Thank you!
>
> Julie
>
>
> On Thu, Mar 10, 2016 at 12:20 PM, Jose Garcia-Rivera via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> >
> > Dear Julie,
> >
> > The administrator re-compiled MET following your instructions, and
> > says there's still trouble. He sent me the log files (attached).
Is
> > there any other approach that might help?
> >
> > Best Regards,
> > Jose
> >
> > -----Original Message-----
> > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > Sent: Wednesday, March 09, 2016 12:39 PM
> > To: Jose Garcia-Rivera
> > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR
to
> > NetCDF
> >
> > Thank you, Jose! It looks like something went wrong during
compilation.
> > I suggest recompiling MET to see if we can get this issue
resolved.
> > NCEP's BUFRLIB is used by the pb2nc MET tool, and is a required
> > external library for pb2nc. MET is not yet compatible with
BUFRLIB
> version 11.0.0, so we
> > suggest getting version 10.2.3. We are working on our online
tutorial
> for
> > METv.5.1, but in the meantime, I'll point you to our online
tutorial
> > directions for installing BUFRLIB:
> >
> >
> >
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.0/co
> > mp
> > ilation/req_libs.php
> >
> > It is also important to review the necessary environment variables
> > to
> set:
> >
> >
> >
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.0/co
> > mp
> > ilation/configure.php
> >
> > For example,
> >
> > "Set *$MET_BUFR* to point to the main BUFR directory, or set
> > *$MET_BUFRLIB* to point to the directory with the BUFR library
files.
> > Because MET doesn't use any BUFR library include files, you don't
> > need to specify *$MET_BUFRINC* ."
> >
> > Once you've installed the required libraries and set up your
> > environment variables, you'll be ready to configure MET
> > (instructions at the bottom of the last link above) and then
compile
> > and install MET (
> >
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.0/co
> > mp
> > ilation/compile.php
> > ).
> > After re-installing MET, please run "make test" again. If you
still
> > encounter the same problem, please send me your *config.log* file
> > and your *make_install.log *file. Please let me know if you have
> > any
> questions.
> >
> > Please let us know how it goes.
> >
> > Thanks,
> > Julie
> >
> >
> >
> >
> > On Wed, Mar 9, 2016 at 10:22 AM, Jose Garcia-Rivera via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> > >
> > > Dear Julie,
> > >
> > > Attached is the test log file. It's showing the same issues on
> > > pb2nc even with the sample files.
> > >
> > > Best Regards,
> > > Jose
> > >
> > > -----Original Message-----
> > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > Sent: Tuesday, March 08, 2016 5:28 PM
> > > To: Jose Garcia-Rivera
> > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR
> > > to NetCDF
> > >
> > > Hi Jose. Thank you for uploading the files. Unfortunately, I
am
> > > unable to reproduce the error you are experiencing. I am
> > > wondering if you have successfully used pb2nc before. As a
check
> > > could you please run the following in your met-5.1/ directory:
> > >
> > > *make test >& make_test.log*
> > >
> > > and then send me the make_test.log file?
> > >
> > > Thanks,
> > > Julie
> > >
> > > On Tue, Mar 8, 2016 at 11:29 AM, Jose Garcia-Rivera via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
>
> > > >
> > > > Dear Julie,
> > > >
> > > > I just put the files in 'garcia_data'. I appreciate your help.
> > > >
> > > > Best Regards,
> > > > Jose
> > > >
> > > > -----Original Message-----
> > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > Sent: Tuesday, March 08, 2016 1:12 PM
> > > > To: Jose Garcia-Rivera
> > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
PREPBUFR
> > > > to NetCDF
> > > >
> > > > Hi Jose. I'm sorry to hear that you are having problems
> > > > converting a PREPBUFR file to NetCDF.
> > > >
> > > > Please upload your input files and configuration file to our
> > > > anonymous ftp site as follows:
> > > > http://www.dtcenter.org/met/users/support/met_help.php
> > > >
> > > > Then I can take a look and get back to you.
> > > >
> > > > Thanks,
> > > > Julie
> > > >
> > > > On Tue, Mar 8, 2016 at 11:01 AM, Jose Garcia-Rivera via RT <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > > >
> > > > > Tue Mar 08 11:01:25 2016: Request 75433 was acted upon.
> > > > > Transaction: Ticket created by GarciaJ at imsg.com
> > > > > Queue: met_help
> > > > > Subject: Issues converting PREPBUFR to NetCDF
> > > > > Owner: Nobody
> > > > > Requestors: GarciaJ at imsg.com
> > > > > Status: new
> > > > > Ticket <URL:
> > > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > >
> > > > >
> > > > >
> > > > > Dear Met Help,
> > > > >
> > > > > Trying to convert a PREPBUFR file to NetCDF.
> > > > >
> > > > > I used the default PB2NC configure file, and got the
following:
> > > > >
> > > > > [garciaj at login prepbufr_obs]$ ./pb2nc gdas1.t12z.prepbufr.nr
> > > > > gdas.20150820.t12z.nc PB2NCConfig_default DEBUG 1: Default
> > > > > Config
> > > > > File:
> > > > > /work/apps/pgi_14.10/met-
5.1/share/met/config/PB2NCConfig_defa
> > > > > ul t DEBUG 1: User Config File: PB2NCConfig_default
> > > > > DEBUG 1: Creating NetCDF File:
gdas.20150820.t12z.nc
> > > > > DEBUG 1: Processing PrepBufr File:
gdas1.t12z.prepbufr.nr
> > > > > DEBUG 1: Blocking PrepBufr file to:
/tmp/tmp_pb2nc_blk_32144_0
> > > > > WARNING:
> > > > > WARNING: process_pbfile() -> No PrepBufr messages to process
> > > > > in
> file:
> > > > > gdas1.t12z.prepbufr.nr
> > > > > WARNING:
> > > > > ERROR :
> > > > > ERROR : write_netcdf_hdr_data() -> No PrepBufr messages
retained.
> > > > > Nothing to write.
> > > > > ERROR :
> > > > >
> > > > >
> > > > > Thanks in advance for the help, Jose M. Garcia-Rivera, PhD
IM
> > > > > Systems Group Rockville/College Park, MD This e-mail,
> > > > > including attachments, may include confidential and/or
> > > > > proprietary information, and may be used only by the person
or
> > > > > entity to which it is addressed. If the reader of this e-
mail
> > > > > is not the intended recipient or his or her authorized
agent,
> > > > > the reader is hereby notified that any dissemination,
> > > > > distribution or copying of this e-mail is prohibited. If you
> > > > > have received this e-mail in error, please notify the sender
> > > > > by replying to this message and delete this
> > > > e-mail immediately.
> > > > >
> > > > >
> > > >
> > > >
> > > > --
> > > > Julie Prestopnik
> > > > National Center for Atmospheric Research Research Applications
> > > > Laboratory
> > > > Phone: 303.497.8399
> > > > Email: jpresto at ucar.edu
> > > >
> > > > This e-mail, including attachments, may include confidential
> > > > and/or proprietary information, and may be used only by the
> > > > person or entity to which it is addressed. If the reader of
this
> > > > e-mail is not the intended recipient or his or her authorized
> > > > agent, the reader is hereby notified that any dissemination,
> > > > distribution or copying of this e-mail is prohibited. If you
> > > > have received this e-mail in error, please notify the sender
by
> > > > replying to this message and delete this
> > > e-mail immediately.
> > > >
> > > >
> > > >
> > >
> > >
> > > --
> > > Julie Prestopnik
> > > National Center for Atmospheric Research Research Applications
> > > Laboratory
> > > Phone: 303.497.8399
> > > Email: jpresto at ucar.edu
> > >
> > > This e-mail, including attachments, may include confidential
> > > and/or proprietary information, and may be used only by the
person
> > > or entity to which it is addressed. If the reader of this e-mail
> > > is not the intended recipient or his or her authorized agent,
the
> > > reader is hereby notified that any dissemination, distribution
or
> > > copying of this e-mail is prohibited. If you have received this
> > > e-mail in error, please notify the sender by replying to this
> > > message and delete this
> > e-mail immediately.
> > >
> > >
> >
> >
> > --
> > Julie Prestopnik
> > National Center for Atmospheric Research Research Applications
> > Laboratory
> > Phone: 303.497.8399
> > Email: jpresto at ucar.edu
> >
> > This e-mail, including attachments, may include confidential
and/or
> > proprietary information, and may be used only by the person or
> > entity to which it is addressed. If the reader of this e-mail is
not
> > the intended recipient or his or her authorized agent, the reader
is
> > hereby notified that any dissemination, distribution or copying of
> > this e-mail is prohibited. If you have received this e-mail in
> > error, please notify the sender by replying to this message and
> > delete this
> e-mail immediately.
> >
> >
>
>
> --
> Julie Prestopnik
> National Center for Atmospheric Research Research Applications
> Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
> This e-mail, including attachments, may include confidential and/or
> proprietary information, and may be used only by the person or
entity
> to which it is addressed. If the reader of this e-mail is not the
> intended recipient or his or her authorized agent, the reader is
> hereby notified that any dissemination, distribution or copying of
> this e-mail is prohibited. If you have received this e-mail in
error,
> please notify the sender by replying to this message and delete this
e-mail immediately.
>
>
>
--
Julie Prestopnik
National Center for Atmospheric Research Research Applications
Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
This e-mail, including attachments, may include confidential and/or
proprietary information, and may be used only by the person or entity
to which it is addressed. If the reader of this e-mail is not the
intended recipient or his or her authorized agent, the reader is
hereby notified that any dissemination, distribution or copying of
this e-mail is prohibited. If you have received this e-mail in error,
please notify the sender by replying to this message and delete this
e-mail immediately.
------------------------------------------------
Subject: Issues converting PREPBUFR to NetCDF
From: Julie Prestopnik
Time: Mon Mar 14 13:31:45 2016
Hi Jose.
Yes, please upload your input files and configuration file
(nmbprs_d01.06,
test.nc, PointStatConfig_default) to our anonymous ftp site as
follows:
http://www.dtcenter.org/met/users/support/met_help.php
Thanks!
Julie
On Mon, Mar 14, 2016 at 1:06 PM, Jose Garcia-Rivera via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
>
> Dear Julie,
>
> I got to convert my prepbufr file using a python script. However, I
have
> trouble running point_stat. Can I send you the files, to see if you
have
> the same issue?
>
>
> This is what I got:
>
> [garciaj at login prepbufr_obs]$ ./point_stat nmbprs_d01.06 test.nc
> PointStatConfig_default
> DEBUG 1: Default Config File:
> /work/apps/pgi_14.10/SANDY/met-
5.1/share/met/config/PointStatConfig_default
> DEBUG 1: User Config File: PointStatConfig_default
> GSL_RNG_TYPE=mt19937
> GSL_RNG_SEED=18446744073425053526
> DEBUG 1: Forecast File: nmbprs_d01.06
> DEBUG 1: Observation File: test.nc
> DEBUG 2:
> DEBUG 2:
>
--------------------------------------------------------------------------------
> DEBUG 2:
> DEBUG 2: Reading data for SPFH/P500.
> DEBUG 2: For SPFH/P500 found 1 forecast levels and 0 climatology
levels.
> DEBUG 2:
> DEBUG 2:
>
--------------------------------------------------------------------------------
> DEBUG 2:
> DEBUG 2: Reading data for TMP/P500.
> DEBUG 2: For TMP/P500 found 1 forecast levels and 0 climatology
levels.
> DEBUG 2:
> DEBUG 2:
>
--------------------------------------------------------------------------------
> DEBUG 2:
> DEBUG 2: Reading data for HGT/P500.
> DEBUG 2: For HGT/P500 found 1 forecast levels and 0 climatology
levels.
> DEBUG 2:
> DEBUG 2:
>
--------------------------------------------------------------------------------
> DEBUG 2:
> DEBUG 2: Reading data for UGRD/P500.
> DEBUG 2: For UGRD/P500 found 1 forecast levels and 0 climatology
levels.
> DEBUG 2:
> DEBUG 2:
>
--------------------------------------------------------------------------------
> DEBUG 2:
> DEBUG 2: Reading data for VGRD/P500.
> DEBUG 2: For VGRD/P500 found 1 forecast levels and 0 climatology
levels.
> DEBUG 2:
> DEBUG 2:
>
--------------------------------------------------------------------------------
> DEBUG 2:
> WARNING:
> WARNING: process_obs_file() -> can't open observation netCDF file:
test.nc
> WARNING:
> DEBUG 2:
> DEBUG 2:
>
--------------------------------------------------------------------------------
> DEBUG 2:
> DEBUG 2: Processing SPFH/P500 versus SPFH/P500, for observation type
> ADPUPA, over region FULL, for interpolation method NEAREST(1), using
0
> pairs.
> DEBUG 2:
> DEBUG 2:
>
--------------------------------------------------------------------------------
> DEBUG 2:
> DEBUG 2: Processing TMP/P500 versus TMP/P500, for observation type
ADPUPA,
> over region FULL, for interpolation method NEAREST(1), using 0
pairs.
> DEBUG 2:
> DEBUG 2:
>
--------------------------------------------------------------------------------
> DEBUG 2:
> DEBUG 2: Processing HGT/P500 versus HGT/P500, for observation type
ADPUPA,
> over region FULL, for interpolation method NEAREST(1), using 0
pairs.
> DEBUG 2:
> DEBUG 2:
>
--------------------------------------------------------------------------------
> DEBUG 2:
> DEBUG 2: Processing UGRD/P500 versus UGRD/P500, for observation type
> ADPUPA, over region FULL, for interpolation method NEAREST(1), using
0
> pairs.
> DEBUG 2:
> DEBUG 2:
>
--------------------------------------------------------------------------------
> DEBUG 2:
> DEBUG 2: Processing VGRD/P500 versus VGRD/P500, for observation type
> ADPUPA, over region FULL, for interpolation method NEAREST(1), using
0
> pairs.
> DEBUG 2:
> DEBUG 2:
>
--------------------------------------------------------------------------------
> DEBUG 2:
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V.stat
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_fho.txt
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_ctc.txt
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_cts.txt
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_mctc.txt
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_mcts.txt
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_cnt.txt
> DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_sl1l2.txt
> DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_sal1l2.txt
> DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_vl1l2.txt
> DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_val1l2.txt
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_pct.txt
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_pstd.txt
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_pjc.txt
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_prc.txt
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_mpr.txt
>
>
> Thanks for the help,
> Jose
>
>
> -----Original Message-----
> From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> Sent: Monday, March 14, 2016 12:17 PM
> To: Jose Garcia-Rivera
> Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to
NetCDF
>
> Hi Jose. I apologize for the delayed response. I was out of the
office
> on Friday. I'm going to try to figure out a solution and get back
with you
> shortly.
>
> Julie
>
> On Fri, Mar 11, 2016 at 2:02 PM, Jose Garcia-Rivera via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> >
> > Dear Julie,
> >
> > Any news regarding pb2nc? We're still unable to make it work.
> >
> > Best Regards,
> > Jose
> >
> > -----Original Message-----
> > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > Sent: Thursday, March 10, 2016 4:20 PM
> > To: Jose Garcia-Rivera
> > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR
to
> > NetCDF
> >
> > Hi Jose. Thank you for attaching the files.
> >
> > Could you please send me a list of the files in
> > /work/apps/pgi_14.10/SANDY/bufrlib/lib?
> >
> > Thank you!
> >
> > Julie
> >
> >
> > On Thu, Mar 10, 2016 at 12:20 PM, Jose Garcia-Rivera via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> > >
> > > Dear Julie,
> > >
> > > The administrator re-compiled MET following your instructions,
and
> > > says there's still trouble. He sent me the log files (attached).
Is
> > > there any other approach that might help?
> > >
> > > Best Regards,
> > > Jose
> > >
> > > -----Original Message-----
> > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > Sent: Wednesday, March 09, 2016 12:39 PM
> > > To: Jose Garcia-Rivera
> > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR
to
> > > NetCDF
> > >
> > > Thank you, Jose! It looks like something went wrong during
> compilation.
> > > I suggest recompiling MET to see if we can get this issue
resolved.
> > > NCEP's BUFRLIB is used by the pb2nc MET tool, and is a required
> > > external library for pb2nc. MET is not yet compatible with
BUFRLIB
> > version 11.0.0, so we
> > > suggest getting version 10.2.3. We are working on our online
tutorial
> > for
> > > METv.5.1, but in the meantime, I'll point you to our online
tutorial
> > > directions for installing BUFRLIB:
> > >
> > >
> > >
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.0/co
> > > mp
> > > ilation/req_libs.php
> > >
> > > It is also important to review the necessary environment
variables
> > > to
> > set:
> > >
> > >
> > >
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.0/co
> > > mp
> > > ilation/configure.php
> > >
> > > For example,
> > >
> > > "Set *$MET_BUFR* to point to the main BUFR directory, or set
> > > *$MET_BUFRLIB* to point to the directory with the BUFR library
files.
> > > Because MET doesn't use any BUFR library include files, you
don't
> > > need to specify *$MET_BUFRINC* ."
> > >
> > > Once you've installed the required libraries and set up your
> > > environment variables, you'll be ready to configure MET
> > > (instructions at the bottom of the last link above) and then
compile
> > > and install MET (
> > >
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.0/co
> > > mp
> > > ilation/compile.php
> > > ).
> > > After re-installing MET, please run "make test" again. If you
still
> > > encounter the same problem, please send me your *config.log*
file
> > > and your *make_install.log *file. Please let me know if you
have
> > > any
> > questions.
> > >
> > > Please let us know how it goes.
> > >
> > > Thanks,
> > > Julie
> > >
> > >
> > >
> > >
> > > On Wed, Mar 9, 2016 at 10:22 AM, Jose Garcia-Rivera via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
>
> > > >
> > > > Dear Julie,
> > > >
> > > > Attached is the test log file. It's showing the same issues on
> > > > pb2nc even with the sample files.
> > > >
> > > > Best Regards,
> > > > Jose
> > > >
> > > > -----Original Message-----
> > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > Sent: Tuesday, March 08, 2016 5:28 PM
> > > > To: Jose Garcia-Rivera
> > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
PREPBUFR
> > > > to NetCDF
> > > >
> > > > Hi Jose. Thank you for uploading the files. Unfortunately, I
am
> > > > unable to reproduce the error you are experiencing. I am
> > > > wondering if you have successfully used pb2nc before. As a
check
> > > > could you please run the following in your met-5.1/ directory:
> > > >
> > > > *make test >& make_test.log*
> > > >
> > > > and then send me the make_test.log file?
> > > >
> > > > Thanks,
> > > > Julie
> > > >
> > > > On Tue, Mar 8, 2016 at 11:29 AM, Jose Garcia-Rivera via RT <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > > >
> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> > > > >
> > > > > Dear Julie,
> > > > >
> > > > > I just put the files in 'garcia_data'. I appreciate your
help.
> > > > >
> > > > > Best Regards,
> > > > > Jose
> > > > >
> > > > > -----Original Message-----
> > > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > > Sent: Tuesday, March 08, 2016 1:12 PM
> > > > > To: Jose Garcia-Rivera
> > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
PREPBUFR
> > > > > to NetCDF
> > > > >
> > > > > Hi Jose. I'm sorry to hear that you are having problems
> > > > > converting a PREPBUFR file to NetCDF.
> > > > >
> > > > > Please upload your input files and configuration file to our
> > > > > anonymous ftp site as follows:
> > > > > http://www.dtcenter.org/met/users/support/met_help.php
> > > > >
> > > > > Then I can take a look and get back to you.
> > > > >
> > > > > Thanks,
> > > > > Julie
> > > > >
> > > > > On Tue, Mar 8, 2016 at 11:01 AM, Jose Garcia-Rivera via RT <
> > > > > met_help at ucar.edu> wrote:
> > > > >
> > > > > >
> > > > > > Tue Mar 08 11:01:25 2016: Request 75433 was acted upon.
> > > > > > Transaction: Ticket created by GarciaJ at imsg.com
> > > > > > Queue: met_help
> > > > > > Subject: Issues converting PREPBUFR to NetCDF
> > > > > > Owner: Nobody
> > > > > > Requestors: GarciaJ at imsg.com
> > > > > > Status: new
> > > > > > Ticket <URL:
> > > > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > > >
> > > > > >
> > > > > >
> > > > > > Dear Met Help,
> > > > > >
> > > > > > Trying to convert a PREPBUFR file to NetCDF.
> > > > > >
> > > > > > I used the default PB2NC configure file, and got the
following:
> > > > > >
> > > > > > [garciaj at login prepbufr_obs]$ ./pb2nc
gdas1.t12z.prepbufr.nr
> > > > > > gdas.20150820.t12z.nc PB2NCConfig_default DEBUG 1: Default
> > > > > > Config
> > > > > > File:
> > > > > > /work/apps/pgi_14.10/met-
5.1/share/met/config/PB2NCConfig_defa
> > > > > > ul t DEBUG 1: User Config File: PB2NCConfig_default
> > > > > > DEBUG 1: Creating NetCDF File:
gdas.20150820.t12z.nc
> > > > > > DEBUG 1: Processing PrepBufr File:
gdas1.t12z.prepbufr.nr
> > > > > > DEBUG 1: Blocking PrepBufr file to:
> /tmp/tmp_pb2nc_blk_32144_0
> > > > > > WARNING:
> > > > > > WARNING: process_pbfile() -> No PrepBufr messages to
process
> > > > > > in
> > file:
> > > > > > gdas1.t12z.prepbufr.nr
> > > > > > WARNING:
> > > > > > ERROR :
> > > > > > ERROR : write_netcdf_hdr_data() -> No PrepBufr messages
> retained.
> > > > > > Nothing to write.
> > > > > > ERROR :
> > > > > >
> > > > > >
> > > > > > Thanks in advance for the help, Jose M. Garcia-Rivera, PhD
IM
> > > > > > Systems Group Rockville/College Park, MD This e-mail,
> > > > > > including attachments, may include confidential and/or
> > > > > > proprietary information, and may be used only by the
person or
> > > > > > entity to which it is addressed. If the reader of this e-
mail
> > > > > > is not the intended recipient or his or her authorized
agent,
> > > > > > the reader is hereby notified that any dissemination,
> > > > > > distribution or copying of this e-mail is prohibited. If
you
> > > > > > have received this e-mail in error, please notify the
sender
> > > > > > by replying to this message and delete this
> > > > > e-mail immediately.
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > > > --
> > > > > Julie Prestopnik
> > > > > National Center for Atmospheric Research Research
Applications
> > > > > Laboratory
> > > > > Phone: 303.497.8399
> > > > > Email: jpresto at ucar.edu
> > > > >
> > > > > This e-mail, including attachments, may include confidential
> > > > > and/or proprietary information, and may be used only by the
> > > > > person or entity to which it is addressed. If the reader of
this
> > > > > e-mail is not the intended recipient or his or her
authorized
> > > > > agent, the reader is hereby notified that any dissemination,
> > > > > distribution or copying of this e-mail is prohibited. If you
> > > > > have received this e-mail in error, please notify the sender
by
> > > > > replying to this message and delete this
> > > > e-mail immediately.
> > > > >
> > > > >
> > > > >
> > > >
> > > >
> > > > --
> > > > Julie Prestopnik
> > > > National Center for Atmospheric Research Research Applications
> > > > Laboratory
> > > > Phone: 303.497.8399
> > > > Email: jpresto at ucar.edu
> > > >
> > > > This e-mail, including attachments, may include confidential
> > > > and/or proprietary information, and may be used only by the
person
> > > > or entity to which it is addressed. If the reader of this e-
mail
> > > > is not the intended recipient or his or her authorized agent,
the
> > > > reader is hereby notified that any dissemination, distribution
or
> > > > copying of this e-mail is prohibited. If you have received
this
> > > > e-mail in error, please notify the sender by replying to this
> > > > message and delete this
> > > e-mail immediately.
> > > >
> > > >
> > >
> > >
> > > --
> > > Julie Prestopnik
> > > National Center for Atmospheric Research Research Applications
> > > Laboratory
> > > Phone: 303.497.8399
> > > Email: jpresto at ucar.edu
> > >
> > > This e-mail, including attachments, may include confidential
and/or
> > > proprietary information, and may be used only by the person or
> > > entity to which it is addressed. If the reader of this e-mail is
not
> > > the intended recipient or his or her authorized agent, the
reader is
> > > hereby notified that any dissemination, distribution or copying
of
> > > this e-mail is prohibited. If you have received this e-mail in
> > > error, please notify the sender by replying to this message and
> > > delete this
> > e-mail immediately.
> > >
> > >
> >
> >
> > --
> > Julie Prestopnik
> > National Center for Atmospheric Research Research Applications
> > Laboratory
> > Phone: 303.497.8399
> > Email: jpresto at ucar.edu
> >
> > This e-mail, including attachments, may include confidential
and/or
> > proprietary information, and may be used only by the person or
entity
> > to which it is addressed. If the reader of this e-mail is not the
> > intended recipient or his or her authorized agent, the reader is
> > hereby notified that any dissemination, distribution or copying of
> > this e-mail is prohibited. If you have received this e-mail in
error,
> > please notify the sender by replying to this message and delete
this
> e-mail immediately.
> >
> >
> >
>
>
> --
> Julie Prestopnik
> National Center for Atmospheric Research Research Applications
Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
> This e-mail, including attachments, may include confidential and/or
> proprietary information, and may be used only by the person or
entity to
> which it is addressed. If the reader of this e-mail is not the
intended
> recipient or his or her authorized agent, the reader is hereby
notified
> that any dissemination, distribution or copying of this e-mail is
> prohibited. If you have received this e-mail in error, please notify
the
> sender by replying to this message and delete this e-mail
immediately.
>
>
>
--
Julie Prestopnik
National Center for Atmospheric Research
Research Applications Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to NetCDF
From: Jose Garcia-Rivera
Time: Mon Mar 14 13:36:22 2016
Dear Julie,
I just uploaded the three files to 'garcia_data'.
Thanks for the help,
Jose
-----Original Message-----
From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
Sent: Monday, March 14, 2016 3:32 PM
To: Jose Garcia-Rivera
Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to
NetCDF
Hi Jose.
Yes, please upload your input files and configuration file
(nmbprs_d01.06, test.nc, PointStatConfig_default) to our anonymous ftp
site as follows:
http://www.dtcenter.org/met/users/support/met_help.php
Thanks!
Julie
On Mon, Mar 14, 2016 at 1:06 PM, Jose Garcia-Rivera via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
>
> Dear Julie,
>
> I got to convert my prepbufr file using a python script. However, I
> have trouble running point_stat. Can I send you the files, to see if
> you have the same issue?
>
>
> This is what I got:
>
> [garciaj at login prepbufr_obs]$ ./point_stat nmbprs_d01.06 test.nc
> PointStatConfig_default DEBUG 1: Default Config File:
> /work/apps/pgi_14.10/SANDY/met-
5.1/share/met/config/PointStatConfig_de
> fault DEBUG 1: User Config File: PointStatConfig_default
> GSL_RNG_TYPE=mt19937
> GSL_RNG_SEED=18446744073425053526
> DEBUG 1: Forecast File: nmbprs_d01.06
> DEBUG 1: Observation File: test.nc
> DEBUG 2:
> DEBUG 2:
>
----------------------------------------------------------------------
> ----------
> DEBUG 2:
> DEBUG 2: Reading data for SPFH/P500.
> DEBUG 2: For SPFH/P500 found 1 forecast levels and 0 climatology
levels.
> DEBUG 2:
> DEBUG 2:
>
----------------------------------------------------------------------
> ----------
> DEBUG 2:
> DEBUG 2: Reading data for TMP/P500.
> DEBUG 2: For TMP/P500 found 1 forecast levels and 0 climatology
levels.
> DEBUG 2:
> DEBUG 2:
>
----------------------------------------------------------------------
> ----------
> DEBUG 2:
> DEBUG 2: Reading data for HGT/P500.
> DEBUG 2: For HGT/P500 found 1 forecast levels and 0 climatology
levels.
> DEBUG 2:
> DEBUG 2:
>
----------------------------------------------------------------------
> ----------
> DEBUG 2:
> DEBUG 2: Reading data for UGRD/P500.
> DEBUG 2: For UGRD/P500 found 1 forecast levels and 0 climatology
levels.
> DEBUG 2:
> DEBUG 2:
>
----------------------------------------------------------------------
> ----------
> DEBUG 2:
> DEBUG 2: Reading data for VGRD/P500.
> DEBUG 2: For VGRD/P500 found 1 forecast levels and 0 climatology
levels.
> DEBUG 2:
> DEBUG 2:
>
----------------------------------------------------------------------
> ----------
> DEBUG 2:
> WARNING:
> WARNING: process_obs_file() -> can't open observation netCDF file:
> test.nc
> WARNING:
> DEBUG 2:
> DEBUG 2:
>
----------------------------------------------------------------------
> ----------
> DEBUG 2:
> DEBUG 2: Processing SPFH/P500 versus SPFH/P500, for observation type
> ADPUPA, over region FULL, for interpolation method NEAREST(1), using
0
> pairs.
> DEBUG 2:
> DEBUG 2:
>
----------------------------------------------------------------------
> ----------
> DEBUG 2:
> DEBUG 2: Processing TMP/P500 versus TMP/P500, for observation type
> ADPUPA, over region FULL, for interpolation method NEAREST(1), using
0 pairs.
> DEBUG 2:
> DEBUG 2:
>
----------------------------------------------------------------------
> ----------
> DEBUG 2:
> DEBUG 2: Processing HGT/P500 versus HGT/P500, for observation type
> ADPUPA, over region FULL, for interpolation method NEAREST(1), using
0 pairs.
> DEBUG 2:
> DEBUG 2:
>
----------------------------------------------------------------------
> ----------
> DEBUG 2:
> DEBUG 2: Processing UGRD/P500 versus UGRD/P500, for observation type
> ADPUPA, over region FULL, for interpolation method NEAREST(1), using
0
> pairs.
> DEBUG 2:
> DEBUG 2:
>
----------------------------------------------------------------------
> ----------
> DEBUG 2:
> DEBUG 2: Processing VGRD/P500 versus VGRD/P500, for observation type
> ADPUPA, over region FULL, for interpolation method NEAREST(1), using
0
> pairs.
> DEBUG 2:
> DEBUG 2:
>
----------------------------------------------------------------------
> ----------
> DEBUG 2:
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V.stat
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_fho.txt
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_ctc.txt
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_cts.txt
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_mctc.txt
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_mcts.txt
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_cnt.txt
> DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_sl1l2.txt
> DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_sal1l2.txt
> DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_vl1l2.txt
> DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_val1l2.txt
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_pct.txt
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_pstd.txt
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_pjc.txt
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_prc.txt
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_mpr.txt
>
>
> Thanks for the help,
> Jose
>
>
> -----Original Message-----
> From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> Sent: Monday, March 14, 2016 12:17 PM
> To: Jose Garcia-Rivera
> Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to
> NetCDF
>
> Hi Jose. I apologize for the delayed response. I was out of the
> office on Friday. I'm going to try to figure out a solution and get
> back with you shortly.
>
> Julie
>
> On Fri, Mar 11, 2016 at 2:02 PM, Jose Garcia-Rivera via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> >
> > Dear Julie,
> >
> > Any news regarding pb2nc? We're still unable to make it work.
> >
> > Best Regards,
> > Jose
> >
> > -----Original Message-----
> > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > Sent: Thursday, March 10, 2016 4:20 PM
> > To: Jose Garcia-Rivera
> > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR
to
> > NetCDF
> >
> > Hi Jose. Thank you for attaching the files.
> >
> > Could you please send me a list of the files in
> > /work/apps/pgi_14.10/SANDY/bufrlib/lib?
> >
> > Thank you!
> >
> > Julie
> >
> >
> > On Thu, Mar 10, 2016 at 12:20 PM, Jose Garcia-Rivera via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> > >
> > > Dear Julie,
> > >
> > > The administrator re-compiled MET following your instructions,
and
> > > says there's still trouble. He sent me the log files (attached).
> > > Is there any other approach that might help?
> > >
> > > Best Regards,
> > > Jose
> > >
> > > -----Original Message-----
> > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > Sent: Wednesday, March 09, 2016 12:39 PM
> > > To: Jose Garcia-Rivera
> > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR
> > > to NetCDF
> > >
> > > Thank you, Jose! It looks like something went wrong during
> compilation.
> > > I suggest recompiling MET to see if we can get this issue
resolved.
> > > NCEP's BUFRLIB is used by the pb2nc MET tool, and is a required
> > > external library for pb2nc. MET is not yet compatible with
> > > BUFRLIB
> > version 11.0.0, so we
> > > suggest getting version 10.2.3. We are working on our online
tutorial
> > for
> > > METv.5.1, but in the meantime, I'll point you to our online
> > > tutorial directions for installing BUFRLIB:
> > >
> > >
> > >
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.0/
> > > co
> > > mp
> > > ilation/req_libs.php
> > >
> > > It is also important to review the necessary environment
variables
> > > to
> > set:
> > >
> > >
> > >
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.0/
> > > co
> > > mp
> > > ilation/configure.php
> > >
> > > For example,
> > >
> > > "Set *$MET_BUFR* to point to the main BUFR directory, or set
> > > *$MET_BUFRLIB* to point to the directory with the BUFR library
files.
> > > Because MET doesn't use any BUFR library include files, you
don't
> > > need to specify *$MET_BUFRINC* ."
> > >
> > > Once you've installed the required libraries and set up your
> > > environment variables, you'll be ready to configure MET
> > > (instructions at the bottom of the last link above) and then
> > > compile and install MET (
> > >
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.0/
> > > co
> > > mp
> > > ilation/compile.php
> > > ).
> > > After re-installing MET, please run "make test" again. If you
> > > still encounter the same problem, please send me your
*config.log*
> > > file and your *make_install.log *file. Please let me know if
you
> > > have any
> > questions.
> > >
> > > Please let us know how it goes.
> > >
> > > Thanks,
> > > Julie
> > >
> > >
> > >
> > >
> > > On Wed, Mar 9, 2016 at 10:22 AM, Jose Garcia-Rivera via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
>
> > > >
> > > > Dear Julie,
> > > >
> > > > Attached is the test log file. It's showing the same issues on
> > > > pb2nc even with the sample files.
> > > >
> > > > Best Regards,
> > > > Jose
> > > >
> > > > -----Original Message-----
> > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > Sent: Tuesday, March 08, 2016 5:28 PM
> > > > To: Jose Garcia-Rivera
> > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
PREPBUFR
> > > > to NetCDF
> > > >
> > > > Hi Jose. Thank you for uploading the files. Unfortunately, I
> > > > am unable to reproduce the error you are experiencing. I am
> > > > wondering if you have successfully used pb2nc before. As a
> > > > check could you please run the following in your met-5.1/
directory:
> > > >
> > > > *make test >& make_test.log*
> > > >
> > > > and then send me the make_test.log file?
> > > >
> > > > Thanks,
> > > > Julie
> > > >
> > > > On Tue, Mar 8, 2016 at 11:29 AM, Jose Garcia-Rivera via RT <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > > >
> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > >
> > > > >
> > > > > Dear Julie,
> > > > >
> > > > > I just put the files in 'garcia_data'. I appreciate your
help.
> > > > >
> > > > > Best Regards,
> > > > > Jose
> > > > >
> > > > > -----Original Message-----
> > > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > > Sent: Tuesday, March 08, 2016 1:12 PM
> > > > > To: Jose Garcia-Rivera
> > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
> > > > > PREPBUFR to NetCDF
> > > > >
> > > > > Hi Jose. I'm sorry to hear that you are having problems
> > > > > converting a PREPBUFR file to NetCDF.
> > > > >
> > > > > Please upload your input files and configuration file to our
> > > > > anonymous ftp site as follows:
> > > > > http://www.dtcenter.org/met/users/support/met_help.php
> > > > >
> > > > > Then I can take a look and get back to you.
> > > > >
> > > > > Thanks,
> > > > > Julie
> > > > >
> > > > > On Tue, Mar 8, 2016 at 11:01 AM, Jose Garcia-Rivera via RT <
> > > > > met_help at ucar.edu> wrote:
> > > > >
> > > > > >
> > > > > > Tue Mar 08 11:01:25 2016: Request 75433 was acted upon.
> > > > > > Transaction: Ticket created by GarciaJ at imsg.com
> > > > > > Queue: met_help
> > > > > > Subject: Issues converting PREPBUFR to NetCDF
> > > > > > Owner: Nobody
> > > > > > Requestors: GarciaJ at imsg.com
> > > > > > Status: new
> > > > > > Ticket <URL:
> > > > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > > >
> > > > > >
> > > > > >
> > > > > > Dear Met Help,
> > > > > >
> > > > > > Trying to convert a PREPBUFR file to NetCDF.
> > > > > >
> > > > > > I used the default PB2NC configure file, and got the
following:
> > > > > >
> > > > > > [garciaj at login prepbufr_obs]$ ./pb2nc
gdas1.t12z.prepbufr.nr
> > > > > > gdas.20150820.t12z.nc PB2NCConfig_default DEBUG 1: Default
> > > > > > Config
> > > > > > File:
> > > > > > /work/apps/pgi_14.10/met-
5.1/share/met/config/PB2NCConfig_de
> > > > > > fa ul t DEBUG 1: User Config File: PB2NCConfig_default
> > > > > > DEBUG 1: Creating NetCDF File:
gdas.20150820.t12z.nc
> > > > > > DEBUG 1: Processing PrepBufr File:
gdas1.t12z.prepbufr.nr
> > > > > > DEBUG 1: Blocking PrepBufr file to:
> /tmp/tmp_pb2nc_blk_32144_0
> > > > > > WARNING:
> > > > > > WARNING: process_pbfile() -> No PrepBufr messages to
process
> > > > > > in
> > file:
> > > > > > gdas1.t12z.prepbufr.nr
> > > > > > WARNING:
> > > > > > ERROR :
> > > > > > ERROR : write_netcdf_hdr_data() -> No PrepBufr messages
> retained.
> > > > > > Nothing to write.
> > > > > > ERROR :
> > > > > >
> > > > > >
> > > > > > Thanks in advance for the help, Jose M. Garcia-Rivera, PhD
> > > > > > IM Systems Group Rockville/College Park, MD This e-mail,
> > > > > > including attachments, may include confidential and/or
> > > > > > proprietary information, and may be used only by the
person
> > > > > > or entity to which it is addressed. If the reader of this
> > > > > > e-mail is not the intended recipient or his or her
> > > > > > authorized agent, the reader is hereby notified that any
> > > > > > dissemination, distribution or copying of this e-mail is
> > > > > > prohibited. If you have received this e-mail in error,
> > > > > > please notify the sender by replying to this message and
> > > > > > delete this
> > > > > e-mail immediately.
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > > > --
> > > > > Julie Prestopnik
> > > > > National Center for Atmospheric Research Research
Applications
> > > > > Laboratory
> > > > > Phone: 303.497.8399
> > > > > Email: jpresto at ucar.edu
> > > > >
> > > > > This e-mail, including attachments, may include confidential
> > > > > and/or proprietary information, and may be used only by the
> > > > > person or entity to which it is addressed. If the reader of
> > > > > this e-mail is not the intended recipient or his or her
> > > > > authorized agent, the reader is hereby notified that any
> > > > > dissemination, distribution or copying of this e-mail is
> > > > > prohibited. If you have received this e-mail in error,
please
> > > > > notify the sender by replying to this message and delete
this
> > > > e-mail immediately.
> > > > >
> > > > >
> > > > >
> > > >
> > > >
> > > > --
> > > > Julie Prestopnik
> > > > National Center for Atmospheric Research Research Applications
> > > > Laboratory
> > > > Phone: 303.497.8399
> > > > Email: jpresto at ucar.edu
> > > >
> > > > This e-mail, including attachments, may include confidential
> > > > and/or proprietary information, and may be used only by the
> > > > person or entity to which it is addressed. If the reader of
this
> > > > e-mail is not the intended recipient or his or her authorized
> > > > agent, the reader is hereby notified that any dissemination,
> > > > distribution or copying of this e-mail is prohibited. If you
> > > > have received this e-mail in error, please notify the sender
by
> > > > replying to this message and delete this
> > > e-mail immediately.
> > > >
> > > >
> > >
> > >
> > > --
> > > Julie Prestopnik
> > > National Center for Atmospheric Research Research Applications
> > > Laboratory
> > > Phone: 303.497.8399
> > > Email: jpresto at ucar.edu
> > >
> > > This e-mail, including attachments, may include confidential
> > > and/or proprietary information, and may be used only by the
person
> > > or entity to which it is addressed. If the reader of this e-mail
> > > is not the intended recipient or his or her authorized agent,
the
> > > reader is hereby notified that any dissemination, distribution
or
> > > copying of this e-mail is prohibited. If you have received this
> > > e-mail in error, please notify the sender by replying to this
> > > message and delete this
> > e-mail immediately.
> > >
> > >
> >
> >
> > --
> > Julie Prestopnik
> > National Center for Atmospheric Research Research Applications
> > Laboratory
> > Phone: 303.497.8399
> > Email: jpresto at ucar.edu
> >
> > This e-mail, including attachments, may include confidential
and/or
> > proprietary information, and may be used only by the person or
> > entity to which it is addressed. If the reader of this e-mail is
not
> > the intended recipient or his or her authorized agent, the reader
is
> > hereby notified that any dissemination, distribution or copying of
> > this e-mail is prohibited. If you have received this e-mail in
> > error, please notify the sender by replying to this message and
> > delete this
> e-mail immediately.
> >
> >
> >
>
>
> --
> Julie Prestopnik
> National Center for Atmospheric Research Research Applications
> Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
> This e-mail, including attachments, may include confidential and/or
> proprietary information, and may be used only by the person or
entity
> to which it is addressed. If the reader of this e-mail is not the
> intended recipient or his or her authorized agent, the reader is
> hereby notified that any dissemination, distribution or copying of
> this e-mail is prohibited. If you have received this e-mail in
error,
> please notify the sender by replying to this message and delete this
e-mail immediately.
>
>
>
--
Julie Prestopnik
National Center for Atmospheric Research Research Applications
Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
This e-mail, including attachments, may include confidential and/or
proprietary information, and may be used only by the person or entity
to which it is addressed. If the reader of this e-mail is not the
intended recipient or his or her authorized agent, the reader is
hereby notified that any dissemination, distribution or copying of
this e-mail is prohibited. If you have received this e-mail in error,
please notify the sender by replying to this message and delete this
e-mail immediately.
------------------------------------------------
Subject: Issues converting PREPBUFR to NetCDF
From: Julie Prestopnik
Time: Tue Mar 15 10:17:23 2016
Thank you, Jose. I'm working with co-workers to try to get these
issues
resolved. I hope to get back to you soon.
Julie
On Mon, Mar 14, 2016 at 1:36 PM, Jose Garcia-Rivera via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
>
> Dear Julie,
>
> I just uploaded the three files to 'garcia_data'.
>
> Thanks for the help,
> Jose
>
>
> -----Original Message-----
> From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> Sent: Monday, March 14, 2016 3:32 PM
> To: Jose Garcia-Rivera
> Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to
NetCDF
>
> Hi Jose.
>
> Yes, please upload your input files and configuration file
(nmbprs_d01.06,
> test.nc, PointStatConfig_default) to our anonymous ftp site as
follows:
> http://www.dtcenter.org/met/users/support/met_help.php
>
> Thanks!
>
> Julie
>
> On Mon, Mar 14, 2016 at 1:06 PM, Jose Garcia-Rivera via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> >
> > Dear Julie,
> >
> > I got to convert my prepbufr file using a python script. However,
I
> > have trouble running point_stat. Can I send you the files, to see
if
> > you have the same issue?
> >
> >
> > This is what I got:
> >
> > [garciaj at login prepbufr_obs]$ ./point_stat nmbprs_d01.06 test.nc
> > PointStatConfig_default DEBUG 1: Default Config File:
> > /work/apps/pgi_14.10/SANDY/met-
5.1/share/met/config/PointStatConfig_de
> > fault DEBUG 1: User Config File: PointStatConfig_default
> > GSL_RNG_TYPE=mt19937
> > GSL_RNG_SEED=18446744073425053526
> > DEBUG 1: Forecast File: nmbprs_d01.06
> > DEBUG 1: Observation File: test.nc
> > DEBUG 2:
> > DEBUG 2:
> >
----------------------------------------------------------------------
> > ----------
> > DEBUG 2:
> > DEBUG 2: Reading data for SPFH/P500.
> > DEBUG 2: For SPFH/P500 found 1 forecast levels and 0 climatology
levels.
> > DEBUG 2:
> > DEBUG 2:
> >
----------------------------------------------------------------------
> > ----------
> > DEBUG 2:
> > DEBUG 2: Reading data for TMP/P500.
> > DEBUG 2: For TMP/P500 found 1 forecast levels and 0 climatology
levels.
> > DEBUG 2:
> > DEBUG 2:
> >
----------------------------------------------------------------------
> > ----------
> > DEBUG 2:
> > DEBUG 2: Reading data for HGT/P500.
> > DEBUG 2: For HGT/P500 found 1 forecast levels and 0 climatology
levels.
> > DEBUG 2:
> > DEBUG 2:
> >
----------------------------------------------------------------------
> > ----------
> > DEBUG 2:
> > DEBUG 2: Reading data for UGRD/P500.
> > DEBUG 2: For UGRD/P500 found 1 forecast levels and 0 climatology
levels.
> > DEBUG 2:
> > DEBUG 2:
> >
----------------------------------------------------------------------
> > ----------
> > DEBUG 2:
> > DEBUG 2: Reading data for VGRD/P500.
> > DEBUG 2: For VGRD/P500 found 1 forecast levels and 0 climatology
levels.
> > DEBUG 2:
> > DEBUG 2:
> >
----------------------------------------------------------------------
> > ----------
> > DEBUG 2:
> > WARNING:
> > WARNING: process_obs_file() -> can't open observation netCDF file:
> > test.nc
> > WARNING:
> > DEBUG 2:
> > DEBUG 2:
> >
----------------------------------------------------------------------
> > ----------
> > DEBUG 2:
> > DEBUG 2: Processing SPFH/P500 versus SPFH/P500, for observation
type
> > ADPUPA, over region FULL, for interpolation method NEAREST(1),
using 0
> > pairs.
> > DEBUG 2:
> > DEBUG 2:
> >
----------------------------------------------------------------------
> > ----------
> > DEBUG 2:
> > DEBUG 2: Processing TMP/P500 versus TMP/P500, for observation type
> > ADPUPA, over region FULL, for interpolation method NEAREST(1),
using 0
> pairs.
> > DEBUG 2:
> > DEBUG 2:
> >
----------------------------------------------------------------------
> > ----------
> > DEBUG 2:
> > DEBUG 2: Processing HGT/P500 versus HGT/P500, for observation type
> > ADPUPA, over region FULL, for interpolation method NEAREST(1),
using 0
> pairs.
> > DEBUG 2:
> > DEBUG 2:
> >
----------------------------------------------------------------------
> > ----------
> > DEBUG 2:
> > DEBUG 2: Processing UGRD/P500 versus UGRD/P500, for observation
type
> > ADPUPA, over region FULL, for interpolation method NEAREST(1),
using 0
> > pairs.
> > DEBUG 2:
> > DEBUG 2:
> >
----------------------------------------------------------------------
> > ----------
> > DEBUG 2:
> > DEBUG 2: Processing VGRD/P500 versus VGRD/P500, for observation
type
> > ADPUPA, over region FULL, for interpolation method NEAREST(1),
using 0
> > pairs.
> > DEBUG 2:
> > DEBUG 2:
> >
----------------------------------------------------------------------
> > ----------
> > DEBUG 2:
> > DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V.stat
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_fho.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_ctc.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_cts.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_mctc.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_mcts.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_cnt.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_sl1l2.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_sal1l2.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_vl1l2.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_val1l2.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_pct.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_pstd.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_pjc.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_prc.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_mpr.txt
> >
> >
> > Thanks for the help,
> > Jose
> >
> >
> > -----Original Message-----
> > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > Sent: Monday, March 14, 2016 12:17 PM
> > To: Jose Garcia-Rivera
> > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR
to
> > NetCDF
> >
> > Hi Jose. I apologize for the delayed response. I was out of the
> > office on Friday. I'm going to try to figure out a solution and
get
> > back with you shortly.
> >
> > Julie
> >
> > On Fri, Mar 11, 2016 at 2:02 PM, Jose Garcia-Rivera via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> > >
> > > Dear Julie,
> > >
> > > Any news regarding pb2nc? We're still unable to make it work.
> > >
> > > Best Regards,
> > > Jose
> > >
> > > -----Original Message-----
> > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > Sent: Thursday, March 10, 2016 4:20 PM
> > > To: Jose Garcia-Rivera
> > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR
to
> > > NetCDF
> > >
> > > Hi Jose. Thank you for attaching the files.
> > >
> > > Could you please send me a list of the files in
> > > /work/apps/pgi_14.10/SANDY/bufrlib/lib?
> > >
> > > Thank you!
> > >
> > > Julie
> > >
> > >
> > > On Thu, Mar 10, 2016 at 12:20 PM, Jose Garcia-Rivera via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
>
> > > >
> > > > Dear Julie,
> > > >
> > > > The administrator re-compiled MET following your instructions,
and
> > > > says there's still trouble. He sent me the log files
(attached).
> > > > Is there any other approach that might help?
> > > >
> > > > Best Regards,
> > > > Jose
> > > >
> > > > -----Original Message-----
> > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > Sent: Wednesday, March 09, 2016 12:39 PM
> > > > To: Jose Garcia-Rivera
> > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
PREPBUFR
> > > > to NetCDF
> > > >
> > > > Thank you, Jose! It looks like something went wrong during
> > compilation.
> > > > I suggest recompiling MET to see if we can get this issue
resolved.
> > > > NCEP's BUFRLIB is used by the pb2nc MET tool, and is a
required
> > > > external library for pb2nc. MET is not yet compatible with
> > > > BUFRLIB
> > > version 11.0.0, so we
> > > > suggest getting version 10.2.3. We are working on our online
> tutorial
> > > for
> > > > METv.5.1, but in the meantime, I'll point you to our online
> > > > tutorial directions for installing BUFRLIB:
> > > >
> > > >
> > > >
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.0/
> > > > co
> > > > mp
> > > > ilation/req_libs.php
> > > >
> > > > It is also important to review the necessary environment
variables
> > > > to
> > > set:
> > > >
> > > >
> > > >
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.0/
> > > > co
> > > > mp
> > > > ilation/configure.php
> > > >
> > > > For example,
> > > >
> > > > "Set *$MET_BUFR* to point to the main BUFR directory, or set
> > > > *$MET_BUFRLIB* to point to the directory with the BUFR library
files.
> > > > Because MET doesn't use any BUFR library include files, you
don't
> > > > need to specify *$MET_BUFRINC* ."
> > > >
> > > > Once you've installed the required libraries and set up your
> > > > environment variables, you'll be ready to configure MET
> > > > (instructions at the bottom of the last link above) and then
> > > > compile and install MET (
> > > >
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.0/
> > > > co
> > > > mp
> > > > ilation/compile.php
> > > > ).
> > > > After re-installing MET, please run "make test" again. If you
> > > > still encounter the same problem, please send me your
*config.log*
> > > > file and your *make_install.log *file. Please let me know if
you
> > > > have any
> > > questions.
> > > >
> > > > Please let us know how it goes.
> > > >
> > > > Thanks,
> > > > Julie
> > > >
> > > >
> > > >
> > > >
> > > > On Wed, Mar 9, 2016 at 10:22 AM, Jose Garcia-Rivera via RT <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > > >
> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> > > > >
> > > > > Dear Julie,
> > > > >
> > > > > Attached is the test log file. It's showing the same issues
on
> > > > > pb2nc even with the sample files.
> > > > >
> > > > > Best Regards,
> > > > > Jose
> > > > >
> > > > > -----Original Message-----
> > > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > > Sent: Tuesday, March 08, 2016 5:28 PM
> > > > > To: Jose Garcia-Rivera
> > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
PREPBUFR
> > > > > to NetCDF
> > > > >
> > > > > Hi Jose. Thank you for uploading the files. Unfortunately,
I
> > > > > am unable to reproduce the error you are experiencing. I am
> > > > > wondering if you have successfully used pb2nc before. As a
> > > > > check could you please run the following in your met-5.1/
> directory:
> > > > >
> > > > > *make test >& make_test.log*
> > > > >
> > > > > and then send me the make_test.log file?
> > > > >
> > > > > Thanks,
> > > > > Julie
> > > > >
> > > > > On Tue, Mar 8, 2016 at 11:29 AM, Jose Garcia-Rivera via RT <
> > > > > met_help at ucar.edu> wrote:
> > > > >
> > > > > >
> > > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > > >
> > > > > >
> > > > > > Dear Julie,
> > > > > >
> > > > > > I just put the files in 'garcia_data'. I appreciate your
help.
> > > > > >
> > > > > > Best Regards,
> > > > > > Jose
> > > > > >
> > > > > > -----Original Message-----
> > > > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > > > Sent: Tuesday, March 08, 2016 1:12 PM
> > > > > > To: Jose Garcia-Rivera
> > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
> > > > > > PREPBUFR to NetCDF
> > > > > >
> > > > > > Hi Jose. I'm sorry to hear that you are having problems
> > > > > > converting a PREPBUFR file to NetCDF.
> > > > > >
> > > > > > Please upload your input files and configuration file to
our
> > > > > > anonymous ftp site as follows:
> > > > > > http://www.dtcenter.org/met/users/support/met_help.php
> > > > > >
> > > > > > Then I can take a look and get back to you.
> > > > > >
> > > > > > Thanks,
> > > > > > Julie
> > > > > >
> > > > > > On Tue, Mar 8, 2016 at 11:01 AM, Jose Garcia-Rivera via RT
<
> > > > > > met_help at ucar.edu> wrote:
> > > > > >
> > > > > > >
> > > > > > > Tue Mar 08 11:01:25 2016: Request 75433 was acted upon.
> > > > > > > Transaction: Ticket created by GarciaJ at imsg.com
> > > > > > > Queue: met_help
> > > > > > > Subject: Issues converting PREPBUFR to NetCDF
> > > > > > > Owner: Nobody
> > > > > > > Requestors: GarciaJ at imsg.com
> > > > > > > Status: new
> > > > > > > Ticket <URL:
> > > > > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > Dear Met Help,
> > > > > > >
> > > > > > > Trying to convert a PREPBUFR file to NetCDF.
> > > > > > >
> > > > > > > I used the default PB2NC configure file, and got the
following:
> > > > > > >
> > > > > > > [garciaj at login prepbufr_obs]$ ./pb2nc
gdas1.t12z.prepbufr.nr
> > > > > > > gdas.20150820.t12z.nc PB2NCConfig_default DEBUG 1:
Default
> > > > > > > Config
> > > > > > > File:
> > > > > > > /work/apps/pgi_14.10/met-
5.1/share/met/config/PB2NCConfig_de
> > > > > > > fa ul t DEBUG 1: User Config File: PB2NCConfig_default
> > > > > > > DEBUG 1: Creating NetCDF File:
gdas.20150820.t12z.nc
> > > > > > > DEBUG 1: Processing PrepBufr File:
gdas1.t12z.prepbufr.nr
> > > > > > > DEBUG 1: Blocking PrepBufr file to:
> > /tmp/tmp_pb2nc_blk_32144_0
> > > > > > > WARNING:
> > > > > > > WARNING: process_pbfile() -> No PrepBufr messages to
process
> > > > > > > in
> > > file:
> > > > > > > gdas1.t12z.prepbufr.nr
> > > > > > > WARNING:
> > > > > > > ERROR :
> > > > > > > ERROR : write_netcdf_hdr_data() -> No PrepBufr messages
> > retained.
> > > > > > > Nothing to write.
> > > > > > > ERROR :
> > > > > > >
> > > > > > >
> > > > > > > Thanks in advance for the help, Jose M. Garcia-Rivera,
PhD
> > > > > > > IM Systems Group Rockville/College Park, MD This e-mail,
> > > > > > > including attachments, may include confidential and/or
> > > > > > > proprietary information, and may be used only by the
person
> > > > > > > or entity to which it is addressed. If the reader of
this
> > > > > > > e-mail is not the intended recipient or his or her
> > > > > > > authorized agent, the reader is hereby notified that any
> > > > > > > dissemination, distribution or copying of this e-mail is
> > > > > > > prohibited. If you have received this e-mail in error,
> > > > > > > please notify the sender by replying to this message and
> > > > > > > delete this
> > > > > > e-mail immediately.
> > > > > > >
> > > > > > >
> > > > > >
> > > > > >
> > > > > > --
> > > > > > Julie Prestopnik
> > > > > > National Center for Atmospheric Research Research
Applications
> > > > > > Laboratory
> > > > > > Phone: 303.497.8399
> > > > > > Email: jpresto at ucar.edu
> > > > > >
> > > > > > This e-mail, including attachments, may include
confidential
> > > > > > and/or proprietary information, and may be used only by
the
> > > > > > person or entity to which it is addressed. If the reader
of
> > > > > > this e-mail is not the intended recipient or his or her
> > > > > > authorized agent, the reader is hereby notified that any
> > > > > > dissemination, distribution or copying of this e-mail is
> > > > > > prohibited. If you have received this e-mail in error,
please
> > > > > > notify the sender by replying to this message and delete
this
> > > > > e-mail immediately.
> > > > > >
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > > > --
> > > > > Julie Prestopnik
> > > > > National Center for Atmospheric Research Research
Applications
> > > > > Laboratory
> > > > > Phone: 303.497.8399
> > > > > Email: jpresto at ucar.edu
> > > > >
> > > > > This e-mail, including attachments, may include confidential
> > > > > and/or proprietary information, and may be used only by the
> > > > > person or entity to which it is addressed. If the reader of
this
> > > > > e-mail is not the intended recipient or his or her
authorized
> > > > > agent, the reader is hereby notified that any dissemination,
> > > > > distribution or copying of this e-mail is prohibited. If you
> > > > > have received this e-mail in error, please notify the sender
by
> > > > > replying to this message and delete this
> > > > e-mail immediately.
> > > > >
> > > > >
> > > >
> > > >
> > > > --
> > > > Julie Prestopnik
> > > > National Center for Atmospheric Research Research Applications
> > > > Laboratory
> > > > Phone: 303.497.8399
> > > > Email: jpresto at ucar.edu
> > > >
> > > > This e-mail, including attachments, may include confidential
> > > > and/or proprietary information, and may be used only by the
person
> > > > or entity to which it is addressed. If the reader of this e-
mail
> > > > is not the intended recipient or his or her authorized agent,
the
> > > > reader is hereby notified that any dissemination, distribution
or
> > > > copying of this e-mail is prohibited. If you have received
this
> > > > e-mail in error, please notify the sender by replying to this
> > > > message and delete this
> > > e-mail immediately.
> > > >
> > > >
> > >
> > >
> > > --
> > > Julie Prestopnik
> > > National Center for Atmospheric Research Research Applications
> > > Laboratory
> > > Phone: 303.497.8399
> > > Email: jpresto at ucar.edu
> > >
> > > This e-mail, including attachments, may include confidential
and/or
> > > proprietary information, and may be used only by the person or
> > > entity to which it is addressed. If the reader of this e-mail is
not
> > > the intended recipient or his or her authorized agent, the
reader is
> > > hereby notified that any dissemination, distribution or copying
of
> > > this e-mail is prohibited. If you have received this e-mail in
> > > error, please notify the sender by replying to this message and
> > > delete this
> > e-mail immediately.
> > >
> > >
> > >
> >
> >
> > --
> > Julie Prestopnik
> > National Center for Atmospheric Research Research Applications
> > Laboratory
> > Phone: 303.497.8399
> > Email: jpresto at ucar.edu
> >
> > This e-mail, including attachments, may include confidential
and/or
> > proprietary information, and may be used only by the person or
entity
> > to which it is addressed. If the reader of this e-mail is not the
> > intended recipient or his or her authorized agent, the reader is
> > hereby notified that any dissemination, distribution or copying of
> > this e-mail is prohibited. If you have received this e-mail in
error,
> > please notify the sender by replying to this message and delete
this
> e-mail immediately.
> >
> >
> >
>
>
> --
> Julie Prestopnik
> National Center for Atmospheric Research Research Applications
Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
> This e-mail, including attachments, may include confidential and/or
> proprietary information, and may be used only by the person or
entity to
> which it is addressed. If the reader of this e-mail is not the
intended
> recipient or his or her authorized agent, the reader is hereby
notified
> that any dissemination, distribution or copying of this e-mail is
> prohibited. If you have received this e-mail in error, please notify
the
> sender by replying to this message and delete this e-mail
immediately.
>
>
>
--
Julie Prestopnik
National Center for Atmospheric Research
Research Applications Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to NetCDF
From: Jose Garcia-Rivera
Time: Tue Mar 15 10:39:06 2016
Dear Julie,
Thank you. I'll be waiting for your e-mail.
Best Regards,
Jose
-----Original Message-----
From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
Sent: Tuesday, March 15, 2016 12:17 PM
To: Jose Garcia-Rivera
Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to
NetCDF
Thank you, Jose. I'm working with co-workers to try to get these
issues resolved. I hope to get back to you soon.
Julie
On Mon, Mar 14, 2016 at 1:36 PM, Jose Garcia-Rivera via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
>
> Dear Julie,
>
> I just uploaded the three files to 'garcia_data'.
>
> Thanks for the help,
> Jose
>
>
> -----Original Message-----
> From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> Sent: Monday, March 14, 2016 3:32 PM
> To: Jose Garcia-Rivera
> Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to
> NetCDF
>
> Hi Jose.
>
> Yes, please upload your input files and configuration file
> (nmbprs_d01.06, test.nc, PointStatConfig_default) to our anonymous
ftp site as follows:
> http://www.dtcenter.org/met/users/support/met_help.php
>
> Thanks!
>
> Julie
>
> On Mon, Mar 14, 2016 at 1:06 PM, Jose Garcia-Rivera via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> >
> > Dear Julie,
> >
> > I got to convert my prepbufr file using a python script. However,
I
> > have trouble running point_stat. Can I send you the files, to see
if
> > you have the same issue?
> >
> >
> > This is what I got:
> >
> > [garciaj at login prepbufr_obs]$ ./point_stat nmbprs_d01.06 test.nc
> > PointStatConfig_default DEBUG 1: Default Config File:
> > /work/apps/pgi_14.10/SANDY/met-
5.1/share/met/config/PointStatConfig_
> > de fault DEBUG 1: User Config File: PointStatConfig_default
> > GSL_RNG_TYPE=mt19937
> > GSL_RNG_SEED=18446744073425053526
> > DEBUG 1: Forecast File: nmbprs_d01.06 DEBUG 1: Observation File:
> > test.nc DEBUG 2:
> > DEBUG 2:
> >
--------------------------------------------------------------------
> > --
> > ----------
> > DEBUG 2:
> > DEBUG 2: Reading data for SPFH/P500.
> > DEBUG 2: For SPFH/P500 found 1 forecast levels and 0 climatology
levels.
> > DEBUG 2:
> > DEBUG 2:
> >
--------------------------------------------------------------------
> > --
> > ----------
> > DEBUG 2:
> > DEBUG 2: Reading data for TMP/P500.
> > DEBUG 2: For TMP/P500 found 1 forecast levels and 0 climatology
levels.
> > DEBUG 2:
> > DEBUG 2:
> >
--------------------------------------------------------------------
> > --
> > ----------
> > DEBUG 2:
> > DEBUG 2: Reading data for HGT/P500.
> > DEBUG 2: For HGT/P500 found 1 forecast levels and 0 climatology
levels.
> > DEBUG 2:
> > DEBUG 2:
> >
--------------------------------------------------------------------
> > --
> > ----------
> > DEBUG 2:
> > DEBUG 2: Reading data for UGRD/P500.
> > DEBUG 2: For UGRD/P500 found 1 forecast levels and 0 climatology
levels.
> > DEBUG 2:
> > DEBUG 2:
> >
--------------------------------------------------------------------
> > --
> > ----------
> > DEBUG 2:
> > DEBUG 2: Reading data for VGRD/P500.
> > DEBUG 2: For VGRD/P500 found 1 forecast levels and 0 climatology
levels.
> > DEBUG 2:
> > DEBUG 2:
> >
--------------------------------------------------------------------
> > --
> > ----------
> > DEBUG 2:
> > WARNING:
> > WARNING: process_obs_file() -> can't open observation netCDF file:
> > test.nc
> > WARNING:
> > DEBUG 2:
> > DEBUG 2:
> >
--------------------------------------------------------------------
> > --
> > ----------
> > DEBUG 2:
> > DEBUG 2: Processing SPFH/P500 versus SPFH/P500, for observation
type
> > ADPUPA, over region FULL, for interpolation method NEAREST(1),
using
> > 0 pairs.
> > DEBUG 2:
> > DEBUG 2:
> >
--------------------------------------------------------------------
> > --
> > ----------
> > DEBUG 2:
> > DEBUG 2: Processing TMP/P500 versus TMP/P500, for observation type
> > ADPUPA, over region FULL, for interpolation method NEAREST(1),
using
> > 0
> pairs.
> > DEBUG 2:
> > DEBUG 2:
> >
--------------------------------------------------------------------
> > --
> > ----------
> > DEBUG 2:
> > DEBUG 2: Processing HGT/P500 versus HGT/P500, for observation type
> > ADPUPA, over region FULL, for interpolation method NEAREST(1),
using
> > 0
> pairs.
> > DEBUG 2:
> > DEBUG 2:
> >
--------------------------------------------------------------------
> > --
> > ----------
> > DEBUG 2:
> > DEBUG 2: Processing UGRD/P500 versus UGRD/P500, for observation
type
> > ADPUPA, over region FULL, for interpolation method NEAREST(1),
using
> > 0 pairs.
> > DEBUG 2:
> > DEBUG 2:
> >
--------------------------------------------------------------------
> > --
> > ----------
> > DEBUG 2:
> > DEBUG 2: Processing VGRD/P500 versus VGRD/P500, for observation
type
> > ADPUPA, over region FULL, for interpolation method NEAREST(1),
using
> > 0 pairs.
> > DEBUG 2:
> > DEBUG 2:
> >
--------------------------------------------------------------------
> > --
> > ----------
> > DEBUG 2:
> > DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V.stat
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_fho.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_ctc.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_cts.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_mctc.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_mcts.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_cnt.txt
> > DEBUG 1: Output file:
> > ./point_stat_060000L_20150820_180000V_sl1l2.txt
> > DEBUG 1: Output file:
> > ./point_stat_060000L_20150820_180000V_sal1l2.txt
> > DEBUG 1: Output file:
> > ./point_stat_060000L_20150820_180000V_vl1l2.txt
> > DEBUG 1: Output file:
> > ./point_stat_060000L_20150820_180000V_val1l2.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_pct.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_pstd.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_pjc.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_prc.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_mpr.txt
> >
> >
> > Thanks for the help,
> > Jose
> >
> >
> > -----Original Message-----
> > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > Sent: Monday, March 14, 2016 12:17 PM
> > To: Jose Garcia-Rivera
> > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR
to
> > NetCDF
> >
> > Hi Jose. I apologize for the delayed response. I was out of the
> > office on Friday. I'm going to try to figure out a solution and
get
> > back with you shortly.
> >
> > Julie
> >
> > On Fri, Mar 11, 2016 at 2:02 PM, Jose Garcia-Rivera via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> > >
> > > Dear Julie,
> > >
> > > Any news regarding pb2nc? We're still unable to make it work.
> > >
> > > Best Regards,
> > > Jose
> > >
> > > -----Original Message-----
> > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > Sent: Thursday, March 10, 2016 4:20 PM
> > > To: Jose Garcia-Rivera
> > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR
> > > to NetCDF
> > >
> > > Hi Jose. Thank you for attaching the files.
> > >
> > > Could you please send me a list of the files in
> > > /work/apps/pgi_14.10/SANDY/bufrlib/lib?
> > >
> > > Thank you!
> > >
> > > Julie
> > >
> > >
> > > On Thu, Mar 10, 2016 at 12:20 PM, Jose Garcia-Rivera via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
>
> > > >
> > > > Dear Julie,
> > > >
> > > > The administrator re-compiled MET following your instructions,
> > > > and says there's still trouble. He sent me the log files
(attached).
> > > > Is there any other approach that might help?
> > > >
> > > > Best Regards,
> > > > Jose
> > > >
> > > > -----Original Message-----
> > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > Sent: Wednesday, March 09, 2016 12:39 PM
> > > > To: Jose Garcia-Rivera
> > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
PREPBUFR
> > > > to NetCDF
> > > >
> > > > Thank you, Jose! It looks like something went wrong during
> > compilation.
> > > > I suggest recompiling MET to see if we can get this issue
resolved.
> > > > NCEP's BUFRLIB is used by the pb2nc MET tool, and is a
required
> > > > external library for pb2nc. MET is not yet compatible with
> > > > BUFRLIB
> > > version 11.0.0, so we
> > > > suggest getting version 10.2.3. We are working on our online
> tutorial
> > > for
> > > > METv.5.1, but in the meantime, I'll point you to our online
> > > > tutorial directions for installing BUFRLIB:
> > > >
> > > >
> > > >
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.
> > > > 0/
> > > > co
> > > > mp
> > > > ilation/req_libs.php
> > > >
> > > > It is also important to review the necessary environment
> > > > variables to
> > > set:
> > > >
> > > >
> > > >
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.
> > > > 0/
> > > > co
> > > > mp
> > > > ilation/configure.php
> > > >
> > > > For example,
> > > >
> > > > "Set *$MET_BUFR* to point to the main BUFR directory, or set
> > > > *$MET_BUFRLIB* to point to the directory with the BUFR library
files.
> > > > Because MET doesn't use any BUFR library include files, you
> > > > don't need to specify *$MET_BUFRINC* ."
> > > >
> > > > Once you've installed the required libraries and set up your
> > > > environment variables, you'll be ready to configure MET
> > > > (instructions at the bottom of the last link above) and then
> > > > compile and install MET (
> > > >
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.
> > > > 0/
> > > > co
> > > > mp
> > > > ilation/compile.php
> > > > ).
> > > > After re-installing MET, please run "make test" again. If you
> > > > still encounter the same problem, please send me your
> > > > *config.log* file and your *make_install.log *file. Please
let
> > > > me know if you have any
> > > questions.
> > > >
> > > > Please let us know how it goes.
> > > >
> > > > Thanks,
> > > > Julie
> > > >
> > > >
> > > >
> > > >
> > > > On Wed, Mar 9, 2016 at 10:22 AM, Jose Garcia-Rivera via RT <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > > >
> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > >
> > > > >
> > > > > Dear Julie,
> > > > >
> > > > > Attached is the test log file. It's showing the same issues
on
> > > > > pb2nc even with the sample files.
> > > > >
> > > > > Best Regards,
> > > > > Jose
> > > > >
> > > > > -----Original Message-----
> > > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > > Sent: Tuesday, March 08, 2016 5:28 PM
> > > > > To: Jose Garcia-Rivera
> > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
> > > > > PREPBUFR to NetCDF
> > > > >
> > > > > Hi Jose. Thank you for uploading the files. Unfortunately,
I
> > > > > am unable to reproduce the error you are experiencing. I am
> > > > > wondering if you have successfully used pb2nc before. As a
> > > > > check could you please run the following in your met-5.1/
> directory:
> > > > >
> > > > > *make test >& make_test.log*
> > > > >
> > > > > and then send me the make_test.log file?
> > > > >
> > > > > Thanks,
> > > > > Julie
> > > > >
> > > > > On Tue, Mar 8, 2016 at 11:29 AM, Jose Garcia-Rivera via RT <
> > > > > met_help at ucar.edu> wrote:
> > > > >
> > > > > >
> > > > > > <URL:
> > > > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > > >
> > > > > >
> > > > > > Dear Julie,
> > > > > >
> > > > > > I just put the files in 'garcia_data'. I appreciate your
help.
> > > > > >
> > > > > > Best Regards,
> > > > > > Jose
> > > > > >
> > > > > > -----Original Message-----
> > > > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > > > Sent: Tuesday, March 08, 2016 1:12 PM
> > > > > > To: Jose Garcia-Rivera
> > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
> > > > > > PREPBUFR to NetCDF
> > > > > >
> > > > > > Hi Jose. I'm sorry to hear that you are having problems
> > > > > > converting a PREPBUFR file to NetCDF.
> > > > > >
> > > > > > Please upload your input files and configuration file to
our
> > > > > > anonymous ftp site as follows:
> > > > > > http://www.dtcenter.org/met/users/support/met_help.php
> > > > > >
> > > > > > Then I can take a look and get back to you.
> > > > > >
> > > > > > Thanks,
> > > > > > Julie
> > > > > >
> > > > > > On Tue, Mar 8, 2016 at 11:01 AM, Jose Garcia-Rivera via RT
<
> > > > > > met_help at ucar.edu> wrote:
> > > > > >
> > > > > > >
> > > > > > > Tue Mar 08 11:01:25 2016: Request 75433 was acted upon.
> > > > > > > Transaction: Ticket created by GarciaJ at imsg.com
> > > > > > > Queue: met_help
> > > > > > > Subject: Issues converting PREPBUFR to NetCDF
> > > > > > > Owner: Nobody
> > > > > > > Requestors: GarciaJ at imsg.com
> > > > > > > Status: new
> > > > > > > Ticket <URL:
> > > > > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > Dear Met Help,
> > > > > > >
> > > > > > > Trying to convert a PREPBUFR file to NetCDF.
> > > > > > >
> > > > > > > I used the default PB2NC configure file, and got the
following:
> > > > > > >
> > > > > > > [garciaj at login prepbufr_obs]$ ./pb2nc
> > > > > > > gdas1.t12z.prepbufr.nr gdas.20150820.t12z.nc
> > > > > > > PB2NCConfig_default DEBUG 1: Default Config
> > > > > > > File:
> > > > > > > /work/apps/pgi_14.10/met-
5.1/share/met/config/PB2NCConfig_
> > > > > > > de fa ul t DEBUG 1: User Config File:
PB2NCConfig_default
> > > > > > > DEBUG 1: Creating NetCDF File:
gdas.20150820.t12z.nc
> > > > > > > DEBUG 1: Processing PrepBufr File:
gdas1.t12z.prepbufr.nr
> > > > > > > DEBUG 1: Blocking PrepBufr file to:
> > /tmp/tmp_pb2nc_blk_32144_0
> > > > > > > WARNING:
> > > > > > > WARNING: process_pbfile() -> No PrepBufr messages to
> > > > > > > process in
> > > file:
> > > > > > > gdas1.t12z.prepbufr.nr
> > > > > > > WARNING:
> > > > > > > ERROR :
> > > > > > > ERROR : write_netcdf_hdr_data() -> No PrepBufr messages
> > retained.
> > > > > > > Nothing to write.
> > > > > > > ERROR :
> > > > > > >
> > > > > > >
> > > > > > > Thanks in advance for the help, Jose M. Garcia-Rivera,
PhD
> > > > > > > IM Systems Group Rockville/College Park, MD This e-mail,
> > > > > > > including attachments, may include confidential and/or
> > > > > > > proprietary information, and may be used only by the
> > > > > > > person or entity to which it is addressed. If the reader
> > > > > > > of this e-mail is not the intended recipient or his or
her
> > > > > > > authorized agent, the reader is hereby notified that any
> > > > > > > dissemination, distribution or copying of this e-mail is
> > > > > > > prohibited. If you have received this e-mail in error,
> > > > > > > please notify the sender by replying to this message and
> > > > > > > delete this
> > > > > > e-mail immediately.
> > > > > > >
> > > > > > >
> > > > > >
> > > > > >
> > > > > > --
> > > > > > Julie Prestopnik
> > > > > > National Center for Atmospheric Research Research
> > > > > > Applications Laboratory
> > > > > > Phone: 303.497.8399
> > > > > > Email: jpresto at ucar.edu
> > > > > >
> > > > > > This e-mail, including attachments, may include
confidential
> > > > > > and/or proprietary information, and may be used only by
the
> > > > > > person or entity to which it is addressed. If the reader
of
> > > > > > this e-mail is not the intended recipient or his or her
> > > > > > authorized agent, the reader is hereby notified that any
> > > > > > dissemination, distribution or copying of this e-mail is
> > > > > > prohibited. If you have received this e-mail in error,
> > > > > > please notify the sender by replying to this message and
> > > > > > delete this
> > > > > e-mail immediately.
> > > > > >
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > > > --
> > > > > Julie Prestopnik
> > > > > National Center for Atmospheric Research Research
Applications
> > > > > Laboratory
> > > > > Phone: 303.497.8399
> > > > > Email: jpresto at ucar.edu
> > > > >
> > > > > This e-mail, including attachments, may include confidential
> > > > > and/or proprietary information, and may be used only by the
> > > > > person or entity to which it is addressed. If the reader of
> > > > > this e-mail is not the intended recipient or his or her
> > > > > authorized agent, the reader is hereby notified that any
> > > > > dissemination, distribution or copying of this e-mail is
> > > > > prohibited. If you have received this e-mail in error,
please
> > > > > notify the sender by replying to this message and delete
this
> > > > e-mail immediately.
> > > > >
> > > > >
> > > >
> > > >
> > > > --
> > > > Julie Prestopnik
> > > > National Center for Atmospheric Research Research Applications
> > > > Laboratory
> > > > Phone: 303.497.8399
> > > > Email: jpresto at ucar.edu
> > > >
> > > > This e-mail, including attachments, may include confidential
> > > > and/or proprietary information, and may be used only by the
> > > > person or entity to which it is addressed. If the reader of
this
> > > > e-mail is not the intended recipient or his or her authorized
> > > > agent, the reader is hereby notified that any dissemination,
> > > > distribution or copying of this e-mail is prohibited. If you
> > > > have received this e-mail in error, please notify the sender
by
> > > > replying to this message and delete this
> > > e-mail immediately.
> > > >
> > > >
> > >
> > >
> > > --
> > > Julie Prestopnik
> > > National Center for Atmospheric Research Research Applications
> > > Laboratory
> > > Phone: 303.497.8399
> > > Email: jpresto at ucar.edu
> > >
> > > This e-mail, including attachments, may include confidential
> > > and/or proprietary information, and may be used only by the
person
> > > or entity to which it is addressed. If the reader of this e-mail
> > > is not the intended recipient or his or her authorized agent,
the
> > > reader is hereby notified that any dissemination, distribution
or
> > > copying of this e-mail is prohibited. If you have received this
> > > e-mail in error, please notify the sender by replying to this
> > > message and delete this
> > e-mail immediately.
> > >
> > >
> > >
> >
> >
> > --
> > Julie Prestopnik
> > National Center for Atmospheric Research Research Applications
> > Laboratory
> > Phone: 303.497.8399
> > Email: jpresto at ucar.edu
> >
> > This e-mail, including attachments, may include confidential
and/or
> > proprietary information, and may be used only by the person or
> > entity to which it is addressed. If the reader of this e-mail is
not
> > the intended recipient or his or her authorized agent, the reader
is
> > hereby notified that any dissemination, distribution or copying of
> > this e-mail is prohibited. If you have received this e-mail in
> > error, please notify the sender by replying to this message and
> > delete this
> e-mail immediately.
> >
> >
> >
>
>
> --
> Julie Prestopnik
> National Center for Atmospheric Research Research Applications
> Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
> This e-mail, including attachments, may include confidential and/or
> proprietary information, and may be used only by the person or
entity
> to which it is addressed. If the reader of this e-mail is not the
> intended recipient or his or her authorized agent, the reader is
> hereby notified that any dissemination, distribution or copying of
> this e-mail is prohibited. If you have received this e-mail in
error,
> please notify the sender by replying to this message and delete this
e-mail immediately.
>
>
>
--
Julie Prestopnik
National Center for Atmospheric Research Research Applications
Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
This e-mail, including attachments, may include confidential and/or
proprietary information, and may be used only by the person or entity
to which it is addressed. If the reader of this e-mail is not the
intended recipient or his or her authorized agent, the reader is
hereby notified that any dissemination, distribution or copying of
this e-mail is prohibited. If you have received this e-mail in error,
please notify the sender by replying to this message and delete this
e-mail immediately.
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to NetCDF
From: Jose Garcia-Rivera
Time: Tue Mar 15 15:05:06 2016
Dear Julie,
Quick question: Were you able to run point_stat with the netCDF file
that I sent yesterday?
Thanks for the help,
Jose
-----Original Message-----
From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
Sent: Tuesday, March 15, 2016 12:17 PM
To: Jose Garcia-Rivera
Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to
NetCDF
Thank you, Jose. I'm working with co-workers to try to get these
issues resolved. I hope to get back to you soon.
Julie
On Mon, Mar 14, 2016 at 1:36 PM, Jose Garcia-Rivera via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
>
> Dear Julie,
>
> I just uploaded the three files to 'garcia_data'.
>
> Thanks for the help,
> Jose
>
>
> -----Original Message-----
> From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> Sent: Monday, March 14, 2016 3:32 PM
> To: Jose Garcia-Rivera
> Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to
> NetCDF
>
> Hi Jose.
>
> Yes, please upload your input files and configuration file
> (nmbprs_d01.06, test.nc, PointStatConfig_default) to our anonymous
ftp site as follows:
> http://www.dtcenter.org/met/users/support/met_help.php
>
> Thanks!
>
> Julie
>
> On Mon, Mar 14, 2016 at 1:06 PM, Jose Garcia-Rivera via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> >
> > Dear Julie,
> >
> > I got to convert my prepbufr file using a python script. However,
I
> > have trouble running point_stat. Can I send you the files, to see
if
> > you have the same issue?
> >
> >
> > This is what I got:
> >
> > [garciaj at login prepbufr_obs]$ ./point_stat nmbprs_d01.06 test.nc
> > PointStatConfig_default DEBUG 1: Default Config File:
> > /work/apps/pgi_14.10/SANDY/met-
5.1/share/met/config/PointStatConfig_
> > de fault DEBUG 1: User Config File: PointStatConfig_default
> > GSL_RNG_TYPE=mt19937
> > GSL_RNG_SEED=18446744073425053526
> > DEBUG 1: Forecast File: nmbprs_d01.06 DEBUG 1: Observation File:
> > test.nc DEBUG 2:
> > DEBUG 2:
> >
--------------------------------------------------------------------
> > --
> > ----------
> > DEBUG 2:
> > DEBUG 2: Reading data for SPFH/P500.
> > DEBUG 2: For SPFH/P500 found 1 forecast levels and 0 climatology
levels.
> > DEBUG 2:
> > DEBUG 2:
> >
--------------------------------------------------------------------
> > --
> > ----------
> > DEBUG 2:
> > DEBUG 2: Reading data for TMP/P500.
> > DEBUG 2: For TMP/P500 found 1 forecast levels and 0 climatology
levels.
> > DEBUG 2:
> > DEBUG 2:
> >
--------------------------------------------------------------------
> > --
> > ----------
> > DEBUG 2:
> > DEBUG 2: Reading data for HGT/P500.
> > DEBUG 2: For HGT/P500 found 1 forecast levels and 0 climatology
levels.
> > DEBUG 2:
> > DEBUG 2:
> >
--------------------------------------------------------------------
> > --
> > ----------
> > DEBUG 2:
> > DEBUG 2: Reading data for UGRD/P500.
> > DEBUG 2: For UGRD/P500 found 1 forecast levels and 0 climatology
levels.
> > DEBUG 2:
> > DEBUG 2:
> >
--------------------------------------------------------------------
> > --
> > ----------
> > DEBUG 2:
> > DEBUG 2: Reading data for VGRD/P500.
> > DEBUG 2: For VGRD/P500 found 1 forecast levels and 0 climatology
levels.
> > DEBUG 2:
> > DEBUG 2:
> >
--------------------------------------------------------------------
> > --
> > ----------
> > DEBUG 2:
> > WARNING:
> > WARNING: process_obs_file() -> can't open observation netCDF file:
> > test.nc
> > WARNING:
> > DEBUG 2:
> > DEBUG 2:
> >
--------------------------------------------------------------------
> > --
> > ----------
> > DEBUG 2:
> > DEBUG 2: Processing SPFH/P500 versus SPFH/P500, for observation
type
> > ADPUPA, over region FULL, for interpolation method NEAREST(1),
using
> > 0 pairs.
> > DEBUG 2:
> > DEBUG 2:
> >
--------------------------------------------------------------------
> > --
> > ----------
> > DEBUG 2:
> > DEBUG 2: Processing TMP/P500 versus TMP/P500, for observation type
> > ADPUPA, over region FULL, for interpolation method NEAREST(1),
using
> > 0
> pairs.
> > DEBUG 2:
> > DEBUG 2:
> >
--------------------------------------------------------------------
> > --
> > ----------
> > DEBUG 2:
> > DEBUG 2: Processing HGT/P500 versus HGT/P500, for observation type
> > ADPUPA, over region FULL, for interpolation method NEAREST(1),
using
> > 0
> pairs.
> > DEBUG 2:
> > DEBUG 2:
> >
--------------------------------------------------------------------
> > --
> > ----------
> > DEBUG 2:
> > DEBUG 2: Processing UGRD/P500 versus UGRD/P500, for observation
type
> > ADPUPA, over region FULL, for interpolation method NEAREST(1),
using
> > 0 pairs.
> > DEBUG 2:
> > DEBUG 2:
> >
--------------------------------------------------------------------
> > --
> > ----------
> > DEBUG 2:
> > DEBUG 2: Processing VGRD/P500 versus VGRD/P500, for observation
type
> > ADPUPA, over region FULL, for interpolation method NEAREST(1),
using
> > 0 pairs.
> > DEBUG 2:
> > DEBUG 2:
> >
--------------------------------------------------------------------
> > --
> > ----------
> > DEBUG 2:
> > DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V.stat
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_fho.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_ctc.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_cts.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_mctc.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_mcts.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_cnt.txt
> > DEBUG 1: Output file:
> > ./point_stat_060000L_20150820_180000V_sl1l2.txt
> > DEBUG 1: Output file:
> > ./point_stat_060000L_20150820_180000V_sal1l2.txt
> > DEBUG 1: Output file:
> > ./point_stat_060000L_20150820_180000V_vl1l2.txt
> > DEBUG 1: Output file:
> > ./point_stat_060000L_20150820_180000V_val1l2.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_pct.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_pstd.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_pjc.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_prc.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_mpr.txt
> >
> >
> > Thanks for the help,
> > Jose
> >
> >
> > -----Original Message-----
> > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > Sent: Monday, March 14, 2016 12:17 PM
> > To: Jose Garcia-Rivera
> > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR
to
> > NetCDF
> >
> > Hi Jose. I apologize for the delayed response. I was out of the
> > office on Friday. I'm going to try to figure out a solution and
get
> > back with you shortly.
> >
> > Julie
> >
> > On Fri, Mar 11, 2016 at 2:02 PM, Jose Garcia-Rivera via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> > >
> > > Dear Julie,
> > >
> > > Any news regarding pb2nc? We're still unable to make it work.
> > >
> > > Best Regards,
> > > Jose
> > >
> > > -----Original Message-----
> > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > Sent: Thursday, March 10, 2016 4:20 PM
> > > To: Jose Garcia-Rivera
> > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR
> > > to NetCDF
> > >
> > > Hi Jose. Thank you for attaching the files.
> > >
> > > Could you please send me a list of the files in
> > > /work/apps/pgi_14.10/SANDY/bufrlib/lib?
> > >
> > > Thank you!
> > >
> > > Julie
> > >
> > >
> > > On Thu, Mar 10, 2016 at 12:20 PM, Jose Garcia-Rivera via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
>
> > > >
> > > > Dear Julie,
> > > >
> > > > The administrator re-compiled MET following your instructions,
> > > > and says there's still trouble. He sent me the log files
(attached).
> > > > Is there any other approach that might help?
> > > >
> > > > Best Regards,
> > > > Jose
> > > >
> > > > -----Original Message-----
> > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > Sent: Wednesday, March 09, 2016 12:39 PM
> > > > To: Jose Garcia-Rivera
> > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
PREPBUFR
> > > > to NetCDF
> > > >
> > > > Thank you, Jose! It looks like something went wrong during
> > compilation.
> > > > I suggest recompiling MET to see if we can get this issue
resolved.
> > > > NCEP's BUFRLIB is used by the pb2nc MET tool, and is a
required
> > > > external library for pb2nc. MET is not yet compatible with
> > > > BUFRLIB
> > > version 11.0.0, so we
> > > > suggest getting version 10.2.3. We are working on our online
> tutorial
> > > for
> > > > METv.5.1, but in the meantime, I'll point you to our online
> > > > tutorial directions for installing BUFRLIB:
> > > >
> > > >
> > > >
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.
> > > > 0/
> > > > co
> > > > mp
> > > > ilation/req_libs.php
> > > >
> > > > It is also important to review the necessary environment
> > > > variables to
> > > set:
> > > >
> > > >
> > > >
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.
> > > > 0/
> > > > co
> > > > mp
> > > > ilation/configure.php
> > > >
> > > > For example,
> > > >
> > > > "Set *$MET_BUFR* to point to the main BUFR directory, or set
> > > > *$MET_BUFRLIB* to point to the directory with the BUFR library
files.
> > > > Because MET doesn't use any BUFR library include files, you
> > > > don't need to specify *$MET_BUFRINC* ."
> > > >
> > > > Once you've installed the required libraries and set up your
> > > > environment variables, you'll be ready to configure MET
> > > > (instructions at the bottom of the last link above) and then
> > > > compile and install MET (
> > > >
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.
> > > > 0/
> > > > co
> > > > mp
> > > > ilation/compile.php
> > > > ).
> > > > After re-installing MET, please run "make test" again. If you
> > > > still encounter the same problem, please send me your
> > > > *config.log* file and your *make_install.log *file. Please
let
> > > > me know if you have any
> > > questions.
> > > >
> > > > Please let us know how it goes.
> > > >
> > > > Thanks,
> > > > Julie
> > > >
> > > >
> > > >
> > > >
> > > > On Wed, Mar 9, 2016 at 10:22 AM, Jose Garcia-Rivera via RT <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > > >
> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > >
> > > > >
> > > > > Dear Julie,
> > > > >
> > > > > Attached is the test log file. It's showing the same issues
on
> > > > > pb2nc even with the sample files.
> > > > >
> > > > > Best Regards,
> > > > > Jose
> > > > >
> > > > > -----Original Message-----
> > > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > > Sent: Tuesday, March 08, 2016 5:28 PM
> > > > > To: Jose Garcia-Rivera
> > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
> > > > > PREPBUFR to NetCDF
> > > > >
> > > > > Hi Jose. Thank you for uploading the files. Unfortunately,
I
> > > > > am unable to reproduce the error you are experiencing. I am
> > > > > wondering if you have successfully used pb2nc before. As a
> > > > > check could you please run the following in your met-5.1/
> directory:
> > > > >
> > > > > *make test >& make_test.log*
> > > > >
> > > > > and then send me the make_test.log file?
> > > > >
> > > > > Thanks,
> > > > > Julie
> > > > >
> > > > > On Tue, Mar 8, 2016 at 11:29 AM, Jose Garcia-Rivera via RT <
> > > > > met_help at ucar.edu> wrote:
> > > > >
> > > > > >
> > > > > > <URL:
> > > > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > > >
> > > > > >
> > > > > > Dear Julie,
> > > > > >
> > > > > > I just put the files in 'garcia_data'. I appreciate your
help.
> > > > > >
> > > > > > Best Regards,
> > > > > > Jose
> > > > > >
> > > > > > -----Original Message-----
> > > > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > > > Sent: Tuesday, March 08, 2016 1:12 PM
> > > > > > To: Jose Garcia-Rivera
> > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
> > > > > > PREPBUFR to NetCDF
> > > > > >
> > > > > > Hi Jose. I'm sorry to hear that you are having problems
> > > > > > converting a PREPBUFR file to NetCDF.
> > > > > >
> > > > > > Please upload your input files and configuration file to
our
> > > > > > anonymous ftp site as follows:
> > > > > > http://www.dtcenter.org/met/users/support/met_help.php
> > > > > >
> > > > > > Then I can take a look and get back to you.
> > > > > >
> > > > > > Thanks,
> > > > > > Julie
> > > > > >
> > > > > > On Tue, Mar 8, 2016 at 11:01 AM, Jose Garcia-Rivera via RT
<
> > > > > > met_help at ucar.edu> wrote:
> > > > > >
> > > > > > >
> > > > > > > Tue Mar 08 11:01:25 2016: Request 75433 was acted upon.
> > > > > > > Transaction: Ticket created by GarciaJ at imsg.com
> > > > > > > Queue: met_help
> > > > > > > Subject: Issues converting PREPBUFR to NetCDF
> > > > > > > Owner: Nobody
> > > > > > > Requestors: GarciaJ at imsg.com
> > > > > > > Status: new
> > > > > > > Ticket <URL:
> > > > > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > Dear Met Help,
> > > > > > >
> > > > > > > Trying to convert a PREPBUFR file to NetCDF.
> > > > > > >
> > > > > > > I used the default PB2NC configure file, and got the
following:
> > > > > > >
> > > > > > > [garciaj at login prepbufr_obs]$ ./pb2nc
> > > > > > > gdas1.t12z.prepbufr.nr gdas.20150820.t12z.nc
> > > > > > > PB2NCConfig_default DEBUG 1: Default Config
> > > > > > > File:
> > > > > > > /work/apps/pgi_14.10/met-
5.1/share/met/config/PB2NCConfig_
> > > > > > > de fa ul t DEBUG 1: User Config File:
PB2NCConfig_default
> > > > > > > DEBUG 1: Creating NetCDF File:
gdas.20150820.t12z.nc
> > > > > > > DEBUG 1: Processing PrepBufr File:
gdas1.t12z.prepbufr.nr
> > > > > > > DEBUG 1: Blocking PrepBufr file to:
> > /tmp/tmp_pb2nc_blk_32144_0
> > > > > > > WARNING:
> > > > > > > WARNING: process_pbfile() -> No PrepBufr messages to
> > > > > > > process in
> > > file:
> > > > > > > gdas1.t12z.prepbufr.nr
> > > > > > > WARNING:
> > > > > > > ERROR :
> > > > > > > ERROR : write_netcdf_hdr_data() -> No PrepBufr messages
> > retained.
> > > > > > > Nothing to write.
> > > > > > > ERROR :
> > > > > > >
> > > > > > >
> > > > > > > Thanks in advance for the help, Jose M. Garcia-Rivera,
PhD
> > > > > > > IM Systems Group Rockville/College Park, MD This e-mail,
> > > > > > > including attachments, may include confidential and/or
> > > > > > > proprietary information, and may be used only by the
> > > > > > > person or entity to which it is addressed. If the reader
> > > > > > > of this e-mail is not the intended recipient or his or
her
> > > > > > > authorized agent, the reader is hereby notified that any
> > > > > > > dissemination, distribution or copying of this e-mail is
> > > > > > > prohibited. If you have received this e-mail in error,
> > > > > > > please notify the sender by replying to this message and
> > > > > > > delete this
> > > > > > e-mail immediately.
> > > > > > >
> > > > > > >
> > > > > >
> > > > > >
> > > > > > --
> > > > > > Julie Prestopnik
> > > > > > National Center for Atmospheric Research Research
> > > > > > Applications Laboratory
> > > > > > Phone: 303.497.8399
> > > > > > Email: jpresto at ucar.edu
> > > > > >
> > > > > > This e-mail, including attachments, may include
confidential
> > > > > > and/or proprietary information, and may be used only by
the
> > > > > > person or entity to which it is addressed. If the reader
of
> > > > > > this e-mail is not the intended recipient or his or her
> > > > > > authorized agent, the reader is hereby notified that any
> > > > > > dissemination, distribution or copying of this e-mail is
> > > > > > prohibited. If you have received this e-mail in error,
> > > > > > please notify the sender by replying to this message and
> > > > > > delete this
> > > > > e-mail immediately.
> > > > > >
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > > > --
> > > > > Julie Prestopnik
> > > > > National Center for Atmospheric Research Research
Applications
> > > > > Laboratory
> > > > > Phone: 303.497.8399
> > > > > Email: jpresto at ucar.edu
> > > > >
> > > > > This e-mail, including attachments, may include confidential
> > > > > and/or proprietary information, and may be used only by the
> > > > > person or entity to which it is addressed. If the reader of
> > > > > this e-mail is not the intended recipient or his or her
> > > > > authorized agent, the reader is hereby notified that any
> > > > > dissemination, distribution or copying of this e-mail is
> > > > > prohibited. If you have received this e-mail in error,
please
> > > > > notify the sender by replying to this message and delete
this
> > > > e-mail immediately.
> > > > >
> > > > >
> > > >
> > > >
> > > > --
> > > > Julie Prestopnik
> > > > National Center for Atmospheric Research Research Applications
> > > > Laboratory
> > > > Phone: 303.497.8399
> > > > Email: jpresto at ucar.edu
> > > >
> > > > This e-mail, including attachments, may include confidential
> > > > and/or proprietary information, and may be used only by the
> > > > person or entity to which it is addressed. If the reader of
this
> > > > e-mail is not the intended recipient or his or her authorized
> > > > agent, the reader is hereby notified that any dissemination,
> > > > distribution or copying of this e-mail is prohibited. If you
> > > > have received this e-mail in error, please notify the sender
by
> > > > replying to this message and delete this
> > > e-mail immediately.
> > > >
> > > >
> > >
> > >
> > > --
> > > Julie Prestopnik
> > > National Center for Atmospheric Research Research Applications
> > > Laboratory
> > > Phone: 303.497.8399
> > > Email: jpresto at ucar.edu
> > >
> > > This e-mail, including attachments, may include confidential
> > > and/or proprietary information, and may be used only by the
person
> > > or entity to which it is addressed. If the reader of this e-mail
> > > is not the intended recipient or his or her authorized agent,
the
> > > reader is hereby notified that any dissemination, distribution
or
> > > copying of this e-mail is prohibited. If you have received this
> > > e-mail in error, please notify the sender by replying to this
> > > message and delete this
> > e-mail immediately.
> > >
> > >
> > >
> >
> >
> > --
> > Julie Prestopnik
> > National Center for Atmospheric Research Research Applications
> > Laboratory
> > Phone: 303.497.8399
> > Email: jpresto at ucar.edu
> >
> > This e-mail, including attachments, may include confidential
and/or
> > proprietary information, and may be used only by the person or
> > entity to which it is addressed. If the reader of this e-mail is
not
> > the intended recipient or his or her authorized agent, the reader
is
> > hereby notified that any dissemination, distribution or copying of
> > this e-mail is prohibited. If you have received this e-mail in
> > error, please notify the sender by replying to this message and
> > delete this
> e-mail immediately.
> >
> >
> >
>
>
> --
> Julie Prestopnik
> National Center for Atmospheric Research Research Applications
> Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
> This e-mail, including attachments, may include confidential and/or
> proprietary information, and may be used only by the person or
entity
> to which it is addressed. If the reader of this e-mail is not the
> intended recipient or his or her authorized agent, the reader is
> hereby notified that any dissemination, distribution or copying of
> this e-mail is prohibited. If you have received this e-mail in
error,
> please notify the sender by replying to this message and delete this
e-mail immediately.
>
>
>
--
Julie Prestopnik
National Center for Atmospheric Research Research Applications
Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
This e-mail, including attachments, may include confidential and/or
proprietary information, and may be used only by the person or entity
to which it is addressed. If the reader of this e-mail is not the
intended recipient or his or her authorized agent, the reader is
hereby notified that any dissemination, distribution or copying of
this e-mail is prohibited. If you have received this e-mail in error,
please notify the sender by replying to this message and delete this
e-mail immediately.
------------------------------------------------
Subject: Issues converting PREPBUFR to NetCDF
From: Julie Prestopnik
Time: Tue Mar 15 15:07:53 2016
Hi Jose. I was not. I got the same error you did. I believe that
the
test.nc file is not in the correct format needed by point_stat, so I
think
we need to get pb2nc working for you. It is likely a communication
problem
between the C code and the Fortran code.
Julie
On Tue, Mar 15, 2016 at 3:05 PM, Jose Garcia-Rivera via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
>
> Dear Julie,
>
> Quick question: Were you able to run point_stat with the netCDF file
that
> I sent yesterday?
>
> Thanks for the help,
> Jose
>
> -----Original Message-----
> From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> Sent: Tuesday, March 15, 2016 12:17 PM
> To: Jose Garcia-Rivera
> Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to
NetCDF
>
> Thank you, Jose. I'm working with co-workers to try to get these
issues
> resolved. I hope to get back to you soon.
>
> Julie
>
> On Mon, Mar 14, 2016 at 1:36 PM, Jose Garcia-Rivera via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> >
> > Dear Julie,
> >
> > I just uploaded the three files to 'garcia_data'.
> >
> > Thanks for the help,
> > Jose
> >
> >
> > -----Original Message-----
> > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > Sent: Monday, March 14, 2016 3:32 PM
> > To: Jose Garcia-Rivera
> > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR
to
> > NetCDF
> >
> > Hi Jose.
> >
> > Yes, please upload your input files and configuration file
> > (nmbprs_d01.06, test.nc, PointStatConfig_default) to our anonymous
ftp
> site as follows:
> > http://www.dtcenter.org/met/users/support/met_help.php
> >
> > Thanks!
> >
> > Julie
> >
> > On Mon, Mar 14, 2016 at 1:06 PM, Jose Garcia-Rivera via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> > >
> > > Dear Julie,
> > >
> > > I got to convert my prepbufr file using a python script.
However, I
> > > have trouble running point_stat. Can I send you the files, to
see if
> > > you have the same issue?
> > >
> > >
> > > This is what I got:
> > >
> > > [garciaj at login prepbufr_obs]$ ./point_stat nmbprs_d01.06 test.nc
> > > PointStatConfig_default DEBUG 1: Default Config File:
> > > /work/apps/pgi_14.10/SANDY/met-
5.1/share/met/config/PointStatConfig_
> > > de fault DEBUG 1: User Config File: PointStatConfig_default
> > > GSL_RNG_TYPE=mt19937
> > > GSL_RNG_SEED=18446744073425053526
> > > DEBUG 1: Forecast File: nmbprs_d01.06 DEBUG 1: Observation File:
> > > test.nc DEBUG 2:
> > > DEBUG 2:
> > >
--------------------------------------------------------------------
> > > --
> > > ----------
> > > DEBUG 2:
> > > DEBUG 2: Reading data for SPFH/P500.
> > > DEBUG 2: For SPFH/P500 found 1 forecast levels and 0 climatology
> levels.
> > > DEBUG 2:
> > > DEBUG 2:
> > >
--------------------------------------------------------------------
> > > --
> > > ----------
> > > DEBUG 2:
> > > DEBUG 2: Reading data for TMP/P500.
> > > DEBUG 2: For TMP/P500 found 1 forecast levels and 0 climatology
levels.
> > > DEBUG 2:
> > > DEBUG 2:
> > >
--------------------------------------------------------------------
> > > --
> > > ----------
> > > DEBUG 2:
> > > DEBUG 2: Reading data for HGT/P500.
> > > DEBUG 2: For HGT/P500 found 1 forecast levels and 0 climatology
levels.
> > > DEBUG 2:
> > > DEBUG 2:
> > >
--------------------------------------------------------------------
> > > --
> > > ----------
> > > DEBUG 2:
> > > DEBUG 2: Reading data for UGRD/P500.
> > > DEBUG 2: For UGRD/P500 found 1 forecast levels and 0 climatology
> levels.
> > > DEBUG 2:
> > > DEBUG 2:
> > >
--------------------------------------------------------------------
> > > --
> > > ----------
> > > DEBUG 2:
> > > DEBUG 2: Reading data for VGRD/P500.
> > > DEBUG 2: For VGRD/P500 found 1 forecast levels and 0 climatology
> levels.
> > > DEBUG 2:
> > > DEBUG 2:
> > >
--------------------------------------------------------------------
> > > --
> > > ----------
> > > DEBUG 2:
> > > WARNING:
> > > WARNING: process_obs_file() -> can't open observation netCDF
file:
> > > test.nc
> > > WARNING:
> > > DEBUG 2:
> > > DEBUG 2:
> > >
--------------------------------------------------------------------
> > > --
> > > ----------
> > > DEBUG 2:
> > > DEBUG 2: Processing SPFH/P500 versus SPFH/P500, for observation
type
> > > ADPUPA, over region FULL, for interpolation method NEAREST(1),
using
> > > 0 pairs.
> > > DEBUG 2:
> > > DEBUG 2:
> > >
--------------------------------------------------------------------
> > > --
> > > ----------
> > > DEBUG 2:
> > > DEBUG 2: Processing TMP/P500 versus TMP/P500, for observation
type
> > > ADPUPA, over region FULL, for interpolation method NEAREST(1),
using
> > > 0
> > pairs.
> > > DEBUG 2:
> > > DEBUG 2:
> > >
--------------------------------------------------------------------
> > > --
> > > ----------
> > > DEBUG 2:
> > > DEBUG 2: Processing HGT/P500 versus HGT/P500, for observation
type
> > > ADPUPA, over region FULL, for interpolation method NEAREST(1),
using
> > > 0
> > pairs.
> > > DEBUG 2:
> > > DEBUG 2:
> > >
--------------------------------------------------------------------
> > > --
> > > ----------
> > > DEBUG 2:
> > > DEBUG 2: Processing UGRD/P500 versus UGRD/P500, for observation
type
> > > ADPUPA, over region FULL, for interpolation method NEAREST(1),
using
> > > 0 pairs.
> > > DEBUG 2:
> > > DEBUG 2:
> > >
--------------------------------------------------------------------
> > > --
> > > ----------
> > > DEBUG 2:
> > > DEBUG 2: Processing VGRD/P500 versus VGRD/P500, for observation
type
> > > ADPUPA, over region FULL, for interpolation method NEAREST(1),
using
> > > 0 pairs.
> > > DEBUG 2:
> > > DEBUG 2:
> > >
--------------------------------------------------------------------
> > > --
> > > ----------
> > > DEBUG 2:
> > > DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V.stat
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_fho.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_ctc.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_cts.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_mctc.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_mcts.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_cnt.txt
> > > DEBUG 1: Output file:
> > > ./point_stat_060000L_20150820_180000V_sl1l2.txt
> > > DEBUG 1: Output file:
> > > ./point_stat_060000L_20150820_180000V_sal1l2.txt
> > > DEBUG 1: Output file:
> > > ./point_stat_060000L_20150820_180000V_vl1l2.txt
> > > DEBUG 1: Output file:
> > > ./point_stat_060000L_20150820_180000V_val1l2.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_pct.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_pstd.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_pjc.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_prc.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_mpr.txt
> > >
> > >
> > > Thanks for the help,
> > > Jose
> > >
> > >
> > > -----Original Message-----
> > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > Sent: Monday, March 14, 2016 12:17 PM
> > > To: Jose Garcia-Rivera
> > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR
to
> > > NetCDF
> > >
> > > Hi Jose. I apologize for the delayed response. I was out of
the
> > > office on Friday. I'm going to try to figure out a solution and
get
> > > back with you shortly.
> > >
> > > Julie
> > >
> > > On Fri, Mar 11, 2016 at 2:02 PM, Jose Garcia-Rivera via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
>
> > > >
> > > > Dear Julie,
> > > >
> > > > Any news regarding pb2nc? We're still unable to make it work.
> > > >
> > > > Best Regards,
> > > > Jose
> > > >
> > > > -----Original Message-----
> > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > Sent: Thursday, March 10, 2016 4:20 PM
> > > > To: Jose Garcia-Rivera
> > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
PREPBUFR
> > > > to NetCDF
> > > >
> > > > Hi Jose. Thank you for attaching the files.
> > > >
> > > > Could you please send me a list of the files in
> > > > /work/apps/pgi_14.10/SANDY/bufrlib/lib?
> > > >
> > > > Thank you!
> > > >
> > > > Julie
> > > >
> > > >
> > > > On Thu, Mar 10, 2016 at 12:20 PM, Jose Garcia-Rivera via RT <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > > >
> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> > > > >
> > > > > Dear Julie,
> > > > >
> > > > > The administrator re-compiled MET following your
instructions,
> > > > > and says there's still trouble. He sent me the log files
> (attached).
> > > > > Is there any other approach that might help?
> > > > >
> > > > > Best Regards,
> > > > > Jose
> > > > >
> > > > > -----Original Message-----
> > > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > > Sent: Wednesday, March 09, 2016 12:39 PM
> > > > > To: Jose Garcia-Rivera
> > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
PREPBUFR
> > > > > to NetCDF
> > > > >
> > > > > Thank you, Jose! It looks like something went wrong during
> > > compilation.
> > > > > I suggest recompiling MET to see if we can get this issue
resolved.
> > > > > NCEP's BUFRLIB is used by the pb2nc MET tool, and is a
required
> > > > > external library for pb2nc. MET is not yet compatible with
> > > > > BUFRLIB
> > > > version 11.0.0, so we
> > > > > suggest getting version 10.2.3. We are working on our
online
> > tutorial
> > > > for
> > > > > METv.5.1, but in the meantime, I'll point you to our online
> > > > > tutorial directions for installing BUFRLIB:
> > > > >
> > > > >
> > > > >
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.
> > > > > 0/
> > > > > co
> > > > > mp
> > > > > ilation/req_libs.php
> > > > >
> > > > > It is also important to review the necessary environment
> > > > > variables to
> > > > set:
> > > > >
> > > > >
> > > > >
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.
> > > > > 0/
> > > > > co
> > > > > mp
> > > > > ilation/configure.php
> > > > >
> > > > > For example,
> > > > >
> > > > > "Set *$MET_BUFR* to point to the main BUFR directory, or set
> > > > > *$MET_BUFRLIB* to point to the directory with the BUFR
library
> files.
> > > > > Because MET doesn't use any BUFR library include files, you
> > > > > don't need to specify *$MET_BUFRINC* ."
> > > > >
> > > > > Once you've installed the required libraries and set up your
> > > > > environment variables, you'll be ready to configure MET
> > > > > (instructions at the bottom of the last link above) and then
> > > > > compile and install MET (
> > > > >
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.
> > > > > 0/
> > > > > co
> > > > > mp
> > > > > ilation/compile.php
> > > > > ).
> > > > > After re-installing MET, please run "make test" again. If
you
> > > > > still encounter the same problem, please send me your
> > > > > *config.log* file and your *make_install.log *file. Please
let
> > > > > me know if you have any
> > > > questions.
> > > > >
> > > > > Please let us know how it goes.
> > > > >
> > > > > Thanks,
> > > > > Julie
> > > > >
> > > > >
> > > > >
> > > > >
> > > > > On Wed, Mar 9, 2016 at 10:22 AM, Jose Garcia-Rivera via RT <
> > > > > met_help at ucar.edu> wrote:
> > > > >
> > > > > >
> > > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > > >
> > > > > >
> > > > > > Dear Julie,
> > > > > >
> > > > > > Attached is the test log file. It's showing the same
issues on
> > > > > > pb2nc even with the sample files.
> > > > > >
> > > > > > Best Regards,
> > > > > > Jose
> > > > > >
> > > > > > -----Original Message-----
> > > > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > > > Sent: Tuesday, March 08, 2016 5:28 PM
> > > > > > To: Jose Garcia-Rivera
> > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
> > > > > > PREPBUFR to NetCDF
> > > > > >
> > > > > > Hi Jose. Thank you for uploading the files.
Unfortunately, I
> > > > > > am unable to reproduce the error you are experiencing. I
am
> > > > > > wondering if you have successfully used pb2nc before. As
a
> > > > > > check could you please run the following in your met-5.1/
> > directory:
> > > > > >
> > > > > > *make test >& make_test.log*
> > > > > >
> > > > > > and then send me the make_test.log file?
> > > > > >
> > > > > > Thanks,
> > > > > > Julie
> > > > > >
> > > > > > On Tue, Mar 8, 2016 at 11:29 AM, Jose Garcia-Rivera via RT
<
> > > > > > met_help at ucar.edu> wrote:
> > > > > >
> > > > > > >
> > > > > > > <URL:
> > > > > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > > > >
> > > > > > >
> > > > > > > Dear Julie,
> > > > > > >
> > > > > > > I just put the files in 'garcia_data'. I appreciate your
help.
> > > > > > >
> > > > > > > Best Regards,
> > > > > > > Jose
> > > > > > >
> > > > > > > -----Original Message-----
> > > > > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > > > > Sent: Tuesday, March 08, 2016 1:12 PM
> > > > > > > To: Jose Garcia-Rivera
> > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
> > > > > > > PREPBUFR to NetCDF
> > > > > > >
> > > > > > > Hi Jose. I'm sorry to hear that you are having problems
> > > > > > > converting a PREPBUFR file to NetCDF.
> > > > > > >
> > > > > > > Please upload your input files and configuration file to
our
> > > > > > > anonymous ftp site as follows:
> > > > > > > http://www.dtcenter.org/met/users/support/met_help.php
> > > > > > >
> > > > > > > Then I can take a look and get back to you.
> > > > > > >
> > > > > > > Thanks,
> > > > > > > Julie
> > > > > > >
> > > > > > > On Tue, Mar 8, 2016 at 11:01 AM, Jose Garcia-Rivera via
RT <
> > > > > > > met_help at ucar.edu> wrote:
> > > > > > >
> > > > > > > >
> > > > > > > > Tue Mar 08 11:01:25 2016: Request 75433 was acted
upon.
> > > > > > > > Transaction: Ticket created by GarciaJ at imsg.com
> > > > > > > > Queue: met_help
> > > > > > > > Subject: Issues converting PREPBUFR to NetCDF
> > > > > > > > Owner: Nobody
> > > > > > > > Requestors: GarciaJ at imsg.com
> > > > > > > > Status: new
> > > > > > > > Ticket <URL:
> > > > > > > >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > Dear Met Help,
> > > > > > > >
> > > > > > > > Trying to convert a PREPBUFR file to NetCDF.
> > > > > > > >
> > > > > > > > I used the default PB2NC configure file, and got the
> following:
> > > > > > > >
> > > > > > > > [garciaj at login prepbufr_obs]$ ./pb2nc
> > > > > > > > gdas1.t12z.prepbufr.nr gdas.20150820.t12z.nc
> > > > > > > > PB2NCConfig_default DEBUG 1: Default Config
> > > > > > > > File:
> > > > > > > > /work/apps/pgi_14.10/met-
5.1/share/met/config/PB2NCConfig_
> > > > > > > > de fa ul t DEBUG 1: User Config File:
PB2NCConfig_default
> > > > > > > > DEBUG 1: Creating NetCDF File:
> gdas.20150820.t12z.nc
> > > > > > > > DEBUG 1: Processing PrepBufr File:
> gdas1.t12z.prepbufr.nr
> > > > > > > > DEBUG 1: Blocking PrepBufr file to:
> > > /tmp/tmp_pb2nc_blk_32144_0
> > > > > > > > WARNING:
> > > > > > > > WARNING: process_pbfile() -> No PrepBufr messages to
> > > > > > > > process in
> > > > file:
> > > > > > > > gdas1.t12z.prepbufr.nr
> > > > > > > > WARNING:
> > > > > > > > ERROR :
> > > > > > > > ERROR : write_netcdf_hdr_data() -> No PrepBufr
messages
> > > retained.
> > > > > > > > Nothing to write.
> > > > > > > > ERROR :
> > > > > > > >
> > > > > > > >
> > > > > > > > Thanks in advance for the help, Jose M. Garcia-Rivera,
PhD
> > > > > > > > IM Systems Group Rockville/College Park, MD This e-
mail,
> > > > > > > > including attachments, may include confidential and/or
> > > > > > > > proprietary information, and may be used only by the
> > > > > > > > person or entity to which it is addressed. If the
reader
> > > > > > > > of this e-mail is not the intended recipient or his or
her
> > > > > > > > authorized agent, the reader is hereby notified that
any
> > > > > > > > dissemination, distribution or copying of this e-mail
is
> > > > > > > > prohibited. If you have received this e-mail in error,
> > > > > > > > please notify the sender by replying to this message
and
> > > > > > > > delete this
> > > > > > > e-mail immediately.
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > --
> > > > > > > Julie Prestopnik
> > > > > > > National Center for Atmospheric Research Research
> > > > > > > Applications Laboratory
> > > > > > > Phone: 303.497.8399
> > > > > > > Email: jpresto at ucar.edu
> > > > > > >
> > > > > > > This e-mail, including attachments, may include
confidential
> > > > > > > and/or proprietary information, and may be used only by
the
> > > > > > > person or entity to which it is addressed. If the reader
of
> > > > > > > this e-mail is not the intended recipient or his or her
> > > > > > > authorized agent, the reader is hereby notified that any
> > > > > > > dissemination, distribution or copying of this e-mail is
> > > > > > > prohibited. If you have received this e-mail in error,
> > > > > > > please notify the sender by replying to this message and
> > > > > > > delete this
> > > > > > e-mail immediately.
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > >
> > > > > >
> > > > > > --
> > > > > > Julie Prestopnik
> > > > > > National Center for Atmospheric Research Research
Applications
> > > > > > Laboratory
> > > > > > Phone: 303.497.8399
> > > > > > Email: jpresto at ucar.edu
> > > > > >
> > > > > > This e-mail, including attachments, may include
confidential
> > > > > > and/or proprietary information, and may be used only by
the
> > > > > > person or entity to which it is addressed. If the reader
of
> > > > > > this e-mail is not the intended recipient or his or her
> > > > > > authorized agent, the reader is hereby notified that any
> > > > > > dissemination, distribution or copying of this e-mail is
> > > > > > prohibited. If you have received this e-mail in error,
please
> > > > > > notify the sender by replying to this message and delete
this
> > > > > e-mail immediately.
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > > > --
> > > > > Julie Prestopnik
> > > > > National Center for Atmospheric Research Research
Applications
> > > > > Laboratory
> > > > > Phone: 303.497.8399
> > > > > Email: jpresto at ucar.edu
> > > > >
> > > > > This e-mail, including attachments, may include confidential
> > > > > and/or proprietary information, and may be used only by the
> > > > > person or entity to which it is addressed. If the reader of
this
> > > > > e-mail is not the intended recipient or his or her
authorized
> > > > > agent, the reader is hereby notified that any dissemination,
> > > > > distribution or copying of this e-mail is prohibited. If you
> > > > > have received this e-mail in error, please notify the sender
by
> > > > > replying to this message and delete this
> > > > e-mail immediately.
> > > > >
> > > > >
> > > >
> > > >
> > > > --
> > > > Julie Prestopnik
> > > > National Center for Atmospheric Research Research Applications
> > > > Laboratory
> > > > Phone: 303.497.8399
> > > > Email: jpresto at ucar.edu
> > > >
> > > > This e-mail, including attachments, may include confidential
> > > > and/or proprietary information, and may be used only by the
person
> > > > or entity to which it is addressed. If the reader of this e-
mail
> > > > is not the intended recipient or his or her authorized agent,
the
> > > > reader is hereby notified that any dissemination, distribution
or
> > > > copying of this e-mail is prohibited. If you have received
this
> > > > e-mail in error, please notify the sender by replying to this
> > > > message and delete this
> > > e-mail immediately.
> > > >
> > > >
> > > >
> > >
> > >
> > > --
> > > Julie Prestopnik
> > > National Center for Atmospheric Research Research Applications
> > > Laboratory
> > > Phone: 303.497.8399
> > > Email: jpresto at ucar.edu
> > >
> > > This e-mail, including attachments, may include confidential
and/or
> > > proprietary information, and may be used only by the person or
> > > entity to which it is addressed. If the reader of this e-mail is
not
> > > the intended recipient or his or her authorized agent, the
reader is
> > > hereby notified that any dissemination, distribution or copying
of
> > > this e-mail is prohibited. If you have received this e-mail in
> > > error, please notify the sender by replying to this message and
> > > delete this
> > e-mail immediately.
> > >
> > >
> > >
> >
> >
> > --
> > Julie Prestopnik
> > National Center for Atmospheric Research Research Applications
> > Laboratory
> > Phone: 303.497.8399
> > Email: jpresto at ucar.edu
> >
> > This e-mail, including attachments, may include confidential
and/or
> > proprietary information, and may be used only by the person or
entity
> > to which it is addressed. If the reader of this e-mail is not the
> > intended recipient or his or her authorized agent, the reader is
> > hereby notified that any dissemination, distribution or copying of
> > this e-mail is prohibited. If you have received this e-mail in
error,
> > please notify the sender by replying to this message and delete
this
> e-mail immediately.
> >
> >
> >
>
>
> --
> Julie Prestopnik
> National Center for Atmospheric Research Research Applications
Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
> This e-mail, including attachments, may include confidential and/or
> proprietary information, and may be used only by the person or
entity to
> which it is addressed. If the reader of this e-mail is not the
intended
> recipient or his or her authorized agent, the reader is hereby
notified
> that any dissemination, distribution or copying of this e-mail is
> prohibited. If you have received this e-mail in error, please notify
the
> sender by replying to this message and delete this e-mail
immediately.
>
>
>
--
Julie Prestopnik
National Center for Atmospheric Research
Research Applications Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to NetCDF
From: Jose Garcia-Rivera
Time: Wed Mar 16 12:17:53 2016
Dear Julie,
Is there anything that we can do here to sort these issues out?
Best Regards,
Jose
-----Original Message-----
From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
Sent: Tuesday, March 15, 2016 5:08 PM
To: Jose Garcia-Rivera
Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to
NetCDF
Hi Jose. I was not. I got the same error you did. I believe that
the test.nc file is not in the correct format needed by point_stat, so
I think we need to get pb2nc working for you. It is likely a
communication problem between the C code and the Fortran code.
Julie
On Tue, Mar 15, 2016 at 3:05 PM, Jose Garcia-Rivera via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
>
> Dear Julie,
>
> Quick question: Were you able to run point_stat with the netCDF file
> that I sent yesterday?
>
> Thanks for the help,
> Jose
>
> -----Original Message-----
> From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> Sent: Tuesday, March 15, 2016 12:17 PM
> To: Jose Garcia-Rivera
> Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to
> NetCDF
>
> Thank you, Jose. I'm working with co-workers to try to get these
> issues resolved. I hope to get back to you soon.
>
> Julie
>
> On Mon, Mar 14, 2016 at 1:36 PM, Jose Garcia-Rivera via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> >
> > Dear Julie,
> >
> > I just uploaded the three files to 'garcia_data'.
> >
> > Thanks for the help,
> > Jose
> >
> >
> > -----Original Message-----
> > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > Sent: Monday, March 14, 2016 3:32 PM
> > To: Jose Garcia-Rivera
> > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR
to
> > NetCDF
> >
> > Hi Jose.
> >
> > Yes, please upload your input files and configuration file
> > (nmbprs_d01.06, test.nc, PointStatConfig_default) to our anonymous
> > ftp
> site as follows:
> > http://www.dtcenter.org/met/users/support/met_help.php
> >
> > Thanks!
> >
> > Julie
> >
> > On Mon, Mar 14, 2016 at 1:06 PM, Jose Garcia-Rivera via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> > >
> > > Dear Julie,
> > >
> > > I got to convert my prepbufr file using a python script.
However,
> > > I have trouble running point_stat. Can I send you the files, to
> > > see if you have the same issue?
> > >
> > >
> > > This is what I got:
> > >
> > > [garciaj at login prepbufr_obs]$ ./point_stat nmbprs_d01.06 test.nc
> > > PointStatConfig_default DEBUG 1: Default Config File:
> > > /work/apps/pgi_14.10/SANDY/met-
5.1/share/met/config/PointStatConfi
> > > g_ de fault DEBUG 1: User Config File: PointStatConfig_default
> > > GSL_RNG_TYPE=mt19937
> > > GSL_RNG_SEED=18446744073425053526
> > > DEBUG 1: Forecast File: nmbprs_d01.06 DEBUG 1: Observation File:
> > > test.nc DEBUG 2:
> > > DEBUG 2:
> > >
------------------------------------------------------------------
> > > --
> > > --
> > > ----------
> > > DEBUG 2:
> > > DEBUG 2: Reading data for SPFH/P500.
> > > DEBUG 2: For SPFH/P500 found 1 forecast levels and 0 climatology
> levels.
> > > DEBUG 2:
> > > DEBUG 2:
> > >
------------------------------------------------------------------
> > > --
> > > --
> > > ----------
> > > DEBUG 2:
> > > DEBUG 2: Reading data for TMP/P500.
> > > DEBUG 2: For TMP/P500 found 1 forecast levels and 0 climatology
levels.
> > > DEBUG 2:
> > > DEBUG 2:
> > >
------------------------------------------------------------------
> > > --
> > > --
> > > ----------
> > > DEBUG 2:
> > > DEBUG 2: Reading data for HGT/P500.
> > > DEBUG 2: For HGT/P500 found 1 forecast levels and 0 climatology
levels.
> > > DEBUG 2:
> > > DEBUG 2:
> > >
------------------------------------------------------------------
> > > --
> > > --
> > > ----------
> > > DEBUG 2:
> > > DEBUG 2: Reading data for UGRD/P500.
> > > DEBUG 2: For UGRD/P500 found 1 forecast levels and 0 climatology
> levels.
> > > DEBUG 2:
> > > DEBUG 2:
> > >
------------------------------------------------------------------
> > > --
> > > --
> > > ----------
> > > DEBUG 2:
> > > DEBUG 2: Reading data for VGRD/P500.
> > > DEBUG 2: For VGRD/P500 found 1 forecast levels and 0 climatology
> levels.
> > > DEBUG 2:
> > > DEBUG 2:
> > >
------------------------------------------------------------------
> > > --
> > > --
> > > ----------
> > > DEBUG 2:
> > > WARNING:
> > > WARNING: process_obs_file() -> can't open observation netCDF
file:
> > > test.nc
> > > WARNING:
> > > DEBUG 2:
> > > DEBUG 2:
> > >
------------------------------------------------------------------
> > > --
> > > --
> > > ----------
> > > DEBUG 2:
> > > DEBUG 2: Processing SPFH/P500 versus SPFH/P500, for observation
> > > type ADPUPA, over region FULL, for interpolation method
> > > NEAREST(1), using
> > > 0 pairs.
> > > DEBUG 2:
> > > DEBUG 2:
> > >
------------------------------------------------------------------
> > > --
> > > --
> > > ----------
> > > DEBUG 2:
> > > DEBUG 2: Processing TMP/P500 versus TMP/P500, for observation
type
> > > ADPUPA, over region FULL, for interpolation method NEAREST(1),
> > > using
> > > 0
> > pairs.
> > > DEBUG 2:
> > > DEBUG 2:
> > >
------------------------------------------------------------------
> > > --
> > > --
> > > ----------
> > > DEBUG 2:
> > > DEBUG 2: Processing HGT/P500 versus HGT/P500, for observation
type
> > > ADPUPA, over region FULL, for interpolation method NEAREST(1),
> > > using
> > > 0
> > pairs.
> > > DEBUG 2:
> > > DEBUG 2:
> > >
------------------------------------------------------------------
> > > --
> > > --
> > > ----------
> > > DEBUG 2:
> > > DEBUG 2: Processing UGRD/P500 versus UGRD/P500, for observation
> > > type ADPUPA, over region FULL, for interpolation method
> > > NEAREST(1), using
> > > 0 pairs.
> > > DEBUG 2:
> > > DEBUG 2:
> > >
------------------------------------------------------------------
> > > --
> > > --
> > > ----------
> > > DEBUG 2:
> > > DEBUG 2: Processing VGRD/P500 versus VGRD/P500, for observation
> > > type ADPUPA, over region FULL, for interpolation method
> > > NEAREST(1), using
> > > 0 pairs.
> > > DEBUG 2:
> > > DEBUG 2:
> > >
------------------------------------------------------------------
> > > --
> > > --
> > > ----------
> > > DEBUG 2:
> > > DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V.stat
> > > DEBUG 1: Output file:
> > > ./point_stat_060000L_20150820_180000V_fho.txt
> > > DEBUG 1: Output file:
> > > ./point_stat_060000L_20150820_180000V_ctc.txt
> > > DEBUG 1: Output file:
> > > ./point_stat_060000L_20150820_180000V_cts.txt
> > > DEBUG 1: Output file:
> > > ./point_stat_060000L_20150820_180000V_mctc.txt
> > > DEBUG 1: Output file:
> > > ./point_stat_060000L_20150820_180000V_mcts.txt
> > > DEBUG 1: Output file:
> > > ./point_stat_060000L_20150820_180000V_cnt.txt
> > > DEBUG 1: Output file:
> > > ./point_stat_060000L_20150820_180000V_sl1l2.txt
> > > DEBUG 1: Output file:
> > > ./point_stat_060000L_20150820_180000V_sal1l2.txt
> > > DEBUG 1: Output file:
> > > ./point_stat_060000L_20150820_180000V_vl1l2.txt
> > > DEBUG 1: Output file:
> > > ./point_stat_060000L_20150820_180000V_val1l2.txt
> > > DEBUG 1: Output file:
> > > ./point_stat_060000L_20150820_180000V_pct.txt
> > > DEBUG 1: Output file:
> > > ./point_stat_060000L_20150820_180000V_pstd.txt
> > > DEBUG 1: Output file:
> > > ./point_stat_060000L_20150820_180000V_pjc.txt
> > > DEBUG 1: Output file:
> > > ./point_stat_060000L_20150820_180000V_prc.txt
> > > DEBUG 1: Output file:
> > > ./point_stat_060000L_20150820_180000V_mpr.txt
> > >
> > >
> > > Thanks for the help,
> > > Jose
> > >
> > >
> > > -----Original Message-----
> > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > Sent: Monday, March 14, 2016 12:17 PM
> > > To: Jose Garcia-Rivera
> > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR
> > > to NetCDF
> > >
> > > Hi Jose. I apologize for the delayed response. I was out of
the
> > > office on Friday. I'm going to try to figure out a solution and
> > > get back with you shortly.
> > >
> > > Julie
> > >
> > > On Fri, Mar 11, 2016 at 2:02 PM, Jose Garcia-Rivera via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
>
> > > >
> > > > Dear Julie,
> > > >
> > > > Any news regarding pb2nc? We're still unable to make it work.
> > > >
> > > > Best Regards,
> > > > Jose
> > > >
> > > > -----Original Message-----
> > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > Sent: Thursday, March 10, 2016 4:20 PM
> > > > To: Jose Garcia-Rivera
> > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
PREPBUFR
> > > > to NetCDF
> > > >
> > > > Hi Jose. Thank you for attaching the files.
> > > >
> > > > Could you please send me a list of the files in
> > > > /work/apps/pgi_14.10/SANDY/bufrlib/lib?
> > > >
> > > > Thank you!
> > > >
> > > > Julie
> > > >
> > > >
> > > > On Thu, Mar 10, 2016 at 12:20 PM, Jose Garcia-Rivera via RT <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > > >
> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > >
> > > > >
> > > > > Dear Julie,
> > > > >
> > > > > The administrator re-compiled MET following your
instructions,
> > > > > and says there's still trouble. He sent me the log files
> (attached).
> > > > > Is there any other approach that might help?
> > > > >
> > > > > Best Regards,
> > > > > Jose
> > > > >
> > > > > -----Original Message-----
> > > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > > Sent: Wednesday, March 09, 2016 12:39 PM
> > > > > To: Jose Garcia-Rivera
> > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
> > > > > PREPBUFR to NetCDF
> > > > >
> > > > > Thank you, Jose! It looks like something went wrong during
> > > compilation.
> > > > > I suggest recompiling MET to see if we can get this issue
resolved.
> > > > > NCEP's BUFRLIB is used by the pb2nc MET tool, and is a
> > > > > required external library for pb2nc. MET is not yet
> > > > > compatible with BUFRLIB
> > > > version 11.0.0, so we
> > > > > suggest getting version 10.2.3. We are working on our
online
> > tutorial
> > > > for
> > > > > METv.5.1, but in the meantime, I'll point you to our online
> > > > > tutorial directions for installing BUFRLIB:
> > > > >
> > > > >
> > > > >
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.
> > > > > 0/
> > > > > co
> > > > > mp
> > > > > ilation/req_libs.php
> > > > >
> > > > > It is also important to review the necessary environment
> > > > > variables to
> > > > set:
> > > > >
> > > > >
> > > > >
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.
> > > > > 0/
> > > > > co
> > > > > mp
> > > > > ilation/configure.php
> > > > >
> > > > > For example,
> > > > >
> > > > > "Set *$MET_BUFR* to point to the main BUFR directory, or set
> > > > > *$MET_BUFRLIB* to point to the directory with the BUFR
library
> files.
> > > > > Because MET doesn't use any BUFR library include files, you
> > > > > don't need to specify *$MET_BUFRINC* ."
> > > > >
> > > > > Once you've installed the required libraries and set up your
> > > > > environment variables, you'll be ready to configure MET
> > > > > (instructions at the bottom of the last link above) and then
> > > > > compile and install MET (
> > > > >
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.
> > > > > 0/
> > > > > co
> > > > > mp
> > > > > ilation/compile.php
> > > > > ).
> > > > > After re-installing MET, please run "make test" again. If
you
> > > > > still encounter the same problem, please send me your
> > > > > *config.log* file and your *make_install.log *file. Please
> > > > > let me know if you have any
> > > > questions.
> > > > >
> > > > > Please let us know how it goes.
> > > > >
> > > > > Thanks,
> > > > > Julie
> > > > >
> > > > >
> > > > >
> > > > >
> > > > > On Wed, Mar 9, 2016 at 10:22 AM, Jose Garcia-Rivera via RT <
> > > > > met_help at ucar.edu> wrote:
> > > > >
> > > > > >
> > > > > > <URL:
> > > > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > > >
> > > > > >
> > > > > > Dear Julie,
> > > > > >
> > > > > > Attached is the test log file. It's showing the same
issues
> > > > > > on pb2nc even with the sample files.
> > > > > >
> > > > > > Best Regards,
> > > > > > Jose
> > > > > >
> > > > > > -----Original Message-----
> > > > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > > > Sent: Tuesday, March 08, 2016 5:28 PM
> > > > > > To: Jose Garcia-Rivera
> > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
> > > > > > PREPBUFR to NetCDF
> > > > > >
> > > > > > Hi Jose. Thank you for uploading the files.
Unfortunately,
> > > > > > I am unable to reproduce the error you are experiencing.
I
> > > > > > am wondering if you have successfully used pb2nc before.
As
> > > > > > a check could you please run the following in your met-
5.1/
> > directory:
> > > > > >
> > > > > > *make test >& make_test.log*
> > > > > >
> > > > > > and then send me the make_test.log file?
> > > > > >
> > > > > > Thanks,
> > > > > > Julie
> > > > > >
> > > > > > On Tue, Mar 8, 2016 at 11:29 AM, Jose Garcia-Rivera via RT
<
> > > > > > met_help at ucar.edu> wrote:
> > > > > >
> > > > > > >
> > > > > > > <URL:
> > > > > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > > > >
> > > > > > >
> > > > > > > Dear Julie,
> > > > > > >
> > > > > > > I just put the files in 'garcia_data'. I appreciate your
help.
> > > > > > >
> > > > > > > Best Regards,
> > > > > > > Jose
> > > > > > >
> > > > > > > -----Original Message-----
> > > > > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > > > > Sent: Tuesday, March 08, 2016 1:12 PM
> > > > > > > To: Jose Garcia-Rivera
> > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
> > > > > > > PREPBUFR to NetCDF
> > > > > > >
> > > > > > > Hi Jose. I'm sorry to hear that you are having problems
> > > > > > > converting a PREPBUFR file to NetCDF.
> > > > > > >
> > > > > > > Please upload your input files and configuration file to
> > > > > > > our anonymous ftp site as follows:
> > > > > > > http://www.dtcenter.org/met/users/support/met_help.php
> > > > > > >
> > > > > > > Then I can take a look and get back to you.
> > > > > > >
> > > > > > > Thanks,
> > > > > > > Julie
> > > > > > >
> > > > > > > On Tue, Mar 8, 2016 at 11:01 AM, Jose Garcia-Rivera via
RT
> > > > > > > < met_help at ucar.edu> wrote:
> > > > > > >
> > > > > > > >
> > > > > > > > Tue Mar 08 11:01:25 2016: Request 75433 was acted
upon.
> > > > > > > > Transaction: Ticket created by GarciaJ at imsg.com
> > > > > > > > Queue: met_help
> > > > > > > > Subject: Issues converting PREPBUFR to NetCDF
> > > > > > > > Owner: Nobody
> > > > > > > > Requestors: GarciaJ at imsg.com
> > > > > > > > Status: new
> > > > > > > > Ticket <URL:
> > > > > > > >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > Dear Met Help,
> > > > > > > >
> > > > > > > > Trying to convert a PREPBUFR file to NetCDF.
> > > > > > > >
> > > > > > > > I used the default PB2NC configure file, and got the
> following:
> > > > > > > >
> > > > > > > > [garciaj at login prepbufr_obs]$ ./pb2nc
> > > > > > > > gdas1.t12z.prepbufr.nr gdas.20150820.t12z.nc
> > > > > > > > PB2NCConfig_default DEBUG 1: Default Config
> > > > > > > > File:
> > > > > > > > /work/apps/pgi_14.10/met-
5.1/share/met/config/PB2NCConfi
> > > > > > > > g_ de fa ul t DEBUG 1: User Config File:
> > > > > > > > PB2NCConfig_default DEBUG 1: Creating NetCDF File:
> gdas.20150820.t12z.nc
> > > > > > > > DEBUG 1: Processing PrepBufr File:
> gdas1.t12z.prepbufr.nr
> > > > > > > > DEBUG 1: Blocking PrepBufr file to:
> > > /tmp/tmp_pb2nc_blk_32144_0
> > > > > > > > WARNING:
> > > > > > > > WARNING: process_pbfile() -> No PrepBufr messages to
> > > > > > > > process in
> > > > file:
> > > > > > > > gdas1.t12z.prepbufr.nr
> > > > > > > > WARNING:
> > > > > > > > ERROR :
> > > > > > > > ERROR : write_netcdf_hdr_data() -> No PrepBufr
messages
> > > retained.
> > > > > > > > Nothing to write.
> > > > > > > > ERROR :
> > > > > > > >
> > > > > > > >
> > > > > > > > Thanks in advance for the help, Jose M. Garcia-Rivera,
> > > > > > > > PhD IM Systems Group Rockville/College Park, MD This
> > > > > > > > e-mail, including attachments, may include
confidential
> > > > > > > > and/or proprietary information, and may be used only
by
> > > > > > > > the person or entity to which it is addressed. If the
> > > > > > > > reader of this e-mail is not the intended recipient or
> > > > > > > > his or her authorized agent, the reader is hereby
> > > > > > > > notified that any dissemination, distribution or
copying
> > > > > > > > of this e-mail is prohibited. If you have received
this
> > > > > > > > e-mail in error, please notify the sender by replying
to
> > > > > > > > this message and delete this
> > > > > > > e-mail immediately.
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > --
> > > > > > > Julie Prestopnik
> > > > > > > National Center for Atmospheric Research Research
> > > > > > > Applications Laboratory
> > > > > > > Phone: 303.497.8399
> > > > > > > Email: jpresto at ucar.edu
> > > > > > >
> > > > > > > This e-mail, including attachments, may include
> > > > > > > confidential and/or proprietary information, and may be
> > > > > > > used only by the person or entity to which it is
> > > > > > > addressed. If the reader of this e-mail is not the
> > > > > > > intended recipient or his or her authorized agent, the
> > > > > > > reader is hereby notified that any dissemination,
> > > > > > > distribution or copying of this e-mail is prohibited. If
> > > > > > > you have received this e-mail in error, please notify
the
> > > > > > > sender by replying to this message and delete this
> > > > > > e-mail immediately.
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > >
> > > > > >
> > > > > > --
> > > > > > Julie Prestopnik
> > > > > > National Center for Atmospheric Research Research
> > > > > > Applications Laboratory
> > > > > > Phone: 303.497.8399
> > > > > > Email: jpresto at ucar.edu
> > > > > >
> > > > > > This e-mail, including attachments, may include
confidential
> > > > > > and/or proprietary information, and may be used only by
the
> > > > > > person or entity to which it is addressed. If the reader
of
> > > > > > this e-mail is not the intended recipient or his or her
> > > > > > authorized agent, the reader is hereby notified that any
> > > > > > dissemination, distribution or copying of this e-mail is
> > > > > > prohibited. If you have received this e-mail in error,
> > > > > > please notify the sender by replying to this message and
> > > > > > delete this
> > > > > e-mail immediately.
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > > > --
> > > > > Julie Prestopnik
> > > > > National Center for Atmospheric Research Research
Applications
> > > > > Laboratory
> > > > > Phone: 303.497.8399
> > > > > Email: jpresto at ucar.edu
> > > > >
> > > > > This e-mail, including attachments, may include confidential
> > > > > and/or proprietary information, and may be used only by the
> > > > > person or entity to which it is addressed. If the reader of
> > > > > this e-mail is not the intended recipient or his or her
> > > > > authorized agent, the reader is hereby notified that any
> > > > > dissemination, distribution or copying of this e-mail is
> > > > > prohibited. If you have received this e-mail in error,
please
> > > > > notify the sender by replying to this message and delete
this
> > > > e-mail immediately.
> > > > >
> > > > >
> > > >
> > > >
> > > > --
> > > > Julie Prestopnik
> > > > National Center for Atmospheric Research Research Applications
> > > > Laboratory
> > > > Phone: 303.497.8399
> > > > Email: jpresto at ucar.edu
> > > >
> > > > This e-mail, including attachments, may include confidential
> > > > and/or proprietary information, and may be used only by the
> > > > person or entity to which it is addressed. If the reader of
this
> > > > e-mail is not the intended recipient or his or her authorized
> > > > agent, the reader is hereby notified that any dissemination,
> > > > distribution or copying of this e-mail is prohibited. If you
> > > > have received this e-mail in error, please notify the sender
by
> > > > replying to this message and delete this
> > > e-mail immediately.
> > > >
> > > >
> > > >
> > >
> > >
> > > --
> > > Julie Prestopnik
> > > National Center for Atmospheric Research Research Applications
> > > Laboratory
> > > Phone: 303.497.8399
> > > Email: jpresto at ucar.edu
> > >
> > > This e-mail, including attachments, may include confidential
> > > and/or proprietary information, and may be used only by the
person
> > > or entity to which it is addressed. If the reader of this e-mail
> > > is not the intended recipient or his or her authorized agent,
the
> > > reader is hereby notified that any dissemination, distribution
or
> > > copying of this e-mail is prohibited. If you have received this
> > > e-mail in error, please notify the sender by replying to this
> > > message and delete this
> > e-mail immediately.
> > >
> > >
> > >
> >
> >
> > --
> > Julie Prestopnik
> > National Center for Atmospheric Research Research Applications
> > Laboratory
> > Phone: 303.497.8399
> > Email: jpresto at ucar.edu
> >
> > This e-mail, including attachments, may include confidential
and/or
> > proprietary information, and may be used only by the person or
> > entity to which it is addressed. If the reader of this e-mail is
not
> > the intended recipient or his or her authorized agent, the reader
is
> > hereby notified that any dissemination, distribution or copying of
> > this e-mail is prohibited. If you have received this e-mail in
> > error, please notify the sender by replying to this message and
> > delete this
> e-mail immediately.
> >
> >
> >
>
>
> --
> Julie Prestopnik
> National Center for Atmospheric Research Research Applications
> Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
> This e-mail, including attachments, may include confidential and/or
> proprietary information, and may be used only by the person or
entity
> to which it is addressed. If the reader of this e-mail is not the
> intended recipient or his or her authorized agent, the reader is
> hereby notified that any dissemination, distribution or copying of
> this e-mail is prohibited. If you have received this e-mail in
error,
> please notify the sender by replying to this message and delete this
e-mail immediately.
>
>
>
--
Julie Prestopnik
National Center for Atmospheric Research Research Applications
Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
This e-mail, including attachments, may include confidential and/or
proprietary information, and may be used only by the person or entity
to which it is addressed. If the reader of this e-mail is not the
intended recipient or his or her authorized agent, the reader is
hereby notified that any dissemination, distribution or copying of
this e-mail is prohibited. If you have received this e-mail in error,
please notify the sender by replying to this message and delete this
e-mail immediately.
------------------------------------------------
Subject: Issues converting PREPBUFR to NetCDF
From: Julie Prestopnik
Time: Wed Mar 16 14:40:11 2016
Hi Jose. I apologize for the delay. This was a tricky problem to
figure
out, however, we were finally able to reproduce the error you are
receiving
for pb2nc.
The problem is BUFRLIB being compiled with pgf90 and MET being
compiled
with pgf77. They aren't talking well to each other. BUFRLIBv10.1.0
compiles with pgf77 but later versions require pgf90.
We will plan on updating the MET Fortran code to compile with pgf90 so
that
we can use newer BUFRLIB versions, but for now, to solve your problem,
I
have attached BUFRLIB_v10-1-0.tar. Please install that version of
BUFRLIB
using pgf77 and then recompile MET without the "LIBS" environment
variable
setting?
Please let me know how that goes. We were able to get a successful
run
using that solution and hope you will too.
Thanks,
Julie
On Wed, Mar 16, 2016 at 12:17 PM, Jose Garcia-Rivera via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
>
> Dear Julie,
>
> Is there anything that we can do here to sort these issues out?
>
> Best Regards,
> Jose
>
> -----Original Message-----
> From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> Sent: Tuesday, March 15, 2016 5:08 PM
> To: Jose Garcia-Rivera
> Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to
NetCDF
>
> Hi Jose. I was not. I got the same error you did. I believe that
the
> test.nc file is not in the correct format needed by point_stat, so I
> think we need to get pb2nc working for you. It is likely a
communication
> problem between the C code and the Fortran code.
>
> Julie
>
> On Tue, Mar 15, 2016 at 3:05 PM, Jose Garcia-Rivera via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> >
> > Dear Julie,
> >
> > Quick question: Were you able to run point_stat with the netCDF
file
> > that I sent yesterday?
> >
> > Thanks for the help,
> > Jose
> >
> > -----Original Message-----
> > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > Sent: Tuesday, March 15, 2016 12:17 PM
> > To: Jose Garcia-Rivera
> > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR
to
> > NetCDF
> >
> > Thank you, Jose. I'm working with co-workers to try to get these
> > issues resolved. I hope to get back to you soon.
> >
> > Julie
> >
> > On Mon, Mar 14, 2016 at 1:36 PM, Jose Garcia-Rivera via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> > >
> > > Dear Julie,
> > >
> > > I just uploaded the three files to 'garcia_data'.
> > >
> > > Thanks for the help,
> > > Jose
> > >
> > >
> > > -----Original Message-----
> > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > Sent: Monday, March 14, 2016 3:32 PM
> > > To: Jose Garcia-Rivera
> > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR
to
> > > NetCDF
> > >
> > > Hi Jose.
> > >
> > > Yes, please upload your input files and configuration file
> > > (nmbprs_d01.06, test.nc, PointStatConfig_default) to our
anonymous
> > > ftp
> > site as follows:
> > > http://www.dtcenter.org/met/users/support/met_help.php
> > >
> > > Thanks!
> > >
> > > Julie
> > >
> > > On Mon, Mar 14, 2016 at 1:06 PM, Jose Garcia-Rivera via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
>
> > > >
> > > > Dear Julie,
> > > >
> > > > I got to convert my prepbufr file using a python script.
However,
> > > > I have trouble running point_stat. Can I send you the files,
to
> > > > see if you have the same issue?
> > > >
> > > >
> > > > This is what I got:
> > > >
> > > > [garciaj at login prepbufr_obs]$ ./point_stat nmbprs_d01.06
test.nc
> > > > PointStatConfig_default DEBUG 1: Default Config File:
> > > > /work/apps/pgi_14.10/SANDY/met-
5.1/share/met/config/PointStatConfi
> > > > g_ de fault DEBUG 1: User Config File: PointStatConfig_default
> > > > GSL_RNG_TYPE=mt19937
> > > > GSL_RNG_SEED=18446744073425053526
> > > > DEBUG 1: Forecast File: nmbprs_d01.06 DEBUG 1: Observation
File:
> > > > test.nc DEBUG 2:
> > > > DEBUG 2:
> > > >
------------------------------------------------------------------
> > > > --
> > > > --
> > > > ----------
> > > > DEBUG 2:
> > > > DEBUG 2: Reading data for SPFH/P500.
> > > > DEBUG 2: For SPFH/P500 found 1 forecast levels and 0
climatology
> > levels.
> > > > DEBUG 2:
> > > > DEBUG 2:
> > > >
------------------------------------------------------------------
> > > > --
> > > > --
> > > > ----------
> > > > DEBUG 2:
> > > > DEBUG 2: Reading data for TMP/P500.
> > > > DEBUG 2: For TMP/P500 found 1 forecast levels and 0
climatology
> levels.
> > > > DEBUG 2:
> > > > DEBUG 2:
> > > >
------------------------------------------------------------------
> > > > --
> > > > --
> > > > ----------
> > > > DEBUG 2:
> > > > DEBUG 2: Reading data for HGT/P500.
> > > > DEBUG 2: For HGT/P500 found 1 forecast levels and 0
climatology
> levels.
> > > > DEBUG 2:
> > > > DEBUG 2:
> > > >
------------------------------------------------------------------
> > > > --
> > > > --
> > > > ----------
> > > > DEBUG 2:
> > > > DEBUG 2: Reading data for UGRD/P500.
> > > > DEBUG 2: For UGRD/P500 found 1 forecast levels and 0
climatology
> > levels.
> > > > DEBUG 2:
> > > > DEBUG 2:
> > > >
------------------------------------------------------------------
> > > > --
> > > > --
> > > > ----------
> > > > DEBUG 2:
> > > > DEBUG 2: Reading data for VGRD/P500.
> > > > DEBUG 2: For VGRD/P500 found 1 forecast levels and 0
climatology
> > levels.
> > > > DEBUG 2:
> > > > DEBUG 2:
> > > >
------------------------------------------------------------------
> > > > --
> > > > --
> > > > ----------
> > > > DEBUG 2:
> > > > WARNING:
> > > > WARNING: process_obs_file() -> can't open observation netCDF
file:
> > > > test.nc
> > > > WARNING:
> > > > DEBUG 2:
> > > > DEBUG 2:
> > > >
------------------------------------------------------------------
> > > > --
> > > > --
> > > > ----------
> > > > DEBUG 2:
> > > > DEBUG 2: Processing SPFH/P500 versus SPFH/P500, for
observation
> > > > type ADPUPA, over region FULL, for interpolation method
> > > > NEAREST(1), using
> > > > 0 pairs.
> > > > DEBUG 2:
> > > > DEBUG 2:
> > > >
------------------------------------------------------------------
> > > > --
> > > > --
> > > > ----------
> > > > DEBUG 2:
> > > > DEBUG 2: Processing TMP/P500 versus TMP/P500, for observation
type
> > > > ADPUPA, over region FULL, for interpolation method NEAREST(1),
> > > > using
> > > > 0
> > > pairs.
> > > > DEBUG 2:
> > > > DEBUG 2:
> > > >
------------------------------------------------------------------
> > > > --
> > > > --
> > > > ----------
> > > > DEBUG 2:
> > > > DEBUG 2: Processing HGT/P500 versus HGT/P500, for observation
type
> > > > ADPUPA, over region FULL, for interpolation method NEAREST(1),
> > > > using
> > > > 0
> > > pairs.
> > > > DEBUG 2:
> > > > DEBUG 2:
> > > >
------------------------------------------------------------------
> > > > --
> > > > --
> > > > ----------
> > > > DEBUG 2:
> > > > DEBUG 2: Processing UGRD/P500 versus UGRD/P500, for
observation
> > > > type ADPUPA, over region FULL, for interpolation method
> > > > NEAREST(1), using
> > > > 0 pairs.
> > > > DEBUG 2:
> > > > DEBUG 2:
> > > >
------------------------------------------------------------------
> > > > --
> > > > --
> > > > ----------
> > > > DEBUG 2:
> > > > DEBUG 2: Processing VGRD/P500 versus VGRD/P500, for
observation
> > > > type ADPUPA, over region FULL, for interpolation method
> > > > NEAREST(1), using
> > > > 0 pairs.
> > > > DEBUG 2:
> > > > DEBUG 2:
> > > >
------------------------------------------------------------------
> > > > --
> > > > --
> > > > ----------
> > > > DEBUG 2:
> > > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V.stat
> > > > DEBUG 1: Output file:
> > > > ./point_stat_060000L_20150820_180000V_fho.txt
> > > > DEBUG 1: Output file:
> > > > ./point_stat_060000L_20150820_180000V_ctc.txt
> > > > DEBUG 1: Output file:
> > > > ./point_stat_060000L_20150820_180000V_cts.txt
> > > > DEBUG 1: Output file:
> > > > ./point_stat_060000L_20150820_180000V_mctc.txt
> > > > DEBUG 1: Output file:
> > > > ./point_stat_060000L_20150820_180000V_mcts.txt
> > > > DEBUG 1: Output file:
> > > > ./point_stat_060000L_20150820_180000V_cnt.txt
> > > > DEBUG 1: Output file:
> > > > ./point_stat_060000L_20150820_180000V_sl1l2.txt
> > > > DEBUG 1: Output file:
> > > > ./point_stat_060000L_20150820_180000V_sal1l2.txt
> > > > DEBUG 1: Output file:
> > > > ./point_stat_060000L_20150820_180000V_vl1l2.txt
> > > > DEBUG 1: Output file:
> > > > ./point_stat_060000L_20150820_180000V_val1l2.txt
> > > > DEBUG 1: Output file:
> > > > ./point_stat_060000L_20150820_180000V_pct.txt
> > > > DEBUG 1: Output file:
> > > > ./point_stat_060000L_20150820_180000V_pstd.txt
> > > > DEBUG 1: Output file:
> > > > ./point_stat_060000L_20150820_180000V_pjc.txt
> > > > DEBUG 1: Output file:
> > > > ./point_stat_060000L_20150820_180000V_prc.txt
> > > > DEBUG 1: Output file:
> > > > ./point_stat_060000L_20150820_180000V_mpr.txt
> > > >
> > > >
> > > > Thanks for the help,
> > > > Jose
> > > >
> > > >
> > > > -----Original Message-----
> > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > Sent: Monday, March 14, 2016 12:17 PM
> > > > To: Jose Garcia-Rivera
> > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
PREPBUFR
> > > > to NetCDF
> > > >
> > > > Hi Jose. I apologize for the delayed response. I was out of
the
> > > > office on Friday. I'm going to try to figure out a solution
and
> > > > get back with you shortly.
> > > >
> > > > Julie
> > > >
> > > > On Fri, Mar 11, 2016 at 2:02 PM, Jose Garcia-Rivera via RT <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > > >
> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> > > > >
> > > > > Dear Julie,
> > > > >
> > > > > Any news regarding pb2nc? We're still unable to make it
work.
> > > > >
> > > > > Best Regards,
> > > > > Jose
> > > > >
> > > > > -----Original Message-----
> > > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > > Sent: Thursday, March 10, 2016 4:20 PM
> > > > > To: Jose Garcia-Rivera
> > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
PREPBUFR
> > > > > to NetCDF
> > > > >
> > > > > Hi Jose. Thank you for attaching the files.
> > > > >
> > > > > Could you please send me a list of the files in
> > > > > /work/apps/pgi_14.10/SANDY/bufrlib/lib?
> > > > >
> > > > > Thank you!
> > > > >
> > > > > Julie
> > > > >
> > > > >
> > > > > On Thu, Mar 10, 2016 at 12:20 PM, Jose Garcia-Rivera via RT
<
> > > > > met_help at ucar.edu> wrote:
> > > > >
> > > > > >
> > > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > > >
> > > > > >
> > > > > > Dear Julie,
> > > > > >
> > > > > > The administrator re-compiled MET following your
instructions,
> > > > > > and says there's still trouble. He sent me the log files
> > (attached).
> > > > > > Is there any other approach that might help?
> > > > > >
> > > > > > Best Regards,
> > > > > > Jose
> > > > > >
> > > > > > -----Original Message-----
> > > > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > > > Sent: Wednesday, March 09, 2016 12:39 PM
> > > > > > To: Jose Garcia-Rivera
> > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
> > > > > > PREPBUFR to NetCDF
> > > > > >
> > > > > > Thank you, Jose! It looks like something went wrong
during
> > > > compilation.
> > > > > > I suggest recompiling MET to see if we can get this issue
> resolved.
> > > > > > NCEP's BUFRLIB is used by the pb2nc MET tool, and is a
> > > > > > required external library for pb2nc. MET is not yet
> > > > > > compatible with BUFRLIB
> > > > > version 11.0.0, so we
> > > > > > suggest getting version 10.2.3. We are working on our
online
> > > tutorial
> > > > > for
> > > > > > METv.5.1, but in the meantime, I'll point you to our
online
> > > > > > tutorial directions for installing BUFRLIB:
> > > > > >
> > > > > >
> > > > > >
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.
> > > > > > 0/
> > > > > > co
> > > > > > mp
> > > > > > ilation/req_libs.php
> > > > > >
> > > > > > It is also important to review the necessary environment
> > > > > > variables to
> > > > > set:
> > > > > >
> > > > > >
> > > > > >
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.
> > > > > > 0/
> > > > > > co
> > > > > > mp
> > > > > > ilation/configure.php
> > > > > >
> > > > > > For example,
> > > > > >
> > > > > > "Set *$MET_BUFR* to point to the main BUFR directory, or
set
> > > > > > *$MET_BUFRLIB* to point to the directory with the BUFR
library
> > files.
> > > > > > Because MET doesn't use any BUFR library include files,
you
> > > > > > don't need to specify *$MET_BUFRINC* ."
> > > > > >
> > > > > > Once you've installed the required libraries and set up
your
> > > > > > environment variables, you'll be ready to configure MET
> > > > > > (instructions at the bottom of the last link above) and
then
> > > > > > compile and install MET (
> > > > > >
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.
> > > > > > 0/
> > > > > > co
> > > > > > mp
> > > > > > ilation/compile.php
> > > > > > ).
> > > > > > After re-installing MET, please run "make test" again. If
you
> > > > > > still encounter the same problem, please send me your
> > > > > > *config.log* file and your *make_install.log *file.
Please
> > > > > > let me know if you have any
> > > > > questions.
> > > > > >
> > > > > > Please let us know how it goes.
> > > > > >
> > > > > > Thanks,
> > > > > > Julie
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > > On Wed, Mar 9, 2016 at 10:22 AM, Jose Garcia-Rivera via RT
<
> > > > > > met_help at ucar.edu> wrote:
> > > > > >
> > > > > > >
> > > > > > > <URL:
> > > > > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > > > >
> > > > > > >
> > > > > > > Dear Julie,
> > > > > > >
> > > > > > > Attached is the test log file. It's showing the same
issues
> > > > > > > on pb2nc even with the sample files.
> > > > > > >
> > > > > > > Best Regards,
> > > > > > > Jose
> > > > > > >
> > > > > > > -----Original Message-----
> > > > > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > > > > Sent: Tuesday, March 08, 2016 5:28 PM
> > > > > > > To: Jose Garcia-Rivera
> > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
> > > > > > > PREPBUFR to NetCDF
> > > > > > >
> > > > > > > Hi Jose. Thank you for uploading the files.
Unfortunately,
> > > > > > > I am unable to reproduce the error you are experiencing.
I
> > > > > > > am wondering if you have successfully used pb2nc before.
As
> > > > > > > a check could you please run the following in your met-
5.1/
> > > directory:
> > > > > > >
> > > > > > > *make test >& make_test.log*
> > > > > > >
> > > > > > > and then send me the make_test.log file?
> > > > > > >
> > > > > > > Thanks,
> > > > > > > Julie
> > > > > > >
> > > > > > > On Tue, Mar 8, 2016 at 11:29 AM, Jose Garcia-Rivera via
RT <
> > > > > > > met_help at ucar.edu> wrote:
> > > > > > >
> > > > > > > >
> > > > > > > > <URL:
> > > > > > > >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > > > > >
> > > > > > > >
> > > > > > > > Dear Julie,
> > > > > > > >
> > > > > > > > I just put the files in 'garcia_data'. I appreciate
your
> help.
> > > > > > > >
> > > > > > > > Best Regards,
> > > > > > > > Jose
> > > > > > > >
> > > > > > > > -----Original Message-----
> > > > > > > > From: Julie Prestopnik via RT
[mailto:met_help at ucar.edu]
> > > > > > > > Sent: Tuesday, March 08, 2016 1:12 PM
> > > > > > > > To: Jose Garcia-Rivera
> > > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues
converting
> > > > > > > > PREPBUFR to NetCDF
> > > > > > > >
> > > > > > > > Hi Jose. I'm sorry to hear that you are having
problems
> > > > > > > > converting a PREPBUFR file to NetCDF.
> > > > > > > >
> > > > > > > > Please upload your input files and configuration file
to
> > > > > > > > our anonymous ftp site as follows:
> > > > > > > > http://www.dtcenter.org/met/users/support/met_help.php
> > > > > > > >
> > > > > > > > Then I can take a look and get back to you.
> > > > > > > >
> > > > > > > > Thanks,
> > > > > > > > Julie
> > > > > > > >
> > > > > > > > On Tue, Mar 8, 2016 at 11:01 AM, Jose Garcia-Rivera
via RT
> > > > > > > > < met_help at ucar.edu> wrote:
> > > > > > > >
> > > > > > > > >
> > > > > > > > > Tue Mar 08 11:01:25 2016: Request 75433 was acted
upon.
> > > > > > > > > Transaction: Ticket created by GarciaJ at imsg.com
> > > > > > > > > Queue: met_help
> > > > > > > > > Subject: Issues converting PREPBUFR to NetCDF
> > > > > > > > > Owner: Nobody
> > > > > > > > > Requestors: GarciaJ at imsg.com
> > > > > > > > > Status: new
> > > > > > > > > Ticket <URL:
> > > > > > > > >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > Dear Met Help,
> > > > > > > > >
> > > > > > > > > Trying to convert a PREPBUFR file to NetCDF.
> > > > > > > > >
> > > > > > > > > I used the default PB2NC configure file, and got the
> > following:
> > > > > > > > >
> > > > > > > > > [garciaj at login prepbufr_obs]$ ./pb2nc
> > > > > > > > > gdas1.t12z.prepbufr.nr gdas.20150820.t12z.nc
> > > > > > > > > PB2NCConfig_default DEBUG 1: Default Config
> > > > > > > > > File:
> > > > > > > > > /work/apps/pgi_14.10/met-
5.1/share/met/config/PB2NCConfi
> > > > > > > > > g_ de fa ul t DEBUG 1: User Config File:
> > > > > > > > > PB2NCConfig_default DEBUG 1: Creating NetCDF File:
> > gdas.20150820.t12z.nc
> > > > > > > > > DEBUG 1: Processing PrepBufr File:
> > gdas1.t12z.prepbufr.nr
> > > > > > > > > DEBUG 1: Blocking PrepBufr file to:
> > > > /tmp/tmp_pb2nc_blk_32144_0
> > > > > > > > > WARNING:
> > > > > > > > > WARNING: process_pbfile() -> No PrepBufr messages to
> > > > > > > > > process in
> > > > > file:
> > > > > > > > > gdas1.t12z.prepbufr.nr
> > > > > > > > > WARNING:
> > > > > > > > > ERROR :
> > > > > > > > > ERROR : write_netcdf_hdr_data() -> No PrepBufr
messages
> > > > retained.
> > > > > > > > > Nothing to write.
> > > > > > > > > ERROR :
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > Thanks in advance for the help, Jose M. Garcia-
Rivera,
> > > > > > > > > PhD IM Systems Group Rockville/College Park, MD This
> > > > > > > > > e-mail, including attachments, may include
confidential
> > > > > > > > > and/or proprietary information, and may be used only
by
> > > > > > > > > the person or entity to which it is addressed. If
the
> > > > > > > > > reader of this e-mail is not the intended recipient
or
> > > > > > > > > his or her authorized agent, the reader is hereby
> > > > > > > > > notified that any dissemination, distribution or
copying
> > > > > > > > > of this e-mail is prohibited. If you have received
this
> > > > > > > > > e-mail in error, please notify the sender by
replying to
> > > > > > > > > this message and delete this
> > > > > > > > e-mail immediately.
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > --
> > > > > > > > Julie Prestopnik
> > > > > > > > National Center for Atmospheric Research Research
> > > > > > > > Applications Laboratory
> > > > > > > > Phone: 303.497.8399
> > > > > > > > Email: jpresto at ucar.edu
> > > > > > > >
> > > > > > > > This e-mail, including attachments, may include
> > > > > > > > confidential and/or proprietary information, and may
be
> > > > > > > > used only by the person or entity to which it is
> > > > > > > > addressed. If the reader of this e-mail is not the
> > > > > > > > intended recipient or his or her authorized agent, the
> > > > > > > > reader is hereby notified that any dissemination,
> > > > > > > > distribution or copying of this e-mail is prohibited.
If
> > > > > > > > you have received this e-mail in error, please notify
the
> > > > > > > > sender by replying to this message and delete this
> > > > > > > e-mail immediately.
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > --
> > > > > > > Julie Prestopnik
> > > > > > > National Center for Atmospheric Research Research
> > > > > > > Applications Laboratory
> > > > > > > Phone: 303.497.8399
> > > > > > > Email: jpresto at ucar.edu
> > > > > > >
> > > > > > > This e-mail, including attachments, may include
confidential
> > > > > > > and/or proprietary information, and may be used only by
the
> > > > > > > person or entity to which it is addressed. If the reader
of
> > > > > > > this e-mail is not the intended recipient or his or her
> > > > > > > authorized agent, the reader is hereby notified that any
> > > > > > > dissemination, distribution or copying of this e-mail is
> > > > > > > prohibited. If you have received this e-mail in error,
> > > > > > > please notify the sender by replying to this message and
> > > > > > > delete this
> > > > > > e-mail immediately.
> > > > > > >
> > > > > > >
> > > > > >
> > > > > >
> > > > > > --
> > > > > > Julie Prestopnik
> > > > > > National Center for Atmospheric Research Research
Applications
> > > > > > Laboratory
> > > > > > Phone: 303.497.8399
> > > > > > Email: jpresto at ucar.edu
> > > > > >
> > > > > > This e-mail, including attachments, may include
confidential
> > > > > > and/or proprietary information, and may be used only by
the
> > > > > > person or entity to which it is addressed. If the reader
of
> > > > > > this e-mail is not the intended recipient or his or her
> > > > > > authorized agent, the reader is hereby notified that any
> > > > > > dissemination, distribution or copying of this e-mail is
> > > > > > prohibited. If you have received this e-mail in error,
please
> > > > > > notify the sender by replying to this message and delete
this
> > > > > e-mail immediately.
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > > > --
> > > > > Julie Prestopnik
> > > > > National Center for Atmospheric Research Research
Applications
> > > > > Laboratory
> > > > > Phone: 303.497.8399
> > > > > Email: jpresto at ucar.edu
> > > > >
> > > > > This e-mail, including attachments, may include confidential
> > > > > and/or proprietary information, and may be used only by the
> > > > > person or entity to which it is addressed. If the reader of
this
> > > > > e-mail is not the intended recipient or his or her
authorized
> > > > > agent, the reader is hereby notified that any dissemination,
> > > > > distribution or copying of this e-mail is prohibited. If you
> > > > > have received this e-mail in error, please notify the sender
by
> > > > > replying to this message and delete this
> > > > e-mail immediately.
> > > > >
> > > > >
> > > > >
> > > >
> > > >
> > > > --
> > > > Julie Prestopnik
> > > > National Center for Atmospheric Research Research Applications
> > > > Laboratory
> > > > Phone: 303.497.8399
> > > > Email: jpresto at ucar.edu
> > > >
> > > > This e-mail, including attachments, may include confidential
> > > > and/or proprietary information, and may be used only by the
person
> > > > or entity to which it is addressed. If the reader of this e-
mail
> > > > is not the intended recipient or his or her authorized agent,
the
> > > > reader is hereby notified that any dissemination, distribution
or
> > > > copying of this e-mail is prohibited. If you have received
this
> > > > e-mail in error, please notify the sender by replying to this
> > > > message and delete this
> > > e-mail immediately.
> > > >
> > > >
> > > >
> > >
> > >
> > > --
> > > Julie Prestopnik
> > > National Center for Atmospheric Research Research Applications
> > > Laboratory
> > > Phone: 303.497.8399
> > > Email: jpresto at ucar.edu
> > >
> > > This e-mail, including attachments, may include confidential
and/or
> > > proprietary information, and may be used only by the person or
> > > entity to which it is addressed. If the reader of this e-mail is
not
> > > the intended recipient or his or her authorized agent, the
reader is
> > > hereby notified that any dissemination, distribution or copying
of
> > > this e-mail is prohibited. If you have received this e-mail in
> > > error, please notify the sender by replying to this message and
> > > delete this
> > e-mail immediately.
> > >
> > >
> > >
> >
> >
> > --
> > Julie Prestopnik
> > National Center for Atmospheric Research Research Applications
> > Laboratory
> > Phone: 303.497.8399
> > Email: jpresto at ucar.edu
> >
> > This e-mail, including attachments, may include confidential
and/or
> > proprietary information, and may be used only by the person or
entity
> > to which it is addressed. If the reader of this e-mail is not the
> > intended recipient or his or her authorized agent, the reader is
> > hereby notified that any dissemination, distribution or copying of
> > this e-mail is prohibited. If you have received this e-mail in
error,
> > please notify the sender by replying to this message and delete
this
> e-mail immediately.
> >
> >
> >
>
>
> --
> Julie Prestopnik
> National Center for Atmospheric Research Research Applications
Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
> This e-mail, including attachments, may include confidential and/or
> proprietary information, and may be used only by the person or
entity to
> which it is addressed. If the reader of this e-mail is not the
intended
> recipient or his or her authorized agent, the reader is hereby
notified
> that any dissemination, distribution or copying of this e-mail is
> prohibited. If you have received this e-mail in error, please notify
the
> sender by replying to this message and delete this e-mail
immediately.
>
>
>
--
Julie Prestopnik
National Center for Atmospheric Research
Research Applications Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to NetCDF
From: Jose Garcia-Rivera
Time: Wed Mar 16 14:44:13 2016
Dear Julie,
Thank you so much for all the help. I forwarded the message to system
administrator (since I don't have permissions to run the compilation),
and I'll let you know once MET is re-compiled.
Best Regards,
Jose
-----Original Message-----
From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
Sent: Wednesday, March 16, 2016 4:40 PM
To: Jose Garcia-Rivera
Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to
NetCDF
Hi Jose. I apologize for the delay. This was a tricky problem to
figure out, however, we were finally able to reproduce the error you
are receiving for pb2nc.
The problem is BUFRLIB being compiled with pgf90 and MET being
compiled with pgf77. They aren't talking well to each other.
BUFRLIBv10.1.0 compiles with pgf77 but later versions require pgf90.
We will plan on updating the MET Fortran code to compile with pgf90 so
that we can use newer BUFRLIB versions, but for now, to solve your
problem, I have attached BUFRLIB_v10-1-0.tar. Please install that
version of BUFRLIB using pgf77 and then recompile MET without the
"LIBS" environment variable setting?
Please let me know how that goes. We were able to get a successful
run using that solution and hope you will too.
Thanks,
Julie
On Wed, Mar 16, 2016 at 12:17 PM, Jose Garcia-Rivera via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
>
> Dear Julie,
>
> Is there anything that we can do here to sort these issues out?
>
> Best Regards,
> Jose
>
> -----Original Message-----
> From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> Sent: Tuesday, March 15, 2016 5:08 PM
> To: Jose Garcia-Rivera
> Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to
> NetCDF
>
> Hi Jose. I was not. I got the same error you did. I believe that
> the test.nc file is not in the correct format needed by point_stat,
so
> I think we need to get pb2nc working for you. It is likely a
> communication problem between the C code and the Fortran code.
>
> Julie
>
> On Tue, Mar 15, 2016 at 3:05 PM, Jose Garcia-Rivera via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> >
> > Dear Julie,
> >
> > Quick question: Were you able to run point_stat with the netCDF
file
> > that I sent yesterday?
> >
> > Thanks for the help,
> > Jose
> >
> > -----Original Message-----
> > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > Sent: Tuesday, March 15, 2016 12:17 PM
> > To: Jose Garcia-Rivera
> > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR
to
> > NetCDF
> >
> > Thank you, Jose. I'm working with co-workers to try to get these
> > issues resolved. I hope to get back to you soon.
> >
> > Julie
> >
> > On Mon, Mar 14, 2016 at 1:36 PM, Jose Garcia-Rivera via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> > >
> > > Dear Julie,
> > >
> > > I just uploaded the three files to 'garcia_data'.
> > >
> > > Thanks for the help,
> > > Jose
> > >
> > >
> > > -----Original Message-----
> > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > Sent: Monday, March 14, 2016 3:32 PM
> > > To: Jose Garcia-Rivera
> > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR
> > > to NetCDF
> > >
> > > Hi Jose.
> > >
> > > Yes, please upload your input files and configuration file
> > > (nmbprs_d01.06, test.nc, PointStatConfig_default) to our
anonymous
> > > ftp
> > site as follows:
> > > http://www.dtcenter.org/met/users/support/met_help.php
> > >
> > > Thanks!
> > >
> > > Julie
> > >
> > > On Mon, Mar 14, 2016 at 1:06 PM, Jose Garcia-Rivera via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
>
> > > >
> > > > Dear Julie,
> > > >
> > > > I got to convert my prepbufr file using a python script.
> > > > However, I have trouble running point_stat. Can I send you the
> > > > files, to see if you have the same issue?
> > > >
> > > >
> > > > This is what I got:
> > > >
> > > > [garciaj at login prepbufr_obs]$ ./point_stat nmbprs_d01.06
test.nc
> > > > PointStatConfig_default DEBUG 1: Default Config File:
> > > > /work/apps/pgi_14.10/SANDY/met-
5.1/share/met/config/PointStatCon
> > > > fi g_ de fault DEBUG 1: User Config File:
> > > > PointStatConfig_default
> > > > GSL_RNG_TYPE=mt19937
> > > > GSL_RNG_SEED=18446744073425053526 DEBUG 1: Forecast File:
> > > > nmbprs_d01.06 DEBUG 1: Observation File:
> > > > test.nc DEBUG 2:
> > > > DEBUG 2:
> > > >
----------------------------------------------------------------
> > > > --
> > > > --
> > > > --
> > > > ----------
> > > > DEBUG 2:
> > > > DEBUG 2: Reading data for SPFH/P500.
> > > > DEBUG 2: For SPFH/P500 found 1 forecast levels and 0
climatology
> > levels.
> > > > DEBUG 2:
> > > > DEBUG 2:
> > > >
----------------------------------------------------------------
> > > > --
> > > > --
> > > > --
> > > > ----------
> > > > DEBUG 2:
> > > > DEBUG 2: Reading data for TMP/P500.
> > > > DEBUG 2: For TMP/P500 found 1 forecast levels and 0
climatology
> levels.
> > > > DEBUG 2:
> > > > DEBUG 2:
> > > >
----------------------------------------------------------------
> > > > --
> > > > --
> > > > --
> > > > ----------
> > > > DEBUG 2:
> > > > DEBUG 2: Reading data for HGT/P500.
> > > > DEBUG 2: For HGT/P500 found 1 forecast levels and 0
climatology
> levels.
> > > > DEBUG 2:
> > > > DEBUG 2:
> > > >
----------------------------------------------------------------
> > > > --
> > > > --
> > > > --
> > > > ----------
> > > > DEBUG 2:
> > > > DEBUG 2: Reading data for UGRD/P500.
> > > > DEBUG 2: For UGRD/P500 found 1 forecast levels and 0
climatology
> > levels.
> > > > DEBUG 2:
> > > > DEBUG 2:
> > > >
----------------------------------------------------------------
> > > > --
> > > > --
> > > > --
> > > > ----------
> > > > DEBUG 2:
> > > > DEBUG 2: Reading data for VGRD/P500.
> > > > DEBUG 2: For VGRD/P500 found 1 forecast levels and 0
climatology
> > levels.
> > > > DEBUG 2:
> > > > DEBUG 2:
> > > >
----------------------------------------------------------------
> > > > --
> > > > --
> > > > --
> > > > ----------
> > > > DEBUG 2:
> > > > WARNING:
> > > > WARNING: process_obs_file() -> can't open observation netCDF
file:
> > > > test.nc
> > > > WARNING:
> > > > DEBUG 2:
> > > > DEBUG 2:
> > > >
----------------------------------------------------------------
> > > > --
> > > > --
> > > > --
> > > > ----------
> > > > DEBUG 2:
> > > > DEBUG 2: Processing SPFH/P500 versus SPFH/P500, for
observation
> > > > type ADPUPA, over region FULL, for interpolation method
> > > > NEAREST(1), using
> > > > 0 pairs.
> > > > DEBUG 2:
> > > > DEBUG 2:
> > > >
----------------------------------------------------------------
> > > > --
> > > > --
> > > > --
> > > > ----------
> > > > DEBUG 2:
> > > > DEBUG 2: Processing TMP/P500 versus TMP/P500, for observation
> > > > type ADPUPA, over region FULL, for interpolation method
> > > > NEAREST(1), using
> > > > 0
> > > pairs.
> > > > DEBUG 2:
> > > > DEBUG 2:
> > > >
----------------------------------------------------------------
> > > > --
> > > > --
> > > > --
> > > > ----------
> > > > DEBUG 2:
> > > > DEBUG 2: Processing HGT/P500 versus HGT/P500, for observation
> > > > type ADPUPA, over region FULL, for interpolation method
> > > > NEAREST(1), using
> > > > 0
> > > pairs.
> > > > DEBUG 2:
> > > > DEBUG 2:
> > > >
----------------------------------------------------------------
> > > > --
> > > > --
> > > > --
> > > > ----------
> > > > DEBUG 2:
> > > > DEBUG 2: Processing UGRD/P500 versus UGRD/P500, for
observation
> > > > type ADPUPA, over region FULL, for interpolation method
> > > > NEAREST(1), using
> > > > 0 pairs.
> > > > DEBUG 2:
> > > > DEBUG 2:
> > > >
----------------------------------------------------------------
> > > > --
> > > > --
> > > > --
> > > > ----------
> > > > DEBUG 2:
> > > > DEBUG 2: Processing VGRD/P500 versus VGRD/P500, for
observation
> > > > type ADPUPA, over region FULL, for interpolation method
> > > > NEAREST(1), using
> > > > 0 pairs.
> > > > DEBUG 2:
> > > > DEBUG 2:
> > > >
----------------------------------------------------------------
> > > > --
> > > > --
> > > > --
> > > > ----------
> > > > DEBUG 2:
> > > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V.stat
> > > > DEBUG 1: Output file:
> > > > ./point_stat_060000L_20150820_180000V_fho.txt
> > > > DEBUG 1: Output file:
> > > > ./point_stat_060000L_20150820_180000V_ctc.txt
> > > > DEBUG 1: Output file:
> > > > ./point_stat_060000L_20150820_180000V_cts.txt
> > > > DEBUG 1: Output file:
> > > > ./point_stat_060000L_20150820_180000V_mctc.txt
> > > > DEBUG 1: Output file:
> > > > ./point_stat_060000L_20150820_180000V_mcts.txt
> > > > DEBUG 1: Output file:
> > > > ./point_stat_060000L_20150820_180000V_cnt.txt
> > > > DEBUG 1: Output file:
> > > > ./point_stat_060000L_20150820_180000V_sl1l2.txt
> > > > DEBUG 1: Output file:
> > > > ./point_stat_060000L_20150820_180000V_sal1l2.txt
> > > > DEBUG 1: Output file:
> > > > ./point_stat_060000L_20150820_180000V_vl1l2.txt
> > > > DEBUG 1: Output file:
> > > > ./point_stat_060000L_20150820_180000V_val1l2.txt
> > > > DEBUG 1: Output file:
> > > > ./point_stat_060000L_20150820_180000V_pct.txt
> > > > DEBUG 1: Output file:
> > > > ./point_stat_060000L_20150820_180000V_pstd.txt
> > > > DEBUG 1: Output file:
> > > > ./point_stat_060000L_20150820_180000V_pjc.txt
> > > > DEBUG 1: Output file:
> > > > ./point_stat_060000L_20150820_180000V_prc.txt
> > > > DEBUG 1: Output file:
> > > > ./point_stat_060000L_20150820_180000V_mpr.txt
> > > >
> > > >
> > > > Thanks for the help,
> > > > Jose
> > > >
> > > >
> > > > -----Original Message-----
> > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > Sent: Monday, March 14, 2016 12:17 PM
> > > > To: Jose Garcia-Rivera
> > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
PREPBUFR
> > > > to NetCDF
> > > >
> > > > Hi Jose. I apologize for the delayed response. I was out of
> > > > the office on Friday. I'm going to try to figure out a
solution
> > > > and get back with you shortly.
> > > >
> > > > Julie
> > > >
> > > > On Fri, Mar 11, 2016 at 2:02 PM, Jose Garcia-Rivera via RT <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > > >
> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > >
> > > > >
> > > > > Dear Julie,
> > > > >
> > > > > Any news regarding pb2nc? We're still unable to make it
work.
> > > > >
> > > > > Best Regards,
> > > > > Jose
> > > > >
> > > > > -----Original Message-----
> > > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > > Sent: Thursday, March 10, 2016 4:20 PM
> > > > > To: Jose Garcia-Rivera
> > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
> > > > > PREPBUFR to NetCDF
> > > > >
> > > > > Hi Jose. Thank you for attaching the files.
> > > > >
> > > > > Could you please send me a list of the files in
> > > > > /work/apps/pgi_14.10/SANDY/bufrlib/lib?
> > > > >
> > > > > Thank you!
> > > > >
> > > > > Julie
> > > > >
> > > > >
> > > > > On Thu, Mar 10, 2016 at 12:20 PM, Jose Garcia-Rivera via RT
<
> > > > > met_help at ucar.edu> wrote:
> > > > >
> > > > > >
> > > > > > <URL:
> > > > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > > >
> > > > > >
> > > > > > Dear Julie,
> > > > > >
> > > > > > The administrator re-compiled MET following your
> > > > > > instructions, and says there's still trouble. He sent me
the
> > > > > > log files
> > (attached).
> > > > > > Is there any other approach that might help?
> > > > > >
> > > > > > Best Regards,
> > > > > > Jose
> > > > > >
> > > > > > -----Original Message-----
> > > > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > > > Sent: Wednesday, March 09, 2016 12:39 PM
> > > > > > To: Jose Garcia-Rivera
> > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
> > > > > > PREPBUFR to NetCDF
> > > > > >
> > > > > > Thank you, Jose! It looks like something went wrong
during
> > > > compilation.
> > > > > > I suggest recompiling MET to see if we can get this issue
> resolved.
> > > > > > NCEP's BUFRLIB is used by the pb2nc MET tool, and is a
> > > > > > required external library for pb2nc. MET is not yet
> > > > > > compatible with BUFRLIB
> > > > > version 11.0.0, so we
> > > > > > suggest getting version 10.2.3. We are working on our
online
> > > tutorial
> > > > > for
> > > > > > METv.5.1, but in the meantime, I'll point you to our
online
> > > > > > tutorial directions for installing BUFRLIB:
> > > > > >
> > > > > >
> > > > > >
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.
> > > > > > 0/
> > > > > > co
> > > > > > mp
> > > > > > ilation/req_libs.php
> > > > > >
> > > > > > It is also important to review the necessary environment
> > > > > > variables to
> > > > > set:
> > > > > >
> > > > > >
> > > > > >
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.
> > > > > > 0/
> > > > > > co
> > > > > > mp
> > > > > > ilation/configure.php
> > > > > >
> > > > > > For example,
> > > > > >
> > > > > > "Set *$MET_BUFR* to point to the main BUFR directory, or
set
> > > > > > *$MET_BUFRLIB* to point to the directory with the BUFR
> > > > > > library
> > files.
> > > > > > Because MET doesn't use any BUFR library include files,
you
> > > > > > don't need to specify *$MET_BUFRINC* ."
> > > > > >
> > > > > > Once you've installed the required libraries and set up
your
> > > > > > environment variables, you'll be ready to configure MET
> > > > > > (instructions at the bottom of the last link above) and
then
> > > > > > compile and install MET (
> > > > > >
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.
> > > > > > 0/
> > > > > > co
> > > > > > mp
> > > > > > ilation/compile.php
> > > > > > ).
> > > > > > After re-installing MET, please run "make test" again. If
> > > > > > you still encounter the same problem, please send me your
> > > > > > *config.log* file and your *make_install.log *file.
Please
> > > > > > let me know if you have any
> > > > > questions.
> > > > > >
> > > > > > Please let us know how it goes.
> > > > > >
> > > > > > Thanks,
> > > > > > Julie
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > > On Wed, Mar 9, 2016 at 10:22 AM, Jose Garcia-Rivera via RT
<
> > > > > > met_help at ucar.edu> wrote:
> > > > > >
> > > > > > >
> > > > > > > <URL:
> > > > > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > > > >
> > > > > > >
> > > > > > > Dear Julie,
> > > > > > >
> > > > > > > Attached is the test log file. It's showing the same
> > > > > > > issues on pb2nc even with the sample files.
> > > > > > >
> > > > > > > Best Regards,
> > > > > > > Jose
> > > > > > >
> > > > > > > -----Original Message-----
> > > > > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > > > > Sent: Tuesday, March 08, 2016 5:28 PM
> > > > > > > To: Jose Garcia-Rivera
> > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
> > > > > > > PREPBUFR to NetCDF
> > > > > > >
> > > > > > > Hi Jose. Thank you for uploading the files.
> > > > > > > Unfortunately, I am unable to reproduce the error you
are
> > > > > > > experiencing. I am wondering if you have successfully
> > > > > > > used pb2nc before. As a check could you please run the
> > > > > > > following in your met-5.1/
> > > directory:
> > > > > > >
> > > > > > > *make test >& make_test.log*
> > > > > > >
> > > > > > > and then send me the make_test.log file?
> > > > > > >
> > > > > > > Thanks,
> > > > > > > Julie
> > > > > > >
> > > > > > > On Tue, Mar 8, 2016 at 11:29 AM, Jose Garcia-Rivera via
RT
> > > > > > > < met_help at ucar.edu> wrote:
> > > > > > >
> > > > > > > >
> > > > > > > > <URL:
> > > > > > > >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > > > > >
> > > > > > > >
> > > > > > > > Dear Julie,
> > > > > > > >
> > > > > > > > I just put the files in 'garcia_data'. I appreciate
your
> help.
> > > > > > > >
> > > > > > > > Best Regards,
> > > > > > > > Jose
> > > > > > > >
> > > > > > > > -----Original Message-----
> > > > > > > > From: Julie Prestopnik via RT
[mailto:met_help at ucar.edu]
> > > > > > > > Sent: Tuesday, March 08, 2016 1:12 PM
> > > > > > > > To: Jose Garcia-Rivera
> > > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues
converting
> > > > > > > > PREPBUFR to NetCDF
> > > > > > > >
> > > > > > > > Hi Jose. I'm sorry to hear that you are having
problems
> > > > > > > > converting a PREPBUFR file to NetCDF.
> > > > > > > >
> > > > > > > > Please upload your input files and configuration file
to
> > > > > > > > our anonymous ftp site as follows:
> > > > > > > > http://www.dtcenter.org/met/users/support/met_help.php
> > > > > > > >
> > > > > > > > Then I can take a look and get back to you.
> > > > > > > >
> > > > > > > > Thanks,
> > > > > > > > Julie
> > > > > > > >
> > > > > > > > On Tue, Mar 8, 2016 at 11:01 AM, Jose Garcia-Rivera
via
> > > > > > > > RT < met_help at ucar.edu> wrote:
> > > > > > > >
> > > > > > > > >
> > > > > > > > > Tue Mar 08 11:01:25 2016: Request 75433 was acted
upon.
> > > > > > > > > Transaction: Ticket created by GarciaJ at imsg.com
> > > > > > > > > Queue: met_help
> > > > > > > > > Subject: Issues converting PREPBUFR to NetCDF
> > > > > > > > > Owner: Nobody
> > > > > > > > > Requestors: GarciaJ at imsg.com
> > > > > > > > > Status: new
> > > > > > > > > Ticket <URL:
> > > > > > > > >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=7543
> > > > > > > > > 3
> > > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > Dear Met Help,
> > > > > > > > >
> > > > > > > > > Trying to convert a PREPBUFR file to NetCDF.
> > > > > > > > >
> > > > > > > > > I used the default PB2NC configure file, and got the
> > following:
> > > > > > > > >
> > > > > > > > > [garciaj at login prepbufr_obs]$ ./pb2nc
> > > > > > > > > gdas1.t12z.prepbufr.nr gdas.20150820.t12z.nc
> > > > > > > > > PB2NCConfig_default DEBUG 1: Default Config
> > > > > > > > > File:
> > > > > > > > > /work/apps/pgi_14.10/met-
5.1/share/met/config/PB2NCCon
> > > > > > > > > fi g_ de fa ul t DEBUG 1: User Config File:
> > > > > > > > > PB2NCConfig_default DEBUG 1: Creating NetCDF File:
> > gdas.20150820.t12z.nc
> > > > > > > > > DEBUG 1: Processing PrepBufr File:
> > gdas1.t12z.prepbufr.nr
> > > > > > > > > DEBUG 1: Blocking PrepBufr file to:
> > > > /tmp/tmp_pb2nc_blk_32144_0
> > > > > > > > > WARNING:
> > > > > > > > > WARNING: process_pbfile() -> No PrepBufr messages to
> > > > > > > > > process in
> > > > > file:
> > > > > > > > > gdas1.t12z.prepbufr.nr
> > > > > > > > > WARNING:
> > > > > > > > > ERROR :
> > > > > > > > > ERROR : write_netcdf_hdr_data() -> No PrepBufr
> > > > > > > > > messages
> > > > retained.
> > > > > > > > > Nothing to write.
> > > > > > > > > ERROR :
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > Thanks in advance for the help, Jose M. Garcia-
Rivera,
> > > > > > > > > PhD IM Systems Group Rockville/College Park, MD This
> > > > > > > > > e-mail, including attachments, may include
> > > > > > > > > confidential and/or proprietary information, and may
> > > > > > > > > be used only by the person or entity to which it is
> > > > > > > > > addressed. If the reader of this e-mail is not the
> > > > > > > > > intended recipient or his or her authorized agent,
the
> > > > > > > > > reader is hereby notified that any dissemination,
> > > > > > > > > distribution or copying of this e-mail is
prohibited.
> > > > > > > > > If you have received this e-mail in error, please
> > > > > > > > > notify the sender by replying to this message and
> > > > > > > > > delete this
> > > > > > > > e-mail immediately.
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > --
> > > > > > > > Julie Prestopnik
> > > > > > > > National Center for Atmospheric Research Research
> > > > > > > > Applications Laboratory
> > > > > > > > Phone: 303.497.8399
> > > > > > > > Email: jpresto at ucar.edu
> > > > > > > >
> > > > > > > > This e-mail, including attachments, may include
> > > > > > > > confidential and/or proprietary information, and may
be
> > > > > > > > used only by the person or entity to which it is
> > > > > > > > addressed. If the reader of this e-mail is not the
> > > > > > > > intended recipient or his or her authorized agent, the
> > > > > > > > reader is hereby notified that any dissemination,
> > > > > > > > distribution or copying of this e-mail is prohibited.
If
> > > > > > > > you have received this e-mail in error, please notify
> > > > > > > > the sender by replying to this message and delete this
> > > > > > > e-mail immediately.
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > --
> > > > > > > Julie Prestopnik
> > > > > > > National Center for Atmospheric Research Research
> > > > > > > Applications Laboratory
> > > > > > > Phone: 303.497.8399
> > > > > > > Email: jpresto at ucar.edu
> > > > > > >
> > > > > > > This e-mail, including attachments, may include
> > > > > > > confidential and/or proprietary information, and may be
> > > > > > > used only by the person or entity to which it is
> > > > > > > addressed. If the reader of this e-mail is not the
> > > > > > > intended recipient or his or her authorized agent, the
> > > > > > > reader is hereby notified that any dissemination,
> > > > > > > distribution or copying of this e-mail is prohibited. If
> > > > > > > you have received this e-mail in error, please notify
the
> > > > > > > sender by replying to this message and delete this
> > > > > > e-mail immediately.
> > > > > > >
> > > > > > >
> > > > > >
> > > > > >
> > > > > > --
> > > > > > Julie Prestopnik
> > > > > > National Center for Atmospheric Research Research
> > > > > > Applications Laboratory
> > > > > > Phone: 303.497.8399
> > > > > > Email: jpresto at ucar.edu
> > > > > >
> > > > > > This e-mail, including attachments, may include
confidential
> > > > > > and/or proprietary information, and may be used only by
the
> > > > > > person or entity to which it is addressed. If the reader
of
> > > > > > this e-mail is not the intended recipient or his or her
> > > > > > authorized agent, the reader is hereby notified that any
> > > > > > dissemination, distribution or copying of this e-mail is
> > > > > > prohibited. If you have received this e-mail in error,
> > > > > > please notify the sender by replying to this message and
> > > > > > delete this
> > > > > e-mail immediately.
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > > > --
> > > > > Julie Prestopnik
> > > > > National Center for Atmospheric Research Research
Applications
> > > > > Laboratory
> > > > > Phone: 303.497.8399
> > > > > Email: jpresto at ucar.edu
> > > > >
> > > > > This e-mail, including attachments, may include confidential
> > > > > and/or proprietary information, and may be used only by the
> > > > > person or entity to which it is addressed. If the reader of
> > > > > this e-mail is not the intended recipient or his or her
> > > > > authorized agent, the reader is hereby notified that any
> > > > > dissemination, distribution or copying of this e-mail is
> > > > > prohibited. If you have received this e-mail in error,
please
> > > > > notify the sender by replying to this message and delete
this
> > > > e-mail immediately.
> > > > >
> > > > >
> > > > >
> > > >
> > > >
> > > > --
> > > > Julie Prestopnik
> > > > National Center for Atmospheric Research Research Applications
> > > > Laboratory
> > > > Phone: 303.497.8399
> > > > Email: jpresto at ucar.edu
> > > >
> > > > This e-mail, including attachments, may include confidential
> > > > and/or proprietary information, and may be used only by the
> > > > person or entity to which it is addressed. If the reader of
this
> > > > e-mail is not the intended recipient or his or her authorized
> > > > agent, the reader is hereby notified that any dissemination,
> > > > distribution or copying of this e-mail is prohibited. If you
> > > > have received this e-mail in error, please notify the sender
by
> > > > replying to this message and delete this
> > > e-mail immediately.
> > > >
> > > >
> > > >
> > >
> > >
> > > --
> > > Julie Prestopnik
> > > National Center for Atmospheric Research Research Applications
> > > Laboratory
> > > Phone: 303.497.8399
> > > Email: jpresto at ucar.edu
> > >
> > > This e-mail, including attachments, may include confidential
> > > and/or proprietary information, and may be used only by the
person
> > > or entity to which it is addressed. If the reader of this e-mail
> > > is not the intended recipient or his or her authorized agent,
the
> > > reader is hereby notified that any dissemination, distribution
or
> > > copying of this e-mail is prohibited. If you have received this
> > > e-mail in error, please notify the sender by replying to this
> > > message and delete this
> > e-mail immediately.
> > >
> > >
> > >
> >
> >
> > --
> > Julie Prestopnik
> > National Center for Atmospheric Research Research Applications
> > Laboratory
> > Phone: 303.497.8399
> > Email: jpresto at ucar.edu
> >
> > This e-mail, including attachments, may include confidential
and/or
> > proprietary information, and may be used only by the person or
> > entity to which it is addressed. If the reader of this e-mail is
not
> > the intended recipient or his or her authorized agent, the reader
is
> > hereby notified that any dissemination, distribution or copying of
> > this e-mail is prohibited. If you have received this e-mail in
> > error, please notify the sender by replying to this message and
> > delete this
> e-mail immediately.
> >
> >
> >
>
>
> --
> Julie Prestopnik
> National Center for Atmospheric Research Research Applications
> Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
> This e-mail, including attachments, may include confidential and/or
> proprietary information, and may be used only by the person or
entity
> to which it is addressed. If the reader of this e-mail is not the
> intended recipient or his or her authorized agent, the reader is
> hereby notified that any dissemination, distribution or copying of
> this e-mail is prohibited. If you have received this e-mail in
error,
> please notify the sender by replying to this message and delete this
e-mail immediately.
>
>
>
--
Julie Prestopnik
National Center for Atmospheric Research Research Applications
Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
This e-mail, including attachments, may include confidential and/or
proprietary information, and may be used only by the person or entity
to which it is addressed. If the reader of this e-mail is not the
intended recipient or his or her authorized agent, the reader is
hereby notified that any dissemination, distribution or copying of
this e-mail is prohibited. If you have received this e-mail in error,
please notify the sender by replying to this message and delete this
e-mail immediately.
------------------------------------------------
Subject: Issues converting PREPBUFR to NetCDF
From: Jose Garcia-Rivera
Time: Thu Mar 17 12:29:42 2016
Dear Julie,
We got the executables to work! However, I have a couple of
issues/questions:
Issue #1 --- Not getting values after running point_stat
Everything seems to run fine. I attached the configuration file. I can
send the three files via FTP if needed.
Issue #2 --- PB2NC doesn't seem to finish the job, but it does? I had
to do CTRL+C, and checked the netCDF file using ncl_filedump:
[garciaj at login prepbufr_obs]$ ./pb2nc prepbufr.gdas.20150820.t18z.nr
newtest.nc PB2NCConfig_default
DEBUG 1: Default Config File: /work/apps/pgi_14.10/SANDY/met-
5.1/share/met/config/PB2NCConfig_default
DEBUG 1: User Config File: PB2NCConfig_default
DEBUG 1: Creating NetCDF File: newtest.nc
DEBUG 1: Processing PrepBufr File: prepbufr.gdas.20150820.t18z.nr
DEBUG 1: Blocking PrepBufr file to: /tmp/tmp_pb2nc_blk_17703_0
DEBUG 2: PrepBufr Time Center: 20150820_180000
DEBUG 2: Searching Time Window: 20150820_163000 to
20150820_193000
DEBUG 2: Processing 685386 PrepBufr messages...
5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90%
95% 100%
DEBUG 2: Total PrepBufr Messages processed = 685386
DEBUG 2: Rejected based on message type = 0
DEBUG 2: Rejected based on station id = 0
DEBUG 2: Rejected based on valid time = 185145
DEBUG 2: Rejected based on masking grid = 0
DEBUG 2: Rejected based on masking polygon = 0
DEBUG 2: Rejected based on elevation = 0
DEBUG 2: Rejected based on pb report type = 0
DEBUG 2: Rejected based on input report type = 0
DEBUG 2: Rejected based on instrument type = 0
DEBUG 2: Rejected based on zero observations = 47833
DEBUG 2: Total PrepBufr Messages retained = 452408
DEBUG 2: Total observations retained or derived = 949837
^C
Checking netCDF file:
[garciaj at login prepbufr_obs]$ ncl_filedump newtest.nc
Copyright (C) 1995-2015 - All Rights Reserved
University Corporation for Atmospheric Research
NCAR Command Language Version 6.3.0
The use of this software is governed by a License Agreement.
See http://www.ncl.ucar.edu/ for more details.
Variable: f
Type: file
filename: newtest
path: newtest.nc
file global attributes:
FileOrigins : File newtest.nc generated 20160317_155548 UTC on
host login.local by the MET pb2nc tool
MET_version : V5.1
MET_tool : pb2nc
dimensions:
mxstr = 16
hdr_arr_len = 3
obs_arr_len = 5
nobs = 949837 // unlimited
nhdr = 452408
variables:
character obs_qty ( nobs, mxstr )
long_name : quality flag
float obs_arr ( nobs, obs_arr_len )
long_name : array of observation values
_fill_value : -9999
columns : hdr_id gc lvl hgt ob
hdr_id_long_name : index of matching header data
gc_long_name : grib code corresponding to the observation
type
lvl_long_name : pressure level (hPa) or accumulation
interval (sec)
hgt_long_name : height in meters above sea level (msl)
ob_long_name : observation value
character hdr_typ ( nhdr, mxstr )
long_name : message type
character hdr_sid ( nhdr, mxstr )
long_name : station identification
character hdr_vld ( nhdr, mxstr )
long_name : valid time
units : YYYYMMDD_HHMMSS
float hdr_arr ( nhdr, hdr_arr_len )
long_name : array of observation station header values
_fill_value : -9999
columns : lat lon elv
lat_long_name : latitude
lat_units : degrees_north
lon_long_name : longitude
lon_units : degrees_east
elv_long_name : elevation
elv_units : meters above sea level (msl)
Thanks for all the help,
Jose
-----Original Message-----
From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
Sent: Wednesday, March 16, 2016 4:40 PM
To: Jose Garcia-Rivera
Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to
NetCDF
Hi Jose. I apologize for the delay. This was a tricky problem to
figure out, however, we were finally able to reproduce the error you
are receiving for pb2nc.
The problem is BUFRLIB being compiled with pgf90 and MET being
compiled with pgf77. They aren't talking well to each other.
BUFRLIBv10.1.0 compiles with pgf77 but later versions require pgf90.
We will plan on updating the MET Fortran code to compile with pgf90 so
that we can use newer BUFRLIB versions, but for now, to solve your
problem, I have attached BUFRLIB_v10-1-0.tar. Please install that
version of BUFRLIB using pgf77 and then recompile MET without the
"LIBS" environment variable setting?
Please let me know how that goes. We were able to get a successful
run using that solution and hope you will too.
Thanks,
Julie
On Wed, Mar 16, 2016 at 12:17 PM, Jose Garcia-Rivera via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
>
> Dear Julie,
>
> Is there anything that we can do here to sort these issues out?
>
> Best Regards,
> Jose
>
> -----Original Message-----
> From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> Sent: Tuesday, March 15, 2016 5:08 PM
> To: Jose Garcia-Rivera
> Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to
> NetCDF
>
> Hi Jose. I was not. I got the same error you did. I believe that
> the test.nc file is not in the correct format needed by point_stat,
so
> I think we need to get pb2nc working for you. It is likely a
> communication problem between the C code and the Fortran code.
>
> Julie
>
> On Tue, Mar 15, 2016 at 3:05 PM, Jose Garcia-Rivera via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> >
> > Dear Julie,
> >
> > Quick question: Were you able to run point_stat with the netCDF
file
> > that I sent yesterday?
> >
> > Thanks for the help,
> > Jose
> >
> > -----Original Message-----
> > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > Sent: Tuesday, March 15, 2016 12:17 PM
> > To: Jose Garcia-Rivera
> > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR
to
> > NetCDF
> >
> > Thank you, Jose. I'm working with co-workers to try to get these
> > issues resolved. I hope to get back to you soon.
> >
> > Julie
> >
> > On Mon, Mar 14, 2016 at 1:36 PM, Jose Garcia-Rivera via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> > >
> > > Dear Julie,
> > >
> > > I just uploaded the three files to 'garcia_data'.
> > >
> > > Thanks for the help,
> > > Jose
> > >
> > >
> > > -----Original Message-----
> > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > Sent: Monday, March 14, 2016 3:32 PM
> > > To: Jose Garcia-Rivera
> > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR
> > > to NetCDF
> > >
> > > Hi Jose.
> > >
> > > Yes, please upload your input files and configuration file
> > > (nmbprs_d01.06, test.nc, PointStatConfig_default) to our
anonymous
> > > ftp
> > site as follows:
> > > http://www.dtcenter.org/met/users/support/met_help.php
> > >
> > > Thanks!
> > >
> > > Julie
> > >
> > > On Mon, Mar 14, 2016 at 1:06 PM, Jose Garcia-Rivera via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
>
> > > >
> > > > Dear Julie,
> > > >
> > > > I got to convert my prepbufr file using a python script.
> > > > However, I have trouble running point_stat. Can I send you the
> > > > files, to see if you have the same issue?
> > > >
> > > >
> > > > This is what I got:
> > > >
> > > > [garciaj at login prepbufr_obs]$ ./point_stat nmbprs_d01.06
test.nc
> > > > PointStatConfig_default DEBUG 1: Default Config File:
> > > > /work/apps/pgi_14.10/SANDY/met-
5.1/share/met/config/PointStatCon
> > > > fi g_ de fault DEBUG 1: User Config File:
> > > > PointStatConfig_default
> > > > GSL_RNG_TYPE=mt19937
> > > > GSL_RNG_SEED=18446744073425053526 DEBUG 1: Forecast File:
> > > > nmbprs_d01.06 DEBUG 1: Observation File:
> > > > test.nc DEBUG 2:
> > > > DEBUG 2:
> > > >
----------------------------------------------------------------
> > > > --
> > > > --
> > > > --
> > > > ----------
> > > > DEBUG 2:
> > > > DEBUG 2: Reading data for SPFH/P500.
> > > > DEBUG 2: For SPFH/P500 found 1 forecast levels and 0
climatology
> > levels.
> > > > DEBUG 2:
> > > > DEBUG 2:
> > > >
----------------------------------------------------------------
> > > > --
> > > > --
> > > > --
> > > > ----------
> > > > DEBUG 2:
> > > > DEBUG 2: Reading data for TMP/P500.
> > > > DEBUG 2: For TMP/P500 found 1 forecast levels and 0
climatology
> levels.
> > > > DEBUG 2:
> > > > DEBUG 2:
> > > >
----------------------------------------------------------------
> > > > --
> > > > --
> > > > --
> > > > ----------
> > > > DEBUG 2:
> > > > DEBUG 2: Reading data for HGT/P500.
> > > > DEBUG 2: For HGT/P500 found 1 forecast levels and 0
climatology
> levels.
> > > > DEBUG 2:
> > > > DEBUG 2:
> > > >
----------------------------------------------------------------
> > > > --
> > > > --
> > > > --
> > > > ----------
> > > > DEBUG 2:
> > > > DEBUG 2: Reading data for UGRD/P500.
> > > > DEBUG 2: For UGRD/P500 found 1 forecast levels and 0
climatology
> > levels.
> > > > DEBUG 2:
> > > > DEBUG 2:
> > > >
----------------------------------------------------------------
> > > > --
> > > > --
> > > > --
> > > > ----------
> > > > DEBUG 2:
> > > > DEBUG 2: Reading data for VGRD/P500.
> > > > DEBUG 2: For VGRD/P500 found 1 forecast levels and 0
climatology
> > levels.
> > > > DEBUG 2:
> > > > DEBUG 2:
> > > >
----------------------------------------------------------------
> > > > --
> > > > --
> > > > --
> > > > ----------
> > > > DEBUG 2:
> > > > WARNING:
> > > > WARNING: process_obs_file() -> can't open observation netCDF
file:
> > > > test.nc
> > > > WARNING:
> > > > DEBUG 2:
> > > > DEBUG 2:
> > > >
----------------------------------------------------------------
> > > > --
> > > > --
> > > > --
> > > > ----------
> > > > DEBUG 2:
> > > > DEBUG 2: Processing SPFH/P500 versus SPFH/P500, for
observation
> > > > type ADPUPA, over region FULL, for interpolation method
> > > > NEAREST(1), using
> > > > 0 pairs.
> > > > DEBUG 2:
> > > > DEBUG 2:
> > > >
----------------------------------------------------------------
> > > > --
> > > > --
> > > > --
> > > > ----------
> > > > DEBUG 2:
> > > > DEBUG 2: Processing TMP/P500 versus TMP/P500, for observation
> > > > type ADPUPA, over region FULL, for interpolation method
> > > > NEAREST(1), using
> > > > 0
> > > pairs.
> > > > DEBUG 2:
> > > > DEBUG 2:
> > > >
----------------------------------------------------------------
> > > > --
> > > > --
> > > > --
> > > > ----------
> > > > DEBUG 2:
> > > > DEBUG 2: Processing HGT/P500 versus HGT/P500, for observation
> > > > type ADPUPA, over region FULL, for interpolation method
> > > > NEAREST(1), using
> > > > 0
> > > pairs.
> > > > DEBUG 2:
> > > > DEBUG 2:
> > > >
----------------------------------------------------------------
> > > > --
> > > > --
> > > > --
> > > > ----------
> > > > DEBUG 2:
> > > > DEBUG 2: Processing UGRD/P500 versus UGRD/P500, for
observation
> > > > type ADPUPA, over region FULL, for interpolation method
> > > > NEAREST(1), using
> > > > 0 pairs.
> > > > DEBUG 2:
> > > > DEBUG 2:
> > > >
----------------------------------------------------------------
> > > > --
> > > > --
> > > > --
> > > > ----------
> > > > DEBUG 2:
> > > > DEBUG 2: Processing VGRD/P500 versus VGRD/P500, for
observation
> > > > type ADPUPA, over region FULL, for interpolation method
> > > > NEAREST(1), using
> > > > 0 pairs.
> > > > DEBUG 2:
> > > > DEBUG 2:
> > > >
----------------------------------------------------------------
> > > > --
> > > > --
> > > > --
> > > > ----------
> > > > DEBUG 2:
> > > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V.stat
> > > > DEBUG 1: Output file:
> > > > ./point_stat_060000L_20150820_180000V_fho.txt
> > > > DEBUG 1: Output file:
> > > > ./point_stat_060000L_20150820_180000V_ctc.txt
> > > > DEBUG 1: Output file:
> > > > ./point_stat_060000L_20150820_180000V_cts.txt
> > > > DEBUG 1: Output file:
> > > > ./point_stat_060000L_20150820_180000V_mctc.txt
> > > > DEBUG 1: Output file:
> > > > ./point_stat_060000L_20150820_180000V_mcts.txt
> > > > DEBUG 1: Output file:
> > > > ./point_stat_060000L_20150820_180000V_cnt.txt
> > > > DEBUG 1: Output file:
> > > > ./point_stat_060000L_20150820_180000V_sl1l2.txt
> > > > DEBUG 1: Output file:
> > > > ./point_stat_060000L_20150820_180000V_sal1l2.txt
> > > > DEBUG 1: Output file:
> > > > ./point_stat_060000L_20150820_180000V_vl1l2.txt
> > > > DEBUG 1: Output file:
> > > > ./point_stat_060000L_20150820_180000V_val1l2.txt
> > > > DEBUG 1: Output file:
> > > > ./point_stat_060000L_20150820_180000V_pct.txt
> > > > DEBUG 1: Output file:
> > > > ./point_stat_060000L_20150820_180000V_pstd.txt
> > > > DEBUG 1: Output file:
> > > > ./point_stat_060000L_20150820_180000V_pjc.txt
> > > > DEBUG 1: Output file:
> > > > ./point_stat_060000L_20150820_180000V_prc.txt
> > > > DEBUG 1: Output file:
> > > > ./point_stat_060000L_20150820_180000V_mpr.txt
> > > >
> > > >
> > > > Thanks for the help,
> > > > Jose
> > > >
> > > >
> > > > -----Original Message-----
> > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > Sent: Monday, March 14, 2016 12:17 PM
> > > > To: Jose Garcia-Rivera
> > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
PREPBUFR
> > > > to NetCDF
> > > >
> > > > Hi Jose. I apologize for the delayed response. I was out of
> > > > the office on Friday. I'm going to try to figure out a
solution
> > > > and get back with you shortly.
> > > >
> > > > Julie
> > > >
> > > > On Fri, Mar 11, 2016 at 2:02 PM, Jose Garcia-Rivera via RT <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > > >
> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > >
> > > > >
> > > > > Dear Julie,
> > > > >
> > > > > Any news regarding pb2nc? We're still unable to make it
work.
> > > > >
> > > > > Best Regards,
> > > > > Jose
> > > > >
> > > > > -----Original Message-----
> > > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > > Sent: Thursday, March 10, 2016 4:20 PM
> > > > > To: Jose Garcia-Rivera
> > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
> > > > > PREPBUFR to NetCDF
> > > > >
> > > > > Hi Jose. Thank you for attaching the files.
> > > > >
> > > > > Could you please send me a list of the files in
> > > > > /work/apps/pgi_14.10/SANDY/bufrlib/lib?
> > > > >
> > > > > Thank you!
> > > > >
> > > > > Julie
> > > > >
> > > > >
> > > > > On Thu, Mar 10, 2016 at 12:20 PM, Jose Garcia-Rivera via RT
<
> > > > > met_help at ucar.edu> wrote:
> > > > >
> > > > > >
> > > > > > <URL:
> > > > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > > >
> > > > > >
> > > > > > Dear Julie,
> > > > > >
> > > > > > The administrator re-compiled MET following your
> > > > > > instructions, and says there's still trouble. He sent me
the
> > > > > > log files
> > (attached).
> > > > > > Is there any other approach that might help?
> > > > > >
> > > > > > Best Regards,
> > > > > > Jose
> > > > > >
> > > > > > -----Original Message-----
> > > > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > > > Sent: Wednesday, March 09, 2016 12:39 PM
> > > > > > To: Jose Garcia-Rivera
> > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
> > > > > > PREPBUFR to NetCDF
> > > > > >
> > > > > > Thank you, Jose! It looks like something went wrong
during
> > > > compilation.
> > > > > > I suggest recompiling MET to see if we can get this issue
> resolved.
> > > > > > NCEP's BUFRLIB is used by the pb2nc MET tool, and is a
> > > > > > required external library for pb2nc. MET is not yet
> > > > > > compatible with BUFRLIB
> > > > > version 11.0.0, so we
> > > > > > suggest getting version 10.2.3. We are working on our
online
> > > tutorial
> > > > > for
> > > > > > METv.5.1, but in the meantime, I'll point you to our
online
> > > > > > tutorial directions for installing BUFRLIB:
> > > > > >
> > > > > >
> > > > > >
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.
> > > > > > 0/
> > > > > > co
> > > > > > mp
> > > > > > ilation/req_libs.php
> > > > > >
> > > > > > It is also important to review the necessary environment
> > > > > > variables to
> > > > > set:
> > > > > >
> > > > > >
> > > > > >
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.
> > > > > > 0/
> > > > > > co
> > > > > > mp
> > > > > > ilation/configure.php
> > > > > >
> > > > > > For example,
> > > > > >
> > > > > > "Set *$MET_BUFR* to point to the main BUFR directory, or
set
> > > > > > *$MET_BUFRLIB* to point to the directory with the BUFR
> > > > > > library
> > files.
> > > > > > Because MET doesn't use any BUFR library include files,
you
> > > > > > don't need to specify *$MET_BUFRINC* ."
> > > > > >
> > > > > > Once you've installed the required libraries and set up
your
> > > > > > environment variables, you'll be ready to configure MET
> > > > > > (instructions at the bottom of the last link above) and
then
> > > > > > compile and install MET (
> > > > > >
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.
> > > > > > 0/
> > > > > > co
> > > > > > mp
> > > > > > ilation/compile.php
> > > > > > ).
> > > > > > After re-installing MET, please run "make test" again. If
> > > > > > you still encounter the same problem, please send me your
> > > > > > *config.log* file and your *make_install.log *file.
Please
> > > > > > let me know if you have any
> > > > > questions.
> > > > > >
> > > > > > Please let us know how it goes.
> > > > > >
> > > > > > Thanks,
> > > > > > Julie
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > > On Wed, Mar 9, 2016 at 10:22 AM, Jose Garcia-Rivera via RT
<
> > > > > > met_help at ucar.edu> wrote:
> > > > > >
> > > > > > >
> > > > > > > <URL:
> > > > > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > > > >
> > > > > > >
> > > > > > > Dear Julie,
> > > > > > >
> > > > > > > Attached is the test log file. It's showing the same
> > > > > > > issues on pb2nc even with the sample files.
> > > > > > >
> > > > > > > Best Regards,
> > > > > > > Jose
> > > > > > >
> > > > > > > -----Original Message-----
> > > > > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > > > > Sent: Tuesday, March 08, 2016 5:28 PM
> > > > > > > To: Jose Garcia-Rivera
> > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
> > > > > > > PREPBUFR to NetCDF
> > > > > > >
> > > > > > > Hi Jose. Thank you for uploading the files.
> > > > > > > Unfortunately, I am unable to reproduce the error you
are
> > > > > > > experiencing. I am wondering if you have successfully
> > > > > > > used pb2nc before. As a check could you please run the
> > > > > > > following in your met-5.1/
> > > directory:
> > > > > > >
> > > > > > > *make test >& make_test.log*
> > > > > > >
> > > > > > > and then send me the make_test.log file?
> > > > > > >
> > > > > > > Thanks,
> > > > > > > Julie
> > > > > > >
> > > > > > > On Tue, Mar 8, 2016 at 11:29 AM, Jose Garcia-Rivera via
RT
> > > > > > > < met_help at ucar.edu> wrote:
> > > > > > >
> > > > > > > >
> > > > > > > > <URL:
> > > > > > > >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > > > > >
> > > > > > > >
> > > > > > > > Dear Julie,
> > > > > > > >
> > > > > > > > I just put the files in 'garcia_data'. I appreciate
your
> help.
> > > > > > > >
> > > > > > > > Best Regards,
> > > > > > > > Jose
> > > > > > > >
> > > > > > > > -----Original Message-----
> > > > > > > > From: Julie Prestopnik via RT
[mailto:met_help at ucar.edu]
> > > > > > > > Sent: Tuesday, March 08, 2016 1:12 PM
> > > > > > > > To: Jose Garcia-Rivera
> > > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues
converting
> > > > > > > > PREPBUFR to NetCDF
> > > > > > > >
> > > > > > > > Hi Jose. I'm sorry to hear that you are having
problems
> > > > > > > > converting a PREPBUFR file to NetCDF.
> > > > > > > >
> > > > > > > > Please upload your input files and configuration file
to
> > > > > > > > our anonymous ftp site as follows:
> > > > > > > > http://www.dtcenter.org/met/users/support/met_help.php
> > > > > > > >
> > > > > > > > Then I can take a look and get back to you.
> > > > > > > >
> > > > > > > > Thanks,
> > > > > > > > Julie
> > > > > > > >
> > > > > > > > On Tue, Mar 8, 2016 at 11:01 AM, Jose Garcia-Rivera
via
> > > > > > > > RT < met_help at ucar.edu> wrote:
> > > > > > > >
> > > > > > > > >
> > > > > > > > > Tue Mar 08 11:01:25 2016: Request 75433 was acted
upon.
> > > > > > > > > Transaction: Ticket created by GarciaJ at imsg.com
> > > > > > > > > Queue: met_help
> > > > > > > > > Subject: Issues converting PREPBUFR to NetCDF
> > > > > > > > > Owner: Nobody
> > > > > > > > > Requestors: GarciaJ at imsg.com
> > > > > > > > > Status: new
> > > > > > > > > Ticket <URL:
> > > > > > > > >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=7543
> > > > > > > > > 3
> > > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > Dear Met Help,
> > > > > > > > >
> > > > > > > > > Trying to convert a PREPBUFR file to NetCDF.
> > > > > > > > >
> > > > > > > > > I used the default PB2NC configure file, and got the
> > following:
> > > > > > > > >
> > > > > > > > > [garciaj at login prepbufr_obs]$ ./pb2nc
> > > > > > > > > gdas1.t12z.prepbufr.nr gdas.20150820.t12z.nc
> > > > > > > > > PB2NCConfig_default DEBUG 1: Default Config
> > > > > > > > > File:
> > > > > > > > > /work/apps/pgi_14.10/met-
5.1/share/met/config/PB2NCCon
> > > > > > > > > fi g_ de fa ul t DEBUG 1: User Config File:
> > > > > > > > > PB2NCConfig_default DEBUG 1: Creating NetCDF File:
> > gdas.20150820.t12z.nc
> > > > > > > > > DEBUG 1: Processing PrepBufr File:
> > gdas1.t12z.prepbufr.nr
> > > > > > > > > DEBUG 1: Blocking PrepBufr file to:
> > > > /tmp/tmp_pb2nc_blk_32144_0
> > > > > > > > > WARNING:
> > > > > > > > > WARNING: process_pbfile() -> No PrepBufr messages to
> > > > > > > > > process in
> > > > > file:
> > > > > > > > > gdas1.t12z.prepbufr.nr
> > > > > > > > > WARNING:
> > > > > > > > > ERROR :
> > > > > > > > > ERROR : write_netcdf_hdr_data() -> No PrepBufr
> > > > > > > > > messages
> > > > retained.
> > > > > > > > > Nothing to write.
> > > > > > > > > ERROR :
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > Thanks in advance for the help, Jose M. Garcia-
Rivera,
> > > > > > > > > PhD IM Systems Group Rockville/College Park, MD This
> > > > > > > > > e-mail, including attachments, may include
> > > > > > > > > confidential and/or proprietary information, and may
> > > > > > > > > be used only by the person or entity to which it is
> > > > > > > > > addressed. If the reader of this e-mail is not the
> > > > > > > > > intended recipient or his or her authorized agent,
the
> > > > > > > > > reader is hereby notified that any dissemination,
> > > > > > > > > distribution or copying of this e-mail is
prohibited.
> > > > > > > > > If you have received this e-mail in error, please
> > > > > > > > > notify the sender by replying to this message and
> > > > > > > > > delete this
> > > > > > > > e-mail immediately.
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > --
> > > > > > > > Julie Prestopnik
> > > > > > > > National Center for Atmospheric Research Research
> > > > > > > > Applications Laboratory
> > > > > > > > Phone: 303.497.8399
> > > > > > > > Email: jpresto at ucar.edu
> > > > > > > >
> > > > > > > > This e-mail, including attachments, may include
> > > > > > > > confidential and/or proprietary information, and may
be
> > > > > > > > used only by the person or entity to which it is
> > > > > > > > addressed. If the reader of this e-mail is not the
> > > > > > > > intended recipient or his or her authorized agent, the
> > > > > > > > reader is hereby notified that any dissemination,
> > > > > > > > distribution or copying of this e-mail is prohibited.
If
> > > > > > > > you have received this e-mail in error, please notify
> > > > > > > > the sender by replying to this message and delete this
> > > > > > > e-mail immediately.
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > --
> > > > > > > Julie Prestopnik
> > > > > > > National Center for Atmospheric Research Research
> > > > > > > Applications Laboratory
> > > > > > > Phone: 303.497.8399
> > > > > > > Email: jpresto at ucar.edu
> > > > > > >
> > > > > > > This e-mail, including attachments, may include
> > > > > > > confidential and/or proprietary information, and may be
> > > > > > > used only by the person or entity to which it is
> > > > > > > addressed. If the reader of this e-mail is not the
> > > > > > > intended recipient or his or her authorized agent, the
> > > > > > > reader is hereby notified that any dissemination,
> > > > > > > distribution or copying of this e-mail is prohibited. If
> > > > > > > you have received this e-mail in error, please notify
the
> > > > > > > sender by replying to this message and delete this
> > > > > > e-mail immediately.
> > > > > > >
> > > > > > >
> > > > > >
> > > > > >
> > > > > > --
> > > > > > Julie Prestopnik
> > > > > > National Center for Atmospheric Research Research
> > > > > > Applications Laboratory
> > > > > > Phone: 303.497.8399
> > > > > > Email: jpresto at ucar.edu
> > > > > >
> > > > > > This e-mail, including attachments, may include
confidential
> > > > > > and/or proprietary information, and may be used only by
the
> > > > > > person or entity to which it is addressed. If the reader
of
> > > > > > this e-mail is not the intended recipient or his or her
> > > > > > authorized agent, the reader is hereby notified that any
> > > > > > dissemination, distribution or copying of this e-mail is
> > > > > > prohibited. If you have received this e-mail in error,
> > > > > > please notify the sender by replying to this message and
> > > > > > delete this
> > > > > e-mail immediately.
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > > > --
> > > > > Julie Prestopnik
> > > > > National Center for Atmospheric Research Research
Applications
> > > > > Laboratory
> > > > > Phone: 303.497.8399
> > > > > Email: jpresto at ucar.edu
> > > > >
> > > > > This e-mail, including attachments, may include confidential
> > > > > and/or proprietary information, and may be used only by the
> > > > > person or entity to which it is addressed. If the reader of
> > > > > this e-mail is not the intended recipient or his or her
> > > > > authorized agent, the reader is hereby notified that any
> > > > > dissemination, distribution or copying of this e-mail is
> > > > > prohibited. If you have received this e-mail in error,
please
> > > > > notify the sender by replying to this message and delete
this
> > > > e-mail immediately.
> > > > >
> > > > >
> > > > >
> > > >
> > > >
> > > > --
> > > > Julie Prestopnik
> > > > National Center for Atmospheric Research Research Applications
> > > > Laboratory
> > > > Phone: 303.497.8399
> > > > Email: jpresto at ucar.edu
> > > >
> > > > This e-mail, including attachments, may include confidential
> > > > and/or proprietary information, and may be used only by the
> > > > person or entity to which it is addressed. If the reader of
this
> > > > e-mail is not the intended recipient or his or her authorized
> > > > agent, the reader is hereby notified that any dissemination,
> > > > distribution or copying of this e-mail is prohibited. If you
> > > > have received this e-mail in error, please notify the sender
by
> > > > replying to this message and delete this
> > > e-mail immediately.
> > > >
> > > >
> > > >
> > >
> > >
> > > --
> > > Julie Prestopnik
> > > National Center for Atmospheric Research Research Applications
> > > Laboratory
> > > Phone: 303.497.8399
> > > Email: jpresto at ucar.edu
> > >
> > > This e-mail, including attachments, may include confidential
> > > and/or proprietary information, and may be used only by the
person
> > > or entity to which it is addressed. If the reader of this e-mail
> > > is not the intended recipient or his or her authorized agent,
the
> > > reader is hereby notified that any dissemination, distribution
or
> > > copying of this e-mail is prohibited. If you have received this
> > > e-mail in error, please notify the sender by replying to this
> > > message and delete this
> > e-mail immediately.
> > >
> > >
> > >
> >
> >
> > --
> > Julie Prestopnik
> > National Center for Atmospheric Research Research Applications
> > Laboratory
> > Phone: 303.497.8399
> > Email: jpresto at ucar.edu
> >
> > This e-mail, including attachments, may include confidential
and/or
> > proprietary information, and may be used only by the person or
> > entity to which it is addressed. If the reader of this e-mail is
not
> > the intended recipient or his or her authorized agent, the reader
is
> > hereby notified that any dissemination, distribution or copying of
> > this e-mail is prohibited. If you have received this e-mail in
> > error, please notify the sender by replying to this message and
> > delete this
> e-mail immediately.
> >
> >
> >
>
>
> --
> Julie Prestopnik
> National Center for Atmospheric Research Research Applications
> Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
> This e-mail, including attachments, may include confidential and/or
> proprietary information, and may be used only by the person or
entity
> to which it is addressed. If the reader of this e-mail is not the
> intended recipient or his or her authorized agent, the reader is
> hereby notified that any dissemination, distribution or copying of
> this e-mail is prohibited. If you have received this e-mail in
error,
> please notify the sender by replying to this message and delete this
e-mail immediately.
>
>
>
--
Julie Prestopnik
National Center for Atmospheric Research Research Applications
Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
This e-mail, including attachments, may include confidential and/or
proprietary information, and may be used only by the person or entity
to which it is addressed. If the reader of this e-mail is not the
intended recipient or his or her authorized agent, the reader is
hereby notified that any dissemination, distribution or copying of
this e-mail is prohibited. If you have received this e-mail in error,
please notify the sender by replying to this message and delete this
e-mail immediately.
------------------------------------------------
Subject: Issues converting PREPBUFR to NetCDF
From: John Halley Gotway
Time: Thu Mar 17 13:28:44 2016
Hello Jose,
Julie is out of the office today, but I should be able to help you.
Glad
you were able to finally get PB2NC working. That was a tricky one!
But it
helped us realize that since BUFRLIB has changed to FORTRAN 90, we
should
update the MET code which calls BUFRLIB to be compatible.
I see that you are now getting 0 matched pairs when you run Point-Stat
with
the output of PB2NC. Please try rerunning Point-Stat but use a higher
verbosity level, like "-v 3". That'll print out the following type of
counts for each of the verification tasks you've defined in the config
file:
DEBUG 3: Number of matched pairs = 312
DEBUG 3: Observations processed = 87753
DEBUG 3: Rejected: SID exclusion = 0
DEBUG 3: Rejected: GRIB code = 77648
DEBUG 3: Rejected: valid time = 0
DEBUG 3: Rejected: bad obs value = 0
DEBUG 3: Rejected: off the grid = 5
DEBUG 3: Rejected: level mismatch = 9219
DEBUG 3: Rejected: quality marker = 0
DEBUG 3: Rejected: message type = 537
DEBUG 3: Rejected: masking region = 32
DEBUG 3: Rejected: bad fcst value = 0
DEBUG 3: Rejected: duplicates = 0
In the example above, 87753 observation values were checked and the
counts
list reasons why there were not used for that task. Out of those
87753
obs, 312 of them were used for this task.
Looking at the counts from your Point-Stat run should help you figure
out
why you have 0 matched pairs.
Thanks,
John
On Thu, Mar 17, 2016 at 12:29 PM, Jose Garcia-Rivera via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
>
> Dear Julie,
>
> We got the executables to work! However, I have a couple of
> issues/questions:
>
>
>
> Issue #1 --- Not getting values after running point_stat
>
> Everything seems to run fine. I attached the configuration file. I
can
> send the three files via FTP if needed.
>
>
>
> Issue #2 --- PB2NC doesn't seem to finish the job, but it does? I
had to
> do CTRL+C, and checked the netCDF file using ncl_filedump:
>
> [garciaj at login prepbufr_obs]$ ./pb2nc prepbufr.gdas.20150820.t18z.nr
> newtest.nc PB2NCConfig_default
> DEBUG 1: Default Config File:
> /work/apps/pgi_14.10/SANDY/met-
5.1/share/met/config/PB2NCConfig_default
> DEBUG 1: User Config File: PB2NCConfig_default
> DEBUG 1: Creating NetCDF File: newtest.nc
> DEBUG 1: Processing PrepBufr File:
prepbufr.gdas.20150820.t18z.nr
> DEBUG 1: Blocking PrepBufr file to: /tmp/tmp_pb2nc_blk_17703_0
> DEBUG 2: PrepBufr Time Center: 20150820_180000
> DEBUG 2: Searching Time Window: 20150820_163000 to
20150820_193000
> DEBUG 2: Processing 685386 PrepBufr messages...
> 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85%
90% 95%
> 100%
> DEBUG 2: Total PrepBufr Messages processed = 685386
> DEBUG 2: Rejected based on message type = 0
> DEBUG 2: Rejected based on station id = 0
> DEBUG 2: Rejected based on valid time = 185145
> DEBUG 2: Rejected based on masking grid = 0
> DEBUG 2: Rejected based on masking polygon = 0
> DEBUG 2: Rejected based on elevation = 0
> DEBUG 2: Rejected based on pb report type = 0
> DEBUG 2: Rejected based on input report type = 0
> DEBUG 2: Rejected based on instrument type = 0
> DEBUG 2: Rejected based on zero observations = 47833
> DEBUG 2: Total PrepBufr Messages retained = 452408
> DEBUG 2: Total observations retained or derived = 949837
> ^C
>
>
> Checking netCDF file:
>
> [garciaj at login prepbufr_obs]$ ncl_filedump newtest.nc
> Copyright (C) 1995-2015 - All Rights Reserved
> University Corporation for Atmospheric Research
> NCAR Command Language Version 6.3.0
> The use of this software is governed by a License Agreement.
> See http://www.ncl.ucar.edu/ for more details.
>
> Variable: f
> Type: file
> filename: newtest
> path: newtest.nc
> file global attributes:
> FileOrigins : File newtest.nc generated 20160317_155548 UTC on
host
> login.local by the MET pb2nc tool
> MET_version : V5.1
> MET_tool : pb2nc
> dimensions:
> mxstr = 16
> hdr_arr_len = 3
> obs_arr_len = 5
> nobs = 949837 // unlimited
> nhdr = 452408
> variables:
> character obs_qty ( nobs, mxstr )
> long_name : quality flag
>
> float obs_arr ( nobs, obs_arr_len )
> long_name : array of observation values
> _fill_value : -9999
> columns : hdr_id gc lvl hgt ob
> hdr_id_long_name : index of matching header data
> gc_long_name : grib code corresponding to the observation
type
> lvl_long_name : pressure level (hPa) or accumulation
> interval (sec)
> hgt_long_name : height in meters above sea level
(msl)
> ob_long_name : observation value
>
> character hdr_typ ( nhdr, mxstr )
> long_name : message type
>
> character hdr_sid ( nhdr, mxstr )
> long_name : station identification
>
> character hdr_vld ( nhdr, mxstr )
> long_name : valid time
> units : YYYYMMDD_HHMMSS
>
> float hdr_arr ( nhdr, hdr_arr_len )
> long_name : array of observation station header values
> _fill_value : -9999
> columns : lat lon elv
> lat_long_name : latitude
> lat_units : degrees_north
> lon_long_name : longitude
> lon_units : degrees_east
> elv_long_name : elevation
> elv_units : meters above sea level (msl)
>
>
>
>
> Thanks for all the help,
> Jose
>
>
>
>
>
>
> -----Original Message-----
> From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> Sent: Wednesday, March 16, 2016 4:40 PM
> To: Jose Garcia-Rivera
> Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to
NetCDF
>
> Hi Jose. I apologize for the delay. This was a tricky problem to
figure
> out, however, we were finally able to reproduce the error you are
receiving
> for pb2nc.
>
> The problem is BUFRLIB being compiled with pgf90 and MET being
compiled
> with pgf77. They aren't talking well to each other. BUFRLIBv10.1.0
> compiles with pgf77 but later versions require pgf90.
>
> We will plan on updating the MET Fortran code to compile with pgf90
so
> that we can use newer BUFRLIB versions, but for now, to solve your
problem,
> I have attached BUFRLIB_v10-1-0.tar. Please install that version of
> BUFRLIB using pgf77 and then recompile MET without the "LIBS"
environment
> variable setting?
>
> Please let me know how that goes. We were able to get a successful
run
> using that solution and hope you will too.
>
> Thanks,
> Julie
>
>
> On Wed, Mar 16, 2016 at 12:17 PM, Jose Garcia-Rivera via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> >
> > Dear Julie,
> >
> > Is there anything that we can do here to sort these issues out?
> >
> > Best Regards,
> > Jose
> >
> > -----Original Message-----
> > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > Sent: Tuesday, March 15, 2016 5:08 PM
> > To: Jose Garcia-Rivera
> > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR
to
> > NetCDF
> >
> > Hi Jose. I was not. I got the same error you did. I believe
that
> > the test.nc file is not in the correct format needed by
point_stat, so
> > I think we need to get pb2nc working for you. It is likely a
> > communication problem between the C code and the Fortran code.
> >
> > Julie
> >
> > On Tue, Mar 15, 2016 at 3:05 PM, Jose Garcia-Rivera via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> > >
> > > Dear Julie,
> > >
> > > Quick question: Were you able to run point_stat with the netCDF
file
> > > that I sent yesterday?
> > >
> > > Thanks for the help,
> > > Jose
> > >
> > > -----Original Message-----
> > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > Sent: Tuesday, March 15, 2016 12:17 PM
> > > To: Jose Garcia-Rivera
> > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR
to
> > > NetCDF
> > >
> > > Thank you, Jose. I'm working with co-workers to try to get
these
> > > issues resolved. I hope to get back to you soon.
> > >
> > > Julie
> > >
> > > On Mon, Mar 14, 2016 at 1:36 PM, Jose Garcia-Rivera via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
>
> > > >
> > > > Dear Julie,
> > > >
> > > > I just uploaded the three files to 'garcia_data'.
> > > >
> > > > Thanks for the help,
> > > > Jose
> > > >
> > > >
> > > > -----Original Message-----
> > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > Sent: Monday, March 14, 2016 3:32 PM
> > > > To: Jose Garcia-Rivera
> > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
PREPBUFR
> > > > to NetCDF
> > > >
> > > > Hi Jose.
> > > >
> > > > Yes, please upload your input files and configuration file
> > > > (nmbprs_d01.06, test.nc, PointStatConfig_default) to our
anonymous
> > > > ftp
> > > site as follows:
> > > > http://www.dtcenter.org/met/users/support/met_help.php
> > > >
> > > > Thanks!
> > > >
> > > > Julie
> > > >
> > > > On Mon, Mar 14, 2016 at 1:06 PM, Jose Garcia-Rivera via RT <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > > >
> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> > > > >
> > > > > Dear Julie,
> > > > >
> > > > > I got to convert my prepbufr file using a python script.
> > > > > However, I have trouble running point_stat. Can I send you
the
> > > > > files, to see if you have the same issue?
> > > > >
> > > > >
> > > > > This is what I got:
> > > > >
> > > > > [garciaj at login prepbufr_obs]$ ./point_stat nmbprs_d01.06
test.nc
> > > > > PointStatConfig_default DEBUG 1: Default Config File:
> > > > > /work/apps/pgi_14.10/SANDY/met-
5.1/share/met/config/PointStatCon
> > > > > fi g_ de fault DEBUG 1: User Config File:
> > > > > PointStatConfig_default
> > > > > GSL_RNG_TYPE=mt19937
> > > > > GSL_RNG_SEED=18446744073425053526 DEBUG 1: Forecast File:
> > > > > nmbprs_d01.06 DEBUG 1: Observation File:
> > > > > test.nc DEBUG 2:
> > > > > DEBUG 2:
> > > > >
----------------------------------------------------------------
> > > > > --
> > > > > --
> > > > > --
> > > > > ----------
> > > > > DEBUG 2:
> > > > > DEBUG 2: Reading data for SPFH/P500.
> > > > > DEBUG 2: For SPFH/P500 found 1 forecast levels and 0
climatology
> > > levels.
> > > > > DEBUG 2:
> > > > > DEBUG 2:
> > > > >
----------------------------------------------------------------
> > > > > --
> > > > > --
> > > > > --
> > > > > ----------
> > > > > DEBUG 2:
> > > > > DEBUG 2: Reading data for TMP/P500.
> > > > > DEBUG 2: For TMP/P500 found 1 forecast levels and 0
climatology
> > levels.
> > > > > DEBUG 2:
> > > > > DEBUG 2:
> > > > >
----------------------------------------------------------------
> > > > > --
> > > > > --
> > > > > --
> > > > > ----------
> > > > > DEBUG 2:
> > > > > DEBUG 2: Reading data for HGT/P500.
> > > > > DEBUG 2: For HGT/P500 found 1 forecast levels and 0
climatology
> > levels.
> > > > > DEBUG 2:
> > > > > DEBUG 2:
> > > > >
----------------------------------------------------------------
> > > > > --
> > > > > --
> > > > > --
> > > > > ----------
> > > > > DEBUG 2:
> > > > > DEBUG 2: Reading data for UGRD/P500.
> > > > > DEBUG 2: For UGRD/P500 found 1 forecast levels and 0
climatology
> > > levels.
> > > > > DEBUG 2:
> > > > > DEBUG 2:
> > > > >
----------------------------------------------------------------
> > > > > --
> > > > > --
> > > > > --
> > > > > ----------
> > > > > DEBUG 2:
> > > > > DEBUG 2: Reading data for VGRD/P500.
> > > > > DEBUG 2: For VGRD/P500 found 1 forecast levels and 0
climatology
> > > levels.
> > > > > DEBUG 2:
> > > > > DEBUG 2:
> > > > >
----------------------------------------------------------------
> > > > > --
> > > > > --
> > > > > --
> > > > > ----------
> > > > > DEBUG 2:
> > > > > WARNING:
> > > > > WARNING: process_obs_file() -> can't open observation netCDF
file:
> > > > > test.nc
> > > > > WARNING:
> > > > > DEBUG 2:
> > > > > DEBUG 2:
> > > > >
----------------------------------------------------------------
> > > > > --
> > > > > --
> > > > > --
> > > > > ----------
> > > > > DEBUG 2:
> > > > > DEBUG 2: Processing SPFH/P500 versus SPFH/P500, for
observation
> > > > > type ADPUPA, over region FULL, for interpolation method
> > > > > NEAREST(1), using
> > > > > 0 pairs.
> > > > > DEBUG 2:
> > > > > DEBUG 2:
> > > > >
----------------------------------------------------------------
> > > > > --
> > > > > --
> > > > > --
> > > > > ----------
> > > > > DEBUG 2:
> > > > > DEBUG 2: Processing TMP/P500 versus TMP/P500, for
observation
> > > > > type ADPUPA, over region FULL, for interpolation method
> > > > > NEAREST(1), using
> > > > > 0
> > > > pairs.
> > > > > DEBUG 2:
> > > > > DEBUG 2:
> > > > >
----------------------------------------------------------------
> > > > > --
> > > > > --
> > > > > --
> > > > > ----------
> > > > > DEBUG 2:
> > > > > DEBUG 2: Processing HGT/P500 versus HGT/P500, for
observation
> > > > > type ADPUPA, over region FULL, for interpolation method
> > > > > NEAREST(1), using
> > > > > 0
> > > > pairs.
> > > > > DEBUG 2:
> > > > > DEBUG 2:
> > > > >
----------------------------------------------------------------
> > > > > --
> > > > > --
> > > > > --
> > > > > ----------
> > > > > DEBUG 2:
> > > > > DEBUG 2: Processing UGRD/P500 versus UGRD/P500, for
observation
> > > > > type ADPUPA, over region FULL, for interpolation method
> > > > > NEAREST(1), using
> > > > > 0 pairs.
> > > > > DEBUG 2:
> > > > > DEBUG 2:
> > > > >
----------------------------------------------------------------
> > > > > --
> > > > > --
> > > > > --
> > > > > ----------
> > > > > DEBUG 2:
> > > > > DEBUG 2: Processing VGRD/P500 versus VGRD/P500, for
observation
> > > > > type ADPUPA, over region FULL, for interpolation method
> > > > > NEAREST(1), using
> > > > > 0 pairs.
> > > > > DEBUG 2:
> > > > > DEBUG 2:
> > > > >
----------------------------------------------------------------
> > > > > --
> > > > > --
> > > > > --
> > > > > ----------
> > > > > DEBUG 2:
> > > > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V.stat
> > > > > DEBUG 1: Output file:
> > > > > ./point_stat_060000L_20150820_180000V_fho.txt
> > > > > DEBUG 1: Output file:
> > > > > ./point_stat_060000L_20150820_180000V_ctc.txt
> > > > > DEBUG 1: Output file:
> > > > > ./point_stat_060000L_20150820_180000V_cts.txt
> > > > > DEBUG 1: Output file:
> > > > > ./point_stat_060000L_20150820_180000V_mctc.txt
> > > > > DEBUG 1: Output file:
> > > > > ./point_stat_060000L_20150820_180000V_mcts.txt
> > > > > DEBUG 1: Output file:
> > > > > ./point_stat_060000L_20150820_180000V_cnt.txt
> > > > > DEBUG 1: Output file:
> > > > > ./point_stat_060000L_20150820_180000V_sl1l2.txt
> > > > > DEBUG 1: Output file:
> > > > > ./point_stat_060000L_20150820_180000V_sal1l2.txt
> > > > > DEBUG 1: Output file:
> > > > > ./point_stat_060000L_20150820_180000V_vl1l2.txt
> > > > > DEBUG 1: Output file:
> > > > > ./point_stat_060000L_20150820_180000V_val1l2.txt
> > > > > DEBUG 1: Output file:
> > > > > ./point_stat_060000L_20150820_180000V_pct.txt
> > > > > DEBUG 1: Output file:
> > > > > ./point_stat_060000L_20150820_180000V_pstd.txt
> > > > > DEBUG 1: Output file:
> > > > > ./point_stat_060000L_20150820_180000V_pjc.txt
> > > > > DEBUG 1: Output file:
> > > > > ./point_stat_060000L_20150820_180000V_prc.txt
> > > > > DEBUG 1: Output file:
> > > > > ./point_stat_060000L_20150820_180000V_mpr.txt
> > > > >
> > > > >
> > > > > Thanks for the help,
> > > > > Jose
> > > > >
> > > > >
> > > > > -----Original Message-----
> > > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > > Sent: Monday, March 14, 2016 12:17 PM
> > > > > To: Jose Garcia-Rivera
> > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
PREPBUFR
> > > > > to NetCDF
> > > > >
> > > > > Hi Jose. I apologize for the delayed response. I was out
of
> > > > > the office on Friday. I'm going to try to figure out a
solution
> > > > > and get back with you shortly.
> > > > >
> > > > > Julie
> > > > >
> > > > > On Fri, Mar 11, 2016 at 2:02 PM, Jose Garcia-Rivera via RT <
> > > > > met_help at ucar.edu> wrote:
> > > > >
> > > > > >
> > > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > > >
> > > > > >
> > > > > > Dear Julie,
> > > > > >
> > > > > > Any news regarding pb2nc? We're still unable to make it
work.
> > > > > >
> > > > > > Best Regards,
> > > > > > Jose
> > > > > >
> > > > > > -----Original Message-----
> > > > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > > > Sent: Thursday, March 10, 2016 4:20 PM
> > > > > > To: Jose Garcia-Rivera
> > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
> > > > > > PREPBUFR to NetCDF
> > > > > >
> > > > > > Hi Jose. Thank you for attaching the files.
> > > > > >
> > > > > > Could you please send me a list of the files in
> > > > > > /work/apps/pgi_14.10/SANDY/bufrlib/lib?
> > > > > >
> > > > > > Thank you!
> > > > > >
> > > > > > Julie
> > > > > >
> > > > > >
> > > > > > On Thu, Mar 10, 2016 at 12:20 PM, Jose Garcia-Rivera via
RT <
> > > > > > met_help at ucar.edu> wrote:
> > > > > >
> > > > > > >
> > > > > > > <URL:
> > > > > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > > > >
> > > > > > >
> > > > > > > Dear Julie,
> > > > > > >
> > > > > > > The administrator re-compiled MET following your
> > > > > > > instructions, and says there's still trouble. He sent me
the
> > > > > > > log files
> > > (attached).
> > > > > > > Is there any other approach that might help?
> > > > > > >
> > > > > > > Best Regards,
> > > > > > > Jose
> > > > > > >
> > > > > > > -----Original Message-----
> > > > > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > > > > Sent: Wednesday, March 09, 2016 12:39 PM
> > > > > > > To: Jose Garcia-Rivera
> > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
> > > > > > > PREPBUFR to NetCDF
> > > > > > >
> > > > > > > Thank you, Jose! It looks like something went wrong
during
> > > > > compilation.
> > > > > > > I suggest recompiling MET to see if we can get this
issue
> > resolved.
> > > > > > > NCEP's BUFRLIB is used by the pb2nc MET tool, and is a
> > > > > > > required external library for pb2nc. MET is not yet
> > > > > > > compatible with BUFRLIB
> > > > > > version 11.0.0, so we
> > > > > > > suggest getting version 10.2.3. We are working on our
online
> > > > tutorial
> > > > > > for
> > > > > > > METv.5.1, but in the meantime, I'll point you to our
online
> > > > > > > tutorial directions for installing BUFRLIB:
> > > > > > >
> > > > > > >
> > > > > > >
> http://www.dtcenter.org/met/users/support/online_tutorial/METv5.
> > > > > > > 0/
> > > > > > > co
> > > > > > > mp
> > > > > > > ilation/req_libs.php
> > > > > > >
> > > > > > > It is also important to review the necessary environment
> > > > > > > variables to
> > > > > > set:
> > > > > > >
> > > > > > >
> > > > > > >
> http://www.dtcenter.org/met/users/support/online_tutorial/METv5.
> > > > > > > 0/
> > > > > > > co
> > > > > > > mp
> > > > > > > ilation/configure.php
> > > > > > >
> > > > > > > For example,
> > > > > > >
> > > > > > > "Set *$MET_BUFR* to point to the main BUFR directory, or
set
> > > > > > > *$MET_BUFRLIB* to point to the directory with the BUFR
> > > > > > > library
> > > files.
> > > > > > > Because MET doesn't use any BUFR library include files,
you
> > > > > > > don't need to specify *$MET_BUFRINC* ."
> > > > > > >
> > > > > > > Once you've installed the required libraries and set up
your
> > > > > > > environment variables, you'll be ready to configure MET
> > > > > > > (instructions at the bottom of the last link above) and
then
> > > > > > > compile and install MET (
> > > > > > >
> http://www.dtcenter.org/met/users/support/online_tutorial/METv5.
> > > > > > > 0/
> > > > > > > co
> > > > > > > mp
> > > > > > > ilation/compile.php
> > > > > > > ).
> > > > > > > After re-installing MET, please run "make test" again.
If
> > > > > > > you still encounter the same problem, please send me
your
> > > > > > > *config.log* file and your *make_install.log *file.
Please
> > > > > > > let me know if you have any
> > > > > > questions.
> > > > > > >
> > > > > > > Please let us know how it goes.
> > > > > > >
> > > > > > > Thanks,
> > > > > > > Julie
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > On Wed, Mar 9, 2016 at 10:22 AM, Jose Garcia-Rivera via
RT <
> > > > > > > met_help at ucar.edu> wrote:
> > > > > > >
> > > > > > > >
> > > > > > > > <URL:
> > > > > > > >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > > > > >
> > > > > > > >
> > > > > > > > Dear Julie,
> > > > > > > >
> > > > > > > > Attached is the test log file. It's showing the same
> > > > > > > > issues on pb2nc even with the sample files.
> > > > > > > >
> > > > > > > > Best Regards,
> > > > > > > > Jose
> > > > > > > >
> > > > > > > > -----Original Message-----
> > > > > > > > From: Julie Prestopnik via RT
[mailto:met_help at ucar.edu]
> > > > > > > > Sent: Tuesday, March 08, 2016 5:28 PM
> > > > > > > > To: Jose Garcia-Rivera
> > > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues
converting
> > > > > > > > PREPBUFR to NetCDF
> > > > > > > >
> > > > > > > > Hi Jose. Thank you for uploading the files.
> > > > > > > > Unfortunately, I am unable to reproduce the error you
are
> > > > > > > > experiencing. I am wondering if you have successfully
> > > > > > > > used pb2nc before. As a check could you please run
the
> > > > > > > > following in your met-5.1/
> > > > directory:
> > > > > > > >
> > > > > > > > *make test >& make_test.log*
> > > > > > > >
> > > > > > > > and then send me the make_test.log file?
> > > > > > > >
> > > > > > > > Thanks,
> > > > > > > > Julie
> > > > > > > >
> > > > > > > > On Tue, Mar 8, 2016 at 11:29 AM, Jose Garcia-Rivera
via RT
> > > > > > > > < met_help at ucar.edu> wrote:
> > > > > > > >
> > > > > > > > >
> > > > > > > > > <URL:
> > > > > > > > >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > > > > > >
> > > > > > > > >
> > > > > > > > > Dear Julie,
> > > > > > > > >
> > > > > > > > > I just put the files in 'garcia_data'. I appreciate
your
> > help.
> > > > > > > > >
> > > > > > > > > Best Regards,
> > > > > > > > > Jose
> > > > > > > > >
> > > > > > > > > -----Original Message-----
> > > > > > > > > From: Julie Prestopnik via RT
[mailto:met_help at ucar.edu]
> > > > > > > > > Sent: Tuesday, March 08, 2016 1:12 PM
> > > > > > > > > To: Jose Garcia-Rivera
> > > > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues
converting
> > > > > > > > > PREPBUFR to NetCDF
> > > > > > > > >
> > > > > > > > > Hi Jose. I'm sorry to hear that you are having
problems
> > > > > > > > > converting a PREPBUFR file to NetCDF.
> > > > > > > > >
> > > > > > > > > Please upload your input files and configuration
file to
> > > > > > > > > our anonymous ftp site as follows:
> > > > > > > > >
http://www.dtcenter.org/met/users/support/met_help.php
> > > > > > > > >
> > > > > > > > > Then I can take a look and get back to you.
> > > > > > > > >
> > > > > > > > > Thanks,
> > > > > > > > > Julie
> > > > > > > > >
> > > > > > > > > On Tue, Mar 8, 2016 at 11:01 AM, Jose Garcia-Rivera
via
> > > > > > > > > RT < met_help at ucar.edu> wrote:
> > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > Tue Mar 08 11:01:25 2016: Request 75433 was acted
upon.
> > > > > > > > > > Transaction: Ticket created by GarciaJ at imsg.com
> > > > > > > > > > Queue: met_help
> > > > > > > > > > Subject: Issues converting PREPBUFR to NetCDF
> > > > > > > > > > Owner: Nobody
> > > > > > > > > > Requestors: GarciaJ at imsg.com
> > > > > > > > > > Status: new
> > > > > > > > > > Ticket <URL:
> > > > > > > > > >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=7543
> > > > > > > > > > 3
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > Dear Met Help,
> > > > > > > > > >
> > > > > > > > > > Trying to convert a PREPBUFR file to NetCDF.
> > > > > > > > > >
> > > > > > > > > > I used the default PB2NC configure file, and got
the
> > > following:
> > > > > > > > > >
> > > > > > > > > > [garciaj at login prepbufr_obs]$ ./pb2nc
> > > > > > > > > > gdas1.t12z.prepbufr.nr gdas.20150820.t12z.nc
> > > > > > > > > > PB2NCConfig_default DEBUG 1: Default Config
> > > > > > > > > > File:
> > > > > > > > > > /work/apps/pgi_14.10/met-
5.1/share/met/config/PB2NCCon
> > > > > > > > > > fi g_ de fa ul t DEBUG 1: User Config File:
> > > > > > > > > > PB2NCConfig_default DEBUG 1: Creating NetCDF File:
> > > gdas.20150820.t12z.nc
> > > > > > > > > > DEBUG 1: Processing PrepBufr File:
> > > gdas1.t12z.prepbufr.nr
> > > > > > > > > > DEBUG 1: Blocking PrepBufr file to:
> > > > > /tmp/tmp_pb2nc_blk_32144_0
> > > > > > > > > > WARNING:
> > > > > > > > > > WARNING: process_pbfile() -> No PrepBufr messages
to
> > > > > > > > > > process in
> > > > > > file:
> > > > > > > > > > gdas1.t12z.prepbufr.nr
> > > > > > > > > > WARNING:
> > > > > > > > > > ERROR :
> > > > > > > > > > ERROR : write_netcdf_hdr_data() -> No PrepBufr
> > > > > > > > > > messages
> > > > > retained.
> > > > > > > > > > Nothing to write.
> > > > > > > > > > ERROR :
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > Thanks in advance for the help, Jose M. Garcia-
Rivera,
> > > > > > > > > > PhD IM Systems Group Rockville/College Park, MD
This
> > > > > > > > > > e-mail, including attachments, may include
> > > > > > > > > > confidential and/or proprietary information, and
may
> > > > > > > > > > be used only by the person or entity to which it
is
> > > > > > > > > > addressed. If the reader of this e-mail is not the
> > > > > > > > > > intended recipient or his or her authorized agent,
the
> > > > > > > > > > reader is hereby notified that any dissemination,
> > > > > > > > > > distribution or copying of this e-mail is
prohibited.
> > > > > > > > > > If you have received this e-mail in error, please
> > > > > > > > > > notify the sender by replying to this message and
> > > > > > > > > > delete this
> > > > > > > > > e-mail immediately.
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > --
> > > > > > > > > Julie Prestopnik
> > > > > > > > > National Center for Atmospheric Research Research
> > > > > > > > > Applications Laboratory
> > > > > > > > > Phone: 303.497.8399
> > > > > > > > > Email: jpresto at ucar.edu
> > > > > > > > >
> > > > > > > > > This e-mail, including attachments, may include
> > > > > > > > > confidential and/or proprietary information, and may
be
> > > > > > > > > used only by the person or entity to which it is
> > > > > > > > > addressed. If the reader of this e-mail is not the
> > > > > > > > > intended recipient or his or her authorized agent,
the
> > > > > > > > > reader is hereby notified that any dissemination,
> > > > > > > > > distribution or copying of this e-mail is
prohibited. If
> > > > > > > > > you have received this e-mail in error, please
notify
> > > > > > > > > the sender by replying to this message and delete
this
> > > > > > > > e-mail immediately.
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > --
> > > > > > > > Julie Prestopnik
> > > > > > > > National Center for Atmospheric Research Research
> > > > > > > > Applications Laboratory
> > > > > > > > Phone: 303.497.8399
> > > > > > > > Email: jpresto at ucar.edu
> > > > > > > >
> > > > > > > > This e-mail, including attachments, may include
> > > > > > > > confidential and/or proprietary information, and may
be
> > > > > > > > used only by the person or entity to which it is
> > > > > > > > addressed. If the reader of this e-mail is not the
> > > > > > > > intended recipient or his or her authorized agent, the
> > > > > > > > reader is hereby notified that any dissemination,
> > > > > > > > distribution or copying of this e-mail is prohibited.
If
> > > > > > > > you have received this e-mail in error, please notify
the
> > > > > > > > sender by replying to this message and delete this
> > > > > > > e-mail immediately.
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > --
> > > > > > > Julie Prestopnik
> > > > > > > National Center for Atmospheric Research Research
> > > > > > > Applications Laboratory
> > > > > > > Phone: 303.497.8399
> > > > > > > Email: jpresto at ucar.edu
> > > > > > >
> > > > > > > This e-mail, including attachments, may include
confidential
> > > > > > > and/or proprietary information, and may be used only by
the
> > > > > > > person or entity to which it is addressed. If the reader
of
> > > > > > > this e-mail is not the intended recipient or his or her
> > > > > > > authorized agent, the reader is hereby notified that any
> > > > > > > dissemination, distribution or copying of this e-mail is
> > > > > > > prohibited. If you have received this e-mail in error,
> > > > > > > please notify the sender by replying to this message and
> > > > > > > delete this
> > > > > > e-mail immediately.
> > > > > > >
> > > > > > >
> > > > > >
> > > > > >
> > > > > > --
> > > > > > Julie Prestopnik
> > > > > > National Center for Atmospheric Research Research
Applications
> > > > > > Laboratory
> > > > > > Phone: 303.497.8399
> > > > > > Email: jpresto at ucar.edu
> > > > > >
> > > > > > This e-mail, including attachments, may include
confidential
> > > > > > and/or proprietary information, and may be used only by
the
> > > > > > person or entity to which it is addressed. If the reader
of
> > > > > > this e-mail is not the intended recipient or his or her
> > > > > > authorized agent, the reader is hereby notified that any
> > > > > > dissemination, distribution or copying of this e-mail is
> > > > > > prohibited. If you have received this e-mail in error,
please
> > > > > > notify the sender by replying to this message and delete
this
> > > > > e-mail immediately.
> > > > > >
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > > > --
> > > > > Julie Prestopnik
> > > > > National Center for Atmospheric Research Research
Applications
> > > > > Laboratory
> > > > > Phone: 303.497.8399
> > > > > Email: jpresto at ucar.edu
> > > > >
> > > > > This e-mail, including attachments, may include confidential
> > > > > and/or proprietary information, and may be used only by the
> > > > > person or entity to which it is addressed. If the reader of
this
> > > > > e-mail is not the intended recipient or his or her
authorized
> > > > > agent, the reader is hereby notified that any dissemination,
> > > > > distribution or copying of this e-mail is prohibited. If you
> > > > > have received this e-mail in error, please notify the sender
by
> > > > > replying to this message and delete this
> > > > e-mail immediately.
> > > > >
> > > > >
> > > > >
> > > >
> > > >
> > > > --
> > > > Julie Prestopnik
> > > > National Center for Atmospheric Research Research Applications
> > > > Laboratory
> > > > Phone: 303.497.8399
> > > > Email: jpresto at ucar.edu
> > > >
> > > > This e-mail, including attachments, may include confidential
> > > > and/or proprietary information, and may be used only by the
person
> > > > or entity to which it is addressed. If the reader of this e-
mail
> > > > is not the intended recipient or his or her authorized agent,
the
> > > > reader is hereby notified that any dissemination, distribution
or
> > > > copying of this e-mail is prohibited. If you have received
this
> > > > e-mail in error, please notify the sender by replying to this
> > > > message and delete this
> > > e-mail immediately.
> > > >
> > > >
> > > >
> > >
> > >
> > > --
> > > Julie Prestopnik
> > > National Center for Atmospheric Research Research Applications
> > > Laboratory
> > > Phone: 303.497.8399
> > > Email: jpresto at ucar.edu
> > >
> > > This e-mail, including attachments, may include confidential
and/or
> > > proprietary information, and may be used only by the person or
> > > entity to which it is addressed. If the reader of this e-mail is
not
> > > the intended recipient or his or her authorized agent, the
reader is
> > > hereby notified that any dissemination, distribution or copying
of
> > > this e-mail is prohibited. If you have received this e-mail in
> > > error, please notify the sender by replying to this message and
> > > delete this
> > e-mail immediately.
> > >
> > >
> > >
> >
> >
> > --
> > Julie Prestopnik
> > National Center for Atmospheric Research Research Applications
> > Laboratory
> > Phone: 303.497.8399
> > Email: jpresto at ucar.edu
> >
> > This e-mail, including attachments, may include confidential
and/or
> > proprietary information, and may be used only by the person or
entity
> > to which it is addressed. If the reader of this e-mail is not the
> > intended recipient or his or her authorized agent, the reader is
> > hereby notified that any dissemination, distribution or copying of
> > this e-mail is prohibited. If you have received this e-mail in
error,
> > please notify the sender by replying to this message and delete
this
> e-mail immediately.
> >
> >
> >
>
>
> --
> Julie Prestopnik
> National Center for Atmospheric Research Research Applications
Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
> This e-mail, including attachments, may include confidential and/or
> proprietary information, and may be used only by the person or
entity to
> which it is addressed. If the reader of this e-mail is not the
intended
> recipient or his or her authorized agent, the reader is hereby
notified
> that any dissemination, distribution or copying of this e-mail is
> prohibited. If you have received this e-mail in error, please notify
the
> sender by replying to this message and delete this e-mail
immediately.
>
>
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to NetCDF
From: Jose Garcia-Rivera
Time: Thu Mar 17 14:39:30 2016
Dear John,
It's great to hear from you again! Julie has been of great help. We
highly appreciate all the help coming from your team.
I followed your recommendation, and got the following:
[garciaj at login prepbufr_obs]$ ./point_stat -v 3 nmbprs_d01.06
newtest.nc PointStatConfig_default
DEBUG 1: Default Config File: /work/apps/pgi_14.10/SANDY/met-
5.1/share/met/config/PointStatConfig_default
DEBUG 1: User Config File: PointStatConfig_default
GSL_RNG_TYPE=mt19937
GSL_RNG_SEED=1041230678
DEBUG 1: Forecast File: nmbprs_d01.06
DEBUG 1: Observation File: newtest.nc
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Reading data for SPFH/P500.
DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found range match for
VarInfo "SPFH/P500" in GRIB record 134 of GRIB file "nmbprs_d01.06".
DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found 1 GRIB records
matching VarInfo "SPFH/P500" in GRIB file "nmbprs_d01.06".
DEBUG 3: Use the matching forecast and observation grids.
DEBUG 3: Grid Definition: Projection: Lambert Conformal Nx: 400 Ny:
400 Lat_LL: 33.302 Lon_LL: 84.951 Lon_orient: 77.459 Alpha: 3781.822
Cone: 0.629 Bx: 210.6765 By: 2557.3266
DEBUG 2: For SPFH/P500 found 1 forecast levels and 0 climatology
levels.
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Reading data for TMP/P500.
DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found range match for
VarInfo "TMP/P500" in GRIB record 131 of GRIB file "nmbprs_d01.06".
DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found 1 GRIB records
matching VarInfo "TMP/P500" in GRIB file "nmbprs_d01.06".
DEBUG 2: For TMP/P500 found 1 forecast levels and 0 climatology
levels.
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Reading data for HGT/P500.
DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found range match for
VarInfo "HGT/P500" in GRIB record 130 of GRIB file "nmbprs_d01.06".
DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found 1 GRIB records
matching VarInfo "HGT/P500" in GRIB file "nmbprs_d01.06".
DEBUG 2: For HGT/P500 found 1 forecast levels and 0 climatology
levels.
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Reading data for UGRD/P500.
DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found range match for
VarInfo "UGRD/P500" in GRIB record 137 of GRIB file "nmbprs_d01.06".
DEBUG 3: MetGrib1DataFile::rotate_winds() -> Have U-wind record,
reading V-wind record.
DEBUG 3: MetGrib1DataFile::data_plane_scalar() -> Found exact match
for VarInfo "UGRD/P500" in GRIB record 138 of GRIB file
"nmbprs_d01.06".
DEBUG 3: Rotating U and V wind components from grid-relative to earth-
relative.
DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found 1 GRIB records
matching VarInfo "UGRD/P500" in GRIB file "nmbprs_d01.06".
DEBUG 2: For UGRD/P500 found 1 forecast levels and 0 climatology
levels.
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Reading data for VGRD/P500.
DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found range match for
VarInfo "VGRD/P500" in GRIB record 138 of GRIB file "nmbprs_d01.06".
DEBUG 3: MetGrib1DataFile::rotate_winds() -> Have V-wind record,
reading U-wind record.
DEBUG 3: MetGrib1DataFile::data_plane_scalar() -> Found exact match
for VarInfo "VGRD/P500" in GRIB record 137 of GRIB file
"nmbprs_d01.06".
DEBUG 3: Rotating U and V wind components from grid-relative to earth-
relative.
DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found 1 GRIB records
matching VarInfo "VGRD/P500" in GRIB file "nmbprs_d01.06".
DEBUG 2: For VGRD/P500 found 1 forecast levels and 0 climatology
levels.
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Searching 949837 observations from 452408 messages.
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Processing SPFH/P500 versus SPFH/P500, for observation type
ADPUPA, over region FULL, for interpolation method NEAREST(1), using 0
pairs.
DEBUG 3: Number of matched pairs = 0
DEBUG 3: Observations processed = 949837
DEBUG 3: Rejected: SID exclusion = 0
DEBUG 3: Rejected: GRIB code = 947898
DEBUG 3: Rejected: valid time = 1416
DEBUG 3: Rejected: bad obs value = 0
DEBUG 3: Rejected: off the grid = 523
DEBUG 3: Rejected: level mismatch = 0
DEBUG 3: Rejected: quality marker = 0
DEBUG 3: Rejected: message type = 0
DEBUG 3: Rejected: masking region = 0
DEBUG 3: Rejected: bad fcst value = 0
DEBUG 3: Rejected: duplicates = 0
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Processing TMP/P500 versus TMP/P500, for observation type
ADPUPA, over region FULL, for interpolation method NEAREST(1), using 0
pairs.
DEBUG 3: Number of matched pairs = 0
DEBUG 3: Observations processed = 949837
DEBUG 3: Rejected: SID exclusion = 0
DEBUG 3: Rejected: GRIB code = 943848
DEBUG 3: Rejected: valid time = 4191
DEBUG 3: Rejected: bad obs value = 0
DEBUG 3: Rejected: off the grid = 1798
DEBUG 3: Rejected: level mismatch = 0
DEBUG 3: Rejected: quality marker = 0
DEBUG 3: Rejected: message type = 0
DEBUG 3: Rejected: masking region = 0
DEBUG 3: Rejected: bad fcst value = 0
DEBUG 3: Rejected: duplicates = 0
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Processing HGT/P500 versus HGT/P500, for observation type
ADPUPA, over region FULL, for interpolation method NEAREST(1), using 0
pairs.
DEBUG 3: Number of matched pairs = 0
DEBUG 3: Observations processed = 949837
DEBUG 3: Rejected: SID exclusion = 0
DEBUG 3: Rejected: GRIB code = 606744
DEBUG 3: Rejected: valid time = 319085
DEBUG 3: Rejected: bad obs value = 0
DEBUG 3: Rejected: off the grid = 23610
DEBUG 3: Rejected: level mismatch = 395
DEBUG 3: Rejected: quality marker = 0
DEBUG 3: Rejected: message type = 3
DEBUG 3: Rejected: masking region = 0
DEBUG 3: Rejected: bad fcst value = 0
DEBUG 3: Rejected: duplicates = 0
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Processing UGRD/P500 versus UGRD/P500, for observation type
ADPUPA, over region FULL, for interpolation method NEAREST(1), using 0
pairs.
DEBUG 3: Number of matched pairs = 0
DEBUG 3: Observations processed = 949837
DEBUG 3: Rejected: SID exclusion = 0
DEBUG 3: Rejected: GRIB code = 650429
DEBUG 3: Rejected: valid time = 277745
DEBUG 3: Rejected: bad obs value = 0
DEBUG 3: Rejected: off the grid = 21341
DEBUG 3: Rejected: level mismatch = 319
DEBUG 3: Rejected: quality marker = 0
DEBUG 3: Rejected: message type = 3
DEBUG 3: Rejected: masking region = 0
DEBUG 3: Rejected: bad fcst value = 0
DEBUG 3: Rejected: duplicates = 0
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Processing VGRD/P500 versus VGRD/P500, for observation type
ADPUPA, over region FULL, for interpolation method NEAREST(1), using 0
pairs.
DEBUG 3: Number of matched pairs = 0
DEBUG 3: Observations processed = 949837
DEBUG 3: Rejected: SID exclusion = 0
DEBUG 3: Rejected: GRIB code = 650429
DEBUG 3: Rejected: valid time = 277745
DEBUG 3: Rejected: bad obs value = 0
DEBUG 3: Rejected: off the grid = 21341
DEBUG 3: Rejected: level mismatch = 319
DEBUG 3: Rejected: quality marker = 0
DEBUG 3: Rejected: message type = 3
DEBUG 3: Rejected: masking region = 0
DEBUG 3: Rejected: bad fcst value = 0
DEBUG 3: Rejected: duplicates = 0
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V.stat
DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_fho.txt
DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_ctc.txt
DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_cts.txt
DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_mctc.txt
DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_mcts.txt
DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_cnt.txt
DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_sl1l2.txt
DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_sal1l2.txt
DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_vl1l2.txt
DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_val1l2.txt
DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_pct.txt
DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_pstd.txt
DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_pjc.txt
DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_prc.txt
DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_mpr.txt
Best Regards,
Jose
-----Original Message-----
From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
Sent: Thursday, March 17, 2016 3:29 PM
To: Jose Garcia-Rivera
Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to
NetCDF
Hello Jose,
Julie is out of the office today, but I should be able to help you.
Glad you were able to finally get PB2NC working. That was a tricky
one! But it helped us realize that since BUFRLIB has changed to
FORTRAN 90, we should update the MET code which calls BUFRLIB to be
compatible.
I see that you are now getting 0 matched pairs when you run Point-Stat
with the output of PB2NC. Please try rerunning Point-Stat but use a
higher verbosity level, like "-v 3". That'll print out the following
type of counts for each of the verification tasks you've defined in
the config file:
DEBUG 3: Number of matched pairs = 312
DEBUG 3: Observations processed = 87753
DEBUG 3: Rejected: SID exclusion = 0
DEBUG 3: Rejected: GRIB code = 77648
DEBUG 3: Rejected: valid time = 0
DEBUG 3: Rejected: bad obs value = 0
DEBUG 3: Rejected: off the grid = 5
DEBUG 3: Rejected: level mismatch = 9219 DEBUG 3: Rejected: quality
marker = 0
DEBUG 3: Rejected: message type = 537
DEBUG 3: Rejected: masking region = 32
DEBUG 3: Rejected: bad fcst value = 0
DEBUG 3: Rejected: duplicates = 0
In the example above, 87753 observation values were checked and the
counts list reasons why there were not used for that task. Out of
those 87753 obs, 312 of them were used for this task.
Looking at the counts from your Point-Stat run should help you figure
out why you have 0 matched pairs.
Thanks,
John
On Thu, Mar 17, 2016 at 12:29 PM, Jose Garcia-Rivera via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
>
> Dear Julie,
>
> We got the executables to work! However, I have a couple of
> issues/questions:
>
>
>
> Issue #1 --- Not getting values after running point_stat
>
> Everything seems to run fine. I attached the configuration file. I
can
> send the three files via FTP if needed.
>
>
>
> Issue #2 --- PB2NC doesn't seem to finish the job, but it does? I
had
> to do CTRL+C, and checked the netCDF file using ncl_filedump:
>
> [garciaj at login prepbufr_obs]$ ./pb2nc prepbufr.gdas.20150820.t18z.nr
> newtest.nc PB2NCConfig_default DEBUG 1: Default Config File:
> /work/apps/pgi_14.10/SANDY/met-
5.1/share/met/config/PB2NCConfig_defaul
> t DEBUG 1: User Config File: PB2NCConfig_default
> DEBUG 1: Creating NetCDF File: newtest.nc
> DEBUG 1: Processing PrepBufr File:
prepbufr.gdas.20150820.t18z.nr
> DEBUG 1: Blocking PrepBufr file to: /tmp/tmp_pb2nc_blk_17703_0
> DEBUG 2: PrepBufr Time Center: 20150820_180000
> DEBUG 2: Searching Time Window: 20150820_163000 to
20150820_193000
> DEBUG 2: Processing 685386 PrepBufr messages...
> 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85%
90%
> 95% 100%
> DEBUG 2: Total PrepBufr Messages processed = 685386
> DEBUG 2: Rejected based on message type = 0
> DEBUG 2: Rejected based on station id = 0
> DEBUG 2: Rejected based on valid time = 185145
> DEBUG 2: Rejected based on masking grid = 0
> DEBUG 2: Rejected based on masking polygon = 0
> DEBUG 2: Rejected based on elevation = 0
> DEBUG 2: Rejected based on pb report type = 0
> DEBUG 2: Rejected based on input report type = 0
> DEBUG 2: Rejected based on instrument type = 0
> DEBUG 2: Rejected based on zero observations = 47833
> DEBUG 2: Total PrepBufr Messages retained = 452408
> DEBUG 2: Total observations retained or derived = 949837 ^C
>
>
> Checking netCDF file:
>
> [garciaj at login prepbufr_obs]$ ncl_filedump newtest.nc Copyright (C)
> 1995-2015 - All Rights Reserved University Corporation for
> Atmospheric Research NCAR Command Language Version 6.3.0 The use
of
> this software is governed by a License Agreement.
> See http://www.ncl.ucar.edu/ for more details.
>
> Variable: f
> Type: file
> filename: newtest
> path: newtest.nc
> file global attributes:
> FileOrigins : File newtest.nc generated 20160317_155548 UTC on
> host login.local by the MET pb2nc tool
> MET_version : V5.1
> MET_tool : pb2nc
> dimensions:
> mxstr = 16
> hdr_arr_len = 3
> obs_arr_len = 5
> nobs = 949837 // unlimited
> nhdr = 452408
> variables:
> character obs_qty ( nobs, mxstr )
> long_name : quality flag
>
> float obs_arr ( nobs, obs_arr_len )
> long_name : array of observation values
> _fill_value : -9999
> columns : hdr_id gc lvl hgt ob
> hdr_id_long_name : index of matching header data
> gc_long_name : grib code corresponding to the observation
type
> lvl_long_name : pressure level (hPa) or accumulation
> interval (sec)
> hgt_long_name : height in meters above sea level
(msl)
> ob_long_name : observation value
>
> character hdr_typ ( nhdr, mxstr )
> long_name : message type
>
> character hdr_sid ( nhdr, mxstr )
> long_name : station identification
>
> character hdr_vld ( nhdr, mxstr )
> long_name : valid time
> units : YYYYMMDD_HHMMSS
>
> float hdr_arr ( nhdr, hdr_arr_len )
> long_name : array of observation station header values
> _fill_value : -9999
> columns : lat lon elv
> lat_long_name : latitude
> lat_units : degrees_north
> lon_long_name : longitude
> lon_units : degrees_east
> elv_long_name : elevation
> elv_units : meters above sea level (msl)
>
>
>
>
> Thanks for all the help,
> Jose
>
>
>
>
>
>
> -----Original Message-----
> From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> Sent: Wednesday, March 16, 2016 4:40 PM
> To: Jose Garcia-Rivera
> Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to
> NetCDF
>
> Hi Jose. I apologize for the delay. This was a tricky problem to
> figure out, however, we were finally able to reproduce the error you
> are receiving for pb2nc.
>
> The problem is BUFRLIB being compiled with pgf90 and MET being
> compiled with pgf77. They aren't talking well to each other.
> BUFRLIBv10.1.0 compiles with pgf77 but later versions require pgf90.
>
> We will plan on updating the MET Fortran code to compile with pgf90
so
> that we can use newer BUFRLIB versions, but for now, to solve your
> problem, I have attached BUFRLIB_v10-1-0.tar. Please install that
> version of BUFRLIB using pgf77 and then recompile MET without the
> "LIBS" environment variable setting?
>
> Please let me know how that goes. We were able to get a successful
> run using that solution and hope you will too.
>
> Thanks,
> Julie
>
>
> On Wed, Mar 16, 2016 at 12:17 PM, Jose Garcia-Rivera via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> >
> > Dear Julie,
> >
> > Is there anything that we can do here to sort these issues out?
> >
> > Best Regards,
> > Jose
> >
> > -----Original Message-----
> > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > Sent: Tuesday, March 15, 2016 5:08 PM
> > To: Jose Garcia-Rivera
> > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR
to
> > NetCDF
> >
> > Hi Jose. I was not. I got the same error you did. I believe
that
> > the test.nc file is not in the correct format needed by
point_stat,
> > so I think we need to get pb2nc working for you. It is likely a
> > communication problem between the C code and the Fortran code.
> >
> > Julie
> >
> > On Tue, Mar 15, 2016 at 3:05 PM, Jose Garcia-Rivera via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> > >
> > > Dear Julie,
> > >
> > > Quick question: Were you able to run point_stat with the netCDF
> > > file that I sent yesterday?
> > >
> > > Thanks for the help,
> > > Jose
> > >
> > > -----Original Message-----
> > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > Sent: Tuesday, March 15, 2016 12:17 PM
> > > To: Jose Garcia-Rivera
> > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR
> > > to NetCDF
> > >
> > > Thank you, Jose. I'm working with co-workers to try to get
these
> > > issues resolved. I hope to get back to you soon.
> > >
> > > Julie
> > >
> > > On Mon, Mar 14, 2016 at 1:36 PM, Jose Garcia-Rivera via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
>
> > > >
> > > > Dear Julie,
> > > >
> > > > I just uploaded the three files to 'garcia_data'.
> > > >
> > > > Thanks for the help,
> > > > Jose
> > > >
> > > >
> > > > -----Original Message-----
> > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > Sent: Monday, March 14, 2016 3:32 PM
> > > > To: Jose Garcia-Rivera
> > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
PREPBUFR
> > > > to NetCDF
> > > >
> > > > Hi Jose.
> > > >
> > > > Yes, please upload your input files and configuration file
> > > > (nmbprs_d01.06, test.nc, PointStatConfig_default) to our
> > > > anonymous ftp
> > > site as follows:
> > > > http://www.dtcenter.org/met/users/support/met_help.php
> > > >
> > > > Thanks!
> > > >
> > > > Julie
> > > >
> > > > On Mon, Mar 14, 2016 at 1:06 PM, Jose Garcia-Rivera via RT <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > > >
> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > >
> > > > >
> > > > > Dear Julie,
> > > > >
> > > > > I got to convert my prepbufr file using a python script.
> > > > > However, I have trouble running point_stat. Can I send you
the
> > > > > files, to see if you have the same issue?
> > > > >
> > > > >
> > > > > This is what I got:
> > > > >
> > > > > [garciaj at login prepbufr_obs]$ ./point_stat nmbprs_d01.06
> > > > > test.nc PointStatConfig_default DEBUG 1: Default Config
File:
> > > > > /work/apps/pgi_14.10/SANDY/met-
5.1/share/met/config/PointStatC
> > > > > on fi g_ de fault DEBUG 1: User Config File:
> > > > > PointStatConfig_default
> > > > > GSL_RNG_TYPE=mt19937
> > > > > GSL_RNG_SEED=18446744073425053526 DEBUG 1: Forecast File:
> > > > > nmbprs_d01.06 DEBUG 1: Observation File:
> > > > > test.nc DEBUG 2:
> > > > > DEBUG 2:
> > > > >
--------------------------------------------------------------
> > > > > --
> > > > > --
> > > > > --
> > > > > --
> > > > > ----------
> > > > > DEBUG 2:
> > > > > DEBUG 2: Reading data for SPFH/P500.
> > > > > DEBUG 2: For SPFH/P500 found 1 forecast levels and 0
> > > > > climatology
> > > levels.
> > > > > DEBUG 2:
> > > > > DEBUG 2:
> > > > >
--------------------------------------------------------------
> > > > > --
> > > > > --
> > > > > --
> > > > > --
> > > > > ----------
> > > > > DEBUG 2:
> > > > > DEBUG 2: Reading data for TMP/P500.
> > > > > DEBUG 2: For TMP/P500 found 1 forecast levels and 0
> > > > > climatology
> > levels.
> > > > > DEBUG 2:
> > > > > DEBUG 2:
> > > > >
--------------------------------------------------------------
> > > > > --
> > > > > --
> > > > > --
> > > > > --
> > > > > ----------
> > > > > DEBUG 2:
> > > > > DEBUG 2: Reading data for HGT/P500.
> > > > > DEBUG 2: For HGT/P500 found 1 forecast levels and 0
> > > > > climatology
> > levels.
> > > > > DEBUG 2:
> > > > > DEBUG 2:
> > > > >
--------------------------------------------------------------
> > > > > --
> > > > > --
> > > > > --
> > > > > --
> > > > > ----------
> > > > > DEBUG 2:
> > > > > DEBUG 2: Reading data for UGRD/P500.
> > > > > DEBUG 2: For UGRD/P500 found 1 forecast levels and 0
> > > > > climatology
> > > levels.
> > > > > DEBUG 2:
> > > > > DEBUG 2:
> > > > >
--------------------------------------------------------------
> > > > > --
> > > > > --
> > > > > --
> > > > > --
> > > > > ----------
> > > > > DEBUG 2:
> > > > > DEBUG 2: Reading data for VGRD/P500.
> > > > > DEBUG 2: For VGRD/P500 found 1 forecast levels and 0
> > > > > climatology
> > > levels.
> > > > > DEBUG 2:
> > > > > DEBUG 2:
> > > > >
--------------------------------------------------------------
> > > > > --
> > > > > --
> > > > > --
> > > > > --
> > > > > ----------
> > > > > DEBUG 2:
> > > > > WARNING:
> > > > > WARNING: process_obs_file() -> can't open observation netCDF
file:
> > > > > test.nc
> > > > > WARNING:
> > > > > DEBUG 2:
> > > > > DEBUG 2:
> > > > >
--------------------------------------------------------------
> > > > > --
> > > > > --
> > > > > --
> > > > > --
> > > > > ----------
> > > > > DEBUG 2:
> > > > > DEBUG 2: Processing SPFH/P500 versus SPFH/P500, for
> > > > > observation type ADPUPA, over region FULL, for interpolation
> > > > > method NEAREST(1), using
> > > > > 0 pairs.
> > > > > DEBUG 2:
> > > > > DEBUG 2:
> > > > >
--------------------------------------------------------------
> > > > > --
> > > > > --
> > > > > --
> > > > > --
> > > > > ----------
> > > > > DEBUG 2:
> > > > > DEBUG 2: Processing TMP/P500 versus TMP/P500, for
observation
> > > > > type ADPUPA, over region FULL, for interpolation method
> > > > > NEAREST(1), using
> > > > > 0
> > > > pairs.
> > > > > DEBUG 2:
> > > > > DEBUG 2:
> > > > >
--------------------------------------------------------------
> > > > > --
> > > > > --
> > > > > --
> > > > > --
> > > > > ----------
> > > > > DEBUG 2:
> > > > > DEBUG 2: Processing HGT/P500 versus HGT/P500, for
observation
> > > > > type ADPUPA, over region FULL, for interpolation method
> > > > > NEAREST(1), using
> > > > > 0
> > > > pairs.
> > > > > DEBUG 2:
> > > > > DEBUG 2:
> > > > >
--------------------------------------------------------------
> > > > > --
> > > > > --
> > > > > --
> > > > > --
> > > > > ----------
> > > > > DEBUG 2:
> > > > > DEBUG 2: Processing UGRD/P500 versus UGRD/P500, for
> > > > > observation type ADPUPA, over region FULL, for interpolation
> > > > > method NEAREST(1), using
> > > > > 0 pairs.
> > > > > DEBUG 2:
> > > > > DEBUG 2:
> > > > >
--------------------------------------------------------------
> > > > > --
> > > > > --
> > > > > --
> > > > > --
> > > > > ----------
> > > > > DEBUG 2:
> > > > > DEBUG 2: Processing VGRD/P500 versus VGRD/P500, for
> > > > > observation type ADPUPA, over region FULL, for interpolation
> > > > > method NEAREST(1), using
> > > > > 0 pairs.
> > > > > DEBUG 2:
> > > > > DEBUG 2:
> > > > >
--------------------------------------------------------------
> > > > > --
> > > > > --
> > > > > --
> > > > > --
> > > > > ----------
> > > > > DEBUG 2:
> > > > > DEBUG 1: Output file:
> > > > > ./point_stat_060000L_20150820_180000V.stat
> > > > > DEBUG 1: Output file:
> > > > > ./point_stat_060000L_20150820_180000V_fho.txt
> > > > > DEBUG 1: Output file:
> > > > > ./point_stat_060000L_20150820_180000V_ctc.txt
> > > > > DEBUG 1: Output file:
> > > > > ./point_stat_060000L_20150820_180000V_cts.txt
> > > > > DEBUG 1: Output file:
> > > > > ./point_stat_060000L_20150820_180000V_mctc.txt
> > > > > DEBUG 1: Output file:
> > > > > ./point_stat_060000L_20150820_180000V_mcts.txt
> > > > > DEBUG 1: Output file:
> > > > > ./point_stat_060000L_20150820_180000V_cnt.txt
> > > > > DEBUG 1: Output file:
> > > > > ./point_stat_060000L_20150820_180000V_sl1l2.txt
> > > > > DEBUG 1: Output file:
> > > > > ./point_stat_060000L_20150820_180000V_sal1l2.txt
> > > > > DEBUG 1: Output file:
> > > > > ./point_stat_060000L_20150820_180000V_vl1l2.txt
> > > > > DEBUG 1: Output file:
> > > > > ./point_stat_060000L_20150820_180000V_val1l2.txt
> > > > > DEBUG 1: Output file:
> > > > > ./point_stat_060000L_20150820_180000V_pct.txt
> > > > > DEBUG 1: Output file:
> > > > > ./point_stat_060000L_20150820_180000V_pstd.txt
> > > > > DEBUG 1: Output file:
> > > > > ./point_stat_060000L_20150820_180000V_pjc.txt
> > > > > DEBUG 1: Output file:
> > > > > ./point_stat_060000L_20150820_180000V_prc.txt
> > > > > DEBUG 1: Output file:
> > > > > ./point_stat_060000L_20150820_180000V_mpr.txt
> > > > >
> > > > >
> > > > > Thanks for the help,
> > > > > Jose
> > > > >
> > > > >
> > > > > -----Original Message-----
> > > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > > Sent: Monday, March 14, 2016 12:17 PM
> > > > > To: Jose Garcia-Rivera
> > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
> > > > > PREPBUFR to NetCDF
> > > > >
> > > > > Hi Jose. I apologize for the delayed response. I was out
of
> > > > > the office on Friday. I'm going to try to figure out a
> > > > > solution and get back with you shortly.
> > > > >
> > > > > Julie
> > > > >
> > > > > On Fri, Mar 11, 2016 at 2:02 PM, Jose Garcia-Rivera via RT <
> > > > > met_help at ucar.edu> wrote:
> > > > >
> > > > > >
> > > > > > <URL:
> > > > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > > >
> > > > > >
> > > > > > Dear Julie,
> > > > > >
> > > > > > Any news regarding pb2nc? We're still unable to make it
work.
> > > > > >
> > > > > > Best Regards,
> > > > > > Jose
> > > > > >
> > > > > > -----Original Message-----
> > > > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > > > Sent: Thursday, March 10, 2016 4:20 PM
> > > > > > To: Jose Garcia-Rivera
> > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
> > > > > > PREPBUFR to NetCDF
> > > > > >
> > > > > > Hi Jose. Thank you for attaching the files.
> > > > > >
> > > > > > Could you please send me a list of the files in
> > > > > > /work/apps/pgi_14.10/SANDY/bufrlib/lib?
> > > > > >
> > > > > > Thank you!
> > > > > >
> > > > > > Julie
> > > > > >
> > > > > >
> > > > > > On Thu, Mar 10, 2016 at 12:20 PM, Jose Garcia-Rivera via
RT
> > > > > > < met_help at ucar.edu> wrote:
> > > > > >
> > > > > > >
> > > > > > > <URL:
> > > > > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > > > >
> > > > > > >
> > > > > > > Dear Julie,
> > > > > > >
> > > > > > > The administrator re-compiled MET following your
> > > > > > > instructions, and says there's still trouble. He sent me
> > > > > > > the log files
> > > (attached).
> > > > > > > Is there any other approach that might help?
> > > > > > >
> > > > > > > Best Regards,
> > > > > > > Jose
> > > > > > >
> > > > > > > -----Original Message-----
> > > > > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > > > > Sent: Wednesday, March 09, 2016 12:39 PM
> > > > > > > To: Jose Garcia-Rivera
> > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
> > > > > > > PREPBUFR to NetCDF
> > > > > > >
> > > > > > > Thank you, Jose! It looks like something went wrong
> > > > > > > during
> > > > > compilation.
> > > > > > > I suggest recompiling MET to see if we can get this
issue
> > resolved.
> > > > > > > NCEP's BUFRLIB is used by the pb2nc MET tool, and is a
> > > > > > > required external library for pb2nc. MET is not yet
> > > > > > > compatible with BUFRLIB
> > > > > > version 11.0.0, so we
> > > > > > > suggest getting version 10.2.3. We are working on our
online
> > > > tutorial
> > > > > > for
> > > > > > > METv.5.1, but in the meantime, I'll point you to our
> > > > > > > online tutorial directions for installing BUFRLIB:
> > > > > > >
> > > > > > >
> > > > > > >
> http://www.dtcenter.org/met/users/support/online_tutorial/METv5.
> > > > > > > 0/
> > > > > > > co
> > > > > > > mp
> > > > > > > ilation/req_libs.php
> > > > > > >
> > > > > > > It is also important to review the necessary environment
> > > > > > > variables to
> > > > > > set:
> > > > > > >
> > > > > > >
> > > > > > >
> http://www.dtcenter.org/met/users/support/online_tutorial/METv5.
> > > > > > > 0/
> > > > > > > co
> > > > > > > mp
> > > > > > > ilation/configure.php
> > > > > > >
> > > > > > > For example,
> > > > > > >
> > > > > > > "Set *$MET_BUFR* to point to the main BUFR directory, or
> > > > > > > set
> > > > > > > *$MET_BUFRLIB* to point to the directory with the BUFR
> > > > > > > library
> > > files.
> > > > > > > Because MET doesn't use any BUFR library include files,
> > > > > > > you don't need to specify *$MET_BUFRINC* ."
> > > > > > >
> > > > > > > Once you've installed the required libraries and set up
> > > > > > > your environment variables, you'll be ready to configure
> > > > > > > MET (instructions at the bottom of the last link above)
> > > > > > > and then compile and install MET (
> > > > > > >
> http://www.dtcenter.org/met/users/support/online_tutorial/METv5.
> > > > > > > 0/
> > > > > > > co
> > > > > > > mp
> > > > > > > ilation/compile.php
> > > > > > > ).
> > > > > > > After re-installing MET, please run "make test" again.
If
> > > > > > > you still encounter the same problem, please send me
your
> > > > > > > *config.log* file and your *make_install.log *file.
> > > > > > > Please let me know if you have any
> > > > > > questions.
> > > > > > >
> > > > > > > Please let us know how it goes.
> > > > > > >
> > > > > > > Thanks,
> > > > > > > Julie
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > On Wed, Mar 9, 2016 at 10:22 AM, Jose Garcia-Rivera via
RT
> > > > > > > < met_help at ucar.edu> wrote:
> > > > > > >
> > > > > > > >
> > > > > > > > <URL:
> > > > > > > >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > > > > >
> > > > > > > >
> > > > > > > > Dear Julie,
> > > > > > > >
> > > > > > > > Attached is the test log file. It's showing the same
> > > > > > > > issues on pb2nc even with the sample files.
> > > > > > > >
> > > > > > > > Best Regards,
> > > > > > > > Jose
> > > > > > > >
> > > > > > > > -----Original Message-----
> > > > > > > > From: Julie Prestopnik via RT
[mailto:met_help at ucar.edu]
> > > > > > > > Sent: Tuesday, March 08, 2016 5:28 PM
> > > > > > > > To: Jose Garcia-Rivera
> > > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues
converting
> > > > > > > > PREPBUFR to NetCDF
> > > > > > > >
> > > > > > > > Hi Jose. Thank you for uploading the files.
> > > > > > > > Unfortunately, I am unable to reproduce the error you
> > > > > > > > are experiencing. I am wondering if you have
> > > > > > > > successfully used pb2nc before. As a check could you
> > > > > > > > please run the following in your met-5.1/
> > > > directory:
> > > > > > > >
> > > > > > > > *make test >& make_test.log*
> > > > > > > >
> > > > > > > > and then send me the make_test.log file?
> > > > > > > >
> > > > > > > > Thanks,
> > > > > > > > Julie
> > > > > > > >
> > > > > > > > On Tue, Mar 8, 2016 at 11:29 AM, Jose Garcia-Rivera
via
> > > > > > > > RT < met_help at ucar.edu> wrote:
> > > > > > > >
> > > > > > > > >
> > > > > > > > > <URL:
> > > > > > > > >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=7543
> > > > > > > > > 3
> > > > > > > > > >
> > > > > > > > >
> > > > > > > > > Dear Julie,
> > > > > > > > >
> > > > > > > > > I just put the files in 'garcia_data'. I appreciate
> > > > > > > > > your
> > help.
> > > > > > > > >
> > > > > > > > > Best Regards,
> > > > > > > > > Jose
> > > > > > > > >
> > > > > > > > > -----Original Message-----
> > > > > > > > > From: Julie Prestopnik via RT
> > > > > > > > > [mailto:met_help at ucar.edu]
> > > > > > > > > Sent: Tuesday, March 08, 2016 1:12 PM
> > > > > > > > > To: Jose Garcia-Rivera
> > > > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues
> > > > > > > > > converting PREPBUFR to NetCDF
> > > > > > > > >
> > > > > > > > > Hi Jose. I'm sorry to hear that you are having
> > > > > > > > > problems converting a PREPBUFR file to NetCDF.
> > > > > > > > >
> > > > > > > > > Please upload your input files and configuration
file
> > > > > > > > > to our anonymous ftp site as follows:
> > > > > > > > >
http://www.dtcenter.org/met/users/support/met_help.php
> > > > > > > > >
> > > > > > > > > Then I can take a look and get back to you.
> > > > > > > > >
> > > > > > > > > Thanks,
> > > > > > > > > Julie
> > > > > > > > >
> > > > > > > > > On Tue, Mar 8, 2016 at 11:01 AM, Jose Garcia-Rivera
> > > > > > > > > via RT < met_help at ucar.edu> wrote:
> > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > Tue Mar 08 11:01:25 2016: Request 75433 was acted
upon.
> > > > > > > > > > Transaction: Ticket created by GarciaJ at imsg.com
> > > > > > > > > > Queue: met_help
> > > > > > > > > > Subject: Issues converting PREPBUFR to NetCDF
> > > > > > > > > > Owner: Nobody
> > > > > > > > > > Requestors: GarciaJ at imsg.com
> > > > > > > > > > Status: new
> > > > > > > > > > Ticket <URL:
> > > > > > > > > >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75
> > > > > > > > > > 43
> > > > > > > > > > 3
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > Dear Met Help,
> > > > > > > > > >
> > > > > > > > > > Trying to convert a PREPBUFR file to NetCDF.
> > > > > > > > > >
> > > > > > > > > > I used the default PB2NC configure file, and got
the
> > > following:
> > > > > > > > > >
> > > > > > > > > > [garciaj at login prepbufr_obs]$ ./pb2nc
> > > > > > > > > > gdas1.t12z.prepbufr.nr gdas.20150820.t12z.nc
> > > > > > > > > > PB2NCConfig_default DEBUG 1: Default Config
> > > > > > > > > > File:
> > > > > > > > > > /work/apps/pgi_14.10/met-
5.1/share/met/config/PB2NCC
> > > > > > > > > > on fi g_ de fa ul t DEBUG 1: User Config File:
> > > > > > > > > > PB2NCConfig_default DEBUG 1: Creating NetCDF File:
> > > gdas.20150820.t12z.nc
> > > > > > > > > > DEBUG 1: Processing PrepBufr File:
> > > gdas1.t12z.prepbufr.nr
> > > > > > > > > > DEBUG 1: Blocking PrepBufr file to:
> > > > > /tmp/tmp_pb2nc_blk_32144_0
> > > > > > > > > > WARNING:
> > > > > > > > > > WARNING: process_pbfile() -> No PrepBufr messages
to
> > > > > > > > > > process in
> > > > > > file:
> > > > > > > > > > gdas1.t12z.prepbufr.nr
> > > > > > > > > > WARNING:
> > > > > > > > > > ERROR :
> > > > > > > > > > ERROR : write_netcdf_hdr_data() -> No PrepBufr
> > > > > > > > > > messages
> > > > > retained.
> > > > > > > > > > Nothing to write.
> > > > > > > > > > ERROR :
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > Thanks in advance for the help, Jose M.
> > > > > > > > > > Garcia-Rivera, PhD IM Systems Group
> > > > > > > > > > Rockville/College Park, MD This e-mail, including
> > > > > > > > > > attachments, may include confidential and/or
> > > > > > > > > > proprietary information, and may be used only by
the
> > > > > > > > > > person or entity to which it is addressed. If the
> > > > > > > > > > reader of this e-mail is not the intended
recipient
> > > > > > > > > > or his or her authorized agent, the reader is
hereby
> > > > > > > > > > notified that any dissemination, distribution or
copying of this e-mail is prohibited.
> > > > > > > > > > If you have received this e-mail in error, please
> > > > > > > > > > notify the sender by replying to this message and
> > > > > > > > > > delete this
> > > > > > > > > e-mail immediately.
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > --
> > > > > > > > > Julie Prestopnik
> > > > > > > > > National Center for Atmospheric Research Research
> > > > > > > > > Applications Laboratory
> > > > > > > > > Phone: 303.497.8399
> > > > > > > > > Email: jpresto at ucar.edu
> > > > > > > > >
> > > > > > > > > This e-mail, including attachments, may include
> > > > > > > > > confidential and/or proprietary information, and may
> > > > > > > > > be used only by the person or entity to which it is
> > > > > > > > > addressed. If the reader of this e-mail is not the
> > > > > > > > > intended recipient or his or her authorized agent,
the
> > > > > > > > > reader is hereby notified that any dissemination,
> > > > > > > > > distribution or copying of this e-mail is
prohibited.
> > > > > > > > > If you have received this e-mail in error, please
> > > > > > > > > notify the sender by replying to this message and
> > > > > > > > > delete this
> > > > > > > > e-mail immediately.
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > --
> > > > > > > > Julie Prestopnik
> > > > > > > > National Center for Atmospheric Research Research
> > > > > > > > Applications Laboratory
> > > > > > > > Phone: 303.497.8399
> > > > > > > > Email: jpresto at ucar.edu
> > > > > > > >
> > > > > > > > This e-mail, including attachments, may include
> > > > > > > > confidential and/or proprietary information, and may
be
> > > > > > > > used only by the person or entity to which it is
> > > > > > > > addressed. If the reader of this e-mail is not the
> > > > > > > > intended recipient or his or her authorized agent, the
> > > > > > > > reader is hereby notified that any dissemination,
> > > > > > > > distribution or copying of this e-mail is prohibited.
If
> > > > > > > > you have received this e-mail in error, please notify
> > > > > > > > the sender by replying to this message and delete this
> > > > > > > e-mail immediately.
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > --
> > > > > > > Julie Prestopnik
> > > > > > > National Center for Atmospheric Research Research
> > > > > > > Applications Laboratory
> > > > > > > Phone: 303.497.8399
> > > > > > > Email: jpresto at ucar.edu
> > > > > > >
> > > > > > > This e-mail, including attachments, may include
> > > > > > > confidential and/or proprietary information, and may be
> > > > > > > used only by the person or entity to which it is
> > > > > > > addressed. If the reader of this e-mail is not the
> > > > > > > intended recipient or his or her authorized agent, the
> > > > > > > reader is hereby notified that any dissemination,
> > > > > > > distribution or copying of this e-mail is prohibited. If
> > > > > > > you have received this e-mail in error, please notify
the
> > > > > > > sender by replying to this message and delete this
> > > > > > e-mail immediately.
> > > > > > >
> > > > > > >
> > > > > >
> > > > > >
> > > > > > --
> > > > > > Julie Prestopnik
> > > > > > National Center for Atmospheric Research Research
> > > > > > Applications Laboratory
> > > > > > Phone: 303.497.8399
> > > > > > Email: jpresto at ucar.edu
> > > > > >
> > > > > > This e-mail, including attachments, may include
confidential
> > > > > > and/or proprietary information, and may be used only by
the
> > > > > > person or entity to which it is addressed. If the reader
of
> > > > > > this e-mail is not the intended recipient or his or her
> > > > > > authorized agent, the reader is hereby notified that any
> > > > > > dissemination, distribution or copying of this e-mail is
> > > > > > prohibited. If you have received this e-mail in error,
> > > > > > please notify the sender by replying to this message and
> > > > > > delete this
> > > > > e-mail immediately.
> > > > > >
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > > > --
> > > > > Julie Prestopnik
> > > > > National Center for Atmospheric Research Research
Applications
> > > > > Laboratory
> > > > > Phone: 303.497.8399
> > > > > Email: jpresto at ucar.edu
> > > > >
> > > > > This e-mail, including attachments, may include confidential
> > > > > and/or proprietary information, and may be used only by the
> > > > > person or entity to which it is addressed. If the reader of
> > > > > this e-mail is not the intended recipient or his or her
> > > > > authorized agent, the reader is hereby notified that any
> > > > > dissemination, distribution or copying of this e-mail is
> > > > > prohibited. If you have received this e-mail in error,
please
> > > > > notify the sender by replying to this message and delete
this
> > > > e-mail immediately.
> > > > >
> > > > >
> > > > >
> > > >
> > > >
> > > > --
> > > > Julie Prestopnik
> > > > National Center for Atmospheric Research Research Applications
> > > > Laboratory
> > > > Phone: 303.497.8399
> > > > Email: jpresto at ucar.edu
> > > >
> > > > This e-mail, including attachments, may include confidential
> > > > and/or proprietary information, and may be used only by the
> > > > person or entity to which it is addressed. If the reader of
this
> > > > e-mail is not the intended recipient or his or her authorized
> > > > agent, the reader is hereby notified that any dissemination,
> > > > distribution or copying of this e-mail is prohibited. If you
> > > > have received this e-mail in error, please notify the sender
by
> > > > replying to this message and delete this
> > > e-mail immediately.
> > > >
> > > >
> > > >
> > >
> > >
> > > --
> > > Julie Prestopnik
> > > National Center for Atmospheric Research Research Applications
> > > Laboratory
> > > Phone: 303.497.8399
> > > Email: jpresto at ucar.edu
> > >
> > > This e-mail, including attachments, may include confidential
> > > and/or proprietary information, and may be used only by the
person
> > > or entity to which it is addressed. If the reader of this e-mail
> > > is not the intended recipient or his or her authorized agent,
the
> > > reader is hereby notified that any dissemination, distribution
or
> > > copying of this e-mail is prohibited. If you have received this
> > > e-mail in error, please notify the sender by replying to this
> > > message and delete this
> > e-mail immediately.
> > >
> > >
> > >
> >
> >
> > --
> > Julie Prestopnik
> > National Center for Atmospheric Research Research Applications
> > Laboratory
> > Phone: 303.497.8399
> > Email: jpresto at ucar.edu
> >
> > This e-mail, including attachments, may include confidential
and/or
> > proprietary information, and may be used only by the person or
> > entity to which it is addressed. If the reader of this e-mail is
not
> > the intended recipient or his or her authorized agent, the reader
is
> > hereby notified that any dissemination, distribution or copying of
> > this e-mail is prohibited. If you have received this e-mail in
> > error, please notify the sender by replying to this message and
> > delete this
> e-mail immediately.
> >
> >
> >
>
>
> --
> Julie Prestopnik
> National Center for Atmospheric Research Research Applications
> Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
> This e-mail, including attachments, may include confidential and/or
> proprietary information, and may be used only by the person or
entity
> to which it is addressed. If the reader of this e-mail is not the
> intended recipient or his or her authorized agent, the reader is
> hereby notified that any dissemination, distribution or copying of
> this e-mail is prohibited. If you have received this e-mail in
error,
> please notify the sender by replying to this message and delete this
e-mail immediately.
>
>
This e-mail, including attachments, may include confidential and/or
proprietary information, and may be used only by the person or entity
to which it is addressed. If the reader of this e-mail is not the
intended recipient or his or her authorized agent, the reader is
hereby notified that any dissemination, distribution or copying of
this e-mail is prohibited. If you have received this e-mail in error,
please notify the sender by replying to this message and delete this
e-mail immediately.
------------------------------------------------
Subject: Issues converting PREPBUFR to NetCDF
From: John Halley Gotway
Time: Thu Mar 17 15:46:35 2016
Jose,
I see that you're doing an upper-air (ADPUPA) evaluation for the time
20150820_180000. Upper-air observations are much more common at 00Z
and
12Z than 06Z and 18Z. Instead of verifying the 06 hour forecast valid
at
18Z, please try the 12 hour forecast valid at 00Z.
Also, you could try evaluating some surface fields against the ADPSFC
message type.
If you get stuck, you can post a sample forecast file to our anonymous
ftp
site, and I can try running it here.
Thanks,
John
On Thu, Mar 17, 2016 at 2:39 PM, Jose Garcia-Rivera via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
>
> Dear John,
>
> It's great to hear from you again! Julie has been of great help. We
highly
> appreciate all the help coming from your team.
>
> I followed your recommendation, and got the following:
>
> [garciaj at login prepbufr_obs]$ ./point_stat -v 3 nmbprs_d01.06
newtest.nc
> PointStatConfig_default
> DEBUG 1: Default Config File:
> /work/apps/pgi_14.10/SANDY/met-
5.1/share/met/config/PointStatConfig_default
> DEBUG 1: User Config File: PointStatConfig_default
> GSL_RNG_TYPE=mt19937
> GSL_RNG_SEED=1041230678
> DEBUG 1: Forecast File: nmbprs_d01.06
> DEBUG 1: Observation File: newtest.nc
> DEBUG 2:
> DEBUG 2:
>
--------------------------------------------------------------------------------
> DEBUG 2:
> DEBUG 2: Reading data for SPFH/P500.
> DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found range match
for
> VarInfo "SPFH/P500" in GRIB record 134 of GRIB file "nmbprs_d01.06".
> DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found 1 GRIB
records
> matching VarInfo "SPFH/P500" in GRIB file "nmbprs_d01.06".
> DEBUG 3: Use the matching forecast and observation grids.
> DEBUG 3: Grid Definition: Projection: Lambert Conformal Nx: 400 Ny:
400
> Lat_LL: 33.302 Lon_LL: 84.951 Lon_orient: 77.459 Alpha: 3781.822
Cone:
> 0.629 Bx: 210.6765 By: 2557.3266
> DEBUG 2: For SPFH/P500 found 1 forecast levels and 0 climatology
levels.
> DEBUG 2:
> DEBUG 2:
>
--------------------------------------------------------------------------------
> DEBUG 2:
> DEBUG 2: Reading data for TMP/P500.
> DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found range match
for
> VarInfo "TMP/P500" in GRIB record 131 of GRIB file "nmbprs_d01.06".
> DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found 1 GRIB
records
> matching VarInfo "TMP/P500" in GRIB file "nmbprs_d01.06".
> DEBUG 2: For TMP/P500 found 1 forecast levels and 0 climatology
levels.
> DEBUG 2:
> DEBUG 2:
>
--------------------------------------------------------------------------------
> DEBUG 2:
> DEBUG 2: Reading data for HGT/P500.
> DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found range match
for
> VarInfo "HGT/P500" in GRIB record 130 of GRIB file "nmbprs_d01.06".
> DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found 1 GRIB
records
> matching VarInfo "HGT/P500" in GRIB file "nmbprs_d01.06".
> DEBUG 2: For HGT/P500 found 1 forecast levels and 0 climatology
levels.
> DEBUG 2:
> DEBUG 2:
>
--------------------------------------------------------------------------------
> DEBUG 2:
> DEBUG 2: Reading data for UGRD/P500.
> DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found range match
for
> VarInfo "UGRD/P500" in GRIB record 137 of GRIB file "nmbprs_d01.06".
> DEBUG 3: MetGrib1DataFile::rotate_winds() -> Have U-wind record,
reading
> V-wind record.
> DEBUG 3: MetGrib1DataFile::data_plane_scalar() -> Found exact match
for
> VarInfo "UGRD/P500" in GRIB record 138 of GRIB file "nmbprs_d01.06".
> DEBUG 3: Rotating U and V wind components from grid-relative to
> earth-relative.
> DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found 1 GRIB
records
> matching VarInfo "UGRD/P500" in GRIB file "nmbprs_d01.06".
> DEBUG 2: For UGRD/P500 found 1 forecast levels and 0 climatology
levels.
> DEBUG 2:
> DEBUG 2:
>
--------------------------------------------------------------------------------
> DEBUG 2:
> DEBUG 2: Reading data for VGRD/P500.
> DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found range match
for
> VarInfo "VGRD/P500" in GRIB record 138 of GRIB file "nmbprs_d01.06".
> DEBUG 3: MetGrib1DataFile::rotate_winds() -> Have V-wind record,
reading
> U-wind record.
> DEBUG 3: MetGrib1DataFile::data_plane_scalar() -> Found exact match
for
> VarInfo "VGRD/P500" in GRIB record 137 of GRIB file "nmbprs_d01.06".
> DEBUG 3: Rotating U and V wind components from grid-relative to
> earth-relative.
> DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found 1 GRIB
records
> matching VarInfo "VGRD/P500" in GRIB file "nmbprs_d01.06".
> DEBUG 2: For VGRD/P500 found 1 forecast levels and 0 climatology
levels.
> DEBUG 2:
> DEBUG 2:
>
--------------------------------------------------------------------------------
> DEBUG 2:
> DEBUG 2: Searching 949837 observations from 452408 messages.
> DEBUG 2:
> DEBUG 2:
>
--------------------------------------------------------------------------------
> DEBUG 2:
> DEBUG 2: Processing SPFH/P500 versus SPFH/P500, for observation type
> ADPUPA, over region FULL, for interpolation method NEAREST(1), using
0
> pairs.
> DEBUG 3: Number of matched pairs = 0
> DEBUG 3: Observations processed = 949837
> DEBUG 3: Rejected: SID exclusion = 0
> DEBUG 3: Rejected: GRIB code = 947898
> DEBUG 3: Rejected: valid time = 1416
> DEBUG 3: Rejected: bad obs value = 0
> DEBUG 3: Rejected: off the grid = 523
> DEBUG 3: Rejected: level mismatch = 0
> DEBUG 3: Rejected: quality marker = 0
> DEBUG 3: Rejected: message type = 0
> DEBUG 3: Rejected: masking region = 0
> DEBUG 3: Rejected: bad fcst value = 0
> DEBUG 3: Rejected: duplicates = 0
> DEBUG 2:
> DEBUG 2:
>
--------------------------------------------------------------------------------
> DEBUG 2:
> DEBUG 2: Processing TMP/P500 versus TMP/P500, for observation type
ADPUPA,
> over region FULL, for interpolation method NEAREST(1), using 0
pairs.
> DEBUG 3: Number of matched pairs = 0
> DEBUG 3: Observations processed = 949837
> DEBUG 3: Rejected: SID exclusion = 0
> DEBUG 3: Rejected: GRIB code = 943848
> DEBUG 3: Rejected: valid time = 4191
> DEBUG 3: Rejected: bad obs value = 0
> DEBUG 3: Rejected: off the grid = 1798
> DEBUG 3: Rejected: level mismatch = 0
> DEBUG 3: Rejected: quality marker = 0
> DEBUG 3: Rejected: message type = 0
> DEBUG 3: Rejected: masking region = 0
> DEBUG 3: Rejected: bad fcst value = 0
> DEBUG 3: Rejected: duplicates = 0
> DEBUG 2:
> DEBUG 2:
>
--------------------------------------------------------------------------------
> DEBUG 2:
> DEBUG 2: Processing HGT/P500 versus HGT/P500, for observation type
ADPUPA,
> over region FULL, for interpolation method NEAREST(1), using 0
pairs.
> DEBUG 3: Number of matched pairs = 0
> DEBUG 3: Observations processed = 949837
> DEBUG 3: Rejected: SID exclusion = 0
> DEBUG 3: Rejected: GRIB code = 606744
> DEBUG 3: Rejected: valid time = 319085
> DEBUG 3: Rejected: bad obs value = 0
> DEBUG 3: Rejected: off the grid = 23610
> DEBUG 3: Rejected: level mismatch = 395
> DEBUG 3: Rejected: quality marker = 0
> DEBUG 3: Rejected: message type = 3
> DEBUG 3: Rejected: masking region = 0
> DEBUG 3: Rejected: bad fcst value = 0
> DEBUG 3: Rejected: duplicates = 0
> DEBUG 2:
> DEBUG 2:
>
--------------------------------------------------------------------------------
> DEBUG 2:
> DEBUG 2: Processing UGRD/P500 versus UGRD/P500, for observation type
> ADPUPA, over region FULL, for interpolation method NEAREST(1), using
0
> pairs.
> DEBUG 3: Number of matched pairs = 0
> DEBUG 3: Observations processed = 949837
> DEBUG 3: Rejected: SID exclusion = 0
> DEBUG 3: Rejected: GRIB code = 650429
> DEBUG 3: Rejected: valid time = 277745
> DEBUG 3: Rejected: bad obs value = 0
> DEBUG 3: Rejected: off the grid = 21341
> DEBUG 3: Rejected: level mismatch = 319
> DEBUG 3: Rejected: quality marker = 0
> DEBUG 3: Rejected: message type = 3
> DEBUG 3: Rejected: masking region = 0
> DEBUG 3: Rejected: bad fcst value = 0
> DEBUG 3: Rejected: duplicates = 0
> DEBUG 2:
> DEBUG 2:
>
--------------------------------------------------------------------------------
> DEBUG 2:
> DEBUG 2: Processing VGRD/P500 versus VGRD/P500, for observation type
> ADPUPA, over region FULL, for interpolation method NEAREST(1), using
0
> pairs.
> DEBUG 3: Number of matched pairs = 0
> DEBUG 3: Observations processed = 949837
> DEBUG 3: Rejected: SID exclusion = 0
> DEBUG 3: Rejected: GRIB code = 650429
> DEBUG 3: Rejected: valid time = 277745
> DEBUG 3: Rejected: bad obs value = 0
> DEBUG 3: Rejected: off the grid = 21341
> DEBUG 3: Rejected: level mismatch = 319
> DEBUG 3: Rejected: quality marker = 0
> DEBUG 3: Rejected: message type = 3
> DEBUG 3: Rejected: masking region = 0
> DEBUG 3: Rejected: bad fcst value = 0
> DEBUG 3: Rejected: duplicates = 0
> DEBUG 2:
> DEBUG 2:
>
--------------------------------------------------------------------------------
> DEBUG 2:
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V.stat
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_fho.txt
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_ctc.txt
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_cts.txt
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_mctc.txt
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_mcts.txt
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_cnt.txt
> DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_sl1l2.txt
> DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_sal1l2.txt
> DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_vl1l2.txt
> DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_val1l2.txt
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_pct.txt
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_pstd.txt
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_pjc.txt
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_prc.txt
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_mpr.txt
>
>
>
> Best Regards,
> Jose
>
>
>
>
>
> -----Original Message-----
> From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> Sent: Thursday, March 17, 2016 3:29 PM
> To: Jose Garcia-Rivera
> Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to
NetCDF
>
> Hello Jose,
>
> Julie is out of the office today, but I should be able to help you.
Glad
> you were able to finally get PB2NC working. That was a tricky one!
But it
> helped us realize that since BUFRLIB has changed to FORTRAN 90, we
should
> update the MET code which calls BUFRLIB to be compatible.
>
> I see that you are now getting 0 matched pairs when you run Point-
Stat
> with the output of PB2NC. Please try rerunning Point-Stat but use a
higher
> verbosity level, like "-v 3". That'll print out the following type
of
> counts for each of the verification tasks you've defined in the
config file:
>
> DEBUG 3: Number of matched pairs = 312
> DEBUG 3: Observations processed = 87753
> DEBUG 3: Rejected: SID exclusion = 0
> DEBUG 3: Rejected: GRIB code = 77648
> DEBUG 3: Rejected: valid time = 0
> DEBUG 3: Rejected: bad obs value = 0
> DEBUG 3: Rejected: off the grid = 5
> DEBUG 3: Rejected: level mismatch = 9219 DEBUG 3: Rejected: quality
marker
> = 0
> DEBUG 3: Rejected: message type = 537
> DEBUG 3: Rejected: masking region = 32
> DEBUG 3: Rejected: bad fcst value = 0
> DEBUG 3: Rejected: duplicates = 0
>
> In the example above, 87753 observation values were checked and the
counts
> list reasons why there were not used for that task. Out of those
87753
> obs, 312 of them were used for this task.
>
> Looking at the counts from your Point-Stat run should help you
figure out
> why you have 0 matched pairs.
>
> Thanks,
> John
>
>
> On Thu, Mar 17, 2016 at 12:29 PM, Jose Garcia-Rivera via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> >
> > Dear Julie,
> >
> > We got the executables to work! However, I have a couple of
> > issues/questions:
> >
> >
> >
> > Issue #1 --- Not getting values after running point_stat
> >
> > Everything seems to run fine. I attached the configuration file. I
can
> > send the three files via FTP if needed.
> >
> >
> >
> > Issue #2 --- PB2NC doesn't seem to finish the job, but it does? I
had
> > to do CTRL+C, and checked the netCDF file using ncl_filedump:
> >
> > [garciaj at login prepbufr_obs]$ ./pb2nc
prepbufr.gdas.20150820.t18z.nr
> > newtest.nc PB2NCConfig_default DEBUG 1: Default Config File:
> > /work/apps/pgi_14.10/SANDY/met-
5.1/share/met/config/PB2NCConfig_defaul
> > t DEBUG 1: User Config File: PB2NCConfig_default
> > DEBUG 1: Creating NetCDF File: newtest.nc
> > DEBUG 1: Processing PrepBufr File:
prepbufr.gdas.20150820.t18z.nr
> > DEBUG 1: Blocking PrepBufr file to: /tmp/tmp_pb2nc_blk_17703_0
> > DEBUG 2: PrepBufr Time Center: 20150820_180000
> > DEBUG 2: Searching Time Window: 20150820_163000 to
> 20150820_193000
> > DEBUG 2: Processing 685386 PrepBufr messages...
> > 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85%
90%
> > 95% 100%
> > DEBUG 2: Total PrepBufr Messages processed = 685386
> > DEBUG 2: Rejected based on message type = 0
> > DEBUG 2: Rejected based on station id = 0
> > DEBUG 2: Rejected based on valid time = 185145
> > DEBUG 2: Rejected based on masking grid = 0
> > DEBUG 2: Rejected based on masking polygon = 0
> > DEBUG 2: Rejected based on elevation = 0
> > DEBUG 2: Rejected based on pb report type = 0
> > DEBUG 2: Rejected based on input report type = 0
> > DEBUG 2: Rejected based on instrument type = 0
> > DEBUG 2: Rejected based on zero observations = 47833
> > DEBUG 2: Total PrepBufr Messages retained = 452408
> > DEBUG 2: Total observations retained or derived = 949837 ^C
> >
> >
> > Checking netCDF file:
> >
> > [garciaj at login prepbufr_obs]$ ncl_filedump newtest.nc Copyright
(C)
> > 1995-2015 - All Rights Reserved University Corporation for
> > Atmospheric Research NCAR Command Language Version 6.3.0 The use
of
> > this software is governed by a License Agreement.
> > See http://www.ncl.ucar.edu/ for more details.
> >
> > Variable: f
> > Type: file
> > filename: newtest
> > path: newtest.nc
> > file global attributes:
> > FileOrigins : File newtest.nc generated 20160317_155548 UTC
on
> > host login.local by the MET pb2nc tool
> > MET_version : V5.1
> > MET_tool : pb2nc
> > dimensions:
> > mxstr = 16
> > hdr_arr_len = 3
> > obs_arr_len = 5
> > nobs = 949837 // unlimited
> > nhdr = 452408
> > variables:
> > character obs_qty ( nobs, mxstr )
> > long_name : quality flag
> >
> > float obs_arr ( nobs, obs_arr_len )
> > long_name : array of observation values
> > _fill_value : -9999
> > columns : hdr_id gc lvl hgt ob
> > hdr_id_long_name : index of matching header data
> > gc_long_name : grib code corresponding to the observation
type
> > lvl_long_name : pressure level (hPa) or
accumulation
> > interval (sec)
> > hgt_long_name : height in meters above sea level
(msl)
> > ob_long_name : observation value
> >
> > character hdr_typ ( nhdr, mxstr )
> > long_name : message type
> >
> > character hdr_sid ( nhdr, mxstr )
> > long_name : station identification
> >
> > character hdr_vld ( nhdr, mxstr )
> > long_name : valid time
> > units : YYYYMMDD_HHMMSS
> >
> > float hdr_arr ( nhdr, hdr_arr_len )
> > long_name : array of observation station header values
> > _fill_value : -9999
> > columns : lat lon elv
> > lat_long_name : latitude
> > lat_units : degrees_north
> > lon_long_name : longitude
> > lon_units : degrees_east
> > elv_long_name : elevation
> > elv_units : meters above sea level (msl)
> >
> >
> >
> >
> > Thanks for all the help,
> > Jose
> >
> >
> >
> >
> >
> >
> > -----Original Message-----
> > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > Sent: Wednesday, March 16, 2016 4:40 PM
> > To: Jose Garcia-Rivera
> > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR
to
> > NetCDF
> >
> > Hi Jose. I apologize for the delay. This was a tricky problem to
> > figure out, however, we were finally able to reproduce the error
you
> > are receiving for pb2nc.
> >
> > The problem is BUFRLIB being compiled with pgf90 and MET being
> > compiled with pgf77. They aren't talking well to each other.
> > BUFRLIBv10.1.0 compiles with pgf77 but later versions require
pgf90.
> >
> > We will plan on updating the MET Fortran code to compile with
pgf90 so
> > that we can use newer BUFRLIB versions, but for now, to solve your
> > problem, I have attached BUFRLIB_v10-1-0.tar. Please install that
> > version of BUFRLIB using pgf77 and then recompile MET without the
> > "LIBS" environment variable setting?
> >
> > Please let me know how that goes. We were able to get a
successful
> > run using that solution and hope you will too.
> >
> > Thanks,
> > Julie
> >
> >
> > On Wed, Mar 16, 2016 at 12:17 PM, Jose Garcia-Rivera via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> > >
> > > Dear Julie,
> > >
> > > Is there anything that we can do here to sort these issues out?
> > >
> > > Best Regards,
> > > Jose
> > >
> > > -----Original Message-----
> > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > Sent: Tuesday, March 15, 2016 5:08 PM
> > > To: Jose Garcia-Rivera
> > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR
to
> > > NetCDF
> > >
> > > Hi Jose. I was not. I got the same error you did. I believe
that
> > > the test.nc file is not in the correct format needed by
point_stat,
> > > so I think we need to get pb2nc working for you. It is likely a
> > > communication problem between the C code and the Fortran code.
> > >
> > > Julie
> > >
> > > On Tue, Mar 15, 2016 at 3:05 PM, Jose Garcia-Rivera via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
>
> > > >
> > > > Dear Julie,
> > > >
> > > > Quick question: Were you able to run point_stat with the
netCDF
> > > > file that I sent yesterday?
> > > >
> > > > Thanks for the help,
> > > > Jose
> > > >
> > > > -----Original Message-----
> > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > Sent: Tuesday, March 15, 2016 12:17 PM
> > > > To: Jose Garcia-Rivera
> > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
PREPBUFR
> > > > to NetCDF
> > > >
> > > > Thank you, Jose. I'm working with co-workers to try to get
these
> > > > issues resolved. I hope to get back to you soon.
> > > >
> > > > Julie
> > > >
> > > > On Mon, Mar 14, 2016 at 1:36 PM, Jose Garcia-Rivera via RT <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > > >
> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> > > > >
> > > > > Dear Julie,
> > > > >
> > > > > I just uploaded the three files to 'garcia_data'.
> > > > >
> > > > > Thanks for the help,
> > > > > Jose
> > > > >
> > > > >
> > > > > -----Original Message-----
> > > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > > Sent: Monday, March 14, 2016 3:32 PM
> > > > > To: Jose Garcia-Rivera
> > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
PREPBUFR
> > > > > to NetCDF
> > > > >
> > > > > Hi Jose.
> > > > >
> > > > > Yes, please upload your input files and configuration file
> > > > > (nmbprs_d01.06, test.nc, PointStatConfig_default) to our
> > > > > anonymous ftp
> > > > site as follows:
> > > > > http://www.dtcenter.org/met/users/support/met_help.php
> > > > >
> > > > > Thanks!
> > > > >
> > > > > Julie
> > > > >
> > > > > On Mon, Mar 14, 2016 at 1:06 PM, Jose Garcia-Rivera via RT <
> > > > > met_help at ucar.edu> wrote:
> > > > >
> > > > > >
> > > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > > >
> > > > > >
> > > > > > Dear Julie,
> > > > > >
> > > > > > I got to convert my prepbufr file using a python script.
> > > > > > However, I have trouble running point_stat. Can I send you
the
> > > > > > files, to see if you have the same issue?
> > > > > >
> > > > > >
> > > > > > This is what I got:
> > > > > >
> > > > > > [garciaj at login prepbufr_obs]$ ./point_stat nmbprs_d01.06
> > > > > > test.nc PointStatConfig_default DEBUG 1: Default Config
File:
> > > > > > /work/apps/pgi_14.10/SANDY/met-
5.1/share/met/config/PointStatC
> > > > > > on fi g_ de fault DEBUG 1: User Config File:
> > > > > > PointStatConfig_default
> > > > > > GSL_RNG_TYPE=mt19937
> > > > > > GSL_RNG_SEED=18446744073425053526 DEBUG 1: Forecast File:
> > > > > > nmbprs_d01.06 DEBUG 1: Observation File:
> > > > > > test.nc DEBUG 2:
> > > > > > DEBUG 2:
> > > > > >
--------------------------------------------------------------
> > > > > > --
> > > > > > --
> > > > > > --
> > > > > > --
> > > > > > ----------
> > > > > > DEBUG 2:
> > > > > > DEBUG 2: Reading data for SPFH/P500.
> > > > > > DEBUG 2: For SPFH/P500 found 1 forecast levels and 0
> > > > > > climatology
> > > > levels.
> > > > > > DEBUG 2:
> > > > > > DEBUG 2:
> > > > > >
--------------------------------------------------------------
> > > > > > --
> > > > > > --
> > > > > > --
> > > > > > --
> > > > > > ----------
> > > > > > DEBUG 2:
> > > > > > DEBUG 2: Reading data for TMP/P500.
> > > > > > DEBUG 2: For TMP/P500 found 1 forecast levels and 0
> > > > > > climatology
> > > levels.
> > > > > > DEBUG 2:
> > > > > > DEBUG 2:
> > > > > >
--------------------------------------------------------------
> > > > > > --
> > > > > > --
> > > > > > --
> > > > > > --
> > > > > > ----------
> > > > > > DEBUG 2:
> > > > > > DEBUG 2: Reading data for HGT/P500.
> > > > > > DEBUG 2: For HGT/P500 found 1 forecast levels and 0
> > > > > > climatology
> > > levels.
> > > > > > DEBUG 2:
> > > > > > DEBUG 2:
> > > > > >
--------------------------------------------------------------
> > > > > > --
> > > > > > --
> > > > > > --
> > > > > > --
> > > > > > ----------
> > > > > > DEBUG 2:
> > > > > > DEBUG 2: Reading data for UGRD/P500.
> > > > > > DEBUG 2: For UGRD/P500 found 1 forecast levels and 0
> > > > > > climatology
> > > > levels.
> > > > > > DEBUG 2:
> > > > > > DEBUG 2:
> > > > > >
--------------------------------------------------------------
> > > > > > --
> > > > > > --
> > > > > > --
> > > > > > --
> > > > > > ----------
> > > > > > DEBUG 2:
> > > > > > DEBUG 2: Reading data for VGRD/P500.
> > > > > > DEBUG 2: For VGRD/P500 found 1 forecast levels and 0
> > > > > > climatology
> > > > levels.
> > > > > > DEBUG 2:
> > > > > > DEBUG 2:
> > > > > >
--------------------------------------------------------------
> > > > > > --
> > > > > > --
> > > > > > --
> > > > > > --
> > > > > > ----------
> > > > > > DEBUG 2:
> > > > > > WARNING:
> > > > > > WARNING: process_obs_file() -> can't open observation
netCDF
> file:
> > > > > > test.nc
> > > > > > WARNING:
> > > > > > DEBUG 2:
> > > > > > DEBUG 2:
> > > > > >
--------------------------------------------------------------
> > > > > > --
> > > > > > --
> > > > > > --
> > > > > > --
> > > > > > ----------
> > > > > > DEBUG 2:
> > > > > > DEBUG 2: Processing SPFH/P500 versus SPFH/P500, for
> > > > > > observation type ADPUPA, over region FULL, for
interpolation
> > > > > > method NEAREST(1), using
> > > > > > 0 pairs.
> > > > > > DEBUG 2:
> > > > > > DEBUG 2:
> > > > > >
--------------------------------------------------------------
> > > > > > --
> > > > > > --
> > > > > > --
> > > > > > --
> > > > > > ----------
> > > > > > DEBUG 2:
> > > > > > DEBUG 2: Processing TMP/P500 versus TMP/P500, for
observation
> > > > > > type ADPUPA, over region FULL, for interpolation method
> > > > > > NEAREST(1), using
> > > > > > 0
> > > > > pairs.
> > > > > > DEBUG 2:
> > > > > > DEBUG 2:
> > > > > >
--------------------------------------------------------------
> > > > > > --
> > > > > > --
> > > > > > --
> > > > > > --
> > > > > > ----------
> > > > > > DEBUG 2:
> > > > > > DEBUG 2: Processing HGT/P500 versus HGT/P500, for
observation
> > > > > > type ADPUPA, over region FULL, for interpolation method
> > > > > > NEAREST(1), using
> > > > > > 0
> > > > > pairs.
> > > > > > DEBUG 2:
> > > > > > DEBUG 2:
> > > > > >
--------------------------------------------------------------
> > > > > > --
> > > > > > --
> > > > > > --
> > > > > > --
> > > > > > ----------
> > > > > > DEBUG 2:
> > > > > > DEBUG 2: Processing UGRD/P500 versus UGRD/P500, for
> > > > > > observation type ADPUPA, over region FULL, for
interpolation
> > > > > > method NEAREST(1), using
> > > > > > 0 pairs.
> > > > > > DEBUG 2:
> > > > > > DEBUG 2:
> > > > > >
--------------------------------------------------------------
> > > > > > --
> > > > > > --
> > > > > > --
> > > > > > --
> > > > > > ----------
> > > > > > DEBUG 2:
> > > > > > DEBUG 2: Processing VGRD/P500 versus VGRD/P500, for
> > > > > > observation type ADPUPA, over region FULL, for
interpolation
> > > > > > method NEAREST(1), using
> > > > > > 0 pairs.
> > > > > > DEBUG 2:
> > > > > > DEBUG 2:
> > > > > >
--------------------------------------------------------------
> > > > > > --
> > > > > > --
> > > > > > --
> > > > > > --
> > > > > > ----------
> > > > > > DEBUG 2:
> > > > > > DEBUG 1: Output file:
> > > > > > ./point_stat_060000L_20150820_180000V.stat
> > > > > > DEBUG 1: Output file:
> > > > > > ./point_stat_060000L_20150820_180000V_fho.txt
> > > > > > DEBUG 1: Output file:
> > > > > > ./point_stat_060000L_20150820_180000V_ctc.txt
> > > > > > DEBUG 1: Output file:
> > > > > > ./point_stat_060000L_20150820_180000V_cts.txt
> > > > > > DEBUG 1: Output file:
> > > > > > ./point_stat_060000L_20150820_180000V_mctc.txt
> > > > > > DEBUG 1: Output file:
> > > > > > ./point_stat_060000L_20150820_180000V_mcts.txt
> > > > > > DEBUG 1: Output file:
> > > > > > ./point_stat_060000L_20150820_180000V_cnt.txt
> > > > > > DEBUG 1: Output file:
> > > > > > ./point_stat_060000L_20150820_180000V_sl1l2.txt
> > > > > > DEBUG 1: Output file:
> > > > > > ./point_stat_060000L_20150820_180000V_sal1l2.txt
> > > > > > DEBUG 1: Output file:
> > > > > > ./point_stat_060000L_20150820_180000V_vl1l2.txt
> > > > > > DEBUG 1: Output file:
> > > > > > ./point_stat_060000L_20150820_180000V_val1l2.txt
> > > > > > DEBUG 1: Output file:
> > > > > > ./point_stat_060000L_20150820_180000V_pct.txt
> > > > > > DEBUG 1: Output file:
> > > > > > ./point_stat_060000L_20150820_180000V_pstd.txt
> > > > > > DEBUG 1: Output file:
> > > > > > ./point_stat_060000L_20150820_180000V_pjc.txt
> > > > > > DEBUG 1: Output file:
> > > > > > ./point_stat_060000L_20150820_180000V_prc.txt
> > > > > > DEBUG 1: Output file:
> > > > > > ./point_stat_060000L_20150820_180000V_mpr.txt
> > > > > >
> > > > > >
> > > > > > Thanks for the help,
> > > > > > Jose
> > > > > >
> > > > > >
> > > > > > -----Original Message-----
> > > > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > > > Sent: Monday, March 14, 2016 12:17 PM
> > > > > > To: Jose Garcia-Rivera
> > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
> > > > > > PREPBUFR to NetCDF
> > > > > >
> > > > > > Hi Jose. I apologize for the delayed response. I was out
of
> > > > > > the office on Friday. I'm going to try to figure out a
> > > > > > solution and get back with you shortly.
> > > > > >
> > > > > > Julie
> > > > > >
> > > > > > On Fri, Mar 11, 2016 at 2:02 PM, Jose Garcia-Rivera via RT
<
> > > > > > met_help at ucar.edu> wrote:
> > > > > >
> > > > > > >
> > > > > > > <URL:
> > > > > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > > > >
> > > > > > >
> > > > > > > Dear Julie,
> > > > > > >
> > > > > > > Any news regarding pb2nc? We're still unable to make it
work.
> > > > > > >
> > > > > > > Best Regards,
> > > > > > > Jose
> > > > > > >
> > > > > > > -----Original Message-----
> > > > > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > > > > Sent: Thursday, March 10, 2016 4:20 PM
> > > > > > > To: Jose Garcia-Rivera
> > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
> > > > > > > PREPBUFR to NetCDF
> > > > > > >
> > > > > > > Hi Jose. Thank you for attaching the files.
> > > > > > >
> > > > > > > Could you please send me a list of the files in
> > > > > > > /work/apps/pgi_14.10/SANDY/bufrlib/lib?
> > > > > > >
> > > > > > > Thank you!
> > > > > > >
> > > > > > > Julie
> > > > > > >
> > > > > > >
> > > > > > > On Thu, Mar 10, 2016 at 12:20 PM, Jose Garcia-Rivera via
RT
> > > > > > > < met_help at ucar.edu> wrote:
> > > > > > >
> > > > > > > >
> > > > > > > > <URL:
> > > > > > > >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > > > > >
> > > > > > > >
> > > > > > > > Dear Julie,
> > > > > > > >
> > > > > > > > The administrator re-compiled MET following your
> > > > > > > > instructions, and says there's still trouble. He sent
me
> > > > > > > > the log files
> > > > (attached).
> > > > > > > > Is there any other approach that might help?
> > > > > > > >
> > > > > > > > Best Regards,
> > > > > > > > Jose
> > > > > > > >
> > > > > > > > -----Original Message-----
> > > > > > > > From: Julie Prestopnik via RT
[mailto:met_help at ucar.edu]
> > > > > > > > Sent: Wednesday, March 09, 2016 12:39 PM
> > > > > > > > To: Jose Garcia-Rivera
> > > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues
converting
> > > > > > > > PREPBUFR to NetCDF
> > > > > > > >
> > > > > > > > Thank you, Jose! It looks like something went wrong
> > > > > > > > during
> > > > > > compilation.
> > > > > > > > I suggest recompiling MET to see if we can get this
issue
> > > resolved.
> > > > > > > > NCEP's BUFRLIB is used by the pb2nc MET tool, and is a
> > > > > > > > required external library for pb2nc. MET is not yet
> > > > > > > > compatible with BUFRLIB
> > > > > > > version 11.0.0, so we
> > > > > > > > suggest getting version 10.2.3. We are working on
our
> online
> > > > > tutorial
> > > > > > > for
> > > > > > > > METv.5.1, but in the meantime, I'll point you to our
> > > > > > > > online tutorial directions for installing BUFRLIB:
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > http://www.dtcenter.org/met/users/support/online_tutorial/METv5.
> > > > > > > > 0/
> > > > > > > > co
> > > > > > > > mp
> > > > > > > > ilation/req_libs.php
> > > > > > > >
> > > > > > > > It is also important to review the necessary
environment
> > > > > > > > variables to
> > > > > > > set:
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > http://www.dtcenter.org/met/users/support/online_tutorial/METv5.
> > > > > > > > 0/
> > > > > > > > co
> > > > > > > > mp
> > > > > > > > ilation/configure.php
> > > > > > > >
> > > > > > > > For example,
> > > > > > > >
> > > > > > > > "Set *$MET_BUFR* to point to the main BUFR directory,
or
> > > > > > > > set
> > > > > > > > *$MET_BUFRLIB* to point to the directory with the BUFR
> > > > > > > > library
> > > > files.
> > > > > > > > Because MET doesn't use any BUFR library include
files,
> > > > > > > > you don't need to specify *$MET_BUFRINC* ."
> > > > > > > >
> > > > > > > > Once you've installed the required libraries and set
up
> > > > > > > > your environment variables, you'll be ready to
configure
> > > > > > > > MET (instructions at the bottom of the last link
above)
> > > > > > > > and then compile and install MET (
> > > > > > > >
> > http://www.dtcenter.org/met/users/support/online_tutorial/METv5.
> > > > > > > > 0/
> > > > > > > > co
> > > > > > > > mp
> > > > > > > > ilation/compile.php
> > > > > > > > ).
> > > > > > > > After re-installing MET, please run "make test" again.
If
> > > > > > > > you still encounter the same problem, please send me
your
> > > > > > > > *config.log* file and your *make_install.log *file.
> > > > > > > > Please let me know if you have any
> > > > > > > questions.
> > > > > > > >
> > > > > > > > Please let us know how it goes.
> > > > > > > >
> > > > > > > > Thanks,
> > > > > > > > Julie
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > On Wed, Mar 9, 2016 at 10:22 AM, Jose Garcia-Rivera
via RT
> > > > > > > > < met_help at ucar.edu> wrote:
> > > > > > > >
> > > > > > > > >
> > > > > > > > > <URL:
> > > > > > > > >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > > > > > >
> > > > > > > > >
> > > > > > > > > Dear Julie,
> > > > > > > > >
> > > > > > > > > Attached is the test log file. It's showing the same
> > > > > > > > > issues on pb2nc even with the sample files.
> > > > > > > > >
> > > > > > > > > Best Regards,
> > > > > > > > > Jose
> > > > > > > > >
> > > > > > > > > -----Original Message-----
> > > > > > > > > From: Julie Prestopnik via RT
[mailto:met_help at ucar.edu]
> > > > > > > > > Sent: Tuesday, March 08, 2016 5:28 PM
> > > > > > > > > To: Jose Garcia-Rivera
> > > > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues
converting
> > > > > > > > > PREPBUFR to NetCDF
> > > > > > > > >
> > > > > > > > > Hi Jose. Thank you for uploading the files.
> > > > > > > > > Unfortunately, I am unable to reproduce the error
you
> > > > > > > > > are experiencing. I am wondering if you have
> > > > > > > > > successfully used pb2nc before. As a check could
you
> > > > > > > > > please run the following in your met-5.1/
> > > > > directory:
> > > > > > > > >
> > > > > > > > > *make test >& make_test.log*
> > > > > > > > >
> > > > > > > > > and then send me the make_test.log file?
> > > > > > > > >
> > > > > > > > > Thanks,
> > > > > > > > > Julie
> > > > > > > > >
> > > > > > > > > On Tue, Mar 8, 2016 at 11:29 AM, Jose Garcia-Rivera
via
> > > > > > > > > RT < met_help at ucar.edu> wrote:
> > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > <URL:
> > > > > > > > > >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=7543
> > > > > > > > > > 3
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > Dear Julie,
> > > > > > > > > >
> > > > > > > > > > I just put the files in 'garcia_data'. I
appreciate
> > > > > > > > > > your
> > > help.
> > > > > > > > > >
> > > > > > > > > > Best Regards,
> > > > > > > > > > Jose
> > > > > > > > > >
> > > > > > > > > > -----Original Message-----
> > > > > > > > > > From: Julie Prestopnik via RT
> > > > > > > > > > [mailto:met_help at ucar.edu]
> > > > > > > > > > Sent: Tuesday, March 08, 2016 1:12 PM
> > > > > > > > > > To: Jose Garcia-Rivera
> > > > > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues
> > > > > > > > > > converting PREPBUFR to NetCDF
> > > > > > > > > >
> > > > > > > > > > Hi Jose. I'm sorry to hear that you are having
> > > > > > > > > > problems converting a PREPBUFR file to NetCDF.
> > > > > > > > > >
> > > > > > > > > > Please upload your input files and configuration
file
> > > > > > > > > > to our anonymous ftp site as follows:
> > > > > > > > > >
http://www.dtcenter.org/met/users/support/met_help.php
> > > > > > > > > >
> > > > > > > > > > Then I can take a look and get back to you.
> > > > > > > > > >
> > > > > > > > > > Thanks,
> > > > > > > > > > Julie
> > > > > > > > > >
> > > > > > > > > > On Tue, Mar 8, 2016 at 11:01 AM, Jose Garcia-
Rivera
> > > > > > > > > > via RT < met_help at ucar.edu> wrote:
> > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > Tue Mar 08 11:01:25 2016: Request 75433 was
acted upon.
> > > > > > > > > > > Transaction: Ticket created by GarciaJ at imsg.com
> > > > > > > > > > > Queue: met_help
> > > > > > > > > > > Subject: Issues converting PREPBUFR to
NetCDF
> > > > > > > > > > > Owner: Nobody
> > > > > > > > > > > Requestors: GarciaJ at imsg.com
> > > > > > > > > > > Status: new
> > > > > > > > > > > Ticket <URL:
> > > > > > > > > > >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75
> > > > > > > > > > > 43
> > > > > > > > > > > 3
> > > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > Dear Met Help,
> > > > > > > > > > >
> > > > > > > > > > > Trying to convert a PREPBUFR file to NetCDF.
> > > > > > > > > > >
> > > > > > > > > > > I used the default PB2NC configure file, and got
the
> > > > following:
> > > > > > > > > > >
> > > > > > > > > > > [garciaj at login prepbufr_obs]$ ./pb2nc
> > > > > > > > > > > gdas1.t12z.prepbufr.nr gdas.20150820.t12z.nc
> > > > > > > > > > > PB2NCConfig_default DEBUG 1: Default Config
> > > > > > > > > > > File:
> > > > > > > > > > > /work/apps/pgi_14.10/met-
5.1/share/met/config/PB2NCC
> > > > > > > > > > > on fi g_ de fa ul t DEBUG 1: User Config File:
> > > > > > > > > > > PB2NCConfig_default DEBUG 1: Creating NetCDF
File:
> > > > gdas.20150820.t12z.nc
> > > > > > > > > > > DEBUG 1: Processing PrepBufr File:
> > > > gdas1.t12z.prepbufr.nr
> > > > > > > > > > > DEBUG 1: Blocking PrepBufr file to:
> > > > > > /tmp/tmp_pb2nc_blk_32144_0
> > > > > > > > > > > WARNING:
> > > > > > > > > > > WARNING: process_pbfile() -> No PrepBufr
messages to
> > > > > > > > > > > process in
> > > > > > > file:
> > > > > > > > > > > gdas1.t12z.prepbufr.nr
> > > > > > > > > > > WARNING:
> > > > > > > > > > > ERROR :
> > > > > > > > > > > ERROR : write_netcdf_hdr_data() -> No PrepBufr
> > > > > > > > > > > messages
> > > > > > retained.
> > > > > > > > > > > Nothing to write.
> > > > > > > > > > > ERROR :
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > Thanks in advance for the help, Jose M.
> > > > > > > > > > > Garcia-Rivera, PhD IM Systems Group
> > > > > > > > > > > Rockville/College Park, MD This e-mail,
including
> > > > > > > > > > > attachments, may include confidential and/or
> > > > > > > > > > > proprietary information, and may be used only by
the
> > > > > > > > > > > person or entity to which it is addressed. If
the
> > > > > > > > > > > reader of this e-mail is not the intended
recipient
> > > > > > > > > > > or his or her authorized agent, the reader is
hereby
> > > > > > > > > > > notified that any dissemination, distribution or
> copying of this e-mail is prohibited.
> > > > > > > > > > > If you have received this e-mail in error,
please
> > > > > > > > > > > notify the sender by replying to this message
and
> > > > > > > > > > > delete this
> > > > > > > > > > e-mail immediately.
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > --
> > > > > > > > > > Julie Prestopnik
> > > > > > > > > > National Center for Atmospheric Research Research
> > > > > > > > > > Applications Laboratory
> > > > > > > > > > Phone: 303.497.8399
> > > > > > > > > > Email: jpresto at ucar.edu
> > > > > > > > > >
> > > > > > > > > > This e-mail, including attachments, may include
> > > > > > > > > > confidential and/or proprietary information, and
may
> > > > > > > > > > be used only by the person or entity to which it
is
> > > > > > > > > > addressed. If the reader of this e-mail is not the
> > > > > > > > > > intended recipient or his or her authorized agent,
the
> > > > > > > > > > reader is hereby notified that any dissemination,
> > > > > > > > > > distribution or copying of this e-mail is
prohibited.
> > > > > > > > > > If you have received this e-mail in error, please
> > > > > > > > > > notify the sender by replying to this message and
> > > > > > > > > > delete this
> > > > > > > > > e-mail immediately.
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > --
> > > > > > > > > Julie Prestopnik
> > > > > > > > > National Center for Atmospheric Research Research
> > > > > > > > > Applications Laboratory
> > > > > > > > > Phone: 303.497.8399
> > > > > > > > > Email: jpresto at ucar.edu
> > > > > > > > >
> > > > > > > > > This e-mail, including attachments, may include
> > > > > > > > > confidential and/or proprietary information, and may
be
> > > > > > > > > used only by the person or entity to which it is
> > > > > > > > > addressed. If the reader of this e-mail is not the
> > > > > > > > > intended recipient or his or her authorized agent,
the
> > > > > > > > > reader is hereby notified that any dissemination,
> > > > > > > > > distribution or copying of this e-mail is
prohibited. If
> > > > > > > > > you have received this e-mail in error, please
notify
> > > > > > > > > the sender by replying to this message and delete
this
> > > > > > > > e-mail immediately.
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > --
> > > > > > > > Julie Prestopnik
> > > > > > > > National Center for Atmospheric Research Research
> > > > > > > > Applications Laboratory
> > > > > > > > Phone: 303.497.8399
> > > > > > > > Email: jpresto at ucar.edu
> > > > > > > >
> > > > > > > > This e-mail, including attachments, may include
> > > > > > > > confidential and/or proprietary information, and may
be
> > > > > > > > used only by the person or entity to which it is
> > > > > > > > addressed. If the reader of this e-mail is not the
> > > > > > > > intended recipient or his or her authorized agent, the
> > > > > > > > reader is hereby notified that any dissemination,
> > > > > > > > distribution or copying of this e-mail is prohibited.
If
> > > > > > > > you have received this e-mail in error, please notify
the
> > > > > > > > sender by replying to this message and delete this
> > > > > > > e-mail immediately.
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > --
> > > > > > > Julie Prestopnik
> > > > > > > National Center for Atmospheric Research Research
> > > > > > > Applications Laboratory
> > > > > > > Phone: 303.497.8399
> > > > > > > Email: jpresto at ucar.edu
> > > > > > >
> > > > > > > This e-mail, including attachments, may include
confidential
> > > > > > > and/or proprietary information, and may be used only by
the
> > > > > > > person or entity to which it is addressed. If the reader
of
> > > > > > > this e-mail is not the intended recipient or his or her
> > > > > > > authorized agent, the reader is hereby notified that any
> > > > > > > dissemination, distribution or copying of this e-mail is
> > > > > > > prohibited. If you have received this e-mail in error,
> > > > > > > please notify the sender by replying to this message and
> > > > > > > delete this
> > > > > > e-mail immediately.
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > >
> > > > > >
> > > > > > --
> > > > > > Julie Prestopnik
> > > > > > National Center for Atmospheric Research Research
Applications
> > > > > > Laboratory
> > > > > > Phone: 303.497.8399
> > > > > > Email: jpresto at ucar.edu
> > > > > >
> > > > > > This e-mail, including attachments, may include
confidential
> > > > > > and/or proprietary information, and may be used only by
the
> > > > > > person or entity to which it is addressed. If the reader
of
> > > > > > this e-mail is not the intended recipient or his or her
> > > > > > authorized agent, the reader is hereby notified that any
> > > > > > dissemination, distribution or copying of this e-mail is
> > > > > > prohibited. If you have received this e-mail in error,
please
> > > > > > notify the sender by replying to this message and delete
this
> > > > > e-mail immediately.
> > > > > >
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > > > --
> > > > > Julie Prestopnik
> > > > > National Center for Atmospheric Research Research
Applications
> > > > > Laboratory
> > > > > Phone: 303.497.8399
> > > > > Email: jpresto at ucar.edu
> > > > >
> > > > > This e-mail, including attachments, may include confidential
> > > > > and/or proprietary information, and may be used only by the
> > > > > person or entity to which it is addressed. If the reader of
this
> > > > > e-mail is not the intended recipient or his or her
authorized
> > > > > agent, the reader is hereby notified that any dissemination,
> > > > > distribution or copying of this e-mail is prohibited. If you
> > > > > have received this e-mail in error, please notify the sender
by
> > > > > replying to this message and delete this
> > > > e-mail immediately.
> > > > >
> > > > >
> > > > >
> > > >
> > > >
> > > > --
> > > > Julie Prestopnik
> > > > National Center for Atmospheric Research Research Applications
> > > > Laboratory
> > > > Phone: 303.497.8399
> > > > Email: jpresto at ucar.edu
> > > >
> > > > This e-mail, including attachments, may include confidential
> > > > and/or proprietary information, and may be used only by the
person
> > > > or entity to which it is addressed. If the reader of this e-
mail
> > > > is not the intended recipient or his or her authorized agent,
the
> > > > reader is hereby notified that any dissemination, distribution
or
> > > > copying of this e-mail is prohibited. If you have received
this
> > > > e-mail in error, please notify the sender by replying to this
> > > > message and delete this
> > > e-mail immediately.
> > > >
> > > >
> > > >
> > >
> > >
> > > --
> > > Julie Prestopnik
> > > National Center for Atmospheric Research Research Applications
> > > Laboratory
> > > Phone: 303.497.8399
> > > Email: jpresto at ucar.edu
> > >
> > > This e-mail, including attachments, may include confidential
and/or
> > > proprietary information, and may be used only by the person or
> > > entity to which it is addressed. If the reader of this e-mail is
not
> > > the intended recipient or his or her authorized agent, the
reader is
> > > hereby notified that any dissemination, distribution or copying
of
> > > this e-mail is prohibited. If you have received this e-mail in
> > > error, please notify the sender by replying to this message and
> > > delete this
> > e-mail immediately.
> > >
> > >
> > >
> >
> >
> > --
> > Julie Prestopnik
> > National Center for Atmospheric Research Research Applications
> > Laboratory
> > Phone: 303.497.8399
> > Email: jpresto at ucar.edu
> >
> > This e-mail, including attachments, may include confidential
and/or
> > proprietary information, and may be used only by the person or
entity
> > to which it is addressed. If the reader of this e-mail is not the
> > intended recipient or his or her authorized agent, the reader is
> > hereby notified that any dissemination, distribution or copying of
> > this e-mail is prohibited. If you have received this e-mail in
error,
> > please notify the sender by replying to this message and delete
this
> e-mail immediately.
> >
> >
>
> This e-mail, including attachments, may include confidential and/or
> proprietary information, and may be used only by the person or
entity to
> which it is addressed. If the reader of this e-mail is not the
intended
> recipient or his or her authorized agent, the reader is hereby
notified
> that any dissemination, distribution or copying of this e-mail is
> prohibited. If you have received this e-mail in error, please notify
the
> sender by replying to this message and delete this e-mail
immediately.
>
>
>
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to NetCDF
From: Jose Garcia-Rivera
Time: Fri Mar 18 10:15:22 2016
Dear John,
I tried as you suggested, but still have empty output. I put the files
in your ftp in 'garcia_data'
The three files in the FTP are:
newtest.nc
nmbprs_d01.06
PointStatConfig
Output:
[garciaj at login prepbufr_obs]$ ./point_stat nmbprs_d01.06 newtest.nc
PointStatConfig_default
DEBUG 1: Default Config File: /work/apps/pgi_14.10/SANDY/met-
5.1/share/met/config/PointStatConfig_default
DEBUG 1: User Config File: PointStatConfig_default
GSL_RNG_TYPE=mt19937
GSL_RNG_SEED=18446744071614164054
DEBUG 1: Forecast File: nmbprs_d01.06
DEBUG 1: Observation File: newtest.nc
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Reading data for TMP/Z2.
DEBUG 2: For TMP/Z2 found 1 forecast levels and 0 climatology levels.
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Searching 949837 observations from 452408 messages.
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Processing TMP/Z2 versus TMP/Z2, for observation type ADPSFC,
over region FULL, for interpolation method NEAREST(1), using 0 pairs.
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V.stat
DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_fho.txt
DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_ctc.txt
DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_cts.txt
DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_mctc.txt
DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_mcts.txt
DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_cnt.txt
DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_sl1l2.txt
DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_sal1l2.txt
DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_vl1l2.txt
DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_val1l2.txt
DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_pct.txt
DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_pstd.txt
DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_pjc.txt
DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_prc.txt
DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_mpr.txt
>From config file:
fcst = {
message_type = [ "ADPSFC" ];
sid_exc = [];
field = [
{
name = "TMP";
level = [ "Z2" ];
cat_thresh = [ >293.0 ];
}
];
Thanks for the help,
Jose
-----Original Message-----
From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
Sent: Thursday, March 17, 2016 5:47 PM
To: Jose Garcia-Rivera
Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to
NetCDF
Jose,
I see that you're doing an upper-air (ADPUPA) evaluation for the time
20150820_180000. Upper-air observations are much more common at 00Z
and 12Z than 06Z and 18Z. Instead of verifying the 06 hour forecast
valid at 18Z, please try the 12 hour forecast valid at 00Z.
Also, you could try evaluating some surface fields against the ADPSFC
message type.
If you get stuck, you can post a sample forecast file to our anonymous
ftp site, and I can try running it here.
Thanks,
John
On Thu, Mar 17, 2016 at 2:39 PM, Jose Garcia-Rivera via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
>
> Dear John,
>
> It's great to hear from you again! Julie has been of great help. We
> highly appreciate all the help coming from your team.
>
> I followed your recommendation, and got the following:
>
> [garciaj at login prepbufr_obs]$ ./point_stat -v 3 nmbprs_d01.06
> newtest.nc PointStatConfig_default DEBUG 1: Default Config File:
> /work/apps/pgi_14.10/SANDY/met-
5.1/share/met/config/PointStatConfig_de
> fault DEBUG 1: User Config File: PointStatConfig_default
> GSL_RNG_TYPE=mt19937
> GSL_RNG_SEED=1041230678
> DEBUG 1: Forecast File: nmbprs_d01.06
> DEBUG 1: Observation File: newtest.nc
> DEBUG 2:
> DEBUG 2:
>
----------------------------------------------------------------------
> ----------
> DEBUG 2:
> DEBUG 2: Reading data for SPFH/P500.
> DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found range match
for
> VarInfo "SPFH/P500" in GRIB record 134 of GRIB file "nmbprs_d01.06".
> DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found 1 GRIB
records
> matching VarInfo "SPFH/P500" in GRIB file "nmbprs_d01.06".
> DEBUG 3: Use the matching forecast and observation grids.
> DEBUG 3: Grid Definition: Projection: Lambert Conformal Nx: 400 Ny:
> 400
> Lat_LL: 33.302 Lon_LL: 84.951 Lon_orient: 77.459 Alpha: 3781.822
Cone:
> 0.629 Bx: 210.6765 By: 2557.3266
> DEBUG 2: For SPFH/P500 found 1 forecast levels and 0 climatology
levels.
> DEBUG 2:
> DEBUG 2:
>
----------------------------------------------------------------------
> ----------
> DEBUG 2:
> DEBUG 2: Reading data for TMP/P500.
> DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found range match
for
> VarInfo "TMP/P500" in GRIB record 131 of GRIB file "nmbprs_d01.06".
> DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found 1 GRIB
records
> matching VarInfo "TMP/P500" in GRIB file "nmbprs_d01.06".
> DEBUG 2: For TMP/P500 found 1 forecast levels and 0 climatology
levels.
> DEBUG 2:
> DEBUG 2:
>
----------------------------------------------------------------------
> ----------
> DEBUG 2:
> DEBUG 2: Reading data for HGT/P500.
> DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found range match
for
> VarInfo "HGT/P500" in GRIB record 130 of GRIB file "nmbprs_d01.06".
> DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found 1 GRIB
records
> matching VarInfo "HGT/P500" in GRIB file "nmbprs_d01.06".
> DEBUG 2: For HGT/P500 found 1 forecast levels and 0 climatology
levels.
> DEBUG 2:
> DEBUG 2:
>
----------------------------------------------------------------------
> ----------
> DEBUG 2:
> DEBUG 2: Reading data for UGRD/P500.
> DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found range match
for
> VarInfo "UGRD/P500" in GRIB record 137 of GRIB file "nmbprs_d01.06".
> DEBUG 3: MetGrib1DataFile::rotate_winds() -> Have U-wind record,
> reading V-wind record.
> DEBUG 3: MetGrib1DataFile::data_plane_scalar() -> Found exact match
> for VarInfo "UGRD/P500" in GRIB record 138 of GRIB file
"nmbprs_d01.06".
> DEBUG 3: Rotating U and V wind components from grid-relative to
> earth-relative.
> DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found 1 GRIB
records
> matching VarInfo "UGRD/P500" in GRIB file "nmbprs_d01.06".
> DEBUG 2: For UGRD/P500 found 1 forecast levels and 0 climatology
levels.
> DEBUG 2:
> DEBUG 2:
>
----------------------------------------------------------------------
> ----------
> DEBUG 2:
> DEBUG 2: Reading data for VGRD/P500.
> DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found range match
for
> VarInfo "VGRD/P500" in GRIB record 138 of GRIB file "nmbprs_d01.06".
> DEBUG 3: MetGrib1DataFile::rotate_winds() -> Have V-wind record,
> reading U-wind record.
> DEBUG 3: MetGrib1DataFile::data_plane_scalar() -> Found exact match
> for VarInfo "VGRD/P500" in GRIB record 137 of GRIB file
"nmbprs_d01.06".
> DEBUG 3: Rotating U and V wind components from grid-relative to
> earth-relative.
> DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found 1 GRIB
records
> matching VarInfo "VGRD/P500" in GRIB file "nmbprs_d01.06".
> DEBUG 2: For VGRD/P500 found 1 forecast levels and 0 climatology
levels.
> DEBUG 2:
> DEBUG 2:
>
----------------------------------------------------------------------
> ----------
> DEBUG 2:
> DEBUG 2: Searching 949837 observations from 452408 messages.
> DEBUG 2:
> DEBUG 2:
>
----------------------------------------------------------------------
> ----------
> DEBUG 2:
> DEBUG 2: Processing SPFH/P500 versus SPFH/P500, for observation type
> ADPUPA, over region FULL, for interpolation method NEAREST(1), using
0
> pairs.
> DEBUG 3: Number of matched pairs = 0
> DEBUG 3: Observations processed = 949837
> DEBUG 3: Rejected: SID exclusion = 0
> DEBUG 3: Rejected: GRIB code = 947898
> DEBUG 3: Rejected: valid time = 1416
> DEBUG 3: Rejected: bad obs value = 0
> DEBUG 3: Rejected: off the grid = 523
> DEBUG 3: Rejected: level mismatch = 0
> DEBUG 3: Rejected: quality marker = 0
> DEBUG 3: Rejected: message type = 0
> DEBUG 3: Rejected: masking region = 0
> DEBUG 3: Rejected: bad fcst value = 0
> DEBUG 3: Rejected: duplicates = 0
> DEBUG 2:
> DEBUG 2:
>
----------------------------------------------------------------------
> ----------
> DEBUG 2:
> DEBUG 2: Processing TMP/P500 versus TMP/P500, for observation type
> ADPUPA, over region FULL, for interpolation method NEAREST(1), using
0 pairs.
> DEBUG 3: Number of matched pairs = 0
> DEBUG 3: Observations processed = 949837
> DEBUG 3: Rejected: SID exclusion = 0
> DEBUG 3: Rejected: GRIB code = 943848
> DEBUG 3: Rejected: valid time = 4191
> DEBUG 3: Rejected: bad obs value = 0
> DEBUG 3: Rejected: off the grid = 1798
> DEBUG 3: Rejected: level mismatch = 0
> DEBUG 3: Rejected: quality marker = 0
> DEBUG 3: Rejected: message type = 0
> DEBUG 3: Rejected: masking region = 0
> DEBUG 3: Rejected: bad fcst value = 0
> DEBUG 3: Rejected: duplicates = 0
> DEBUG 2:
> DEBUG 2:
>
----------------------------------------------------------------------
> ----------
> DEBUG 2:
> DEBUG 2: Processing HGT/P500 versus HGT/P500, for observation type
> ADPUPA, over region FULL, for interpolation method NEAREST(1), using
0 pairs.
> DEBUG 3: Number of matched pairs = 0
> DEBUG 3: Observations processed = 949837
> DEBUG 3: Rejected: SID exclusion = 0
> DEBUG 3: Rejected: GRIB code = 606744
> DEBUG 3: Rejected: valid time = 319085
> DEBUG 3: Rejected: bad obs value = 0
> DEBUG 3: Rejected: off the grid = 23610
> DEBUG 3: Rejected: level mismatch = 395 DEBUG 3: Rejected: quality
> marker = 0
> DEBUG 3: Rejected: message type = 3
> DEBUG 3: Rejected: masking region = 0
> DEBUG 3: Rejected: bad fcst value = 0
> DEBUG 3: Rejected: duplicates = 0
> DEBUG 2:
> DEBUG 2:
>
----------------------------------------------------------------------
> ----------
> DEBUG 2:
> DEBUG 2: Processing UGRD/P500 versus UGRD/P500, for observation type
> ADPUPA, over region FULL, for interpolation method NEAREST(1), using
0
> pairs.
> DEBUG 3: Number of matched pairs = 0
> DEBUG 3: Observations processed = 949837
> DEBUG 3: Rejected: SID exclusion = 0
> DEBUG 3: Rejected: GRIB code = 650429
> DEBUG 3: Rejected: valid time = 277745
> DEBUG 3: Rejected: bad obs value = 0
> DEBUG 3: Rejected: off the grid = 21341
> DEBUG 3: Rejected: level mismatch = 319 DEBUG 3: Rejected: quality
> marker = 0
> DEBUG 3: Rejected: message type = 3
> DEBUG 3: Rejected: masking region = 0
> DEBUG 3: Rejected: bad fcst value = 0
> DEBUG 3: Rejected: duplicates = 0
> DEBUG 2:
> DEBUG 2:
>
----------------------------------------------------------------------
> ----------
> DEBUG 2:
> DEBUG 2: Processing VGRD/P500 versus VGRD/P500, for observation type
> ADPUPA, over region FULL, for interpolation method NEAREST(1), using
0
> pairs.
> DEBUG 3: Number of matched pairs = 0
> DEBUG 3: Observations processed = 949837
> DEBUG 3: Rejected: SID exclusion = 0
> DEBUG 3: Rejected: GRIB code = 650429
> DEBUG 3: Rejected: valid time = 277745
> DEBUG 3: Rejected: bad obs value = 0
> DEBUG 3: Rejected: off the grid = 21341
> DEBUG 3: Rejected: level mismatch = 319 DEBUG 3: Rejected: quality
> marker = 0
> DEBUG 3: Rejected: message type = 3
> DEBUG 3: Rejected: masking region = 0
> DEBUG 3: Rejected: bad fcst value = 0
> DEBUG 3: Rejected: duplicates = 0
> DEBUG 2:
> DEBUG 2:
>
----------------------------------------------------------------------
> ----------
> DEBUG 2:
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V.stat
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_fho.txt
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_ctc.txt
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_cts.txt
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_mctc.txt
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_mcts.txt
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_cnt.txt
> DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_sl1l2.txt
> DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_sal1l2.txt
> DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_vl1l2.txt
> DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_val1l2.txt
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_pct.txt
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_pstd.txt
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_pjc.txt
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_prc.txt
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_mpr.txt
>
>
>
> Best Regards,
> Jose
>
>
>
>
>
> -----Original Message-----
> From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> Sent: Thursday, March 17, 2016 3:29 PM
> To: Jose Garcia-Rivera
> Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to
> NetCDF
>
> Hello Jose,
>
> Julie is out of the office today, but I should be able to help you.
> Glad you were able to finally get PB2NC working. That was a tricky
> one! But it helped us realize that since BUFRLIB has changed to
> FORTRAN 90, we should update the MET code which calls BUFRLIB to be
compatible.
>
> I see that you are now getting 0 matched pairs when you run Point-
Stat
> with the output of PB2NC. Please try rerunning Point-Stat but use a
> higher verbosity level, like "-v 3". That'll print out the
following
> type of counts for each of the verification tasks you've defined in
the config file:
>
> DEBUG 3: Number of matched pairs = 312
> DEBUG 3: Observations processed = 87753
> DEBUG 3: Rejected: SID exclusion = 0
> DEBUG 3: Rejected: GRIB code = 77648
> DEBUG 3: Rejected: valid time = 0
> DEBUG 3: Rejected: bad obs value = 0
> DEBUG 3: Rejected: off the grid = 5
> DEBUG 3: Rejected: level mismatch = 9219 DEBUG 3: Rejected: quality
> marker = 0
> DEBUG 3: Rejected: message type = 537
> DEBUG 3: Rejected: masking region = 32 DEBUG 3: Rejected: bad fcst
> value = 0
> DEBUG 3: Rejected: duplicates = 0
>
> In the example above, 87753 observation values were checked and the
> counts list reasons why there were not used for that task. Out of
> those 87753 obs, 312 of them were used for this task.
>
> Looking at the counts from your Point-Stat run should help you
figure
> out why you have 0 matched pairs.
>
> Thanks,
> John
>
>
> On Thu, Mar 17, 2016 at 12:29 PM, Jose Garcia-Rivera via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> >
> > Dear Julie,
> >
> > We got the executables to work! However, I have a couple of
> > issues/questions:
> >
> >
> >
> > Issue #1 --- Not getting values after running point_stat
> >
> > Everything seems to run fine. I attached the configuration file. I
> > can send the three files via FTP if needed.
> >
> >
> >
> > Issue #2 --- PB2NC doesn't seem to finish the job, but it does? I
> > had to do CTRL+C, and checked the netCDF file using ncl_filedump:
> >
> > [garciaj at login prepbufr_obs]$ ./pb2nc
prepbufr.gdas.20150820.t18z.nr
> > newtest.nc PB2NCConfig_default DEBUG 1: Default Config File:
> > /work/apps/pgi_14.10/SANDY/met-
5.1/share/met/config/PB2NCConfig_defa
> > ul t DEBUG 1: User Config File: PB2NCConfig_default
> > DEBUG 1: Creating NetCDF File: newtest.nc
> > DEBUG 1: Processing PrepBufr File:
prepbufr.gdas.20150820.t18z.nr
> > DEBUG 1: Blocking PrepBufr file to: /tmp/tmp_pb2nc_blk_17703_0
> > DEBUG 2: PrepBufr Time Center: 20150820_180000
> > DEBUG 2: Searching Time Window: 20150820_163000 to
> 20150820_193000
> > DEBUG 2: Processing 685386 PrepBufr messages...
> > 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85%
> > 90% 95% 100%
> > DEBUG 2: Total PrepBufr Messages processed = 685386
> > DEBUG 2: Rejected based on message type = 0
> > DEBUG 2: Rejected based on station id = 0
> > DEBUG 2: Rejected based on valid time = 185145
> > DEBUG 2: Rejected based on masking grid = 0
> > DEBUG 2: Rejected based on masking polygon = 0
> > DEBUG 2: Rejected based on elevation = 0
> > DEBUG 2: Rejected based on pb report type = 0
> > DEBUG 2: Rejected based on input report type = 0
> > DEBUG 2: Rejected based on instrument type = 0
> > DEBUG 2: Rejected based on zero observations = 47833
> > DEBUG 2: Total PrepBufr Messages retained = 452408
> > DEBUG 2: Total observations retained or derived = 949837 ^C
> >
> >
> > Checking netCDF file:
> >
> > [garciaj at login prepbufr_obs]$ ncl_filedump newtest.nc Copyright
(C)
> > 1995-2015 - All Rights Reserved University Corporation for
> > Atmospheric Research NCAR Command Language Version 6.3.0 The use
> > of this software is governed by a License Agreement.
> > See http://www.ncl.ucar.edu/ for more details.
> >
> > Variable: f
> > Type: file
> > filename: newtest
> > path: newtest.nc
> > file global attributes:
> > FileOrigins : File newtest.nc generated 20160317_155548 UTC
on
> > host login.local by the MET pb2nc tool
> > MET_version : V5.1
> > MET_tool : pb2nc
> > dimensions:
> > mxstr = 16
> > hdr_arr_len = 3
> > obs_arr_len = 5
> > nobs = 949837 // unlimited
> > nhdr = 452408
> > variables:
> > character obs_qty ( nobs, mxstr )
> > long_name : quality flag
> >
> > float obs_arr ( nobs, obs_arr_len )
> > long_name : array of observation values
> > _fill_value : -9999
> > columns : hdr_id gc lvl hgt ob
> > hdr_id_long_name : index of matching header data
> > gc_long_name : grib code corresponding to the observation
type
> > lvl_long_name : pressure level (hPa) or
accumulation
> > interval (sec)
> > hgt_long_name : height in meters above sea level
(msl)
> > ob_long_name : observation value
> >
> > character hdr_typ ( nhdr, mxstr )
> > long_name : message type
> >
> > character hdr_sid ( nhdr, mxstr )
> > long_name : station identification
> >
> > character hdr_vld ( nhdr, mxstr )
> > long_name : valid time
> > units : YYYYMMDD_HHMMSS
> >
> > float hdr_arr ( nhdr, hdr_arr_len )
> > long_name : array of observation station header values
> > _fill_value : -9999
> > columns : lat lon elv
> > lat_long_name : latitude
> > lat_units : degrees_north
> > lon_long_name : longitude
> > lon_units : degrees_east
> > elv_long_name : elevation
> > elv_units : meters above sea level (msl)
> >
> >
> >
> >
> > Thanks for all the help,
> > Jose
> >
> >
> >
> >
> >
> >
> > -----Original Message-----
> > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > Sent: Wednesday, March 16, 2016 4:40 PM
> > To: Jose Garcia-Rivera
> > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR
to
> > NetCDF
> >
> > Hi Jose. I apologize for the delay. This was a tricky problem to
> > figure out, however, we were finally able to reproduce the error
you
> > are receiving for pb2nc.
> >
> > The problem is BUFRLIB being compiled with pgf90 and MET being
> > compiled with pgf77. They aren't talking well to each other.
> > BUFRLIBv10.1.0 compiles with pgf77 but later versions require
pgf90.
> >
> > We will plan on updating the MET Fortran code to compile with
pgf90
> > so that we can use newer BUFRLIB versions, but for now, to solve
> > your problem, I have attached BUFRLIB_v10-1-0.tar. Please install
> > that version of BUFRLIB using pgf77 and then recompile MET without
> > the "LIBS" environment variable setting?
> >
> > Please let me know how that goes. We were able to get a
successful
> > run using that solution and hope you will too.
> >
> > Thanks,
> > Julie
> >
> >
> > On Wed, Mar 16, 2016 at 12:17 PM, Jose Garcia-Rivera via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> > >
> > > Dear Julie,
> > >
> > > Is there anything that we can do here to sort these issues out?
> > >
> > > Best Regards,
> > > Jose
> > >
> > > -----Original Message-----
> > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > Sent: Tuesday, March 15, 2016 5:08 PM
> > > To: Jose Garcia-Rivera
> > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR
> > > to NetCDF
> > >
> > > Hi Jose. I was not. I got the same error you did. I believe
> > > that the test.nc file is not in the correct format needed by
> > > point_stat, so I think we need to get pb2nc working for you. It
> > > is likely a communication problem between the C code and the
Fortran code.
> > >
> > > Julie
> > >
> > > On Tue, Mar 15, 2016 at 3:05 PM, Jose Garcia-Rivera via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
>
> > > >
> > > > Dear Julie,
> > > >
> > > > Quick question: Were you able to run point_stat with the
netCDF
> > > > file that I sent yesterday?
> > > >
> > > > Thanks for the help,
> > > > Jose
> > > >
> > > > -----Original Message-----
> > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > Sent: Tuesday, March 15, 2016 12:17 PM
> > > > To: Jose Garcia-Rivera
> > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
PREPBUFR
> > > > to NetCDF
> > > >
> > > > Thank you, Jose. I'm working with co-workers to try to get
> > > > these issues resolved. I hope to get back to you soon.
> > > >
> > > > Julie
> > > >
> > > > On Mon, Mar 14, 2016 at 1:36 PM, Jose Garcia-Rivera via RT <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > > >
> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > >
> > > > >
> > > > > Dear Julie,
> > > > >
> > > > > I just uploaded the three files to 'garcia_data'.
> > > > >
> > > > > Thanks for the help,
> > > > > Jose
> > > > >
> > > > >
> > > > > -----Original Message-----
> > > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > > Sent: Monday, March 14, 2016 3:32 PM
> > > > > To: Jose Garcia-Rivera
> > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
> > > > > PREPBUFR to NetCDF
> > > > >
> > > > > Hi Jose.
> > > > >
> > > > > Yes, please upload your input files and configuration file
> > > > > (nmbprs_d01.06, test.nc, PointStatConfig_default) to our
> > > > > anonymous ftp
> > > > site as follows:
> > > > > http://www.dtcenter.org/met/users/support/met_help.php
> > > > >
> > > > > Thanks!
> > > > >
> > > > > Julie
> > > > >
> > > > > On Mon, Mar 14, 2016 at 1:06 PM, Jose Garcia-Rivera via RT <
> > > > > met_help at ucar.edu> wrote:
> > > > >
> > > > > >
> > > > > > <URL:
> > > > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > > >
> > > > > >
> > > > > > Dear Julie,
> > > > > >
> > > > > > I got to convert my prepbufr file using a python script.
> > > > > > However, I have trouble running point_stat. Can I send you
> > > > > > the files, to see if you have the same issue?
> > > > > >
> > > > > >
> > > > > > This is what I got:
> > > > > >
> > > > > > [garciaj at login prepbufr_obs]$ ./point_stat nmbprs_d01.06
> > > > > > test.nc PointStatConfig_default DEBUG 1: Default Config
File:
> > > > > > /work/apps/pgi_14.10/SANDY/met-
5.1/share/met/config/PointSta
> > > > > > tC on fi g_ de fault DEBUG 1: User Config File:
> > > > > > PointStatConfig_default
> > > > > > GSL_RNG_TYPE=mt19937
> > > > > > GSL_RNG_SEED=18446744073425053526 DEBUG 1: Forecast File:
> > > > > > nmbprs_d01.06 DEBUG 1: Observation File:
> > > > > > test.nc DEBUG 2:
> > > > > > DEBUG 2:
> > > > > >
------------------------------------------------------------
> > > > > > --
> > > > > > --
> > > > > > --
> > > > > > --
> > > > > > --
> > > > > > ----------
> > > > > > DEBUG 2:
> > > > > > DEBUG 2: Reading data for SPFH/P500.
> > > > > > DEBUG 2: For SPFH/P500 found 1 forecast levels and 0
> > > > > > climatology
> > > > levels.
> > > > > > DEBUG 2:
> > > > > > DEBUG 2:
> > > > > >
------------------------------------------------------------
> > > > > > --
> > > > > > --
> > > > > > --
> > > > > > --
> > > > > > --
> > > > > > ----------
> > > > > > DEBUG 2:
> > > > > > DEBUG 2: Reading data for TMP/P500.
> > > > > > DEBUG 2: For TMP/P500 found 1 forecast levels and 0
> > > > > > climatology
> > > levels.
> > > > > > DEBUG 2:
> > > > > > DEBUG 2:
> > > > > >
------------------------------------------------------------
> > > > > > --
> > > > > > --
> > > > > > --
> > > > > > --
> > > > > > --
> > > > > > ----------
> > > > > > DEBUG 2:
> > > > > > DEBUG 2: Reading data for HGT/P500.
> > > > > > DEBUG 2: For HGT/P500 found 1 forecast levels and 0
> > > > > > climatology
> > > levels.
> > > > > > DEBUG 2:
> > > > > > DEBUG 2:
> > > > > >
------------------------------------------------------------
> > > > > > --
> > > > > > --
> > > > > > --
> > > > > > --
> > > > > > --
> > > > > > ----------
> > > > > > DEBUG 2:
> > > > > > DEBUG 2: Reading data for UGRD/P500.
> > > > > > DEBUG 2: For UGRD/P500 found 1 forecast levels and 0
> > > > > > climatology
> > > > levels.
> > > > > > DEBUG 2:
> > > > > > DEBUG 2:
> > > > > >
------------------------------------------------------------
> > > > > > --
> > > > > > --
> > > > > > --
> > > > > > --
> > > > > > --
> > > > > > ----------
> > > > > > DEBUG 2:
> > > > > > DEBUG 2: Reading data for VGRD/P500.
> > > > > > DEBUG 2: For VGRD/P500 found 1 forecast levels and 0
> > > > > > climatology
> > > > levels.
> > > > > > DEBUG 2:
> > > > > > DEBUG 2:
> > > > > >
------------------------------------------------------------
> > > > > > --
> > > > > > --
> > > > > > --
> > > > > > --
> > > > > > --
> > > > > > ----------
> > > > > > DEBUG 2:
> > > > > > WARNING:
> > > > > > WARNING: process_obs_file() -> can't open observation
netCDF
> file:
> > > > > > test.nc
> > > > > > WARNING:
> > > > > > DEBUG 2:
> > > > > > DEBUG 2:
> > > > > >
------------------------------------------------------------
> > > > > > --
> > > > > > --
> > > > > > --
> > > > > > --
> > > > > > --
> > > > > > ----------
> > > > > > DEBUG 2:
> > > > > > DEBUG 2: Processing SPFH/P500 versus SPFH/P500, for
> > > > > > observation type ADPUPA, over region FULL, for
interpolation
> > > > > > method NEAREST(1), using
> > > > > > 0 pairs.
> > > > > > DEBUG 2:
> > > > > > DEBUG 2:
> > > > > >
------------------------------------------------------------
> > > > > > --
> > > > > > --
> > > > > > --
> > > > > > --
> > > > > > --
> > > > > > ----------
> > > > > > DEBUG 2:
> > > > > > DEBUG 2: Processing TMP/P500 versus TMP/P500, for
> > > > > > observation type ADPUPA, over region FULL, for
interpolation
> > > > > > method NEAREST(1), using
> > > > > > 0
> > > > > pairs.
> > > > > > DEBUG 2:
> > > > > > DEBUG 2:
> > > > > >
------------------------------------------------------------
> > > > > > --
> > > > > > --
> > > > > > --
> > > > > > --
> > > > > > --
> > > > > > ----------
> > > > > > DEBUG 2:
> > > > > > DEBUG 2: Processing HGT/P500 versus HGT/P500, for
> > > > > > observation type ADPUPA, over region FULL, for
interpolation
> > > > > > method NEAREST(1), using
> > > > > > 0
> > > > > pairs.
> > > > > > DEBUG 2:
> > > > > > DEBUG 2:
> > > > > >
------------------------------------------------------------
> > > > > > --
> > > > > > --
> > > > > > --
> > > > > > --
> > > > > > --
> > > > > > ----------
> > > > > > DEBUG 2:
> > > > > > DEBUG 2: Processing UGRD/P500 versus UGRD/P500, for
> > > > > > observation type ADPUPA, over region FULL, for
interpolation
> > > > > > method NEAREST(1), using
> > > > > > 0 pairs.
> > > > > > DEBUG 2:
> > > > > > DEBUG 2:
> > > > > >
------------------------------------------------------------
> > > > > > --
> > > > > > --
> > > > > > --
> > > > > > --
> > > > > > --
> > > > > > ----------
> > > > > > DEBUG 2:
> > > > > > DEBUG 2: Processing VGRD/P500 versus VGRD/P500, for
> > > > > > observation type ADPUPA, over region FULL, for
interpolation
> > > > > > method NEAREST(1), using
> > > > > > 0 pairs.
> > > > > > DEBUG 2:
> > > > > > DEBUG 2:
> > > > > >
------------------------------------------------------------
> > > > > > --
> > > > > > --
> > > > > > --
> > > > > > --
> > > > > > --
> > > > > > ----------
> > > > > > DEBUG 2:
> > > > > > DEBUG 1: Output file:
> > > > > > ./point_stat_060000L_20150820_180000V.stat
> > > > > > DEBUG 1: Output file:
> > > > > > ./point_stat_060000L_20150820_180000V_fho.txt
> > > > > > DEBUG 1: Output file:
> > > > > > ./point_stat_060000L_20150820_180000V_ctc.txt
> > > > > > DEBUG 1: Output file:
> > > > > > ./point_stat_060000L_20150820_180000V_cts.txt
> > > > > > DEBUG 1: Output file:
> > > > > > ./point_stat_060000L_20150820_180000V_mctc.txt
> > > > > > DEBUG 1: Output file:
> > > > > > ./point_stat_060000L_20150820_180000V_mcts.txt
> > > > > > DEBUG 1: Output file:
> > > > > > ./point_stat_060000L_20150820_180000V_cnt.txt
> > > > > > DEBUG 1: Output file:
> > > > > > ./point_stat_060000L_20150820_180000V_sl1l2.txt
> > > > > > DEBUG 1: Output file:
> > > > > > ./point_stat_060000L_20150820_180000V_sal1l2.txt
> > > > > > DEBUG 1: Output file:
> > > > > > ./point_stat_060000L_20150820_180000V_vl1l2.txt
> > > > > > DEBUG 1: Output file:
> > > > > > ./point_stat_060000L_20150820_180000V_val1l2.txt
> > > > > > DEBUG 1: Output file:
> > > > > > ./point_stat_060000L_20150820_180000V_pct.txt
> > > > > > DEBUG 1: Output file:
> > > > > > ./point_stat_060000L_20150820_180000V_pstd.txt
> > > > > > DEBUG 1: Output file:
> > > > > > ./point_stat_060000L_20150820_180000V_pjc.txt
> > > > > > DEBUG 1: Output file:
> > > > > > ./point_stat_060000L_20150820_180000V_prc.txt
> > > > > > DEBUG 1: Output file:
> > > > > > ./point_stat_060000L_20150820_180000V_mpr.txt
> > > > > >
> > > > > >
> > > > > > Thanks for the help,
> > > > > > Jose
> > > > > >
> > > > > >
> > > > > > -----Original Message-----
> > > > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > > > Sent: Monday, March 14, 2016 12:17 PM
> > > > > > To: Jose Garcia-Rivera
> > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
> > > > > > PREPBUFR to NetCDF
> > > > > >
> > > > > > Hi Jose. I apologize for the delayed response. I was out
> > > > > > of the office on Friday. I'm going to try to figure out a
> > > > > > solution and get back with you shortly.
> > > > > >
> > > > > > Julie
> > > > > >
> > > > > > On Fri, Mar 11, 2016 at 2:02 PM, Jose Garcia-Rivera via RT
<
> > > > > > met_help at ucar.edu> wrote:
> > > > > >
> > > > > > >
> > > > > > > <URL:
> > > > > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > > > >
> > > > > > >
> > > > > > > Dear Julie,
> > > > > > >
> > > > > > > Any news regarding pb2nc? We're still unable to make it
work.
> > > > > > >
> > > > > > > Best Regards,
> > > > > > > Jose
> > > > > > >
> > > > > > > -----Original Message-----
> > > > > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > > > > Sent: Thursday, March 10, 2016 4:20 PM
> > > > > > > To: Jose Garcia-Rivera
> > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
> > > > > > > PREPBUFR to NetCDF
> > > > > > >
> > > > > > > Hi Jose. Thank you for attaching the files.
> > > > > > >
> > > > > > > Could you please send me a list of the files in
> > > > > > > /work/apps/pgi_14.10/SANDY/bufrlib/lib?
> > > > > > >
> > > > > > > Thank you!
> > > > > > >
> > > > > > > Julie
> > > > > > >
> > > > > > >
> > > > > > > On Thu, Mar 10, 2016 at 12:20 PM, Jose Garcia-Rivera via
> > > > > > > RT < met_help at ucar.edu> wrote:
> > > > > > >
> > > > > > > >
> > > > > > > > <URL:
> > > > > > > >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > > > > >
> > > > > > > >
> > > > > > > > Dear Julie,
> > > > > > > >
> > > > > > > > The administrator re-compiled MET following your
> > > > > > > > instructions, and says there's still trouble. He sent
me
> > > > > > > > the log files
> > > > (attached).
> > > > > > > > Is there any other approach that might help?
> > > > > > > >
> > > > > > > > Best Regards,
> > > > > > > > Jose
> > > > > > > >
> > > > > > > > -----Original Message-----
> > > > > > > > From: Julie Prestopnik via RT
[mailto:met_help at ucar.edu]
> > > > > > > > Sent: Wednesday, March 09, 2016 12:39 PM
> > > > > > > > To: Jose Garcia-Rivera
> > > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues
converting
> > > > > > > > PREPBUFR to NetCDF
> > > > > > > >
> > > > > > > > Thank you, Jose! It looks like something went wrong
> > > > > > > > during
> > > > > > compilation.
> > > > > > > > I suggest recompiling MET to see if we can get this
> > > > > > > > issue
> > > resolved.
> > > > > > > > NCEP's BUFRLIB is used by the pb2nc MET tool, and is a
> > > > > > > > required external library for pb2nc. MET is not yet
> > > > > > > > compatible with BUFRLIB
> > > > > > > version 11.0.0, so we
> > > > > > > > suggest getting version 10.2.3. We are working on
our
> online
> > > > > tutorial
> > > > > > > for
> > > > > > > > METv.5.1, but in the meantime, I'll point you to our
> > > > > > > > online tutorial directions for installing BUFRLIB:
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > http://www.dtcenter.org/met/users/support/online_tutorial/METv5.
> > > > > > > > 0/
> > > > > > > > co
> > > > > > > > mp
> > > > > > > > ilation/req_libs.php
> > > > > > > >
> > > > > > > > It is also important to review the necessary
environment
> > > > > > > > variables to
> > > > > > > set:
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > http://www.dtcenter.org/met/users/support/online_tutorial/METv5.
> > > > > > > > 0/
> > > > > > > > co
> > > > > > > > mp
> > > > > > > > ilation/configure.php
> > > > > > > >
> > > > > > > > For example,
> > > > > > > >
> > > > > > > > "Set *$MET_BUFR* to point to the main BUFR directory,
or
> > > > > > > > set
> > > > > > > > *$MET_BUFRLIB* to point to the directory with the BUFR
> > > > > > > > library
> > > > files.
> > > > > > > > Because MET doesn't use any BUFR library include
files,
> > > > > > > > you don't need to specify *$MET_BUFRINC* ."
> > > > > > > >
> > > > > > > > Once you've installed the required libraries and set
up
> > > > > > > > your environment variables, you'll be ready to
configure
> > > > > > > > MET (instructions at the bottom of the last link
above)
> > > > > > > > and then compile and install MET (
> > > > > > > >
> > http://www.dtcenter.org/met/users/support/online_tutorial/METv5.
> > > > > > > > 0/
> > > > > > > > co
> > > > > > > > mp
> > > > > > > > ilation/compile.php
> > > > > > > > ).
> > > > > > > > After re-installing MET, please run "make test" again.
> > > > > > > > If you still encounter the same problem, please send
me
> > > > > > > > your
> > > > > > > > *config.log* file and your *make_install.log *file.
> > > > > > > > Please let me know if you have any
> > > > > > > questions.
> > > > > > > >
> > > > > > > > Please let us know how it goes.
> > > > > > > >
> > > > > > > > Thanks,
> > > > > > > > Julie
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > On Wed, Mar 9, 2016 at 10:22 AM, Jose Garcia-Rivera
via
> > > > > > > > RT < met_help at ucar.edu> wrote:
> > > > > > > >
> > > > > > > > >
> > > > > > > > > <URL:
> > > > > > > > >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=7543
> > > > > > > > > 3
> > > > > > > > > >
> > > > > > > > >
> > > > > > > > > Dear Julie,
> > > > > > > > >
> > > > > > > > > Attached is the test log file. It's showing the same
> > > > > > > > > issues on pb2nc even with the sample files.
> > > > > > > > >
> > > > > > > > > Best Regards,
> > > > > > > > > Jose
> > > > > > > > >
> > > > > > > > > -----Original Message-----
> > > > > > > > > From: Julie Prestopnik via RT
> > > > > > > > > [mailto:met_help at ucar.edu]
> > > > > > > > > Sent: Tuesday, March 08, 2016 5:28 PM
> > > > > > > > > To: Jose Garcia-Rivera
> > > > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues
> > > > > > > > > converting PREPBUFR to NetCDF
> > > > > > > > >
> > > > > > > > > Hi Jose. Thank you for uploading the files.
> > > > > > > > > Unfortunately, I am unable to reproduce the error
you
> > > > > > > > > are experiencing. I am wondering if you have
> > > > > > > > > successfully used pb2nc before. As a check could
you
> > > > > > > > > please run the following in your met-5.1/
> > > > > directory:
> > > > > > > > >
> > > > > > > > > *make test >& make_test.log*
> > > > > > > > >
> > > > > > > > > and then send me the make_test.log file?
> > > > > > > > >
> > > > > > > > > Thanks,
> > > > > > > > > Julie
> > > > > > > > >
> > > > > > > > > On Tue, Mar 8, 2016 at 11:29 AM, Jose Garcia-Rivera
> > > > > > > > > via RT < met_help at ucar.edu> wrote:
> > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > <URL:
> > > > > > > > > >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75
> > > > > > > > > > 43
> > > > > > > > > > 3
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > Dear Julie,
> > > > > > > > > >
> > > > > > > > > > I just put the files in 'garcia_data'. I
appreciate
> > > > > > > > > > your
> > > help.
> > > > > > > > > >
> > > > > > > > > > Best Regards,
> > > > > > > > > > Jose
> > > > > > > > > >
> > > > > > > > > > -----Original Message-----
> > > > > > > > > > From: Julie Prestopnik via RT
> > > > > > > > > > [mailto:met_help at ucar.edu]
> > > > > > > > > > Sent: Tuesday, March 08, 2016 1:12 PM
> > > > > > > > > > To: Jose Garcia-Rivera
> > > > > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues
> > > > > > > > > > converting PREPBUFR to NetCDF
> > > > > > > > > >
> > > > > > > > > > Hi Jose. I'm sorry to hear that you are having
> > > > > > > > > > problems converting a PREPBUFR file to NetCDF.
> > > > > > > > > >
> > > > > > > > > > Please upload your input files and configuration
> > > > > > > > > > file to our anonymous ftp site as follows:
> > > > > > > > > >
http://www.dtcenter.org/met/users/support/met_help.p
> > > > > > > > > > hp
> > > > > > > > > >
> > > > > > > > > > Then I can take a look and get back to you.
> > > > > > > > > >
> > > > > > > > > > Thanks,
> > > > > > > > > > Julie
> > > > > > > > > >
> > > > > > > > > > On Tue, Mar 8, 2016 at 11:01 AM, Jose Garcia-
Rivera
> > > > > > > > > > via RT < met_help at ucar.edu> wrote:
> > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > Tue Mar 08 11:01:25 2016: Request 75433 was
acted upon.
> > > > > > > > > > > Transaction: Ticket created by GarciaJ at imsg.com
> > > > > > > > > > > Queue: met_help
> > > > > > > > > > > Subject: Issues converting PREPBUFR to
NetCDF
> > > > > > > > > > > Owner: Nobody
> > > > > > > > > > > Requestors: GarciaJ at imsg.com
> > > > > > > > > > > Status: new
> > > > > > > > > > > Ticket <URL:
> > > > > > > > > > >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=
> > > > > > > > > > > 75
> > > > > > > > > > > 43
> > > > > > > > > > > 3
> > > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > Dear Met Help,
> > > > > > > > > > >
> > > > > > > > > > > Trying to convert a PREPBUFR file to NetCDF.
> > > > > > > > > > >
> > > > > > > > > > > I used the default PB2NC configure file, and got
> > > > > > > > > > > the
> > > > following:
> > > > > > > > > > >
> > > > > > > > > > > [garciaj at login prepbufr_obs]$ ./pb2nc
> > > > > > > > > > > gdas1.t12z.prepbufr.nr gdas.20150820.t12z.nc
> > > > > > > > > > > PB2NCConfig_default DEBUG 1: Default Config
> > > > > > > > > > > File:
> > > > > > > > > > > /work/apps/pgi_14.10/met-
5.1/share/met/config/PB2N
> > > > > > > > > > > CC on fi g_ de fa ul t DEBUG 1: User Config
File:
> > > > > > > > > > > PB2NCConfig_default DEBUG 1: Creating NetCDF
File:
> > > > gdas.20150820.t12z.nc
> > > > > > > > > > > DEBUG 1: Processing PrepBufr File:
> > > > gdas1.t12z.prepbufr.nr
> > > > > > > > > > > DEBUG 1: Blocking PrepBufr file to:
> > > > > > /tmp/tmp_pb2nc_blk_32144_0
> > > > > > > > > > > WARNING:
> > > > > > > > > > > WARNING: process_pbfile() -> No PrepBufr
messages
> > > > > > > > > > > to process in
> > > > > > > file:
> > > > > > > > > > > gdas1.t12z.prepbufr.nr
> > > > > > > > > > > WARNING:
> > > > > > > > > > > ERROR :
> > > > > > > > > > > ERROR : write_netcdf_hdr_data() -> No PrepBufr
> > > > > > > > > > > messages
> > > > > > retained.
> > > > > > > > > > > Nothing to write.
> > > > > > > > > > > ERROR :
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > Thanks in advance for the help, Jose M.
> > > > > > > > > > > Garcia-Rivera, PhD IM Systems Group
> > > > > > > > > > > Rockville/College Park, MD This e-mail,
including
> > > > > > > > > > > attachments, may include confidential and/or
> > > > > > > > > > > proprietary information, and may be used only by
> > > > > > > > > > > the person or entity to which it is addressed.
If
> > > > > > > > > > > the reader of this e-mail is not the intended
> > > > > > > > > > > recipient or his or her authorized agent, the
> > > > > > > > > > > reader is hereby notified that any
dissemination,
> > > > > > > > > > > distribution or
> copying of this e-mail is prohibited.
> > > > > > > > > > > If you have received this e-mail in error,
please
> > > > > > > > > > > notify the sender by replying to this message
and
> > > > > > > > > > > delete this
> > > > > > > > > > e-mail immediately.
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > --
> > > > > > > > > > Julie Prestopnik
> > > > > > > > > > National Center for Atmospheric Research Research
> > > > > > > > > > Applications Laboratory
> > > > > > > > > > Phone: 303.497.8399
> > > > > > > > > > Email: jpresto at ucar.edu
> > > > > > > > > >
> > > > > > > > > > This e-mail, including attachments, may include
> > > > > > > > > > confidential and/or proprietary information, and
may
> > > > > > > > > > be used only by the person or entity to which it
is
> > > > > > > > > > addressed. If the reader of this e-mail is not the
> > > > > > > > > > intended recipient or his or her authorized agent,
> > > > > > > > > > the reader is hereby notified that any
> > > > > > > > > > dissemination, distribution or copying of this e-
mail is prohibited.
> > > > > > > > > > If you have received this e-mail in error, please
> > > > > > > > > > notify the sender by replying to this message and
> > > > > > > > > > delete this
> > > > > > > > > e-mail immediately.
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > --
> > > > > > > > > Julie Prestopnik
> > > > > > > > > National Center for Atmospheric Research Research
> > > > > > > > > Applications Laboratory
> > > > > > > > > Phone: 303.497.8399
> > > > > > > > > Email: jpresto at ucar.edu
> > > > > > > > >
> > > > > > > > > This e-mail, including attachments, may include
> > > > > > > > > confidential and/or proprietary information, and may
> > > > > > > > > be used only by the person or entity to which it is
> > > > > > > > > addressed. If the reader of this e-mail is not the
> > > > > > > > > intended recipient or his or her authorized agent,
the
> > > > > > > > > reader is hereby notified that any dissemination,
> > > > > > > > > distribution or copying of this e-mail is
prohibited.
> > > > > > > > > If you have received this e-mail in error, please
> > > > > > > > > notify the sender by replying to this message and
> > > > > > > > > delete this
> > > > > > > > e-mail immediately.
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > --
> > > > > > > > Julie Prestopnik
> > > > > > > > National Center for Atmospheric Research Research
> > > > > > > > Applications Laboratory
> > > > > > > > Phone: 303.497.8399
> > > > > > > > Email: jpresto at ucar.edu
> > > > > > > >
> > > > > > > > This e-mail, including attachments, may include
> > > > > > > > confidential and/or proprietary information, and may
be
> > > > > > > > used only by the person or entity to which it is
> > > > > > > > addressed. If the reader of this e-mail is not the
> > > > > > > > intended recipient or his or her authorized agent, the
> > > > > > > > reader is hereby notified that any dissemination,
> > > > > > > > distribution or copying of this e-mail is prohibited.
If
> > > > > > > > you have received this e-mail in error, please notify
> > > > > > > > the sender by replying to this message and delete this
> > > > > > > e-mail immediately.
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > --
> > > > > > > Julie Prestopnik
> > > > > > > National Center for Atmospheric Research Research
> > > > > > > Applications Laboratory
> > > > > > > Phone: 303.497.8399
> > > > > > > Email: jpresto at ucar.edu
> > > > > > >
> > > > > > > This e-mail, including attachments, may include
> > > > > > > confidential and/or proprietary information, and may be
> > > > > > > used only by the person or entity to which it is
> > > > > > > addressed. If the reader of this e-mail is not the
> > > > > > > intended recipient or his or her authorized agent, the
> > > > > > > reader is hereby notified that any dissemination,
> > > > > > > distribution or copying of this e-mail is prohibited. If
> > > > > > > you have received this e-mail in error, please notify
the
> > > > > > > sender by replying to this message and delete this
> > > > > > e-mail immediately.
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > >
> > > > > >
> > > > > > --
> > > > > > Julie Prestopnik
> > > > > > National Center for Atmospheric Research Research
> > > > > > Applications Laboratory
> > > > > > Phone: 303.497.8399
> > > > > > Email: jpresto at ucar.edu
> > > > > >
> > > > > > This e-mail, including attachments, may include
confidential
> > > > > > and/or proprietary information, and may be used only by
the
> > > > > > person or entity to which it is addressed. If the reader
of
> > > > > > this e-mail is not the intended recipient or his or her
> > > > > > authorized agent, the reader is hereby notified that any
> > > > > > dissemination, distribution or copying of this e-mail is
> > > > > > prohibited. If you have received this e-mail in error,
> > > > > > please notify the sender by replying to this message and
> > > > > > delete this
> > > > > e-mail immediately.
> > > > > >
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > > > --
> > > > > Julie Prestopnik
> > > > > National Center for Atmospheric Research Research
Applications
> > > > > Laboratory
> > > > > Phone: 303.497.8399
> > > > > Email: jpresto at ucar.edu
> > > > >
> > > > > This e-mail, including attachments, may include confidential
> > > > > and/or proprietary information, and may be used only by the
> > > > > person or entity to which it is addressed. If the reader of
> > > > > this e-mail is not the intended recipient or his or her
> > > > > authorized agent, the reader is hereby notified that any
> > > > > dissemination, distribution or copying of this e-mail is
> > > > > prohibited. If you have received this e-mail in error,
please
> > > > > notify the sender by replying to this message and delete
this
> > > > e-mail immediately.
> > > > >
> > > > >
> > > > >
> > > >
> > > >
> > > > --
> > > > Julie Prestopnik
> > > > National Center for Atmospheric Research Research Applications
> > > > Laboratory
> > > > Phone: 303.497.8399
> > > > Email: jpresto at ucar.edu
> > > >
> > > > This e-mail, including attachments, may include confidential
> > > > and/or proprietary information, and may be used only by the
> > > > person or entity to which it is addressed. If the reader of
this
> > > > e-mail is not the intended recipient or his or her authorized
> > > > agent, the reader is hereby notified that any dissemination,
> > > > distribution or copying of this e-mail is prohibited. If you
> > > > have received this e-mail in error, please notify the sender
by
> > > > replying to this message and delete this
> > > e-mail immediately.
> > > >
> > > >
> > > >
> > >
> > >
> > > --
> > > Julie Prestopnik
> > > National Center for Atmospheric Research Research Applications
> > > Laboratory
> > > Phone: 303.497.8399
> > > Email: jpresto at ucar.edu
> > >
> > > This e-mail, including attachments, may include confidential
> > > and/or proprietary information, and may be used only by the
person
> > > or entity to which it is addressed. If the reader of this e-mail
> > > is not the intended recipient or his or her authorized agent,
the
> > > reader is hereby notified that any dissemination, distribution
or
> > > copying of this e-mail is prohibited. If you have received this
> > > e-mail in error, please notify the sender by replying to this
> > > message and delete this
> > e-mail immediately.
> > >
> > >
> > >
> >
> >
> > --
> > Julie Prestopnik
> > National Center for Atmospheric Research Research Applications
> > Laboratory
> > Phone: 303.497.8399
> > Email: jpresto at ucar.edu
> >
> > This e-mail, including attachments, may include confidential
and/or
> > proprietary information, and may be used only by the person or
> > entity to which it is addressed. If the reader of this e-mail is
not
> > the intended recipient or his or her authorized agent, the reader
is
> > hereby notified that any dissemination, distribution or copying of
> > this e-mail is prohibited. If you have received this e-mail in
> > error, please notify the sender by replying to this message and
> > delete this
> e-mail immediately.
> >
> >
>
> This e-mail, including attachments, may include confidential and/or
> proprietary information, and may be used only by the person or
entity
> to which it is addressed. If the reader of this e-mail is not the
> intended recipient or his or her authorized agent, the reader is
> hereby notified that any dissemination, distribution or copying of
> this e-mail is prohibited. If you have received this e-mail in
error,
> please notify the sender by replying to this message and delete this
e-mail immediately.
>
>
>
This e-mail, including attachments, may include confidential and/or
proprietary information, and may be used only by the person or entity
to which it is addressed. If the reader of this e-mail is not the
intended recipient or his or her authorized agent, the reader is
hereby notified that any dissemination, distribution or copying of
this e-mail is prohibited. If you have received this e-mail in error,
please notify the sender by replying to this message and delete this
e-mail immediately.
------------------------------------------------
Subject: Issues converting PREPBUFR to NetCDF
From: John Halley Gotway
Time: Fri Mar 18 11:00:52 2016
Jose,
Thanks for sending the test data. I see that your model data is valid
at
time 20150820_180000. When I run Point-Stat, I see the following
reason
counts in the output:
DEBUG 2: Processing TMP/Z2 versus TMP/Z2, for observation type ADPSFC,
over
region FULL, for interpolation method NEAREST(1), using 0 pairs.
DEBUG 3: Number of matched pairs = 0
DEBUG 3: Observations processed = 949837
DEBUG 3: Rejected: SID exclusion = 0
DEBUG 3: Rejected: GRIB code = 943848
DEBUG 3: Rejected: valid time = 4191
DEBUG 3: Rejected: bad obs value = 0
DEBUG 3: Rejected: off the grid = 1798
DEBUG 3: Rejected: level mismatch = 0
DEBUG 3: Rejected: quality marker = 0
DEBUG 3: Rejected: message type = 0
DEBUG 3: Rejected: masking region = 0
DEBUG 3: Rejected: bad fcst value = 0
DEBUG 3: Rejected: duplicates = 0
So it looks like several observations are not used for either the
valid
time or being off the grid. Let's look at where these temperature
exist.
I ran the following command to plot their location:
met-5.1/bin/plot_point_obs newtest.nc newtest.ps -gc 11 -v 3
The "-gc 11" option says only plot temperature. The resulting image
is
attached. Notice that none of them fall within your East Coast
domain.
Also notice in the log output that these are all AIRCFT temperature
observations! No ADPUPA and no ADPSFC.
Since you're using GDAS observations, you should be aware of the
quality
marker issue for surface observations noted at the bottom of this
page:
http://www.dtcenter.org/met/users/downloads/observation_data.php
To get Point-Stat running, I did the following steps:
(1) Pull GDAS observations for 20150820_180000:
wget
http://nomads.ncdc.noaa.gov/data/gdas/201508/20150820/gdas1.t18z.prepbufr.nr
(2) Run PB2NC using the attached configuration file (note quality
marker =
9):
met-5.1/bin/pb2nc gdas1.t18z.prepbufr.nr gdas1.t18z.prepbufr.nc
PB2NCConfig_GDAS
(3) Run Point-Stat using the data/config file you sent me:
met-5.1/bin/point_stat nmbprs_d01.06 gdas1.t18z.prepbufr.nc
PointStatConfig -outdir out -v 4
And that give me 3584 matched pairs:
DEBUG 3: Number of matched pairs = 3584
So the problem was caused by the GDAS quality marker issue. Also note
that
for North American grids, using NDAS (i.e. north american data
assimilation) would work equally well and NDAS does *NOT* have this
quality
marker issue.
Lastly, I see the following warning when I run Point-Stat with your
data:
WARNING:
WARNING: gds_to_lambert() -> MET does not currently support Lambert
Conformal grids where dx (3.317) != dy (2.97) and may produce
unexpected
results!
WARNING:
I'd suggest post-processing to a different grid where Dx = Dy prior to
running MET.
Hope that helps.
Thanks,
John
On Fri, Mar 18, 2016 at 10:15 AM, Jose Garcia-Rivera via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
>
> Dear John,
>
> I tried as you suggested, but still have empty output. I put the
files in
> your ftp in 'garcia_data'
>
> The three files in the FTP are:
>
> newtest.nc
> nmbprs_d01.06
> PointStatConfig
>
>
> Output:
>
> [garciaj at login prepbufr_obs]$ ./point_stat nmbprs_d01.06 newtest.nc
> PointStatConfig_default
> DEBUG 1: Default Config File:
> /work/apps/pgi_14.10/SANDY/met-
5.1/share/met/config/PointStatConfig_default
> DEBUG 1: User Config File: PointStatConfig_default
> GSL_RNG_TYPE=mt19937
> GSL_RNG_SEED=18446744071614164054
> DEBUG 1: Forecast File: nmbprs_d01.06
> DEBUG 1: Observation File: newtest.nc
> DEBUG 2:
> DEBUG 2:
>
--------------------------------------------------------------------------------
> DEBUG 2:
> DEBUG 2: Reading data for TMP/Z2.
> DEBUG 2: For TMP/Z2 found 1 forecast levels and 0 climatology
levels.
> DEBUG 2:
> DEBUG 2:
>
--------------------------------------------------------------------------------
> DEBUG 2:
> DEBUG 2: Searching 949837 observations from 452408 messages.
> DEBUG 2:
> DEBUG 2:
>
--------------------------------------------------------------------------------
> DEBUG 2:
> DEBUG 2: Processing TMP/Z2 versus TMP/Z2, for observation type
ADPSFC,
> over region FULL, for interpolation method NEAREST(1), using 0
pairs.
> DEBUG 2:
> DEBUG 2:
>
--------------------------------------------------------------------------------
> DEBUG 2:
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V.stat
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_fho.txt
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_ctc.txt
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_cts.txt
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_mctc.txt
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_mcts.txt
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_cnt.txt
> DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_sl1l2.txt
> DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_sal1l2.txt
> DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_vl1l2.txt
> DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_val1l2.txt
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_pct.txt
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_pstd.txt
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_pjc.txt
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_prc.txt
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_mpr.txt
>
> From config file:
>
> fcst = {
> message_type = [ "ADPSFC" ];
> sid_exc = [];
>
> field = [
> {
> name = "TMP";
> level = [ "Z2" ];
> cat_thresh = [ >293.0 ];
> }
> ];
>
>
> Thanks for the help,
> Jose
>
>
>
> -----Original Message-----
> From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> Sent: Thursday, March 17, 2016 5:47 PM
> To: Jose Garcia-Rivera
> Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to
NetCDF
>
> Jose,
>
> I see that you're doing an upper-air (ADPUPA) evaluation for the
time
> 20150820_180000. Upper-air observations are much more common at 00Z
and
> 12Z than 06Z and 18Z. Instead of verifying the 06 hour forecast
valid at
> 18Z, please try the 12 hour forecast valid at 00Z.
>
> Also, you could try evaluating some surface fields against the
ADPSFC
> message type.
>
> If you get stuck, you can post a sample forecast file to our
anonymous ftp
> site, and I can try running it here.
>
> Thanks,
> John
>
>
>
> On Thu, Mar 17, 2016 at 2:39 PM, Jose Garcia-Rivera via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> >
> > Dear John,
> >
> > It's great to hear from you again! Julie has been of great help.
We
> > highly appreciate all the help coming from your team.
> >
> > I followed your recommendation, and got the following:
> >
> > [garciaj at login prepbufr_obs]$ ./point_stat -v 3 nmbprs_d01.06
> > newtest.nc PointStatConfig_default DEBUG 1: Default Config File:
> > /work/apps/pgi_14.10/SANDY/met-
5.1/share/met/config/PointStatConfig_de
> > fault DEBUG 1: User Config File: PointStatConfig_default
> > GSL_RNG_TYPE=mt19937
> > GSL_RNG_SEED=1041230678
> > DEBUG 1: Forecast File: nmbprs_d01.06
> > DEBUG 1: Observation File: newtest.nc
> > DEBUG 2:
> > DEBUG 2:
> >
----------------------------------------------------------------------
> > ----------
> > DEBUG 2:
> > DEBUG 2: Reading data for SPFH/P500.
> > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found range match
for
> > VarInfo "SPFH/P500" in GRIB record 134 of GRIB file
"nmbprs_d01.06".
> > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found 1 GRIB
records
> > matching VarInfo "SPFH/P500" in GRIB file "nmbprs_d01.06".
> > DEBUG 3: Use the matching forecast and observation grids.
> > DEBUG 3: Grid Definition: Projection: Lambert Conformal Nx: 400
Ny:
> > 400
> > Lat_LL: 33.302 Lon_LL: 84.951 Lon_orient: 77.459 Alpha: 3781.822
Cone:
> > 0.629 Bx: 210.6765 By: 2557.3266
> > DEBUG 2: For SPFH/P500 found 1 forecast levels and 0 climatology
levels.
> > DEBUG 2:
> > DEBUG 2:
> >
----------------------------------------------------------------------
> > ----------
> > DEBUG 2:
> > DEBUG 2: Reading data for TMP/P500.
> > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found range match
for
> > VarInfo "TMP/P500" in GRIB record 131 of GRIB file
"nmbprs_d01.06".
> > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found 1 GRIB
records
> > matching VarInfo "TMP/P500" in GRIB file "nmbprs_d01.06".
> > DEBUG 2: For TMP/P500 found 1 forecast levels and 0 climatology
levels.
> > DEBUG 2:
> > DEBUG 2:
> >
----------------------------------------------------------------------
> > ----------
> > DEBUG 2:
> > DEBUG 2: Reading data for HGT/P500.
> > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found range match
for
> > VarInfo "HGT/P500" in GRIB record 130 of GRIB file
"nmbprs_d01.06".
> > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found 1 GRIB
records
> > matching VarInfo "HGT/P500" in GRIB file "nmbprs_d01.06".
> > DEBUG 2: For HGT/P500 found 1 forecast levels and 0 climatology
levels.
> > DEBUG 2:
> > DEBUG 2:
> >
----------------------------------------------------------------------
> > ----------
> > DEBUG 2:
> > DEBUG 2: Reading data for UGRD/P500.
> > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found range match
for
> > VarInfo "UGRD/P500" in GRIB record 137 of GRIB file
"nmbprs_d01.06".
> > DEBUG 3: MetGrib1DataFile::rotate_winds() -> Have U-wind record,
> > reading V-wind record.
> > DEBUG 3: MetGrib1DataFile::data_plane_scalar() -> Found exact
match
> > for VarInfo "UGRD/P500" in GRIB record 138 of GRIB file
"nmbprs_d01.06".
> > DEBUG 3: Rotating U and V wind components from grid-relative to
> > earth-relative.
> > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found 1 GRIB
records
> > matching VarInfo "UGRD/P500" in GRIB file "nmbprs_d01.06".
> > DEBUG 2: For UGRD/P500 found 1 forecast levels and 0 climatology
levels.
> > DEBUG 2:
> > DEBUG 2:
> >
----------------------------------------------------------------------
> > ----------
> > DEBUG 2:
> > DEBUG 2: Reading data for VGRD/P500.
> > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found range match
for
> > VarInfo "VGRD/P500" in GRIB record 138 of GRIB file
"nmbprs_d01.06".
> > DEBUG 3: MetGrib1DataFile::rotate_winds() -> Have V-wind record,
> > reading U-wind record.
> > DEBUG 3: MetGrib1DataFile::data_plane_scalar() -> Found exact
match
> > for VarInfo "VGRD/P500" in GRIB record 137 of GRIB file
"nmbprs_d01.06".
> > DEBUG 3: Rotating U and V wind components from grid-relative to
> > earth-relative.
> > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found 1 GRIB
records
> > matching VarInfo "VGRD/P500" in GRIB file "nmbprs_d01.06".
> > DEBUG 2: For VGRD/P500 found 1 forecast levels and 0 climatology
levels.
> > DEBUG 2:
> > DEBUG 2:
> >
----------------------------------------------------------------------
> > ----------
> > DEBUG 2:
> > DEBUG 2: Searching 949837 observations from 452408 messages.
> > DEBUG 2:
> > DEBUG 2:
> >
----------------------------------------------------------------------
> > ----------
> > DEBUG 2:
> > DEBUG 2: Processing SPFH/P500 versus SPFH/P500, for observation
type
> > ADPUPA, over region FULL, for interpolation method NEAREST(1),
using 0
> > pairs.
> > DEBUG 3: Number of matched pairs = 0
> > DEBUG 3: Observations processed = 949837
> > DEBUG 3: Rejected: SID exclusion = 0
> > DEBUG 3: Rejected: GRIB code = 947898
> > DEBUG 3: Rejected: valid time = 1416
> > DEBUG 3: Rejected: bad obs value = 0
> > DEBUG 3: Rejected: off the grid = 523
> > DEBUG 3: Rejected: level mismatch = 0
> > DEBUG 3: Rejected: quality marker = 0
> > DEBUG 3: Rejected: message type = 0
> > DEBUG 3: Rejected: masking region = 0
> > DEBUG 3: Rejected: bad fcst value = 0
> > DEBUG 3: Rejected: duplicates = 0
> > DEBUG 2:
> > DEBUG 2:
> >
----------------------------------------------------------------------
> > ----------
> > DEBUG 2:
> > DEBUG 2: Processing TMP/P500 versus TMP/P500, for observation type
> > ADPUPA, over region FULL, for interpolation method NEAREST(1),
using 0
> pairs.
> > DEBUG 3: Number of matched pairs = 0
> > DEBUG 3: Observations processed = 949837
> > DEBUG 3: Rejected: SID exclusion = 0
> > DEBUG 3: Rejected: GRIB code = 943848
> > DEBUG 3: Rejected: valid time = 4191
> > DEBUG 3: Rejected: bad obs value = 0
> > DEBUG 3: Rejected: off the grid = 1798
> > DEBUG 3: Rejected: level mismatch = 0
> > DEBUG 3: Rejected: quality marker = 0
> > DEBUG 3: Rejected: message type = 0
> > DEBUG 3: Rejected: masking region = 0
> > DEBUG 3: Rejected: bad fcst value = 0
> > DEBUG 3: Rejected: duplicates = 0
> > DEBUG 2:
> > DEBUG 2:
> >
----------------------------------------------------------------------
> > ----------
> > DEBUG 2:
> > DEBUG 2: Processing HGT/P500 versus HGT/P500, for observation type
> > ADPUPA, over region FULL, for interpolation method NEAREST(1),
using 0
> pairs.
> > DEBUG 3: Number of matched pairs = 0
> > DEBUG 3: Observations processed = 949837
> > DEBUG 3: Rejected: SID exclusion = 0
> > DEBUG 3: Rejected: GRIB code = 606744
> > DEBUG 3: Rejected: valid time = 319085
> > DEBUG 3: Rejected: bad obs value = 0
> > DEBUG 3: Rejected: off the grid = 23610
> > DEBUG 3: Rejected: level mismatch = 395 DEBUG 3: Rejected: quality
> > marker = 0
> > DEBUG 3: Rejected: message type = 3
> > DEBUG 3: Rejected: masking region = 0
> > DEBUG 3: Rejected: bad fcst value = 0
> > DEBUG 3: Rejected: duplicates = 0
> > DEBUG 2:
> > DEBUG 2:
> >
----------------------------------------------------------------------
> > ----------
> > DEBUG 2:
> > DEBUG 2: Processing UGRD/P500 versus UGRD/P500, for observation
type
> > ADPUPA, over region FULL, for interpolation method NEAREST(1),
using 0
> > pairs.
> > DEBUG 3: Number of matched pairs = 0
> > DEBUG 3: Observations processed = 949837
> > DEBUG 3: Rejected: SID exclusion = 0
> > DEBUG 3: Rejected: GRIB code = 650429
> > DEBUG 3: Rejected: valid time = 277745
> > DEBUG 3: Rejected: bad obs value = 0
> > DEBUG 3: Rejected: off the grid = 21341
> > DEBUG 3: Rejected: level mismatch = 319 DEBUG 3: Rejected: quality
> > marker = 0
> > DEBUG 3: Rejected: message type = 3
> > DEBUG 3: Rejected: masking region = 0
> > DEBUG 3: Rejected: bad fcst value = 0
> > DEBUG 3: Rejected: duplicates = 0
> > DEBUG 2:
> > DEBUG 2:
> >
----------------------------------------------------------------------
> > ----------
> > DEBUG 2:
> > DEBUG 2: Processing VGRD/P500 versus VGRD/P500, for observation
type
> > ADPUPA, over region FULL, for interpolation method NEAREST(1),
using 0
> > pairs.
> > DEBUG 3: Number of matched pairs = 0
> > DEBUG 3: Observations processed = 949837
> > DEBUG 3: Rejected: SID exclusion = 0
> > DEBUG 3: Rejected: GRIB code = 650429
> > DEBUG 3: Rejected: valid time = 277745
> > DEBUG 3: Rejected: bad obs value = 0
> > DEBUG 3: Rejected: off the grid = 21341
> > DEBUG 3: Rejected: level mismatch = 319 DEBUG 3: Rejected: quality
> > marker = 0
> > DEBUG 3: Rejected: message type = 3
> > DEBUG 3: Rejected: masking region = 0
> > DEBUG 3: Rejected: bad fcst value = 0
> > DEBUG 3: Rejected: duplicates = 0
> > DEBUG 2:
> > DEBUG 2:
> >
----------------------------------------------------------------------
> > ----------
> > DEBUG 2:
> > DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V.stat
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_fho.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_ctc.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_cts.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_mctc.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_mcts.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_cnt.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_sl1l2.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_sal1l2.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_vl1l2.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_val1l2.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_pct.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_pstd.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_pjc.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_prc.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_mpr.txt
> >
> >
> >
> > Best Regards,
> > Jose
> >
> >
> >
> >
> >
> > -----Original Message-----
> > From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> > Sent: Thursday, March 17, 2016 3:29 PM
> > To: Jose Garcia-Rivera
> > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR
to
> > NetCDF
> >
> > Hello Jose,
> >
> > Julie is out of the office today, but I should be able to help
you.
> > Glad you were able to finally get PB2NC working. That was a
tricky
> > one! But it helped us realize that since BUFRLIB has changed to
> > FORTRAN 90, we should update the MET code which calls BUFRLIB to
be
> compatible.
> >
> > I see that you are now getting 0 matched pairs when you run Point-
Stat
> > with the output of PB2NC. Please try rerunning Point-Stat but use
a
> > higher verbosity level, like "-v 3". That'll print out the
following
> > type of counts for each of the verification tasks you've defined
in the
> config file:
> >
> > DEBUG 3: Number of matched pairs = 312
> > DEBUG 3: Observations processed = 87753
> > DEBUG 3: Rejected: SID exclusion = 0
> > DEBUG 3: Rejected: GRIB code = 77648
> > DEBUG 3: Rejected: valid time = 0
> > DEBUG 3: Rejected: bad obs value = 0
> > DEBUG 3: Rejected: off the grid = 5
> > DEBUG 3: Rejected: level mismatch = 9219 DEBUG 3: Rejected:
quality
> > marker = 0
> > DEBUG 3: Rejected: message type = 537
> > DEBUG 3: Rejected: masking region = 32 DEBUG 3: Rejected: bad fcst
> > value = 0
> > DEBUG 3: Rejected: duplicates = 0
> >
> > In the example above, 87753 observation values were checked and
the
> > counts list reasons why there were not used for that task. Out of
> > those 87753 obs, 312 of them were used for this task.
> >
> > Looking at the counts from your Point-Stat run should help you
figure
> > out why you have 0 matched pairs.
> >
> > Thanks,
> > John
> >
> >
> > On Thu, Mar 17, 2016 at 12:29 PM, Jose Garcia-Rivera via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> > >
> > > Dear Julie,
> > >
> > > We got the executables to work! However, I have a couple of
> > > issues/questions:
> > >
> > >
> > >
> > > Issue #1 --- Not getting values after running point_stat
> > >
> > > Everything seems to run fine. I attached the configuration file.
I
> > > can send the three files via FTP if needed.
> > >
> > >
> > >
> > > Issue #2 --- PB2NC doesn't seem to finish the job, but it does?
I
> > > had to do CTRL+C, and checked the netCDF file using
ncl_filedump:
> > >
> > > [garciaj at login prepbufr_obs]$ ./pb2nc
prepbufr.gdas.20150820.t18z.nr
> > > newtest.nc PB2NCConfig_default DEBUG 1: Default Config File:
> > > /work/apps/pgi_14.10/SANDY/met-
5.1/share/met/config/PB2NCConfig_defa
> > > ul t DEBUG 1: User Config File: PB2NCConfig_default
> > > DEBUG 1: Creating NetCDF File: newtest.nc
> > > DEBUG 1: Processing PrepBufr File:
prepbufr.gdas.20150820.t18z.nr
> > > DEBUG 1: Blocking PrepBufr file to:
/tmp/tmp_pb2nc_blk_17703_0
> > > DEBUG 2: PrepBufr Time Center: 20150820_180000
> > > DEBUG 2: Searching Time Window: 20150820_163000 to
> > 20150820_193000
> > > DEBUG 2: Processing 685386 PrepBufr messages...
> > > 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80%
85%
> > > 90% 95% 100%
> > > DEBUG 2: Total PrepBufr Messages processed = 685386
> > > DEBUG 2: Rejected based on message type = 0
> > > DEBUG 2: Rejected based on station id = 0
> > > DEBUG 2: Rejected based on valid time = 185145
> > > DEBUG 2: Rejected based on masking grid = 0
> > > DEBUG 2: Rejected based on masking polygon = 0
> > > DEBUG 2: Rejected based on elevation = 0
> > > DEBUG 2: Rejected based on pb report type = 0
> > > DEBUG 2: Rejected based on input report type = 0
> > > DEBUG 2: Rejected based on instrument type = 0
> > > DEBUG 2: Rejected based on zero observations = 47833
> > > DEBUG 2: Total PrepBufr Messages retained = 452408
> > > DEBUG 2: Total observations retained or derived = 949837 ^C
> > >
> > >
> > > Checking netCDF file:
> > >
> > > [garciaj at login prepbufr_obs]$ ncl_filedump newtest.nc Copyright
(C)
> > > 1995-2015 - All Rights Reserved University Corporation for
> > > Atmospheric Research NCAR Command Language Version 6.3.0 The
use
> > > of this software is governed by a License Agreement.
> > > See http://www.ncl.ucar.edu/ for more details.
> > >
> > > Variable: f
> > > Type: file
> > > filename: newtest
> > > path: newtest.nc
> > > file global attributes:
> > > FileOrigins : File newtest.nc generated 20160317_155548
UTC on
> > > host login.local by the MET pb2nc tool
> > > MET_version : V5.1
> > > MET_tool : pb2nc
> > > dimensions:
> > > mxstr = 16
> > > hdr_arr_len = 3
> > > obs_arr_len = 5
> > > nobs = 949837 // unlimited
> > > nhdr = 452408
> > > variables:
> > > character obs_qty ( nobs, mxstr )
> > > long_name : quality flag
> > >
> > > float obs_arr ( nobs, obs_arr_len )
> > > long_name : array of observation values
> > > _fill_value : -9999
> > > columns : hdr_id gc lvl hgt ob
> > > hdr_id_long_name : index of matching header data
> > > gc_long_name : grib code corresponding to the
observation type
> > > lvl_long_name : pressure level (hPa) or
accumulation
> > > interval (sec)
> > > hgt_long_name : height in meters above sea level
(msl)
> > > ob_long_name : observation value
> > >
> > > character hdr_typ ( nhdr, mxstr )
> > > long_name : message type
> > >
> > > character hdr_sid ( nhdr, mxstr )
> > > long_name : station identification
> > >
> > > character hdr_vld ( nhdr, mxstr )
> > > long_name : valid time
> > > units : YYYYMMDD_HHMMSS
> > >
> > > float hdr_arr ( nhdr, hdr_arr_len )
> > > long_name : array of observation station header
values
> > > _fill_value : -9999
> > > columns : lat lon elv
> > > lat_long_name : latitude
> > > lat_units : degrees_north
> > > lon_long_name : longitude
> > > lon_units : degrees_east
> > > elv_long_name : elevation
> > > elv_units : meters above sea level (msl)
> > >
> > >
> > >
> > >
> > > Thanks for all the help,
> > > Jose
> > >
> > >
> > >
> > >
> > >
> > >
> > > -----Original Message-----
> > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > Sent: Wednesday, March 16, 2016 4:40 PM
> > > To: Jose Garcia-Rivera
> > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR
to
> > > NetCDF
> > >
> > > Hi Jose. I apologize for the delay. This was a tricky problem
to
> > > figure out, however, we were finally able to reproduce the error
you
> > > are receiving for pb2nc.
> > >
> > > The problem is BUFRLIB being compiled with pgf90 and MET being
> > > compiled with pgf77. They aren't talking well to each other.
> > > BUFRLIBv10.1.0 compiles with pgf77 but later versions require
pgf90.
> > >
> > > We will plan on updating the MET Fortran code to compile with
pgf90
> > > so that we can use newer BUFRLIB versions, but for now, to solve
> > > your problem, I have attached BUFRLIB_v10-1-0.tar. Please
install
> > > that version of BUFRLIB using pgf77 and then recompile MET
without
> > > the "LIBS" environment variable setting?
> > >
> > > Please let me know how that goes. We were able to get a
successful
> > > run using that solution and hope you will too.
> > >
> > > Thanks,
> > > Julie
> > >
> > >
> > > On Wed, Mar 16, 2016 at 12:17 PM, Jose Garcia-Rivera via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
>
> > > >
> > > > Dear Julie,
> > > >
> > > > Is there anything that we can do here to sort these issues
out?
> > > >
> > > > Best Regards,
> > > > Jose
> > > >
> > > > -----Original Message-----
> > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > Sent: Tuesday, March 15, 2016 5:08 PM
> > > > To: Jose Garcia-Rivera
> > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
PREPBUFR
> > > > to NetCDF
> > > >
> > > > Hi Jose. I was not. I got the same error you did. I believe
> > > > that the test.nc file is not in the correct format needed by
> > > > point_stat, so I think we need to get pb2nc working for you.
It
> > > > is likely a communication problem between the C code and the
Fortran
> code.
> > > >
> > > > Julie
> > > >
> > > > On Tue, Mar 15, 2016 at 3:05 PM, Jose Garcia-Rivera via RT <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > > >
> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> > > > >
> > > > > Dear Julie,
> > > > >
> > > > > Quick question: Were you able to run point_stat with the
netCDF
> > > > > file that I sent yesterday?
> > > > >
> > > > > Thanks for the help,
> > > > > Jose
> > > > >
> > > > > -----Original Message-----
> > > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > > Sent: Tuesday, March 15, 2016 12:17 PM
> > > > > To: Jose Garcia-Rivera
> > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
PREPBUFR
> > > > > to NetCDF
> > > > >
> > > > > Thank you, Jose. I'm working with co-workers to try to get
> > > > > these issues resolved. I hope to get back to you soon.
> > > > >
> > > > > Julie
> > > > >
> > > > > On Mon, Mar 14, 2016 at 1:36 PM, Jose Garcia-Rivera via RT <
> > > > > met_help at ucar.edu> wrote:
> > > > >
> > > > > >
> > > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > > >
> > > > > >
> > > > > > Dear Julie,
> > > > > >
> > > > > > I just uploaded the three files to 'garcia_data'.
> > > > > >
> > > > > > Thanks for the help,
> > > > > > Jose
> > > > > >
> > > > > >
> > > > > > -----Original Message-----
> > > > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > > > Sent: Monday, March 14, 2016 3:32 PM
> > > > > > To: Jose Garcia-Rivera
> > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
> > > > > > PREPBUFR to NetCDF
> > > > > >
> > > > > > Hi Jose.
> > > > > >
> > > > > > Yes, please upload your input files and configuration file
> > > > > > (nmbprs_d01.06, test.nc, PointStatConfig_default) to our
> > > > > > anonymous ftp
> > > > > site as follows:
> > > > > > http://www.dtcenter.org/met/users/support/met_help.php
> > > > > >
> > > > > > Thanks!
> > > > > >
> > > > > > Julie
> > > > > >
> > > > > > On Mon, Mar 14, 2016 at 1:06 PM, Jose Garcia-Rivera via RT
<
> > > > > > met_help at ucar.edu> wrote:
> > > > > >
> > > > > > >
> > > > > > > <URL:
> > > > > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > > > >
> > > > > > >
> > > > > > > Dear Julie,
> > > > > > >
> > > > > > > I got to convert my prepbufr file using a python script.
> > > > > > > However, I have trouble running point_stat. Can I send
you
> > > > > > > the files, to see if you have the same issue?
> > > > > > >
> > > > > > >
> > > > > > > This is what I got:
> > > > > > >
> > > > > > > [garciaj at login prepbufr_obs]$ ./point_stat nmbprs_d01.06
> > > > > > > test.nc PointStatConfig_default DEBUG 1: Default Config
File:
> > > > > > > /work/apps/pgi_14.10/SANDY/met-
5.1/share/met/config/PointSta
> > > > > > > tC on fi g_ de fault DEBUG 1: User Config File:
> > > > > > > PointStatConfig_default
> > > > > > > GSL_RNG_TYPE=mt19937
> > > > > > > GSL_RNG_SEED=18446744073425053526 DEBUG 1: Forecast
File:
> > > > > > > nmbprs_d01.06 DEBUG 1: Observation File:
> > > > > > > test.nc DEBUG 2:
> > > > > > > DEBUG 2:
> > > > > > >
------------------------------------------------------------
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > ----------
> > > > > > > DEBUG 2:
> > > > > > > DEBUG 2: Reading data for SPFH/P500.
> > > > > > > DEBUG 2: For SPFH/P500 found 1 forecast levels and 0
> > > > > > > climatology
> > > > > levels.
> > > > > > > DEBUG 2:
> > > > > > > DEBUG 2:
> > > > > > >
------------------------------------------------------------
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > ----------
> > > > > > > DEBUG 2:
> > > > > > > DEBUG 2: Reading data for TMP/P500.
> > > > > > > DEBUG 2: For TMP/P500 found 1 forecast levels and 0
> > > > > > > climatology
> > > > levels.
> > > > > > > DEBUG 2:
> > > > > > > DEBUG 2:
> > > > > > >
------------------------------------------------------------
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > ----------
> > > > > > > DEBUG 2:
> > > > > > > DEBUG 2: Reading data for HGT/P500.
> > > > > > > DEBUG 2: For HGT/P500 found 1 forecast levels and 0
> > > > > > > climatology
> > > > levels.
> > > > > > > DEBUG 2:
> > > > > > > DEBUG 2:
> > > > > > >
------------------------------------------------------------
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > ----------
> > > > > > > DEBUG 2:
> > > > > > > DEBUG 2: Reading data for UGRD/P500.
> > > > > > > DEBUG 2: For UGRD/P500 found 1 forecast levels and 0
> > > > > > > climatology
> > > > > levels.
> > > > > > > DEBUG 2:
> > > > > > > DEBUG 2:
> > > > > > >
------------------------------------------------------------
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > ----------
> > > > > > > DEBUG 2:
> > > > > > > DEBUG 2: Reading data for VGRD/P500.
> > > > > > > DEBUG 2: For VGRD/P500 found 1 forecast levels and 0
> > > > > > > climatology
> > > > > levels.
> > > > > > > DEBUG 2:
> > > > > > > DEBUG 2:
> > > > > > >
------------------------------------------------------------
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > ----------
> > > > > > > DEBUG 2:
> > > > > > > WARNING:
> > > > > > > WARNING: process_obs_file() -> can't open observation
netCDF
> > file:
> > > > > > > test.nc
> > > > > > > WARNING:
> > > > > > > DEBUG 2:
> > > > > > > DEBUG 2:
> > > > > > >
------------------------------------------------------------
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > ----------
> > > > > > > DEBUG 2:
> > > > > > > DEBUG 2: Processing SPFH/P500 versus SPFH/P500, for
> > > > > > > observation type ADPUPA, over region FULL, for
interpolation
> > > > > > > method NEAREST(1), using
> > > > > > > 0 pairs.
> > > > > > > DEBUG 2:
> > > > > > > DEBUG 2:
> > > > > > >
------------------------------------------------------------
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > ----------
> > > > > > > DEBUG 2:
> > > > > > > DEBUG 2: Processing TMP/P500 versus TMP/P500, for
> > > > > > > observation type ADPUPA, over region FULL, for
interpolation
> > > > > > > method NEAREST(1), using
> > > > > > > 0
> > > > > > pairs.
> > > > > > > DEBUG 2:
> > > > > > > DEBUG 2:
> > > > > > >
------------------------------------------------------------
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > ----------
> > > > > > > DEBUG 2:
> > > > > > > DEBUG 2: Processing HGT/P500 versus HGT/P500, for
> > > > > > > observation type ADPUPA, over region FULL, for
interpolation
> > > > > > > method NEAREST(1), using
> > > > > > > 0
> > > > > > pairs.
> > > > > > > DEBUG 2:
> > > > > > > DEBUG 2:
> > > > > > >
------------------------------------------------------------
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > ----------
> > > > > > > DEBUG 2:
> > > > > > > DEBUG 2: Processing UGRD/P500 versus UGRD/P500, for
> > > > > > > observation type ADPUPA, over region FULL, for
interpolation
> > > > > > > method NEAREST(1), using
> > > > > > > 0 pairs.
> > > > > > > DEBUG 2:
> > > > > > > DEBUG 2:
> > > > > > >
------------------------------------------------------------
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > ----------
> > > > > > > DEBUG 2:
> > > > > > > DEBUG 2: Processing VGRD/P500 versus VGRD/P500, for
> > > > > > > observation type ADPUPA, over region FULL, for
interpolation
> > > > > > > method NEAREST(1), using
> > > > > > > 0 pairs.
> > > > > > > DEBUG 2:
> > > > > > > DEBUG 2:
> > > > > > >
------------------------------------------------------------
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > ----------
> > > > > > > DEBUG 2:
> > > > > > > DEBUG 1: Output file:
> > > > > > > ./point_stat_060000L_20150820_180000V.stat
> > > > > > > DEBUG 1: Output file:
> > > > > > > ./point_stat_060000L_20150820_180000V_fho.txt
> > > > > > > DEBUG 1: Output file:
> > > > > > > ./point_stat_060000L_20150820_180000V_ctc.txt
> > > > > > > DEBUG 1: Output file:
> > > > > > > ./point_stat_060000L_20150820_180000V_cts.txt
> > > > > > > DEBUG 1: Output file:
> > > > > > > ./point_stat_060000L_20150820_180000V_mctc.txt
> > > > > > > DEBUG 1: Output file:
> > > > > > > ./point_stat_060000L_20150820_180000V_mcts.txt
> > > > > > > DEBUG 1: Output file:
> > > > > > > ./point_stat_060000L_20150820_180000V_cnt.txt
> > > > > > > DEBUG 1: Output file:
> > > > > > > ./point_stat_060000L_20150820_180000V_sl1l2.txt
> > > > > > > DEBUG 1: Output file:
> > > > > > > ./point_stat_060000L_20150820_180000V_sal1l2.txt
> > > > > > > DEBUG 1: Output file:
> > > > > > > ./point_stat_060000L_20150820_180000V_vl1l2.txt
> > > > > > > DEBUG 1: Output file:
> > > > > > > ./point_stat_060000L_20150820_180000V_val1l2.txt
> > > > > > > DEBUG 1: Output file:
> > > > > > > ./point_stat_060000L_20150820_180000V_pct.txt
> > > > > > > DEBUG 1: Output file:
> > > > > > > ./point_stat_060000L_20150820_180000V_pstd.txt
> > > > > > > DEBUG 1: Output file:
> > > > > > > ./point_stat_060000L_20150820_180000V_pjc.txt
> > > > > > > DEBUG 1: Output file:
> > > > > > > ./point_stat_060000L_20150820_180000V_prc.txt
> > > > > > > DEBUG 1: Output file:
> > > > > > > ./point_stat_060000L_20150820_180000V_mpr.txt
> > > > > > >
> > > > > > >
> > > > > > > Thanks for the help,
> > > > > > > Jose
> > > > > > >
> > > > > > >
> > > > > > > -----Original Message-----
> > > > > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > > > > Sent: Monday, March 14, 2016 12:17 PM
> > > > > > > To: Jose Garcia-Rivera
> > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
> > > > > > > PREPBUFR to NetCDF
> > > > > > >
> > > > > > > Hi Jose. I apologize for the delayed response. I was
out
> > > > > > > of the office on Friday. I'm going to try to figure out
a
> > > > > > > solution and get back with you shortly.
> > > > > > >
> > > > > > > Julie
> > > > > > >
> > > > > > > On Fri, Mar 11, 2016 at 2:02 PM, Jose Garcia-Rivera via
RT <
> > > > > > > met_help at ucar.edu> wrote:
> > > > > > >
> > > > > > > >
> > > > > > > > <URL:
> > > > > > > >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > > > > >
> > > > > > > >
> > > > > > > > Dear Julie,
> > > > > > > >
> > > > > > > > Any news regarding pb2nc? We're still unable to make
it work.
> > > > > > > >
> > > > > > > > Best Regards,
> > > > > > > > Jose
> > > > > > > >
> > > > > > > > -----Original Message-----
> > > > > > > > From: Julie Prestopnik via RT
[mailto:met_help at ucar.edu]
> > > > > > > > Sent: Thursday, March 10, 2016 4:20 PM
> > > > > > > > To: Jose Garcia-Rivera
> > > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues
converting
> > > > > > > > PREPBUFR to NetCDF
> > > > > > > >
> > > > > > > > Hi Jose. Thank you for attaching the files.
> > > > > > > >
> > > > > > > > Could you please send me a list of the files in
> > > > > > > > /work/apps/pgi_14.10/SANDY/bufrlib/lib?
> > > > > > > >
> > > > > > > > Thank you!
> > > > > > > >
> > > > > > > > Julie
> > > > > > > >
> > > > > > > >
> > > > > > > > On Thu, Mar 10, 2016 at 12:20 PM, Jose Garcia-Rivera
via
> > > > > > > > RT < met_help at ucar.edu> wrote:
> > > > > > > >
> > > > > > > > >
> > > > > > > > > <URL:
> > > > > > > > >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > > > > > >
> > > > > > > > >
> > > > > > > > > Dear Julie,
> > > > > > > > >
> > > > > > > > > The administrator re-compiled MET following your
> > > > > > > > > instructions, and says there's still trouble. He
sent me
> > > > > > > > > the log files
> > > > > (attached).
> > > > > > > > > Is there any other approach that might help?
> > > > > > > > >
> > > > > > > > > Best Regards,
> > > > > > > > > Jose
> > > > > > > > >
> > > > > > > > > -----Original Message-----
> > > > > > > > > From: Julie Prestopnik via RT
[mailto:met_help at ucar.edu]
> > > > > > > > > Sent: Wednesday, March 09, 2016 12:39 PM
> > > > > > > > > To: Jose Garcia-Rivera
> > > > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues
converting
> > > > > > > > > PREPBUFR to NetCDF
> > > > > > > > >
> > > > > > > > > Thank you, Jose! It looks like something went wrong
> > > > > > > > > during
> > > > > > > compilation.
> > > > > > > > > I suggest recompiling MET to see if we can get this
> > > > > > > > > issue
> > > > resolved.
> > > > > > > > > NCEP's BUFRLIB is used by the pb2nc MET tool, and is
a
> > > > > > > > > required external library for pb2nc. MET is not yet
> > > > > > > > > compatible with BUFRLIB
> > > > > > > > version 11.0.0, so we
> > > > > > > > > suggest getting version 10.2.3. We are working on
our
> > online
> > > > > > tutorial
> > > > > > > > for
> > > > > > > > > METv.5.1, but in the meantime, I'll point you to our
> > > > > > > > > online tutorial directions for installing BUFRLIB:
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > http://www.dtcenter.org/met/users/support/online_tutorial/METv5.
> > > > > > > > > 0/
> > > > > > > > > co
> > > > > > > > > mp
> > > > > > > > > ilation/req_libs.php
> > > > > > > > >
> > > > > > > > > It is also important to review the necessary
environment
> > > > > > > > > variables to
> > > > > > > > set:
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > http://www.dtcenter.org/met/users/support/online_tutorial/METv5.
> > > > > > > > > 0/
> > > > > > > > > co
> > > > > > > > > mp
> > > > > > > > > ilation/configure.php
> > > > > > > > >
> > > > > > > > > For example,
> > > > > > > > >
> > > > > > > > > "Set *$MET_BUFR* to point to the main BUFR
directory, or
> > > > > > > > > set
> > > > > > > > > *$MET_BUFRLIB* to point to the directory with the
BUFR
> > > > > > > > > library
> > > > > files.
> > > > > > > > > Because MET doesn't use any BUFR library include
files,
> > > > > > > > > you don't need to specify *$MET_BUFRINC* ."
> > > > > > > > >
> > > > > > > > > Once you've installed the required libraries and set
up
> > > > > > > > > your environment variables, you'll be ready to
configure
> > > > > > > > > MET (instructions at the bottom of the last link
above)
> > > > > > > > > and then compile and install MET (
> > > > > > > > >
> > > http://www.dtcenter.org/met/users/support/online_tutorial/METv5.
> > > > > > > > > 0/
> > > > > > > > > co
> > > > > > > > > mp
> > > > > > > > > ilation/compile.php
> > > > > > > > > ).
> > > > > > > > > After re-installing MET, please run "make test"
again.
> > > > > > > > > If you still encounter the same problem, please send
me
> > > > > > > > > your
> > > > > > > > > *config.log* file and your *make_install.log *file.
> > > > > > > > > Please let me know if you have any
> > > > > > > > questions.
> > > > > > > > >
> > > > > > > > > Please let us know how it goes.
> > > > > > > > >
> > > > > > > > > Thanks,
> > > > > > > > > Julie
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > On Wed, Mar 9, 2016 at 10:22 AM, Jose Garcia-Rivera
via
> > > > > > > > > RT < met_help at ucar.edu> wrote:
> > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > <URL:
> > > > > > > > > >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=7543
> > > > > > > > > > 3
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > Dear Julie,
> > > > > > > > > >
> > > > > > > > > > Attached is the test log file. It's showing the
same
> > > > > > > > > > issues on pb2nc even with the sample files.
> > > > > > > > > >
> > > > > > > > > > Best Regards,
> > > > > > > > > > Jose
> > > > > > > > > >
> > > > > > > > > > -----Original Message-----
> > > > > > > > > > From: Julie Prestopnik via RT
> > > > > > > > > > [mailto:met_help at ucar.edu]
> > > > > > > > > > Sent: Tuesday, March 08, 2016 5:28 PM
> > > > > > > > > > To: Jose Garcia-Rivera
> > > > > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues
> > > > > > > > > > converting PREPBUFR to NetCDF
> > > > > > > > > >
> > > > > > > > > > Hi Jose. Thank you for uploading the files.
> > > > > > > > > > Unfortunately, I am unable to reproduce the error
you
> > > > > > > > > > are experiencing. I am wondering if you have
> > > > > > > > > > successfully used pb2nc before. As a check could
you
> > > > > > > > > > please run the following in your met-5.1/
> > > > > > directory:
> > > > > > > > > >
> > > > > > > > > > *make test >& make_test.log*
> > > > > > > > > >
> > > > > > > > > > and then send me the make_test.log file?
> > > > > > > > > >
> > > > > > > > > > Thanks,
> > > > > > > > > > Julie
> > > > > > > > > >
> > > > > > > > > > On Tue, Mar 8, 2016 at 11:29 AM, Jose Garcia-
Rivera
> > > > > > > > > > via RT < met_help at ucar.edu> wrote:
> > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > <URL:
> > > > > > > > > > >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75
> > > > > > > > > > > 43
> > > > > > > > > > > 3
> > > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > Dear Julie,
> > > > > > > > > > >
> > > > > > > > > > > I just put the files in 'garcia_data'. I
appreciate
> > > > > > > > > > > your
> > > > help.
> > > > > > > > > > >
> > > > > > > > > > > Best Regards,
> > > > > > > > > > > Jose
> > > > > > > > > > >
> > > > > > > > > > > -----Original Message-----
> > > > > > > > > > > From: Julie Prestopnik via RT
> > > > > > > > > > > [mailto:met_help at ucar.edu]
> > > > > > > > > > > Sent: Tuesday, March 08, 2016 1:12 PM
> > > > > > > > > > > To: Jose Garcia-Rivera
> > > > > > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues
> > > > > > > > > > > converting PREPBUFR to NetCDF
> > > > > > > > > > >
> > > > > > > > > > > Hi Jose. I'm sorry to hear that you are having
> > > > > > > > > > > problems converting a PREPBUFR file to NetCDF.
> > > > > > > > > > >
> > > > > > > > > > > Please upload your input files and configuration
> > > > > > > > > > > file to our anonymous ftp site as follows:
> > > > > > > > > > >
http://www.dtcenter.org/met/users/support/met_help.p
> > > > > > > > > > > hp
> > > > > > > > > > >
> > > > > > > > > > > Then I can take a look and get back to you.
> > > > > > > > > > >
> > > > > > > > > > > Thanks,
> > > > > > > > > > > Julie
> > > > > > > > > > >
> > > > > > > > > > > On Tue, Mar 8, 2016 at 11:01 AM, Jose Garcia-
Rivera
> > > > > > > > > > > via RT < met_help at ucar.edu> wrote:
> > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > Tue Mar 08 11:01:25 2016: Request 75433 was
acted
> upon.
> > > > > > > > > > > > Transaction: Ticket created by
GarciaJ at imsg.com
> > > > > > > > > > > > Queue: met_help
> > > > > > > > > > > > Subject: Issues converting PREPBUFR to
NetCDF
> > > > > > > > > > > > Owner: Nobody
> > > > > > > > > > > > Requestors: GarciaJ at imsg.com
> > > > > > > > > > > > Status: new
> > > > > > > > > > > > Ticket <URL:
> > > > > > > > > > > >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=
> > > > > > > > > > > > 75
> > > > > > > > > > > > 43
> > > > > > > > > > > > 3
> > > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > Dear Met Help,
> > > > > > > > > > > >
> > > > > > > > > > > > Trying to convert a PREPBUFR file to NetCDF.
> > > > > > > > > > > >
> > > > > > > > > > > > I used the default PB2NC configure file, and
got
> > > > > > > > > > > > the
> > > > > following:
> > > > > > > > > > > >
> > > > > > > > > > > > [garciaj at login prepbufr_obs]$ ./pb2nc
> > > > > > > > > > > > gdas1.t12z.prepbufr.nr gdas.20150820.t12z.nc
> > > > > > > > > > > > PB2NCConfig_default DEBUG 1: Default Config
> > > > > > > > > > > > File:
> > > > > > > > > > > > /work/apps/pgi_14.10/met-
5.1/share/met/config/PB2N
> > > > > > > > > > > > CC on fi g_ de fa ul t DEBUG 1: User Config
File:
> > > > > > > > > > > > PB2NCConfig_default DEBUG 1: Creating NetCDF
File:
> > > > > gdas.20150820.t12z.nc
> > > > > > > > > > > > DEBUG 1: Processing PrepBufr File:
> > > > > gdas1.t12z.prepbufr.nr
> > > > > > > > > > > > DEBUG 1: Blocking PrepBufr file to:
> > > > > > > /tmp/tmp_pb2nc_blk_32144_0
> > > > > > > > > > > > WARNING:
> > > > > > > > > > > > WARNING: process_pbfile() -> No PrepBufr
messages
> > > > > > > > > > > > to process in
> > > > > > > > file:
> > > > > > > > > > > > gdas1.t12z.prepbufr.nr
> > > > > > > > > > > > WARNING:
> > > > > > > > > > > > ERROR :
> > > > > > > > > > > > ERROR : write_netcdf_hdr_data() -> No
PrepBufr
> > > > > > > > > > > > messages
> > > > > > > retained.
> > > > > > > > > > > > Nothing to write.
> > > > > > > > > > > > ERROR :
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > Thanks in advance for the help, Jose M.
> > > > > > > > > > > > Garcia-Rivera, PhD IM Systems Group
> > > > > > > > > > > > Rockville/College Park, MD This e-mail,
including
> > > > > > > > > > > > attachments, may include confidential and/or
> > > > > > > > > > > > proprietary information, and may be used only
by
> > > > > > > > > > > > the person or entity to which it is addressed.
If
> > > > > > > > > > > > the reader of this e-mail is not the intended
> > > > > > > > > > > > recipient or his or her authorized agent, the
> > > > > > > > > > > > reader is hereby notified that any
dissemination,
> > > > > > > > > > > > distribution or
> > copying of this e-mail is prohibited.
> > > > > > > > > > > > If you have received this e-mail in error,
please
> > > > > > > > > > > > notify the sender by replying to this message
and
> > > > > > > > > > > > delete this
> > > > > > > > > > > e-mail immediately.
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > --
> > > > > > > > > > > Julie Prestopnik
> > > > > > > > > > > National Center for Atmospheric Research
Research
> > > > > > > > > > > Applications Laboratory
> > > > > > > > > > > Phone: 303.497.8399
> > > > > > > > > > > Email: jpresto at ucar.edu
> > > > > > > > > > >
> > > > > > > > > > > This e-mail, including attachments, may include
> > > > > > > > > > > confidential and/or proprietary information, and
may
> > > > > > > > > > > be used only by the person or entity to which it
is
> > > > > > > > > > > addressed. If the reader of this e-mail is not
the
> > > > > > > > > > > intended recipient or his or her authorized
agent,
> > > > > > > > > > > the reader is hereby notified that any
> > > > > > > > > > > dissemination, distribution or copying of this
e-mail
> is prohibited.
> > > > > > > > > > > If you have received this e-mail in error,
please
> > > > > > > > > > > notify the sender by replying to this message
and
> > > > > > > > > > > delete this
> > > > > > > > > > e-mail immediately.
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > --
> > > > > > > > > > Julie Prestopnik
> > > > > > > > > > National Center for Atmospheric Research Research
> > > > > > > > > > Applications Laboratory
> > > > > > > > > > Phone: 303.497.8399
> > > > > > > > > > Email: jpresto at ucar.edu
> > > > > > > > > >
> > > > > > > > > > This e-mail, including attachments, may include
> > > > > > > > > > confidential and/or proprietary information, and
may
> > > > > > > > > > be used only by the person or entity to which it
is
> > > > > > > > > > addressed. If the reader of this e-mail is not the
> > > > > > > > > > intended recipient or his or her authorized agent,
the
> > > > > > > > > > reader is hereby notified that any dissemination,
> > > > > > > > > > distribution or copying of this e-mail is
prohibited.
> > > > > > > > > > If you have received this e-mail in error, please
> > > > > > > > > > notify the sender by replying to this message and
> > > > > > > > > > delete this
> > > > > > > > > e-mail immediately.
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > --
> > > > > > > > > Julie Prestopnik
> > > > > > > > > National Center for Atmospheric Research Research
> > > > > > > > > Applications Laboratory
> > > > > > > > > Phone: 303.497.8399
> > > > > > > > > Email: jpresto at ucar.edu
> > > > > > > > >
> > > > > > > > > This e-mail, including attachments, may include
> > > > > > > > > confidential and/or proprietary information, and may
be
> > > > > > > > > used only by the person or entity to which it is
> > > > > > > > > addressed. If the reader of this e-mail is not the
> > > > > > > > > intended recipient or his or her authorized agent,
the
> > > > > > > > > reader is hereby notified that any dissemination,
> > > > > > > > > distribution or copying of this e-mail is
prohibited. If
> > > > > > > > > you have received this e-mail in error, please
notify
> > > > > > > > > the sender by replying to this message and delete
this
> > > > > > > > e-mail immediately.
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > --
> > > > > > > > Julie Prestopnik
> > > > > > > > National Center for Atmospheric Research Research
> > > > > > > > Applications Laboratory
> > > > > > > > Phone: 303.497.8399
> > > > > > > > Email: jpresto at ucar.edu
> > > > > > > >
> > > > > > > > This e-mail, including attachments, may include
> > > > > > > > confidential and/or proprietary information, and may
be
> > > > > > > > used only by the person or entity to which it is
> > > > > > > > addressed. If the reader of this e-mail is not the
> > > > > > > > intended recipient or his or her authorized agent, the
> > > > > > > > reader is hereby notified that any dissemination,
> > > > > > > > distribution or copying of this e-mail is prohibited.
If
> > > > > > > > you have received this e-mail in error, please notify
the
> > > > > > > > sender by replying to this message and delete this
> > > > > > > e-mail immediately.
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > --
> > > > > > > Julie Prestopnik
> > > > > > > National Center for Atmospheric Research Research
> > > > > > > Applications Laboratory
> > > > > > > Phone: 303.497.8399
> > > > > > > Email: jpresto at ucar.edu
> > > > > > >
> > > > > > > This e-mail, including attachments, may include
confidential
> > > > > > > and/or proprietary information, and may be used only by
the
> > > > > > > person or entity to which it is addressed. If the reader
of
> > > > > > > this e-mail is not the intended recipient or his or her
> > > > > > > authorized agent, the reader is hereby notified that any
> > > > > > > dissemination, distribution or copying of this e-mail is
> > > > > > > prohibited. If you have received this e-mail in error,
> > > > > > > please notify the sender by replying to this message and
> > > > > > > delete this
> > > > > > e-mail immediately.
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > >
> > > > > >
> > > > > > --
> > > > > > Julie Prestopnik
> > > > > > National Center for Atmospheric Research Research
Applications
> > > > > > Laboratory
> > > > > > Phone: 303.497.8399
> > > > > > Email: jpresto at ucar.edu
> > > > > >
> > > > > > This e-mail, including attachments, may include
confidential
> > > > > > and/or proprietary information, and may be used only by
the
> > > > > > person or entity to which it is addressed. If the reader
of
> > > > > > this e-mail is not the intended recipient or his or her
> > > > > > authorized agent, the reader is hereby notified that any
> > > > > > dissemination, distribution or copying of this e-mail is
> > > > > > prohibited. If you have received this e-mail in error,
please
> > > > > > notify the sender by replying to this message and delete
this
> > > > > e-mail immediately.
> > > > > >
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > > > --
> > > > > Julie Prestopnik
> > > > > National Center for Atmospheric Research Research
Applications
> > > > > Laboratory
> > > > > Phone: 303.497.8399
> > > > > Email: jpresto at ucar.edu
> > > > >
> > > > > This e-mail, including attachments, may include confidential
> > > > > and/or proprietary information, and may be used only by the
> > > > > person or entity to which it is addressed. If the reader of
this
> > > > > e-mail is not the intended recipient or his or her
authorized
> > > > > agent, the reader is hereby notified that any dissemination,
> > > > > distribution or copying of this e-mail is prohibited. If you
> > > > > have received this e-mail in error, please notify the sender
by
> > > > > replying to this message and delete this
> > > > e-mail immediately.
> > > > >
> > > > >
> > > > >
> > > >
> > > >
> > > > --
> > > > Julie Prestopnik
> > > > National Center for Atmospheric Research Research Applications
> > > > Laboratory
> > > > Phone: 303.497.8399
> > > > Email: jpresto at ucar.edu
> > > >
> > > > This e-mail, including attachments, may include confidential
> > > > and/or proprietary information, and may be used only by the
person
> > > > or entity to which it is addressed. If the reader of this e-
mail
> > > > is not the intended recipient or his or her authorized agent,
the
> > > > reader is hereby notified that any dissemination, distribution
or
> > > > copying of this e-mail is prohibited. If you have received
this
> > > > e-mail in error, please notify the sender by replying to this
> > > > message and delete this
> > > e-mail immediately.
> > > >
> > > >
> > > >
> > >
> > >
> > > --
> > > Julie Prestopnik
> > > National Center for Atmospheric Research Research Applications
> > > Laboratory
> > > Phone: 303.497.8399
> > > Email: jpresto at ucar.edu
> > >
> > > This e-mail, including attachments, may include confidential
and/or
> > > proprietary information, and may be used only by the person or
> > > entity to which it is addressed. If the reader of this e-mail is
not
> > > the intended recipient or his or her authorized agent, the
reader is
> > > hereby notified that any dissemination, distribution or copying
of
> > > this e-mail is prohibited. If you have received this e-mail in
> > > error, please notify the sender by replying to this message and
> > > delete this
> > e-mail immediately.
> > >
> > >
> >
> > This e-mail, including attachments, may include confidential
and/or
> > proprietary information, and may be used only by the person or
entity
> > to which it is addressed. If the reader of this e-mail is not the
> > intended recipient or his or her authorized agent, the reader is
> > hereby notified that any dissemination, distribution or copying of
> > this e-mail is prohibited. If you have received this e-mail in
error,
> > please notify the sender by replying to this message and delete
this
> e-mail immediately.
> >
> >
> >
>
> This e-mail, including attachments, may include confidential and/or
> proprietary information, and may be used only by the person or
entity to
> which it is addressed. If the reader of this e-mail is not the
intended
> recipient or his or her authorized agent, the reader is hereby
notified
> that any dissemination, distribution or copying of this e-mail is
> prohibited. If you have received this e-mail in error, please notify
the
> sender by replying to this message and delete this e-mail
immediately.
>
>
>
------------------------------------------------
Subject: Issues converting PREPBUFR to NetCDF
From: John Halley Gotway
Time: Fri Mar 18 11:02:21 2016
Jose,
Sorry, I didn't send the attachments. For some reason, my email
client
isn't letting me add an attachment. The only change I made to the
default
PB2NCConfig file was this:
quality_mark_thresh = 9;
John
On Fri, Mar 18, 2016 at 11:00 AM, John Halley Gotway <johnhg at ucar.edu>
wrote:
> Jose,
>
> Thanks for sending the test data. I see that your model data is
valid at
> time 20150820_180000. When I run Point-Stat, I see the following
reason
> counts in the output:
>
> DEBUG 2: Processing TMP/Z2 versus TMP/Z2, for observation type
ADPSFC,
> over region FULL, for interpolation method NEAREST(1), using 0
pairs.
> DEBUG 3: Number of matched pairs = 0
> DEBUG 3: Observations processed = 949837
> DEBUG 3: Rejected: SID exclusion = 0
> DEBUG 3: Rejected: GRIB code = 943848
> DEBUG 3: Rejected: valid time = 4191
> DEBUG 3: Rejected: bad obs value = 0
> DEBUG 3: Rejected: off the grid = 1798
> DEBUG 3: Rejected: level mismatch = 0
> DEBUG 3: Rejected: quality marker = 0
> DEBUG 3: Rejected: message type = 0
> DEBUG 3: Rejected: masking region = 0
> DEBUG 3: Rejected: bad fcst value = 0
> DEBUG 3: Rejected: duplicates = 0
>
> So it looks like several observations are not used for either the
valid
> time or being off the grid. Let's look at where these temperature
exist.
> I ran the following command to plot their location:
> met-5.1/bin/plot_point_obs newtest.nc newtest.ps -gc 11 -v 3
>
> The "-gc 11" option says only plot temperature. The resulting image
is
> attached. Notice that none of them fall within your East Coast
domain.
> Also notice in the log output that these are all AIRCFT temperature
> observations! No ADPUPA and no ADPSFC.
>
> Since you're using GDAS observations, you should be aware of the
quality
> marker issue for surface observations noted at the bottom of this
page:
> http://www.dtcenter.org/met/users/downloads/observation_data.php
>
> To get Point-Stat running, I did the following steps:
>
> (1) Pull GDAS observations for 20150820_180000:
> wget
>
http://nomads.ncdc.noaa.gov/data/gdas/201508/20150820/gdas1.t18z.prepbufr.nr
>
> (2) Run PB2NC using the attached configuration file (note quality
marker =
> 9):
> met-5.1/bin/pb2nc gdas1.t18z.prepbufr.nr gdas1.t18z.prepbufr.nc
> PB2NCConfig_GDAS
>
> (3) Run Point-Stat using the data/config file you sent me:
> met-5.1/bin/point_stat nmbprs_d01.06 gdas1.t18z.prepbufr.nc
> PointStatConfig -outdir out -v 4
>
> And that give me 3584 matched pairs:
> DEBUG 3: Number of matched pairs = 3584
>
> So the problem was caused by the GDAS quality marker issue. Also
note
> that for North American grids, using NDAS (i.e. north american data
> assimilation) would work equally well and NDAS does *NOT* have this
quality
> marker issue.
>
> Lastly, I see the following warning when I run Point-Stat with your
data:
> WARNING:
> WARNING: gds_to_lambert() -> MET does not currently support Lambert
> Conformal grids where dx (3.317) != dy (2.97) and may produce
unexpected
> results!
> WARNING:
>
> I'd suggest post-processing to a different grid where Dx = Dy prior
to
> running MET.
>
> Hope that helps.
>
> Thanks,
> John
>
> On Fri, Mar 18, 2016 at 10:15 AM, Jose Garcia-Rivera via RT <
> met_help at ucar.edu> wrote:
>
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
>>
>> Dear John,
>>
>> I tried as you suggested, but still have empty output. I put the
files in
>> your ftp in 'garcia_data'
>>
>> The three files in the FTP are:
>>
>> newtest.nc
>> nmbprs_d01.06
>> PointStatConfig
>>
>>
>> Output:
>>
>> [garciaj at login prepbufr_obs]$ ./point_stat nmbprs_d01.06 newtest.nc
>> PointStatConfig_default
>> DEBUG 1: Default Config File:
>> /work/apps/pgi_14.10/SANDY/met-
5.1/share/met/config/PointStatConfig_default
>> DEBUG 1: User Config File: PointStatConfig_default
>> GSL_RNG_TYPE=mt19937
>> GSL_RNG_SEED=18446744071614164054
>> DEBUG 1: Forecast File: nmbprs_d01.06
>> DEBUG 1: Observation File: newtest.nc
>> DEBUG 2:
>> DEBUG 2:
>>
--------------------------------------------------------------------------------
>> DEBUG 2:
>> DEBUG 2: Reading data for TMP/Z2.
>> DEBUG 2: For TMP/Z2 found 1 forecast levels and 0 climatology
levels.
>> DEBUG 2:
>> DEBUG 2:
>>
--------------------------------------------------------------------------------
>> DEBUG 2:
>> DEBUG 2: Searching 949837 observations from 452408 messages.
>> DEBUG 2:
>> DEBUG 2:
>>
--------------------------------------------------------------------------------
>> DEBUG 2:
>> DEBUG 2: Processing TMP/Z2 versus TMP/Z2, for observation type
ADPSFC,
>> over region FULL, for interpolation method NEAREST(1), using 0
pairs.
>> DEBUG 2:
>> DEBUG 2:
>>
--------------------------------------------------------------------------------
>> DEBUG 2:
>> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V.stat
>> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_fho.txt
>> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_ctc.txt
>> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_cts.txt
>> DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_mctc.txt
>> DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_mcts.txt
>> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_cnt.txt
>> DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_sl1l2.txt
>> DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_sal1l2.txt
>> DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_vl1l2.txt
>> DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_val1l2.txt
>> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_pct.txt
>> DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_pstd.txt
>> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_pjc.txt
>> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_prc.txt
>> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_mpr.txt
>>
>> From config file:
>>
>> fcst = {
>> message_type = [ "ADPSFC" ];
>> sid_exc = [];
>>
>> field = [
>> {
>> name = "TMP";
>> level = [ "Z2" ];
>> cat_thresh = [ >293.0 ];
>> }
>> ];
>>
>>
>> Thanks for the help,
>> Jose
>>
>>
>>
>> -----Original Message-----
>> From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
>> Sent: Thursday, March 17, 2016 5:47 PM
>> To: Jose Garcia-Rivera
>> Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to
>> NetCDF
>>
>> Jose,
>>
>> I see that you're doing an upper-air (ADPUPA) evaluation for the
time
>> 20150820_180000. Upper-air observations are much more common at
00Z and
>> 12Z than 06Z and 18Z. Instead of verifying the 06 hour forecast
valid at
>> 18Z, please try the 12 hour forecast valid at 00Z.
>>
>> Also, you could try evaluating some surface fields against the
ADPSFC
>> message type.
>>
>> If you get stuck, you can post a sample forecast file to our
anonymous
>> ftp site, and I can try running it here.
>>
>> Thanks,
>> John
>>
>>
>>
>> On Thu, Mar 17, 2016 at 2:39 PM, Jose Garcia-Rivera via RT <
>> met_help at ucar.edu> wrote:
>>
>> >
>> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
>> >
>> > Dear John,
>> >
>> > It's great to hear from you again! Julie has been of great help.
We
>> > highly appreciate all the help coming from your team.
>> >
>> > I followed your recommendation, and got the following:
>> >
>> > [garciaj at login prepbufr_obs]$ ./point_stat -v 3 nmbprs_d01.06
>> > newtest.nc PointStatConfig_default DEBUG 1: Default Config File:
>> > /work/apps/pgi_14.10/SANDY/met-
5.1/share/met/config/PointStatConfig_de
>> > fault DEBUG 1: User Config File: PointStatConfig_default
>> > GSL_RNG_TYPE=mt19937
>> > GSL_RNG_SEED=1041230678
>> > DEBUG 1: Forecast File: nmbprs_d01.06
>> > DEBUG 1: Observation File: newtest.nc
>> > DEBUG 2:
>> > DEBUG 2:
>> >
----------------------------------------------------------------------
>> > ----------
>> > DEBUG 2:
>> > DEBUG 2: Reading data for SPFH/P500.
>> > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found range
match for
>> > VarInfo "SPFH/P500" in GRIB record 134 of GRIB file
"nmbprs_d01.06".
>> > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found 1 GRIB
records
>> > matching VarInfo "SPFH/P500" in GRIB file "nmbprs_d01.06".
>> > DEBUG 3: Use the matching forecast and observation grids.
>> > DEBUG 3: Grid Definition: Projection: Lambert Conformal Nx: 400
Ny:
>> > 400
>> > Lat_LL: 33.302 Lon_LL: 84.951 Lon_orient: 77.459 Alpha: 3781.822
Cone:
>> > 0.629 Bx: 210.6765 By: 2557.3266
>> > DEBUG 2: For SPFH/P500 found 1 forecast levels and 0 climatology
levels.
>> > DEBUG 2:
>> > DEBUG 2:
>> >
----------------------------------------------------------------------
>> > ----------
>> > DEBUG 2:
>> > DEBUG 2: Reading data for TMP/P500.
>> > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found range
match for
>> > VarInfo "TMP/P500" in GRIB record 131 of GRIB file
"nmbprs_d01.06".
>> > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found 1 GRIB
records
>> > matching VarInfo "TMP/P500" in GRIB file "nmbprs_d01.06".
>> > DEBUG 2: For TMP/P500 found 1 forecast levels and 0 climatology
levels.
>> > DEBUG 2:
>> > DEBUG 2:
>> >
----------------------------------------------------------------------
>> > ----------
>> > DEBUG 2:
>> > DEBUG 2: Reading data for HGT/P500.
>> > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found range
match for
>> > VarInfo "HGT/P500" in GRIB record 130 of GRIB file
"nmbprs_d01.06".
>> > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found 1 GRIB
records
>> > matching VarInfo "HGT/P500" in GRIB file "nmbprs_d01.06".
>> > DEBUG 2: For HGT/P500 found 1 forecast levels and 0 climatology
levels.
>> > DEBUG 2:
>> > DEBUG 2:
>> >
----------------------------------------------------------------------
>> > ----------
>> > DEBUG 2:
>> > DEBUG 2: Reading data for UGRD/P500.
>> > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found range
match for
>> > VarInfo "UGRD/P500" in GRIB record 137 of GRIB file
"nmbprs_d01.06".
>> > DEBUG 3: MetGrib1DataFile::rotate_winds() -> Have U-wind record,
>> > reading V-wind record.
>> > DEBUG 3: MetGrib1DataFile::data_plane_scalar() -> Found exact
match
>> > for VarInfo "UGRD/P500" in GRIB record 138 of GRIB file
"nmbprs_d01.06".
>> > DEBUG 3: Rotating U and V wind components from grid-relative to
>> > earth-relative.
>> > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found 1 GRIB
records
>> > matching VarInfo "UGRD/P500" in GRIB file "nmbprs_d01.06".
>> > DEBUG 2: For UGRD/P500 found 1 forecast levels and 0 climatology
levels.
>> > DEBUG 2:
>> > DEBUG 2:
>> >
----------------------------------------------------------------------
>> > ----------
>> > DEBUG 2:
>> > DEBUG 2: Reading data for VGRD/P500.
>> > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found range
match for
>> > VarInfo "VGRD/P500" in GRIB record 138 of GRIB file
"nmbprs_d01.06".
>> > DEBUG 3: MetGrib1DataFile::rotate_winds() -> Have V-wind record,
>> > reading U-wind record.
>> > DEBUG 3: MetGrib1DataFile::data_plane_scalar() -> Found exact
match
>> > for VarInfo "VGRD/P500" in GRIB record 137 of GRIB file
"nmbprs_d01.06".
>> > DEBUG 3: Rotating U and V wind components from grid-relative to
>> > earth-relative.
>> > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found 1 GRIB
records
>> > matching VarInfo "VGRD/P500" in GRIB file "nmbprs_d01.06".
>> > DEBUG 2: For VGRD/P500 found 1 forecast levels and 0 climatology
levels.
>> > DEBUG 2:
>> > DEBUG 2:
>> >
----------------------------------------------------------------------
>> > ----------
>> > DEBUG 2:
>> > DEBUG 2: Searching 949837 observations from 452408 messages.
>> > DEBUG 2:
>> > DEBUG 2:
>> >
----------------------------------------------------------------------
>> > ----------
>> > DEBUG 2:
>> > DEBUG 2: Processing SPFH/P500 versus SPFH/P500, for observation
type
>> > ADPUPA, over region FULL, for interpolation method NEAREST(1),
using 0
>> > pairs.
>> > DEBUG 3: Number of matched pairs = 0
>> > DEBUG 3: Observations processed = 949837
>> > DEBUG 3: Rejected: SID exclusion = 0
>> > DEBUG 3: Rejected: GRIB code = 947898
>> > DEBUG 3: Rejected: valid time = 1416
>> > DEBUG 3: Rejected: bad obs value = 0
>> > DEBUG 3: Rejected: off the grid = 523
>> > DEBUG 3: Rejected: level mismatch = 0
>> > DEBUG 3: Rejected: quality marker = 0
>> > DEBUG 3: Rejected: message type = 0
>> > DEBUG 3: Rejected: masking region = 0
>> > DEBUG 3: Rejected: bad fcst value = 0
>> > DEBUG 3: Rejected: duplicates = 0
>> > DEBUG 2:
>> > DEBUG 2:
>> >
----------------------------------------------------------------------
>> > ----------
>> > DEBUG 2:
>> > DEBUG 2: Processing TMP/P500 versus TMP/P500, for observation
type
>> > ADPUPA, over region FULL, for interpolation method NEAREST(1),
using 0
>> pairs.
>> > DEBUG 3: Number of matched pairs = 0
>> > DEBUG 3: Observations processed = 949837
>> > DEBUG 3: Rejected: SID exclusion = 0
>> > DEBUG 3: Rejected: GRIB code = 943848
>> > DEBUG 3: Rejected: valid time = 4191
>> > DEBUG 3: Rejected: bad obs value = 0
>> > DEBUG 3: Rejected: off the grid = 1798
>> > DEBUG 3: Rejected: level mismatch = 0
>> > DEBUG 3: Rejected: quality marker = 0
>> > DEBUG 3: Rejected: message type = 0
>> > DEBUG 3: Rejected: masking region = 0
>> > DEBUG 3: Rejected: bad fcst value = 0
>> > DEBUG 3: Rejected: duplicates = 0
>> > DEBUG 2:
>> > DEBUG 2:
>> >
----------------------------------------------------------------------
>> > ----------
>> > DEBUG 2:
>> > DEBUG 2: Processing HGT/P500 versus HGT/P500, for observation
type
>> > ADPUPA, over region FULL, for interpolation method NEAREST(1),
using 0
>> pairs.
>> > DEBUG 3: Number of matched pairs = 0
>> > DEBUG 3: Observations processed = 949837
>> > DEBUG 3: Rejected: SID exclusion = 0
>> > DEBUG 3: Rejected: GRIB code = 606744
>> > DEBUG 3: Rejected: valid time = 319085
>> > DEBUG 3: Rejected: bad obs value = 0
>> > DEBUG 3: Rejected: off the grid = 23610
>> > DEBUG 3: Rejected: level mismatch = 395 DEBUG 3: Rejected:
quality
>> > marker = 0
>> > DEBUG 3: Rejected: message type = 3
>> > DEBUG 3: Rejected: masking region = 0
>> > DEBUG 3: Rejected: bad fcst value = 0
>> > DEBUG 3: Rejected: duplicates = 0
>> > DEBUG 2:
>> > DEBUG 2:
>> >
----------------------------------------------------------------------
>> > ----------
>> > DEBUG 2:
>> > DEBUG 2: Processing UGRD/P500 versus UGRD/P500, for observation
type
>> > ADPUPA, over region FULL, for interpolation method NEAREST(1),
using 0
>> > pairs.
>> > DEBUG 3: Number of matched pairs = 0
>> > DEBUG 3: Observations processed = 949837
>> > DEBUG 3: Rejected: SID exclusion = 0
>> > DEBUG 3: Rejected: GRIB code = 650429
>> > DEBUG 3: Rejected: valid time = 277745
>> > DEBUG 3: Rejected: bad obs value = 0
>> > DEBUG 3: Rejected: off the grid = 21341
>> > DEBUG 3: Rejected: level mismatch = 319 DEBUG 3: Rejected:
quality
>> > marker = 0
>> > DEBUG 3: Rejected: message type = 3
>> > DEBUG 3: Rejected: masking region = 0
>> > DEBUG 3: Rejected: bad fcst value = 0
>> > DEBUG 3: Rejected: duplicates = 0
>> > DEBUG 2:
>> > DEBUG 2:
>> >
----------------------------------------------------------------------
>> > ----------
>> > DEBUG 2:
>> > DEBUG 2: Processing VGRD/P500 versus VGRD/P500, for observation
type
>> > ADPUPA, over region FULL, for interpolation method NEAREST(1),
using 0
>> > pairs.
>> > DEBUG 3: Number of matched pairs = 0
>> > DEBUG 3: Observations processed = 949837
>> > DEBUG 3: Rejected: SID exclusion = 0
>> > DEBUG 3: Rejected: GRIB code = 650429
>> > DEBUG 3: Rejected: valid time = 277745
>> > DEBUG 3: Rejected: bad obs value = 0
>> > DEBUG 3: Rejected: off the grid = 21341
>> > DEBUG 3: Rejected: level mismatch = 319 DEBUG 3: Rejected:
quality
>> > marker = 0
>> > DEBUG 3: Rejected: message type = 3
>> > DEBUG 3: Rejected: masking region = 0
>> > DEBUG 3: Rejected: bad fcst value = 0
>> > DEBUG 3: Rejected: duplicates = 0
>> > DEBUG 2:
>> > DEBUG 2:
>> >
----------------------------------------------------------------------
>> > ----------
>> > DEBUG 2:
>> > DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V.stat
>> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_fho.txt
>> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_ctc.txt
>> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_cts.txt
>> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_mctc.txt
>> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_mcts.txt
>> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_cnt.txt
>> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_sl1l2.txt
>> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_sal1l2.txt
>> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_vl1l2.txt
>> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_val1l2.txt
>> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_pct.txt
>> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_pstd.txt
>> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_pjc.txt
>> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_prc.txt
>> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_mpr.txt
>> >
>> >
>> >
>> > Best Regards,
>> > Jose
>> >
>> >
>> >
>> >
>> >
>> > -----Original Message-----
>> > From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
>> > Sent: Thursday, March 17, 2016 3:29 PM
>> > To: Jose Garcia-Rivera
>> > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR
to
>> > NetCDF
>> >
>> > Hello Jose,
>> >
>> > Julie is out of the office today, but I should be able to help
you.
>> > Glad you were able to finally get PB2NC working. That was a
tricky
>> > one! But it helped us realize that since BUFRLIB has changed to
>> > FORTRAN 90, we should update the MET code which calls BUFRLIB to
be
>> compatible.
>> >
>> > I see that you are now getting 0 matched pairs when you run
Point-Stat
>> > with the output of PB2NC. Please try rerunning Point-Stat but
use a
>> > higher verbosity level, like "-v 3". That'll print out the
following
>> > type of counts for each of the verification tasks you've defined
in the
>> config file:
>> >
>> > DEBUG 3: Number of matched pairs = 312
>> > DEBUG 3: Observations processed = 87753
>> > DEBUG 3: Rejected: SID exclusion = 0
>> > DEBUG 3: Rejected: GRIB code = 77648
>> > DEBUG 3: Rejected: valid time = 0
>> > DEBUG 3: Rejected: bad obs value = 0
>> > DEBUG 3: Rejected: off the grid = 5
>> > DEBUG 3: Rejected: level mismatch = 9219 DEBUG 3: Rejected:
quality
>> > marker = 0
>> > DEBUG 3: Rejected: message type = 537
>> > DEBUG 3: Rejected: masking region = 32 DEBUG 3: Rejected: bad
fcst
>> > value = 0
>> > DEBUG 3: Rejected: duplicates = 0
>> >
>> > In the example above, 87753 observation values were checked and
the
>> > counts list reasons why there were not used for that task. Out
of
>> > those 87753 obs, 312 of them were used for this task.
>> >
>> > Looking at the counts from your Point-Stat run should help you
figure
>> > out why you have 0 matched pairs.
>> >
>> > Thanks,
>> > John
>> >
>> >
>> > On Thu, Mar 17, 2016 at 12:29 PM, Jose Garcia-Rivera via RT <
>> > met_help at ucar.edu> wrote:
>> >
>> > >
>> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
>> > >
>> > > Dear Julie,
>> > >
>> > > We got the executables to work! However, I have a couple of
>> > > issues/questions:
>> > >
>> > >
>> > >
>> > > Issue #1 --- Not getting values after running point_stat
>> > >
>> > > Everything seems to run fine. I attached the configuration
file. I
>> > > can send the three files via FTP if needed.
>> > >
>> > >
>> > >
>> > > Issue #2 --- PB2NC doesn't seem to finish the job, but it does?
I
>> > > had to do CTRL+C, and checked the netCDF file using
ncl_filedump:
>> > >
>> > > [garciaj at login prepbufr_obs]$ ./pb2nc
prepbufr.gdas.20150820.t18z.nr
>> > > newtest.nc PB2NCConfig_default DEBUG 1: Default Config File:
>> > > /work/apps/pgi_14.10/SANDY/met-
5.1/share/met/config/PB2NCConfig_defa
>> > > ul t DEBUG 1: User Config File: PB2NCConfig_default
>> > > DEBUG 1: Creating NetCDF File: newtest.nc
>> > > DEBUG 1: Processing PrepBufr File:
>> prepbufr.gdas.20150820.t18z.nr
>> > > DEBUG 1: Blocking PrepBufr file to:
/tmp/tmp_pb2nc_blk_17703_0
>> > > DEBUG 2: PrepBufr Time Center: 20150820_180000
>> > > DEBUG 2: Searching Time Window: 20150820_163000 to
>> > 20150820_193000
>> > > DEBUG 2: Processing 685386 PrepBufr messages...
>> > > 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80%
85%
>> > > 90% 95% 100%
>> > > DEBUG 2: Total PrepBufr Messages processed = 685386
>> > > DEBUG 2: Rejected based on message type = 0
>> > > DEBUG 2: Rejected based on station id = 0
>> > > DEBUG 2: Rejected based on valid time = 185145
>> > > DEBUG 2: Rejected based on masking grid = 0
>> > > DEBUG 2: Rejected based on masking polygon = 0
>> > > DEBUG 2: Rejected based on elevation = 0
>> > > DEBUG 2: Rejected based on pb report type = 0
>> > > DEBUG 2: Rejected based on input report type = 0
>> > > DEBUG 2: Rejected based on instrument type = 0
>> > > DEBUG 2: Rejected based on zero observations = 47833
>> > > DEBUG 2: Total PrepBufr Messages retained = 452408
>> > > DEBUG 2: Total observations retained or derived = 949837 ^C
>> > >
>> > >
>> > > Checking netCDF file:
>> > >
>> > > [garciaj at login prepbufr_obs]$ ncl_filedump newtest.nc
Copyright (C)
>> > > 1995-2015 - All Rights Reserved University Corporation for
>> > > Atmospheric Research NCAR Command Language Version 6.3.0 The
use
>> > > of this software is governed by a License Agreement.
>> > > See http://www.ncl.ucar.edu/ for more details.
>> > >
>> > > Variable: f
>> > > Type: file
>> > > filename: newtest
>> > > path: newtest.nc
>> > > file global attributes:
>> > > FileOrigins : File newtest.nc generated 20160317_155548
UTC on
>> > > host login.local by the MET pb2nc tool
>> > > MET_version : V5.1
>> > > MET_tool : pb2nc
>> > > dimensions:
>> > > mxstr = 16
>> > > hdr_arr_len = 3
>> > > obs_arr_len = 5
>> > > nobs = 949837 // unlimited
>> > > nhdr = 452408
>> > > variables:
>> > > character obs_qty ( nobs, mxstr )
>> > > long_name : quality flag
>> > >
>> > > float obs_arr ( nobs, obs_arr_len )
>> > > long_name : array of observation values
>> > > _fill_value : -9999
>> > > columns : hdr_id gc lvl hgt ob
>> > > hdr_id_long_name : index of matching header data
>> > > gc_long_name : grib code corresponding to the
observation
>> type
>> > > lvl_long_name : pressure level (hPa) or
accumulation
>> > > interval (sec)
>> > > hgt_long_name : height in meters above sea
level (msl)
>> > > ob_long_name : observation value
>> > >
>> > > character hdr_typ ( nhdr, mxstr )
>> > > long_name : message type
>> > >
>> > > character hdr_sid ( nhdr, mxstr )
>> > > long_name : station identification
>> > >
>> > > character hdr_vld ( nhdr, mxstr )
>> > > long_name : valid time
>> > > units : YYYYMMDD_HHMMSS
>> > >
>> > > float hdr_arr ( nhdr, hdr_arr_len )
>> > > long_name : array of observation station header
values
>> > > _fill_value : -9999
>> > > columns : lat lon elv
>> > > lat_long_name : latitude
>> > > lat_units : degrees_north
>> > > lon_long_name : longitude
>> > > lon_units : degrees_east
>> > > elv_long_name : elevation
>> > > elv_units : meters above sea level (msl)
>> > >
>> > >
>> > >
>> > >
>> > > Thanks for all the help,
>> > > Jose
>> > >
>> > >
>> > >
>> > >
>> > >
>> > >
>> > > -----Original Message-----
>> > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
>> > > Sent: Wednesday, March 16, 2016 4:40 PM
>> > > To: Jose Garcia-Rivera
>> > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
PREPBUFR to
>> > > NetCDF
>> > >
>> > > Hi Jose. I apologize for the delay. This was a tricky problem
to
>> > > figure out, however, we were finally able to reproduce the
error you
>> > > are receiving for pb2nc.
>> > >
>> > > The problem is BUFRLIB being compiled with pgf90 and MET being
>> > > compiled with pgf77. They aren't talking well to each other.
>> > > BUFRLIBv10.1.0 compiles with pgf77 but later versions require
pgf90.
>> > >
>> > > We will plan on updating the MET Fortran code to compile with
pgf90
>> > > so that we can use newer BUFRLIB versions, but for now, to
solve
>> > > your problem, I have attached BUFRLIB_v10-1-0.tar. Please
install
>> > > that version of BUFRLIB using pgf77 and then recompile MET
without
>> > > the "LIBS" environment variable setting?
>> > >
>> > > Please let me know how that goes. We were able to get a
successful
>> > > run using that solution and hope you will too.
>> > >
>> > > Thanks,
>> > > Julie
>> > >
>> > >
>> > > On Wed, Mar 16, 2016 at 12:17 PM, Jose Garcia-Rivera via RT <
>> > > met_help at ucar.edu> wrote:
>> > >
>> > > >
>> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
>
>> > > >
>> > > > Dear Julie,
>> > > >
>> > > > Is there anything that we can do here to sort these issues
out?
>> > > >
>> > > > Best Regards,
>> > > > Jose
>> > > >
>> > > > -----Original Message-----
>> > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
>> > > > Sent: Tuesday, March 15, 2016 5:08 PM
>> > > > To: Jose Garcia-Rivera
>> > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
PREPBUFR
>> > > > to NetCDF
>> > > >
>> > > > Hi Jose. I was not. I got the same error you did. I
believe
>> > > > that the test.nc file is not in the correct format needed by
>> > > > point_stat, so I think we need to get pb2nc working for you.
It
>> > > > is likely a communication problem between the C code and the
>> Fortran code.
>> > > >
>> > > > Julie
>> > > >
>> > > > On Tue, Mar 15, 2016 at 3:05 PM, Jose Garcia-Rivera via RT <
>> > > > met_help at ucar.edu> wrote:
>> > > >
>> > > > >
>> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
>> > > > >
>> > > > > Dear Julie,
>> > > > >
>> > > > > Quick question: Were you able to run point_stat with the
netCDF
>> > > > > file that I sent yesterday?
>> > > > >
>> > > > > Thanks for the help,
>> > > > > Jose
>> > > > >
>> > > > > -----Original Message-----
>> > > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
>> > > > > Sent: Tuesday, March 15, 2016 12:17 PM
>> > > > > To: Jose Garcia-Rivera
>> > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
PREPBUFR
>> > > > > to NetCDF
>> > > > >
>> > > > > Thank you, Jose. I'm working with co-workers to try to get
>> > > > > these issues resolved. I hope to get back to you soon.
>> > > > >
>> > > > > Julie
>> > > > >
>> > > > > On Mon, Mar 14, 2016 at 1:36 PM, Jose Garcia-Rivera via RT
<
>> > > > > met_help at ucar.edu> wrote:
>> > > > >
>> > > > > >
>> > > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
>> > > > > > >
>> > > > > >
>> > > > > > Dear Julie,
>> > > > > >
>> > > > > > I just uploaded the three files to 'garcia_data'.
>> > > > > >
>> > > > > > Thanks for the help,
>> > > > > > Jose
>> > > > > >
>> > > > > >
>> > > > > > -----Original Message-----
>> > > > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
>> > > > > > Sent: Monday, March 14, 2016 3:32 PM
>> > > > > > To: Jose Garcia-Rivera
>> > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
>> > > > > > PREPBUFR to NetCDF
>> > > > > >
>> > > > > > Hi Jose.
>> > > > > >
>> > > > > > Yes, please upload your input files and configuration
file
>> > > > > > (nmbprs_d01.06, test.nc, PointStatConfig_default) to our
>> > > > > > anonymous ftp
>> > > > > site as follows:
>> > > > > > http://www.dtcenter.org/met/users/support/met_help.php
>> > > > > >
>> > > > > > Thanks!
>> > > > > >
>> > > > > > Julie
>> > > > > >
>> > > > > > On Mon, Mar 14, 2016 at 1:06 PM, Jose Garcia-Rivera via
RT <
>> > > > > > met_help at ucar.edu> wrote:
>> > > > > >
>> > > > > > >
>> > > > > > > <URL:
>> > > > > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
>> > > > > > > >
>> > > > > > >
>> > > > > > > Dear Julie,
>> > > > > > >
>> > > > > > > I got to convert my prepbufr file using a python
script.
>> > > > > > > However, I have trouble running point_stat. Can I send
you
>> > > > > > > the files, to see if you have the same issue?
>> > > > > > >
>> > > > > > >
>> > > > > > > This is what I got:
>> > > > > > >
>> > > > > > > [garciaj at login prepbufr_obs]$ ./point_stat
nmbprs_d01.06
>> > > > > > > test.nc PointStatConfig_default DEBUG 1: Default Config
File:
>> > > > > > > /work/apps/pgi_14.10/SANDY/met-
5.1/share/met/config/PointSta
>> > > > > > > tC on fi g_ de fault DEBUG 1: User Config File:
>> > > > > > > PointStatConfig_default
>> > > > > > > GSL_RNG_TYPE=mt19937
>> > > > > > > GSL_RNG_SEED=18446744073425053526 DEBUG 1: Forecast
File:
>> > > > > > > nmbprs_d01.06 DEBUG 1: Observation File:
>> > > > > > > test.nc DEBUG 2:
>> > > > > > > DEBUG 2:
>> > > > > > >
------------------------------------------------------------
>> > > > > > > --
>> > > > > > > --
>> > > > > > > --
>> > > > > > > --
>> > > > > > > --
>> > > > > > > ----------
>> > > > > > > DEBUG 2:
>> > > > > > > DEBUG 2: Reading data for SPFH/P500.
>> > > > > > > DEBUG 2: For SPFH/P500 found 1 forecast levels and 0
>> > > > > > > climatology
>> > > > > levels.
>> > > > > > > DEBUG 2:
>> > > > > > > DEBUG 2:
>> > > > > > >
------------------------------------------------------------
>> > > > > > > --
>> > > > > > > --
>> > > > > > > --
>> > > > > > > --
>> > > > > > > --
>> > > > > > > ----------
>> > > > > > > DEBUG 2:
>> > > > > > > DEBUG 2: Reading data for TMP/P500.
>> > > > > > > DEBUG 2: For TMP/P500 found 1 forecast levels and 0
>> > > > > > > climatology
>> > > > levels.
>> > > > > > > DEBUG 2:
>> > > > > > > DEBUG 2:
>> > > > > > >
------------------------------------------------------------
>> > > > > > > --
>> > > > > > > --
>> > > > > > > --
>> > > > > > > --
>> > > > > > > --
>> > > > > > > ----------
>> > > > > > > DEBUG 2:
>> > > > > > > DEBUG 2: Reading data for HGT/P500.
>> > > > > > > DEBUG 2: For HGT/P500 found 1 forecast levels and 0
>> > > > > > > climatology
>> > > > levels.
>> > > > > > > DEBUG 2:
>> > > > > > > DEBUG 2:
>> > > > > > >
------------------------------------------------------------
>> > > > > > > --
>> > > > > > > --
>> > > > > > > --
>> > > > > > > --
>> > > > > > > --
>> > > > > > > ----------
>> > > > > > > DEBUG 2:
>> > > > > > > DEBUG 2: Reading data for UGRD/P500.
>> > > > > > > DEBUG 2: For UGRD/P500 found 1 forecast levels and 0
>> > > > > > > climatology
>> > > > > levels.
>> > > > > > > DEBUG 2:
>> > > > > > > DEBUG 2:
>> > > > > > >
------------------------------------------------------------
>> > > > > > > --
>> > > > > > > --
>> > > > > > > --
>> > > > > > > --
>> > > > > > > --
>> > > > > > > ----------
>> > > > > > > DEBUG 2:
>> > > > > > > DEBUG 2: Reading data for VGRD/P500.
>> > > > > > > DEBUG 2: For VGRD/P500 found 1 forecast levels and 0
>> > > > > > > climatology
>> > > > > levels.
>> > > > > > > DEBUG 2:
>> > > > > > > DEBUG 2:
>> > > > > > >
------------------------------------------------------------
>> > > > > > > --
>> > > > > > > --
>> > > > > > > --
>> > > > > > > --
>> > > > > > > --
>> > > > > > > ----------
>> > > > > > > DEBUG 2:
>> > > > > > > WARNING:
>> > > > > > > WARNING: process_obs_file() -> can't open observation
netCDF
>> > file:
>> > > > > > > test.nc
>> > > > > > > WARNING:
>> > > > > > > DEBUG 2:
>> > > > > > > DEBUG 2:
>> > > > > > >
------------------------------------------------------------
>> > > > > > > --
>> > > > > > > --
>> > > > > > > --
>> > > > > > > --
>> > > > > > > --
>> > > > > > > ----------
>> > > > > > > DEBUG 2:
>> > > > > > > DEBUG 2: Processing SPFH/P500 versus SPFH/P500, for
>> > > > > > > observation type ADPUPA, over region FULL, for
interpolation
>> > > > > > > method NEAREST(1), using
>> > > > > > > 0 pairs.
>> > > > > > > DEBUG 2:
>> > > > > > > DEBUG 2:
>> > > > > > >
------------------------------------------------------------
>> > > > > > > --
>> > > > > > > --
>> > > > > > > --
>> > > > > > > --
>> > > > > > > --
>> > > > > > > ----------
>> > > > > > > DEBUG 2:
>> > > > > > > DEBUG 2: Processing TMP/P500 versus TMP/P500, for
>> > > > > > > observation type ADPUPA, over region FULL, for
interpolation
>> > > > > > > method NEAREST(1), using
>> > > > > > > 0
>> > > > > > pairs.
>> > > > > > > DEBUG 2:
>> > > > > > > DEBUG 2:
>> > > > > > >
------------------------------------------------------------
>> > > > > > > --
>> > > > > > > --
>> > > > > > > --
>> > > > > > > --
>> > > > > > > --
>> > > > > > > ----------
>> > > > > > > DEBUG 2:
>> > > > > > > DEBUG 2: Processing HGT/P500 versus HGT/P500, for
>> > > > > > > observation type ADPUPA, over region FULL, for
interpolation
>> > > > > > > method NEAREST(1), using
>> > > > > > > 0
>> > > > > > pairs.
>> > > > > > > DEBUG 2:
>> > > > > > > DEBUG 2:
>> > > > > > >
------------------------------------------------------------
>> > > > > > > --
>> > > > > > > --
>> > > > > > > --
>> > > > > > > --
>> > > > > > > --
>> > > > > > > ----------
>> > > > > > > DEBUG 2:
>> > > > > > > DEBUG 2: Processing UGRD/P500 versus UGRD/P500, for
>> > > > > > > observation type ADPUPA, over region FULL, for
interpolation
>> > > > > > > method NEAREST(1), using
>> > > > > > > 0 pairs.
>> > > > > > > DEBUG 2:
>> > > > > > > DEBUG 2:
>> > > > > > >
------------------------------------------------------------
>> > > > > > > --
>> > > > > > > --
>> > > > > > > --
>> > > > > > > --
>> > > > > > > --
>> > > > > > > ----------
>> > > > > > > DEBUG 2:
>> > > > > > > DEBUG 2: Processing VGRD/P500 versus VGRD/P500, for
>> > > > > > > observation type ADPUPA, over region FULL, for
interpolation
>> > > > > > > method NEAREST(1), using
>> > > > > > > 0 pairs.
>> > > > > > > DEBUG 2:
>> > > > > > > DEBUG 2:
>> > > > > > >
------------------------------------------------------------
>> > > > > > > --
>> > > > > > > --
>> > > > > > > --
>> > > > > > > --
>> > > > > > > --
>> > > > > > > ----------
>> > > > > > > DEBUG 2:
>> > > > > > > DEBUG 1: Output file:
>> > > > > > > ./point_stat_060000L_20150820_180000V.stat
>> > > > > > > DEBUG 1: Output file:
>> > > > > > > ./point_stat_060000L_20150820_180000V_fho.txt
>> > > > > > > DEBUG 1: Output file:
>> > > > > > > ./point_stat_060000L_20150820_180000V_ctc.txt
>> > > > > > > DEBUG 1: Output file:
>> > > > > > > ./point_stat_060000L_20150820_180000V_cts.txt
>> > > > > > > DEBUG 1: Output file:
>> > > > > > > ./point_stat_060000L_20150820_180000V_mctc.txt
>> > > > > > > DEBUG 1: Output file:
>> > > > > > > ./point_stat_060000L_20150820_180000V_mcts.txt
>> > > > > > > DEBUG 1: Output file:
>> > > > > > > ./point_stat_060000L_20150820_180000V_cnt.txt
>> > > > > > > DEBUG 1: Output file:
>> > > > > > > ./point_stat_060000L_20150820_180000V_sl1l2.txt
>> > > > > > > DEBUG 1: Output file:
>> > > > > > > ./point_stat_060000L_20150820_180000V_sal1l2.txt
>> > > > > > > DEBUG 1: Output file:
>> > > > > > > ./point_stat_060000L_20150820_180000V_vl1l2.txt
>> > > > > > > DEBUG 1: Output file:
>> > > > > > > ./point_stat_060000L_20150820_180000V_val1l2.txt
>> > > > > > > DEBUG 1: Output file:
>> > > > > > > ./point_stat_060000L_20150820_180000V_pct.txt
>> > > > > > > DEBUG 1: Output file:
>> > > > > > > ./point_stat_060000L_20150820_180000V_pstd.txt
>> > > > > > > DEBUG 1: Output file:
>> > > > > > > ./point_stat_060000L_20150820_180000V_pjc.txt
>> > > > > > > DEBUG 1: Output file:
>> > > > > > > ./point_stat_060000L_20150820_180000V_prc.txt
>> > > > > > > DEBUG 1: Output file:
>> > > > > > > ./point_stat_060000L_20150820_180000V_mpr.txt
>> > > > > > >
>> > > > > > >
>> > > > > > > Thanks for the help,
>> > > > > > > Jose
>> > > > > > >
>> > > > > > >
>> > > > > > > -----Original Message-----
>> > > > > > > From: Julie Prestopnik via RT
[mailto:met_help at ucar.edu]
>> > > > > > > Sent: Monday, March 14, 2016 12:17 PM
>> > > > > > > To: Jose Garcia-Rivera
>> > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
>> > > > > > > PREPBUFR to NetCDF
>> > > > > > >
>> > > > > > > Hi Jose. I apologize for the delayed response. I was
out
>> > > > > > > of the office on Friday. I'm going to try to figure
out a
>> > > > > > > solution and get back with you shortly.
>> > > > > > >
>> > > > > > > Julie
>> > > > > > >
>> > > > > > > On Fri, Mar 11, 2016 at 2:02 PM, Jose Garcia-Rivera via
RT <
>> > > > > > > met_help at ucar.edu> wrote:
>> > > > > > >
>> > > > > > > >
>> > > > > > > > <URL:
>> > > > > > > >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
>> > > > > > > > >
>> > > > > > > >
>> > > > > > > > Dear Julie,
>> > > > > > > >
>> > > > > > > > Any news regarding pb2nc? We're still unable to make
it
>> work.
>> > > > > > > >
>> > > > > > > > Best Regards,
>> > > > > > > > Jose
>> > > > > > > >
>> > > > > > > > -----Original Message-----
>> > > > > > > > From: Julie Prestopnik via RT
[mailto:met_help at ucar.edu]
>> > > > > > > > Sent: Thursday, March 10, 2016 4:20 PM
>> > > > > > > > To: Jose Garcia-Rivera
>> > > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues
converting
>> > > > > > > > PREPBUFR to NetCDF
>> > > > > > > >
>> > > > > > > > Hi Jose. Thank you for attaching the files.
>> > > > > > > >
>> > > > > > > > Could you please send me a list of the files in
>> > > > > > > > /work/apps/pgi_14.10/SANDY/bufrlib/lib?
>> > > > > > > >
>> > > > > > > > Thank you!
>> > > > > > > >
>> > > > > > > > Julie
>> > > > > > > >
>> > > > > > > >
>> > > > > > > > On Thu, Mar 10, 2016 at 12:20 PM, Jose Garcia-Rivera
via
>> > > > > > > > RT < met_help at ucar.edu> wrote:
>> > > > > > > >
>> > > > > > > > >
>> > > > > > > > > <URL:
>> > > > > > > > >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
>> > > > > > > > > >
>> > > > > > > > >
>> > > > > > > > > Dear Julie,
>> > > > > > > > >
>> > > > > > > > > The administrator re-compiled MET following your
>> > > > > > > > > instructions, and says there's still trouble. He
sent me
>> > > > > > > > > the log files
>> > > > > (attached).
>> > > > > > > > > Is there any other approach that might help?
>> > > > > > > > >
>> > > > > > > > > Best Regards,
>> > > > > > > > > Jose
>> > > > > > > > >
>> > > > > > > > > -----Original Message-----
>> > > > > > > > > From: Julie Prestopnik via RT
[mailto:met_help at ucar.edu]
>> > > > > > > > > Sent: Wednesday, March 09, 2016 12:39 PM
>> > > > > > > > > To: Jose Garcia-Rivera
>> > > > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues
converting
>> > > > > > > > > PREPBUFR to NetCDF
>> > > > > > > > >
>> > > > > > > > > Thank you, Jose! It looks like something went
wrong
>> > > > > > > > > during
>> > > > > > > compilation.
>> > > > > > > > > I suggest recompiling MET to see if we can get this
>> > > > > > > > > issue
>> > > > resolved.
>> > > > > > > > > NCEP's BUFRLIB is used by the pb2nc MET tool, and
is a
>> > > > > > > > > required external library for pb2nc. MET is not
yet
>> > > > > > > > > compatible with BUFRLIB
>> > > > > > > > version 11.0.0, so we
>> > > > > > > > > suggest getting version 10.2.3. We are working on
our
>> > online
>> > > > > > tutorial
>> > > > > > > > for
>> > > > > > > > > METv.5.1, but in the meantime, I'll point you to
our
>> > > > > > > > > online tutorial directions for installing BUFRLIB:
>> > > > > > > > >
>> > > > > > > > >
>> > > > > > > > >
>> > >
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.
>> > > > > > > > > 0/
>> > > > > > > > > co
>> > > > > > > > > mp
>> > > > > > > > > ilation/req_libs.php
>> > > > > > > > >
>> > > > > > > > > It is also important to review the necessary
environment
>> > > > > > > > > variables to
>> > > > > > > > set:
>> > > > > > > > >
>> > > > > > > > >
>> > > > > > > > >
>> > >
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.
>> > > > > > > > > 0/
>> > > > > > > > > co
>> > > > > > > > > mp
>> > > > > > > > > ilation/configure.php
>> > > > > > > > >
>> > > > > > > > > For example,
>> > > > > > > > >
>> > > > > > > > > "Set *$MET_BUFR* to point to the main BUFR
directory, or
>> > > > > > > > > set
>> > > > > > > > > *$MET_BUFRLIB* to point to the directory with the
BUFR
>> > > > > > > > > library
>> > > > > files.
>> > > > > > > > > Because MET doesn't use any BUFR library include
files,
>> > > > > > > > > you don't need to specify *$MET_BUFRINC* ."
>> > > > > > > > >
>> > > > > > > > > Once you've installed the required libraries and
set up
>> > > > > > > > > your environment variables, you'll be ready to
configure
>> > > > > > > > > MET (instructions at the bottom of the last link
above)
>> > > > > > > > > and then compile and install MET (
>> > > > > > > > >
>> > >
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.
>> > > > > > > > > 0/
>> > > > > > > > > co
>> > > > > > > > > mp
>> > > > > > > > > ilation/compile.php
>> > > > > > > > > ).
>> > > > > > > > > After re-installing MET, please run "make test"
again.
>> > > > > > > > > If you still encounter the same problem, please
send me
>> > > > > > > > > your
>> > > > > > > > > *config.log* file and your *make_install.log *file.
>> > > > > > > > > Please let me know if you have any
>> > > > > > > > questions.
>> > > > > > > > >
>> > > > > > > > > Please let us know how it goes.
>> > > > > > > > >
>> > > > > > > > > Thanks,
>> > > > > > > > > Julie
>> > > > > > > > >
>> > > > > > > > >
>> > > > > > > > >
>> > > > > > > > >
>> > > > > > > > > On Wed, Mar 9, 2016 at 10:22 AM, Jose Garcia-Rivera
via
>> > > > > > > > > RT < met_help at ucar.edu> wrote:
>> > > > > > > > >
>> > > > > > > > > >
>> > > > > > > > > > <URL:
>> > > > > > > > > >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=7543
>> > > > > > > > > > 3
>> > > > > > > > > > >
>> > > > > > > > > >
>> > > > > > > > > > Dear Julie,
>> > > > > > > > > >
>> > > > > > > > > > Attached is the test log file. It's showing the
same
>> > > > > > > > > > issues on pb2nc even with the sample files.
>> > > > > > > > > >
>> > > > > > > > > > Best Regards,
>> > > > > > > > > > Jose
>> > > > > > > > > >
>> > > > > > > > > > -----Original Message-----
>> > > > > > > > > > From: Julie Prestopnik via RT
>> > > > > > > > > > [mailto:met_help at ucar.edu]
>> > > > > > > > > > Sent: Tuesday, March 08, 2016 5:28 PM
>> > > > > > > > > > To: Jose Garcia-Rivera
>> > > > > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues
>> > > > > > > > > > converting PREPBUFR to NetCDF
>> > > > > > > > > >
>> > > > > > > > > > Hi Jose. Thank you for uploading the files.
>> > > > > > > > > > Unfortunately, I am unable to reproduce the error
you
>> > > > > > > > > > are experiencing. I am wondering if you have
>> > > > > > > > > > successfully used pb2nc before. As a check could
you
>> > > > > > > > > > please run the following in your met-5.1/
>> > > > > > directory:
>> > > > > > > > > >
>> > > > > > > > > > *make test >& make_test.log*
>> > > > > > > > > >
>> > > > > > > > > > and then send me the make_test.log file?
>> > > > > > > > > >
>> > > > > > > > > > Thanks,
>> > > > > > > > > > Julie
>> > > > > > > > > >
>> > > > > > > > > > On Tue, Mar 8, 2016 at 11:29 AM, Jose Garcia-
Rivera
>> > > > > > > > > > via RT < met_help at ucar.edu> wrote:
>> > > > > > > > > >
>> > > > > > > > > > >
>> > > > > > > > > > > <URL:
>> > > > > > > > > > >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75
>> > > > > > > > > > > 43
>> > > > > > > > > > > 3
>> > > > > > > > > > > >
>> > > > > > > > > > >
>> > > > > > > > > > > Dear Julie,
>> > > > > > > > > > >
>> > > > > > > > > > > I just put the files in 'garcia_data'. I
appreciate
>> > > > > > > > > > > your
>> > > > help.
>> > > > > > > > > > >
>> > > > > > > > > > > Best Regards,
>> > > > > > > > > > > Jose
>> > > > > > > > > > >
>> > > > > > > > > > > -----Original Message-----
>> > > > > > > > > > > From: Julie Prestopnik via RT
>> > > > > > > > > > > [mailto:met_help at ucar.edu]
>> > > > > > > > > > > Sent: Tuesday, March 08, 2016 1:12 PM
>> > > > > > > > > > > To: Jose Garcia-Rivera
>> > > > > > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues
>> > > > > > > > > > > converting PREPBUFR to NetCDF
>> > > > > > > > > > >
>> > > > > > > > > > > Hi Jose. I'm sorry to hear that you are having
>> > > > > > > > > > > problems converting a PREPBUFR file to NetCDF.
>> > > > > > > > > > >
>> > > > > > > > > > > Please upload your input files and
configuration
>> > > > > > > > > > > file to our anonymous ftp site as follows:
>> > > > > > > > > > >
http://www.dtcenter.org/met/users/support/met_help.p
>> > > > > > > > > > > hp
>> > > > > > > > > > >
>> > > > > > > > > > > Then I can take a look and get back to you.
>> > > > > > > > > > >
>> > > > > > > > > > > Thanks,
>> > > > > > > > > > > Julie
>> > > > > > > > > > >
>> > > > > > > > > > > On Tue, Mar 8, 2016 at 11:01 AM, Jose Garcia-
Rivera
>> > > > > > > > > > > via RT < met_help at ucar.edu> wrote:
>> > > > > > > > > > >
>> > > > > > > > > > > >
>> > > > > > > > > > > > Tue Mar 08 11:01:25 2016: Request 75433 was
acted
>> upon.
>> > > > > > > > > > > > Transaction: Ticket created by
GarciaJ at imsg.com
>> > > > > > > > > > > > Queue: met_help
>> > > > > > > > > > > > Subject: Issues converting PREPBUFR to
NetCDF
>> > > > > > > > > > > > Owner: Nobody
>> > > > > > > > > > > > Requestors: GarciaJ at imsg.com
>> > > > > > > > > > > > Status: new
>> > > > > > > > > > > > Ticket <URL:
>> > > > > > > > > > > >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=
>> > > > > > > > > > > > 75
>> > > > > > > > > > > > 43
>> > > > > > > > > > > > 3
>> > > > > > > > > > > > >
>> > > > > > > > > > > >
>> > > > > > > > > > > >
>> > > > > > > > > > > > Dear Met Help,
>> > > > > > > > > > > >
>> > > > > > > > > > > > Trying to convert a PREPBUFR file to NetCDF.
>> > > > > > > > > > > >
>> > > > > > > > > > > > I used the default PB2NC configure file, and
got
>> > > > > > > > > > > > the
>> > > > > following:
>> > > > > > > > > > > >
>> > > > > > > > > > > > [garciaj at login prepbufr_obs]$ ./pb2nc
>> > > > > > > > > > > > gdas1.t12z.prepbufr.nr gdas.20150820.t12z.nc
>> > > > > > > > > > > > PB2NCConfig_default DEBUG 1: Default Config
>> > > > > > > > > > > > File:
>> > > > > > > > > > > > /work/apps/pgi_14.10/met-
5.1/share/met/config/PB2N
>> > > > > > > > > > > > CC on fi g_ de fa ul t DEBUG 1: User Config
File:
>> > > > > > > > > > > > PB2NCConfig_default DEBUG 1: Creating NetCDF
File:
>> > > > > gdas.20150820.t12z.nc
>> > > > > > > > > > > > DEBUG 1: Processing PrepBufr File:
>> > > > > gdas1.t12z.prepbufr.nr
>> > > > > > > > > > > > DEBUG 1: Blocking PrepBufr file to:
>> > > > > > > /tmp/tmp_pb2nc_blk_32144_0
>> > > > > > > > > > > > WARNING:
>> > > > > > > > > > > > WARNING: process_pbfile() -> No PrepBufr
messages
>> > > > > > > > > > > > to process in
>> > > > > > > > file:
>> > > > > > > > > > > > gdas1.t12z.prepbufr.nr
>> > > > > > > > > > > > WARNING:
>> > > > > > > > > > > > ERROR :
>> > > > > > > > > > > > ERROR : write_netcdf_hdr_data() -> No
PrepBufr
>> > > > > > > > > > > > messages
>> > > > > > > retained.
>> > > > > > > > > > > > Nothing to write.
>> > > > > > > > > > > > ERROR :
>> > > > > > > > > > > >
>> > > > > > > > > > > >
>> > > > > > > > > > > > Thanks in advance for the help, Jose M.
>> > > > > > > > > > > > Garcia-Rivera, PhD IM Systems Group
>> > > > > > > > > > > > Rockville/College Park, MD This e-mail,
including
>> > > > > > > > > > > > attachments, may include confidential and/or
>> > > > > > > > > > > > proprietary information, and may be used only
by
>> > > > > > > > > > > > the person or entity to which it is
addressed. If
>> > > > > > > > > > > > the reader of this e-mail is not the intended
>> > > > > > > > > > > > recipient or his or her authorized agent, the
>> > > > > > > > > > > > reader is hereby notified that any
dissemination,
>> > > > > > > > > > > > distribution or
>> > copying of this e-mail is prohibited.
>> > > > > > > > > > > > If you have received this e-mail in error,
please
>> > > > > > > > > > > > notify the sender by replying to this message
and
>> > > > > > > > > > > > delete this
>> > > > > > > > > > > e-mail immediately.
>> > > > > > > > > > > >
>> > > > > > > > > > > >
>> > > > > > > > > > >
>> > > > > > > > > > >
>> > > > > > > > > > > --
>> > > > > > > > > > > Julie Prestopnik
>> > > > > > > > > > > National Center for Atmospheric Research
Research
>> > > > > > > > > > > Applications Laboratory
>> > > > > > > > > > > Phone: 303.497.8399
>> > > > > > > > > > > Email: jpresto at ucar.edu
>> > > > > > > > > > >
>> > > > > > > > > > > This e-mail, including attachments, may include
>> > > > > > > > > > > confidential and/or proprietary information,
and may
>> > > > > > > > > > > be used only by the person or entity to which
it is
>> > > > > > > > > > > addressed. If the reader of this e-mail is not
the
>> > > > > > > > > > > intended recipient or his or her authorized
agent,
>> > > > > > > > > > > the reader is hereby notified that any
>> > > > > > > > > > > dissemination, distribution or copying of this
e-mail
>> is prohibited.
>> > > > > > > > > > > If you have received this e-mail in error,
please
>> > > > > > > > > > > notify the sender by replying to this message
and
>> > > > > > > > > > > delete this
>> > > > > > > > > > e-mail immediately.
>> > > > > > > > > > >
>> > > > > > > > > > >
>> > > > > > > > > > >
>> > > > > > > > > >
>> > > > > > > > > >
>> > > > > > > > > > --
>> > > > > > > > > > Julie Prestopnik
>> > > > > > > > > > National Center for Atmospheric Research Research
>> > > > > > > > > > Applications Laboratory
>> > > > > > > > > > Phone: 303.497.8399
>> > > > > > > > > > Email: jpresto at ucar.edu
>> > > > > > > > > >
>> > > > > > > > > > This e-mail, including attachments, may include
>> > > > > > > > > > confidential and/or proprietary information, and
may
>> > > > > > > > > > be used only by the person or entity to which it
is
>> > > > > > > > > > addressed. If the reader of this e-mail is not
the
>> > > > > > > > > > intended recipient or his or her authorized
agent, the
>> > > > > > > > > > reader is hereby notified that any dissemination,
>> > > > > > > > > > distribution or copying of this e-mail is
prohibited.
>> > > > > > > > > > If you have received this e-mail in error, please
>> > > > > > > > > > notify the sender by replying to this message and
>> > > > > > > > > > delete this
>> > > > > > > > > e-mail immediately.
>> > > > > > > > > >
>> > > > > > > > > >
>> > > > > > > > >
>> > > > > > > > >
>> > > > > > > > > --
>> > > > > > > > > Julie Prestopnik
>> > > > > > > > > National Center for Atmospheric Research Research
>> > > > > > > > > Applications Laboratory
>> > > > > > > > > Phone: 303.497.8399
>> > > > > > > > > Email: jpresto at ucar.edu
>> > > > > > > > >
>> > > > > > > > > This e-mail, including attachments, may include
>> > > > > > > > > confidential and/or proprietary information, and
may be
>> > > > > > > > > used only by the person or entity to which it is
>> > > > > > > > > addressed. If the reader of this e-mail is not the
>> > > > > > > > > intended recipient or his or her authorized agent,
the
>> > > > > > > > > reader is hereby notified that any dissemination,
>> > > > > > > > > distribution or copying of this e-mail is
prohibited. If
>> > > > > > > > > you have received this e-mail in error, please
notify
>> > > > > > > > > the sender by replying to this message and delete
this
>> > > > > > > > e-mail immediately.
>> > > > > > > > >
>> > > > > > > > >
>> > > > > > > >
>> > > > > > > >
>> > > > > > > > --
>> > > > > > > > Julie Prestopnik
>> > > > > > > > National Center for Atmospheric Research Research
>> > > > > > > > Applications Laboratory
>> > > > > > > > Phone: 303.497.8399
>> > > > > > > > Email: jpresto at ucar.edu
>> > > > > > > >
>> > > > > > > > This e-mail, including attachments, may include
>> > > > > > > > confidential and/or proprietary information, and may
be
>> > > > > > > > used only by the person or entity to which it is
>> > > > > > > > addressed. If the reader of this e-mail is not the
>> > > > > > > > intended recipient or his or her authorized agent,
the
>> > > > > > > > reader is hereby notified that any dissemination,
>> > > > > > > > distribution or copying of this e-mail is prohibited.
If
>> > > > > > > > you have received this e-mail in error, please notify
the
>> > > > > > > > sender by replying to this message and delete this
>> > > > > > > e-mail immediately.
>> > > > > > > >
>> > > > > > > >
>> > > > > > > >
>> > > > > > >
>> > > > > > >
>> > > > > > > --
>> > > > > > > Julie Prestopnik
>> > > > > > > National Center for Atmospheric Research Research
>> > > > > > > Applications Laboratory
>> > > > > > > Phone: 303.497.8399
>> > > > > > > Email: jpresto at ucar.edu
>> > > > > > >
>> > > > > > > This e-mail, including attachments, may include
confidential
>> > > > > > > and/or proprietary information, and may be used only by
the
>> > > > > > > person or entity to which it is addressed. If the
reader of
>> > > > > > > this e-mail is not the intended recipient or his or her
>> > > > > > > authorized agent, the reader is hereby notified that
any
>> > > > > > > dissemination, distribution or copying of this e-mail
is
>> > > > > > > prohibited. If you have received this e-mail in error,
>> > > > > > > please notify the sender by replying to this message
and
>> > > > > > > delete this
>> > > > > > e-mail immediately.
>> > > > > > >
>> > > > > > >
>> > > > > > >
>> > > > > >
>> > > > > >
>> > > > > > --
>> > > > > > Julie Prestopnik
>> > > > > > National Center for Atmospheric Research Research
Applications
>> > > > > > Laboratory
>> > > > > > Phone: 303.497.8399
>> > > > > > Email: jpresto at ucar.edu
>> > > > > >
>> > > > > > This e-mail, including attachments, may include
confidential
>> > > > > > and/or proprietary information, and may be used only by
the
>> > > > > > person or entity to which it is addressed. If the reader
of
>> > > > > > this e-mail is not the intended recipient or his or her
>> > > > > > authorized agent, the reader is hereby notified that any
>> > > > > > dissemination, distribution or copying of this e-mail is
>> > > > > > prohibited. If you have received this e-mail in error,
please
>> > > > > > notify the sender by replying to this message and delete
this
>> > > > > e-mail immediately.
>> > > > > >
>> > > > > >
>> > > > > >
>> > > > >
>> > > > >
>> > > > > --
>> > > > > Julie Prestopnik
>> > > > > National Center for Atmospheric Research Research
Applications
>> > > > > Laboratory
>> > > > > Phone: 303.497.8399
>> > > > > Email: jpresto at ucar.edu
>> > > > >
>> > > > > This e-mail, including attachments, may include
confidential
>> > > > > and/or proprietary information, and may be used only by the
>> > > > > person or entity to which it is addressed. If the reader of
this
>> > > > > e-mail is not the intended recipient or his or her
authorized
>> > > > > agent, the reader is hereby notified that any
dissemination,
>> > > > > distribution or copying of this e-mail is prohibited. If
you
>> > > > > have received this e-mail in error, please notify the
sender by
>> > > > > replying to this message and delete this
>> > > > e-mail immediately.
>> > > > >
>> > > > >
>> > > > >
>> > > >
>> > > >
>> > > > --
>> > > > Julie Prestopnik
>> > > > National Center for Atmospheric Research Research
Applications
>> > > > Laboratory
>> > > > Phone: 303.497.8399
>> > > > Email: jpresto at ucar.edu
>> > > >
>> > > > This e-mail, including attachments, may include confidential
>> > > > and/or proprietary information, and may be used only by the
person
>> > > > or entity to which it is addressed. If the reader of this e-
mail
>> > > > is not the intended recipient or his or her authorized agent,
the
>> > > > reader is hereby notified that any dissemination,
distribution or
>> > > > copying of this e-mail is prohibited. If you have received
this
>> > > > e-mail in error, please notify the sender by replying to this
>> > > > message and delete this
>> > > e-mail immediately.
>> > > >
>> > > >
>> > > >
>> > >
>> > >
>> > > --
>> > > Julie Prestopnik
>> > > National Center for Atmospheric Research Research Applications
>> > > Laboratory
>> > > Phone: 303.497.8399
>> > > Email: jpresto at ucar.edu
>> > >
>> > > This e-mail, including attachments, may include confidential
and/or
>> > > proprietary information, and may be used only by the person or
>> > > entity to which it is addressed. If the reader of this e-mail
is not
>> > > the intended recipient or his or her authorized agent, the
reader is
>> > > hereby notified that any dissemination, distribution or copying
of
>> > > this e-mail is prohibited. If you have received this e-mail in
>> > > error, please notify the sender by replying to this message and
>> > > delete this
>> > e-mail immediately.
>> > >
>> > >
>> >
>> > This e-mail, including attachments, may include confidential
and/or
>> > proprietary information, and may be used only by the person or
entity
>> > to which it is addressed. If the reader of this e-mail is not the
>> > intended recipient or his or her authorized agent, the reader is
>> > hereby notified that any dissemination, distribution or copying
of
>> > this e-mail is prohibited. If you have received this e-mail in
error,
>> > please notify the sender by replying to this message and delete
this
>> e-mail immediately.
>> >
>> >
>> >
>>
>> This e-mail, including attachments, may include confidential and/or
>> proprietary information, and may be used only by the person or
entity to
>> which it is addressed. If the reader of this e-mail is not the
intended
>> recipient or his or her authorized agent, the reader is hereby
notified
>> that any dissemination, distribution or copying of this e-mail is
>> prohibited. If you have received this e-mail in error, please
notify the
>> sender by replying to this message and delete this e-mail
immediately.
>>
>>
>>
>
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to NetCDF
From: Jose Garcia-Rivera
Time: Fri Mar 18 12:58:36 2016
Dear John,
I modified the config file for pb2nc, and still have the same issue. I
uploaded these two files to 'garcia_data'
3km_nmbprs_d01.06
newtest.nc
I don’t need to change the quality flag in the point_stat
configuration file, right?
One extra thing to mention: I had to type CNTL+C to exit pb2nc, since
it seemed to stay stuck on a loop,,, yet I got the netcdf file. This
happened every time:
[garciaj at login prepbufr_obs]$ ./pb2nc gdas1.t18z.prepbufr.nr
newtest.nc PB2NCConfig_default
DEBUG 1: Default Config File: /work/apps/pgi_14.10/SANDY/met-
5.1/share/met/config/PB2NCConfig_default
DEBUG 1: User Config File: PB2NCConfig_default
DEBUG 1: Creating NetCDF File: newtest.nc
DEBUG 1: Processing PrepBufr File: gdas1.t18z.prepbufr.nr
DEBUG 1: Blocking PrepBufr file to: /tmp/tmp_pb2nc_blk_50363_0
DEBUG 2: PrepBufr Time Center: 20150820_180000
DEBUG 2: Searching Time Window: 20150820_163000 to
20150820_193000
DEBUG 2: Processing 685386 PrepBufr messages...
5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90%
95% 100%
DEBUG 2: Total PrepBufr Messages processed = 685386
DEBUG 2: Rejected based on message type = 0
DEBUG 2: Rejected based on station id = 0
DEBUG 2: Rejected based on valid time = 185145
DEBUG 2: Rejected based on masking grid = 0
DEBUG 2: Rejected based on masking polygon = 0
DEBUG 2: Rejected based on elevation = 0
DEBUG 2: Rejected based on pb report type = 0
DEBUG 2: Rejected based on input report type = 0
DEBUG 2: Rejected based on instrument type = 0
DEBUG 2: Rejected based on zero observations = 11135
DEBUG 2: Total PrepBufr Messages retained = 489106
DEBUG 2: Total observations retained or derived = 1330661
^C
Thanks for the help,
Jose
-----Original Message-----
From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
Sent: Friday, March 18, 2016 1:01 PM
To: Jose Garcia-Rivera
Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to
NetCDF
Jose,
Thanks for sending the test data. I see that your model data is valid
at
time 20150820_180000. When I run Point-Stat, I see the following
reason
counts in the output:
DEBUG 2: Processing TMP/Z2 versus TMP/Z2, for observation type ADPSFC,
over
region FULL, for interpolation method NEAREST(1), using 0 pairs.
DEBUG 3: Number of matched pairs = 0
DEBUG 3: Observations processed = 949837
DEBUG 3: Rejected: SID exclusion = 0
DEBUG 3: Rejected: GRIB code = 943848
DEBUG 3: Rejected: valid time = 4191
DEBUG 3: Rejected: bad obs value = 0
DEBUG 3: Rejected: off the grid = 1798
DEBUG 3: Rejected: level mismatch = 0
DEBUG 3: Rejected: quality marker = 0
DEBUG 3: Rejected: message type = 0
DEBUG 3: Rejected: masking region = 0
DEBUG 3: Rejected: bad fcst value = 0
DEBUG 3: Rejected: duplicates = 0
So it looks like several observations are not used for either the
valid
time or being off the grid. Let's look at where these temperature
exist.
I ran the following command to plot their location:
met-5.1/bin/plot_point_obs newtest.nc newtest.ps -gc 11 -v 3
The "-gc 11" option says only plot temperature. The resulting image
is
attached. Notice that none of them fall within your East Coast
domain.
Also notice in the log output that these are all AIRCFT temperature
observations! No ADPUPA and no ADPSFC.
Since you're using GDAS observations, you should be aware of the
quality
marker issue for surface observations noted at the bottom of this
page:
http://www.dtcenter.org/met/users/downloads/observation_data.php
To get Point-Stat running, I did the following steps:
(1) Pull GDAS observations for 20150820_180000:
wget
http://nomads.ncdc.noaa.gov/data/gdas/201508/20150820/gdas1.t18z.prepbufr.nr
(2) Run PB2NC using the attached configuration file (note quality
marker =
9):
met-5.1/bin/pb2nc gdas1.t18z.prepbufr.nr gdas1.t18z.prepbufr.nc
PB2NCConfig_GDAS
(3) Run Point-Stat using the data/config file you sent me:
met-5.1/bin/point_stat nmbprs_d01.06 gdas1.t18z.prepbufr.nc
PointStatConfig -outdir out -v 4
And that give me 3584 matched pairs:
DEBUG 3: Number of matched pairs = 3584
So the problem was caused by the GDAS quality marker issue. Also note
that
for North American grids, using NDAS (i.e. north american data
assimilation) would work equally well and NDAS does *NOT* have this
quality
marker issue.
Lastly, I see the following warning when I run Point-Stat with your
data:
WARNING:
WARNING: gds_to_lambert() -> MET does not currently support Lambert
Conformal grids where dx (3.317) != dy (2.97) and may produce
unexpected
results!
WARNING:
I'd suggest post-processing to a different grid where Dx = Dy prior to
running MET.
Hope that helps.
Thanks,
John
On Fri, Mar 18, 2016 at 10:15 AM, Jose Garcia-Rivera via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
>
> Dear John,
>
> I tried as you suggested, but still have empty output. I put the
files in
> your ftp in 'garcia_data'
>
> The three files in the FTP are:
>
> newtest.nc
> nmbprs_d01.06
> PointStatConfig
>
>
> Output:
>
> [garciaj at login prepbufr_obs]$ ./point_stat nmbprs_d01.06 newtest.nc
> PointStatConfig_default
> DEBUG 1: Default Config File:
> /work/apps/pgi_14.10/SANDY/met-
5.1/share/met/config/PointStatConfig_default
> DEBUG 1: User Config File: PointStatConfig_default
> GSL_RNG_TYPE=mt19937
> GSL_RNG_SEED=18446744071614164054
> DEBUG 1: Forecast File: nmbprs_d01.06
> DEBUG 1: Observation File: newtest.nc
> DEBUG 2:
> DEBUG 2:
>
--------------------------------------------------------------------------------
> DEBUG 2:
> DEBUG 2: Reading data for TMP/Z2.
> DEBUG 2: For TMP/Z2 found 1 forecast levels and 0 climatology
levels.
> DEBUG 2:
> DEBUG 2:
>
--------------------------------------------------------------------------------
> DEBUG 2:
> DEBUG 2: Searching 949837 observations from 452408 messages.
> DEBUG 2:
> DEBUG 2:
>
--------------------------------------------------------------------------------
> DEBUG 2:
> DEBUG 2: Processing TMP/Z2 versus TMP/Z2, for observation type
ADPSFC,
> over region FULL, for interpolation method NEAREST(1), using 0
pairs.
> DEBUG 2:
> DEBUG 2:
>
--------------------------------------------------------------------------------
> DEBUG 2:
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V.stat
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_fho.txt
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_ctc.txt
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_cts.txt
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_mctc.txt
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_mcts.txt
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_cnt.txt
> DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_sl1l2.txt
> DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_sal1l2.txt
> DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_vl1l2.txt
> DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_val1l2.txt
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_pct.txt
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_pstd.txt
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_pjc.txt
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_prc.txt
> DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V_mpr.txt
>
> From config file:
>
> fcst = {
> message_type = [ "ADPSFC" ];
> sid_exc = [];
>
> field = [
> {
> name = "TMP";
> level = [ "Z2" ];
> cat_thresh = [ >293.0 ];
> }
> ];
>
>
> Thanks for the help,
> Jose
>
>
>
> -----Original Message-----
> From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> Sent: Thursday, March 17, 2016 5:47 PM
> To: Jose Garcia-Rivera
> Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to
NetCDF
>
> Jose,
>
> I see that you're doing an upper-air (ADPUPA) evaluation for the
time
> 20150820_180000. Upper-air observations are much more common at 00Z
and
> 12Z than 06Z and 18Z. Instead of verifying the 06 hour forecast
valid at
> 18Z, please try the 12 hour forecast valid at 00Z.
>
> Also, you could try evaluating some surface fields against the
ADPSFC
> message type.
>
> If you get stuck, you can post a sample forecast file to our
anonymous ftp
> site, and I can try running it here.
>
> Thanks,
> John
>
>
>
> On Thu, Mar 17, 2016 at 2:39 PM, Jose Garcia-Rivera via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> >
> > Dear John,
> >
> > It's great to hear from you again! Julie has been of great help.
We
> > highly appreciate all the help coming from your team.
> >
> > I followed your recommendation, and got the following:
> >
> > [garciaj at login prepbufr_obs]$ ./point_stat -v 3 nmbprs_d01.06
> > newtest.nc PointStatConfig_default DEBUG 1: Default Config File:
> > /work/apps/pgi_14.10/SANDY/met-
5.1/share/met/config/PointStatConfig_de
> > fault DEBUG 1: User Config File: PointStatConfig_default
> > GSL_RNG_TYPE=mt19937
> > GSL_RNG_SEED=1041230678
> > DEBUG 1: Forecast File: nmbprs_d01.06
> > DEBUG 1: Observation File: newtest.nc
> > DEBUG 2:
> > DEBUG 2:
> >
----------------------------------------------------------------------
> > ----------
> > DEBUG 2:
> > DEBUG 2: Reading data for SPFH/P500.
> > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found range match
for
> > VarInfo "SPFH/P500" in GRIB record 134 of GRIB file
"nmbprs_d01.06".
> > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found 1 GRIB
records
> > matching VarInfo "SPFH/P500" in GRIB file "nmbprs_d01.06".
> > DEBUG 3: Use the matching forecast and observation grids.
> > DEBUG 3: Grid Definition: Projection: Lambert Conformal Nx: 400
Ny:
> > 400
> > Lat_LL: 33.302 Lon_LL: 84.951 Lon_orient: 77.459 Alpha: 3781.822
Cone:
> > 0.629 Bx: 210.6765 By: 2557.3266
> > DEBUG 2: For SPFH/P500 found 1 forecast levels and 0 climatology
levels.
> > DEBUG 2:
> > DEBUG 2:
> >
----------------------------------------------------------------------
> > ----------
> > DEBUG 2:
> > DEBUG 2: Reading data for TMP/P500.
> > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found range match
for
> > VarInfo "TMP/P500" in GRIB record 131 of GRIB file
"nmbprs_d01.06".
> > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found 1 GRIB
records
> > matching VarInfo "TMP/P500" in GRIB file "nmbprs_d01.06".
> > DEBUG 2: For TMP/P500 found 1 forecast levels and 0 climatology
levels.
> > DEBUG 2:
> > DEBUG 2:
> >
----------------------------------------------------------------------
> > ----------
> > DEBUG 2:
> > DEBUG 2: Reading data for HGT/P500.
> > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found range match
for
> > VarInfo "HGT/P500" in GRIB record 130 of GRIB file
"nmbprs_d01.06".
> > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found 1 GRIB
records
> > matching VarInfo "HGT/P500" in GRIB file "nmbprs_d01.06".
> > DEBUG 2: For HGT/P500 found 1 forecast levels and 0 climatology
levels.
> > DEBUG 2:
> > DEBUG 2:
> >
----------------------------------------------------------------------
> > ----------
> > DEBUG 2:
> > DEBUG 2: Reading data for UGRD/P500.
> > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found range match
for
> > VarInfo "UGRD/P500" in GRIB record 137 of GRIB file
"nmbprs_d01.06".
> > DEBUG 3: MetGrib1DataFile::rotate_winds() -> Have U-wind record,
> > reading V-wind record.
> > DEBUG 3: MetGrib1DataFile::data_plane_scalar() -> Found exact
match
> > for VarInfo "UGRD/P500" in GRIB record 138 of GRIB file
"nmbprs_d01.06".
> > DEBUG 3: Rotating U and V wind components from grid-relative to
> > earth-relative.
> > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found 1 GRIB
records
> > matching VarInfo "UGRD/P500" in GRIB file "nmbprs_d01.06".
> > DEBUG 2: For UGRD/P500 found 1 forecast levels and 0 climatology
levels.
> > DEBUG 2:
> > DEBUG 2:
> >
----------------------------------------------------------------------
> > ----------
> > DEBUG 2:
> > DEBUG 2: Reading data for VGRD/P500.
> > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found range match
for
> > VarInfo "VGRD/P500" in GRIB record 138 of GRIB file
"nmbprs_d01.06".
> > DEBUG 3: MetGrib1DataFile::rotate_winds() -> Have V-wind record,
> > reading U-wind record.
> > DEBUG 3: MetGrib1DataFile::data_plane_scalar() -> Found exact
match
> > for VarInfo "VGRD/P500" in GRIB record 137 of GRIB file
"nmbprs_d01.06".
> > DEBUG 3: Rotating U and V wind components from grid-relative to
> > earth-relative.
> > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found 1 GRIB
records
> > matching VarInfo "VGRD/P500" in GRIB file "nmbprs_d01.06".
> > DEBUG 2: For VGRD/P500 found 1 forecast levels and 0 climatology
levels.
> > DEBUG 2:
> > DEBUG 2:
> >
----------------------------------------------------------------------
> > ----------
> > DEBUG 2:
> > DEBUG 2: Searching 949837 observations from 452408 messages.
> > DEBUG 2:
> > DEBUG 2:
> >
----------------------------------------------------------------------
> > ----------
> > DEBUG 2:
> > DEBUG 2: Processing SPFH/P500 versus SPFH/P500, for observation
type
> > ADPUPA, over region FULL, for interpolation method NEAREST(1),
using 0
> > pairs.
> > DEBUG 3: Number of matched pairs = 0
> > DEBUG 3: Observations processed = 949837
> > DEBUG 3: Rejected: SID exclusion = 0
> > DEBUG 3: Rejected: GRIB code = 947898
> > DEBUG 3: Rejected: valid time = 1416
> > DEBUG 3: Rejected: bad obs value = 0
> > DEBUG 3: Rejected: off the grid = 523
> > DEBUG 3: Rejected: level mismatch = 0
> > DEBUG 3: Rejected: quality marker = 0
> > DEBUG 3: Rejected: message type = 0
> > DEBUG 3: Rejected: masking region = 0
> > DEBUG 3: Rejected: bad fcst value = 0
> > DEBUG 3: Rejected: duplicates = 0
> > DEBUG 2:
> > DEBUG 2:
> >
----------------------------------------------------------------------
> > ----------
> > DEBUG 2:
> > DEBUG 2: Processing TMP/P500 versus TMP/P500, for observation type
> > ADPUPA, over region FULL, for interpolation method NEAREST(1),
using 0
> pairs.
> > DEBUG 3: Number of matched pairs = 0
> > DEBUG 3: Observations processed = 949837
> > DEBUG 3: Rejected: SID exclusion = 0
> > DEBUG 3: Rejected: GRIB code = 943848
> > DEBUG 3: Rejected: valid time = 4191
> > DEBUG 3: Rejected: bad obs value = 0
> > DEBUG 3: Rejected: off the grid = 1798
> > DEBUG 3: Rejected: level mismatch = 0
> > DEBUG 3: Rejected: quality marker = 0
> > DEBUG 3: Rejected: message type = 0
> > DEBUG 3: Rejected: masking region = 0
> > DEBUG 3: Rejected: bad fcst value = 0
> > DEBUG 3: Rejected: duplicates = 0
> > DEBUG 2:
> > DEBUG 2:
> >
----------------------------------------------------------------------
> > ----------
> > DEBUG 2:
> > DEBUG 2: Processing HGT/P500 versus HGT/P500, for observation type
> > ADPUPA, over region FULL, for interpolation method NEAREST(1),
using 0
> pairs.
> > DEBUG 3: Number of matched pairs = 0
> > DEBUG 3: Observations processed = 949837
> > DEBUG 3: Rejected: SID exclusion = 0
> > DEBUG 3: Rejected: GRIB code = 606744
> > DEBUG 3: Rejected: valid time = 319085
> > DEBUG 3: Rejected: bad obs value = 0
> > DEBUG 3: Rejected: off the grid = 23610
> > DEBUG 3: Rejected: level mismatch = 395 DEBUG 3: Rejected: quality
> > marker = 0
> > DEBUG 3: Rejected: message type = 3
> > DEBUG 3: Rejected: masking region = 0
> > DEBUG 3: Rejected: bad fcst value = 0
> > DEBUG 3: Rejected: duplicates = 0
> > DEBUG 2:
> > DEBUG 2:
> >
----------------------------------------------------------------------
> > ----------
> > DEBUG 2:
> > DEBUG 2: Processing UGRD/P500 versus UGRD/P500, for observation
type
> > ADPUPA, over region FULL, for interpolation method NEAREST(1),
using 0
> > pairs.
> > DEBUG 3: Number of matched pairs = 0
> > DEBUG 3: Observations processed = 949837
> > DEBUG 3: Rejected: SID exclusion = 0
> > DEBUG 3: Rejected: GRIB code = 650429
> > DEBUG 3: Rejected: valid time = 277745
> > DEBUG 3: Rejected: bad obs value = 0
> > DEBUG 3: Rejected: off the grid = 21341
> > DEBUG 3: Rejected: level mismatch = 319 DEBUG 3: Rejected: quality
> > marker = 0
> > DEBUG 3: Rejected: message type = 3
> > DEBUG 3: Rejected: masking region = 0
> > DEBUG 3: Rejected: bad fcst value = 0
> > DEBUG 3: Rejected: duplicates = 0
> > DEBUG 2:
> > DEBUG 2:
> >
----------------------------------------------------------------------
> > ----------
> > DEBUG 2:
> > DEBUG 2: Processing VGRD/P500 versus VGRD/P500, for observation
type
> > ADPUPA, over region FULL, for interpolation method NEAREST(1),
using 0
> > pairs.
> > DEBUG 3: Number of matched pairs = 0
> > DEBUG 3: Observations processed = 949837
> > DEBUG 3: Rejected: SID exclusion = 0
> > DEBUG 3: Rejected: GRIB code = 650429
> > DEBUG 3: Rejected: valid time = 277745
> > DEBUG 3: Rejected: bad obs value = 0
> > DEBUG 3: Rejected: off the grid = 21341
> > DEBUG 3: Rejected: level mismatch = 319 DEBUG 3: Rejected: quality
> > marker = 0
> > DEBUG 3: Rejected: message type = 3
> > DEBUG 3: Rejected: masking region = 0
> > DEBUG 3: Rejected: bad fcst value = 0
> > DEBUG 3: Rejected: duplicates = 0
> > DEBUG 2:
> > DEBUG 2:
> >
----------------------------------------------------------------------
> > ----------
> > DEBUG 2:
> > DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V.stat
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_fho.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_ctc.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_cts.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_mctc.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_mcts.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_cnt.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_sl1l2.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_sal1l2.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_vl1l2.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_val1l2.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_pct.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_pstd.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_pjc.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_prc.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_mpr.txt
> >
> >
> >
> > Best Regards,
> > Jose
> >
> >
> >
> >
> >
> > -----Original Message-----
> > From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> > Sent: Thursday, March 17, 2016 3:29 PM
> > To: Jose Garcia-Rivera
> > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR
to
> > NetCDF
> >
> > Hello Jose,
> >
> > Julie is out of the office today, but I should be able to help
you.
> > Glad you were able to finally get PB2NC working. That was a
tricky
> > one! But it helped us realize that since BUFRLIB has changed to
> > FORTRAN 90, we should update the MET code which calls BUFRLIB to
be
> compatible.
> >
> > I see that you are now getting 0 matched pairs when you run Point-
Stat
> > with the output of PB2NC. Please try rerunning Point-Stat but use
a
> > higher verbosity level, like "-v 3". That'll print out the
following
> > type of counts for each of the verification tasks you've defined
in the
> config file:
> >
> > DEBUG 3: Number of matched pairs = 312
> > DEBUG 3: Observations processed = 87753
> > DEBUG 3: Rejected: SID exclusion = 0
> > DEBUG 3: Rejected: GRIB code = 77648
> > DEBUG 3: Rejected: valid time = 0
> > DEBUG 3: Rejected: bad obs value = 0
> > DEBUG 3: Rejected: off the grid = 5
> > DEBUG 3: Rejected: level mismatch = 9219 DEBUG 3: Rejected:
quality
> > marker = 0
> > DEBUG 3: Rejected: message type = 537
> > DEBUG 3: Rejected: masking region = 32 DEBUG 3: Rejected: bad fcst
> > value = 0
> > DEBUG 3: Rejected: duplicates = 0
> >
> > In the example above, 87753 observation values were checked and
the
> > counts list reasons why there were not used for that task. Out of
> > those 87753 obs, 312 of them were used for this task.
> >
> > Looking at the counts from your Point-Stat run should help you
figure
> > out why you have 0 matched pairs.
> >
> > Thanks,
> > John
> >
> >
> > On Thu, Mar 17, 2016 at 12:29 PM, Jose Garcia-Rivera via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> > >
> > > Dear Julie,
> > >
> > > We got the executables to work! However, I have a couple of
> > > issues/questions:
> > >
> > >
> > >
> > > Issue #1 --- Not getting values after running point_stat
> > >
> > > Everything seems to run fine. I attached the configuration file.
I
> > > can send the three files via FTP if needed.
> > >
> > >
> > >
> > > Issue #2 --- PB2NC doesn't seem to finish the job, but it does?
I
> > > had to do CTRL+C, and checked the netCDF file using
ncl_filedump:
> > >
> > > [garciaj at login prepbufr_obs]$ ./pb2nc
prepbufr.gdas.20150820.t18z.nr
> > > newtest.nc PB2NCConfig_default DEBUG 1: Default Config File:
> > > /work/apps/pgi_14.10/SANDY/met-
5.1/share/met/config/PB2NCConfig_defa
> > > ul t DEBUG 1: User Config File: PB2NCConfig_default
> > > DEBUG 1: Creating NetCDF File: newtest.nc
> > > DEBUG 1: Processing PrepBufr File:
prepbufr.gdas.20150820.t18z.nr
> > > DEBUG 1: Blocking PrepBufr file to:
/tmp/tmp_pb2nc_blk_17703_0
> > > DEBUG 2: PrepBufr Time Center: 20150820_180000
> > > DEBUG 2: Searching Time Window: 20150820_163000 to
> > 20150820_193000
> > > DEBUG 2: Processing 685386 PrepBufr messages...
> > > 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80%
85%
> > > 90% 95% 100%
> > > DEBUG 2: Total PrepBufr Messages processed = 685386
> > > DEBUG 2: Rejected based on message type = 0
> > > DEBUG 2: Rejected based on station id = 0
> > > DEBUG 2: Rejected based on valid time = 185145
> > > DEBUG 2: Rejected based on masking grid = 0
> > > DEBUG 2: Rejected based on masking polygon = 0
> > > DEBUG 2: Rejected based on elevation = 0
> > > DEBUG 2: Rejected based on pb report type = 0
> > > DEBUG 2: Rejected based on input report type = 0
> > > DEBUG 2: Rejected based on instrument type = 0
> > > DEBUG 2: Rejected based on zero observations = 47833
> > > DEBUG 2: Total PrepBufr Messages retained = 452408
> > > DEBUG 2: Total observations retained or derived = 949837 ^C
> > >
> > >
> > > Checking netCDF file:
> > >
> > > [garciaj at login prepbufr_obs]$ ncl_filedump newtest.nc Copyright
(C)
> > > 1995-2015 - All Rights Reserved University Corporation for
> > > Atmospheric Research NCAR Command Language Version 6.3.0 The
use
> > > of this software is governed by a License Agreement.
> > > See http://www.ncl.ucar.edu/ for more details.
> > >
> > > Variable: f
> > > Type: file
> > > filename: newtest
> > > path: newtest.nc
> > > file global attributes:
> > > FileOrigins : File newtest.nc generated 20160317_155548
UTC on
> > > host login.local by the MET pb2nc tool
> > > MET_version : V5.1
> > > MET_tool : pb2nc
> > > dimensions:
> > > mxstr = 16
> > > hdr_arr_len = 3
> > > obs_arr_len = 5
> > > nobs = 949837 // unlimited
> > > nhdr = 452408
> > > variables:
> > > character obs_qty ( nobs, mxstr )
> > > long_name : quality flag
> > >
> > > float obs_arr ( nobs, obs_arr_len )
> > > long_name : array of observation values
> > > _fill_value : -9999
> > > columns : hdr_id gc lvl hgt ob
> > > hdr_id_long_name : index of matching header data
> > > gc_long_name : grib code corresponding to the
observation type
> > > lvl_long_name : pressure level (hPa) or
accumulation
> > > interval (sec)
> > > hgt_long_name : height in meters above sea level
(msl)
> > > ob_long_name : observation value
> > >
> > > character hdr_typ ( nhdr, mxstr )
> > > long_name : message type
> > >
> > > character hdr_sid ( nhdr, mxstr )
> > > long_name : station identification
> > >
> > > character hdr_vld ( nhdr, mxstr )
> > > long_name : valid time
> > > units : YYYYMMDD_HHMMSS
> > >
> > > float hdr_arr ( nhdr, hdr_arr_len )
> > > long_name : array of observation station header
values
> > > _fill_value : -9999
> > > columns : lat lon elv
> > > lat_long_name : latitude
> > > lat_units : degrees_north
> > > lon_long_name : longitude
> > > lon_units : degrees_east
> > > elv_long_name : elevation
> > > elv_units : meters above sea level (msl)
> > >
> > >
> > >
> > >
> > > Thanks for all the help,
> > > Jose
> > >
> > >
> > >
> > >
> > >
> > >
> > > -----Original Message-----
> > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > Sent: Wednesday, March 16, 2016 4:40 PM
> > > To: Jose Garcia-Rivera
> > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR
to
> > > NetCDF
> > >
> > > Hi Jose. I apologize for the delay. This was a tricky problem
to
> > > figure out, however, we were finally able to reproduce the error
you
> > > are receiving for pb2nc.
> > >
> > > The problem is BUFRLIB being compiled with pgf90 and MET being
> > > compiled with pgf77. They aren't talking well to each other.
> > > BUFRLIBv10.1.0 compiles with pgf77 but later versions require
pgf90.
> > >
> > > We will plan on updating the MET Fortran code to compile with
pgf90
> > > so that we can use newer BUFRLIB versions, but for now, to solve
> > > your problem, I have attached BUFRLIB_v10-1-0.tar. Please
install
> > > that version of BUFRLIB using pgf77 and then recompile MET
without
> > > the "LIBS" environment variable setting?
> > >
> > > Please let me know how that goes. We were able to get a
successful
> > > run using that solution and hope you will too.
> > >
> > > Thanks,
> > > Julie
> > >
> > >
> > > On Wed, Mar 16, 2016 at 12:17 PM, Jose Garcia-Rivera via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
>
> > > >
> > > > Dear Julie,
> > > >
> > > > Is there anything that we can do here to sort these issues
out?
> > > >
> > > > Best Regards,
> > > > Jose
> > > >
> > > > -----Original Message-----
> > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > Sent: Tuesday, March 15, 2016 5:08 PM
> > > > To: Jose Garcia-Rivera
> > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
PREPBUFR
> > > > to NetCDF
> > > >
> > > > Hi Jose. I was not. I got the same error you did. I believe
> > > > that the test.nc file is not in the correct format needed by
> > > > point_stat, so I think we need to get pb2nc working for you.
It
> > > > is likely a communication problem between the C code and the
Fortran
> code.
> > > >
> > > > Julie
> > > >
> > > > On Tue, Mar 15, 2016 at 3:05 PM, Jose Garcia-Rivera via RT <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > > >
> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> > > > >
> > > > > Dear Julie,
> > > > >
> > > > > Quick question: Were you able to run point_stat with the
netCDF
> > > > > file that I sent yesterday?
> > > > >
> > > > > Thanks for the help,
> > > > > Jose
> > > > >
> > > > > -----Original Message-----
> > > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > > Sent: Tuesday, March 15, 2016 12:17 PM
> > > > > To: Jose Garcia-Rivera
> > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
PREPBUFR
> > > > > to NetCDF
> > > > >
> > > > > Thank you, Jose. I'm working with co-workers to try to get
> > > > > these issues resolved. I hope to get back to you soon.
> > > > >
> > > > > Julie
> > > > >
> > > > > On Mon, Mar 14, 2016 at 1:36 PM, Jose Garcia-Rivera via RT <
> > > > > met_help at ucar.edu> wrote:
> > > > >
> > > > > >
> > > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > > >
> > > > > >
> > > > > > Dear Julie,
> > > > > >
> > > > > > I just uploaded the three files to 'garcia_data'.
> > > > > >
> > > > > > Thanks for the help,
> > > > > > Jose
> > > > > >
> > > > > >
> > > > > > -----Original Message-----
> > > > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > > > Sent: Monday, March 14, 2016 3:32 PM
> > > > > > To: Jose Garcia-Rivera
> > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
> > > > > > PREPBUFR to NetCDF
> > > > > >
> > > > > > Hi Jose.
> > > > > >
> > > > > > Yes, please upload your input files and configuration file
> > > > > > (nmbprs_d01.06, test.nc, PointStatConfig_default) to our
> > > > > > anonymous ftp
> > > > > site as follows:
> > > > > > http://www.dtcenter.org/met/users/support/met_help.php
> > > > > >
> > > > > > Thanks!
> > > > > >
> > > > > > Julie
> > > > > >
> > > > > > On Mon, Mar 14, 2016 at 1:06 PM, Jose Garcia-Rivera via RT
<
> > > > > > met_help at ucar.edu> wrote:
> > > > > >
> > > > > > >
> > > > > > > <URL:
> > > > > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > > > >
> > > > > > >
> > > > > > > Dear Julie,
> > > > > > >
> > > > > > > I got to convert my prepbufr file using a python script.
> > > > > > > However, I have trouble running point_stat. Can I send
you
> > > > > > > the files, to see if you have the same issue?
> > > > > > >
> > > > > > >
> > > > > > > This is what I got:
> > > > > > >
> > > > > > > [garciaj at login prepbufr_obs]$ ./point_stat nmbprs_d01.06
> > > > > > > test.nc PointStatConfig_default DEBUG 1: Default Config
File:
> > > > > > > /work/apps/pgi_14.10/SANDY/met-
5.1/share/met/config/PointSta
> > > > > > > tC on fi g_ de fault DEBUG 1: User Config File:
> > > > > > > PointStatConfig_default
> > > > > > > GSL_RNG_TYPE=mt19937
> > > > > > > GSL_RNG_SEED=18446744073425053526 DEBUG 1: Forecast
File:
> > > > > > > nmbprs_d01.06 DEBUG 1: Observation File:
> > > > > > > test.nc DEBUG 2:
> > > > > > > DEBUG 2:
> > > > > > >
------------------------------------------------------------
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > ----------
> > > > > > > DEBUG 2:
> > > > > > > DEBUG 2: Reading data for SPFH/P500.
> > > > > > > DEBUG 2: For SPFH/P500 found 1 forecast levels and 0
> > > > > > > climatology
> > > > > levels.
> > > > > > > DEBUG 2:
> > > > > > > DEBUG 2:
> > > > > > >
------------------------------------------------------------
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > ----------
> > > > > > > DEBUG 2:
> > > > > > > DEBUG 2: Reading data for TMP/P500.
> > > > > > > DEBUG 2: For TMP/P500 found 1 forecast levels and 0
> > > > > > > climatology
> > > > levels.
> > > > > > > DEBUG 2:
> > > > > > > DEBUG 2:
> > > > > > >
------------------------------------------------------------
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > ----------
> > > > > > > DEBUG 2:
> > > > > > > DEBUG 2: Reading data for HGT/P500.
> > > > > > > DEBUG 2: For HGT/P500 found 1 forecast levels and 0
> > > > > > > climatology
> > > > levels.
> > > > > > > DEBUG 2:
> > > > > > > DEBUG 2:
> > > > > > >
------------------------------------------------------------
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > ----------
> > > > > > > DEBUG 2:
> > > > > > > DEBUG 2: Reading data for UGRD/P500.
> > > > > > > DEBUG 2: For UGRD/P500 found 1 forecast levels and 0
> > > > > > > climatology
> > > > > levels.
> > > > > > > DEBUG 2:
> > > > > > > DEBUG 2:
> > > > > > >
------------------------------------------------------------
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > ----------
> > > > > > > DEBUG 2:
> > > > > > > DEBUG 2: Reading data for VGRD/P500.
> > > > > > > DEBUG 2: For VGRD/P500 found 1 forecast levels and 0
> > > > > > > climatology
> > > > > levels.
> > > > > > > DEBUG 2:
> > > > > > > DEBUG 2:
> > > > > > >
------------------------------------------------------------
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > ----------
> > > > > > > DEBUG 2:
> > > > > > > WARNING:
> > > > > > > WARNING: process_obs_file() -> can't open observation
netCDF
> > file:
> > > > > > > test.nc
> > > > > > > WARNING:
> > > > > > > DEBUG 2:
> > > > > > > DEBUG 2:
> > > > > > >
------------------------------------------------------------
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > ----------
> > > > > > > DEBUG 2:
> > > > > > > DEBUG 2: Processing SPFH/P500 versus SPFH/P500, for
> > > > > > > observation type ADPUPA, over region FULL, for
interpolation
> > > > > > > method NEAREST(1), using
> > > > > > > 0 pairs.
> > > > > > > DEBUG 2:
> > > > > > > DEBUG 2:
> > > > > > >
------------------------------------------------------------
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > ----------
> > > > > > > DEBUG 2:
> > > > > > > DEBUG 2: Processing TMP/P500 versus TMP/P500, for
> > > > > > > observation type ADPUPA, over region FULL, for
interpolation
> > > > > > > method NEAREST(1), using
> > > > > > > 0
> > > > > > pairs.
> > > > > > > DEBUG 2:
> > > > > > > DEBUG 2:
> > > > > > >
------------------------------------------------------------
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > ----------
> > > > > > > DEBUG 2:
> > > > > > > DEBUG 2: Processing HGT/P500 versus HGT/P500, for
> > > > > > > observation type ADPUPA, over region FULL, for
interpolation
> > > > > > > method NEAREST(1), using
> > > > > > > 0
> > > > > > pairs.
> > > > > > > DEBUG 2:
> > > > > > > DEBUG 2:
> > > > > > >
------------------------------------------------------------
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > ----------
> > > > > > > DEBUG 2:
> > > > > > > DEBUG 2: Processing UGRD/P500 versus UGRD/P500, for
> > > > > > > observation type ADPUPA, over region FULL, for
interpolation
> > > > > > > method NEAREST(1), using
> > > > > > > 0 pairs.
> > > > > > > DEBUG 2:
> > > > > > > DEBUG 2:
> > > > > > >
------------------------------------------------------------
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > ----------
> > > > > > > DEBUG 2:
> > > > > > > DEBUG 2: Processing VGRD/P500 versus VGRD/P500, for
> > > > > > > observation type ADPUPA, over region FULL, for
interpolation
> > > > > > > method NEAREST(1), using
> > > > > > > 0 pairs.
> > > > > > > DEBUG 2:
> > > > > > > DEBUG 2:
> > > > > > >
------------------------------------------------------------
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > --
> > > > > > > ----------
> > > > > > > DEBUG 2:
> > > > > > > DEBUG 1: Output file:
> > > > > > > ./point_stat_060000L_20150820_180000V.stat
> > > > > > > DEBUG 1: Output file:
> > > > > > > ./point_stat_060000L_20150820_180000V_fho.txt
> > > > > > > DEBUG 1: Output file:
> > > > > > > ./point_stat_060000L_20150820_180000V_ctc.txt
> > > > > > > DEBUG 1: Output file:
> > > > > > > ./point_stat_060000L_20150820_180000V_cts.txt
> > > > > > > DEBUG 1: Output file:
> > > > > > > ./point_stat_060000L_20150820_180000V_mctc.txt
> > > > > > > DEBUG 1: Output file:
> > > > > > > ./point_stat_060000L_20150820_180000V_mcts.txt
> > > > > > > DEBUG 1: Output file:
> > > > > > > ./point_stat_060000L_20150820_180000V_cnt.txt
> > > > > > > DEBUG 1: Output file:
> > > > > > > ./point_stat_060000L_20150820_180000V_sl1l2.txt
> > > > > > > DEBUG 1: Output file:
> > > > > > > ./point_stat_060000L_20150820_180000V_sal1l2.txt
> > > > > > > DEBUG 1: Output file:
> > > > > > > ./point_stat_060000L_20150820_180000V_vl1l2.txt
> > > > > > > DEBUG 1: Output file:
> > > > > > > ./point_stat_060000L_20150820_180000V_val1l2.txt
> > > > > > > DEBUG 1: Output file:
> > > > > > > ./point_stat_060000L_20150820_180000V_pct.txt
> > > > > > > DEBUG 1: Output file:
> > > > > > > ./point_stat_060000L_20150820_180000V_pstd.txt
> > > > > > > DEBUG 1: Output file:
> > > > > > > ./point_stat_060000L_20150820_180000V_pjc.txt
> > > > > > > DEBUG 1: Output file:
> > > > > > > ./point_stat_060000L_20150820_180000V_prc.txt
> > > > > > > DEBUG 1: Output file:
> > > > > > > ./point_stat_060000L_20150820_180000V_mpr.txt
> > > > > > >
> > > > > > >
> > > > > > > Thanks for the help,
> > > > > > > Jose
> > > > > > >
> > > > > > >
> > > > > > > -----Original Message-----
> > > > > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > > > > Sent: Monday, March 14, 2016 12:17 PM
> > > > > > > To: Jose Garcia-Rivera
> > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
> > > > > > > PREPBUFR to NetCDF
> > > > > > >
> > > > > > > Hi Jose. I apologize for the delayed response. I was
out
> > > > > > > of the office on Friday. I'm going to try to figure out
a
> > > > > > > solution and get back with you shortly.
> > > > > > >
> > > > > > > Julie
> > > > > > >
> > > > > > > On Fri, Mar 11, 2016 at 2:02 PM, Jose Garcia-Rivera via
RT <
> > > > > > > met_help at ucar.edu> wrote:
> > > > > > >
> > > > > > > >
> > > > > > > > <URL:
> > > > > > > >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > > > > >
> > > > > > > >
> > > > > > > > Dear Julie,
> > > > > > > >
> > > > > > > > Any news regarding pb2nc? We're still unable to make
it work.
> > > > > > > >
> > > > > > > > Best Regards,
> > > > > > > > Jose
> > > > > > > >
> > > > > > > > -----Original Message-----
> > > > > > > > From: Julie Prestopnik via RT
[mailto:met_help at ucar.edu]
> > > > > > > > Sent: Thursday, March 10, 2016 4:20 PM
> > > > > > > > To: Jose Garcia-Rivera
> > > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues
converting
> > > > > > > > PREPBUFR to NetCDF
> > > > > > > >
> > > > > > > > Hi Jose. Thank you for attaching the files.
> > > > > > > >
> > > > > > > > Could you please send me a list of the files in
> > > > > > > > /work/apps/pgi_14.10/SANDY/bufrlib/lib?
> > > > > > > >
> > > > > > > > Thank you!
> > > > > > > >
> > > > > > > > Julie
> > > > > > > >
> > > > > > > >
> > > > > > > > On Thu, Mar 10, 2016 at 12:20 PM, Jose Garcia-Rivera
via
> > > > > > > > RT < met_help at ucar.edu> wrote:
> > > > > > > >
> > > > > > > > >
> > > > > > > > > <URL:
> > > > > > > > >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > > > > > >
> > > > > > > > >
> > > > > > > > > Dear Julie,
> > > > > > > > >
> > > > > > > > > The administrator re-compiled MET following your
> > > > > > > > > instructions, and says there's still trouble. He
sent me
> > > > > > > > > the log files
> > > > > (attached).
> > > > > > > > > Is there any other approach that might help?
> > > > > > > > >
> > > > > > > > > Best Regards,
> > > > > > > > > Jose
> > > > > > > > >
> > > > > > > > > -----Original Message-----
> > > > > > > > > From: Julie Prestopnik via RT
[mailto:met_help at ucar.edu]
> > > > > > > > > Sent: Wednesday, March 09, 2016 12:39 PM
> > > > > > > > > To: Jose Garcia-Rivera
> > > > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues
converting
> > > > > > > > > PREPBUFR to NetCDF
> > > > > > > > >
> > > > > > > > > Thank you, Jose! It looks like something went wrong
> > > > > > > > > during
> > > > > > > compilation.
> > > > > > > > > I suggest recompiling MET to see if we can get this
> > > > > > > > > issue
> > > > resolved.
> > > > > > > > > NCEP's BUFRLIB is used by the pb2nc MET tool, and is
a
> > > > > > > > > required external library for pb2nc. MET is not yet
> > > > > > > > > compatible with BUFRLIB
> > > > > > > > version 11.0.0, so we
> > > > > > > > > suggest getting version 10.2.3. We are working on
our
> > online
> > > > > > tutorial
> > > > > > > > for
> > > > > > > > > METv.5.1, but in the meantime, I'll point you to our
> > > > > > > > > online tutorial directions for installing BUFRLIB:
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > http://www.dtcenter.org/met/users/support/online_tutorial/METv5.
> > > > > > > > > 0/
> > > > > > > > > co
> > > > > > > > > mp
> > > > > > > > > ilation/req_libs.php
> > > > > > > > >
> > > > > > > > > It is also important to review the necessary
environment
> > > > > > > > > variables to
> > > > > > > > set:
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > http://www.dtcenter.org/met/users/support/online_tutorial/METv5.
> > > > > > > > > 0/
> > > > > > > > > co
> > > > > > > > > mp
> > > > > > > > > ilation/configure.php
> > > > > > > > >
> > > > > > > > > For example,
> > > > > > > > >
> > > > > > > > > "Set *$MET_BUFR* to point to the main BUFR
directory, or
> > > > > > > > > set
> > > > > > > > > *$MET_BUFRLIB* to point to the directory with the
BUFR
> > > > > > > > > library
> > > > > files.
> > > > > > > > > Because MET doesn't use any BUFR library include
files,
> > > > > > > > > you don't need to specify *$MET_BUFRINC* ."
> > > > > > > > >
> > > > > > > > > Once you've installed the required libraries and set
up
> > > > > > > > > your environment variables, you'll be ready to
configure
> > > > > > > > > MET (instructions at the bottom of the last link
above)
> > > > > > > > > and then compile and install MET (
> > > > > > > > >
> > > http://www.dtcenter.org/met/users/support/online_tutorial/METv5.
> > > > > > > > > 0/
> > > > > > > > > co
> > > > > > > > > mp
> > > > > > > > > ilation/compile.php
> > > > > > > > > ).
> > > > > > > > > After re-installing MET, please run "make test"
again.
> > > > > > > > > If you still encounter the same problem, please send
me
> > > > > > > > > your
> > > > > > > > > *config.log* file and your *make_install.log *file.
> > > > > > > > > Please let me know if you have any
> > > > > > > > questions.
> > > > > > > > >
> > > > > > > > > Please let us know how it goes.
> > > > > > > > >
> > > > > > > > > Thanks,
> > > > > > > > > Julie
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > On Wed, Mar 9, 2016 at 10:22 AM, Jose Garcia-Rivera
via
> > > > > > > > > RT < met_help at ucar.edu> wrote:
> > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > <URL:
> > > > > > > > > >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=7543
> > > > > > > > > > 3
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > Dear Julie,
> > > > > > > > > >
> > > > > > > > > > Attached is the test log file. It's showing the
same
> > > > > > > > > > issues on pb2nc even with the sample files.
> > > > > > > > > >
> > > > > > > > > > Best Regards,
> > > > > > > > > > Jose
> > > > > > > > > >
> > > > > > > > > > -----Original Message-----
> > > > > > > > > > From: Julie Prestopnik via RT
> > > > > > > > > > [mailto:met_help at ucar.edu]
> > > > > > > > > > Sent: Tuesday, March 08, 2016 5:28 PM
> > > > > > > > > > To: Jose Garcia-Rivera
> > > > > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues
> > > > > > > > > > converting PREPBUFR to NetCDF
> > > > > > > > > >
> > > > > > > > > > Hi Jose. Thank you for uploading the files.
> > > > > > > > > > Unfortunately, I am unable to reproduce the error
you
> > > > > > > > > > are experiencing. I am wondering if you have
> > > > > > > > > > successfully used pb2nc before. As a check could
you
> > > > > > > > > > please run the following in your met-5.1/
> > > > > > directory:
> > > > > > > > > >
> > > > > > > > > > *make test >& make_test.log*
> > > > > > > > > >
> > > > > > > > > > and then send me the make_test.log file?
> > > > > > > > > >
> > > > > > > > > > Thanks,
> > > > > > > > > > Julie
> > > > > > > > > >
> > > > > > > > > > On Tue, Mar 8, 2016 at 11:29 AM, Jose Garcia-
Rivera
> > > > > > > > > > via RT < met_help at ucar.edu> wrote:
> > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > <URL:
> > > > > > > > > > >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75
> > > > > > > > > > > 43
> > > > > > > > > > > 3
> > > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > Dear Julie,
> > > > > > > > > > >
> > > > > > > > > > > I just put the files in 'garcia_data'. I
appreciate
> > > > > > > > > > > your
> > > > help.
> > > > > > > > > > >
> > > > > > > > > > > Best Regards,
> > > > > > > > > > > Jose
> > > > > > > > > > >
> > > > > > > > > > > -----Original Message-----
> > > > > > > > > > > From: Julie Prestopnik via RT
> > > > > > > > > > > [mailto:met_help at ucar.edu]
> > > > > > > > > > > Sent: Tuesday, March 08, 2016 1:12 PM
> > > > > > > > > > > To: Jose Garcia-Rivera
> > > > > > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues
> > > > > > > > > > > converting PREPBUFR to NetCDF
> > > > > > > > > > >
> > > > > > > > > > > Hi Jose. I'm sorry to hear that you are having
> > > > > > > > > > > problems converting a PREPBUFR file to NetCDF.
> > > > > > > > > > >
> > > > > > > > > > > Please upload your input files and configuration
> > > > > > > > > > > file to our anonymous ftp site as follows:
> > > > > > > > > > >
http://www.dtcenter.org/met/users/support/met_help.p
> > > > > > > > > > > hp
> > > > > > > > > > >
> > > > > > > > > > > Then I can take a look and get back to you.
> > > > > > > > > > >
> > > > > > > > > > > Thanks,
> > > > > > > > > > > Julie
> > > > > > > > > > >
> > > > > > > > > > > On Tue, Mar 8, 2016 at 11:01 AM, Jose Garcia-
Rivera
> > > > > > > > > > > via RT < met_help at ucar.edu> wrote:
> > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > Tue Mar 08 11:01:25 2016: Request 75433 was
acted
> upon.
> > > > > > > > > > > > Transaction: Ticket created by
GarciaJ at imsg.com
> > > > > > > > > > > > Queue: met_help
> > > > > > > > > > > > Subject: Issues converting PREPBUFR to
NetCDF
> > > > > > > > > > > > Owner: Nobody
> > > > > > > > > > > > Requestors: GarciaJ at imsg.com
> > > > > > > > > > > > Status: new
> > > > > > > > > > > > Ticket <URL:
> > > > > > > > > > > >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=
> > > > > > > > > > > > 75
> > > > > > > > > > > > 43
> > > > > > > > > > > > 3
> > > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > Dear Met Help,
> > > > > > > > > > > >
> > > > > > > > > > > > Trying to convert a PREPBUFR file to NetCDF.
> > > > > > > > > > > >
> > > > > > > > > > > > I used the default PB2NC configure file, and
got
> > > > > > > > > > > > the
> > > > > following:
> > > > > > > > > > > >
> > > > > > > > > > > > [garciaj at login prepbufr_obs]$ ./pb2nc
> > > > > > > > > > > > gdas1.t12z.prepbufr.nr gdas.20150820.t12z.nc
> > > > > > > > > > > > PB2NCConfig_default DEBUG 1: Default Config
> > > > > > > > > > > > File:
> > > > > > > > > > > > /work/apps/pgi_14.10/met-
5.1/share/met/config/PB2N
> > > > > > > > > > > > CC on fi g_ de fa ul t DEBUG 1: User Config
File:
> > > > > > > > > > > > PB2NCConfig_default DEBUG 1: Creating NetCDF
File:
> > > > > gdas.20150820.t12z.nc
> > > > > > > > > > > > DEBUG 1: Processing PrepBufr File:
> > > > > gdas1.t12z.prepbufr.nr
> > > > > > > > > > > > DEBUG 1: Blocking PrepBufr file to:
> > > > > > > /tmp/tmp_pb2nc_blk_32144_0
> > > > > > > > > > > > WARNING:
> > > > > > > > > > > > WARNING: process_pbfile() -> No PrepBufr
messages
> > > > > > > > > > > > to process in
> > > > > > > > file:
> > > > > > > > > > > > gdas1.t12z.prepbufr.nr
> > > > > > > > > > > > WARNING:
> > > > > > > > > > > > ERROR :
> > > > > > > > > > > > ERROR : write_netcdf_hdr_data() -> No
PrepBufr
> > > > > > > > > > > > messages
> > > > > > > retained.
> > > > > > > > > > > > Nothing to write.
> > > > > > > > > > > > ERROR :
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > Thanks in advance for the help, Jose M.
> > > > > > > > > > > > Garcia-Rivera, PhD IM Systems Group
> > > > > > > > > > > > Rockville/College Park, MD This e-mail,
including
> > > > > > > > > > > > attachments, may include confidential and/or
> > > > > > > > > > > > proprietary information, and may be used only
by
> > > > > > > > > > > > the person or entity to which it is addressed.
If
> > > > > > > > > > > > the reader of this e-mail is not the intended
> > > > > > > > > > > > recipient or his or her authorized agent, the
> > > > > > > > > > > > reader is hereby notified that any
dissemination,
> > > > > > > > > > > > distribution or
> > copying of this e-mail is prohibited.
> > > > > > > > > > > > If you have received this e-mail in error,
please
> > > > > > > > > > > > notify the sender by replying to this message
and
> > > > > > > > > > > > delete this
> > > > > > > > > > > e-mail immediately.
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > --
> > > > > > > > > > > Julie Prestopnik
> > > > > > > > > > > National Center for Atmospheric Research
Research
> > > > > > > > > > > Applications Laboratory
> > > > > > > > > > > Phone: 303.497.8399
> > > > > > > > > > > Email: jpresto at ucar.edu
> > > > > > > > > > >
> > > > > > > > > > > This e-mail, including attachments, may include
> > > > > > > > > > > confidential and/or proprietary information, and
may
> > > > > > > > > > > be used only by the person or entity to which it
is
> > > > > > > > > > > addressed. If the reader of this e-mail is not
the
> > > > > > > > > > > intended recipient or his or her authorized
agent,
> > > > > > > > > > > the reader is hereby notified that any
> > > > > > > > > > > dissemination, distribution or copying of this
e-mail
> is prohibited.
> > > > > > > > > > > If you have received this e-mail in error,
please
> > > > > > > > > > > notify the sender by replying to this message
and
> > > > > > > > > > > delete this
> > > > > > > > > > e-mail immediately.
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > --
> > > > > > > > > > Julie Prestopnik
> > > > > > > > > > National Center for Atmospheric Research Research
> > > > > > > > > > Applications Laboratory
> > > > > > > > > > Phone: 303.497.8399
> > > > > > > > > > Email: jpresto at ucar.edu
> > > > > > > > > >
> > > > > > > > > > This e-mail, including attachments, may include
> > > > > > > > > > confidential and/or proprietary information, and
may
> > > > > > > > > > be used only by the person or entity to which it
is
> > > > > > > > > > addressed. If the reader of this e-mail is not the
> > > > > > > > > > intended recipient or his or her authorized agent,
the
> > > > > > > > > > reader is hereby notified that any dissemination,
> > > > > > > > > > distribution or copying of this e-mail is
prohibited.
> > > > > > > > > > If you have received this e-mail in error, please
> > > > > > > > > > notify the sender by replying to this message and
> > > > > > > > > > delete this
> > > > > > > > > e-mail immediately.
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > --
> > > > > > > > > Julie Prestopnik
> > > > > > > > > National Center for Atmospheric Research Research
> > > > > > > > > Applications Laboratory
> > > > > > > > > Phone: 303.497.8399
> > > > > > > > > Email: jpresto at ucar.edu
> > > > > > > > >
> > > > > > > > > This e-mail, including attachments, may include
> > > > > > > > > confidential and/or proprietary information, and may
be
> > > > > > > > > used only by the person or entity to which it is
> > > > > > > > > addressed. If the reader of this e-mail is not the
> > > > > > > > > intended recipient or his or her authorized agent,
the
> > > > > > > > > reader is hereby notified that any dissemination,
> > > > > > > > > distribution or copying of this e-mail is
prohibited. If
> > > > > > > > > you have received this e-mail in error, please
notify
> > > > > > > > > the sender by replying to this message and delete
this
> > > > > > > > e-mail immediately.
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > --
> > > > > > > > Julie Prestopnik
> > > > > > > > National Center for Atmospheric Research Research
> > > > > > > > Applications Laboratory
> > > > > > > > Phone: 303.497.8399
> > > > > > > > Email: jpresto at ucar.edu
> > > > > > > >
> > > > > > > > This e-mail, including attachments, may include
> > > > > > > > confidential and/or proprietary information, and may
be
> > > > > > > > used only by the person or entity to which it is
> > > > > > > > addressed. If the reader of this e-mail is not the
> > > > > > > > intended recipient or his or her authorized agent, the
> > > > > > > > reader is hereby notified that any dissemination,
> > > > > > > > distribution or copying of this e-mail is prohibited.
If
> > > > > > > > you have received this e-mail in error, please notify
the
> > > > > > > > sender by replying to this message and delete this
> > > > > > > e-mail immediately.
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > --
> > > > > > > Julie Prestopnik
> > > > > > > National Center for Atmospheric Research Research
> > > > > > > Applications Laboratory
> > > > > > > Phone: 303.497.8399
> > > > > > > Email: jpresto at ucar.edu
> > > > > > >
> > > > > > > This e-mail, including attachments, may include
confidential
> > > > > > > and/or proprietary information, and may be used only by
the
> > > > > > > person or entity to which it is addressed. If the reader
of
> > > > > > > this e-mail is not the intended recipient or his or her
> > > > > > > authorized agent, the reader is hereby notified that any
> > > > > > > dissemination, distribution or copying of this e-mail is
> > > > > > > prohibited. If you have received this e-mail in error,
> > > > > > > please notify the sender by replying to this message and
> > > > > > > delete this
> > > > > > e-mail immediately.
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > >
> > > > > >
> > > > > > --
> > > > > > Julie Prestopnik
> > > > > > National Center for Atmospheric Research Research
Applications
> > > > > > Laboratory
> > > > > > Phone: 303.497.8399
> > > > > > Email: jpresto at ucar.edu
> > > > > >
> > > > > > This e-mail, including attachments, may include
confidential
> > > > > > and/or proprietary information, and may be used only by
the
> > > > > > person or entity to which it is addressed. If the reader
of
> > > > > > this e-mail is not the intended recipient or his or her
> > > > > > authorized agent, the reader is hereby notified that any
> > > > > > dissemination, distribution or copying of this e-mail is
> > > > > > prohibited. If you have received this e-mail in error,
please
> > > > > > notify the sender by replying to this message and delete
this
> > > > > e-mail immediately.
> > > > > >
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > > > --
> > > > > Julie Prestopnik
> > > > > National Center for Atmospheric Research Research
Applications
> > > > > Laboratory
> > > > > Phone: 303.497.8399
> > > > > Email: jpresto at ucar.edu
> > > > >
> > > > > This e-mail, including attachments, may include confidential
> > > > > and/or proprietary information, and may be used only by the
> > > > > person or entity to which it is addressed. If the reader of
this
> > > > > e-mail is not the intended recipient or his or her
authorized
> > > > > agent, the reader is hereby notified that any dissemination,
> > > > > distribution or copying of this e-mail is prohibited. If you
> > > > > have received this e-mail in error, please notify the sender
by
> > > > > replying to this message and delete this
> > > > e-mail immediately.
> > > > >
> > > > >
> > > > >
> > > >
> > > >
> > > > --
> > > > Julie Prestopnik
> > > > National Center for Atmospheric Research Research Applications
> > > > Laboratory
> > > > Phone: 303.497.8399
> > > > Email: jpresto at ucar.edu
> > > >
> > > > This e-mail, including attachments, may include confidential
> > > > and/or proprietary information, and may be used only by the
person
> > > > or entity to which it is addressed. If the reader of this e-
mail
> > > > is not the intended recipient or his or her authorized agent,
the
> > > > reader is hereby notified that any dissemination, distribution
or
> > > > copying of this e-mail is prohibited. If you have received
this
> > > > e-mail in error, please notify the sender by replying to this
> > > > message and delete this
> > > e-mail immediately.
> > > >
> > > >
> > > >
> > >
> > >
> > > --
> > > Julie Prestopnik
> > > National Center for Atmospheric Research Research Applications
> > > Laboratory
> > > Phone: 303.497.8399
> > > Email: jpresto at ucar.edu
> > >
> > > This e-mail, including attachments, may include confidential
and/or
> > > proprietary information, and may be used only by the person or
> > > entity to which it is addressed. If the reader of this e-mail is
not
> > > the intended recipient or his or her authorized agent, the
reader is
> > > hereby notified that any dissemination, distribution or copying
of
> > > this e-mail is prohibited. If you have received this e-mail in
> > > error, please notify the sender by replying to this message and
> > > delete this
> > e-mail immediately.
> > >
> > >
> >
> > This e-mail, including attachments, may include confidential
and/or
> > proprietary information, and may be used only by the person or
entity
> > to which it is addressed. If the reader of this e-mail is not the
> > intended recipient or his or her authorized agent, the reader is
> > hereby notified that any dissemination, distribution or copying of
> > this e-mail is prohibited. If you have received this e-mail in
error,
> > please notify the sender by replying to this message and delete
this
> e-mail immediately.
> >
> >
> >
>
> This e-mail, including attachments, may include confidential and/or
> proprietary information, and may be used only by the person or
entity to
> which it is addressed. If the reader of this e-mail is not the
intended
> recipient or his or her authorized agent, the reader is hereby
notified
> that any dissemination, distribution or copying of this e-mail is
> prohibited. If you have received this e-mail in error, please notify
the
> sender by replying to this message and delete this e-mail
immediately.
>
>
>
This e-mail, including attachments, may include confidential and/or
proprietary information, and may be used only by the person or entity
to which it is addressed. If the reader of this e-mail is not the
intended recipient or his or her authorized agent, the reader is
hereby notified that any dissemination, distribution or copying of
this e-mail is prohibited. If you have received this e-mail in error,
please notify the sender by replying to this message and delete this
e-mail immediately.
------------------------------------------------
Subject: Issues converting PREPBUFR to NetCDF
From: John Halley Gotway
Time: Fri Mar 18 14:08:25 2016
Jose,
Ah OK, I suspect that exiting the PB2NC command early is the problem.
While PB2NC did create an output file, you probably killed it before
it
finished writing out all the observations.
This same issue actually came up recently when running on the NCAR
supercomputer, Yellowstone. PB2NC finishes processing the
observations in
a few minutes, but takes multiple hours to write the output NetCDF
file.
The same step takes about 2 seconds on my desktop machine, but 2 hours
on
Yellowstone! So that's an open issue we need to investigate further.
For your needs, please do the following:
(1) I posted my PB2NC output file to our ftp site:
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/for_garcia/gdas1.t18z.prepbufr.nc
Please grab it and verify that when you use it in your Point-Stat
runs, you
actually do get matched pairs.
(2) Try rerunning PB2NC yourself, but this time set the following in
your
PB2NC config file:
mask = "G212";
That will filter the observations and only keep the ones which fall
within
this pre-defined NCEP Grid:
http://www.nco.ncep.noaa.gov/pmb/docs/on388/grids/grid212.gif
That should result in 293763 observations instead of 1330661 of them.
Perhaps PB2NC will run in a more reasonable time.
But in the long run of course, we'll need to figure out why PB2NC is
so
slow and fix it!
Thanks,
John
(2)
On Fri, Mar 18, 2016 at 12:58 PM, Jose Garcia-Rivera via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
>
> Dear John,
>
> I modified the config file for pb2nc, and still have the same issue.
I
> uploaded these two files to 'garcia_data'
>
> 3km_nmbprs_d01.06
> newtest.nc
>
> I don’t need to change the quality flag in the point_stat
configuration
> file, right?
>
> One extra thing to mention: I had to type CNTL+C to exit pb2nc,
since it
> seemed to stay stuck on a loop,,, yet I got the netcdf file. This
happened
> every time:
>
> [garciaj at login prepbufr_obs]$ ./pb2nc gdas1.t18z.prepbufr.nr
newtest.nc
> PB2NCConfig_default
> DEBUG 1: Default Config File:
> /work/apps/pgi_14.10/SANDY/met-
5.1/share/met/config/PB2NCConfig_default
> DEBUG 1: User Config File: PB2NCConfig_default
> DEBUG 1: Creating NetCDF File: newtest.nc
> DEBUG 1: Processing PrepBufr File: gdas1.t18z.prepbufr.nr
> DEBUG 1: Blocking PrepBufr file to: /tmp/tmp_pb2nc_blk_50363_0
> DEBUG 2: PrepBufr Time Center: 20150820_180000
> DEBUG 2: Searching Time Window: 20150820_163000 to
20150820_193000
> DEBUG 2: Processing 685386 PrepBufr messages...
> 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85%
90% 95%
> 100%
> DEBUG 2: Total PrepBufr Messages processed = 685386
> DEBUG 2: Rejected based on message type = 0
> DEBUG 2: Rejected based on station id = 0
> DEBUG 2: Rejected based on valid time = 185145
> DEBUG 2: Rejected based on masking grid = 0
> DEBUG 2: Rejected based on masking polygon = 0
> DEBUG 2: Rejected based on elevation = 0
> DEBUG 2: Rejected based on pb report type = 0
> DEBUG 2: Rejected based on input report type = 0
> DEBUG 2: Rejected based on instrument type = 0
> DEBUG 2: Rejected based on zero observations = 11135
> DEBUG 2: Total PrepBufr Messages retained = 489106
> DEBUG 2: Total observations retained or derived = 1330661
>
> ^C
>
>
>
> Thanks for the help,
> Jose
>
> -----Original Message-----
> From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> Sent: Friday, March 18, 2016 1:01 PM
> To: Jose Garcia-Rivera
> Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to
NetCDF
>
> Jose,
>
> Thanks for sending the test data. I see that your model data is
valid at
> time 20150820_180000. When I run Point-Stat, I see the following
reason
> counts in the output:
>
> DEBUG 2: Processing TMP/Z2 versus TMP/Z2, for observation type
ADPSFC, over
> region FULL, for interpolation method NEAREST(1), using 0 pairs.
> DEBUG 3: Number of matched pairs = 0
> DEBUG 3: Observations processed = 949837
> DEBUG 3: Rejected: SID exclusion = 0
> DEBUG 3: Rejected: GRIB code = 943848
> DEBUG 3: Rejected: valid time = 4191
> DEBUG 3: Rejected: bad obs value = 0
> DEBUG 3: Rejected: off the grid = 1798
> DEBUG 3: Rejected: level mismatch = 0
> DEBUG 3: Rejected: quality marker = 0
> DEBUG 3: Rejected: message type = 0
> DEBUG 3: Rejected: masking region = 0
> DEBUG 3: Rejected: bad fcst value = 0
> DEBUG 3: Rejected: duplicates = 0
>
> So it looks like several observations are not used for either the
valid
> time or being off the grid. Let's look at where these temperature
exist.
> I ran the following command to plot their location:
> met-5.1/bin/plot_point_obs newtest.nc newtest.ps -gc 11 -v 3
>
> The "-gc 11" option says only plot temperature. The resulting image
is
> attached. Notice that none of them fall within your East Coast
domain.
> Also notice in the log output that these are all AIRCFT temperature
> observations! No ADPUPA and no ADPSFC.
>
> Since you're using GDAS observations, you should be aware of the
quality
> marker issue for surface observations noted at the bottom of this
page:
> http://www.dtcenter.org/met/users/downloads/observation_data.php
>
> To get Point-Stat running, I did the following steps:
>
> (1) Pull GDAS observations for 20150820_180000:
> wget
>
>
http://nomads.ncdc.noaa.gov/data/gdas/201508/20150820/gdas1.t18z.prepbufr.nr
>
> (2) Run PB2NC using the attached configuration file (note quality
marker =
> 9):
> met-5.1/bin/pb2nc gdas1.t18z.prepbufr.nr gdas1.t18z.prepbufr.nc
> PB2NCConfig_GDAS
>
> (3) Run Point-Stat using the data/config file you sent me:
> met-5.1/bin/point_stat nmbprs_d01.06 gdas1.t18z.prepbufr.nc
> PointStatConfig -outdir out -v 4
>
> And that give me 3584 matched pairs:
> DEBUG 3: Number of matched pairs = 3584
>
> So the problem was caused by the GDAS quality marker issue. Also
note that
> for North American grids, using NDAS (i.e. north american data
> assimilation) would work equally well and NDAS does *NOT* have this
quality
> marker issue.
>
> Lastly, I see the following warning when I run Point-Stat with your
data:
> WARNING:
> WARNING: gds_to_lambert() -> MET does not currently support Lambert
> Conformal grids where dx (3.317) != dy (2.97) and may produce
unexpected
> results!
> WARNING:
>
> I'd suggest post-processing to a different grid where Dx = Dy prior
to
> running MET.
>
> Hope that helps.
>
> Thanks,
> John
>
> On Fri, Mar 18, 2016 at 10:15 AM, Jose Garcia-Rivera via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> >
> > Dear John,
> >
> > I tried as you suggested, but still have empty output. I put the
files in
> > your ftp in 'garcia_data'
> >
> > The three files in the FTP are:
> >
> > newtest.nc
> > nmbprs_d01.06
> > PointStatConfig
> >
> >
> > Output:
> >
> > [garciaj at login prepbufr_obs]$ ./point_stat nmbprs_d01.06
newtest.nc
> > PointStatConfig_default
> > DEBUG 1: Default Config File:
> >
> /work/apps/pgi_14.10/SANDY/met-
5.1/share/met/config/PointStatConfig_default
> > DEBUG 1: User Config File: PointStatConfig_default
> > GSL_RNG_TYPE=mt19937
> > GSL_RNG_SEED=18446744071614164054
> > DEBUG 1: Forecast File: nmbprs_d01.06
> > DEBUG 1: Observation File: newtest.nc
> > DEBUG 2:
> > DEBUG 2:
> >
>
--------------------------------------------------------------------------------
> > DEBUG 2:
> > DEBUG 2: Reading data for TMP/Z2.
> > DEBUG 2: For TMP/Z2 found 1 forecast levels and 0 climatology
levels.
> > DEBUG 2:
> > DEBUG 2:
> >
>
--------------------------------------------------------------------------------
> > DEBUG 2:
> > DEBUG 2: Searching 949837 observations from 452408 messages.
> > DEBUG 2:
> > DEBUG 2:
> >
>
--------------------------------------------------------------------------------
> > DEBUG 2:
> > DEBUG 2: Processing TMP/Z2 versus TMP/Z2, for observation type
ADPSFC,
> > over region FULL, for interpolation method NEAREST(1), using 0
pairs.
> > DEBUG 2:
> > DEBUG 2:
> >
>
--------------------------------------------------------------------------------
> > DEBUG 2:
> > DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V.stat
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_fho.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_ctc.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_cts.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_mctc.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_mcts.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_cnt.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_sl1l2.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_sal1l2.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_vl1l2.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_val1l2.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_pct.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_pstd.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_pjc.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_prc.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_mpr.txt
> >
> > From config file:
> >
> > fcst = {
> > message_type = [ "ADPSFC" ];
> > sid_exc = [];
> >
> > field = [
> > {
> > name = "TMP";
> > level = [ "Z2" ];
> > cat_thresh = [ >293.0 ];
> > }
> > ];
> >
> >
> > Thanks for the help,
> > Jose
> >
> >
> >
> > -----Original Message-----
> > From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> > Sent: Thursday, March 17, 2016 5:47 PM
> > To: Jose Garcia-Rivera
> > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR
to
> NetCDF
> >
> > Jose,
> >
> > I see that you're doing an upper-air (ADPUPA) evaluation for the
time
> > 20150820_180000. Upper-air observations are much more common at
00Z and
> > 12Z than 06Z and 18Z. Instead of verifying the 06 hour forecast
valid at
> > 18Z, please try the 12 hour forecast valid at 00Z.
> >
> > Also, you could try evaluating some surface fields against the
ADPSFC
> > message type.
> >
> > If you get stuck, you can post a sample forecast file to our
anonymous
> ftp
> > site, and I can try running it here.
> >
> > Thanks,
> > John
> >
> >
> >
> > On Thu, Mar 17, 2016 at 2:39 PM, Jose Garcia-Rivera via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> > >
> > > Dear John,
> > >
> > > It's great to hear from you again! Julie has been of great help.
We
> > > highly appreciate all the help coming from your team.
> > >
> > > I followed your recommendation, and got the following:
> > >
> > > [garciaj at login prepbufr_obs]$ ./point_stat -v 3 nmbprs_d01.06
> > > newtest.nc PointStatConfig_default DEBUG 1: Default Config File:
> > > /work/apps/pgi_14.10/SANDY/met-
5.1/share/met/config/PointStatConfig_de
> > > fault DEBUG 1: User Config File: PointStatConfig_default
> > > GSL_RNG_TYPE=mt19937
> > > GSL_RNG_SEED=1041230678
> > > DEBUG 1: Forecast File: nmbprs_d01.06
> > > DEBUG 1: Observation File: newtest.nc
> > > DEBUG 2:
> > > DEBUG 2:
> > >
----------------------------------------------------------------------
> > > ----------
> > > DEBUG 2:
> > > DEBUG 2: Reading data for SPFH/P500.
> > > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found range
match for
> > > VarInfo "SPFH/P500" in GRIB record 134 of GRIB file
"nmbprs_d01.06".
> > > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found 1 GRIB
records
> > > matching VarInfo "SPFH/P500" in GRIB file "nmbprs_d01.06".
> > > DEBUG 3: Use the matching forecast and observation grids.
> > > DEBUG 3: Grid Definition: Projection: Lambert Conformal Nx: 400
Ny:
> > > 400
> > > Lat_LL: 33.302 Lon_LL: 84.951 Lon_orient: 77.459 Alpha: 3781.822
Cone:
> > > 0.629 Bx: 210.6765 By: 2557.3266
> > > DEBUG 2: For SPFH/P500 found 1 forecast levels and 0 climatology
> levels.
> > > DEBUG 2:
> > > DEBUG 2:
> > >
----------------------------------------------------------------------
> > > ----------
> > > DEBUG 2:
> > > DEBUG 2: Reading data for TMP/P500.
> > > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found range
match for
> > > VarInfo "TMP/P500" in GRIB record 131 of GRIB file
"nmbprs_d01.06".
> > > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found 1 GRIB
records
> > > matching VarInfo "TMP/P500" in GRIB file "nmbprs_d01.06".
> > > DEBUG 2: For TMP/P500 found 1 forecast levels and 0 climatology
levels.
> > > DEBUG 2:
> > > DEBUG 2:
> > >
----------------------------------------------------------------------
> > > ----------
> > > DEBUG 2:
> > > DEBUG 2: Reading data for HGT/P500.
> > > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found range
match for
> > > VarInfo "HGT/P500" in GRIB record 130 of GRIB file
"nmbprs_d01.06".
> > > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found 1 GRIB
records
> > > matching VarInfo "HGT/P500" in GRIB file "nmbprs_d01.06".
> > > DEBUG 2: For HGT/P500 found 1 forecast levels and 0 climatology
levels.
> > > DEBUG 2:
> > > DEBUG 2:
> > >
----------------------------------------------------------------------
> > > ----------
> > > DEBUG 2:
> > > DEBUG 2: Reading data for UGRD/P500.
> > > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found range
match for
> > > VarInfo "UGRD/P500" in GRIB record 137 of GRIB file
"nmbprs_d01.06".
> > > DEBUG 3: MetGrib1DataFile::rotate_winds() -> Have U-wind record,
> > > reading V-wind record.
> > > DEBUG 3: MetGrib1DataFile::data_plane_scalar() -> Found exact
match
> > > for VarInfo "UGRD/P500" in GRIB record 138 of GRIB file
> "nmbprs_d01.06".
> > > DEBUG 3: Rotating U and V wind components from grid-relative to
> > > earth-relative.
> > > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found 1 GRIB
records
> > > matching VarInfo "UGRD/P500" in GRIB file "nmbprs_d01.06".
> > > DEBUG 2: For UGRD/P500 found 1 forecast levels and 0 climatology
> levels.
> > > DEBUG 2:
> > > DEBUG 2:
> > >
----------------------------------------------------------------------
> > > ----------
> > > DEBUG 2:
> > > DEBUG 2: Reading data for VGRD/P500.
> > > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found range
match for
> > > VarInfo "VGRD/P500" in GRIB record 138 of GRIB file
"nmbprs_d01.06".
> > > DEBUG 3: MetGrib1DataFile::rotate_winds() -> Have V-wind record,
> > > reading U-wind record.
> > > DEBUG 3: MetGrib1DataFile::data_plane_scalar() -> Found exact
match
> > > for VarInfo "VGRD/P500" in GRIB record 137 of GRIB file
> "nmbprs_d01.06".
> > > DEBUG 3: Rotating U and V wind components from grid-relative to
> > > earth-relative.
> > > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found 1 GRIB
records
> > > matching VarInfo "VGRD/P500" in GRIB file "nmbprs_d01.06".
> > > DEBUG 2: For VGRD/P500 found 1 forecast levels and 0 climatology
> levels.
> > > DEBUG 2:
> > > DEBUG 2:
> > >
----------------------------------------------------------------------
> > > ----------
> > > DEBUG 2:
> > > DEBUG 2: Searching 949837 observations from 452408 messages.
> > > DEBUG 2:
> > > DEBUG 2:
> > >
----------------------------------------------------------------------
> > > ----------
> > > DEBUG 2:
> > > DEBUG 2: Processing SPFH/P500 versus SPFH/P500, for observation
type
> > > ADPUPA, over region FULL, for interpolation method NEAREST(1),
using 0
> > > pairs.
> > > DEBUG 3: Number of matched pairs = 0
> > > DEBUG 3: Observations processed = 949837
> > > DEBUG 3: Rejected: SID exclusion = 0
> > > DEBUG 3: Rejected: GRIB code = 947898
> > > DEBUG 3: Rejected: valid time = 1416
> > > DEBUG 3: Rejected: bad obs value = 0
> > > DEBUG 3: Rejected: off the grid = 523
> > > DEBUG 3: Rejected: level mismatch = 0
> > > DEBUG 3: Rejected: quality marker = 0
> > > DEBUG 3: Rejected: message type = 0
> > > DEBUG 3: Rejected: masking region = 0
> > > DEBUG 3: Rejected: bad fcst value = 0
> > > DEBUG 3: Rejected: duplicates = 0
> > > DEBUG 2:
> > > DEBUG 2:
> > >
----------------------------------------------------------------------
> > > ----------
> > > DEBUG 2:
> > > DEBUG 2: Processing TMP/P500 versus TMP/P500, for observation
type
> > > ADPUPA, over region FULL, for interpolation method NEAREST(1),
using 0
> > pairs.
> > > DEBUG 3: Number of matched pairs = 0
> > > DEBUG 3: Observations processed = 949837
> > > DEBUG 3: Rejected: SID exclusion = 0
> > > DEBUG 3: Rejected: GRIB code = 943848
> > > DEBUG 3: Rejected: valid time = 4191
> > > DEBUG 3: Rejected: bad obs value = 0
> > > DEBUG 3: Rejected: off the grid = 1798
> > > DEBUG 3: Rejected: level mismatch = 0
> > > DEBUG 3: Rejected: quality marker = 0
> > > DEBUG 3: Rejected: message type = 0
> > > DEBUG 3: Rejected: masking region = 0
> > > DEBUG 3: Rejected: bad fcst value = 0
> > > DEBUG 3: Rejected: duplicates = 0
> > > DEBUG 2:
> > > DEBUG 2:
> > >
----------------------------------------------------------------------
> > > ----------
> > > DEBUG 2:
> > > DEBUG 2: Processing HGT/P500 versus HGT/P500, for observation
type
> > > ADPUPA, over region FULL, for interpolation method NEAREST(1),
using 0
> > pairs.
> > > DEBUG 3: Number of matched pairs = 0
> > > DEBUG 3: Observations processed = 949837
> > > DEBUG 3: Rejected: SID exclusion = 0
> > > DEBUG 3: Rejected: GRIB code = 606744
> > > DEBUG 3: Rejected: valid time = 319085
> > > DEBUG 3: Rejected: bad obs value = 0
> > > DEBUG 3: Rejected: off the grid = 23610
> > > DEBUG 3: Rejected: level mismatch = 395 DEBUG 3: Rejected:
quality
> > > marker = 0
> > > DEBUG 3: Rejected: message type = 3
> > > DEBUG 3: Rejected: masking region = 0
> > > DEBUG 3: Rejected: bad fcst value = 0
> > > DEBUG 3: Rejected: duplicates = 0
> > > DEBUG 2:
> > > DEBUG 2:
> > >
----------------------------------------------------------------------
> > > ----------
> > > DEBUG 2:
> > > DEBUG 2: Processing UGRD/P500 versus UGRD/P500, for observation
type
> > > ADPUPA, over region FULL, for interpolation method NEAREST(1),
using 0
> > > pairs.
> > > DEBUG 3: Number of matched pairs = 0
> > > DEBUG 3: Observations processed = 949837
> > > DEBUG 3: Rejected: SID exclusion = 0
> > > DEBUG 3: Rejected: GRIB code = 650429
> > > DEBUG 3: Rejected: valid time = 277745
> > > DEBUG 3: Rejected: bad obs value = 0
> > > DEBUG 3: Rejected: off the grid = 21341
> > > DEBUG 3: Rejected: level mismatch = 319 DEBUG 3: Rejected:
quality
> > > marker = 0
> > > DEBUG 3: Rejected: message type = 3
> > > DEBUG 3: Rejected: masking region = 0
> > > DEBUG 3: Rejected: bad fcst value = 0
> > > DEBUG 3: Rejected: duplicates = 0
> > > DEBUG 2:
> > > DEBUG 2:
> > >
----------------------------------------------------------------------
> > > ----------
> > > DEBUG 2:
> > > DEBUG 2: Processing VGRD/P500 versus VGRD/P500, for observation
type
> > > ADPUPA, over region FULL, for interpolation method NEAREST(1),
using 0
> > > pairs.
> > > DEBUG 3: Number of matched pairs = 0
> > > DEBUG 3: Observations processed = 949837
> > > DEBUG 3: Rejected: SID exclusion = 0
> > > DEBUG 3: Rejected: GRIB code = 650429
> > > DEBUG 3: Rejected: valid time = 277745
> > > DEBUG 3: Rejected: bad obs value = 0
> > > DEBUG 3: Rejected: off the grid = 21341
> > > DEBUG 3: Rejected: level mismatch = 319 DEBUG 3: Rejected:
quality
> > > marker = 0
> > > DEBUG 3: Rejected: message type = 3
> > > DEBUG 3: Rejected: masking region = 0
> > > DEBUG 3: Rejected: bad fcst value = 0
> > > DEBUG 3: Rejected: duplicates = 0
> > > DEBUG 2:
> > > DEBUG 2:
> > >
----------------------------------------------------------------------
> > > ----------
> > > DEBUG 2:
> > > DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V.stat
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_fho.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_ctc.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_cts.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_mctc.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_mcts.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_cnt.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_sl1l2.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_sal1l2.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_vl1l2.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_val1l2.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_pct.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_pstd.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_pjc.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_prc.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_mpr.txt
> > >
> > >
> > >
> > > Best Regards,
> > > Jose
> > >
> > >
> > >
> > >
> > >
> > > -----Original Message-----
> > > From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> > > Sent: Thursday, March 17, 2016 3:29 PM
> > > To: Jose Garcia-Rivera
> > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR
to
> > > NetCDF
> > >
> > > Hello Jose,
> > >
> > > Julie is out of the office today, but I should be able to help
you.
> > > Glad you were able to finally get PB2NC working. That was a
tricky
> > > one! But it helped us realize that since BUFRLIB has changed to
> > > FORTRAN 90, we should update the MET code which calls BUFRLIB to
be
> > compatible.
> > >
> > > I see that you are now getting 0 matched pairs when you run
Point-Stat
> > > with the output of PB2NC. Please try rerunning Point-Stat but
use a
> > > higher verbosity level, like "-v 3". That'll print out the
following
> > > type of counts for each of the verification tasks you've defined
in the
> > config file:
> > >
> > > DEBUG 3: Number of matched pairs = 312
> > > DEBUG 3: Observations processed = 87753
> > > DEBUG 3: Rejected: SID exclusion = 0
> > > DEBUG 3: Rejected: GRIB code = 77648
> > > DEBUG 3: Rejected: valid time = 0
> > > DEBUG 3: Rejected: bad obs value = 0
> > > DEBUG 3: Rejected: off the grid = 5
> > > DEBUG 3: Rejected: level mismatch = 9219 DEBUG 3: Rejected:
quality
> > > marker = 0
> > > DEBUG 3: Rejected: message type = 537
> > > DEBUG 3: Rejected: masking region = 32 DEBUG 3: Rejected: bad
fcst
> > > value = 0
> > > DEBUG 3: Rejected: duplicates = 0
> > >
> > > In the example above, 87753 observation values were checked and
the
> > > counts list reasons why there were not used for that task. Out
of
> > > those 87753 obs, 312 of them were used for this task.
> > >
> > > Looking at the counts from your Point-Stat run should help you
figure
> > > out why you have 0 matched pairs.
> > >
> > > Thanks,
> > > John
> > >
> > >
> > > On Thu, Mar 17, 2016 at 12:29 PM, Jose Garcia-Rivera via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
>
> > > >
> > > > Dear Julie,
> > > >
> > > > We got the executables to work! However, I have a couple of
> > > > issues/questions:
> > > >
> > > >
> > > >
> > > > Issue #1 --- Not getting values after running point_stat
> > > >
> > > > Everything seems to run fine. I attached the configuration
file. I
> > > > can send the three files via FTP if needed.
> > > >
> > > >
> > > >
> > > > Issue #2 --- PB2NC doesn't seem to finish the job, but it
does? I
> > > > had to do CTRL+C, and checked the netCDF file using
ncl_filedump:
> > > >
> > > > [garciaj at login prepbufr_obs]$ ./pb2nc
prepbufr.gdas.20150820.t18z.nr
> > > > newtest.nc PB2NCConfig_default DEBUG 1: Default Config File:
> > > > /work/apps/pgi_14.10/SANDY/met-
5.1/share/met/config/PB2NCConfig_defa
> > > > ul t DEBUG 1: User Config File: PB2NCConfig_default
> > > > DEBUG 1: Creating NetCDF File: newtest.nc
> > > > DEBUG 1: Processing PrepBufr File:
> prepbufr.gdas.20150820.t18z.nr
> > > > DEBUG 1: Blocking PrepBufr file to:
/tmp/tmp_pb2nc_blk_17703_0
> > > > DEBUG 2: PrepBufr Time Center: 20150820_180000
> > > > DEBUG 2: Searching Time Window: 20150820_163000 to
> > > 20150820_193000
> > > > DEBUG 2: Processing 685386 PrepBufr messages...
> > > > 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80%
85%
> > > > 90% 95% 100%
> > > > DEBUG 2: Total PrepBufr Messages processed = 685386
> > > > DEBUG 2: Rejected based on message type = 0
> > > > DEBUG 2: Rejected based on station id = 0
> > > > DEBUG 2: Rejected based on valid time = 185145
> > > > DEBUG 2: Rejected based on masking grid = 0
> > > > DEBUG 2: Rejected based on masking polygon = 0
> > > > DEBUG 2: Rejected based on elevation = 0
> > > > DEBUG 2: Rejected based on pb report type = 0
> > > > DEBUG 2: Rejected based on input report type = 0
> > > > DEBUG 2: Rejected based on instrument type = 0
> > > > DEBUG 2: Rejected based on zero observations = 47833
> > > > DEBUG 2: Total PrepBufr Messages retained = 452408
> > > > DEBUG 2: Total observations retained or derived = 949837 ^C
> > > >
> > > >
> > > > Checking netCDF file:
> > > >
> > > > [garciaj at login prepbufr_obs]$ ncl_filedump newtest.nc
Copyright (C)
> > > > 1995-2015 - All Rights Reserved University Corporation for
> > > > Atmospheric Research NCAR Command Language Version 6.3.0 The
use
> > > > of this software is governed by a License Agreement.
> > > > See http://www.ncl.ucar.edu/ for more details.
> > > >
> > > > Variable: f
> > > > Type: file
> > > > filename: newtest
> > > > path: newtest.nc
> > > > file global attributes:
> > > > FileOrigins : File newtest.nc generated 20160317_155548
UTC on
> > > > host login.local by the MET pb2nc tool
> > > > MET_version : V5.1
> > > > MET_tool : pb2nc
> > > > dimensions:
> > > > mxstr = 16
> > > > hdr_arr_len = 3
> > > > obs_arr_len = 5
> > > > nobs = 949837 // unlimited
> > > > nhdr = 452408
> > > > variables:
> > > > character obs_qty ( nobs, mxstr )
> > > > long_name : quality flag
> > > >
> > > > float obs_arr ( nobs, obs_arr_len )
> > > > long_name : array of observation values
> > > > _fill_value : -9999
> > > > columns : hdr_id gc lvl hgt ob
> > > > hdr_id_long_name : index of matching header data
> > > > gc_long_name : grib code corresponding to the
observation
> type
> > > > lvl_long_name : pressure level (hPa) or
accumulation
> > > > interval (sec)
> > > > hgt_long_name : height in meters above sea
level
> (msl)
> > > > ob_long_name : observation value
> > > >
> > > > character hdr_typ ( nhdr, mxstr )
> > > > long_name : message type
> > > >
> > > > character hdr_sid ( nhdr, mxstr )
> > > > long_name : station identification
> > > >
> > > > character hdr_vld ( nhdr, mxstr )
> > > > long_name : valid time
> > > > units : YYYYMMDD_HHMMSS
> > > >
> > > > float hdr_arr ( nhdr, hdr_arr_len )
> > > > long_name : array of observation station header
values
> > > > _fill_value : -9999
> > > > columns : lat lon elv
> > > > lat_long_name : latitude
> > > > lat_units : degrees_north
> > > > lon_long_name : longitude
> > > > lon_units : degrees_east
> > > > elv_long_name : elevation
> > > > elv_units : meters above sea level (msl)
> > > >
> > > >
> > > >
> > > >
> > > > Thanks for all the help,
> > > > Jose
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > > -----Original Message-----
> > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > Sent: Wednesday, March 16, 2016 4:40 PM
> > > > To: Jose Garcia-Rivera
> > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
PREPBUFR to
> > > > NetCDF
> > > >
> > > > Hi Jose. I apologize for the delay. This was a tricky
problem to
> > > > figure out, however, we were finally able to reproduce the
error you
> > > > are receiving for pb2nc.
> > > >
> > > > The problem is BUFRLIB being compiled with pgf90 and MET being
> > > > compiled with pgf77. They aren't talking well to each other.
> > > > BUFRLIBv10.1.0 compiles with pgf77 but later versions require
pgf90.
> > > >
> > > > We will plan on updating the MET Fortran code to compile with
pgf90
> > > > so that we can use newer BUFRLIB versions, but for now, to
solve
> > > > your problem, I have attached BUFRLIB_v10-1-0.tar. Please
install
> > > > that version of BUFRLIB using pgf77 and then recompile MET
without
> > > > the "LIBS" environment variable setting?
> > > >
> > > > Please let me know how that goes. We were able to get a
successful
> > > > run using that solution and hope you will too.
> > > >
> > > > Thanks,
> > > > Julie
> > > >
> > > >
> > > > On Wed, Mar 16, 2016 at 12:17 PM, Jose Garcia-Rivera via RT <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > > >
> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> > > > >
> > > > > Dear Julie,
> > > > >
> > > > > Is there anything that we can do here to sort these issues
out?
> > > > >
> > > > > Best Regards,
> > > > > Jose
> > > > >
> > > > > -----Original Message-----
> > > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > > Sent: Tuesday, March 15, 2016 5:08 PM
> > > > > To: Jose Garcia-Rivera
> > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
PREPBUFR
> > > > > to NetCDF
> > > > >
> > > > > Hi Jose. I was not. I got the same error you did. I
believe
> > > > > that the test.nc file is not in the correct format needed by
> > > > > point_stat, so I think we need to get pb2nc working for you.
It
> > > > > is likely a communication problem between the C code and the
> Fortran
> > code.
> > > > >
> > > > > Julie
> > > > >
> > > > > On Tue, Mar 15, 2016 at 3:05 PM, Jose Garcia-Rivera via RT <
> > > > > met_help at ucar.edu> wrote:
> > > > >
> > > > > >
> > > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> > > > > >
> > > > > > Dear Julie,
> > > > > >
> > > > > > Quick question: Were you able to run point_stat with the
netCDF
> > > > > > file that I sent yesterday?
> > > > > >
> > > > > > Thanks for the help,
> > > > > > Jose
> > > > > >
> > > > > > -----Original Message-----
> > > > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > > > Sent: Tuesday, March 15, 2016 12:17 PM
> > > > > > To: Jose Garcia-Rivera
> > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
PREPBUFR
> > > > > > to NetCDF
> > > > > >
> > > > > > Thank you, Jose. I'm working with co-workers to try to
get
> > > > > > these issues resolved. I hope to get back to you soon.
> > > > > >
> > > > > > Julie
> > > > > >
> > > > > > On Mon, Mar 14, 2016 at 1:36 PM, Jose Garcia-Rivera via RT
<
> > > > > > met_help at ucar.edu> wrote:
> > > > > >
> > > > > > >
> > > > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > > > >
> > > > > > >
> > > > > > > Dear Julie,
> > > > > > >
> > > > > > > I just uploaded the three files to 'garcia_data'.
> > > > > > >
> > > > > > > Thanks for the help,
> > > > > > > Jose
> > > > > > >
> > > > > > >
> > > > > > > -----Original Message-----
> > > > > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > > > > Sent: Monday, March 14, 2016 3:32 PM
> > > > > > > To: Jose Garcia-Rivera
> > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
> > > > > > > PREPBUFR to NetCDF
> > > > > > >
> > > > > > > Hi Jose.
> > > > > > >
> > > > > > > Yes, please upload your input files and configuration
file
> > > > > > > (nmbprs_d01.06, test.nc, PointStatConfig_default) to our
> > > > > > > anonymous ftp
> > > > > > site as follows:
> > > > > > > http://www.dtcenter.org/met/users/support/met_help.php
> > > > > > >
> > > > > > > Thanks!
> > > > > > >
> > > > > > > Julie
> > > > > > >
> > > > > > > On Mon, Mar 14, 2016 at 1:06 PM, Jose Garcia-Rivera via
RT <
> > > > > > > met_help at ucar.edu> wrote:
> > > > > > >
> > > > > > > >
> > > > > > > > <URL:
> > > > > > > >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > > > > >
> > > > > > > >
> > > > > > > > Dear Julie,
> > > > > > > >
> > > > > > > > I got to convert my prepbufr file using a python
script.
> > > > > > > > However, I have trouble running point_stat. Can I send
you
> > > > > > > > the files, to see if you have the same issue?
> > > > > > > >
> > > > > > > >
> > > > > > > > This is what I got:
> > > > > > > >
> > > > > > > > [garciaj at login prepbufr_obs]$ ./point_stat
nmbprs_d01.06
> > > > > > > > test.nc PointStatConfig_default DEBUG 1: Default
Config
> File:
> > > > > > > > /work/apps/pgi_14.10/SANDY/met-
5.1/share/met/config/PointSta
> > > > > > > > tC on fi g_ de fault DEBUG 1: User Config File:
> > > > > > > > PointStatConfig_default
> > > > > > > > GSL_RNG_TYPE=mt19937
> > > > > > > > GSL_RNG_SEED=18446744073425053526 DEBUG 1: Forecast
File:
> > > > > > > > nmbprs_d01.06 DEBUG 1: Observation File:
> > > > > > > > test.nc DEBUG 2:
> > > > > > > > DEBUG 2:
> > > > > > > >
------------------------------------------------------------
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > ----------
> > > > > > > > DEBUG 2:
> > > > > > > > DEBUG 2: Reading data for SPFH/P500.
> > > > > > > > DEBUG 2: For SPFH/P500 found 1 forecast levels and 0
> > > > > > > > climatology
> > > > > > levels.
> > > > > > > > DEBUG 2:
> > > > > > > > DEBUG 2:
> > > > > > > >
------------------------------------------------------------
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > ----------
> > > > > > > > DEBUG 2:
> > > > > > > > DEBUG 2: Reading data for TMP/P500.
> > > > > > > > DEBUG 2: For TMP/P500 found 1 forecast levels and 0
> > > > > > > > climatology
> > > > > levels.
> > > > > > > > DEBUG 2:
> > > > > > > > DEBUG 2:
> > > > > > > >
------------------------------------------------------------
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > ----------
> > > > > > > > DEBUG 2:
> > > > > > > > DEBUG 2: Reading data for HGT/P500.
> > > > > > > > DEBUG 2: For HGT/P500 found 1 forecast levels and 0
> > > > > > > > climatology
> > > > > levels.
> > > > > > > > DEBUG 2:
> > > > > > > > DEBUG 2:
> > > > > > > >
------------------------------------------------------------
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > ----------
> > > > > > > > DEBUG 2:
> > > > > > > > DEBUG 2: Reading data for UGRD/P500.
> > > > > > > > DEBUG 2: For UGRD/P500 found 1 forecast levels and 0
> > > > > > > > climatology
> > > > > > levels.
> > > > > > > > DEBUG 2:
> > > > > > > > DEBUG 2:
> > > > > > > >
------------------------------------------------------------
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > ----------
> > > > > > > > DEBUG 2:
> > > > > > > > DEBUG 2: Reading data for VGRD/P500.
> > > > > > > > DEBUG 2: For VGRD/P500 found 1 forecast levels and 0
> > > > > > > > climatology
> > > > > > levels.
> > > > > > > > DEBUG 2:
> > > > > > > > DEBUG 2:
> > > > > > > >
------------------------------------------------------------
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > ----------
> > > > > > > > DEBUG 2:
> > > > > > > > WARNING:
> > > > > > > > WARNING: process_obs_file() -> can't open observation
netCDF
> > > file:
> > > > > > > > test.nc
> > > > > > > > WARNING:
> > > > > > > > DEBUG 2:
> > > > > > > > DEBUG 2:
> > > > > > > >
------------------------------------------------------------
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > ----------
> > > > > > > > DEBUG 2:
> > > > > > > > DEBUG 2: Processing SPFH/P500 versus SPFH/P500, for
> > > > > > > > observation type ADPUPA, over region FULL, for
interpolation
> > > > > > > > method NEAREST(1), using
> > > > > > > > 0 pairs.
> > > > > > > > DEBUG 2:
> > > > > > > > DEBUG 2:
> > > > > > > >
------------------------------------------------------------
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > ----------
> > > > > > > > DEBUG 2:
> > > > > > > > DEBUG 2: Processing TMP/P500 versus TMP/P500, for
> > > > > > > > observation type ADPUPA, over region FULL, for
interpolation
> > > > > > > > method NEAREST(1), using
> > > > > > > > 0
> > > > > > > pairs.
> > > > > > > > DEBUG 2:
> > > > > > > > DEBUG 2:
> > > > > > > >
------------------------------------------------------------
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > ----------
> > > > > > > > DEBUG 2:
> > > > > > > > DEBUG 2: Processing HGT/P500 versus HGT/P500, for
> > > > > > > > observation type ADPUPA, over region FULL, for
interpolation
> > > > > > > > method NEAREST(1), using
> > > > > > > > 0
> > > > > > > pairs.
> > > > > > > > DEBUG 2:
> > > > > > > > DEBUG 2:
> > > > > > > >
------------------------------------------------------------
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > ----------
> > > > > > > > DEBUG 2:
> > > > > > > > DEBUG 2: Processing UGRD/P500 versus UGRD/P500, for
> > > > > > > > observation type ADPUPA, over region FULL, for
interpolation
> > > > > > > > method NEAREST(1), using
> > > > > > > > 0 pairs.
> > > > > > > > DEBUG 2:
> > > > > > > > DEBUG 2:
> > > > > > > >
------------------------------------------------------------
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > ----------
> > > > > > > > DEBUG 2:
> > > > > > > > DEBUG 2: Processing VGRD/P500 versus VGRD/P500, for
> > > > > > > > observation type ADPUPA, over region FULL, for
interpolation
> > > > > > > > method NEAREST(1), using
> > > > > > > > 0 pairs.
> > > > > > > > DEBUG 2:
> > > > > > > > DEBUG 2:
> > > > > > > >
------------------------------------------------------------
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > ----------
> > > > > > > > DEBUG 2:
> > > > > > > > DEBUG 1: Output file:
> > > > > > > > ./point_stat_060000L_20150820_180000V.stat
> > > > > > > > DEBUG 1: Output file:
> > > > > > > > ./point_stat_060000L_20150820_180000V_fho.txt
> > > > > > > > DEBUG 1: Output file:
> > > > > > > > ./point_stat_060000L_20150820_180000V_ctc.txt
> > > > > > > > DEBUG 1: Output file:
> > > > > > > > ./point_stat_060000L_20150820_180000V_cts.txt
> > > > > > > > DEBUG 1: Output file:
> > > > > > > > ./point_stat_060000L_20150820_180000V_mctc.txt
> > > > > > > > DEBUG 1: Output file:
> > > > > > > > ./point_stat_060000L_20150820_180000V_mcts.txt
> > > > > > > > DEBUG 1: Output file:
> > > > > > > > ./point_stat_060000L_20150820_180000V_cnt.txt
> > > > > > > > DEBUG 1: Output file:
> > > > > > > > ./point_stat_060000L_20150820_180000V_sl1l2.txt
> > > > > > > > DEBUG 1: Output file:
> > > > > > > > ./point_stat_060000L_20150820_180000V_sal1l2.txt
> > > > > > > > DEBUG 1: Output file:
> > > > > > > > ./point_stat_060000L_20150820_180000V_vl1l2.txt
> > > > > > > > DEBUG 1: Output file:
> > > > > > > > ./point_stat_060000L_20150820_180000V_val1l2.txt
> > > > > > > > DEBUG 1: Output file:
> > > > > > > > ./point_stat_060000L_20150820_180000V_pct.txt
> > > > > > > > DEBUG 1: Output file:
> > > > > > > > ./point_stat_060000L_20150820_180000V_pstd.txt
> > > > > > > > DEBUG 1: Output file:
> > > > > > > > ./point_stat_060000L_20150820_180000V_pjc.txt
> > > > > > > > DEBUG 1: Output file:
> > > > > > > > ./point_stat_060000L_20150820_180000V_prc.txt
> > > > > > > > DEBUG 1: Output file:
> > > > > > > > ./point_stat_060000L_20150820_180000V_mpr.txt
> > > > > > > >
> > > > > > > >
> > > > > > > > Thanks for the help,
> > > > > > > > Jose
> > > > > > > >
> > > > > > > >
> > > > > > > > -----Original Message-----
> > > > > > > > From: Julie Prestopnik via RT
[mailto:met_help at ucar.edu]
> > > > > > > > Sent: Monday, March 14, 2016 12:17 PM
> > > > > > > > To: Jose Garcia-Rivera
> > > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues
converting
> > > > > > > > PREPBUFR to NetCDF
> > > > > > > >
> > > > > > > > Hi Jose. I apologize for the delayed response. I was
out
> > > > > > > > of the office on Friday. I'm going to try to figure
out a
> > > > > > > > solution and get back with you shortly.
> > > > > > > >
> > > > > > > > Julie
> > > > > > > >
> > > > > > > > On Fri, Mar 11, 2016 at 2:02 PM, Jose Garcia-Rivera
via RT <
> > > > > > > > met_help at ucar.edu> wrote:
> > > > > > > >
> > > > > > > > >
> > > > > > > > > <URL:
> > > > > > > > >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > > > > > >
> > > > > > > > >
> > > > > > > > > Dear Julie,
> > > > > > > > >
> > > > > > > > > Any news regarding pb2nc? We're still unable to make
it
> work.
> > > > > > > > >
> > > > > > > > > Best Regards,
> > > > > > > > > Jose
> > > > > > > > >
> > > > > > > > > -----Original Message-----
> > > > > > > > > From: Julie Prestopnik via RT
[mailto:met_help at ucar.edu]
> > > > > > > > > Sent: Thursday, March 10, 2016 4:20 PM
> > > > > > > > > To: Jose Garcia-Rivera
> > > > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues
converting
> > > > > > > > > PREPBUFR to NetCDF
> > > > > > > > >
> > > > > > > > > Hi Jose. Thank you for attaching the files.
> > > > > > > > >
> > > > > > > > > Could you please send me a list of the files in
> > > > > > > > > /work/apps/pgi_14.10/SANDY/bufrlib/lib?
> > > > > > > > >
> > > > > > > > > Thank you!
> > > > > > > > >
> > > > > > > > > Julie
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > On Thu, Mar 10, 2016 at 12:20 PM, Jose Garcia-Rivera
via
> > > > > > > > > RT < met_help at ucar.edu> wrote:
> > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > <URL:
> > > > > > > > > >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > Dear Julie,
> > > > > > > > > >
> > > > > > > > > > The administrator re-compiled MET following your
> > > > > > > > > > instructions, and says there's still trouble. He
sent me
> > > > > > > > > > the log files
> > > > > > (attached).
> > > > > > > > > > Is there any other approach that might help?
> > > > > > > > > >
> > > > > > > > > > Best Regards,
> > > > > > > > > > Jose
> > > > > > > > > >
> > > > > > > > > > -----Original Message-----
> > > > > > > > > > From: Julie Prestopnik via RT
[mailto:met_help at ucar.edu]
> > > > > > > > > > Sent: Wednesday, March 09, 2016 12:39 PM
> > > > > > > > > > To: Jose Garcia-Rivera
> > > > > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues
converting
> > > > > > > > > > PREPBUFR to NetCDF
> > > > > > > > > >
> > > > > > > > > > Thank you, Jose! It looks like something went
wrong
> > > > > > > > > > during
> > > > > > > > compilation.
> > > > > > > > > > I suggest recompiling MET to see if we can get
this
> > > > > > > > > > issue
> > > > > resolved.
> > > > > > > > > > NCEP's BUFRLIB is used by the pb2nc MET tool, and
is a
> > > > > > > > > > required external library for pb2nc. MET is not
yet
> > > > > > > > > > compatible with BUFRLIB
> > > > > > > > > version 11.0.0, so we
> > > > > > > > > > suggest getting version 10.2.3. We are working
on our
> > > online
> > > > > > > tutorial
> > > > > > > > > for
> > > > > > > > > > METv.5.1, but in the meantime, I'll point you to
our
> > > > > > > > > > online tutorial directions for installing BUFRLIB:
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > >
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.
> > > > > > > > > > 0/
> > > > > > > > > > co
> > > > > > > > > > mp
> > > > > > > > > > ilation/req_libs.php
> > > > > > > > > >
> > > > > > > > > > It is also important to review the necessary
environment
> > > > > > > > > > variables to
> > > > > > > > > set:
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > >
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.
> > > > > > > > > > 0/
> > > > > > > > > > co
> > > > > > > > > > mp
> > > > > > > > > > ilation/configure.php
> > > > > > > > > >
> > > > > > > > > > For example,
> > > > > > > > > >
> > > > > > > > > > "Set *$MET_BUFR* to point to the main BUFR
directory, or
> > > > > > > > > > set
> > > > > > > > > > *$MET_BUFRLIB* to point to the directory with the
BUFR
> > > > > > > > > > library
> > > > > > files.
> > > > > > > > > > Because MET doesn't use any BUFR library include
files,
> > > > > > > > > > you don't need to specify *$MET_BUFRINC* ."
> > > > > > > > > >
> > > > > > > > > > Once you've installed the required libraries and
set up
> > > > > > > > > > your environment variables, you'll be ready to
configure
> > > > > > > > > > MET (instructions at the bottom of the last link
above)
> > > > > > > > > > and then compile and install MET (
> > > > > > > > > >
> > > >
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.
> > > > > > > > > > 0/
> > > > > > > > > > co
> > > > > > > > > > mp
> > > > > > > > > > ilation/compile.php
> > > > > > > > > > ).
> > > > > > > > > > After re-installing MET, please run "make test"
again.
> > > > > > > > > > If you still encounter the same problem, please
send me
> > > > > > > > > > your
> > > > > > > > > > *config.log* file and your *make_install.log
*file.
> > > > > > > > > > Please let me know if you have any
> > > > > > > > > questions.
> > > > > > > > > >
> > > > > > > > > > Please let us know how it goes.
> > > > > > > > > >
> > > > > > > > > > Thanks,
> > > > > > > > > > Julie
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > On Wed, Mar 9, 2016 at 10:22 AM, Jose Garcia-
Rivera via
> > > > > > > > > > RT < met_help at ucar.edu> wrote:
> > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > <URL:
> > > > > > > > > > >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=7543
> > > > > > > > > > > 3
> > > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > Dear Julie,
> > > > > > > > > > >
> > > > > > > > > > > Attached is the test log file. It's showing the
same
> > > > > > > > > > > issues on pb2nc even with the sample files.
> > > > > > > > > > >
> > > > > > > > > > > Best Regards,
> > > > > > > > > > > Jose
> > > > > > > > > > >
> > > > > > > > > > > -----Original Message-----
> > > > > > > > > > > From: Julie Prestopnik via RT
> > > > > > > > > > > [mailto:met_help at ucar.edu]
> > > > > > > > > > > Sent: Tuesday, March 08, 2016 5:28 PM
> > > > > > > > > > > To: Jose Garcia-Rivera
> > > > > > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues
> > > > > > > > > > > converting PREPBUFR to NetCDF
> > > > > > > > > > >
> > > > > > > > > > > Hi Jose. Thank you for uploading the files.
> > > > > > > > > > > Unfortunately, I am unable to reproduce the
error you
> > > > > > > > > > > are experiencing. I am wondering if you have
> > > > > > > > > > > successfully used pb2nc before. As a check
could you
> > > > > > > > > > > please run the following in your met-5.1/
> > > > > > > directory:
> > > > > > > > > > >
> > > > > > > > > > > *make test >& make_test.log*
> > > > > > > > > > >
> > > > > > > > > > > and then send me the make_test.log file?
> > > > > > > > > > >
> > > > > > > > > > > Thanks,
> > > > > > > > > > > Julie
> > > > > > > > > > >
> > > > > > > > > > > On Tue, Mar 8, 2016 at 11:29 AM, Jose Garcia-
Rivera
> > > > > > > > > > > via RT < met_help at ucar.edu> wrote:
> > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > <URL:
> > > > > > > > > > > >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75
> > > > > > > > > > > > 43
> > > > > > > > > > > > 3
> > > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > Dear Julie,
> > > > > > > > > > > >
> > > > > > > > > > > > I just put the files in 'garcia_data'. I
appreciate
> > > > > > > > > > > > your
> > > > > help.
> > > > > > > > > > > >
> > > > > > > > > > > > Best Regards,
> > > > > > > > > > > > Jose
> > > > > > > > > > > >
> > > > > > > > > > > > -----Original Message-----
> > > > > > > > > > > > From: Julie Prestopnik via RT
> > > > > > > > > > > > [mailto:met_help at ucar.edu]
> > > > > > > > > > > > Sent: Tuesday, March 08, 2016 1:12 PM
> > > > > > > > > > > > To: Jose Garcia-Rivera
> > > > > > > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues
> > > > > > > > > > > > converting PREPBUFR to NetCDF
> > > > > > > > > > > >
> > > > > > > > > > > > Hi Jose. I'm sorry to hear that you are having
> > > > > > > > > > > > problems converting a PREPBUFR file to NetCDF.
> > > > > > > > > > > >
> > > > > > > > > > > > Please upload your input files and
configuration
> > > > > > > > > > > > file to our anonymous ftp site as follows:
> > > > > > > > > > > >
http://www.dtcenter.org/met/users/support/met_help.p
> > > > > > > > > > > > hp
> > > > > > > > > > > >
> > > > > > > > > > > > Then I can take a look and get back to you.
> > > > > > > > > > > >
> > > > > > > > > > > > Thanks,
> > > > > > > > > > > > Julie
> > > > > > > > > > > >
> > > > > > > > > > > > On Tue, Mar 8, 2016 at 11:01 AM, Jose Garcia-
Rivera
> > > > > > > > > > > > via RT < met_help at ucar.edu> wrote:
> > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > > Tue Mar 08 11:01:25 2016: Request 75433 was
acted
> > upon.
> > > > > > > > > > > > > Transaction: Ticket created by
GarciaJ at imsg.com
> > > > > > > > > > > > > Queue: met_help
> > > > > > > > > > > > > Subject: Issues converting PREPBUFR to
NetCDF
> > > > > > > > > > > > > Owner: Nobody
> > > > > > > > > > > > > Requestors: GarciaJ at imsg.com
> > > > > > > > > > > > > Status: new
> > > > > > > > > > > > > Ticket <URL:
> > > > > > > > > > > > >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=
> > > > > > > > > > > > > 75
> > > > > > > > > > > > > 43
> > > > > > > > > > > > > 3
> > > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > > Dear Met Help,
> > > > > > > > > > > > >
> > > > > > > > > > > > > Trying to convert a PREPBUFR file to NetCDF.
> > > > > > > > > > > > >
> > > > > > > > > > > > > I used the default PB2NC configure file, and
got
> > > > > > > > > > > > > the
> > > > > > following:
> > > > > > > > > > > > >
> > > > > > > > > > > > > [garciaj at login prepbufr_obs]$ ./pb2nc
> > > > > > > > > > > > > gdas1.t12z.prepbufr.nr gdas.20150820.t12z.nc
> > > > > > > > > > > > > PB2NCConfig_default DEBUG 1: Default Config
> > > > > > > > > > > > > File:
> > > > > > > > > > > > > /work/apps/pgi_14.10/met-
5.1/share/met/config/PB2N
> > > > > > > > > > > > > CC on fi g_ de fa ul t DEBUG 1: User Config
File:
> > > > > > > > > > > > > PB2NCConfig_default DEBUG 1: Creating NetCDF
File:
> > > > > > gdas.20150820.t12z.nc
> > > > > > > > > > > > > DEBUG 1: Processing PrepBufr File:
> > > > > > gdas1.t12z.prepbufr.nr
> > > > > > > > > > > > > DEBUG 1: Blocking PrepBufr file to:
> > > > > > > > /tmp/tmp_pb2nc_blk_32144_0
> > > > > > > > > > > > > WARNING:
> > > > > > > > > > > > > WARNING: process_pbfile() -> No PrepBufr
messages
> > > > > > > > > > > > > to process in
> > > > > > > > > file:
> > > > > > > > > > > > > gdas1.t12z.prepbufr.nr
> > > > > > > > > > > > > WARNING:
> > > > > > > > > > > > > ERROR :
> > > > > > > > > > > > > ERROR : write_netcdf_hdr_data() -> No
PrepBufr
> > > > > > > > > > > > > messages
> > > > > > > > retained.
> > > > > > > > > > > > > Nothing to write.
> > > > > > > > > > > > > ERROR :
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > > Thanks in advance for the help, Jose M.
> > > > > > > > > > > > > Garcia-Rivera, PhD IM Systems Group
> > > > > > > > > > > > > Rockville/College Park, MD This e-mail,
including
> > > > > > > > > > > > > attachments, may include confidential and/or
> > > > > > > > > > > > > proprietary information, and may be used
only by
> > > > > > > > > > > > > the person or entity to which it is
addressed. If
> > > > > > > > > > > > > the reader of this e-mail is not the
intended
> > > > > > > > > > > > > recipient or his or her authorized agent,
the
> > > > > > > > > > > > > reader is hereby notified that any
dissemination,
> > > > > > > > > > > > > distribution or
> > > copying of this e-mail is prohibited.
> > > > > > > > > > > > > If you have received this e-mail in error,
please
> > > > > > > > > > > > > notify the sender by replying to this
message and
> > > > > > > > > > > > > delete this
> > > > > > > > > > > > e-mail immediately.
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > --
> > > > > > > > > > > > Julie Prestopnik
> > > > > > > > > > > > National Center for Atmospheric Research
Research
> > > > > > > > > > > > Applications Laboratory
> > > > > > > > > > > > Phone: 303.497.8399
> > > > > > > > > > > > Email: jpresto at ucar.edu
> > > > > > > > > > > >
> > > > > > > > > > > > This e-mail, including attachments, may
include
> > > > > > > > > > > > confidential and/or proprietary information,
and may
> > > > > > > > > > > > be used only by the person or entity to which
it is
> > > > > > > > > > > > addressed. If the reader of this e-mail is not
the
> > > > > > > > > > > > intended recipient or his or her authorized
agent,
> > > > > > > > > > > > the reader is hereby notified that any
> > > > > > > > > > > > dissemination, distribution or copying of this
e-mail
> > is prohibited.
> > > > > > > > > > > > If you have received this e-mail in error,
please
> > > > > > > > > > > > notify the sender by replying to this message
and
> > > > > > > > > > > > delete this
> > > > > > > > > > > e-mail immediately.
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > --
> > > > > > > > > > > Julie Prestopnik
> > > > > > > > > > > National Center for Atmospheric Research
Research
> > > > > > > > > > > Applications Laboratory
> > > > > > > > > > > Phone: 303.497.8399
> > > > > > > > > > > Email: jpresto at ucar.edu
> > > > > > > > > > >
> > > > > > > > > > > This e-mail, including attachments, may include
> > > > > > > > > > > confidential and/or proprietary information, and
may
> > > > > > > > > > > be used only by the person or entity to which it
is
> > > > > > > > > > > addressed. If the reader of this e-mail is not
the
> > > > > > > > > > > intended recipient or his or her authorized
agent, the
> > > > > > > > > > > reader is hereby notified that any
dissemination,
> > > > > > > > > > > distribution or copying of this e-mail is
prohibited.
> > > > > > > > > > > If you have received this e-mail in error,
please
> > > > > > > > > > > notify the sender by replying to this message
and
> > > > > > > > > > > delete this
> > > > > > > > > > e-mail immediately.
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > --
> > > > > > > > > > Julie Prestopnik
> > > > > > > > > > National Center for Atmospheric Research Research
> > > > > > > > > > Applications Laboratory
> > > > > > > > > > Phone: 303.497.8399
> > > > > > > > > > Email: jpresto at ucar.edu
> > > > > > > > > >
> > > > > > > > > > This e-mail, including attachments, may include
> > > > > > > > > > confidential and/or proprietary information, and
may be
> > > > > > > > > > used only by the person or entity to which it is
> > > > > > > > > > addressed. If the reader of this e-mail is not the
> > > > > > > > > > intended recipient or his or her authorized agent,
the
> > > > > > > > > > reader is hereby notified that any dissemination,
> > > > > > > > > > distribution or copying of this e-mail is
prohibited. If
> > > > > > > > > > you have received this e-mail in error, please
notify
> > > > > > > > > > the sender by replying to this message and delete
this
> > > > > > > > > e-mail immediately.
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > --
> > > > > > > > > Julie Prestopnik
> > > > > > > > > National Center for Atmospheric Research Research
> > > > > > > > > Applications Laboratory
> > > > > > > > > Phone: 303.497.8399
> > > > > > > > > Email: jpresto at ucar.edu
> > > > > > > > >
> > > > > > > > > This e-mail, including attachments, may include
> > > > > > > > > confidential and/or proprietary information, and may
be
> > > > > > > > > used only by the person or entity to which it is
> > > > > > > > > addressed. If the reader of this e-mail is not the
> > > > > > > > > intended recipient or his or her authorized agent,
the
> > > > > > > > > reader is hereby notified that any dissemination,
> > > > > > > > > distribution or copying of this e-mail is
prohibited. If
> > > > > > > > > you have received this e-mail in error, please
notify the
> > > > > > > > > sender by replying to this message and delete this
> > > > > > > > e-mail immediately.
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > --
> > > > > > > > Julie Prestopnik
> > > > > > > > National Center for Atmospheric Research Research
> > > > > > > > Applications Laboratory
> > > > > > > > Phone: 303.497.8399
> > > > > > > > Email: jpresto at ucar.edu
> > > > > > > >
> > > > > > > > This e-mail, including attachments, may include
confidential
> > > > > > > > and/or proprietary information, and may be used only
by the
> > > > > > > > person or entity to which it is addressed. If the
reader of
> > > > > > > > this e-mail is not the intended recipient or his or
her
> > > > > > > > authorized agent, the reader is hereby notified that
any
> > > > > > > > dissemination, distribution or copying of this e-mail
is
> > > > > > > > prohibited. If you have received this e-mail in error,
> > > > > > > > please notify the sender by replying to this message
and
> > > > > > > > delete this
> > > > > > > e-mail immediately.
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > --
> > > > > > > Julie Prestopnik
> > > > > > > National Center for Atmospheric Research Research
Applications
> > > > > > > Laboratory
> > > > > > > Phone: 303.497.8399
> > > > > > > Email: jpresto at ucar.edu
> > > > > > >
> > > > > > > This e-mail, including attachments, may include
confidential
> > > > > > > and/or proprietary information, and may be used only by
the
> > > > > > > person or entity to which it is addressed. If the reader
of
> > > > > > > this e-mail is not the intended recipient or his or her
> > > > > > > authorized agent, the reader is hereby notified that any
> > > > > > > dissemination, distribution or copying of this e-mail is
> > > > > > > prohibited. If you have received this e-mail in error,
please
> > > > > > > notify the sender by replying to this message and delete
this
> > > > > > e-mail immediately.
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > >
> > > > > >
> > > > > > --
> > > > > > Julie Prestopnik
> > > > > > National Center for Atmospheric Research Research
Applications
> > > > > > Laboratory
> > > > > > Phone: 303.497.8399
> > > > > > Email: jpresto at ucar.edu
> > > > > >
> > > > > > This e-mail, including attachments, may include
confidential
> > > > > > and/or proprietary information, and may be used only by
the
> > > > > > person or entity to which it is addressed. If the reader
of this
> > > > > > e-mail is not the intended recipient or his or her
authorized
> > > > > > agent, the reader is hereby notified that any
dissemination,
> > > > > > distribution or copying of this e-mail is prohibited. If
you
> > > > > > have received this e-mail in error, please notify the
sender by
> > > > > > replying to this message and delete this
> > > > > e-mail immediately.
> > > > > >
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > > > --
> > > > > Julie Prestopnik
> > > > > National Center for Atmospheric Research Research
Applications
> > > > > Laboratory
> > > > > Phone: 303.497.8399
> > > > > Email: jpresto at ucar.edu
> > > > >
> > > > > This e-mail, including attachments, may include confidential
> > > > > and/or proprietary information, and may be used only by the
person
> > > > > or entity to which it is addressed. If the reader of this e-
mail
> > > > > is not the intended recipient or his or her authorized
agent, the
> > > > > reader is hereby notified that any dissemination,
distribution or
> > > > > copying of this e-mail is prohibited. If you have received
this
> > > > > e-mail in error, please notify the sender by replying to
this
> > > > > message and delete this
> > > > e-mail immediately.
> > > > >
> > > > >
> > > > >
> > > >
> > > >
> > > > --
> > > > Julie Prestopnik
> > > > National Center for Atmospheric Research Research Applications
> > > > Laboratory
> > > > Phone: 303.497.8399
> > > > Email: jpresto at ucar.edu
> > > >
> > > > This e-mail, including attachments, may include confidential
and/or
> > > > proprietary information, and may be used only by the person or
> > > > entity to which it is addressed. If the reader of this e-mail
is not
> > > > the intended recipient or his or her authorized agent, the
reader is
> > > > hereby notified that any dissemination, distribution or
copying of
> > > > this e-mail is prohibited. If you have received this e-mail in
> > > > error, please notify the sender by replying to this message
and
> > > > delete this
> > > e-mail immediately.
> > > >
> > > >
> > >
> > > This e-mail, including attachments, may include confidential
and/or
> > > proprietary information, and may be used only by the person or
entity
> > > to which it is addressed. If the reader of this e-mail is not
the
> > > intended recipient or his or her authorized agent, the reader is
> > > hereby notified that any dissemination, distribution or copying
of
> > > this e-mail is prohibited. If you have received this e-mail in
error,
> > > please notify the sender by replying to this message and delete
this
> > e-mail immediately.
> > >
> > >
> > >
> >
> > This e-mail, including attachments, may include confidential
and/or
> > proprietary information, and may be used only by the person or
entity to
> > which it is addressed. If the reader of this e-mail is not the
intended
> > recipient or his or her authorized agent, the reader is hereby
notified
> > that any dissemination, distribution or copying of this e-mail is
> > prohibited. If you have received this e-mail in error, please
notify the
> > sender by replying to this message and delete this e-mail
immediately.
> >
> >
> >
>
> This e-mail, including attachments, may include confidential and/or
> proprietary information, and may be used only by the person or
entity to
> which it is addressed. If the reader of this e-mail is not the
intended
> recipient or his or her authorized agent, the reader is hereby
notified
> that any dissemination, distribution or copying of this e-mail is
> prohibited. If you have received this e-mail in error, please notify
the
> sender by replying to this message and delete this e-mail
immediately.
>
>
>
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to NetCDF
From: Jose Garcia-Rivera
Time: Fri Mar 18 14:21:23 2016
Dear John,
Thank you so much. I'll let you know how it went with your file
running point_stat.
Quick question:
Is there a way of me specifying any specific grid or region when
running pb2nc? I ask because I can use my own model output grid. For
example:
255 3 400 400 33302 -84951 8 -77459 3317 2970 0 64 38947
38947 44033 -68740
I ask, because we are going to have a domain over Asia.
Best Regards,
Jose
-----Original Message-----
From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
Sent: Friday, March 18, 2016 4:08 PM
To: Jose Garcia-Rivera
Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to
NetCDF
Jose,
Ah OK, I suspect that exiting the PB2NC command early is the problem.
While PB2NC did create an output file, you probably killed it before
it
finished writing out all the observations.
This same issue actually came up recently when running on the NCAR
supercomputer, Yellowstone. PB2NC finishes processing the
observations in
a few minutes, but takes multiple hours to write the output NetCDF
file.
The same step takes about 2 seconds on my desktop machine, but 2 hours
on
Yellowstone! So that's an open issue we need to investigate further.
For your needs, please do the following:
(1) I posted my PB2NC output file to our ftp site:
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/for_garcia/gdas1.t18z.prepbufr.nc
Please grab it and verify that when you use it in your Point-Stat
runs, you
actually do get matched pairs.
(2) Try rerunning PB2NC yourself, but this time set the following in
your
PB2NC config file:
mask = "G212";
That will filter the observations and only keep the ones which fall
within
this pre-defined NCEP Grid:
http://www.nco.ncep.noaa.gov/pmb/docs/on388/grids/grid212.gif
That should result in 293763 observations instead of 1330661 of them.
Perhaps PB2NC will run in a more reasonable time.
But in the long run of course, we'll need to figure out why PB2NC is
so
slow and fix it!
Thanks,
John
(2)
On Fri, Mar 18, 2016 at 12:58 PM, Jose Garcia-Rivera via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
>
> Dear John,
>
> I modified the config file for pb2nc, and still have the same issue.
I
> uploaded these two files to 'garcia_data'
>
> 3km_nmbprs_d01.06
> newtest.nc
>
> I don’t need to change the quality flag in the point_stat
configuration
> file, right?
>
> One extra thing to mention: I had to type CNTL+C to exit pb2nc,
since it
> seemed to stay stuck on a loop,,, yet I got the netcdf file. This
happened
> every time:
>
> [garciaj at login prepbufr_obs]$ ./pb2nc gdas1.t18z.prepbufr.nr
newtest.nc
> PB2NCConfig_default
> DEBUG 1: Default Config File:
> /work/apps/pgi_14.10/SANDY/met-
5.1/share/met/config/PB2NCConfig_default
> DEBUG 1: User Config File: PB2NCConfig_default
> DEBUG 1: Creating NetCDF File: newtest.nc
> DEBUG 1: Processing PrepBufr File: gdas1.t18z.prepbufr.nr
> DEBUG 1: Blocking PrepBufr file to: /tmp/tmp_pb2nc_blk_50363_0
> DEBUG 2: PrepBufr Time Center: 20150820_180000
> DEBUG 2: Searching Time Window: 20150820_163000 to
20150820_193000
> DEBUG 2: Processing 685386 PrepBufr messages...
> 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85%
90% 95%
> 100%
> DEBUG 2: Total PrepBufr Messages processed = 685386
> DEBUG 2: Rejected based on message type = 0
> DEBUG 2: Rejected based on station id = 0
> DEBUG 2: Rejected based on valid time = 185145
> DEBUG 2: Rejected based on masking grid = 0
> DEBUG 2: Rejected based on masking polygon = 0
> DEBUG 2: Rejected based on elevation = 0
> DEBUG 2: Rejected based on pb report type = 0
> DEBUG 2: Rejected based on input report type = 0
> DEBUG 2: Rejected based on instrument type = 0
> DEBUG 2: Rejected based on zero observations = 11135
> DEBUG 2: Total PrepBufr Messages retained = 489106
> DEBUG 2: Total observations retained or derived = 1330661
>
> ^C
>
>
>
> Thanks for the help,
> Jose
>
> -----Original Message-----
> From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> Sent: Friday, March 18, 2016 1:01 PM
> To: Jose Garcia-Rivera
> Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to
NetCDF
>
> Jose,
>
> Thanks for sending the test data. I see that your model data is
valid at
> time 20150820_180000. When I run Point-Stat, I see the following
reason
> counts in the output:
>
> DEBUG 2: Processing TMP/Z2 versus TMP/Z2, for observation type
ADPSFC, over
> region FULL, for interpolation method NEAREST(1), using 0 pairs.
> DEBUG 3: Number of matched pairs = 0
> DEBUG 3: Observations processed = 949837
> DEBUG 3: Rejected: SID exclusion = 0
> DEBUG 3: Rejected: GRIB code = 943848
> DEBUG 3: Rejected: valid time = 4191
> DEBUG 3: Rejected: bad obs value = 0
> DEBUG 3: Rejected: off the grid = 1798
> DEBUG 3: Rejected: level mismatch = 0
> DEBUG 3: Rejected: quality marker = 0
> DEBUG 3: Rejected: message type = 0
> DEBUG 3: Rejected: masking region = 0
> DEBUG 3: Rejected: bad fcst value = 0
> DEBUG 3: Rejected: duplicates = 0
>
> So it looks like several observations are not used for either the
valid
> time or being off the grid. Let's look at where these temperature
exist.
> I ran the following command to plot their location:
> met-5.1/bin/plot_point_obs newtest.nc newtest.ps -gc 11 -v 3
>
> The "-gc 11" option says only plot temperature. The resulting image
is
> attached. Notice that none of them fall within your East Coast
domain.
> Also notice in the log output that these are all AIRCFT temperature
> observations! No ADPUPA and no ADPSFC.
>
> Since you're using GDAS observations, you should be aware of the
quality
> marker issue for surface observations noted at the bottom of this
page:
> http://www.dtcenter.org/met/users/downloads/observation_data.php
>
> To get Point-Stat running, I did the following steps:
>
> (1) Pull GDAS observations for 20150820_180000:
> wget
>
>
http://nomads.ncdc.noaa.gov/data/gdas/201508/20150820/gdas1.t18z.prepbufr.nr
>
> (2) Run PB2NC using the attached configuration file (note quality
marker =
> 9):
> met-5.1/bin/pb2nc gdas1.t18z.prepbufr.nr gdas1.t18z.prepbufr.nc
> PB2NCConfig_GDAS
>
> (3) Run Point-Stat using the data/config file you sent me:
> met-5.1/bin/point_stat nmbprs_d01.06 gdas1.t18z.prepbufr.nc
> PointStatConfig -outdir out -v 4
>
> And that give me 3584 matched pairs:
> DEBUG 3: Number of matched pairs = 3584
>
> So the problem was caused by the GDAS quality marker issue. Also
note that
> for North American grids, using NDAS (i.e. north american data
> assimilation) would work equally well and NDAS does *NOT* have this
quality
> marker issue.
>
> Lastly, I see the following warning when I run Point-Stat with your
data:
> WARNING:
> WARNING: gds_to_lambert() -> MET does not currently support Lambert
> Conformal grids where dx (3.317) != dy (2.97) and may produce
unexpected
> results!
> WARNING:
>
> I'd suggest post-processing to a different grid where Dx = Dy prior
to
> running MET.
>
> Hope that helps.
>
> Thanks,
> John
>
> On Fri, Mar 18, 2016 at 10:15 AM, Jose Garcia-Rivera via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> >
> > Dear John,
> >
> > I tried as you suggested, but still have empty output. I put the
files in
> > your ftp in 'garcia_data'
> >
> > The three files in the FTP are:
> >
> > newtest.nc
> > nmbprs_d01.06
> > PointStatConfig
> >
> >
> > Output:
> >
> > [garciaj at login prepbufr_obs]$ ./point_stat nmbprs_d01.06
newtest.nc
> > PointStatConfig_default
> > DEBUG 1: Default Config File:
> >
> /work/apps/pgi_14.10/SANDY/met-
5.1/share/met/config/PointStatConfig_default
> > DEBUG 1: User Config File: PointStatConfig_default
> > GSL_RNG_TYPE=mt19937
> > GSL_RNG_SEED=18446744071614164054
> > DEBUG 1: Forecast File: nmbprs_d01.06
> > DEBUG 1: Observation File: newtest.nc
> > DEBUG 2:
> > DEBUG 2:
> >
>
--------------------------------------------------------------------------------
> > DEBUG 2:
> > DEBUG 2: Reading data for TMP/Z2.
> > DEBUG 2: For TMP/Z2 found 1 forecast levels and 0 climatology
levels.
> > DEBUG 2:
> > DEBUG 2:
> >
>
--------------------------------------------------------------------------------
> > DEBUG 2:
> > DEBUG 2: Searching 949837 observations from 452408 messages.
> > DEBUG 2:
> > DEBUG 2:
> >
>
--------------------------------------------------------------------------------
> > DEBUG 2:
> > DEBUG 2: Processing TMP/Z2 versus TMP/Z2, for observation type
ADPSFC,
> > over region FULL, for interpolation method NEAREST(1), using 0
pairs.
> > DEBUG 2:
> > DEBUG 2:
> >
>
--------------------------------------------------------------------------------
> > DEBUG 2:
> > DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V.stat
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_fho.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_ctc.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_cts.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_mctc.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_mcts.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_cnt.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_sl1l2.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_sal1l2.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_vl1l2.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_val1l2.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_pct.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_pstd.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_pjc.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_prc.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_mpr.txt
> >
> > From config file:
> >
> > fcst = {
> > message_type = [ "ADPSFC" ];
> > sid_exc = [];
> >
> > field = [
> > {
> > name = "TMP";
> > level = [ "Z2" ];
> > cat_thresh = [ >293.0 ];
> > }
> > ];
> >
> >
> > Thanks for the help,
> > Jose
> >
> >
> >
> > -----Original Message-----
> > From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> > Sent: Thursday, March 17, 2016 5:47 PM
> > To: Jose Garcia-Rivera
> > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR
to
> NetCDF
> >
> > Jose,
> >
> > I see that you're doing an upper-air (ADPUPA) evaluation for the
time
> > 20150820_180000. Upper-air observations are much more common at
00Z and
> > 12Z than 06Z and 18Z. Instead of verifying the 06 hour forecast
valid at
> > 18Z, please try the 12 hour forecast valid at 00Z.
> >
> > Also, you could try evaluating some surface fields against the
ADPSFC
> > message type.
> >
> > If you get stuck, you can post a sample forecast file to our
anonymous
> ftp
> > site, and I can try running it here.
> >
> > Thanks,
> > John
> >
> >
> >
> > On Thu, Mar 17, 2016 at 2:39 PM, Jose Garcia-Rivera via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> > >
> > > Dear John,
> > >
> > > It's great to hear from you again! Julie has been of great help.
We
> > > highly appreciate all the help coming from your team.
> > >
> > > I followed your recommendation, and got the following:
> > >
> > > [garciaj at login prepbufr_obs]$ ./point_stat -v 3 nmbprs_d01.06
> > > newtest.nc PointStatConfig_default DEBUG 1: Default Config File:
> > > /work/apps/pgi_14.10/SANDY/met-
5.1/share/met/config/PointStatConfig_de
> > > fault DEBUG 1: User Config File: PointStatConfig_default
> > > GSL_RNG_TYPE=mt19937
> > > GSL_RNG_SEED=1041230678
> > > DEBUG 1: Forecast File: nmbprs_d01.06
> > > DEBUG 1: Observation File: newtest.nc
> > > DEBUG 2:
> > > DEBUG 2:
> > >
----------------------------------------------------------------------
> > > ----------
> > > DEBUG 2:
> > > DEBUG 2: Reading data for SPFH/P500.
> > > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found range
match for
> > > VarInfo "SPFH/P500" in GRIB record 134 of GRIB file
"nmbprs_d01.06".
> > > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found 1 GRIB
records
> > > matching VarInfo "SPFH/P500" in GRIB file "nmbprs_d01.06".
> > > DEBUG 3: Use the matching forecast and observation grids.
> > > DEBUG 3: Grid Definition: Projection: Lambert Conformal Nx: 400
Ny:
> > > 400
> > > Lat_LL: 33.302 Lon_LL: 84.951 Lon_orient: 77.459 Alpha: 3781.822
Cone:
> > > 0.629 Bx: 210.6765 By: 2557.3266
> > > DEBUG 2: For SPFH/P500 found 1 forecast levels and 0 climatology
> levels.
> > > DEBUG 2:
> > > DEBUG 2:
> > >
----------------------------------------------------------------------
> > > ----------
> > > DEBUG 2:
> > > DEBUG 2: Reading data for TMP/P500.
> > > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found range
match for
> > > VarInfo "TMP/P500" in GRIB record 131 of GRIB file
"nmbprs_d01.06".
> > > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found 1 GRIB
records
> > > matching VarInfo "TMP/P500" in GRIB file "nmbprs_d01.06".
> > > DEBUG 2: For TMP/P500 found 1 forecast levels and 0 climatology
levels.
> > > DEBUG 2:
> > > DEBUG 2:
> > >
----------------------------------------------------------------------
> > > ----------
> > > DEBUG 2:
> > > DEBUG 2: Reading data for HGT/P500.
> > > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found range
match for
> > > VarInfo "HGT/P500" in GRIB record 130 of GRIB file
"nmbprs_d01.06".
> > > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found 1 GRIB
records
> > > matching VarInfo "HGT/P500" in GRIB file "nmbprs_d01.06".
> > > DEBUG 2: For HGT/P500 found 1 forecast levels and 0 climatology
levels.
> > > DEBUG 2:
> > > DEBUG 2:
> > >
----------------------------------------------------------------------
> > > ----------
> > > DEBUG 2:
> > > DEBUG 2: Reading data for UGRD/P500.
> > > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found range
match for
> > > VarInfo "UGRD/P500" in GRIB record 137 of GRIB file
"nmbprs_d01.06".
> > > DEBUG 3: MetGrib1DataFile::rotate_winds() -> Have U-wind record,
> > > reading V-wind record.
> > > DEBUG 3: MetGrib1DataFile::data_plane_scalar() -> Found exact
match
> > > for VarInfo "UGRD/P500" in GRIB record 138 of GRIB file
> "nmbprs_d01.06".
> > > DEBUG 3: Rotating U and V wind components from grid-relative to
> > > earth-relative.
> > > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found 1 GRIB
records
> > > matching VarInfo "UGRD/P500" in GRIB file "nmbprs_d01.06".
> > > DEBUG 2: For UGRD/P500 found 1 forecast levels and 0 climatology
> levels.
> > > DEBUG 2:
> > > DEBUG 2:
> > >
----------------------------------------------------------------------
> > > ----------
> > > DEBUG 2:
> > > DEBUG 2: Reading data for VGRD/P500.
> > > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found range
match for
> > > VarInfo "VGRD/P500" in GRIB record 138 of GRIB file
"nmbprs_d01.06".
> > > DEBUG 3: MetGrib1DataFile::rotate_winds() -> Have V-wind record,
> > > reading U-wind record.
> > > DEBUG 3: MetGrib1DataFile::data_plane_scalar() -> Found exact
match
> > > for VarInfo "VGRD/P500" in GRIB record 137 of GRIB file
> "nmbprs_d01.06".
> > > DEBUG 3: Rotating U and V wind components from grid-relative to
> > > earth-relative.
> > > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found 1 GRIB
records
> > > matching VarInfo "VGRD/P500" in GRIB file "nmbprs_d01.06".
> > > DEBUG 2: For VGRD/P500 found 1 forecast levels and 0 climatology
> levels.
> > > DEBUG 2:
> > > DEBUG 2:
> > >
----------------------------------------------------------------------
> > > ----------
> > > DEBUG 2:
> > > DEBUG 2: Searching 949837 observations from 452408 messages.
> > > DEBUG 2:
> > > DEBUG 2:
> > >
----------------------------------------------------------------------
> > > ----------
> > > DEBUG 2:
> > > DEBUG 2: Processing SPFH/P500 versus SPFH/P500, for observation
type
> > > ADPUPA, over region FULL, for interpolation method NEAREST(1),
using 0
> > > pairs.
> > > DEBUG 3: Number of matched pairs = 0
> > > DEBUG 3: Observations processed = 949837
> > > DEBUG 3: Rejected: SID exclusion = 0
> > > DEBUG 3: Rejected: GRIB code = 947898
> > > DEBUG 3: Rejected: valid time = 1416
> > > DEBUG 3: Rejected: bad obs value = 0
> > > DEBUG 3: Rejected: off the grid = 523
> > > DEBUG 3: Rejected: level mismatch = 0
> > > DEBUG 3: Rejected: quality marker = 0
> > > DEBUG 3: Rejected: message type = 0
> > > DEBUG 3: Rejected: masking region = 0
> > > DEBUG 3: Rejected: bad fcst value = 0
> > > DEBUG 3: Rejected: duplicates = 0
> > > DEBUG 2:
> > > DEBUG 2:
> > >
----------------------------------------------------------------------
> > > ----------
> > > DEBUG 2:
> > > DEBUG 2: Processing TMP/P500 versus TMP/P500, for observation
type
> > > ADPUPA, over region FULL, for interpolation method NEAREST(1),
using 0
> > pairs.
> > > DEBUG 3: Number of matched pairs = 0
> > > DEBUG 3: Observations processed = 949837
> > > DEBUG 3: Rejected: SID exclusion = 0
> > > DEBUG 3: Rejected: GRIB code = 943848
> > > DEBUG 3: Rejected: valid time = 4191
> > > DEBUG 3: Rejected: bad obs value = 0
> > > DEBUG 3: Rejected: off the grid = 1798
> > > DEBUG 3: Rejected: level mismatch = 0
> > > DEBUG 3: Rejected: quality marker = 0
> > > DEBUG 3: Rejected: message type = 0
> > > DEBUG 3: Rejected: masking region = 0
> > > DEBUG 3: Rejected: bad fcst value = 0
> > > DEBUG 3: Rejected: duplicates = 0
> > > DEBUG 2:
> > > DEBUG 2:
> > >
----------------------------------------------------------------------
> > > ----------
> > > DEBUG 2:
> > > DEBUG 2: Processing HGT/P500 versus HGT/P500, for observation
type
> > > ADPUPA, over region FULL, for interpolation method NEAREST(1),
using 0
> > pairs.
> > > DEBUG 3: Number of matched pairs = 0
> > > DEBUG 3: Observations processed = 949837
> > > DEBUG 3: Rejected: SID exclusion = 0
> > > DEBUG 3: Rejected: GRIB code = 606744
> > > DEBUG 3: Rejected: valid time = 319085
> > > DEBUG 3: Rejected: bad obs value = 0
> > > DEBUG 3: Rejected: off the grid = 23610
> > > DEBUG 3: Rejected: level mismatch = 395 DEBUG 3: Rejected:
quality
> > > marker = 0
> > > DEBUG 3: Rejected: message type = 3
> > > DEBUG 3: Rejected: masking region = 0
> > > DEBUG 3: Rejected: bad fcst value = 0
> > > DEBUG 3: Rejected: duplicates = 0
> > > DEBUG 2:
> > > DEBUG 2:
> > >
----------------------------------------------------------------------
> > > ----------
> > > DEBUG 2:
> > > DEBUG 2: Processing UGRD/P500 versus UGRD/P500, for observation
type
> > > ADPUPA, over region FULL, for interpolation method NEAREST(1),
using 0
> > > pairs.
> > > DEBUG 3: Number of matched pairs = 0
> > > DEBUG 3: Observations processed = 949837
> > > DEBUG 3: Rejected: SID exclusion = 0
> > > DEBUG 3: Rejected: GRIB code = 650429
> > > DEBUG 3: Rejected: valid time = 277745
> > > DEBUG 3: Rejected: bad obs value = 0
> > > DEBUG 3: Rejected: off the grid = 21341
> > > DEBUG 3: Rejected: level mismatch = 319 DEBUG 3: Rejected:
quality
> > > marker = 0
> > > DEBUG 3: Rejected: message type = 3
> > > DEBUG 3: Rejected: masking region = 0
> > > DEBUG 3: Rejected: bad fcst value = 0
> > > DEBUG 3: Rejected: duplicates = 0
> > > DEBUG 2:
> > > DEBUG 2:
> > >
----------------------------------------------------------------------
> > > ----------
> > > DEBUG 2:
> > > DEBUG 2: Processing VGRD/P500 versus VGRD/P500, for observation
type
> > > ADPUPA, over region FULL, for interpolation method NEAREST(1),
using 0
> > > pairs.
> > > DEBUG 3: Number of matched pairs = 0
> > > DEBUG 3: Observations processed = 949837
> > > DEBUG 3: Rejected: SID exclusion = 0
> > > DEBUG 3: Rejected: GRIB code = 650429
> > > DEBUG 3: Rejected: valid time = 277745
> > > DEBUG 3: Rejected: bad obs value = 0
> > > DEBUG 3: Rejected: off the grid = 21341
> > > DEBUG 3: Rejected: level mismatch = 319 DEBUG 3: Rejected:
quality
> > > marker = 0
> > > DEBUG 3: Rejected: message type = 3
> > > DEBUG 3: Rejected: masking region = 0
> > > DEBUG 3: Rejected: bad fcst value = 0
> > > DEBUG 3: Rejected: duplicates = 0
> > > DEBUG 2:
> > > DEBUG 2:
> > >
----------------------------------------------------------------------
> > > ----------
> > > DEBUG 2:
> > > DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V.stat
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_fho.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_ctc.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_cts.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_mctc.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_mcts.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_cnt.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_sl1l2.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_sal1l2.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_vl1l2.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_val1l2.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_pct.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_pstd.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_pjc.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_prc.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_mpr.txt
> > >
> > >
> > >
> > > Best Regards,
> > > Jose
> > >
> > >
> > >
> > >
> > >
> > > -----Original Message-----
> > > From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> > > Sent: Thursday, March 17, 2016 3:29 PM
> > > To: Jose Garcia-Rivera
> > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR
to
> > > NetCDF
> > >
> > > Hello Jose,
> > >
> > > Julie is out of the office today, but I should be able to help
you.
> > > Glad you were able to finally get PB2NC working. That was a
tricky
> > > one! But it helped us realize that since BUFRLIB has changed to
> > > FORTRAN 90, we should update the MET code which calls BUFRLIB to
be
> > compatible.
> > >
> > > I see that you are now getting 0 matched pairs when you run
Point-Stat
> > > with the output of PB2NC. Please try rerunning Point-Stat but
use a
> > > higher verbosity level, like "-v 3". That'll print out the
following
> > > type of counts for each of the verification tasks you've defined
in the
> > config file:
> > >
> > > DEBUG 3: Number of matched pairs = 312
> > > DEBUG 3: Observations processed = 87753
> > > DEBUG 3: Rejected: SID exclusion = 0
> > > DEBUG 3: Rejected: GRIB code = 77648
> > > DEBUG 3: Rejected: valid time = 0
> > > DEBUG 3: Rejected: bad obs value = 0
> > > DEBUG 3: Rejected: off the grid = 5
> > > DEBUG 3: Rejected: level mismatch = 9219 DEBUG 3: Rejected:
quality
> > > marker = 0
> > > DEBUG 3: Rejected: message type = 537
> > > DEBUG 3: Rejected: masking region = 32 DEBUG 3: Rejected: bad
fcst
> > > value = 0
> > > DEBUG 3: Rejected: duplicates = 0
> > >
> > > In the example above, 87753 observation values were checked and
the
> > > counts list reasons why there were not used for that task. Out
of
> > > those 87753 obs, 312 of them were used for this task.
> > >
> > > Looking at the counts from your Point-Stat run should help you
figure
> > > out why you have 0 matched pairs.
> > >
> > > Thanks,
> > > John
> > >
> > >
> > > On Thu, Mar 17, 2016 at 12:29 PM, Jose Garcia-Rivera via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
>
> > > >
> > > > Dear Julie,
> > > >
> > > > We got the executables to work! However, I have a couple of
> > > > issues/questions:
> > > >
> > > >
> > > >
> > > > Issue #1 --- Not getting values after running point_stat
> > > >
> > > > Everything seems to run fine. I attached the configuration
file. I
> > > > can send the three files via FTP if needed.
> > > >
> > > >
> > > >
> > > > Issue #2 --- PB2NC doesn't seem to finish the job, but it
does? I
> > > > had to do CTRL+C, and checked the netCDF file using
ncl_filedump:
> > > >
> > > > [garciaj at login prepbufr_obs]$ ./pb2nc
prepbufr.gdas.20150820.t18z.nr
> > > > newtest.nc PB2NCConfig_default DEBUG 1: Default Config File:
> > > > /work/apps/pgi_14.10/SANDY/met-
5.1/share/met/config/PB2NCConfig_defa
> > > > ul t DEBUG 1: User Config File: PB2NCConfig_default
> > > > DEBUG 1: Creating NetCDF File: newtest.nc
> > > > DEBUG 1: Processing PrepBufr File:
> prepbufr.gdas.20150820.t18z.nr
> > > > DEBUG 1: Blocking PrepBufr file to:
/tmp/tmp_pb2nc_blk_17703_0
> > > > DEBUG 2: PrepBufr Time Center: 20150820_180000
> > > > DEBUG 2: Searching Time Window: 20150820_163000 to
> > > 20150820_193000
> > > > DEBUG 2: Processing 685386 PrepBufr messages...
> > > > 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80%
85%
> > > > 90% 95% 100%
> > > > DEBUG 2: Total PrepBufr Messages processed = 685386
> > > > DEBUG 2: Rejected based on message type = 0
> > > > DEBUG 2: Rejected based on station id = 0
> > > > DEBUG 2: Rejected based on valid time = 185145
> > > > DEBUG 2: Rejected based on masking grid = 0
> > > > DEBUG 2: Rejected based on masking polygon = 0
> > > > DEBUG 2: Rejected based on elevation = 0
> > > > DEBUG 2: Rejected based on pb report type = 0
> > > > DEBUG 2: Rejected based on input report type = 0
> > > > DEBUG 2: Rejected based on instrument type = 0
> > > > DEBUG 2: Rejected based on zero observations = 47833
> > > > DEBUG 2: Total PrepBufr Messages retained = 452408
> > > > DEBUG 2: Total observations retained or derived = 949837 ^C
> > > >
> > > >
> > > > Checking netCDF file:
> > > >
> > > > [garciaj at login prepbufr_obs]$ ncl_filedump newtest.nc
Copyright (C)
> > > > 1995-2015 - All Rights Reserved University Corporation for
> > > > Atmospheric Research NCAR Command Language Version 6.3.0 The
use
> > > > of this software is governed by a License Agreement.
> > > > See http://www.ncl.ucar.edu/ for more details.
> > > >
> > > > Variable: f
> > > > Type: file
> > > > filename: newtest
> > > > path: newtest.nc
> > > > file global attributes:
> > > > FileOrigins : File newtest.nc generated 20160317_155548
UTC on
> > > > host login.local by the MET pb2nc tool
> > > > MET_version : V5.1
> > > > MET_tool : pb2nc
> > > > dimensions:
> > > > mxstr = 16
> > > > hdr_arr_len = 3
> > > > obs_arr_len = 5
> > > > nobs = 949837 // unlimited
> > > > nhdr = 452408
> > > > variables:
> > > > character obs_qty ( nobs, mxstr )
> > > > long_name : quality flag
> > > >
> > > > float obs_arr ( nobs, obs_arr_len )
> > > > long_name : array of observation values
> > > > _fill_value : -9999
> > > > columns : hdr_id gc lvl hgt ob
> > > > hdr_id_long_name : index of matching header data
> > > > gc_long_name : grib code corresponding to the
observation
> type
> > > > lvl_long_name : pressure level (hPa) or
accumulation
> > > > interval (sec)
> > > > hgt_long_name : height in meters above sea
level
> (msl)
> > > > ob_long_name : observation value
> > > >
> > > > character hdr_typ ( nhdr, mxstr )
> > > > long_name : message type
> > > >
> > > > character hdr_sid ( nhdr, mxstr )
> > > > long_name : station identification
> > > >
> > > > character hdr_vld ( nhdr, mxstr )
> > > > long_name : valid time
> > > > units : YYYYMMDD_HHMMSS
> > > >
> > > > float hdr_arr ( nhdr, hdr_arr_len )
> > > > long_name : array of observation station header
values
> > > > _fill_value : -9999
> > > > columns : lat lon elv
> > > > lat_long_name : latitude
> > > > lat_units : degrees_north
> > > > lon_long_name : longitude
> > > > lon_units : degrees_east
> > > > elv_long_name : elevation
> > > > elv_units : meters above sea level (msl)
> > > >
> > > >
> > > >
> > > >
> > > > Thanks for all the help,
> > > > Jose
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > > -----Original Message-----
> > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > Sent: Wednesday, March 16, 2016 4:40 PM
> > > > To: Jose Garcia-Rivera
> > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
PREPBUFR to
> > > > NetCDF
> > > >
> > > > Hi Jose. I apologize for the delay. This was a tricky
problem to
> > > > figure out, however, we were finally able to reproduce the
error you
> > > > are receiving for pb2nc.
> > > >
> > > > The problem is BUFRLIB being compiled with pgf90 and MET being
> > > > compiled with pgf77. They aren't talking well to each other.
> > > > BUFRLIBv10.1.0 compiles with pgf77 but later versions require
pgf90.
> > > >
> > > > We will plan on updating the MET Fortran code to compile with
pgf90
> > > > so that we can use newer BUFRLIB versions, but for now, to
solve
> > > > your problem, I have attached BUFRLIB_v10-1-0.tar. Please
install
> > > > that version of BUFRLIB using pgf77 and then recompile MET
without
> > > > the "LIBS" environment variable setting?
> > > >
> > > > Please let me know how that goes. We were able to get a
successful
> > > > run using that solution and hope you will too.
> > > >
> > > > Thanks,
> > > > Julie
> > > >
> > > >
> > > > On Wed, Mar 16, 2016 at 12:17 PM, Jose Garcia-Rivera via RT <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > > >
> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> > > > >
> > > > > Dear Julie,
> > > > >
> > > > > Is there anything that we can do here to sort these issues
out?
> > > > >
> > > > > Best Regards,
> > > > > Jose
> > > > >
> > > > > -----Original Message-----
> > > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > > Sent: Tuesday, March 15, 2016 5:08 PM
> > > > > To: Jose Garcia-Rivera
> > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
PREPBUFR
> > > > > to NetCDF
> > > > >
> > > > > Hi Jose. I was not. I got the same error you did. I
believe
> > > > > that the test.nc file is not in the correct format needed by
> > > > > point_stat, so I think we need to get pb2nc working for you.
It
> > > > > is likely a communication problem between the C code and the
> Fortran
> > code.
> > > > >
> > > > > Julie
> > > > >
> > > > > On Tue, Mar 15, 2016 at 3:05 PM, Jose Garcia-Rivera via RT <
> > > > > met_help at ucar.edu> wrote:
> > > > >
> > > > > >
> > > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> > > > > >
> > > > > > Dear Julie,
> > > > > >
> > > > > > Quick question: Were you able to run point_stat with the
netCDF
> > > > > > file that I sent yesterday?
> > > > > >
> > > > > > Thanks for the help,
> > > > > > Jose
> > > > > >
> > > > > > -----Original Message-----
> > > > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > > > Sent: Tuesday, March 15, 2016 12:17 PM
> > > > > > To: Jose Garcia-Rivera
> > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
PREPBUFR
> > > > > > to NetCDF
> > > > > >
> > > > > > Thank you, Jose. I'm working with co-workers to try to
get
> > > > > > these issues resolved. I hope to get back to you soon.
> > > > > >
> > > > > > Julie
> > > > > >
> > > > > > On Mon, Mar 14, 2016 at 1:36 PM, Jose Garcia-Rivera via RT
<
> > > > > > met_help at ucar.edu> wrote:
> > > > > >
> > > > > > >
> > > > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > > > >
> > > > > > >
> > > > > > > Dear Julie,
> > > > > > >
> > > > > > > I just uploaded the three files to 'garcia_data'.
> > > > > > >
> > > > > > > Thanks for the help,
> > > > > > > Jose
> > > > > > >
> > > > > > >
> > > > > > > -----Original Message-----
> > > > > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > > > > Sent: Monday, March 14, 2016 3:32 PM
> > > > > > > To: Jose Garcia-Rivera
> > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
> > > > > > > PREPBUFR to NetCDF
> > > > > > >
> > > > > > > Hi Jose.
> > > > > > >
> > > > > > > Yes, please upload your input files and configuration
file
> > > > > > > (nmbprs_d01.06, test.nc, PointStatConfig_default) to our
> > > > > > > anonymous ftp
> > > > > > site as follows:
> > > > > > > http://www.dtcenter.org/met/users/support/met_help.php
> > > > > > >
> > > > > > > Thanks!
> > > > > > >
> > > > > > > Julie
> > > > > > >
> > > > > > > On Mon, Mar 14, 2016 at 1:06 PM, Jose Garcia-Rivera via
RT <
> > > > > > > met_help at ucar.edu> wrote:
> > > > > > >
> > > > > > > >
> > > > > > > > <URL:
> > > > > > > >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > > > > >
> > > > > > > >
> > > > > > > > Dear Julie,
> > > > > > > >
> > > > > > > > I got to convert my prepbufr file using a python
script.
> > > > > > > > However, I have trouble running point_stat. Can I send
you
> > > > > > > > the files, to see if you have the same issue?
> > > > > > > >
> > > > > > > >
> > > > > > > > This is what I got:
> > > > > > > >
> > > > > > > > [garciaj at login prepbufr_obs]$ ./point_stat
nmbprs_d01.06
> > > > > > > > test.nc PointStatConfig_default DEBUG 1: Default
Config
> File:
> > > > > > > > /work/apps/pgi_14.10/SANDY/met-
5.1/share/met/config/PointSta
> > > > > > > > tC on fi g_ de fault DEBUG 1: User Config File:
> > > > > > > > PointStatConfig_default
> > > > > > > > GSL_RNG_TYPE=mt19937
> > > > > > > > GSL_RNG_SEED=18446744073425053526 DEBUG 1: Forecast
File:
> > > > > > > > nmbprs_d01.06 DEBUG 1: Observation File:
> > > > > > > > test.nc DEBUG 2:
> > > > > > > > DEBUG 2:
> > > > > > > >
------------------------------------------------------------
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > ----------
> > > > > > > > DEBUG 2:
> > > > > > > > DEBUG 2: Reading data for SPFH/P500.
> > > > > > > > DEBUG 2: For SPFH/P500 found 1 forecast levels and 0
> > > > > > > > climatology
> > > > > > levels.
> > > > > > > > DEBUG 2:
> > > > > > > > DEBUG 2:
> > > > > > > >
------------------------------------------------------------
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > ----------
> > > > > > > > DEBUG 2:
> > > > > > > > DEBUG 2: Reading data for TMP/P500.
> > > > > > > > DEBUG 2: For TMP/P500 found 1 forecast levels and 0
> > > > > > > > climatology
> > > > > levels.
> > > > > > > > DEBUG 2:
> > > > > > > > DEBUG 2:
> > > > > > > >
------------------------------------------------------------
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > ----------
> > > > > > > > DEBUG 2:
> > > > > > > > DEBUG 2: Reading data for HGT/P500.
> > > > > > > > DEBUG 2: For HGT/P500 found 1 forecast levels and 0
> > > > > > > > climatology
> > > > > levels.
> > > > > > > > DEBUG 2:
> > > > > > > > DEBUG 2:
> > > > > > > >
------------------------------------------------------------
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > ----------
> > > > > > > > DEBUG 2:
> > > > > > > > DEBUG 2: Reading data for UGRD/P500.
> > > > > > > > DEBUG 2: For UGRD/P500 found 1 forecast levels and 0
> > > > > > > > climatology
> > > > > > levels.
> > > > > > > > DEBUG 2:
> > > > > > > > DEBUG 2:
> > > > > > > >
------------------------------------------------------------
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > ----------
> > > > > > > > DEBUG 2:
> > > > > > > > DEBUG 2: Reading data for VGRD/P500.
> > > > > > > > DEBUG 2: For VGRD/P500 found 1 forecast levels and 0
> > > > > > > > climatology
> > > > > > levels.
> > > > > > > > DEBUG 2:
> > > > > > > > DEBUG 2:
> > > > > > > >
------------------------------------------------------------
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > ----------
> > > > > > > > DEBUG 2:
> > > > > > > > WARNING:
> > > > > > > > WARNING: process_obs_file() -> can't open observation
netCDF
> > > file:
> > > > > > > > test.nc
> > > > > > > > WARNING:
> > > > > > > > DEBUG 2:
> > > > > > > > DEBUG 2:
> > > > > > > >
------------------------------------------------------------
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > ----------
> > > > > > > > DEBUG 2:
> > > > > > > > DEBUG 2: Processing SPFH/P500 versus SPFH/P500, for
> > > > > > > > observation type ADPUPA, over region FULL, for
interpolation
> > > > > > > > method NEAREST(1), using
> > > > > > > > 0 pairs.
> > > > > > > > DEBUG 2:
> > > > > > > > DEBUG 2:
> > > > > > > >
------------------------------------------------------------
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > ----------
> > > > > > > > DEBUG 2:
> > > > > > > > DEBUG 2: Processing TMP/P500 versus TMP/P500, for
> > > > > > > > observation type ADPUPA, over region FULL, for
interpolation
> > > > > > > > method NEAREST(1), using
> > > > > > > > 0
> > > > > > > pairs.
> > > > > > > > DEBUG 2:
> > > > > > > > DEBUG 2:
> > > > > > > >
------------------------------------------------------------
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > ----------
> > > > > > > > DEBUG 2:
> > > > > > > > DEBUG 2: Processing HGT/P500 versus HGT/P500, for
> > > > > > > > observation type ADPUPA, over region FULL, for
interpolation
> > > > > > > > method NEAREST(1), using
> > > > > > > > 0
> > > > > > > pairs.
> > > > > > > > DEBUG 2:
> > > > > > > > DEBUG 2:
> > > > > > > >
------------------------------------------------------------
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > ----------
> > > > > > > > DEBUG 2:
> > > > > > > > DEBUG 2: Processing UGRD/P500 versus UGRD/P500, for
> > > > > > > > observation type ADPUPA, over region FULL, for
interpolation
> > > > > > > > method NEAREST(1), using
> > > > > > > > 0 pairs.
> > > > > > > > DEBUG 2:
> > > > > > > > DEBUG 2:
> > > > > > > >
------------------------------------------------------------
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > ----------
> > > > > > > > DEBUG 2:
> > > > > > > > DEBUG 2: Processing VGRD/P500 versus VGRD/P500, for
> > > > > > > > observation type ADPUPA, over region FULL, for
interpolation
> > > > > > > > method NEAREST(1), using
> > > > > > > > 0 pairs.
> > > > > > > > DEBUG 2:
> > > > > > > > DEBUG 2:
> > > > > > > >
------------------------------------------------------------
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > ----------
> > > > > > > > DEBUG 2:
> > > > > > > > DEBUG 1: Output file:
> > > > > > > > ./point_stat_060000L_20150820_180000V.stat
> > > > > > > > DEBUG 1: Output file:
> > > > > > > > ./point_stat_060000L_20150820_180000V_fho.txt
> > > > > > > > DEBUG 1: Output file:
> > > > > > > > ./point_stat_060000L_20150820_180000V_ctc.txt
> > > > > > > > DEBUG 1: Output file:
> > > > > > > > ./point_stat_060000L_20150820_180000V_cts.txt
> > > > > > > > DEBUG 1: Output file:
> > > > > > > > ./point_stat_060000L_20150820_180000V_mctc.txt
> > > > > > > > DEBUG 1: Output file:
> > > > > > > > ./point_stat_060000L_20150820_180000V_mcts.txt
> > > > > > > > DEBUG 1: Output file:
> > > > > > > > ./point_stat_060000L_20150820_180000V_cnt.txt
> > > > > > > > DEBUG 1: Output file:
> > > > > > > > ./point_stat_060000L_20150820_180000V_sl1l2.txt
> > > > > > > > DEBUG 1: Output file:
> > > > > > > > ./point_stat_060000L_20150820_180000V_sal1l2.txt
> > > > > > > > DEBUG 1: Output file:
> > > > > > > > ./point_stat_060000L_20150820_180000V_vl1l2.txt
> > > > > > > > DEBUG 1: Output file:
> > > > > > > > ./point_stat_060000L_20150820_180000V_val1l2.txt
> > > > > > > > DEBUG 1: Output file:
> > > > > > > > ./point_stat_060000L_20150820_180000V_pct.txt
> > > > > > > > DEBUG 1: Output file:
> > > > > > > > ./point_stat_060000L_20150820_180000V_pstd.txt
> > > > > > > > DEBUG 1: Output file:
> > > > > > > > ./point_stat_060000L_20150820_180000V_pjc.txt
> > > > > > > > DEBUG 1: Output file:
> > > > > > > > ./point_stat_060000L_20150820_180000V_prc.txt
> > > > > > > > DEBUG 1: Output file:
> > > > > > > > ./point_stat_060000L_20150820_180000V_mpr.txt
> > > > > > > >
> > > > > > > >
> > > > > > > > Thanks for the help,
> > > > > > > > Jose
> > > > > > > >
> > > > > > > >
> > > > > > > > -----Original Message-----
> > > > > > > > From: Julie Prestopnik via RT
[mailto:met_help at ucar.edu]
> > > > > > > > Sent: Monday, March 14, 2016 12:17 PM
> > > > > > > > To: Jose Garcia-Rivera
> > > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues
converting
> > > > > > > > PREPBUFR to NetCDF
> > > > > > > >
> > > > > > > > Hi Jose. I apologize for the delayed response. I was
out
> > > > > > > > of the office on Friday. I'm going to try to figure
out a
> > > > > > > > solution and get back with you shortly.
> > > > > > > >
> > > > > > > > Julie
> > > > > > > >
> > > > > > > > On Fri, Mar 11, 2016 at 2:02 PM, Jose Garcia-Rivera
via RT <
> > > > > > > > met_help at ucar.edu> wrote:
> > > > > > > >
> > > > > > > > >
> > > > > > > > > <URL:
> > > > > > > > >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > > > > > >
> > > > > > > > >
> > > > > > > > > Dear Julie,
> > > > > > > > >
> > > > > > > > > Any news regarding pb2nc? We're still unable to make
it
> work.
> > > > > > > > >
> > > > > > > > > Best Regards,
> > > > > > > > > Jose
> > > > > > > > >
> > > > > > > > > -----Original Message-----
> > > > > > > > > From: Julie Prestopnik via RT
[mailto:met_help at ucar.edu]
> > > > > > > > > Sent: Thursday, March 10, 2016 4:20 PM
> > > > > > > > > To: Jose Garcia-Rivera
> > > > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues
converting
> > > > > > > > > PREPBUFR to NetCDF
> > > > > > > > >
> > > > > > > > > Hi Jose. Thank you for attaching the files.
> > > > > > > > >
> > > > > > > > > Could you please send me a list of the files in
> > > > > > > > > /work/apps/pgi_14.10/SANDY/bufrlib/lib?
> > > > > > > > >
> > > > > > > > > Thank you!
> > > > > > > > >
> > > > > > > > > Julie
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > On Thu, Mar 10, 2016 at 12:20 PM, Jose Garcia-Rivera
via
> > > > > > > > > RT < met_help at ucar.edu> wrote:
> > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > <URL:
> > > > > > > > > >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > Dear Julie,
> > > > > > > > > >
> > > > > > > > > > The administrator re-compiled MET following your
> > > > > > > > > > instructions, and says there's still trouble. He
sent me
> > > > > > > > > > the log files
> > > > > > (attached).
> > > > > > > > > > Is there any other approach that might help?
> > > > > > > > > >
> > > > > > > > > > Best Regards,
> > > > > > > > > > Jose
> > > > > > > > > >
> > > > > > > > > > -----Original Message-----
> > > > > > > > > > From: Julie Prestopnik via RT
[mailto:met_help at ucar.edu]
> > > > > > > > > > Sent: Wednesday, March 09, 2016 12:39 PM
> > > > > > > > > > To: Jose Garcia-Rivera
> > > > > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues
converting
> > > > > > > > > > PREPBUFR to NetCDF
> > > > > > > > > >
> > > > > > > > > > Thank you, Jose! It looks like something went
wrong
> > > > > > > > > > during
> > > > > > > > compilation.
> > > > > > > > > > I suggest recompiling MET to see if we can get
this
> > > > > > > > > > issue
> > > > > resolved.
> > > > > > > > > > NCEP's BUFRLIB is used by the pb2nc MET tool, and
is a
> > > > > > > > > > required external library for pb2nc. MET is not
yet
> > > > > > > > > > compatible with BUFRLIB
> > > > > > > > > version 11.0.0, so we
> > > > > > > > > > suggest getting version 10.2.3. We are working
on our
> > > online
> > > > > > > tutorial
> > > > > > > > > for
> > > > > > > > > > METv.5.1, but in the meantime, I'll point you to
our
> > > > > > > > > > online tutorial directions for installing BUFRLIB:
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > >
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.
> > > > > > > > > > 0/
> > > > > > > > > > co
> > > > > > > > > > mp
> > > > > > > > > > ilation/req_libs.php
> > > > > > > > > >
> > > > > > > > > > It is also important to review the necessary
environment
> > > > > > > > > > variables to
> > > > > > > > > set:
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > >
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.
> > > > > > > > > > 0/
> > > > > > > > > > co
> > > > > > > > > > mp
> > > > > > > > > > ilation/configure.php
> > > > > > > > > >
> > > > > > > > > > For example,
> > > > > > > > > >
> > > > > > > > > > "Set *$MET_BUFR* to point to the main BUFR
directory, or
> > > > > > > > > > set
> > > > > > > > > > *$MET_BUFRLIB* to point to the directory with the
BUFR
> > > > > > > > > > library
> > > > > > files.
> > > > > > > > > > Because MET doesn't use any BUFR library include
files,
> > > > > > > > > > you don't need to specify *$MET_BUFRINC* ."
> > > > > > > > > >
> > > > > > > > > > Once you've installed the required libraries and
set up
> > > > > > > > > > your environment variables, you'll be ready to
configure
> > > > > > > > > > MET (instructions at the bottom of the last link
above)
> > > > > > > > > > and then compile and install MET (
> > > > > > > > > >
> > > >
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.
> > > > > > > > > > 0/
> > > > > > > > > > co
> > > > > > > > > > mp
> > > > > > > > > > ilation/compile.php
> > > > > > > > > > ).
> > > > > > > > > > After re-installing MET, please run "make test"
again.
> > > > > > > > > > If you still encounter the same problem, please
send me
> > > > > > > > > > your
> > > > > > > > > > *config.log* file and your *make_install.log
*file.
> > > > > > > > > > Please let me know if you have any
> > > > > > > > > questions.
> > > > > > > > > >
> > > > > > > > > > Please let us know how it goes.
> > > > > > > > > >
> > > > > > > > > > Thanks,
> > > > > > > > > > Julie
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > On Wed, Mar 9, 2016 at 10:22 AM, Jose Garcia-
Rivera via
> > > > > > > > > > RT < met_help at ucar.edu> wrote:
> > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > <URL:
> > > > > > > > > > >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=7543
> > > > > > > > > > > 3
> > > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > Dear Julie,
> > > > > > > > > > >
> > > > > > > > > > > Attached is the test log file. It's showing the
same
> > > > > > > > > > > issues on pb2nc even with the sample files.
> > > > > > > > > > >
> > > > > > > > > > > Best Regards,
> > > > > > > > > > > Jose
> > > > > > > > > > >
> > > > > > > > > > > -----Original Message-----
> > > > > > > > > > > From: Julie Prestopnik via RT
> > > > > > > > > > > [mailto:met_help at ucar.edu]
> > > > > > > > > > > Sent: Tuesday, March 08, 2016 5:28 PM
> > > > > > > > > > > To: Jose Garcia-Rivera
> > > > > > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues
> > > > > > > > > > > converting PREPBUFR to NetCDF
> > > > > > > > > > >
> > > > > > > > > > > Hi Jose. Thank you for uploading the files.
> > > > > > > > > > > Unfortunately, I am unable to reproduce the
error you
> > > > > > > > > > > are experiencing. I am wondering if you have
> > > > > > > > > > > successfully used pb2nc before. As a check
could you
> > > > > > > > > > > please run the following in your met-5.1/
> > > > > > > directory:
> > > > > > > > > > >
> > > > > > > > > > > *make test >& make_test.log*
> > > > > > > > > > >
> > > > > > > > > > > and then send me the make_test.log file?
> > > > > > > > > > >
> > > > > > > > > > > Thanks,
> > > > > > > > > > > Julie
> > > > > > > > > > >
> > > > > > > > > > > On Tue, Mar 8, 2016 at 11:29 AM, Jose Garcia-
Rivera
> > > > > > > > > > > via RT < met_help at ucar.edu> wrote:
> > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > <URL:
> > > > > > > > > > > >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75
> > > > > > > > > > > > 43
> > > > > > > > > > > > 3
> > > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > Dear Julie,
> > > > > > > > > > > >
> > > > > > > > > > > > I just put the files in 'garcia_data'. I
appreciate
> > > > > > > > > > > > your
> > > > > help.
> > > > > > > > > > > >
> > > > > > > > > > > > Best Regards,
> > > > > > > > > > > > Jose
> > > > > > > > > > > >
> > > > > > > > > > > > -----Original Message-----
> > > > > > > > > > > > From: Julie Prestopnik via RT
> > > > > > > > > > > > [mailto:met_help at ucar.edu]
> > > > > > > > > > > > Sent: Tuesday, March 08, 2016 1:12 PM
> > > > > > > > > > > > To: Jose Garcia-Rivera
> > > > > > > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues
> > > > > > > > > > > > converting PREPBUFR to NetCDF
> > > > > > > > > > > >
> > > > > > > > > > > > Hi Jose. I'm sorry to hear that you are having
> > > > > > > > > > > > problems converting a PREPBUFR file to NetCDF.
> > > > > > > > > > > >
> > > > > > > > > > > > Please upload your input files and
configuration
> > > > > > > > > > > > file to our anonymous ftp site as follows:
> > > > > > > > > > > >
http://www.dtcenter.org/met/users/support/met_help.p
> > > > > > > > > > > > hp
> > > > > > > > > > > >
> > > > > > > > > > > > Then I can take a look and get back to you.
> > > > > > > > > > > >
> > > > > > > > > > > > Thanks,
> > > > > > > > > > > > Julie
> > > > > > > > > > > >
> > > > > > > > > > > > On Tue, Mar 8, 2016 at 11:01 AM, Jose Garcia-
Rivera
> > > > > > > > > > > > via RT < met_help at ucar.edu> wrote:
> > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > > Tue Mar 08 11:01:25 2016: Request 75433 was
acted
> > upon.
> > > > > > > > > > > > > Transaction: Ticket created by
GarciaJ at imsg.com
> > > > > > > > > > > > > Queue: met_help
> > > > > > > > > > > > > Subject: Issues converting PREPBUFR to
NetCDF
> > > > > > > > > > > > > Owner: Nobody
> > > > > > > > > > > > > Requestors: GarciaJ at imsg.com
> > > > > > > > > > > > > Status: new
> > > > > > > > > > > > > Ticket <URL:
> > > > > > > > > > > > >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=
> > > > > > > > > > > > > 75
> > > > > > > > > > > > > 43
> > > > > > > > > > > > > 3
> > > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > > Dear Met Help,
> > > > > > > > > > > > >
> > > > > > > > > > > > > Trying to convert a PREPBUFR file to NetCDF.
> > > > > > > > > > > > >
> > > > > > > > > > > > > I used the default PB2NC configure file, and
got
> > > > > > > > > > > > > the
> > > > > > following:
> > > > > > > > > > > > >
> > > > > > > > > > > > > [garciaj at login prepbufr_obs]$ ./pb2nc
> > > > > > > > > > > > > gdas1.t12z.prepbufr.nr gdas.20150820.t12z.nc
> > > > > > > > > > > > > PB2NCConfig_default DEBUG 1: Default Config
> > > > > > > > > > > > > File:
> > > > > > > > > > > > > /work/apps/pgi_14.10/met-
5.1/share/met/config/PB2N
> > > > > > > > > > > > > CC on fi g_ de fa ul t DEBUG 1: User Config
File:
> > > > > > > > > > > > > PB2NCConfig_default DEBUG 1: Creating NetCDF
File:
> > > > > > gdas.20150820.t12z.nc
> > > > > > > > > > > > > DEBUG 1: Processing PrepBufr File:
> > > > > > gdas1.t12z.prepbufr.nr
> > > > > > > > > > > > > DEBUG 1: Blocking PrepBufr file to:
> > > > > > > > /tmp/tmp_pb2nc_blk_32144_0
> > > > > > > > > > > > > WARNING:
> > > > > > > > > > > > > WARNING: process_pbfile() -> No PrepBufr
messages
> > > > > > > > > > > > > to process in
> > > > > > > > > file:
> > > > > > > > > > > > > gdas1.t12z.prepbufr.nr
> > > > > > > > > > > > > WARNING:
> > > > > > > > > > > > > ERROR :
> > > > > > > > > > > > > ERROR : write_netcdf_hdr_data() -> No
PrepBufr
> > > > > > > > > > > > > messages
> > > > > > > > retained.
> > > > > > > > > > > > > Nothing to write.
> > > > > > > > > > > > > ERROR :
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > > Thanks in advance for the help, Jose M.
> > > > > > > > > > > > > Garcia-Rivera, PhD IM Systems Group
> > > > > > > > > > > > > Rockville/College Park, MD This e-mail,
including
> > > > > > > > > > > > > attachments, may include confidential and/or
> > > > > > > > > > > > > proprietary information, and may be used
only by
> > > > > > > > > > > > > the person or entity to which it is
addressed. If
> > > > > > > > > > > > > the reader of this e-mail is not the
intended
> > > > > > > > > > > > > recipient or his or her authorized agent,
the
> > > > > > > > > > > > > reader is hereby notified that any
dissemination,
> > > > > > > > > > > > > distribution or
> > > copying of this e-mail is prohibited.
> > > > > > > > > > > > > If you have received this e-mail in error,
please
> > > > > > > > > > > > > notify the sender by replying to this
message and
> > > > > > > > > > > > > delete this
> > > > > > > > > > > > e-mail immediately.
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > --
> > > > > > > > > > > > Julie Prestopnik
> > > > > > > > > > > > National Center for Atmospheric Research
Research
> > > > > > > > > > > > Applications Laboratory
> > > > > > > > > > > > Phone: 303.497.8399
> > > > > > > > > > > > Email: jpresto at ucar.edu
> > > > > > > > > > > >
> > > > > > > > > > > > This e-mail, including attachments, may
include
> > > > > > > > > > > > confidential and/or proprietary information,
and may
> > > > > > > > > > > > be used only by the person or entity to which
it is
> > > > > > > > > > > > addressed. If the reader of this e-mail is not
the
> > > > > > > > > > > > intended recipient or his or her authorized
agent,
> > > > > > > > > > > > the reader is hereby notified that any
> > > > > > > > > > > > dissemination, distribution or copying of this
e-mail
> > is prohibited.
> > > > > > > > > > > > If you have received this e-mail in error,
please
> > > > > > > > > > > > notify the sender by replying to this message
and
> > > > > > > > > > > > delete this
> > > > > > > > > > > e-mail immediately.
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > --
> > > > > > > > > > > Julie Prestopnik
> > > > > > > > > > > National Center for Atmospheric Research
Research
> > > > > > > > > > > Applications Laboratory
> > > > > > > > > > > Phone: 303.497.8399
> > > > > > > > > > > Email: jpresto at ucar.edu
> > > > > > > > > > >
> > > > > > > > > > > This e-mail, including attachments, may include
> > > > > > > > > > > confidential and/or proprietary information, and
may
> > > > > > > > > > > be used only by the person or entity to which it
is
> > > > > > > > > > > addressed. If the reader of this e-mail is not
the
> > > > > > > > > > > intended recipient or his or her authorized
agent, the
> > > > > > > > > > > reader is hereby notified that any
dissemination,
> > > > > > > > > > > distribution or copying of this e-mail is
prohibited.
> > > > > > > > > > > If you have received this e-mail in error,
please
> > > > > > > > > > > notify the sender by replying to this message
and
> > > > > > > > > > > delete this
> > > > > > > > > > e-mail immediately.
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > --
> > > > > > > > > > Julie Prestopnik
> > > > > > > > > > National Center for Atmospheric Research Research
> > > > > > > > > > Applications Laboratory
> > > > > > > > > > Phone: 303.497.8399
> > > > > > > > > > Email: jpresto at ucar.edu
> > > > > > > > > >
> > > > > > > > > > This e-mail, including attachments, may include
> > > > > > > > > > confidential and/or proprietary information, and
may be
> > > > > > > > > > used only by the person or entity to which it is
> > > > > > > > > > addressed. If the reader of this e-mail is not the
> > > > > > > > > > intended recipient or his or her authorized agent,
the
> > > > > > > > > > reader is hereby notified that any dissemination,
> > > > > > > > > > distribution or copying of this e-mail is
prohibited. If
> > > > > > > > > > you have received this e-mail in error, please
notify
> > > > > > > > > > the sender by replying to this message and delete
this
> > > > > > > > > e-mail immediately.
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > --
> > > > > > > > > Julie Prestopnik
> > > > > > > > > National Center for Atmospheric Research Research
> > > > > > > > > Applications Laboratory
> > > > > > > > > Phone: 303.497.8399
> > > > > > > > > Email: jpresto at ucar.edu
> > > > > > > > >
> > > > > > > > > This e-mail, including attachments, may include
> > > > > > > > > confidential and/or proprietary information, and may
be
> > > > > > > > > used only by the person or entity to which it is
> > > > > > > > > addressed. If the reader of this e-mail is not the
> > > > > > > > > intended recipient or his or her authorized agent,
the
> > > > > > > > > reader is hereby notified that any dissemination,
> > > > > > > > > distribution or copying of this e-mail is
prohibited. If
> > > > > > > > > you have received this e-mail in error, please
notify the
> > > > > > > > > sender by replying to this message and delete this
> > > > > > > > e-mail immediately.
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > --
> > > > > > > > Julie Prestopnik
> > > > > > > > National Center for Atmospheric Research Research
> > > > > > > > Applications Laboratory
> > > > > > > > Phone: 303.497.8399
> > > > > > > > Email: jpresto at ucar.edu
> > > > > > > >
> > > > > > > > This e-mail, including attachments, may include
confidential
> > > > > > > > and/or proprietary information, and may be used only
by the
> > > > > > > > person or entity to which it is addressed. If the
reader of
> > > > > > > > this e-mail is not the intended recipient or his or
her
> > > > > > > > authorized agent, the reader is hereby notified that
any
> > > > > > > > dissemination, distribution or copying of this e-mail
is
> > > > > > > > prohibited. If you have received this e-mail in error,
> > > > > > > > please notify the sender by replying to this message
and
> > > > > > > > delete this
> > > > > > > e-mail immediately.
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > --
> > > > > > > Julie Prestopnik
> > > > > > > National Center for Atmospheric Research Research
Applications
> > > > > > > Laboratory
> > > > > > > Phone: 303.497.8399
> > > > > > > Email: jpresto at ucar.edu
> > > > > > >
> > > > > > > This e-mail, including attachments, may include
confidential
> > > > > > > and/or proprietary information, and may be used only by
the
> > > > > > > person or entity to which it is addressed. If the reader
of
> > > > > > > this e-mail is not the intended recipient or his or her
> > > > > > > authorized agent, the reader is hereby notified that any
> > > > > > > dissemination, distribution or copying of this e-mail is
> > > > > > > prohibited. If you have received this e-mail in error,
please
> > > > > > > notify the sender by replying to this message and delete
this
> > > > > > e-mail immediately.
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > >
> > > > > >
> > > > > > --
> > > > > > Julie Prestopnik
> > > > > > National Center for Atmospheric Research Research
Applications
> > > > > > Laboratory
> > > > > > Phone: 303.497.8399
> > > > > > Email: jpresto at ucar.edu
> > > > > >
> > > > > > This e-mail, including attachments, may include
confidential
> > > > > > and/or proprietary information, and may be used only by
the
> > > > > > person or entity to which it is addressed. If the reader
of this
> > > > > > e-mail is not the intended recipient or his or her
authorized
> > > > > > agent, the reader is hereby notified that any
dissemination,
> > > > > > distribution or copying of this e-mail is prohibited. If
you
> > > > > > have received this e-mail in error, please notify the
sender by
> > > > > > replying to this message and delete this
> > > > > e-mail immediately.
> > > > > >
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > > > --
> > > > > Julie Prestopnik
> > > > > National Center for Atmospheric Research Research
Applications
> > > > > Laboratory
> > > > > Phone: 303.497.8399
> > > > > Email: jpresto at ucar.edu
> > > > >
> > > > > This e-mail, including attachments, may include confidential
> > > > > and/or proprietary information, and may be used only by the
person
> > > > > or entity to which it is addressed. If the reader of this e-
mail
> > > > > is not the intended recipient or his or her authorized
agent, the
> > > > > reader is hereby notified that any dissemination,
distribution or
> > > > > copying of this e-mail is prohibited. If you have received
this
> > > > > e-mail in error, please notify the sender by replying to
this
> > > > > message and delete this
> > > > e-mail immediately.
> > > > >
> > > > >
> > > > >
> > > >
> > > >
> > > > --
> > > > Julie Prestopnik
> > > > National Center for Atmospheric Research Research Applications
> > > > Laboratory
> > > > Phone: 303.497.8399
> > > > Email: jpresto at ucar.edu
> > > >
> > > > This e-mail, including attachments, may include confidential
and/or
> > > > proprietary information, and may be used only by the person or
> > > > entity to which it is addressed. If the reader of this e-mail
is not
> > > > the intended recipient or his or her authorized agent, the
reader is
> > > > hereby notified that any dissemination, distribution or
copying of
> > > > this e-mail is prohibited. If you have received this e-mail in
> > > > error, please notify the sender by replying to this message
and
> > > > delete this
> > > e-mail immediately.
> > > >
> > > >
> > >
> > > This e-mail, including attachments, may include confidential
and/or
> > > proprietary information, and may be used only by the person or
entity
> > > to which it is addressed. If the reader of this e-mail is not
the
> > > intended recipient or his or her authorized agent, the reader is
> > > hereby notified that any dissemination, distribution or copying
of
> > > this e-mail is prohibited. If you have received this e-mail in
error,
> > > please notify the sender by replying to this message and delete
this
> > e-mail immediately.
> > >
> > >
> > >
> >
> > This e-mail, including attachments, may include confidential
and/or
> > proprietary information, and may be used only by the person or
entity to
> > which it is addressed. If the reader of this e-mail is not the
intended
> > recipient or his or her authorized agent, the reader is hereby
notified
> > that any dissemination, distribution or copying of this e-mail is
> > prohibited. If you have received this e-mail in error, please
notify the
> > sender by replying to this message and delete this e-mail
immediately.
> >
> >
> >
>
> This e-mail, including attachments, may include confidential and/or
> proprietary information, and may be used only by the person or
entity to
> which it is addressed. If the reader of this e-mail is not the
intended
> recipient or his or her authorized agent, the reader is hereby
notified
> that any dissemination, distribution or copying of this e-mail is
> prohibited. If you have received this e-mail in error, please notify
the
> sender by replying to this message and delete this e-mail
immediately.
>
>
>
This e-mail, including attachments, may include confidential and/or
proprietary information, and may be used only by the person or entity
to which it is addressed. If the reader of this e-mail is not the
intended recipient or his or her authorized agent, the reader is
hereby notified that any dissemination, distribution or copying of
this e-mail is prohibited. If you have received this e-mail in error,
please notify the sender by replying to this message and delete this
e-mail immediately.
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to NetCDF
From: Jose Garcia-Rivera
Time: Fri Mar 18 15:06:55 2016
Dear John,
Update: point_stat worked with the converted file that you produced.
This is a question from the previous e-mail I sent you:
Is there a way of me specifying any specific grid or region when
running pb2nc? I ask because I can use my own model output grid. For
example:
255 3 400 400 33302 -84951 8 -77459 3317 2970 0 64 38947
38947 44033 -68740
I ask, because we are going to have a domain over Asia.
Thanks for the help,
Jose
-----Original Message-----
From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
Sent: Friday, March 18, 2016 4:08 PM
To: Jose Garcia-Rivera
Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to
NetCDF
Jose,
Ah OK, I suspect that exiting the PB2NC command early is the problem.
While PB2NC did create an output file, you probably killed it before
it
finished writing out all the observations.
This same issue actually came up recently when running on the NCAR
supercomputer, Yellowstone. PB2NC finishes processing the
observations in
a few minutes, but takes multiple hours to write the output NetCDF
file.
The same step takes about 2 seconds on my desktop machine, but 2 hours
on
Yellowstone! So that's an open issue we need to investigate further.
For your needs, please do the following:
(1) I posted my PB2NC output file to our ftp site:
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/for_garcia/gdas1.t18z.prepbufr.nc
Please grab it and verify that when you use it in your Point-Stat
runs, you
actually do get matched pairs.
(2) Try rerunning PB2NC yourself, but this time set the following in
your
PB2NC config file:
mask = "G212";
That will filter the observations and only keep the ones which fall
within
this pre-defined NCEP Grid:
http://www.nco.ncep.noaa.gov/pmb/docs/on388/grids/grid212.gif
That should result in 293763 observations instead of 1330661 of them.
Perhaps PB2NC will run in a more reasonable time.
But in the long run of course, we'll need to figure out why PB2NC is
so
slow and fix it!
Thanks,
John
(2)
On Fri, Mar 18, 2016 at 12:58 PM, Jose Garcia-Rivera via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
>
> Dear John,
>
> I modified the config file for pb2nc, and still have the same issue.
I
> uploaded these two files to 'garcia_data'
>
> 3km_nmbprs_d01.06
> newtest.nc
>
> I don’t need to change the quality flag in the point_stat
configuration
> file, right?
>
> One extra thing to mention: I had to type CNTL+C to exit pb2nc,
since it
> seemed to stay stuck on a loop,,, yet I got the netcdf file. This
happened
> every time:
>
> [garciaj at login prepbufr_obs]$ ./pb2nc gdas1.t18z.prepbufr.nr
newtest.nc
> PB2NCConfig_default
> DEBUG 1: Default Config File:
> /work/apps/pgi_14.10/SANDY/met-
5.1/share/met/config/PB2NCConfig_default
> DEBUG 1: User Config File: PB2NCConfig_default
> DEBUG 1: Creating NetCDF File: newtest.nc
> DEBUG 1: Processing PrepBufr File: gdas1.t18z.prepbufr.nr
> DEBUG 1: Blocking PrepBufr file to: /tmp/tmp_pb2nc_blk_50363_0
> DEBUG 2: PrepBufr Time Center: 20150820_180000
> DEBUG 2: Searching Time Window: 20150820_163000 to
20150820_193000
> DEBUG 2: Processing 685386 PrepBufr messages...
> 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85%
90% 95%
> 100%
> DEBUG 2: Total PrepBufr Messages processed = 685386
> DEBUG 2: Rejected based on message type = 0
> DEBUG 2: Rejected based on station id = 0
> DEBUG 2: Rejected based on valid time = 185145
> DEBUG 2: Rejected based on masking grid = 0
> DEBUG 2: Rejected based on masking polygon = 0
> DEBUG 2: Rejected based on elevation = 0
> DEBUG 2: Rejected based on pb report type = 0
> DEBUG 2: Rejected based on input report type = 0
> DEBUG 2: Rejected based on instrument type = 0
> DEBUG 2: Rejected based on zero observations = 11135
> DEBUG 2: Total PrepBufr Messages retained = 489106
> DEBUG 2: Total observations retained or derived = 1330661
>
> ^C
>
>
>
> Thanks for the help,
> Jose
>
> -----Original Message-----
> From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> Sent: Friday, March 18, 2016 1:01 PM
> To: Jose Garcia-Rivera
> Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to
NetCDF
>
> Jose,
>
> Thanks for sending the test data. I see that your model data is
valid at
> time 20150820_180000. When I run Point-Stat, I see the following
reason
> counts in the output:
>
> DEBUG 2: Processing TMP/Z2 versus TMP/Z2, for observation type
ADPSFC, over
> region FULL, for interpolation method NEAREST(1), using 0 pairs.
> DEBUG 3: Number of matched pairs = 0
> DEBUG 3: Observations processed = 949837
> DEBUG 3: Rejected: SID exclusion = 0
> DEBUG 3: Rejected: GRIB code = 943848
> DEBUG 3: Rejected: valid time = 4191
> DEBUG 3: Rejected: bad obs value = 0
> DEBUG 3: Rejected: off the grid = 1798
> DEBUG 3: Rejected: level mismatch = 0
> DEBUG 3: Rejected: quality marker = 0
> DEBUG 3: Rejected: message type = 0
> DEBUG 3: Rejected: masking region = 0
> DEBUG 3: Rejected: bad fcst value = 0
> DEBUG 3: Rejected: duplicates = 0
>
> So it looks like several observations are not used for either the
valid
> time or being off the grid. Let's look at where these temperature
exist.
> I ran the following command to plot their location:
> met-5.1/bin/plot_point_obs newtest.nc newtest.ps -gc 11 -v 3
>
> The "-gc 11" option says only plot temperature. The resulting image
is
> attached. Notice that none of them fall within your East Coast
domain.
> Also notice in the log output that these are all AIRCFT temperature
> observations! No ADPUPA and no ADPSFC.
>
> Since you're using GDAS observations, you should be aware of the
quality
> marker issue for surface observations noted at the bottom of this
page:
> http://www.dtcenter.org/met/users/downloads/observation_data.php
>
> To get Point-Stat running, I did the following steps:
>
> (1) Pull GDAS observations for 20150820_180000:
> wget
>
>
http://nomads.ncdc.noaa.gov/data/gdas/201508/20150820/gdas1.t18z.prepbufr.nr
>
> (2) Run PB2NC using the attached configuration file (note quality
marker =
> 9):
> met-5.1/bin/pb2nc gdas1.t18z.prepbufr.nr gdas1.t18z.prepbufr.nc
> PB2NCConfig_GDAS
>
> (3) Run Point-Stat using the data/config file you sent me:
> met-5.1/bin/point_stat nmbprs_d01.06 gdas1.t18z.prepbufr.nc
> PointStatConfig -outdir out -v 4
>
> And that give me 3584 matched pairs:
> DEBUG 3: Number of matched pairs = 3584
>
> So the problem was caused by the GDAS quality marker issue. Also
note that
> for North American grids, using NDAS (i.e. north american data
> assimilation) would work equally well and NDAS does *NOT* have this
quality
> marker issue.
>
> Lastly, I see the following warning when I run Point-Stat with your
data:
> WARNING:
> WARNING: gds_to_lambert() -> MET does not currently support Lambert
> Conformal grids where dx (3.317) != dy (2.97) and may produce
unexpected
> results!
> WARNING:
>
> I'd suggest post-processing to a different grid where Dx = Dy prior
to
> running MET.
>
> Hope that helps.
>
> Thanks,
> John
>
> On Fri, Mar 18, 2016 at 10:15 AM, Jose Garcia-Rivera via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> >
> > Dear John,
> >
> > I tried as you suggested, but still have empty output. I put the
files in
> > your ftp in 'garcia_data'
> >
> > The three files in the FTP are:
> >
> > newtest.nc
> > nmbprs_d01.06
> > PointStatConfig
> >
> >
> > Output:
> >
> > [garciaj at login prepbufr_obs]$ ./point_stat nmbprs_d01.06
newtest.nc
> > PointStatConfig_default
> > DEBUG 1: Default Config File:
> >
> /work/apps/pgi_14.10/SANDY/met-
5.1/share/met/config/PointStatConfig_default
> > DEBUG 1: User Config File: PointStatConfig_default
> > GSL_RNG_TYPE=mt19937
> > GSL_RNG_SEED=18446744071614164054
> > DEBUG 1: Forecast File: nmbprs_d01.06
> > DEBUG 1: Observation File: newtest.nc
> > DEBUG 2:
> > DEBUG 2:
> >
>
--------------------------------------------------------------------------------
> > DEBUG 2:
> > DEBUG 2: Reading data for TMP/Z2.
> > DEBUG 2: For TMP/Z2 found 1 forecast levels and 0 climatology
levels.
> > DEBUG 2:
> > DEBUG 2:
> >
>
--------------------------------------------------------------------------------
> > DEBUG 2:
> > DEBUG 2: Searching 949837 observations from 452408 messages.
> > DEBUG 2:
> > DEBUG 2:
> >
>
--------------------------------------------------------------------------------
> > DEBUG 2:
> > DEBUG 2: Processing TMP/Z2 versus TMP/Z2, for observation type
ADPSFC,
> > over region FULL, for interpolation method NEAREST(1), using 0
pairs.
> > DEBUG 2:
> > DEBUG 2:
> >
>
--------------------------------------------------------------------------------
> > DEBUG 2:
> > DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V.stat
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_fho.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_ctc.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_cts.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_mctc.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_mcts.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_cnt.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_sl1l2.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_sal1l2.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_vl1l2.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_val1l2.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_pct.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_pstd.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_pjc.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_prc.txt
> > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_mpr.txt
> >
> > From config file:
> >
> > fcst = {
> > message_type = [ "ADPSFC" ];
> > sid_exc = [];
> >
> > field = [
> > {
> > name = "TMP";
> > level = [ "Z2" ];
> > cat_thresh = [ >293.0 ];
> > }
> > ];
> >
> >
> > Thanks for the help,
> > Jose
> >
> >
> >
> > -----Original Message-----
> > From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> > Sent: Thursday, March 17, 2016 5:47 PM
> > To: Jose Garcia-Rivera
> > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR
to
> NetCDF
> >
> > Jose,
> >
> > I see that you're doing an upper-air (ADPUPA) evaluation for the
time
> > 20150820_180000. Upper-air observations are much more common at
00Z and
> > 12Z than 06Z and 18Z. Instead of verifying the 06 hour forecast
valid at
> > 18Z, please try the 12 hour forecast valid at 00Z.
> >
> > Also, you could try evaluating some surface fields against the
ADPSFC
> > message type.
> >
> > If you get stuck, you can post a sample forecast file to our
anonymous
> ftp
> > site, and I can try running it here.
> >
> > Thanks,
> > John
> >
> >
> >
> > On Thu, Mar 17, 2016 at 2:39 PM, Jose Garcia-Rivera via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> > >
> > > Dear John,
> > >
> > > It's great to hear from you again! Julie has been of great help.
We
> > > highly appreciate all the help coming from your team.
> > >
> > > I followed your recommendation, and got the following:
> > >
> > > [garciaj at login prepbufr_obs]$ ./point_stat -v 3 nmbprs_d01.06
> > > newtest.nc PointStatConfig_default DEBUG 1: Default Config File:
> > > /work/apps/pgi_14.10/SANDY/met-
5.1/share/met/config/PointStatConfig_de
> > > fault DEBUG 1: User Config File: PointStatConfig_default
> > > GSL_RNG_TYPE=mt19937
> > > GSL_RNG_SEED=1041230678
> > > DEBUG 1: Forecast File: nmbprs_d01.06
> > > DEBUG 1: Observation File: newtest.nc
> > > DEBUG 2:
> > > DEBUG 2:
> > >
----------------------------------------------------------------------
> > > ----------
> > > DEBUG 2:
> > > DEBUG 2: Reading data for SPFH/P500.
> > > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found range
match for
> > > VarInfo "SPFH/P500" in GRIB record 134 of GRIB file
"nmbprs_d01.06".
> > > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found 1 GRIB
records
> > > matching VarInfo "SPFH/P500" in GRIB file "nmbprs_d01.06".
> > > DEBUG 3: Use the matching forecast and observation grids.
> > > DEBUG 3: Grid Definition: Projection: Lambert Conformal Nx: 400
Ny:
> > > 400
> > > Lat_LL: 33.302 Lon_LL: 84.951 Lon_orient: 77.459 Alpha: 3781.822
Cone:
> > > 0.629 Bx: 210.6765 By: 2557.3266
> > > DEBUG 2: For SPFH/P500 found 1 forecast levels and 0 climatology
> levels.
> > > DEBUG 2:
> > > DEBUG 2:
> > >
----------------------------------------------------------------------
> > > ----------
> > > DEBUG 2:
> > > DEBUG 2: Reading data for TMP/P500.
> > > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found range
match for
> > > VarInfo "TMP/P500" in GRIB record 131 of GRIB file
"nmbprs_d01.06".
> > > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found 1 GRIB
records
> > > matching VarInfo "TMP/P500" in GRIB file "nmbprs_d01.06".
> > > DEBUG 2: For TMP/P500 found 1 forecast levels and 0 climatology
levels.
> > > DEBUG 2:
> > > DEBUG 2:
> > >
----------------------------------------------------------------------
> > > ----------
> > > DEBUG 2:
> > > DEBUG 2: Reading data for HGT/P500.
> > > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found range
match for
> > > VarInfo "HGT/P500" in GRIB record 130 of GRIB file
"nmbprs_d01.06".
> > > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found 1 GRIB
records
> > > matching VarInfo "HGT/P500" in GRIB file "nmbprs_d01.06".
> > > DEBUG 2: For HGT/P500 found 1 forecast levels and 0 climatology
levels.
> > > DEBUG 2:
> > > DEBUG 2:
> > >
----------------------------------------------------------------------
> > > ----------
> > > DEBUG 2:
> > > DEBUG 2: Reading data for UGRD/P500.
> > > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found range
match for
> > > VarInfo "UGRD/P500" in GRIB record 137 of GRIB file
"nmbprs_d01.06".
> > > DEBUG 3: MetGrib1DataFile::rotate_winds() -> Have U-wind record,
> > > reading V-wind record.
> > > DEBUG 3: MetGrib1DataFile::data_plane_scalar() -> Found exact
match
> > > for VarInfo "UGRD/P500" in GRIB record 138 of GRIB file
> "nmbprs_d01.06".
> > > DEBUG 3: Rotating U and V wind components from grid-relative to
> > > earth-relative.
> > > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found 1 GRIB
records
> > > matching VarInfo "UGRD/P500" in GRIB file "nmbprs_d01.06".
> > > DEBUG 2: For UGRD/P500 found 1 forecast levels and 0 climatology
> levels.
> > > DEBUG 2:
> > > DEBUG 2:
> > >
----------------------------------------------------------------------
> > > ----------
> > > DEBUG 2:
> > > DEBUG 2: Reading data for VGRD/P500.
> > > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found range
match for
> > > VarInfo "VGRD/P500" in GRIB record 138 of GRIB file
"nmbprs_d01.06".
> > > DEBUG 3: MetGrib1DataFile::rotate_winds() -> Have V-wind record,
> > > reading U-wind record.
> > > DEBUG 3: MetGrib1DataFile::data_plane_scalar() -> Found exact
match
> > > for VarInfo "VGRD/P500" in GRIB record 137 of GRIB file
> "nmbprs_d01.06".
> > > DEBUG 3: Rotating U and V wind components from grid-relative to
> > > earth-relative.
> > > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found 1 GRIB
records
> > > matching VarInfo "VGRD/P500" in GRIB file "nmbprs_d01.06".
> > > DEBUG 2: For VGRD/P500 found 1 forecast levels and 0 climatology
> levels.
> > > DEBUG 2:
> > > DEBUG 2:
> > >
----------------------------------------------------------------------
> > > ----------
> > > DEBUG 2:
> > > DEBUG 2: Searching 949837 observations from 452408 messages.
> > > DEBUG 2:
> > > DEBUG 2:
> > >
----------------------------------------------------------------------
> > > ----------
> > > DEBUG 2:
> > > DEBUG 2: Processing SPFH/P500 versus SPFH/P500, for observation
type
> > > ADPUPA, over region FULL, for interpolation method NEAREST(1),
using 0
> > > pairs.
> > > DEBUG 3: Number of matched pairs = 0
> > > DEBUG 3: Observations processed = 949837
> > > DEBUG 3: Rejected: SID exclusion = 0
> > > DEBUG 3: Rejected: GRIB code = 947898
> > > DEBUG 3: Rejected: valid time = 1416
> > > DEBUG 3: Rejected: bad obs value = 0
> > > DEBUG 3: Rejected: off the grid = 523
> > > DEBUG 3: Rejected: level mismatch = 0
> > > DEBUG 3: Rejected: quality marker = 0
> > > DEBUG 3: Rejected: message type = 0
> > > DEBUG 3: Rejected: masking region = 0
> > > DEBUG 3: Rejected: bad fcst value = 0
> > > DEBUG 3: Rejected: duplicates = 0
> > > DEBUG 2:
> > > DEBUG 2:
> > >
----------------------------------------------------------------------
> > > ----------
> > > DEBUG 2:
> > > DEBUG 2: Processing TMP/P500 versus TMP/P500, for observation
type
> > > ADPUPA, over region FULL, for interpolation method NEAREST(1),
using 0
> > pairs.
> > > DEBUG 3: Number of matched pairs = 0
> > > DEBUG 3: Observations processed = 949837
> > > DEBUG 3: Rejected: SID exclusion = 0
> > > DEBUG 3: Rejected: GRIB code = 943848
> > > DEBUG 3: Rejected: valid time = 4191
> > > DEBUG 3: Rejected: bad obs value = 0
> > > DEBUG 3: Rejected: off the grid = 1798
> > > DEBUG 3: Rejected: level mismatch = 0
> > > DEBUG 3: Rejected: quality marker = 0
> > > DEBUG 3: Rejected: message type = 0
> > > DEBUG 3: Rejected: masking region = 0
> > > DEBUG 3: Rejected: bad fcst value = 0
> > > DEBUG 3: Rejected: duplicates = 0
> > > DEBUG 2:
> > > DEBUG 2:
> > >
----------------------------------------------------------------------
> > > ----------
> > > DEBUG 2:
> > > DEBUG 2: Processing HGT/P500 versus HGT/P500, for observation
type
> > > ADPUPA, over region FULL, for interpolation method NEAREST(1),
using 0
> > pairs.
> > > DEBUG 3: Number of matched pairs = 0
> > > DEBUG 3: Observations processed = 949837
> > > DEBUG 3: Rejected: SID exclusion = 0
> > > DEBUG 3: Rejected: GRIB code = 606744
> > > DEBUG 3: Rejected: valid time = 319085
> > > DEBUG 3: Rejected: bad obs value = 0
> > > DEBUG 3: Rejected: off the grid = 23610
> > > DEBUG 3: Rejected: level mismatch = 395 DEBUG 3: Rejected:
quality
> > > marker = 0
> > > DEBUG 3: Rejected: message type = 3
> > > DEBUG 3: Rejected: masking region = 0
> > > DEBUG 3: Rejected: bad fcst value = 0
> > > DEBUG 3: Rejected: duplicates = 0
> > > DEBUG 2:
> > > DEBUG 2:
> > >
----------------------------------------------------------------------
> > > ----------
> > > DEBUG 2:
> > > DEBUG 2: Processing UGRD/P500 versus UGRD/P500, for observation
type
> > > ADPUPA, over region FULL, for interpolation method NEAREST(1),
using 0
> > > pairs.
> > > DEBUG 3: Number of matched pairs = 0
> > > DEBUG 3: Observations processed = 949837
> > > DEBUG 3: Rejected: SID exclusion = 0
> > > DEBUG 3: Rejected: GRIB code = 650429
> > > DEBUG 3: Rejected: valid time = 277745
> > > DEBUG 3: Rejected: bad obs value = 0
> > > DEBUG 3: Rejected: off the grid = 21341
> > > DEBUG 3: Rejected: level mismatch = 319 DEBUG 3: Rejected:
quality
> > > marker = 0
> > > DEBUG 3: Rejected: message type = 3
> > > DEBUG 3: Rejected: masking region = 0
> > > DEBUG 3: Rejected: bad fcst value = 0
> > > DEBUG 3: Rejected: duplicates = 0
> > > DEBUG 2:
> > > DEBUG 2:
> > >
----------------------------------------------------------------------
> > > ----------
> > > DEBUG 2:
> > > DEBUG 2: Processing VGRD/P500 versus VGRD/P500, for observation
type
> > > ADPUPA, over region FULL, for interpolation method NEAREST(1),
using 0
> > > pairs.
> > > DEBUG 3: Number of matched pairs = 0
> > > DEBUG 3: Observations processed = 949837
> > > DEBUG 3: Rejected: SID exclusion = 0
> > > DEBUG 3: Rejected: GRIB code = 650429
> > > DEBUG 3: Rejected: valid time = 277745
> > > DEBUG 3: Rejected: bad obs value = 0
> > > DEBUG 3: Rejected: off the grid = 21341
> > > DEBUG 3: Rejected: level mismatch = 319 DEBUG 3: Rejected:
quality
> > > marker = 0
> > > DEBUG 3: Rejected: message type = 3
> > > DEBUG 3: Rejected: masking region = 0
> > > DEBUG 3: Rejected: bad fcst value = 0
> > > DEBUG 3: Rejected: duplicates = 0
> > > DEBUG 2:
> > > DEBUG 2:
> > >
----------------------------------------------------------------------
> > > ----------
> > > DEBUG 2:
> > > DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V.stat
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_fho.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_ctc.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_cts.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_mctc.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_mcts.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_cnt.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_sl1l2.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_sal1l2.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_vl1l2.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_val1l2.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_pct.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_pstd.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_pjc.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_prc.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_mpr.txt
> > >
> > >
> > >
> > > Best Regards,
> > > Jose
> > >
> > >
> > >
> > >
> > >
> > > -----Original Message-----
> > > From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> > > Sent: Thursday, March 17, 2016 3:29 PM
> > > To: Jose Garcia-Rivera
> > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR
to
> > > NetCDF
> > >
> > > Hello Jose,
> > >
> > > Julie is out of the office today, but I should be able to help
you.
> > > Glad you were able to finally get PB2NC working. That was a
tricky
> > > one! But it helped us realize that since BUFRLIB has changed to
> > > FORTRAN 90, we should update the MET code which calls BUFRLIB to
be
> > compatible.
> > >
> > > I see that you are now getting 0 matched pairs when you run
Point-Stat
> > > with the output of PB2NC. Please try rerunning Point-Stat but
use a
> > > higher verbosity level, like "-v 3". That'll print out the
following
> > > type of counts for each of the verification tasks you've defined
in the
> > config file:
> > >
> > > DEBUG 3: Number of matched pairs = 312
> > > DEBUG 3: Observations processed = 87753
> > > DEBUG 3: Rejected: SID exclusion = 0
> > > DEBUG 3: Rejected: GRIB code = 77648
> > > DEBUG 3: Rejected: valid time = 0
> > > DEBUG 3: Rejected: bad obs value = 0
> > > DEBUG 3: Rejected: off the grid = 5
> > > DEBUG 3: Rejected: level mismatch = 9219 DEBUG 3: Rejected:
quality
> > > marker = 0
> > > DEBUG 3: Rejected: message type = 537
> > > DEBUG 3: Rejected: masking region = 32 DEBUG 3: Rejected: bad
fcst
> > > value = 0
> > > DEBUG 3: Rejected: duplicates = 0
> > >
> > > In the example above, 87753 observation values were checked and
the
> > > counts list reasons why there were not used for that task. Out
of
> > > those 87753 obs, 312 of them were used for this task.
> > >
> > > Looking at the counts from your Point-Stat run should help you
figure
> > > out why you have 0 matched pairs.
> > >
> > > Thanks,
> > > John
> > >
> > >
> > > On Thu, Mar 17, 2016 at 12:29 PM, Jose Garcia-Rivera via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
>
> > > >
> > > > Dear Julie,
> > > >
> > > > We got the executables to work! However, I have a couple of
> > > > issues/questions:
> > > >
> > > >
> > > >
> > > > Issue #1 --- Not getting values after running point_stat
> > > >
> > > > Everything seems to run fine. I attached the configuration
file. I
> > > > can send the three files via FTP if needed.
> > > >
> > > >
> > > >
> > > > Issue #2 --- PB2NC doesn't seem to finish the job, but it
does? I
> > > > had to do CTRL+C, and checked the netCDF file using
ncl_filedump:
> > > >
> > > > [garciaj at login prepbufr_obs]$ ./pb2nc
prepbufr.gdas.20150820.t18z.nr
> > > > newtest.nc PB2NCConfig_default DEBUG 1: Default Config File:
> > > > /work/apps/pgi_14.10/SANDY/met-
5.1/share/met/config/PB2NCConfig_defa
> > > > ul t DEBUG 1: User Config File: PB2NCConfig_default
> > > > DEBUG 1: Creating NetCDF File: newtest.nc
> > > > DEBUG 1: Processing PrepBufr File:
> prepbufr.gdas.20150820.t18z.nr
> > > > DEBUG 1: Blocking PrepBufr file to:
/tmp/tmp_pb2nc_blk_17703_0
> > > > DEBUG 2: PrepBufr Time Center: 20150820_180000
> > > > DEBUG 2: Searching Time Window: 20150820_163000 to
> > > 20150820_193000
> > > > DEBUG 2: Processing 685386 PrepBufr messages...
> > > > 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80%
85%
> > > > 90% 95% 100%
> > > > DEBUG 2: Total PrepBufr Messages processed = 685386
> > > > DEBUG 2: Rejected based on message type = 0
> > > > DEBUG 2: Rejected based on station id = 0
> > > > DEBUG 2: Rejected based on valid time = 185145
> > > > DEBUG 2: Rejected based on masking grid = 0
> > > > DEBUG 2: Rejected based on masking polygon = 0
> > > > DEBUG 2: Rejected based on elevation = 0
> > > > DEBUG 2: Rejected based on pb report type = 0
> > > > DEBUG 2: Rejected based on input report type = 0
> > > > DEBUG 2: Rejected based on instrument type = 0
> > > > DEBUG 2: Rejected based on zero observations = 47833
> > > > DEBUG 2: Total PrepBufr Messages retained = 452408
> > > > DEBUG 2: Total observations retained or derived = 949837 ^C
> > > >
> > > >
> > > > Checking netCDF file:
> > > >
> > > > [garciaj at login prepbufr_obs]$ ncl_filedump newtest.nc
Copyright (C)
> > > > 1995-2015 - All Rights Reserved University Corporation for
> > > > Atmospheric Research NCAR Command Language Version 6.3.0 The
use
> > > > of this software is governed by a License Agreement.
> > > > See http://www.ncl.ucar.edu/ for more details.
> > > >
> > > > Variable: f
> > > > Type: file
> > > > filename: newtest
> > > > path: newtest.nc
> > > > file global attributes:
> > > > FileOrigins : File newtest.nc generated 20160317_155548
UTC on
> > > > host login.local by the MET pb2nc tool
> > > > MET_version : V5.1
> > > > MET_tool : pb2nc
> > > > dimensions:
> > > > mxstr = 16
> > > > hdr_arr_len = 3
> > > > obs_arr_len = 5
> > > > nobs = 949837 // unlimited
> > > > nhdr = 452408
> > > > variables:
> > > > character obs_qty ( nobs, mxstr )
> > > > long_name : quality flag
> > > >
> > > > float obs_arr ( nobs, obs_arr_len )
> > > > long_name : array of observation values
> > > > _fill_value : -9999
> > > > columns : hdr_id gc lvl hgt ob
> > > > hdr_id_long_name : index of matching header data
> > > > gc_long_name : grib code corresponding to the
observation
> type
> > > > lvl_long_name : pressure level (hPa) or
accumulation
> > > > interval (sec)
> > > > hgt_long_name : height in meters above sea
level
> (msl)
> > > > ob_long_name : observation value
> > > >
> > > > character hdr_typ ( nhdr, mxstr )
> > > > long_name : message type
> > > >
> > > > character hdr_sid ( nhdr, mxstr )
> > > > long_name : station identification
> > > >
> > > > character hdr_vld ( nhdr, mxstr )
> > > > long_name : valid time
> > > > units : YYYYMMDD_HHMMSS
> > > >
> > > > float hdr_arr ( nhdr, hdr_arr_len )
> > > > long_name : array of observation station header
values
> > > > _fill_value : -9999
> > > > columns : lat lon elv
> > > > lat_long_name : latitude
> > > > lat_units : degrees_north
> > > > lon_long_name : longitude
> > > > lon_units : degrees_east
> > > > elv_long_name : elevation
> > > > elv_units : meters above sea level (msl)
> > > >
> > > >
> > > >
> > > >
> > > > Thanks for all the help,
> > > > Jose
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > > -----Original Message-----
> > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > Sent: Wednesday, March 16, 2016 4:40 PM
> > > > To: Jose Garcia-Rivera
> > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
PREPBUFR to
> > > > NetCDF
> > > >
> > > > Hi Jose. I apologize for the delay. This was a tricky
problem to
> > > > figure out, however, we were finally able to reproduce the
error you
> > > > are receiving for pb2nc.
> > > >
> > > > The problem is BUFRLIB being compiled with pgf90 and MET being
> > > > compiled with pgf77. They aren't talking well to each other.
> > > > BUFRLIBv10.1.0 compiles with pgf77 but later versions require
pgf90.
> > > >
> > > > We will plan on updating the MET Fortran code to compile with
pgf90
> > > > so that we can use newer BUFRLIB versions, but for now, to
solve
> > > > your problem, I have attached BUFRLIB_v10-1-0.tar. Please
install
> > > > that version of BUFRLIB using pgf77 and then recompile MET
without
> > > > the "LIBS" environment variable setting?
> > > >
> > > > Please let me know how that goes. We were able to get a
successful
> > > > run using that solution and hope you will too.
> > > >
> > > > Thanks,
> > > > Julie
> > > >
> > > >
> > > > On Wed, Mar 16, 2016 at 12:17 PM, Jose Garcia-Rivera via RT <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > > >
> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> > > > >
> > > > > Dear Julie,
> > > > >
> > > > > Is there anything that we can do here to sort these issues
out?
> > > > >
> > > > > Best Regards,
> > > > > Jose
> > > > >
> > > > > -----Original Message-----
> > > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > > Sent: Tuesday, March 15, 2016 5:08 PM
> > > > > To: Jose Garcia-Rivera
> > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
PREPBUFR
> > > > > to NetCDF
> > > > >
> > > > > Hi Jose. I was not. I got the same error you did. I
believe
> > > > > that the test.nc file is not in the correct format needed by
> > > > > point_stat, so I think we need to get pb2nc working for you.
It
> > > > > is likely a communication problem between the C code and the
> Fortran
> > code.
> > > > >
> > > > > Julie
> > > > >
> > > > > On Tue, Mar 15, 2016 at 3:05 PM, Jose Garcia-Rivera via RT <
> > > > > met_help at ucar.edu> wrote:
> > > > >
> > > > > >
> > > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> > > > > >
> > > > > > Dear Julie,
> > > > > >
> > > > > > Quick question: Were you able to run point_stat with the
netCDF
> > > > > > file that I sent yesterday?
> > > > > >
> > > > > > Thanks for the help,
> > > > > > Jose
> > > > > >
> > > > > > -----Original Message-----
> > > > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > > > Sent: Tuesday, March 15, 2016 12:17 PM
> > > > > > To: Jose Garcia-Rivera
> > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
PREPBUFR
> > > > > > to NetCDF
> > > > > >
> > > > > > Thank you, Jose. I'm working with co-workers to try to
get
> > > > > > these issues resolved. I hope to get back to you soon.
> > > > > >
> > > > > > Julie
> > > > > >
> > > > > > On Mon, Mar 14, 2016 at 1:36 PM, Jose Garcia-Rivera via RT
<
> > > > > > met_help at ucar.edu> wrote:
> > > > > >
> > > > > > >
> > > > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > > > >
> > > > > > >
> > > > > > > Dear Julie,
> > > > > > >
> > > > > > > I just uploaded the three files to 'garcia_data'.
> > > > > > >
> > > > > > > Thanks for the help,
> > > > > > > Jose
> > > > > > >
> > > > > > >
> > > > > > > -----Original Message-----
> > > > > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > > > > Sent: Monday, March 14, 2016 3:32 PM
> > > > > > > To: Jose Garcia-Rivera
> > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
> > > > > > > PREPBUFR to NetCDF
> > > > > > >
> > > > > > > Hi Jose.
> > > > > > >
> > > > > > > Yes, please upload your input files and configuration
file
> > > > > > > (nmbprs_d01.06, test.nc, PointStatConfig_default) to our
> > > > > > > anonymous ftp
> > > > > > site as follows:
> > > > > > > http://www.dtcenter.org/met/users/support/met_help.php
> > > > > > >
> > > > > > > Thanks!
> > > > > > >
> > > > > > > Julie
> > > > > > >
> > > > > > > On Mon, Mar 14, 2016 at 1:06 PM, Jose Garcia-Rivera via
RT <
> > > > > > > met_help at ucar.edu> wrote:
> > > > > > >
> > > > > > > >
> > > > > > > > <URL:
> > > > > > > >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > > > > >
> > > > > > > >
> > > > > > > > Dear Julie,
> > > > > > > >
> > > > > > > > I got to convert my prepbufr file using a python
script.
> > > > > > > > However, I have trouble running point_stat. Can I send
you
> > > > > > > > the files, to see if you have the same issue?
> > > > > > > >
> > > > > > > >
> > > > > > > > This is what I got:
> > > > > > > >
> > > > > > > > [garciaj at login prepbufr_obs]$ ./point_stat
nmbprs_d01.06
> > > > > > > > test.nc PointStatConfig_default DEBUG 1: Default
Config
> File:
> > > > > > > > /work/apps/pgi_14.10/SANDY/met-
5.1/share/met/config/PointSta
> > > > > > > > tC on fi g_ de fault DEBUG 1: User Config File:
> > > > > > > > PointStatConfig_default
> > > > > > > > GSL_RNG_TYPE=mt19937
> > > > > > > > GSL_RNG_SEED=18446744073425053526 DEBUG 1: Forecast
File:
> > > > > > > > nmbprs_d01.06 DEBUG 1: Observation File:
> > > > > > > > test.nc DEBUG 2:
> > > > > > > > DEBUG 2:
> > > > > > > >
------------------------------------------------------------
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > ----------
> > > > > > > > DEBUG 2:
> > > > > > > > DEBUG 2: Reading data for SPFH/P500.
> > > > > > > > DEBUG 2: For SPFH/P500 found 1 forecast levels and 0
> > > > > > > > climatology
> > > > > > levels.
> > > > > > > > DEBUG 2:
> > > > > > > > DEBUG 2:
> > > > > > > >
------------------------------------------------------------
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > ----------
> > > > > > > > DEBUG 2:
> > > > > > > > DEBUG 2: Reading data for TMP/P500.
> > > > > > > > DEBUG 2: For TMP/P500 found 1 forecast levels and 0
> > > > > > > > climatology
> > > > > levels.
> > > > > > > > DEBUG 2:
> > > > > > > > DEBUG 2:
> > > > > > > >
------------------------------------------------------------
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > ----------
> > > > > > > > DEBUG 2:
> > > > > > > > DEBUG 2: Reading data for HGT/P500.
> > > > > > > > DEBUG 2: For HGT/P500 found 1 forecast levels and 0
> > > > > > > > climatology
> > > > > levels.
> > > > > > > > DEBUG 2:
> > > > > > > > DEBUG 2:
> > > > > > > >
------------------------------------------------------------
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > ----------
> > > > > > > > DEBUG 2:
> > > > > > > > DEBUG 2: Reading data for UGRD/P500.
> > > > > > > > DEBUG 2: For UGRD/P500 found 1 forecast levels and 0
> > > > > > > > climatology
> > > > > > levels.
> > > > > > > > DEBUG 2:
> > > > > > > > DEBUG 2:
> > > > > > > >
------------------------------------------------------------
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > ----------
> > > > > > > > DEBUG 2:
> > > > > > > > DEBUG 2: Reading data for VGRD/P500.
> > > > > > > > DEBUG 2: For VGRD/P500 found 1 forecast levels and 0
> > > > > > > > climatology
> > > > > > levels.
> > > > > > > > DEBUG 2:
> > > > > > > > DEBUG 2:
> > > > > > > >
------------------------------------------------------------
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > ----------
> > > > > > > > DEBUG 2:
> > > > > > > > WARNING:
> > > > > > > > WARNING: process_obs_file() -> can't open observation
netCDF
> > > file:
> > > > > > > > test.nc
> > > > > > > > WARNING:
> > > > > > > > DEBUG 2:
> > > > > > > > DEBUG 2:
> > > > > > > >
------------------------------------------------------------
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > ----------
> > > > > > > > DEBUG 2:
> > > > > > > > DEBUG 2: Processing SPFH/P500 versus SPFH/P500, for
> > > > > > > > observation type ADPUPA, over region FULL, for
interpolation
> > > > > > > > method NEAREST(1), using
> > > > > > > > 0 pairs.
> > > > > > > > DEBUG 2:
> > > > > > > > DEBUG 2:
> > > > > > > >
------------------------------------------------------------
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > ----------
> > > > > > > > DEBUG 2:
> > > > > > > > DEBUG 2: Processing TMP/P500 versus TMP/P500, for
> > > > > > > > observation type ADPUPA, over region FULL, for
interpolation
> > > > > > > > method NEAREST(1), using
> > > > > > > > 0
> > > > > > > pairs.
> > > > > > > > DEBUG 2:
> > > > > > > > DEBUG 2:
> > > > > > > >
------------------------------------------------------------
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > ----------
> > > > > > > > DEBUG 2:
> > > > > > > > DEBUG 2: Processing HGT/P500 versus HGT/P500, for
> > > > > > > > observation type ADPUPA, over region FULL, for
interpolation
> > > > > > > > method NEAREST(1), using
> > > > > > > > 0
> > > > > > > pairs.
> > > > > > > > DEBUG 2:
> > > > > > > > DEBUG 2:
> > > > > > > >
------------------------------------------------------------
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > ----------
> > > > > > > > DEBUG 2:
> > > > > > > > DEBUG 2: Processing UGRD/P500 versus UGRD/P500, for
> > > > > > > > observation type ADPUPA, over region FULL, for
interpolation
> > > > > > > > method NEAREST(1), using
> > > > > > > > 0 pairs.
> > > > > > > > DEBUG 2:
> > > > > > > > DEBUG 2:
> > > > > > > >
------------------------------------------------------------
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > ----------
> > > > > > > > DEBUG 2:
> > > > > > > > DEBUG 2: Processing VGRD/P500 versus VGRD/P500, for
> > > > > > > > observation type ADPUPA, over region FULL, for
interpolation
> > > > > > > > method NEAREST(1), using
> > > > > > > > 0 pairs.
> > > > > > > > DEBUG 2:
> > > > > > > > DEBUG 2:
> > > > > > > >
------------------------------------------------------------
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > --
> > > > > > > > ----------
> > > > > > > > DEBUG 2:
> > > > > > > > DEBUG 1: Output file:
> > > > > > > > ./point_stat_060000L_20150820_180000V.stat
> > > > > > > > DEBUG 1: Output file:
> > > > > > > > ./point_stat_060000L_20150820_180000V_fho.txt
> > > > > > > > DEBUG 1: Output file:
> > > > > > > > ./point_stat_060000L_20150820_180000V_ctc.txt
> > > > > > > > DEBUG 1: Output file:
> > > > > > > > ./point_stat_060000L_20150820_180000V_cts.txt
> > > > > > > > DEBUG 1: Output file:
> > > > > > > > ./point_stat_060000L_20150820_180000V_mctc.txt
> > > > > > > > DEBUG 1: Output file:
> > > > > > > > ./point_stat_060000L_20150820_180000V_mcts.txt
> > > > > > > > DEBUG 1: Output file:
> > > > > > > > ./point_stat_060000L_20150820_180000V_cnt.txt
> > > > > > > > DEBUG 1: Output file:
> > > > > > > > ./point_stat_060000L_20150820_180000V_sl1l2.txt
> > > > > > > > DEBUG 1: Output file:
> > > > > > > > ./point_stat_060000L_20150820_180000V_sal1l2.txt
> > > > > > > > DEBUG 1: Output file:
> > > > > > > > ./point_stat_060000L_20150820_180000V_vl1l2.txt
> > > > > > > > DEBUG 1: Output file:
> > > > > > > > ./point_stat_060000L_20150820_180000V_val1l2.txt
> > > > > > > > DEBUG 1: Output file:
> > > > > > > > ./point_stat_060000L_20150820_180000V_pct.txt
> > > > > > > > DEBUG 1: Output file:
> > > > > > > > ./point_stat_060000L_20150820_180000V_pstd.txt
> > > > > > > > DEBUG 1: Output file:
> > > > > > > > ./point_stat_060000L_20150820_180000V_pjc.txt
> > > > > > > > DEBUG 1: Output file:
> > > > > > > > ./point_stat_060000L_20150820_180000V_prc.txt
> > > > > > > > DEBUG 1: Output file:
> > > > > > > > ./point_stat_060000L_20150820_180000V_mpr.txt
> > > > > > > >
> > > > > > > >
> > > > > > > > Thanks for the help,
> > > > > > > > Jose
> > > > > > > >
> > > > > > > >
> > > > > > > > -----Original Message-----
> > > > > > > > From: Julie Prestopnik via RT
[mailto:met_help at ucar.edu]
> > > > > > > > Sent: Monday, March 14, 2016 12:17 PM
> > > > > > > > To: Jose Garcia-Rivera
> > > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues
converting
> > > > > > > > PREPBUFR to NetCDF
> > > > > > > >
> > > > > > > > Hi Jose. I apologize for the delayed response. I was
out
> > > > > > > > of the office on Friday. I'm going to try to figure
out a
> > > > > > > > solution and get back with you shortly.
> > > > > > > >
> > > > > > > > Julie
> > > > > > > >
> > > > > > > > On Fri, Mar 11, 2016 at 2:02 PM, Jose Garcia-Rivera
via RT <
> > > > > > > > met_help at ucar.edu> wrote:
> > > > > > > >
> > > > > > > > >
> > > > > > > > > <URL:
> > > > > > > > >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > > > > > >
> > > > > > > > >
> > > > > > > > > Dear Julie,
> > > > > > > > >
> > > > > > > > > Any news regarding pb2nc? We're still unable to make
it
> work.
> > > > > > > > >
> > > > > > > > > Best Regards,
> > > > > > > > > Jose
> > > > > > > > >
> > > > > > > > > -----Original Message-----
> > > > > > > > > From: Julie Prestopnik via RT
[mailto:met_help at ucar.edu]
> > > > > > > > > Sent: Thursday, March 10, 2016 4:20 PM
> > > > > > > > > To: Jose Garcia-Rivera
> > > > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues
converting
> > > > > > > > > PREPBUFR to NetCDF
> > > > > > > > >
> > > > > > > > > Hi Jose. Thank you for attaching the files.
> > > > > > > > >
> > > > > > > > > Could you please send me a list of the files in
> > > > > > > > > /work/apps/pgi_14.10/SANDY/bufrlib/lib?
> > > > > > > > >
> > > > > > > > > Thank you!
> > > > > > > > >
> > > > > > > > > Julie
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > On Thu, Mar 10, 2016 at 12:20 PM, Jose Garcia-Rivera
via
> > > > > > > > > RT < met_help at ucar.edu> wrote:
> > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > <URL:
> > > > > > > > > >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > Dear Julie,
> > > > > > > > > >
> > > > > > > > > > The administrator re-compiled MET following your
> > > > > > > > > > instructions, and says there's still trouble. He
sent me
> > > > > > > > > > the log files
> > > > > > (attached).
> > > > > > > > > > Is there any other approach that might help?
> > > > > > > > > >
> > > > > > > > > > Best Regards,
> > > > > > > > > > Jose
> > > > > > > > > >
> > > > > > > > > > -----Original Message-----
> > > > > > > > > > From: Julie Prestopnik via RT
[mailto:met_help at ucar.edu]
> > > > > > > > > > Sent: Wednesday, March 09, 2016 12:39 PM
> > > > > > > > > > To: Jose Garcia-Rivera
> > > > > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues
converting
> > > > > > > > > > PREPBUFR to NetCDF
> > > > > > > > > >
> > > > > > > > > > Thank you, Jose! It looks like something went
wrong
> > > > > > > > > > during
> > > > > > > > compilation.
> > > > > > > > > > I suggest recompiling MET to see if we can get
this
> > > > > > > > > > issue
> > > > > resolved.
> > > > > > > > > > NCEP's BUFRLIB is used by the pb2nc MET tool, and
is a
> > > > > > > > > > required external library for pb2nc. MET is not
yet
> > > > > > > > > > compatible with BUFRLIB
> > > > > > > > > version 11.0.0, so we
> > > > > > > > > > suggest getting version 10.2.3. We are working
on our
> > > online
> > > > > > > tutorial
> > > > > > > > > for
> > > > > > > > > > METv.5.1, but in the meantime, I'll point you to
our
> > > > > > > > > > online tutorial directions for installing BUFRLIB:
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > >
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.
> > > > > > > > > > 0/
> > > > > > > > > > co
> > > > > > > > > > mp
> > > > > > > > > > ilation/req_libs.php
> > > > > > > > > >
> > > > > > > > > > It is also important to review the necessary
environment
> > > > > > > > > > variables to
> > > > > > > > > set:
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > >
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.
> > > > > > > > > > 0/
> > > > > > > > > > co
> > > > > > > > > > mp
> > > > > > > > > > ilation/configure.php
> > > > > > > > > >
> > > > > > > > > > For example,
> > > > > > > > > >
> > > > > > > > > > "Set *$MET_BUFR* to point to the main BUFR
directory, or
> > > > > > > > > > set
> > > > > > > > > > *$MET_BUFRLIB* to point to the directory with the
BUFR
> > > > > > > > > > library
> > > > > > files.
> > > > > > > > > > Because MET doesn't use any BUFR library include
files,
> > > > > > > > > > you don't need to specify *$MET_BUFRINC* ."
> > > > > > > > > >
> > > > > > > > > > Once you've installed the required libraries and
set up
> > > > > > > > > > your environment variables, you'll be ready to
configure
> > > > > > > > > > MET (instructions at the bottom of the last link
above)
> > > > > > > > > > and then compile and install MET (
> > > > > > > > > >
> > > >
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.
> > > > > > > > > > 0/
> > > > > > > > > > co
> > > > > > > > > > mp
> > > > > > > > > > ilation/compile.php
> > > > > > > > > > ).
> > > > > > > > > > After re-installing MET, please run "make test"
again.
> > > > > > > > > > If you still encounter the same problem, please
send me
> > > > > > > > > > your
> > > > > > > > > > *config.log* file and your *make_install.log
*file.
> > > > > > > > > > Please let me know if you have any
> > > > > > > > > questions.
> > > > > > > > > >
> > > > > > > > > > Please let us know how it goes.
> > > > > > > > > >
> > > > > > > > > > Thanks,
> > > > > > > > > > Julie
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > On Wed, Mar 9, 2016 at 10:22 AM, Jose Garcia-
Rivera via
> > > > > > > > > > RT < met_help at ucar.edu> wrote:
> > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > <URL:
> > > > > > > > > > >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=7543
> > > > > > > > > > > 3
> > > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > Dear Julie,
> > > > > > > > > > >
> > > > > > > > > > > Attached is the test log file. It's showing the
same
> > > > > > > > > > > issues on pb2nc even with the sample files.
> > > > > > > > > > >
> > > > > > > > > > > Best Regards,
> > > > > > > > > > > Jose
> > > > > > > > > > >
> > > > > > > > > > > -----Original Message-----
> > > > > > > > > > > From: Julie Prestopnik via RT
> > > > > > > > > > > [mailto:met_help at ucar.edu]
> > > > > > > > > > > Sent: Tuesday, March 08, 2016 5:28 PM
> > > > > > > > > > > To: Jose Garcia-Rivera
> > > > > > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues
> > > > > > > > > > > converting PREPBUFR to NetCDF
> > > > > > > > > > >
> > > > > > > > > > > Hi Jose. Thank you for uploading the files.
> > > > > > > > > > > Unfortunately, I am unable to reproduce the
error you
> > > > > > > > > > > are experiencing. I am wondering if you have
> > > > > > > > > > > successfully used pb2nc before. As a check
could you
> > > > > > > > > > > please run the following in your met-5.1/
> > > > > > > directory:
> > > > > > > > > > >
> > > > > > > > > > > *make test >& make_test.log*
> > > > > > > > > > >
> > > > > > > > > > > and then send me the make_test.log file?
> > > > > > > > > > >
> > > > > > > > > > > Thanks,
> > > > > > > > > > > Julie
> > > > > > > > > > >
> > > > > > > > > > > On Tue, Mar 8, 2016 at 11:29 AM, Jose Garcia-
Rivera
> > > > > > > > > > > via RT < met_help at ucar.edu> wrote:
> > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > <URL:
> > > > > > > > > > > >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75
> > > > > > > > > > > > 43
> > > > > > > > > > > > 3
> > > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > Dear Julie,
> > > > > > > > > > > >
> > > > > > > > > > > > I just put the files in 'garcia_data'. I
appreciate
> > > > > > > > > > > > your
> > > > > help.
> > > > > > > > > > > >
> > > > > > > > > > > > Best Regards,
> > > > > > > > > > > > Jose
> > > > > > > > > > > >
> > > > > > > > > > > > -----Original Message-----
> > > > > > > > > > > > From: Julie Prestopnik via RT
> > > > > > > > > > > > [mailto:met_help at ucar.edu]
> > > > > > > > > > > > Sent: Tuesday, March 08, 2016 1:12 PM
> > > > > > > > > > > > To: Jose Garcia-Rivera
> > > > > > > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues
> > > > > > > > > > > > converting PREPBUFR to NetCDF
> > > > > > > > > > > >
> > > > > > > > > > > > Hi Jose. I'm sorry to hear that you are having
> > > > > > > > > > > > problems converting a PREPBUFR file to NetCDF.
> > > > > > > > > > > >
> > > > > > > > > > > > Please upload your input files and
configuration
> > > > > > > > > > > > file to our anonymous ftp site as follows:
> > > > > > > > > > > >
http://www.dtcenter.org/met/users/support/met_help.p
> > > > > > > > > > > > hp
> > > > > > > > > > > >
> > > > > > > > > > > > Then I can take a look and get back to you.
> > > > > > > > > > > >
> > > > > > > > > > > > Thanks,
> > > > > > > > > > > > Julie
> > > > > > > > > > > >
> > > > > > > > > > > > On Tue, Mar 8, 2016 at 11:01 AM, Jose Garcia-
Rivera
> > > > > > > > > > > > via RT < met_help at ucar.edu> wrote:
> > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > > Tue Mar 08 11:01:25 2016: Request 75433 was
acted
> > upon.
> > > > > > > > > > > > > Transaction: Ticket created by
GarciaJ at imsg.com
> > > > > > > > > > > > > Queue: met_help
> > > > > > > > > > > > > Subject: Issues converting PREPBUFR to
NetCDF
> > > > > > > > > > > > > Owner: Nobody
> > > > > > > > > > > > > Requestors: GarciaJ at imsg.com
> > > > > > > > > > > > > Status: new
> > > > > > > > > > > > > Ticket <URL:
> > > > > > > > > > > > >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=
> > > > > > > > > > > > > 75
> > > > > > > > > > > > > 43
> > > > > > > > > > > > > 3
> > > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > > Dear Met Help,
> > > > > > > > > > > > >
> > > > > > > > > > > > > Trying to convert a PREPBUFR file to NetCDF.
> > > > > > > > > > > > >
> > > > > > > > > > > > > I used the default PB2NC configure file, and
got
> > > > > > > > > > > > > the
> > > > > > following:
> > > > > > > > > > > > >
> > > > > > > > > > > > > [garciaj at login prepbufr_obs]$ ./pb2nc
> > > > > > > > > > > > > gdas1.t12z.prepbufr.nr gdas.20150820.t12z.nc
> > > > > > > > > > > > > PB2NCConfig_default DEBUG 1: Default Config
> > > > > > > > > > > > > File:
> > > > > > > > > > > > > /work/apps/pgi_14.10/met-
5.1/share/met/config/PB2N
> > > > > > > > > > > > > CC on fi g_ de fa ul t DEBUG 1: User Config
File:
> > > > > > > > > > > > > PB2NCConfig_default DEBUG 1: Creating NetCDF
File:
> > > > > > gdas.20150820.t12z.nc
> > > > > > > > > > > > > DEBUG 1: Processing PrepBufr File:
> > > > > > gdas1.t12z.prepbufr.nr
> > > > > > > > > > > > > DEBUG 1: Blocking PrepBufr file to:
> > > > > > > > /tmp/tmp_pb2nc_blk_32144_0
> > > > > > > > > > > > > WARNING:
> > > > > > > > > > > > > WARNING: process_pbfile() -> No PrepBufr
messages
> > > > > > > > > > > > > to process in
> > > > > > > > > file:
> > > > > > > > > > > > > gdas1.t12z.prepbufr.nr
> > > > > > > > > > > > > WARNING:
> > > > > > > > > > > > > ERROR :
> > > > > > > > > > > > > ERROR : write_netcdf_hdr_data() -> No
PrepBufr
> > > > > > > > > > > > > messages
> > > > > > > > retained.
> > > > > > > > > > > > > Nothing to write.
> > > > > > > > > > > > > ERROR :
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > > Thanks in advance for the help, Jose M.
> > > > > > > > > > > > > Garcia-Rivera, PhD IM Systems Group
> > > > > > > > > > > > > Rockville/College Park, MD This e-mail,
including
> > > > > > > > > > > > > attachments, may include confidential and/or
> > > > > > > > > > > > > proprietary information, and may be used
only by
> > > > > > > > > > > > > the person or entity to which it is
addressed. If
> > > > > > > > > > > > > the reader of this e-mail is not the
intended
> > > > > > > > > > > > > recipient or his or her authorized agent,
the
> > > > > > > > > > > > > reader is hereby notified that any
dissemination,
> > > > > > > > > > > > > distribution or
> > > copying of this e-mail is prohibited.
> > > > > > > > > > > > > If you have received this e-mail in error,
please
> > > > > > > > > > > > > notify the sender by replying to this
message and
> > > > > > > > > > > > > delete this
> > > > > > > > > > > > e-mail immediately.
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > --
> > > > > > > > > > > > Julie Prestopnik
> > > > > > > > > > > > National Center for Atmospheric Research
Research
> > > > > > > > > > > > Applications Laboratory
> > > > > > > > > > > > Phone: 303.497.8399
> > > > > > > > > > > > Email: jpresto at ucar.edu
> > > > > > > > > > > >
> > > > > > > > > > > > This e-mail, including attachments, may
include
> > > > > > > > > > > > confidential and/or proprietary information,
and may
> > > > > > > > > > > > be used only by the person or entity to which
it is
> > > > > > > > > > > > addressed. If the reader of this e-mail is not
the
> > > > > > > > > > > > intended recipient or his or her authorized
agent,
> > > > > > > > > > > > the reader is hereby notified that any
> > > > > > > > > > > > dissemination, distribution or copying of this
e-mail
> > is prohibited.
> > > > > > > > > > > > If you have received this e-mail in error,
please
> > > > > > > > > > > > notify the sender by replying to this message
and
> > > > > > > > > > > > delete this
> > > > > > > > > > > e-mail immediately.
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > --
> > > > > > > > > > > Julie Prestopnik
> > > > > > > > > > > National Center for Atmospheric Research
Research
> > > > > > > > > > > Applications Laboratory
> > > > > > > > > > > Phone: 303.497.8399
> > > > > > > > > > > Email: jpresto at ucar.edu
> > > > > > > > > > >
> > > > > > > > > > > This e-mail, including attachments, may include
> > > > > > > > > > > confidential and/or proprietary information, and
may
> > > > > > > > > > > be used only by the person or entity to which it
is
> > > > > > > > > > > addressed. If the reader of this e-mail is not
the
> > > > > > > > > > > intended recipient or his or her authorized
agent, the
> > > > > > > > > > > reader is hereby notified that any
dissemination,
> > > > > > > > > > > distribution or copying of this e-mail is
prohibited.
> > > > > > > > > > > If you have received this e-mail in error,
please
> > > > > > > > > > > notify the sender by replying to this message
and
> > > > > > > > > > > delete this
> > > > > > > > > > e-mail immediately.
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > --
> > > > > > > > > > Julie Prestopnik
> > > > > > > > > > National Center for Atmospheric Research Research
> > > > > > > > > > Applications Laboratory
> > > > > > > > > > Phone: 303.497.8399
> > > > > > > > > > Email: jpresto at ucar.edu
> > > > > > > > > >
> > > > > > > > > > This e-mail, including attachments, may include
> > > > > > > > > > confidential and/or proprietary information, and
may be
> > > > > > > > > > used only by the person or entity to which it is
> > > > > > > > > > addressed. If the reader of this e-mail is not the
> > > > > > > > > > intended recipient or his or her authorized agent,
the
> > > > > > > > > > reader is hereby notified that any dissemination,
> > > > > > > > > > distribution or copying of this e-mail is
prohibited. If
> > > > > > > > > > you have received this e-mail in error, please
notify
> > > > > > > > > > the sender by replying to this message and delete
this
> > > > > > > > > e-mail immediately.
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > --
> > > > > > > > > Julie Prestopnik
> > > > > > > > > National Center for Atmospheric Research Research
> > > > > > > > > Applications Laboratory
> > > > > > > > > Phone: 303.497.8399
> > > > > > > > > Email: jpresto at ucar.edu
> > > > > > > > >
> > > > > > > > > This e-mail, including attachments, may include
> > > > > > > > > confidential and/or proprietary information, and may
be
> > > > > > > > > used only by the person or entity to which it is
> > > > > > > > > addressed. If the reader of this e-mail is not the
> > > > > > > > > intended recipient or his or her authorized agent,
the
> > > > > > > > > reader is hereby notified that any dissemination,
> > > > > > > > > distribution or copying of this e-mail is
prohibited. If
> > > > > > > > > you have received this e-mail in error, please
notify the
> > > > > > > > > sender by replying to this message and delete this
> > > > > > > > e-mail immediately.
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > --
> > > > > > > > Julie Prestopnik
> > > > > > > > National Center for Atmospheric Research Research
> > > > > > > > Applications Laboratory
> > > > > > > > Phone: 303.497.8399
> > > > > > > > Email: jpresto at ucar.edu
> > > > > > > >
> > > > > > > > This e-mail, including attachments, may include
confidential
> > > > > > > > and/or proprietary information, and may be used only
by the
> > > > > > > > person or entity to which it is addressed. If the
reader of
> > > > > > > > this e-mail is not the intended recipient or his or
her
> > > > > > > > authorized agent, the reader is hereby notified that
any
> > > > > > > > dissemination, distribution or copying of this e-mail
is
> > > > > > > > prohibited. If you have received this e-mail in error,
> > > > > > > > please notify the sender by replying to this message
and
> > > > > > > > delete this
> > > > > > > e-mail immediately.
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > --
> > > > > > > Julie Prestopnik
> > > > > > > National Center for Atmospheric Research Research
Applications
> > > > > > > Laboratory
> > > > > > > Phone: 303.497.8399
> > > > > > > Email: jpresto at ucar.edu
> > > > > > >
> > > > > > > This e-mail, including attachments, may include
confidential
> > > > > > > and/or proprietary information, and may be used only by
the
> > > > > > > person or entity to which it is addressed. If the reader
of
> > > > > > > this e-mail is not the intended recipient or his or her
> > > > > > > authorized agent, the reader is hereby notified that any
> > > > > > > dissemination, distribution or copying of this e-mail is
> > > > > > > prohibited. If you have received this e-mail in error,
please
> > > > > > > notify the sender by replying to this message and delete
this
> > > > > > e-mail immediately.
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > >
> > > > > >
> > > > > > --
> > > > > > Julie Prestopnik
> > > > > > National Center for Atmospheric Research Research
Applications
> > > > > > Laboratory
> > > > > > Phone: 303.497.8399
> > > > > > Email: jpresto at ucar.edu
> > > > > >
> > > > > > This e-mail, including attachments, may include
confidential
> > > > > > and/or proprietary information, and may be used only by
the
> > > > > > person or entity to which it is addressed. If the reader
of this
> > > > > > e-mail is not the intended recipient or his or her
authorized
> > > > > > agent, the reader is hereby notified that any
dissemination,
> > > > > > distribution or copying of this e-mail is prohibited. If
you
> > > > > > have received this e-mail in error, please notify the
sender by
> > > > > > replying to this message and delete this
> > > > > e-mail immediately.
> > > > > >
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > > > --
> > > > > Julie Prestopnik
> > > > > National Center for Atmospheric Research Research
Applications
> > > > > Laboratory
> > > > > Phone: 303.497.8399
> > > > > Email: jpresto at ucar.edu
> > > > >
> > > > > This e-mail, including attachments, may include confidential
> > > > > and/or proprietary information, and may be used only by the
person
> > > > > or entity to which it is addressed. If the reader of this e-
mail
> > > > > is not the intended recipient or his or her authorized
agent, the
> > > > > reader is hereby notified that any dissemination,
distribution or
> > > > > copying of this e-mail is prohibited. If you have received
this
> > > > > e-mail in error, please notify the sender by replying to
this
> > > > > message and delete this
> > > > e-mail immediately.
> > > > >
> > > > >
> > > > >
> > > >
> > > >
> > > > --
> > > > Julie Prestopnik
> > > > National Center for Atmospheric Research Research Applications
> > > > Laboratory
> > > > Phone: 303.497.8399
> > > > Email: jpresto at ucar.edu
> > > >
> > > > This e-mail, including attachments, may include confidential
and/or
> > > > proprietary information, and may be used only by the person or
> > > > entity to which it is addressed. If the reader of this e-mail
is not
> > > > the intended recipient or his or her authorized agent, the
reader is
> > > > hereby notified that any dissemination, distribution or
copying of
> > > > this e-mail is prohibited. If you have received this e-mail in
> > > > error, please notify the sender by replying to this message
and
> > > > delete this
> > > e-mail immediately.
> > > >
> > > >
> > >
> > > This e-mail, including attachments, may include confidential
and/or
> > > proprietary information, and may be used only by the person or
entity
> > > to which it is addressed. If the reader of this e-mail is not
the
> > > intended recipient or his or her authorized agent, the reader is
> > > hereby notified that any dissemination, distribution or copying
of
> > > this e-mail is prohibited. If you have received this e-mail in
error,
> > > please notify the sender by replying to this message and delete
this
> > e-mail immediately.
> > >
> > >
> > >
> >
> > This e-mail, including attachments, may include confidential
and/or
> > proprietary information, and may be used only by the person or
entity to
> > which it is addressed. If the reader of this e-mail is not the
intended
> > recipient or his or her authorized agent, the reader is hereby
notified
> > that any dissemination, distribution or copying of this e-mail is
> > prohibited. If you have received this e-mail in error, please
notify the
> > sender by replying to this message and delete this e-mail
immediately.
> >
> >
> >
>
> This e-mail, including attachments, may include confidential and/or
> proprietary information, and may be used only by the person or
entity to
> which it is addressed. If the reader of this e-mail is not the
intended
> recipient or his or her authorized agent, the reader is hereby
notified
> that any dissemination, distribution or copying of this e-mail is
> prohibited. If you have received this e-mail in error, please notify
the
> sender by replying to this message and delete this e-mail
immediately.
>
>
>
This e-mail, including attachments, may include confidential and/or
proprietary information, and may be used only by the person or entity
to which it is addressed. If the reader of this e-mail is not the
intended recipient or his or her authorized agent, the reader is
hereby notified that any dissemination, distribution or copying of
this e-mail is prohibited. If you have received this e-mail in error,
please notify the sender by replying to this message and delete this
e-mail immediately.
------------------------------------------------
Subject: Issues converting PREPBUFR to NetCDF
From: John Halley Gotway
Time: Fri Mar 18 15:32:25 2016
Jose,
Unfortunately, no, there isn't. We have enhanced other places in MET
to
support manually defining a grid or passing in a gridded data file to
define the grid. But PB2NC currently doesn't support that.
However, you could easily use polyline masking and it should work just
as
well. Just pick 4 lat/lon corner points and write to a file. Then
set the
following in the PB2NC config file:
poly = "eastern_us.poly";
Where eastern_us.poly would contain something like this:
-----------------------
EASTERN_US
20.0 -110.0
60.0 -110.0
60.0 -50.0
20.0 -50.0
-----------------------
Only observations falling within this lat/lon box will be retained.
And
those values could easily be changed for use over Africa.
Thanks,
John
On Fri, Mar 18, 2016 at 3:06 PM, Jose Garcia-Rivera via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
>
> Dear John,
>
> Update: point_stat worked with the converted file that you
produced.
>
>
> This is a question from the previous e-mail I sent you:
>
> Is there a way of me specifying any specific grid or region when
running
> pb2nc? I ask because I can use my own model output grid. For
example:
>
> 255 3 400 400 33302 -84951 8 -77459 3317 2970 0 64 38947
38947
> 44033 -68740
>
> I ask, because we are going to have a domain over Asia.
>
>
> Thanks for the help,
> Jose
>
>
>
>
> -----Original Message-----
> From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> Sent: Friday, March 18, 2016 4:08 PM
> To: Jose Garcia-Rivera
> Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to
NetCDF
>
> Jose,
>
> Ah OK, I suspect that exiting the PB2NC command early is the
problem.
> While PB2NC did create an output file, you probably killed it before
it
> finished writing out all the observations.
>
> This same issue actually came up recently when running on the NCAR
> supercomputer, Yellowstone. PB2NC finishes processing the
observations in
> a few minutes, but takes multiple hours to write the output NetCDF
file.
>
> The same step takes about 2 seconds on my desktop machine, but 2
hours on
> Yellowstone! So that's an open issue we need to investigate
further.
>
> For your needs, please do the following:
>
> (1) I posted my PB2NC output file to our ftp site:
>
>
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/for_garcia/gdas1.t18z.prepbufr.nc
>
> Please grab it and verify that when you use it in your Point-Stat
runs, you
> actually do get matched pairs.
>
> (2) Try rerunning PB2NC yourself, but this time set the following in
your
> PB2NC config file:
> mask = "G212";
>
> That will filter the observations and only keep the ones which fall
within
> this pre-defined NCEP Grid:
> http://www.nco.ncep.noaa.gov/pmb/docs/on388/grids/grid212.gif
>
> That should result in 293763 observations instead of 1330661 of
them.
> Perhaps PB2NC will run in a more reasonable time.
>
> But in the long run of course, we'll need to figure out why PB2NC is
so
> slow and fix it!
>
> Thanks,
> John
>
>
> (2)
>
> On Fri, Mar 18, 2016 at 12:58 PM, Jose Garcia-Rivera via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> >
> > Dear John,
> >
> > I modified the config file for pb2nc, and still have the same
issue. I
> > uploaded these two files to 'garcia_data'
> >
> > 3km_nmbprs_d01.06
> > newtest.nc
> >
> > I don’t need to change the quality flag in the point_stat
configuration
> > file, right?
> >
> > One extra thing to mention: I had to type CNTL+C to exit pb2nc,
since it
> > seemed to stay stuck on a loop,,, yet I got the netcdf file. This
> happened
> > every time:
> >
> > [garciaj at login prepbufr_obs]$ ./pb2nc gdas1.t18z.prepbufr.nr
newtest.nc
> > PB2NCConfig_default
> > DEBUG 1: Default Config File:
> > /work/apps/pgi_14.10/SANDY/met-
5.1/share/met/config/PB2NCConfig_default
> > DEBUG 1: User Config File: PB2NCConfig_default
> > DEBUG 1: Creating NetCDF File: newtest.nc
> > DEBUG 1: Processing PrepBufr File: gdas1.t18z.prepbufr.nr
> > DEBUG 1: Blocking PrepBufr file to: /tmp/tmp_pb2nc_blk_50363_0
> > DEBUG 2: PrepBufr Time Center: 20150820_180000
> > DEBUG 2: Searching Time Window: 20150820_163000 to
> 20150820_193000
> > DEBUG 2: Processing 685386 PrepBufr messages...
> > 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85%
90%
> 95%
> > 100%
> > DEBUG 2: Total PrepBufr Messages processed = 685386
> > DEBUG 2: Rejected based on message type = 0
> > DEBUG 2: Rejected based on station id = 0
> > DEBUG 2: Rejected based on valid time = 185145
> > DEBUG 2: Rejected based on masking grid = 0
> > DEBUG 2: Rejected based on masking polygon = 0
> > DEBUG 2: Rejected based on elevation = 0
> > DEBUG 2: Rejected based on pb report type = 0
> > DEBUG 2: Rejected based on input report type = 0
> > DEBUG 2: Rejected based on instrument type = 0
> > DEBUG 2: Rejected based on zero observations = 11135
> > DEBUG 2: Total PrepBufr Messages retained = 489106
> > DEBUG 2: Total observations retained or derived = 1330661
> >
> > ^C
> >
> >
> >
> > Thanks for the help,
> > Jose
> >
> > -----Original Message-----
> > From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> > Sent: Friday, March 18, 2016 1:01 PM
> > To: Jose Garcia-Rivera
> > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR
to
> NetCDF
> >
> > Jose,
> >
> > Thanks for sending the test data. I see that your model data is
valid at
> > time 20150820_180000. When I run Point-Stat, I see the following
reason
> > counts in the output:
> >
> > DEBUG 2: Processing TMP/Z2 versus TMP/Z2, for observation type
ADPSFC,
> over
> > region FULL, for interpolation method NEAREST(1), using 0 pairs.
> > DEBUG 3: Number of matched pairs = 0
> > DEBUG 3: Observations processed = 949837
> > DEBUG 3: Rejected: SID exclusion = 0
> > DEBUG 3: Rejected: GRIB code = 943848
> > DEBUG 3: Rejected: valid time = 4191
> > DEBUG 3: Rejected: bad obs value = 0
> > DEBUG 3: Rejected: off the grid = 1798
> > DEBUG 3: Rejected: level mismatch = 0
> > DEBUG 3: Rejected: quality marker = 0
> > DEBUG 3: Rejected: message type = 0
> > DEBUG 3: Rejected: masking region = 0
> > DEBUG 3: Rejected: bad fcst value = 0
> > DEBUG 3: Rejected: duplicates = 0
> >
> > So it looks like several observations are not used for either the
valid
> > time or being off the grid. Let's look at where these temperature
exist.
> > I ran the following command to plot their location:
> > met-5.1/bin/plot_point_obs newtest.nc newtest.ps -gc 11 -v 3
> >
> > The "-gc 11" option says only plot temperature. The resulting
image is
> > attached. Notice that none of them fall within your East Coast
domain.
> > Also notice in the log output that these are all AIRCFT
temperature
> > observations! No ADPUPA and no ADPSFC.
> >
> > Since you're using GDAS observations, you should be aware of the
quality
> > marker issue for surface observations noted at the bottom of this
page:
> >
http://www.dtcenter.org/met/users/downloads/observation_data.php
> >
> > To get Point-Stat running, I did the following steps:
> >
> > (1) Pull GDAS observations for 20150820_180000:
> > wget
> >
> >
>
http://nomads.ncdc.noaa.gov/data/gdas/201508/20150820/gdas1.t18z.prepbufr.nr
> >
> > (2) Run PB2NC using the attached configuration file (note quality
marker
> =
> > 9):
> > met-5.1/bin/pb2nc gdas1.t18z.prepbufr.nr
gdas1.t18z.prepbufr.nc
> > PB2NCConfig_GDAS
> >
> > (3) Run Point-Stat using the data/config file you sent me:
> > met-5.1/bin/point_stat nmbprs_d01.06 gdas1.t18z.prepbufr.nc
> > PointStatConfig -outdir out -v 4
> >
> > And that give me 3584 matched pairs:
> > DEBUG 3: Number of matched pairs = 3584
> >
> > So the problem was caused by the GDAS quality marker issue. Also
note
> that
> > for North American grids, using NDAS (i.e. north american data
> > assimilation) would work equally well and NDAS does *NOT* have
this
> quality
> > marker issue.
> >
> > Lastly, I see the following warning when I run Point-Stat with
your data:
> > WARNING:
> > WARNING: gds_to_lambert() -> MET does not currently support
Lambert
> > Conformal grids where dx (3.317) != dy (2.97) and may produce
unexpected
> > results!
> > WARNING:
> >
> > I'd suggest post-processing to a different grid where Dx = Dy
prior to
> > running MET.
> >
> > Hope that helps.
> >
> > Thanks,
> > John
> >
> > On Fri, Mar 18, 2016 at 10:15 AM, Jose Garcia-Rivera via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> > >
> > > Dear John,
> > >
> > > I tried as you suggested, but still have empty output. I put the
files
> in
> > > your ftp in 'garcia_data'
> > >
> > > The three files in the FTP are:
> > >
> > > newtest.nc
> > > nmbprs_d01.06
> > > PointStatConfig
> > >
> > >
> > > Output:
> > >
> > > [garciaj at login prepbufr_obs]$ ./point_stat nmbprs_d01.06
newtest.nc
> > > PointStatConfig_default
> > > DEBUG 1: Default Config File:
> > >
> >
> /work/apps/pgi_14.10/SANDY/met-
5.1/share/met/config/PointStatConfig_default
> > > DEBUG 1: User Config File: PointStatConfig_default
> > > GSL_RNG_TYPE=mt19937
> > > GSL_RNG_SEED=18446744071614164054
> > > DEBUG 1: Forecast File: nmbprs_d01.06
> > > DEBUG 1: Observation File: newtest.nc
> > > DEBUG 2:
> > > DEBUG 2:
> > >
> >
>
--------------------------------------------------------------------------------
> > > DEBUG 2:
> > > DEBUG 2: Reading data for TMP/Z2.
> > > DEBUG 2: For TMP/Z2 found 1 forecast levels and 0 climatology
levels.
> > > DEBUG 2:
> > > DEBUG 2:
> > >
> >
>
--------------------------------------------------------------------------------
> > > DEBUG 2:
> > > DEBUG 2: Searching 949837 observations from 452408 messages.
> > > DEBUG 2:
> > > DEBUG 2:
> > >
> >
>
--------------------------------------------------------------------------------
> > > DEBUG 2:
> > > DEBUG 2: Processing TMP/Z2 versus TMP/Z2, for observation type
ADPSFC,
> > > over region FULL, for interpolation method NEAREST(1), using 0
pairs.
> > > DEBUG 2:
> > > DEBUG 2:
> > >
> >
>
--------------------------------------------------------------------------------
> > > DEBUG 2:
> > > DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V.stat
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_fho.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_ctc.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_cts.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_mctc.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_mcts.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_cnt.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_sl1l2.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_sal1l2.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_vl1l2.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_val1l2.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_pct.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_pstd.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_pjc.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_prc.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_mpr.txt
> > >
> > > From config file:
> > >
> > > fcst = {
> > > message_type = [ "ADPSFC" ];
> > > sid_exc = [];
> > >
> > > field = [
> > > {
> > > name = "TMP";
> > > level = [ "Z2" ];
> > > cat_thresh = [ >293.0 ];
> > > }
> > > ];
> > >
> > >
> > > Thanks for the help,
> > > Jose
> > >
> > >
> > >
> > > -----Original Message-----
> > > From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> > > Sent: Thursday, March 17, 2016 5:47 PM
> > > To: Jose Garcia-Rivera
> > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR
to
> > NetCDF
> > >
> > > Jose,
> > >
> > > I see that you're doing an upper-air (ADPUPA) evaluation for the
time
> > > 20150820_180000. Upper-air observations are much more common at
00Z
> and
> > > 12Z than 06Z and 18Z. Instead of verifying the 06 hour forecast
valid
> at
> > > 18Z, please try the 12 hour forecast valid at 00Z.
> > >
> > > Also, you could try evaluating some surface fields against the
ADPSFC
> > > message type.
> > >
> > > If you get stuck, you can post a sample forecast file to our
anonymous
> > ftp
> > > site, and I can try running it here.
> > >
> > > Thanks,
> > > John
> > >
> > >
> > >
> > > On Thu, Mar 17, 2016 at 2:39 PM, Jose Garcia-Rivera via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
>
> > > >
> > > > Dear John,
> > > >
> > > > It's great to hear from you again! Julie has been of great
help. We
> > > > highly appreciate all the help coming from your team.
> > > >
> > > > I followed your recommendation, and got the following:
> > > >
> > > > [garciaj at login prepbufr_obs]$ ./point_stat -v 3 nmbprs_d01.06
> > > > newtest.nc PointStatConfig_default DEBUG 1: Default Config
File:
> > > >
> /work/apps/pgi_14.10/SANDY/met-
5.1/share/met/config/PointStatConfig_de
> > > > fault DEBUG 1: User Config File: PointStatConfig_default
> > > > GSL_RNG_TYPE=mt19937
> > > > GSL_RNG_SEED=1041230678
> > > > DEBUG 1: Forecast File: nmbprs_d01.06
> > > > DEBUG 1: Observation File: newtest.nc
> > > > DEBUG 2:
> > > > DEBUG 2:
> > > >
>
----------------------------------------------------------------------
> > > > ----------
> > > > DEBUG 2:
> > > > DEBUG 2: Reading data for SPFH/P500.
> > > > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found range
match
> for
> > > > VarInfo "SPFH/P500" in GRIB record 134 of GRIB file
"nmbprs_d01.06".
> > > > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found 1 GRIB
records
> > > > matching VarInfo "SPFH/P500" in GRIB file "nmbprs_d01.06".
> > > > DEBUG 3: Use the matching forecast and observation grids.
> > > > DEBUG 3: Grid Definition: Projection: Lambert Conformal Nx:
400 Ny:
> > > > 400
> > > > Lat_LL: 33.302 Lon_LL: 84.951 Lon_orient: 77.459 Alpha:
3781.822
> Cone:
> > > > 0.629 Bx: 210.6765 By: 2557.3266
> > > > DEBUG 2: For SPFH/P500 found 1 forecast levels and 0
climatology
> > levels.
> > > > DEBUG 2:
> > > > DEBUG 2:
> > > >
>
----------------------------------------------------------------------
> > > > ----------
> > > > DEBUG 2:
> > > > DEBUG 2: Reading data for TMP/P500.
> > > > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found range
match
> for
> > > > VarInfo "TMP/P500" in GRIB record 131 of GRIB file
"nmbprs_d01.06".
> > > > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found 1 GRIB
records
> > > > matching VarInfo "TMP/P500" in GRIB file "nmbprs_d01.06".
> > > > DEBUG 2: For TMP/P500 found 1 forecast levels and 0
climatology
> levels.
> > > > DEBUG 2:
> > > > DEBUG 2:
> > > >
>
----------------------------------------------------------------------
> > > > ----------
> > > > DEBUG 2:
> > > > DEBUG 2: Reading data for HGT/P500.
> > > > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found range
match
> for
> > > > VarInfo "HGT/P500" in GRIB record 130 of GRIB file
"nmbprs_d01.06".
> > > > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found 1 GRIB
records
> > > > matching VarInfo "HGT/P500" in GRIB file "nmbprs_d01.06".
> > > > DEBUG 2: For HGT/P500 found 1 forecast levels and 0
climatology
> levels.
> > > > DEBUG 2:
> > > > DEBUG 2:
> > > >
>
----------------------------------------------------------------------
> > > > ----------
> > > > DEBUG 2:
> > > > DEBUG 2: Reading data for UGRD/P500.
> > > > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found range
match
> for
> > > > VarInfo "UGRD/P500" in GRIB record 137 of GRIB file
"nmbprs_d01.06".
> > > > DEBUG 3: MetGrib1DataFile::rotate_winds() -> Have U-wind
record,
> > > > reading V-wind record.
> > > > DEBUG 3: MetGrib1DataFile::data_plane_scalar() -> Found exact
match
> > > > for VarInfo "UGRD/P500" in GRIB record 138 of GRIB file
> > "nmbprs_d01.06".
> > > > DEBUG 3: Rotating U and V wind components from grid-relative
to
> > > > earth-relative.
> > > > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found 1 GRIB
records
> > > > matching VarInfo "UGRD/P500" in GRIB file "nmbprs_d01.06".
> > > > DEBUG 2: For UGRD/P500 found 1 forecast levels and 0
climatology
> > levels.
> > > > DEBUG 2:
> > > > DEBUG 2:
> > > >
>
----------------------------------------------------------------------
> > > > ----------
> > > > DEBUG 2:
> > > > DEBUG 2: Reading data for VGRD/P500.
> > > > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found range
match
> for
> > > > VarInfo "VGRD/P500" in GRIB record 138 of GRIB file
"nmbprs_d01.06".
> > > > DEBUG 3: MetGrib1DataFile::rotate_winds() -> Have V-wind
record,
> > > > reading U-wind record.
> > > > DEBUG 3: MetGrib1DataFile::data_plane_scalar() -> Found exact
match
> > > > for VarInfo "VGRD/P500" in GRIB record 137 of GRIB file
> > "nmbprs_d01.06".
> > > > DEBUG 3: Rotating U and V wind components from grid-relative
to
> > > > earth-relative.
> > > > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found 1 GRIB
records
> > > > matching VarInfo "VGRD/P500" in GRIB file "nmbprs_d01.06".
> > > > DEBUG 2: For VGRD/P500 found 1 forecast levels and 0
climatology
> > levels.
> > > > DEBUG 2:
> > > > DEBUG 2:
> > > >
>
----------------------------------------------------------------------
> > > > ----------
> > > > DEBUG 2:
> > > > DEBUG 2: Searching 949837 observations from 452408 messages.
> > > > DEBUG 2:
> > > > DEBUG 2:
> > > >
>
----------------------------------------------------------------------
> > > > ----------
> > > > DEBUG 2:
> > > > DEBUG 2: Processing SPFH/P500 versus SPFH/P500, for
observation type
> > > > ADPUPA, over region FULL, for interpolation method NEAREST(1),
using
> 0
> > > > pairs.
> > > > DEBUG 3: Number of matched pairs = 0
> > > > DEBUG 3: Observations processed = 949837
> > > > DEBUG 3: Rejected: SID exclusion = 0
> > > > DEBUG 3: Rejected: GRIB code = 947898
> > > > DEBUG 3: Rejected: valid time = 1416
> > > > DEBUG 3: Rejected: bad obs value = 0
> > > > DEBUG 3: Rejected: off the grid = 523
> > > > DEBUG 3: Rejected: level mismatch = 0
> > > > DEBUG 3: Rejected: quality marker = 0
> > > > DEBUG 3: Rejected: message type = 0
> > > > DEBUG 3: Rejected: masking region = 0
> > > > DEBUG 3: Rejected: bad fcst value = 0
> > > > DEBUG 3: Rejected: duplicates = 0
> > > > DEBUG 2:
> > > > DEBUG 2:
> > > >
>
----------------------------------------------------------------------
> > > > ----------
> > > > DEBUG 2:
> > > > DEBUG 2: Processing TMP/P500 versus TMP/P500, for observation
type
> > > > ADPUPA, over region FULL, for interpolation method NEAREST(1),
using
> 0
> > > pairs.
> > > > DEBUG 3: Number of matched pairs = 0
> > > > DEBUG 3: Observations processed = 949837
> > > > DEBUG 3: Rejected: SID exclusion = 0
> > > > DEBUG 3: Rejected: GRIB code = 943848
> > > > DEBUG 3: Rejected: valid time = 4191
> > > > DEBUG 3: Rejected: bad obs value = 0
> > > > DEBUG 3: Rejected: off the grid = 1798
> > > > DEBUG 3: Rejected: level mismatch = 0
> > > > DEBUG 3: Rejected: quality marker = 0
> > > > DEBUG 3: Rejected: message type = 0
> > > > DEBUG 3: Rejected: masking region = 0
> > > > DEBUG 3: Rejected: bad fcst value = 0
> > > > DEBUG 3: Rejected: duplicates = 0
> > > > DEBUG 2:
> > > > DEBUG 2:
> > > >
>
----------------------------------------------------------------------
> > > > ----------
> > > > DEBUG 2:
> > > > DEBUG 2: Processing HGT/P500 versus HGT/P500, for observation
type
> > > > ADPUPA, over region FULL, for interpolation method NEAREST(1),
using
> 0
> > > pairs.
> > > > DEBUG 3: Number of matched pairs = 0
> > > > DEBUG 3: Observations processed = 949837
> > > > DEBUG 3: Rejected: SID exclusion = 0
> > > > DEBUG 3: Rejected: GRIB code = 606744
> > > > DEBUG 3: Rejected: valid time = 319085
> > > > DEBUG 3: Rejected: bad obs value = 0
> > > > DEBUG 3: Rejected: off the grid = 23610
> > > > DEBUG 3: Rejected: level mismatch = 395 DEBUG 3: Rejected:
quality
> > > > marker = 0
> > > > DEBUG 3: Rejected: message type = 3
> > > > DEBUG 3: Rejected: masking region = 0
> > > > DEBUG 3: Rejected: bad fcst value = 0
> > > > DEBUG 3: Rejected: duplicates = 0
> > > > DEBUG 2:
> > > > DEBUG 2:
> > > >
>
----------------------------------------------------------------------
> > > > ----------
> > > > DEBUG 2:
> > > > DEBUG 2: Processing UGRD/P500 versus UGRD/P500, for
observation type
> > > > ADPUPA, over region FULL, for interpolation method NEAREST(1),
using
> 0
> > > > pairs.
> > > > DEBUG 3: Number of matched pairs = 0
> > > > DEBUG 3: Observations processed = 949837
> > > > DEBUG 3: Rejected: SID exclusion = 0
> > > > DEBUG 3: Rejected: GRIB code = 650429
> > > > DEBUG 3: Rejected: valid time = 277745
> > > > DEBUG 3: Rejected: bad obs value = 0
> > > > DEBUG 3: Rejected: off the grid = 21341
> > > > DEBUG 3: Rejected: level mismatch = 319 DEBUG 3: Rejected:
quality
> > > > marker = 0
> > > > DEBUG 3: Rejected: message type = 3
> > > > DEBUG 3: Rejected: masking region = 0
> > > > DEBUG 3: Rejected: bad fcst value = 0
> > > > DEBUG 3: Rejected: duplicates = 0
> > > > DEBUG 2:
> > > > DEBUG 2:
> > > >
>
----------------------------------------------------------------------
> > > > ----------
> > > > DEBUG 2:
> > > > DEBUG 2: Processing VGRD/P500 versus VGRD/P500, for
observation type
> > > > ADPUPA, over region FULL, for interpolation method NEAREST(1),
using
> 0
> > > > pairs.
> > > > DEBUG 3: Number of matched pairs = 0
> > > > DEBUG 3: Observations processed = 949837
> > > > DEBUG 3: Rejected: SID exclusion = 0
> > > > DEBUG 3: Rejected: GRIB code = 650429
> > > > DEBUG 3: Rejected: valid time = 277745
> > > > DEBUG 3: Rejected: bad obs value = 0
> > > > DEBUG 3: Rejected: off the grid = 21341
> > > > DEBUG 3: Rejected: level mismatch = 319 DEBUG 3: Rejected:
quality
> > > > marker = 0
> > > > DEBUG 3: Rejected: message type = 3
> > > > DEBUG 3: Rejected: masking region = 0
> > > > DEBUG 3: Rejected: bad fcst value = 0
> > > > DEBUG 3: Rejected: duplicates = 0
> > > > DEBUG 2:
> > > > DEBUG 2:
> > > >
>
----------------------------------------------------------------------
> > > > ----------
> > > > DEBUG 2:
> > > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V.stat
> > > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_fho.txt
> > > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_ctc.txt
> > > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_cts.txt
> > > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_mctc.txt
> > > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_mcts.txt
> > > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_cnt.txt
> > > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_sl1l2.txt
> > > > DEBUG 1: Output file:
> ./point_stat_060000L_20150820_180000V_sal1l2.txt
> > > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_vl1l2.txt
> > > > DEBUG 1: Output file:
> ./point_stat_060000L_20150820_180000V_val1l2.txt
> > > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_pct.txt
> > > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_pstd.txt
> > > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_pjc.txt
> > > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_prc.txt
> > > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_mpr.txt
> > > >
> > > >
> > > >
> > > > Best Regards,
> > > > Jose
> > > >
> > > >
> > > >
> > > >
> > > >
> > > > -----Original Message-----
> > > > From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> > > > Sent: Thursday, March 17, 2016 3:29 PM
> > > > To: Jose Garcia-Rivera
> > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
PREPBUFR to
> > > > NetCDF
> > > >
> > > > Hello Jose,
> > > >
> > > > Julie is out of the office today, but I should be able to help
you.
> > > > Glad you were able to finally get PB2NC working. That was a
tricky
> > > > one! But it helped us realize that since BUFRLIB has changed
to
> > > > FORTRAN 90, we should update the MET code which calls BUFRLIB
to be
> > > compatible.
> > > >
> > > > I see that you are now getting 0 matched pairs when you run
> Point-Stat
> > > > with the output of PB2NC. Please try rerunning Point-Stat but
use a
> > > > higher verbosity level, like "-v 3". That'll print out the
following
> > > > type of counts for each of the verification tasks you've
defined in
> the
> > > config file:
> > > >
> > > > DEBUG 3: Number of matched pairs = 312
> > > > DEBUG 3: Observations processed = 87753
> > > > DEBUG 3: Rejected: SID exclusion = 0
> > > > DEBUG 3: Rejected: GRIB code = 77648
> > > > DEBUG 3: Rejected: valid time = 0
> > > > DEBUG 3: Rejected: bad obs value = 0
> > > > DEBUG 3: Rejected: off the grid = 5
> > > > DEBUG 3: Rejected: level mismatch = 9219 DEBUG 3: Rejected:
quality
> > > > marker = 0
> > > > DEBUG 3: Rejected: message type = 537
> > > > DEBUG 3: Rejected: masking region = 32 DEBUG 3: Rejected: bad
fcst
> > > > value = 0
> > > > DEBUG 3: Rejected: duplicates = 0
> > > >
> > > > In the example above, 87753 observation values were checked
and the
> > > > counts list reasons why there were not used for that task.
Out of
> > > > those 87753 obs, 312 of them were used for this task.
> > > >
> > > > Looking at the counts from your Point-Stat run should help you
figure
> > > > out why you have 0 matched pairs.
> > > >
> > > > Thanks,
> > > > John
> > > >
> > > >
> > > > On Thu, Mar 17, 2016 at 12:29 PM, Jose Garcia-Rivera via RT <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > > >
> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> > > > >
> > > > > Dear Julie,
> > > > >
> > > > > We got the executables to work! However, I have a couple of
> > > > > issues/questions:
> > > > >
> > > > >
> > > > >
> > > > > Issue #1 --- Not getting values after running point_stat
> > > > >
> > > > > Everything seems to run fine. I attached the configuration
file. I
> > > > > can send the three files via FTP if needed.
> > > > >
> > > > >
> > > > >
> > > > > Issue #2 --- PB2NC doesn't seem to finish the job, but it
does? I
> > > > > had to do CTRL+C, and checked the netCDF file using
ncl_filedump:
> > > > >
> > > > > [garciaj at login prepbufr_obs]$ ./pb2nc
> prepbufr.gdas.20150820.t18z.nr
> > > > > newtest.nc PB2NCConfig_default DEBUG 1: Default Config File:
> > > > >
> /work/apps/pgi_14.10/SANDY/met-5.1/share/met/config/PB2NCConfig_defa
> > > > > ul t DEBUG 1: User Config File: PB2NCConfig_default
> > > > > DEBUG 1: Creating NetCDF File: newtest.nc
> > > > > DEBUG 1: Processing PrepBufr File:
> > prepbufr.gdas.20150820.t18z.nr
> > > > > DEBUG 1: Blocking PrepBufr file to:
/tmp/tmp_pb2nc_blk_17703_0
> > > > > DEBUG 2: PrepBufr Time Center: 20150820_180000
> > > > > DEBUG 2: Searching Time Window: 20150820_163000 to
> > > > 20150820_193000
> > > > > DEBUG 2: Processing 685386 PrepBufr messages...
> > > > > 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75%
80% 85%
> > > > > 90% 95% 100%
> > > > > DEBUG 2: Total PrepBufr Messages processed = 685386
> > > > > DEBUG 2: Rejected based on message type = 0
> > > > > DEBUG 2: Rejected based on station id = 0
> > > > > DEBUG 2: Rejected based on valid time = 185145
> > > > > DEBUG 2: Rejected based on masking grid = 0
> > > > > DEBUG 2: Rejected based on masking polygon = 0
> > > > > DEBUG 2: Rejected based on elevation = 0
> > > > > DEBUG 2: Rejected based on pb report type = 0
> > > > > DEBUG 2: Rejected based on input report type = 0
> > > > > DEBUG 2: Rejected based on instrument type = 0
> > > > > DEBUG 2: Rejected based on zero observations = 47833
> > > > > DEBUG 2: Total PrepBufr Messages retained = 452408
> > > > > DEBUG 2: Total observations retained or derived = 949837 ^C
> > > > >
> > > > >
> > > > > Checking netCDF file:
> > > > >
> > > > > [garciaj at login prepbufr_obs]$ ncl_filedump newtest.nc
Copyright
> (C)
> > > > > 1995-2015 - All Rights Reserved University Corporation for
> > > > > Atmospheric Research NCAR Command Language Version 6.3.0
The use
> > > > > of this software is governed by a License Agreement.
> > > > > See http://www.ncl.ucar.edu/ for more details.
> > > > >
> > > > > Variable: f
> > > > > Type: file
> > > > > filename: newtest
> > > > > path: newtest.nc
> > > > > file global attributes:
> > > > > FileOrigins : File newtest.nc generated
20160317_155548 UTC
> on
> > > > > host login.local by the MET pb2nc tool
> > > > > MET_version : V5.1
> > > > > MET_tool : pb2nc
> > > > > dimensions:
> > > > > mxstr = 16
> > > > > hdr_arr_len = 3
> > > > > obs_arr_len = 5
> > > > > nobs = 949837 // unlimited
> > > > > nhdr = 452408
> > > > > variables:
> > > > > character obs_qty ( nobs, mxstr )
> > > > > long_name : quality flag
> > > > >
> > > > > float obs_arr ( nobs, obs_arr_len )
> > > > > long_name : array of observation values
> > > > > _fill_value : -9999
> > > > > columns : hdr_id gc lvl hgt ob
> > > > > hdr_id_long_name : index of matching header
data
> > > > > gc_long_name : grib code corresponding to the
observation
> > type
> > > > > lvl_long_name : pressure level (hPa) or
> accumulation
> > > > > interval (sec)
> > > > > hgt_long_name : height in meters above sea
level
> > (msl)
> > > > > ob_long_name : observation value
> > > > >
> > > > > character hdr_typ ( nhdr, mxstr )
> > > > > long_name : message type
> > > > >
> > > > > character hdr_sid ( nhdr, mxstr )
> > > > > long_name : station identification
> > > > >
> > > > > character hdr_vld ( nhdr, mxstr )
> > > > > long_name : valid time
> > > > > units : YYYYMMDD_HHMMSS
> > > > >
> > > > > float hdr_arr ( nhdr, hdr_arr_len )
> > > > > long_name : array of observation station header
values
> > > > > _fill_value : -9999
> > > > > columns : lat lon elv
> > > > > lat_long_name : latitude
> > > > > lat_units : degrees_north
> > > > > lon_long_name : longitude
> > > > > lon_units : degrees_east
> > > > > elv_long_name : elevation
> > > > > elv_units : meters above sea level (msl)
> > > > >
> > > > >
> > > > >
> > > > >
> > > > > Thanks for all the help,
> > > > > Jose
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > > -----Original Message-----
> > > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > > Sent: Wednesday, March 16, 2016 4:40 PM
> > > > > To: Jose Garcia-Rivera
> > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
PREPBUFR
> to
> > > > > NetCDF
> > > > >
> > > > > Hi Jose. I apologize for the delay. This was a tricky
problem to
> > > > > figure out, however, we were finally able to reproduce the
error
> you
> > > > > are receiving for pb2nc.
> > > > >
> > > > > The problem is BUFRLIB being compiled with pgf90 and MET
being
> > > > > compiled with pgf77. They aren't talking well to each
other.
> > > > > BUFRLIBv10.1.0 compiles with pgf77 but later versions
require
> pgf90.
> > > > >
> > > > > We will plan on updating the MET Fortran code to compile
with pgf90
> > > > > so that we can use newer BUFRLIB versions, but for now, to
solve
> > > > > your problem, I have attached BUFRLIB_v10-1-0.tar. Please
install
> > > > > that version of BUFRLIB using pgf77 and then recompile MET
without
> > > > > the "LIBS" environment variable setting?
> > > > >
> > > > > Please let me know how that goes. We were able to get a
successful
> > > > > run using that solution and hope you will too.
> > > > >
> > > > > Thanks,
> > > > > Julie
> > > > >
> > > > >
> > > > > On Wed, Mar 16, 2016 at 12:17 PM, Jose Garcia-Rivera via RT
<
> > > > > met_help at ucar.edu> wrote:
> > > > >
> > > > > >
> > > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> > > > > >
> > > > > > Dear Julie,
> > > > > >
> > > > > > Is there anything that we can do here to sort these issues
out?
> > > > > >
> > > > > > Best Regards,
> > > > > > Jose
> > > > > >
> > > > > > -----Original Message-----
> > > > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > > > Sent: Tuesday, March 15, 2016 5:08 PM
> > > > > > To: Jose Garcia-Rivera
> > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
PREPBUFR
> > > > > > to NetCDF
> > > > > >
> > > > > > Hi Jose. I was not. I got the same error you did. I
believe
> > > > > > that the test.nc file is not in the correct format needed
by
> > > > > > point_stat, so I think we need to get pb2nc working for
you. It
> > > > > > is likely a communication problem between the C code and
the
> > Fortran
> > > code.
> > > > > >
> > > > > > Julie
> > > > > >
> > > > > > On Tue, Mar 15, 2016 at 3:05 PM, Jose Garcia-Rivera via RT
<
> > > > > > met_help at ucar.edu> wrote:
> > > > > >
> > > > > > >
> > > > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> >
> > > > > > >
> > > > > > > Dear Julie,
> > > > > > >
> > > > > > > Quick question: Were you able to run point_stat with the
netCDF
> > > > > > > file that I sent yesterday?
> > > > > > >
> > > > > > > Thanks for the help,
> > > > > > > Jose
> > > > > > >
> > > > > > > -----Original Message-----
> > > > > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > > > > Sent: Tuesday, March 15, 2016 12:17 PM
> > > > > > > To: Jose Garcia-Rivera
> > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
> PREPBUFR
> > > > > > > to NetCDF
> > > > > > >
> > > > > > > Thank you, Jose. I'm working with co-workers to try to
get
> > > > > > > these issues resolved. I hope to get back to you soon.
> > > > > > >
> > > > > > > Julie
> > > > > > >
> > > > > > > On Mon, Mar 14, 2016 at 1:36 PM, Jose Garcia-Rivera via
RT <
> > > > > > > met_help at ucar.edu> wrote:
> > > > > > >
> > > > > > > >
> > > > > > > > <URL:
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > > > > >
> > > > > > > >
> > > > > > > > Dear Julie,
> > > > > > > >
> > > > > > > > I just uploaded the three files to 'garcia_data'.
> > > > > > > >
> > > > > > > > Thanks for the help,
> > > > > > > > Jose
> > > > > > > >
> > > > > > > >
> > > > > > > > -----Original Message-----
> > > > > > > > From: Julie Prestopnik via RT
[mailto:met_help at ucar.edu]
> > > > > > > > Sent: Monday, March 14, 2016 3:32 PM
> > > > > > > > To: Jose Garcia-Rivera
> > > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues
converting
> > > > > > > > PREPBUFR to NetCDF
> > > > > > > >
> > > > > > > > Hi Jose.
> > > > > > > >
> > > > > > > > Yes, please upload your input files and configuration
file
> > > > > > > > (nmbprs_d01.06, test.nc, PointStatConfig_default) to
our
> > > > > > > > anonymous ftp
> > > > > > > site as follows:
> > > > > > > > http://www.dtcenter.org/met/users/support/met_help.php
> > > > > > > >
> > > > > > > > Thanks!
> > > > > > > >
> > > > > > > > Julie
> > > > > > > >
> > > > > > > > On Mon, Mar 14, 2016 at 1:06 PM, Jose Garcia-Rivera
via RT <
> > > > > > > > met_help at ucar.edu> wrote:
> > > > > > > >
> > > > > > > > >
> > > > > > > > > <URL:
> > > > > > > > >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > > > > > >
> > > > > > > > >
> > > > > > > > > Dear Julie,
> > > > > > > > >
> > > > > > > > > I got to convert my prepbufr file using a python
script.
> > > > > > > > > However, I have trouble running point_stat. Can I
send you
> > > > > > > > > the files, to see if you have the same issue?
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > This is what I got:
> > > > > > > > >
> > > > > > > > > [garciaj at login prepbufr_obs]$ ./point_stat
nmbprs_d01.06
> > > > > > > > > test.nc PointStatConfig_default DEBUG 1: Default
Config
> > File:
> > > > > > > > >
> /work/apps/pgi_14.10/SANDY/met-5.1/share/met/config/PointSta
> > > > > > > > > tC on fi g_ de fault DEBUG 1: User Config File:
> > > > > > > > > PointStatConfig_default
> > > > > > > > > GSL_RNG_TYPE=mt19937
> > > > > > > > > GSL_RNG_SEED=18446744073425053526 DEBUG 1: Forecast
File:
> > > > > > > > > nmbprs_d01.06 DEBUG 1: Observation File:
> > > > > > > > > test.nc DEBUG 2:
> > > > > > > > > DEBUG 2:
> > > > > > > > >
> ------------------------------------------------------------
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > ----------
> > > > > > > > > DEBUG 2:
> > > > > > > > > DEBUG 2: Reading data for SPFH/P500.
> > > > > > > > > DEBUG 2: For SPFH/P500 found 1 forecast levels and 0
> > > > > > > > > climatology
> > > > > > > levels.
> > > > > > > > > DEBUG 2:
> > > > > > > > > DEBUG 2:
> > > > > > > > >
> ------------------------------------------------------------
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > ----------
> > > > > > > > > DEBUG 2:
> > > > > > > > > DEBUG 2: Reading data for TMP/P500.
> > > > > > > > > DEBUG 2: For TMP/P500 found 1 forecast levels and 0
> > > > > > > > > climatology
> > > > > > levels.
> > > > > > > > > DEBUG 2:
> > > > > > > > > DEBUG 2:
> > > > > > > > >
> ------------------------------------------------------------
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > ----------
> > > > > > > > > DEBUG 2:
> > > > > > > > > DEBUG 2: Reading data for HGT/P500.
> > > > > > > > > DEBUG 2: For HGT/P500 found 1 forecast levels and 0
> > > > > > > > > climatology
> > > > > > levels.
> > > > > > > > > DEBUG 2:
> > > > > > > > > DEBUG 2:
> > > > > > > > >
> ------------------------------------------------------------
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > ----------
> > > > > > > > > DEBUG 2:
> > > > > > > > > DEBUG 2: Reading data for UGRD/P500.
> > > > > > > > > DEBUG 2: For UGRD/P500 found 1 forecast levels and 0
> > > > > > > > > climatology
> > > > > > > levels.
> > > > > > > > > DEBUG 2:
> > > > > > > > > DEBUG 2:
> > > > > > > > >
> ------------------------------------------------------------
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > ----------
> > > > > > > > > DEBUG 2:
> > > > > > > > > DEBUG 2: Reading data for VGRD/P500.
> > > > > > > > > DEBUG 2: For VGRD/P500 found 1 forecast levels and 0
> > > > > > > > > climatology
> > > > > > > levels.
> > > > > > > > > DEBUG 2:
> > > > > > > > > DEBUG 2:
> > > > > > > > >
> ------------------------------------------------------------
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > ----------
> > > > > > > > > DEBUG 2:
> > > > > > > > > WARNING:
> > > > > > > > > WARNING: process_obs_file() -> can't open
observation
> netCDF
> > > > file:
> > > > > > > > > test.nc
> > > > > > > > > WARNING:
> > > > > > > > > DEBUG 2:
> > > > > > > > > DEBUG 2:
> > > > > > > > >
> ------------------------------------------------------------
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > ----------
> > > > > > > > > DEBUG 2:
> > > > > > > > > DEBUG 2: Processing SPFH/P500 versus SPFH/P500, for
> > > > > > > > > observation type ADPUPA, over region FULL, for
> interpolation
> > > > > > > > > method NEAREST(1), using
> > > > > > > > > 0 pairs.
> > > > > > > > > DEBUG 2:
> > > > > > > > > DEBUG 2:
> > > > > > > > >
> ------------------------------------------------------------
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > ----------
> > > > > > > > > DEBUG 2:
> > > > > > > > > DEBUG 2: Processing TMP/P500 versus TMP/P500, for
> > > > > > > > > observation type ADPUPA, over region FULL, for
> interpolation
> > > > > > > > > method NEAREST(1), using
> > > > > > > > > 0
> > > > > > > > pairs.
> > > > > > > > > DEBUG 2:
> > > > > > > > > DEBUG 2:
> > > > > > > > >
> ------------------------------------------------------------
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > ----------
> > > > > > > > > DEBUG 2:
> > > > > > > > > DEBUG 2: Processing HGT/P500 versus HGT/P500, for
> > > > > > > > > observation type ADPUPA, over region FULL, for
> interpolation
> > > > > > > > > method NEAREST(1), using
> > > > > > > > > 0
> > > > > > > > pairs.
> > > > > > > > > DEBUG 2:
> > > > > > > > > DEBUG 2:
> > > > > > > > >
> ------------------------------------------------------------
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > ----------
> > > > > > > > > DEBUG 2:
> > > > > > > > > DEBUG 2: Processing UGRD/P500 versus UGRD/P500, for
> > > > > > > > > observation type ADPUPA, over region FULL, for
> interpolation
> > > > > > > > > method NEAREST(1), using
> > > > > > > > > 0 pairs.
> > > > > > > > > DEBUG 2:
> > > > > > > > > DEBUG 2:
> > > > > > > > >
> ------------------------------------------------------------
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > ----------
> > > > > > > > > DEBUG 2:
> > > > > > > > > DEBUG 2: Processing VGRD/P500 versus VGRD/P500, for
> > > > > > > > > observation type ADPUPA, over region FULL, for
> interpolation
> > > > > > > > > method NEAREST(1), using
> > > > > > > > > 0 pairs.
> > > > > > > > > DEBUG 2:
> > > > > > > > > DEBUG 2:
> > > > > > > > >
> ------------------------------------------------------------
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > ----------
> > > > > > > > > DEBUG 2:
> > > > > > > > > DEBUG 1: Output file:
> > > > > > > > > ./point_stat_060000L_20150820_180000V.stat
> > > > > > > > > DEBUG 1: Output file:
> > > > > > > > > ./point_stat_060000L_20150820_180000V_fho.txt
> > > > > > > > > DEBUG 1: Output file:
> > > > > > > > > ./point_stat_060000L_20150820_180000V_ctc.txt
> > > > > > > > > DEBUG 1: Output file:
> > > > > > > > > ./point_stat_060000L_20150820_180000V_cts.txt
> > > > > > > > > DEBUG 1: Output file:
> > > > > > > > > ./point_stat_060000L_20150820_180000V_mctc.txt
> > > > > > > > > DEBUG 1: Output file:
> > > > > > > > > ./point_stat_060000L_20150820_180000V_mcts.txt
> > > > > > > > > DEBUG 1: Output file:
> > > > > > > > > ./point_stat_060000L_20150820_180000V_cnt.txt
> > > > > > > > > DEBUG 1: Output file:
> > > > > > > > > ./point_stat_060000L_20150820_180000V_sl1l2.txt
> > > > > > > > > DEBUG 1: Output file:
> > > > > > > > > ./point_stat_060000L_20150820_180000V_sal1l2.txt
> > > > > > > > > DEBUG 1: Output file:
> > > > > > > > > ./point_stat_060000L_20150820_180000V_vl1l2.txt
> > > > > > > > > DEBUG 1: Output file:
> > > > > > > > > ./point_stat_060000L_20150820_180000V_val1l2.txt
> > > > > > > > > DEBUG 1: Output file:
> > > > > > > > > ./point_stat_060000L_20150820_180000V_pct.txt
> > > > > > > > > DEBUG 1: Output file:
> > > > > > > > > ./point_stat_060000L_20150820_180000V_pstd.txt
> > > > > > > > > DEBUG 1: Output file:
> > > > > > > > > ./point_stat_060000L_20150820_180000V_pjc.txt
> > > > > > > > > DEBUG 1: Output file:
> > > > > > > > > ./point_stat_060000L_20150820_180000V_prc.txt
> > > > > > > > > DEBUG 1: Output file:
> > > > > > > > > ./point_stat_060000L_20150820_180000V_mpr.txt
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > Thanks for the help,
> > > > > > > > > Jose
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > -----Original Message-----
> > > > > > > > > From: Julie Prestopnik via RT
[mailto:met_help at ucar.edu]
> > > > > > > > > Sent: Monday, March 14, 2016 12:17 PM
> > > > > > > > > To: Jose Garcia-Rivera
> > > > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues
converting
> > > > > > > > > PREPBUFR to NetCDF
> > > > > > > > >
> > > > > > > > > Hi Jose. I apologize for the delayed response. I
was out
> > > > > > > > > of the office on Friday. I'm going to try to figure
out a
> > > > > > > > > solution and get back with you shortly.
> > > > > > > > >
> > > > > > > > > Julie
> > > > > > > > >
> > > > > > > > > On Fri, Mar 11, 2016 at 2:02 PM, Jose Garcia-Rivera
via RT
> <
> > > > > > > > > met_help at ucar.edu> wrote:
> > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > <URL:
> > > > > > > > > >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > Dear Julie,
> > > > > > > > > >
> > > > > > > > > > Any news regarding pb2nc? We're still unable to
make it
> > work.
> > > > > > > > > >
> > > > > > > > > > Best Regards,
> > > > > > > > > > Jose
> > > > > > > > > >
> > > > > > > > > > -----Original Message-----
> > > > > > > > > > From: Julie Prestopnik via RT
[mailto:met_help at ucar.edu]
> > > > > > > > > > Sent: Thursday, March 10, 2016 4:20 PM
> > > > > > > > > > To: Jose Garcia-Rivera
> > > > > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues
converting
> > > > > > > > > > PREPBUFR to NetCDF
> > > > > > > > > >
> > > > > > > > > > Hi Jose. Thank you for attaching the files.
> > > > > > > > > >
> > > > > > > > > > Could you please send me a list of the files in
> > > > > > > > > > /work/apps/pgi_14.10/SANDY/bufrlib/lib?
> > > > > > > > > >
> > > > > > > > > > Thank you!
> > > > > > > > > >
> > > > > > > > > > Julie
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > On Thu, Mar 10, 2016 at 12:20 PM, Jose Garcia-
Rivera via
> > > > > > > > > > RT < met_help at ucar.edu> wrote:
> > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > <URL:
> > > > > > > > > > >
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > Dear Julie,
> > > > > > > > > > >
> > > > > > > > > > > The administrator re-compiled MET following your
> > > > > > > > > > > instructions, and says there's still trouble. He
sent
> me
> > > > > > > > > > > the log files
> > > > > > > (attached).
> > > > > > > > > > > Is there any other approach that might help?
> > > > > > > > > > >
> > > > > > > > > > > Best Regards,
> > > > > > > > > > > Jose
> > > > > > > > > > >
> > > > > > > > > > > -----Original Message-----
> > > > > > > > > > > From: Julie Prestopnik via RT [mailto:
> met_help at ucar.edu]
> > > > > > > > > > > Sent: Wednesday, March 09, 2016 12:39 PM
> > > > > > > > > > > To: Jose Garcia-Rivera
> > > > > > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues
> converting
> > > > > > > > > > > PREPBUFR to NetCDF
> > > > > > > > > > >
> > > > > > > > > > > Thank you, Jose! It looks like something went
wrong
> > > > > > > > > > > during
> > > > > > > > > compilation.
> > > > > > > > > > > I suggest recompiling MET to see if we can get
this
> > > > > > > > > > > issue
> > > > > > resolved.
> > > > > > > > > > > NCEP's BUFRLIB is used by the pb2nc MET tool,
and is a
> > > > > > > > > > > required external library for pb2nc. MET is not
yet
> > > > > > > > > > > compatible with BUFRLIB
> > > > > > > > > > version 11.0.0, so we
> > > > > > > > > > > suggest getting version 10.2.3. We are working
on our
> > > > online
> > > > > > > > tutorial
> > > > > > > > > > for
> > > > > > > > > > > METv.5.1, but in the meantime, I'll point you to
our
> > > > > > > > > > > online tutorial directions for installing
BUFRLIB:
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > >
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.
> > > > > > > > > > > 0/
> > > > > > > > > > > co
> > > > > > > > > > > mp
> > > > > > > > > > > ilation/req_libs.php
> > > > > > > > > > >
> > > > > > > > > > > It is also important to review the necessary
> environment
> > > > > > > > > > > variables to
> > > > > > > > > > set:
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > >
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.
> > > > > > > > > > > 0/
> > > > > > > > > > > co
> > > > > > > > > > > mp
> > > > > > > > > > > ilation/configure.php
> > > > > > > > > > >
> > > > > > > > > > > For example,
> > > > > > > > > > >
> > > > > > > > > > > "Set *$MET_BUFR* to point to the main BUFR
directory,
> or
> > > > > > > > > > > set
> > > > > > > > > > > *$MET_BUFRLIB* to point to the directory with
the BUFR
> > > > > > > > > > > library
> > > > > > > files.
> > > > > > > > > > > Because MET doesn't use any BUFR library include
files,
> > > > > > > > > > > you don't need to specify *$MET_BUFRINC* ."
> > > > > > > > > > >
> > > > > > > > > > > Once you've installed the required libraries and
set up
> > > > > > > > > > > your environment variables, you'll be ready to
> configure
> > > > > > > > > > > MET (instructions at the bottom of the last link
above)
> > > > > > > > > > > and then compile and install MET (
> > > > > > > > > > >
> > > > >
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.
> > > > > > > > > > > 0/
> > > > > > > > > > > co
> > > > > > > > > > > mp
> > > > > > > > > > > ilation/compile.php
> > > > > > > > > > > ).
> > > > > > > > > > > After re-installing MET, please run "make test"
again.
> > > > > > > > > > > If you still encounter the same problem, please
send me
> > > > > > > > > > > your
> > > > > > > > > > > *config.log* file and your *make_install.log
*file.
> > > > > > > > > > > Please let me know if you have any
> > > > > > > > > > questions.
> > > > > > > > > > >
> > > > > > > > > > > Please let us know how it goes.
> > > > > > > > > > >
> > > > > > > > > > > Thanks,
> > > > > > > > > > > Julie
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > On Wed, Mar 9, 2016 at 10:22 AM, Jose Garcia-
Rivera via
> > > > > > > > > > > RT < met_help at ucar.edu> wrote:
> > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > <URL:
> > > > > > > > > > > >
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=7543
> > > > > > > > > > > > 3
> > > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > Dear Julie,
> > > > > > > > > > > >
> > > > > > > > > > > > Attached is the test log file. It's showing
the same
> > > > > > > > > > > > issues on pb2nc even with the sample files.
> > > > > > > > > > > >
> > > > > > > > > > > > Best Regards,
> > > > > > > > > > > > Jose
> > > > > > > > > > > >
> > > > > > > > > > > > -----Original Message-----
> > > > > > > > > > > > From: Julie Prestopnik via RT
> > > > > > > > > > > > [mailto:met_help at ucar.edu]
> > > > > > > > > > > > Sent: Tuesday, March 08, 2016 5:28 PM
> > > > > > > > > > > > To: Jose Garcia-Rivera
> > > > > > > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues
> > > > > > > > > > > > converting PREPBUFR to NetCDF
> > > > > > > > > > > >
> > > > > > > > > > > > Hi Jose. Thank you for uploading the files.
> > > > > > > > > > > > Unfortunately, I am unable to reproduce the
error you
> > > > > > > > > > > > are experiencing. I am wondering if you have
> > > > > > > > > > > > successfully used pb2nc before. As a check
could you
> > > > > > > > > > > > please run the following in your met-5.1/
> > > > > > > > directory:
> > > > > > > > > > > >
> > > > > > > > > > > > *make test >& make_test.log*
> > > > > > > > > > > >
> > > > > > > > > > > > and then send me the make_test.log file?
> > > > > > > > > > > >
> > > > > > > > > > > > Thanks,
> > > > > > > > > > > > Julie
> > > > > > > > > > > >
> > > > > > > > > > > > On Tue, Mar 8, 2016 at 11:29 AM, Jose Garcia-
Rivera
> > > > > > > > > > > > via RT < met_help at ucar.edu> wrote:
> > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > > <URL:
> > > > > > > > > > > > >
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75
> > > > > > > > > > > > > 43
> > > > > > > > > > > > > 3
> > > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > > Dear Julie,
> > > > > > > > > > > > >
> > > > > > > > > > > > > I just put the files in 'garcia_data'. I
appreciate
> > > > > > > > > > > > > your
> > > > > > help.
> > > > > > > > > > > > >
> > > > > > > > > > > > > Best Regards,
> > > > > > > > > > > > > Jose
> > > > > > > > > > > > >
> > > > > > > > > > > > > -----Original Message-----
> > > > > > > > > > > > > From: Julie Prestopnik via RT
> > > > > > > > > > > > > [mailto:met_help at ucar.edu]
> > > > > > > > > > > > > Sent: Tuesday, March 08, 2016 1:12 PM
> > > > > > > > > > > > > To: Jose Garcia-Rivera
> > > > > > > > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues
> > > > > > > > > > > > > converting PREPBUFR to NetCDF
> > > > > > > > > > > > >
> > > > > > > > > > > > > Hi Jose. I'm sorry to hear that you are
having
> > > > > > > > > > > > > problems converting a PREPBUFR file to
NetCDF.
> > > > > > > > > > > > >
> > > > > > > > > > > > > Please upload your input files and
configuration
> > > > > > > > > > > > > file to our anonymous ftp site as follows:
> > > > > > > > > > > > >
> http://www.dtcenter.org/met/users/support/met_help.p
> > > > > > > > > > > > > hp
> > > > > > > > > > > > >
> > > > > > > > > > > > > Then I can take a look and get back to you.
> > > > > > > > > > > > >
> > > > > > > > > > > > > Thanks,
> > > > > > > > > > > > > Julie
> > > > > > > > > > > > >
> > > > > > > > > > > > > On Tue, Mar 8, 2016 at 11:01 AM, Jose
Garcia-Rivera
> > > > > > > > > > > > > via RT < met_help at ucar.edu> wrote:
> > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > Tue Mar 08 11:01:25 2016: Request 75433
was acted
> > > upon.
> > > > > > > > > > > > > > Transaction: Ticket created by
GarciaJ at imsg.com
> > > > > > > > > > > > > > Queue: met_help
> > > > > > > > > > > > > > Subject: Issues converting PREPBUFR
to
> NetCDF
> > > > > > > > > > > > > > Owner: Nobody
> > > > > > > > > > > > > > Requestors: GarciaJ at imsg.com
> > > > > > > > > > > > > > Status: new
> > > > > > > > > > > > > > Ticket <URL:
> > > > > > > > > > > > > >
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=
> > > > > > > > > > > > > > 75
> > > > > > > > > > > > > > 43
> > > > > > > > > > > > > > 3
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > Dear Met Help,
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > Trying to convert a PREPBUFR file to
NetCDF.
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > I used the default PB2NC configure file,
and got
> > > > > > > > > > > > > > the
> > > > > > > following:
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > [garciaj at login prepbufr_obs]$ ./pb2nc
> > > > > > > > > > > > > > gdas1.t12z.prepbufr.nr
gdas.20150820.t12z.nc
> > > > > > > > > > > > > > PB2NCConfig_default DEBUG 1: Default
Config
> > > > > > > > > > > > > > File:
> > > > > > > > > > > > > >
> /work/apps/pgi_14.10/met-5.1/share/met/config/PB2N
> > > > > > > > > > > > > > CC on fi g_ de fa ul t DEBUG 1: User
Config File:
> > > > > > > > > > > > > > PB2NCConfig_default DEBUG 1: Creating
NetCDF
> File:
> > > > > > > gdas.20150820.t12z.nc
> > > > > > > > > > > > > > DEBUG 1: Processing PrepBufr File:
> > > > > > > gdas1.t12z.prepbufr.nr
> > > > > > > > > > > > > > DEBUG 1: Blocking PrepBufr file to:
> > > > > > > > > /tmp/tmp_pb2nc_blk_32144_0
> > > > > > > > > > > > > > WARNING:
> > > > > > > > > > > > > > WARNING: process_pbfile() -> No PrepBufr
messages
> > > > > > > > > > > > > > to process in
> > > > > > > > > > file:
> > > > > > > > > > > > > > gdas1.t12z.prepbufr.nr
> > > > > > > > > > > > > > WARNING:
> > > > > > > > > > > > > > ERROR :
> > > > > > > > > > > > > > ERROR : write_netcdf_hdr_data() -> No
PrepBufr
> > > > > > > > > > > > > > messages
> > > > > > > > > retained.
> > > > > > > > > > > > > > Nothing to write.
> > > > > > > > > > > > > > ERROR :
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > Thanks in advance for the help, Jose M.
> > > > > > > > > > > > > > Garcia-Rivera, PhD IM Systems Group
> > > > > > > > > > > > > > Rockville/College Park, MD This e-mail,
including
> > > > > > > > > > > > > > attachments, may include confidential
and/or
> > > > > > > > > > > > > > proprietary information, and may be used
only by
> > > > > > > > > > > > > > the person or entity to which it is
addressed. If
> > > > > > > > > > > > > > the reader of this e-mail is not the
intended
> > > > > > > > > > > > > > recipient or his or her authorized agent,
the
> > > > > > > > > > > > > > reader is hereby notified that any
dissemination,
> > > > > > > > > > > > > > distribution or
> > > > copying of this e-mail is prohibited.
> > > > > > > > > > > > > > If you have received this e-mail in error,
please
> > > > > > > > > > > > > > notify the sender by replying to this
message and
> > > > > > > > > > > > > > delete this
> > > > > > > > > > > > > e-mail immediately.
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > > --
> > > > > > > > > > > > > Julie Prestopnik
> > > > > > > > > > > > > National Center for Atmospheric Research
Research
> > > > > > > > > > > > > Applications Laboratory
> > > > > > > > > > > > > Phone: 303.497.8399
> > > > > > > > > > > > > Email: jpresto at ucar.edu
> > > > > > > > > > > > >
> > > > > > > > > > > > > This e-mail, including attachments, may
include
> > > > > > > > > > > > > confidential and/or proprietary information,
and
> may
> > > > > > > > > > > > > be used only by the person or entity to
which it is
> > > > > > > > > > > > > addressed. If the reader of this e-mail is
not the
> > > > > > > > > > > > > intended recipient or his or her authorized
agent,
> > > > > > > > > > > > > the reader is hereby notified that any
> > > > > > > > > > > > > dissemination, distribution or copying of
this
> e-mail
> > > is prohibited.
> > > > > > > > > > > > > If you have received this e-mail in error,
please
> > > > > > > > > > > > > notify the sender by replying to this
message and
> > > > > > > > > > > > > delete this
> > > > > > > > > > > > e-mail immediately.
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > --
> > > > > > > > > > > > Julie Prestopnik
> > > > > > > > > > > > National Center for Atmospheric Research
Research
> > > > > > > > > > > > Applications Laboratory
> > > > > > > > > > > > Phone: 303.497.8399
> > > > > > > > > > > > Email: jpresto at ucar.edu
> > > > > > > > > > > >
> > > > > > > > > > > > This e-mail, including attachments, may
include
> > > > > > > > > > > > confidential and/or proprietary information,
and may
> > > > > > > > > > > > be used only by the person or entity to which
it is
> > > > > > > > > > > > addressed. If the reader of this e-mail is not
the
> > > > > > > > > > > > intended recipient or his or her authorized
agent,
> the
> > > > > > > > > > > > reader is hereby notified that any
dissemination,
> > > > > > > > > > > > distribution or copying of this e-mail is
prohibited.
> > > > > > > > > > > > If you have received this e-mail in error,
please
> > > > > > > > > > > > notify the sender by replying to this message
and
> > > > > > > > > > > > delete this
> > > > > > > > > > > e-mail immediately.
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > --
> > > > > > > > > > > Julie Prestopnik
> > > > > > > > > > > National Center for Atmospheric Research
Research
> > > > > > > > > > > Applications Laboratory
> > > > > > > > > > > Phone: 303.497.8399
> > > > > > > > > > > Email: jpresto at ucar.edu
> > > > > > > > > > >
> > > > > > > > > > > This e-mail, including attachments, may include
> > > > > > > > > > > confidential and/or proprietary information, and
may be
> > > > > > > > > > > used only by the person or entity to which it is
> > > > > > > > > > > addressed. If the reader of this e-mail is not
the
> > > > > > > > > > > intended recipient or his or her authorized
agent, the
> > > > > > > > > > > reader is hereby notified that any
dissemination,
> > > > > > > > > > > distribution or copying of this e-mail is
prohibited.
> If
> > > > > > > > > > > you have received this e-mail in error, please
notify
> > > > > > > > > > > the sender by replying to this message and
delete this
> > > > > > > > > > e-mail immediately.
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > --
> > > > > > > > > > Julie Prestopnik
> > > > > > > > > > National Center for Atmospheric Research Research
> > > > > > > > > > Applications Laboratory
> > > > > > > > > > Phone: 303.497.8399
> > > > > > > > > > Email: jpresto at ucar.edu
> > > > > > > > > >
> > > > > > > > > > This e-mail, including attachments, may include
> > > > > > > > > > confidential and/or proprietary information, and
may be
> > > > > > > > > > used only by the person or entity to which it is
> > > > > > > > > > addressed. If the reader of this e-mail is not the
> > > > > > > > > > intended recipient or his or her authorized agent,
the
> > > > > > > > > > reader is hereby notified that any dissemination,
> > > > > > > > > > distribution or copying of this e-mail is
prohibited. If
> > > > > > > > > > you have received this e-mail in error, please
notify the
> > > > > > > > > > sender by replying to this message and delete this
> > > > > > > > > e-mail immediately.
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > --
> > > > > > > > > Julie Prestopnik
> > > > > > > > > National Center for Atmospheric Research Research
> > > > > > > > > Applications Laboratory
> > > > > > > > > Phone: 303.497.8399
> > > > > > > > > Email: jpresto at ucar.edu
> > > > > > > > >
> > > > > > > > > This e-mail, including attachments, may include
> confidential
> > > > > > > > > and/or proprietary information, and may be used only
by the
> > > > > > > > > person or entity to which it is addressed. If the
reader of
> > > > > > > > > this e-mail is not the intended recipient or his or
her
> > > > > > > > > authorized agent, the reader is hereby notified that
any
> > > > > > > > > dissemination, distribution or copying of this e-
mail is
> > > > > > > > > prohibited. If you have received this e-mail in
error,
> > > > > > > > > please notify the sender by replying to this message
and
> > > > > > > > > delete this
> > > > > > > > e-mail immediately.
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > --
> > > > > > > > Julie Prestopnik
> > > > > > > > National Center for Atmospheric Research Research
> Applications
> > > > > > > > Laboratory
> > > > > > > > Phone: 303.497.8399
> > > > > > > > Email: jpresto at ucar.edu
> > > > > > > >
> > > > > > > > This e-mail, including attachments, may include
confidential
> > > > > > > > and/or proprietary information, and may be used only
by the
> > > > > > > > person or entity to which it is addressed. If the
reader of
> > > > > > > > this e-mail is not the intended recipient or his or
her
> > > > > > > > authorized agent, the reader is hereby notified that
any
> > > > > > > > dissemination, distribution or copying of this e-mail
is
> > > > > > > > prohibited. If you have received this e-mail in error,
please
> > > > > > > > notify the sender by replying to this message and
delete this
> > > > > > > e-mail immediately.
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > --
> > > > > > > Julie Prestopnik
> > > > > > > National Center for Atmospheric Research Research
Applications
> > > > > > > Laboratory
> > > > > > > Phone: 303.497.8399
> > > > > > > Email: jpresto at ucar.edu
> > > > > > >
> > > > > > > This e-mail, including attachments, may include
confidential
> > > > > > > and/or proprietary information, and may be used only by
the
> > > > > > > person or entity to which it is addressed. If the reader
of
> this
> > > > > > > e-mail is not the intended recipient or his or her
authorized
> > > > > > > agent, the reader is hereby notified that any
dissemination,
> > > > > > > distribution or copying of this e-mail is prohibited. If
you
> > > > > > > have received this e-mail in error, please notify the
sender by
> > > > > > > replying to this message and delete this
> > > > > > e-mail immediately.
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > >
> > > > > >
> > > > > > --
> > > > > > Julie Prestopnik
> > > > > > National Center for Atmospheric Research Research
Applications
> > > > > > Laboratory
> > > > > > Phone: 303.497.8399
> > > > > > Email: jpresto at ucar.edu
> > > > > >
> > > > > > This e-mail, including attachments, may include
confidential
> > > > > > and/or proprietary information, and may be used only by
the
> person
> > > > > > or entity to which it is addressed. If the reader of this
e-mail
> > > > > > is not the intended recipient or his or her authorized
agent, the
> > > > > > reader is hereby notified that any dissemination,
distribution or
> > > > > > copying of this e-mail is prohibited. If you have received
this
> > > > > > e-mail in error, please notify the sender by replying to
this
> > > > > > message and delete this
> > > > > e-mail immediately.
> > > > > >
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > > > --
> > > > > Julie Prestopnik
> > > > > National Center for Atmospheric Research Research
Applications
> > > > > Laboratory
> > > > > Phone: 303.497.8399
> > > > > Email: jpresto at ucar.edu
> > > > >
> > > > > This e-mail, including attachments, may include confidential
and/or
> > > > > proprietary information, and may be used only by the person
or
> > > > > entity to which it is addressed. If the reader of this e-
mail is
> not
> > > > > the intended recipient or his or her authorized agent, the
reader
> is
> > > > > hereby notified that any dissemination, distribution or
copying of
> > > > > this e-mail is prohibited. If you have received this e-mail
in
> > > > > error, please notify the sender by replying to this message
and
> > > > > delete this
> > > > e-mail immediately.
> > > > >
> > > > >
> > > >
> > > > This e-mail, including attachments, may include confidential
and/or
> > > > proprietary information, and may be used only by the person or
entity
> > > > to which it is addressed. If the reader of this e-mail is not
the
> > > > intended recipient or his or her authorized agent, the reader
is
> > > > hereby notified that any dissemination, distribution or
copying of
> > > > this e-mail is prohibited. If you have received this e-mail in
error,
> > > > please notify the sender by replying to this message and
delete this
> > > e-mail immediately.
> > > >
> > > >
> > > >
> > >
> > > This e-mail, including attachments, may include confidential
and/or
> > > proprietary information, and may be used only by the person or
entity
> to
> > > which it is addressed. If the reader of this e-mail is not the
intended
> > > recipient or his or her authorized agent, the reader is hereby
notified
> > > that any dissemination, distribution or copying of this e-mail
is
> > > prohibited. If you have received this e-mail in error, please
notify
> the
> > > sender by replying to this message and delete this e-mail
immediately.
> > >
> > >
> > >
> >
> > This e-mail, including attachments, may include confidential
and/or
> > proprietary information, and may be used only by the person or
entity to
> > which it is addressed. If the reader of this e-mail is not the
intended
> > recipient or his or her authorized agent, the reader is hereby
notified
> > that any dissemination, distribution or copying of this e-mail is
> > prohibited. If you have received this e-mail in error, please
notify the
> > sender by replying to this message and delete this e-mail
immediately.
> >
> >
> >
>
> This e-mail, including attachments, may include confidential and/or
> proprietary information, and may be used only by the person or
entity to
> which it is addressed. If the reader of this e-mail is not the
intended
> recipient or his or her authorized agent, the reader is hereby
notified
> that any dissemination, distribution or copying of this e-mail is
> prohibited. If you have received this e-mail in error, please notify
the
> sender by replying to this message and delete this e-mail
immediately.
>
>
>
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to NetCDF
From: Jose Garcia-Rivera
Time: Fri Mar 18 16:04:13 2016
Dear John,
Your suggestion worked! I managed to bring the PREPBUFR down to 78387
observations, and it ran quite quickly. I guess that will be the way
to go until a permanent solution is figured out. Thanks to you and
Julie for all the help.
One quick question: I haven't done much research on which skill scores
are more accepted when using point_stat. Do you have any
recommendations? We were using FSS when running grid_stat, but it
doesn't seem to be outputted with point_stat.
Have a great weekend,
Jose
-----Original Message-----
From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
Sent: Friday, March 18, 2016 5:32 PM
To: Jose Garcia-Rivera
Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to
NetCDF
Jose,
Unfortunately, no, there isn't. We have enhanced other places in MET
to
support manually defining a grid or passing in a gridded data file to
define the grid. But PB2NC currently doesn't support that.
However, you could easily use polyline masking and it should work just
as
well. Just pick 4 lat/lon corner points and write to a file. Then
set the
following in the PB2NC config file:
poly = "eastern_us.poly";
Where eastern_us.poly would contain something like this:
-----------------------
EASTERN_US
20.0 -110.0
60.0 -110.0
60.0 -50.0
20.0 -50.0
-----------------------
Only observations falling within this lat/lon box will be retained.
And
those values could easily be changed for use over Africa.
Thanks,
John
On Fri, Mar 18, 2016 at 3:06 PM, Jose Garcia-Rivera via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
>
> Dear John,
>
> Update: point_stat worked with the converted file that you
produced.
>
>
> This is a question from the previous e-mail I sent you:
>
> Is there a way of me specifying any specific grid or region when
running
> pb2nc? I ask because I can use my own model output grid. For
example:
>
> 255 3 400 400 33302 -84951 8 -77459 3317 2970 0 64 38947
38947
> 44033 -68740
>
> I ask, because we are going to have a domain over Asia.
>
>
> Thanks for the help,
> Jose
>
>
>
>
> -----Original Message-----
> From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> Sent: Friday, March 18, 2016 4:08 PM
> To: Jose Garcia-Rivera
> Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR to
NetCDF
>
> Jose,
>
> Ah OK, I suspect that exiting the PB2NC command early is the
problem.
> While PB2NC did create an output file, you probably killed it before
it
> finished writing out all the observations.
>
> This same issue actually came up recently when running on the NCAR
> supercomputer, Yellowstone. PB2NC finishes processing the
observations in
> a few minutes, but takes multiple hours to write the output NetCDF
file.
>
> The same step takes about 2 seconds on my desktop machine, but 2
hours on
> Yellowstone! So that's an open issue we need to investigate
further.
>
> For your needs, please do the following:
>
> (1) I posted my PB2NC output file to our ftp site:
>
>
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/for_garcia/gdas1.t18z.prepbufr.nc
>
> Please grab it and verify that when you use it in your Point-Stat
runs, you
> actually do get matched pairs.
>
> (2) Try rerunning PB2NC yourself, but this time set the following in
your
> PB2NC config file:
> mask = "G212";
>
> That will filter the observations and only keep the ones which fall
within
> this pre-defined NCEP Grid:
> http://www.nco.ncep.noaa.gov/pmb/docs/on388/grids/grid212.gif
>
> That should result in 293763 observations instead of 1330661 of
them.
> Perhaps PB2NC will run in a more reasonable time.
>
> But in the long run of course, we'll need to figure out why PB2NC is
so
> slow and fix it!
>
> Thanks,
> John
>
>
> (2)
>
> On Fri, Mar 18, 2016 at 12:58 PM, Jose Garcia-Rivera via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> >
> > Dear John,
> >
> > I modified the config file for pb2nc, and still have the same
issue. I
> > uploaded these two files to 'garcia_data'
> >
> > 3km_nmbprs_d01.06
> > newtest.nc
> >
> > I don’t need to change the quality flag in the point_stat
configuration
> > file, right?
> >
> > One extra thing to mention: I had to type CNTL+C to exit pb2nc,
since it
> > seemed to stay stuck on a loop,,, yet I got the netcdf file. This
> happened
> > every time:
> >
> > [garciaj at login prepbufr_obs]$ ./pb2nc gdas1.t18z.prepbufr.nr
newtest.nc
> > PB2NCConfig_default
> > DEBUG 1: Default Config File:
> > /work/apps/pgi_14.10/SANDY/met-
5.1/share/met/config/PB2NCConfig_default
> > DEBUG 1: User Config File: PB2NCConfig_default
> > DEBUG 1: Creating NetCDF File: newtest.nc
> > DEBUG 1: Processing PrepBufr File: gdas1.t18z.prepbufr.nr
> > DEBUG 1: Blocking PrepBufr file to: /tmp/tmp_pb2nc_blk_50363_0
> > DEBUG 2: PrepBufr Time Center: 20150820_180000
> > DEBUG 2: Searching Time Window: 20150820_163000 to
> 20150820_193000
> > DEBUG 2: Processing 685386 PrepBufr messages...
> > 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85%
90%
> 95%
> > 100%
> > DEBUG 2: Total PrepBufr Messages processed = 685386
> > DEBUG 2: Rejected based on message type = 0
> > DEBUG 2: Rejected based on station id = 0
> > DEBUG 2: Rejected based on valid time = 185145
> > DEBUG 2: Rejected based on masking grid = 0
> > DEBUG 2: Rejected based on masking polygon = 0
> > DEBUG 2: Rejected based on elevation = 0
> > DEBUG 2: Rejected based on pb report type = 0
> > DEBUG 2: Rejected based on input report type = 0
> > DEBUG 2: Rejected based on instrument type = 0
> > DEBUG 2: Rejected based on zero observations = 11135
> > DEBUG 2: Total PrepBufr Messages retained = 489106
> > DEBUG 2: Total observations retained or derived = 1330661
> >
> > ^C
> >
> >
> >
> > Thanks for the help,
> > Jose
> >
> > -----Original Message-----
> > From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> > Sent: Friday, March 18, 2016 1:01 PM
> > To: Jose Garcia-Rivera
> > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR
to
> NetCDF
> >
> > Jose,
> >
> > Thanks for sending the test data. I see that your model data is
valid at
> > time 20150820_180000. When I run Point-Stat, I see the following
reason
> > counts in the output:
> >
> > DEBUG 2: Processing TMP/Z2 versus TMP/Z2, for observation type
ADPSFC,
> over
> > region FULL, for interpolation method NEAREST(1), using 0 pairs.
> > DEBUG 3: Number of matched pairs = 0
> > DEBUG 3: Observations processed = 949837
> > DEBUG 3: Rejected: SID exclusion = 0
> > DEBUG 3: Rejected: GRIB code = 943848
> > DEBUG 3: Rejected: valid time = 4191
> > DEBUG 3: Rejected: bad obs value = 0
> > DEBUG 3: Rejected: off the grid = 1798
> > DEBUG 3: Rejected: level mismatch = 0
> > DEBUG 3: Rejected: quality marker = 0
> > DEBUG 3: Rejected: message type = 0
> > DEBUG 3: Rejected: masking region = 0
> > DEBUG 3: Rejected: bad fcst value = 0
> > DEBUG 3: Rejected: duplicates = 0
> >
> > So it looks like several observations are not used for either the
valid
> > time or being off the grid. Let's look at where these temperature
exist.
> > I ran the following command to plot their location:
> > met-5.1/bin/plot_point_obs newtest.nc newtest.ps -gc 11 -v 3
> >
> > The "-gc 11" option says only plot temperature. The resulting
image is
> > attached. Notice that none of them fall within your East Coast
domain.
> > Also notice in the log output that these are all AIRCFT
temperature
> > observations! No ADPUPA and no ADPSFC.
> >
> > Since you're using GDAS observations, you should be aware of the
quality
> > marker issue for surface observations noted at the bottom of this
page:
> >
http://www.dtcenter.org/met/users/downloads/observation_data.php
> >
> > To get Point-Stat running, I did the following steps:
> >
> > (1) Pull GDAS observations for 20150820_180000:
> > wget
> >
> >
>
http://nomads.ncdc.noaa.gov/data/gdas/201508/20150820/gdas1.t18z.prepbufr.nr
> >
> > (2) Run PB2NC using the attached configuration file (note quality
marker
> =
> > 9):
> > met-5.1/bin/pb2nc gdas1.t18z.prepbufr.nr
gdas1.t18z.prepbufr.nc
> > PB2NCConfig_GDAS
> >
> > (3) Run Point-Stat using the data/config file you sent me:
> > met-5.1/bin/point_stat nmbprs_d01.06 gdas1.t18z.prepbufr.nc
> > PointStatConfig -outdir out -v 4
> >
> > And that give me 3584 matched pairs:
> > DEBUG 3: Number of matched pairs = 3584
> >
> > So the problem was caused by the GDAS quality marker issue. Also
note
> that
> > for North American grids, using NDAS (i.e. north american data
> > assimilation) would work equally well and NDAS does *NOT* have
this
> quality
> > marker issue.
> >
> > Lastly, I see the following warning when I run Point-Stat with
your data:
> > WARNING:
> > WARNING: gds_to_lambert() -> MET does not currently support
Lambert
> > Conformal grids where dx (3.317) != dy (2.97) and may produce
unexpected
> > results!
> > WARNING:
> >
> > I'd suggest post-processing to a different grid where Dx = Dy
prior to
> > running MET.
> >
> > Hope that helps.
> >
> > Thanks,
> > John
> >
> > On Fri, Mar 18, 2016 at 10:15 AM, Jose Garcia-Rivera via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> > >
> > > Dear John,
> > >
> > > I tried as you suggested, but still have empty output. I put the
files
> in
> > > your ftp in 'garcia_data'
> > >
> > > The three files in the FTP are:
> > >
> > > newtest.nc
> > > nmbprs_d01.06
> > > PointStatConfig
> > >
> > >
> > > Output:
> > >
> > > [garciaj at login prepbufr_obs]$ ./point_stat nmbprs_d01.06
newtest.nc
> > > PointStatConfig_default
> > > DEBUG 1: Default Config File:
> > >
> >
> /work/apps/pgi_14.10/SANDY/met-
5.1/share/met/config/PointStatConfig_default
> > > DEBUG 1: User Config File: PointStatConfig_default
> > > GSL_RNG_TYPE=mt19937
> > > GSL_RNG_SEED=18446744071614164054
> > > DEBUG 1: Forecast File: nmbprs_d01.06
> > > DEBUG 1: Observation File: newtest.nc
> > > DEBUG 2:
> > > DEBUG 2:
> > >
> >
>
--------------------------------------------------------------------------------
> > > DEBUG 2:
> > > DEBUG 2: Reading data for TMP/Z2.
> > > DEBUG 2: For TMP/Z2 found 1 forecast levels and 0 climatology
levels.
> > > DEBUG 2:
> > > DEBUG 2:
> > >
> >
>
--------------------------------------------------------------------------------
> > > DEBUG 2:
> > > DEBUG 2: Searching 949837 observations from 452408 messages.
> > > DEBUG 2:
> > > DEBUG 2:
> > >
> >
>
--------------------------------------------------------------------------------
> > > DEBUG 2:
> > > DEBUG 2: Processing TMP/Z2 versus TMP/Z2, for observation type
ADPSFC,
> > > over region FULL, for interpolation method NEAREST(1), using 0
pairs.
> > > DEBUG 2:
> > > DEBUG 2:
> > >
> >
>
--------------------------------------------------------------------------------
> > > DEBUG 2:
> > > DEBUG 1: Output file: ./point_stat_060000L_20150820_180000V.stat
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_fho.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_ctc.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_cts.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_mctc.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_mcts.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_cnt.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_sl1l2.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_sal1l2.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_vl1l2.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_val1l2.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_pct.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_pstd.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_pjc.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_prc.txt
> > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_mpr.txt
> > >
> > > From config file:
> > >
> > > fcst = {
> > > message_type = [ "ADPSFC" ];
> > > sid_exc = [];
> > >
> > > field = [
> > > {
> > > name = "TMP";
> > > level = [ "Z2" ];
> > > cat_thresh = [ >293.0 ];
> > > }
> > > ];
> > >
> > >
> > > Thanks for the help,
> > > Jose
> > >
> > >
> > >
> > > -----Original Message-----
> > > From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> > > Sent: Thursday, March 17, 2016 5:47 PM
> > > To: Jose Garcia-Rivera
> > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting PREPBUFR
to
> > NetCDF
> > >
> > > Jose,
> > >
> > > I see that you're doing an upper-air (ADPUPA) evaluation for the
time
> > > 20150820_180000. Upper-air observations are much more common at
00Z
> and
> > > 12Z than 06Z and 18Z. Instead of verifying the 06 hour forecast
valid
> at
> > > 18Z, please try the 12 hour forecast valid at 00Z.
> > >
> > > Also, you could try evaluating some surface fields against the
ADPSFC
> > > message type.
> > >
> > > If you get stuck, you can post a sample forecast file to our
anonymous
> > ftp
> > > site, and I can try running it here.
> > >
> > > Thanks,
> > > John
> > >
> > >
> > >
> > > On Thu, Mar 17, 2016 at 2:39 PM, Jose Garcia-Rivera via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
>
> > > >
> > > > Dear John,
> > > >
> > > > It's great to hear from you again! Julie has been of great
help. We
> > > > highly appreciate all the help coming from your team.
> > > >
> > > > I followed your recommendation, and got the following:
> > > >
> > > > [garciaj at login prepbufr_obs]$ ./point_stat -v 3 nmbprs_d01.06
> > > > newtest.nc PointStatConfig_default DEBUG 1: Default Config
File:
> > > >
> /work/apps/pgi_14.10/SANDY/met-
5.1/share/met/config/PointStatConfig_de
> > > > fault DEBUG 1: User Config File: PointStatConfig_default
> > > > GSL_RNG_TYPE=mt19937
> > > > GSL_RNG_SEED=1041230678
> > > > DEBUG 1: Forecast File: nmbprs_d01.06
> > > > DEBUG 1: Observation File: newtest.nc
> > > > DEBUG 2:
> > > > DEBUG 2:
> > > >
>
----------------------------------------------------------------------
> > > > ----------
> > > > DEBUG 2:
> > > > DEBUG 2: Reading data for SPFH/P500.
> > > > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found range
match
> for
> > > > VarInfo "SPFH/P500" in GRIB record 134 of GRIB file
"nmbprs_d01.06".
> > > > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found 1 GRIB
records
> > > > matching VarInfo "SPFH/P500" in GRIB file "nmbprs_d01.06".
> > > > DEBUG 3: Use the matching forecast and observation grids.
> > > > DEBUG 3: Grid Definition: Projection: Lambert Conformal Nx:
400 Ny:
> > > > 400
> > > > Lat_LL: 33.302 Lon_LL: 84.951 Lon_orient: 77.459 Alpha:
3781.822
> Cone:
> > > > 0.629 Bx: 210.6765 By: 2557.3266
> > > > DEBUG 2: For SPFH/P500 found 1 forecast levels and 0
climatology
> > levels.
> > > > DEBUG 2:
> > > > DEBUG 2:
> > > >
>
----------------------------------------------------------------------
> > > > ----------
> > > > DEBUG 2:
> > > > DEBUG 2: Reading data for TMP/P500.
> > > > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found range
match
> for
> > > > VarInfo "TMP/P500" in GRIB record 131 of GRIB file
"nmbprs_d01.06".
> > > > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found 1 GRIB
records
> > > > matching VarInfo "TMP/P500" in GRIB file "nmbprs_d01.06".
> > > > DEBUG 2: For TMP/P500 found 1 forecast levels and 0
climatology
> levels.
> > > > DEBUG 2:
> > > > DEBUG 2:
> > > >
>
----------------------------------------------------------------------
> > > > ----------
> > > > DEBUG 2:
> > > > DEBUG 2: Reading data for HGT/P500.
> > > > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found range
match
> for
> > > > VarInfo "HGT/P500" in GRIB record 130 of GRIB file
"nmbprs_d01.06".
> > > > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found 1 GRIB
records
> > > > matching VarInfo "HGT/P500" in GRIB file "nmbprs_d01.06".
> > > > DEBUG 2: For HGT/P500 found 1 forecast levels and 0
climatology
> levels.
> > > > DEBUG 2:
> > > > DEBUG 2:
> > > >
>
----------------------------------------------------------------------
> > > > ----------
> > > > DEBUG 2:
> > > > DEBUG 2: Reading data for UGRD/P500.
> > > > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found range
match
> for
> > > > VarInfo "UGRD/P500" in GRIB record 137 of GRIB file
"nmbprs_d01.06".
> > > > DEBUG 3: MetGrib1DataFile::rotate_winds() -> Have U-wind
record,
> > > > reading V-wind record.
> > > > DEBUG 3: MetGrib1DataFile::data_plane_scalar() -> Found exact
match
> > > > for VarInfo "UGRD/P500" in GRIB record 138 of GRIB file
> > "nmbprs_d01.06".
> > > > DEBUG 3: Rotating U and V wind components from grid-relative
to
> > > > earth-relative.
> > > > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found 1 GRIB
records
> > > > matching VarInfo "UGRD/P500" in GRIB file "nmbprs_d01.06".
> > > > DEBUG 2: For UGRD/P500 found 1 forecast levels and 0
climatology
> > levels.
> > > > DEBUG 2:
> > > > DEBUG 2:
> > > >
>
----------------------------------------------------------------------
> > > > ----------
> > > > DEBUG 2:
> > > > DEBUG 2: Reading data for VGRD/P500.
> > > > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found range
match
> for
> > > > VarInfo "VGRD/P500" in GRIB record 138 of GRIB file
"nmbprs_d01.06".
> > > > DEBUG 3: MetGrib1DataFile::rotate_winds() -> Have V-wind
record,
> > > > reading U-wind record.
> > > > DEBUG 3: MetGrib1DataFile::data_plane_scalar() -> Found exact
match
> > > > for VarInfo "VGRD/P500" in GRIB record 137 of GRIB file
> > "nmbprs_d01.06".
> > > > DEBUG 3: Rotating U and V wind components from grid-relative
to
> > > > earth-relative.
> > > > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found 1 GRIB
records
> > > > matching VarInfo "VGRD/P500" in GRIB file "nmbprs_d01.06".
> > > > DEBUG 2: For VGRD/P500 found 1 forecast levels and 0
climatology
> > levels.
> > > > DEBUG 2:
> > > > DEBUG 2:
> > > >
>
----------------------------------------------------------------------
> > > > ----------
> > > > DEBUG 2:
> > > > DEBUG 2: Searching 949837 observations from 452408 messages.
> > > > DEBUG 2:
> > > > DEBUG 2:
> > > >
>
----------------------------------------------------------------------
> > > > ----------
> > > > DEBUG 2:
> > > > DEBUG 2: Processing SPFH/P500 versus SPFH/P500, for
observation type
> > > > ADPUPA, over region FULL, for interpolation method NEAREST(1),
using
> 0
> > > > pairs.
> > > > DEBUG 3: Number of matched pairs = 0
> > > > DEBUG 3: Observations processed = 949837
> > > > DEBUG 3: Rejected: SID exclusion = 0
> > > > DEBUG 3: Rejected: GRIB code = 947898
> > > > DEBUG 3: Rejected: valid time = 1416
> > > > DEBUG 3: Rejected: bad obs value = 0
> > > > DEBUG 3: Rejected: off the grid = 523
> > > > DEBUG 3: Rejected: level mismatch = 0
> > > > DEBUG 3: Rejected: quality marker = 0
> > > > DEBUG 3: Rejected: message type = 0
> > > > DEBUG 3: Rejected: masking region = 0
> > > > DEBUG 3: Rejected: bad fcst value = 0
> > > > DEBUG 3: Rejected: duplicates = 0
> > > > DEBUG 2:
> > > > DEBUG 2:
> > > >
>
----------------------------------------------------------------------
> > > > ----------
> > > > DEBUG 2:
> > > > DEBUG 2: Processing TMP/P500 versus TMP/P500, for observation
type
> > > > ADPUPA, over region FULL, for interpolation method NEAREST(1),
using
> 0
> > > pairs.
> > > > DEBUG 3: Number of matched pairs = 0
> > > > DEBUG 3: Observations processed = 949837
> > > > DEBUG 3: Rejected: SID exclusion = 0
> > > > DEBUG 3: Rejected: GRIB code = 943848
> > > > DEBUG 3: Rejected: valid time = 4191
> > > > DEBUG 3: Rejected: bad obs value = 0
> > > > DEBUG 3: Rejected: off the grid = 1798
> > > > DEBUG 3: Rejected: level mismatch = 0
> > > > DEBUG 3: Rejected: quality marker = 0
> > > > DEBUG 3: Rejected: message type = 0
> > > > DEBUG 3: Rejected: masking region = 0
> > > > DEBUG 3: Rejected: bad fcst value = 0
> > > > DEBUG 3: Rejected: duplicates = 0
> > > > DEBUG 2:
> > > > DEBUG 2:
> > > >
>
----------------------------------------------------------------------
> > > > ----------
> > > > DEBUG 2:
> > > > DEBUG 2: Processing HGT/P500 versus HGT/P500, for observation
type
> > > > ADPUPA, over region FULL, for interpolation method NEAREST(1),
using
> 0
> > > pairs.
> > > > DEBUG 3: Number of matched pairs = 0
> > > > DEBUG 3: Observations processed = 949837
> > > > DEBUG 3: Rejected: SID exclusion = 0
> > > > DEBUG 3: Rejected: GRIB code = 606744
> > > > DEBUG 3: Rejected: valid time = 319085
> > > > DEBUG 3: Rejected: bad obs value = 0
> > > > DEBUG 3: Rejected: off the grid = 23610
> > > > DEBUG 3: Rejected: level mismatch = 395 DEBUG 3: Rejected:
quality
> > > > marker = 0
> > > > DEBUG 3: Rejected: message type = 3
> > > > DEBUG 3: Rejected: masking region = 0
> > > > DEBUG 3: Rejected: bad fcst value = 0
> > > > DEBUG 3: Rejected: duplicates = 0
> > > > DEBUG 2:
> > > > DEBUG 2:
> > > >
>
----------------------------------------------------------------------
> > > > ----------
> > > > DEBUG 2:
> > > > DEBUG 2: Processing UGRD/P500 versus UGRD/P500, for
observation type
> > > > ADPUPA, over region FULL, for interpolation method NEAREST(1),
using
> 0
> > > > pairs.
> > > > DEBUG 3: Number of matched pairs = 0
> > > > DEBUG 3: Observations processed = 949837
> > > > DEBUG 3: Rejected: SID exclusion = 0
> > > > DEBUG 3: Rejected: GRIB code = 650429
> > > > DEBUG 3: Rejected: valid time = 277745
> > > > DEBUG 3: Rejected: bad obs value = 0
> > > > DEBUG 3: Rejected: off the grid = 21341
> > > > DEBUG 3: Rejected: level mismatch = 319 DEBUG 3: Rejected:
quality
> > > > marker = 0
> > > > DEBUG 3: Rejected: message type = 3
> > > > DEBUG 3: Rejected: masking region = 0
> > > > DEBUG 3: Rejected: bad fcst value = 0
> > > > DEBUG 3: Rejected: duplicates = 0
> > > > DEBUG 2:
> > > > DEBUG 2:
> > > >
>
----------------------------------------------------------------------
> > > > ----------
> > > > DEBUG 2:
> > > > DEBUG 2: Processing VGRD/P500 versus VGRD/P500, for
observation type
> > > > ADPUPA, over region FULL, for interpolation method NEAREST(1),
using
> 0
> > > > pairs.
> > > > DEBUG 3: Number of matched pairs = 0
> > > > DEBUG 3: Observations processed = 949837
> > > > DEBUG 3: Rejected: SID exclusion = 0
> > > > DEBUG 3: Rejected: GRIB code = 650429
> > > > DEBUG 3: Rejected: valid time = 277745
> > > > DEBUG 3: Rejected: bad obs value = 0
> > > > DEBUG 3: Rejected: off the grid = 21341
> > > > DEBUG 3: Rejected: level mismatch = 319 DEBUG 3: Rejected:
quality
> > > > marker = 0
> > > > DEBUG 3: Rejected: message type = 3
> > > > DEBUG 3: Rejected: masking region = 0
> > > > DEBUG 3: Rejected: bad fcst value = 0
> > > > DEBUG 3: Rejected: duplicates = 0
> > > > DEBUG 2:
> > > > DEBUG 2:
> > > >
>
----------------------------------------------------------------------
> > > > ----------
> > > > DEBUG 2:
> > > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V.stat
> > > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_fho.txt
> > > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_ctc.txt
> > > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_cts.txt
> > > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_mctc.txt
> > > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_mcts.txt
> > > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_cnt.txt
> > > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_sl1l2.txt
> > > > DEBUG 1: Output file:
> ./point_stat_060000L_20150820_180000V_sal1l2.txt
> > > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_vl1l2.txt
> > > > DEBUG 1: Output file:
> ./point_stat_060000L_20150820_180000V_val1l2.txt
> > > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_pct.txt
> > > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_pstd.txt
> > > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_pjc.txt
> > > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_prc.txt
> > > > DEBUG 1: Output file:
./point_stat_060000L_20150820_180000V_mpr.txt
> > > >
> > > >
> > > >
> > > > Best Regards,
> > > > Jose
> > > >
> > > >
> > > >
> > > >
> > > >
> > > > -----Original Message-----
> > > > From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> > > > Sent: Thursday, March 17, 2016 3:29 PM
> > > > To: Jose Garcia-Rivera
> > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
PREPBUFR to
> > > > NetCDF
> > > >
> > > > Hello Jose,
> > > >
> > > > Julie is out of the office today, but I should be able to help
you.
> > > > Glad you were able to finally get PB2NC working. That was a
tricky
> > > > one! But it helped us realize that since BUFRLIB has changed
to
> > > > FORTRAN 90, we should update the MET code which calls BUFRLIB
to be
> > > compatible.
> > > >
> > > > I see that you are now getting 0 matched pairs when you run
> Point-Stat
> > > > with the output of PB2NC. Please try rerunning Point-Stat but
use a
> > > > higher verbosity level, like "-v 3". That'll print out the
following
> > > > type of counts for each of the verification tasks you've
defined in
> the
> > > config file:
> > > >
> > > > DEBUG 3: Number of matched pairs = 312
> > > > DEBUG 3: Observations processed = 87753
> > > > DEBUG 3: Rejected: SID exclusion = 0
> > > > DEBUG 3: Rejected: GRIB code = 77648
> > > > DEBUG 3: Rejected: valid time = 0
> > > > DEBUG 3: Rejected: bad obs value = 0
> > > > DEBUG 3: Rejected: off the grid = 5
> > > > DEBUG 3: Rejected: level mismatch = 9219 DEBUG 3: Rejected:
quality
> > > > marker = 0
> > > > DEBUG 3: Rejected: message type = 537
> > > > DEBUG 3: Rejected: masking region = 32 DEBUG 3: Rejected: bad
fcst
> > > > value = 0
> > > > DEBUG 3: Rejected: duplicates = 0
> > > >
> > > > In the example above, 87753 observation values were checked
and the
> > > > counts list reasons why there were not used for that task.
Out of
> > > > those 87753 obs, 312 of them were used for this task.
> > > >
> > > > Looking at the counts from your Point-Stat run should help you
figure
> > > > out why you have 0 matched pairs.
> > > >
> > > > Thanks,
> > > > John
> > > >
> > > >
> > > > On Thu, Mar 17, 2016 at 12:29 PM, Jose Garcia-Rivera via RT <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > > >
> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> > > > >
> > > > > Dear Julie,
> > > > >
> > > > > We got the executables to work! However, I have a couple of
> > > > > issues/questions:
> > > > >
> > > > >
> > > > >
> > > > > Issue #1 --- Not getting values after running point_stat
> > > > >
> > > > > Everything seems to run fine. I attached the configuration
file. I
> > > > > can send the three files via FTP if needed.
> > > > >
> > > > >
> > > > >
> > > > > Issue #2 --- PB2NC doesn't seem to finish the job, but it
does? I
> > > > > had to do CTRL+C, and checked the netCDF file using
ncl_filedump:
> > > > >
> > > > > [garciaj at login prepbufr_obs]$ ./pb2nc
> prepbufr.gdas.20150820.t18z.nr
> > > > > newtest.nc PB2NCConfig_default DEBUG 1: Default Config File:
> > > > >
> /work/apps/pgi_14.10/SANDY/met-5.1/share/met/config/PB2NCConfig_defa
> > > > > ul t DEBUG 1: User Config File: PB2NCConfig_default
> > > > > DEBUG 1: Creating NetCDF File: newtest.nc
> > > > > DEBUG 1: Processing PrepBufr File:
> > prepbufr.gdas.20150820.t18z.nr
> > > > > DEBUG 1: Blocking PrepBufr file to:
/tmp/tmp_pb2nc_blk_17703_0
> > > > > DEBUG 2: PrepBufr Time Center: 20150820_180000
> > > > > DEBUG 2: Searching Time Window: 20150820_163000 to
> > > > 20150820_193000
> > > > > DEBUG 2: Processing 685386 PrepBufr messages...
> > > > > 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75%
80% 85%
> > > > > 90% 95% 100%
> > > > > DEBUG 2: Total PrepBufr Messages processed = 685386
> > > > > DEBUG 2: Rejected based on message type = 0
> > > > > DEBUG 2: Rejected based on station id = 0
> > > > > DEBUG 2: Rejected based on valid time = 185145
> > > > > DEBUG 2: Rejected based on masking grid = 0
> > > > > DEBUG 2: Rejected based on masking polygon = 0
> > > > > DEBUG 2: Rejected based on elevation = 0
> > > > > DEBUG 2: Rejected based on pb report type = 0
> > > > > DEBUG 2: Rejected based on input report type = 0
> > > > > DEBUG 2: Rejected based on instrument type = 0
> > > > > DEBUG 2: Rejected based on zero observations = 47833
> > > > > DEBUG 2: Total PrepBufr Messages retained = 452408
> > > > > DEBUG 2: Total observations retained or derived = 949837 ^C
> > > > >
> > > > >
> > > > > Checking netCDF file:
> > > > >
> > > > > [garciaj at login prepbufr_obs]$ ncl_filedump newtest.nc
Copyright
> (C)
> > > > > 1995-2015 - All Rights Reserved University Corporation for
> > > > > Atmospheric Research NCAR Command Language Version 6.3.0
The use
> > > > > of this software is governed by a License Agreement.
> > > > > See http://www.ncl.ucar.edu/ for more details.
> > > > >
> > > > > Variable: f
> > > > > Type: file
> > > > > filename: newtest
> > > > > path: newtest.nc
> > > > > file global attributes:
> > > > > FileOrigins : File newtest.nc generated
20160317_155548 UTC
> on
> > > > > host login.local by the MET pb2nc tool
> > > > > MET_version : V5.1
> > > > > MET_tool : pb2nc
> > > > > dimensions:
> > > > > mxstr = 16
> > > > > hdr_arr_len = 3
> > > > > obs_arr_len = 5
> > > > > nobs = 949837 // unlimited
> > > > > nhdr = 452408
> > > > > variables:
> > > > > character obs_qty ( nobs, mxstr )
> > > > > long_name : quality flag
> > > > >
> > > > > float obs_arr ( nobs, obs_arr_len )
> > > > > long_name : array of observation values
> > > > > _fill_value : -9999
> > > > > columns : hdr_id gc lvl hgt ob
> > > > > hdr_id_long_name : index of matching header
data
> > > > > gc_long_name : grib code corresponding to the
observation
> > type
> > > > > lvl_long_name : pressure level (hPa) or
> accumulation
> > > > > interval (sec)
> > > > > hgt_long_name : height in meters above sea
level
> > (msl)
> > > > > ob_long_name : observation value
> > > > >
> > > > > character hdr_typ ( nhdr, mxstr )
> > > > > long_name : message type
> > > > >
> > > > > character hdr_sid ( nhdr, mxstr )
> > > > > long_name : station identification
> > > > >
> > > > > character hdr_vld ( nhdr, mxstr )
> > > > > long_name : valid time
> > > > > units : YYYYMMDD_HHMMSS
> > > > >
> > > > > float hdr_arr ( nhdr, hdr_arr_len )
> > > > > long_name : array of observation station header
values
> > > > > _fill_value : -9999
> > > > > columns : lat lon elv
> > > > > lat_long_name : latitude
> > > > > lat_units : degrees_north
> > > > > lon_long_name : longitude
> > > > > lon_units : degrees_east
> > > > > elv_long_name : elevation
> > > > > elv_units : meters above sea level (msl)
> > > > >
> > > > >
> > > > >
> > > > >
> > > > > Thanks for all the help,
> > > > > Jose
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > > -----Original Message-----
> > > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > > Sent: Wednesday, March 16, 2016 4:40 PM
> > > > > To: Jose Garcia-Rivera
> > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
PREPBUFR
> to
> > > > > NetCDF
> > > > >
> > > > > Hi Jose. I apologize for the delay. This was a tricky
problem to
> > > > > figure out, however, we were finally able to reproduce the
error
> you
> > > > > are receiving for pb2nc.
> > > > >
> > > > > The problem is BUFRLIB being compiled with pgf90 and MET
being
> > > > > compiled with pgf77. They aren't talking well to each
other.
> > > > > BUFRLIBv10.1.0 compiles with pgf77 but later versions
require
> pgf90.
> > > > >
> > > > > We will plan on updating the MET Fortran code to compile
with pgf90
> > > > > so that we can use newer BUFRLIB versions, but for now, to
solve
> > > > > your problem, I have attached BUFRLIB_v10-1-0.tar. Please
install
> > > > > that version of BUFRLIB using pgf77 and then recompile MET
without
> > > > > the "LIBS" environment variable setting?
> > > > >
> > > > > Please let me know how that goes. We were able to get a
successful
> > > > > run using that solution and hope you will too.
> > > > >
> > > > > Thanks,
> > > > > Julie
> > > > >
> > > > >
> > > > > On Wed, Mar 16, 2016 at 12:17 PM, Jose Garcia-Rivera via RT
<
> > > > > met_help at ucar.edu> wrote:
> > > > >
> > > > > >
> > > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433 >
> > > > > >
> > > > > > Dear Julie,
> > > > > >
> > > > > > Is there anything that we can do here to sort these issues
out?
> > > > > >
> > > > > > Best Regards,
> > > > > > Jose
> > > > > >
> > > > > > -----Original Message-----
> > > > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > > > Sent: Tuesday, March 15, 2016 5:08 PM
> > > > > > To: Jose Garcia-Rivera
> > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
PREPBUFR
> > > > > > to NetCDF
> > > > > >
> > > > > > Hi Jose. I was not. I got the same error you did. I
believe
> > > > > > that the test.nc file is not in the correct format needed
by
> > > > > > point_stat, so I think we need to get pb2nc working for
you. It
> > > > > > is likely a communication problem between the C code and
the
> > Fortran
> > > code.
> > > > > >
> > > > > > Julie
> > > > > >
> > > > > > On Tue, Mar 15, 2016 at 3:05 PM, Jose Garcia-Rivera via RT
<
> > > > > > met_help at ucar.edu> wrote:
> > > > > >
> > > > > > >
> > > > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> >
> > > > > > >
> > > > > > > Dear Julie,
> > > > > > >
> > > > > > > Quick question: Were you able to run point_stat with the
netCDF
> > > > > > > file that I sent yesterday?
> > > > > > >
> > > > > > > Thanks for the help,
> > > > > > > Jose
> > > > > > >
> > > > > > > -----Original Message-----
> > > > > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > > > > Sent: Tuesday, March 15, 2016 12:17 PM
> > > > > > > To: Jose Garcia-Rivera
> > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues converting
> PREPBUFR
> > > > > > > to NetCDF
> > > > > > >
> > > > > > > Thank you, Jose. I'm working with co-workers to try to
get
> > > > > > > these issues resolved. I hope to get back to you soon.
> > > > > > >
> > > > > > > Julie
> > > > > > >
> > > > > > > On Mon, Mar 14, 2016 at 1:36 PM, Jose Garcia-Rivera via
RT <
> > > > > > > met_help at ucar.edu> wrote:
> > > > > > >
> > > > > > > >
> > > > > > > > <URL:
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > > > > >
> > > > > > > >
> > > > > > > > Dear Julie,
> > > > > > > >
> > > > > > > > I just uploaded the three files to 'garcia_data'.
> > > > > > > >
> > > > > > > > Thanks for the help,
> > > > > > > > Jose
> > > > > > > >
> > > > > > > >
> > > > > > > > -----Original Message-----
> > > > > > > > From: Julie Prestopnik via RT
[mailto:met_help at ucar.edu]
> > > > > > > > Sent: Monday, March 14, 2016 3:32 PM
> > > > > > > > To: Jose Garcia-Rivera
> > > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues
converting
> > > > > > > > PREPBUFR to NetCDF
> > > > > > > >
> > > > > > > > Hi Jose.
> > > > > > > >
> > > > > > > > Yes, please upload your input files and configuration
file
> > > > > > > > (nmbprs_d01.06, test.nc, PointStatConfig_default) to
our
> > > > > > > > anonymous ftp
> > > > > > > site as follows:
> > > > > > > > http://www.dtcenter.org/met/users/support/met_help.php
> > > > > > > >
> > > > > > > > Thanks!
> > > > > > > >
> > > > > > > > Julie
> > > > > > > >
> > > > > > > > On Mon, Mar 14, 2016 at 1:06 PM, Jose Garcia-Rivera
via RT <
> > > > > > > > met_help at ucar.edu> wrote:
> > > > > > > >
> > > > > > > > >
> > > > > > > > > <URL:
> > > > > > > > >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > > > > > >
> > > > > > > > >
> > > > > > > > > Dear Julie,
> > > > > > > > >
> > > > > > > > > I got to convert my prepbufr file using a python
script.
> > > > > > > > > However, I have trouble running point_stat. Can I
send you
> > > > > > > > > the files, to see if you have the same issue?
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > This is what I got:
> > > > > > > > >
> > > > > > > > > [garciaj at login prepbufr_obs]$ ./point_stat
nmbprs_d01.06
> > > > > > > > > test.nc PointStatConfig_default DEBUG 1: Default
Config
> > File:
> > > > > > > > >
> /work/apps/pgi_14.10/SANDY/met-5.1/share/met/config/PointSta
> > > > > > > > > tC on fi g_ de fault DEBUG 1: User Config File:
> > > > > > > > > PointStatConfig_default
> > > > > > > > > GSL_RNG_TYPE=mt19937
> > > > > > > > > GSL_RNG_SEED=18446744073425053526 DEBUG 1: Forecast
File:
> > > > > > > > > nmbprs_d01.06 DEBUG 1: Observation File:
> > > > > > > > > test.nc DEBUG 2:
> > > > > > > > > DEBUG 2:
> > > > > > > > >
> ------------------------------------------------------------
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > ----------
> > > > > > > > > DEBUG 2:
> > > > > > > > > DEBUG 2: Reading data for SPFH/P500.
> > > > > > > > > DEBUG 2: For SPFH/P500 found 1 forecast levels and 0
> > > > > > > > > climatology
> > > > > > > levels.
> > > > > > > > > DEBUG 2:
> > > > > > > > > DEBUG 2:
> > > > > > > > >
> ------------------------------------------------------------
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > ----------
> > > > > > > > > DEBUG 2:
> > > > > > > > > DEBUG 2: Reading data for TMP/P500.
> > > > > > > > > DEBUG 2: For TMP/P500 found 1 forecast levels and 0
> > > > > > > > > climatology
> > > > > > levels.
> > > > > > > > > DEBUG 2:
> > > > > > > > > DEBUG 2:
> > > > > > > > >
> ------------------------------------------------------------
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > ----------
> > > > > > > > > DEBUG 2:
> > > > > > > > > DEBUG 2: Reading data for HGT/P500.
> > > > > > > > > DEBUG 2: For HGT/P500 found 1 forecast levels and 0
> > > > > > > > > climatology
> > > > > > levels.
> > > > > > > > > DEBUG 2:
> > > > > > > > > DEBUG 2:
> > > > > > > > >
> ------------------------------------------------------------
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > ----------
> > > > > > > > > DEBUG 2:
> > > > > > > > > DEBUG 2: Reading data for UGRD/P500.
> > > > > > > > > DEBUG 2: For UGRD/P500 found 1 forecast levels and 0
> > > > > > > > > climatology
> > > > > > > levels.
> > > > > > > > > DEBUG 2:
> > > > > > > > > DEBUG 2:
> > > > > > > > >
> ------------------------------------------------------------
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > ----------
> > > > > > > > > DEBUG 2:
> > > > > > > > > DEBUG 2: Reading data for VGRD/P500.
> > > > > > > > > DEBUG 2: For VGRD/P500 found 1 forecast levels and 0
> > > > > > > > > climatology
> > > > > > > levels.
> > > > > > > > > DEBUG 2:
> > > > > > > > > DEBUG 2:
> > > > > > > > >
> ------------------------------------------------------------
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > ----------
> > > > > > > > > DEBUG 2:
> > > > > > > > > WARNING:
> > > > > > > > > WARNING: process_obs_file() -> can't open
observation
> netCDF
> > > > file:
> > > > > > > > > test.nc
> > > > > > > > > WARNING:
> > > > > > > > > DEBUG 2:
> > > > > > > > > DEBUG 2:
> > > > > > > > >
> ------------------------------------------------------------
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > ----------
> > > > > > > > > DEBUG 2:
> > > > > > > > > DEBUG 2: Processing SPFH/P500 versus SPFH/P500, for
> > > > > > > > > observation type ADPUPA, over region FULL, for
> interpolation
> > > > > > > > > method NEAREST(1), using
> > > > > > > > > 0 pairs.
> > > > > > > > > DEBUG 2:
> > > > > > > > > DEBUG 2:
> > > > > > > > >
> ------------------------------------------------------------
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > ----------
> > > > > > > > > DEBUG 2:
> > > > > > > > > DEBUG 2: Processing TMP/P500 versus TMP/P500, for
> > > > > > > > > observation type ADPUPA, over region FULL, for
> interpolation
> > > > > > > > > method NEAREST(1), using
> > > > > > > > > 0
> > > > > > > > pairs.
> > > > > > > > > DEBUG 2:
> > > > > > > > > DEBUG 2:
> > > > > > > > >
> ------------------------------------------------------------
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > ----------
> > > > > > > > > DEBUG 2:
> > > > > > > > > DEBUG 2: Processing HGT/P500 versus HGT/P500, for
> > > > > > > > > observation type ADPUPA, over region FULL, for
> interpolation
> > > > > > > > > method NEAREST(1), using
> > > > > > > > > 0
> > > > > > > > pairs.
> > > > > > > > > DEBUG 2:
> > > > > > > > > DEBUG 2:
> > > > > > > > >
> ------------------------------------------------------------
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > ----------
> > > > > > > > > DEBUG 2:
> > > > > > > > > DEBUG 2: Processing UGRD/P500 versus UGRD/P500, for
> > > > > > > > > observation type ADPUPA, over region FULL, for
> interpolation
> > > > > > > > > method NEAREST(1), using
> > > > > > > > > 0 pairs.
> > > > > > > > > DEBUG 2:
> > > > > > > > > DEBUG 2:
> > > > > > > > >
> ------------------------------------------------------------
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > ----------
> > > > > > > > > DEBUG 2:
> > > > > > > > > DEBUG 2: Processing VGRD/P500 versus VGRD/P500, for
> > > > > > > > > observation type ADPUPA, over region FULL, for
> interpolation
> > > > > > > > > method NEAREST(1), using
> > > > > > > > > 0 pairs.
> > > > > > > > > DEBUG 2:
> > > > > > > > > DEBUG 2:
> > > > > > > > >
> ------------------------------------------------------------
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > --
> > > > > > > > > ----------
> > > > > > > > > DEBUG 2:
> > > > > > > > > DEBUG 1: Output file:
> > > > > > > > > ./point_stat_060000L_20150820_180000V.stat
> > > > > > > > > DEBUG 1: Output file:
> > > > > > > > > ./point_stat_060000L_20150820_180000V_fho.txt
> > > > > > > > > DEBUG 1: Output file:
> > > > > > > > > ./point_stat_060000L_20150820_180000V_ctc.txt
> > > > > > > > > DEBUG 1: Output file:
> > > > > > > > > ./point_stat_060000L_20150820_180000V_cts.txt
> > > > > > > > > DEBUG 1: Output file:
> > > > > > > > > ./point_stat_060000L_20150820_180000V_mctc.txt
> > > > > > > > > DEBUG 1: Output file:
> > > > > > > > > ./point_stat_060000L_20150820_180000V_mcts.txt
> > > > > > > > > DEBUG 1: Output file:
> > > > > > > > > ./point_stat_060000L_20150820_180000V_cnt.txt
> > > > > > > > > DEBUG 1: Output file:
> > > > > > > > > ./point_stat_060000L_20150820_180000V_sl1l2.txt
> > > > > > > > > DEBUG 1: Output file:
> > > > > > > > > ./point_stat_060000L_20150820_180000V_sal1l2.txt
> > > > > > > > > DEBUG 1: Output file:
> > > > > > > > > ./point_stat_060000L_20150820_180000V_vl1l2.txt
> > > > > > > > > DEBUG 1: Output file:
> > > > > > > > > ./point_stat_060000L_20150820_180000V_val1l2.txt
> > > > > > > > > DEBUG 1: Output file:
> > > > > > > > > ./point_stat_060000L_20150820_180000V_pct.txt
> > > > > > > > > DEBUG 1: Output file:
> > > > > > > > > ./point_stat_060000L_20150820_180000V_pstd.txt
> > > > > > > > > DEBUG 1: Output file:
> > > > > > > > > ./point_stat_060000L_20150820_180000V_pjc.txt
> > > > > > > > > DEBUG 1: Output file:
> > > > > > > > > ./point_stat_060000L_20150820_180000V_prc.txt
> > > > > > > > > DEBUG 1: Output file:
> > > > > > > > > ./point_stat_060000L_20150820_180000V_mpr.txt
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > Thanks for the help,
> > > > > > > > > Jose
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > -----Original Message-----
> > > > > > > > > From: Julie Prestopnik via RT
[mailto:met_help at ucar.edu]
> > > > > > > > > Sent: Monday, March 14, 2016 12:17 PM
> > > > > > > > > To: Jose Garcia-Rivera
> > > > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues
converting
> > > > > > > > > PREPBUFR to NetCDF
> > > > > > > > >
> > > > > > > > > Hi Jose. I apologize for the delayed response. I
was out
> > > > > > > > > of the office on Friday. I'm going to try to figure
out a
> > > > > > > > > solution and get back with you shortly.
> > > > > > > > >
> > > > > > > > > Julie
> > > > > > > > >
> > > > > > > > > On Fri, Mar 11, 2016 at 2:02 PM, Jose Garcia-Rivera
via RT
> <
> > > > > > > > > met_help at ucar.edu> wrote:
> > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > <URL:
> > > > > > > > > >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > Dear Julie,
> > > > > > > > > >
> > > > > > > > > > Any news regarding pb2nc? We're still unable to
make it
> > work.
> > > > > > > > > >
> > > > > > > > > > Best Regards,
> > > > > > > > > > Jose
> > > > > > > > > >
> > > > > > > > > > -----Original Message-----
> > > > > > > > > > From: Julie Prestopnik via RT
[mailto:met_help at ucar.edu]
> > > > > > > > > > Sent: Thursday, March 10, 2016 4:20 PM
> > > > > > > > > > To: Jose Garcia-Rivera
> > > > > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues
converting
> > > > > > > > > > PREPBUFR to NetCDF
> > > > > > > > > >
> > > > > > > > > > Hi Jose. Thank you for attaching the files.
> > > > > > > > > >
> > > > > > > > > > Could you please send me a list of the files in
> > > > > > > > > > /work/apps/pgi_14.10/SANDY/bufrlib/lib?
> > > > > > > > > >
> > > > > > > > > > Thank you!
> > > > > > > > > >
> > > > > > > > > > Julie
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > On Thu, Mar 10, 2016 at 12:20 PM, Jose Garcia-
Rivera via
> > > > > > > > > > RT < met_help at ucar.edu> wrote:
> > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > <URL:
> > > > > > > > > > >
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75433
> > > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > Dear Julie,
> > > > > > > > > > >
> > > > > > > > > > > The administrator re-compiled MET following your
> > > > > > > > > > > instructions, and says there's still trouble. He
sent
> me
> > > > > > > > > > > the log files
> > > > > > > (attached).
> > > > > > > > > > > Is there any other approach that might help?
> > > > > > > > > > >
> > > > > > > > > > > Best Regards,
> > > > > > > > > > > Jose
> > > > > > > > > > >
> > > > > > > > > > > -----Original Message-----
> > > > > > > > > > > From: Julie Prestopnik via RT [mailto:
> met_help at ucar.edu]
> > > > > > > > > > > Sent: Wednesday, March 09, 2016 12:39 PM
> > > > > > > > > > > To: Jose Garcia-Rivera
> > > > > > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues
> converting
> > > > > > > > > > > PREPBUFR to NetCDF
> > > > > > > > > > >
> > > > > > > > > > > Thank you, Jose! It looks like something went
wrong
> > > > > > > > > > > during
> > > > > > > > > compilation.
> > > > > > > > > > > I suggest recompiling MET to see if we can get
this
> > > > > > > > > > > issue
> > > > > > resolved.
> > > > > > > > > > > NCEP's BUFRLIB is used by the pb2nc MET tool,
and is a
> > > > > > > > > > > required external library for pb2nc. MET is not
yet
> > > > > > > > > > > compatible with BUFRLIB
> > > > > > > > > > version 11.0.0, so we
> > > > > > > > > > > suggest getting version 10.2.3. We are working
on our
> > > > online
> > > > > > > > tutorial
> > > > > > > > > > for
> > > > > > > > > > > METv.5.1, but in the meantime, I'll point you to
our
> > > > > > > > > > > online tutorial directions for installing
BUFRLIB:
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > >
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.
> > > > > > > > > > > 0/
> > > > > > > > > > > co
> > > > > > > > > > > mp
> > > > > > > > > > > ilation/req_libs.php
> > > > > > > > > > >
> > > > > > > > > > > It is also important to review the necessary
> environment
> > > > > > > > > > > variables to
> > > > > > > > > > set:
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > >
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.
> > > > > > > > > > > 0/
> > > > > > > > > > > co
> > > > > > > > > > > mp
> > > > > > > > > > > ilation/configure.php
> > > > > > > > > > >
> > > > > > > > > > > For example,
> > > > > > > > > > >
> > > > > > > > > > > "Set *$MET_BUFR* to point to the main BUFR
directory,
> or
> > > > > > > > > > > set
> > > > > > > > > > > *$MET_BUFRLIB* to point to the directory with
the BUFR
> > > > > > > > > > > library
> > > > > > > files.
> > > > > > > > > > > Because MET doesn't use any BUFR library include
files,
> > > > > > > > > > > you don't need to specify *$MET_BUFRINC* ."
> > > > > > > > > > >
> > > > > > > > > > > Once you've installed the required libraries and
set up
> > > > > > > > > > > your environment variables, you'll be ready to
> configure
> > > > > > > > > > > MET (instructions at the bottom of the last link
above)
> > > > > > > > > > > and then compile and install MET (
> > > > > > > > > > >
> > > > >
http://www.dtcenter.org/met/users/support/online_tutorial/METv5.
> > > > > > > > > > > 0/
> > > > > > > > > > > co
> > > > > > > > > > > mp
> > > > > > > > > > > ilation/compile.php
> > > > > > > > > > > ).
> > > > > > > > > > > After re-installing MET, please run "make test"
again.
> > > > > > > > > > > If you still encounter the same problem, please
send me
> > > > > > > > > > > your
> > > > > > > > > > > *config.log* file and your *make_install.log
*file.
> > > > > > > > > > > Please let me know if you have any
> > > > > > > > > > questions.
> > > > > > > > > > >
> > > > > > > > > > > Please let us know how it goes.
> > > > > > > > > > >
> > > > > > > > > > > Thanks,
> > > > > > > > > > > Julie
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > On Wed, Mar 9, 2016 at 10:22 AM, Jose Garcia-
Rivera via
> > > > > > > > > > > RT < met_help at ucar.edu> wrote:
> > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > <URL:
> > > > > > > > > > > >
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=7543
> > > > > > > > > > > > 3
> > > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > Dear Julie,
> > > > > > > > > > > >
> > > > > > > > > > > > Attached is the test log file. It's showing
the same
> > > > > > > > > > > > issues on pb2nc even with the sample files.
> > > > > > > > > > > >
> > > > > > > > > > > > Best Regards,
> > > > > > > > > > > > Jose
> > > > > > > > > > > >
> > > > > > > > > > > > -----Original Message-----
> > > > > > > > > > > > From: Julie Prestopnik via RT
> > > > > > > > > > > > [mailto:met_help at ucar.edu]
> > > > > > > > > > > > Sent: Tuesday, March 08, 2016 5:28 PM
> > > > > > > > > > > > To: Jose Garcia-Rivera
> > > > > > > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues
> > > > > > > > > > > > converting PREPBUFR to NetCDF
> > > > > > > > > > > >
> > > > > > > > > > > > Hi Jose. Thank you for uploading the files.
> > > > > > > > > > > > Unfortunately, I am unable to reproduce the
error you
> > > > > > > > > > > > are experiencing. I am wondering if you have
> > > > > > > > > > > > successfully used pb2nc before. As a check
could you
> > > > > > > > > > > > please run the following in your met-5.1/
> > > > > > > > directory:
> > > > > > > > > > > >
> > > > > > > > > > > > *make test >& make_test.log*
> > > > > > > > > > > >
> > > > > > > > > > > > and then send me the make_test.log file?
> > > > > > > > > > > >
> > > > > > > > > > > > Thanks,
> > > > > > > > > > > > Julie
> > > > > > > > > > > >
> > > > > > > > > > > > On Tue, Mar 8, 2016 at 11:29 AM, Jose Garcia-
Rivera
> > > > > > > > > > > > via RT < met_help at ucar.edu> wrote:
> > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > > <URL:
> > > > > > > > > > > > >
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75
> > > > > > > > > > > > > 43
> > > > > > > > > > > > > 3
> > > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > > Dear Julie,
> > > > > > > > > > > > >
> > > > > > > > > > > > > I just put the files in 'garcia_data'. I
appreciate
> > > > > > > > > > > > > your
> > > > > > help.
> > > > > > > > > > > > >
> > > > > > > > > > > > > Best Regards,
> > > > > > > > > > > > > Jose
> > > > > > > > > > > > >
> > > > > > > > > > > > > -----Original Message-----
> > > > > > > > > > > > > From: Julie Prestopnik via RT
> > > > > > > > > > > > > [mailto:met_help at ucar.edu]
> > > > > > > > > > > > > Sent: Tuesday, March 08, 2016 1:12 PM
> > > > > > > > > > > > > To: Jose Garcia-Rivera
> > > > > > > > > > > > > Subject: Re: [rt.rap.ucar.edu #75433] Issues
> > > > > > > > > > > > > converting PREPBUFR to NetCDF
> > > > > > > > > > > > >
> > > > > > > > > > > > > Hi Jose. I'm sorry to hear that you are
having
> > > > > > > > > > > > > problems converting a PREPBUFR file to
NetCDF.
> > > > > > > > > > > > >
> > > > > > > > > > > > > Please upload your input files and
configuration
> > > > > > > > > > > > > file to our anonymous ftp site as follows:
> > > > > > > > > > > > >
> http://www.dtcenter.org/met/users/support/met_help.p
> > > > > > > > > > > > > hp
> > > > > > > > > > > > >
> > > > > > > > > > > > > Then I can take a look and get back to you.
> > > > > > > > > > > > >
> > > > > > > > > > > > > Thanks,
> > > > > > > > > > > > > Julie
> > > > > > > > > > > > >
> > > > > > > > > > > > > On Tue, Mar 8, 2016 at 11:01 AM, Jose
Garcia-Rivera
> > > > > > > > > > > > > via RT < met_help at ucar.edu> wrote:
> > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > Tue Mar 08 11:01:25 2016: Request 75433
was acted
> > > upon.
> > > > > > > > > > > > > > Transaction: Ticket created by
GarciaJ at imsg.com
> > > > > > > > > > > > > > Queue: met_help
> > > > > > > > > > > > > > Subject: Issues converting PREPBUFR
to
> NetCDF
> > > > > > > > > > > > > > Owner: Nobody
> > > > > > > > > > > > > > Requestors: GarciaJ at imsg.com
> > > > > > > > > > > > > > Status: new
> > > > > > > > > > > > > > Ticket <URL:
> > > > > > > > > > > > > >
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=
> > > > > > > > > > > > > > 75
> > > > > > > > > > > > > > 43
> > > > > > > > > > > > > > 3
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > Dear Met Help,
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > Trying to convert a PREPBUFR file to
NetCDF.
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > I used the default PB2NC configure file,
and got
> > > > > > > > > > > > > > the
> > > > > > > following:
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > [garciaj at login prepbufr_obs]$ ./pb2nc
> > > > > > > > > > > > > > gdas1.t12z.prepbufr.nr
gdas.20150820.t12z.nc
> > > > > > > > > > > > > > PB2NCConfig_default DEBUG 1: Default
Config
> > > > > > > > > > > > > > File:
> > > > > > > > > > > > > >
> /work/apps/pgi_14.10/met-5.1/share/met/config/PB2N
> > > > > > > > > > > > > > CC on fi g_ de fa ul t DEBUG 1: User
Config File:
> > > > > > > > > > > > > > PB2NCConfig_default DEBUG 1: Creating
NetCDF
> File:
> > > > > > > gdas.20150820.t12z.nc
> > > > > > > > > > > > > > DEBUG 1: Processing PrepBufr File:
> > > > > > > gdas1.t12z.prepbufr.nr
> > > > > > > > > > > > > > DEBUG 1: Blocking PrepBufr file to:
> > > > > > > > > /tmp/tmp_pb2nc_blk_32144_0
> > > > > > > > > > > > > > WARNING:
> > > > > > > > > > > > > > WARNING: process_pbfile() -> No PrepBufr
messages
> > > > > > > > > > > > > > to process in
> > > > > > > > > > file:
> > > > > > > > > > > > > > gdas1.t12z.prepbufr.nr
> > > > > > > > > > > > > > WARNING:
> > > > > > > > > > > > > > ERROR :
> > > > > > > > > > > > > > ERROR : write_netcdf_hdr_data() -> No
PrepBufr
> > > > > > > > > > > > > > messages
> > > > > > > > > retained.
> > > > > > > > > > > > > > Nothing to write.
> > > > > > > > > > > > > > ERROR :
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > Thanks in advance for the help, Jose M.
> > > > > > > > > > > > > > Garcia-Rivera, PhD IM Systems Group
> > > > > > > > > > > > > > Rockville/College Park, MD This e-mail,
including
> > > > > > > > > > > > > > attachments, may include confidential
and/or
> > > > > > > > > > > > > > proprietary information, and may be used
only by
> > > > > > > > > > > > > > the person or entity to which it is
addressed. If
> > > > > > > > > > > > > > the reader of this e-mail is not the
intended
> > > > > > > > > > > > > > recipient or his or her authorized agent,
the
> > > > > > > > > > > > > > reader is hereby notified that any
dissemination,
> > > > > > > > > > > > > > distribution or
> > > > copying of this e-mail is prohibited.
> > > > > > > > > > > > > > If you have received this e-mail in error,
please
> > > > > > > > > > > > > > notify the sender by replying to this
message and
> > > > > > > > > > > > > > delete this
> > > > > > > > > > > > > e-mail immediately.
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > > --
> > > > > > > > > > > > > Julie Prestopnik
> > > > > > > > > > > > > National Center for Atmospheric Research
Research
> > > > > > > > > > > > > Applications Laboratory
> > > > > > > > > > > > > Phone: 303.497.8399
> > > > > > > > > > > > > Email: jpresto at ucar.edu
> > > > > > > > > > > > >
> > > > > > > > > > > > > This e-mail, including attachments, may
include
> > > > > > > > > > > > > confidential and/or proprietary information,
and
> may
> > > > > > > > > > > > > be used only by the person or entity to
which it is
> > > > > > > > > > > > > addressed. If the reader of this e-mail is
not the
> > > > > > > > > > > > > intended recipient or his or her authorized
agent,
> > > > > > > > > > > > > the reader is hereby notified that any
> > > > > > > > > > > > > dissemination, distribution or copying of
this
> e-mail
> > > is prohibited.
> > > > > > > > > > > > > If you have received this e-mail in error,
please
> > > > > > > > > > > > > notify the sender by replying to this
message and
> > > > > > > > > > > > > delete this
> > > > > > > > > > > > e-mail immediately.
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > --
> > > > > > > > > > > > Julie Prestopnik
> > > > > > > > > > > > National Center for Atmospheric Research
Research
> > > > > > > > > > > > Applications Laboratory
> > > > > > > > > > > > Phone: 303.497.8399
> > > > > > > > > > > > Email: jpresto at ucar.edu
> > > > > > > > > > > >
> > > > > > > > > > > > This e-mail, including attachments, may
include
> > > > > > > > > > > > confidential and/or proprietary information,
and may
> > > > > > > > > > > > be used only by the person or entity to which
it is
> > > > > > > > > > > > addressed. If the reader of this e-mail is not
the
> > > > > > > > > > > > intended recipient or his or her authorized
agent,
> the
> > > > > > > > > > > > reader is hereby notified that any
dissemination,
> > > > > > > > > > > > distribution or copying of this e-mail is
prohibited.
> > > > > > > > > > > > If you have received this e-mail in error,
please
> > > > > > > > > > > > notify the sender by replying to this message
and
> > > > > > > > > > > > delete this
> > > > > > > > > > > e-mail immediately.
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > --
> > > > > > > > > > > Julie Prestopnik
> > > > > > > > > > > National Center for Atmospheric Research
Research
> > > > > > > > > > > Applications Laboratory
> > > > > > > > > > > Phone: 303.497.8399
> > > > > > > > > > > Email: jpresto at ucar.edu
> > > > > > > > > > >
> > > > > > > > > > > This e-mail, including attachments, may include
> > > > > > > > > > > confidential and/or proprietary information, and
may be
> > > > > > > > > > > used only by the person or entity to which it is
> > > > > > > > > > > addressed. If the reader of this e-mail is not
the
> > > > > > > > > > > intended recipient or his or her authorized
agent, the
> > > > > > > > > > > reader is hereby notified that any
dissemination,
> > > > > > > > > > > distribution or copying of this e-mail is
prohibited.
> If
> > > > > > > > > > > you have received this e-mail in error, please
notify
> > > > > > > > > > > the sender by replying to this message and
delete this
> > > > > > > > > > e-mail immediately.
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > --
> > > > > > > > > > Julie Prestopnik
> > > > > > > > > > National Center for Atmospheric Research Research
> > > > > > > > > > Applications Laboratory
> > > > > > > > > > Phone: 303.497.8399
> > > > > > > > > > Email: jpresto at ucar.edu
> > > > > > > > > >
> > > > > > > > > > This e-mail, including attachments, may include
> > > > > > > > > > confidential and/or proprietary information, and
may be
> > > > > > > > > > used only by the person or entity to which it is
> > > > > > > > > > addressed. If the reader of this e-mail is not the
> > > > > > > > > > intended recipient or his or her authorized agent,
the
> > > > > > > > > > reader is hereby notified that any dissemination,
> > > > > > > > > > distribution or copying of this e-mail is
prohibited. If
> > > > > > > > > > you have received this e-mail in error, please
notify the
> > > > > > > > > > sender by replying to this message and delete this
> > > > > > > > > e-mail immediately.
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > --
> > > > > > > > > Julie Prestopnik
> > > > > > > > > National Center for Atmospheric Research Research
> > > > > > > > > Applications Laboratory
> > > > > > > > > Phone: 303.497.8399
> > > > > > > > > Email: jpresto at ucar.edu
> > > > > > > > >
> > > > > > > > > This e-mail, including attachments, may include
> confidential
> > > > > > > > > and/or proprietary information, and may be used only
by the
> > > > > > > > > person or entity to which it is addressed. If the
reader of
> > > > > > > > > this e-mail is not the intended recipient or his or
her
> > > > > > > > > authorized agent, the reader is hereby notified that
any
> > > > > > > > > dissemination, distribution or copying of this e-
mail is
> > > > > > > > > prohibited. If you have received this e-mail in
error,
> > > > > > > > > please notify the sender by replying to this message
and
> > > > > > > > > delete this
> > > > > > > > e-mail immediately.
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > --
> > > > > > > > Julie Prestopnik
> > > > > > > > National Center for Atmospheric Research Research
> Applications
> > > > > > > > Laboratory
> > > > > > > > Phone: 303.497.8399
> > > > > > > > Email: jpresto at ucar.edu
> > > > > > > >
> > > > > > > > This e-mail, including attachments, may include
confidential
> > > > > > > > and/or proprietary information, and may be used only
by the
> > > > > > > > person or entity to which it is addressed. If the
reader of
> > > > > > > > this e-mail is not the intended recipient or his or
her
> > > > > > > > authorized agent, the reader is hereby notified that
any
> > > > > > > > dissemination, distribution or copying of this e-mail
is
> > > > > > > > prohibited. If you have received this e-mail in error,
please
> > > > > > > > notify the sender by replying to this message and
delete this
> > > > > > > e-mail immediately.
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > --
> > > > > > > Julie Prestopnik
> > > > > > > National Center for Atmospheric Research Research
Applications
> > > > > > > Laboratory
> > > > > > > Phone: 303.497.8399
> > > > > > > Email: jpresto at ucar.edu
> > > > > > >
> > > > > > > This e-mail, including attachments, may include
confidential
> > > > > > > and/or proprietary information, and may be used only by
the
> > > > > > > person or entity to which it is addressed. If the reader
of
> this
> > > > > > > e-mail is not the intended recipient or his or her
authorized
> > > > > > > agent, the reader is hereby notified that any
dissemination,
> > > > > > > distribution or copying of this e-mail is prohibited. If
you
> > > > > > > have received this e-mail in error, please notify the
sender by
> > > > > > > replying to this message and delete this
> > > > > > e-mail immediately.
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > >
> > > > > >
> > > > > > --
> > > > > > Julie Prestopnik
> > > > > > National Center for Atmospheric Research Research
Applications
> > > > > > Laboratory
> > > > > > Phone: 303.497.8399
> > > > > > Email: jpresto at ucar.edu
> > > > > >
> > > > > > This e-mail, including attachments, may include
confidential
> > > > > > and/or proprietary information, and may be used only by
the
> person
> > > > > > or entity to which it is addressed. If the reader of this
e-mail
> > > > > > is not the intended recipient or his or her authorized
agent, the
> > > > > > reader is hereby notified that any dissemination,
distribution or
> > > > > > copying of this e-mail is prohibited. If you have received
this
> > > > > > e-mail in error, please notify the sender by replying to
this
> > > > > > message and delete this
> > > > > e-mail immediately.
> > > > > >
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > > > --
> > > > > Julie Prestopnik
> > > > > National Center for Atmospheric Research Research
Applications
> > > > > Laboratory
> > > > > Phone: 303.497.8399
> > > > > Email: jpresto at ucar.edu
> > > > >
> > > > > This e-mail, including attachments, may include confidential
and/or
> > > > > proprietary information, and may be used only by the person
or
> > > > > entity to which it is addressed. If the reader of this e-
mail is
> not
> > > > > the intended recipient or his or her authorized agent, the
reader
> is
> > > > > hereby notified that any dissemination, distribution or
copying of
> > > > > this e-mail is prohibited. If you have received this e-mail
in
> > > > > error, please notify the sender by replying to this message
and
> > > > > delete this
> > > > e-mail immediately.
> > > > >
> > > > >
> > > >
> > > > This e-mail, including attachments, may include confidential
and/or
> > > > proprietary information, and may be used only by the person or
entity
> > > > to which it is addressed. If the reader of this e-mail is not
the
> > > > intended recipient or his or her authorized agent, the reader
is
> > > > hereby notified that any dissemination, distribution or
copying of
> > > > this e-mail is prohibited. If you have received this e-mail in
error,
> > > > please notify the sender by replying to this message and
delete this
> > > e-mail immediately.
> > > >
> > > >
> > > >
> > >
> > > This e-mail, including attachments, may include confidential
and/or
> > > proprietary information, and may be used only by the person or
entity
> to
> > > which it is addressed. If the reader of this e-mail is not the
intended
> > > recipient or his or her authorized agent, the reader is hereby
notified
> > > that any dissemination, distribution or copying of this e-mail
is
> > > prohibited. If you have received this e-mail in error, please
notify
> the
> > > sender by replying to this message and delete this e-mail
immediately.
> > >
> > >
> > >
> >
> > This e-mail, including attachments, may include confidential
and/or
> > proprietary information, and may be used only by the person or
entity to
> > which it is addressed. If the reader of this e-mail is not the
intended
> > recipient or his or her authorized agent, the reader is hereby
notified
> > that any dissemination, distribution or copying of this e-mail is
> > prohibited. If you have received this e-mail in error, please
notify the
> > sender by replying to this message and delete this e-mail
immediately.
> >
> >
> >
>
> This e-mail, including attachments, may include confidential and/or
> proprietary information, and may be used only by the person or
entity to
> which it is addressed. If the reader of this e-mail is not the
intended
> recipient or his or her authorized agent, the reader is hereby
notified
> that any dissemination, distribution or copying of this e-mail is
> prohibited. If you have received this e-mail in error, please notify
the
> sender by replying to this message and delete this e-mail
immediately.
>
>
>
This e-mail, including attachments, may include confidential and/or
proprietary information, and may be used only by the person or entity
to which it is addressed. If the reader of this e-mail is not the
intended recipient or his or her authorized agent, the reader is
hereby notified that any dissemination, distribution or copying of
this e-mail is prohibited. If you have received this e-mail in error,
please notify the sender by replying to this message and delete this
e-mail immediately.
------------------------------------------------
More information about the Met_help
mailing list