[Met_help] [rt.rap.ucar.edu #69196] History for Questions about PREPBUFR DATA in MET
John Halley Gotway via RT
met_help at ucar.edu
Mon Oct 6 09:29:06 MDT 2014
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Dear Officer,
I'm trying to use MET to convert Prepbufr data to NC format, I can run the /pb2nc successfully on the conventional Prepbufr data provided by NCEP/NCAR, but when I tried to use this program on Tail Doppler Radar(TDR) Prepbufr data, the following errors appears:
EBUG 1: User Config File: tutorial/config/PB2NCConfig_tutorial
DEBUG 1: Creating NetCDF File: tutorial/out/pb2nc/tutorial_pb.nc
DEBUG 1: Processing PrepBufr File: data/sample_obs/prepbufr/gdas1.t12z.tldplr.tm00.bufr_d
DEBUG 1: Blocking PrepBufr file to: /tmp/tmp_pb2nc_blk_11947_0
DEBUG 2: PrepBufr Time Center: 20100902_100000
DEBUG 2: Searching Time Window: 20100902_093000 to 20100902_103000
DEBUG 2: Processing 936513 PrepBufr messages...
ERROR :
ERROR : process_pbfile() -> the observation time should remain the same for all PrepBufr messages: 1283425200 != 1283421600
ERROR :
Could you please tell me what is this error mean, and how to solve this problem?
In addition, I would like to consult you whether MET is installed in Jet server? I have compiled most of the application of MET by myself, but I can't compile the modis regrib and the graphics part of MET successfully in Jet server.
Thanks in advance, and looking forward to hear from you soon!
Best wishes,
Shixuan
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: Questions about PREPBUFR DATA in MET
From: John Halley Gotway
Time: Thu Oct 02 14:28:49 2014
Shixuan,
I see that you're having trouble running the PB2NC tool. I'm
wondering if
the file that you're running is actually a PREPBUFR file or is it
perhaps a
BUFR file instead? PB2NC is set up to specifically read PREPBUFR
files but
doesn't work on the more general BUFR format.
If this is in fact a PREPBUFR file, I can tell you that PREPBUFR files
usually have a single center time defined for each file. The times of
the
actual PREPBUFR messages are stored as offsets from this center time.
The
error is saying that the center time has changed from one message to
another. It's possible that this a valid way of storing times that we
just
have not yet encountered. If so, we'd need to tweak the logic in the
PB2NC
tool to handle it.
Can you tell me where you got this file? If it's on jet, can you
please
tell me where I could find it. If it's publicly available on an ftp
somewhere, please just send me the link. If not, you could post it to
our
anonymous ftp site following these instructions:
http://www.dtcenter.org/met/users/support/met_help.php#ftp
Regarding an installation on jet, METv4.1 is installed in my home
directory:
/misc/whome/John.H.Gotway/MET_releases/METv4.1
But I haven't installed met-5.0 yet. And I'd like to put it in a more
common area than just my home directory.
Thanks,
John Halley Gotway
met_help at ucar.edu
On Thu, Oct 2, 2014 at 12:58 AM, SHIXUAN ZHANG via RT
<met_help at ucar.edu>
wrote:
>
> Thu Oct 02 00:58:56 2014: Request 69196 was acted upon.
> Transaction: Ticket created by shixuan.zhang at utah.edu
> Queue: met_help
> Subject: Questions about PREPBUFR DATA in MET
> Owner: Nobody
> Requestors: shixuan.zhang at utah.edu
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=69196 >
>
>
> Dear Officer,
>
> I'm trying to use MET to convert Prepbufr data to NC format, I can
run the
> /pb2nc successfully on the conventional Prepbufr data provided by
> NCEP/NCAR, but when I tried to use this program on Tail Doppler
Radar(TDR)
> Prepbufr data, the following errors appears:
>
>
> EBUG 1: User Config File: tutorial/config/PB2NCConfig_tutorial
>
> DEBUG 1: Creating NetCDF File: tutorial/out/pb2nc/tutorial_pb.nc
>
> DEBUG 1: Processing PrepBufr File:
> data/sample_obs/prepbufr/gdas1.t12z.tldplr.tm00.bufr_d
>
> DEBUG 1: Blocking PrepBufr file to: /tmp/tmp_pb2nc_blk_11947_0
>
> DEBUG 2: PrepBufr Time Center: 20100902_100000
>
> DEBUG 2: Searching Time Window: 20100902_093000 to 20100902_103000
>
> DEBUG 2: Processing 936513 PrepBufr messages...
>
> ERROR :
>
> ERROR : process_pbfile() -> the observation time should remain the
same
> for all PrepBufr messages: 1283425200 != 1283421600
>
> ERROR :
>
> Could you please tell me what is this error mean, and how to solve
this
> problem?
>
> In addition, I would like to consult you whether MET is installed in
Jet
> server? I have compiled most of the application of MET by myself,
but I
> can't compile the modis regrib and the graphics part of MET
successfully in
> Jet server.
>
> Thanks in advance, and looking forward to hear from you soon!
>
> Best wishes,
>
> Shixuan
>
>
>
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #69196] Questions about PREPBUFR DATA in MET
From: SHIXUAN ZHANG
Time: Thu Oct 02 14:55:47 2014
Dear John,
Thank your for your kind help, you can see the files in the following
direcotry:
/lfs1/projects/hwrf-vd/hwrf-input/TDR/2010/
all the files are the same format.
As you say, this file maybe a BUFR format. If it is, is there any way
to deal with the BUFR format file?
Thanks again,
Best wishes,
Shixuan
________________________________________
From: John Halley Gotway via RT [met_help at ucar.edu]
Sent: Thursday, October 02, 2014 2:28 PM
To: SHIXUAN ZHANG
Subject: Re: [rt.rap.ucar.edu #69196] Questions about PREPBUFR DATA in
MET
Shixuan,
I see that you're having trouble running the PB2NC tool. I'm
wondering if
the file that you're running is actually a PREPBUFR file or is it
perhaps a
BUFR file instead? PB2NC is set up to specifically read PREPBUFR
files but
doesn't work on the more general BUFR format.
If this is in fact a PREPBUFR file, I can tell you that PREPBUFR files
usually have a single center time defined for each file. The times of
the
actual PREPBUFR messages are stored as offsets from this center time.
The
error is saying that the center time has changed from one message to
another. It's possible that this a valid way of storing times that we
just
have not yet encountered. If so, we'd need to tweak the logic in the
PB2NC
tool to handle it.
Can you tell me where you got this file? If it's on jet, can you
please
tell me where I could find it. If it's publicly available on an ftp
somewhere, please just send me the link. If not, you could post it to
our
anonymous ftp site following these instructions:
http://www.dtcenter.org/met/users/support/met_help.php#ftp
Regarding an installation on jet, METv4.1 is installed in my home
directory:
/misc/whome/John.H.Gotway/MET_releases/METv4.1
But I haven't installed met-5.0 yet. And I'd like to put it in a more
common area than just my home directory.
Thanks,
John Halley Gotway
met_help at ucar.edu
On Thu, Oct 2, 2014 at 12:58 AM, SHIXUAN ZHANG via RT
<met_help at ucar.edu>
wrote:
>
> Thu Oct 02 00:58:56 2014: Request 69196 was acted upon.
> Transaction: Ticket created by shixuan.zhang at utah.edu
> Queue: met_help
> Subject: Questions about PREPBUFR DATA in MET
> Owner: Nobody
> Requestors: shixuan.zhang at utah.edu
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=69196 >
>
>
> Dear Officer,
>
> I'm trying to use MET to convert Prepbufr data to NC format, I can
run the
> /pb2nc successfully on the conventional Prepbufr data provided by
> NCEP/NCAR, but when I tried to use this program on Tail Doppler
Radar(TDR)
> Prepbufr data, the following errors appears:
>
>
> EBUG 1: User Config File: tutorial/config/PB2NCConfig_tutorial
>
> DEBUG 1: Creating NetCDF File: tutorial/out/pb2nc/tutorial_pb.nc
>
> DEBUG 1: Processing PrepBufr File:
> data/sample_obs/prepbufr/gdas1.t12z.tldplr.tm00.bufr_d
>
> DEBUG 1: Blocking PrepBufr file to: /tmp/tmp_pb2nc_blk_11947_0
>
> DEBUG 2: PrepBufr Time Center: 20100902_100000
>
> DEBUG 2: Searching Time Window: 20100902_093000 to 20100902_103000
>
> DEBUG 2: Processing 936513 PrepBufr messages...
>
> ERROR :
>
> ERROR : process_pbfile() -> the observation time should remain the
same
> for all PrepBufr messages: 1283425200 != 1283421600
>
> ERROR :
>
> Could you please tell me what is this error mean, and how to solve
this
> problem?
>
> In addition, I would like to consult you whether MET is installed in
Jet
> server? I have compiled most of the application of MET by myself,
but I
> can't compile the modis regrib and the graphics part of MET
successfully in
> Jet server.
>
> Thanks in advance, and looking forward to hear from you soon!
>
> Best wishes,
>
> Shixuan
>
>
>
------------------------------------------------
Subject: Questions about PREPBUFR DATA in MET
From: John Halley Gotway
Time: Fri Oct 03 12:22:02 2014
Shixuan,
Thanks for pointing me to those files on jet. Yep, they look to be
BUFR
data which the pb2nc tool cannot handle directly. You could try using
GDAS
PREPBUFR files. We've listed links to them here:
http://www.dtcenter.org/met/users/downloads/observation_data.php
For example:
http://nomads.ncep.noaa.gov/pub/data/nccf/com/gfs/prod/gdas.20141002/gdas1.t00z.prepbufr.nr
We've discussed trying to support BUFR files directly, but
unfortunately
haven't found the time or funding to do so. However, a lot of the
data in
the BUFR files does get included in the PREPBUFR output of the data
assimilation.
Thanks,
John
On Thu, Oct 2, 2014 at 2:55 PM, SHIXUAN ZHANG via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=69196 >
>
> Dear John,
>
> Thank your for your kind help, you can see the files in the
following
> direcotry:
>
> /lfs1/projects/hwrf-vd/hwrf-input/TDR/2010/
>
> all the files are the same format.
>
> As you say, this file maybe a BUFR format. If it is, is there any
way to
> deal with the BUFR format file?
>
> Thanks again,
>
> Best wishes,
>
> Shixuan
> ________________________________________
> From: John Halley Gotway via RT [met_help at ucar.edu]
> Sent: Thursday, October 02, 2014 2:28 PM
> To: SHIXUAN ZHANG
> Subject: Re: [rt.rap.ucar.edu #69196] Questions about PREPBUFR DATA
in MET
>
> Shixuan,
>
> I see that you're having trouble running the PB2NC tool. I'm
wondering if
> the file that you're running is actually a PREPBUFR file or is it
perhaps a
> BUFR file instead? PB2NC is set up to specifically read PREPBUFR
files but
> doesn't work on the more general BUFR format.
>
> If this is in fact a PREPBUFR file, I can tell you that PREPBUFR
files
> usually have a single center time defined for each file. The times
of the
> actual PREPBUFR messages are stored as offsets from this center
time. The
> error is saying that the center time has changed from one message to
> another. It's possible that this a valid way of storing times that
we just
> have not yet encountered. If so, we'd need to tweak the logic in
the PB2NC
> tool to handle it.
>
> Can you tell me where you got this file? If it's on jet, can you
please
> tell me where I could find it. If it's publicly available on an ftp
> somewhere, please just send me the link. If not, you could post it
to our
> anonymous ftp site following these instructions:
> http://www.dtcenter.org/met/users/support/met_help.php#ftp
>
> Regarding an installation on jet, METv4.1 is installed in my home
> directory:
> /misc/whome/John.H.Gotway/MET_releases/METv4.1
>
> But I haven't installed met-5.0 yet. And I'd like to put it in a
more
> common area than just my home directory.
>
> Thanks,
> John Halley Gotway
> met_help at ucar.edu
>
> On Thu, Oct 2, 2014 at 12:58 AM, SHIXUAN ZHANG via RT
<met_help at ucar.edu>
> wrote:
>
> >
> > Thu Oct 02 00:58:56 2014: Request 69196 was acted upon.
> > Transaction: Ticket created by shixuan.zhang at utah.edu
> > Queue: met_help
> > Subject: Questions about PREPBUFR DATA in MET
> > Owner: Nobody
> > Requestors: shixuan.zhang at utah.edu
> > Status: new
> > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=69196 >
> >
> >
> > Dear Officer,
> >
> > I'm trying to use MET to convert Prepbufr data to NC format, I can
run
> the
> > /pb2nc successfully on the conventional Prepbufr data provided by
> > NCEP/NCAR, but when I tried to use this program on Tail Doppler
> Radar(TDR)
> > Prepbufr data, the following errors appears:
> >
> >
> > EBUG 1: User Config File: tutorial/config/PB2NCConfig_tutorial
> >
> > DEBUG 1: Creating NetCDF File: tutorial/out/pb2nc/tutorial_pb.nc
> >
> > DEBUG 1: Processing PrepBufr File:
> > data/sample_obs/prepbufr/gdas1.t12z.tldplr.tm00.bufr_d
> >
> > DEBUG 1: Blocking PrepBufr file to: /tmp/tmp_pb2nc_blk_11947_0
> >
> > DEBUG 2: PrepBufr Time Center: 20100902_100000
> >
> > DEBUG 2: Searching Time Window: 20100902_093000 to 20100902_103000
> >
> > DEBUG 2: Processing 936513 PrepBufr messages...
> >
> > ERROR :
> >
> > ERROR : process_pbfile() -> the observation time should remain
the same
> > for all PrepBufr messages: 1283425200 != 1283421600
> >
> > ERROR :
> >
> > Could you please tell me what is this error mean, and how to solve
this
> > problem?
> >
> > In addition, I would like to consult you whether MET is installed
in Jet
> > server? I have compiled most of the application of MET by myself,
but I
> > can't compile the modis regrib and the graphics part of MET
successfully
> in
> > Jet server.
> >
> > Thanks in advance, and looking forward to hear from you soon!
> >
> > Best wishes,
> >
> > Shixuan
> >
> >
> >
>
>
>
>
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #69196] Questions about PREPBUFR DATA in MET
From: SHIXUAN ZHANG
Time: Fri Oct 03 12:53:45 2014
Dear John,
Thank you for your kind help. I will try to use other ways.
Best,
shixuan
________________________________________
From: John Halley Gotway via RT [met_help at ucar.edu]
Sent: Friday, October 03, 2014 12:22 PM
To: SHIXUAN ZHANG
Subject: Re: [rt.rap.ucar.edu #69196] Questions about PREPBUFR DATA in
MET
Shixuan,
Thanks for pointing me to those files on jet. Yep, they look to be
BUFR
data which the pb2nc tool cannot handle directly. You could try using
GDAS
PREPBUFR files. We've listed links to them here:
http://www.dtcenter.org/met/users/downloads/observation_data.php
For example:
http://nomads.ncep.noaa.gov/pub/data/nccf/com/gfs/prod/gdas.20141002/gdas1.t00z.prepbufr.nr
We've discussed trying to support BUFR files directly, but
unfortunately
haven't found the time or funding to do so. However, a lot of the
data in
the BUFR files does get included in the PREPBUFR output of the data
assimilation.
Thanks,
John
On Thu, Oct 2, 2014 at 2:55 PM, SHIXUAN ZHANG via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=69196 >
>
> Dear John,
>
> Thank your for your kind help, you can see the files in the
following
> direcotry:
>
> /lfs1/projects/hwrf-vd/hwrf-input/TDR/2010/
>
> all the files are the same format.
>
> As you say, this file maybe a BUFR format. If it is, is there any
way to
> deal with the BUFR format file?
>
> Thanks again,
>
> Best wishes,
>
> Shixuan
> ________________________________________
> From: John Halley Gotway via RT [met_help at ucar.edu]
> Sent: Thursday, October 02, 2014 2:28 PM
> To: SHIXUAN ZHANG
> Subject: Re: [rt.rap.ucar.edu #69196] Questions about PREPBUFR DATA
in MET
>
> Shixuan,
>
> I see that you're having trouble running the PB2NC tool. I'm
wondering if
> the file that you're running is actually a PREPBUFR file or is it
perhaps a
> BUFR file instead? PB2NC is set up to specifically read PREPBUFR
files but
> doesn't work on the more general BUFR format.
>
> If this is in fact a PREPBUFR file, I can tell you that PREPBUFR
files
> usually have a single center time defined for each file. The times
of the
> actual PREPBUFR messages are stored as offsets from this center
time. The
> error is saying that the center time has changed from one message to
> another. It's possible that this a valid way of storing times that
we just
> have not yet encountered. If so, we'd need to tweak the logic in
the PB2NC
> tool to handle it.
>
> Can you tell me where you got this file? If it's on jet, can you
please
> tell me where I could find it. If it's publicly available on an ftp
> somewhere, please just send me the link. If not, you could post it
to our
> anonymous ftp site following these instructions:
> http://www.dtcenter.org/met/users/support/met_help.php#ftp
>
> Regarding an installation on jet, METv4.1 is installed in my home
> directory:
> /misc/whome/John.H.Gotway/MET_releases/METv4.1
>
> But I haven't installed met-5.0 yet. And I'd like to put it in a
more
> common area than just my home directory.
>
> Thanks,
> John Halley Gotway
> met_help at ucar.edu
>
> On Thu, Oct 2, 2014 at 12:58 AM, SHIXUAN ZHANG via RT
<met_help at ucar.edu>
> wrote:
>
> >
> > Thu Oct 02 00:58:56 2014: Request 69196 was acted upon.
> > Transaction: Ticket created by shixuan.zhang at utah.edu
> > Queue: met_help
> > Subject: Questions about PREPBUFR DATA in MET
> > Owner: Nobody
> > Requestors: shixuan.zhang at utah.edu
> > Status: new
> > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=69196 >
> >
> >
> > Dear Officer,
> >
> > I'm trying to use MET to convert Prepbufr data to NC format, I can
run
> the
> > /pb2nc successfully on the conventional Prepbufr data provided by
> > NCEP/NCAR, but when I tried to use this program on Tail Doppler
> Radar(TDR)
> > Prepbufr data, the following errors appears:
> >
> >
> > EBUG 1: User Config File: tutorial/config/PB2NCConfig_tutorial
> >
> > DEBUG 1: Creating NetCDF File: tutorial/out/pb2nc/tutorial_pb.nc
> >
> > DEBUG 1: Processing PrepBufr File:
> > data/sample_obs/prepbufr/gdas1.t12z.tldplr.tm00.bufr_d
> >
> > DEBUG 1: Blocking PrepBufr file to: /tmp/tmp_pb2nc_blk_11947_0
> >
> > DEBUG 2: PrepBufr Time Center: 20100902_100000
> >
> > DEBUG 2: Searching Time Window: 20100902_093000 to 20100902_103000
> >
> > DEBUG 2: Processing 936513 PrepBufr messages...
> >
> > ERROR :
> >
> > ERROR : process_pbfile() -> the observation time should remain
the same
> > for all PrepBufr messages: 1283425200 != 1283421600
> >
> > ERROR :
> >
> > Could you please tell me what is this error mean, and how to solve
this
> > problem?
> >
> > In addition, I would like to consult you whether MET is installed
in Jet
> > server? I have compiled most of the application of MET by myself,
but I
> > can't compile the modis regrib and the graphics part of MET
successfully
> in
> > Jet server.
> >
> > Thanks in advance, and looking forward to hear from you soon!
> >
> > Best wishes,
> >
> > Shixuan
> >
> >
> >
>
>
>
>
------------------------------------------------
More information about the Met_help
mailing list