[Met_help] [rt.rap.ucar.edu #80501] History for pulling out certain hours from prepbufr when using pb2nc
John Halley Gotway via RT
met_help at ucar.edu
Wed May 17 15:53:15 MDT 2017
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Hi,
I was wondering if there was a way of only pulling out certain hours from
the prepbufr file when writing to a NetCDF file? For example, I want to
match my observation time range of 2017050100_000000 - 2017050100_005959 to
a 00hour GFS forecast file, then 2017050100_010000 - 2017050100_015959 to a
01hour GFS forecast file, etc.
My call to pb2nc looks like:
pb2nc gfs.t00z.prepbufr uv_wind_pb_20170501_f00.nc PB2NCConfig -valid_beg
20170501_000000 -valid_end 20170501_005959 -v 2
and, I get an error message:
WARNING:
WARNING: process_pbfile() -> No PrepBufr messages retained from file:
/com2/gfs/prod/gfs.20170504/gfs.t00z.prepbufr
WARNING:
ERROR :
ERROR : write_netcdf_hdr_data() -> No PrepBufr messages retained. Nothing
to write.
ERROR :
But, when I look at the output from my initially processed file, where I
didn't set the begin and end date, I have data time stamped
20170501_000726, which is within that time range. So, I'm not sure why
this doesn't work. Any ideas?
Roz
--
Rosalyn MacCracken
Support Scientist
Ocean Applilcations Branch
NOAA/NWS Ocean Prediction Center
NCWCP
5830 University Research Ct
College Park, MD 20740-3818
(p) 301-683-1551
rosalyn.maccracken at noaa.gov
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: pulling out certain hours from prepbufr when using pb2nc
From: John Halley Gotway
Time: Wed May 17 13:32:48 2017
Roz,
You have an error in your script in the processing of timesteps. Look
very
closely at the warning message and compare it to the command line:
WARNING: process_pbfile() -> No PrepBufr messages retained from file:
/com2/gfs/prod/gfs.20170504/gfs.t00z.prepbufr
pb2nc gfs.t00z.prepbufr uv_wind_pb_20170501_f00.nc PB2NCConfig
-valid_beg
20170501_000000 -valid_end 20170501_005959 -v 2
On the command line, you're trying to process data from 20170501, but
the
warning message indicates that the "gfs.t00z.prepbufr" file lives in a
directory with a timestamp of "gfs.20170504"... which is 3 days later.
John
On Wed, May 17, 2017 at 12:59 PM, Rosalyn MacCracken - NOAA Affiliate
via
RT <met_help at ucar.edu> wrote:
>
> Wed May 17 12:59:37 2017: Request 80501 was acted upon.
> Transaction: Ticket created by rosalyn.maccracken at noaa.gov
> Queue: met_help
> Subject: pulling out certain hours from prepbufr when using
pb2nc
> Owner: Nobody
> Requestors: rosalyn.maccracken at noaa.gov
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80501 >
>
>
> Hi,
>
> I was wondering if there was a way of only pulling out certain hours
from
> the prepbufr file when writing to a NetCDF file? For example, I
want to
> match my observation time range of 2017050100_000000 -
2017050100_005959
> to
> a 00hour GFS forecast file, then 2017050100_010000 -
2017050100_015959 to
> a
> 01hour GFS forecast file, etc.
>
> My call to pb2nc looks like:
> pb2nc gfs.t00z.prepbufr uv_wind_pb_20170501_f00.nc PB2NCConfig
-valid_beg
> 20170501_000000 -valid_end 20170501_005959 -v 2
>
> and, I get an error message:
> WARNING:
> WARNING: process_pbfile() -> No PrepBufr messages retained from
file:
> /com2/gfs/prod/gfs.20170504/gfs.t00z.prepbufr
> WARNING:
> ERROR :
> ERROR : write_netcdf_hdr_data() -> No PrepBufr messages retained.
Nothing
> to write.
> ERROR :
>
> But, when I look at the output from my initially processed file,
where I
> didn't set the begin and end date, I have data time stamped
> 20170501_000726, which is within that time range. So, I'm not sure
why
> this doesn't work. Any ideas?
>
> Roz
>
> --
> Rosalyn MacCracken
> Support Scientist
>
> Ocean Applilcations Branch
> NOAA/NWS Ocean Prediction Center
> NCWCP
> 5830 University Research Ct
> College Park, MD 20740-3818
>
> (p) 301-683-1551
> rosalyn.maccracken at noaa.gov
>
>
------------------------------------------------
Subject: pulling out certain hours from prepbufr when using pb2nc
From: Rosalyn MacCracken - NOAA Affiliate
Time: Wed May 17 13:56:20 2017
Oh, silly me. That's a copy paste and removing my wildcard characters
from
my script. I was creating images for 20170501 at the same time I was
typing the email. So, I did pass in the correct date, 20170504. I
have
those variables set in my script. The lines in my script looks like:
YYYY=2017
MM=05
DD=04
HH=00
for fhr in 00 01 02 03 04 05 06
do
pb2nc ${OPERDATA}gfs.${YYYY}${MM}${DD}/gfs.t${HH}z.prepbufr
${MASTERDIR_HRLY}uv_wind_pb_${YYYY}${MM}${DD}${HH}_f${fhr}.nc
${CONFIGDIR}PB2NCConfig_working -valid_beg
${YYYY}${MM}${DD}_${fhr}0000
-valid_end ${YYYY}${MM}${DD}_${fhr}5959 -v 2
done
which works just fine. Then, I double checked the the data was there
by
running the command again, without specifying the -valid_beg and
_valid_end
and then running point-stat, and I can see that there is matched pair
data
with the obs time stamp of 20170504_000114. I'm sure there is other
time
steps as well. So, this should work...right?
Roz
On Wed, May 17, 2017 at 7:32 PM, John Halley Gotway via RT <
met_help at ucar.edu> wrote:
> Roz,
>
> You have an error in your script in the processing of timesteps.
Look very
> closely at the warning message and compare it to the command line:
>
> WARNING: process_pbfile() -> No PrepBufr messages retained from
file:
> /com2/gfs/prod/gfs.20170504/gfs.t00z.prepbufr
>
> pb2nc gfs.t00z.prepbufr uv_wind_pb_20170501_f00.nc PB2NCConfig
-valid_beg
> 20170501_000000 -valid_end 20170501_005959 -v 2
>
> On the command line, you're trying to process data from 20170501,
but the
> warning message indicates that the "gfs.t00z.prepbufr" file lives in
a
> directory with a timestamp of "gfs.20170504"... which is 3 days
later.
>
> John
>
>
>
> On Wed, May 17, 2017 at 12:59 PM, Rosalyn MacCracken - NOAA
Affiliate via
> RT <met_help at ucar.edu> wrote:
>
> >
> > Wed May 17 12:59:37 2017: Request 80501 was acted upon.
> > Transaction: Ticket created by rosalyn.maccracken at noaa.gov
> > Queue: met_help
> > Subject: pulling out certain hours from prepbufr when using
pb2nc
> > Owner: Nobody
> > Requestors: rosalyn.maccracken at noaa.gov
> > Status: new
> > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80501 >
> >
> >
> > Hi,
> >
> > I was wondering if there was a way of only pulling out certain
hours from
> > the prepbufr file when writing to a NetCDF file? For example, I
want to
> > match my observation time range of 2017050100_000000 -
2017050100_005959
> > to
> > a 00hour GFS forecast file, then 2017050100_010000 -
2017050100_015959
> to
> > a
> > 01hour GFS forecast file, etc.
> >
> > My call to pb2nc looks like:
> > pb2nc gfs.t00z.prepbufr uv_wind_pb_20170501_f00.nc PB2NCConfig
> -valid_beg
> > 20170501_000000 -valid_end 20170501_005959 -v 2
> >
> > and, I get an error message:
> > WARNING:
> > WARNING: process_pbfile() -> No PrepBufr messages retained from
file:
> > /com2/gfs/prod/gfs.20170504/gfs.t00z.prepbufr
> > WARNING:
> > ERROR :
> > ERROR : write_netcdf_hdr_data() -> No PrepBufr messages retained.
> Nothing
> > to write.
> > ERROR :
> >
> > But, when I look at the output from my initially processed file,
where I
> > didn't set the begin and end date, I have data time stamped
> > 20170501_000726, which is within that time range. So, I'm not
sure why
> > this doesn't work. Any ideas?
> >
> > Roz
> >
> > --
> > Rosalyn MacCracken
> > Support Scientist
> >
> > Ocean Applilcations Branch
> > NOAA/NWS Ocean Prediction Center
> > NCWCP
> > 5830 University Research Ct
> > College Park, MD 20740-3818
> >
> > (p) 301-683-1551
> > rosalyn.maccracken at noaa.gov
> >
> >
>
>
--
Rosalyn MacCracken
Support Scientist
Ocean Applilcations Branch
NOAA/NWS Ocean Prediction Center
NCWCP
5830 University Research Ct
College Park, MD 20740-3818
(p) 301-683-1551
rosalyn.maccracken at noaa.gov
------------------------------------------------
Subject: pulling out certain hours from prepbufr when using pb2nc
From: John Halley Gotway
Time: Wed May 17 15:05:55 2017
Roz,
Sure, that all sounds good to me.
Thanks,
John
On Wed, May 17, 2017 at 1:56 PM, Rosalyn MacCracken - NOAA Affiliate
via RT
<met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80501 >
>
> Oh, silly me. That's a copy paste and removing my wildcard
characters from
> my script. I was creating images for 20170501 at the same time I
was
> typing the email. So, I did pass in the correct date, 20170504. I
have
> those variables set in my script. The lines in my script looks
like:
>
> YYYY=2017
> MM=05
> DD=04
> HH=00
> for fhr in 00 01 02 03 04 05 06
> do
> pb2nc ${OPERDATA}gfs.${YYYY}${MM}${DD}/gfs.t${HH}z.prepbufr
> ${MASTERDIR_HRLY}uv_wind_pb_${YYYY}${MM}${DD}${HH}_f${fhr}.nc
> ${CONFIGDIR}PB2NCConfig_working -valid_beg
${YYYY}${MM}${DD}_${fhr}0000
> -valid_end ${YYYY}${MM}${DD}_${fhr}5959 -v 2
> done
>
> which works just fine. Then, I double checked the the data was
there by
> running the command again, without specifying the -valid_beg and
_valid_end
> and then running point-stat, and I can see that there is matched
pair data
> with the obs time stamp of 20170504_000114. I'm sure there is other
time
> steps as well. So, this should work...right?
>
> Roz
>
> On Wed, May 17, 2017 at 7:32 PM, John Halley Gotway via RT <
> met_help at ucar.edu> wrote:
>
> > Roz,
> >
> > You have an error in your script in the processing of timesteps.
Look
> very
> > closely at the warning message and compare it to the command line:
> >
> > WARNING: process_pbfile() -> No PrepBufr messages retained from
file:
> > /com2/gfs/prod/gfs.20170504/gfs.t00z.prepbufr
> >
> > pb2nc gfs.t00z.prepbufr uv_wind_pb_20170501_f00.nc PB2NCConfig
> -valid_beg
> > 20170501_000000 -valid_end 20170501_005959 -v 2
> >
> > On the command line, you're trying to process data from 20170501,
but the
> > warning message indicates that the "gfs.t00z.prepbufr" file lives
in a
> > directory with a timestamp of "gfs.20170504"... which is 3 days
later.
> >
> > John
> >
> >
> >
> > On Wed, May 17, 2017 at 12:59 PM, Rosalyn MacCracken - NOAA
Affiliate via
> > RT <met_help at ucar.edu> wrote:
> >
> > >
> > > Wed May 17 12:59:37 2017: Request 80501 was acted upon.
> > > Transaction: Ticket created by rosalyn.maccracken at noaa.gov
> > > Queue: met_help
> > > Subject: pulling out certain hours from prepbufr when using
pb2nc
> > > Owner: Nobody
> > > Requestors: rosalyn.maccracken at noaa.gov
> > > Status: new
> > > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80501
> >
> > >
> > >
> > > Hi,
> > >
> > > I was wondering if there was a way of only pulling out certain
hours
> from
> > > the prepbufr file when writing to a NetCDF file? For example, I
want
> to
> > > match my observation time range of 2017050100_000000 -
2017050100
> _005959
> > > to
> > > a 00hour GFS forecast file, then 2017050100_010000 -
2017050100_015959
> > to
> > > a
> > > 01hour GFS forecast file, etc.
> > >
> > > My call to pb2nc looks like:
> > > pb2nc gfs.t00z.prepbufr uv_wind_pb_20170501_f00.nc PB2NCConfig
> > -valid_beg
> > > 20170501_000000 -valid_end 20170501_005959 -v 2
> > >
> > > and, I get an error message:
> > > WARNING:
> > > WARNING: process_pbfile() -> No PrepBufr messages retained from
file:
> > > /com2/gfs/prod/gfs.20170504/gfs.t00z.prepbufr
> > > WARNING:
> > > ERROR :
> > > ERROR : write_netcdf_hdr_data() -> No PrepBufr messages
retained.
> > Nothing
> > > to write.
> > > ERROR :
> > >
> > > But, when I look at the output from my initially processed file,
where
> I
> > > didn't set the begin and end date, I have data time stamped
> > > 20170501_000726, which is within that time range. So, I'm not
sure why
> > > this doesn't work. Any ideas?
> > >
> > > Roz
> > >
> > > --
> > > Rosalyn MacCracken
> > > Support Scientist
> > >
> > > Ocean Applilcations Branch
> > > NOAA/NWS Ocean Prediction Center
> > > NCWCP
> > > 5830 University Research Ct
> > > College Park, MD 20740-3818
> > >
> > > (p) 301-683-1551
> > > rosalyn.maccracken at noaa.gov
> > >
> > >
> >
> >
>
>
> --
> Rosalyn MacCracken
> Support Scientist
>
> Ocean Applilcations Branch
> NOAA/NWS Ocean Prediction Center
> NCWCP
> 5830 University Research Ct
> College Park, MD 20740-3818
>
> (p) 301-683-1551
> rosalyn.maccracken at noaa.gov
>
>
------------------------------------------------
More information about the Met_help
mailing list