[Met_help] [rt.rap.ucar.edu #85911] History for pb2nc and a 10-year old mailing list question
John Halley Gotway via RT
met_help at ucar.edu
Wed Jun 27 14:26:12 MDT 2018
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
met-help,
We were just trying to dump one of NCEP's PREPBUFR files using MET's pb2nc and got the error
DEBUG 2: Processing 75868 PrepBufr messages...
ERROR :
ERROR : process_pbfile() -> the observation time should remain the same for all PrepBufr messages: 1529575200 != 1529571600
You responded to a user raising this same issue back in 2008 (!) on met-help and said it'd be easy to change pb2nc to handle this issue:
http://mailman.ucar.edu/pipermail/met_help/2008-August/000367.html
That I got the message using a relatively recent release of MET (v6) would seem to indicate that this change never did get made to pb2nc to allow for these files to be read.
I'm really surprised that no one ever hits this since the simplest possible use would be to just dump all records in one of NCEP's files. I hit this when trying to open recent versions of their surface (ADPSFC) or upper air (ADPUPA) files (e.g., yesterday's).
Any thoughts on a workaround? We haven't dug into the source for pb2nc to see what change is required to pass them all through yet. Thought I should go to the man with the plan first.
thanks a lot,
-mike
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: pb2nc and a 10-year old mailing list question
From: John Halley Gotway
Time: Wed Jun 27 11:37:59 2018
Mike,
Couple of questions. I'd like to be able to reproduce this error
message you're getting to make sure we resolve it correctly.
Can you please...
(1) tell me the version of MET you're running
(2) send me your PB2NC config file
(3) point me to the PREPBUFR file that produces this error
Thanks,
John
------------------------------------------------
Subject: pb2nc and a 10-year old mailing list question
From: mike.kay at spire.com
Time: Wed Jun 27 11:54:24 2018
Hi John -
Here are the answers to your questions:
1) 6.0-bugfix
2) see 3)
3) Files ftped to the anonymous site in a subdir named mkay. I placed
two
files in there - one for surface data and one for upper air data. The
config file is currently set to only parse ADPSFC files so that'd need
to
be changed when running on the ADPUPA file.
thanks for taking a look,
-mike
*Mike Kay*
Global Validation Model
*Spire Global, Inc.*
1050 Walnut Street, Suite 402, Boulder, CO 80302 USA
+1-303-562-9585 <3035629585>
On Wed, Jun 27, 2018 at 11:38 AM, John Halley Gotway via RT <
met_help at ucar.edu> wrote:
> Mike,
>
> Couple of questions. I'd like to be able to reproduce this error
message
> you're getting to make sure we resolve it correctly.
>
> Can you please...
> (1) tell me the version of MET you're running
> (2) send me your PB2NC config file
> (3) point me to the PREPBUFR file that produces this error
>
> Thanks,
> John
>
------------------------------------------------
Subject: pb2nc and a 10-year old mailing list question
From: John Halley Gotway
Time: Wed Jun 27 12:56:44 2018
Mike,
Thanks for sending the sample data. OK, these files are BUFR files,
not
PREPBUFR... which is one further step down the data processing step at
NCEP. We have recently (met-6.1 and met-7.0) added support for
reading
these NCEP BUFR files directly, but that's not available in met-6.0.
Let's use the data in the location as an example:
http://www.ftp.ncep.noaa.gov/data/nccf/com/gfs/prod/gfs.2018062700/
I think you have 2 options...
(1) Continue using met-6.0 and process only this PREPBUFR file:
gfs.t00z.perpbufr.nc
I tested and that runs through met-6.0 without error.
(2) Upgrade to met-7.0 and be able to process those bufr files:
gfs.t00z.adpsfc.tm00.bufr_d.nr
gfs.t00z.adpupa.tm00.bufr_d
In 7.0, you can use the -index command line option to list out all the
observation types that are available in the data file. Running that
on the
ADPSFC BUFR file you posted resulted in the attached list of
observation
variables. There's precip in there (TP01, TP03, TP12, and TP24) but
the
surprising variable names for temperature. And the message type names
are
not actually ADPSFC at all.
In met-6.0, you only have access to a handful of observation types,
like
TMP, SPFC, HGT, UGRD, and VGRD, as well as a few derived types. In
met-7.0, you have access to many more observation types.
John
DEBUG 1: Observation variables:
DEBUG 1: RRSTG: RAW REPORT
STRING types: NC000001
NC000002
NC000007
DEBUG 1: SEQNUM: CHANNEL SEQUENCE
NUMBER types: NC000001 NC000002
NC000007
DEBUG 1: BBB: BULLETIN BEING MONITORED
(BBB) types: NC000001 NC000007
DEBUG 1: BORG: BULLETIN BEING MONITORED
(CCCC) types: NC000001 NC000002 NC000007
DEBUG 1: BULTIM: BULLETIN BEING MONITORED
(YYGGgg) types: NC000001 NC000002 NC000007
DEBUG 1: BUHD: BULLETIN BEING MONITORED
(TTAAii) types: NC000001 NC000002 NC000007
DEBUG 1: CORN: CORRECTED REPORT
INDICATOR types: NC000001 NC000002
NC000007
DEBUG 1: HBLCS: HEIGHT ABOVE SURFACE OF BASE OF LOWEST CLOUD
SEEN types: NC000001 NC000002
DEBUG 1: INPC: INDIC INCLUSION/OMISSION OF
PREC types: NC000001 NC000002
DEBUG 1: TMDP: DEW POINT
TEMPERATURE types: NC000001
NC000002
NC000007
DEBUG 1: TMDB: TEMPERATURE/DRY BULB
TEMPERATURE types: NC000001 NC000002 NC000007
DEBUG 1: WSPD: WIND
SPEED types: NC000001
NC000002 NC000007
DEBUG 1: WDIR: WIND
DIRECTION types: NC000001
NC000002 NC000007
DEBUG 1: CHPT: CHARACTERISTIC OF PRESSURE
TENDENCY types: NC000001 NC000007
DEBUG 1: 3HPC: 3 HOUR PRESSURE
CHANGE types: NC000001 NC000007
DEBUG 1: PMSL: PRESSURE REDUCED TO
MSL types: NC000001 NC000002
NC000007
DEBUG 1: PRES:
PRESSURE types:
NC000001
NC000002
DEBUG 1: RCTS: RECEIPT TIME
SIGNIFICANCE types: NC000001 NC000002
NC000007
DEBUG 1: SELV: HEIGHT OF
STATION types: NC000001
NC000002
NC000007
DEBUG 1: RCMI: MINUTE - TIME OF
RECEIPT types: NC000001 NC000002
NC000007
DEBUG 1: RCHR: HOUR - TIME OF
RECEIPT types: NC000001 NC000002
NC000007
DEBUG 1: RCDY: DAY - TIME OF
RECEIPT types: NC000001 NC000002
NC000007
DEBUG 1: RCMO: MONTH - TIME OF
RECEIPT types: NC000001 NC000002
NC000007
DEBUG 1: RCYR: YEAR - TIME OF
RECEIPT types: NC000001 NC000002
NC000007
DEBUG 1: ITSO: IND TYPE OF STN OPERATION
PAST/P types: NC000001 NC000002
DEBUG 1: TIWM: TYPE OF INSTRUMENTATION FOR WIND
MEASUREMENT types: NC000001 NC000002
DEBUG 1: TOST: TYPE OF
STATION types: NC000001
NC000002
DEBUG 1: WMOS: WMO STATION
NUMBER types: NC000001
DEBUG 1: WMOB: WMO BLOCK
NUMBER types: NC000001
DEBUG 1: QMPR: SDMEDIT QUALITY MARK FOR
PRESSURE types: NC000001 NC000007
DEBUG 1: QMWN: SDMEDIT QUALITY MARK FOR
WIND types: NC000001 NC000007
DEBUG 1: QMDD: SDMEDIT QUALITY MARK FOR
MOISTURE types: NC000001 NC000007
DEBUG 1: QMAT: SDMEDIT QUALITY MARK FOR
TEMPERATURE types: NC000001 NC000007
DEBUG 1: CLTP: CLOUD
TYPE types: NC000001
NC000007
DEBUG 1: CLAM: CLOUD
AMOUNT types: NC000001
NC000007
DEBUG 1: TOCC: CLOUD COVER
(TOTAL) types: NC000001
DEBUG 1: HOVI: HORIZONTAL
VISIBILITY types: NC000001
NC000007
DEBUG 1: 24PC: 24 HOUR PRESSURE
CHANGE types: NC000001 NC000002
DEBUG 1: VSSO: VERT. SIGNIFICANCE (SFC
OBSERVATION) types: NC000001 NC000007
DEBUG 1: PSW2: PAST WEATHER
(2) types: NC000001
DEBUG 1: PSW1: PAST WEATHER
(1) types: NC000001
DEBUG 1: PRWE: PRESENT
WEATHER types: NC000001
NC000007
DEBUG 1: SOGR: STATE OF THE
GROUND types: NC000001
DEBUG 1: TP03: TOTAL PRECIPITATION PAST 3
HOURS types: NC000001 NC000002 NC000007
DEBUG 1: MXGS: MAXIMUM WIND GUST
SPEED types: NC000001 NC000002
NC000007
DEBUG 1: MITM: MINIMUM
TEMPERATURE types: NC000001
NC000007
DEBUG 1: MXTM: MAXIMUM
TEMPERATURE types: NC000001
NC000002
NC000007
DEBUG 1: HOCB: HEIGHT OF BASE OF
CLOUD types: NC000001 NC000007
DEBUG 1: TOSD: TOTAL SNOW
DEPTH types: NC000001
DEBUG 1: TP01: TOTAL PRECIPITATION PAST 1
HOUR types: NC000001 NC000002 NC000007
DEBUG 1: GP10:
GEOPOTENTIAL types:
NC000001
NC000002
DEBUG 1: PRLC:
PRESSURE types:
NC000001
NC000002
DEBUG 1: VTVI: VERTICAL
VISIBILITY types: NC000001
NC000007
DEBUG 1: DOFS: DEPTH OF FRESH
SNOW types: NC000001
DEBUG 1: CTDS: CLOUD TOP
DESCRIPTION types: NC000001
DEBUG 1: HOCT: HEIGHT OF TOP OF
CLOUD types: NC000001
DEBUG 1: REHU: RELATIVE
HUMIDITY types: NC000001
NC000002
DEBUG 1: SST1: SEA
TEMPERATURE types: NC000001
NC000007
DEBUG 1: HOWV: HEIGHT OF
WAVES types: NC000001
DEBUG 1: POWV: PERIOD OF
WAVES types: NC000001
DEBUG 1: MSST: METHOD OF SEA SURFACE TEMPERATURE
MEASUREMENT types: NC000001
DEBUG 1: TOPC: TOTAL PRECIPITATION/TOTAL WATER
EQUIVALENT types: NC000001 NC000002
DEBUG 1: TP06: TOTAL PRECIPITATION PAST 6
HOURS types: NC000001 NC000002 NC000007
DEBUG 1: HOWW: HEIGHT OF WIND
WAVES types: NC000001
DEBUG 1: POWW: PERIOD OF WIND
WAVES types: NC000001
DEBUG 1: TP12: TOTAL PRECIPITATION PAST 12
HOURS types: NC000001 NC000002
DEBUG 1: TP24: TOTAL PRECIPITATION PAST 24
HOURS types: NC000001 NC000002 NC000007
DEBUG 1: HOSW: HEIGHT OF SWELL
WAVES types: NC000001
DEBUG 1: POSW: PERIOD OF SWELL
WAVES types: NC000001
DEBUG 1: DOSW: DIRECTION OF SWELL
WAVES types: NC000001
DEBUG 1: TMWB: WET BULB
TEMPERATURE types: NC000001
DEBUG 1: MWBT: METHOD OF WET BULB TEMPERATURE
MEASUREMENT types: NC000001
DEBUG 1: QCEVR: STATION ELEVATION QUALITY MARK (FOR MOBIL
STATIONS) types: NC000002
DEBUG 1: ALSE: ALTIMETER
SETTING types: NC000007
DEBUG 1: THRPT: TYPE OF HOURLY
REPORT types: NC000007
DEBUG 1: ICLX: SHORT ICAO LOCATION
INDICATOR types: NC000007
DEBUG 1: DRC2: EXTREME CW WIND DIRECTION OF VARIABLE
WIND types: NC000007
DEBUG 1: DRC1: EXTREME CCW WIND DIRECTION OF VARIABLE
WIND types: NC000007
DEBUG 1: AUTO: AUTOMATED STATION
TYPE types: NC000007
DEBUG 1: V1RIM: FIRST RUNWAY VISUAL
RANGE types: NC000007
DEBUG 1: RWYT: RUNWAY VISUAL RANGE
TENDENCY types: NC000007
DEBUG 1: RWID: RUNWAY
IDENTIFIER types: NC000007
DEBUG 1: WSHFTM: TIME OF OCCURENCE OF WIND SHIFT
(MINUTES) types: NC000007
DEBUG 1: WSHFTH: TIME OF OCCURENCE OF WIND SHIFT
(HOURS) types: NC000007
DEBUG 1: V2RIM: SECOND RUNWAY VISUAL
RANGE types: NC000007
DEBUG 1: PKWDSP: PEAK WIND
SPEED types: NC000007
DEBUG 1: PKWDDR: PEAK WIND
DIRECTION types: NC000007
DEBUG 1: SEST: STATE OF THE
SEA types: NC000007
On Wed, Jun 27, 2018 at 11:54 AM mike.kay at spire.com via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=85911 >
>
> Hi John -
>
> Here are the answers to your questions:
> 1) 6.0-bugfix
> 2) see 3)
> 3) Files ftped to the anonymous site in a subdir named mkay. I
placed two
> files in there - one for surface data and one for upper air data.
The
> config file is currently set to only parse ADPSFC files so that'd
need to
> be changed when running on the ADPUPA file.
>
> thanks for taking a look,
> -mike
>
>
>
> *Mike Kay*
>
> Global Validation Model
>
> *Spire Global, Inc.*
>
> 1050 Walnut Street, Suite 402, Boulder, CO 80302 USA
>
> +1-303-562-9585 <3035629585>
>
> On Wed, Jun 27, 2018 at 11:38 AM, John Halley Gotway via RT <
> met_help at ucar.edu> wrote:
>
> > Mike,
> >
> > Couple of questions. I'd like to be able to reproduce this error
message
> > you're getting to make sure we resolve it correctly.
> >
> > Can you please...
> > (1) tell me the version of MET you're running
> > (2) send me your PB2NC config file
> > (3) point me to the PREPBUFR file that produces this error
> >
> > Thanks,
> > John
> >
>
>
------------------------------------------------
Subject: pb2nc and a 10-year old mailing list question
From: mike.kay at spire.com
Time: Wed Jun 27 14:14:11 2018
John -
Thanks for pointing out the issue here (file type) and that going with
a
new version of MET should give us the functionality we were looking
for.
We'll give it a go with v7.
thanks again,
-mike
*Mike Kay*
Global Validation Model
*Spire Global, Inc.*
1050 Walnut Street, Suite 402, Boulder, CO 80302 USA
+1-303-562-9585 <3035629585>
On Wed, Jun 27, 2018 at 12:56 PM, John Halley Gotway via RT <
met_help at ucar.edu> wrote:
> Mike,
>
> Thanks for sending the sample data. OK, these files are BUFR files,
not
> PREPBUFR... which is one further step down the data processing step
at
> NCEP. We have recently (met-6.1 and met-7.0) added support for
reading
> these NCEP BUFR files directly, but that's not available in met-6.0.
>
> Let's use the data in the location as an example:
>
http://www.ftp.ncep.noaa.gov/data/nccf/com/gfs/prod/gfs.2018062700/
>
> I think you have 2 options...
>
> (1) Continue using met-6.0 and process only this PREPBUFR file:
> gfs.t00z.perpbufr.nc
> I tested and that runs through met-6.0 without error.
>
> (2) Upgrade to met-7.0 and be able to process those bufr files:
> gfs.t00z.adpsfc.tm00.bufr_d.nr
> gfs.t00z.adpupa.tm00.bufr_d
>
> In 7.0, you can use the -index command line option to list out all
the
> observation types that are available in the data file. Running that
on the
> ADPSFC BUFR file you posted resulted in the attached list of
observation
> variables. There's precip in there (TP01, TP03, TP12, and TP24) but
the
> surprising variable names for temperature. And the message type
names are
> not actually ADPSFC at all.
>
> In met-6.0, you only have access to a handful of observation types,
like
> TMP, SPFC, HGT, UGRD, and VGRD, as well as a few derived types. In
> met-7.0, you have access to many more observation types.
>
> John
>
> DEBUG 1: Observation variables:
> DEBUG 1: RRSTG: RAW REPORT
> STRING types: NC000001
NC000002
> NC000007
> DEBUG 1: SEQNUM: CHANNEL SEQUENCE
> NUMBER types: NC000001 NC000002
NC000007
> DEBUG 1: BBB: BULLETIN BEING MONITORED
> (BBB) types: NC000001 NC000007
> DEBUG 1: BORG: BULLETIN BEING MONITORED
> (CCCC) types: NC000001 NC000002 NC000007
> DEBUG 1: BULTIM: BULLETIN BEING MONITORED
> (YYGGgg) types: NC000001 NC000002 NC000007
> DEBUG 1: BUHD: BULLETIN BEING MONITORED
> (TTAAii) types: NC000001 NC000002 NC000007
> DEBUG 1: CORN: CORRECTED REPORT
> INDICATOR types: NC000001 NC000002
NC000007
> DEBUG 1: HBLCS: HEIGHT ABOVE SURFACE OF BASE OF LOWEST CLOUD
> SEEN types: NC000001 NC000002
> DEBUG 1: INPC: INDIC INCLUSION/OMISSION OF
> PREC types: NC000001 NC000002
> DEBUG 1: TMDP: DEW POINT
> TEMPERATURE types: NC000001
NC000002
> NC000007
> DEBUG 1: TMDB: TEMPERATURE/DRY BULB
> TEMPERATURE types: NC000001 NC000002
NC000007
> DEBUG 1: WSPD: WIND
> SPEED types: NC000001
> NC000002 NC000007
> DEBUG 1: WDIR: WIND
> DIRECTION types: NC000001
> NC000002 NC000007
> DEBUG 1: CHPT: CHARACTERISTIC OF PRESSURE
> TENDENCY types: NC000001 NC000007
> DEBUG 1: 3HPC: 3 HOUR PRESSURE
> CHANGE types: NC000001 NC000007
> DEBUG 1: PMSL: PRESSURE REDUCED TO
> MSL types: NC000001 NC000002
NC000007
> DEBUG 1: PRES:
> PRESSURE types:
NC000001
> NC000002
> DEBUG 1: RCTS: RECEIPT TIME
> SIGNIFICANCE types: NC000001
NC000002
> NC000007
> DEBUG 1: SELV: HEIGHT OF
> STATION types: NC000001
NC000002
> NC000007
> DEBUG 1: RCMI: MINUTE - TIME OF
> RECEIPT types: NC000001 NC000002
NC000007
> DEBUG 1: RCHR: HOUR - TIME OF
> RECEIPT types: NC000001 NC000002
NC000007
> DEBUG 1: RCDY: DAY - TIME OF
> RECEIPT types: NC000001 NC000002
NC000007
> DEBUG 1: RCMO: MONTH - TIME OF
> RECEIPT types: NC000001 NC000002
NC000007
> DEBUG 1: RCYR: YEAR - TIME OF
> RECEIPT types: NC000001 NC000002
NC000007
> DEBUG 1: ITSO: IND TYPE OF STN OPERATION
> PAST/P types: NC000001 NC000002
> DEBUG 1: TIWM: TYPE OF INSTRUMENTATION FOR WIND
> MEASUREMENT types: NC000001 NC000002
> DEBUG 1: TOST: TYPE OF
> STATION types: NC000001
NC000002
> DEBUG 1: WMOS: WMO STATION
> NUMBER types: NC000001
> DEBUG 1: WMOB: WMO BLOCK
> NUMBER types: NC000001
> DEBUG 1: QMPR: SDMEDIT QUALITY MARK FOR
> PRESSURE types: NC000001 NC000007
> DEBUG 1: QMWN: SDMEDIT QUALITY MARK FOR
> WIND types: NC000001 NC000007
> DEBUG 1: QMDD: SDMEDIT QUALITY MARK FOR
> MOISTURE types: NC000001 NC000007
> DEBUG 1: QMAT: SDMEDIT QUALITY MARK FOR
> TEMPERATURE types: NC000001 NC000007
> DEBUG 1: CLTP: CLOUD
> TYPE types: NC000001
> NC000007
> DEBUG 1: CLAM: CLOUD
> AMOUNT types: NC000001
> NC000007
> DEBUG 1: TOCC: CLOUD COVER
> (TOTAL) types: NC000001
> DEBUG 1: HOVI: HORIZONTAL
> VISIBILITY types: NC000001
NC000007
> DEBUG 1: 24PC: 24 HOUR PRESSURE
> CHANGE types: NC000001 NC000002
> DEBUG 1: VSSO: VERT. SIGNIFICANCE (SFC
> OBSERVATION) types: NC000001 NC000007
> DEBUG 1: PSW2: PAST WEATHER
> (2) types: NC000001
> DEBUG 1: PSW1: PAST WEATHER
> (1) types: NC000001
> DEBUG 1: PRWE: PRESENT
> WEATHER types: NC000001
NC000007
> DEBUG 1: SOGR: STATE OF THE
> GROUND types: NC000001
> DEBUG 1: TP03: TOTAL PRECIPITATION PAST 3
> HOURS types: NC000001 NC000002 NC000007
> DEBUG 1: MXGS: MAXIMUM WIND GUST
> SPEED types: NC000001 NC000002
NC000007
> DEBUG 1: MITM: MINIMUM
> TEMPERATURE types: NC000001
NC000007
> DEBUG 1: MXTM: MAXIMUM
> TEMPERATURE types: NC000001
NC000002
> NC000007
> DEBUG 1: HOCB: HEIGHT OF BASE OF
> CLOUD types: NC000001 NC000007
> DEBUG 1: TOSD: TOTAL SNOW
> DEPTH types: NC000001
> DEBUG 1: TP01: TOTAL PRECIPITATION PAST 1
> HOUR types: NC000001 NC000002 NC000007
> DEBUG 1: GP10:
> GEOPOTENTIAL types:
NC000001
> NC000002
> DEBUG 1: PRLC:
> PRESSURE types:
NC000001
> NC000002
> DEBUG 1: VTVI: VERTICAL
> VISIBILITY types: NC000001
NC000007
> DEBUG 1: DOFS: DEPTH OF FRESH
> SNOW types: NC000001
> DEBUG 1: CTDS: CLOUD TOP
> DESCRIPTION types: NC000001
> DEBUG 1: HOCT: HEIGHT OF TOP OF
> CLOUD types: NC000001
> DEBUG 1: REHU: RELATIVE
> HUMIDITY types: NC000001
NC000002
> DEBUG 1: SST1: SEA
> TEMPERATURE types:
NC000001
> NC000007
> DEBUG 1: HOWV: HEIGHT OF
> WAVES types: NC000001
> DEBUG 1: POWV: PERIOD OF
> WAVES types: NC000001
> DEBUG 1: MSST: METHOD OF SEA SURFACE TEMPERATURE
> MEASUREMENT types: NC000001
> DEBUG 1: TOPC: TOTAL PRECIPITATION/TOTAL WATER
> EQUIVALENT types: NC000001 NC000002
> DEBUG 1: TP06: TOTAL PRECIPITATION PAST 6
> HOURS types: NC000001 NC000002 NC000007
> DEBUG 1: HOWW: HEIGHT OF WIND
> WAVES types: NC000001
> DEBUG 1: POWW: PERIOD OF WIND
> WAVES types: NC000001
> DEBUG 1: TP12: TOTAL PRECIPITATION PAST 12
> HOURS types: NC000001 NC000002
> DEBUG 1: TP24: TOTAL PRECIPITATION PAST 24
> HOURS types: NC000001 NC000002 NC000007
> DEBUG 1: HOSW: HEIGHT OF SWELL
> WAVES types: NC000001
> DEBUG 1: POSW: PERIOD OF SWELL
> WAVES types: NC000001
> DEBUG 1: DOSW: DIRECTION OF SWELL
> WAVES types: NC000001
> DEBUG 1: TMWB: WET BULB
> TEMPERATURE types: NC000001
> DEBUG 1: MWBT: METHOD OF WET BULB TEMPERATURE
> MEASUREMENT types: NC000001
> DEBUG 1: QCEVR: STATION ELEVATION QUALITY MARK (FOR MOBIL
> STATIONS) types: NC000002
> DEBUG 1: ALSE: ALTIMETER
> SETTING types: NC000007
> DEBUG 1: THRPT: TYPE OF HOURLY
> REPORT types: NC000007
> DEBUG 1: ICLX: SHORT ICAO LOCATION
> INDICATOR types: NC000007
> DEBUG 1: DRC2: EXTREME CW WIND DIRECTION OF VARIABLE
> WIND types: NC000007
> DEBUG 1: DRC1: EXTREME CCW WIND DIRECTION OF VARIABLE
> WIND types: NC000007
> DEBUG 1: AUTO: AUTOMATED STATION
> TYPE types: NC000007
> DEBUG 1: V1RIM: FIRST RUNWAY VISUAL
> RANGE types: NC000007
> DEBUG 1: RWYT: RUNWAY VISUAL RANGE
> TENDENCY types: NC000007
> DEBUG 1: RWID: RUNWAY
> IDENTIFIER types: NC000007
> DEBUG 1: WSHFTM: TIME OF OCCURENCE OF WIND SHIFT
> (MINUTES) types: NC000007
> DEBUG 1: WSHFTH: TIME OF OCCURENCE OF WIND SHIFT
> (HOURS) types: NC000007
> DEBUG 1: V2RIM: SECOND RUNWAY VISUAL
> RANGE types: NC000007
> DEBUG 1: PKWDSP: PEAK WIND
> SPEED types: NC000007
> DEBUG 1: PKWDDR: PEAK WIND
> DIRECTION types: NC000007
> DEBUG 1: SEST: STATE OF THE
> SEA types: NC000007
>
>
>
> On Wed, Jun 27, 2018 at 11:54 AM mike.kay at spire.com via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=85911 >
> >
> > Hi John -
> >
> > Here are the answers to your questions:
> > 1) 6.0-bugfix
> > 2) see 3)
> > 3) Files ftped to the anonymous site in a subdir named mkay. I
placed two
> > files in there - one for surface data and one for upper air data.
The
> > config file is currently set to only parse ADPSFC files so that'd
need to
> > be changed when running on the ADPUPA file.
> >
> > thanks for taking a look,
> > -mike
> >
> >
> >
> > *Mike Kay*
> >
> > Global Validation Model
> >
> > *Spire Global, Inc.*
> >
> > 1050 Walnut Street, Suite 402, Boulder, CO 80302 USA
> >
> > +1-303-562-9585 <3035629585>
> >
> > On Wed, Jun 27, 2018 at 11:38 AM, John Halley Gotway via RT <
> > met_help at ucar.edu> wrote:
> >
> > > Mike,
> > >
> > > Couple of questions. I'd like to be able to reproduce this
error
> message
> > > you're getting to make sure we resolve it correctly.
> > >
> > > Can you please...
> > > (1) tell me the version of MET you're running
> > > (2) send me your PB2NC config file
> > > (3) point me to the PREPBUFR file that produces this error
> > >
> > > Thanks,
> > > John
> > >
> >
> >
>
>
------------------------------------------------
Subject: pb2nc and a 10-year old mailing list question
From: John Halley Gotway
Time: Wed Jun 27 14:26:10 2018
Sure thing. Just let us know what other issues or questions come up.
Thanks,
John
On Wed, Jun 27, 2018 at 2:14 PM mike.kay at spire.com via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=85911 >
>
> John -
>
> Thanks for pointing out the issue here (file type) and that going
with a
> new version of MET should give us the functionality we were looking
for.
> We'll give it a go with v7.
>
> thanks again,
> -mike
>
>
>
> *Mike Kay*
>
> Global Validation Model
>
> *Spire Global, Inc.*
>
> 1050 Walnut Street, Suite 402, Boulder, CO 80302 USA
>
> +1-303-562-9585 <3035629585>
>
> On Wed, Jun 27, 2018 at 12:56 PM, John Halley Gotway via RT <
> met_help at ucar.edu> wrote:
>
> > Mike,
> >
> > Thanks for sending the sample data. OK, these files are BUFR
files, not
> > PREPBUFR... which is one further step down the data processing
step at
> > NCEP. We have recently (met-6.1 and met-7.0) added support for
reading
> > these NCEP BUFR files directly, but that's not available in met-
6.0.
> >
> > Let's use the data in the location as an example:
> >
http://www.ftp.ncep.noaa.gov/data/nccf/com/gfs/prod/gfs.2018062700/
> >
> > I think you have 2 options...
> >
> > (1) Continue using met-6.0 and process only this PREPBUFR file:
> > gfs.t00z.perpbufr.nc
> > I tested and that runs through met-6.0 without error.
> >
> > (2) Upgrade to met-7.0 and be able to process those bufr files:
> > gfs.t00z.adpsfc.tm00.bufr_d.nr
> > gfs.t00z.adpupa.tm00.bufr_d
> >
> > In 7.0, you can use the -index command line option to list out all
the
> > observation types that are available in the data file. Running
that on
> the
> > ADPSFC BUFR file you posted resulted in the attached list of
observation
> > variables. There's precip in there (TP01, TP03, TP12, and TP24)
but the
> > surprising variable names for temperature. And the message type
names
> are
> > not actually ADPSFC at all.
> >
> > In met-6.0, you only have access to a handful of observation
types, like
> > TMP, SPFC, HGT, UGRD, and VGRD, as well as a few derived types.
In
> > met-7.0, you have access to many more observation types.
> >
> > John
> >
> > DEBUG 1: Observation variables:
> > DEBUG 1: RRSTG: RAW REPORT
> > STRING types: NC000001
NC000002
> > NC000007
> > DEBUG 1: SEQNUM: CHANNEL SEQUENCE
> > NUMBER types: NC000001 NC000002
> NC000007
> > DEBUG 1: BBB: BULLETIN BEING MONITORED
> > (BBB) types: NC000001 NC000007
> > DEBUG 1: BORG: BULLETIN BEING MONITORED
> > (CCCC) types: NC000001 NC000002 NC000007
> > DEBUG 1: BULTIM: BULLETIN BEING MONITORED
> > (YYGGgg) types: NC000001 NC000002 NC000007
> > DEBUG 1: BUHD: BULLETIN BEING MONITORED
> > (TTAAii) types: NC000001 NC000002 NC000007
> > DEBUG 1: CORN: CORRECTED REPORT
> > INDICATOR types: NC000001 NC000002
> NC000007
> > DEBUG 1: HBLCS: HEIGHT ABOVE SURFACE OF BASE OF LOWEST CLOUD
> > SEEN types: NC000001 NC000002
> > DEBUG 1: INPC: INDIC INCLUSION/OMISSION OF
> > PREC types: NC000001 NC000002
> > DEBUG 1: TMDP: DEW POINT
> > TEMPERATURE types: NC000001
NC000002
> > NC000007
> > DEBUG 1: TMDB: TEMPERATURE/DRY BULB
> > TEMPERATURE types: NC000001 NC000002
NC000007
> > DEBUG 1: WSPD: WIND
> > SPEED types:
NC000001
> > NC000002 NC000007
> > DEBUG 1: WDIR: WIND
> > DIRECTION types:
NC000001
> > NC000002 NC000007
> > DEBUG 1: CHPT: CHARACTERISTIC OF PRESSURE
> > TENDENCY types: NC000001 NC000007
> > DEBUG 1: 3HPC: 3 HOUR PRESSURE
> > CHANGE types: NC000001 NC000007
> > DEBUG 1: PMSL: PRESSURE REDUCED TO
> > MSL types: NC000001 NC000002
NC000007
> > DEBUG 1: PRES:
> > PRESSURE types:
NC000001
> > NC000002
> > DEBUG 1: RCTS: RECEIPT TIME
> > SIGNIFICANCE types: NC000001
NC000002
> > NC000007
> > DEBUG 1: SELV: HEIGHT OF
> > STATION types: NC000001
NC000002
> > NC000007
> > DEBUG 1: RCMI: MINUTE - TIME OF
> > RECEIPT types: NC000001 NC000002
> NC000007
> > DEBUG 1: RCHR: HOUR - TIME OF
> > RECEIPT types: NC000001 NC000002
> NC000007
> > DEBUG 1: RCDY: DAY - TIME OF
> > RECEIPT types: NC000001 NC000002
> NC000007
> > DEBUG 1: RCMO: MONTH - TIME OF
> > RECEIPT types: NC000001 NC000002
> NC000007
> > DEBUG 1: RCYR: YEAR - TIME OF
> > RECEIPT types: NC000001 NC000002
> NC000007
> > DEBUG 1: ITSO: IND TYPE OF STN OPERATION
> > PAST/P types: NC000001 NC000002
> > DEBUG 1: TIWM: TYPE OF INSTRUMENTATION FOR WIND
> > MEASUREMENT types: NC000001 NC000002
> > DEBUG 1: TOST: TYPE OF
> > STATION types: NC000001
> NC000002
> > DEBUG 1: WMOS: WMO STATION
> > NUMBER types: NC000001
> > DEBUG 1: WMOB: WMO BLOCK
> > NUMBER types: NC000001
> > DEBUG 1: QMPR: SDMEDIT QUALITY MARK FOR
> > PRESSURE types: NC000001 NC000007
> > DEBUG 1: QMWN: SDMEDIT QUALITY MARK FOR
> > WIND types: NC000001 NC000007
> > DEBUG 1: QMDD: SDMEDIT QUALITY MARK FOR
> > MOISTURE types: NC000001 NC000007
> > DEBUG 1: QMAT: SDMEDIT QUALITY MARK FOR
> > TEMPERATURE types: NC000001 NC000007
> > DEBUG 1: CLTP: CLOUD
> > TYPE types:
NC000001
> > NC000007
> > DEBUG 1: CLAM: CLOUD
> > AMOUNT types:
NC000001
> > NC000007
> > DEBUG 1: TOCC: CLOUD COVER
> > (TOTAL) types: NC000001
> > DEBUG 1: HOVI: HORIZONTAL
> > VISIBILITY types: NC000001
NC000007
> > DEBUG 1: 24PC: 24 HOUR PRESSURE
> > CHANGE types: NC000001 NC000002
> > DEBUG 1: VSSO: VERT. SIGNIFICANCE (SFC
> > OBSERVATION) types: NC000001 NC000007
> > DEBUG 1: PSW2: PAST WEATHER
> > (2) types: NC000001
> > DEBUG 1: PSW1: PAST WEATHER
> > (1) types: NC000001
> > DEBUG 1: PRWE: PRESENT
> > WEATHER types: NC000001
> NC000007
> > DEBUG 1: SOGR: STATE OF THE
> > GROUND types: NC000001
> > DEBUG 1: TP03: TOTAL PRECIPITATION PAST 3
> > HOURS types: NC000001 NC000002 NC000007
> > DEBUG 1: MXGS: MAXIMUM WIND GUST
> > SPEED types: NC000001 NC000002
NC000007
> > DEBUG 1: MITM: MINIMUM
> > TEMPERATURE types: NC000001
> NC000007
> > DEBUG 1: MXTM: MAXIMUM
> > TEMPERATURE types: NC000001
> NC000002
> > NC000007
> > DEBUG 1: HOCB: HEIGHT OF BASE OF
> > CLOUD types: NC000001 NC000007
> > DEBUG 1: TOSD: TOTAL SNOW
> > DEPTH types: NC000001
> > DEBUG 1: TP01: TOTAL PRECIPITATION PAST 1
> > HOUR types: NC000001 NC000002 NC000007
> > DEBUG 1: GP10:
> > GEOPOTENTIAL types:
NC000001
> > NC000002
> > DEBUG 1: PRLC:
> > PRESSURE types:
NC000001
> > NC000002
> > DEBUG 1: VTVI: VERTICAL
> > VISIBILITY types: NC000001
NC000007
> > DEBUG 1: DOFS: DEPTH OF FRESH
> > SNOW types: NC000001
> > DEBUG 1: CTDS: CLOUD TOP
> > DESCRIPTION types: NC000001
> > DEBUG 1: HOCT: HEIGHT OF TOP OF
> > CLOUD types: NC000001
> > DEBUG 1: REHU: RELATIVE
> > HUMIDITY types: NC000001
NC000002
> > DEBUG 1: SST1: SEA
> > TEMPERATURE types:
NC000001
> > NC000007
> > DEBUG 1: HOWV: HEIGHT OF
> > WAVES types: NC000001
> > DEBUG 1: POWV: PERIOD OF
> > WAVES types: NC000001
> > DEBUG 1: MSST: METHOD OF SEA SURFACE TEMPERATURE
> > MEASUREMENT types: NC000001
> > DEBUG 1: TOPC: TOTAL PRECIPITATION/TOTAL WATER
> > EQUIVALENT types: NC000001 NC000002
> > DEBUG 1: TP06: TOTAL PRECIPITATION PAST 6
> > HOURS types: NC000001 NC000002 NC000007
> > DEBUG 1: HOWW: HEIGHT OF WIND
> > WAVES types: NC000001
> > DEBUG 1: POWW: PERIOD OF WIND
> > WAVES types: NC000001
> > DEBUG 1: TP12: TOTAL PRECIPITATION PAST 12
> > HOURS types: NC000001 NC000002
> > DEBUG 1: TP24: TOTAL PRECIPITATION PAST 24
> > HOURS types: NC000001 NC000002 NC000007
> > DEBUG 1: HOSW: HEIGHT OF SWELL
> > WAVES types: NC000001
> > DEBUG 1: POSW: PERIOD OF SWELL
> > WAVES types: NC000001
> > DEBUG 1: DOSW: DIRECTION OF SWELL
> > WAVES types: NC000001
> > DEBUG 1: TMWB: WET BULB
> > TEMPERATURE types: NC000001
> > DEBUG 1: MWBT: METHOD OF WET BULB TEMPERATURE
> > MEASUREMENT types: NC000001
> > DEBUG 1: QCEVR: STATION ELEVATION QUALITY MARK (FOR MOBIL
> > STATIONS) types: NC000002
> > DEBUG 1: ALSE: ALTIMETER
> > SETTING types: NC000007
> > DEBUG 1: THRPT: TYPE OF HOURLY
> > REPORT types: NC000007
> > DEBUG 1: ICLX: SHORT ICAO LOCATION
> > INDICATOR types: NC000007
> > DEBUG 1: DRC2: EXTREME CW WIND DIRECTION OF VARIABLE
> > WIND types: NC000007
> > DEBUG 1: DRC1: EXTREME CCW WIND DIRECTION OF VARIABLE
> > WIND types: NC000007
> > DEBUG 1: AUTO: AUTOMATED STATION
> > TYPE types: NC000007
> > DEBUG 1: V1RIM: FIRST RUNWAY VISUAL
> > RANGE types: NC000007
> > DEBUG 1: RWYT: RUNWAY VISUAL RANGE
> > TENDENCY types: NC000007
> > DEBUG 1: RWID: RUNWAY
> > IDENTIFIER types: NC000007
> > DEBUG 1: WSHFTM: TIME OF OCCURENCE OF WIND SHIFT
> > (MINUTES) types: NC000007
> > DEBUG 1: WSHFTH: TIME OF OCCURENCE OF WIND SHIFT
> > (HOURS) types: NC000007
> > DEBUG 1: V2RIM: SECOND RUNWAY VISUAL
> > RANGE types: NC000007
> > DEBUG 1: PKWDSP: PEAK WIND
> > SPEED types: NC000007
> > DEBUG 1: PKWDDR: PEAK WIND
> > DIRECTION types: NC000007
> > DEBUG 1: SEST: STATE OF THE
> > SEA types: NC000007
> >
> >
> >
> > On Wed, Jun 27, 2018 at 11:54 AM mike.kay at spire.com via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=85911 >
> > >
> > > Hi John -
> > >
> > > Here are the answers to your questions:
> > > 1) 6.0-bugfix
> > > 2) see 3)
> > > 3) Files ftped to the anonymous site in a subdir named mkay. I
placed
> two
> > > files in there - one for surface data and one for upper air
data. The
> > > config file is currently set to only parse ADPSFC files so
that'd need
> to
> > > be changed when running on the ADPUPA file.
> > >
> > > thanks for taking a look,
> > > -mike
> > >
> > >
> > >
> > > *Mike Kay*
> > >
> > > Global Validation Model
> > >
> > > *Spire Global, Inc.*
> > >
> > > 1050 Walnut Street, Suite 402, Boulder, CO 80302 USA
> > >
> > > +1-303-562-9585 <3035629585>
> > >
> > > On Wed, Jun 27, 2018 at 11:38 AM, John Halley Gotway via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > > Mike,
> > > >
> > > > Couple of questions. I'd like to be able to reproduce this
error
> > message
> > > > you're getting to make sure we resolve it correctly.
> > > >
> > > > Can you please...
> > > > (1) tell me the version of MET you're running
> > > > (2) send me your PB2NC config file
> > > > (3) point me to the PREPBUFR file that produces this error
> > > >
> > > > Thanks,
> > > > John
> > > >
> > >
> > >
> >
> >
>
>
------------------------------------------------
More information about the Met_help
mailing list