[Met_help] [rt.rap.ucar.edu #99474] History for pcp_combine usage for ECWMF files
John Halley Gotway via RT
met_help at ucar.edu
Fri Apr 9 13:43:53 MDT 2021
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
John,
A question for usage of pcp_combine for ECMWF files.
I have 2 ECMWF grib2 files which only contain 12h accumulation fcst
precip data.
Adding them to get 24h accumulation fcst.
I try to use -add option like this
pcp_combine -add file1 '12' file2 '12' output.nc
This seems not working since the 2 input files are ECMWF grib2 files
that are not standard GRIB2 format. Using wgrib2 for one of files, get
1:0:d=2021040600:var discipline=255 master_table=2 parmcat=1
parm=8:surface:0-12 hour acc fcst:ENS=-25
In this case, how to set the configuration string for pcp_combine -add ?
The testing data can be found in my directory on MARS
/gpfs/dell2/emc/verification/noscrub/Binbin.Zhou/com/verf/dev/ens.20210406/apcp24
The running script is test.sh
Thanks!
Binbin
--
Binbin Zhou
IMSG at NOAA/NWS/NCEP/EMC
5830 University Research Ct.
College Park, MD 20740
Binbin.Zhou at noaa.gov
301-683-3683
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: pcp_combine usage for ECWMF files
From: John Halley Gotway
Time: Fri Apr 09 11:01:04 2021
Binbin,
Sorry for not getting to this yesterday afternoon. Thanks for placing
the
data in a directory I can access on WCOSS. I always use
plot_data_plane to
test out reading data from new files.
You're right, MET does not currently have a GRIB2 table definition for
this
record. When I run plot_data_plane for it, that's exactly what this
error
message is telling us:
*plot_data_plane ecme.ens01.t00z.grid212.12h.f012.grib2 ~/plot.ps
<http://plot.ps> 'GRIB2_disc=255; GRIB2_parm_cat=1; GRIB2_parm=8;
level="A12";' -v 4*
ERROR : VarInfoGrib2::set_dict() -> no parameter found with matching
GRIB2_disc (255) GRIB2_parm_cat (1) GRIB2_parm (8). Use the
MET_GRIB_TABLES
environment variable to define custom GRIB tables.
So I created a custom GRIB table for this record, using the following
debug
4 log message from plot_data_plane to tell me what to add:
DEBUG 4: MetGrib2DataFile::read_grib2_record_list() - unrecognized
GRIB2
field indexes - disc: 255, master table: 2, center: 98, local table:
1,
parm_cat: 1, parm: 8
*echo 'GRIB2' > ~/grib2_ecmwf.txt*
*echo '255 2 0 255 98 1 1 8 "APCP" "Accumulated Precipitation" "mm"'
>>
~/grib2_ecmwf.txt*
*export MET_GRIB_TABLES=/u/John.H.Gotway/grib2_ecmwf.txt*
*plot_data_plane ecme.ens01.t00z.grid212.12h.f012.grib2 ~/plot.ps
<http://plot.ps> 'GRIB2_disc=255; GRIB2_parm_cat=1; GRIB2_parm=8;
level="A12";' -v 4*
You can find an explanation of these entries in the MET User's Guide.
Search for "MET_GRIB_TABLES" on this page:
https://met.readthedocs.io/en/develop/Users_Guide/config_options.html
But I think the real point here is that it'd be nice to add GRIB2
tables
for ECMWF table directly to MET!
Thanks and please let me know if you have more questions.
John
On Thu, Apr 8, 2021 at 3:56 PM Minna Win via RT <met_help at ucar.edu>
wrote:
>
> Thu Apr 08 15:56:53 2021: Request 99474 was acted upon.
> Transaction: Given to johnhg (John Halley Gotway) by minnawin
> Queue: met_help
> Subject: pcp_combine usage for ECWMF files
> Owner: johnhg
> Requestors: Binbin.Zhou at noaa.gov
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99474 >
>
>
> This transaction appears to have no content
>
------------------------------------------------
Subject: pcp_combine usage for ECWMF files
From: Binbin.Zhou at noaa.gov
Time: Fri Apr 09 12:49:16 2021
John,
Thanks for this further help. Following your customer grib2 table,
I can run both plot_data_plane and pcp_combine
For pcp_combine, following command can create accumulated 24h APCP
NetCDF
file apcp24h.nc
export MET_GRIB_TABLES=./data/grib2_ecmwf.txt
pcp_combine -add ./data/ecme.ens01.t00z.grid212.12h.f012.grib2 \
'GRIB2_disc=255; GRIB2_parm_cat=1; GRIB2_parm=8; level="A12";' \
./data/ecme.ens01.t00z.grid212.12h.f024.grib2 \
'GRIB2_disc=255; GRIB2_parm_cat=1; GRIB2_parm=8; level="A12";' \
apcp24h.nc
Defining a customer grib2 table is a robust way for special grib
format
data files.
If MET has grib2 table for ECMWF data files, it will be convenient for
our
future verification
at EMC.
Binbin
On Fri, Apr 9, 2021 at 1:01 PM John Halley Gotway via RT
<met_help at ucar.edu>
wrote:
> Binbin,
>
> Sorry for not getting to this yesterday afternoon. Thanks for
placing the
> data in a directory I can access on WCOSS. I always use
plot_data_plane to
> test out reading data from new files.
>
> You're right, MET does not currently have a GRIB2 table definition
for this
> record. When I run plot_data_plane for it, that's exactly what this
error
> message is telling us:
>
> *plot_data_plane ecme.ens01.t00z.grid212.12h.f012.grib2 ~/plot.ps
> <http://plot.ps> 'GRIB2_disc=255; GRIB2_parm_cat=1; GRIB2_parm=8;
> level="A12";' -v 4*
>
> ERROR : VarInfoGrib2::set_dict() -> no parameter found with
matching
> GRIB2_disc (255) GRIB2_parm_cat (1) GRIB2_parm (8). Use the
MET_GRIB_TABLES
> environment variable to define custom GRIB tables.
>
> So I created a custom GRIB table for this record, using the
following debug
> 4 log message from plot_data_plane to tell me what to add:
>
> DEBUG 4: MetGrib2DataFile::read_grib2_record_list() - unrecognized
GRIB2
> field indexes - disc: 255, master table: 2, center: 98, local table:
1,
> parm_cat: 1, parm: 8
>
> *echo 'GRIB2' > ~/grib2_ecmwf.txt*
> *echo '255 2 0 255 98 1 1 8 "APCP" "Accumulated Precipitation"
"mm"' >>
> ~/grib2_ecmwf.txt*
>
> *export MET_GRIB_TABLES=/u/John.H.Gotway/grib2_ecmwf.txt*
> *plot_data_plane ecme.ens01.t00z.grid212.12h.f012.grib2 ~/plot.ps
> <http://plot.ps> 'GRIB2_disc=255; GRIB2_parm_cat=1; GRIB2_parm=8;
> level="A12";' -v 4*
>
> You can find an explanation of these entries in the MET User's
Guide.
> Search for "MET_GRIB_TABLES" on this page:
>
https://met.readthedocs.io/en/develop/Users_Guide/config_options.html
>
> But I think the real point here is that it'd be nice to add GRIB2
tables
> for ECMWF table directly to MET!
>
> Thanks and please let me know if you have more questions.
>
> John
>
> On Thu, Apr 8, 2021 at 3:56 PM Minna Win via RT <met_help at ucar.edu>
wrote:
>
> >
> > Thu Apr 08 15:56:53 2021: Request 99474 was acted upon.
> > Transaction: Given to johnhg (John Halley Gotway) by minnawin
> > Queue: met_help
> > Subject: pcp_combine usage for ECWMF files
> > Owner: johnhg
> > Requestors: Binbin.Zhou at noaa.gov
> > Status: new
> > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99474 >
> >
> >
> > This transaction appears to have no content
> >
>
>
--
Binbin Zhou
IMSG at NOAA/NWS/NCEP/EMC
5830 University Research Ct.
College Park, MD 20740
Binbin.Zhou at noaa.gov
301-683-3683
------------------------------------------------
Subject: pcp_combine usage for ECWMF files
From: John Halley Gotway
Time: Fri Apr 09 13:11:04 2021
Binbin,
Thanks for confirming. Please note though that this is even simpler.
As
long as you're defining a custom MET_GRIB_TABLES file, you can
actually
just refer to the field by name instead of specifying the GRIB ID's:
export MET_GRIB_TABLES=./data/grib2_ecmwf.txt
pcp_combine -add ./data/ecme.ens01.t00z.grid212.12h.f012.grib2 \
'name="APCP"; level="A12";' \
./data/ecme.ens01.t00z.grid212.12h.f024.grib2 \
'name="APCP"; level="A12";' \
apcp24h.nc
Can you please confirm that this simpler command line also works?
Thanks,
John
On Fri, Apr 9, 2021 at 12:49 PM Binbin.Zhou at noaa.gov via RT <
met_help at ucar.edu> wrote:
> John,
>
> Thanks for this further help. Following your customer grib2
table,
> I can run both plot_data_plane and pcp_combine
> For pcp_combine, following command can create accumulated 24h APCP
NetCDF
> file apcp24h.nc
>
> export MET_GRIB_TABLES=./data/grib2_ecmwf.txt
> pcp_combine -add ./data/ecme.ens01.t00z.grid212.12h.f012.grib2 \
> 'GRIB2_disc=255; GRIB2_parm_cat=1; GRIB2_parm=8; level="A12";' \
> ./data/ecme.ens01.t00z.grid212.12h.f024.grib2 \
> 'GRIB2_disc=255; GRIB2_parm_cat=1; GRIB2_parm=8; level="A12";' \
> apcp24h.nc
>
> Defining a customer grib2 table is a robust way for special grib
format
> data files.
> If MET has grib2 table for ECMWF data files, it will be convenient
for our
> future verification
> at EMC.
>
> Binbin
>
>
>
>
> On Fri, Apr 9, 2021 at 1:01 PM John Halley Gotway via RT <
> met_help at ucar.edu>
> wrote:
>
> > Binbin,
> >
> > Sorry for not getting to this yesterday afternoon. Thanks for
placing the
> > data in a directory I can access on WCOSS. I always use
plot_data_plane
> to
> > test out reading data from new files.
> >
> > You're right, MET does not currently have a GRIB2 table definition
for
> this
> > record. When I run plot_data_plane for it, that's exactly what
this error
> > message is telling us:
> >
> > *plot_data_plane ecme.ens01.t00z.grid212.12h.f012.grib2 ~/plot.ps
> > <http://plot.ps> 'GRIB2_disc=255; GRIB2_parm_cat=1; GRIB2_parm=8;
> > level="A12";' -v 4*
> >
> > ERROR : VarInfoGrib2::set_dict() -> no parameter found with
matching
> > GRIB2_disc (255) GRIB2_parm_cat (1) GRIB2_parm (8). Use the
> MET_GRIB_TABLES
> > environment variable to define custom GRIB tables.
> >
> > So I created a custom GRIB table for this record, using the
following
> debug
> > 4 log message from plot_data_plane to tell me what to add:
> >
> > DEBUG 4: MetGrib2DataFile::read_grib2_record_list() - unrecognized
GRIB2
> > field indexes - disc: 255, master table: 2, center: 98, local
table: 1,
> > parm_cat: 1, parm: 8
> >
> > *echo 'GRIB2' > ~/grib2_ecmwf.txt*
> > *echo '255 2 0 255 98 1 1 8 "APCP" "Accumulated Precipitation"
"mm"' >>
> > ~/grib2_ecmwf.txt*
> >
> > *export MET_GRIB_TABLES=/u/John.H.Gotway/grib2_ecmwf.txt*
> > *plot_data_plane ecme.ens01.t00z.grid212.12h.f012.grib2 ~/plot.ps
> > <http://plot.ps> 'GRIB2_disc=255; GRIB2_parm_cat=1; GRIB2_parm=8;
> > level="A12";' -v 4*
> >
> > You can find an explanation of these entries in the MET User's
Guide.
> > Search for "MET_GRIB_TABLES" on this page:
> >
https://met.readthedocs.io/en/develop/Users_Guide/config_options.html
> >
> > But I think the real point here is that it'd be nice to add GRIB2
tables
> > for ECMWF table directly to MET!
> >
> > Thanks and please let me know if you have more questions.
> >
> > John
> >
> > On Thu, Apr 8, 2021 at 3:56 PM Minna Win via RT
<met_help at ucar.edu>
> wrote:
> >
> > >
> > > Thu Apr 08 15:56:53 2021: Request 99474 was acted upon.
> > > Transaction: Given to johnhg (John Halley Gotway) by minnawin
> > > Queue: met_help
> > > Subject: pcp_combine usage for ECWMF files
> > > Owner: johnhg
> > > Requestors: Binbin.Zhou at noaa.gov
> > > Status: new
> > > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99474
> >
> > >
> > >
> > > This transaction appears to have no content
> > >
> >
> >
>
> --
>
> Binbin Zhou
>
> IMSG at NOAA/NWS/NCEP/EMC
>
> 5830 University Research Ct.
>
> College Park, MD 20740
>
> Binbin.Zhou at noaa.gov
>
> 301-683-3683
>
>
------------------------------------------------
Subject: pcp_combine usage for ECWMF files
From: Binbin.Zhou at noaa.gov
Time: Fri Apr 09 13:19:32 2021
John,
Yes, it works as well.
Binbin
On Fri, Apr 9, 2021 at 3:11 PM John Halley Gotway via RT
<met_help at ucar.edu>
wrote:
> Binbin,
>
> Thanks for confirming. Please note though that this is even simpler.
As
> long as you're defining a custom MET_GRIB_TABLES file, you can
actually
> just refer to the field by name instead of specifying the GRIB ID's:
>
> export MET_GRIB_TABLES=./data/grib2_ecmwf.txt
> pcp_combine -add ./data/ecme.ens01.t00z.grid212.12h.f012.grib2 \
> 'name="APCP"; level="A12";' \
> ./data/ecme.ens01.t00z.grid212.12h.f024.grib2 \
> 'name="APCP"; level="A12";' \
> apcp24h.nc
>
> Can you please confirm that this simpler command line also works?
>
> Thanks,
> John
>
> On Fri, Apr 9, 2021 at 12:49 PM Binbin.Zhou at noaa.gov via RT <
> met_help at ucar.edu> wrote:
>
> > John,
> >
> > Thanks for this further help. Following your customer grib2
table,
> > I can run both plot_data_plane and pcp_combine
> > For pcp_combine, following command can create accumulated 24h APCP
NetCDF
> > file apcp24h.nc
> >
> > export MET_GRIB_TABLES=./data/grib2_ecmwf.txt
> > pcp_combine -add ./data/ecme.ens01.t00z.grid212.12h.f012.grib2 \
> > 'GRIB2_disc=255; GRIB2_parm_cat=1; GRIB2_parm=8; level="A12";' \
> > ./data/ecme.ens01.t00z.grid212.12h.f024.grib2 \
> > 'GRIB2_disc=255; GRIB2_parm_cat=1; GRIB2_parm=8; level="A12";' \
> > apcp24h.nc
> >
> > Defining a customer grib2 table is a robust way for special grib
format
> > data files.
> > If MET has grib2 table for ECMWF data files, it will be convenient
for
> our
> > future verification
> > at EMC.
> >
> > Binbin
> >
> >
> >
> >
> > On Fri, Apr 9, 2021 at 1:01 PM John Halley Gotway via RT <
> > met_help at ucar.edu>
> > wrote:
> >
> > > Binbin,
> > >
> > > Sorry for not getting to this yesterday afternoon. Thanks for
placing
> the
> > > data in a directory I can access on WCOSS. I always use
plot_data_plane
> > to
> > > test out reading data from new files.
> > >
> > > You're right, MET does not currently have a GRIB2 table
definition for
> > this
> > > record. When I run plot_data_plane for it, that's exactly what
this
> error
> > > message is telling us:
> > >
> > > *plot_data_plane ecme.ens01.t00z.grid212.12h.f012.grib2
~/plot.ps
> > > <http://plot.ps> 'GRIB2_disc=255; GRIB2_parm_cat=1;
GRIB2_parm=8;
> > > level="A12";' -v 4*
> > >
> > > ERROR : VarInfoGrib2::set_dict() -> no parameter found with
matching
> > > GRIB2_disc (255) GRIB2_parm_cat (1) GRIB2_parm (8). Use the
> > MET_GRIB_TABLES
> > > environment variable to define custom GRIB tables.
> > >
> > > So I created a custom GRIB table for this record, using the
following
> > debug
> > > 4 log message from plot_data_plane to tell me what to add:
> > >
> > > DEBUG 4: MetGrib2DataFile::read_grib2_record_list() -
unrecognized
> GRIB2
> > > field indexes - disc: 255, master table: 2, center: 98, local
table: 1,
> > > parm_cat: 1, parm: 8
> > >
> > > *echo 'GRIB2' > ~/grib2_ecmwf.txt*
> > > *echo '255 2 0 255 98 1 1 8 "APCP" "Accumulated Precipitation"
"mm"'
> >>
> > > ~/grib2_ecmwf.txt*
> > >
> > > *export MET_GRIB_TABLES=/u/John.H.Gotway/grib2_ecmwf.txt*
> > > *plot_data_plane ecme.ens01.t00z.grid212.12h.f012.grib2
~/plot.ps
> > > <http://plot.ps> 'GRIB2_disc=255; GRIB2_parm_cat=1;
GRIB2_parm=8;
> > > level="A12";' -v 4*
> > >
> > > You can find an explanation of these entries in the MET User's
Guide.
> > > Search for "MET_GRIB_TABLES" on this page:
> > >
https://met.readthedocs.io/en/develop/Users_Guide/config_options.html
> > >
> > > But I think the real point here is that it'd be nice to add
GRIB2
> tables
> > > for ECMWF table directly to MET!
> > >
> > > Thanks and please let me know if you have more questions.
> > >
> > > John
> > >
> > > On Thu, Apr 8, 2021 at 3:56 PM Minna Win via RT
<met_help at ucar.edu>
> > wrote:
> > >
> > > >
> > > > Thu Apr 08 15:56:53 2021: Request 99474 was acted upon.
> > > > Transaction: Given to johnhg (John Halley Gotway) by minnawin
> > > > Queue: met_help
> > > > Subject: pcp_combine usage for ECWMF files
> > > > Owner: johnhg
> > > > Requestors: Binbin.Zhou at noaa.gov
> > > > Status: new
> > > > Ticket <URL:
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99474
> > >
> > > >
> > > >
> > > > This transaction appears to have no content
> > > >
> > >
> > >
> >
> > --
> >
> > Binbin Zhou
> >
> > IMSG at NOAA/NWS/NCEP/EMC
> >
> > 5830 University Research Ct.
> >
> > College Park, MD 20740
> >
> > Binbin.Zhou at noaa.gov
> >
> > 301-683-3683
> >
> >
>
>
--
Binbin Zhou
IMSG at NOAA/NWS/NCEP/EMC
5830 University Research Ct.
College Park, MD 20740
Binbin.Zhou at noaa.gov
301-683-3683
------------------------------------------------
More information about the Met_help
mailing list