[Met_help] [rt.rap.ucar.edu #79724] History for pcp_combine
John Halley Gotway via RT
met_help at ucar.edu
Fri Mar 10 14:11:18 MST 2017
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Dear MET Help staff.
My goal is to use pcp_combine in order to accumulate some 1-hr
accumulated rainfall from our regional model but for simplicity I'm just
converting a Grib file to NetCDF, so I used:
bin/pcp_combine -add file_in.grb 01 file_out.nc
DEBUG 1: Reading input file: file_in.grb
WARNING:
WARNING: MetGrib1DataFile::data_plane() -> No exact match found for
VarInfo "APCP/A01" in GRIB file "file_in.grb".
WARNING:
ERROR :
ERROR : get_field() -> can't get data plane from file "file_in.grb"
ERROR :
It is Ok, since APCP does not exist, as shown by wgrib:
wgrib file_in.grb
...
12:33745404:d=16120113:*var61*:kpds5=61:kpds6=1:kpds7=0:TR=0:P1=0:P2=0:TimeU=1:sfc:anl:NAve=0
...
The actual variable name I'm interested in is "var61". But, when I
specify it on the pcp_combine command....
bin/pcp_combine -add file_in.grb 01 file_out.nc*-field var61*
DEBUG 1: Reading input file: file_in.grb
ERROR :
ERROR : yyerror() -> syntax error in file "config_29125_0_.temp"
ERROR :
ERROR : line = 2
ERROR :
ERROR : column = 1
ERROR :
ERROR : text = "(nul)"
ERROR :
ERROR :
ERROR : (nul)
ERROR : (nul)
Could someone please help me?
Thanks a lot.
JR Garcia
--
==================================================
Jose Roberto Motta Garcia, PhD
Divisão de Modelagem e Desenvolvimento (DMD)
www.cptec.inpe.br
www.inpe.br
Tel.: +55 (12) 3208-7966
--------------------------------------------------
***** Save natural resources *****
==================================================
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: pcp_combine
From: John Halley Gotway
Time: Mon Mar 06 11:04:48 2017
JR Garcia,
I see you're having trouble running APCP GRIB data through
pcp_combine.
Thanks for sending the output of wgrib.
Looking carefully at that output I see this info "TR=0" and "anl".
That
indicates that this an instantaneous 0-hour "analysis" forecast. So
the
APCP variable in your data is not stored as an accumulation interval
(i.e.
TR=4) but instead is stored as an instantaneous forecast (i.e. TR=0).
Here's a table about those settings:
http://www.nco.ncep.noaa.gov/pmb/docs/on388/table5.html
And that's why pcp_combine isn't working. It's looking for a 1-hour
accumulation of precip, but that's not present in your data.
The GRIB code is stored as 61 (kpds5=61) which is usually for APCP,
but
wgrib doesn't correctly interpret that. So I'm guessing your data
file is
using a non-standard parameter table version (PTV) number. This is a
wild
guess, but perhaps you're just writing the parameter table version
number
as 0.
Try running this:
wgrib -PDS10 file_in.grb
The PTV is listed as the 4th entry in the PDS10 array and here's more
info
about that:
http://www.nco.ncep.noaa.gov/pmb/docs/on388/section1.html
If you have PTV = 0 and can change that from your regional model... it
should probably be 2 instead. Then wgrib and MET will be happy.
If you can't change it, then there are some work-arounds:
(1) You could edit the GRIB tables used by MET to add new entries for
your
PTV. That would enable MET to correctly interpret the string "APCP".
(2) You could make a more explicit call to pcp_combine (but substitute
in
the actual PTV value from your GRIB file):
bin/pcp_combine -add file_in.grb 'GRIB1_ptv=0; GRIB1_code=61;
level="L0";' file_out.nc
Hope that helps. Just let me know what other questions you have.
Thanks,
John Halley Gotway
On Mon, Mar 6, 2017 at 7:19 AM, Roberto Garcia (INPE) via RT <
met_help at ucar.edu> wrote:
>
> Mon Mar 06 07:19:32 2017: Request 79724 was acted upon.
> Transaction: Ticket created by roberto.garcia at inpe.br
> Queue: met_help
> Subject: pcp_combine
> Owner: Nobody
> Requestors: roberto.garcia at inpe.br
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=79724 >
>
>
> Dear MET Help staff.
>
> My goal is to use pcp_combine in order to accumulate some 1-hr
> accumulated rainfall from our regional model but for simplicity I'm
just
> converting a Grib file to NetCDF, so I used:
>
> bin/pcp_combine -add file_in.grb 01 file_out.nc
>
> DEBUG 1: Reading input file: file_in.grb
> WARNING:
> WARNING: MetGrib1DataFile::data_plane() -> No exact match found for
> VarInfo "APCP/A01" in GRIB file "file_in.grb".
> WARNING:
> ERROR :
> ERROR : get_field() -> can't get data plane from file "file_in.grb"
> ERROR :
>
>
> It is Ok, since APCP does not exist, as shown by wgrib:
>
> wgrib file_in.grb
>
> ...
>
> 12:33745404:d=16120113:*var61*:kpds5=61:kpds6=1:kpds7=0:TR=
> 0:P1=0:P2=0:TimeU=1:sfc:anl:NAve=0
> ...
>
>
> The actual variable name I'm interested in is "var61". But, when I
> specify it on the pcp_combine command....
>
> bin/pcp_combine -add file_in.grb 01 file_out.nc*-field var61*
> DEBUG 1: Reading input file: file_in.grb
> ERROR :
> ERROR : yyerror() -> syntax error in file "config_29125_0_.temp"
> ERROR :
> ERROR : line = 2
> ERROR :
> ERROR : column = 1
> ERROR :
> ERROR : text = "(nul)"
> ERROR :
> ERROR :
> ERROR : (nul)
> ERROR : (nul)
>
> Could someone please help me?
>
> Thanks a lot.
>
>
> JR Garcia
>
> --
> ==================================================
> Jose Roberto Motta Garcia, PhD
>
> Divisão de Modelagem e Desenvolvimento (DMD)
> www.cptec.inpe.br
> www.inpe.br
> Tel.: +55 (12) 3208-7966
> --------------------------------------------------
> ***** Save natural resources *****
> ==================================================
>
>
>
------------------------------------------------
Subject: pcp_combine
From: Roberto Garcia (INPE)
Time: Mon Mar 06 12:48:49 2017
Dear John,
Thanks a lot for your help.
I'm not the owner/builder of the data I'm only in charge of evaluating
the model, so I think change the PTV would is not an option now.
The output of wgrib -PDS10 file_in.grb is:
...
*12:33745404:d=16120113:var61:kpds5=61:kpds6=1:kpds7=0:TR=0:P1=0:P2=0:TimeU=1:sfc:anl:NAve=0:PDS10=
0 0 28 128 100 13 255 128 61 1 0 0 16 12 1 13 0 1 0 0 0 0 0 0 21 2 0
0*
...
I didn't know about this wgrib option, I've noticed that our data file
is using a non-standard PTV number when I used
ncl_filedump file_in.grb
which reported
*warning:NclGRIB: Unrecognized parameter table (center 100, subcenter
2,
table 128), defaulting to NCEP operational table: variable names and
units may be incorrect*
and
*float A_PCP_GDS0_SFC ( g0_lat_1, g0_lon_2 )****sub_center :
2****center : Brazzaville****long_name : Total precipitation****units
: kg/m^2****_FillValue : 1e+20****level_indicator : 1****gds_grid_type
: 0****parameter_table_version : 128****parameter_number :
61****forecast_time : 0****forecast_time_units : hours****initial_time
: 12/01/2016 (13:00)***
for the grib code 61.
I used the work-around #2:
bin/pcp_combine -add file_in.grb 'GRIB1_ptv=128; GRIB1_code=61;
level="L0";' file_out.nc
and it worked! Now I'll move to the phase of adding those files.
And if I were to use the work-around #1, considering the PTV below:
-1:100:2:128
1:VWSH:Vertical speed shear [1/s]
...
12:APCP:Total precipitation [kg/m^2]
...
In what aspects should I change it? Which entries should I add? Does
it seem ok to you? And how should I use it in pcp_combine?
I've built this file from an example but I'm not sure if it is ok. I
took the wgrib output as base to build it but some entries repeat
along few lines, such as:
81:245421120:d=16120113:var52:kpds5=52:...
*82:248488884:d=16120113:NLWRT:kpds5=39:...****83:251556648:d=16120113:NLWRT:kpds5=39:...****84:254624412:d=16120113:NLWRT:kpds5=39:...****85:257692176:d=16120113:NLWRT:kpds5=39:...****86:260759940:d=16120113:NLWRT:kpds5=39:...****87:263827704:d=16120113:NLWRT:kpds5=39:...****88:266895468:d=16120113:NLWRT:kpds5=39:...****89:269963232:d=16120113:NLWRT:kpds5=39:...***90:273030996:d=16120113:var51:kpds5=51:...
I guessed that, as the PTV has only the number, variable name, and
comment, this should be summarized to:
81:var52:bla...bla...bla
82:NLWRT:bla...bla...bla
90:var51:bla...bla...bla
I'm wrong?
Thanks a lot
JR Garcia
--
==================================================
Jose Roberto Motta Garcia, PhD
Divisão de Modelagem e Desenvolvimento (DMD)
www.cptec.inpe.br
www.inpe.br
Tel.: +55 (12) 3208-7966
--------------------------------------------------
***** Save natural resources *****
==================================================
On 06/03/2017 15:04, John Halley Gotway via RT wrote:
> JR Garcia,
>
> I see you're having trouble running APCP GRIB data through
pcp_combine.
> Thanks for sending the output of wgrib.
>
> Looking carefully at that output I see this info "TR=0" and "anl".
That
> indicates that this an instantaneous 0-hour "analysis" forecast. So
the
> APCP variable in your data is not stored as an accumulation interval
(i.e.
> TR=4) but instead is stored as an instantaneous forecast (i.e.
TR=0).
> Here's a table about those settings:
> http://www.nco.ncep.noaa.gov/pmb/docs/on388/table5.html
>
> And that's why pcp_combine isn't working. It's looking for a 1-hour
> accumulation of precip, but that's not present in your data.
>
> The GRIB code is stored as 61 (kpds5=61) which is usually for APCP,
but
> wgrib doesn't correctly interpret that. So I'm guessing your data
file is
> using a non-standard parameter table version (PTV) number. This is
a wild
> guess, but perhaps you're just writing the parameter table version
number
> as 0.
>
> Try running this:
> wgrib -PDS10 file_in.grb
>
> The PTV is listed as the 4th entry in the PDS10 array and here's
more info
> about that:
> http://www.nco.ncep.noaa.gov/pmb/docs/on388/section1.html
>
> If you have PTV = 0 and can change that from your regional model...
it
> should probably be 2 instead. Then wgrib and MET will be happy.
>
> If you can't change it, then there are some work-arounds:
>
> (1) You could edit the GRIB tables used by MET to add new entries
for your
> PTV. That would enable MET to correctly interpret the string
"APCP".
>
> (2) You could make a more explicit call to pcp_combine (but
substitute in
> the actual PTV value from your GRIB file):
>
> bin/pcp_combine -add file_in.grb 'GRIB1_ptv=0; GRIB1_code=61;
> level="L0";' file_out.nc
>
> Hope that helps. Just let me know what other questions you have.
>
> Thanks,
> John Halley Gotway
>
>
> On Mon, Mar 6, 2017 at 7:19 AM, Roberto Garcia (INPE) via RT <
> met_help at ucar.edu> wrote:
>
>> Mon Mar 06 07:19:32 2017: Request 79724 was acted upon.
>> Transaction: Ticket created by roberto.garcia at inpe.br
>> Queue: met_help
>> Subject: pcp_combine
>> Owner: Nobody
>> Requestors: roberto.garcia at inpe.br
>> Status: new
>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=79724 >
>>
>>
>> Dear MET Help staff.
>>
>> My goal is to use pcp_combine in order to accumulate some 1-hr
>> accumulated rainfall from our regional model but for simplicity I'm
just
>> converting a Grib file to NetCDF, so I used:
>>
>> bin/pcp_combine -add file_in.grb 01 file_out.nc
>>
>> DEBUG 1: Reading input file: file_in.grb
>> WARNING:
>> WARNING: MetGrib1DataFile::data_plane() -> No exact match found for
>> VarInfo "APCP/A01" in GRIB file "file_in.grb".
>> WARNING:
>> ERROR :
>> ERROR : get_field() -> can't get data plane from file
"file_in.grb"
>> ERROR :
>>
>>
>> It is Ok, since APCP does not exist, as shown by wgrib:
>>
>> wgrib file_in.grb
>>
>> ...
>>
>> 12:33745404:d=16120113:*var61*:kpds5=61:kpds6=1:kpds7=0:TR=
>> 0:P1=0:P2=0:TimeU=1:sfc:anl:NAve=0
>> ...
>>
>>
>> The actual variable name I'm interested in is "var61". But, when I
>> specify it on the pcp_combine command....
>>
>> bin/pcp_combine -add file_in.grb 01 file_out.nc*-field var61*
>> DEBUG 1: Reading input file: file_in.grb
>> ERROR :
>> ERROR : yyerror() -> syntax error in file "config_29125_0_.temp"
>> ERROR :
>> ERROR : line = 2
>> ERROR :
>> ERROR : column = 1
>> ERROR :
>> ERROR : text = "(nul)"
>> ERROR :
>> ERROR :
>> ERROR : (nul)
>> ERROR : (nul)
>>
>> Could someone please help me?
>>
>> Thanks a lot.
>>
>>
>> JR Garcia
>>
>> --
>> ==================================================
>> Jose Roberto Motta Garcia, PhD
>>
>> Divisão de Modelagem e Desenvolvimento (DMD)
>> www.cptec.inpe.br
>> www.inpe.br
>> Tel.: +55 (12) 3208-7966
>> --------------------------------------------------
>> ***** Save natural resources *****
>> ==================================================
>>
>>
>>
------------------------------------------------
Subject: pcp_combine
From: John Halley Gotway
Time: Mon Mar 06 13:21:52 2017
JR Garcia,
MET version 5.2 reads GRIB table information from static ascii files
which
are defined in the met-5.2/data/table_files directory.
Following the existing naming convention in that directory, you'd
create a
new file named:
met-5.2/data/table_files/grib1_inpe_128_100.txt
The number '7' is the center number for NCEP and your data is using
center
number 100. You could just copy over the NCEP usage and switch all
the 7's
to 100's:
cat met-5.2/data/table_files/grib1_ncep_128_7.txt | sed 's/128 7
/128
100 /g' > met-5.2/data/table_files/grib1_inpe_128_100.txt
Next, you should either re-run "make install" for met-5.2 or manually
copy
that file over into the *INSTALLED* met-5.2/share/met/table_files
directory. That's where the code actually reads these files at
runtime.
Once you've tried this, try rerunning pcp_combine like this:
pcp_combine -add file_in.grb 'name="APCP"; level="L0";'
file_out.nc
If pcp_combine correctly matches APCP to your data, then your change
worked.
Also, be sure to save this GRIB1 table file somewhere else as well.
It
won't be included in newer versions of MET and you'll need to add it
in
before compiling a newer version.
Please let me know how it goes.
Thanks,
John
On Mon, Mar 6, 2017 at 12:48 PM, Roberto Garcia (INPE) via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=79724 >
>
> Dear John,
>
> Thanks a lot for your help.
>
> I'm not the owner/builder of the data I'm only in charge of
evaluating the
> model, so I think change the PTV would is not an option now.
>
> The output of wgrib -PDS10 file_in.grb is:
>
> ...
> *12:33745404:d=16120113:var61:kpds5=61:kpds6=1:kpds7=0:TR=0:
> P1=0:P2=0:TimeU=1:sfc:anl:NAve=0:PDS10=
> 0 0 28 128 100 13 255 128 61 1 0 0 16 12 1 13 0 1 0 0 0 0 0 0 21 2 0
0*
> ...
>
> I didn't know about this wgrib option, I've noticed that our data
file is
> using a non-standard PTV number when I used
>
> ncl_filedump file_in.grb
>
> which reported
>
> *warning:NclGRIB: Unrecognized parameter table (center 100,
subcenter 2,
> table 128), defaulting to NCEP operational table: variable names and
> units may be incorrect*
>
> and
>
> *float A_PCP_GDS0_SFC ( g0_lat_1, g0_lon_2 )****sub_center :
2****center :
> Brazzaville****long_name : Total precipitation****units :
> kg/m^2****_FillValue : 1e+20****level_indicator : 1****gds_grid_type
:
> 0****parameter_table_version : 128****parameter_number :
> 61****forecast_time : 0****forecast_time_units :
hours****initial_time :
> 12/01/2016 (13:00)***
> for the grib code 61.
>
>
> I used the work-around #2:
>
> bin/pcp_combine -add file_in.grb 'GRIB1_ptv=128; GRIB1_code=61;
> level="L0";' file_out.nc
>
> and it worked! Now I'll move to the phase of adding those files.
>
>
> And if I were to use the work-around #1, considering the PTV below:
> -1:100:2:128
> 1:VWSH:Vertical speed shear [1/s]
> ...
> 12:APCP:Total precipitation [kg/m^2]
> ...
>
> In what aspects should I change it? Which entries should I add? Does
it
> seem ok to you? And how should I use it in pcp_combine?
> I've built this file from an example but I'm not sure if it is ok. I
took
> the wgrib output as base to build it but some entries repeat along
few
> lines, such as:
>
> 81:245421120:d=16120113:var52:kpds5=52:...
> *82:248488884:d=16120113:NLWRT:kpds5=39:...****83:
> 251556648:d=16120113:NLWRT:kpds5=39:...****84:254624412:
> d=16120113:NLWRT:kpds5=39:...****85:257692176:d=16120113:
> NLWRT:kpds5=39:...****86:260759940:d=16120113:NLWRT:
> kpds5=39:...****87:263827704:d=16120113:NLWRT:kpds5=39:...*
> ***88:266895468:d=16120113:NLWRT:kpds5=39:...****89:
> 269963232:d=16120113:NLWRT:kpds5=39:...***90:273030996:d=
> 16120113:var51:kpds5=51:...
>
> I guessed that, as the PTV has only the number, variable name, and
> comment, this should be summarized to:
>
> 81:var52:bla...bla...bla
> 82:NLWRT:bla...bla...bla
> 90:var51:bla...bla...bla
>
> I'm wrong?
>
>
> Thanks a lot
>
> JR Garcia
>
> --
> ==================================================
> Jose Roberto Motta Garcia, PhD
>
> Divisão de Modelagem e Desenvolvimento (DMD)
> www.cptec.inpe.br
> www.inpe.br
> Tel.: +55 (12) 3208-7966
> --------------------------------------------------
> ***** Save natural resources *****
> ==================================================
>
> On 06/03/2017 15:04, John Halley Gotway via RT wrote:
> > JR Garcia,
> >
> > I see you're having trouble running APCP GRIB data through
pcp_combine.
> > Thanks for sending the output of wgrib.
> >
> > Looking carefully at that output I see this info "TR=0" and "anl".
That
> > indicates that this an instantaneous 0-hour "analysis" forecast.
So the
> > APCP variable in your data is not stored as an accumulation
interval
> (i.e.
> > TR=4) but instead is stored as an instantaneous forecast (i.e.
TR=0).
> > Here's a table about those settings:
> > http://www.nco.ncep.noaa.gov/pmb/docs/on388/table5.html
> >
> > And that's why pcp_combine isn't working. It's looking for a 1-
hour
> > accumulation of precip, but that's not present in your data.
> >
> > The GRIB code is stored as 61 (kpds5=61) which is usually for
APCP, but
> > wgrib doesn't correctly interpret that. So I'm guessing your data
file
> is
> > using a non-standard parameter table version (PTV) number. This
is a
> wild
> > guess, but perhaps you're just writing the parameter table version
number
> > as 0.
> >
> > Try running this:
> > wgrib -PDS10 file_in.grb
> >
> > The PTV is listed as the 4th entry in the PDS10 array and here's
more
> info
> > about that:
> > http://www.nco.ncep.noaa.gov/pmb/docs/on388/section1.html
> >
> > If you have PTV = 0 and can change that from your regional
model... it
> > should probably be 2 instead. Then wgrib and MET will be happy.
> >
> > If you can't change it, then there are some work-arounds:
> >
> > (1) You could edit the GRIB tables used by MET to add new entries
for
> your
> > PTV. That would enable MET to correctly interpret the string
"APCP".
> >
> > (2) You could make a more explicit call to pcp_combine (but
substitute in
> > the actual PTV value from your GRIB file):
> >
> > bin/pcp_combine -add file_in.grb 'GRIB1_ptv=0; GRIB1_code=61;
> > level="L0";' file_out.nc
> >
> > Hope that helps. Just let me know what other questions you have.
> >
> > Thanks,
> > John Halley Gotway
> >
> >
> > On Mon, Mar 6, 2017 at 7:19 AM, Roberto Garcia (INPE) via RT <
> > met_help at ucar.edu> wrote:
> >
> >> Mon Mar 06 07:19:32 2017: Request 79724 was acted upon.
> >> Transaction: Ticket created by roberto.garcia at inpe.br
> >> Queue: met_help
> >> Subject: pcp_combine
> >> Owner: Nobody
> >> Requestors: roberto.garcia at inpe.br
> >> Status: new
> >> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=79724
> >
> >>
> >>
> >> Dear MET Help staff.
> >>
> >> My goal is to use pcp_combine in order to accumulate some 1-hr
> >> accumulated rainfall from our regional model but for simplicity
I'm just
> >> converting a Grib file to NetCDF, so I used:
> >>
> >> bin/pcp_combine -add file_in.grb 01 file_out.nc
> >>
> >> DEBUG 1: Reading input file: file_in.grb
> >> WARNING:
> >> WARNING: MetGrib1DataFile::data_plane() -> No exact match found
for
> >> VarInfo "APCP/A01" in GRIB file "file_in.grb".
> >> WARNING:
> >> ERROR :
> >> ERROR : get_field() -> can't get data plane from file
"file_in.grb"
> >> ERROR :
> >>
> >>
> >> It is Ok, since APCP does not exist, as shown by wgrib:
> >>
> >> wgrib file_in.grb
> >>
> >> ...
> >>
> >> 12:33745404:d=16120113:*var61*:kpds5=61:kpds6=1:kpds7=0:TR=
> >> 0:P1=0:P2=0:TimeU=1:sfc:anl:NAve=0
> >> ...
> >>
> >>
> >> The actual variable name I'm interested in is "var61". But, when
I
> >> specify it on the pcp_combine command....
> >>
> >> bin/pcp_combine -add file_in.grb 01 file_out.nc*-field var61*
> >> DEBUG 1: Reading input file: file_in.grb
> >> ERROR :
> >> ERROR : yyerror() -> syntax error in file "config_29125_0_.temp"
> >> ERROR :
> >> ERROR : line = 2
> >> ERROR :
> >> ERROR : column = 1
> >> ERROR :
> >> ERROR : text = "(nul)"
> >> ERROR :
> >> ERROR :
> >> ERROR : (nul)
> >> ERROR : (nul)
> >>
> >> Could someone please help me?
> >>
> >> Thanks a lot.
> >>
> >>
> >> JR Garcia
> >>
> >> --
> >> ==================================================
> >> Jose Roberto Motta Garcia, PhD
> >>
> >> Divisão de Modelagem e Desenvolvimento (DMD)
> >> www.cptec.inpe.br
> >> www.inpe.br
> >> Tel.: +55 (12) 3208-7966
> >> --------------------------------------------------
> >> ***** Save natural resources *****
> >> ==================================================
> >>
> >>
> >>
>
>
>
------------------------------------------------
Subject: pcp_combine
From: Roberto Garcia (INPE)
Time: Tue Mar 07 06:05:18 2017
Hi John, and if there isn't a table_files directory?
> ll met-5.2/data/
drwxr-xr-x 2 roberto.garcia pesq_dop 4,0K Ago 15 2016 config
drwxr-xr-x 3 roberto.garcia pesq_dop 4,0K Ago 15 2016 poly
drwxr-xr-x 7 roberto.garcia pesq_dop 0 Ago 15 2016 sample_fcst
drwxr-xr-x 7 roberto.garcia pesq_dop 0 Ago 15 2016 sample_obs
drwxr-xr-x 2 roberto.garcia pesq_dop 4,0K Ago 15 2016 tc_data
drwxr-xr-x 5 roberto.garcia pesq_dop 0 Set 7 20:55 tutorial
Thanks
JR Garcia
--
==================================================
Jose Roberto Motta Garcia, PhD
Divisão de Modelagem e Desenvolvimento (DMD)
www.cptec.inpe.br
www.inpe.br
Tel.: +55 (12) 3208-7966
--------------------------------------------------
***** Save natural resources *****
==================================================
On 06/03/2017 17:21, John Halley Gotway via RT wrote:
> JR Garcia,
>
> MET version 5.2 reads GRIB table information from static ascii files
which
> are defined in the met-5.2/data/table_files directory.
>
> Following the existing naming convention in that directory, you'd
create a
> new file named:
>
> met-5.2/data/table_files/grib1_inpe_128_100.txt
>
> The number '7' is the center number for NCEP and your data is using
center
> number 100. You could just copy over the NCEP usage and switch all
the 7's
> to 100's:
>
> cat met-5.2/data/table_files/grib1_ncep_128_7.txt | sed 's/128 7
/128
> 100 /g' > met-5.2/data/table_files/grib1_inpe_128_100.txt
>
> Next, you should either re-run "make install" for met-5.2 or
manually copy
> that file over into the *INSTALLED* met-5.2/share/met/table_files
> directory. That's where the code actually reads these files at
runtime.
>
> Once you've tried this, try rerunning pcp_combine like this:
>
> pcp_combine -add file_in.grb 'name="APCP"; level="L0";'
file_out.nc
>
> If pcp_combine correctly matches APCP to your data, then your change
worked.
>
> Also, be sure to save this GRIB1 table file somewhere else as well.
It
> won't be included in newer versions of MET and you'll need to add it
in
> before compiling a newer version.
>
> Please let me know how it goes.
>
> Thanks,
> John
>
>
> On Mon, Mar 6, 2017 at 12:48 PM, Roberto Garcia (INPE) via RT <
> met_help at ucar.edu> wrote:
>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=79724 >
>>
>> Dear John,
>>
>> Thanks a lot for your help.
>>
>> I'm not the owner/builder of the data I'm only in charge of
evaluating the
>> model, so I think change the PTV would is not an option now.
>>
>> The output of wgrib -PDS10 file_in.grb is:
>>
>> ...
>> *12:33745404:d=16120113:var61:kpds5=61:kpds6=1:kpds7=0:TR=0:
>> P1=0:P2=0:TimeU=1:sfc:anl:NAve=0:PDS10=
>> 0 0 28 128 100 13 255 128 61 1 0 0 16 12 1 13 0 1 0 0 0 0 0 0 21 2
0 0*
>> ...
>>
>> I didn't know about this wgrib option, I've noticed that our data
file is
>> using a non-standard PTV number when I used
>>
>> ncl_filedump file_in.grb
>>
>> which reported
>>
>> *warning:NclGRIB: Unrecognized parameter table (center 100,
subcenter 2,
>> table 128), defaulting to NCEP operational table: variable names
and
>> units may be incorrect*
>>
>> and
>>
>> *float A_PCP_GDS0_SFC ( g0_lat_1, g0_lon_2 )****sub_center :
2****center :
>> Brazzaville****long_name : Total precipitation****units :
>> kg/m^2****_FillValue : 1e+20****level_indicator :
1****gds_grid_type :
>> 0****parameter_table_version : 128****parameter_number :
>> 61****forecast_time : 0****forecast_time_units :
hours****initial_time :
>> 12/01/2016 (13:00)***
>> for the grib code 61.
>>
>>
>> I used the work-around #2:
>>
>> bin/pcp_combine -add file_in.grb 'GRIB1_ptv=128; GRIB1_code=61;
>> level="L0";' file_out.nc
>>
>> and it worked! Now I'll move to the phase of adding those files.
>>
>>
>> And if I were to use the work-around #1, considering the PTV below:
>> -1:100:2:128
>> 1:VWSH:Vertical speed shear [1/s]
>> ...
>> 12:APCP:Total precipitation [kg/m^2]
>> ...
>>
>> In what aspects should I change it? Which entries should I add?
Does it
>> seem ok to you? And how should I use it in pcp_combine?
>> I've built this file from an example but I'm not sure if it is ok.
I took
>> the wgrib output as base to build it but some entries repeat along
few
>> lines, such as:
>>
>> 81:245421120:d=16120113:var52:kpds5=52:...
>> *82:248488884:d=16120113:NLWRT:kpds5=39:...****83:
>> 251556648:d=16120113:NLWRT:kpds5=39:...****84:254624412:
>> d=16120113:NLWRT:kpds5=39:...****85:257692176:d=16120113:
>> NLWRT:kpds5=39:...****86:260759940:d=16120113:NLWRT:
>> kpds5=39:...****87:263827704:d=16120113:NLWRT:kpds5=39:...*
>> ***88:266895468:d=16120113:NLWRT:kpds5=39:...****89:
>> 269963232:d=16120113:NLWRT:kpds5=39:...***90:273030996:d=
>> 16120113:var51:kpds5=51:...
>>
>> I guessed that, as the PTV has only the number, variable name, and
>> comment, this should be summarized to:
>>
>> 81:var52:bla...bla...bla
>> 82:NLWRT:bla...bla...bla
>> 90:var51:bla...bla...bla
>>
>> I'm wrong?
>>
>>
>> Thanks a lot
>>
>> JR Garcia
>>
>> --
>> ==================================================
>> Jose Roberto Motta Garcia, PhD
>>
>> Divisão de Modelagem e Desenvolvimento (DMD)
>> www.cptec.inpe.br
>> www.inpe.br
>> Tel.: +55 (12) 3208-7966
>> --------------------------------------------------
>> ***** Save natural resources *****
>> ==================================================
>>
>> On 06/03/2017 15:04, John Halley Gotway via RT wrote:
>>> JR Garcia,
>>>
>>> I see you're having trouble running APCP GRIB data through
pcp_combine.
>>> Thanks for sending the output of wgrib.
>>>
>>> Looking carefully at that output I see this info "TR=0" and "anl".
That
>>> indicates that this an instantaneous 0-hour "analysis" forecast.
So the
>>> APCP variable in your data is not stored as an accumulation
interval
>> (i.e.
>>> TR=4) but instead is stored as an instantaneous forecast (i.e.
TR=0).
>>> Here's a table about those settings:
>>> http://www.nco.ncep.noaa.gov/pmb/docs/on388/table5.html
>>>
>>> And that's why pcp_combine isn't working. It's looking for a 1-
hour
>>> accumulation of precip, but that's not present in your data.
>>>
>>> The GRIB code is stored as 61 (kpds5=61) which is usually for
APCP, but
>>> wgrib doesn't correctly interpret that. So I'm guessing your data
file
>> is
>>> using a non-standard parameter table version (PTV) number. This
is a
>> wild
>>> guess, but perhaps you're just writing the parameter table version
number
>>> as 0.
>>>
>>> Try running this:
>>> wgrib -PDS10 file_in.grb
>>>
>>> The PTV is listed as the 4th entry in the PDS10 array and here's
more
>> info
>>> about that:
>>> http://www.nco.ncep.noaa.gov/pmb/docs/on388/section1.html
>>>
>>> If you have PTV = 0 and can change that from your regional
model... it
>>> should probably be 2 instead. Then wgrib and MET will be happy.
>>>
>>> If you can't change it, then there are some work-arounds:
>>>
>>> (1) You could edit the GRIB tables used by MET to add new entries
for
>> your
>>> PTV. That would enable MET to correctly interpret the string
"APCP".
>>>
>>> (2) You could make a more explicit call to pcp_combine (but
substitute in
>>> the actual PTV value from your GRIB file):
>>>
>>> bin/pcp_combine -add file_in.grb 'GRIB1_ptv=0; GRIB1_code=61;
>>> level="L0";' file_out.nc
>>>
>>> Hope that helps. Just let me know what other questions you have.
>>>
>>> Thanks,
>>> John Halley Gotway
>>>
>>>
>>> On Mon, Mar 6, 2017 at 7:19 AM, Roberto Garcia (INPE) via RT <
>>> met_help at ucar.edu> wrote:
>>>
>>>> Mon Mar 06 07:19:32 2017: Request 79724 was acted upon.
>>>> Transaction: Ticket created by roberto.garcia at inpe.br
>>>> Queue: met_help
>>>> Subject: pcp_combine
>>>> Owner: Nobody
>>>> Requestors: roberto.garcia at inpe.br
>>>> Status: new
>>>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=79724
>>>>
>>>> Dear MET Help staff.
>>>>
>>>> My goal is to use pcp_combine in order to accumulate some 1-hr
>>>> accumulated rainfall from our regional model but for simplicity
I'm just
>>>> converting a Grib file to NetCDF, so I used:
>>>>
>>>> bin/pcp_combine -add file_in.grb 01 file_out.nc
>>>>
>>>> DEBUG 1: Reading input file: file_in.grb
>>>> WARNING:
>>>> WARNING: MetGrib1DataFile::data_plane() -> No exact match found
for
>>>> VarInfo "APCP/A01" in GRIB file "file_in.grb".
>>>> WARNING:
>>>> ERROR :
>>>> ERROR : get_field() -> can't get data plane from file
"file_in.grb"
>>>> ERROR :
>>>>
>>>>
>>>> It is Ok, since APCP does not exist, as shown by wgrib:
>>>>
>>>> wgrib file_in.grb
>>>>
>>>> ...
>>>>
>>>> 12:33745404:d=16120113:*var61*:kpds5=61:kpds6=1:kpds7=0:TR=
>>>> 0:P1=0:P2=0:TimeU=1:sfc:anl:NAve=0
>>>> ...
>>>>
>>>>
>>>> The actual variable name I'm interested in is "var61". But, when
I
>>>> specify it on the pcp_combine command....
>>>>
>>>> bin/pcp_combine -add file_in.grb 01 file_out.nc*-field var61*
>>>> DEBUG 1: Reading input file: file_in.grb
>>>> ERROR :
>>>> ERROR : yyerror() -> syntax error in file "config_29125_0_.temp"
>>>> ERROR :
>>>> ERROR : line = 2
>>>> ERROR :
>>>> ERROR : column = 1
>>>> ERROR :
>>>> ERROR : text = "(nul)"
>>>> ERROR :
>>>> ERROR :
>>>> ERROR : (nul)
>>>> ERROR : (nul)
>>>>
>>>> Could someone please help me?
>>>>
>>>> Thanks a lot.
>>>>
>>>>
>>>> JR Garcia
>>>>
>>>> --
>>>> ==================================================
>>>> Jose Roberto Motta Garcia, PhD
>>>>
>>>> Divisão de Modelagem e Desenvolvimento (DMD)
>>>> www.cptec.inpe.br
>>>> www.inpe.br
>>>> Tel.: +55 (12) 3208-7966
>>>> --------------------------------------------------
>>>> ***** Save natural resources *****
>>>> ==================================================
>>>>
>>>>
>>>>
>>
>>
------------------------------------------------
Subject: pcp_combine
From: John Halley Gotway
Time: Wed Mar 08 16:57:09 2017
Hmm, I'm really not sure. When you download the met-5.2 tarball from
the
website and unpack it, it certainly contains a data/table_files
directory.
To me, the directories you've sent look like what you use for running
the
MET online tutorial.
Did you install MET yourself, or did a sysadmin install it? If it was
a
sysadmin, that person would know where it is.
John
On Tue, Mar 7, 2017 at 6:05 AM, Roberto Garcia (INPE) via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=79724 >
>
> Hi John, and if there isn't a table_files directory?
>
> > ll met-5.2/data/
> drwxr-xr-x 2 roberto.garcia pesq_dop 4,0K Ago 15 2016 config
> drwxr-xr-x 3 roberto.garcia pesq_dop 4,0K Ago 15 2016 poly
> drwxr-xr-x 7 roberto.garcia pesq_dop 0 Ago 15 2016 sample_fcst
> drwxr-xr-x 7 roberto.garcia pesq_dop 0 Ago 15 2016 sample_obs
> drwxr-xr-x 2 roberto.garcia pesq_dop 4,0K Ago 15 2016 tc_data
> drwxr-xr-x 5 roberto.garcia pesq_dop 0 Set 7 20:55 tutorial
>
> Thanks
>
> JR Garcia
>
> --
> ==================================================
> Jose Roberto Motta Garcia, PhD
>
> Divisão de Modelagem e Desenvolvimento (DMD)
> www.cptec.inpe.br
> www.inpe.br
> Tel.: +55 (12) 3208-7966
> --------------------------------------------------
> ***** Save natural resources *****
> ==================================================
>
> On 06/03/2017 17:21, John Halley Gotway via RT wrote:
> > JR Garcia,
> >
> > MET version 5.2 reads GRIB table information from static ascii
files
> which
> > are defined in the met-5.2/data/table_files directory.
> >
> > Following the existing naming convention in that directory, you'd
create
> a
> > new file named:
> >
> > met-5.2/data/table_files/grib1_inpe_128_100.txt
> >
> > The number '7' is the center number for NCEP and your data is
using
> center
> > number 100. You could just copy over the NCEP usage and switch
all the
> 7's
> > to 100's:
> >
> > cat met-5.2/data/table_files/grib1_ncep_128_7.txt | sed 's/128
7
> /128
> > 100 /g' > met-5.2/data/table_files/grib1_inpe_128_100.txt
> >
> > Next, you should either re-run "make install" for met-5.2 or
manually
> copy
> > that file over into the *INSTALLED* met-5.2/share/met/table_files
> > directory. That's where the code actually reads these files at
runtime.
> >
> > Once you've tried this, try rerunning pcp_combine like this:
> >
> > pcp_combine -add file_in.grb 'name="APCP"; level="L0";'
> file_out.nc
> >
> > If pcp_combine correctly matches APCP to your data, then your
change
> worked.
> >
> > Also, be sure to save this GRIB1 table file somewhere else as
well. It
> > won't be included in newer versions of MET and you'll need to add
it in
> > before compiling a newer version.
> >
> > Please let me know how it goes.
> >
> > Thanks,
> > John
> >
> >
> > On Mon, Mar 6, 2017 at 12:48 PM, Roberto Garcia (INPE) via RT <
> > met_help at ucar.edu> wrote:
> >
> >> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=79724 >
> >>
> >> Dear John,
> >>
> >> Thanks a lot for your help.
> >>
> >> I'm not the owner/builder of the data I'm only in charge of
evaluating
> the
> >> model, so I think change the PTV would is not an option now.
> >>
> >> The output of wgrib -PDS10 file_in.grb is:
> >>
> >> ...
> >> *12:33745404:d=16120113:var61:kpds5=61:kpds6=1:kpds7=0:TR=0:
> >> P1=0:P2=0:TimeU=1:sfc:anl:NAve=0:PDS10=
> >> 0 0 28 128 100 13 255 128 61 1 0 0 16 12 1 13 0 1 0 0 0 0 0 0 21
2 0 0*
> >> ...
> >>
> >> I didn't know about this wgrib option, I've noticed that our data
file
> is
> >> using a non-standard PTV number when I used
> >>
> >> ncl_filedump file_in.grb
> >>
> >> which reported
> >>
> >> *warning:NclGRIB: Unrecognized parameter table (center 100,
subcenter 2,
> >> table 128), defaulting to NCEP operational table: variable names
and
> >> units may be incorrect*
> >>
> >> and
> >>
> >> *float A_PCP_GDS0_SFC ( g0_lat_1, g0_lon_2 )****sub_center :
> 2****center :
> >> Brazzaville****long_name : Total precipitation****units :
> >> kg/m^2****_FillValue : 1e+20****level_indicator :
1****gds_grid_type :
> >> 0****parameter_table_version : 128****parameter_number :
> >> 61****forecast_time : 0****forecast_time_units :
hours****initial_time :
> >> 12/01/2016 (13:00)***
> >> for the grib code 61.
> >>
> >>
> >> I used the work-around #2:
> >>
> >> bin/pcp_combine -add file_in.grb 'GRIB1_ptv=128; GRIB1_code=61;
> >> level="L0";' file_out.nc
> >>
> >> and it worked! Now I'll move to the phase of adding those files.
> >>
> >>
> >> And if I were to use the work-around #1, considering the PTV
below:
> >> -1:100:2:128
> >> 1:VWSH:Vertical speed shear [1/s]
> >> ...
> >> 12:APCP:Total precipitation [kg/m^2]
> >> ...
> >>
> >> In what aspects should I change it? Which entries should I add?
Does it
> >> seem ok to you? And how should I use it in pcp_combine?
> >> I've built this file from an example but I'm not sure if it is
ok. I
> took
> >> the wgrib output as base to build it but some entries repeat
along few
> >> lines, such as:
> >>
> >> 81:245421120:d=16120113:var52:kpds5=52:...
> >> *82:248488884:d=16120113:NLWRT:kpds5=39:...****83:
> >> 251556648:d=16120113:NLWRT:kpds5=39:...****84:254624412:
> >> d=16120113:NLWRT:kpds5=39:...****85:257692176:d=16120113:
> >> NLWRT:kpds5=39:...****86:260759940:d=16120113:NLWRT:
> >> kpds5=39:...****87:263827704:d=16120113:NLWRT:kpds5=39:...*
> >> ***88:266895468:d=16120113:NLWRT:kpds5=39:...****89:
> >> 269963232:d=16120113:NLWRT:kpds5=39:...***90:273030996:d=
> >> 16120113:var51:kpds5=51:...
> >>
> >> I guessed that, as the PTV has only the number, variable name,
and
> >> comment, this should be summarized to:
> >>
> >> 81:var52:bla...bla...bla
> >> 82:NLWRT:bla...bla...bla
> >> 90:var51:bla...bla...bla
> >>
> >> I'm wrong?
> >>
> >>
> >> Thanks a lot
> >>
> >> JR Garcia
> >>
> >> --
> >> ==================================================
> >> Jose Roberto Motta Garcia, PhD
> >>
> >> Divisão de Modelagem e Desenvolvimento (DMD)
> >> www.cptec.inpe.br
> >> www.inpe.br
> >> Tel.: +55 (12) 3208-7966
> >> --------------------------------------------------
> >> ***** Save natural resources *****
> >> ==================================================
> >>
> >> On 06/03/2017 15:04, John Halley Gotway via RT wrote:
> >>> JR Garcia,
> >>>
> >>> I see you're having trouble running APCP GRIB data through
pcp_combine.
> >>> Thanks for sending the output of wgrib.
> >>>
> >>> Looking carefully at that output I see this info "TR=0" and
"anl".
> That
> >>> indicates that this an instantaneous 0-hour "analysis" forecast.
So
> the
> >>> APCP variable in your data is not stored as an accumulation
interval
> >> (i.e.
> >>> TR=4) but instead is stored as an instantaneous forecast (i.e.
TR=0).
> >>> Here's a table about those settings:
> >>> http://www.nco.ncep.noaa.gov/pmb/docs/on388/table5.html
> >>>
> >>> And that's why pcp_combine isn't working. It's looking for a 1-
hour
> >>> accumulation of precip, but that's not present in your data.
> >>>
> >>> The GRIB code is stored as 61 (kpds5=61) which is usually for
APCP, but
> >>> wgrib doesn't correctly interpret that. So I'm guessing your
data file
> >> is
> >>> using a non-standard parameter table version (PTV) number. This
is a
> >> wild
> >>> guess, but perhaps you're just writing the parameter table
version
> number
> >>> as 0.
> >>>
> >>> Try running this:
> >>> wgrib -PDS10 file_in.grb
> >>>
> >>> The PTV is listed as the 4th entry in the PDS10 array and here's
more
> >> info
> >>> about that:
> >>> http://www.nco.ncep.noaa.gov/pmb/docs/on388/section1.html
> >>>
> >>> If you have PTV = 0 and can change that from your regional
model... it
> >>> should probably be 2 instead. Then wgrib and MET will be happy.
> >>>
> >>> If you can't change it, then there are some work-arounds:
> >>>
> >>> (1) You could edit the GRIB tables used by MET to add new
entries for
> >> your
> >>> PTV. That would enable MET to correctly interpret the string
"APCP".
> >>>
> >>> (2) You could make a more explicit call to pcp_combine (but
substitute
> in
> >>> the actual PTV value from your GRIB file):
> >>>
> >>> bin/pcp_combine -add file_in.grb 'GRIB1_ptv=0;
GRIB1_code=61;
> >>> level="L0";' file_out.nc
> >>>
> >>> Hope that helps. Just let me know what other questions you
have.
> >>>
> >>> Thanks,
> >>> John Halley Gotway
> >>>
> >>>
> >>> On Mon, Mar 6, 2017 at 7:19 AM, Roberto Garcia (INPE) via RT <
> >>> met_help at ucar.edu> wrote:
> >>>
> >>>> Mon Mar 06 07:19:32 2017: Request 79724 was acted upon.
> >>>> Transaction: Ticket created by roberto.garcia at inpe.br
> >>>> Queue: met_help
> >>>> Subject: pcp_combine
> >>>> Owner: Nobody
> >>>> Requestors: roberto.garcia at inpe.br
> >>>> Status: new
> >>>> Ticket <URL: https://rt.rap.ucar.edu/rt/
> Ticket/Display.html?id=79724
> >>>>
> >>>> Dear MET Help staff.
> >>>>
> >>>> My goal is to use pcp_combine in order to accumulate some 1-hr
> >>>> accumulated rainfall from our regional model but for simplicity
I'm
> just
> >>>> converting a Grib file to NetCDF, so I used:
> >>>>
> >>>> bin/pcp_combine -add file_in.grb 01 file_out.nc
> >>>>
> >>>> DEBUG 1: Reading input file: file_in.grb
> >>>> WARNING:
> >>>> WARNING: MetGrib1DataFile::data_plane() -> No exact match found
for
> >>>> VarInfo "APCP/A01" in GRIB file "file_in.grb".
> >>>> WARNING:
> >>>> ERROR :
> >>>> ERROR : get_field() -> can't get data plane from file
"file_in.grb"
> >>>> ERROR :
> >>>>
> >>>>
> >>>> It is Ok, since APCP does not exist, as shown by wgrib:
> >>>>
> >>>> wgrib file_in.grb
> >>>>
> >>>> ...
> >>>>
> >>>> 12:33745404:d=16120113:*var61*:kpds5=61:kpds6=1:kpds7=0:TR=
> >>>> 0:P1=0:P2=0:TimeU=1:sfc:anl:NAve=0
> >>>> ...
> >>>>
> >>>>
> >>>> The actual variable name I'm interested in is "var61". But,
when I
> >>>> specify it on the pcp_combine command....
> >>>>
> >>>> bin/pcp_combine -add file_in.grb 01 file_out.nc*-field var61*
> >>>> DEBUG 1: Reading input file: file_in.grb
> >>>> ERROR :
> >>>> ERROR : yyerror() -> syntax error in file
"config_29125_0_.temp"
> >>>> ERROR :
> >>>> ERROR : line = 2
> >>>> ERROR :
> >>>> ERROR : column = 1
> >>>> ERROR :
> >>>> ERROR : text = "(nul)"
> >>>> ERROR :
> >>>> ERROR :
> >>>> ERROR : (nul)
> >>>> ERROR : (nul)
> >>>>
> >>>> Could someone please help me?
> >>>>
> >>>> Thanks a lot.
> >>>>
> >>>>
> >>>> JR Garcia
> >>>>
> >>>> --
> >>>> ==================================================
> >>>> Jose Roberto Motta Garcia, PhD
> >>>>
> >>>> Divisão de Modelagem e Desenvolvimento (DMD)
> >>>> www.cptec.inpe.br
> >>>> www.inpe.br
> >>>> Tel.: +55 (12) 3208-7966
> >>>> --------------------------------------------------
> >>>> ***** Save natural resources *****
> >>>> ==================================================
> >>>>
> >>>>
> >>>>
> >>
> >>
>
>
>
------------------------------------------------
Subject: pcp_combine
From: Roberto Garcia (INPE)
Time: Fri Mar 10 07:32:35 2017
Hi John, my table_files directory actually is at
met-5.2/share/met/table_files and I don't know why.
I've installed it by myself. I was thinking that I've done something
wrong in the installation and installed again (MET and patch 2017) and
this is the directory tree I've got (without tutorial):
met-5.2$ find . -type d
./bin
./share
./share/met
./share/met/table_files
./share/met/map
./share/met/map/admin_by_country
./share/met/config
./share/met/ps
./share/met/poly
./share/met/poly/HMT_masks
./share/met/tc_data
./share/met/colortables
./share/met/colortables/NCL_colortables
The table files are there:
$ ll ./share/met/table_files
-rw-r--r-- 1 roberto.garcia pesq_dop 12K Nov 4 13:41
grib1_af_131_57.txt
-rw-r--r-- 1 roberto.garcia pesq_dop 13K Nov 4 13:41
grib1_cptec_254_64.txt
-rw-r--r-- 1 roberto.garcia pesq_dop 12K Nov 4 13:41
grib1_dwd_2_78.txt
...
-rw-r--r-- 1 roberto.garcia pesq_dop 15K Nov 4 13:41
grib1_ecmwf_128_98.txt
...
-rw-r--r-- 1 roberto.garcia pesq_dop 49K Nov 4 13:41
grib1_ncep_2_7.txt
-rw-r--r-- 1 roberto.garcia pesq_dop 12K Nov 4 13:41
grib1_ncep_128_7.txt
...
-rw-r--r-- 1 roberto.garcia pesq_dop 72K Nov 4 13:41 grib2_all.txt
...
And there is already an entry for CPTEC. I'll try to use that method
you
suggested to me.
I'm doing something wrong in the instalation?
Best regards.
JR Garcia
--
==================================================
Jose Roberto Motta Garcia, PhD
Divisão de Modelagem e Desenvolvimento (DMD)
www.cptec.inpe.br
www.inpe.br
Tel.: +55 (12) 3208-7966
--------------------------------------------------
***** Save natural resources *****
==================================================
On 08/03/2017 20:57, John Halley Gotway via RT wrote:
> Hmm, I'm really not sure. When you download the met-5.2 tarball
from the
> website and unpack it, it certainly contains a data/table_files
directory.
> To me, the directories you've sent look like what you use for
running the
> MET online tutorial.
>
> Did you install MET yourself, or did a sysadmin install it? If it
was a
> sysadmin, that person would know where it is.
>
> John
>
>
> On Tue, Mar 7, 2017 at 6:05 AM, Roberto Garcia (INPE) via RT <
> met_help at ucar.edu> wrote:
>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=79724 >
>>
>> Hi John, and if there isn't a table_files directory?
>>
>> > ll met-5.2/data/
>> drwxr-xr-x 2 roberto.garcia pesq_dop 4,0K Ago 15 2016 config
>> drwxr-xr-x 3 roberto.garcia pesq_dop 4,0K Ago 15 2016 poly
>> drwxr-xr-x 7 roberto.garcia pesq_dop 0 Ago 15 2016 sample_fcst
>> drwxr-xr-x 7 roberto.garcia pesq_dop 0 Ago 15 2016 sample_obs
>> drwxr-xr-x 2 roberto.garcia pesq_dop 4,0K Ago 15 2016 tc_data
>> drwxr-xr-x 5 roberto.garcia pesq_dop 0 Set 7 20:55 tutorial
>>
>> Thanks
>>
>> JR Garcia
>>
>> --
>> ==================================================
>> Jose Roberto Motta Garcia, PhD
>>
>> Divisão de Modelagem e Desenvolvimento (DMD)
>> www.cptec.inpe.br
>> www.inpe.br
>> Tel.: +55 (12) 3208-7966
>> --------------------------------------------------
>> ***** Save natural resources *****
>> ==================================================
>>
>> On 06/03/2017 17:21, John Halley Gotway via RT wrote:
>>> JR Garcia,
>>>
>>> MET version 5.2 reads GRIB table information from static ascii
files
>> which
>>> are defined in the met-5.2/data/table_files directory.
>>>
>>> Following the existing naming convention in that directory, you'd
create
>> a
>>> new file named:
>>>
>>> met-5.2/data/table_files/grib1_inpe_128_100.txt
>>>
>>> The number '7' is the center number for NCEP and your data is
using
>> center
>>> number 100. You could just copy over the NCEP usage and switch
all the
>> 7's
>>> to 100's:
>>>
>>> cat met-5.2/data/table_files/grib1_ncep_128_7.txt | sed
's/128 7
>> /128
>>> 100 /g' > met-5.2/data/table_files/grib1_inpe_128_100.txt
>>>
>>> Next, you should either re-run "make install" for met-5.2 or
manually
>> copy
>>> that file over into the *INSTALLED* met-5.2/share/met/table_files
>>> directory. That's where the code actually reads these files at
runtime.
>>>
>>> Once you've tried this, try rerunning pcp_combine like this:
>>>
>>> pcp_combine -add file_in.grb 'name="APCP"; level="L0";'
>> file_out.nc
>>> If pcp_combine correctly matches APCP to your data, then your
change
>> worked.
>>> Also, be sure to save this GRIB1 table file somewhere else as
well. It
>>> won't be included in newer versions of MET and you'll need to add
it in
>>> before compiling a newer version.
>>>
>>> Please let me know how it goes.
>>>
>>> Thanks,
>>> John
>>>
>>>
>>> On Mon, Mar 6, 2017 at 12:48 PM, Roberto Garcia (INPE) via RT <
>>> met_help at ucar.edu> wrote:
>>>
>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=79724 >
>>>>
>>>> Dear John,
>>>>
>>>> Thanks a lot for your help.
>>>>
>>>> I'm not the owner/builder of the data I'm only in charge of
evaluating
>> the
>>>> model, so I think change the PTV would is not an option now.
>>>>
>>>> The output of wgrib -PDS10 file_in.grb is:
>>>>
>>>> ...
>>>> *12:33745404:d=16120113:var61:kpds5=61:kpds6=1:kpds7=0:TR=0:
>>>> P1=0:P2=0:TimeU=1:sfc:anl:NAve=0:PDS10=
>>>> 0 0 28 128 100 13 255 128 61 1 0 0 16 12 1 13 0 1 0 0 0 0 0 0 21
2 0 0*
>>>> ...
>>>>
>>>> I didn't know about this wgrib option, I've noticed that our data
file
>> is
>>>> using a non-standard PTV number when I used
>>>>
>>>> ncl_filedump file_in.grb
>>>>
>>>> which reported
>>>>
>>>> *warning:NclGRIB: Unrecognized parameter table (center 100,
subcenter 2,
>>>> table 128), defaulting to NCEP operational table: variable names
and
>>>> units may be incorrect*
>>>>
>>>> and
>>>>
>>>> *float A_PCP_GDS0_SFC ( g0_lat_1, g0_lon_2 )****sub_center :
>> 2****center :
>>>> Brazzaville****long_name : Total precipitation****units :
>>>> kg/m^2****_FillValue : 1e+20****level_indicator :
1****gds_grid_type :
>>>> 0****parameter_table_version : 128****parameter_number :
>>>> 61****forecast_time : 0****forecast_time_units :
hours****initial_time :
>>>> 12/01/2016 (13:00)***
>>>> for the grib code 61.
>>>>
>>>>
>>>> I used the work-around #2:
>>>>
>>>> bin/pcp_combine -add file_in.grb 'GRIB1_ptv=128; GRIB1_code=61;
>>>> level="L0";' file_out.nc
>>>>
>>>> and it worked! Now I'll move to the phase of adding those files.
>>>>
>>>>
>>>> And if I were to use the work-around #1, considering the PTV
below:
>>>> -1:100:2:128
>>>> 1:VWSH:Vertical speed shear [1/s]
>>>> ...
>>>> 12:APCP:Total precipitation [kg/m^2]
>>>> ...
>>>>
>>>> In what aspects should I change it? Which entries should I add?
Does it
>>>> seem ok to you? And how should I use it in pcp_combine?
>>>> I've built this file from an example but I'm not sure if it is
ok. I
>> took
>>>> the wgrib output as base to build it but some entries repeat
along few
>>>> lines, such as:
>>>>
>>>> 81:245421120:d=16120113:var52:kpds5=52:...
>>>> *82:248488884:d=16120113:NLWRT:kpds5=39:...****83:
>>>> 251556648:d=16120113:NLWRT:kpds5=39:...****84:254624412:
>>>> d=16120113:NLWRT:kpds5=39:...****85:257692176:d=16120113:
>>>> NLWRT:kpds5=39:...****86:260759940:d=16120113:NLWRT:
>>>> kpds5=39:...****87:263827704:d=16120113:NLWRT:kpds5=39:...*
>>>> ***88:266895468:d=16120113:NLWRT:kpds5=39:...****89:
>>>> 269963232:d=16120113:NLWRT:kpds5=39:...***90:273030996:d=
>>>> 16120113:var51:kpds5=51:...
>>>>
>>>> I guessed that, as the PTV has only the number, variable name,
and
>>>> comment, this should be summarized to:
>>>>
>>>> 81:var52:bla...bla...bla
>>>> 82:NLWRT:bla...bla...bla
>>>> 90:var51:bla...bla...bla
>>>>
>>>> I'm wrong?
>>>>
>>>>
>>>> Thanks a lot
>>>>
>>>> JR Garcia
>>>>
>>>> --
>>>> ==================================================
>>>> Jose Roberto Motta Garcia, PhD
>>>>
>>>> Divisão de Modelagem e Desenvolvimento (DMD)
>>>> www.cptec.inpe.br
>>>> www.inpe.br
>>>> Tel.: +55 (12) 3208-7966
>>>> --------------------------------------------------
>>>> ***** Save natural resources *****
>>>> ==================================================
>>>>
>>>> On 06/03/2017 15:04, John Halley Gotway via RT wrote:
>>>>> JR Garcia,
>>>>>
>>>>> I see you're having trouble running APCP GRIB data through
pcp_combine.
>>>>> Thanks for sending the output of wgrib.
>>>>>
>>>>> Looking carefully at that output I see this info "TR=0" and
"anl".
>> That
>>>>> indicates that this an instantaneous 0-hour "analysis" forecast.
So
>> the
>>>>> APCP variable in your data is not stored as an accumulation
interval
>>>> (i.e.
>>>>> TR=4) but instead is stored as an instantaneous forecast (i.e.
TR=0).
>>>>> Here's a table about those settings:
>>>>> http://www.nco.ncep.noaa.gov/pmb/docs/on388/table5.html
>>>>>
>>>>> And that's why pcp_combine isn't working. It's looking for a 1-
hour
>>>>> accumulation of precip, but that's not present in your data.
>>>>>
>>>>> The GRIB code is stored as 61 (kpds5=61) which is usually for
APCP, but
>>>>> wgrib doesn't correctly interpret that. So I'm guessing your
data file
>>>> is
>>>>> using a non-standard parameter table version (PTV) number. This
is a
>>>> wild
>>>>> guess, but perhaps you're just writing the parameter table
version
>> number
>>>>> as 0.
>>>>>
>>>>> Try running this:
>>>>> wgrib -PDS10 file_in.grb
>>>>>
>>>>> The PTV is listed as the 4th entry in the PDS10 array and here's
more
>>>> info
>>>>> about that:
>>>>> http://www.nco.ncep.noaa.gov/pmb/docs/on388/section1.html
>>>>>
>>>>> If you have PTV = 0 and can change that from your regional
model... it
>>>>> should probably be 2 instead. Then wgrib and MET will be happy.
>>>>>
>>>>> If you can't change it, then there are some work-arounds:
>>>>>
>>>>> (1) You could edit the GRIB tables used by MET to add new
entries for
>>>> your
>>>>> PTV. That would enable MET to correctly interpret the string
"APCP".
>>>>>
>>>>> (2) You could make a more explicit call to pcp_combine (but
substitute
>> in
>>>>> the actual PTV value from your GRIB file):
>>>>>
>>>>> bin/pcp_combine -add file_in.grb 'GRIB1_ptv=0;
GRIB1_code=61;
>>>>> level="L0";' file_out.nc
>>>>>
>>>>> Hope that helps. Just let me know what other questions you
have.
>>>>>
>>>>> Thanks,
>>>>> John Halley Gotway
>>>>>
>>>>>
>>>>> On Mon, Mar 6, 2017 at 7:19 AM, Roberto Garcia (INPE) via RT <
>>>>> met_help at ucar.edu> wrote:
>>>>>
>>>>>> Mon Mar 06 07:19:32 2017: Request 79724 was acted upon.
>>>>>> Transaction: Ticket created by roberto.garcia at inpe.br
>>>>>> Queue: met_help
>>>>>> Subject: pcp_combine
>>>>>> Owner: Nobody
>>>>>> Requestors: roberto.garcia at inpe.br
>>>>>> Status: new
>>>>>> Ticket <URL: https://rt.rap.ucar.edu/rt/
>> Ticket/Display.html?id=79724
>>>>>> Dear MET Help staff.
>>>>>>
>>>>>> My goal is to use pcp_combine in order to accumulate some 1-hr
>>>>>> accumulated rainfall from our regional model but for simplicity
I'm
>> just
>>>>>> converting a Grib file to NetCDF, so I used:
>>>>>>
>>>>>> bin/pcp_combine -add file_in.grb 01 file_out.nc
>>>>>>
>>>>>> DEBUG 1: Reading input file: file_in.grb
>>>>>> WARNING:
>>>>>> WARNING: MetGrib1DataFile::data_plane() -> No exact match found
for
>>>>>> VarInfo "APCP/A01" in GRIB file "file_in.grb".
>>>>>> WARNING:
>>>>>> ERROR :
>>>>>> ERROR : get_field() -> can't get data plane from file
"file_in.grb"
>>>>>> ERROR :
>>>>>>
>>>>>>
>>>>>> It is Ok, since APCP does not exist, as shown by wgrib:
>>>>>>
>>>>>> wgrib file_in.grb
>>>>>>
>>>>>> ...
>>>>>>
>>>>>> 12:33745404:d=16120113:*var61*:kpds5=61:kpds6=1:kpds7=0:TR=
>>>>>> 0:P1=0:P2=0:TimeU=1:sfc:anl:NAve=0
>>>>>> ...
>>>>>>
>>>>>>
>>>>>> The actual variable name I'm interested in is "var61". But,
when I
>>>>>> specify it on the pcp_combine command....
>>>>>>
>>>>>> bin/pcp_combine -add file_in.grb 01 file_out.nc*-field var61*
>>>>>> DEBUG 1: Reading input file: file_in.grb
>>>>>> ERROR :
>>>>>> ERROR : yyerror() -> syntax error in file
"config_29125_0_.temp"
>>>>>> ERROR :
>>>>>> ERROR : line = 2
>>>>>> ERROR :
>>>>>> ERROR : column = 1
>>>>>> ERROR :
>>>>>> ERROR : text = "(nul)"
>>>>>> ERROR :
>>>>>> ERROR :
>>>>>> ERROR : (nul)
>>>>>> ERROR : (nul)
>>>>>>
>>>>>> Could someone please help me?
>>>>>>
>>>>>> Thanks a lot.
>>>>>>
>>>>>>
>>>>>> JR Garcia
>>>>>>
>>>>>> --
>>>>>> ==================================================
>>>>>> Jose Roberto Motta Garcia, PhD
>>>>>>
>>>>>> Divisão de Modelagem e Desenvolvimento (DMD)
>>>>>> www.cptec.inpe.br
>>>>>> www.inpe.br
>>>>>> Tel.: +55 (12) 3208-7966
>>>>>> --------------------------------------------------
>>>>>> ***** Save natural resources *****
>>>>>> ==================================================
>>>>>>
>>>>>>
>>>>>>
>>>>
>>
>>
------------------------------------------------
Subject: pcp_combine
From: John Halley Gotway
Time: Fri Mar 10 13:01:13 2017
Roberto,
The MET tools need some static data files at runtime (including the
GRIB
table files that we're discussing).
When you unpack the met-5.2 tarball, that data lives in the "met-
5.2/data"
directory.
When you run the configure command, you specify where you'd like to
install
MET using the "--prefix" option.
When you run "make install", it copies that static data for runtime
from
"met-5.2/data" to "INSTALL_PREFIX/share/met", where INSTALL_PREFIX is
the
--prefix path.
When you run the MET tools, they read the static data from
"INSTALL_PREFIX/share/met".
Placing static runtime data in a "share" directory is the standard
method
used by autoconf.
Hopefully that helps clarify.
Thanks,
John
On Fri, Mar 10, 2017 at 7:32 AM, Roberto Garcia (INPE) via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=79724 >
>
> Hi John, my table_files directory actually is at
> met-5.2/share/met/table_files and I don't know why.
>
> I've installed it by myself. I was thinking that I've done something
> wrong in the installation and installed again (MET and patch 2017)
and
> this is the directory tree I've got (without tutorial):
>
> met-5.2$ find . -type d
> ./bin
> ./share
> ./share/met
> ./share/met/table_files
> ./share/met/map
> ./share/met/map/admin_by_country
> ./share/met/config
> ./share/met/ps
> ./share/met/poly
> ./share/met/poly/HMT_masks
> ./share/met/tc_data
> ./share/met/colortables
> ./share/met/colortables/NCL_colortables
>
> The table files are there:
>
> $ ll ./share/met/table_files
> -rw-r--r-- 1 roberto.garcia pesq_dop 12K Nov 4 13:41
grib1_af_131_57.txt
> -rw-r--r-- 1 roberto.garcia pesq_dop 13K Nov 4 13:41
> grib1_cptec_254_64.txt
> -rw-r--r-- 1 roberto.garcia pesq_dop 12K Nov 4 13:41
grib1_dwd_2_78.txt
> ...
> -rw-r--r-- 1 roberto.garcia pesq_dop 15K Nov 4 13:41
> grib1_ecmwf_128_98.txt
> ...
> -rw-r--r-- 1 roberto.garcia pesq_dop 49K Nov 4 13:41
grib1_ncep_2_7.txt
> -rw-r--r-- 1 roberto.garcia pesq_dop 12K Nov 4 13:41
grib1_ncep_128_7.txt
> ...
> -rw-r--r-- 1 roberto.garcia pesq_dop 72K Nov 4 13:41 grib2_all.txt
> ...
>
> And there is already an entry for CPTEC. I'll try to use that method
you
> suggested to me.
>
> I'm doing something wrong in the instalation?
>
> Best regards.
>
> JR Garcia
>
> --
> ==================================================
> Jose Roberto Motta Garcia, PhD
>
> Divisão de Modelagem e Desenvolvimento (DMD)
> www.cptec.inpe.br
> www.inpe.br
> Tel.: +55 (12) 3208-7966
> --------------------------------------------------
> ***** Save natural resources *****
> ==================================================
>
> On 08/03/2017 20:57, John Halley Gotway via RT wrote:
> > Hmm, I'm really not sure. When you download the met-5.2 tarball
from the
> > website and unpack it, it certainly contains a data/table_files
> directory.
> > To me, the directories you've sent look like what you use for
running the
> > MET online tutorial.
> >
> > Did you install MET yourself, or did a sysadmin install it? If it
was a
> > sysadmin, that person would know where it is.
> >
> > John
> >
> >
> > On Tue, Mar 7, 2017 at 6:05 AM, Roberto Garcia (INPE) via RT <
> > met_help at ucar.edu> wrote:
> >
> >> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=79724 >
> >>
> >> Hi John, and if there isn't a table_files directory?
> >>
> >> > ll met-5.2/data/
> >> drwxr-xr-x 2 roberto.garcia pesq_dop 4,0K Ago 15 2016 config
> >> drwxr-xr-x 3 roberto.garcia pesq_dop 4,0K Ago 15 2016 poly
> >> drwxr-xr-x 7 roberto.garcia pesq_dop 0 Ago 15 2016
sample_fcst
> >> drwxr-xr-x 7 roberto.garcia pesq_dop 0 Ago 15 2016 sample_obs
> >> drwxr-xr-x 2 roberto.garcia pesq_dop 4,0K Ago 15 2016 tc_data
> >> drwxr-xr-x 5 roberto.garcia pesq_dop 0 Set 7 20:55 tutorial
> >>
> >> Thanks
> >>
> >> JR Garcia
> >>
> >> --
> >> ==================================================
> >> Jose Roberto Motta Garcia, PhD
> >>
> >> Divisão de Modelagem e Desenvolvimento (DMD)
> >> www.cptec.inpe.br
> >> www.inpe.br
> >> Tel.: +55 (12) 3208-7966
> >> --------------------------------------------------
> >> ***** Save natural resources *****
> >> ==================================================
> >>
> >> On 06/03/2017 17:21, John Halley Gotway via RT wrote:
> >>> JR Garcia,
> >>>
> >>> MET version 5.2 reads GRIB table information from static ascii
files
> >> which
> >>> are defined in the met-5.2/data/table_files directory.
> >>>
> >>> Following the existing naming convention in that directory,
you'd
> create
> >> a
> >>> new file named:
> >>>
> >>> met-5.2/data/table_files/grib1_inpe_128_100.txt
> >>>
> >>> The number '7' is the center number for NCEP and your data is
using
> >> center
> >>> number 100. You could just copy over the NCEP usage and switch
all the
> >> 7's
> >>> to 100's:
> >>>
> >>> cat met-5.2/data/table_files/grib1_ncep_128_7.txt | sed
's/128 7
> >> /128
> >>> 100 /g' > met-5.2/data/table_files/grib1_inpe_128_100.txt
> >>>
> >>> Next, you should either re-run "make install" for met-5.2 or
manually
> >> copy
> >>> that file over into the *INSTALLED* met-
5.2/share/met/table_files
> >>> directory. That's where the code actually reads these files at
> runtime.
> >>>
> >>> Once you've tried this, try rerunning pcp_combine like this:
> >>>
> >>> pcp_combine -add file_in.grb 'name="APCP"; level="L0";'
> >> file_out.nc
> >>> If pcp_combine correctly matches APCP to your data, then your
change
> >> worked.
> >>> Also, be sure to save this GRIB1 table file somewhere else as
well. It
> >>> won't be included in newer versions of MET and you'll need to
add it in
> >>> before compiling a newer version.
> >>>
> >>> Please let me know how it goes.
> >>>
> >>> Thanks,
> >>> John
> >>>
> >>>
> >>> On Mon, Mar 6, 2017 at 12:48 PM, Roberto Garcia (INPE) via RT <
> >>> met_help at ucar.edu> wrote:
> >>>
> >>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=79724 >
> >>>>
> >>>> Dear John,
> >>>>
> >>>> Thanks a lot for your help.
> >>>>
> >>>> I'm not the owner/builder of the data I'm only in charge of
evaluating
> >> the
> >>>> model, so I think change the PTV would is not an option now.
> >>>>
> >>>> The output of wgrib -PDS10 file_in.grb is:
> >>>>
> >>>> ...
> >>>> *12:33745404:d=16120113:var61:kpds5=61:kpds6=1:kpds7=0:TR=0:
> >>>> P1=0:P2=0:TimeU=1:sfc:anl:NAve=0:PDS10=
> >>>> 0 0 28 128 100 13 255 128 61 1 0 0 16 12 1 13 0 1 0 0 0 0 0 0
21 2 0
> 0*
> >>>> ...
> >>>>
> >>>> I didn't know about this wgrib option, I've noticed that our
data file
> >> is
> >>>> using a non-standard PTV number when I used
> >>>>
> >>>> ncl_filedump file_in.grb
> >>>>
> >>>> which reported
> >>>>
> >>>> *warning:NclGRIB: Unrecognized parameter table (center 100,
subcenter
> 2,
> >>>> table 128), defaulting to NCEP operational table: variable
names and
> >>>> units may be incorrect*
> >>>>
> >>>> and
> >>>>
> >>>> *float A_PCP_GDS0_SFC ( g0_lat_1, g0_lon_2 )****sub_center :
> >> 2****center :
> >>>> Brazzaville****long_name : Total precipitation****units :
> >>>> kg/m^2****_FillValue : 1e+20****level_indicator :
1****gds_grid_type :
> >>>> 0****parameter_table_version : 128****parameter_number :
> >>>> 61****forecast_time : 0****forecast_time_units :
> hours****initial_time :
> >>>> 12/01/2016 (13:00)***
> >>>> for the grib code 61.
> >>>>
> >>>>
> >>>> I used the work-around #2:
> >>>>
> >>>> bin/pcp_combine -add file_in.grb 'GRIB1_ptv=128; GRIB1_code=61;
> >>>> level="L0";' file_out.nc
> >>>>
> >>>> and it worked! Now I'll move to the phase of adding those
files.
> >>>>
> >>>>
> >>>> And if I were to use the work-around #1, considering the PTV
below:
> >>>> -1:100:2:128
> >>>> 1:VWSH:Vertical speed shear [1/s]
> >>>> ...
> >>>> 12:APCP:Total precipitation [kg/m^2]
> >>>> ...
> >>>>
> >>>> In what aspects should I change it? Which entries should I add?
Does
> it
> >>>> seem ok to you? And how should I use it in pcp_combine?
> >>>> I've built this file from an example but I'm not sure if it is
ok. I
> >> took
> >>>> the wgrib output as base to build it but some entries repeat
along few
> >>>> lines, such as:
> >>>>
> >>>> 81:245421120:d=16120113:var52:kpds5=52:...
> >>>> *82:248488884:d=16120113:NLWRT:kpds5=39:...****83:
> >>>> 251556648:d=16120113:NLWRT:kpds5=39:...****84:254624412:
> >>>> d=16120113:NLWRT:kpds5=39:...****85:257692176:d=16120113:
> >>>> NLWRT:kpds5=39:...****86:260759940:d=16120113:NLWRT:
> >>>> kpds5=39:...****87:263827704:d=16120113:NLWRT:kpds5=39:...*
> >>>> ***88:266895468:d=16120113:NLWRT:kpds5=39:...****89:
> >>>> 269963232:d=16120113:NLWRT:kpds5=39:...***90:273030996:d=
> >>>> 16120113:var51:kpds5=51:...
> >>>>
> >>>> I guessed that, as the PTV has only the number, variable name,
and
> >>>> comment, this should be summarized to:
> >>>>
> >>>> 81:var52:bla...bla...bla
> >>>> 82:NLWRT:bla...bla...bla
> >>>> 90:var51:bla...bla...bla
> >>>>
> >>>> I'm wrong?
> >>>>
> >>>>
> >>>> Thanks a lot
> >>>>
> >>>> JR Garcia
> >>>>
> >>>> --
> >>>> ==================================================
> >>>> Jose Roberto Motta Garcia, PhD
> >>>>
> >>>> Divisão de Modelagem e Desenvolvimento (DMD)
> >>>> www.cptec.inpe.br
> >>>> www.inpe.br
> >>>> Tel.: +55 (12) 3208-7966
> >>>> --------------------------------------------------
> >>>> ***** Save natural resources *****
> >>>> ==================================================
> >>>>
> >>>> On 06/03/2017 15:04, John Halley Gotway via RT wrote:
> >>>>> JR Garcia,
> >>>>>
> >>>>> I see you're having trouble running APCP GRIB data through
> pcp_combine.
> >>>>> Thanks for sending the output of wgrib.
> >>>>>
> >>>>> Looking carefully at that output I see this info "TR=0" and
"anl".
> >> That
> >>>>> indicates that this an instantaneous 0-hour "analysis"
forecast. So
> >> the
> >>>>> APCP variable in your data is not stored as an accumulation
interval
> >>>> (i.e.
> >>>>> TR=4) but instead is stored as an instantaneous forecast (i.e.
TR=0).
> >>>>> Here's a table about those settings:
> >>>>> http://www.nco.ncep.noaa.gov/pmb/docs/on388/table5.html
> >>>>>
> >>>>> And that's why pcp_combine isn't working. It's looking for a
1-hour
> >>>>> accumulation of precip, but that's not present in your data.
> >>>>>
> >>>>> The GRIB code is stored as 61 (kpds5=61) which is usually for
APCP,
> but
> >>>>> wgrib doesn't correctly interpret that. So I'm guessing your
data
> file
> >>>> is
> >>>>> using a non-standard parameter table version (PTV) number.
This is a
> >>>> wild
> >>>>> guess, but perhaps you're just writing the parameter table
version
> >> number
> >>>>> as 0.
> >>>>>
> >>>>> Try running this:
> >>>>> wgrib -PDS10 file_in.grb
> >>>>>
> >>>>> The PTV is listed as the 4th entry in the PDS10 array and
here's more
> >>>> info
> >>>>> about that:
> >>>>>
http://www.nco.ncep.noaa.gov/pmb/docs/on388/section1.html
> >>>>>
> >>>>> If you have PTV = 0 and can change that from your regional
model...
> it
> >>>>> should probably be 2 instead. Then wgrib and MET will be
happy.
> >>>>>
> >>>>> If you can't change it, then there are some work-arounds:
> >>>>>
> >>>>> (1) You could edit the GRIB tables used by MET to add new
entries for
> >>>> your
> >>>>> PTV. That would enable MET to correctly interpret the string
"APCP".
> >>>>>
> >>>>> (2) You could make a more explicit call to pcp_combine (but
> substitute
> >> in
> >>>>> the actual PTV value from your GRIB file):
> >>>>>
> >>>>> bin/pcp_combine -add file_in.grb 'GRIB1_ptv=0;
GRIB1_code=61;
> >>>>> level="L0";' file_out.nc
> >>>>>
> >>>>> Hope that helps. Just let me know what other questions you
have.
> >>>>>
> >>>>> Thanks,
> >>>>> John Halley Gotway
> >>>>>
> >>>>>
> >>>>> On Mon, Mar 6, 2017 at 7:19 AM, Roberto Garcia (INPE) via RT <
> >>>>> met_help at ucar.edu> wrote:
> >>>>>
> >>>>>> Mon Mar 06 07:19:32 2017: Request 79724 was acted upon.
> >>>>>> Transaction: Ticket created by roberto.garcia at inpe.br
> >>>>>> Queue: met_help
> >>>>>> Subject: pcp_combine
> >>>>>> Owner: Nobody
> >>>>>> Requestors: roberto.garcia at inpe.br
> >>>>>> Status: new
> >>>>>> Ticket <URL: https://rt.rap.ucar.edu/rt/
> >> Ticket/Display.html?id=79724
> >>>>>> Dear MET Help staff.
> >>>>>>
> >>>>>> My goal is to use pcp_combine in order to accumulate some 1-
hr
> >>>>>> accumulated rainfall from our regional model but for
simplicity I'm
> >> just
> >>>>>> converting a Grib file to NetCDF, so I used:
> >>>>>>
> >>>>>> bin/pcp_combine -add file_in.grb 01 file_out.nc
> >>>>>>
> >>>>>> DEBUG 1: Reading input file: file_in.grb
> >>>>>> WARNING:
> >>>>>> WARNING: MetGrib1DataFile::data_plane() -> No exact match
found for
> >>>>>> VarInfo "APCP/A01" in GRIB file "file_in.grb".
> >>>>>> WARNING:
> >>>>>> ERROR :
> >>>>>> ERROR : get_field() -> can't get data plane from file
"file_in.grb"
> >>>>>> ERROR :
> >>>>>>
> >>>>>>
> >>>>>> It is Ok, since APCP does not exist, as shown by wgrib:
> >>>>>>
> >>>>>> wgrib file_in.grb
> >>>>>>
> >>>>>> ...
> >>>>>>
> >>>>>> 12:33745404:d=16120113:*var61*:kpds5=61:kpds6=1:kpds7=0:TR=
> >>>>>> 0:P1=0:P2=0:TimeU=1:sfc:anl:NAve=0
> >>>>>> ...
> >>>>>>
> >>>>>>
> >>>>>> The actual variable name I'm interested in is "var61". But,
when I
> >>>>>> specify it on the pcp_combine command....
> >>>>>>
> >>>>>> bin/pcp_combine -add file_in.grb 01 file_out.nc*-field var61*
> >>>>>> DEBUG 1: Reading input file: file_in.grb
> >>>>>> ERROR :
> >>>>>> ERROR : yyerror() -> syntax error in file
"config_29125_0_.temp"
> >>>>>> ERROR :
> >>>>>> ERROR : line = 2
> >>>>>> ERROR :
> >>>>>> ERROR : column = 1
> >>>>>> ERROR :
> >>>>>> ERROR : text = "(nul)"
> >>>>>> ERROR :
> >>>>>> ERROR :
> >>>>>> ERROR : (nul)
> >>>>>> ERROR : (nul)
> >>>>>>
> >>>>>> Could someone please help me?
> >>>>>>
> >>>>>> Thanks a lot.
> >>>>>>
> >>>>>>
> >>>>>> JR Garcia
> >>>>>>
> >>>>>> --
> >>>>>> ==================================================
> >>>>>> Jose Roberto Motta Garcia, PhD
> >>>>>>
> >>>>>> Divisão de Modelagem e Desenvolvimento (DMD)
> >>>>>> www.cptec.inpe.br
> >>>>>> www.inpe.br
> >>>>>> Tel.: +55 (12) 3208-7966
> >>>>>> --------------------------------------------------
> >>>>>> ***** Save natural resources *****
> >>>>>> ==================================================
> >>>>>>
> >>>>>>
> >>>>>>
> >>>>
> >>
> >>
>
>
>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #79724] pcp_combine
From: Roberto Garcia (INPE)
Time: Fri Mar 10 13:37:40 2017
Both methods worked.
Many thanks John.
Best regards,
JR Garcia
--
==================================================
Jose Roberto Motta Garcia, PhD
Divisão de Modelagem e Desenvolvimento (DMD)
www.cptec.inpe.br
www.inpe.br
Tel.: +55 (12) 3208-7966
--------------------------------------------------
***** Save natural resources *****
==================================================
On 10/03/2017 17:01, John Halley Gotway via RT wrote:
> Roberto,
>
> The MET tools need some static data files at runtime (including the
GRIB
> table files that we're discussing).
>
> When you unpack the met-5.2 tarball, that data lives in the "met-
5.2/data"
> directory.
> When you run the configure command, you specify where you'd like to
install
> MET using the "--prefix" option.
> When you run "make install", it copies that static data for runtime
from
> "met-5.2/data" to "INSTALL_PREFIX/share/met", where INSTALL_PREFIX
is the
> --prefix path.
> When you run the MET tools, they read the static data from
> "INSTALL_PREFIX/share/met".
>
> Placing static runtime data in a "share" directory is the standard
method
> used by autoconf.
>
> Hopefully that helps clarify.
>
> Thanks,
> John
>
>
>
> On Fri, Mar 10, 2017 at 7:32 AM, Roberto Garcia (INPE) via RT <
> met_help at ucar.edu> wrote:
>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=79724 >
>>
>> Hi John, my table_files directory actually is at
>> met-5.2/share/met/table_files and I don't know why.
>>
>> I've installed it by myself. I was thinking that I've done
something
>> wrong in the installation and installed again (MET and patch 2017)
and
>> this is the directory tree I've got (without tutorial):
>>
>> met-5.2$ find . -type d
>> ./bin
>> ./share
>> ./share/met
>> ./share/met/table_files
>> ./share/met/map
>> ./share/met/map/admin_by_country
>> ./share/met/config
>> ./share/met/ps
>> ./share/met/poly
>> ./share/met/poly/HMT_masks
>> ./share/met/tc_data
>> ./share/met/colortables
>> ./share/met/colortables/NCL_colortables
>>
>> The table files are there:
>>
>> $ ll ./share/met/table_files
>> -rw-r--r-- 1 roberto.garcia pesq_dop 12K Nov 4 13:41
grib1_af_131_57.txt
>> -rw-r--r-- 1 roberto.garcia pesq_dop 13K Nov 4 13:41
>> grib1_cptec_254_64.txt
>> -rw-r--r-- 1 roberto.garcia pesq_dop 12K Nov 4 13:41
grib1_dwd_2_78.txt
>> ...
>> -rw-r--r-- 1 roberto.garcia pesq_dop 15K Nov 4 13:41
>> grib1_ecmwf_128_98.txt
>> ...
>> -rw-r--r-- 1 roberto.garcia pesq_dop 49K Nov 4 13:41
grib1_ncep_2_7.txt
>> -rw-r--r-- 1 roberto.garcia pesq_dop 12K Nov 4 13:41
grib1_ncep_128_7.txt
>> ...
>> -rw-r--r-- 1 roberto.garcia pesq_dop 72K Nov 4 13:41
grib2_all.txt
>> ...
>>
>> And there is already an entry for CPTEC. I'll try to use that
method you
>> suggested to me.
>>
>> I'm doing something wrong in the instalation?
>>
>> Best regards.
>>
>> JR Garcia
>>
>> --
>> ==================================================
>> Jose Roberto Motta Garcia, PhD
>>
>> Divisão de Modelagem e Desenvolvimento (DMD)
>> www.cptec.inpe.br
>> www.inpe.br
>> Tel.: +55 (12) 3208-7966
>> --------------------------------------------------
>> ***** Save natural resources *****
>> ==================================================
>>
>> On 08/03/2017 20:57, John Halley Gotway via RT wrote:
>>> Hmm, I'm really not sure. When you download the met-5.2 tarball
from the
>>> website and unpack it, it certainly contains a data/table_files
>> directory.
>>> To me, the directories you've sent look like what you use for
running the
>>> MET online tutorial.
>>>
>>> Did you install MET yourself, or did a sysadmin install it? If it
was a
>>> sysadmin, that person would know where it is.
>>>
>>> John
>>>
>>>
>>> On Tue, Mar 7, 2017 at 6:05 AM, Roberto Garcia (INPE) via RT <
>>> met_help at ucar.edu> wrote:
>>>
>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=79724 >
>>>>
>>>> Hi John, and if there isn't a table_files directory?
>>>>
>>>> > ll met-5.2/data/
>>>> drwxr-xr-x 2 roberto.garcia pesq_dop 4,0K Ago 15 2016 config
>>>> drwxr-xr-x 3 roberto.garcia pesq_dop 4,0K Ago 15 2016 poly
>>>> drwxr-xr-x 7 roberto.garcia pesq_dop 0 Ago 15 2016
sample_fcst
>>>> drwxr-xr-x 7 roberto.garcia pesq_dop 0 Ago 15 2016 sample_obs
>>>> drwxr-xr-x 2 roberto.garcia pesq_dop 4,0K Ago 15 2016 tc_data
>>>> drwxr-xr-x 5 roberto.garcia pesq_dop 0 Set 7 20:55 tutorial
>>>>
>>>> Thanks
>>>>
>>>> JR Garcia
>>>>
>>>> --
>>>> ==================================================
>>>> Jose Roberto Motta Garcia, PhD
>>>>
>>>> Divisão de Modelagem e Desenvolvimento (DMD)
>>>> www.cptec.inpe.br
>>>> www.inpe.br
>>>> Tel.: +55 (12) 3208-7966
>>>> --------------------------------------------------
>>>> ***** Save natural resources *****
>>>> ==================================================
>>>>
>>>> On 06/03/2017 17:21, John Halley Gotway via RT wrote:
>>>>> JR Garcia,
>>>>>
>>>>> MET version 5.2 reads GRIB table information from static ascii
files
>>>> which
>>>>> are defined in the met-5.2/data/table_files directory.
>>>>>
>>>>> Following the existing naming convention in that directory,
you'd
>> create
>>>> a
>>>>> new file named:
>>>>>
>>>>> met-5.2/data/table_files/grib1_inpe_128_100.txt
>>>>>
>>>>> The number '7' is the center number for NCEP and your data is
using
>>>> center
>>>>> number 100. You could just copy over the NCEP usage and switch
all the
>>>> 7's
>>>>> to 100's:
>>>>>
>>>>> cat met-5.2/data/table_files/grib1_ncep_128_7.txt | sed
's/128 7
>>>> /128
>>>>> 100 /g' > met-5.2/data/table_files/grib1_inpe_128_100.txt
>>>>>
>>>>> Next, you should either re-run "make install" for met-5.2 or
manually
>>>> copy
>>>>> that file over into the *INSTALLED* met-
5.2/share/met/table_files
>>>>> directory. That's where the code actually reads these files at
>> runtime.
>>>>> Once you've tried this, try rerunning pcp_combine like this:
>>>>>
>>>>> pcp_combine -add file_in.grb 'name="APCP"; level="L0";'
>>>> file_out.nc
>>>>> If pcp_combine correctly matches APCP to your data, then your
change
>>>> worked.
>>>>> Also, be sure to save this GRIB1 table file somewhere else as
well. It
>>>>> won't be included in newer versions of MET and you'll need to
add it in
>>>>> before compiling a newer version.
>>>>>
>>>>> Please let me know how it goes.
>>>>>
>>>>> Thanks,
>>>>> John
>>>>>
>>>>>
>>>>> On Mon, Mar 6, 2017 at 12:48 PM, Roberto Garcia (INPE) via RT <
>>>>> met_help at ucar.edu> wrote:
>>>>>
>>>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=79724 >
>>>>>>
>>>>>> Dear John,
>>>>>>
>>>>>> Thanks a lot for your help.
>>>>>>
>>>>>> I'm not the owner/builder of the data I'm only in charge of
evaluating
>>>> the
>>>>>> model, so I think change the PTV would is not an option now.
>>>>>>
>>>>>> The output of wgrib -PDS10 file_in.grb is:
>>>>>>
>>>>>> ...
>>>>>> *12:33745404:d=16120113:var61:kpds5=61:kpds6=1:kpds7=0:TR=0:
>>>>>> P1=0:P2=0:TimeU=1:sfc:anl:NAve=0:PDS10=
>>>>>> 0 0 28 128 100 13 255 128 61 1 0 0 16 12 1 13 0 1 0 0 0 0 0 0
21 2 0
>> 0*
>>>>>> ...
>>>>>>
>>>>>> I didn't know about this wgrib option, I've noticed that our
data file
>>>> is
>>>>>> using a non-standard PTV number when I used
>>>>>>
>>>>>> ncl_filedump file_in.grb
>>>>>>
>>>>>> which reported
>>>>>>
>>>>>> *warning:NclGRIB: Unrecognized parameter table (center 100,
subcenter
>> 2,
>>>>>> table 128), defaulting to NCEP operational table: variable
names and
>>>>>> units may be incorrect*
>>>>>>
>>>>>> and
>>>>>>
>>>>>> *float A_PCP_GDS0_SFC ( g0_lat_1, g0_lon_2 )****sub_center :
>>>> 2****center :
>>>>>> Brazzaville****long_name : Total precipitation****units :
>>>>>> kg/m^2****_FillValue : 1e+20****level_indicator :
1****gds_grid_type :
>>>>>> 0****parameter_table_version : 128****parameter_number :
>>>>>> 61****forecast_time : 0****forecast_time_units :
>> hours****initial_time :
>>>>>> 12/01/2016 (13:00)***
>>>>>> for the grib code 61.
>>>>>>
>>>>>>
>>>>>> I used the work-around #2:
>>>>>>
>>>>>> bin/pcp_combine -add file_in.grb 'GRIB1_ptv=128; GRIB1_code=61;
>>>>>> level="L0";' file_out.nc
>>>>>>
>>>>>> and it worked! Now I'll move to the phase of adding those
files.
>>>>>>
>>>>>>
>>>>>> And if I were to use the work-around #1, considering the PTV
below:
>>>>>> -1:100:2:128
>>>>>> 1:VWSH:Vertical speed shear [1/s]
>>>>>> ...
>>>>>> 12:APCP:Total precipitation [kg/m^2]
>>>>>> ...
>>>>>>
>>>>>> In what aspects should I change it? Which entries should I add?
Does
>> it
>>>>>> seem ok to you? And how should I use it in pcp_combine?
>>>>>> I've built this file from an example but I'm not sure if it is
ok. I
>>>> took
>>>>>> the wgrib output as base to build it but some entries repeat
along few
>>>>>> lines, such as:
>>>>>>
>>>>>> 81:245421120:d=16120113:var52:kpds5=52:...
>>>>>> *82:248488884:d=16120113:NLWRT:kpds5=39:...****83:
>>>>>> 251556648:d=16120113:NLWRT:kpds5=39:...****84:254624412:
>>>>>> d=16120113:NLWRT:kpds5=39:...****85:257692176:d=16120113:
>>>>>> NLWRT:kpds5=39:...****86:260759940:d=16120113:NLWRT:
>>>>>> kpds5=39:...****87:263827704:d=16120113:NLWRT:kpds5=39:...*
>>>>>> ***88:266895468:d=16120113:NLWRT:kpds5=39:...****89:
>>>>>> 269963232:d=16120113:NLWRT:kpds5=39:...***90:273030996:d=
>>>>>> 16120113:var51:kpds5=51:...
>>>>>>
>>>>>> I guessed that, as the PTV has only the number, variable name,
and
>>>>>> comment, this should be summarized to:
>>>>>>
>>>>>> 81:var52:bla...bla...bla
>>>>>> 82:NLWRT:bla...bla...bla
>>>>>> 90:var51:bla...bla...bla
>>>>>>
>>>>>> I'm wrong?
>>>>>>
>>>>>>
>>>>>> Thanks a lot
>>>>>>
>>>>>> JR Garcia
>>>>>>
>>>>>> --
>>>>>> ==================================================
>>>>>> Jose Roberto Motta Garcia, PhD
>>>>>>
>>>>>> Divisão de Modelagem e Desenvolvimento (DMD)
>>>>>> www.cptec.inpe.br
>>>>>> www.inpe.br
>>>>>> Tel.: +55 (12) 3208-7966
>>>>>> --------------------------------------------------
>>>>>> ***** Save natural resources *****
>>>>>> ==================================================
>>>>>>
>>>>>> On 06/03/2017 15:04, John Halley Gotway via RT wrote:
>>>>>>> JR Garcia,
>>>>>>>
>>>>>>> I see you're having trouble running APCP GRIB data through
>> pcp_combine.
>>>>>>> Thanks for sending the output of wgrib.
>>>>>>>
>>>>>>> Looking carefully at that output I see this info "TR=0" and
"anl".
>>>> That
>>>>>>> indicates that this an instantaneous 0-hour "analysis"
forecast. So
>>>> the
>>>>>>> APCP variable in your data is not stored as an accumulation
interval
>>>>>> (i.e.
>>>>>>> TR=4) but instead is stored as an instantaneous forecast (i.e.
TR=0).
>>>>>>> Here's a table about those settings:
>>>>>>> http://www.nco.ncep.noaa.gov/pmb/docs/on388/table5.html
>>>>>>>
>>>>>>> And that's why pcp_combine isn't working. It's looking for a
1-hour
>>>>>>> accumulation of precip, but that's not present in your data.
>>>>>>>
>>>>>>> The GRIB code is stored as 61 (kpds5=61) which is usually for
APCP,
>> but
>>>>>>> wgrib doesn't correctly interpret that. So I'm guessing your
data
>> file
>>>>>> is
>>>>>>> using a non-standard parameter table version (PTV) number.
This is a
>>>>>> wild
>>>>>>> guess, but perhaps you're just writing the parameter table
version
>>>> number
>>>>>>> as 0.
>>>>>>>
>>>>>>> Try running this:
>>>>>>> wgrib -PDS10 file_in.grb
>>>>>>>
>>>>>>> The PTV is listed as the 4th entry in the PDS10 array and
here's more
>>>>>> info
>>>>>>> about that:
>>>>>>>
http://www.nco.ncep.noaa.gov/pmb/docs/on388/section1.html
>>>>>>>
>>>>>>> If you have PTV = 0 and can change that from your regional
model...
>> it
>>>>>>> should probably be 2 instead. Then wgrib and MET will be
happy.
>>>>>>>
>>>>>>> If you can't change it, then there are some work-arounds:
>>>>>>>
>>>>>>> (1) You could edit the GRIB tables used by MET to add new
entries for
>>>>>> your
>>>>>>> PTV. That would enable MET to correctly interpret the string
"APCP".
>>>>>>>
>>>>>>> (2) You could make a more explicit call to pcp_combine (but
>> substitute
>>>> in
>>>>>>> the actual PTV value from your GRIB file):
>>>>>>>
>>>>>>> bin/pcp_combine -add file_in.grb 'GRIB1_ptv=0;
GRIB1_code=61;
>>>>>>> level="L0";' file_out.nc
>>>>>>>
>>>>>>> Hope that helps. Just let me know what other questions you
have.
>>>>>>>
>>>>>>> Thanks,
>>>>>>> John Halley Gotway
>>>>>>>
>>>>>>>
>>>>>>> On Mon, Mar 6, 2017 at 7:19 AM, Roberto Garcia (INPE) via RT <
>>>>>>> met_help at ucar.edu> wrote:
>>>>>>>
>>>>>>>> Mon Mar 06 07:19:32 2017: Request 79724 was acted upon.
>>>>>>>> Transaction: Ticket created by roberto.garcia at inpe.br
>>>>>>>> Queue: met_help
>>>>>>>> Subject: pcp_combine
>>>>>>>> Owner: Nobody
>>>>>>>> Requestors: roberto.garcia at inpe.br
>>>>>>>> Status: new
>>>>>>>> Ticket <URL: https://rt.rap.ucar.edu/rt/
>>>> Ticket/Display.html?id=79724
>>>>>>>> Dear MET Help staff.
>>>>>>>>
>>>>>>>> My goal is to use pcp_combine in order to accumulate some 1-
hr
>>>>>>>> accumulated rainfall from our regional model but for
simplicity I'm
>>>> just
>>>>>>>> converting a Grib file to NetCDF, so I used:
>>>>>>>>
>>>>>>>> bin/pcp_combine -add file_in.grb 01 file_out.nc
>>>>>>>>
>>>>>>>> DEBUG 1: Reading input file: file_in.grb
>>>>>>>> WARNING:
>>>>>>>> WARNING: MetGrib1DataFile::data_plane() -> No exact match
found for
>>>>>>>> VarInfo "APCP/A01" in GRIB file "file_in.grb".
>>>>>>>> WARNING:
>>>>>>>> ERROR :
>>>>>>>> ERROR : get_field() -> can't get data plane from file
"file_in.grb"
>>>>>>>> ERROR :
>>>>>>>>
>>>>>>>>
>>>>>>>> It is Ok, since APCP does not exist, as shown by wgrib:
>>>>>>>>
>>>>>>>> wgrib file_in.grb
>>>>>>>>
>>>>>>>> ...
>>>>>>>>
>>>>>>>> 12:33745404:d=16120113:*var61*:kpds5=61:kpds6=1:kpds7=0:TR=
>>>>>>>> 0:P1=0:P2=0:TimeU=1:sfc:anl:NAve=0
>>>>>>>> ...
>>>>>>>>
>>>>>>>>
>>>>>>>> The actual variable name I'm interested in is "var61". But,
when I
>>>>>>>> specify it on the pcp_combine command....
>>>>>>>>
>>>>>>>> bin/pcp_combine -add file_in.grb 01 file_out.nc*-field var61*
>>>>>>>> DEBUG 1: Reading input file: file_in.grb
>>>>>>>> ERROR :
>>>>>>>> ERROR : yyerror() -> syntax error in file
"config_29125_0_.temp"
>>>>>>>> ERROR :
>>>>>>>> ERROR : line = 2
>>>>>>>> ERROR :
>>>>>>>> ERROR : column = 1
>>>>>>>> ERROR :
>>>>>>>> ERROR : text = "(nul)"
>>>>>>>> ERROR :
>>>>>>>> ERROR :
>>>>>>>> ERROR : (nul)
>>>>>>>> ERROR : (nul)
>>>>>>>>
>>>>>>>> Could someone please help me?
>>>>>>>>
>>>>>>>> Thanks a lot.
>>>>>>>>
>>>>>>>>
>>>>>>>> JR Garcia
>>>>>>>>
>>>>>>>> --
>>>>>>>> ==================================================
>>>>>>>> Jose Roberto Motta Garcia, PhD
>>>>>>>>
>>>>>>>> Divisão de Modelagem e Desenvolvimento (DMD)
>>>>>>>> www.cptec.inpe.br
>>>>>>>> www.inpe.br
>>>>>>>> Tel.: +55 (12) 3208-7966
>>>>>>>> --------------------------------------------------
>>>>>>>> ***** Save natural resources *****
>>>>>>>> ==================================================
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>
>>
>>
------------------------------------------------
Subject: pcp_combine
From: John Halley Gotway
Time: Fri Mar 10 14:10:59 2017
Great, thanks for following up to let me know.
I'll go ahead and resolve this ticket now.
John
On Fri, Mar 10, 2017 at 1:37 PM, Roberto Garcia (INPE) via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=79724 >
>
> Both methods worked.
>
> Many thanks John.
>
> Best regards,
>
>
> JR Garcia
>
> --
> ==================================================
> Jose Roberto Motta Garcia, PhD
>
> Divisão de Modelagem e Desenvolvimento (DMD)
> www.cptec.inpe.br
> www.inpe.br
> Tel.: +55 (12) 3208-7966
> --------------------------------------------------
> ***** Save natural resources *****
> ==================================================
>
> On 10/03/2017 17:01, John Halley Gotway via RT wrote:
> > Roberto,
> >
> > The MET tools need some static data files at runtime (including
the GRIB
> > table files that we're discussing).
> >
> > When you unpack the met-5.2 tarball, that data lives in the
> "met-5.2/data"
> > directory.
> > When you run the configure command, you specify where you'd like
to
> install
> > MET using the "--prefix" option.
> > When you run "make install", it copies that static data for
runtime from
> > "met-5.2/data" to "INSTALL_PREFIX/share/met", where INSTALL_PREFIX
is the
> > --prefix path.
> > When you run the MET tools, they read the static data from
> > "INSTALL_PREFIX/share/met".
> >
> > Placing static runtime data in a "share" directory is the standard
method
> > used by autoconf.
> >
> > Hopefully that helps clarify.
> >
> > Thanks,
> > John
> >
> >
> >
> > On Fri, Mar 10, 2017 at 7:32 AM, Roberto Garcia (INPE) via RT <
> > met_help at ucar.edu> wrote:
> >
> >> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=79724 >
> >>
> >> Hi John, my table_files directory actually is at
> >> met-5.2/share/met/table_files and I don't know why.
> >>
> >> I've installed it by myself. I was thinking that I've done
something
> >> wrong in the installation and installed again (MET and patch
2017) and
> >> this is the directory tree I've got (without tutorial):
> >>
> >> met-5.2$ find . -type d
> >> ./bin
> >> ./share
> >> ./share/met
> >> ./share/met/table_files
> >> ./share/met/map
> >> ./share/met/map/admin_by_country
> >> ./share/met/config
> >> ./share/met/ps
> >> ./share/met/poly
> >> ./share/met/poly/HMT_masks
> >> ./share/met/tc_data
> >> ./share/met/colortables
> >> ./share/met/colortables/NCL_colortables
> >>
> >> The table files are there:
> >>
> >> $ ll ./share/met/table_files
> >> -rw-r--r-- 1 roberto.garcia pesq_dop 12K Nov 4 13:41
> grib1_af_131_57.txt
> >> -rw-r--r-- 1 roberto.garcia pesq_dop 13K Nov 4 13:41
> >> grib1_cptec_254_64.txt
> >> -rw-r--r-- 1 roberto.garcia pesq_dop 12K Nov 4 13:41
> grib1_dwd_2_78.txt
> >> ...
> >> -rw-r--r-- 1 roberto.garcia pesq_dop 15K Nov 4 13:41
> >> grib1_ecmwf_128_98.txt
> >> ...
> >> -rw-r--r-- 1 roberto.garcia pesq_dop 49K Nov 4 13:41
> grib1_ncep_2_7.txt
> >> -rw-r--r-- 1 roberto.garcia pesq_dop 12K Nov 4 13:41
> grib1_ncep_128_7.txt
> >> ...
> >> -rw-r--r-- 1 roberto.garcia pesq_dop 72K Nov 4 13:41
grib2_all.txt
> >> ...
> >>
> >> And there is already an entry for CPTEC. I'll try to use that
method you
> >> suggested to me.
> >>
> >> I'm doing something wrong in the instalation?
> >>
> >> Best regards.
> >>
> >> JR Garcia
> >>
> >> --
> >> ==================================================
> >> Jose Roberto Motta Garcia, PhD
> >>
> >> Divisão de Modelagem e Desenvolvimento (DMD)
> >> www.cptec.inpe.br
> >> www.inpe.br
> >> Tel.: +55 (12) 3208-7966
> >> --------------------------------------------------
> >> ***** Save natural resources *****
> >> ==================================================
> >>
> >> On 08/03/2017 20:57, John Halley Gotway via RT wrote:
> >>> Hmm, I'm really not sure. When you download the met-5.2 tarball
from
> the
> >>> website and unpack it, it certainly contains a data/table_files
> >> directory.
> >>> To me, the directories you've sent look like what you use for
running
> the
> >>> MET online tutorial.
> >>>
> >>> Did you install MET yourself, or did a sysadmin install it? If
it was
> a
> >>> sysadmin, that person would know where it is.
> >>>
> >>> John
> >>>
> >>>
> >>> On Tue, Mar 7, 2017 at 6:05 AM, Roberto Garcia (INPE) via RT <
> >>> met_help at ucar.edu> wrote:
> >>>
> >>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=79724 >
> >>>>
> >>>> Hi John, and if there isn't a table_files directory?
> >>>>
> >>>> > ll met-5.2/data/
> >>>> drwxr-xr-x 2 roberto.garcia pesq_dop 4,0K Ago 15 2016 config
> >>>> drwxr-xr-x 3 roberto.garcia pesq_dop 4,0K Ago 15 2016 poly
> >>>> drwxr-xr-x 7 roberto.garcia pesq_dop 0 Ago 15 2016
sample_fcst
> >>>> drwxr-xr-x 7 roberto.garcia pesq_dop 0 Ago 15 2016
sample_obs
> >>>> drwxr-xr-x 2 roberto.garcia pesq_dop 4,0K Ago 15 2016 tc_data
> >>>> drwxr-xr-x 5 roberto.garcia pesq_dop 0 Set 7 20:55 tutorial
> >>>>
> >>>> Thanks
> >>>>
> >>>> JR Garcia
> >>>>
> >>>> --
> >>>> ==================================================
> >>>> Jose Roberto Motta Garcia, PhD
> >>>>
> >>>> Divisão de Modelagem e Desenvolvimento (DMD)
> >>>> www.cptec.inpe.br
> >>>> www.inpe.br
> >>>> Tel.: +55 (12) 3208-7966
> >>>> --------------------------------------------------
> >>>> ***** Save natural resources *****
> >>>> ==================================================
> >>>>
> >>>> On 06/03/2017 17:21, John Halley Gotway via RT wrote:
> >>>>> JR Garcia,
> >>>>>
> >>>>> MET version 5.2 reads GRIB table information from static ascii
files
> >>>> which
> >>>>> are defined in the met-5.2/data/table_files directory.
> >>>>>
> >>>>> Following the existing naming convention in that directory,
you'd
> >> create
> >>>> a
> >>>>> new file named:
> >>>>>
> >>>>> met-5.2/data/table_files/grib1_inpe_128_100.txt
> >>>>>
> >>>>> The number '7' is the center number for NCEP and your data is
using
> >>>> center
> >>>>> number 100. You could just copy over the NCEP usage and
switch all
> the
> >>>> 7's
> >>>>> to 100's:
> >>>>>
> >>>>> cat met-5.2/data/table_files/grib1_ncep_128_7.txt | sed
> 's/128 7
> >>>> /128
> >>>>> 100 /g' > met-5.2/data/table_files/grib1_inpe_128_100.txt
> >>>>>
> >>>>> Next, you should either re-run "make install" for met-5.2 or
manually
> >>>> copy
> >>>>> that file over into the *INSTALLED* met-
5.2/share/met/table_files
> >>>>> directory. That's where the code actually reads these files
at
> >> runtime.
> >>>>> Once you've tried this, try rerunning pcp_combine like this:
> >>>>>
> >>>>> pcp_combine -add file_in.grb 'name="APCP";
level="L0";'
> >>>> file_out.nc
> >>>>> If pcp_combine correctly matches APCP to your data, then your
change
> >>>> worked.
> >>>>> Also, be sure to save this GRIB1 table file somewhere else as
well.
> It
> >>>>> won't be included in newer versions of MET and you'll need to
add it
> in
> >>>>> before compiling a newer version.
> >>>>>
> >>>>> Please let me know how it goes.
> >>>>>
> >>>>> Thanks,
> >>>>> John
> >>>>>
> >>>>>
> >>>>> On Mon, Mar 6, 2017 at 12:48 PM, Roberto Garcia (INPE) via RT
<
> >>>>> met_help at ucar.edu> wrote:
> >>>>>
> >>>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=79724
>
> >>>>>>
> >>>>>> Dear John,
> >>>>>>
> >>>>>> Thanks a lot for your help.
> >>>>>>
> >>>>>> I'm not the owner/builder of the data I'm only in charge of
> evaluating
> >>>> the
> >>>>>> model, so I think change the PTV would is not an option now.
> >>>>>>
> >>>>>> The output of wgrib -PDS10 file_in.grb is:
> >>>>>>
> >>>>>> ...
> >>>>>> *12:33745404:d=16120113:var61:kpds5=61:kpds6=1:kpds7=0:TR=0:
> >>>>>> P1=0:P2=0:TimeU=1:sfc:anl:NAve=0:PDS10=
> >>>>>> 0 0 28 128 100 13 255 128 61 1 0 0 16 12 1 13 0 1 0 0 0 0 0 0
21 2 0
> >> 0*
> >>>>>> ...
> >>>>>>
> >>>>>> I didn't know about this wgrib option, I've noticed that our
data
> file
> >>>> is
> >>>>>> using a non-standard PTV number when I used
> >>>>>>
> >>>>>> ncl_filedump file_in.grb
> >>>>>>
> >>>>>> which reported
> >>>>>>
> >>>>>> *warning:NclGRIB: Unrecognized parameter table (center 100,
> subcenter
> >> 2,
> >>>>>> table 128), defaulting to NCEP operational table: variable
names and
> >>>>>> units may be incorrect*
> >>>>>>
> >>>>>> and
> >>>>>>
> >>>>>> *float A_PCP_GDS0_SFC ( g0_lat_1, g0_lon_2 )****sub_center :
> >>>> 2****center :
> >>>>>> Brazzaville****long_name : Total precipitation****units :
> >>>>>> kg/m^2****_FillValue : 1e+20****level_indicator :
> 1****gds_grid_type :
> >>>>>> 0****parameter_table_version : 128****parameter_number :
> >>>>>> 61****forecast_time : 0****forecast_time_units :
> >> hours****initial_time :
> >>>>>> 12/01/2016 (13:00)***
> >>>>>> for the grib code 61.
> >>>>>>
> >>>>>>
> >>>>>> I used the work-around #2:
> >>>>>>
> >>>>>> bin/pcp_combine -add file_in.grb 'GRIB1_ptv=128;
GRIB1_code=61;
> >>>>>> level="L0";' file_out.nc
> >>>>>>
> >>>>>> and it worked! Now I'll move to the phase of adding those
files.
> >>>>>>
> >>>>>>
> >>>>>> And if I were to use the work-around #1, considering the PTV
below:
> >>>>>> -1:100:2:128
> >>>>>> 1:VWSH:Vertical speed shear [1/s]
> >>>>>> ...
> >>>>>> 12:APCP:Total precipitation [kg/m^2]
> >>>>>> ...
> >>>>>>
> >>>>>> In what aspects should I change it? Which entries should I
add? Does
> >> it
> >>>>>> seem ok to you? And how should I use it in pcp_combine?
> >>>>>> I've built this file from an example but I'm not sure if it
is ok. I
> >>>> took
> >>>>>> the wgrib output as base to build it but some entries repeat
along
> few
> >>>>>> lines, such as:
> >>>>>>
> >>>>>> 81:245421120:d=16120113:var52:kpds5=52:...
> >>>>>> *82:248488884:d=16120113:NLWRT:kpds5=39:...****83:
> >>>>>> 251556648:d=16120113:NLWRT:kpds5=39:...****84:254624412:
> >>>>>> d=16120113:NLWRT:kpds5=39:...****85:257692176:d=16120113:
> >>>>>> NLWRT:kpds5=39:...****86:260759940:d=16120113:NLWRT:
> >>>>>> kpds5=39:...****87:263827704:d=16120113:NLWRT:kpds5=39:...*
> >>>>>> ***88:266895468:d=16120113:NLWRT:kpds5=39:...****89:
> >>>>>> 269963232:d=16120113:NLWRT:kpds5=39:...***90:273030996:d=
> >>>>>> 16120113:var51:kpds5=51:...
> >>>>>>
> >>>>>> I guessed that, as the PTV has only the number, variable
name, and
> >>>>>> comment, this should be summarized to:
> >>>>>>
> >>>>>> 81:var52:bla...bla...bla
> >>>>>> 82:NLWRT:bla...bla...bla
> >>>>>> 90:var51:bla...bla...bla
> >>>>>>
> >>>>>> I'm wrong?
> >>>>>>
> >>>>>>
> >>>>>> Thanks a lot
> >>>>>>
> >>>>>> JR Garcia
> >>>>>>
> >>>>>> --
> >>>>>> ==================================================
> >>>>>> Jose Roberto Motta Garcia, PhD
> >>>>>>
> >>>>>> Divisão de Modelagem e Desenvolvimento (DMD)
> >>>>>> www.cptec.inpe.br
> >>>>>> www.inpe.br
> >>>>>> Tel.: +55 (12) 3208-7966
> >>>>>> --------------------------------------------------
> >>>>>> ***** Save natural resources *****
> >>>>>> ==================================================
> >>>>>>
> >>>>>> On 06/03/2017 15:04, John Halley Gotway via RT wrote:
> >>>>>>> JR Garcia,
> >>>>>>>
> >>>>>>> I see you're having trouble running APCP GRIB data through
> >> pcp_combine.
> >>>>>>> Thanks for sending the output of wgrib.
> >>>>>>>
> >>>>>>> Looking carefully at that output I see this info "TR=0" and
"anl".
> >>>> That
> >>>>>>> indicates that this an instantaneous 0-hour "analysis"
forecast.
> So
> >>>> the
> >>>>>>> APCP variable in your data is not stored as an accumulation
> interval
> >>>>>> (i.e.
> >>>>>>> TR=4) but instead is stored as an instantaneous forecast
(i.e.
> TR=0).
> >>>>>>> Here's a table about those settings:
> >>>>>>>
http://www.nco.ncep.noaa.gov/pmb/docs/on388/table5.html
> >>>>>>>
> >>>>>>> And that's why pcp_combine isn't working. It's looking for
a
> 1-hour
> >>>>>>> accumulation of precip, but that's not present in your data.
> >>>>>>>
> >>>>>>> The GRIB code is stored as 61 (kpds5=61) which is usually
for APCP,
> >> but
> >>>>>>> wgrib doesn't correctly interpret that. So I'm guessing
your data
> >> file
> >>>>>> is
> >>>>>>> using a non-standard parameter table version (PTV) number.
This
> is a
> >>>>>> wild
> >>>>>>> guess, but perhaps you're just writing the parameter table
version
> >>>> number
> >>>>>>> as 0.
> >>>>>>>
> >>>>>>> Try running this:
> >>>>>>> wgrib -PDS10 file_in.grb
> >>>>>>>
> >>>>>>> The PTV is listed as the 4th entry in the PDS10 array and
here's
> more
> >>>>>> info
> >>>>>>> about that:
> >>>>>>>
http://www.nco.ncep.noaa.gov/pmb/docs/on388/section1.html
> >>>>>>>
> >>>>>>> If you have PTV = 0 and can change that from your regional
model...
> >> it
> >>>>>>> should probably be 2 instead. Then wgrib and MET will be
happy.
> >>>>>>>
> >>>>>>> If you can't change it, then there are some work-arounds:
> >>>>>>>
> >>>>>>> (1) You could edit the GRIB tables used by MET to add new
entries
> for
> >>>>>> your
> >>>>>>> PTV. That would enable MET to correctly interpret the
string
> "APCP".
> >>>>>>>
> >>>>>>> (2) You could make a more explicit call to pcp_combine (but
> >> substitute
> >>>> in
> >>>>>>> the actual PTV value from your GRIB file):
> >>>>>>>
> >>>>>>> bin/pcp_combine -add file_in.grb 'GRIB1_ptv=0;
> GRIB1_code=61;
> >>>>>>> level="L0";' file_out.nc
> >>>>>>>
> >>>>>>> Hope that helps. Just let me know what other questions you
have.
> >>>>>>>
> >>>>>>> Thanks,
> >>>>>>> John Halley Gotway
> >>>>>>>
> >>>>>>>
> >>>>>>> On Mon, Mar 6, 2017 at 7:19 AM, Roberto Garcia (INPE) via RT
<
> >>>>>>> met_help at ucar.edu> wrote:
> >>>>>>>
> >>>>>>>> Mon Mar 06 07:19:32 2017: Request 79724 was acted upon.
> >>>>>>>> Transaction: Ticket created by roberto.garcia at inpe.br
> >>>>>>>> Queue: met_help
> >>>>>>>> Subject: pcp_combine
> >>>>>>>> Owner: Nobody
> >>>>>>>> Requestors: roberto.garcia at inpe.br
> >>>>>>>> Status: new
> >>>>>>>> Ticket <URL: https://rt.rap.ucar.edu/rt/
> >>>> Ticket/Display.html?id=79724
> >>>>>>>> Dear MET Help staff.
> >>>>>>>>
> >>>>>>>> My goal is to use pcp_combine in order to accumulate some
1-hr
> >>>>>>>> accumulated rainfall from our regional model but for
simplicity
> I'm
> >>>> just
> >>>>>>>> converting a Grib file to NetCDF, so I used:
> >>>>>>>>
> >>>>>>>> bin/pcp_combine -add file_in.grb 01 file_out.nc
> >>>>>>>>
> >>>>>>>> DEBUG 1: Reading input file: file_in.grb
> >>>>>>>> WARNING:
> >>>>>>>> WARNING: MetGrib1DataFile::data_plane() -> No exact match
found
> for
> >>>>>>>> VarInfo "APCP/A01" in GRIB file "file_in.grb".
> >>>>>>>> WARNING:
> >>>>>>>> ERROR :
> >>>>>>>> ERROR : get_field() -> can't get data plane from file
> "file_in.grb"
> >>>>>>>> ERROR :
> >>>>>>>>
> >>>>>>>>
> >>>>>>>> It is Ok, since APCP does not exist, as shown by wgrib:
> >>>>>>>>
> >>>>>>>> wgrib file_in.grb
> >>>>>>>>
> >>>>>>>> ...
> >>>>>>>>
> >>>>>>>> 12:33745404:d=16120113:*var61*:kpds5=61:kpds6=1:kpds7=0:TR=
> >>>>>>>> 0:P1=0:P2=0:TimeU=1:sfc:anl:NAve=0
> >>>>>>>> ...
> >>>>>>>>
> >>>>>>>>
> >>>>>>>> The actual variable name I'm interested in is "var61". But,
when I
> >>>>>>>> specify it on the pcp_combine command....
> >>>>>>>>
> >>>>>>>> bin/pcp_combine -add file_in.grb 01 file_out.nc*-field
var61*
> >>>>>>>> DEBUG 1: Reading input file: file_in.grb
> >>>>>>>> ERROR :
> >>>>>>>> ERROR : yyerror() -> syntax error in file
"config_29125_0_.temp"
> >>>>>>>> ERROR :
> >>>>>>>> ERROR : line = 2
> >>>>>>>> ERROR :
> >>>>>>>> ERROR : column = 1
> >>>>>>>> ERROR :
> >>>>>>>> ERROR : text = "(nul)"
> >>>>>>>> ERROR :
> >>>>>>>> ERROR :
> >>>>>>>> ERROR : (nul)
> >>>>>>>> ERROR : (nul)
> >>>>>>>>
> >>>>>>>> Could someone please help me?
> >>>>>>>>
> >>>>>>>> Thanks a lot.
> >>>>>>>>
> >>>>>>>>
> >>>>>>>> JR Garcia
> >>>>>>>>
> >>>>>>>> --
> >>>>>>>> ==================================================
> >>>>>>>> Jose Roberto Motta Garcia, PhD
> >>>>>>>>
> >>>>>>>> Divisão de Modelagem e Desenvolvimento (DMD)
> >>>>>>>> www.cptec.inpe.br
> >>>>>>>> www.inpe.br
> >>>>>>>> Tel.: +55 (12) 3208-7966
> >>>>>>>> --------------------------------------------------
> >>>>>>>> ***** Save natural resources *****
> >>>>>>>> ==================================================
> >>>>>>>>
> >>>>>>>>
> >>>>>>>>
> >>>>
> >>
> >>
>
>
>
------------------------------------------------
More information about the Met_help
mailing list