[Met_help] [rt.rap.ucar.edu #80978] History for Error with pcp_combine for GRIB2 files
John Halley Gotway via RT
met_help at ucar.edu
Fri Jun 23 13:46:13 MDT 2017
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Hi,
I am trying to combine hourly WRF output files which have been converted to
GRIB2 format using UPP.
In the MET online tutorial, it is written "By default, PCP-Combine searches
for records containing GRIB code 61 (accumulated precipitation). Use
the *-config
config_str* option to override this default and process other fields." So I
wanted to change the default for 325 APCP. But the direction in the
tutorial is not clear to me.
Do I need to change configure file? (Then, which config file should I
change?)
Or can I do this in command line?
When I tried as below, I got error messages.
> -sum 00000000_000000 1 20050101_000000 24 \
>
/scratch/halstead/y/yoo108/wrfAnalysis/METanal/pcp_combine/sample_wrf_2005010100V_24A.nc
\
> -pcpdir /scratch/halstead/k/khoogewi/CCRC_wrf/grib2/2005/200501 \
> -field APCP \
> -config 325
ERROR :
ERROR : yyerror() -> syntax error in file "/tmp/config_4646_0_.temp"
ERROR :
ERROR : line = 1
ERROR :
ERROR : column = 1
ERROR :
ERROR : text = "325"
ERROR :
ERROR :
ERROR : 325
ERROR : ^^^
ERROR :
Can you help?
Thank you.
Regards,
Jinwoong Yoo
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: Error with pcp_combine for GRIB2 files
From: Jinwoong Yoo
Time: Wed Jun 21 16:35:37 2017
Hi,
When I didn't specify -field and -config and ran the command:
yoo108 at halstead-fe03:
*/scratch/halstead/y/yoo108/wrfAnalysis/METanal/pcp_combine* $
/home/yoo108/met-6.0_bugfix/bin/pcp_combine -sum 00000000_000000 1
20050101_000000 24
/scratch/halstead/y/yoo108/wrfAnalysis/METanal/pcp_combine/sample_wrf_2005010100V_24A.nc
-pcpdir /scratch/halstead/k/khoogewi/CCRC_wrf/grib2/2005/200501
I got this error below:
DEBUG 1: [1] File
/scratch/halstead/k/khoogewi/CCRC_wrf/grib2/2005/200501/CESM_WRF_d03_4km_200501010000.grb2
matches valid time of 20050101_000000
ERROR :
ERROR : sum_data_files() -> Cannot find a file with a valid time of
20041231_230000 and accumulation time of 010000 matching the regular
expression ".*"
ERROR :
I don't know why it tries to find 20041231_230000 file?
Do I need to use regular expression with it?
Thank you.
Regards,
Jinwoong
On Wed, Jun 21, 2017 at 6:18 PM, met_help at ucar.edu via RT
<met_help at ucar.edu
> wrote:
> NOTE: THE MET TEAM HAS LIMITED AVAILABILITY BETWEEN 5/23/17 AND
5/30/17.
> RESPONSES MAY BE DELAYED.
>
> Greetings,
>
> This message has been automatically generated in response to the
> creation of a trouble ticket regarding:
> "Error with pcp_combine for GRIB2 files",
> a summary of which appears below.
>
> There is no need to reply to this message right now. Your ticket
has been
> assigned an ID of [rt.rap.ucar.edu #80978].
>
> Please include the string:
>
> [rt.rap.ucar.edu #80978]
>
> in the subject line of all future correspondence about this issue.
To do
> so,
> you may reply to this message.
>
> Thank you,
> met_help at ucar.edu
>
>
-------------------------------------------------------------------------
> Hi,
> I am trying to combine hourly WRF output files which have been
converted to
> GRIB2 format using UPP.
>
>
> In the MET online tutorial, it is written "By default, PCP-Combine
searches
> for records containing GRIB code 61 (accumulated precipitation). Use
> the *-config
> config_str* option to override this default and process other
fields." So I
> wanted to change the default for 325 APCP. But the direction in the
> tutorial is not clear to me.
>
> Do I need to change configure file? (Then, which config file should
I
> change?)
> Or can I do this in command line?
>
> When I tried as below, I got error messages.
>
> > -sum 00000000_000000 1 20050101_000000 24 \
>
> >
>
/scratch/halstead/y/yoo108/wrfAnalysis/METanal/pcp_combine/sample_wrf_
> 2005010100V_24A.nc
> \
>
> > -pcpdir /scratch/halstead/k/khoogewi/CCRC_wrf/grib2/2005/200501 \
>
> > -field APCP \
>
> > -config 325
>
> ERROR :
>
> ERROR : yyerror() -> syntax error in file
"/tmp/config_4646_0_.temp"
>
> ERROR :
>
> ERROR : line = 1
>
> ERROR :
>
> ERROR : column = 1
>
> ERROR :
>
> ERROR : text = "325"
>
> ERROR :
>
> ERROR :
>
> ERROR : 325
>
> ERROR : ^^^
>
> ERROR :
>
>
>
>
> Can you help?
> Thank you.
>
> Regards,
>
> Jinwoong Yoo
>
>
------------------------------------------------
Subject: Error with pcp_combine for GRIB2 files
From: John Halley Gotway
Time: Wed Jun 21 17:10:51 2017
Jinwoong,
I see that you've having trouble getting pcp_combine to sum up the
data in
the way you'd like.
I think you're very close, but unfortunately, I don't understand what
you
mean by 325. Is the record number that you'd like to extract from the
GRIB2 file? Usually, its better to refer to the name of the variable
and
have MET find it for you rather then specifying an explicit record
number.
Let me show you an example for 2m temperature using sample data that's
included in the MET tarball. Of course it doesn't make any sense to
sum up
2m temperature values! But I'm just showing you as an example.
Hopefully,
you can adapt the example to do what you're trying to do:
cd met-6.0/data/sample_fcst/2005080700
../../../bin/pcp_combine -sum 00000000_000000 3 20050807_120000 12
sum.nc
-pcpdir . \
-field 'name="TMP"; level="Z2";'
DEBUG 1: [1] File ./wrfprs_ruc13_12.tm00_G212 matches valid time of
20050807_120000
DEBUG 1: [2] File ./wrfprs_ruc13_09.tm00_G212 matches valid time of
20050807_090000
DEBUG 1: [3] File ./wrfprs_ruc13_06.tm00_G212 matches valid time of
20050807_060000
DEBUG 1: [4] File ./wrfprs_ruc13_03.tm00_G212 matches valid time of
20050807_030000
DEBUG 1: [1] Reading input file: ./wrfprs_ruc13_12.tm00_G212
DEBUG 1: [2] Reading input file: ./wrfprs_ruc13_09.tm00_G212
DEBUG 1: [3] Reading input file: ./wrfprs_ruc13_06.tm00_G212
DEBUG 1: [4] Reading input file: ./wrfprs_ruc13_03.tm00_G212
DEBUG 1: Writing output file: sum.nc
The key here is that I set: -field 'name="TMP"; level="Z2";'
The name and level strings are used to search the GRIB records in each
file
looking for a match.
Hopefully that helps.
Thanks,
John
On Wed, Jun 21, 2017 at 4:35 PM, Jinwoong Yoo via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80978 >
>
> Hi,
>
> When I didn't specify -field and -config and ran the command:
>
> yoo108 at halstead-fe03:
> */scratch/halstead/y/yoo108/wrfAnalysis/METanal/pcp_combine* $
> /home/yoo108/met-6.0_bugfix/bin/pcp_combine -sum 00000000_000000 1
> 20050101_000000 24
>
/scratch/halstead/y/yoo108/wrfAnalysis/METanal/pcp_combine/sample_wrf_
> 2005010100V_24A.nc
> -pcpdir /scratch/halstead/k/khoogewi/CCRC_wrf/grib2/2005/200501
>
>
>
> I got this error below:
>
> DEBUG 1: [1] File
> /scratch/halstead/k/khoogewi/CCRC_wrf/grib2/2005/200501/
> CESM_WRF_d03_4km_200501010000.grb2
> matches valid time of 20050101_000000
>
> ERROR :
>
> ERROR : sum_data_files() -> Cannot find a file with a valid time of
> 20041231_230000 and accumulation time of 010000 matching the regular
> expression ".*"
>
> ERROR :
>
>
> I don't know why it tries to find 20041231_230000 file?
> Do I need to use regular expression with it?
>
> Thank you.
> Regards,
>
> Jinwoong
>
> On Wed, Jun 21, 2017 at 6:18 PM, met_help at ucar.edu via RT <
> met_help at ucar.edu
> > wrote:
>
> > NOTE: THE MET TEAM HAS LIMITED AVAILABILITY BETWEEN 5/23/17 AND
5/30/17.
> > RESPONSES MAY BE DELAYED.
> >
> > Greetings,
> >
> > This message has been automatically generated in response to the
> > creation of a trouble ticket regarding:
> > "Error with pcp_combine for GRIB2 files",
> > a summary of which appears below.
> >
> > There is no need to reply to this message right now. Your ticket
has
> been
> > assigned an ID of [rt.rap.ucar.edu #80978].
> >
> > Please include the string:
> >
> > [rt.rap.ucar.edu #80978]
> >
> > in the subject line of all future correspondence about this issue.
To do
> > so,
> > you may reply to this message.
> >
> > Thank you,
> > met_help at ucar.edu
> >
> > ------------------------------------------------------------
> -------------
> > Hi,
> > I am trying to combine hourly WRF output files which have been
converted
> to
> > GRIB2 format using UPP.
> >
> >
> > In the MET online tutorial, it is written "By default, PCP-Combine
> searches
> > for records containing GRIB code 61 (accumulated precipitation).
Use
> > the *-config
> > config_str* option to override this default and process other
fields."
> So I
> > wanted to change the default for 325 APCP. But the direction in
the
> > tutorial is not clear to me.
> >
> > Do I need to change configure file? (Then, which config file
should I
> > change?)
> > Or can I do this in command line?
> >
> > When I tried as below, I got error messages.
> >
> > > -sum 00000000_000000 1 20050101_000000 24 \
> >
> > >
> >
/scratch/halstead/y/yoo108/wrfAnalysis/METanal/pcp_combine/sample_wrf_
> > 2005010100V_24A.nc
> > \
> >
> > > -pcpdir /scratch/halstead/k/khoogewi/CCRC_wrf/grib2/2005/200501
\
> >
> > > -field APCP \
> >
> > > -config 325
> >
> > ERROR :
> >
> > ERROR : yyerror() -> syntax error in file
"/tmp/config_4646_0_.temp"
> >
> > ERROR :
> >
> > ERROR : line = 1
> >
> > ERROR :
> >
> > ERROR : column = 1
> >
> > ERROR :
> >
> > ERROR : text = "325"
> >
> > ERROR :
> >
> > ERROR :
> >
> > ERROR : 325
> >
> > ERROR : ^^^
> >
> > ERROR :
> >
> >
> >
> >
> > Can you help?
> > Thank you.
> >
> > Regards,
> >
> > Jinwoong Yoo
> >
> >
>
>
------------------------------------------------
Subject: Error with pcp_combine for GRIB2 files
From: Jinwoong Yoo
Time: Wed Jun 21 18:44:09 2017
Hi John,
Thank you for your quick reply.
In my WRF grib2 files, I have two APCP variables as shown below:
324:14427217:d=2004121700:APCP Total Precipitation [kg/m^2]:surface:0-
1103
hour acc fcst:
325:14479093:d=2004121700:APCP Total Precipitation
[kg/m^2]:surface:1102-1103 hour acc fcst:
In my case, I would like to use values in "325" line which is APCP for
one
hour accumulation not the total accumulation from the initialization
of the
simulation to the forecast time which is "324".
Anyway,
when I modified my command line with "-field 'name="APCP";level="Z0";'
I still got the error as below:
yoo108 at halstead-fe01:
*/scratch/halstead/y/yoo108/wrfAnalysis/METanal/pcp_combine* $
/home/yoo108/met-6.0_bugfix/bin/pcp_combine -sum 00000000_000000 1
20050101_000000 24
/scratch/halstead/y/yoo108/wrfAnalysis/METanal/pcp_combine/sample_wrf_2005010100V_24A.nc
-pcpdir /scratch/halstead/k/khoogewi/CCRC_wrf/grib2/2005/200501 -field
'name="APCP";level="Z0";'
ERROR :
ERROR : sum_data_files() -> Cannot find a file with a valid time of
20050101_000000 and accumulation time of 010000 matching the regular
expression ".*"
ERROR :
Thank you.
Regards,
Jinwoong
On Wed, Jun 21, 2017 at 7:10 PM, John Halley Gotway via RT <
met_help at ucar.edu> wrote:
> Jinwoong,
>
> I see that you've having trouble getting pcp_combine to sum up the
data in
> the way you'd like.
>
> I think you're very close, but unfortunately, I don't understand
what you
> mean by 325. Is the record number that you'd like to extract from
the
> GRIB2 file? Usually, its better to refer to the name of the
variable and
> have MET find it for you rather then specifying an explicit record
number.
>
> Let me show you an example for 2m temperature using sample data
that's
> included in the MET tarball. Of course it doesn't make any sense to
sum up
> 2m temperature values! But I'm just showing you as an example.
Hopefully,
> you can adapt the example to do what you're trying to do:
>
> cd met-6.0/data/sample_fcst/2005080700
> ../../../bin/pcp_combine -sum 00000000_000000 3 20050807_120000 12
sum.nc
> -pcpdir . \
> -field 'name="TMP"; level="Z2";'
>
> DEBUG 1: [1] File ./wrfprs_ruc13_12.tm00_G212 matches valid time of
> 20050807_120000
> DEBUG 1: [2] File ./wrfprs_ruc13_09.tm00_G212 matches valid time of
> 20050807_090000
> DEBUG 1: [3] File ./wrfprs_ruc13_06.tm00_G212 matches valid time of
> 20050807_060000
> DEBUG 1: [4] File ./wrfprs_ruc13_03.tm00_G212 matches valid time of
> 20050807_030000
> DEBUG 1: [1] Reading input file: ./wrfprs_ruc13_12.tm00_G212
> DEBUG 1: [2] Reading input file: ./wrfprs_ruc13_09.tm00_G212
> DEBUG 1: [3] Reading input file: ./wrfprs_ruc13_06.tm00_G212
> DEBUG 1: [4] Reading input file: ./wrfprs_ruc13_03.tm00_G212
> DEBUG 1: Writing output file: sum.nc
>
> The key here is that I set: -field 'name="TMP"; level="Z2";'
>
> The name and level strings are used to search the GRIB records in
each file
> looking for a match.
>
> Hopefully that helps.
>
> Thanks,
> John
>
> On Wed, Jun 21, 2017 at 4:35 PM, Jinwoong Yoo via RT
<met_help at ucar.edu>
> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80978 >
> >
> > Hi,
> >
> > When I didn't specify -field and -config and ran the command:
> >
> > yoo108 at halstead-fe03:
> > */scratch/halstead/y/yoo108/wrfAnalysis/METanal/pcp_combine* $
> > /home/yoo108/met-6.0_bugfix/bin/pcp_combine -sum 00000000_000000 1
> > 20050101_000000 24
> >
/scratch/halstead/y/yoo108/wrfAnalysis/METanal/pcp_combine/sample_wrf_
> > 2005010100V_24A.nc
> > -pcpdir /scratch/halstead/k/khoogewi/CCRC_wrf/grib2/2005/200501
> >
> >
> >
> > I got this error below:
> >
> > DEBUG 1: [1] File
> > /scratch/halstead/k/khoogewi/CCRC_wrf/grib2/2005/200501/
> > CESM_WRF_d03_4km_200501010000.grb2
> > matches valid time of 20050101_000000
> >
> > ERROR :
> >
> > ERROR : sum_data_files() -> Cannot find a file with a valid time
of
> > 20041231_230000 and accumulation time of 010000 matching the
regular
> > expression ".*"
> >
> > ERROR :
> >
> >
> > I don't know why it tries to find 20041231_230000 file?
> > Do I need to use regular expression with it?
> >
> > Thank you.
> > Regards,
> >
> > Jinwoong
> >
> > On Wed, Jun 21, 2017 at 6:18 PM, met_help at ucar.edu via RT <
> > met_help at ucar.edu
> > > wrote:
> >
> > > NOTE: THE MET TEAM HAS LIMITED AVAILABILITY BETWEEN 5/23/17 AND
> 5/30/17.
> > > RESPONSES MAY BE DELAYED.
> > >
> > > Greetings,
> > >
> > > This message has been automatically generated in response to the
> > > creation of a trouble ticket regarding:
> > > "Error with pcp_combine for GRIB2 files",
> > > a summary of which appears below.
> > >
> > > There is no need to reply to this message right now. Your
ticket has
> > been
> > > assigned an ID of [rt.rap.ucar.edu #80978].
> > >
> > > Please include the string:
> > >
> > > [rt.rap.ucar.edu #80978]
> > >
> > > in the subject line of all future correspondence about this
issue. To
> do
> > > so,
> > > you may reply to this message.
> > >
> > > Thank you,
> > > met_help at ucar.edu
> > >
> > > ------------------------------------------------------------
> > -------------
> > > Hi,
> > > I am trying to combine hourly WRF output files which have been
> converted
> > to
> > > GRIB2 format using UPP.
> > >
> > >
> > > In the MET online tutorial, it is written "By default, PCP-
Combine
> > searches
> > > for records containing GRIB code 61 (accumulated precipitation).
Use
> > > the *-config
> > > config_str* option to override this default and process other
fields."
> > So I
> > > wanted to change the default for 325 APCP. But the direction in
the
> > > tutorial is not clear to me.
> > >
> > > Do I need to change configure file? (Then, which config file
should I
> > > change?)
> > > Or can I do this in command line?
> > >
> > > When I tried as below, I got error messages.
> > >
> > > > -sum 00000000_000000 1 20050101_000000 24 \
> > >
> > > >
> > >
/scratch/halstead/y/yoo108/wrfAnalysis/METanal/pcp_combine/sample_wrf_
> > > 2005010100V_24A.nc
> > > \
> > >
> > > > -pcpdir
/scratch/halstead/k/khoogewi/CCRC_wrf/grib2/2005/200501 \
> > >
> > > > -field APCP \
> > >
> > > > -config 325
> > >
> > > ERROR :
> > >
> > > ERROR : yyerror() -> syntax error in file
"/tmp/config_4646_0_.temp"
> > >
> > > ERROR :
> > >
> > > ERROR : line = 1
> > >
> > > ERROR :
> > >
> > > ERROR : column = 1
> > >
> > > ERROR :
> > >
> > > ERROR : text = "325"
> > >
> > > ERROR :
> > >
> > > ERROR :
> > >
> > > ERROR : 325
> > >
> > > ERROR : ^^^
> > >
> > > ERROR :
> > >
> > >
> > >
> > >
> > > Can you help?
> > > Thank you.
> > >
> > > Regards,
> > >
> > > Jinwoong Yoo
> > >
> > >
> >
> >
>
>
------------------------------------------------
Subject: Error with pcp_combine for GRIB2 files
From: Jinwoong Yoo
Time: Wed Jun 21 20:57:27 2017
Hi John,
I am playing with the pcp_combine by changing input arguments
particularly
with init_time of the simulation and regular expression.
Still I am getting error though.
yoo108 at halstead-fe01:
*/scratch/halstead/y/yoo108/wrfAnalysis/METanal/pcp_combine* $
/home/yoo108/met-6.0_bugfix/bin/pcp_combine -sum 20041217_000000 1
20050102_000000 24
/scratch/halstead/y/yoo108/wrfAnalysis/METanal/pcp_combine/sample_wrf_2005010100V_24A.nc
-pcpdir /scratch/halstead/k/khoogewi/CCRC_wrf/grib2/2005/200501 -field
'name="APCP";level="Z0";' -pcprx "*.grb2"
ERROR : sum_data_files() -> Cannot find a file with a valid time of
20050102_000000 and accumulation time of 010000 matching the regular
expression "*.grb2"
It seems that MET-6.0 does not recognize the format of time in my
input
grib2 files.
Naming convention of my wrf outputs is like "
CESM_WRF_d03_4km_200501010000.grb2".
As shown previously, each file has its initial time info (i.g.,
d=2004121700) as in
"325:14479093:d=2004121700:APCP Total Precipitation
[kg/m^2]:surface:1102-1103 hour acc fcst:"
But, it seems that pcp_combine is expecting something different, which
is
not clear to me.
Am I getting to the point?
Thanks.
Regards,
Jinwoong
On Wed, Jun 21, 2017 at 8:44 PM, Jinwoong Yoo <jinwoong.yoo at gmail.com>
wrote:
> Hi John,
>
> Thank you for your quick reply.
>
> In my WRF grib2 files, I have two APCP variables as shown below:
>
> 324:14427217:d=2004121700:APCP Total Precipitation
[kg/m^2]:surface:0-1103
> hour acc fcst:
>
> 325:14479093:d=2004121700:APCP Total Precipitation
> [kg/m^2]:surface:1102-1103 hour acc fcst:
> In my case, I would like to use values in "325" line which is APCP
for one
> hour accumulation not the total accumulation from the initialization
of the
> simulation to the forecast time which is "324".
>
>
> Anyway,
> when I modified my command line with "-field
'name="APCP";level="Z0";'
> I still got the error as below:
>
> yoo108 at halstead-fe01:
> */scratch/halstead/y/yoo108/wrfAnalysis/METanal/pcp_combine* $
> /home/yoo108/met-6.0_bugfix/bin/pcp_combine -sum 00000000_000000 1
> 20050101_000000 24
/scratch/halstead/y/yoo108/wrfAnalysis/METanal/pcp_
> combine/sample_wrf_2005010100V_24A.nc -pcpdir
> /scratch/halstead/k/khoogewi/CCRC_wrf/grib2/2005/200501 -field
> 'name="APCP";level="Z0";'
>
> ERROR :
>
> ERROR : sum_data_files() -> Cannot find a file with a valid time of
> 20050101_000000 and accumulation time of 010000 matching the regular
> expression ".*"
>
> ERROR :
>
>
> Thank you.
>
> Regards,
>
> Jinwoong
>
>
> On Wed, Jun 21, 2017 at 7:10 PM, John Halley Gotway via RT <
> met_help at ucar.edu> wrote:
>
>> Jinwoong,
>>
>> I see that you've having trouble getting pcp_combine to sum up the
data in
>> the way you'd like.
>>
>> I think you're very close, but unfortunately, I don't understand
what you
>> mean by 325. Is the record number that you'd like to extract from
the
>> GRIB2 file? Usually, its better to refer to the name of the
variable and
>> have MET find it for you rather then specifying an explicit record
number.
>>
>> Let me show you an example for 2m temperature using sample data
that's
>> included in the MET tarball. Of course it doesn't make any sense
to sum
>> up
>> 2m temperature values! But I'm just showing you as an example.
>> Hopefully,
>> you can adapt the example to do what you're trying to do:
>>
>> cd met-6.0/data/sample_fcst/2005080700
>> ../../../bin/pcp_combine -sum 00000000_000000 3 20050807_120000 12
sum.nc
>> -pcpdir . \
>> -field 'name="TMP"; level="Z2";'
>>
>> DEBUG 1: [1] File ./wrfprs_ruc13_12.tm00_G212 matches valid time of
>> 20050807_120000
>> DEBUG 1: [2] File ./wrfprs_ruc13_09.tm00_G212 matches valid time of
>> 20050807_090000
>> DEBUG 1: [3] File ./wrfprs_ruc13_06.tm00_G212 matches valid time of
>> 20050807_060000
>> DEBUG 1: [4] File ./wrfprs_ruc13_03.tm00_G212 matches valid time of
>> 20050807_030000
>> DEBUG 1: [1] Reading input file: ./wrfprs_ruc13_12.tm00_G212
>> DEBUG 1: [2] Reading input file: ./wrfprs_ruc13_09.tm00_G212
>> DEBUG 1: [3] Reading input file: ./wrfprs_ruc13_06.tm00_G212
>> DEBUG 1: [4] Reading input file: ./wrfprs_ruc13_03.tm00_G212
>> DEBUG 1: Writing output file: sum.nc
>>
>> The key here is that I set: -field 'name="TMP"; level="Z2";'
>>
>> The name and level strings are used to search the GRIB records in
each
>> file
>> looking for a match.
>>
>> Hopefully that helps.
>>
>> Thanks,
>> John
>>
>> On Wed, Jun 21, 2017 at 4:35 PM, Jinwoong Yoo via RT
<met_help at ucar.edu>
>> wrote:
>>
>> >
>> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80978 >
>> >
>> > Hi,
>> >
>> > When I didn't specify -field and -config and ran the command:
>> >
>> > yoo108 at halstead-fe03:
>> > */scratch/halstead/y/yoo108/wrfAnalysis/METanal/pcp_combine* $
>> > /home/yoo108/met-6.0_bugfix/bin/pcp_combine -sum 00000000_000000
1
>> > 20050101_000000 24
>> >
/scratch/halstead/y/yoo108/wrfAnalysis/METanal/pcp_combine/sample_wrf_
>> > 2005010100V_24A.nc
>> > -pcpdir /scratch/halstead/k/khoogewi/CCRC_wrf/grib2/2005/200501
>> >
>> >
>> >
>> > I got this error below:
>> >
>> > DEBUG 1: [1] File
>> > /scratch/halstead/k/khoogewi/CCRC_wrf/grib2/2005/200501/
>> > CESM_WRF_d03_4km_200501010000.grb2
>> > matches valid time of 20050101_000000
>> >
>> > ERROR :
>> >
>> > ERROR : sum_data_files() -> Cannot find a file with a valid time
of
>> > 20041231_230000 and accumulation time of 010000 matching the
regular
>> > expression ".*"
>> >
>> > ERROR :
>> >
>> >
>> > I don't know why it tries to find 20041231_230000 file?
>> > Do I need to use regular expression with it?
>> >
>> > Thank you.
>> > Regards,
>> >
>> > Jinwoong
>> >
>> > On Wed, Jun 21, 2017 at 6:18 PM, met_help at ucar.edu via RT <
>> > met_help at ucar.edu
>> > > wrote:
>> >
>> > > NOTE: THE MET TEAM HAS LIMITED AVAILABILITY BETWEEN 5/23/17 AND
>> 5/30/17.
>> > > RESPONSES MAY BE DELAYED.
>> > >
>> > > Greetings,
>> > >
>> > > This message has been automatically generated in response to
the
>> > > creation of a trouble ticket regarding:
>> > > "Error with pcp_combine for GRIB2 files",
>> > > a summary of which appears below.
>> > >
>> > > There is no need to reply to this message right now. Your
ticket has
>> > been
>> > > assigned an ID of [rt.rap.ucar.edu #80978].
>> > >
>> > > Please include the string:
>> > >
>> > > [rt.rap.ucar.edu #80978]
>> > >
>> > > in the subject line of all future correspondence about this
issue. To
>> do
>> > > so,
>> > > you may reply to this message.
>> > >
>> > > Thank you,
>> > > met_help at ucar.edu
>> > >
>> > > ------------------------------------------------------------
>> > -------------
>> > > Hi,
>> > > I am trying to combine hourly WRF output files which have been
>> converted
>> > to
>> > > GRIB2 format using UPP.
>> > >
>> > >
>> > > In the MET online tutorial, it is written "By default, PCP-
Combine
>> > searches
>> > > for records containing GRIB code 61 (accumulated
precipitation). Use
>> > > the *-config
>> > > config_str* option to override this default and process other
fields."
>> > So I
>> > > wanted to change the default for 325 APCP. But the direction in
the
>> > > tutorial is not clear to me.
>> > >
>> > > Do I need to change configure file? (Then, which config file
should I
>> > > change?)
>> > > Or can I do this in command line?
>> > >
>> > > When I tried as below, I got error messages.
>> > >
>> > > > -sum 00000000_000000 1 20050101_000000 24 \
>> > >
>> > > >
>> > > /scratch/halstead/y/yoo108/wrfAnalysis/METanal/pcp_combine/
>> sample_wrf_
>> > > 2005010100V_24A.nc
>> > > \
>> > >
>> > > > -pcpdir
/scratch/halstead/k/khoogewi/CCRC_wrf/grib2/2005/200501 \
>> > >
>> > > > -field APCP \
>> > >
>> > > > -config 325
>> > >
>> > > ERROR :
>> > >
>> > > ERROR : yyerror() -> syntax error in file
"/tmp/config_4646_0_.temp"
>> > >
>> > > ERROR :
>> > >
>> > > ERROR : line = 1
>> > >
>> > > ERROR :
>> > >
>> > > ERROR : column = 1
>> > >
>> > > ERROR :
>> > >
>> > > ERROR : text = "325"
>> > >
>> > > ERROR :
>> > >
>> > > ERROR :
>> > >
>> > > ERROR : 325
>> > >
>> > > ERROR : ^^^
>> > >
>> > > ERROR :
>> > >
>> > >
>> > >
>> > >
>> > > Can you help?
>> > > Thank you.
>> > >
>> > > Regards,
>> > >
>> > > Jinwoong Yoo
>> > >
>> > >
>> >
>> >
>>
>>
>
------------------------------------------------
Subject: Error with pcp_combine for GRIB2 files
From: Jinwoong Yoo
Time: Thu Jun 22 07:06:27 2017
Hi John,
As I look at the sample data using wgrib and wgrib2 under the
directory of
data/sample_fcst/2005080700/,
they also have two lines for APCP as my wrfout files:
1:0:D=2005080700:APCP:sfc:kpds=61,1,0:0-24hr acc:winds in grid
direction:"Total precipitation [kg/m^2]
2:31408:D=2005080700:APCP:sfc:kpds=61,1,0:21-24hr acc:winds in grid
direction:"Total precipitation [kg/m^2]
VS.
324:14427217:d=2004121700:APCP Total Precipitation [kg/m^2]:surface:0-
1103
hour acc fcst:
325:14479093:d=2004121700:APCP Total Precipitation
[kg/m^2]:surface:1102-1103
hour acc fcst:
But, there are a few differences between their format.
While sample grib files have "APCP" and its long name and
units separately, mines have its long name and units along with name
of
variable together, which part is the biggest thing I suspect. Can MET
pick
up them correctly?
Also, mines don't have kpds column.
Do you think these are causing error in my case?
If it is the case, how can I control MET to read these differences?
Thanks.
Regards,
Jinwoong
On Wed, Jun 21, 2017 at 8:44 PM, Jinwoong Yoo <jinwoong.yoo at gmail.com>
wrote:
> Hi John,
>
> Thank you for your quick reply.
>
> In my WRF grib2 files, I have two APCP variables as shown below:
>
> 324:14427217:d=2004121700:APCP Total Precipitation
[kg/m^2]:surface:0-1103
> hour acc fcst:
>
> 325:14479093:d=2004121700:APCP Total Precipitation
> [kg/m^2]:surface:1102-1103 hour acc fcst:
> In my case, I would like to use values in "325" line which is APCP
for one
> hour accumulation not the total accumulation from the initialization
of the
> simulation to the forecast time which is "324".
>
>
> Anyway,
> when I modified my command line with "-field
'name="APCP";level="Z0";'
> I still got the error as below:
>
> yoo108 at halstead-fe01:
> */scratch/halstead/y/yoo108/wrfAnalysis/METanal/pcp_combine* $
> /home/yoo108/met-6.0_bugfix/bin/pcp_combine -sum 00000000_000000 1
> 20050101_000000 24
/scratch/halstead/y/yoo108/wrfAnalysis/METanal/pcp_
> combine/sample_wrf_2005010100V_24A.nc -pcpdir
> /scratch/halstead/k/khoogewi/CCRC_wrf/grib2/2005/200501 -field
> 'name="APCP";level="Z0";'
>
> ERROR :
>
> ERROR : sum_data_files() -> Cannot find a file with a valid time of
> 20050101_000000 and accumulation time of 010000 matching the regular
> expression ".*"
>
> ERROR :
>
>
> Thank you.
>
> Regards,
>
> Jinwoong
>
>
> On Wed, Jun 21, 2017 at 7:10 PM, John Halley Gotway via RT <
> met_help at ucar.edu> wrote:
>
>> Jinwoong,
>>
>> I see that you've having trouble getting pcp_combine to sum up the
data in
>> the way you'd like.
>>
>> I think you're very close, but unfortunately, I don't understand
what you
>> mean by 325. Is the record number that you'd like to extract from
the
>> GRIB2 file? Usually, its better to refer to the name of the
variable and
>> have MET find it for you rather then specifying an explicit record
number.
>>
>> Let me show you an example for 2m temperature using sample data
that's
>> included in the MET tarball. Of course it doesn't make any sense
to sum
>> up
>> 2m temperature values! But I'm just showing you as an example.
>> Hopefully,
>> you can adapt the example to do what you're trying to do:
>>
>> cd met-6.0/data/sample_fcst/2005080700
>> ../../../bin/pcp_combine -sum 00000000_000000 3 20050807_120000 12
sum.nc
>> -pcpdir . \
>> -field 'name="TMP"; level="Z2";'
>>
>> DEBUG 1: [1] File ./wrfprs_ruc13_12.tm00_G212 matches valid time of
>> 20050807_120000
>> DEBUG 1: [2] File ./wrfprs_ruc13_09.tm00_G212 matches valid time of
>> 20050807_090000
>> DEBUG 1: [3] File ./wrfprs_ruc13_06.tm00_G212 matches valid time of
>> 20050807_060000
>> DEBUG 1: [4] File ./wrfprs_ruc13_03.tm00_G212 matches valid time of
>> 20050807_030000
>> DEBUG 1: [1] Reading input file: ./wrfprs_ruc13_12.tm00_G212
>> DEBUG 1: [2] Reading input file: ./wrfprs_ruc13_09.tm00_G212
>> DEBUG 1: [3] Reading input file: ./wrfprs_ruc13_06.tm00_G212
>> DEBUG 1: [4] Reading input file: ./wrfprs_ruc13_03.tm00_G212
>> DEBUG 1: Writing output file: sum.nc
>>
>> The key here is that I set: -field 'name="TMP"; level="Z2";'
>>
>> The name and level strings are used to search the GRIB records in
each
>> file
>> looking for a match.
>>
>> Hopefully that helps.
>>
>> Thanks,
>> John
>>
>> On Wed, Jun 21, 2017 at 4:35 PM, Jinwoong Yoo via RT
<met_help at ucar.edu>
>> wrote:
>>
>> >
>> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80978 >
>> >
>> > Hi,
>> >
>> > When I didn't specify -field and -config and ran the command:
>> >
>> > yoo108 at halstead-fe03:
>> > */scratch/halstead/y/yoo108/wrfAnalysis/METanal/pcp_combine* $
>> > /home/yoo108/met-6.0_bugfix/bin/pcp_combine -sum 00000000_000000
1
>> > 20050101_000000 24
>> >
/scratch/halstead/y/yoo108/wrfAnalysis/METanal/pcp_combine/sample_wrf_
>> > 2005010100V_24A.nc
>> > -pcpdir /scratch/halstead/k/khoogewi/CCRC_wrf/grib2/2005/200501
>> >
>> >
>> >
>> > I got this error below:
>> >
>> > DEBUG 1: [1] File
>> > /scratch/halstead/k/khoogewi/CCRC_wrf/grib2/2005/200501/
>> > CESM_WRF_d03_4km_200501010000.grb2
>> > matches valid time of 20050101_000000
>> >
>> > ERROR :
>> >
>> > ERROR : sum_data_files() -> Cannot find a file with a valid time
of
>> > 20041231_230000 and accumulation time of 010000 matching the
regular
>> > expression ".*"
>> >
>> > ERROR :
>> >
>> >
>> > I don't know why it tries to find 20041231_230000 file?
>> > Do I need to use regular expression with it?
>> >
>> > Thank you.
>> > Regards,
>> >
>> > Jinwoong
>> >
>> > On Wed, Jun 21, 2017 at 6:18 PM, met_help at ucar.edu via RT <
>> > met_help at ucar.edu
>> > > wrote:
>> >
>> > > NOTE: THE MET TEAM HAS LIMITED AVAILABILITY BETWEEN 5/23/17 AND
>> 5/30/17.
>> > > RESPONSES MAY BE DELAYED.
>> > >
>> > > Greetings,
>> > >
>> > > This message has been automatically generated in response to
the
>> > > creation of a trouble ticket regarding:
>> > > "Error with pcp_combine for GRIB2 files",
>> > > a summary of which appears below.
>> > >
>> > > There is no need to reply to this message right now. Your
ticket has
>> > been
>> > > assigned an ID of [rt.rap.ucar.edu #80978].
>> > >
>> > > Please include the string:
>> > >
>> > > [rt.rap.ucar.edu #80978]
>> > >
>> > > in the subject line of all future correspondence about this
issue. To
>> do
>> > > so,
>> > > you may reply to this message.
>> > >
>> > > Thank you,
>> > > met_help at ucar.edu
>> > >
>> > > ------------------------------------------------------------
>> > -------------
>> > > Hi,
>> > > I am trying to combine hourly WRF output files which have been
>> converted
>> > to
>> > > GRIB2 format using UPP.
>> > >
>> > >
>> > > In the MET online tutorial, it is written "By default, PCP-
Combine
>> > searches
>> > > for records containing GRIB code 61 (accumulated
precipitation). Use
>> > > the *-config
>> > > config_str* option to override this default and process other
fields."
>> > So I
>> > > wanted to change the default for 325 APCP. But the direction in
the
>> > > tutorial is not clear to me.
>> > >
>> > > Do I need to change configure file? (Then, which config file
should I
>> > > change?)
>> > > Or can I do this in command line?
>> > >
>> > > When I tried as below, I got error messages.
>> > >
>> > > > -sum 00000000_000000 1 20050101_000000 24 \
>> > >
>> > > >
>> > > /scratch/halstead/y/yoo108/wrfAnalysis/METanal/pcp_combine/
>> sample_wrf_
>> > > 2005010100V_24A.nc
>> > > \
>> > >
>> > > > -pcpdir
/scratch/halstead/k/khoogewi/CCRC_wrf/grib2/2005/200501 \
>> > >
>> > > > -field APCP \
>> > >
>> > > > -config 325
>> > >
>> > > ERROR :
>> > >
>> > > ERROR : yyerror() -> syntax error in file
"/tmp/config_4646_0_.temp"
>> > >
>> > > ERROR :
>> > >
>> > > ERROR : line = 1
>> > >
>> > > ERROR :
>> > >
>> > > ERROR : column = 1
>> > >
>> > > ERROR :
>> > >
>> > > ERROR : text = "325"
>> > >
>> > > ERROR :
>> > >
>> > > ERROR :
>> > >
>> > > ERROR : 325
>> > >
>> > > ERROR : ^^^
>> > >
>> > > ERROR :
>> > >
>> > >
>> > >
>> > >
>> > > Can you help?
>> > > Thank you.
>> > >
>> > > Regards,
>> > >
>> > > Jinwoong Yoo
>> > >
>> > >
>> >
>> >
>>
>>
>
------------------------------------------------
Subject: Error with pcp_combine for GRIB2 files
From: John Halley Gotway
Time: Thu Jun 22 07:57:18 2017
Jinwoong,
Can you please send me two sample data files so I can look more
closely at
the details? You can post them to our anonymois ftp site following
these
instructions:
http://www.dtcenter.org/met/users/support/met_help.php#ftp
Please let me know when the data is there and I'll go grab it.
Thanks,
John
On Thu, Jun 22, 2017 at 7:06 AM Jinwoong Yoo via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80978 >
>
> Hi John,
>
> As I look at the sample data using wgrib and wgrib2 under the
directory of
> data/sample_fcst/2005080700/,
> they also have two lines for APCP as my wrfout files:
>
> 1:0:D=2005080700:APCP:sfc:kpds=61,1,0:0-24hr acc:winds in grid
> direction:"Total precipitation [kg/m^2]
>
> 2:31408:D=2005080700:APCP:sfc:kpds=61,1,0:21-24hr acc:winds in grid
> direction:"Total precipitation [kg/m^2]
> VS.
>
> 324:14427217:d=2004121700:APCP Total Precipitation
[kg/m^2]:surface:0-1103
> hour acc fcst:
>
> 325:14479093:d=2004121700:APCP Total Precipitation
> [kg/m^2]:surface:1102-1103
> hour acc fcst:
>
>
>
> But, there are a few differences between their format.
> While sample grib files have "APCP" and its long name and
> units separately, mines have its long name and units along with name
of
> variable together, which part is the biggest thing I suspect. Can
MET pick
> up them correctly?
>
> Also, mines don't have kpds column.
>
> Do you think these are causing error in my case?
> If it is the case, how can I control MET to read these differences?
> Thanks.
>
> Regards,
>
> Jinwoong
>
>
> On Wed, Jun 21, 2017 at 8:44 PM, Jinwoong Yoo
<jinwoong.yoo at gmail.com>
> wrote:
>
> > Hi John,
> >
> > Thank you for your quick reply.
> >
> > In my WRF grib2 files, I have two APCP variables as shown below:
> >
> > 324:14427217:d=2004121700:APCP Total Precipitation
> [kg/m^2]:surface:0-1103
> > hour acc fcst:
> >
> > 325:14479093:d=2004121700:APCP Total Precipitation
> > [kg/m^2]:surface:1102-1103 hour acc fcst:
> > In my case, I would like to use values in "325" line which is APCP
for
> one
> > hour accumulation not the total accumulation from the
initialization of
> the
> > simulation to the forecast time which is "324".
> >
> >
> > Anyway,
> > when I modified my command line with "-field
'name="APCP";level="Z0";'
> > I still got the error as below:
> >
> > yoo108 at halstead-fe01:
> > */scratch/halstead/y/yoo108/wrfAnalysis/METanal/pcp_combine* $
> > /home/yoo108/met-6.0_bugfix/bin/pcp_combine -sum 00000000_000000 1
> > 20050101_000000 24
/scratch/halstead/y/yoo108/wrfAnalysis/METanal/pcp_
> > combine/sample_wrf_2005010100V_24A.nc -pcpdir
> > /scratch/halstead/k/khoogewi/CCRC_wrf/grib2/2005/200501 -field
> > 'name="APCP";level="Z0";'
> >
> > ERROR :
> >
> > ERROR : sum_data_files() -> Cannot find a file with a valid time
of
> > 20050101_000000 and accumulation time of 010000 matching the
regular
> > expression ".*"
> >
> > ERROR :
> >
> >
> > Thank you.
> >
> > Regards,
> >
> > Jinwoong
> >
> >
> > On Wed, Jun 21, 2017 at 7:10 PM, John Halley Gotway via RT <
> > met_help at ucar.edu> wrote:
> >
> >> Jinwoong,
> >>
> >> I see that you've having trouble getting pcp_combine to sum up
the data
> in
> >> the way you'd like.
> >>
> >> I think you're very close, but unfortunately, I don't understand
what
> you
> >> mean by 325. Is the record number that you'd like to extract
from the
> >> GRIB2 file? Usually, its better to refer to the name of the
variable
> and
> >> have MET find it for you rather then specifying an explicit
record
> number.
> >>
> >> Let me show you an example for 2m temperature using sample data
that's
> >> included in the MET tarball. Of course it doesn't make any sense
to sum
> >> up
> >> 2m temperature values! But I'm just showing you as an example.
> >> Hopefully,
> >> you can adapt the example to do what you're trying to do:
> >>
> >> cd met-6.0/data/sample_fcst/2005080700
> >> ../../../bin/pcp_combine -sum 00000000_000000 3 20050807_120000
12
> sum.nc
> >> -pcpdir . \
> >> -field 'name="TMP"; level="Z2";'
> >>
> >> DEBUG 1: [1] File ./wrfprs_ruc13_12.tm00_G212 matches valid time
of
> >> 20050807_120000
> >> DEBUG 1: [2] File ./wrfprs_ruc13_09.tm00_G212 matches valid time
of
> >> 20050807_090000
> >> DEBUG 1: [3] File ./wrfprs_ruc13_06.tm00_G212 matches valid time
of
> >> 20050807_060000
> >> DEBUG 1: [4] File ./wrfprs_ruc13_03.tm00_G212 matches valid time
of
> >> 20050807_030000
> >> DEBUG 1: [1] Reading input file: ./wrfprs_ruc13_12.tm00_G212
> >> DEBUG 1: [2] Reading input file: ./wrfprs_ruc13_09.tm00_G212
> >> DEBUG 1: [3] Reading input file: ./wrfprs_ruc13_06.tm00_G212
> >> DEBUG 1: [4] Reading input file: ./wrfprs_ruc13_03.tm00_G212
> >> DEBUG 1: Writing output file: sum.nc
> >>
> >> The key here is that I set: -field 'name="TMP"; level="Z2";'
> >>
> >> The name and level strings are used to search the GRIB records in
each
> >> file
> >> looking for a match.
> >>
> >> Hopefully that helps.
> >>
> >> Thanks,
> >> John
> >>
> >> On Wed, Jun 21, 2017 at 4:35 PM, Jinwoong Yoo via RT
<met_help at ucar.edu
> >
> >> wrote:
> >>
> >> >
> >> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80978 >
> >> >
> >> > Hi,
> >> >
> >> > When I didn't specify -field and -config and ran the command:
> >> >
> >> > yoo108 at halstead-fe03:
> >> > */scratch/halstead/y/yoo108/wrfAnalysis/METanal/pcp_combine* $
> >> > /home/yoo108/met-6.0_bugfix/bin/pcp_combine -sum
00000000_000000 1
> >> > 20050101_000000 24
> >> >
/scratch/halstead/y/yoo108/wrfAnalysis/METanal/pcp_combine/sample_wrf_
> >> > 2005010100V_24A.nc
> >> > -pcpdir /scratch/halstead/k/khoogewi/CCRC_wrf/grib2/2005/200501
> >> >
> >> >
> >> >
> >> > I got this error below:
> >> >
> >> > DEBUG 1: [1] File
> >> > /scratch/halstead/k/khoogewi/CCRC_wrf/grib2/2005/200501/
> >> > CESM_WRF_d03_4km_200501010000.grb2
> >> > matches valid time of 20050101_000000
> >> >
> >> > ERROR :
> >> >
> >> > ERROR : sum_data_files() -> Cannot find a file with a valid
time of
> >> > 20041231_230000 and accumulation time of 010000 matching the
regular
> >> > expression ".*"
> >> >
> >> > ERROR :
> >> >
> >> >
> >> > I don't know why it tries to find 20041231_230000 file?
> >> > Do I need to use regular expression with it?
> >> >
> >> > Thank you.
> >> > Regards,
> >> >
> >> > Jinwoong
> >> >
> >> > On Wed, Jun 21, 2017 at 6:18 PM, met_help at ucar.edu via RT <
> >> > met_help at ucar.edu
> >> > > wrote:
> >> >
> >> > > NOTE: THE MET TEAM HAS LIMITED AVAILABILITY BETWEEN 5/23/17
AND
> >> 5/30/17.
> >> > > RESPONSES MAY BE DELAYED.
> >> > >
> >> > > Greetings,
> >> > >
> >> > > This message has been automatically generated in response to
the
> >> > > creation of a trouble ticket regarding:
> >> > > "Error with pcp_combine for GRIB2 files",
> >> > > a summary of which appears below.
> >> > >
> >> > > There is no need to reply to this message right now. Your
ticket
> has
> >> > been
> >> > > assigned an ID of [rt.rap.ucar.edu #80978].
> >> > >
> >> > > Please include the string:
> >> > >
> >> > > [rt.rap.ucar.edu #80978]
> >> > >
> >> > > in the subject line of all future correspondence about this
issue.
> To
> >> do
> >> > > so,
> >> > > you may reply to this message.
> >> > >
> >> > > Thank you,
> >> > > met_help at ucar.edu
> >> > >
> >> > > ------------------------------------------------------------
> >> > -------------
> >> > > Hi,
> >> > > I am trying to combine hourly WRF output files which have
been
> >> converted
> >> > to
> >> > > GRIB2 format using UPP.
> >> > >
> >> > >
> >> > > In the MET online tutorial, it is written "By default, PCP-
Combine
> >> > searches
> >> > > for records containing GRIB code 61 (accumulated
precipitation). Use
> >> > > the *-config
> >> > > config_str* option to override this default and process other
> fields."
> >> > So I
> >> > > wanted to change the default for 325 APCP. But the direction
in the
> >> > > tutorial is not clear to me.
> >> > >
> >> > > Do I need to change configure file? (Then, which config file
should
> I
> >> > > change?)
> >> > > Or can I do this in command line?
> >> > >
> >> > > When I tried as below, I got error messages.
> >> > >
> >> > > > -sum 00000000_000000 1 20050101_000000 24 \
> >> > >
> >> > > >
> >> > > /scratch/halstead/y/yoo108/wrfAnalysis/METanal/pcp_combine/
> >> sample_wrf_
> >> > > 2005010100V_24A.nc
> >> > > \
> >> > >
> >> > > > -pcpdir
/scratch/halstead/k/khoogewi/CCRC_wrf/grib2/2005/200501 \
> >> > >
> >> > > > -field APCP \
> >> > >
> >> > > > -config 325
> >> > >
> >> > > ERROR :
> >> > >
> >> > > ERROR : yyerror() -> syntax error in file
> "/tmp/config_4646_0_.temp"
> >> > >
> >> > > ERROR :
> >> > >
> >> > > ERROR : line = 1
> >> > >
> >> > > ERROR :
> >> > >
> >> > > ERROR : column = 1
> >> > >
> >> > > ERROR :
> >> > >
> >> > > ERROR : text = "325"
> >> > >
> >> > > ERROR :
> >> > >
> >> > > ERROR :
> >> > >
> >> > > ERROR : 325
> >> > >
> >> > > ERROR : ^^^
> >> > >
> >> > > ERROR :
> >> > >
> >> > >
> >> > >
> >> > >
> >> > > Can you help?
> >> > > Thank you.
> >> > >
> >> > > Regards,
> >> > >
> >> > > Jinwoong Yoo
> >> > >
> >> > >
> >> >
> >> >
> >>
> >>
> >
>
>
------------------------------------------------
Subject: Error with pcp_combine for GRIB2 files
From: Jinwoong Yoo
Time: Thu Jun 22 08:47:09 2017
Hi John,
I uploaded my sample files in a tar file.
If you cannot find it, please let me know.
Thank you.
Regards,
Jinwoong
On Thu, Jun 22, 2017 at 9:57 AM, John Halley Gotway via RT <
met_help at ucar.edu> wrote:
> Jinwoong,
>
> Can you please send me two sample data files so I can look more
closely at
> the details? You can post them to our anonymois ftp site following
these
> instructions:
>
> http://www.dtcenter.org/met/users/support/met_help.php#ftp
>
> Please let me know when the data is there and I'll go grab it.
>
> Thanks,
> John
>
> On Thu, Jun 22, 2017 at 7:06 AM Jinwoong Yoo via RT
<met_help at ucar.edu>
> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80978 >
> >
> > Hi John,
> >
> > As I look at the sample data using wgrib and wgrib2 under the
directory
> of
> > data/sample_fcst/2005080700/,
> > they also have two lines for APCP as my wrfout files:
> >
> > 1:0:D=2005080700:APCP:sfc:kpds=61,1,0:0-24hr acc:winds in grid
> > direction:"Total precipitation [kg/m^2]
> >
> > 2:31408:D=2005080700:APCP:sfc:kpds=61,1,0:21-24hr acc:winds in
grid
> > direction:"Total precipitation [kg/m^2]
> > VS.
> >
> > 324:14427217:d=2004121700:APCP Total Precipitation
> [kg/m^2]:surface:0-1103
> > hour acc fcst:
> >
> > 325:14479093:d=2004121700:APCP Total Precipitation
> > [kg/m^2]:surface:1102-1103
> > hour acc fcst:
> >
> >
> >
> > But, there are a few differences between their format.
> > While sample grib files have "APCP" and its long name and
> > units separately, mines have its long name and units along with
name of
> > variable together, which part is the biggest thing I suspect. Can
MET
> pick
> > up them correctly?
> >
> > Also, mines don't have kpds column.
> >
> > Do you think these are causing error in my case?
> > If it is the case, how can I control MET to read these
differences?
> > Thanks.
> >
> > Regards,
> >
> > Jinwoong
> >
> >
> > On Wed, Jun 21, 2017 at 8:44 PM, Jinwoong Yoo
<jinwoong.yoo at gmail.com>
> > wrote:
> >
> > > Hi John,
> > >
> > > Thank you for your quick reply.
> > >
> > > In my WRF grib2 files, I have two APCP variables as shown below:
> > >
> > > 324:14427217:d=2004121700:APCP Total Precipitation
> > [kg/m^2]:surface:0-1103
> > > hour acc fcst:
> > >
> > > 325:14479093:d=2004121700:APCP Total Precipitation
> > > [kg/m^2]:surface:1102-1103 hour acc fcst:
> > > In my case, I would like to use values in "325" line which is
APCP for
> > one
> > > hour accumulation not the total accumulation from the
initialization of
> > the
> > > simulation to the forecast time which is "324".
> > >
> > >
> > > Anyway,
> > > when I modified my command line with "-field
'name="APCP";level="Z0";'
> > > I still got the error as below:
> > >
> > > yoo108 at halstead-fe01:
> > > */scratch/halstead/y/yoo108/wrfAnalysis/METanal/pcp_combine* $
> > > /home/yoo108/met-6.0_bugfix/bin/pcp_combine -sum 00000000_000000
1
> > > 20050101_000000 24
/scratch/halstead/y/yoo108/wrfAnalysis/METanal/pcp_
> > > combine/sample_wrf_2005010100V_24A.nc -pcpdir
> > > /scratch/halstead/k/khoogewi/CCRC_wrf/grib2/2005/200501 -field
> > > 'name="APCP";level="Z0";'
> > >
> > > ERROR :
> > >
> > > ERROR : sum_data_files() -> Cannot find a file with a valid
time of
> > > 20050101_000000 and accumulation time of 010000 matching the
regular
> > > expression ".*"
> > >
> > > ERROR :
> > >
> > >
> > > Thank you.
> > >
> > > Regards,
> > >
> > > Jinwoong
> > >
> > >
> > > On Wed, Jun 21, 2017 at 7:10 PM, John Halley Gotway via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > >> Jinwoong,
> > >>
> > >> I see that you've having trouble getting pcp_combine to sum up
the
> data
> > in
> > >> the way you'd like.
> > >>
> > >> I think you're very close, but unfortunately, I don't
understand what
> > you
> > >> mean by 325. Is the record number that you'd like to extract
from the
> > >> GRIB2 file? Usually, its better to refer to the name of the
variable
> > and
> > >> have MET find it for you rather then specifying an explicit
record
> > number.
> > >>
> > >> Let me show you an example for 2m temperature using sample data
that's
> > >> included in the MET tarball. Of course it doesn't make any
sense to
> sum
> > >> up
> > >> 2m temperature values! But I'm just showing you as an example.
> > >> Hopefully,
> > >> you can adapt the example to do what you're trying to do:
> > >>
> > >> cd met-6.0/data/sample_fcst/2005080700
> > >> ../../../bin/pcp_combine -sum 00000000_000000 3 20050807_120000
12
> > sum.nc
> > >> -pcpdir . \
> > >> -field 'name="TMP"; level="Z2";'
> > >>
> > >> DEBUG 1: [1] File ./wrfprs_ruc13_12.tm00_G212 matches valid
time of
> > >> 20050807_120000
> > >> DEBUG 1: [2] File ./wrfprs_ruc13_09.tm00_G212 matches valid
time of
> > >> 20050807_090000
> > >> DEBUG 1: [3] File ./wrfprs_ruc13_06.tm00_G212 matches valid
time of
> > >> 20050807_060000
> > >> DEBUG 1: [4] File ./wrfprs_ruc13_03.tm00_G212 matches valid
time of
> > >> 20050807_030000
> > >> DEBUG 1: [1] Reading input file: ./wrfprs_ruc13_12.tm00_G212
> > >> DEBUG 1: [2] Reading input file: ./wrfprs_ruc13_09.tm00_G212
> > >> DEBUG 1: [3] Reading input file: ./wrfprs_ruc13_06.tm00_G212
> > >> DEBUG 1: [4] Reading input file: ./wrfprs_ruc13_03.tm00_G212
> > >> DEBUG 1: Writing output file: sum.nc
> > >>
> > >> The key here is that I set: -field 'name="TMP"; level="Z2";'
> > >>
> > >> The name and level strings are used to search the GRIB records
in each
> > >> file
> > >> looking for a match.
> > >>
> > >> Hopefully that helps.
> > >>
> > >> Thanks,
> > >> John
> > >>
> > >> On Wed, Jun 21, 2017 at 4:35 PM, Jinwoong Yoo via RT <
> met_help at ucar.edu
> > >
> > >> wrote:
> > >>
> > >> >
> > >> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80978
>
> > >> >
> > >> > Hi,
> > >> >
> > >> > When I didn't specify -field and -config and ran the command:
> > >> >
> > >> > yoo108 at halstead-fe03:
> > >> > */scratch/halstead/y/yoo108/wrfAnalysis/METanal/pcp_combine*
$
> > >> > /home/yoo108/met-6.0_bugfix/bin/pcp_combine -sum
00000000_000000 1
> > >> > 20050101_000000 24
> > >> > /scratch/halstead/y/yoo108/wrfAnalysis/METanal/pcp_
> combine/sample_wrf_
> > >> > 2005010100V_24A.nc
> > >> > -pcpdir
/scratch/halstead/k/khoogewi/CCRC_wrf/grib2/2005/200501
> > >> >
> > >> >
> > >> >
> > >> > I got this error below:
> > >> >
> > >> > DEBUG 1: [1] File
> > >> > /scratch/halstead/k/khoogewi/CCRC_wrf/grib2/2005/200501/
> > >> > CESM_WRF_d03_4km_200501010000.grb2
> > >> > matches valid time of 20050101_000000
> > >> >
> > >> > ERROR :
> > >> >
> > >> > ERROR : sum_data_files() -> Cannot find a file with a valid
time of
> > >> > 20041231_230000 and accumulation time of 010000 matching the
regular
> > >> > expression ".*"
> > >> >
> > >> > ERROR :
> > >> >
> > >> >
> > >> > I don't know why it tries to find 20041231_230000 file?
> > >> > Do I need to use regular expression with it?
> > >> >
> > >> > Thank you.
> > >> > Regards,
> > >> >
> > >> > Jinwoong
> > >> >
> > >> > On Wed, Jun 21, 2017 at 6:18 PM, met_help at ucar.edu via RT <
> > >> > met_help at ucar.edu
> > >> > > wrote:
> > >> >
> > >> > > NOTE: THE MET TEAM HAS LIMITED AVAILABILITY BETWEEN 5/23/17
AND
> > >> 5/30/17.
> > >> > > RESPONSES MAY BE DELAYED.
> > >> > >
> > >> > > Greetings,
> > >> > >
> > >> > > This message has been automatically generated in response
to the
> > >> > > creation of a trouble ticket regarding:
> > >> > > "Error with pcp_combine for GRIB2 files",
> > >> > > a summary of which appears below.
> > >> > >
> > >> > > There is no need to reply to this message right now. Your
ticket
> > has
> > >> > been
> > >> > > assigned an ID of [rt.rap.ucar.edu #80978].
> > >> > >
> > >> > > Please include the string:
> > >> > >
> > >> > > [rt.rap.ucar.edu #80978]
> > >> > >
> > >> > > in the subject line of all future correspondence about this
issue.
> > To
> > >> do
> > >> > > so,
> > >> > > you may reply to this message.
> > >> > >
> > >> > > Thank you,
> > >> > > met_help at ucar.edu
> > >> > >
> > >> > >
------------------------------------------------------------
> > >> > -------------
> > >> > > Hi,
> > >> > > I am trying to combine hourly WRF output files which have
been
> > >> converted
> > >> > to
> > >> > > GRIB2 format using UPP.
> > >> > >
> > >> > >
> > >> > > In the MET online tutorial, it is written "By default, PCP-
Combine
> > >> > searches
> > >> > > for records containing GRIB code 61 (accumulated
precipitation).
> Use
> > >> > > the *-config
> > >> > > config_str* option to override this default and process
other
> > fields."
> > >> > So I
> > >> > > wanted to change the default for 325 APCP. But the
direction in
> the
> > >> > > tutorial is not clear to me.
> > >> > >
> > >> > > Do I need to change configure file? (Then, which config
file
> should
> > I
> > >> > > change?)
> > >> > > Or can I do this in command line?
> > >> > >
> > >> > > When I tried as below, I got error messages.
> > >> > >
> > >> > > > -sum 00000000_000000 1 20050101_000000 24 \
> > >> > >
> > >> > > >
> > >> > > /scratch/halstead/y/yoo108/wrfAnalysis/METanal/pcp_combine/
> > >> sample_wrf_
> > >> > > 2005010100V_24A.nc
> > >> > > \
> > >> > >
> > >> > > > -pcpdir
/scratch/halstead/k/khoogewi/CCRC_wrf/grib2/2005/200501
> \
> > >> > >
> > >> > > > -field APCP \
> > >> > >
> > >> > > > -config 325
> > >> > >
> > >> > > ERROR :
> > >> > >
> > >> > > ERROR : yyerror() -> syntax error in file
> > "/tmp/config_4646_0_.temp"
> > >> > >
> > >> > > ERROR :
> > >> > >
> > >> > > ERROR : line = 1
> > >> > >
> > >> > > ERROR :
> > >> > >
> > >> > > ERROR : column = 1
> > >> > >
> > >> > > ERROR :
> > >> > >
> > >> > > ERROR : text = "325"
> > >> > >
> > >> > > ERROR :
> > >> > >
> > >> > > ERROR :
> > >> > >
> > >> > > ERROR : 325
> > >> > >
> > >> > > ERROR : ^^^
> > >> > >
> > >> > > ERROR :
> > >> > >
> > >> > >
> > >> > >
> > >> > >
> > >> > > Can you help?
> > >> > > Thank you.
> > >> > >
> > >> > > Regards,
> > >> > >
> > >> > > Jinwoong Yoo
> > >> > >
> > >> > >
> > >> >
> > >> >
> > >>
> > >>
> > >
> >
> >
>
>
------------------------------------------------
Subject: Error with pcp_combine for GRIB2 files
From: John Halley Gotway
Time: Thu Jun 22 12:21:06 2017
Jinwoong,
I went to go grab it from this location but it appears to be empty:
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/Yoo_data/
Could you please try again?
Thanks,
John
On Thu, Jun 22, 2017 at 8:47 AM, Jinwoong Yoo via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80978 >
>
> Hi John,
>
> I uploaded my sample files in a tar file.
> If you cannot find it, please let me know.
> Thank you.
>
> Regards,
>
> Jinwoong
>
> On Thu, Jun 22, 2017 at 9:57 AM, John Halley Gotway via RT <
> met_help at ucar.edu> wrote:
>
> > Jinwoong,
> >
> > Can you please send me two sample data files so I can look more
closely
> at
> > the details? You can post them to our anonymois ftp site
following these
> > instructions:
> >
> > http://www.dtcenter.org/met/users/support/met_help.php#ftp
> >
> > Please let me know when the data is there and I'll go grab it.
> >
> > Thanks,
> > John
> >
> > On Thu, Jun 22, 2017 at 7:06 AM Jinwoong Yoo via RT
<met_help at ucar.edu>
> > wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80978 >
> > >
> > > Hi John,
> > >
> > > As I look at the sample data using wgrib and wgrib2 under the
directory
> > of
> > > data/sample_fcst/2005080700/,
> > > they also have two lines for APCP as my wrfout files:
> > >
> > > 1:0:D=2005080700:APCP:sfc:kpds=61,1,0:0-24hr acc:winds in grid
> > > direction:"Total precipitation [kg/m^2]
> > >
> > > 2:31408:D=2005080700:APCP:sfc:kpds=61,1,0:21-24hr acc:winds in
grid
> > > direction:"Total precipitation [kg/m^2]
> > > VS.
> > >
> > > 324:14427217:d=2004121700:APCP Total Precipitation
> > [kg/m^2]:surface:0-1103
> > > hour acc fcst:
> > >
> > > 325:14479093:d=2004121700:APCP Total Precipitation
> > > [kg/m^2]:surface:1102-1103
> > > hour acc fcst:
> > >
> > >
> > >
> > > But, there are a few differences between their format.
> > > While sample grib files have "APCP" and its long name and
> > > units separately, mines have its long name and units along with
name of
> > > variable together, which part is the biggest thing I suspect.
Can MET
> > pick
> > > up them correctly?
> > >
> > > Also, mines don't have kpds column.
> > >
> > > Do you think these are causing error in my case?
> > > If it is the case, how can I control MET to read these
differences?
> > > Thanks.
> > >
> > > Regards,
> > >
> > > Jinwoong
> > >
> > >
> > > On Wed, Jun 21, 2017 at 8:44 PM, Jinwoong Yoo
<jinwoong.yoo at gmail.com>
> > > wrote:
> > >
> > > > Hi John,
> > > >
> > > > Thank you for your quick reply.
> > > >
> > > > In my WRF grib2 files, I have two APCP variables as shown
below:
> > > >
> > > > 324:14427217:d=2004121700:APCP Total Precipitation
> > > [kg/m^2]:surface:0-1103
> > > > hour acc fcst:
> > > >
> > > > 325:14479093:d=2004121700:APCP Total Precipitation
> > > > [kg/m^2]:surface:1102-1103 hour acc fcst:
> > > > In my case, I would like to use values in "325" line which is
APCP
> for
> > > one
> > > > hour accumulation not the total accumulation from the
initialization
> of
> > > the
> > > > simulation to the forecast time which is "324".
> > > >
> > > >
> > > > Anyway,
> > > > when I modified my command line with "-field
> 'name="APCP";level="Z0";'
> > > > I still got the error as below:
> > > >
> > > > yoo108 at halstead-fe01:
> > > > */scratch/halstead/y/yoo108/wrfAnalysis/METanal/pcp_combine* $
> > > > /home/yoo108/met-6.0_bugfix/bin/pcp_combine -sum
00000000_000000 1
> > > > 20050101_000000 24 /scratch/halstead/y/yoo108/wrf
> Analysis/METanal/pcp_
> > > > combine/sample_wrf_2005010100V_24A.nc -pcpdir
> > > > /scratch/halstead/k/khoogewi/CCRC_wrf/grib2/2005/200501 -field
> > > > 'name="APCP";level="Z0";'
> > > >
> > > > ERROR :
> > > >
> > > > ERROR : sum_data_files() -> Cannot find a file with a valid
time of
> > > > 20050101_000000 and accumulation time of 010000 matching the
regular
> > > > expression ".*"
> > > >
> > > > ERROR :
> > > >
> > > >
> > > > Thank you.
> > > >
> > > > Regards,
> > > >
> > > > Jinwoong
> > > >
> > > >
> > > > On Wed, Jun 21, 2017 at 7:10 PM, John Halley Gotway via RT <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > >> Jinwoong,
> > > >>
> > > >> I see that you've having trouble getting pcp_combine to sum
up the
> > data
> > > in
> > > >> the way you'd like.
> > > >>
> > > >> I think you're very close, but unfortunately, I don't
understand
> what
> > > you
> > > >> mean by 325. Is the record number that you'd like to extract
from
> the
> > > >> GRIB2 file? Usually, its better to refer to the name of the
> variable
> > > and
> > > >> have MET find it for you rather then specifying an explicit
record
> > > number.
> > > >>
> > > >> Let me show you an example for 2m temperature using sample
data
> that's
> > > >> included in the MET tarball. Of course it doesn't make any
sense to
> > sum
> > > >> up
> > > >> 2m temperature values! But I'm just showing you as an
example.
> > > >> Hopefully,
> > > >> you can adapt the example to do what you're trying to do:
> > > >>
> > > >> cd met-6.0/data/sample_fcst/2005080700
> > > >> ../../../bin/pcp_combine -sum 00000000_000000 3
20050807_120000 12
> > > sum.nc
> > > >> -pcpdir . \
> > > >> -field 'name="TMP"; level="Z2";'
> > > >>
> > > >> DEBUG 1: [1] File ./wrfprs_ruc13_12.tm00_G212 matches valid
time of
> > > >> 20050807_120000
> > > >> DEBUG 1: [2] File ./wrfprs_ruc13_09.tm00_G212 matches valid
time of
> > > >> 20050807_090000
> > > >> DEBUG 1: [3] File ./wrfprs_ruc13_06.tm00_G212 matches valid
time of
> > > >> 20050807_060000
> > > >> DEBUG 1: [4] File ./wrfprs_ruc13_03.tm00_G212 matches valid
time of
> > > >> 20050807_030000
> > > >> DEBUG 1: [1] Reading input file: ./wrfprs_ruc13_12.tm00_G212
> > > >> DEBUG 1: [2] Reading input file: ./wrfprs_ruc13_09.tm00_G212
> > > >> DEBUG 1: [3] Reading input file: ./wrfprs_ruc13_06.tm00_G212
> > > >> DEBUG 1: [4] Reading input file: ./wrfprs_ruc13_03.tm00_G212
> > > >> DEBUG 1: Writing output file: sum.nc
> > > >>
> > > >> The key here is that I set: -field 'name="TMP"; level="Z2";'
> > > >>
> > > >> The name and level strings are used to search the GRIB
records in
> each
> > > >> file
> > > >> looking for a match.
> > > >>
> > > >> Hopefully that helps.
> > > >>
> > > >> Thanks,
> > > >> John
> > > >>
> > > >> On Wed, Jun 21, 2017 at 4:35 PM, Jinwoong Yoo via RT <
> > met_help at ucar.edu
> > > >
> > > >> wrote:
> > > >>
> > > >> >
> > > >> > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80978 >
> > > >> >
> > > >> > Hi,
> > > >> >
> > > >> > When I didn't specify -field and -config and ran the
command:
> > > >> >
> > > >> > yoo108 at halstead-fe03:
> > > >> >
*/scratch/halstead/y/yoo108/wrfAnalysis/METanal/pcp_combine* $
> > > >> > /home/yoo108/met-6.0_bugfix/bin/pcp_combine -sum
00000000_000000
> 1
> > > >> > 20050101_000000 24
> > > >> > /scratch/halstead/y/yoo108/wrfAnalysis/METanal/pcp_
> > combine/sample_wrf_
> > > >> > 2005010100V_24A.nc
> > > >> > -pcpdir
/scratch/halstead/k/khoogewi/CCRC_wrf/grib2/2005/200501
> > > >> >
> > > >> >
> > > >> >
> > > >> > I got this error below:
> > > >> >
> > > >> > DEBUG 1: [1] File
> > > >> > /scratch/halstead/k/khoogewi/CCRC_wrf/grib2/2005/200501/
> > > >> > CESM_WRF_d03_4km_200501010000.grb2
> > > >> > matches valid time of 20050101_000000
> > > >> >
> > > >> > ERROR :
> > > >> >
> > > >> > ERROR : sum_data_files() -> Cannot find a file with a
valid time
> of
> > > >> > 20041231_230000 and accumulation time of 010000 matching
the
> regular
> > > >> > expression ".*"
> > > >> >
> > > >> > ERROR :
> > > >> >
> > > >> >
> > > >> > I don't know why it tries to find 20041231_230000 file?
> > > >> > Do I need to use regular expression with it?
> > > >> >
> > > >> > Thank you.
> > > >> > Regards,
> > > >> >
> > > >> > Jinwoong
> > > >> >
> > > >> > On Wed, Jun 21, 2017 at 6:18 PM, met_help at ucar.edu via RT <
> > > >> > met_help at ucar.edu
> > > >> > > wrote:
> > > >> >
> > > >> > > NOTE: THE MET TEAM HAS LIMITED AVAILABILITY BETWEEN
5/23/17 AND
> > > >> 5/30/17.
> > > >> > > RESPONSES MAY BE DELAYED.
> > > >> > >
> > > >> > > Greetings,
> > > >> > >
> > > >> > > This message has been automatically generated in response
to the
> > > >> > > creation of a trouble ticket regarding:
> > > >> > > "Error with pcp_combine for GRIB2 files",
> > > >> > > a summary of which appears below.
> > > >> > >
> > > >> > > There is no need to reply to this message right now.
Your
> ticket
> > > has
> > > >> > been
> > > >> > > assigned an ID of [rt.rap.ucar.edu #80978].
> > > >> > >
> > > >> > > Please include the string:
> > > >> > >
> > > >> > > [rt.rap.ucar.edu #80978]
> > > >> > >
> > > >> > > in the subject line of all future correspondence about
this
> issue.
> > > To
> > > >> do
> > > >> > > so,
> > > >> > > you may reply to this message.
> > > >> > >
> > > >> > > Thank you,
> > > >> > > met_help at ucar.edu
> > > >> > >
> > > >> > >
------------------------------------------------------------
> > > >> > -------------
> > > >> > > Hi,
> > > >> > > I am trying to combine hourly WRF output files which have
been
> > > >> converted
> > > >> > to
> > > >> > > GRIB2 format using UPP.
> > > >> > >
> > > >> > >
> > > >> > > In the MET online tutorial, it is written "By default,
> PCP-Combine
> > > >> > searches
> > > >> > > for records containing GRIB code 61 (accumulated
precipitation).
> > Use
> > > >> > > the *-config
> > > >> > > config_str* option to override this default and process
other
> > > fields."
> > > >> > So I
> > > >> > > wanted to change the default for 325 APCP. But the
direction in
> > the
> > > >> > > tutorial is not clear to me.
> > > >> > >
> > > >> > > Do I need to change configure file? (Then, which config
file
> > should
> > > I
> > > >> > > change?)
> > > >> > > Or can I do this in command line?
> > > >> > >
> > > >> > > When I tried as below, I got error messages.
> > > >> > >
> > > >> > > > -sum 00000000_000000 1 20050101_000000 24 \
> > > >> > >
> > > >> > > >
> > > >> > >
/scratch/halstead/y/yoo108/wrfAnalysis/METanal/pcp_combine/
> > > >> sample_wrf_
> > > >> > > 2005010100V_24A.nc
> > > >> > > \
> > > >> > >
> > > >> > > > -pcpdir /scratch/halstead/k/khoogewi/C
> CRC_wrf/grib2/2005/200501
> > \
> > > >> > >
> > > >> > > > -field APCP \
> > > >> > >
> > > >> > > > -config 325
> > > >> > >
> > > >> > > ERROR :
> > > >> > >
> > > >> > > ERROR : yyerror() -> syntax error in file
> > > "/tmp/config_4646_0_.temp"
> > > >> > >
> > > >> > > ERROR :
> > > >> > >
> > > >> > > ERROR : line = 1
> > > >> > >
> > > >> > > ERROR :
> > > >> > >
> > > >> > > ERROR : column = 1
> > > >> > >
> > > >> > > ERROR :
> > > >> > >
> > > >> > > ERROR : text = "325"
> > > >> > >
> > > >> > > ERROR :
> > > >> > >
> > > >> > > ERROR :
> > > >> > >
> > > >> > > ERROR : 325
> > > >> > >
> > > >> > > ERROR : ^^^
> > > >> > >
> > > >> > > ERROR :
> > > >> > >
> > > >> > >
> > > >> > >
> > > >> > >
> > > >> > > Can you help?
> > > >> > > Thank you.
> > > >> > >
> > > >> > > Regards,
> > > >> > >
> > > >> > > Jinwoong Yoo
> > > >> > >
> > > >> > >
> > > >> >
> > > >> >
> > > >>
> > > >>
> > > >
> > >
> > >
> >
> >
>
>
------------------------------------------------
Subject: Error with pcp_combine for GRIB2 files
From: Jinwoong Yoo
Time: Thu Jun 22 12:41:58 2017
Hi John,
I uploaded Yoo_data2.tar file in the Yoo_data directory.
Thank you.
Regards,
Jinwoong
On Thu, Jun 22, 2017 at 2:21 PM, John Halley Gotway via RT <
met_help at ucar.edu> wrote:
> Jinwoong,
>
> I went to go grab it from this location but it appears to be empty:
> ftp://ftp.rap.ucar.edu/incoming/irap/met_help/Yoo_data/
>
> Could you please try again?
>
> Thanks,
> John
>
> On Thu, Jun 22, 2017 at 8:47 AM, Jinwoong Yoo via RT
<met_help at ucar.edu>
> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80978 >
> >
> > Hi John,
> >
> > I uploaded my sample files in a tar file.
> > If you cannot find it, please let me know.
> > Thank you.
> >
> > Regards,
> >
> > Jinwoong
> >
> > On Thu, Jun 22, 2017 at 9:57 AM, John Halley Gotway via RT <
> > met_help at ucar.edu> wrote:
> >
> > > Jinwoong,
> > >
> > > Can you please send me two sample data files so I can look more
closely
> > at
> > > the details? You can post them to our anonymois ftp site
following
> these
> > > instructions:
> > >
> > > http://www.dtcenter.org/met/users/support/met_help.php#ftp
> > >
> > > Please let me know when the data is there and I'll go grab it.
> > >
> > > Thanks,
> > > John
> > >
> > > On Thu, Jun 22, 2017 at 7:06 AM Jinwoong Yoo via RT
<met_help at ucar.edu
> >
> > > wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80978
>
> > > >
> > > > Hi John,
> > > >
> > > > As I look at the sample data using wgrib and wgrib2 under the
> directory
> > > of
> > > > data/sample_fcst/2005080700/,
> > > > they also have two lines for APCP as my wrfout files:
> > > >
> > > > 1:0:D=2005080700:APCP:sfc:kpds=61,1,0:0-24hr acc:winds in grid
> > > > direction:"Total precipitation [kg/m^2]
> > > >
> > > > 2:31408:D=2005080700:APCP:sfc:kpds=61,1,0:21-24hr acc:winds in
grid
> > > > direction:"Total precipitation [kg/m^2]
> > > > VS.
> > > >
> > > > 324:14427217:d=2004121700:APCP Total Precipitation
> > > [kg/m^2]:surface:0-1103
> > > > hour acc fcst:
> > > >
> > > > 325:14479093:d=2004121700:APCP Total Precipitation
> > > > [kg/m^2]:surface:1102-1103
> > > > hour acc fcst:
> > > >
> > > >
> > > >
> > > > But, there are a few differences between their format.
> > > > While sample grib files have "APCP" and its long name and
> > > > units separately, mines have its long name and units along
with name
> of
> > > > variable together, which part is the biggest thing I suspect.
Can MET
> > > pick
> > > > up them correctly?
> > > >
> > > > Also, mines don't have kpds column.
> > > >
> > > > Do you think these are causing error in my case?
> > > > If it is the case, how can I control MET to read these
differences?
> > > > Thanks.
> > > >
> > > > Regards,
> > > >
> > > > Jinwoong
> > > >
> > > >
> > > > On Wed, Jun 21, 2017 at 8:44 PM, Jinwoong Yoo <
> jinwoong.yoo at gmail.com>
> > > > wrote:
> > > >
> > > > > Hi John,
> > > > >
> > > > > Thank you for your quick reply.
> > > > >
> > > > > In my WRF grib2 files, I have two APCP variables as shown
below:
> > > > >
> > > > > 324:14427217:d=2004121700:APCP Total Precipitation
> > > > [kg/m^2]:surface:0-1103
> > > > > hour acc fcst:
> > > > >
> > > > > 325:14479093:d=2004121700:APCP Total Precipitation
> > > > > [kg/m^2]:surface:1102-1103 hour acc fcst:
> > > > > In my case, I would like to use values in "325" line which
is APCP
> > for
> > > > one
> > > > > hour accumulation not the total accumulation from the
> initialization
> > of
> > > > the
> > > > > simulation to the forecast time which is "324".
> > > > >
> > > > >
> > > > > Anyway,
> > > > > when I modified my command line with "-field
> > 'name="APCP";level="Z0";'
> > > > > I still got the error as below:
> > > > >
> > > > > yoo108 at halstead-fe01:
> > > > > */scratch/halstead/y/yoo108/wrfAnalysis/METanal/pcp_combine*
$
> > > > > /home/yoo108/met-6.0_bugfix/bin/pcp_combine -sum
00000000_000000 1
> > > > > 20050101_000000 24 /scratch/halstead/y/yoo108/wrf
> > Analysis/METanal/pcp_
> > > > > combine/sample_wrf_2005010100V_24A.nc -pcpdir
> > > > > /scratch/halstead/k/khoogewi/CCRC_wrf/grib2/2005/200501
-field
> > > > > 'name="APCP";level="Z0";'
> > > > >
> > > > > ERROR :
> > > > >
> > > > > ERROR : sum_data_files() -> Cannot find a file with a valid
time
> of
> > > > > 20050101_000000 and accumulation time of 010000 matching the
> regular
> > > > > expression ".*"
> > > > >
> > > > > ERROR :
> > > > >
> > > > >
> > > > > Thank you.
> > > > >
> > > > > Regards,
> > > > >
> > > > > Jinwoong
> > > > >
> > > > >
> > > > > On Wed, Jun 21, 2017 at 7:10 PM, John Halley Gotway via RT <
> > > > > met_help at ucar.edu> wrote:
> > > > >
> > > > >> Jinwoong,
> > > > >>
> > > > >> I see that you've having trouble getting pcp_combine to sum
up the
> > > data
> > > > in
> > > > >> the way you'd like.
> > > > >>
> > > > >> I think you're very close, but unfortunately, I don't
understand
> > what
> > > > you
> > > > >> mean by 325. Is the record number that you'd like to
extract from
> > the
> > > > >> GRIB2 file? Usually, its better to refer to the name of
the
> > variable
> > > > and
> > > > >> have MET find it for you rather then specifying an explicit
record
> > > > number.
> > > > >>
> > > > >> Let me show you an example for 2m temperature using sample
data
> > that's
> > > > >> included in the MET tarball. Of course it doesn't make any
sense
> to
> > > sum
> > > > >> up
> > > > >> 2m temperature values! But I'm just showing you as an
example.
> > > > >> Hopefully,
> > > > >> you can adapt the example to do what you're trying to do:
> > > > >>
> > > > >> cd met-6.0/data/sample_fcst/2005080700
> > > > >> ../../../bin/pcp_combine -sum 00000000_000000 3
20050807_120000 12
> > > > sum.nc
> > > > >> -pcpdir . \
> > > > >> -field 'name="TMP"; level="Z2";'
> > > > >>
> > > > >> DEBUG 1: [1] File ./wrfprs_ruc13_12.tm00_G212 matches valid
time
> of
> > > > >> 20050807_120000
> > > > >> DEBUG 1: [2] File ./wrfprs_ruc13_09.tm00_G212 matches valid
time
> of
> > > > >> 20050807_090000
> > > > >> DEBUG 1: [3] File ./wrfprs_ruc13_06.tm00_G212 matches valid
time
> of
> > > > >> 20050807_060000
> > > > >> DEBUG 1: [4] File ./wrfprs_ruc13_03.tm00_G212 matches valid
time
> of
> > > > >> 20050807_030000
> > > > >> DEBUG 1: [1] Reading input file:
./wrfprs_ruc13_12.tm00_G212
> > > > >> DEBUG 1: [2] Reading input file:
./wrfprs_ruc13_09.tm00_G212
> > > > >> DEBUG 1: [3] Reading input file:
./wrfprs_ruc13_06.tm00_G212
> > > > >> DEBUG 1: [4] Reading input file:
./wrfprs_ruc13_03.tm00_G212
> > > > >> DEBUG 1: Writing output file: sum.nc
> > > > >>
> > > > >> The key here is that I set: -field 'name="TMP";
level="Z2";'
> > > > >>
> > > > >> The name and level strings are used to search the GRIB
records in
> > each
> > > > >> file
> > > > >> looking for a match.
> > > > >>
> > > > >> Hopefully that helps.
> > > > >>
> > > > >> Thanks,
> > > > >> John
> > > > >>
> > > > >> On Wed, Jun 21, 2017 at 4:35 PM, Jinwoong Yoo via RT <
> > > met_help at ucar.edu
> > > > >
> > > > >> wrote:
> > > > >>
> > > > >> >
> > > > >> > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80978 >
> > > > >> >
> > > > >> > Hi,
> > > > >> >
> > > > >> > When I didn't specify -field and -config and ran the
command:
> > > > >> >
> > > > >> > yoo108 at halstead-fe03:
> > > > >> >
*/scratch/halstead/y/yoo108/wrfAnalysis/METanal/pcp_combine* $
> > > > >> > /home/yoo108/met-6.0_bugfix/bin/pcp_combine -sum
> 00000000_000000
> > 1
> > > > >> > 20050101_000000 24
> > > > >> > /scratch/halstead/y/yoo108/wrfAnalysis/METanal/pcp_
> > > combine/sample_wrf_
> > > > >> > 2005010100V_24A.nc
> > > > >> > -pcpdir
/scratch/halstead/k/khoogewi/CCRC_wrf/grib2/2005/200501
> > > > >> >
> > > > >> >
> > > > >> >
> > > > >> > I got this error below:
> > > > >> >
> > > > >> > DEBUG 1: [1] File
> > > > >> > /scratch/halstead/k/khoogewi/CCRC_wrf/grib2/2005/200501/
> > > > >> > CESM_WRF_d03_4km_200501010000.grb2
> > > > >> > matches valid time of 20050101_000000
> > > > >> >
> > > > >> > ERROR :
> > > > >> >
> > > > >> > ERROR : sum_data_files() -> Cannot find a file with a
valid
> time
> > of
> > > > >> > 20041231_230000 and accumulation time of 010000 matching
the
> > regular
> > > > >> > expression ".*"
> > > > >> >
> > > > >> > ERROR :
> > > > >> >
> > > > >> >
> > > > >> > I don't know why it tries to find 20041231_230000 file?
> > > > >> > Do I need to use regular expression with it?
> > > > >> >
> > > > >> > Thank you.
> > > > >> > Regards,
> > > > >> >
> > > > >> > Jinwoong
> > > > >> >
> > > > >> > On Wed, Jun 21, 2017 at 6:18 PM, met_help at ucar.edu via RT
<
> > > > >> > met_help at ucar.edu
> > > > >> > > wrote:
> > > > >> >
> > > > >> > > NOTE: THE MET TEAM HAS LIMITED AVAILABILITY BETWEEN
5/23/17
> AND
> > > > >> 5/30/17.
> > > > >> > > RESPONSES MAY BE DELAYED.
> > > > >> > >
> > > > >> > > Greetings,
> > > > >> > >
> > > > >> > > This message has been automatically generated in
response to
> the
> > > > >> > > creation of a trouble ticket regarding:
> > > > >> > > "Error with pcp_combine for GRIB2 files",
> > > > >> > > a summary of which appears below.
> > > > >> > >
> > > > >> > > There is no need to reply to this message right now.
Your
> > ticket
> > > > has
> > > > >> > been
> > > > >> > > assigned an ID of [rt.rap.ucar.edu #80978].
> > > > >> > >
> > > > >> > > Please include the string:
> > > > >> > >
> > > > >> > > [rt.rap.ucar.edu #80978]
> > > > >> > >
> > > > >> > > in the subject line of all future correspondence about
this
> > issue.
> > > > To
> > > > >> do
> > > > >> > > so,
> > > > >> > > you may reply to this message.
> > > > >> > >
> > > > >> > > Thank you,
> > > > >> > > met_help at ucar.edu
> > > > >> > >
> > > > >> > >
------------------------------------------------------------
> > > > >> > -------------
> > > > >> > > Hi,
> > > > >> > > I am trying to combine hourly WRF output files which
have been
> > > > >> converted
> > > > >> > to
> > > > >> > > GRIB2 format using UPP.
> > > > >> > >
> > > > >> > >
> > > > >> > > In the MET online tutorial, it is written "By default,
> > PCP-Combine
> > > > >> > searches
> > > > >> > > for records containing GRIB code 61 (accumulated
> precipitation).
> > > Use
> > > > >> > > the *-config
> > > > >> > > config_str* option to override this default and process
other
> > > > fields."
> > > > >> > So I
> > > > >> > > wanted to change the default for 325 APCP. But the
direction
> in
> > > the
> > > > >> > > tutorial is not clear to me.
> > > > >> > >
> > > > >> > > Do I need to change configure file? (Then, which config
file
> > > should
> > > > I
> > > > >> > > change?)
> > > > >> > > Or can I do this in command line?
> > > > >> > >
> > > > >> > > When I tried as below, I got error messages.
> > > > >> > >
> > > > >> > > > -sum 00000000_000000 1 20050101_000000 24 \
> > > > >> > >
> > > > >> > > >
> > > > >> > >
/scratch/halstead/y/yoo108/wrfAnalysis/METanal/pcp_combine/
> > > > >> sample_wrf_
> > > > >> > > 2005010100V_24A.nc
> > > > >> > > \
> > > > >> > >
> > > > >> > > > -pcpdir /scratch/halstead/k/khoogewi/C
> > CRC_wrf/grib2/2005/200501
> > > \
> > > > >> > >
> > > > >> > > > -field APCP \
> > > > >> > >
> > > > >> > > > -config 325
> > > > >> > >
> > > > >> > > ERROR :
> > > > >> > >
> > > > >> > > ERROR : yyerror() -> syntax error in file
> > > > "/tmp/config_4646_0_.temp"
> > > > >> > >
> > > > >> > > ERROR :
> > > > >> > >
> > > > >> > > ERROR : line = 1
> > > > >> > >
> > > > >> > > ERROR :
> > > > >> > >
> > > > >> > > ERROR : column = 1
> > > > >> > >
> > > > >> > > ERROR :
> > > > >> > >
> > > > >> > > ERROR : text = "325"
> > > > >> > >
> > > > >> > > ERROR :
> > > > >> > >
> > > > >> > > ERROR :
> > > > >> > >
> > > > >> > > ERROR : 325
> > > > >> > >
> > > > >> > > ERROR : ^^^
> > > > >> > >
> > > > >> > > ERROR :
> > > > >> > >
> > > > >> > >
> > > > >> > >
> > > > >> > >
> > > > >> > > Can you help?
> > > > >> > > Thank you.
> > > > >> > >
> > > > >> > > Regards,
> > > > >> > >
> > > > >> > > Jinwoong Yoo
> > > > >> > >
> > > > >> > >
> > > > >> >
> > > > >> >
> > > > >>
> > > > >>
> > > > >
> > > >
> > > >
> > >
> > >
> >
> >
>
>
------------------------------------------------
Subject: Error with pcp_combine for GRIB2 files
From: John Halley Gotway
Time: Thu Jun 22 13:37:45 2017
Jinwoong,
Great, thanks for sending this sample data.
Based on the commands you were running, it looks like you're trying to
compute 24-hour accumulations. Your GRIB2 files contain 2 different
records for APCP, one is a 1-hour accumulation and the second is a
runtime
accumulation.
Let me demonstrate two options for compute 24-hour accumulations.
(1) Using the pcp_combine "sum" to sum up the 1-hour records.
First, let me point out that the errors you were getting were caused
the
valid time you requested. Four times are required for the "sum"
command:
init_time, in_accum, valid_time, and out_accum
You were requesting a 24-hour accumulation with a valid time of
200501010000. That told pcp_combine to search for 1-hourly
accumulations
starting at 2004123100 and ending at 2005010100. But you don't have
any
data in 2014. Running pcp_combine using these options works fine:
met-6.0/bin/pcp_combine \
-sum 00000000_000000 1 20050102_000000 24 \
sample_wrf_2005010100V_24A.nc -pcpdir CESM_WRF
This is telling it to search from 2005010100 through 2005010200, and
your
data covers that time period.
(2) Instead of summing up the hourly accumulations, you could simply
subtract the runtime accumulations:
met-6.0/bin/pcp_combine \
-subtract CESM_WRF/CESM_WRF_d03_4km_200501020000.grb2 384 \
CESM_WRF/CESM_WRF_d03_4km_200501010000.grb2 360 \
CESM_APCP_20050101_to_20050102.nc
This tells pcp_combine to find the 384 hour precip accumulation from
first
first file and 360 hour accumulation from the second find and subtract
them. Their difference is the precip that occurred between hours 360
and
384.
Personally, I think option (2) is much simpler that option (1), since
it
only requires 2 files instead of 24, but way either works.
After running option (2), I ran the following command to plot the
output:
met-6.0/bin/plot_data_plane \
CESM_APCP_20050101_to_20050102.nc \
CESM_APCP_20050101_to_20050102.ps \
'name="APCP_24"; level="(*,*)";'
The resulting image is attached.
Thanks,
John
On Thu, Jun 22, 2017 at 12:41 PM, Jinwoong Yoo via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80978 >
>
> Hi John,
>
> I uploaded Yoo_data2.tar file in the Yoo_data directory.
> Thank you.
>
> Regards,
>
> Jinwoong
>
> On Thu, Jun 22, 2017 at 2:21 PM, John Halley Gotway via RT <
> met_help at ucar.edu> wrote:
>
> > Jinwoong,
> >
> > I went to go grab it from this location but it appears to be
empty:
> > ftp://ftp.rap.ucar.edu/incoming/irap/met_help/Yoo_data/
> >
> > Could you please try again?
> >
> > Thanks,
> > John
> >
> > On Thu, Jun 22, 2017 at 8:47 AM, Jinwoong Yoo via RT
<met_help at ucar.edu>
> > wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80978 >
> > >
> > > Hi John,
> > >
> > > I uploaded my sample files in a tar file.
> > > If you cannot find it, please let me know.
> > > Thank you.
> > >
> > > Regards,
> > >
> > > Jinwoong
> > >
> > > On Thu, Jun 22, 2017 at 9:57 AM, John Halley Gotway via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > > Jinwoong,
> > > >
> > > > Can you please send me two sample data files so I can look
more
> closely
> > > at
> > > > the details? You can post them to our anonymois ftp site
following
> > these
> > > > instructions:
> > > >
> > > > http://www.dtcenter.org/met/users/support/met_help.php#ftp
> > > >
> > > > Please let me know when the data is there and I'll go grab it.
> > > >
> > > > Thanks,
> > > > John
> > > >
> > > > On Thu, Jun 22, 2017 at 7:06 AM Jinwoong Yoo via RT <
> met_help at ucar.edu
> > >
> > > > wrote:
> > > >
> > > > >
> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80978 >
> > > > >
> > > > > Hi John,
> > > > >
> > > > > As I look at the sample data using wgrib and wgrib2 under
the
> > directory
> > > > of
> > > > > data/sample_fcst/2005080700/,
> > > > > they also have two lines for APCP as my wrfout files:
> > > > >
> > > > > 1:0:D=2005080700:APCP:sfc:kpds=61,1,0:0-24hr acc:winds in
grid
> > > > > direction:"Total precipitation [kg/m^2]
> > > > >
> > > > > 2:31408:D=2005080700:APCP:sfc:kpds=61,1,0:21-24hr acc:winds
in
> grid
> > > > > direction:"Total precipitation [kg/m^2]
> > > > > VS.
> > > > >
> > > > > 324:14427217:d=2004121700:APCP Total Precipitation
> > > > [kg/m^2]:surface:0-1103
> > > > > hour acc fcst:
> > > > >
> > > > > 325:14479093:d=2004121700:APCP Total Precipitation
> > > > > [kg/m^2]:surface:1102-1103
> > > > > hour acc fcst:
> > > > >
> > > > >
> > > > >
> > > > > But, there are a few differences between their format.
> > > > > While sample grib files have "APCP" and its long name and
> > > > > units separately, mines have its long name and units along
with
> name
> > of
> > > > > variable together, which part is the biggest thing I
suspect. Can
> MET
> > > > pick
> > > > > up them correctly?
> > > > >
> > > > > Also, mines don't have kpds column.
> > > > >
> > > > > Do you think these are causing error in my case?
> > > > > If it is the case, how can I control MET to read these
differences?
> > > > > Thanks.
> > > > >
> > > > > Regards,
> > > > >
> > > > > Jinwoong
> > > > >
> > > > >
> > > > > On Wed, Jun 21, 2017 at 8:44 PM, Jinwoong Yoo <
> > jinwoong.yoo at gmail.com>
> > > > > wrote:
> > > > >
> > > > > > Hi John,
> > > > > >
> > > > > > Thank you for your quick reply.
> > > > > >
> > > > > > In my WRF grib2 files, I have two APCP variables as shown
below:
> > > > > >
> > > > > > 324:14427217:d=2004121700:APCP Total Precipitation
> > > > > [kg/m^2]:surface:0-1103
> > > > > > hour acc fcst:
> > > > > >
> > > > > > 325:14479093:d=2004121700:APCP Total Precipitation
> > > > > > [kg/m^2]:surface:1102-1103 hour acc fcst:
> > > > > > In my case, I would like to use values in "325" line which
is
> APCP
> > > for
> > > > > one
> > > > > > hour accumulation not the total accumulation from the
> > initialization
> > > of
> > > > > the
> > > > > > simulation to the forecast time which is "324".
> > > > > >
> > > > > >
> > > > > > Anyway,
> > > > > > when I modified my command line with "-field
> > > 'name="APCP";level="Z0";'
> > > > > > I still got the error as below:
> > > > > >
> > > > > > yoo108 at halstead-fe01:
> > > > > >
*/scratch/halstead/y/yoo108/wrfAnalysis/METanal/pcp_combine* $
> > > > > > /home/yoo108/met-6.0_bugfix/bin/pcp_combine -sum
> 00000000_000000 1
> > > > > > 20050101_000000 24 /scratch/halstead/y/yoo108/wrf
> > > Analysis/METanal/pcp_
> > > > > > combine/sample_wrf_2005010100V_24A.nc -pcpdir
> > > > > > /scratch/halstead/k/khoogewi/CCRC_wrf/grib2/2005/200501
-field
> > > > > > 'name="APCP";level="Z0";'
> > > > > >
> > > > > > ERROR :
> > > > > >
> > > > > > ERROR : sum_data_files() -> Cannot find a file with a
valid time
> > of
> > > > > > 20050101_000000 and accumulation time of 010000 matching
the
> > regular
> > > > > > expression ".*"
> > > > > >
> > > > > > ERROR :
> > > > > >
> > > > > >
> > > > > > Thank you.
> > > > > >
> > > > > > Regards,
> > > > > >
> > > > > > Jinwoong
> > > > > >
> > > > > >
> > > > > > On Wed, Jun 21, 2017 at 7:10 PM, John Halley Gotway via RT
<
> > > > > > met_help at ucar.edu> wrote:
> > > > > >
> > > > > >> Jinwoong,
> > > > > >>
> > > > > >> I see that you've having trouble getting pcp_combine to
sum up
> the
> > > > data
> > > > > in
> > > > > >> the way you'd like.
> > > > > >>
> > > > > >> I think you're very close, but unfortunately, I don't
understand
> > > what
> > > > > you
> > > > > >> mean by 325. Is the record number that you'd like to
extract
> from
> > > the
> > > > > >> GRIB2 file? Usually, its better to refer to the name of
the
> > > variable
> > > > > and
> > > > > >> have MET find it for you rather then specifying an
explicit
> record
> > > > > number.
> > > > > >>
> > > > > >> Let me show you an example for 2m temperature using
sample data
> > > that's
> > > > > >> included in the MET tarball. Of course it doesn't make
any
> sense
> > to
> > > > sum
> > > > > >> up
> > > > > >> 2m temperature values! But I'm just showing you as an
example.
> > > > > >> Hopefully,
> > > > > >> you can adapt the example to do what you're trying to do:
> > > > > >>
> > > > > >> cd met-6.0/data/sample_fcst/2005080700
> > > > > >> ../../../bin/pcp_combine -sum 00000000_000000 3
20050807_120000
> 12
> > > > > sum.nc
> > > > > >> -pcpdir . \
> > > > > >> -field 'name="TMP"; level="Z2";'
> > > > > >>
> > > > > >> DEBUG 1: [1] File ./wrfprs_ruc13_12.tm00_G212 matches
valid time
> > of
> > > > > >> 20050807_120000
> > > > > >> DEBUG 1: [2] File ./wrfprs_ruc13_09.tm00_G212 matches
valid time
> > of
> > > > > >> 20050807_090000
> > > > > >> DEBUG 1: [3] File ./wrfprs_ruc13_06.tm00_G212 matches
valid time
> > of
> > > > > >> 20050807_060000
> > > > > >> DEBUG 1: [4] File ./wrfprs_ruc13_03.tm00_G212 matches
valid time
> > of
> > > > > >> 20050807_030000
> > > > > >> DEBUG 1: [1] Reading input file:
./wrfprs_ruc13_12.tm00_G212
> > > > > >> DEBUG 1: [2] Reading input file:
./wrfprs_ruc13_09.tm00_G212
> > > > > >> DEBUG 1: [3] Reading input file:
./wrfprs_ruc13_06.tm00_G212
> > > > > >> DEBUG 1: [4] Reading input file:
./wrfprs_ruc13_03.tm00_G212
> > > > > >> DEBUG 1: Writing output file: sum.nc
> > > > > >>
> > > > > >> The key here is that I set: -field 'name="TMP";
level="Z2";'
> > > > > >>
> > > > > >> The name and level strings are used to search the GRIB
records
> in
> > > each
> > > > > >> file
> > > > > >> looking for a match.
> > > > > >>
> > > > > >> Hopefully that helps.
> > > > > >>
> > > > > >> Thanks,
> > > > > >> John
> > > > > >>
> > > > > >> On Wed, Jun 21, 2017 at 4:35 PM, Jinwoong Yoo via RT <
> > > > met_help at ucar.edu
> > > > > >
> > > > > >> wrote:
> > > > > >>
> > > > > >> >
> > > > > >> > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80978
> >
> > > > > >> >
> > > > > >> > Hi,
> > > > > >> >
> > > > > >> > When I didn't specify -field and -config and ran the
command:
> > > > > >> >
> > > > > >> > yoo108 at halstead-fe03:
> > > > > >> >
*/scratch/halstead/y/yoo108/wrfAnalysis/METanal/pcp_combine*
> $
> > > > > >> > /home/yoo108/met-6.0_bugfix/bin/pcp_combine -sum
> > 00000000_000000
> > > 1
> > > > > >> > 20050101_000000 24
> > > > > >> > /scratch/halstead/y/yoo108/wrfAnalysis/METanal/pcp_
> > > > combine/sample_wrf_
> > > > > >> > 2005010100V_24A.nc
> > > > > >> > -pcpdir /scratch/halstead/k/khoogewi/
> CCRC_wrf/grib2/2005/200501
> > > > > >> >
> > > > > >> >
> > > > > >> >
> > > > > >> > I got this error below:
> > > > > >> >
> > > > > >> > DEBUG 1: [1] File
> > > > > >> >
/scratch/halstead/k/khoogewi/CCRC_wrf/grib2/2005/200501/
> > > > > >> > CESM_WRF_d03_4km_200501010000.grb2
> > > > > >> > matches valid time of 20050101_000000
> > > > > >> >
> > > > > >> > ERROR :
> > > > > >> >
> > > > > >> > ERROR : sum_data_files() -> Cannot find a file with a
valid
> > time
> > > of
> > > > > >> > 20041231_230000 and accumulation time of 010000
matching the
> > > regular
> > > > > >> > expression ".*"
> > > > > >> >
> > > > > >> > ERROR :
> > > > > >> >
> > > > > >> >
> > > > > >> > I don't know why it tries to find 20041231_230000 file?
> > > > > >> > Do I need to use regular expression with it?
> > > > > >> >
> > > > > >> > Thank you.
> > > > > >> > Regards,
> > > > > >> >
> > > > > >> > Jinwoong
> > > > > >> >
> > > > > >> > On Wed, Jun 21, 2017 at 6:18 PM, met_help at ucar.edu via
RT <
> > > > > >> > met_help at ucar.edu
> > > > > >> > > wrote:
> > > > > >> >
> > > > > >> > > NOTE: THE MET TEAM HAS LIMITED AVAILABILITY BETWEEN
5/23/17
> > AND
> > > > > >> 5/30/17.
> > > > > >> > > RESPONSES MAY BE DELAYED.
> > > > > >> > >
> > > > > >> > > Greetings,
> > > > > >> > >
> > > > > >> > > This message has been automatically generated in
response to
> > the
> > > > > >> > > creation of a trouble ticket regarding:
> > > > > >> > > "Error with pcp_combine for GRIB2 files",
> > > > > >> > > a summary of which appears below.
> > > > > >> > >
> > > > > >> > > There is no need to reply to this message right now.
Your
> > > ticket
> > > > > has
> > > > > >> > been
> > > > > >> > > assigned an ID of [rt.rap.ucar.edu #80978].
> > > > > >> > >
> > > > > >> > > Please include the string:
> > > > > >> > >
> > > > > >> > > [rt.rap.ucar.edu #80978]
> > > > > >> > >
> > > > > >> > > in the subject line of all future correspondence
about this
> > > issue.
> > > > > To
> > > > > >> do
> > > > > >> > > so,
> > > > > >> > > you may reply to this message.
> > > > > >> > >
> > > > > >> > > Thank you,
> > > > > >> > > met_help at ucar.edu
> > > > > >> > >
> > > > > >> > > ------------------------------
> ------------------------------
> > > > > >> > -------------
> > > > > >> > > Hi,
> > > > > >> > > I am trying to combine hourly WRF output files which
have
> been
> > > > > >> converted
> > > > > >> > to
> > > > > >> > > GRIB2 format using UPP.
> > > > > >> > >
> > > > > >> > >
> > > > > >> > > In the MET online tutorial, it is written "By
default,
> > > PCP-Combine
> > > > > >> > searches
> > > > > >> > > for records containing GRIB code 61 (accumulated
> > precipitation).
> > > > Use
> > > > > >> > > the *-config
> > > > > >> > > config_str* option to override this default and
process
> other
> > > > > fields."
> > > > > >> > So I
> > > > > >> > > wanted to change the default for 325 APCP. But the
direction
> > in
> > > > the
> > > > > >> > > tutorial is not clear to me.
> > > > > >> > >
> > > > > >> > > Do I need to change configure file? (Then, which
config file
> > > > should
> > > > > I
> > > > > >> > > change?)
> > > > > >> > > Or can I do this in command line?
> > > > > >> > >
> > > > > >> > > When I tried as below, I got error messages.
> > > > > >> > >
> > > > > >> > > > -sum 00000000_000000 1 20050101_000000 24 \
> > > > > >> > >
> > > > > >> > > >
> > > > > >> > >
/scratch/halstead/y/yoo108/wrfAnalysis/METanal/pcp_combine/
> > > > > >> sample_wrf_
> > > > > >> > > 2005010100V_24A.nc
> > > > > >> > > \
> > > > > >> > >
> > > > > >> > > > -pcpdir /scratch/halstead/k/khoogewi/C
> > > CRC_wrf/grib2/2005/200501
> > > > \
> > > > > >> > >
> > > > > >> > > > -field APCP \
> > > > > >> > >
> > > > > >> > > > -config 325
> > > > > >> > >
> > > > > >> > > ERROR :
> > > > > >> > >
> > > > > >> > > ERROR : yyerror() -> syntax error in file
> > > > > "/tmp/config_4646_0_.temp"
> > > > > >> > >
> > > > > >> > > ERROR :
> > > > > >> > >
> > > > > >> > > ERROR : line = 1
> > > > > >> > >
> > > > > >> > > ERROR :
> > > > > >> > >
> > > > > >> > > ERROR : column = 1
> > > > > >> > >
> > > > > >> > > ERROR :
> > > > > >> > >
> > > > > >> > > ERROR : text = "325"
> > > > > >> > >
> > > > > >> > > ERROR :
> > > > > >> > >
> > > > > >> > > ERROR :
> > > > > >> > >
> > > > > >> > > ERROR : 325
> > > > > >> > >
> > > > > >> > > ERROR : ^^^
> > > > > >> > >
> > > > > >> > > ERROR :
> > > > > >> > >
> > > > > >> > >
> > > > > >> > >
> > > > > >> > >
> > > > > >> > > Can you help?
> > > > > >> > > Thank you.
> > > > > >> > >
> > > > > >> > > Regards,
> > > > > >> > >
> > > > > >> > > Jinwoong Yoo
> > > > > >> > >
> > > > > >> > >
> > > > > >> >
> > > > > >> >
> > > > > >>
> > > > > >>
> > > > > >
> > > > >
> > > > >
> > > >
> > > >
> > >
> > >
> >
> >
>
>
------------------------------------------------
Subject: Error with pcp_combine for GRIB2 files
From: Jinwoong Yoo
Time: Thu Jun 22 14:05:36 2017
Hi John,
Thank you very much for your kind message!
I appreciate it.
Let me try to reproduce what you did myself.
Thank you.
Regards,
Jinwoong
On Thu, Jun 22, 2017 at 3:37 PM, John Halley Gotway via RT <
met_help at ucar.edu> wrote:
> Jinwoong,
>
> Great, thanks for sending this sample data.
>
> Based on the commands you were running, it looks like you're trying
to
> compute 24-hour accumulations. Your GRIB2 files contain 2 different
> records for APCP, one is a 1-hour accumulation and the second is a
runtime
> accumulation.
>
> Let me demonstrate two options for compute 24-hour accumulations.
>
> (1) Using the pcp_combine "sum" to sum up the 1-hour records.
>
> First, let me point out that the errors you were getting were caused
the
> valid time you requested. Four times are required for the "sum"
command:
> init_time, in_accum, valid_time, and out_accum
>
> You were requesting a 24-hour accumulation with a valid time of
> 200501010000. That told pcp_combine to search for 1-hourly
accumulations
> starting at 2004123100 and ending at 2005010100. But you don't have
any
> data in 2014. Running pcp_combine using these options works fine:
>
> met-6.0/bin/pcp_combine \
> -sum 00000000_000000 1 20050102_000000 24 \
> sample_wrf_2005010100V_24A.nc -pcpdir CESM_WRF
>
> This is telling it to search from 2005010100 through 2005010200, and
your
> data covers that time period.
>
> (2) Instead of summing up the hourly accumulations, you could simply
> subtract the runtime accumulations:
>
> met-6.0/bin/pcp_combine \
> -subtract CESM_WRF/CESM_WRF_d03_4km_200501020000.grb2 384 \
> CESM_WRF/CESM_WRF_d03_4km_200501010000.grb2 360 \
> CESM_APCP_20050101_to_20050102.nc
>
> This tells pcp_combine to find the 384 hour precip accumulation from
first
> first file and 360 hour accumulation from the second find and
subtract
> them. Their difference is the precip that occurred between hours
360 and
> 384.
>
> Personally, I think option (2) is much simpler that option (1),
since it
> only requires 2 files instead of 24, but way either works.
>
> After running option (2), I ran the following command to plot the
output:
>
> met-6.0/bin/plot_data_plane \
> CESM_APCP_20050101_to_20050102.nc \
> CESM_APCP_20050101_to_20050102.ps \
> 'name="APCP_24"; level="(*,*)";'
>
> The resulting image is attached.
>
> Thanks,
> John
>
> On Thu, Jun 22, 2017 at 12:41 PM, Jinwoong Yoo via RT
<met_help at ucar.edu>
> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80978 >
> >
> > Hi John,
> >
> > I uploaded Yoo_data2.tar file in the Yoo_data directory.
> > Thank you.
> >
> > Regards,
> >
> > Jinwoong
> >
> > On Thu, Jun 22, 2017 at 2:21 PM, John Halley Gotway via RT <
> > met_help at ucar.edu> wrote:
> >
> > > Jinwoong,
> > >
> > > I went to go grab it from this location but it appears to be
empty:
> > > ftp://ftp.rap.ucar.edu/incoming/irap/met_help/Yoo_data/
> > >
> > > Could you please try again?
> > >
> > > Thanks,
> > > John
> > >
> > > On Thu, Jun 22, 2017 at 8:47 AM, Jinwoong Yoo via RT <
> met_help at ucar.edu>
> > > wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80978
>
> > > >
> > > > Hi John,
> > > >
> > > > I uploaded my sample files in a tar file.
> > > > If you cannot find it, please let me know.
> > > > Thank you.
> > > >
> > > > Regards,
> > > >
> > > > Jinwoong
> > > >
> > > > On Thu, Jun 22, 2017 at 9:57 AM, John Halley Gotway via RT <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > > > Jinwoong,
> > > > >
> > > > > Can you please send me two sample data files so I can look
more
> > closely
> > > > at
> > > > > the details? You can post them to our anonymois ftp site
following
> > > these
> > > > > instructions:
> > > > >
> > > > > http://www.dtcenter.org/met/users/support/met_help.php#ftp
> > > > >
> > > > > Please let me know when the data is there and I'll go grab
it.
> > > > >
> > > > > Thanks,
> > > > > John
> > > > >
> > > > > On Thu, Jun 22, 2017 at 7:06 AM Jinwoong Yoo via RT <
> > met_help at ucar.edu
> > > >
> > > > > wrote:
> > > > >
> > > > > >
> > > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80978 >
> > > > > >
> > > > > > Hi John,
> > > > > >
> > > > > > As I look at the sample data using wgrib and wgrib2 under
the
> > > directory
> > > > > of
> > > > > > data/sample_fcst/2005080700/,
> > > > > > they also have two lines for APCP as my wrfout files:
> > > > > >
> > > > > > 1:0:D=2005080700:APCP:sfc:kpds=61,1,0:0-24hr acc:winds in
grid
> > > > > > direction:"Total precipitation [kg/m^2]
> > > > > >
> > > > > > 2:31408:D=2005080700:APCP:sfc:kpds=61,1,0:21-24hr
acc:winds in
> > grid
> > > > > > direction:"Total precipitation [kg/m^2]
> > > > > > VS.
> > > > > >
> > > > > > 324:14427217:d=2004121700:APCP Total Precipitation
> > > > > [kg/m^2]:surface:0-1103
> > > > > > hour acc fcst:
> > > > > >
> > > > > > 325:14479093:d=2004121700:APCP Total Precipitation
> > > > > > [kg/m^2]:surface:1102-1103
> > > > > > hour acc fcst:
> > > > > >
> > > > > >
> > > > > >
> > > > > > But, there are a few differences between their format.
> > > > > > While sample grib files have "APCP" and its long name and
> > > > > > units separately, mines have its long name and units along
with
> > name
> > > of
> > > > > > variable together, which part is the biggest thing I
suspect. Can
> > MET
> > > > > pick
> > > > > > up them correctly?
> > > > > >
> > > > > > Also, mines don't have kpds column.
> > > > > >
> > > > > > Do you think these are causing error in my case?
> > > > > > If it is the case, how can I control MET to read these
> differences?
> > > > > > Thanks.
> > > > > >
> > > > > > Regards,
> > > > > >
> > > > > > Jinwoong
> > > > > >
> > > > > >
> > > > > > On Wed, Jun 21, 2017 at 8:44 PM, Jinwoong Yoo <
> > > jinwoong.yoo at gmail.com>
> > > > > > wrote:
> > > > > >
> > > > > > > Hi John,
> > > > > > >
> > > > > > > Thank you for your quick reply.
> > > > > > >
> > > > > > > In my WRF grib2 files, I have two APCP variables as
shown
> below:
> > > > > > >
> > > > > > > 324:14427217:d=2004121700:APCP Total Precipitation
> > > > > > [kg/m^2]:surface:0-1103
> > > > > > > hour acc fcst:
> > > > > > >
> > > > > > > 325:14479093:d=2004121700:APCP Total Precipitation
> > > > > > > [kg/m^2]:surface:1102-1103 hour acc fcst:
> > > > > > > In my case, I would like to use values in "325" line
which is
> > APCP
> > > > for
> > > > > > one
> > > > > > > hour accumulation not the total accumulation from the
> > > initialization
> > > > of
> > > > > > the
> > > > > > > simulation to the forecast time which is "324".
> > > > > > >
> > > > > > >
> > > > > > > Anyway,
> > > > > > > when I modified my command line with "-field
> > > > 'name="APCP";level="Z0";'
> > > > > > > I still got the error as below:
> > > > > > >
> > > > > > > yoo108 at halstead-fe01:
> > > > > > >
*/scratch/halstead/y/yoo108/wrfAnalysis/METanal/pcp_combine* $
> > > > > > > /home/yoo108/met-6.0_bugfix/bin/pcp_combine -sum
> > 00000000_000000 1
> > > > > > > 20050101_000000 24 /scratch/halstead/y/yoo108/wrf
> > > > Analysis/METanal/pcp_
> > > > > > > combine/sample_wrf_2005010100V_24A.nc -pcpdir
> > > > > > > /scratch/halstead/k/khoogewi/CCRC_wrf/grib2/2005/200501
-field
> > > > > > > 'name="APCP";level="Z0";'
> > > > > > >
> > > > > > > ERROR :
> > > > > > >
> > > > > > > ERROR : sum_data_files() -> Cannot find a file with a
valid
> time
> > > of
> > > > > > > 20050101_000000 and accumulation time of 010000 matching
the
> > > regular
> > > > > > > expression ".*"
> > > > > > >
> > > > > > > ERROR :
> > > > > > >
> > > > > > >
> > > > > > > Thank you.
> > > > > > >
> > > > > > > Regards,
> > > > > > >
> > > > > > > Jinwoong
> > > > > > >
> > > > > > >
> > > > > > > On Wed, Jun 21, 2017 at 7:10 PM, John Halley Gotway via
RT <
> > > > > > > met_help at ucar.edu> wrote:
> > > > > > >
> > > > > > >> Jinwoong,
> > > > > > >>
> > > > > > >> I see that you've having trouble getting pcp_combine to
sum up
> > the
> > > > > data
> > > > > > in
> > > > > > >> the way you'd like.
> > > > > > >>
> > > > > > >> I think you're very close, but unfortunately, I don't
> understand
> > > > what
> > > > > > you
> > > > > > >> mean by 325. Is the record number that you'd like to
extract
> > from
> > > > the
> > > > > > >> GRIB2 file? Usually, its better to refer to the name
of the
> > > > variable
> > > > > > and
> > > > > > >> have MET find it for you rather then specifying an
explicit
> > record
> > > > > > number.
> > > > > > >>
> > > > > > >> Let me show you an example for 2m temperature using
sample
> data
> > > > that's
> > > > > > >> included in the MET tarball. Of course it doesn't make
any
> > sense
> > > to
> > > > > sum
> > > > > > >> up
> > > > > > >> 2m temperature values! But I'm just showing you as an
> example.
> > > > > > >> Hopefully,
> > > > > > >> you can adapt the example to do what you're trying to
do:
> > > > > > >>
> > > > > > >> cd met-6.0/data/sample_fcst/2005080700
> > > > > > >> ../../../bin/pcp_combine -sum 00000000_000000 3
> 20050807_120000
> > 12
> > > > > > sum.nc
> > > > > > >> -pcpdir . \
> > > > > > >> -field 'name="TMP"; level="Z2";'
> > > > > > >>
> > > > > > >> DEBUG 1: [1] File ./wrfprs_ruc13_12.tm00_G212 matches
valid
> time
> > > of
> > > > > > >> 20050807_120000
> > > > > > >> DEBUG 1: [2] File ./wrfprs_ruc13_09.tm00_G212 matches
valid
> time
> > > of
> > > > > > >> 20050807_090000
> > > > > > >> DEBUG 1: [3] File ./wrfprs_ruc13_06.tm00_G212 matches
valid
> time
> > > of
> > > > > > >> 20050807_060000
> > > > > > >> DEBUG 1: [4] File ./wrfprs_ruc13_03.tm00_G212 matches
valid
> time
> > > of
> > > > > > >> 20050807_030000
> > > > > > >> DEBUG 1: [1] Reading input file:
./wrfprs_ruc13_12.tm00_G212
> > > > > > >> DEBUG 1: [2] Reading input file:
./wrfprs_ruc13_09.tm00_G212
> > > > > > >> DEBUG 1: [3] Reading input file:
./wrfprs_ruc13_06.tm00_G212
> > > > > > >> DEBUG 1: [4] Reading input file:
./wrfprs_ruc13_03.tm00_G212
> > > > > > >> DEBUG 1: Writing output file: sum.nc
> > > > > > >>
> > > > > > >> The key here is that I set: -field 'name="TMP";
level="Z2";'
> > > > > > >>
> > > > > > >> The name and level strings are used to search the GRIB
records
> > in
> > > > each
> > > > > > >> file
> > > > > > >> looking for a match.
> > > > > > >>
> > > > > > >> Hopefully that helps.
> > > > > > >>
> > > > > > >> Thanks,
> > > > > > >> John
> > > > > > >>
> > > > > > >> On Wed, Jun 21, 2017 at 4:35 PM, Jinwoong Yoo via RT <
> > > > > met_help at ucar.edu
> > > > > > >
> > > > > > >> wrote:
> > > > > > >>
> > > > > > >> >
> > > > > > >> > <URL: https://rt.rap.ucar.edu/rt/
> Ticket/Display.html?id=80978
> > >
> > > > > > >> >
> > > > > > >> > Hi,
> > > > > > >> >
> > > > > > >> > When I didn't specify -field and -config and ran the
> command:
> > > > > > >> >
> > > > > > >> > yoo108 at halstead-fe03:
> > > > > > >> > */scratch/halstead/y/yoo108/wrfAnalysis/METanal/pcp_
> combine*
> > $
> > > > > > >> > /home/yoo108/met-6.0_bugfix/bin/pcp_combine -sum
> > > 00000000_000000
> > > > 1
> > > > > > >> > 20050101_000000 24
> > > > > > >> > /scratch/halstead/y/yoo108/wrfAnalysis/METanal/pcp_
> > > > > combine/sample_wrf_
> > > > > > >> > 2005010100V_24A.nc
> > > > > > >> > -pcpdir /scratch/halstead/k/khoogewi/
> > CCRC_wrf/grib2/2005/200501
> > > > > > >> >
> > > > > > >> >
> > > > > > >> >
> > > > > > >> > I got this error below:
> > > > > > >> >
> > > > > > >> > DEBUG 1: [1] File
> > > > > > >> >
/scratch/halstead/k/khoogewi/CCRC_wrf/grib2/2005/200501/
> > > > > > >> > CESM_WRF_d03_4km_200501010000.grb2
> > > > > > >> > matches valid time of 20050101_000000
> > > > > > >> >
> > > > > > >> > ERROR :
> > > > > > >> >
> > > > > > >> > ERROR : sum_data_files() -> Cannot find a file with
a valid
> > > time
> > > > of
> > > > > > >> > 20041231_230000 and accumulation time of 010000
matching the
> > > > regular
> > > > > > >> > expression ".*"
> > > > > > >> >
> > > > > > >> > ERROR :
> > > > > > >> >
> > > > > > >> >
> > > > > > >> > I don't know why it tries to find 20041231_230000
file?
> > > > > > >> > Do I need to use regular expression with it?
> > > > > > >> >
> > > > > > >> > Thank you.
> > > > > > >> > Regards,
> > > > > > >> >
> > > > > > >> > Jinwoong
> > > > > > >> >
> > > > > > >> > On Wed, Jun 21, 2017 at 6:18 PM, met_help at ucar.edu
via RT <
> > > > > > >> > met_help at ucar.edu
> > > > > > >> > > wrote:
> > > > > > >> >
> > > > > > >> > > NOTE: THE MET TEAM HAS LIMITED AVAILABILITY BETWEEN
> 5/23/17
> > > AND
> > > > > > >> 5/30/17.
> > > > > > >> > > RESPONSES MAY BE DELAYED.
> > > > > > >> > >
> > > > > > >> > > Greetings,
> > > > > > >> > >
> > > > > > >> > > This message has been automatically generated in
response
> to
> > > the
> > > > > > >> > > creation of a trouble ticket regarding:
> > > > > > >> > > "Error with pcp_combine for GRIB2 files",
> > > > > > >> > > a summary of which appears below.
> > > > > > >> > >
> > > > > > >> > > There is no need to reply to this message right
now. Your
> > > > ticket
> > > > > > has
> > > > > > >> > been
> > > > > > >> > > assigned an ID of [rt.rap.ucar.edu #80978].
> > > > > > >> > >
> > > > > > >> > > Please include the string:
> > > > > > >> > >
> > > > > > >> > > [rt.rap.ucar.edu #80978]
> > > > > > >> > >
> > > > > > >> > > in the subject line of all future correspondence
about
> this
> > > > issue.
> > > > > > To
> > > > > > >> do
> > > > > > >> > > so,
> > > > > > >> > > you may reply to this message.
> > > > > > >> > >
> > > > > > >> > > Thank you,
> > > > > > >> > > met_help at ucar.edu
> > > > > > >> > >
> > > > > > >> > > ------------------------------
> > ------------------------------
> > > > > > >> > -------------
> > > > > > >> > > Hi,
> > > > > > >> > > I am trying to combine hourly WRF output files
which have
> > been
> > > > > > >> converted
> > > > > > >> > to
> > > > > > >> > > GRIB2 format using UPP.
> > > > > > >> > >
> > > > > > >> > >
> > > > > > >> > > In the MET online tutorial, it is written "By
default,
> > > > PCP-Combine
> > > > > > >> > searches
> > > > > > >> > > for records containing GRIB code 61 (accumulated
> > > precipitation).
> > > > > Use
> > > > > > >> > > the *-config
> > > > > > >> > > config_str* option to override this default and
process
> > other
> > > > > > fields."
> > > > > > >> > So I
> > > > > > >> > > wanted to change the default for 325 APCP. But the
> direction
> > > in
> > > > > the
> > > > > > >> > > tutorial is not clear to me.
> > > > > > >> > >
> > > > > > >> > > Do I need to change configure file? (Then, which
config
> file
> > > > > should
> > > > > > I
> > > > > > >> > > change?)
> > > > > > >> > > Or can I do this in command line?
> > > > > > >> > >
> > > > > > >> > > When I tried as below, I got error messages.
> > > > > > >> > >
> > > > > > >> > > > -sum 00000000_000000 1 20050101_000000 24 \
> > > > > > >> > >
> > > > > > >> > > >
> > > > > > >> > > /scratch/halstead/y/yoo108/wrfAnalysis/METanal/pcp_
> combine/
> > > > > > >> sample_wrf_
> > > > > > >> > > 2005010100V_24A.nc
> > > > > > >> > > \
> > > > > > >> > >
> > > > > > >> > > > -pcpdir /scratch/halstead/k/khoogewi/C
> > > > CRC_wrf/grib2/2005/200501
> > > > > \
> > > > > > >> > >
> > > > > > >> > > > -field APCP \
> > > > > > >> > >
> > > > > > >> > > > -config 325
> > > > > > >> > >
> > > > > > >> > > ERROR :
> > > > > > >> > >
> > > > > > >> > > ERROR : yyerror() -> syntax error in file
> > > > > > "/tmp/config_4646_0_.temp"
> > > > > > >> > >
> > > > > > >> > > ERROR :
> > > > > > >> > >
> > > > > > >> > > ERROR : line = 1
> > > > > > >> > >
> > > > > > >> > > ERROR :
> > > > > > >> > >
> > > > > > >> > > ERROR : column = 1
> > > > > > >> > >
> > > > > > >> > > ERROR :
> > > > > > >> > >
> > > > > > >> > > ERROR : text = "325"
> > > > > > >> > >
> > > > > > >> > > ERROR :
> > > > > > >> > >
> > > > > > >> > > ERROR :
> > > > > > >> > >
> > > > > > >> > > ERROR : 325
> > > > > > >> > >
> > > > > > >> > > ERROR : ^^^
> > > > > > >> > >
> > > > > > >> > > ERROR :
> > > > > > >> > >
> > > > > > >> > >
> > > > > > >> > >
> > > > > > >> > >
> > > > > > >> > > Can you help?
> > > > > > >> > > Thank you.
> > > > > > >> > >
> > > > > > >> > > Regards,
> > > > > > >> > >
> > > > > > >> > > Jinwoong Yoo
> > > > > > >> > >
> > > > > > >> > >
> > > > > > >> >
> > > > > > >> >
> > > > > > >>
> > > > > > >>
> > > > > > >
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > >
> > > >
> > >
> > >
> >
> >
>
>
------------------------------------------------
Subject: Error with pcp_combine for GRIB2 files
From: Jinwoong Yoo
Time: Fri Jun 23 09:14:03 2017
Hi John,
I was able to reproduce your output.
I like the second option better too.
Thank you very much!
Using the second method (subtract the runtime accumulations),
now I am working on a script file to process my wrf grib2 files by
month.
As I was testing it for a month, I found error messages for a group of
files towards the end of the month.
One of the error messages look like below:
DEBUG 1: Reading input file:
/scratch/halstead/k/khoogewi/CCRC_wrf/grib2/1976/197601/CESM_WRF_d03_4km_197601280000.grb2
ERROR :
ERROR : yyerror() -> syntax error in file "/tmp/config_25364_0_.temp"
ERROR :
ERROR : line = 1
ERROR :
ERROR : column = 1
ERROR :
ERROR : text = "1008"
ERROR :
ERROR :
ERROR : 1008
ERROR : ^^^^
ERROR :
I couldn't find the .temp file when I tried.
Input files are in the directory.
I don't know why it failed to process.
One set of my WRF simulation last for about 45~46 days.
These error start to occur at 42th day of simulation from the
initialization.
At this time, the forecast hour becomes 1008.
I am suspecting the forecast hour more than 1000 is causing the issue.
Previously, UPP had a similar issue with forecast hour hardcoded to
have
only up to triple digits.
What do you think?
I am using my own bash script to process them.
Please let me know if you have any question.
Thank you.
Regards,
Jinwoong
On Thu, Jun 22, 2017 at 4:05 PM, Jinwoong Yoo <jinwoong.yoo at gmail.com>
wrote:
> Hi John,
>
> Thank you very much for your kind message!
> I appreciate it.
> Let me try to reproduce what you did myself.
> Thank you.
>
> Regards,
>
> Jinwoong
>
> On Thu, Jun 22, 2017 at 3:37 PM, John Halley Gotway via RT <
> met_help at ucar.edu> wrote:
>
>> Jinwoong,
>>
>> Great, thanks for sending this sample data.
>>
>> Based on the commands you were running, it looks like you're trying
to
>> compute 24-hour accumulations. Your GRIB2 files contain 2
different
>> records for APCP, one is a 1-hour accumulation and the second is a
runtime
>> accumulation.
>>
>> Let me demonstrate two options for compute 24-hour accumulations.
>>
>> (1) Using the pcp_combine "sum" to sum up the 1-hour records.
>>
>> First, let me point out that the errors you were getting were
caused the
>> valid time you requested. Four times are required for the "sum"
command:
>> init_time, in_accum, valid_time, and out_accum
>>
>> You were requesting a 24-hour accumulation with a valid time of
>> 200501010000. That told pcp_combine to search for 1-hourly
accumulations
>> starting at 2004123100 and ending at 2005010100. But you don't
have any
>> data in 2014. Running pcp_combine using these options works fine:
>>
>> met-6.0/bin/pcp_combine \
>> -sum 00000000_000000 1 20050102_000000 24 \
>> sample_wrf_2005010100V_24A.nc -pcpdir CESM_WRF
>>
>> This is telling it to search from 2005010100 through 2005010200,
and your
>> data covers that time period.
>>
>> (2) Instead of summing up the hourly accumulations, you could
simply
>> subtract the runtime accumulations:
>>
>> met-6.0/bin/pcp_combine \
>> -subtract CESM_WRF/CESM_WRF_d03_4km_200501020000.grb2 384 \
>> CESM_WRF/CESM_WRF_d03_4km_200501010000.grb2 360 \
>> CESM_APCP_20050101_to_20050102.nc
>>
>> This tells pcp_combine to find the 384 hour precip accumulation
from first
>> first file and 360 hour accumulation from the second find and
subtract
>> them. Their difference is the precip that occurred between hours
360 and
>> 384.
>>
>> Personally, I think option (2) is much simpler that option (1),
since it
>> only requires 2 files instead of 24, but way either works.
>>
>> After running option (2), I ran the following command to plot the
output:
>>
>> met-6.0/bin/plot_data_plane \
>> CESM_APCP_20050101_to_20050102.nc \
>> CESM_APCP_20050101_to_20050102.ps \
>> 'name="APCP_24"; level="(*,*)";'
>>
>> The resulting image is attached.
>>
>> Thanks,
>> John
>>
>> On Thu, Jun 22, 2017 at 12:41 PM, Jinwoong Yoo via RT
<met_help at ucar.edu>
>> wrote:
>>
>> >
>> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80978 >
>> >
>> > Hi John,
>> >
>> > I uploaded Yoo_data2.tar file in the Yoo_data directory.
>> > Thank you.
>> >
>> > Regards,
>> >
>> > Jinwoong
>> >
>> > On Thu, Jun 22, 2017 at 2:21 PM, John Halley Gotway via RT <
>> > met_help at ucar.edu> wrote:
>> >
>> > > Jinwoong,
>> > >
>> > > I went to go grab it from this location but it appears to be
empty:
>> > > ftp://ftp.rap.ucar.edu/incoming/irap/met_help/Yoo_data/
>> > >
>> > > Could you please try again?
>> > >
>> > > Thanks,
>> > > John
>> > >
>> > > On Thu, Jun 22, 2017 at 8:47 AM, Jinwoong Yoo via RT <
>> met_help at ucar.edu>
>> > > wrote:
>> > >
>> > > >
>> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80978
>
>> > > >
>> > > > Hi John,
>> > > >
>> > > > I uploaded my sample files in a tar file.
>> > > > If you cannot find it, please let me know.
>> > > > Thank you.
>> > > >
>> > > > Regards,
>> > > >
>> > > > Jinwoong
>> > > >
>> > > > On Thu, Jun 22, 2017 at 9:57 AM, John Halley Gotway via RT <
>> > > > met_help at ucar.edu> wrote:
>> > > >
>> > > > > Jinwoong,
>> > > > >
>> > > > > Can you please send me two sample data files so I can look
more
>> > closely
>> > > > at
>> > > > > the details? You can post them to our anonymois ftp site
>> following
>> > > these
>> > > > > instructions:
>> > > > >
>> > > > > http://www.dtcenter.org/met/users/support/met_help.php#ftp
>> > > > >
>> > > > > Please let me know when the data is there and I'll go grab
it.
>> > > > >
>> > > > > Thanks,
>> > > > > John
>> > > > >
>> > > > > On Thu, Jun 22, 2017 at 7:06 AM Jinwoong Yoo via RT <
>> > met_help at ucar.edu
>> > > >
>> > > > > wrote:
>> > > > >
>> > > > > >
>> > > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80978 >
>> > > > > >
>> > > > > > Hi John,
>> > > > > >
>> > > > > > As I look at the sample data using wgrib and wgrib2 under
the
>> > > directory
>> > > > > of
>> > > > > > data/sample_fcst/2005080700/,
>> > > > > > they also have two lines for APCP as my wrfout files:
>> > > > > >
>> > > > > > 1:0:D=2005080700:APCP:sfc:kpds=61,1,0:0-24hr acc:winds in
grid
>> > > > > > direction:"Total precipitation [kg/m^2]
>> > > > > >
>> > > > > > 2:31408:D=2005080700:APCP:sfc:kpds=61,1,0:21-24hr
acc:winds in
>> > grid
>> > > > > > direction:"Total precipitation [kg/m^2]
>> > > > > > VS.
>> > > > > >
>> > > > > > 324:14427217:d=2004121700:APCP Total Precipitation
>> > > > > [kg/m^2]:surface:0-1103
>> > > > > > hour acc fcst:
>> > > > > >
>> > > > > > 325:14479093:d=2004121700:APCP Total Precipitation
>> > > > > > [kg/m^2]:surface:1102-1103
>> > > > > > hour acc fcst:
>> > > > > >
>> > > > > >
>> > > > > >
>> > > > > > But, there are a few differences between their format.
>> > > > > > While sample grib files have "APCP" and its long name
and
>> > > > > > units separately, mines have its long name and units
along with
>> > name
>> > > of
>> > > > > > variable together, which part is the biggest thing I
suspect.
>> Can
>> > MET
>> > > > > pick
>> > > > > > up them correctly?
>> > > > > >
>> > > > > > Also, mines don't have kpds column.
>> > > > > >
>> > > > > > Do you think these are causing error in my case?
>> > > > > > If it is the case, how can I control MET to read these
>> differences?
>> > > > > > Thanks.
>> > > > > >
>> > > > > > Regards,
>> > > > > >
>> > > > > > Jinwoong
>> > > > > >
>> > > > > >
>> > > > > > On Wed, Jun 21, 2017 at 8:44 PM, Jinwoong Yoo <
>> > > jinwoong.yoo at gmail.com>
>> > > > > > wrote:
>> > > > > >
>> > > > > > > Hi John,
>> > > > > > >
>> > > > > > > Thank you for your quick reply.
>> > > > > > >
>> > > > > > > In my WRF grib2 files, I have two APCP variables as
shown
>> below:
>> > > > > > >
>> > > > > > > 324:14427217:d=2004121700:APCP Total Precipitation
>> > > > > > [kg/m^2]:surface:0-1103
>> > > > > > > hour acc fcst:
>> > > > > > >
>> > > > > > > 325:14479093:d=2004121700:APCP Total Precipitation
>> > > > > > > [kg/m^2]:surface:1102-1103 hour acc fcst:
>> > > > > > > In my case, I would like to use values in "325" line
which is
>> > APCP
>> > > > for
>> > > > > > one
>> > > > > > > hour accumulation not the total accumulation from the
>> > > initialization
>> > > > of
>> > > > > > the
>> > > > > > > simulation to the forecast time which is "324".
>> > > > > > >
>> > > > > > >
>> > > > > > > Anyway,
>> > > > > > > when I modified my command line with "-field
>> > > > 'name="APCP";level="Z0";'
>> > > > > > > I still got the error as below:
>> > > > > > >
>> > > > > > > yoo108 at halstead-fe01:
>> > > > > > >
*/scratch/halstead/y/yoo108/wrfAnalysis/METanal/pcp_combine*
>> $
>> > > > > > > /home/yoo108/met-6.0_bugfix/bin/pcp_combine -sum
>> > 00000000_000000 1
>> > > > > > > 20050101_000000 24 /scratch/halstead/y/yoo108/wrf
>> > > > Analysis/METanal/pcp_
>> > > > > > > combine/sample_wrf_2005010100V_24A.nc -pcpdir
>> > > > > > > /scratch/halstead/k/khoogewi/CCRC_wrf/grib2/2005/200501
>> -field
>> > > > > > > 'name="APCP";level="Z0";'
>> > > > > > >
>> > > > > > > ERROR :
>> > > > > > >
>> > > > > > > ERROR : sum_data_files() -> Cannot find a file with a
valid
>> time
>> > > of
>> > > > > > > 20050101_000000 and accumulation time of 010000
matching the
>> > > regular
>> > > > > > > expression ".*"
>> > > > > > >
>> > > > > > > ERROR :
>> > > > > > >
>> > > > > > >
>> > > > > > > Thank you.
>> > > > > > >
>> > > > > > > Regards,
>> > > > > > >
>> > > > > > > Jinwoong
>> > > > > > >
>> > > > > > >
>> > > > > > > On Wed, Jun 21, 2017 at 7:10 PM, John Halley Gotway via
RT <
>> > > > > > > met_help at ucar.edu> wrote:
>> > > > > > >
>> > > > > > >> Jinwoong,
>> > > > > > >>
>> > > > > > >> I see that you've having trouble getting pcp_combine
to sum
>> up
>> > the
>> > > > > data
>> > > > > > in
>> > > > > > >> the way you'd like.
>> > > > > > >>
>> > > > > > >> I think you're very close, but unfortunately, I don't
>> understand
>> > > > what
>> > > > > > you
>> > > > > > >> mean by 325. Is the record number that you'd like to
extract
>> > from
>> > > > the
>> > > > > > >> GRIB2 file? Usually, its better to refer to the name
of the
>> > > > variable
>> > > > > > and
>> > > > > > >> have MET find it for you rather then specifying an
explicit
>> > record
>> > > > > > number.
>> > > > > > >>
>> > > > > > >> Let me show you an example for 2m temperature using
sample
>> data
>> > > > that's
>> > > > > > >> included in the MET tarball. Of course it doesn't
make any
>> > sense
>> > > to
>> > > > > sum
>> > > > > > >> up
>> > > > > > >> 2m temperature values! But I'm just showing you as an
>> example.
>> > > > > > >> Hopefully,
>> > > > > > >> you can adapt the example to do what you're trying to
do:
>> > > > > > >>
>> > > > > > >> cd met-6.0/data/sample_fcst/2005080700
>> > > > > > >> ../../../bin/pcp_combine -sum 00000000_000000 3
>> 20050807_120000
>> > 12
>> > > > > > sum.nc
>> > > > > > >> -pcpdir . \
>> > > > > > >> -field 'name="TMP"; level="Z2";'
>> > > > > > >>
>> > > > > > >> DEBUG 1: [1] File ./wrfprs_ruc13_12.tm00_G212 matches
valid
>> time
>> > > of
>> > > > > > >> 20050807_120000
>> > > > > > >> DEBUG 1: [2] File ./wrfprs_ruc13_09.tm00_G212 matches
valid
>> time
>> > > of
>> > > > > > >> 20050807_090000
>> > > > > > >> DEBUG 1: [3] File ./wrfprs_ruc13_06.tm00_G212 matches
valid
>> time
>> > > of
>> > > > > > >> 20050807_060000
>> > > > > > >> DEBUG 1: [4] File ./wrfprs_ruc13_03.tm00_G212 matches
valid
>> time
>> > > of
>> > > > > > >> 20050807_030000
>> > > > > > >> DEBUG 1: [1] Reading input file:
./wrfprs_ruc13_12.tm00_G212
>> > > > > > >> DEBUG 1: [2] Reading input file:
./wrfprs_ruc13_09.tm00_G212
>> > > > > > >> DEBUG 1: [3] Reading input file:
./wrfprs_ruc13_06.tm00_G212
>> > > > > > >> DEBUG 1: [4] Reading input file:
./wrfprs_ruc13_03.tm00_G212
>> > > > > > >> DEBUG 1: Writing output file: sum.nc
>> > > > > > >>
>> > > > > > >> The key here is that I set: -field 'name="TMP";
level="Z2";'
>> > > > > > >>
>> > > > > > >> The name and level strings are used to search the GRIB
>> records
>> > in
>> > > > each
>> > > > > > >> file
>> > > > > > >> looking for a match.
>> > > > > > >>
>> > > > > > >> Hopefully that helps.
>> > > > > > >>
>> > > > > > >> Thanks,
>> > > > > > >> John
>> > > > > > >>
>> > > > > > >> On Wed, Jun 21, 2017 at 4:35 PM, Jinwoong Yoo via RT <
>> > > > > met_help at ucar.edu
>> > > > > > >
>> > > > > > >> wrote:
>> > > > > > >>
>> > > > > > >> >
>> > > > > > >> > <URL: https://rt.rap.ucar.edu/rt/Tic
>> ket/Display.html?id=80978
>> > >
>> > > > > > >> >
>> > > > > > >> > Hi,
>> > > > > > >> >
>> > > > > > >> > When I didn't specify -field and -config and ran the
>> command:
>> > > > > > >> >
>> > > > > > >> > yoo108 at halstead-fe03:
>> > > > > > >> > */scratch/halstead/y/yoo108/wr
>> fAnalysis/METanal/pcp_combine*
>> > $
>> > > > > > >> > /home/yoo108/met-6.0_bugfix/bin/pcp_combine -sum
>> > > 00000000_000000
>> > > > 1
>> > > > > > >> > 20050101_000000 24
>> > > > > > >> > /scratch/halstead/y/yoo108/wrfAnalysis/METanal/pcp_
>> > > > > combine/sample_wrf_
>> > > > > > >> > 2005010100V_24A.nc
>> > > > > > >> > -pcpdir /scratch/halstead/k/khoogewi/
>> > CCRC_wrf/grib2/2005/200501
>> > > > > > >> >
>> > > > > > >> >
>> > > > > > >> >
>> > > > > > >> > I got this error below:
>> > > > > > >> >
>> > > > > > >> > DEBUG 1: [1] File
>> > > > > > >> >
/scratch/halstead/k/khoogewi/CCRC_wrf/grib2/2005/200501/
>> > > > > > >> > CESM_WRF_d03_4km_200501010000.grb2
>> > > > > > >> > matches valid time of 20050101_000000
>> > > > > > >> >
>> > > > > > >> > ERROR :
>> > > > > > >> >
>> > > > > > >> > ERROR : sum_data_files() -> Cannot find a file with
a
>> valid
>> > > time
>> > > > of
>> > > > > > >> > 20041231_230000 and accumulation time of 010000
matching
>> the
>> > > > regular
>> > > > > > >> > expression ".*"
>> > > > > > >> >
>> > > > > > >> > ERROR :
>> > > > > > >> >
>> > > > > > >> >
>> > > > > > >> > I don't know why it tries to find 20041231_230000
file?
>> > > > > > >> > Do I need to use regular expression with it?
>> > > > > > >> >
>> > > > > > >> > Thank you.
>> > > > > > >> > Regards,
>> > > > > > >> >
>> > > > > > >> > Jinwoong
>> > > > > > >> >
>> > > > > > >> > On Wed, Jun 21, 2017 at 6:18 PM, met_help at ucar.edu
via RT
>> <
>> > > > > > >> > met_help at ucar.edu
>> > > > > > >> > > wrote:
>> > > > > > >> >
>> > > > > > >> > > NOTE: THE MET TEAM HAS LIMITED AVAILABILITY
BETWEEN
>> 5/23/17
>> > > AND
>> > > > > > >> 5/30/17.
>> > > > > > >> > > RESPONSES MAY BE DELAYED.
>> > > > > > >> > >
>> > > > > > >> > > Greetings,
>> > > > > > >> > >
>> > > > > > >> > > This message has been automatically generated in
>> response to
>> > > the
>> > > > > > >> > > creation of a trouble ticket regarding:
>> > > > > > >> > > "Error with pcp_combine for GRIB2 files",
>> > > > > > >> > > a summary of which appears below.
>> > > > > > >> > >
>> > > > > > >> > > There is no need to reply to this message right
now.
>> Your
>> > > > ticket
>> > > > > > has
>> > > > > > >> > been
>> > > > > > >> > > assigned an ID of [rt.rap.ucar.edu #80978].
>> > > > > > >> > >
>> > > > > > >> > > Please include the string:
>> > > > > > >> > >
>> > > > > > >> > > [rt.rap.ucar.edu #80978]
>> > > > > > >> > >
>> > > > > > >> > > in the subject line of all future correspondence
about
>> this
>> > > > issue.
>> > > > > > To
>> > > > > > >> do
>> > > > > > >> > > so,
>> > > > > > >> > > you may reply to this message.
>> > > > > > >> > >
>> > > > > > >> > > Thank you,
>> > > > > > >> > > met_help at ucar.edu
>> > > > > > >> > >
>> > > > > > >> > > ------------------------------
>> > ------------------------------
>> > > > > > >> > -------------
>> > > > > > >> > > Hi,
>> > > > > > >> > > I am trying to combine hourly WRF output files
which have
>> > been
>> > > > > > >> converted
>> > > > > > >> > to
>> > > > > > >> > > GRIB2 format using UPP.
>> > > > > > >> > >
>> > > > > > >> > >
>> > > > > > >> > > In the MET online tutorial, it is written "By
default,
>> > > > PCP-Combine
>> > > > > > >> > searches
>> > > > > > >> > > for records containing GRIB code 61 (accumulated
>> > > precipitation).
>> > > > > Use
>> > > > > > >> > > the *-config
>> > > > > > >> > > config_str* option to override this default and
process
>> > other
>> > > > > > fields."
>> > > > > > >> > So I
>> > > > > > >> > > wanted to change the default for 325 APCP. But the
>> direction
>> > > in
>> > > > > the
>> > > > > > >> > > tutorial is not clear to me.
>> > > > > > >> > >
>> > > > > > >> > > Do I need to change configure file? (Then, which
config
>> file
>> > > > > should
>> > > > > > I
>> > > > > > >> > > change?)
>> > > > > > >> > > Or can I do this in command line?
>> > > > > > >> > >
>> > > > > > >> > > When I tried as below, I got error messages.
>> > > > > > >> > >
>> > > > > > >> > > > -sum 00000000_000000 1 20050101_000000 24 \
>> > > > > > >> > >
>> > > > > > >> > > >
>> > > > > > >> > > /scratch/halstead/y/yoo108/wrf
>> Analysis/METanal/pcp_combine/
>> > > > > > >> sample_wrf_
>> > > > > > >> > > 2005010100V_24A.nc
>> > > > > > >> > > \
>> > > > > > >> > >
>> > > > > > >> > > > -pcpdir /scratch/halstead/k/khoogewi/C
>> > > > CRC_wrf/grib2/2005/200501
>> > > > > \
>> > > > > > >> > >
>> > > > > > >> > > > -field APCP \
>> > > > > > >> > >
>> > > > > > >> > > > -config 325
>> > > > > > >> > >
>> > > > > > >> > > ERROR :
>> > > > > > >> > >
>> > > > > > >> > > ERROR : yyerror() -> syntax error in file
>> > > > > > "/tmp/config_4646_0_.temp"
>> > > > > > >> > >
>> > > > > > >> > > ERROR :
>> > > > > > >> > >
>> > > > > > >> > > ERROR : line = 1
>> > > > > > >> > >
>> > > > > > >> > > ERROR :
>> > > > > > >> > >
>> > > > > > >> > > ERROR : column = 1
>> > > > > > >> > >
>> > > > > > >> > > ERROR :
>> > > > > > >> > >
>> > > > > > >> > > ERROR : text = "325"
>> > > > > > >> > >
>> > > > > > >> > > ERROR :
>> > > > > > >> > >
>> > > > > > >> > > ERROR :
>> > > > > > >> > >
>> > > > > > >> > > ERROR : 325
>> > > > > > >> > >
>> > > > > > >> > > ERROR : ^^^
>> > > > > > >> > >
>> > > > > > >> > > ERROR :
>> > > > > > >> > >
>> > > > > > >> > >
>> > > > > > >> > >
>> > > > > > >> > >
>> > > > > > >> > > Can you help?
>> > > > > > >> > > Thank you.
>> > > > > > >> > >
>> > > > > > >> > > Regards,
>> > > > > > >> > >
>> > > > > > >> > > Jinwoong Yoo
>> > > > > > >> > >
>> > > > > > >> > >
>> > > > > > >> >
>> > > > > > >> >
>> > > > > > >>
>> > > > > > >>
>> > > > > > >
>> > > > > >
>> > > > > >
>> > > > >
>> > > > >
>> > > >
>> > > >
>> > >
>> > >
>> >
>> >
>>
>>
>
------------------------------------------------
Subject: Error with pcp_combine for GRIB2 files
From: John Halley Gotway
Time: Fri Jun 23 09:54:56 2017
Jinwoong,
Yes, I was worried about this happening. I agree that going from 3 to
4
digits is causing the problem. But I am surprised by the error you're
getting. The error you've sent indicates that there's a problem in
the
syntax of the command line.
Instead, I would expect to see an error like this:
ERROR: timestring_to_sec(const char *) -> can't parse time string
"1008"
I looked on our ftp site and grabbed this file:
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/Yoo_data/Yoo_data2.tar
But that's the data you'd sent previously.
Could you please send me a couple of files that have a 1000 hour +
accumulation interval? I can run them through the debugger to see how
the
logic could be tweaked to handle them.
Thanks,
John
On Fri, Jun 23, 2017 at 9:14 AM, Jinwoong Yoo via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80978 >
>
> Hi John,
>
> I was able to reproduce your output.
> I like the second option better too.
> Thank you very much!
>
> Using the second method (subtract the runtime accumulations),
> now I am working on a script file to process my wrf grib2 files by
month.
> As I was testing it for a month, I found error messages for a group
of
> files towards the end of the month.
> One of the error messages look like below:
>
> DEBUG 1: Reading input file:
> /scratch/halstead/k/khoogewi/CCRC_wrf/grib2/1976/197601/
> CESM_WRF_d03_4km_197601280000.grb2
>
> ERROR :
>
> ERROR : yyerror() -> syntax error in file
"/tmp/config_25364_0_.temp"
>
> ERROR :
>
> ERROR : line = 1
>
> ERROR :
>
> ERROR : column = 1
>
> ERROR :
>
> ERROR : text = "1008"
>
> ERROR :
>
> ERROR :
>
> ERROR : 1008
>
> ERROR : ^^^^
>
> ERROR :
>
> I couldn't find the .temp file when I tried.
> Input files are in the directory.
> I don't know why it failed to process.
>
> One set of my WRF simulation last for about 45~46 days.
> These error start to occur at 42th day of simulation from the
> initialization.
> At this time, the forecast hour becomes 1008.
> I am suspecting the forecast hour more than 1000 is causing the
issue.
> Previously, UPP had a similar issue with forecast hour hardcoded to
have
> only up to triple digits.
> What do you think?
>
> I am using my own bash script to process them.
> Please let me know if you have any question.
> Thank you.
>
> Regards,
>
> Jinwoong
>
>
>
> On Thu, Jun 22, 2017 at 4:05 PM, Jinwoong Yoo
<jinwoong.yoo at gmail.com>
> wrote:
>
> > Hi John,
> >
> > Thank you very much for your kind message!
> > I appreciate it.
> > Let me try to reproduce what you did myself.
> > Thank you.
> >
> > Regards,
> >
> > Jinwoong
> >
> > On Thu, Jun 22, 2017 at 3:37 PM, John Halley Gotway via RT <
> > met_help at ucar.edu> wrote:
> >
> >> Jinwoong,
> >>
> >> Great, thanks for sending this sample data.
> >>
> >> Based on the commands you were running, it looks like you're
trying to
> >> compute 24-hour accumulations. Your GRIB2 files contain 2
different
> >> records for APCP, one is a 1-hour accumulation and the second is
a
> runtime
> >> accumulation.
> >>
> >> Let me demonstrate two options for compute 24-hour accumulations.
> >>
> >> (1) Using the pcp_combine "sum" to sum up the 1-hour records.
> >>
> >> First, let me point out that the errors you were getting were
caused the
> >> valid time you requested. Four times are required for the "sum"
> command:
> >> init_time, in_accum, valid_time, and out_accum
> >>
> >> You were requesting a 24-hour accumulation with a valid time of
> >> 200501010000. That told pcp_combine to search for 1-hourly
> accumulations
> >> starting at 2004123100 and ending at 2005010100. But you don't
have any
> >> data in 2014. Running pcp_combine using these options works
fine:
> >>
> >> met-6.0/bin/pcp_combine \
> >> -sum 00000000_000000 1 20050102_000000 24 \
> >> sample_wrf_2005010100V_24A.nc -pcpdir CESM_WRF
> >>
> >> This is telling it to search from 2005010100 through 2005010200,
and
> your
> >> data covers that time period.
> >>
> >> (2) Instead of summing up the hourly accumulations, you could
simply
> >> subtract the runtime accumulations:
> >>
> >> met-6.0/bin/pcp_combine \
> >> -subtract CESM_WRF/CESM_WRF_d03_4km_200501020000.grb2 384 \
> >> CESM_WRF/CESM_WRF_d03_4km_200501010000.grb2 360 \
> >> CESM_APCP_20050101_to_20050102.nc
> >>
> >> This tells pcp_combine to find the 384 hour precip accumulation
from
> first
> >> first file and 360 hour accumulation from the second find and
subtract
> >> them. Their difference is the precip that occurred between hours
360
> and
> >> 384.
> >>
> >> Personally, I think option (2) is much simpler that option (1),
since it
> >> only requires 2 files instead of 24, but way either works.
> >>
> >> After running option (2), I ran the following command to plot the
> output:
> >>
> >> met-6.0/bin/plot_data_plane \
> >> CESM_APCP_20050101_to_20050102.nc \
> >> CESM_APCP_20050101_to_20050102.ps \
> >> 'name="APCP_24"; level="(*,*)";'
> >>
> >> The resulting image is attached.
> >>
> >> Thanks,
> >> John
> >>
> >> On Thu, Jun 22, 2017 at 12:41 PM, Jinwoong Yoo via RT <
> met_help at ucar.edu>
> >> wrote:
> >>
> >> >
> >> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80978 >
> >> >
> >> > Hi John,
> >> >
> >> > I uploaded Yoo_data2.tar file in the Yoo_data directory.
> >> > Thank you.
> >> >
> >> > Regards,
> >> >
> >> > Jinwoong
> >> >
> >> > On Thu, Jun 22, 2017 at 2:21 PM, John Halley Gotway via RT <
> >> > met_help at ucar.edu> wrote:
> >> >
> >> > > Jinwoong,
> >> > >
> >> > > I went to go grab it from this location but it appears to be
empty:
> >> > > ftp://ftp.rap.ucar.edu/incoming/irap/met_help/Yoo_data/
> >> > >
> >> > > Could you please try again?
> >> > >
> >> > > Thanks,
> >> > > John
> >> > >
> >> > > On Thu, Jun 22, 2017 at 8:47 AM, Jinwoong Yoo via RT <
> >> met_help at ucar.edu>
> >> > > wrote:
> >> > >
> >> > > >
> >> > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80978 >
> >> > > >
> >> > > > Hi John,
> >> > > >
> >> > > > I uploaded my sample files in a tar file.
> >> > > > If you cannot find it, please let me know.
> >> > > > Thank you.
> >> > > >
> >> > > > Regards,
> >> > > >
> >> > > > Jinwoong
> >> > > >
> >> > > > On Thu, Jun 22, 2017 at 9:57 AM, John Halley Gotway via RT
<
> >> > > > met_help at ucar.edu> wrote:
> >> > > >
> >> > > > > Jinwoong,
> >> > > > >
> >> > > > > Can you please send me two sample data files so I can
look more
> >> > closely
> >> > > > at
> >> > > > > the details? You can post them to our anonymois ftp site
> >> following
> >> > > these
> >> > > > > instructions:
> >> > > > >
> >> > > > >
http://www.dtcenter.org/met/users/support/met_help.php#ftp
> >> > > > >
> >> > > > > Please let me know when the data is there and I'll go
grab it.
> >> > > > >
> >> > > > > Thanks,
> >> > > > > John
> >> > > > >
> >> > > > > On Thu, Jun 22, 2017 at 7:06 AM Jinwoong Yoo via RT <
> >> > met_help at ucar.edu
> >> > > >
> >> > > > > wrote:
> >> > > > >
> >> > > > > >
> >> > > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80978
> >
> >> > > > > >
> >> > > > > > Hi John,
> >> > > > > >
> >> > > > > > As I look at the sample data using wgrib and wgrib2
under the
> >> > > directory
> >> > > > > of
> >> > > > > > data/sample_fcst/2005080700/,
> >> > > > > > they also have two lines for APCP as my wrfout files:
> >> > > > > >
> >> > > > > > 1:0:D=2005080700:APCP:sfc:kpds=61,1,0:0-24hr acc:winds
in
> grid
> >> > > > > > direction:"Total precipitation [kg/m^2]
> >> > > > > >
> >> > > > > > 2:31408:D=2005080700:APCP:sfc:kpds=61,1,0:21-24hr
acc:winds
> in
> >> > grid
> >> > > > > > direction:"Total precipitation [kg/m^2]
> >> > > > > > VS.
> >> > > > > >
> >> > > > > > 324:14427217:d=2004121700:APCP Total Precipitation
> >> > > > > [kg/m^2]:surface:0-1103
> >> > > > > > hour acc fcst:
> >> > > > > >
> >> > > > > > 325:14479093:d=2004121700:APCP Total Precipitation
> >> > > > > > [kg/m^2]:surface:1102-1103
> >> > > > > > hour acc fcst:
> >> > > > > >
> >> > > > > >
> >> > > > > >
> >> > > > > > But, there are a few differences between their format.
> >> > > > > > While sample grib files have "APCP" and its long name
and
> >> > > > > > units separately, mines have its long name and units
along
> with
> >> > name
> >> > > of
> >> > > > > > variable together, which part is the biggest thing I
suspect.
> >> Can
> >> > MET
> >> > > > > pick
> >> > > > > > up them correctly?
> >> > > > > >
> >> > > > > > Also, mines don't have kpds column.
> >> > > > > >
> >> > > > > > Do you think these are causing error in my case?
> >> > > > > > If it is the case, how can I control MET to read these
> >> differences?
> >> > > > > > Thanks.
> >> > > > > >
> >> > > > > > Regards,
> >> > > > > >
> >> > > > > > Jinwoong
> >> > > > > >
> >> > > > > >
> >> > > > > > On Wed, Jun 21, 2017 at 8:44 PM, Jinwoong Yoo <
> >> > > jinwoong.yoo at gmail.com>
> >> > > > > > wrote:
> >> > > > > >
> >> > > > > > > Hi John,
> >> > > > > > >
> >> > > > > > > Thank you for your quick reply.
> >> > > > > > >
> >> > > > > > > In my WRF grib2 files, I have two APCP variables as
shown
> >> below:
> >> > > > > > >
> >> > > > > > > 324:14427217:d=2004121700:APCP Total Precipitation
> >> > > > > > [kg/m^2]:surface:0-1103
> >> > > > > > > hour acc fcst:
> >> > > > > > >
> >> > > > > > > 325:14479093:d=2004121700:APCP Total Precipitation
> >> > > > > > > [kg/m^2]:surface:1102-1103 hour acc fcst:
> >> > > > > > > In my case, I would like to use values in "325" line
which
> is
> >> > APCP
> >> > > > for
> >> > > > > > one
> >> > > > > > > hour accumulation not the total accumulation from the
> >> > > initialization
> >> > > > of
> >> > > > > > the
> >> > > > > > > simulation to the forecast time which is "324".
> >> > > > > > >
> >> > > > > > >
> >> > > > > > > Anyway,
> >> > > > > > > when I modified my command line with "-field
> >> > > > 'name="APCP";level="Z0";'
> >> > > > > > > I still got the error as below:
> >> > > > > > >
> >> > > > > > > yoo108 at halstead-fe01:
> >> > > > > > > */scratch/halstead/y/yoo108/wrfAnalysis/METanal/pcp_
> combine*
> >> $
> >> > > > > > > /home/yoo108/met-6.0_bugfix/bin/pcp_combine -sum
> >> > 00000000_000000 1
> >> > > > > > > 20050101_000000 24 /scratch/halstead/y/yoo108/wrf
> >> > > > Analysis/METanal/pcp_
> >> > > > > > > combine/sample_wrf_2005010100V_24A.nc -pcpdir
> >> > > > > > >
/scratch/halstead/k/khoogewi/CCRC_wrf/grib2/2005/200501
> >> -field
> >> > > > > > > 'name="APCP";level="Z0";'
> >> > > > > > >
> >> > > > > > > ERROR :
> >> > > > > > >
> >> > > > > > > ERROR : sum_data_files() -> Cannot find a file with
a valid
> >> time
> >> > > of
> >> > > > > > > 20050101_000000 and accumulation time of 010000
matching the
> >> > > regular
> >> > > > > > > expression ".*"
> >> > > > > > >
> >> > > > > > > ERROR :
> >> > > > > > >
> >> > > > > > >
> >> > > > > > > Thank you.
> >> > > > > > >
> >> > > > > > > Regards,
> >> > > > > > >
> >> > > > > > > Jinwoong
> >> > > > > > >
> >> > > > > > >
> >> > > > > > > On Wed, Jun 21, 2017 at 7:10 PM, John Halley Gotway
via RT <
> >> > > > > > > met_help at ucar.edu> wrote:
> >> > > > > > >
> >> > > > > > >> Jinwoong,
> >> > > > > > >>
> >> > > > > > >> I see that you've having trouble getting pcp_combine
to sum
> >> up
> >> > the
> >> > > > > data
> >> > > > > > in
> >> > > > > > >> the way you'd like.
> >> > > > > > >>
> >> > > > > > >> I think you're very close, but unfortunately, I
don't
> >> understand
> >> > > > what
> >> > > > > > you
> >> > > > > > >> mean by 325. Is the record number that you'd like
to
> extract
> >> > from
> >> > > > the
> >> > > > > > >> GRIB2 file? Usually, its better to refer to the
name of
> the
> >> > > > variable
> >> > > > > > and
> >> > > > > > >> have MET find it for you rather then specifying an
explicit
> >> > record
> >> > > > > > number.
> >> > > > > > >>
> >> > > > > > >> Let me show you an example for 2m temperature using
sample
> >> data
> >> > > > that's
> >> > > > > > >> included in the MET tarball. Of course it doesn't
make any
> >> > sense
> >> > > to
> >> > > > > sum
> >> > > > > > >> up
> >> > > > > > >> 2m temperature values! But I'm just showing you as
an
> >> example.
> >> > > > > > >> Hopefully,
> >> > > > > > >> you can adapt the example to do what you're trying
to do:
> >> > > > > > >>
> >> > > > > > >> cd met-6.0/data/sample_fcst/2005080700
> >> > > > > > >> ../../../bin/pcp_combine -sum 00000000_000000 3
> >> 20050807_120000
> >> > 12
> >> > > > > > sum.nc
> >> > > > > > >> -pcpdir . \
> >> > > > > > >> -field 'name="TMP"; level="Z2";'
> >> > > > > > >>
> >> > > > > > >> DEBUG 1: [1] File ./wrfprs_ruc13_12.tm00_G212
matches valid
> >> time
> >> > > of
> >> > > > > > >> 20050807_120000
> >> > > > > > >> DEBUG 1: [2] File ./wrfprs_ruc13_09.tm00_G212
matches valid
> >> time
> >> > > of
> >> > > > > > >> 20050807_090000
> >> > > > > > >> DEBUG 1: [3] File ./wrfprs_ruc13_06.tm00_G212
matches valid
> >> time
> >> > > of
> >> > > > > > >> 20050807_060000
> >> > > > > > >> DEBUG 1: [4] File ./wrfprs_ruc13_03.tm00_G212
matches valid
> >> time
> >> > > of
> >> > > > > > >> 20050807_030000
> >> > > > > > >> DEBUG 1: [1] Reading input file:
> ./wrfprs_ruc13_12.tm00_G212
> >> > > > > > >> DEBUG 1: [2] Reading input file:
> ./wrfprs_ruc13_09.tm00_G212
> >> > > > > > >> DEBUG 1: [3] Reading input file:
> ./wrfprs_ruc13_06.tm00_G212
> >> > > > > > >> DEBUG 1: [4] Reading input file:
> ./wrfprs_ruc13_03.tm00_G212
> >> > > > > > >> DEBUG 1: Writing output file: sum.nc
> >> > > > > > >>
> >> > > > > > >> The key here is that I set: -field 'name="TMP";
> level="Z2";'
> >> > > > > > >>
> >> > > > > > >> The name and level strings are used to search the
GRIB
> >> records
> >> > in
> >> > > > each
> >> > > > > > >> file
> >> > > > > > >> looking for a match.
> >> > > > > > >>
> >> > > > > > >> Hopefully that helps.
> >> > > > > > >>
> >> > > > > > >> Thanks,
> >> > > > > > >> John
> >> > > > > > >>
> >> > > > > > >> On Wed, Jun 21, 2017 at 4:35 PM, Jinwoong Yoo via RT
<
> >> > > > > met_help at ucar.edu
> >> > > > > > >
> >> > > > > > >> wrote:
> >> > > > > > >>
> >> > > > > > >> >
> >> > > > > > >> > <URL: https://rt.rap.ucar.edu/rt/Tic
> >> ket/Display.html?id=80978
> >> > >
> >> > > > > > >> >
> >> > > > > > >> > Hi,
> >> > > > > > >> >
> >> > > > > > >> > When I didn't specify -field and -config and ran
the
> >> command:
> >> > > > > > >> >
> >> > > > > > >> > yoo108 at halstead-fe03:
> >> > > > > > >> > */scratch/halstead/y/yoo108/wr
> >> fAnalysis/METanal/pcp_combine*
> >> > $
> >> > > > > > >> > /home/yoo108/met-6.0_bugfix/bin/pcp_combine -sum
> >> > > 00000000_000000
> >> > > > 1
> >> > > > > > >> > 20050101_000000 24
> >> > > > > > >> >
/scratch/halstead/y/yoo108/wrfAnalysis/METanal/pcp_
> >> > > > > combine/sample_wrf_
> >> > > > > > >> > 2005010100V_24A.nc
> >> > > > > > >> > -pcpdir /scratch/halstead/k/khoogewi/
> >> > CCRC_wrf/grib2/2005/200501
> >> > > > > > >> >
> >> > > > > > >> >
> >> > > > > > >> >
> >> > > > > > >> > I got this error below:
> >> > > > > > >> >
> >> > > > > > >> > DEBUG 1: [1] File
> >> > > > > > >> >
/scratch/halstead/k/khoogewi/CCRC_wrf/grib2/2005/200501/
> >> > > > > > >> > CESM_WRF_d03_4km_200501010000.grb2
> >> > > > > > >> > matches valid time of 20050101_000000
> >> > > > > > >> >
> >> > > > > > >> > ERROR :
> >> > > > > > >> >
> >> > > > > > >> > ERROR : sum_data_files() -> Cannot find a file
with a
> >> valid
> >> > > time
> >> > > > of
> >> > > > > > >> > 20041231_230000 and accumulation time of 010000
matching
> >> the
> >> > > > regular
> >> > > > > > >> > expression ".*"
> >> > > > > > >> >
> >> > > > > > >> > ERROR :
> >> > > > > > >> >
> >> > > > > > >> >
> >> > > > > > >> > I don't know why it tries to find 20041231_230000
file?
> >> > > > > > >> > Do I need to use regular expression with it?
> >> > > > > > >> >
> >> > > > > > >> > Thank you.
> >> > > > > > >> > Regards,
> >> > > > > > >> >
> >> > > > > > >> > Jinwoong
> >> > > > > > >> >
> >> > > > > > >> > On Wed, Jun 21, 2017 at 6:18 PM, met_help at ucar.edu
via
> RT
> >> <
> >> > > > > > >> > met_help at ucar.edu
> >> > > > > > >> > > wrote:
> >> > > > > > >> >
> >> > > > > > >> > > NOTE: THE MET TEAM HAS LIMITED AVAILABILITY
BETWEEN
> >> 5/23/17
> >> > > AND
> >> > > > > > >> 5/30/17.
> >> > > > > > >> > > RESPONSES MAY BE DELAYED.
> >> > > > > > >> > >
> >> > > > > > >> > > Greetings,
> >> > > > > > >> > >
> >> > > > > > >> > > This message has been automatically generated in
> >> response to
> >> > > the
> >> > > > > > >> > > creation of a trouble ticket regarding:
> >> > > > > > >> > > "Error with pcp_combine for GRIB2
files",
> >> > > > > > >> > > a summary of which appears below.
> >> > > > > > >> > >
> >> > > > > > >> > > There is no need to reply to this message right
now.
> >> Your
> >> > > > ticket
> >> > > > > > has
> >> > > > > > >> > been
> >> > > > > > >> > > assigned an ID of [rt.rap.ucar.edu #80978].
> >> > > > > > >> > >
> >> > > > > > >> > > Please include the string:
> >> > > > > > >> > >
> >> > > > > > >> > > [rt.rap.ucar.edu #80978]
> >> > > > > > >> > >
> >> > > > > > >> > > in the subject line of all future correspondence
about
> >> this
> >> > > > issue.
> >> > > > > > To
> >> > > > > > >> do
> >> > > > > > >> > > so,
> >> > > > > > >> > > you may reply to this message.
> >> > > > > > >> > >
> >> > > > > > >> > > Thank you,
> >> > > > > > >> > > met_help at ucar.edu
> >> > > > > > >> > >
> >> > > > > > >> > > ------------------------------
> >> > ------------------------------
> >> > > > > > >> > -------------
> >> > > > > > >> > > Hi,
> >> > > > > > >> > > I am trying to combine hourly WRF output files
which
> have
> >> > been
> >> > > > > > >> converted
> >> > > > > > >> > to
> >> > > > > > >> > > GRIB2 format using UPP.
> >> > > > > > >> > >
> >> > > > > > >> > >
> >> > > > > > >> > > In the MET online tutorial, it is written "By
default,
> >> > > > PCP-Combine
> >> > > > > > >> > searches
> >> > > > > > >> > > for records containing GRIB code 61 (accumulated
> >> > > precipitation).
> >> > > > > Use
> >> > > > > > >> > > the *-config
> >> > > > > > >> > > config_str* option to override this default and
process
> >> > other
> >> > > > > > fields."
> >> > > > > > >> > So I
> >> > > > > > >> > > wanted to change the default for 325 APCP. But
the
> >> direction
> >> > > in
> >> > > > > the
> >> > > > > > >> > > tutorial is not clear to me.
> >> > > > > > >> > >
> >> > > > > > >> > > Do I need to change configure file? (Then, which
config
> >> file
> >> > > > > should
> >> > > > > > I
> >> > > > > > >> > > change?)
> >> > > > > > >> > > Or can I do this in command line?
> >> > > > > > >> > >
> >> > > > > > >> > > When I tried as below, I got error messages.
> >> > > > > > >> > >
> >> > > > > > >> > > > -sum 00000000_000000 1 20050101_000000 24 \
> >> > > > > > >> > >
> >> > > > > > >> > > >
> >> > > > > > >> > > /scratch/halstead/y/yoo108/wrf
> >> Analysis/METanal/pcp_combine/
> >> > > > > > >> sample_wrf_
> >> > > > > > >> > > 2005010100V_24A.nc
> >> > > > > > >> > > \
> >> > > > > > >> > >
> >> > > > > > >> > > > -pcpdir /scratch/halstead/k/khoogewi/C
> >> > > > CRC_wrf/grib2/2005/200501
> >> > > > > \
> >> > > > > > >> > >
> >> > > > > > >> > > > -field APCP \
> >> > > > > > >> > >
> >> > > > > > >> > > > -config 325
> >> > > > > > >> > >
> >> > > > > > >> > > ERROR :
> >> > > > > > >> > >
> >> > > > > > >> > > ERROR : yyerror() -> syntax error in file
> >> > > > > > "/tmp/config_4646_0_.temp"
> >> > > > > > >> > >
> >> > > > > > >> > > ERROR :
> >> > > > > > >> > >
> >> > > > > > >> > > ERROR : line = 1
> >> > > > > > >> > >
> >> > > > > > >> > > ERROR :
> >> > > > > > >> > >
> >> > > > > > >> > > ERROR : column = 1
> >> > > > > > >> > >
> >> > > > > > >> > > ERROR :
> >> > > > > > >> > >
> >> > > > > > >> > > ERROR : text = "325"
> >> > > > > > >> > >
> >> > > > > > >> > > ERROR :
> >> > > > > > >> > >
> >> > > > > > >> > > ERROR :
> >> > > > > > >> > >
> >> > > > > > >> > > ERROR : 325
> >> > > > > > >> > >
> >> > > > > > >> > > ERROR : ^^^
> >> > > > > > >> > >
> >> > > > > > >> > > ERROR :
> >> > > > > > >> > >
> >> > > > > > >> > >
> >> > > > > > >> > >
> >> > > > > > >> > >
> >> > > > > > >> > > Can you help?
> >> > > > > > >> > > Thank you.
> >> > > > > > >> > >
> >> > > > > > >> > > Regards,
> >> > > > > > >> > >
> >> > > > > > >> > > Jinwoong Yoo
> >> > > > > > >> > >
> >> > > > > > >> > >
> >> > > > > > >> >
> >> > > > > > >> >
> >> > > > > > >>
> >> > > > > > >>
> >> > > > > > >
> >> > > > > >
> >> > > > > >
> >> > > > >
> >> > > > >
> >> > > >
> >> > > >
> >> > >
> >> > >
> >> >
> >> >
> >>
> >>
> >
>
>
------------------------------------------------
Subject: Error with pcp_combine for GRIB2 files
From: Jinwoong Yoo
Time: Fri Jun 23 10:07:31 2017
Hi John,
Thank you very much for your quick reply.
I uploaded sample files as in Yoo_data3.tar.
Thank you very much!
Regards,
Jinwoong
On Fri, Jun 23, 2017 at 11:54 AM, John Halley Gotway via RT <
met_help at ucar.edu> wrote:
> Jinwoong,
>
> Yes, I was worried about this happening. I agree that going from 3
to 4
> digits is causing the problem. But I am surprised by the error
you're
> getting. The error you've sent indicates that there's a problem in
the
> syntax of the command line.
>
> Instead, I would expect to see an error like this:
> ERROR: timestring_to_sec(const char *) -> can't parse time string
"1008"
>
> I looked on our ftp site and grabbed this file:
> ftp://ftp.rap.ucar.edu/incoming/irap/met_help/Yoo_data/Yoo_data2.tar
>
> But that's the data you'd sent previously.
>
> Could you please send me a couple of files that have a 1000 hour +
> accumulation interval? I can run them through the debugger to see
how the
> logic could be tweaked to handle them.
>
> Thanks,
> John
>
>
> On Fri, Jun 23, 2017 at 9:14 AM, Jinwoong Yoo via RT
<met_help at ucar.edu>
> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80978 >
> >
> > Hi John,
> >
> > I was able to reproduce your output.
> > I like the second option better too.
> > Thank you very much!
> >
> > Using the second method (subtract the runtime accumulations),
> > now I am working on a script file to process my wrf grib2 files by
month.
> > As I was testing it for a month, I found error messages for a
group of
> > files towards the end of the month.
> > One of the error messages look like below:
> >
> > DEBUG 1: Reading input file:
> > /scratch/halstead/k/khoogewi/CCRC_wrf/grib2/1976/197601/
> > CESM_WRF_d03_4km_197601280000.grb2
> >
> > ERROR :
> >
> > ERROR : yyerror() -> syntax error in file
"/tmp/config_25364_0_.temp"
> >
> > ERROR :
> >
> > ERROR : line = 1
> >
> > ERROR :
> >
> > ERROR : column = 1
> >
> > ERROR :
> >
> > ERROR : text = "1008"
> >
> > ERROR :
> >
> > ERROR :
> >
> > ERROR : 1008
> >
> > ERROR : ^^^^
> >
> > ERROR :
> >
> > I couldn't find the .temp file when I tried.
> > Input files are in the directory.
> > I don't know why it failed to process.
> >
> > One set of my WRF simulation last for about 45~46 days.
> > These error start to occur at 42th day of simulation from the
> > initialization.
> > At this time, the forecast hour becomes 1008.
> > I am suspecting the forecast hour more than 1000 is causing the
issue.
> > Previously, UPP had a similar issue with forecast hour hardcoded
to have
> > only up to triple digits.
> > What do you think?
> >
> > I am using my own bash script to process them.
> > Please let me know if you have any question.
> > Thank you.
> >
> > Regards,
> >
> > Jinwoong
> >
> >
> >
> > On Thu, Jun 22, 2017 at 4:05 PM, Jinwoong Yoo
<jinwoong.yoo at gmail.com>
> > wrote:
> >
> > > Hi John,
> > >
> > > Thank you very much for your kind message!
> > > I appreciate it.
> > > Let me try to reproduce what you did myself.
> > > Thank you.
> > >
> > > Regards,
> > >
> > > Jinwoong
> > >
> > > On Thu, Jun 22, 2017 at 3:37 PM, John Halley Gotway via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > >> Jinwoong,
> > >>
> > >> Great, thanks for sending this sample data.
> > >>
> > >> Based on the commands you were running, it looks like you're
trying to
> > >> compute 24-hour accumulations. Your GRIB2 files contain 2
different
> > >> records for APCP, one is a 1-hour accumulation and the second
is a
> > runtime
> > >> accumulation.
> > >>
> > >> Let me demonstrate two options for compute 24-hour
accumulations.
> > >>
> > >> (1) Using the pcp_combine "sum" to sum up the 1-hour records.
> > >>
> > >> First, let me point out that the errors you were getting were
caused
> the
> > >> valid time you requested. Four times are required for the
"sum"
> > command:
> > >> init_time, in_accum, valid_time, and out_accum
> > >>
> > >> You were requesting a 24-hour accumulation with a valid time of
> > >> 200501010000. That told pcp_combine to search for 1-hourly
> > accumulations
> > >> starting at 2004123100 and ending at 2005010100. But you don't
have
> any
> > >> data in 2014. Running pcp_combine using these options works
fine:
> > >>
> > >> met-6.0/bin/pcp_combine \
> > >> -sum 00000000_000000 1 20050102_000000 24 \
> > >> sample_wrf_2005010100V_24A.nc -pcpdir CESM_WRF
> > >>
> > >> This is telling it to search from 2005010100 through
2005010200, and
> > your
> > >> data covers that time period.
> > >>
> > >> (2) Instead of summing up the hourly accumulations, you could
simply
> > >> subtract the runtime accumulations:
> > >>
> > >> met-6.0/bin/pcp_combine \
> > >> -subtract CESM_WRF/CESM_WRF_d03_4km_200501020000.grb2 384 \
> > >> CESM_WRF/CESM_WRF_d03_4km_200501010000.grb2 360 \
> > >> CESM_APCP_20050101_to_20050102.nc
> > >>
> > >> This tells pcp_combine to find the 384 hour precip accumulation
from
> > first
> > >> first file and 360 hour accumulation from the second find and
subtract
> > >> them. Their difference is the precip that occurred between
hours 360
> > and
> > >> 384.
> > >>
> > >> Personally, I think option (2) is much simpler that option (1),
since
> it
> > >> only requires 2 files instead of 24, but way either works.
> > >>
> > >> After running option (2), I ran the following command to plot
the
> > output:
> > >>
> > >> met-6.0/bin/plot_data_plane \
> > >> CESM_APCP_20050101_to_20050102.nc \
> > >> CESM_APCP_20050101_to_20050102.ps \
> > >> 'name="APCP_24"; level="(*,*)";'
> > >>
> > >> The resulting image is attached.
> > >>
> > >> Thanks,
> > >> John
> > >>
> > >> On Thu, Jun 22, 2017 at 12:41 PM, Jinwoong Yoo via RT <
> > met_help at ucar.edu>
> > >> wrote:
> > >>
> > >> >
> > >> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80978
>
> > >> >
> > >> > Hi John,
> > >> >
> > >> > I uploaded Yoo_data2.tar file in the Yoo_data directory.
> > >> > Thank you.
> > >> >
> > >> > Regards,
> > >> >
> > >> > Jinwoong
> > >> >
> > >> > On Thu, Jun 22, 2017 at 2:21 PM, John Halley Gotway via RT <
> > >> > met_help at ucar.edu> wrote:
> > >> >
> > >> > > Jinwoong,
> > >> > >
> > >> > > I went to go grab it from this location but it appears to
be
> empty:
> > >> > > ftp://ftp.rap.ucar.edu/incoming/irap/met_help/Yoo_data/
> > >> > >
> > >> > > Could you please try again?
> > >> > >
> > >> > > Thanks,
> > >> > > John
> > >> > >
> > >> > > On Thu, Jun 22, 2017 at 8:47 AM, Jinwoong Yoo via RT <
> > >> met_help at ucar.edu>
> > >> > > wrote:
> > >> > >
> > >> > > >
> > >> > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80978 >
> > >> > > >
> > >> > > > Hi John,
> > >> > > >
> > >> > > > I uploaded my sample files in a tar file.
> > >> > > > If you cannot find it, please let me know.
> > >> > > > Thank you.
> > >> > > >
> > >> > > > Regards,
> > >> > > >
> > >> > > > Jinwoong
> > >> > > >
> > >> > > > On Thu, Jun 22, 2017 at 9:57 AM, John Halley Gotway via
RT <
> > >> > > > met_help at ucar.edu> wrote:
> > >> > > >
> > >> > > > > Jinwoong,
> > >> > > > >
> > >> > > > > Can you please send me two sample data files so I can
look
> more
> > >> > closely
> > >> > > > at
> > >> > > > > the details? You can post them to our anonymois ftp
site
> > >> following
> > >> > > these
> > >> > > > > instructions:
> > >> > > > >
> > >> > > > >
http://www.dtcenter.org/met/users/support/met_help.php#ftp
> > >> > > > >
> > >> > > > > Please let me know when the data is there and I'll go
grab it.
> > >> > > > >
> > >> > > > > Thanks,
> > >> > > > > John
> > >> > > > >
> > >> > > > > On Thu, Jun 22, 2017 at 7:06 AM Jinwoong Yoo via RT <
> > >> > met_help at ucar.edu
> > >> > > >
> > >> > > > > wrote:
> > >> > > > >
> > >> > > > > >
> > >> > > > > > <URL: https://rt.rap.ucar.edu/rt/
> Ticket/Display.html?id=80978
> > >
> > >> > > > > >
> > >> > > > > > Hi John,
> > >> > > > > >
> > >> > > > > > As I look at the sample data using wgrib and wgrib2
under
> the
> > >> > > directory
> > >> > > > > of
> > >> > > > > > data/sample_fcst/2005080700/,
> > >> > > > > > they also have two lines for APCP as my wrfout files:
> > >> > > > > >
> > >> > > > > > 1:0:D=2005080700:APCP:sfc:kpds=61,1,0:0-24hr
acc:winds in
> > grid
> > >> > > > > > direction:"Total precipitation [kg/m^2]
> > >> > > > > >
> > >> > > > > > 2:31408:D=2005080700:APCP:sfc:kpds=61,1,0:21-24hr
acc:winds
> > in
> > >> > grid
> > >> > > > > > direction:"Total precipitation [kg/m^2]
> > >> > > > > > VS.
> > >> > > > > >
> > >> > > > > > 324:14427217:d=2004121700:APCP Total Precipitation
> > >> > > > > [kg/m^2]:surface:0-1103
> > >> > > > > > hour acc fcst:
> > >> > > > > >
> > >> > > > > > 325:14479093:d=2004121700:APCP Total Precipitation
> > >> > > > > > [kg/m^2]:surface:1102-1103
> > >> > > > > > hour acc fcst:
> > >> > > > > >
> > >> > > > > >
> > >> > > > > >
> > >> > > > > > But, there are a few differences between their
format.
> > >> > > > > > While sample grib files have "APCP" and its long
name and
> > >> > > > > > units separately, mines have its long name and units
along
> > with
> > >> > name
> > >> > > of
> > >> > > > > > variable together, which part is the biggest thing I
> suspect.
> > >> Can
> > >> > MET
> > >> > > > > pick
> > >> > > > > > up them correctly?
> > >> > > > > >
> > >> > > > > > Also, mines don't have kpds column.
> > >> > > > > >
> > >> > > > > > Do you think these are causing error in my case?
> > >> > > > > > If it is the case, how can I control MET to read
these
> > >> differences?
> > >> > > > > > Thanks.
> > >> > > > > >
> > >> > > > > > Regards,
> > >> > > > > >
> > >> > > > > > Jinwoong
> > >> > > > > >
> > >> > > > > >
> > >> > > > > > On Wed, Jun 21, 2017 at 8:44 PM, Jinwoong Yoo <
> > >> > > jinwoong.yoo at gmail.com>
> > >> > > > > > wrote:
> > >> > > > > >
> > >> > > > > > > Hi John,
> > >> > > > > > >
> > >> > > > > > > Thank you for your quick reply.
> > >> > > > > > >
> > >> > > > > > > In my WRF grib2 files, I have two APCP variables as
shown
> > >> below:
> > >> > > > > > >
> > >> > > > > > > 324:14427217:d=2004121700:APCP Total Precipitation
> > >> > > > > > [kg/m^2]:surface:0-1103
> > >> > > > > > > hour acc fcst:
> > >> > > > > > >
> > >> > > > > > > 325:14479093:d=2004121700:APCP Total Precipitation
> > >> > > > > > > [kg/m^2]:surface:1102-1103 hour acc fcst:
> > >> > > > > > > In my case, I would like to use values in "325"
line which
> > is
> > >> > APCP
> > >> > > > for
> > >> > > > > > one
> > >> > > > > > > hour accumulation not the total accumulation from
the
> > >> > > initialization
> > >> > > > of
> > >> > > > > > the
> > >> > > > > > > simulation to the forecast time which is "324".
> > >> > > > > > >
> > >> > > > > > >
> > >> > > > > > > Anyway,
> > >> > > > > > > when I modified my command line with "-field
> > >> > > > 'name="APCP";level="Z0";'
> > >> > > > > > > I still got the error as below:
> > >> > > > > > >
> > >> > > > > > > yoo108 at halstead-fe01:
> > >> > > > > > >
*/scratch/halstead/y/yoo108/wrfAnalysis/METanal/pcp_
> > combine*
> > >> $
> > >> > > > > > > /home/yoo108/met-6.0_bugfix/bin/pcp_combine -sum
> > >> > 00000000_000000 1
> > >> > > > > > > 20050101_000000 24 /scratch/halstead/y/yoo108/wrf
> > >> > > > Analysis/METanal/pcp_
> > >> > > > > > > combine/sample_wrf_2005010100V_24A.nc -pcpdir
> > >> > > > > > >
/scratch/halstead/k/khoogewi/CCRC_wrf/grib2/2005/200501
> > >> -field
> > >> > > > > > > 'name="APCP";level="Z0";'
> > >> > > > > > >
> > >> > > > > > > ERROR :
> > >> > > > > > >
> > >> > > > > > > ERROR : sum_data_files() -> Cannot find a file
with a
> valid
> > >> time
> > >> > > of
> > >> > > > > > > 20050101_000000 and accumulation time of 010000
matching
> the
> > >> > > regular
> > >> > > > > > > expression ".*"
> > >> > > > > > >
> > >> > > > > > > ERROR :
> > >> > > > > > >
> > >> > > > > > >
> > >> > > > > > > Thank you.
> > >> > > > > > >
> > >> > > > > > > Regards,
> > >> > > > > > >
> > >> > > > > > > Jinwoong
> > >> > > > > > >
> > >> > > > > > >
> > >> > > > > > > On Wed, Jun 21, 2017 at 7:10 PM, John Halley Gotway
via
> RT <
> > >> > > > > > > met_help at ucar.edu> wrote:
> > >> > > > > > >
> > >> > > > > > >> Jinwoong,
> > >> > > > > > >>
> > >> > > > > > >> I see that you've having trouble getting
pcp_combine to
> sum
> > >> up
> > >> > the
> > >> > > > > data
> > >> > > > > > in
> > >> > > > > > >> the way you'd like.
> > >> > > > > > >>
> > >> > > > > > >> I think you're very close, but unfortunately, I
don't
> > >> understand
> > >> > > > what
> > >> > > > > > you
> > >> > > > > > >> mean by 325. Is the record number that you'd like
to
> > extract
> > >> > from
> > >> > > > the
> > >> > > > > > >> GRIB2 file? Usually, its better to refer to the
name of
> > the
> > >> > > > variable
> > >> > > > > > and
> > >> > > > > > >> have MET find it for you rather then specifying an
> explicit
> > >> > record
> > >> > > > > > number.
> > >> > > > > > >>
> > >> > > > > > >> Let me show you an example for 2m temperature
using
> sample
> > >> data
> > >> > > > that's
> > >> > > > > > >> included in the MET tarball. Of course it doesn't
make
> any
> > >> > sense
> > >> > > to
> > >> > > > > sum
> > >> > > > > > >> up
> > >> > > > > > >> 2m temperature values! But I'm just showing you
as an
> > >> example.
> > >> > > > > > >> Hopefully,
> > >> > > > > > >> you can adapt the example to do what you're trying
to do:
> > >> > > > > > >>
> > >> > > > > > >> cd met-6.0/data/sample_fcst/2005080700
> > >> > > > > > >> ../../../bin/pcp_combine -sum 00000000_000000 3
> > >> 20050807_120000
> > >> > 12
> > >> > > > > > sum.nc
> > >> > > > > > >> -pcpdir . \
> > >> > > > > > >> -field 'name="TMP"; level="Z2";'
> > >> > > > > > >>
> > >> > > > > > >> DEBUG 1: [1] File ./wrfprs_ruc13_12.tm00_G212
matches
> valid
> > >> time
> > >> > > of
> > >> > > > > > >> 20050807_120000
> > >> > > > > > >> DEBUG 1: [2] File ./wrfprs_ruc13_09.tm00_G212
matches
> valid
> > >> time
> > >> > > of
> > >> > > > > > >> 20050807_090000
> > >> > > > > > >> DEBUG 1: [3] File ./wrfprs_ruc13_06.tm00_G212
matches
> valid
> > >> time
> > >> > > of
> > >> > > > > > >> 20050807_060000
> > >> > > > > > >> DEBUG 1: [4] File ./wrfprs_ruc13_03.tm00_G212
matches
> valid
> > >> time
> > >> > > of
> > >> > > > > > >> 20050807_030000
> > >> > > > > > >> DEBUG 1: [1] Reading input file:
> > ./wrfprs_ruc13_12.tm00_G212
> > >> > > > > > >> DEBUG 1: [2] Reading input file:
> > ./wrfprs_ruc13_09.tm00_G212
> > >> > > > > > >> DEBUG 1: [3] Reading input file:
> > ./wrfprs_ruc13_06.tm00_G212
> > >> > > > > > >> DEBUG 1: [4] Reading input file:
> > ./wrfprs_ruc13_03.tm00_G212
> > >> > > > > > >> DEBUG 1: Writing output file: sum.nc
> > >> > > > > > >>
> > >> > > > > > >> The key here is that I set: -field 'name="TMP";
> > level="Z2";'
> > >> > > > > > >>
> > >> > > > > > >> The name and level strings are used to search the
GRIB
> > >> records
> > >> > in
> > >> > > > each
> > >> > > > > > >> file
> > >> > > > > > >> looking for a match.
> > >> > > > > > >>
> > >> > > > > > >> Hopefully that helps.
> > >> > > > > > >>
> > >> > > > > > >> Thanks,
> > >> > > > > > >> John
> > >> > > > > > >>
> > >> > > > > > >> On Wed, Jun 21, 2017 at 4:35 PM, Jinwoong Yoo via
RT <
> > >> > > > > met_help at ucar.edu
> > >> > > > > > >
> > >> > > > > > >> wrote:
> > >> > > > > > >>
> > >> > > > > > >> >
> > >> > > > > > >> > <URL: https://rt.rap.ucar.edu/rt/Tic
> > >> ket/Display.html?id=80978
> > >> > >
> > >> > > > > > >> >
> > >> > > > > > >> > Hi,
> > >> > > > > > >> >
> > >> > > > > > >> > When I didn't specify -field and -config and ran
the
> > >> command:
> > >> > > > > > >> >
> > >> > > > > > >> > yoo108 at halstead-fe03:
> > >> > > > > > >> > */scratch/halstead/y/yoo108/wr
> > >> fAnalysis/METanal/pcp_combine*
> > >> > $
> > >> > > > > > >> > /home/yoo108/met-6.0_bugfix/bin/pcp_combine -sum
> > >> > > 00000000_000000
> > >> > > > 1
> > >> > > > > > >> > 20050101_000000 24
> > >> > > > > > >> >
/scratch/halstead/y/yoo108/wrfAnalysis/METanal/pcp_
> > >> > > > > combine/sample_wrf_
> > >> > > > > > >> > 2005010100V_24A.nc
> > >> > > > > > >> > -pcpdir /scratch/halstead/k/khoogewi/
> > >> > CCRC_wrf/grib2/2005/200501
> > >> > > > > > >> >
> > >> > > > > > >> >
> > >> > > > > > >> >
> > >> > > > > > >> > I got this error below:
> > >> > > > > > >> >
> > >> > > > > > >> > DEBUG 1: [1] File
> > >> > > > > > >> > /scratch/halstead/k/khoogewi/
> CCRC_wrf/grib2/2005/200501/
> > >> > > > > > >> > CESM_WRF_d03_4km_200501010000.grb2
> > >> > > > > > >> > matches valid time of 20050101_000000
> > >> > > > > > >> >
> > >> > > > > > >> > ERROR :
> > >> > > > > > >> >
> > >> > > > > > >> > ERROR : sum_data_files() -> Cannot find a file
with a
> > >> valid
> > >> > > time
> > >> > > > of
> > >> > > > > > >> > 20041231_230000 and accumulation time of 010000
> matching
> > >> the
> > >> > > > regular
> > >> > > > > > >> > expression ".*"
> > >> > > > > > >> >
> > >> > > > > > >> > ERROR :
> > >> > > > > > >> >
> > >> > > > > > >> >
> > >> > > > > > >> > I don't know why it tries to find
20041231_230000 file?
> > >> > > > > > >> > Do I need to use regular expression with it?
> > >> > > > > > >> >
> > >> > > > > > >> > Thank you.
> > >> > > > > > >> > Regards,
> > >> > > > > > >> >
> > >> > > > > > >> > Jinwoong
> > >> > > > > > >> >
> > >> > > > > > >> > On Wed, Jun 21, 2017 at 6:18 PM,
met_help at ucar.edu via
> > RT
> > >> <
> > >> > > > > > >> > met_help at ucar.edu
> > >> > > > > > >> > > wrote:
> > >> > > > > > >> >
> > >> > > > > > >> > > NOTE: THE MET TEAM HAS LIMITED AVAILABILITY
BETWEEN
> > >> 5/23/17
> > >> > > AND
> > >> > > > > > >> 5/30/17.
> > >> > > > > > >> > > RESPONSES MAY BE DELAYED.
> > >> > > > > > >> > >
> > >> > > > > > >> > > Greetings,
> > >> > > > > > >> > >
> > >> > > > > > >> > > This message has been automatically generated
in
> > >> response to
> > >> > > the
> > >> > > > > > >> > > creation of a trouble ticket regarding:
> > >> > > > > > >> > > "Error with pcp_combine for GRIB2
files",
> > >> > > > > > >> > > a summary of which appears below.
> > >> > > > > > >> > >
> > >> > > > > > >> > > There is no need to reply to this message
right now.
> > >> Your
> > >> > > > ticket
> > >> > > > > > has
> > >> > > > > > >> > been
> > >> > > > > > >> > > assigned an ID of [rt.rap.ucar.edu #80978].
> > >> > > > > > >> > >
> > >> > > > > > >> > > Please include the string:
> > >> > > > > > >> > >
> > >> > > > > > >> > > [rt.rap.ucar.edu #80978]
> > >> > > > > > >> > >
> > >> > > > > > >> > > in the subject line of all future
correspondence
> about
> > >> this
> > >> > > > issue.
> > >> > > > > > To
> > >> > > > > > >> do
> > >> > > > > > >> > > so,
> > >> > > > > > >> > > you may reply to this message.
> > >> > > > > > >> > >
> > >> > > > > > >> > > Thank you,
> > >> > > > > > >> > > met_help at ucar.edu
> > >> > > > > > >> > >
> > >> > > > > > >> > > ------------------------------
> > >> > ------------------------------
> > >> > > > > > >> > -------------
> > >> > > > > > >> > > Hi,
> > >> > > > > > >> > > I am trying to combine hourly WRF output files
which
> > have
> > >> > been
> > >> > > > > > >> converted
> > >> > > > > > >> > to
> > >> > > > > > >> > > GRIB2 format using UPP.
> > >> > > > > > >> > >
> > >> > > > > > >> > >
> > >> > > > > > >> > > In the MET online tutorial, it is written "By
> default,
> > >> > > > PCP-Combine
> > >> > > > > > >> > searches
> > >> > > > > > >> > > for records containing GRIB code 61
(accumulated
> > >> > > precipitation).
> > >> > > > > Use
> > >> > > > > > >> > > the *-config
> > >> > > > > > >> > > config_str* option to override this default
and
> process
> > >> > other
> > >> > > > > > fields."
> > >> > > > > > >> > So I
> > >> > > > > > >> > > wanted to change the default for 325 APCP. But
the
> > >> direction
> > >> > > in
> > >> > > > > the
> > >> > > > > > >> > > tutorial is not clear to me.
> > >> > > > > > >> > >
> > >> > > > > > >> > > Do I need to change configure file? (Then,
which
> config
> > >> file
> > >> > > > > should
> > >> > > > > > I
> > >> > > > > > >> > > change?)
> > >> > > > > > >> > > Or can I do this in command line?
> > >> > > > > > >> > >
> > >> > > > > > >> > > When I tried as below, I got error messages.
> > >> > > > > > >> > >
> > >> > > > > > >> > > > -sum 00000000_000000 1 20050101_000000 24 \
> > >> > > > > > >> > >
> > >> > > > > > >> > > >
> > >> > > > > > >> > > /scratch/halstead/y/yoo108/wrf
> > >> Analysis/METanal/pcp_combine/
> > >> > > > > > >> sample_wrf_
> > >> > > > > > >> > > 2005010100V_24A.nc
> > >> > > > > > >> > > \
> > >> > > > > > >> > >
> > >> > > > > > >> > > > -pcpdir /scratch/halstead/k/khoogewi/C
> > >> > > > CRC_wrf/grib2/2005/200501
> > >> > > > > \
> > >> > > > > > >> > >
> > >> > > > > > >> > > > -field APCP \
> > >> > > > > > >> > >
> > >> > > > > > >> > > > -config 325
> > >> > > > > > >> > >
> > >> > > > > > >> > > ERROR :
> > >> > > > > > >> > >
> > >> > > > > > >> > > ERROR : yyerror() -> syntax error in file
> > >> > > > > > "/tmp/config_4646_0_.temp"
> > >> > > > > > >> > >
> > >> > > > > > >> > > ERROR :
> > >> > > > > > >> > >
> > >> > > > > > >> > > ERROR : line = 1
> > >> > > > > > >> > >
> > >> > > > > > >> > > ERROR :
> > >> > > > > > >> > >
> > >> > > > > > >> > > ERROR : column = 1
> > >> > > > > > >> > >
> > >> > > > > > >> > > ERROR :
> > >> > > > > > >> > >
> > >> > > > > > >> > > ERROR : text = "325"
> > >> > > > > > >> > >
> > >> > > > > > >> > > ERROR :
> > >> > > > > > >> > >
> > >> > > > > > >> > > ERROR :
> > >> > > > > > >> > >
> > >> > > > > > >> > > ERROR : 325
> > >> > > > > > >> > >
> > >> > > > > > >> > > ERROR : ^^^
> > >> > > > > > >> > >
> > >> > > > > > >> > > ERROR :
> > >> > > > > > >> > >
> > >> > > > > > >> > >
> > >> > > > > > >> > >
> > >> > > > > > >> > >
> > >> > > > > > >> > > Can you help?
> > >> > > > > > >> > > Thank you.
> > >> > > > > > >> > >
> > >> > > > > > >> > > Regards,
> > >> > > > > > >> > >
> > >> > > > > > >> > > Jinwoong Yoo
> > >> > > > > > >> > >
> > >> > > > > > >> > >
> > >> > > > > > >> >
> > >> > > > > > >> >
> > >> > > > > > >>
> > >> > > > > > >>
> > >> > > > > > >
> > >> > > > > >
> > >> > > > > >
> > >> > > > >
> > >> > > > >
> > >> > > >
> > >> > > >
> > >> > >
> > >> > >
> > >> >
> > >> >
> > >>
> > >>
> > >
> >
> >
>
>
------------------------------------------------
Subject: Error with pcp_combine for GRIB2 files
From: John Halley Gotway
Time: Fri Jun 23 11:31:14 2017
Great, thanks for sending the sample data files.
The number that you specify on the command line for pcp_combine, e.g.
1056,
is actually a timestring formatted as HH[MMSS]. So it's either a
number of
hours or hours followed by minutes and seconds. The trick is defining
the
logic to differentiate between the HH and HHMMSS.
Currently, MET is interpreting up to 3 digits as a number of hours.
But I
realize that we could loosen that logic to allow for up to 5 digits:
- 1 to 5 digits means a number of hours.
- 6 or more digits means 1-5 digits for hours, 2 digits for
minutes, and
2 digits for seconds.
Is it safe to assume that your accumulations will not exceed 99,999
hours
(or 11.4 years)? For accumulations longer than that, we'd need to
change
the logic to allow for the specification of years, months, and days as
well.
This is actually an easy 2-line fix in 1 file:
met-6.0/src/basic/vx_cal/time_strings.cc
I've attached the updated version of that file. Unfortunately, you'll
need
to recompile MET (do a "make clean" and then "make install") with this
change.
Please test to make sure this resolves the issue.
Once I hear back from you that the fix works, I'll commit it to the
repository and post it as a bugfix for met-6.0.
Thanks,
John
On Fri, Jun 23, 2017 at 10:07 AM, Jinwoong Yoo via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80978 >
>
> Hi John,
>
> Thank you very much for your quick reply.
> I uploaded sample files as in Yoo_data3.tar.
> Thank you very much!
>
> Regards,
>
> Jinwoong
>
> On Fri, Jun 23, 2017 at 11:54 AM, John Halley Gotway via RT <
> met_help at ucar.edu> wrote:
>
> > Jinwoong,
> >
> > Yes, I was worried about this happening. I agree that going from
3 to 4
> > digits is causing the problem. But I am surprised by the error
you're
> > getting. The error you've sent indicates that there's a problem
in the
> > syntax of the command line.
> >
> > Instead, I would expect to see an error like this:
> > ERROR: timestring_to_sec(const char *) -> can't parse time string
"1008"
> >
> > I looked on our ftp site and grabbed this file:
> >
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/Yoo_data/Yoo_data2.tar
> >
> > But that's the data you'd sent previously.
> >
> > Could you please send me a couple of files that have a 1000 hour +
> > accumulation interval? I can run them through the debugger to see
how
> the
> > logic could be tweaked to handle them.
> >
> > Thanks,
> > John
> >
> >
> > On Fri, Jun 23, 2017 at 9:14 AM, Jinwoong Yoo via RT
<met_help at ucar.edu>
> > wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80978 >
> > >
> > > Hi John,
> > >
> > > I was able to reproduce your output.
> > > I like the second option better too.
> > > Thank you very much!
> > >
> > > Using the second method (subtract the runtime accumulations),
> > > now I am working on a script file to process my wrf grib2 files
by
> month.
> > > As I was testing it for a month, I found error messages for a
group of
> > > files towards the end of the month.
> > > One of the error messages look like below:
> > >
> > > DEBUG 1: Reading input file:
> > > /scratch/halstead/k/khoogewi/CCRC_wrf/grib2/1976/197601/
> > > CESM_WRF_d03_4km_197601280000.grb2
> > >
> > > ERROR :
> > >
> > > ERROR : yyerror() -> syntax error in file
"/tmp/config_25364_0_.temp"
> > >
> > > ERROR :
> > >
> > > ERROR : line = 1
> > >
> > > ERROR :
> > >
> > > ERROR : column = 1
> > >
> > > ERROR :
> > >
> > > ERROR : text = "1008"
> > >
> > > ERROR :
> > >
> > > ERROR :
> > >
> > > ERROR : 1008
> > >
> > > ERROR : ^^^^
> > >
> > > ERROR :
> > >
> > > I couldn't find the .temp file when I tried.
> > > Input files are in the directory.
> > > I don't know why it failed to process.
> > >
> > > One set of my WRF simulation last for about 45~46 days.
> > > These error start to occur at 42th day of simulation from the
> > > initialization.
> > > At this time, the forecast hour becomes 1008.
> > > I am suspecting the forecast hour more than 1000 is causing the
issue.
> > > Previously, UPP had a similar issue with forecast hour hardcoded
to
> have
> > > only up to triple digits.
> > > What do you think?
> > >
> > > I am using my own bash script to process them.
> > > Please let me know if you have any question.
> > > Thank you.
> > >
> > > Regards,
> > >
> > > Jinwoong
> > >
> > >
> > >
> > > On Thu, Jun 22, 2017 at 4:05 PM, Jinwoong Yoo
<jinwoong.yoo at gmail.com>
> > > wrote:
> > >
> > > > Hi John,
> > > >
> > > > Thank you very much for your kind message!
> > > > I appreciate it.
> > > > Let me try to reproduce what you did myself.
> > > > Thank you.
> > > >
> > > > Regards,
> > > >
> > > > Jinwoong
> > > >
> > > > On Thu, Jun 22, 2017 at 3:37 PM, John Halley Gotway via RT <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > >> Jinwoong,
> > > >>
> > > >> Great, thanks for sending this sample data.
> > > >>
> > > >> Based on the commands you were running, it looks like you're
trying
> to
> > > >> compute 24-hour accumulations. Your GRIB2 files contain 2
different
> > > >> records for APCP, one is a 1-hour accumulation and the second
is a
> > > runtime
> > > >> accumulation.
> > > >>
> > > >> Let me demonstrate two options for compute 24-hour
accumulations.
> > > >>
> > > >> (1) Using the pcp_combine "sum" to sum up the 1-hour records.
> > > >>
> > > >> First, let me point out that the errors you were getting were
caused
> > the
> > > >> valid time you requested. Four times are required for the
"sum"
> > > command:
> > > >> init_time, in_accum, valid_time, and out_accum
> > > >>
> > > >> You were requesting a 24-hour accumulation with a valid time
of
> > > >> 200501010000. That told pcp_combine to search for 1-hourly
> > > accumulations
> > > >> starting at 2004123100 and ending at 2005010100. But you
don't have
> > any
> > > >> data in 2014. Running pcp_combine using these options works
fine:
> > > >>
> > > >> met-6.0/bin/pcp_combine \
> > > >> -sum 00000000_000000 1 20050102_000000 24 \
> > > >> sample_wrf_2005010100V_24A.nc -pcpdir CESM_WRF
> > > >>
> > > >> This is telling it to search from 2005010100 through
2005010200, and
> > > your
> > > >> data covers that time period.
> > > >>
> > > >> (2) Instead of summing up the hourly accumulations, you could
simply
> > > >> subtract the runtime accumulations:
> > > >>
> > > >> met-6.0/bin/pcp_combine \
> > > >> -subtract CESM_WRF/CESM_WRF_d03_4km_200501020000.grb2 384 \
> > > >> CESM_WRF/CESM_WRF_d03_4km_200501010000.grb2 360
\
> > > >> CESM_APCP_20050101_to_20050102.nc
> > > >>
> > > >> This tells pcp_combine to find the 384 hour precip
accumulation from
> > > first
> > > >> first file and 360 hour accumulation from the second find and
> subtract
> > > >> them. Their difference is the precip that occurred between
hours
> 360
> > > and
> > > >> 384.
> > > >>
> > > >> Personally, I think option (2) is much simpler that option
(1),
> since
> > it
> > > >> only requires 2 files instead of 24, but way either works.
> > > >>
> > > >> After running option (2), I ran the following command to plot
the
> > > output:
> > > >>
> > > >> met-6.0/bin/plot_data_plane \
> > > >> CESM_APCP_20050101_to_20050102.nc \
> > > >> CESM_APCP_20050101_to_20050102.ps \
> > > >> 'name="APCP_24"; level="(*,*)";'
> > > >>
> > > >> The resulting image is attached.
> > > >>
> > > >> Thanks,
> > > >> John
> > > >>
> > > >> On Thu, Jun 22, 2017 at 12:41 PM, Jinwoong Yoo via RT <
> > > met_help at ucar.edu>
> > > >> wrote:
> > > >>
> > > >> >
> > > >> > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80978 >
> > > >> >
> > > >> > Hi John,
> > > >> >
> > > >> > I uploaded Yoo_data2.tar file in the Yoo_data directory.
> > > >> > Thank you.
> > > >> >
> > > >> > Regards,
> > > >> >
> > > >> > Jinwoong
> > > >> >
> > > >> > On Thu, Jun 22, 2017 at 2:21 PM, John Halley Gotway via RT
<
> > > >> > met_help at ucar.edu> wrote:
> > > >> >
> > > >> > > Jinwoong,
> > > >> > >
> > > >> > > I went to go grab it from this location but it appears to
be
> > empty:
> > > >> > >
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/Yoo_data/
> > > >> > >
> > > >> > > Could you please try again?
> > > >> > >
> > > >> > > Thanks,
> > > >> > > John
> > > >> > >
> > > >> > > On Thu, Jun 22, 2017 at 8:47 AM, Jinwoong Yoo via RT <
> > > >> met_help at ucar.edu>
> > > >> > > wrote:
> > > >> > >
> > > >> > > >
> > > >> > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80978
> >
> > > >> > > >
> > > >> > > > Hi John,
> > > >> > > >
> > > >> > > > I uploaded my sample files in a tar file.
> > > >> > > > If you cannot find it, please let me know.
> > > >> > > > Thank you.
> > > >> > > >
> > > >> > > > Regards,
> > > >> > > >
> > > >> > > > Jinwoong
> > > >> > > >
> > > >> > > > On Thu, Jun 22, 2017 at 9:57 AM, John Halley Gotway via
RT <
> > > >> > > > met_help at ucar.edu> wrote:
> > > >> > > >
> > > >> > > > > Jinwoong,
> > > >> > > > >
> > > >> > > > > Can you please send me two sample data files so I can
look
> > more
> > > >> > closely
> > > >> > > > at
> > > >> > > > > the details? You can post them to our anonymois ftp
site
> > > >> following
> > > >> > > these
> > > >> > > > > instructions:
> > > >> > > > >
> > > >> > > > >
http://www.dtcenter.org/met/users/support/met_help.php#ftp
> > > >> > > > >
> > > >> > > > > Please let me know when the data is there and I'll go
grab
> it.
> > > >> > > > >
> > > >> > > > > Thanks,
> > > >> > > > > John
> > > >> > > > >
> > > >> > > > > On Thu, Jun 22, 2017 at 7:06 AM Jinwoong Yoo via RT <
> > > >> > met_help at ucar.edu
> > > >> > > >
> > > >> > > > > wrote:
> > > >> > > > >
> > > >> > > > > >
> > > >> > > > > > <URL: https://rt.rap.ucar.edu/rt/
> > Ticket/Display.html?id=80978
> > > >
> > > >> > > > > >
> > > >> > > > > > Hi John,
> > > >> > > > > >
> > > >> > > > > > As I look at the sample data using wgrib and wgrib2
under
> > the
> > > >> > > directory
> > > >> > > > > of
> > > >> > > > > > data/sample_fcst/2005080700/,
> > > >> > > > > > they also have two lines for APCP as my wrfout
files:
> > > >> > > > > >
> > > >> > > > > > 1:0:D=2005080700:APCP:sfc:kpds=61,1,0:0-24hr
acc:winds in
> > > grid
> > > >> > > > > > direction:"Total precipitation [kg/m^2]
> > > >> > > > > >
> > > >> > > > > > 2:31408:D=2005080700:APCP:sfc:kpds=61,1,0:21-24hr
> acc:winds
> > > in
> > > >> > grid
> > > >> > > > > > direction:"Total precipitation [kg/m^2]
> > > >> > > > > > VS.
> > > >> > > > > >
> > > >> > > > > > 324:14427217:d=2004121700:APCP Total Precipitation
> > > >> > > > > [kg/m^2]:surface:0-1103
> > > >> > > > > > hour acc fcst:
> > > >> > > > > >
> > > >> > > > > > 325:14479093:d=2004121700:APCP Total Precipitation
> > > >> > > > > > [kg/m^2]:surface:1102-1103
> > > >> > > > > > hour acc fcst:
> > > >> > > > > >
> > > >> > > > > >
> > > >> > > > > >
> > > >> > > > > > But, there are a few differences between their
format.
> > > >> > > > > > While sample grib files have "APCP" and its long
name and
> > > >> > > > > > units separately, mines have its long name and
units along
> > > with
> > > >> > name
> > > >> > > of
> > > >> > > > > > variable together, which part is the biggest thing
I
> > suspect.
> > > >> Can
> > > >> > MET
> > > >> > > > > pick
> > > >> > > > > > up them correctly?
> > > >> > > > > >
> > > >> > > > > > Also, mines don't have kpds column.
> > > >> > > > > >
> > > >> > > > > > Do you think these are causing error in my case?
> > > >> > > > > > If it is the case, how can I control MET to read
these
> > > >> differences?
> > > >> > > > > > Thanks.
> > > >> > > > > >
> > > >> > > > > > Regards,
> > > >> > > > > >
> > > >> > > > > > Jinwoong
> > > >> > > > > >
> > > >> > > > > >
> > > >> > > > > > On Wed, Jun 21, 2017 at 8:44 PM, Jinwoong Yoo <
> > > >> > > jinwoong.yoo at gmail.com>
> > > >> > > > > > wrote:
> > > >> > > > > >
> > > >> > > > > > > Hi John,
> > > >> > > > > > >
> > > >> > > > > > > Thank you for your quick reply.
> > > >> > > > > > >
> > > >> > > > > > > In my WRF grib2 files, I have two APCP variables
as
> shown
> > > >> below:
> > > >> > > > > > >
> > > >> > > > > > > 324:14427217:d=2004121700:APCP Total
Precipitation
> > > >> > > > > > [kg/m^2]:surface:0-1103
> > > >> > > > > > > hour acc fcst:
> > > >> > > > > > >
> > > >> > > > > > > 325:14479093:d=2004121700:APCP Total
Precipitation
> > > >> > > > > > > [kg/m^2]:surface:1102-1103 hour acc fcst:
> > > >> > > > > > > In my case, I would like to use values in "325"
line
> which
> > > is
> > > >> > APCP
> > > >> > > > for
> > > >> > > > > > one
> > > >> > > > > > > hour accumulation not the total accumulation from
the
> > > >> > > initialization
> > > >> > > > of
> > > >> > > > > > the
> > > >> > > > > > > simulation to the forecast time which is "324".
> > > >> > > > > > >
> > > >> > > > > > >
> > > >> > > > > > > Anyway,
> > > >> > > > > > > when I modified my command line with "-field
> > > >> > > > 'name="APCP";level="Z0";'
> > > >> > > > > > > I still got the error as below:
> > > >> > > > > > >
> > > >> > > > > > > yoo108 at halstead-fe01:
> > > >> > > > > > >
*/scratch/halstead/y/yoo108/wrfAnalysis/METanal/pcp_
> > > combine*
> > > >> $
> > > >> > > > > > > /home/yoo108/met-6.0_bugfix/bin/pcp_combine -sum
> > > >> > 00000000_000000 1
> > > >> > > > > > > 20050101_000000 24 /scratch/halstead/y/yoo108/wrf
> > > >> > > > Analysis/METanal/pcp_
> > > >> > > > > > > combine/sample_wrf_2005010100V_24A.nc -pcpdir
> > > >> > > > > > >
/scratch/halstead/k/khoogewi/CCRC_wrf/grib2/2005/200501
> > > >> -field
> > > >> > > > > > > 'name="APCP";level="Z0";'
> > > >> > > > > > >
> > > >> > > > > > > ERROR :
> > > >> > > > > > >
> > > >> > > > > > > ERROR : sum_data_files() -> Cannot find a file
with a
> > valid
> > > >> time
> > > >> > > of
> > > >> > > > > > > 20050101_000000 and accumulation time of 010000
matching
> > the
> > > >> > > regular
> > > >> > > > > > > expression ".*"
> > > >> > > > > > >
> > > >> > > > > > > ERROR :
> > > >> > > > > > >
> > > >> > > > > > >
> > > >> > > > > > > Thank you.
> > > >> > > > > > >
> > > >> > > > > > > Regards,
> > > >> > > > > > >
> > > >> > > > > > > Jinwoong
> > > >> > > > > > >
> > > >> > > > > > >
> > > >> > > > > > > On Wed, Jun 21, 2017 at 7:10 PM, John Halley
Gotway via
> > RT <
> > > >> > > > > > > met_help at ucar.edu> wrote:
> > > >> > > > > > >
> > > >> > > > > > >> Jinwoong,
> > > >> > > > > > >>
> > > >> > > > > > >> I see that you've having trouble getting
pcp_combine to
> > sum
> > > >> up
> > > >> > the
> > > >> > > > > data
> > > >> > > > > > in
> > > >> > > > > > >> the way you'd like.
> > > >> > > > > > >>
> > > >> > > > > > >> I think you're very close, but unfortunately, I
don't
> > > >> understand
> > > >> > > > what
> > > >> > > > > > you
> > > >> > > > > > >> mean by 325. Is the record number that you'd
like to
> > > extract
> > > >> > from
> > > >> > > > the
> > > >> > > > > > >> GRIB2 file? Usually, its better to refer to the
name
> of
> > > the
> > > >> > > > variable
> > > >> > > > > > and
> > > >> > > > > > >> have MET find it for you rather then specifying
an
> > explicit
> > > >> > record
> > > >> > > > > > number.
> > > >> > > > > > >>
> > > >> > > > > > >> Let me show you an example for 2m temperature
using
> > sample
> > > >> data
> > > >> > > > that's
> > > >> > > > > > >> included in the MET tarball. Of course it
doesn't make
> > any
> > > >> > sense
> > > >> > > to
> > > >> > > > > sum
> > > >> > > > > > >> up
> > > >> > > > > > >> 2m temperature values! But I'm just showing you
as an
> > > >> example.
> > > >> > > > > > >> Hopefully,
> > > >> > > > > > >> you can adapt the example to do what you're
trying to
> do:
> > > >> > > > > > >>
> > > >> > > > > > >> cd met-6.0/data/sample_fcst/2005080700
> > > >> > > > > > >> ../../../bin/pcp_combine -sum 00000000_000000 3
> > > >> 20050807_120000
> > > >> > 12
> > > >> > > > > > sum.nc
> > > >> > > > > > >> -pcpdir . \
> > > >> > > > > > >> -field 'name="TMP"; level="Z2";'
> > > >> > > > > > >>
> > > >> > > > > > >> DEBUG 1: [1] File ./wrfprs_ruc13_12.tm00_G212
matches
> > valid
> > > >> time
> > > >> > > of
> > > >> > > > > > >> 20050807_120000
> > > >> > > > > > >> DEBUG 1: [2] File ./wrfprs_ruc13_09.tm00_G212
matches
> > valid
> > > >> time
> > > >> > > of
> > > >> > > > > > >> 20050807_090000
> > > >> > > > > > >> DEBUG 1: [3] File ./wrfprs_ruc13_06.tm00_G212
matches
> > valid
> > > >> time
> > > >> > > of
> > > >> > > > > > >> 20050807_060000
> > > >> > > > > > >> DEBUG 1: [4] File ./wrfprs_ruc13_03.tm00_G212
matches
> > valid
> > > >> time
> > > >> > > of
> > > >> > > > > > >> 20050807_030000
> > > >> > > > > > >> DEBUG 1: [1] Reading input file:
> > > ./wrfprs_ruc13_12.tm00_G212
> > > >> > > > > > >> DEBUG 1: [2] Reading input file:
> > > ./wrfprs_ruc13_09.tm00_G212
> > > >> > > > > > >> DEBUG 1: [3] Reading input file:
> > > ./wrfprs_ruc13_06.tm00_G212
> > > >> > > > > > >> DEBUG 1: [4] Reading input file:
> > > ./wrfprs_ruc13_03.tm00_G212
> > > >> > > > > > >> DEBUG 1: Writing output file: sum.nc
> > > >> > > > > > >>
> > > >> > > > > > >> The key here is that I set: -field 'name="TMP";
> > > level="Z2";'
> > > >> > > > > > >>
> > > >> > > > > > >> The name and level strings are used to search
the GRIB
> > > >> records
> > > >> > in
> > > >> > > > each
> > > >> > > > > > >> file
> > > >> > > > > > >> looking for a match.
> > > >> > > > > > >>
> > > >> > > > > > >> Hopefully that helps.
> > > >> > > > > > >>
> > > >> > > > > > >> Thanks,
> > > >> > > > > > >> John
> > > >> > > > > > >>
> > > >> > > > > > >> On Wed, Jun 21, 2017 at 4:35 PM, Jinwoong Yoo
via RT <
> > > >> > > > > met_help at ucar.edu
> > > >> > > > > > >
> > > >> > > > > > >> wrote:
> > > >> > > > > > >>
> > > >> > > > > > >> >
> > > >> > > > > > >> > <URL: https://rt.rap.ucar.edu/rt/Tic
> > > >> ket/Display.html?id=80978
> > > >> > >
> > > >> > > > > > >> >
> > > >> > > > > > >> > Hi,
> > > >> > > > > > >> >
> > > >> > > > > > >> > When I didn't specify -field and -config and
ran the
> > > >> command:
> > > >> > > > > > >> >
> > > >> > > > > > >> > yoo108 at halstead-fe03:
> > > >> > > > > > >> > */scratch/halstead/y/yoo108/wr
> > > >> fAnalysis/METanal/pcp_combine*
> > > >> > $
> > > >> > > > > > >> > /home/yoo108/met-6.0_bugfix/bin/pcp_combine
-sum
> > > >> > > 00000000_000000
> > > >> > > > 1
> > > >> > > > > > >> > 20050101_000000 24
> > > >> > > > > > >> >
/scratch/halstead/y/yoo108/wrfAnalysis/METanal/pcp_
> > > >> > > > > combine/sample_wrf_
> > > >> > > > > > >> > 2005010100V_24A.nc
> > > >> > > > > > >> > -pcpdir /scratch/halstead/k/khoogewi/
> > > >> > CCRC_wrf/grib2/2005/200501
> > > >> > > > > > >> >
> > > >> > > > > > >> >
> > > >> > > > > > >> >
> > > >> > > > > > >> > I got this error below:
> > > >> > > > > > >> >
> > > >> > > > > > >> > DEBUG 1: [1] File
> > > >> > > > > > >> > /scratch/halstead/k/khoogewi/
> > CCRC_wrf/grib2/2005/200501/
> > > >> > > > > > >> > CESM_WRF_d03_4km_200501010000.grb2
> > > >> > > > > > >> > matches valid time of 20050101_000000
> > > >> > > > > > >> >
> > > >> > > > > > >> > ERROR :
> > > >> > > > > > >> >
> > > >> > > > > > >> > ERROR : sum_data_files() -> Cannot find a
file with
> a
> > > >> valid
> > > >> > > time
> > > >> > > > of
> > > >> > > > > > >> > 20041231_230000 and accumulation time of
010000
> > matching
> > > >> the
> > > >> > > > regular
> > > >> > > > > > >> > expression ".*"
> > > >> > > > > > >> >
> > > >> > > > > > >> > ERROR :
> > > >> > > > > > >> >
> > > >> > > > > > >> >
> > > >> > > > > > >> > I don't know why it tries to find
20041231_230000
> file?
> > > >> > > > > > >> > Do I need to use regular expression with it?
> > > >> > > > > > >> >
> > > >> > > > > > >> > Thank you.
> > > >> > > > > > >> > Regards,
> > > >> > > > > > >> >
> > > >> > > > > > >> > Jinwoong
> > > >> > > > > > >> >
> > > >> > > > > > >> > On Wed, Jun 21, 2017 at 6:18 PM,
met_help at ucar.edu
> via
> > > RT
> > > >> <
> > > >> > > > > > >> > met_help at ucar.edu
> > > >> > > > > > >> > > wrote:
> > > >> > > > > > >> >
> > > >> > > > > > >> > > NOTE: THE MET TEAM HAS LIMITED AVAILABILITY
BETWEEN
> > > >> 5/23/17
> > > >> > > AND
> > > >> > > > > > >> 5/30/17.
> > > >> > > > > > >> > > RESPONSES MAY BE DELAYED.
> > > >> > > > > > >> > >
> > > >> > > > > > >> > > Greetings,
> > > >> > > > > > >> > >
> > > >> > > > > > >> > > This message has been automatically
generated in
> > > >> response to
> > > >> > > the
> > > >> > > > > > >> > > creation of a trouble ticket regarding:
> > > >> > > > > > >> > > "Error with pcp_combine for GRIB2
files",
> > > >> > > > > > >> > > a summary of which appears below.
> > > >> > > > > > >> > >
> > > >> > > > > > >> > > There is no need to reply to this message
right
> now.
> > > >> Your
> > > >> > > > ticket
> > > >> > > > > > has
> > > >> > > > > > >> > been
> > > >> > > > > > >> > > assigned an ID of [rt.rap.ucar.edu #80978].
> > > >> > > > > > >> > >
> > > >> > > > > > >> > > Please include the string:
> > > >> > > > > > >> > >
> > > >> > > > > > >> > > [rt.rap.ucar.edu #80978]
> > > >> > > > > > >> > >
> > > >> > > > > > >> > > in the subject line of all future
correspondence
> > about
> > > >> this
> > > >> > > > issue.
> > > >> > > > > > To
> > > >> > > > > > >> do
> > > >> > > > > > >> > > so,
> > > >> > > > > > >> > > you may reply to this message.
> > > >> > > > > > >> > >
> > > >> > > > > > >> > > Thank you,
> > > >> > > > > > >> > > met_help at ucar.edu
> > > >> > > > > > >> > >
> > > >> > > > > > >> > > ------------------------------
> > > >> > ------------------------------
> > > >> > > > > > >> > -------------
> > > >> > > > > > >> > > Hi,
> > > >> > > > > > >> > > I am trying to combine hourly WRF output
files
> which
> > > have
> > > >> > been
> > > >> > > > > > >> converted
> > > >> > > > > > >> > to
> > > >> > > > > > >> > > GRIB2 format using UPP.
> > > >> > > > > > >> > >
> > > >> > > > > > >> > >
> > > >> > > > > > >> > > In the MET online tutorial, it is written
"By
> > default,
> > > >> > > > PCP-Combine
> > > >> > > > > > >> > searches
> > > >> > > > > > >> > > for records containing GRIB code 61
(accumulated
> > > >> > > precipitation).
> > > >> > > > > Use
> > > >> > > > > > >> > > the *-config
> > > >> > > > > > >> > > config_str* option to override this default
and
> > process
> > > >> > other
> > > >> > > > > > fields."
> > > >> > > > > > >> > So I
> > > >> > > > > > >> > > wanted to change the default for 325 APCP.
But the
> > > >> direction
> > > >> > > in
> > > >> > > > > the
> > > >> > > > > > >> > > tutorial is not clear to me.
> > > >> > > > > > >> > >
> > > >> > > > > > >> > > Do I need to change configure file? (Then,
which
> > config
> > > >> file
> > > >> > > > > should
> > > >> > > > > > I
> > > >> > > > > > >> > > change?)
> > > >> > > > > > >> > > Or can I do this in command line?
> > > >> > > > > > >> > >
> > > >> > > > > > >> > > When I tried as below, I got error messages.
> > > >> > > > > > >> > >
> > > >> > > > > > >> > > > -sum 00000000_000000 1 20050101_000000 24
\
> > > >> > > > > > >> > >
> > > >> > > > > > >> > > >
> > > >> > > > > > >> > > /scratch/halstead/y/yoo108/wrf
> > > >> Analysis/METanal/pcp_combine/
> > > >> > > > > > >> sample_wrf_
> > > >> > > > > > >> > > 2005010100V_24A.nc
> > > >> > > > > > >> > > \
> > > >> > > > > > >> > >
> > > >> > > > > > >> > > > -pcpdir /scratch/halstead/k/khoogewi/C
> > > >> > > > CRC_wrf/grib2/2005/200501
> > > >> > > > > \
> > > >> > > > > > >> > >
> > > >> > > > > > >> > > > -field APCP \
> > > >> > > > > > >> > >
> > > >> > > > > > >> > > > -config 325
> > > >> > > > > > >> > >
> > > >> > > > > > >> > > ERROR :
> > > >> > > > > > >> > >
> > > >> > > > > > >> > > ERROR : yyerror() -> syntax error in file
> > > >> > > > > > "/tmp/config_4646_0_.temp"
> > > >> > > > > > >> > >
> > > >> > > > > > >> > > ERROR :
> > > >> > > > > > >> > >
> > > >> > > > > > >> > > ERROR : line = 1
> > > >> > > > > > >> > >
> > > >> > > > > > >> > > ERROR :
> > > >> > > > > > >> > >
> > > >> > > > > > >> > > ERROR : column = 1
> > > >> > > > > > >> > >
> > > >> > > > > > >> > > ERROR :
> > > >> > > > > > >> > >
> > > >> > > > > > >> > > ERROR : text = "325"
> > > >> > > > > > >> > >
> > > >> > > > > > >> > > ERROR :
> > > >> > > > > > >> > >
> > > >> > > > > > >> > > ERROR :
> > > >> > > > > > >> > >
> > > >> > > > > > >> > > ERROR : 325
> > > >> > > > > > >> > >
> > > >> > > > > > >> > > ERROR : ^^^
> > > >> > > > > > >> > >
> > > >> > > > > > >> > > ERROR :
> > > >> > > > > > >> > >
> > > >> > > > > > >> > >
> > > >> > > > > > >> > >
> > > >> > > > > > >> > >
> > > >> > > > > > >> > > Can you help?
> > > >> > > > > > >> > > Thank you.
> > > >> > > > > > >> > >
> > > >> > > > > > >> > > Regards,
> > > >> > > > > > >> > >
> > > >> > > > > > >> > > Jinwoong Yoo
> > > >> > > > > > >> > >
> > > >> > > > > > >> > >
> > > >> > > > > > >> >
> > > >> > > > > > >> >
> > > >> > > > > > >>
> > > >> > > > > > >>
> > > >> > > > > > >
> > > >> > > > > >
> > > >> > > > > >
> > > >> > > > >
> > > >> > > > >
> > > >> > > >
> > > >> > > >
> > > >> > >
> > > >> > >
> > > >> >
> > > >> >
> > > >>
> > > >>
> > > >
> > >
> > >
> >
> >
>
>
------------------------------------------------
Subject: Error with pcp_combine for GRIB2 files
From: Jinwoong Yoo
Time: Fri Jun 23 12:14:20 2017
Hi John,
Thank you for your investigation and solution.
"Is it safe to assume that your accumulations will not exceed 99,999
hours
(or 11.4 years)?"
>>> Yes, it is alright for now. But I may run a continuous climate
simulation longer than 30 years in the near future. So, I would like
to see
an "unlimited"-ish forecast hour in the new version of MET.
After I rebuild met-6.0 with the time_strings.cc provided,
do you think I can keep my syntax as now using 4 digits?
Let me rebuild MET and try it.
Will let you know.
Thank you.
Regards,
Jinwoong
On Fri, Jun 23, 2017 at 1:31 PM, John Halley Gotway via RT <
met_help at ucar.edu> wrote:
> Great, thanks for sending the sample data files.
>
> The number that you specify on the command line for pcp_combine,
e.g. 1056,
> is actually a timestring formatted as HH[MMSS]. So it's either a
number of
> hours or hours followed by minutes and seconds. The trick is
defining the
> logic to differentiate between the HH and HHMMSS.
>
> Currently, MET is interpreting up to 3 digits as a number of hours.
But I
> realize that we could loosen that logic to allow for up to 5 digits:
> - 1 to 5 digits means a number of hours.
> - 6 or more digits means 1-5 digits for hours, 2 digits for
minutes, and
> 2 digits for seconds.
>
> Is it safe to assume that your accumulations will not exceed 99,999
hours
> (or 11.4 years)? For accumulations longer than that, we'd need to
change
> the logic to allow for the specification of years, months, and days
as
> well.
>
> This is actually an easy 2-line fix in 1 file:
> met-6.0/src/basic/vx_cal/time_strings.cc
>
> I've attached the updated version of that file. Unfortunately,
you'll need
> to recompile MET (do a "make clean" and then "make install") with
this
> change.
>
> Please test to make sure this resolves the issue.
>
> Once I hear back from you that the fix works, I'll commit it to the
> repository and post it as a bugfix for met-6.0.
>
> Thanks,
> John
>
> On Fri, Jun 23, 2017 at 10:07 AM, Jinwoong Yoo via RT
<met_help at ucar.edu>
> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80978 >
> >
> > Hi John,
> >
> > Thank you very much for your quick reply.
> > I uploaded sample files as in Yoo_data3.tar.
> > Thank you very much!
> >
> > Regards,
> >
> > Jinwoong
> >
> > On Fri, Jun 23, 2017 at 11:54 AM, John Halley Gotway via RT <
> > met_help at ucar.edu> wrote:
> >
> > > Jinwoong,
> > >
> > > Yes, I was worried about this happening. I agree that going
from 3 to
> 4
> > > digits is causing the problem. But I am surprised by the error
you're
> > > getting. The error you've sent indicates that there's a problem
in the
> > > syntax of the command line.
> > >
> > > Instead, I would expect to see an error like this:
> > > ERROR: timestring_to_sec(const char *) -> can't parse time
string
> "1008"
> > >
> > > I looked on our ftp site and grabbed this file:
> > >
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/Yoo_data/Yoo_data2.tar
> > >
> > > But that's the data you'd sent previously.
> > >
> > > Could you please send me a couple of files that have a 1000 hour
+
> > > accumulation interval? I can run them through the debugger to
see how
> > the
> > > logic could be tweaked to handle them.
> > >
> > > Thanks,
> > > John
> > >
> > >
> > > On Fri, Jun 23, 2017 at 9:14 AM, Jinwoong Yoo via RT <
> met_help at ucar.edu>
> > > wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80978
>
> > > >
> > > > Hi John,
> > > >
> > > > I was able to reproduce your output.
> > > > I like the second option better too.
> > > > Thank you very much!
> > > >
> > > > Using the second method (subtract the runtime accumulations),
> > > > now I am working on a script file to process my wrf grib2
files by
> > month.
> > > > As I was testing it for a month, I found error messages for a
group
> of
> > > > files towards the end of the month.
> > > > One of the error messages look like below:
> > > >
> > > > DEBUG 1: Reading input file:
> > > > /scratch/halstead/k/khoogewi/CCRC_wrf/grib2/1976/197601/
> > > > CESM_WRF_d03_4km_197601280000.grb2
> > > >
> > > > ERROR :
> > > >
> > > > ERROR : yyerror() -> syntax error in file
> "/tmp/config_25364_0_.temp"
> > > >
> > > > ERROR :
> > > >
> > > > ERROR : line = 1
> > > >
> > > > ERROR :
> > > >
> > > > ERROR : column = 1
> > > >
> > > > ERROR :
> > > >
> > > > ERROR : text = "1008"
> > > >
> > > > ERROR :
> > > >
> > > > ERROR :
> > > >
> > > > ERROR : 1008
> > > >
> > > > ERROR : ^^^^
> > > >
> > > > ERROR :
> > > >
> > > > I couldn't find the .temp file when I tried.
> > > > Input files are in the directory.
> > > > I don't know why it failed to process.
> > > >
> > > > One set of my WRF simulation last for about 45~46 days.
> > > > These error start to occur at 42th day of simulation from the
> > > > initialization.
> > > > At this time, the forecast hour becomes 1008.
> > > > I am suspecting the forecast hour more than 1000 is causing
the
> issue.
> > > > Previously, UPP had a similar issue with forecast hour
hardcoded to
> > have
> > > > only up to triple digits.
> > > > What do you think?
> > > >
> > > > I am using my own bash script to process them.
> > > > Please let me know if you have any question.
> > > > Thank you.
> > > >
> > > > Regards,
> > > >
> > > > Jinwoong
> > > >
> > > >
> > > >
> > > > On Thu, Jun 22, 2017 at 4:05 PM, Jinwoong Yoo <
> jinwoong.yoo at gmail.com>
> > > > wrote:
> > > >
> > > > > Hi John,
> > > > >
> > > > > Thank you very much for your kind message!
> > > > > I appreciate it.
> > > > > Let me try to reproduce what you did myself.
> > > > > Thank you.
> > > > >
> > > > > Regards,
> > > > >
> > > > > Jinwoong
> > > > >
> > > > > On Thu, Jun 22, 2017 at 3:37 PM, John Halley Gotway via RT <
> > > > > met_help at ucar.edu> wrote:
> > > > >
> > > > >> Jinwoong,
> > > > >>
> > > > >> Great, thanks for sending this sample data.
> > > > >>
> > > > >> Based on the commands you were running, it looks like
you're
> trying
> > to
> > > > >> compute 24-hour accumulations. Your GRIB2 files contain 2
> different
> > > > >> records for APCP, one is a 1-hour accumulation and the
second is a
> > > > runtime
> > > > >> accumulation.
> > > > >>
> > > > >> Let me demonstrate two options for compute 24-hour
accumulations.
> > > > >>
> > > > >> (1) Using the pcp_combine "sum" to sum up the 1-hour
records.
> > > > >>
> > > > >> First, let me point out that the errors you were getting
were
> caused
> > > the
> > > > >> valid time you requested. Four times are required for the
"sum"
> > > > command:
> > > > >> init_time, in_accum, valid_time, and out_accum
> > > > >>
> > > > >> You were requesting a 24-hour accumulation with a valid
time of
> > > > >> 200501010000. That told pcp_combine to search for 1-hourly
> > > > accumulations
> > > > >> starting at 2004123100 and ending at 2005010100. But you
don't
> have
> > > any
> > > > >> data in 2014. Running pcp_combine using these options
works fine:
> > > > >>
> > > > >> met-6.0/bin/pcp_combine \
> > > > >> -sum 00000000_000000 1 20050102_000000 24 \
> > > > >> sample_wrf_2005010100V_24A.nc -pcpdir CESM_WRF
> > > > >>
> > > > >> This is telling it to search from 2005010100 through
2005010200,
> and
> > > > your
> > > > >> data covers that time period.
> > > > >>
> > > > >> (2) Instead of summing up the hourly accumulations, you
could
> simply
> > > > >> subtract the runtime accumulations:
> > > > >>
> > > > >> met-6.0/bin/pcp_combine \
> > > > >> -subtract CESM_WRF/CESM_WRF_d03_4km_200501020000.grb2 384 \
> > > > >> CESM_WRF/CESM_WRF_d03_4km_200501010000.grb2
360 \
> > > > >> CESM_APCP_20050101_to_20050102.nc
> > > > >>
> > > > >> This tells pcp_combine to find the 384 hour precip
accumulation
> from
> > > > first
> > > > >> first file and 360 hour accumulation from the second find
and
> > subtract
> > > > >> them. Their difference is the precip that occurred between
hours
> > 360
> > > > and
> > > > >> 384.
> > > > >>
> > > > >> Personally, I think option (2) is much simpler that option
(1),
> > since
> > > it
> > > > >> only requires 2 files instead of 24, but way either works.
> > > > >>
> > > > >> After running option (2), I ran the following command to
plot the
> > > > output:
> > > > >>
> > > > >> met-6.0/bin/plot_data_plane \
> > > > >> CESM_APCP_20050101_to_20050102.nc \
> > > > >> CESM_APCP_20050101_to_20050102.ps \
> > > > >> 'name="APCP_24"; level="(*,*)";'
> > > > >>
> > > > >> The resulting image is attached.
> > > > >>
> > > > >> Thanks,
> > > > >> John
> > > > >>
> > > > >> On Thu, Jun 22, 2017 at 12:41 PM, Jinwoong Yoo via RT <
> > > > met_help at ucar.edu>
> > > > >> wrote:
> > > > >>
> > > > >> >
> > > > >> > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80978 >
> > > > >> >
> > > > >> > Hi John,
> > > > >> >
> > > > >> > I uploaded Yoo_data2.tar file in the Yoo_data directory.
> > > > >> > Thank you.
> > > > >> >
> > > > >> > Regards,
> > > > >> >
> > > > >> > Jinwoong
> > > > >> >
> > > > >> > On Thu, Jun 22, 2017 at 2:21 PM, John Halley Gotway via
RT <
> > > > >> > met_help at ucar.edu> wrote:
> > > > >> >
> > > > >> > > Jinwoong,
> > > > >> > >
> > > > >> > > I went to go grab it from this location but it appears
to be
> > > empty:
> > > > >> > >
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/Yoo_data/
> > > > >> > >
> > > > >> > > Could you please try again?
> > > > >> > >
> > > > >> > > Thanks,
> > > > >> > > John
> > > > >> > >
> > > > >> > > On Thu, Jun 22, 2017 at 8:47 AM, Jinwoong Yoo via RT <
> > > > >> met_help at ucar.edu>
> > > > >> > > wrote:
> > > > >> > >
> > > > >> > > >
> > > > >> > > > <URL: https://rt.rap.ucar.edu/rt/
> Ticket/Display.html?id=80978
> > >
> > > > >> > > >
> > > > >> > > > Hi John,
> > > > >> > > >
> > > > >> > > > I uploaded my sample files in a tar file.
> > > > >> > > > If you cannot find it, please let me know.
> > > > >> > > > Thank you.
> > > > >> > > >
> > > > >> > > > Regards,
> > > > >> > > >
> > > > >> > > > Jinwoong
> > > > >> > > >
> > > > >> > > > On Thu, Jun 22, 2017 at 9:57 AM, John Halley Gotway
via RT <
> > > > >> > > > met_help at ucar.edu> wrote:
> > > > >> > > >
> > > > >> > > > > Jinwoong,
> > > > >> > > > >
> > > > >> > > > > Can you please send me two sample data files so I
can look
> > > more
> > > > >> > closely
> > > > >> > > > at
> > > > >> > > > > the details? You can post them to our anonymois
ftp site
> > > > >> following
> > > > >> > > these
> > > > >> > > > > instructions:
> > > > >> > > > >
> > > > >> > > > > http://www.dtcenter.org/met/
> users/support/met_help.php#ftp
> > > > >> > > > >
> > > > >> > > > > Please let me know when the data is there and I'll
go grab
> > it.
> > > > >> > > > >
> > > > >> > > > > Thanks,
> > > > >> > > > > John
> > > > >> > > > >
> > > > >> > > > > On Thu, Jun 22, 2017 at 7:06 AM Jinwoong Yoo via RT
<
> > > > >> > met_help at ucar.edu
> > > > >> > > >
> > > > >> > > > > wrote:
> > > > >> > > > >
> > > > >> > > > > >
> > > > >> > > > > > <URL: https://rt.rap.ucar.edu/rt/
> > > Ticket/Display.html?id=80978
> > > > >
> > > > >> > > > > >
> > > > >> > > > > > Hi John,
> > > > >> > > > > >
> > > > >> > > > > > As I look at the sample data using wgrib and
wgrib2
> under
> > > the
> > > > >> > > directory
> > > > >> > > > > of
> > > > >> > > > > > data/sample_fcst/2005080700/,
> > > > >> > > > > > they also have two lines for APCP as my wrfout
files:
> > > > >> > > > > >
> > > > >> > > > > > 1:0:D=2005080700:APCP:sfc:kpds=61,1,0:0-24hr
acc:winds
> in
> > > > grid
> > > > >> > > > > > direction:"Total precipitation [kg/m^2]
> > > > >> > > > > >
> > > > >> > > > > > 2:31408:D=2005080700:APCP:sfc:kpds=61,1,0:21-24hr
> > acc:winds
> > > > in
> > > > >> > grid
> > > > >> > > > > > direction:"Total precipitation [kg/m^2]
> > > > >> > > > > > VS.
> > > > >> > > > > >
> > > > >> > > > > > 324:14427217:d=2004121700:APCP Total
Precipitation
> > > > >> > > > > [kg/m^2]:surface:0-1103
> > > > >> > > > > > hour acc fcst:
> > > > >> > > > > >
> > > > >> > > > > > 325:14479093:d=2004121700:APCP Total
Precipitation
> > > > >> > > > > > [kg/m^2]:surface:1102-1103
> > > > >> > > > > > hour acc fcst:
> > > > >> > > > > >
> > > > >> > > > > >
> > > > >> > > > > >
> > > > >> > > > > > But, there are a few differences between their
format.
> > > > >> > > > > > While sample grib files have "APCP" and its long
name
> and
> > > > >> > > > > > units separately, mines have its long name and
units
> along
> > > > with
> > > > >> > name
> > > > >> > > of
> > > > >> > > > > > variable together, which part is the biggest
thing I
> > > suspect.
> > > > >> Can
> > > > >> > MET
> > > > >> > > > > pick
> > > > >> > > > > > up them correctly?
> > > > >> > > > > >
> > > > >> > > > > > Also, mines don't have kpds column.
> > > > >> > > > > >
> > > > >> > > > > > Do you think these are causing error in my case?
> > > > >> > > > > > If it is the case, how can I control MET to read
these
> > > > >> differences?
> > > > >> > > > > > Thanks.
> > > > >> > > > > >
> > > > >> > > > > > Regards,
> > > > >> > > > > >
> > > > >> > > > > > Jinwoong
> > > > >> > > > > >
> > > > >> > > > > >
> > > > >> > > > > > On Wed, Jun 21, 2017 at 8:44 PM, Jinwoong Yoo <
> > > > >> > > jinwoong.yoo at gmail.com>
> > > > >> > > > > > wrote:
> > > > >> > > > > >
> > > > >> > > > > > > Hi John,
> > > > >> > > > > > >
> > > > >> > > > > > > Thank you for your quick reply.
> > > > >> > > > > > >
> > > > >> > > > > > > In my WRF grib2 files, I have two APCP
variables as
> > shown
> > > > >> below:
> > > > >> > > > > > >
> > > > >> > > > > > > 324:14427217:d=2004121700:APCP Total
Precipitation
> > > > >> > > > > > [kg/m^2]:surface:0-1103
> > > > >> > > > > > > hour acc fcst:
> > > > >> > > > > > >
> > > > >> > > > > > > 325:14479093:d=2004121700:APCP Total
Precipitation
> > > > >> > > > > > > [kg/m^2]:surface:1102-1103 hour acc fcst:
> > > > >> > > > > > > In my case, I would like to use values in "325"
line
> > which
> > > > is
> > > > >> > APCP
> > > > >> > > > for
> > > > >> > > > > > one
> > > > >> > > > > > > hour accumulation not the total accumulation
from the
> > > > >> > > initialization
> > > > >> > > > of
> > > > >> > > > > > the
> > > > >> > > > > > > simulation to the forecast time which is "324".
> > > > >> > > > > > >
> > > > >> > > > > > >
> > > > >> > > > > > > Anyway,
> > > > >> > > > > > > when I modified my command line with "-field
> > > > >> > > > 'name="APCP";level="Z0";'
> > > > >> > > > > > > I still got the error as below:
> > > > >> > > > > > >
> > > > >> > > > > > > yoo108 at halstead-fe01:
> > > > >> > > > > > >
*/scratch/halstead/y/yoo108/wrfAnalysis/METanal/pcp_
> > > > combine*
> > > > >> $
> > > > >> > > > > > > /home/yoo108/met-6.0_bugfix/bin/pcp_combine
-sum
> > > > >> > 00000000_000000 1
> > > > >> > > > > > > 20050101_000000 24
/scratch/halstead/y/yoo108/wrf
> > > > >> > > > Analysis/METanal/pcp_
> > > > >> > > > > > > combine/sample_wrf_2005010100V_24A.nc -pcpdir
> > > > >> > > > > > > /scratch/halstead/k/khoogewi/
> CCRC_wrf/grib2/2005/200501
> > > > >> -field
> > > > >> > > > > > > 'name="APCP";level="Z0";'
> > > > >> > > > > > >
> > > > >> > > > > > > ERROR :
> > > > >> > > > > > >
> > > > >> > > > > > > ERROR : sum_data_files() -> Cannot find a file
with a
> > > valid
> > > > >> time
> > > > >> > > of
> > > > >> > > > > > > 20050101_000000 and accumulation time of 010000
> matching
> > > the
> > > > >> > > regular
> > > > >> > > > > > > expression ".*"
> > > > >> > > > > > >
> > > > >> > > > > > > ERROR :
> > > > >> > > > > > >
> > > > >> > > > > > >
> > > > >> > > > > > > Thank you.
> > > > >> > > > > > >
> > > > >> > > > > > > Regards,
> > > > >> > > > > > >
> > > > >> > > > > > > Jinwoong
> > > > >> > > > > > >
> > > > >> > > > > > >
> > > > >> > > > > > > On Wed, Jun 21, 2017 at 7:10 PM, John Halley
Gotway
> via
> > > RT <
> > > > >> > > > > > > met_help at ucar.edu> wrote:
> > > > >> > > > > > >
> > > > >> > > > > > >> Jinwoong,
> > > > >> > > > > > >>
> > > > >> > > > > > >> I see that you've having trouble getting
pcp_combine
> to
> > > sum
> > > > >> up
> > > > >> > the
> > > > >> > > > > data
> > > > >> > > > > > in
> > > > >> > > > > > >> the way you'd like.
> > > > >> > > > > > >>
> > > > >> > > > > > >> I think you're very close, but unfortunately,
I don't
> > > > >> understand
> > > > >> > > > what
> > > > >> > > > > > you
> > > > >> > > > > > >> mean by 325. Is the record number that you'd
like to
> > > > extract
> > > > >> > from
> > > > >> > > > the
> > > > >> > > > > > >> GRIB2 file? Usually, its better to refer to
the name
> > of
> > > > the
> > > > >> > > > variable
> > > > >> > > > > > and
> > > > >> > > > > > >> have MET find it for you rather then
specifying an
> > > explicit
> > > > >> > record
> > > > >> > > > > > number.
> > > > >> > > > > > >>
> > > > >> > > > > > >> Let me show you an example for 2m temperature
using
> > > sample
> > > > >> data
> > > > >> > > > that's
> > > > >> > > > > > >> included in the MET tarball. Of course it
doesn't
> make
> > > any
> > > > >> > sense
> > > > >> > > to
> > > > >> > > > > sum
> > > > >> > > > > > >> up
> > > > >> > > > > > >> 2m temperature values! But I'm just showing
you as
> an
> > > > >> example.
> > > > >> > > > > > >> Hopefully,
> > > > >> > > > > > >> you can adapt the example to do what you're
trying to
> > do:
> > > > >> > > > > > >>
> > > > >> > > > > > >> cd met-6.0/data/sample_fcst/2005080700
> > > > >> > > > > > >> ../../../bin/pcp_combine -sum 00000000_000000
3
> > > > >> 20050807_120000
> > > > >> > 12
> > > > >> > > > > > sum.nc
> > > > >> > > > > > >> -pcpdir . \
> > > > >> > > > > > >> -field 'name="TMP"; level="Z2";'
> > > > >> > > > > > >>
> > > > >> > > > > > >> DEBUG 1: [1] File ./wrfprs_ruc13_12.tm00_G212
matches
> > > valid
> > > > >> time
> > > > >> > > of
> > > > >> > > > > > >> 20050807_120000
> > > > >> > > > > > >> DEBUG 1: [2] File ./wrfprs_ruc13_09.tm00_G212
matches
> > > valid
> > > > >> time
> > > > >> > > of
> > > > >> > > > > > >> 20050807_090000
> > > > >> > > > > > >> DEBUG 1: [3] File ./wrfprs_ruc13_06.tm00_G212
matches
> > > valid
> > > > >> time
> > > > >> > > of
> > > > >> > > > > > >> 20050807_060000
> > > > >> > > > > > >> DEBUG 1: [4] File ./wrfprs_ruc13_03.tm00_G212
matches
> > > valid
> > > > >> time
> > > > >> > > of
> > > > >> > > > > > >> 20050807_030000
> > > > >> > > > > > >> DEBUG 1: [1] Reading input file:
> > > > ./wrfprs_ruc13_12.tm00_G212
> > > > >> > > > > > >> DEBUG 1: [2] Reading input file:
> > > > ./wrfprs_ruc13_09.tm00_G212
> > > > >> > > > > > >> DEBUG 1: [3] Reading input file:
> > > > ./wrfprs_ruc13_06.tm00_G212
> > > > >> > > > > > >> DEBUG 1: [4] Reading input file:
> > > > ./wrfprs_ruc13_03.tm00_G212
> > > > >> > > > > > >> DEBUG 1: Writing output file: sum.nc
> > > > >> > > > > > >>
> > > > >> > > > > > >> The key here is that I set: -field
'name="TMP";
> > > > level="Z2";'
> > > > >> > > > > > >>
> > > > >> > > > > > >> The name and level strings are used to search
the
> GRIB
> > > > >> records
> > > > >> > in
> > > > >> > > > each
> > > > >> > > > > > >> file
> > > > >> > > > > > >> looking for a match.
> > > > >> > > > > > >>
> > > > >> > > > > > >> Hopefully that helps.
> > > > >> > > > > > >>
> > > > >> > > > > > >> Thanks,
> > > > >> > > > > > >> John
> > > > >> > > > > > >>
> > > > >> > > > > > >> On Wed, Jun 21, 2017 at 4:35 PM, Jinwoong Yoo
via RT
> <
> > > > >> > > > > met_help at ucar.edu
> > > > >> > > > > > >
> > > > >> > > > > > >> wrote:
> > > > >> > > > > > >>
> > > > >> > > > > > >> >
> > > > >> > > > > > >> > <URL: https://rt.rap.ucar.edu/rt/Tic
> > > > >> ket/Display.html?id=80978
> > > > >> > >
> > > > >> > > > > > >> >
> > > > >> > > > > > >> > Hi,
> > > > >> > > > > > >> >
> > > > >> > > > > > >> > When I didn't specify -field and -config and
ran
> the
> > > > >> command:
> > > > >> > > > > > >> >
> > > > >> > > > > > >> > yoo108 at halstead-fe03:
> > > > >> > > > > > >> > */scratch/halstead/y/yoo108/wr
> > > > >> fAnalysis/METanal/pcp_combine*
> > > > >> > $
> > > > >> > > > > > >> > /home/yoo108/met-6.0_bugfix/bin/pcp_combine
-sum
> > > > >> > > 00000000_000000
> > > > >> > > > 1
> > > > >> > > > > > >> > 20050101_000000 24
> > > > >> > > > > > >> > /scratch/halstead/y/yoo108/
> wrfAnalysis/METanal/pcp_
> > > > >> > > > > combine/sample_wrf_
> > > > >> > > > > > >> > 2005010100V_24A.nc
> > > > >> > > > > > >> > -pcpdir /scratch/halstead/k/khoogewi/
> > > > >> > CCRC_wrf/grib2/2005/200501
> > > > >> > > > > > >> >
> > > > >> > > > > > >> >
> > > > >> > > > > > >> >
> > > > >> > > > > > >> > I got this error below:
> > > > >> > > > > > >> >
> > > > >> > > > > > >> > DEBUG 1: [1] File
> > > > >> > > > > > >> > /scratch/halstead/k/khoogewi/
> > > CCRC_wrf/grib2/2005/200501/
> > > > >> > > > > > >> > CESM_WRF_d03_4km_200501010000.grb2
> > > > >> > > > > > >> > matches valid time of 20050101_000000
> > > > >> > > > > > >> >
> > > > >> > > > > > >> > ERROR :
> > > > >> > > > > > >> >
> > > > >> > > > > > >> > ERROR : sum_data_files() -> Cannot find a
file
> with
> > a
> > > > >> valid
> > > > >> > > time
> > > > >> > > > of
> > > > >> > > > > > >> > 20041231_230000 and accumulation time of
010000
> > > matching
> > > > >> the
> > > > >> > > > regular
> > > > >> > > > > > >> > expression ".*"
> > > > >> > > > > > >> >
> > > > >> > > > > > >> > ERROR :
> > > > >> > > > > > >> >
> > > > >> > > > > > >> >
> > > > >> > > > > > >> > I don't know why it tries to find
20041231_230000
> > file?
> > > > >> > > > > > >> > Do I need to use regular expression with it?
> > > > >> > > > > > >> >
> > > > >> > > > > > >> > Thank you.
> > > > >> > > > > > >> > Regards,
> > > > >> > > > > > >> >
> > > > >> > > > > > >> > Jinwoong
> > > > >> > > > > > >> >
> > > > >> > > > > > >> > On Wed, Jun 21, 2017 at 6:18 PM,
met_help at ucar.edu
> > via
> > > > RT
> > > > >> <
> > > > >> > > > > > >> > met_help at ucar.edu
> > > > >> > > > > > >> > > wrote:
> > > > >> > > > > > >> >
> > > > >> > > > > > >> > > NOTE: THE MET TEAM HAS LIMITED
AVAILABILITY
> BETWEEN
> > > > >> 5/23/17
> > > > >> > > AND
> > > > >> > > > > > >> 5/30/17.
> > > > >> > > > > > >> > > RESPONSES MAY BE DELAYED.
> > > > >> > > > > > >> > >
> > > > >> > > > > > >> > > Greetings,
> > > > >> > > > > > >> > >
> > > > >> > > > > > >> > > This message has been automatically
generated in
> > > > >> response to
> > > > >> > > the
> > > > >> > > > > > >> > > creation of a trouble ticket regarding:
> > > > >> > > > > > >> > > "Error with pcp_combine for GRIB2
files",
> > > > >> > > > > > >> > > a summary of which appears below.
> > > > >> > > > > > >> > >
> > > > >> > > > > > >> > > There is no need to reply to this message
right
> > now.
> > > > >> Your
> > > > >> > > > ticket
> > > > >> > > > > > has
> > > > >> > > > > > >> > been
> > > > >> > > > > > >> > > assigned an ID of [rt.rap.ucar.edu
#80978].
> > > > >> > > > > > >> > >
> > > > >> > > > > > >> > > Please include the string:
> > > > >> > > > > > >> > >
> > > > >> > > > > > >> > > [rt.rap.ucar.edu #80978]
> > > > >> > > > > > >> > >
> > > > >> > > > > > >> > > in the subject line of all future
correspondence
> > > about
> > > > >> this
> > > > >> > > > issue.
> > > > >> > > > > > To
> > > > >> > > > > > >> do
> > > > >> > > > > > >> > > so,
> > > > >> > > > > > >> > > you may reply to this message.
> > > > >> > > > > > >> > >
> > > > >> > > > > > >> > > Thank you,
> > > > >> > > > > > >> > > met_help at ucar.edu
> > > > >> > > > > > >> > >
> > > > >> > > > > > >> > > ------------------------------
> > > > >> > ------------------------------
> > > > >> > > > > > >> > -------------
> > > > >> > > > > > >> > > Hi,
> > > > >> > > > > > >> > > I am trying to combine hourly WRF output
files
> > which
> > > > have
> > > > >> > been
> > > > >> > > > > > >> converted
> > > > >> > > > > > >> > to
> > > > >> > > > > > >> > > GRIB2 format using UPP.
> > > > >> > > > > > >> > >
> > > > >> > > > > > >> > >
> > > > >> > > > > > >> > > In the MET online tutorial, it is written
"By
> > > default,
> > > > >> > > > PCP-Combine
> > > > >> > > > > > >> > searches
> > > > >> > > > > > >> > > for records containing GRIB code 61
(accumulated
> > > > >> > > precipitation).
> > > > >> > > > > Use
> > > > >> > > > > > >> > > the *-config
> > > > >> > > > > > >> > > config_str* option to override this
default and
> > > process
> > > > >> > other
> > > > >> > > > > > fields."
> > > > >> > > > > > >> > So I
> > > > >> > > > > > >> > > wanted to change the default for 325 APCP.
But
> the
> > > > >> direction
> > > > >> > > in
> > > > >> > > > > the
> > > > >> > > > > > >> > > tutorial is not clear to me.
> > > > >> > > > > > >> > >
> > > > >> > > > > > >> > > Do I need to change configure file? (Then,
which
> > > config
> > > > >> file
> > > > >> > > > > should
> > > > >> > > > > > I
> > > > >> > > > > > >> > > change?)
> > > > >> > > > > > >> > > Or can I do this in command line?
> > > > >> > > > > > >> > >
> > > > >> > > > > > >> > > When I tried as below, I got error
messages.
> > > > >> > > > > > >> > >
> > > > >> > > > > > >> > > > -sum 00000000_000000 1 20050101_000000
24 \
> > > > >> > > > > > >> > >
> > > > >> > > > > > >> > > >
> > > > >> > > > > > >> > > /scratch/halstead/y/yoo108/wrf
> > > > >> Analysis/METanal/pcp_combine/
> > > > >> > > > > > >> sample_wrf_
> > > > >> > > > > > >> > > 2005010100V_24A.nc
> > > > >> > > > > > >> > > \
> > > > >> > > > > > >> > >
> > > > >> > > > > > >> > > > -pcpdir /scratch/halstead/k/khoogewi/C
> > > > >> > > > CRC_wrf/grib2/2005/200501
> > > > >> > > > > \
> > > > >> > > > > > >> > >
> > > > >> > > > > > >> > > > -field APCP \
> > > > >> > > > > > >> > >
> > > > >> > > > > > >> > > > -config 325
> > > > >> > > > > > >> > >
> > > > >> > > > > > >> > > ERROR :
> > > > >> > > > > > >> > >
> > > > >> > > > > > >> > > ERROR : yyerror() -> syntax error in file
> > > > >> > > > > > "/tmp/config_4646_0_.temp"
> > > > >> > > > > > >> > >
> > > > >> > > > > > >> > > ERROR :
> > > > >> > > > > > >> > >
> > > > >> > > > > > >> > > ERROR : line = 1
> > > > >> > > > > > >> > >
> > > > >> > > > > > >> > > ERROR :
> > > > >> > > > > > >> > >
> > > > >> > > > > > >> > > ERROR : column = 1
> > > > >> > > > > > >> > >
> > > > >> > > > > > >> > > ERROR :
> > > > >> > > > > > >> > >
> > > > >> > > > > > >> > > ERROR : text = "325"
> > > > >> > > > > > >> > >
> > > > >> > > > > > >> > > ERROR :
> > > > >> > > > > > >> > >
> > > > >> > > > > > >> > > ERROR :
> > > > >> > > > > > >> > >
> > > > >> > > > > > >> > > ERROR : 325
> > > > >> > > > > > >> > >
> > > > >> > > > > > >> > > ERROR : ^^^
> > > > >> > > > > > >> > >
> > > > >> > > > > > >> > > ERROR :
> > > > >> > > > > > >> > >
> > > > >> > > > > > >> > >
> > > > >> > > > > > >> > >
> > > > >> > > > > > >> > >
> > > > >> > > > > > >> > > Can you help?
> > > > >> > > > > > >> > > Thank you.
> > > > >> > > > > > >> > >
> > > > >> > > > > > >> > > Regards,
> > > > >> > > > > > >> > >
> > > > >> > > > > > >> > > Jinwoong Yoo
> > > > >> > > > > > >> > >
> > > > >> > > > > > >> > >
> > > > >> > > > > > >> >
> > > > >> > > > > > >> >
> > > > >> > > > > > >>
> > > > >> > > > > > >>
> > > > >> > > > > > >
> > > > >> > > > > >
> > > > >> > > > > >
> > > > >> > > > >
> > > > >> > > > >
> > > > >> > > >
> > > > >> > > >
> > > > >> > >
> > > > >> > >
> > > > >> >
> > > > >> >
> > > > >>
> > > > >>
> > > > >
> > > >
> > > >
> > >
> > >
> >
> >
>
>
------------------------------------------------
Subject: Error with pcp_combine for GRIB2 files
From: John Halley Gotway
Time: Fri Jun 23 12:34:45 2017
Jinwoong,
Yes, using 4 digits for the hour should work after you recompile with
the
fix.
One longer term solution would be to enhance pcp_combine to support
timestrings formatted as YYYYMMDD_HHMMSS.
The presence of an underscore '_' would tell pcp_combine to parse it
as
YYYYMMDD_HHMMSS. No underscore and it'd continue parsing it as HHMMSS
timestring.
If you already have or can generate a sample data file with an
accumulation
interval > 99,999 hours, please send it along. That would be very
useful
for development and testing.
Thanks,
John
John
On Fri, Jun 23, 2017 at 12:14 PM, Jinwoong Yoo via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80978 >
>
> Hi John,
>
> Thank you for your investigation and solution.
>
> "Is it safe to assume that your accumulations will not exceed 99,999
hours
> (or 11.4 years)?"
> >>> Yes, it is alright for now. But I may run a continuous climate
> simulation longer than 30 years in the near future. So, I would like
to see
> an "unlimited"-ish forecast hour in the new version of MET.
>
>
> After I rebuild met-6.0 with the time_strings.cc provided,
> do you think I can keep my syntax as now using 4 digits?
>
> Let me rebuild MET and try it.
> Will let you know.
>
> Thank you.
> Regards,
>
> Jinwoong
>
>
> On Fri, Jun 23, 2017 at 1:31 PM, John Halley Gotway via RT <
> met_help at ucar.edu> wrote:
>
> > Great, thanks for sending the sample data files.
> >
> > The number that you specify on the command line for pcp_combine,
e.g.
> 1056,
> > is actually a timestring formatted as HH[MMSS]. So it's either a
number
> of
> > hours or hours followed by minutes and seconds. The trick is
defining
> the
> > logic to differentiate between the HH and HHMMSS.
> >
> > Currently, MET is interpreting up to 3 digits as a number of
hours. But
> I
> > realize that we could loosen that logic to allow for up to 5
digits:
> > - 1 to 5 digits means a number of hours.
> > - 6 or more digits means 1-5 digits for hours, 2 digits for
minutes,
> and
> > 2 digits for seconds.
> >
> > Is it safe to assume that your accumulations will not exceed
99,999 hours
> > (or 11.4 years)? For accumulations longer than that, we'd need to
change
> > the logic to allow for the specification of years, months, and
days as
> > well.
> >
> > This is actually an easy 2-line fix in 1 file:
> > met-6.0/src/basic/vx_cal/time_strings.cc
> >
> > I've attached the updated version of that file. Unfortunately,
you'll
> need
> > to recompile MET (do a "make clean" and then "make install") with
this
> > change.
> >
> > Please test to make sure this resolves the issue.
> >
> > Once I hear back from you that the fix works, I'll commit it to
the
> > repository and post it as a bugfix for met-6.0.
> >
> > Thanks,
> > John
> >
> > On Fri, Jun 23, 2017 at 10:07 AM, Jinwoong Yoo via RT
<met_help at ucar.edu
> >
> > wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80978 >
> > >
> > > Hi John,
> > >
> > > Thank you very much for your quick reply.
> > > I uploaded sample files as in Yoo_data3.tar.
> > > Thank you very much!
> > >
> > > Regards,
> > >
> > > Jinwoong
> > >
> > > On Fri, Jun 23, 2017 at 11:54 AM, John Halley Gotway via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > > Jinwoong,
> > > >
> > > > Yes, I was worried about this happening. I agree that going
from 3
> to
> > 4
> > > > digits is causing the problem. But I am surprised by the
error
> you're
> > > > getting. The error you've sent indicates that there's a
problem in
> the
> > > > syntax of the command line.
> > > >
> > > > Instead, I would expect to see an error like this:
> > > > ERROR: timestring_to_sec(const char *) -> can't parse time
string
> > "1008"
> > > >
> > > > I looked on our ftp site and grabbed this file:
> > > >
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/Yoo_data/Yoo_data2.tar
> > > >
> > > > But that's the data you'd sent previously.
> > > >
> > > > Could you please send me a couple of files that have a 1000
hour +
> > > > accumulation interval? I can run them through the debugger to
see
> how
> > > the
> > > > logic could be tweaked to handle them.
> > > >
> > > > Thanks,
> > > > John
> > > >
> > > >
> > > > On Fri, Jun 23, 2017 at 9:14 AM, Jinwoong Yoo via RT <
> > met_help at ucar.edu>
> > > > wrote:
> > > >
> > > > >
> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80978 >
> > > > >
> > > > > Hi John,
> > > > >
> > > > > I was able to reproduce your output.
> > > > > I like the second option better too.
> > > > > Thank you very much!
> > > > >
> > > > > Using the second method (subtract the runtime
accumulations),
> > > > > now I am working on a script file to process my wrf grib2
files by
> > > month.
> > > > > As I was testing it for a month, I found error messages for
a group
> > of
> > > > > files towards the end of the month.
> > > > > One of the error messages look like below:
> > > > >
> > > > > DEBUG 1: Reading input file:
> > > > > /scratch/halstead/k/khoogewi/CCRC_wrf/grib2/1976/197601/
> > > > > CESM_WRF_d03_4km_197601280000.grb2
> > > > >
> > > > > ERROR :
> > > > >
> > > > > ERROR : yyerror() -> syntax error in file
> > "/tmp/config_25364_0_.temp"
> > > > >
> > > > > ERROR :
> > > > >
> > > > > ERROR : line = 1
> > > > >
> > > > > ERROR :
> > > > >
> > > > > ERROR : column = 1
> > > > >
> > > > > ERROR :
> > > > >
> > > > > ERROR : text = "1008"
> > > > >
> > > > > ERROR :
> > > > >
> > > > > ERROR :
> > > > >
> > > > > ERROR : 1008
> > > > >
> > > > > ERROR : ^^^^
> > > > >
> > > > > ERROR :
> > > > >
> > > > > I couldn't find the .temp file when I tried.
> > > > > Input files are in the directory.
> > > > > I don't know why it failed to process.
> > > > >
> > > > > One set of my WRF simulation last for about 45~46 days.
> > > > > These error start to occur at 42th day of simulation from
the
> > > > > initialization.
> > > > > At this time, the forecast hour becomes 1008.
> > > > > I am suspecting the forecast hour more than 1000 is causing
the
> > issue.
> > > > > Previously, UPP had a similar issue with forecast hour
hardcoded to
> > > have
> > > > > only up to triple digits.
> > > > > What do you think?
> > > > >
> > > > > I am using my own bash script to process them.
> > > > > Please let me know if you have any question.
> > > > > Thank you.
> > > > >
> > > > > Regards,
> > > > >
> > > > > Jinwoong
> > > > >
> > > > >
> > > > >
> > > > > On Thu, Jun 22, 2017 at 4:05 PM, Jinwoong Yoo <
> > jinwoong.yoo at gmail.com>
> > > > > wrote:
> > > > >
> > > > > > Hi John,
> > > > > >
> > > > > > Thank you very much for your kind message!
> > > > > > I appreciate it.
> > > > > > Let me try to reproduce what you did myself.
> > > > > > Thank you.
> > > > > >
> > > > > > Regards,
> > > > > >
> > > > > > Jinwoong
> > > > > >
> > > > > > On Thu, Jun 22, 2017 at 3:37 PM, John Halley Gotway via RT
<
> > > > > > met_help at ucar.edu> wrote:
> > > > > >
> > > > > >> Jinwoong,
> > > > > >>
> > > > > >> Great, thanks for sending this sample data.
> > > > > >>
> > > > > >> Based on the commands you were running, it looks like
you're
> > trying
> > > to
> > > > > >> compute 24-hour accumulations. Your GRIB2 files contain
2
> > different
> > > > > >> records for APCP, one is a 1-hour accumulation and the
second
> is a
> > > > > runtime
> > > > > >> accumulation.
> > > > > >>
> > > > > >> Let me demonstrate two options for compute 24-hour
> accumulations.
> > > > > >>
> > > > > >> (1) Using the pcp_combine "sum" to sum up the 1-hour
records.
> > > > > >>
> > > > > >> First, let me point out that the errors you were getting
were
> > caused
> > > > the
> > > > > >> valid time you requested. Four times are required for
the "sum"
> > > > > command:
> > > > > >> init_time, in_accum, valid_time, and out_accum
> > > > > >>
> > > > > >> You were requesting a 24-hour accumulation with a valid
time of
> > > > > >> 200501010000. That told pcp_combine to search for 1-
hourly
> > > > > accumulations
> > > > > >> starting at 2004123100 and ending at 2005010100. But you
don't
> > have
> > > > any
> > > > > >> data in 2014. Running pcp_combine using these options
works
> fine:
> > > > > >>
> > > > > >> met-6.0/bin/pcp_combine \
> > > > > >> -sum 00000000_000000 1 20050102_000000 24 \
> > > > > >> sample_wrf_2005010100V_24A.nc -pcpdir CESM_WRF
> > > > > >>
> > > > > >> This is telling it to search from 2005010100 through
2005010200,
> > and
> > > > > your
> > > > > >> data covers that time period.
> > > > > >>
> > > > > >> (2) Instead of summing up the hourly accumulations, you
could
> > simply
> > > > > >> subtract the runtime accumulations:
> > > > > >>
> > > > > >> met-6.0/bin/pcp_combine \
> > > > > >> -subtract CESM_WRF/CESM_WRF_d03_4km_200501020000.grb2 384
\
> > > > > >> CESM_WRF/CESM_WRF_d03_4km_200501010000.grb2
360 \
> > > > > >> CESM_APCP_20050101_to_20050102.nc
> > > > > >>
> > > > > >> This tells pcp_combine to find the 384 hour precip
accumulation
> > from
> > > > > first
> > > > > >> first file and 360 hour accumulation from the second find
and
> > > subtract
> > > > > >> them. Their difference is the precip that occurred
between
> hours
> > > 360
> > > > > and
> > > > > >> 384.
> > > > > >>
> > > > > >> Personally, I think option (2) is much simpler that
option (1),
> > > since
> > > > it
> > > > > >> only requires 2 files instead of 24, but way either
works.
> > > > > >>
> > > > > >> After running option (2), I ran the following command to
plot
> the
> > > > > output:
> > > > > >>
> > > > > >> met-6.0/bin/plot_data_plane \
> > > > > >> CESM_APCP_20050101_to_20050102.nc \
> > > > > >> CESM_APCP_20050101_to_20050102.ps \
> > > > > >> 'name="APCP_24"; level="(*,*)";'
> > > > > >>
> > > > > >> The resulting image is attached.
> > > > > >>
> > > > > >> Thanks,
> > > > > >> John
> > > > > >>
> > > > > >> On Thu, Jun 22, 2017 at 12:41 PM, Jinwoong Yoo via RT <
> > > > > met_help at ucar.edu>
> > > > > >> wrote:
> > > > > >>
> > > > > >> >
> > > > > >> > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80978
> >
> > > > > >> >
> > > > > >> > Hi John,
> > > > > >> >
> > > > > >> > I uploaded Yoo_data2.tar file in the Yoo_data
directory.
> > > > > >> > Thank you.
> > > > > >> >
> > > > > >> > Regards,
> > > > > >> >
> > > > > >> > Jinwoong
> > > > > >> >
> > > > > >> > On Thu, Jun 22, 2017 at 2:21 PM, John Halley Gotway via
RT <
> > > > > >> > met_help at ucar.edu> wrote:
> > > > > >> >
> > > > > >> > > Jinwoong,
> > > > > >> > >
> > > > > >> > > I went to go grab it from this location but it
appears to be
> > > > empty:
> > > > > >> > >
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/Yoo_data/
> > > > > >> > >
> > > > > >> > > Could you please try again?
> > > > > >> > >
> > > > > >> > > Thanks,
> > > > > >> > > John
> > > > > >> > >
> > > > > >> > > On Thu, Jun 22, 2017 at 8:47 AM, Jinwoong Yoo via RT
<
> > > > > >> met_help at ucar.edu>
> > > > > >> > > wrote:
> > > > > >> > >
> > > > > >> > > >
> > > > > >> > > > <URL: https://rt.rap.ucar.edu/rt/
> > Ticket/Display.html?id=80978
> > > >
> > > > > >> > > >
> > > > > >> > > > Hi John,
> > > > > >> > > >
> > > > > >> > > > I uploaded my sample files in a tar file.
> > > > > >> > > > If you cannot find it, please let me know.
> > > > > >> > > > Thank you.
> > > > > >> > > >
> > > > > >> > > > Regards,
> > > > > >> > > >
> > > > > >> > > > Jinwoong
> > > > > >> > > >
> > > > > >> > > > On Thu, Jun 22, 2017 at 9:57 AM, John Halley Gotway
via
> RT <
> > > > > >> > > > met_help at ucar.edu> wrote:
> > > > > >> > > >
> > > > > >> > > > > Jinwoong,
> > > > > >> > > > >
> > > > > >> > > > > Can you please send me two sample data files so I
can
> look
> > > > more
> > > > > >> > closely
> > > > > >> > > > at
> > > > > >> > > > > the details? You can post them to our anonymois
ftp
> site
> > > > > >> following
> > > > > >> > > these
> > > > > >> > > > > instructions:
> > > > > >> > > > >
> > > > > >> > > > > http://www.dtcenter.org/met/
> > users/support/met_help.php#ftp
> > > > > >> > > > >
> > > > > >> > > > > Please let me know when the data is there and
I'll go
> grab
> > > it.
> > > > > >> > > > >
> > > > > >> > > > > Thanks,
> > > > > >> > > > > John
> > > > > >> > > > >
> > > > > >> > > > > On Thu, Jun 22, 2017 at 7:06 AM Jinwoong Yoo via
RT <
> > > > > >> > met_help at ucar.edu
> > > > > >> > > >
> > > > > >> > > > > wrote:
> > > > > >> > > > >
> > > > > >> > > > > >
> > > > > >> > > > > > <URL: https://rt.rap.ucar.edu/rt/
> > > > Ticket/Display.html?id=80978
> > > > > >
> > > > > >> > > > > >
> > > > > >> > > > > > Hi John,
> > > > > >> > > > > >
> > > > > >> > > > > > As I look at the sample data using wgrib and
wgrib2
> > under
> > > > the
> > > > > >> > > directory
> > > > > >> > > > > of
> > > > > >> > > > > > data/sample_fcst/2005080700/,
> > > > > >> > > > > > they also have two lines for APCP as my wrfout
files:
> > > > > >> > > > > >
> > > > > >> > > > > > 1:0:D=2005080700:APCP:sfc:kpds=61,1,0:0-24hr
> acc:winds
> > in
> > > > > grid
> > > > > >> > > > > > direction:"Total precipitation [kg/m^2]
> > > > > >> > > > > >
> > > > > >> > > > > > 2:31408:D=2005080700:APCP:sfc:kpds=61,1,0:21-
24hr
> > > acc:winds
> > > > > in
> > > > > >> > grid
> > > > > >> > > > > > direction:"Total precipitation [kg/m^2]
> > > > > >> > > > > > VS.
> > > > > >> > > > > >
> > > > > >> > > > > > 324:14427217:d=2004121700:APCP Total
Precipitation
> > > > > >> > > > > [kg/m^2]:surface:0-1103
> > > > > >> > > > > > hour acc fcst:
> > > > > >> > > > > >
> > > > > >> > > > > > 325:14479093:d=2004121700:APCP Total
Precipitation
> > > > > >> > > > > > [kg/m^2]:surface:1102-1103
> > > > > >> > > > > > hour acc fcst:
> > > > > >> > > > > >
> > > > > >> > > > > >
> > > > > >> > > > > >
> > > > > >> > > > > > But, there are a few differences between their
format.
> > > > > >> > > > > > While sample grib files have "APCP" and its
long name
> > and
> > > > > >> > > > > > units separately, mines have its long name and
units
> > along
> > > > > with
> > > > > >> > name
> > > > > >> > > of
> > > > > >> > > > > > variable together, which part is the biggest
thing I
> > > > suspect.
> > > > > >> Can
> > > > > >> > MET
> > > > > >> > > > > pick
> > > > > >> > > > > > up them correctly?
> > > > > >> > > > > >
> > > > > >> > > > > > Also, mines don't have kpds column.
> > > > > >> > > > > >
> > > > > >> > > > > > Do you think these are causing error in my
case?
> > > > > >> > > > > > If it is the case, how can I control MET to
read these
> > > > > >> differences?
> > > > > >> > > > > > Thanks.
> > > > > >> > > > > >
> > > > > >> > > > > > Regards,
> > > > > >> > > > > >
> > > > > >> > > > > > Jinwoong
> > > > > >> > > > > >
> > > > > >> > > > > >
> > > > > >> > > > > > On Wed, Jun 21, 2017 at 8:44 PM, Jinwoong Yoo <
> > > > > >> > > jinwoong.yoo at gmail.com>
> > > > > >> > > > > > wrote:
> > > > > >> > > > > >
> > > > > >> > > > > > > Hi John,
> > > > > >> > > > > > >
> > > > > >> > > > > > > Thank you for your quick reply.
> > > > > >> > > > > > >
> > > > > >> > > > > > > In my WRF grib2 files, I have two APCP
variables as
> > > shown
> > > > > >> below:
> > > > > >> > > > > > >
> > > > > >> > > > > > > 324:14427217:d=2004121700:APCP Total
Precipitation
> > > > > >> > > > > > [kg/m^2]:surface:0-1103
> > > > > >> > > > > > > hour acc fcst:
> > > > > >> > > > > > >
> > > > > >> > > > > > > 325:14479093:d=2004121700:APCP Total
Precipitation
> > > > > >> > > > > > > [kg/m^2]:surface:1102-1103 hour acc fcst:
> > > > > >> > > > > > > In my case, I would like to use values in
"325" line
> > > which
> > > > > is
> > > > > >> > APCP
> > > > > >> > > > for
> > > > > >> > > > > > one
> > > > > >> > > > > > > hour accumulation not the total accumulation
from
> the
> > > > > >> > > initialization
> > > > > >> > > > of
> > > > > >> > > > > > the
> > > > > >> > > > > > > simulation to the forecast time which is
"324".
> > > > > >> > > > > > >
> > > > > >> > > > > > >
> > > > > >> > > > > > > Anyway,
> > > > > >> > > > > > > when I modified my command line with "-field
> > > > > >> > > > 'name="APCP";level="Z0";'
> > > > > >> > > > > > > I still got the error as below:
> > > > > >> > > > > > >
> > > > > >> > > > > > > yoo108 at halstead-fe01:
> > > > > >> > > > > > > */scratch/halstead/y/yoo108/
> wrfAnalysis/METanal/pcp_
> > > > > combine*
> > > > > >> $
> > > > > >> > > > > > > /home/yoo108/met-6.0_bugfix/bin/pcp_combine
-sum
> > > > > >> > 00000000_000000 1
> > > > > >> > > > > > > 20050101_000000 24
/scratch/halstead/y/yoo108/wrf
> > > > > >> > > > Analysis/METanal/pcp_
> > > > > >> > > > > > > combine/sample_wrf_2005010100V_24A.nc -pcpdir
> > > > > >> > > > > > > /scratch/halstead/k/khoogewi/
> > CCRC_wrf/grib2/2005/200501
> > > > > >> -field
> > > > > >> > > > > > > 'name="APCP";level="Z0";'
> > > > > >> > > > > > >
> > > > > >> > > > > > > ERROR :
> > > > > >> > > > > > >
> > > > > >> > > > > > > ERROR : sum_data_files() -> Cannot find a
file
> with a
> > > > valid
> > > > > >> time
> > > > > >> > > of
> > > > > >> > > > > > > 20050101_000000 and accumulation time of
010000
> > matching
> > > > the
> > > > > >> > > regular
> > > > > >> > > > > > > expression ".*"
> > > > > >> > > > > > >
> > > > > >> > > > > > > ERROR :
> > > > > >> > > > > > >
> > > > > >> > > > > > >
> > > > > >> > > > > > > Thank you.
> > > > > >> > > > > > >
> > > > > >> > > > > > > Regards,
> > > > > >> > > > > > >
> > > > > >> > > > > > > Jinwoong
> > > > > >> > > > > > >
> > > > > >> > > > > > >
> > > > > >> > > > > > > On Wed, Jun 21, 2017 at 7:10 PM, John Halley
Gotway
> > via
> > > > RT <
> > > > > >> > > > > > > met_help at ucar.edu> wrote:
> > > > > >> > > > > > >
> > > > > >> > > > > > >> Jinwoong,
> > > > > >> > > > > > >>
> > > > > >> > > > > > >> I see that you've having trouble getting
> pcp_combine
> > to
> > > > sum
> > > > > >> up
> > > > > >> > the
> > > > > >> > > > > data
> > > > > >> > > > > > in
> > > > > >> > > > > > >> the way you'd like.
> > > > > >> > > > > > >>
> > > > > >> > > > > > >> I think you're very close, but
unfortunately, I
> don't
> > > > > >> understand
> > > > > >> > > > what
> > > > > >> > > > > > you
> > > > > >> > > > > > >> mean by 325. Is the record number that
you'd like
> to
> > > > > extract
> > > > > >> > from
> > > > > >> > > > the
> > > > > >> > > > > > >> GRIB2 file? Usually, its better to refer to
the
> name
> > > of
> > > > > the
> > > > > >> > > > variable
> > > > > >> > > > > > and
> > > > > >> > > > > > >> have MET find it for you rather then
specifying an
> > > > explicit
> > > > > >> > record
> > > > > >> > > > > > number.
> > > > > >> > > > > > >>
> > > > > >> > > > > > >> Let me show you an example for 2m
temperature using
> > > > sample
> > > > > >> data
> > > > > >> > > > that's
> > > > > >> > > > > > >> included in the MET tarball. Of course it
doesn't
> > make
> > > > any
> > > > > >> > sense
> > > > > >> > > to
> > > > > >> > > > > sum
> > > > > >> > > > > > >> up
> > > > > >> > > > > > >> 2m temperature values! But I'm just showing
you as
> > an
> > > > > >> example.
> > > > > >> > > > > > >> Hopefully,
> > > > > >> > > > > > >> you can adapt the example to do what you're
trying
> to
> > > do:
> > > > > >> > > > > > >>
> > > > > >> > > > > > >> cd met-6.0/data/sample_fcst/2005080700
> > > > > >> > > > > > >> ../../../bin/pcp_combine -sum
00000000_000000 3
> > > > > >> 20050807_120000
> > > > > >> > 12
> > > > > >> > > > > > sum.nc
> > > > > >> > > > > > >> -pcpdir . \
> > > > > >> > > > > > >> -field 'name="TMP"; level="Z2";'
> > > > > >> > > > > > >>
> > > > > >> > > > > > >> DEBUG 1: [1] File
./wrfprs_ruc13_12.tm00_G212
> matches
> > > > valid
> > > > > >> time
> > > > > >> > > of
> > > > > >> > > > > > >> 20050807_120000
> > > > > >> > > > > > >> DEBUG 1: [2] File
./wrfprs_ruc13_09.tm00_G212
> matches
> > > > valid
> > > > > >> time
> > > > > >> > > of
> > > > > >> > > > > > >> 20050807_090000
> > > > > >> > > > > > >> DEBUG 1: [3] File
./wrfprs_ruc13_06.tm00_G212
> matches
> > > > valid
> > > > > >> time
> > > > > >> > > of
> > > > > >> > > > > > >> 20050807_060000
> > > > > >> > > > > > >> DEBUG 1: [4] File
./wrfprs_ruc13_03.tm00_G212
> matches
> > > > valid
> > > > > >> time
> > > > > >> > > of
> > > > > >> > > > > > >> 20050807_030000
> > > > > >> > > > > > >> DEBUG 1: [1] Reading input file:
> > > > > ./wrfprs_ruc13_12.tm00_G212
> > > > > >> > > > > > >> DEBUG 1: [2] Reading input file:
> > > > > ./wrfprs_ruc13_09.tm00_G212
> > > > > >> > > > > > >> DEBUG 1: [3] Reading input file:
> > > > > ./wrfprs_ruc13_06.tm00_G212
> > > > > >> > > > > > >> DEBUG 1: [4] Reading input file:
> > > > > ./wrfprs_ruc13_03.tm00_G212
> > > > > >> > > > > > >> DEBUG 1: Writing output file: sum.nc
> > > > > >> > > > > > >>
> > > > > >> > > > > > >> The key here is that I set: -field
'name="TMP";
> > > > > level="Z2";'
> > > > > >> > > > > > >>
> > > > > >> > > > > > >> The name and level strings are used to
search the
> > GRIB
> > > > > >> records
> > > > > >> > in
> > > > > >> > > > each
> > > > > >> > > > > > >> file
> > > > > >> > > > > > >> looking for a match.
> > > > > >> > > > > > >>
> > > > > >> > > > > > >> Hopefully that helps.
> > > > > >> > > > > > >>
> > > > > >> > > > > > >> Thanks,
> > > > > >> > > > > > >> John
> > > > > >> > > > > > >>
> > > > > >> > > > > > >> On Wed, Jun 21, 2017 at 4:35 PM, Jinwoong
Yoo via
> RT
> > <
> > > > > >> > > > > met_help at ucar.edu
> > > > > >> > > > > > >
> > > > > >> > > > > > >> wrote:
> > > > > >> > > > > > >>
> > > > > >> > > > > > >> >
> > > > > >> > > > > > >> > <URL: https://rt.rap.ucar.edu/rt/Tic
> > > > > >> ket/Display.html?id=80978
> > > > > >> > >
> > > > > >> > > > > > >> >
> > > > > >> > > > > > >> > Hi,
> > > > > >> > > > > > >> >
> > > > > >> > > > > > >> > When I didn't specify -field and -config
and ran
> > the
> > > > > >> command:
> > > > > >> > > > > > >> >
> > > > > >> > > > > > >> > yoo108 at halstead-fe03:
> > > > > >> > > > > > >> > */scratch/halstead/y/yoo108/wr
> > > > > >> fAnalysis/METanal/pcp_combine*
> > > > > >> > $
> > > > > >> > > > > > >> > /home/yoo108/met-
6.0_bugfix/bin/pcp_combine -sum
> > > > > >> > > 00000000_000000
> > > > > >> > > > 1
> > > > > >> > > > > > >> > 20050101_000000 24
> > > > > >> > > > > > >> > /scratch/halstead/y/yoo108/
> > wrfAnalysis/METanal/pcp_
> > > > > >> > > > > combine/sample_wrf_
> > > > > >> > > > > > >> > 2005010100V_24A.nc
> > > > > >> > > > > > >> > -pcpdir /scratch/halstead/k/khoogewi/
> > > > > >> > CCRC_wrf/grib2/2005/200501
> > > > > >> > > > > > >> >
> > > > > >> > > > > > >> >
> > > > > >> > > > > > >> >
> > > > > >> > > > > > >> > I got this error below:
> > > > > >> > > > > > >> >
> > > > > >> > > > > > >> > DEBUG 1: [1] File
> > > > > >> > > > > > >> > /scratch/halstead/k/khoogewi/
> > > > CCRC_wrf/grib2/2005/200501/
> > > > > >> > > > > > >> > CESM_WRF_d03_4km_200501010000.grb2
> > > > > >> > > > > > >> > matches valid time of 20050101_000000
> > > > > >> > > > > > >> >
> > > > > >> > > > > > >> > ERROR :
> > > > > >> > > > > > >> >
> > > > > >> > > > > > >> > ERROR : sum_data_files() -> Cannot find a
file
> > with
> > > a
> > > > > >> valid
> > > > > >> > > time
> > > > > >> > > > of
> > > > > >> > > > > > >> > 20041231_230000 and accumulation time of
010000
> > > > matching
> > > > > >> the
> > > > > >> > > > regular
> > > > > >> > > > > > >> > expression ".*"
> > > > > >> > > > > > >> >
> > > > > >> > > > > > >> > ERROR :
> > > > > >> > > > > > >> >
> > > > > >> > > > > > >> >
> > > > > >> > > > > > >> > I don't know why it tries to find
20041231_230000
> > > file?
> > > > > >> > > > > > >> > Do I need to use regular expression with
it?
> > > > > >> > > > > > >> >
> > > > > >> > > > > > >> > Thank you.
> > > > > >> > > > > > >> > Regards,
> > > > > >> > > > > > >> >
> > > > > >> > > > > > >> > Jinwoong
> > > > > >> > > > > > >> >
> > > > > >> > > > > > >> > On Wed, Jun 21, 2017 at 6:18 PM,
> met_help at ucar.edu
> > > via
> > > > > RT
> > > > > >> <
> > > > > >> > > > > > >> > met_help at ucar.edu
> > > > > >> > > > > > >> > > wrote:
> > > > > >> > > > > > >> >
> > > > > >> > > > > > >> > > NOTE: THE MET TEAM HAS LIMITED
AVAILABILITY
> > BETWEEN
> > > > > >> 5/23/17
> > > > > >> > > AND
> > > > > >> > > > > > >> 5/30/17.
> > > > > >> > > > > > >> > > RESPONSES MAY BE DELAYED.
> > > > > >> > > > > > >> > >
> > > > > >> > > > > > >> > > Greetings,
> > > > > >> > > > > > >> > >
> > > > > >> > > > > > >> > > This message has been automatically
generated
> in
> > > > > >> response to
> > > > > >> > > the
> > > > > >> > > > > > >> > > creation of a trouble ticket regarding:
> > > > > >> > > > > > >> > > "Error with pcp_combine for
GRIB2
> files",
> > > > > >> > > > > > >> > > a summary of which appears below.
> > > > > >> > > > > > >> > >
> > > > > >> > > > > > >> > > There is no need to reply to this
message right
> > > now.
> > > > > >> Your
> > > > > >> > > > ticket
> > > > > >> > > > > > has
> > > > > >> > > > > > >> > been
> > > > > >> > > > > > >> > > assigned an ID of [rt.rap.ucar.edu
#80978].
> > > > > >> > > > > > >> > >
> > > > > >> > > > > > >> > > Please include the string:
> > > > > >> > > > > > >> > >
> > > > > >> > > > > > >> > > [rt.rap.ucar.edu #80978]
> > > > > >> > > > > > >> > >
> > > > > >> > > > > > >> > > in the subject line of all future
> correspondence
> > > > about
> > > > > >> this
> > > > > >> > > > issue.
> > > > > >> > > > > > To
> > > > > >> > > > > > >> do
> > > > > >> > > > > > >> > > so,
> > > > > >> > > > > > >> > > you may reply to this message.
> > > > > >> > > > > > >> > >
> > > > > >> > > > > > >> > > Thank you,
> > > > > >> > > > > > >> > >
met_help at ucar.edu
> > > > > >> > > > > > >> > >
> > > > > >> > > > > > >> > > ------------------------------
> > > > > >> > ------------------------------
> > > > > >> > > > > > >> > -------------
> > > > > >> > > > > > >> > > Hi,
> > > > > >> > > > > > >> > > I am trying to combine hourly WRF output
files
> > > which
> > > > > have
> > > > > >> > been
> > > > > >> > > > > > >> converted
> > > > > >> > > > > > >> > to
> > > > > >> > > > > > >> > > GRIB2 format using UPP.
> > > > > >> > > > > > >> > >
> > > > > >> > > > > > >> > >
> > > > > >> > > > > > >> > > In the MET online tutorial, it is
written "By
> > > > default,
> > > > > >> > > > PCP-Combine
> > > > > >> > > > > > >> > searches
> > > > > >> > > > > > >> > > for records containing GRIB code 61
> (accumulated
> > > > > >> > > precipitation).
> > > > > >> > > > > Use
> > > > > >> > > > > > >> > > the *-config
> > > > > >> > > > > > >> > > config_str* option to override this
default and
> > > > process
> > > > > >> > other
> > > > > >> > > > > > fields."
> > > > > >> > > > > > >> > So I
> > > > > >> > > > > > >> > > wanted to change the default for 325
APCP. But
> > the
> > > > > >> direction
> > > > > >> > > in
> > > > > >> > > > > the
> > > > > >> > > > > > >> > > tutorial is not clear to me.
> > > > > >> > > > > > >> > >
> > > > > >> > > > > > >> > > Do I need to change configure file?
(Then,
> which
> > > > config
> > > > > >> file
> > > > > >> > > > > should
> > > > > >> > > > > > I
> > > > > >> > > > > > >> > > change?)
> > > > > >> > > > > > >> > > Or can I do this in command line?
> > > > > >> > > > > > >> > >
> > > > > >> > > > > > >> > > When I tried as below, I got error
messages.
> > > > > >> > > > > > >> > >
> > > > > >> > > > > > >> > > > -sum 00000000_000000 1 20050101_000000
24 \
> > > > > >> > > > > > >> > >
> > > > > >> > > > > > >> > > >
> > > > > >> > > > > > >> > > /scratch/halstead/y/yoo108/wrf
> > > > > >> Analysis/METanal/pcp_combine/
> > > > > >> > > > > > >> sample_wrf_
> > > > > >> > > > > > >> > > 2005010100V_24A.nc
> > > > > >> > > > > > >> > > \
> > > > > >> > > > > > >> > >
> > > > > >> > > > > > >> > > > -pcpdir /scratch/halstead/k/khoogewi/C
> > > > > >> > > > CRC_wrf/grib2/2005/200501
> > > > > >> > > > > \
> > > > > >> > > > > > >> > >
> > > > > >> > > > > > >> > > > -field APCP \
> > > > > >> > > > > > >> > >
> > > > > >> > > > > > >> > > > -config 325
> > > > > >> > > > > > >> > >
> > > > > >> > > > > > >> > > ERROR :
> > > > > >> > > > > > >> > >
> > > > > >> > > > > > >> > > ERROR : yyerror() -> syntax error in
file
> > > > > >> > > > > > "/tmp/config_4646_0_.temp"
> > > > > >> > > > > > >> > >
> > > > > >> > > > > > >> > > ERROR :
> > > > > >> > > > > > >> > >
> > > > > >> > > > > > >> > > ERROR : line = 1
> > > > > >> > > > > > >> > >
> > > > > >> > > > > > >> > > ERROR :
> > > > > >> > > > > > >> > >
> > > > > >> > > > > > >> > > ERROR : column = 1
> > > > > >> > > > > > >> > >
> > > > > >> > > > > > >> > > ERROR :
> > > > > >> > > > > > >> > >
> > > > > >> > > > > > >> > > ERROR : text = "325"
> > > > > >> > > > > > >> > >
> > > > > >> > > > > > >> > > ERROR :
> > > > > >> > > > > > >> > >
> > > > > >> > > > > > >> > > ERROR :
> > > > > >> > > > > > >> > >
> > > > > >> > > > > > >> > > ERROR : 325
> > > > > >> > > > > > >> > >
> > > > > >> > > > > > >> > > ERROR : ^^^
> > > > > >> > > > > > >> > >
> > > > > >> > > > > > >> > > ERROR :
> > > > > >> > > > > > >> > >
> > > > > >> > > > > > >> > >
> > > > > >> > > > > > >> > >
> > > > > >> > > > > > >> > >
> > > > > >> > > > > > >> > > Can you help?
> > > > > >> > > > > > >> > > Thank you.
> > > > > >> > > > > > >> > >
> > > > > >> > > > > > >> > > Regards,
> > > > > >> > > > > > >> > >
> > > > > >> > > > > > >> > > Jinwoong Yoo
> > > > > >> > > > > > >> > >
> > > > > >> > > > > > >> > >
> > > > > >> > > > > > >> >
> > > > > >> > > > > > >> >
> > > > > >> > > > > > >>
> > > > > >> > > > > > >>
> > > > > >> > > > > > >
> > > > > >> > > > > >
> > > > > >> > > > > >
> > > > > >> > > > >
> > > > > >> > > > >
> > > > > >> > > >
> > > > > >> > > >
> > > > > >> > >
> > > > > >> > >
> > > > > >> >
> > > > > >> >
> > > > > >>
> > > > > >>
> > > > > >
> > > > >
> > > > >
> > > >
> > > >
> > >
> > >
> >
> >
>
>
------------------------------------------------
Subject: Error with pcp_combine for GRIB2 files
From: Jinwoong Yoo
Time: Fri Jun 23 13:26:37 2017
Hi John,
Yes, it works now after I rebuilt the MET-6.0 with the updated time_
strings.cc.
Thank you very much.
Sounds good to me.
I will let you know if I produce forecast files > 99,999 hours in the
future.
Thank you.
Regards,
Jinwoong
On Fri, Jun 23, 2017 at 2:34 PM, John Halley Gotway via RT <
met_help at ucar.edu> wrote:
> Jinwoong,
>
> Yes, using 4 digits for the hour should work after you recompile
with the
> fix.
>
> One longer term solution would be to enhance pcp_combine to support
> timestrings formatted as YYYYMMDD_HHMMSS.
>
> The presence of an underscore '_' would tell pcp_combine to parse it
as
> YYYYMMDD_HHMMSS. No underscore and it'd continue parsing it as
HHMMSS
> timestring.
>
> If you already have or can generate a sample data file with an
accumulation
> interval > 99,999 hours, please send it along. That would be very
useful
> for development and testing.
>
> Thanks,
> John
>
> John
>
> On Fri, Jun 23, 2017 at 12:14 PM, Jinwoong Yoo via RT
<met_help at ucar.edu>
> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80978 >
> >
> > Hi John,
> >
> > Thank you for your investigation and solution.
> >
> > "Is it safe to assume that your accumulations will not exceed
99,999
> hours
> > (or 11.4 years)?"
> > >>> Yes, it is alright for now. But I may run a continuous climate
> > simulation longer than 30 years in the near future. So, I would
like to
> see
> > an "unlimited"-ish forecast hour in the new version of MET.
> >
> >
> > After I rebuild met-6.0 with the time_strings.cc provided,
> > do you think I can keep my syntax as now using 4 digits?
> >
> > Let me rebuild MET and try it.
> > Will let you know.
> >
> > Thank you.
> > Regards,
> >
> > Jinwoong
> >
> >
> > On Fri, Jun 23, 2017 at 1:31 PM, John Halley Gotway via RT <
> > met_help at ucar.edu> wrote:
> >
> > > Great, thanks for sending the sample data files.
> > >
> > > The number that you specify on the command line for pcp_combine,
e.g.
> > 1056,
> > > is actually a timestring formatted as HH[MMSS]. So it's either
a
> number
> > of
> > > hours or hours followed by minutes and seconds. The trick is
defining
> > the
> > > logic to differentiate between the HH and HHMMSS.
> > >
> > > Currently, MET is interpreting up to 3 digits as a number of
hours.
> But
> > I
> > > realize that we could loosen that logic to allow for up to 5
digits:
> > > - 1 to 5 digits means a number of hours.
> > > - 6 or more digits means 1-5 digits for hours, 2 digits for
minutes,
> > and
> > > 2 digits for seconds.
> > >
> > > Is it safe to assume that your accumulations will not exceed
99,999
> hours
> > > (or 11.4 years)? For accumulations longer than that, we'd need
to
> change
> > > the logic to allow for the specification of years, months, and
days as
> > > well.
> > >
> > > This is actually an easy 2-line fix in 1 file:
> > > met-6.0/src/basic/vx_cal/time_strings.cc
> > >
> > > I've attached the updated version of that file. Unfortunately,
you'll
> > need
> > > to recompile MET (do a "make clean" and then "make install")
with this
> > > change.
> > >
> > > Please test to make sure this resolves the issue.
> > >
> > > Once I hear back from you that the fix works, I'll commit it to
the
> > > repository and post it as a bugfix for met-6.0.
> > >
> > > Thanks,
> > > John
> > >
> > > On Fri, Jun 23, 2017 at 10:07 AM, Jinwoong Yoo via RT <
> met_help at ucar.edu
> > >
> > > wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80978
>
> > > >
> > > > Hi John,
> > > >
> > > > Thank you very much for your quick reply.
> > > > I uploaded sample files as in Yoo_data3.tar.
> > > > Thank you very much!
> > > >
> > > > Regards,
> > > >
> > > > Jinwoong
> > > >
> > > > On Fri, Jun 23, 2017 at 11:54 AM, John Halley Gotway via RT <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > > > Jinwoong,
> > > > >
> > > > > Yes, I was worried about this happening. I agree that going
from 3
> > to
> > > 4
> > > > > digits is causing the problem. But I am surprised by the
error
> > you're
> > > > > getting. The error you've sent indicates that there's a
problem in
> > the
> > > > > syntax of the command line.
> > > > >
> > > > > Instead, I would expect to see an error like this:
> > > > > ERROR: timestring_to_sec(const char *) -> can't parse time
string
> > > "1008"
> > > > >
> > > > > I looked on our ftp site and grabbed this file:
> > > > > ftp://ftp.rap.ucar.edu/incoming/irap/met_help/Yoo_
> data/Yoo_data2.tar
> > > > >
> > > > > But that's the data you'd sent previously.
> > > > >
> > > > > Could you please send me a couple of files that have a 1000
hour +
> > > > > accumulation interval? I can run them through the debugger
to see
> > how
> > > > the
> > > > > logic could be tweaked to handle them.
> > > > >
> > > > > Thanks,
> > > > > John
> > > > >
> > > > >
> > > > > On Fri, Jun 23, 2017 at 9:14 AM, Jinwoong Yoo via RT <
> > > met_help at ucar.edu>
> > > > > wrote:
> > > > >
> > > > > >
> > > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80978 >
> > > > > >
> > > > > > Hi John,
> > > > > >
> > > > > > I was able to reproduce your output.
> > > > > > I like the second option better too.
> > > > > > Thank you very much!
> > > > > >
> > > > > > Using the second method (subtract the runtime
accumulations),
> > > > > > now I am working on a script file to process my wrf grib2
files
> by
> > > > month.
> > > > > > As I was testing it for a month, I found error messages
for a
> group
> > > of
> > > > > > files towards the end of the month.
> > > > > > One of the error messages look like below:
> > > > > >
> > > > > > DEBUG 1: Reading input file:
> > > > > > /scratch/halstead/k/khoogewi/CCRC_wrf/grib2/1976/197601/
> > > > > > CESM_WRF_d03_4km_197601280000.grb2
> > > > > >
> > > > > > ERROR :
> > > > > >
> > > > > > ERROR : yyerror() -> syntax error in file
> > > "/tmp/config_25364_0_.temp"
> > > > > >
> > > > > > ERROR :
> > > > > >
> > > > > > ERROR : line = 1
> > > > > >
> > > > > > ERROR :
> > > > > >
> > > > > > ERROR : column = 1
> > > > > >
> > > > > > ERROR :
> > > > > >
> > > > > > ERROR : text = "1008"
> > > > > >
> > > > > > ERROR :
> > > > > >
> > > > > > ERROR :
> > > > > >
> > > > > > ERROR : 1008
> > > > > >
> > > > > > ERROR : ^^^^
> > > > > >
> > > > > > ERROR :
> > > > > >
> > > > > > I couldn't find the .temp file when I tried.
> > > > > > Input files are in the directory.
> > > > > > I don't know why it failed to process.
> > > > > >
> > > > > > One set of my WRF simulation last for about 45~46 days.
> > > > > > These error start to occur at 42th day of simulation from
the
> > > > > > initialization.
> > > > > > At this time, the forecast hour becomes 1008.
> > > > > > I am suspecting the forecast hour more than 1000 is
causing the
> > > issue.
> > > > > > Previously, UPP had a similar issue with forecast hour
hardcoded
> to
> > > > have
> > > > > > only up to triple digits.
> > > > > > What do you think?
> > > > > >
> > > > > > I am using my own bash script to process them.
> > > > > > Please let me know if you have any question.
> > > > > > Thank you.
> > > > > >
> > > > > > Regards,
> > > > > >
> > > > > > Jinwoong
> > > > > >
> > > > > >
> > > > > >
> > > > > > On Thu, Jun 22, 2017 at 4:05 PM, Jinwoong Yoo <
> > > jinwoong.yoo at gmail.com>
> > > > > > wrote:
> > > > > >
> > > > > > > Hi John,
> > > > > > >
> > > > > > > Thank you very much for your kind message!
> > > > > > > I appreciate it.
> > > > > > > Let me try to reproduce what you did myself.
> > > > > > > Thank you.
> > > > > > >
> > > > > > > Regards,
> > > > > > >
> > > > > > > Jinwoong
> > > > > > >
> > > > > > > On Thu, Jun 22, 2017 at 3:37 PM, John Halley Gotway via
RT <
> > > > > > > met_help at ucar.edu> wrote:
> > > > > > >
> > > > > > >> Jinwoong,
> > > > > > >>
> > > > > > >> Great, thanks for sending this sample data.
> > > > > > >>
> > > > > > >> Based on the commands you were running, it looks like
you're
> > > trying
> > > > to
> > > > > > >> compute 24-hour accumulations. Your GRIB2 files
contain 2
> > > different
> > > > > > >> records for APCP, one is a 1-hour accumulation and the
second
> > is a
> > > > > > runtime
> > > > > > >> accumulation.
> > > > > > >>
> > > > > > >> Let me demonstrate two options for compute 24-hour
> > accumulations.
> > > > > > >>
> > > > > > >> (1) Using the pcp_combine "sum" to sum up the 1-hour
records.
> > > > > > >>
> > > > > > >> First, let me point out that the errors you were
getting were
> > > caused
> > > > > the
> > > > > > >> valid time you requested. Four times are required for
the
> "sum"
> > > > > > command:
> > > > > > >> init_time, in_accum, valid_time, and out_accum
> > > > > > >>
> > > > > > >> You were requesting a 24-hour accumulation with a valid
time
> of
> > > > > > >> 200501010000. That told pcp_combine to search for 1-
hourly
> > > > > > accumulations
> > > > > > >> starting at 2004123100 and ending at 2005010100. But
you
> don't
> > > have
> > > > > any
> > > > > > >> data in 2014. Running pcp_combine using these options
works
> > fine:
> > > > > > >>
> > > > > > >> met-6.0/bin/pcp_combine \
> > > > > > >> -sum 00000000_000000 1 20050102_000000 24 \
> > > > > > >> sample_wrf_2005010100V_24A.nc -pcpdir CESM_WRF
> > > > > > >>
> > > > > > >> This is telling it to search from 2005010100 through
> 2005010200,
> > > and
> > > > > > your
> > > > > > >> data covers that time period.
> > > > > > >>
> > > > > > >> (2) Instead of summing up the hourly accumulations, you
could
> > > simply
> > > > > > >> subtract the runtime accumulations:
> > > > > > >>
> > > > > > >> met-6.0/bin/pcp_combine \
> > > > > > >> -subtract CESM_WRF/CESM_WRF_d03_4km_200501020000.grb2
384 \
> > > > > > >>
CESM_WRF/CESM_WRF_d03_4km_200501010000.grb2 360
> \
> > > > > > >> CESM_APCP_20050101_to_20050102.nc
> > > > > > >>
> > > > > > >> This tells pcp_combine to find the 384 hour precip
> accumulation
> > > from
> > > > > > first
> > > > > > >> first file and 360 hour accumulation from the second
find and
> > > > subtract
> > > > > > >> them. Their difference is the precip that occurred
between
> > hours
> > > > 360
> > > > > > and
> > > > > > >> 384.
> > > > > > >>
> > > > > > >> Personally, I think option (2) is much simpler that
option
> (1),
> > > > since
> > > > > it
> > > > > > >> only requires 2 files instead of 24, but way either
works.
> > > > > > >>
> > > > > > >> After running option (2), I ran the following command
to plot
> > the
> > > > > > output:
> > > > > > >>
> > > > > > >> met-6.0/bin/plot_data_plane \
> > > > > > >> CESM_APCP_20050101_to_20050102.nc \
> > > > > > >> CESM_APCP_20050101_to_20050102.ps \
> > > > > > >> 'name="APCP_24"; level="(*,*)";'
> > > > > > >>
> > > > > > >> The resulting image is attached.
> > > > > > >>
> > > > > > >> Thanks,
> > > > > > >> John
> > > > > > >>
> > > > > > >> On Thu, Jun 22, 2017 at 12:41 PM, Jinwoong Yoo via RT <
> > > > > > met_help at ucar.edu>
> > > > > > >> wrote:
> > > > > > >>
> > > > > > >> >
> > > > > > >> > <URL: https://rt.rap.ucar.edu/rt/
> Ticket/Display.html?id=80978
> > >
> > > > > > >> >
> > > > > > >> > Hi John,
> > > > > > >> >
> > > > > > >> > I uploaded Yoo_data2.tar file in the Yoo_data
directory.
> > > > > > >> > Thank you.
> > > > > > >> >
> > > > > > >> > Regards,
> > > > > > >> >
> > > > > > >> > Jinwoong
> > > > > > >> >
> > > > > > >> > On Thu, Jun 22, 2017 at 2:21 PM, John Halley Gotway
via RT <
> > > > > > >> > met_help at ucar.edu> wrote:
> > > > > > >> >
> > > > > > >> > > Jinwoong,
> > > > > > >> > >
> > > > > > >> > > I went to go grab it from this location but it
appears to
> be
> > > > > empty:
> > > > > > >> > >
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/Yoo_
> data/
> > > > > > >> > >
> > > > > > >> > > Could you please try again?
> > > > > > >> > >
> > > > > > >> > > Thanks,
> > > > > > >> > > John
> > > > > > >> > >
> > > > > > >> > > On Thu, Jun 22, 2017 at 8:47 AM, Jinwoong Yoo via
RT <
> > > > > > >> met_help at ucar.edu>
> > > > > > >> > > wrote:
> > > > > > >> > >
> > > > > > >> > > >
> > > > > > >> > > > <URL: https://rt.rap.ucar.edu/rt/
> > > Ticket/Display.html?id=80978
> > > > >
> > > > > > >> > > >
> > > > > > >> > > > Hi John,
> > > > > > >> > > >
> > > > > > >> > > > I uploaded my sample files in a tar file.
> > > > > > >> > > > If you cannot find it, please let me know.
> > > > > > >> > > > Thank you.
> > > > > > >> > > >
> > > > > > >> > > > Regards,
> > > > > > >> > > >
> > > > > > >> > > > Jinwoong
> > > > > > >> > > >
> > > > > > >> > > > On Thu, Jun 22, 2017 at 9:57 AM, John Halley
Gotway via
> > RT <
> > > > > > >> > > > met_help at ucar.edu> wrote:
> > > > > > >> > > >
> > > > > > >> > > > > Jinwoong,
> > > > > > >> > > > >
> > > > > > >> > > > > Can you please send me two sample data files so
I can
> > look
> > > > > more
> > > > > > >> > closely
> > > > > > >> > > > at
> > > > > > >> > > > > the details? You can post them to our
anonymois ftp
> > site
> > > > > > >> following
> > > > > > >> > > these
> > > > > > >> > > > > instructions:
> > > > > > >> > > > >
> > > > > > >> > > > > http://www.dtcenter.org/met/
> > > users/support/met_help.php#ftp
> > > > > > >> > > > >
> > > > > > >> > > > > Please let me know when the data is there and
I'll go
> > grab
> > > > it.
> > > > > > >> > > > >
> > > > > > >> > > > > Thanks,
> > > > > > >> > > > > John
> > > > > > >> > > > >
> > > > > > >> > > > > On Thu, Jun 22, 2017 at 7:06 AM Jinwoong Yoo
via RT <
> > > > > > >> > met_help at ucar.edu
> > > > > > >> > > >
> > > > > > >> > > > > wrote:
> > > > > > >> > > > >
> > > > > > >> > > > > >
> > > > > > >> > > > > > <URL: https://rt.rap.ucar.edu/rt/
> > > > > Ticket/Display.html?id=80978
> > > > > > >
> > > > > > >> > > > > >
> > > > > > >> > > > > > Hi John,
> > > > > > >> > > > > >
> > > > > > >> > > > > > As I look at the sample data using wgrib and
wgrib2
> > > under
> > > > > the
> > > > > > >> > > directory
> > > > > > >> > > > > of
> > > > > > >> > > > > > data/sample_fcst/2005080700/,
> > > > > > >> > > > > > they also have two lines for APCP as my
wrfout
> files:
> > > > > > >> > > > > >
> > > > > > >> > > > > > 1:0:D=2005080700:APCP:sfc:kpds=61,1,0:0-24hr
> > acc:winds
> > > in
> > > > > > grid
> > > > > > >> > > > > > direction:"Total precipitation [kg/m^2]
> > > > > > >> > > > > >
> > > > > > >> > > > > > 2:31408:D=2005080700:APCP:sfc:kpds=61,1,0:21-
24hr
> > > > acc:winds
> > > > > > in
> > > > > > >> > grid
> > > > > > >> > > > > > direction:"Total precipitation [kg/m^2]
> > > > > > >> > > > > > VS.
> > > > > > >> > > > > >
> > > > > > >> > > > > > 324:14427217:d=2004121700:APCP Total
Precipitation
> > > > > > >> > > > > [kg/m^2]:surface:0-1103
> > > > > > >> > > > > > hour acc fcst:
> > > > > > >> > > > > >
> > > > > > >> > > > > > 325:14479093:d=2004121700:APCP Total
Precipitation
> > > > > > >> > > > > > [kg/m^2]:surface:1102-1103
> > > > > > >> > > > > > hour acc fcst:
> > > > > > >> > > > > >
> > > > > > >> > > > > >
> > > > > > >> > > > > >
> > > > > > >> > > > > > But, there are a few differences between
their
> format.
> > > > > > >> > > > > > While sample grib files have "APCP" and its
long
> name
> > > and
> > > > > > >> > > > > > units separately, mines have its long name
and units
> > > along
> > > > > > with
> > > > > > >> > name
> > > > > > >> > > of
> > > > > > >> > > > > > variable together, which part is the biggest
thing I
> > > > > suspect.
> > > > > > >> Can
> > > > > > >> > MET
> > > > > > >> > > > > pick
> > > > > > >> > > > > > up them correctly?
> > > > > > >> > > > > >
> > > > > > >> > > > > > Also, mines don't have kpds column.
> > > > > > >> > > > > >
> > > > > > >> > > > > > Do you think these are causing error in my
case?
> > > > > > >> > > > > > If it is the case, how can I control MET to
read
> these
> > > > > > >> differences?
> > > > > > >> > > > > > Thanks.
> > > > > > >> > > > > >
> > > > > > >> > > > > > Regards,
> > > > > > >> > > > > >
> > > > > > >> > > > > > Jinwoong
> > > > > > >> > > > > >
> > > > > > >> > > > > >
> > > > > > >> > > > > > On Wed, Jun 21, 2017 at 8:44 PM, Jinwoong Yoo
<
> > > > > > >> > > jinwoong.yoo at gmail.com>
> > > > > > >> > > > > > wrote:
> > > > > > >> > > > > >
> > > > > > >> > > > > > > Hi John,
> > > > > > >> > > > > > >
> > > > > > >> > > > > > > Thank you for your quick reply.
> > > > > > >> > > > > > >
> > > > > > >> > > > > > > In my WRF grib2 files, I have two APCP
variables
> as
> > > > shown
> > > > > > >> below:
> > > > > > >> > > > > > >
> > > > > > >> > > > > > > 324:14427217:d=2004121700:APCP Total
Precipitation
> > > > > > >> > > > > > [kg/m^2]:surface:0-1103
> > > > > > >> > > > > > > hour acc fcst:
> > > > > > >> > > > > > >
> > > > > > >> > > > > > > 325:14479093:d=2004121700:APCP Total
Precipitation
> > > > > > >> > > > > > > [kg/m^2]:surface:1102-1103 hour acc fcst:
> > > > > > >> > > > > > > In my case, I would like to use values in
"325"
> line
> > > > which
> > > > > > is
> > > > > > >> > APCP
> > > > > > >> > > > for
> > > > > > >> > > > > > one
> > > > > > >> > > > > > > hour accumulation not the total
accumulation from
> > the
> > > > > > >> > > initialization
> > > > > > >> > > > of
> > > > > > >> > > > > > the
> > > > > > >> > > > > > > simulation to the forecast time which is
"324".
> > > > > > >> > > > > > >
> > > > > > >> > > > > > >
> > > > > > >> > > > > > > Anyway,
> > > > > > >> > > > > > > when I modified my command line with "-
field
> > > > > > >> > > > 'name="APCP";level="Z0";'
> > > > > > >> > > > > > > I still got the error as below:
> > > > > > >> > > > > > >
> > > > > > >> > > > > > > yoo108 at halstead-fe01:
> > > > > > >> > > > > > > */scratch/halstead/y/yoo108/
> > wrfAnalysis/METanal/pcp_
> > > > > > combine*
> > > > > > >> $
> > > > > > >> > > > > > > /home/yoo108/met-6.0_bugfix/bin/pcp_combine
-sum
> > > > > > >> > 00000000_000000 1
> > > > > > >> > > > > > > 20050101_000000 24
/scratch/halstead/y/yoo108/wrf
> > > > > > >> > > > Analysis/METanal/pcp_
> > > > > > >> > > > > > > combine/sample_wrf_2005010100V_24A.nc
-pcpdir
> > > > > > >> > > > > > > /scratch/halstead/k/khoogewi/
> > > CCRC_wrf/grib2/2005/200501
> > > > > > >> -field
> > > > > > >> > > > > > > 'name="APCP";level="Z0";'
> > > > > > >> > > > > > >
> > > > > > >> > > > > > > ERROR :
> > > > > > >> > > > > > >
> > > > > > >> > > > > > > ERROR : sum_data_files() -> Cannot find a
file
> > with a
> > > > > valid
> > > > > > >> time
> > > > > > >> > > of
> > > > > > >> > > > > > > 20050101_000000 and accumulation time of
010000
> > > matching
> > > > > the
> > > > > > >> > > regular
> > > > > > >> > > > > > > expression ".*"
> > > > > > >> > > > > > >
> > > > > > >> > > > > > > ERROR :
> > > > > > >> > > > > > >
> > > > > > >> > > > > > >
> > > > > > >> > > > > > > Thank you.
> > > > > > >> > > > > > >
> > > > > > >> > > > > > > Regards,
> > > > > > >> > > > > > >
> > > > > > >> > > > > > > Jinwoong
> > > > > > >> > > > > > >
> > > > > > >> > > > > > >
> > > > > > >> > > > > > > On Wed, Jun 21, 2017 at 7:10 PM, John
Halley
> Gotway
> > > via
> > > > > RT <
> > > > > > >> > > > > > > met_help at ucar.edu> wrote:
> > > > > > >> > > > > > >
> > > > > > >> > > > > > >> Jinwoong,
> > > > > > >> > > > > > >>
> > > > > > >> > > > > > >> I see that you've having trouble getting
> > pcp_combine
> > > to
> > > > > sum
> > > > > > >> up
> > > > > > >> > the
> > > > > > >> > > > > data
> > > > > > >> > > > > > in
> > > > > > >> > > > > > >> the way you'd like.
> > > > > > >> > > > > > >>
> > > > > > >> > > > > > >> I think you're very close, but
unfortunately, I
> > don't
> > > > > > >> understand
> > > > > > >> > > > what
> > > > > > >> > > > > > you
> > > > > > >> > > > > > >> mean by 325. Is the record number that
you'd
> like
> > to
> > > > > > extract
> > > > > > >> > from
> > > > > > >> > > > the
> > > > > > >> > > > > > >> GRIB2 file? Usually, its better to refer
to the
> > name
> > > > of
> > > > > > the
> > > > > > >> > > > variable
> > > > > > >> > > > > > and
> > > > > > >> > > > > > >> have MET find it for you rather then
specifying
> an
> > > > > explicit
> > > > > > >> > record
> > > > > > >> > > > > > number.
> > > > > > >> > > > > > >>
> > > > > > >> > > > > > >> Let me show you an example for 2m
temperature
> using
> > > > > sample
> > > > > > >> data
> > > > > > >> > > > that's
> > > > > > >> > > > > > >> included in the MET tarball. Of course it
> doesn't
> > > make
> > > > > any
> > > > > > >> > sense
> > > > > > >> > > to
> > > > > > >> > > > > sum
> > > > > > >> > > > > > >> up
> > > > > > >> > > > > > >> 2m temperature values! But I'm just
showing you
> as
> > > an
> > > > > > >> example.
> > > > > > >> > > > > > >> Hopefully,
> > > > > > >> > > > > > >> you can adapt the example to do what
you're
> trying
> > to
> > > > do:
> > > > > > >> > > > > > >>
> > > > > > >> > > > > > >> cd met-6.0/data/sample_fcst/2005080700
> > > > > > >> > > > > > >> ../../../bin/pcp_combine -sum
00000000_000000 3
> > > > > > >> 20050807_120000
> > > > > > >> > 12
> > > > > > >> > > > > > sum.nc
> > > > > > >> > > > > > >> -pcpdir . \
> > > > > > >> > > > > > >> -field 'name="TMP"; level="Z2";'
> > > > > > >> > > > > > >>
> > > > > > >> > > > > > >> DEBUG 1: [1] File
./wrfprs_ruc13_12.tm00_G212
> > matches
> > > > > valid
> > > > > > >> time
> > > > > > >> > > of
> > > > > > >> > > > > > >> 20050807_120000
> > > > > > >> > > > > > >> DEBUG 1: [2] File
./wrfprs_ruc13_09.tm00_G212
> > matches
> > > > > valid
> > > > > > >> time
> > > > > > >> > > of
> > > > > > >> > > > > > >> 20050807_090000
> > > > > > >> > > > > > >> DEBUG 1: [3] File
./wrfprs_ruc13_06.tm00_G212
> > matches
> > > > > valid
> > > > > > >> time
> > > > > > >> > > of
> > > > > > >> > > > > > >> 20050807_060000
> > > > > > >> > > > > > >> DEBUG 1: [4] File
./wrfprs_ruc13_03.tm00_G212
> > matches
> > > > > valid
> > > > > > >> time
> > > > > > >> > > of
> > > > > > >> > > > > > >> 20050807_030000
> > > > > > >> > > > > > >> DEBUG 1: [1] Reading input file:
> > > > > > ./wrfprs_ruc13_12.tm00_G212
> > > > > > >> > > > > > >> DEBUG 1: [2] Reading input file:
> > > > > > ./wrfprs_ruc13_09.tm00_G212
> > > > > > >> > > > > > >> DEBUG 1: [3] Reading input file:
> > > > > > ./wrfprs_ruc13_06.tm00_G212
> > > > > > >> > > > > > >> DEBUG 1: [4] Reading input file:
> > > > > > ./wrfprs_ruc13_03.tm00_G212
> > > > > > >> > > > > > >> DEBUG 1: Writing output file: sum.nc
> > > > > > >> > > > > > >>
> > > > > > >> > > > > > >> The key here is that I set: -field
'name="TMP";
> > > > > > level="Z2";'
> > > > > > >> > > > > > >>
> > > > > > >> > > > > > >> The name and level strings are used to
search the
> > > GRIB
> > > > > > >> records
> > > > > > >> > in
> > > > > > >> > > > each
> > > > > > >> > > > > > >> file
> > > > > > >> > > > > > >> looking for a match.
> > > > > > >> > > > > > >>
> > > > > > >> > > > > > >> Hopefully that helps.
> > > > > > >> > > > > > >>
> > > > > > >> > > > > > >> Thanks,
> > > > > > >> > > > > > >> John
> > > > > > >> > > > > > >>
> > > > > > >> > > > > > >> On Wed, Jun 21, 2017 at 4:35 PM, Jinwoong
Yoo via
> > RT
> > > <
> > > > > > >> > > > > met_help at ucar.edu
> > > > > > >> > > > > > >
> > > > > > >> > > > > > >> wrote:
> > > > > > >> > > > > > >>
> > > > > > >> > > > > > >> >
> > > > > > >> > > > > > >> > <URL: https://rt.rap.ucar.edu/rt/Tic
> > > > > > >> ket/Display.html?id=80978
> > > > > > >> > >
> > > > > > >> > > > > > >> >
> > > > > > >> > > > > > >> > Hi,
> > > > > > >> > > > > > >> >
> > > > > > >> > > > > > >> > When I didn't specify -field and -config
and
> ran
> > > the
> > > > > > >> command:
> > > > > > >> > > > > > >> >
> > > > > > >> > > > > > >> > yoo108 at halstead-fe03:
> > > > > > >> > > > > > >> > */scratch/halstead/y/yoo108/wr
> > > > > > >> fAnalysis/METanal/pcp_combine*
> > > > > > >> > $
> > > > > > >> > > > > > >> > /home/yoo108/met-
6.0_bugfix/bin/pcp_combine
> -sum
> > > > > > >> > > 00000000_000000
> > > > > > >> > > > 1
> > > > > > >> > > > > > >> > 20050101_000000 24
> > > > > > >> > > > > > >> > /scratch/halstead/y/yoo108/
> > > wrfAnalysis/METanal/pcp_
> > > > > > >> > > > > combine/sample_wrf_
> > > > > > >> > > > > > >> > 2005010100V_24A.nc
> > > > > > >> > > > > > >> > -pcpdir /scratch/halstead/k/khoogewi/
> > > > > > >> > CCRC_wrf/grib2/2005/200501
> > > > > > >> > > > > > >> >
> > > > > > >> > > > > > >> >
> > > > > > >> > > > > > >> >
> > > > > > >> > > > > > >> > I got this error below:
> > > > > > >> > > > > > >> >
> > > > > > >> > > > > > >> > DEBUG 1: [1] File
> > > > > > >> > > > > > >> > /scratch/halstead/k/khoogewi/
> > > > > CCRC_wrf/grib2/2005/200501/
> > > > > > >> > > > > > >> > CESM_WRF_d03_4km_200501010000.grb2
> > > > > > >> > > > > > >> > matches valid time of 20050101_000000
> > > > > > >> > > > > > >> >
> > > > > > >> > > > > > >> > ERROR :
> > > > > > >> > > > > > >> >
> > > > > > >> > > > > > >> > ERROR : sum_data_files() -> Cannot find
a file
> > > with
> > > > a
> > > > > > >> valid
> > > > > > >> > > time
> > > > > > >> > > > of
> > > > > > >> > > > > > >> > 20041231_230000 and accumulation time of
010000
> > > > > matching
> > > > > > >> the
> > > > > > >> > > > regular
> > > > > > >> > > > > > >> > expression ".*"
> > > > > > >> > > > > > >> >
> > > > > > >> > > > > > >> > ERROR :
> > > > > > >> > > > > > >> >
> > > > > > >> > > > > > >> >
> > > > > > >> > > > > > >> > I don't know why it tries to find
> 20041231_230000
> > > > file?
> > > > > > >> > > > > > >> > Do I need to use regular expression with
it?
> > > > > > >> > > > > > >> >
> > > > > > >> > > > > > >> > Thank you.
> > > > > > >> > > > > > >> > Regards,
> > > > > > >> > > > > > >> >
> > > > > > >> > > > > > >> > Jinwoong
> > > > > > >> > > > > > >> >
> > > > > > >> > > > > > >> > On Wed, Jun 21, 2017 at 6:18 PM,
> > met_help at ucar.edu
> > > > via
> > > > > > RT
> > > > > > >> <
> > > > > > >> > > > > > >> > met_help at ucar.edu
> > > > > > >> > > > > > >> > > wrote:
> > > > > > >> > > > > > >> >
> > > > > > >> > > > > > >> > > NOTE: THE MET TEAM HAS LIMITED
AVAILABILITY
> > > BETWEEN
> > > > > > >> 5/23/17
> > > > > > >> > > AND
> > > > > > >> > > > > > >> 5/30/17.
> > > > > > >> > > > > > >> > > RESPONSES MAY BE DELAYED.
> > > > > > >> > > > > > >> > >
> > > > > > >> > > > > > >> > > Greetings,
> > > > > > >> > > > > > >> > >
> > > > > > >> > > > > > >> > > This message has been automatically
generated
> > in
> > > > > > >> response to
> > > > > > >> > > the
> > > > > > >> > > > > > >> > > creation of a trouble ticket
regarding:
> > > > > > >> > > > > > >> > > "Error with pcp_combine for
GRIB2
> > files",
> > > > > > >> > > > > > >> > > a summary of which appears below.
> > > > > > >> > > > > > >> > >
> > > > > > >> > > > > > >> > > There is no need to reply to this
message
> right
> > > > now.
> > > > > > >> Your
> > > > > > >> > > > ticket
> > > > > > >> > > > > > has
> > > > > > >> > > > > > >> > been
> > > > > > >> > > > > > >> > > assigned an ID of [rt.rap.ucar.edu
#80978].
> > > > > > >> > > > > > >> > >
> > > > > > >> > > > > > >> > > Please include the string:
> > > > > > >> > > > > > >> > >
> > > > > > >> > > > > > >> > > [rt.rap.ucar.edu #80978]
> > > > > > >> > > > > > >> > >
> > > > > > >> > > > > > >> > > in the subject line of all future
> > correspondence
> > > > > about
> > > > > > >> this
> > > > > > >> > > > issue.
> > > > > > >> > > > > > To
> > > > > > >> > > > > > >> do
> > > > > > >> > > > > > >> > > so,
> > > > > > >> > > > > > >> > > you may reply to this message.
> > > > > > >> > > > > > >> > >
> > > > > > >> > > > > > >> > > Thank you,
> > > > > > >> > > > > > >> > >
met_help at ucar.edu
> > > > > > >> > > > > > >> > >
> > > > > > >> > > > > > >> > > ------------------------------
> > > > > > >> > ------------------------------
> > > > > > >> > > > > > >> > -------------
> > > > > > >> > > > > > >> > > Hi,
> > > > > > >> > > > > > >> > > I am trying to combine hourly WRF
output
> files
> > > > which
> > > > > > have
> > > > > > >> > been
> > > > > > >> > > > > > >> converted
> > > > > > >> > > > > > >> > to
> > > > > > >> > > > > > >> > > GRIB2 format using UPP.
> > > > > > >> > > > > > >> > >
> > > > > > >> > > > > > >> > >
> > > > > > >> > > > > > >> > > In the MET online tutorial, it is
written "By
> > > > > default,
> > > > > > >> > > > PCP-Combine
> > > > > > >> > > > > > >> > searches
> > > > > > >> > > > > > >> > > for records containing GRIB code 61
> > (accumulated
> > > > > > >> > > precipitation).
> > > > > > >> > > > > Use
> > > > > > >> > > > > > >> > > the *-config
> > > > > > >> > > > > > >> > > config_str* option to override this
default
> and
> > > > > process
> > > > > > >> > other
> > > > > > >> > > > > > fields."
> > > > > > >> > > > > > >> > So I
> > > > > > >> > > > > > >> > > wanted to change the default for 325
APCP.
> But
> > > the
> > > > > > >> direction
> > > > > > >> > > in
> > > > > > >> > > > > the
> > > > > > >> > > > > > >> > > tutorial is not clear to me.
> > > > > > >> > > > > > >> > >
> > > > > > >> > > > > > >> > > Do I need to change configure file?
(Then,
> > which
> > > > > config
> > > > > > >> file
> > > > > > >> > > > > should
> > > > > > >> > > > > > I
> > > > > > >> > > > > > >> > > change?)
> > > > > > >> > > > > > >> > > Or can I do this in command line?
> > > > > > >> > > > > > >> > >
> > > > > > >> > > > > > >> > > When I tried as below, I got error
messages.
> > > > > > >> > > > > > >> > >
> > > > > > >> > > > > > >> > > > -sum 00000000_000000 1
20050101_000000 24 \
> > > > > > >> > > > > > >> > >
> > > > > > >> > > > > > >> > > >
> > > > > > >> > > > > > >> > > /scratch/halstead/y/yoo108/wrf
> > > > > > >> Analysis/METanal/pcp_combine/
> > > > > > >> > > > > > >> sample_wrf_
> > > > > > >> > > > > > >> > > 2005010100V_24A.nc
> > > > > > >> > > > > > >> > > \
> > > > > > >> > > > > > >> > >
> > > > > > >> > > > > > >> > > > -pcpdir
/scratch/halstead/k/khoogewi/C
> > > > > > >> > > > CRC_wrf/grib2/2005/200501
> > > > > > >> > > > > \
> > > > > > >> > > > > > >> > >
> > > > > > >> > > > > > >> > > > -field APCP \
> > > > > > >> > > > > > >> > >
> > > > > > >> > > > > > >> > > > -config 325
> > > > > > >> > > > > > >> > >
> > > > > > >> > > > > > >> > > ERROR :
> > > > > > >> > > > > > >> > >
> > > > > > >> > > > > > >> > > ERROR : yyerror() -> syntax error in
file
> > > > > > >> > > > > > "/tmp/config_4646_0_.temp"
> > > > > > >> > > > > > >> > >
> > > > > > >> > > > > > >> > > ERROR :
> > > > > > >> > > > > > >> > >
> > > > > > >> > > > > > >> > > ERROR : line = 1
> > > > > > >> > > > > > >> > >
> > > > > > >> > > > > > >> > > ERROR :
> > > > > > >> > > > > > >> > >
> > > > > > >> > > > > > >> > > ERROR : column = 1
> > > > > > >> > > > > > >> > >
> > > > > > >> > > > > > >> > > ERROR :
> > > > > > >> > > > > > >> > >
> > > > > > >> > > > > > >> > > ERROR : text = "325"
> > > > > > >> > > > > > >> > >
> > > > > > >> > > > > > >> > > ERROR :
> > > > > > >> > > > > > >> > >
> > > > > > >> > > > > > >> > > ERROR :
> > > > > > >> > > > > > >> > >
> > > > > > >> > > > > > >> > > ERROR : 325
> > > > > > >> > > > > > >> > >
> > > > > > >> > > > > > >> > > ERROR : ^^^
> > > > > > >> > > > > > >> > >
> > > > > > >> > > > > > >> > > ERROR :
> > > > > > >> > > > > > >> > >
> > > > > > >> > > > > > >> > >
> > > > > > >> > > > > > >> > >
> > > > > > >> > > > > > >> > >
> > > > > > >> > > > > > >> > > Can you help?
> > > > > > >> > > > > > >> > > Thank you.
> > > > > > >> > > > > > >> > >
> > > > > > >> > > > > > >> > > Regards,
> > > > > > >> > > > > > >> > >
> > > > > > >> > > > > > >> > > Jinwoong Yoo
> > > > > > >> > > > > > >> > >
> > > > > > >> > > > > > >> > >
> > > > > > >> > > > > > >> >
> > > > > > >> > > > > > >> >
> > > > > > >> > > > > > >>
> > > > > > >> > > > > > >>
> > > > > > >> > > > > > >
> > > > > > >> > > > > >
> > > > > > >> > > > > >
> > > > > > >> > > > >
> > > > > > >> > > > >
> > > > > > >> > > >
> > > > > > >> > > >
> > > > > > >> > >
> > > > > > >> > >
> > > > > > >> >
> > > > > > >> >
> > > > > > >>
> > > > > > >>
> > > > > > >
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > >
> > > >
> > >
> > >
> >
> >
>
>
------------------------------------------------
More information about the Met_help
mailing list