[Met_help] [rt.rap.ucar.edu #80133] History for PCP_COMBINE Issue
John Halley Gotway via RT
met_help at ucar.edu
Thu Jun 15 10:31:22 MDT 2017
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
John, I am running pcp_combine to sum up um (galwem) 6 hour precip data. When I run the following command, the software seems to go into a loop that I have to control - C out of.
/h/WXQC/met-5.2/bin/pcp_combine 20170402_000000 06 20170402_120000 12 /h/data/global/WXQC/data/met/tmp/eaffdf4d-460f-4559-b437-3316451c8105 -pcpdir /h/data/global/WXQC/data/umm/ -pcprx 17040200* -v 4
The output is below:
['/h/WXQC/met-5.2/bin/pcp_combine', '20170402_000000', '06', '20170402_120000', '12', '/h/data/global/WXQC/data/met/tmp/eaffdf4d-460f-4559-b437-3316451c8105', '-pcpdir', '/h/data/global/WXQC/data/umm/', '-pcprx', '17040200*', '-v', '4']
DEBUG 2: Performing sum command: Init/In_Accum/Valid/Out_Accum Times = 20170402_000000/060000/20170402_120000/120000
DEBUG 2: Searching for 2 files with accumulation times of 060000 to sum to a total accumulation time of 120000.
DEBUG 4: Met2dDataFileFactory::new_met_2d_data_file() -> created new Met2dDataFile object of type "FileType_Gb2".
DEBUG 3: Switching the GRIB2 radius of the earth value of 6371.23 km to 6371.2 km for internal consistency.
DEBUG 4:
DEBUG 4: Latitude/Longitude Grid Data:
DEBUG 4: lat_ll: -89.9219
DEBUG 4: lon_ll: -0.117187
DEBUG 4: delta_lat: 0.15625
DEBUG 4: delta_lon: 0.234375
DEBUG 4: Nlat: 1152
DEBUG 4: Nlon: 1536
DEBUG 4:
DEBUG 4: VarInfoFactory::new_var_info() -> created new VarInfo object of type "FileType_Gb2".
DEBUG 4: Met2dDataFileFactory::new_met_2d_data_file() -> created new Met2dDataFile object of type "FileType_Gb2".
DEBUG 3: Switching the GRIB2 radius of the earth value of 6371.23 km to 6371.2 km for internal consistency.
DEBUG 4:
DEBUG 4: Latitude/Longitude Grid Data:
DEBUG 4: lat_ll: -89.9219
DEBUG 4: lon_ll: -0.117187
DEBUG 4: delta_lat: 0.15625
DEBUG 4: delta_lon: 0.234375
DEBUG 4: Nlat: 1152
DEBUG 4: Nlon: 1536
DEBUG 4:
DEBUG 4: VarInfoFactory::new_var_info() -> created new VarInfo object of type "FileType_Gb2".
DEBUG 4: Met2dDataFileFactory::new_met_2d_data_file() -> created new Met2dDataFile object of type "FileType_Gb2".
DEBUG 3: Switching the GRIB2 radius of the earth value of 6371.23 km to 6371.2 km for internal consistency.
DEBUG 4:
DEBUG 4: Latitude/Longitude Grid Data:
DEBUG 4: lat_ll: -89.9219
DEBUG 4: lon_ll: -0.117187
DEBUG 4: delta_lat: 0.15625
DEBUG 4: delta_lon: 0.234375
DEBUG 4: Nlat: 1152
DEBUG 4: Nlon: 1536
DEBUG 4:
DEBUG 4: VarInfoFactory::new_var_info() -> created new VarInfo object of type "FileType_Gb2".
DEBUG 4: Met2dDataFileFactory::new_met_2d_data_file() -> created new Met2dDataFile object of type "FileType_Gb2".
DEBUG 3: Switching the GRIB2 radius of the earth value of 6371.23 km to 6371.2 km for internal consistency.
DEBUG 4:
DEBUG 4: Latitude/Longitude Grid Data:
DEBUG 4: lat_ll: -89.9219
DEBUG 4: lon_ll: -0.117187
DEBUG 4: delta_lat: 0.15625
DEBUG 4: delta_lon: 0.234375
DEBUG 4: Nlat: 1152
DEBUG 4: Nlon: 1536
DEBUG 4:
DEBUG 4: VarInfoFactory::new_var_info() -> created new VarInfo object of type "FileType_Gb2".
^CTraceback (most recent call last):
File "/h/WXQC/bin/runPointStat.py", line 304, in <module>
result=pt.runMET()
File "/h/WXQC/bin/runPointStat.py", line 250, in runMET
fcstfilename=sumPrecipGrid(datestr,cycle,self._accumperiod,fcst,filename_prefix)
File "/gpfs/h/WXQC/bin/py_met_functions.py", line 405, in sumPrecipGrid
call(cmdstr)
File "/gpfs/python/python-2.7/lib/python2.7/subprocess.py", line 522, in call
return Popen(*popenargs, **kwargs).wait()
File "/gpfs/python/python-2.7/lib/python2.7/subprocess.py", line 1384, in wait
pid, sts = _eintr_retry_call(os.waitpid, self.pid, 0)
File "/gpfs/python/python-2.7/lib/python2.7/subprocess.py", line 476, in _eintr_retry_call
return func(*args)
KeyboardInterrupt
What have I done wrong? I the um data is on the server, or will be.
Thanks
Bob Craig
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: PCP_COMBINE Issue
From: John Halley Gotway
Time: Thu Apr 13 09:52:18 2017
Bob,
I see you're having some trouble with pcp_combine. It appears to be
hanging. I went to grab data from the ftp site, and see 3 file names,
the
0-hour, 6-hour, and 114-hour forecast files. But the 6 hour one is
empty:
-rw-r--r-- 1 120 120 74067939 Apr 12 21:13 1704020000
-rw-r--r-- 1 120 120 0 Apr 12 21:26 1704020006
-rw-r--r-- 1 120 120 76240531 Apr 12 21:16 17040200114
I grabbed those files and looked at the 114-hour one. Running wgrib2
on it
reveals that the accumulation is all the way out to 114 hours:
wgrib2 17040200114 | grep APCP
87:62545910:d=2017040200:APCP:surface:0-114 hour acc fcst:
That suggests that these GRIB2 files likely contain a "runtime"
accumulation of precip. That means that the 6-hour forecast has an
accumulation of 0 to 6 hours, the 72 has 0 to 72 hours, the 114 has 0
to
114 hours, and so on. Run wgrib2 on a few files to make sure, but if
that's the case, you don't want to be running the pcp_combine "sum"
command. Instead, you want to use the "subtract" option.
For example, the following subtraction command would result in a 12
hour
accumulation between forecast hours 24 and 36:
/h/WXQC/met-5.2/bin/pcp_combine -subtract \
/h/data/global/WXQC/data/umm/1704020036 36 \
/h/data/global/WXQC/data/umm/1704020024 24 \
APCP_A12_2017040400_F36.nc
Looking at the date in your actual sum command, it looks like you want
a
12-hour accumulation for the 12-hour forecast. But (assuming a
runtime
accumulation), you already have that in this file!
wgrib2 /h/data/global/WXQC/data/umm/1704020012 | grep APCP
You have two options here... you could either process this file as-is
in
GRIB2 format... but then you need to configure Grid-Stat to specify
the
"name" and "level" for GRIB2 files. Or you could run this through
pcp_combine to basically just reformat it into NetCDF format so that
the
same Grid-Stat configuration file works for all forecast lead times.
That
what people in the DTC tend to do to keep the Grid-Stat configuration
file
simpler. Here's how you could use pcp_combine to reformat it:
/h/WXQC/met-5.2/bin/pcp_combine -add \
/h/data/global/WXQC/data/umm/1704020012 12 \
APCP_A12_2017040400_F12.nc
Hope that helps clarify.
Thanks,
John
On Wed, Apr 12, 2017 at 3:33 PM, robert.craig.2 at us.af.mil via RT <
met_help at ucar.edu> wrote:
>
> Wed Apr 12 15:33:08 2017: Request 80133 was acted upon.
> Transaction: Ticket created by robert.craig.2 at us.af.mil
> Queue: met_help
> Subject: PCP_COMBINE Issue
> Owner: Nobody
> Requestors: robert.craig.2 at us.af.mil
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80133 >
>
>
> John, I am running pcp_combine to sum up um (galwem) 6 hour precip
data.
> When I run the following command, the software seems to go into a
loop that
> I have to control - C out of.
>
> /h/WXQC/met-5.2/bin/pcp_combine 20170402_000000 06 20170402_120000
12
> /h/data/global/WXQC/data/met/tmp/eaffdf4d-460f-4559-b437-
3316451c8105
> -pcpdir /h/data/global/WXQC/data/umm/ -pcprx 17040200* -v 4
>
> The output is below:
>
> ['/h/WXQC/met-5.2/bin/pcp_combine', '20170402_000000', '06',
> '20170402_120000', '12', '/h/data/global/WXQC/data/met/
> tmp/eaffdf4d-460f-4559-b437-3316451c8105', '-pcpdir',
> '/h/data/global/WXQC/data/umm/', '-pcprx', '17040200*', '-v', '4']
> DEBUG 2: Performing sum command: Init/In_Accum/Valid/Out_Accum Times
=
> 20170402_000000/060000/20170402_120000/120000
> DEBUG 2: Searching for 2 files with accumulation times of 060000 to
sum to
> a total accumulation time of 120000.
> DEBUG 4: Met2dDataFileFactory::new_met_2d_data_file() -> created new
> Met2dDataFile object of type "FileType_Gb2".
> DEBUG 3: Switching the GRIB2 radius of the earth value of 6371.23 km
to
> 6371.2 km for internal consistency.
> DEBUG 4:
> DEBUG 4: Latitude/Longitude Grid Data:
> DEBUG 4: lat_ll: -89.9219
> DEBUG 4: lon_ll: -0.117187
> DEBUG 4: delta_lat: 0.15625
> DEBUG 4: delta_lon: 0.234375
> DEBUG 4: Nlat: 1152
> DEBUG 4: Nlon: 1536
> DEBUG 4:
> DEBUG 4: VarInfoFactory::new_var_info() -> created new VarInfo
object of
> type "FileType_Gb2".
> DEBUG 4: Met2dDataFileFactory::new_met_2d_data_file() -> created new
> Met2dDataFile object of type "FileType_Gb2".
> DEBUG 3: Switching the GRIB2 radius of the earth value of 6371.23 km
to
> 6371.2 km for internal consistency.
> DEBUG 4:
> DEBUG 4: Latitude/Longitude Grid Data:
> DEBUG 4: lat_ll: -89.9219
> DEBUG 4: lon_ll: -0.117187
> DEBUG 4: delta_lat: 0.15625
> DEBUG 4: delta_lon: 0.234375
> DEBUG 4: Nlat: 1152
> DEBUG 4: Nlon: 1536
> DEBUG 4:
> DEBUG 4: VarInfoFactory::new_var_info() -> created new VarInfo
object of
> type "FileType_Gb2".
> DEBUG 4: Met2dDataFileFactory::new_met_2d_data_file() -> created new
> Met2dDataFile object of type "FileType_Gb2".
> DEBUG 3: Switching the GRIB2 radius of the earth value of 6371.23 km
to
> 6371.2 km for internal consistency.
> DEBUG 4:
> DEBUG 4: Latitude/Longitude Grid Data:
> DEBUG 4: lat_ll: -89.9219
> DEBUG 4: lon_ll: -0.117187
> DEBUG 4: delta_lat: 0.15625
> DEBUG 4: delta_lon: 0.234375
> DEBUG 4: Nlat: 1152
> DEBUG 4: Nlon: 1536
> DEBUG 4:
> DEBUG 4: VarInfoFactory::new_var_info() -> created new VarInfo
object of
> type "FileType_Gb2".
> DEBUG 4: Met2dDataFileFactory::new_met_2d_data_file() -> created new
> Met2dDataFile object of type "FileType_Gb2".
> DEBUG 3: Switching the GRIB2 radius of the earth value of 6371.23 km
to
> 6371.2 km for internal consistency.
> DEBUG 4:
> DEBUG 4: Latitude/Longitude Grid Data:
> DEBUG 4: lat_ll: -89.9219
> DEBUG 4: lon_ll: -0.117187
> DEBUG 4: delta_lat: 0.15625
> DEBUG 4: delta_lon: 0.234375
> DEBUG 4: Nlat: 1152
> DEBUG 4: Nlon: 1536
> DEBUG 4:
> DEBUG 4: VarInfoFactory::new_var_info() -> created new VarInfo
object of
> type "FileType_Gb2".
> ^CTraceback (most recent call last):
> File "/h/WXQC/bin/runPointStat.py", line 304, in <module>
> result=pt.runMET()
> File "/h/WXQC/bin/runPointStat.py", line 250, in runMET
> fcstfilename=sumPrecipGrid(datestr,cycle,self._
> accumperiod,fcst,filename_prefix)
> File "/gpfs/h/WXQC/bin/py_met_functions.py", line 405, in
sumPrecipGrid
> call(cmdstr)
> File "/gpfs/python/python-2.7/lib/python2.7/subprocess.py", line
522,
> in call
> return Popen(*popenargs, **kwargs).wait()
> File "/gpfs/python/python-2.7/lib/python2.7/subprocess.py", line
1384,
> in wait
> pid, sts = _eintr_retry_call(os.waitpid, self.pid, 0)
> File "/gpfs/python/python-2.7/lib/python2.7/subprocess.py", line
476,
> in _eintr_retry_call
> return func(*args)
> KeyboardInterrupt
>
> What have I done wrong? I the um data is on the server, or will be.
>
> Thanks
> Bob Craig
>
>
>
------------------------------------------------
More information about the Met_help
mailing list