[Met_help] [rt.rap.ucar.edu #96910] History for GFS/pcp_combine issue
John Halley Gotway via RT
met_help at ucar.edu
Thu Oct 1 13:43:25 MDT 2020
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Good morning MET help desk
We are having some problems using pcp_combine to compute the 1-hr QPF for
the GFS using MET V9.1. I'm currently running a test with the 35-hr and
36-hr files. Here is the wgrib2 listing for the two projections:
1:0:d=2020093012:APCP:surface:0-36 hour acc fcst:
1:0:d=2020093012:APCP:surface:0-35 hour acc fcst:
For other models, we would have run something like this:
pcp_combine -v 4 -subtract gfscogb0p2520093012qpf01f036
gfscogb0p2520093012qpf01f035 gfscogb0p2520093012qpf01f036_diff
The error that I get with this is
DEBUG 2: Since the "-field" command line option was not used, parsing the
command line arguments a list of files, each followed by a configuration
string.
ERROR :
ERROR : process_add_sub_derive_args() -> file name used when config string
expected (gfscogb0p2520093012qpf01f035). Did you forget the "-field" option?
ERROR :
It seems as though we need to add -field, which we haven't needed to do
with other models. As far as I can tell, the command should be:
pcp_combine -v 4 -subtract gfscogb0p2520093012qpf01f036
gfscogb0p2520093012qpf01f035 gfscogb0p2520093012qpf01f036_diff -field
'name="APCP"; level="A36";' -field 'name="APCP"; level="A35";'
The error that I get with this is
WARNING:
WARNING: MetGrib2DataFile::data_plane() -> No matching record found for
'APCP/A36'
WARNING:
ERROR :
ERROR : get_field() -> can't get data plane from file
"gfscogb0p2520093012qpf01f035"
ERROR :
I also tried using (*,*) for the level, but that gives me this error:
ERROR :
ERROR : VarInfo::set_level_info_grib() - failed to parse level string
'(*,*)'
ERROR :
At this point, I'm pretty sure that the error is that I am not providing
the correct level. We've tried multiple other values, but none of them
work. Is there a way for us to know what level value(s) MET is expecting?
Any help would be appreciated.
If you're on WCOSS, my test files and script are in
/gpfs/dell3/mdl/mdlverif/noscrub/usr/John.L.Wagner/mdl-verification/pcp_combine_test
Thanks
John
--
John Wagner
Verification Task Lead
NOAA/National Weather Service
Meteorological Development Laboratory
Digital Forecast Services Division
SSMC2 Room 10106
Silver Spring, MD 20910
(301) 427-9471 (office)
(908) 902-4155 (cell/text)
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: GFS/pcp_combine issue
From: Minna Win
Time: Thu Oct 01 09:36:24 2020
Hello,
It looks like you need help debugging PCP-Combine for your data. I'm
assigning this issue to John Halley Gotway. Please allow a few
business
days for a full response.
Regards,
Minna
---------------
Minna Win
National Center for Atmospheric Research
Developmental Testbed Center
Pronouns: she/her
Phone: 303-497-8423
Fax: 303-497-8401
On Thu, Oct 1, 2020 at 9:01 AM John L Wagner - NOAA Federal via RT <
met_help at ucar.edu> wrote:
>
> Thu Oct 01 09:01:14 2020: Request 96910 was acted upon.
> Transaction: Ticket created by john.l.wagner at noaa.gov
> Queue: met_help
> Subject: GFS/pcp_combine issue
> Owner: Nobody
> Requestors: john.l.wagner at noaa.gov
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96910 >
>
>
> Good morning MET help desk
> We are having some problems using pcp_combine to compute the 1-hr
QPF for
> the GFS using MET V9.1. I'm currently running a test with the 35-hr
and
> 36-hr files. Here is the wgrib2 listing for the two projections:
>
> 1:0:d=2020093012:APCP:surface:0-36 hour acc fcst:
> 1:0:d=2020093012:APCP:surface:0-35 hour acc fcst:
>
> For other models, we would have run something like this:
>
> pcp_combine -v 4 -subtract gfscogb0p2520093012qpf01f036
> gfscogb0p2520093012qpf01f035 gfscogb0p2520093012qpf01f036_diff
>
> The error that I get with this is
>
> DEBUG 2: Since the "-field" command line option was not used,
parsing the
> command line arguments a list of files, each followed by a
configuration
> string.
> ERROR :
> ERROR : process_add_sub_derive_args() -> file name used when config
string
> expected (gfscogb0p2520093012qpf01f035). Did you forget the "-field"
> option?
> ERROR :
>
> It seems as though we need to add -field, which we haven't needed to
do
> with other models. As far as I can tell, the command should be:
>
> pcp_combine -v 4 -subtract gfscogb0p2520093012qpf01f036
> gfscogb0p2520093012qpf01f035 gfscogb0p2520093012qpf01f036_diff
-field
> 'name="APCP"; level="A36";' -field 'name="APCP"; level="A35";'
>
> The error that I get with this is
>
> WARNING:
> WARNING: MetGrib2DataFile::data_plane() -> No matching record found
for
> 'APCP/A36'
> WARNING:
> ERROR :
> ERROR : get_field() -> can't get data plane from file
> "gfscogb0p2520093012qpf01f035"
> ERROR :
>
> I also tried using (*,*) for the level, but that gives me this
error:
>
> ERROR :
> ERROR : VarInfo::set_level_info_grib() - failed to parse level
string
> '(*,*)'
> ERROR :
>
> At this point, I'm pretty sure that the error is that I am not
providing
> the correct level. We've tried multiple other values, but none of
them
> work. Is there a way for us to know what level value(s) MET is
expecting?
> Any help would be appreciated.
> If you're on WCOSS, my test files and script are in
>
>
> /gpfs/dell3/mdl/mdlverif/noscrub/usr/John.L.Wagner/mdl-
verification/pcp_combine_test
>
> Thanks
> John
> --
> John Wagner
> Verification Task Lead
> NOAA/National Weather Service
> Meteorological Development Laboratory
> Digital Forecast Services Division
> SSMC2 Room 10106
> Silver Spring, MD 20910
> (301) 427-9471 (office)
> (908) 902-4155 (cell/text)
>
>
------------------------------------------------
Subject: GFS/pcp_combine issue
From: Minna Win
Time: Thu Oct 01 10:40:37 2020
Hi John,
It looks like you are missing the '36', and the '35' following the
input
files:
pcp_combine -v 4 -subtract gfscogb0p2520093012qpf01f036 36
gfscogb0p2520093012qpf01f035 35 gfscogb0p2520093012qpf01f036_diff
This follows the example in the User documentation for pcp-combine for
subtract:
https://dtcenter.github.io/MET/Users_Guide/reformat_grid.html (section
5.1.1.6).
Regards,
Minna
---------------
Minna Win
National Center for Atmospheric Research
Developmental Testbed Center
Pronouns: she/her
Phone: 303-497-8423
Fax: 303-497-8401
On Thu, Oct 1, 2020 at 9:01 AM John L Wagner - NOAA Federal via RT <
met_help at ucar.edu> wrote:
>
> Thu Oct 01 09:01:14 2020: Request 96910 was acted upon.
> Transaction: Ticket created by john.l.wagner at noaa.gov
> Queue: met_help
> Subject: GFS/pcp_combine issue
> Owner: Nobody
> Requestors: john.l.wagner at noaa.gov
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96910 >
>
>
> Good morning MET help desk
> We are having some problems using pcp_combine to compute the 1-hr
QPF for
> the GFS using MET V9.1. I'm currently running a test with the 35-hr
and
> 36-hr files. Here is the wgrib2 listing for the two projections:
>
> 1:0:d=2020093012:APCP:surface:0-36 hour acc fcst:
> 1:0:d=2020093012:APCP:surface:0-35 hour acc fcst:
>
> For other models, we would have run something like this:
>
> pcp_combine -v 4 -subtract gfscogb0p2520093012qpf01f036
> gfscogb0p2520093012qpf01f035 gfscogb0p2520093012qpf01f036_diff
>
> The error that I get with this is
>
> DEBUG 2: Since the "-field" command line option was not used,
parsing the
> command line arguments a list of files, each followed by a
configuration
> string.
> ERROR :
> ERROR : process_add_sub_derive_args() -> file name used when config
string
> expected (gfscogb0p2520093012qpf01f035). Did you forget the "-field"
> option?
> ERROR :
>
> It seems as though we need to add -field, which we haven't needed to
do
> with other models. As far as I can tell, the command should be:
>
> pcp_combine -v 4 -subtract gfscogb0p2520093012qpf01f036
> gfscogb0p2520093012qpf01f035 gfscogb0p2520093012qpf01f036_diff
-field
> 'name="APCP"; level="A36";' -field 'name="APCP"; level="A35";'
>
> The error that I get with this is
>
> WARNING:
> WARNING: MetGrib2DataFile::data_plane() -> No matching record found
for
> 'APCP/A36'
> WARNING:
> ERROR :
> ERROR : get_field() -> can't get data plane from file
> "gfscogb0p2520093012qpf01f035"
> ERROR :
>
> I also tried using (*,*) for the level, but that gives me this
error:
>
> ERROR :
> ERROR : VarInfo::set_level_info_grib() - failed to parse level
string
> '(*,*)'
> ERROR :
>
> At this point, I'm pretty sure that the error is that I am not
providing
> the correct level. We've tried multiple other values, but none of
them
> work. Is there a way for us to know what level value(s) MET is
expecting?
> Any help would be appreciated.
> If you're on WCOSS, my test files and script are in
>
>
> /gpfs/dell3/mdl/mdlverif/noscrub/usr/John.L.Wagner/mdl-
verification/pcp_combine_test
>
> Thanks
> John
> --
> John Wagner
> Verification Task Lead
> NOAA/National Weather Service
> Meteorological Development Laboratory
> Digital Forecast Services Division
> SSMC2 Room 10106
> Silver Spring, MD 20910
> (301) 427-9471 (office)
> (908) 902-4155 (cell/text)
>
>
------------------------------------------------
Subject: GFS/pcp_combine issue
From: John L Wagner - NOAA Federal
Time: Thu Oct 01 10:51:34 2020
We did test with those projections in the command. The error I get
then is
DEBUG 2: Since the "-field" command line option was used, parsing the
command line arguments as a list of files.
ERROR :
ERROR : do_sub_command() -> you must specify exactly two input files
for
subtraction.
ERROR :
It seemed like it was treating them as files instead of projections.
We
have used those in earlier versions of MET. I wasn't sure if this was
a
change for V9.1 or not.
On Thu, Oct 1, 2020 at 12:40 PM Minna Win via RT <met_help at ucar.edu>
wrote:
> Hi John,
>
> It looks like you are missing the '36', and the '35' following the
input
> files:
>
> pcp_combine -v 4 -subtract gfscogb0p2520093012qpf01f036 36
> gfscogb0p2520093012qpf01f035 35 gfscogb0p2520093012qpf01f036_diff
>
> This follows the example in the User documentation for pcp-combine
for
> subtract:
> https://dtcenter.github.io/MET/Users_Guide/reformat_grid.html
(section
> 5.1.1.6).
>
> Regards,
> Minna
> ---------------
> Minna Win
> National Center for Atmospheric Research
> Developmental Testbed Center
> Pronouns: she/her
> Phone: 303-497-8423
> Fax: 303-497-8401
>
>
>
> On Thu, Oct 1, 2020 at 9:01 AM John L Wagner - NOAA Federal via RT <
> met_help at ucar.edu> wrote:
>
> >
> > Thu Oct 01 09:01:14 2020: Request 96910 was acted upon.
> > Transaction: Ticket created by john.l.wagner at noaa.gov
> > Queue: met_help
> > Subject: GFS/pcp_combine issue
> > Owner: Nobody
> > Requestors: john.l.wagner at noaa.gov
> > Status: new
> > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96910 >
> >
> >
> > Good morning MET help desk
> > We are having some problems using pcp_combine to compute the 1-hr
QPF for
> > the GFS using MET V9.1. I'm currently running a test with the 35-
hr and
> > 36-hr files. Here is the wgrib2 listing for the two projections:
> >
> > 1:0:d=2020093012:APCP:surface:0-36 hour acc fcst:
> > 1:0:d=2020093012:APCP:surface:0-35 hour acc fcst:
> >
> > For other models, we would have run something like this:
> >
> > pcp_combine -v 4 -subtract gfscogb0p2520093012qpf01f036
> > gfscogb0p2520093012qpf01f035 gfscogb0p2520093012qpf01f036_diff
> >
> > The error that I get with this is
> >
> > DEBUG 2: Since the "-field" command line option was not used,
parsing the
> > command line arguments a list of files, each followed by a
configuration
> > string.
> > ERROR :
> > ERROR : process_add_sub_derive_args() -> file name used when
config
> string
> > expected (gfscogb0p2520093012qpf01f035). Did you forget the "-
field"
> > option?
> > ERROR :
> >
> > It seems as though we need to add -field, which we haven't needed
to do
> > with other models. As far as I can tell, the command should be:
> >
> > pcp_combine -v 4 -subtract gfscogb0p2520093012qpf01f036
> > gfscogb0p2520093012qpf01f035 gfscogb0p2520093012qpf01f036_diff
-field
> > 'name="APCP"; level="A36";' -field 'name="APCP"; level="A35";'
> >
> > The error that I get with this is
> >
> > WARNING:
> > WARNING: MetGrib2DataFile::data_plane() -> No matching record
found for
> > 'APCP/A36'
> > WARNING:
> > ERROR :
> > ERROR : get_field() -> can't get data plane from file
> > "gfscogb0p2520093012qpf01f035"
> > ERROR :
> >
> > I also tried using (*,*) for the level, but that gives me this
error:
> >
> > ERROR :
> > ERROR : VarInfo::set_level_info_grib() - failed to parse level
string
> > '(*,*)'
> > ERROR :
> >
> > At this point, I'm pretty sure that the error is that I am not
providing
> > the correct level. We've tried multiple other values, but none of
them
> > work. Is there a way for us to know what level value(s) MET is
> expecting?
> > Any help would be appreciated.
> > If you're on WCOSS, my test files and script are in
> >
> >
> >
> /gpfs/dell3/mdl/mdlverif/noscrub/usr/John.L.Wagner/mdl-
verification/pcp_combine_test
> >
> > Thanks
> > John
> > --
> > John Wagner
> > Verification Task Lead
> > NOAA/National Weather Service
> > Meteorological Development Laboratory
> > Digital Forecast Services Division
> > SSMC2 Room 10106
> > Silver Spring, MD 20910
> > (301) 427-9471 (office)
> > (908) 902-4155 (cell/text)
> >
> >
>
>
--
John Wagner
Verification Task Lead
NOAA/National Weather Service
Meteorological Development Laboratory
Digital Forecast Services Division
SSMC2 Room 10106
Silver Spring, MD 20910
(301) 427-9471 (office)
(908) 902-4155 (cell/text)
------------------------------------------------
Subject: GFS/pcp_combine issue
From: John Halley Gotway
Time: Thu Oct 01 12:10:36 2020
Hi John,
This is John Halley Gotway. I'll log on to WCOSS now and take a look
at
your files to see what's going on.
Thanks,
John
On Thu, Oct 1, 2020 at 10:51 AM John L Wagner - NOAA Federal via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96910 >
>
> We did test with those projections in the command. The error I get
then is
>
> DEBUG 2: Since the "-field" command line option was used, parsing
the
> command line arguments as a list of files.
> ERROR :
> ERROR : do_sub_command() -> you must specify exactly two input
files for
> subtraction.
> ERROR :
>
> It seemed like it was treating them as files instead of projections.
We
> have used those in earlier versions of MET. I wasn't sure if this
was a
> change for V9.1 or not.
>
> On Thu, Oct 1, 2020 at 12:40 PM Minna Win via RT <met_help at ucar.edu>
> wrote:
>
> > Hi John,
> >
> > It looks like you are missing the '36', and the '35' following the
input
> > files:
> >
> > pcp_combine -v 4 -subtract gfscogb0p2520093012qpf01f036 36
> > gfscogb0p2520093012qpf01f035 35 gfscogb0p2520093012qpf01f036_diff
> >
> > This follows the example in the User documentation for pcp-combine
for
> > subtract:
> > https://dtcenter.github.io/MET/Users_Guide/reformat_grid.html
(section
> > 5.1.1.6).
> >
> > Regards,
> > Minna
> > ---------------
> > Minna Win
> > National Center for Atmospheric Research
> > Developmental Testbed Center
> > Pronouns: she/her
> > Phone: 303-497-8423
> > Fax: 303-497-8401
> >
> >
> >
> > On Thu, Oct 1, 2020 at 9:01 AM John L Wagner - NOAA Federal via RT
<
> > met_help at ucar.edu> wrote:
> >
> > >
> > > Thu Oct 01 09:01:14 2020: Request 96910 was acted upon.
> > > Transaction: Ticket created by john.l.wagner at noaa.gov
> > > Queue: met_help
> > > Subject: GFS/pcp_combine issue
> > > Owner: Nobody
> > > Requestors: john.l.wagner at noaa.gov
> > > Status: new
> > > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96910
> >
> > >
> > >
> > > Good morning MET help desk
> > > We are having some problems using pcp_combine to compute the 1-
hr QPF
> for
> > > the GFS using MET V9.1. I'm currently running a test with the
35-hr
> and
> > > 36-hr files. Here is the wgrib2 listing for the two
projections:
> > >
> > > 1:0:d=2020093012:APCP:surface:0-36 hour acc fcst:
> > > 1:0:d=2020093012:APCP:surface:0-35 hour acc fcst:
> > >
> > > For other models, we would have run something like this:
> > >
> > > pcp_combine -v 4 -subtract gfscogb0p2520093012qpf01f036
> > > gfscogb0p2520093012qpf01f035 gfscogb0p2520093012qpf01f036_diff
> > >
> > > The error that I get with this is
> > >
> > > DEBUG 2: Since the "-field" command line option was not used,
parsing
> the
> > > command line arguments a list of files, each followed by a
> configuration
> > > string.
> > > ERROR :
> > > ERROR : process_add_sub_derive_args() -> file name used when
config
> > string
> > > expected (gfscogb0p2520093012qpf01f035). Did you forget the "-
field"
> > > option?
> > > ERROR :
> > >
> > > It seems as though we need to add -field, which we haven't
needed to do
> > > with other models. As far as I can tell, the command should be:
> > >
> > > pcp_combine -v 4 -subtract gfscogb0p2520093012qpf01f036
> > > gfscogb0p2520093012qpf01f035 gfscogb0p2520093012qpf01f036_diff
-field
> > > 'name="APCP"; level="A36";' -field 'name="APCP"; level="A35";'
> > >
> > > The error that I get with this is
> > >
> > > WARNING:
> > > WARNING: MetGrib2DataFile::data_plane() -> No matching record
found for
> > > 'APCP/A36'
> > > WARNING:
> > > ERROR :
> > > ERROR : get_field() -> can't get data plane from file
> > > "gfscogb0p2520093012qpf01f035"
> > > ERROR :
> > >
> > > I also tried using (*,*) for the level, but that gives me this
error:
> > >
> > > ERROR :
> > > ERROR : VarInfo::set_level_info_grib() - failed to parse level
string
> > > '(*,*)'
> > > ERROR :
> > >
> > > At this point, I'm pretty sure that the error is that I am not
> providing
> > > the correct level. We've tried multiple other values, but none
of them
> > > work. Is there a way for us to know what level value(s) MET is
> > expecting?
> > > Any help would be appreciated.
> > > If you're on WCOSS, my test files and script are in
> > >
> > >
> > >
> >
> /gpfs/dell3/mdl/mdlverif/noscrub/usr/John.L.Wagner/mdl-
verification/pcp_combine_test
> > >
> > > Thanks
> > > John
> > > --
> > > John Wagner
> > > Verification Task Lead
> > > NOAA/National Weather Service
> > > Meteorological Development Laboratory
> > > Digital Forecast Services Division
> > > SSMC2 Room 10106
> > > Silver Spring, MD 20910
> > > (301) 427-9471 (office)
> > > (908) 902-4155 (cell/text)
> > >
> > >
> >
> >
>
> --
> John Wagner
> Verification Task Lead
> NOAA/National Weather Service
> Meteorological Development Laboratory
> Digital Forecast Services Division
> SSMC2 Room 10106
> Silver Spring, MD 20910
> (301) 427-9471 (office)
> (908) 902-4155 (cell/text)
>
>
------------------------------------------------
Subject: GFS/pcp_combine issue
From: John Halley Gotway
Time: Thu Oct 01 12:24:18 2020
John,
Good news. There's no problem with the software, as long as you use
the
command line options that Minna described. Listed below are the
commands I
used to test:
*cd
/gpfs/dell3/mdl/mdlverif/noscrub/usr/John.L.Wagner/mdl-
verification/pcp_combine_test*
*module use
/gpfs/dell2/emc/verification/noscrub/emc.metplus/modulefiles/module
load
met/9.1*
*pcp_combine -subtract \*
*gfscogb0p2520093012qpf01f036 36 \*
*gfscogb0p2520093012qpf01f035 35 \*
*/u/John.H.Gotway/gfscogb0p2520093012qpf01f036_diff*
I wrote the output to my home directory because of permission issues.
This
runs fine and produces the expected output.
Let me list a second variation that also works.
*pcp_combine -subtract \*
*gfscogb0p2520093012qpf01f036 'name="APCP"; level="A36";' \*
*gfscogb0p2520093012qpf01f035 'name="APCP"; level="A35";' \*
*/u/John.H.Gotway/gfscogb0p2520093012qpf01f036_diff*
Both commands do exactly the same thing... I just replaced "35" and
"36"
with a longer string explicitly defining the field to be read from
that
input file. That's what this NOTE in the pcp_combine usage statement
means:
*Note: The "config_str" and "-field" strings may be set to a
timestring in
HH[MMSS] format for accumulated precipitation or a full configuration
string.*
If not otherwise specified, pcp_combine assumes that you're processing
precip (APCP) and the integer you specify after the input file name is
the
accumulation interval that should be used.
I see that you've been using the "-field" option. This only works when
you're processing the SAME FIELD from all input files. If the
accumulation
interval differs (e.g. 35 vs 36), then it's not the same field. Let's
say
you want to compute the maximum 2-m temperature value at each grid
point
over your model integration, you could run:
*pcp_combine -derive max gfscogb0p2520093012f* -field 'name="TMP";
level="Z2";' max.nc <http://max.nc>*
This assumes of course that 2m-temperature exists in those input
files. And
it'd find that record from each input file and compute the maximum
value at
each grid point.
Hope that helps clarify.
Thanks,
John
On Thu, Oct 1, 2020 at 12:03 PM John Halley Gotway <johnhg at ucar.edu>
wrote:
> Hi John,
>
> This is John Halley Gotway. I'll log on to WCOSS now and take a look
at
> your files to see what's going on.
>
> Thanks,
> John
>
> On Thu, Oct 1, 2020 at 10:51 AM John L Wagner - NOAA Federal via RT
<
> met_help at ucar.edu> wrote:
>
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96910 >
>>
>> We did test with those projections in the command. The error I get
then
>> is
>>
>> DEBUG 2: Since the "-field" command line option was used, parsing
the
>> command line arguments as a list of files.
>> ERROR :
>> ERROR : do_sub_command() -> you must specify exactly two input
files for
>> subtraction.
>> ERROR :
>>
>> It seemed like it was treating them as files instead of
projections. We
>> have used those in earlier versions of MET. I wasn't sure if this
was a
>> change for V9.1 or not.
>>
>> On Thu, Oct 1, 2020 at 12:40 PM Minna Win via RT
<met_help at ucar.edu>
>> wrote:
>>
>> > Hi John,
>> >
>> > It looks like you are missing the '36', and the '35' following
the input
>> > files:
>> >
>> > pcp_combine -v 4 -subtract gfscogb0p2520093012qpf01f036 36
>> > gfscogb0p2520093012qpf01f035 35 gfscogb0p2520093012qpf01f036_diff
>> >
>> > This follows the example in the User documentation for pcp-
combine for
>> > subtract:
>> > https://dtcenter.github.io/MET/Users_Guide/reformat_grid.html
(section
>> > 5.1.1.6).
>> >
>> > Regards,
>> > Minna
>> > ---------------
>> > Minna Win
>> > National Center for Atmospheric Research
>> > Developmental Testbed Center
>> > Pronouns: she/her
>> > Phone: 303-497-8423
>> > Fax: 303-497-8401
>> >
>> >
>> >
>> > On Thu, Oct 1, 2020 at 9:01 AM John L Wagner - NOAA Federal via
RT <
>> > met_help at ucar.edu> wrote:
>> >
>> > >
>> > > Thu Oct 01 09:01:14 2020: Request 96910 was acted upon.
>> > > Transaction: Ticket created by john.l.wagner at noaa.gov
>> > > Queue: met_help
>> > > Subject: GFS/pcp_combine issue
>> > > Owner: Nobody
>> > > Requestors: john.l.wagner at noaa.gov
>> > > Status: new
>> > > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96910
>> >
>> > >
>> > >
>> > > Good morning MET help desk
>> > > We are having some problems using pcp_combine to compute the 1-
hr QPF
>> for
>> > > the GFS using MET V9.1. I'm currently running a test with the
35-hr
>> and
>> > > 36-hr files. Here is the wgrib2 listing for the two
projections:
>> > >
>> > > 1:0:d=2020093012:APCP:surface:0-36 hour acc fcst:
>> > > 1:0:d=2020093012:APCP:surface:0-35 hour acc fcst:
>> > >
>> > > For other models, we would have run something like this:
>> > >
>> > > pcp_combine -v 4 -subtract gfscogb0p2520093012qpf01f036
>> > > gfscogb0p2520093012qpf01f035 gfscogb0p2520093012qpf01f036_diff
>> > >
>> > > The error that I get with this is
>> > >
>> > > DEBUG 2: Since the "-field" command line option was not used,
parsing
>> the
>> > > command line arguments a list of files, each followed by a
>> configuration
>> > > string.
>> > > ERROR :
>> > > ERROR : process_add_sub_derive_args() -> file name used when
config
>> > string
>> > > expected (gfscogb0p2520093012qpf01f035). Did you forget the "-
field"
>> > > option?
>> > > ERROR :
>> > >
>> > > It seems as though we need to add -field, which we haven't
needed to
>> do
>> > > with other models. As far as I can tell, the command should
be:
>> > >
>> > > pcp_combine -v 4 -subtract gfscogb0p2520093012qpf01f036
>> > > gfscogb0p2520093012qpf01f035 gfscogb0p2520093012qpf01f036_diff
-field
>> > > 'name="APCP"; level="A36";' -field 'name="APCP"; level="A35";'
>> > >
>> > > The error that I get with this is
>> > >
>> > > WARNING:
>> > > WARNING: MetGrib2DataFile::data_plane() -> No matching record
found
>> for
>> > > 'APCP/A36'
>> > > WARNING:
>> > > ERROR :
>> > > ERROR : get_field() -> can't get data plane from file
>> > > "gfscogb0p2520093012qpf01f035"
>> > > ERROR :
>> > >
>> > > I also tried using (*,*) for the level, but that gives me this
error:
>> > >
>> > > ERROR :
>> > > ERROR : VarInfo::set_level_info_grib() - failed to parse level
string
>> > > '(*,*)'
>> > > ERROR :
>> > >
>> > > At this point, I'm pretty sure that the error is that I am not
>> providing
>> > > the correct level. We've tried multiple other values, but none
of
>> them
>> > > work. Is there a way for us to know what level value(s) MET is
>> > expecting?
>> > > Any help would be appreciated.
>> > > If you're on WCOSS, my test files and script are in
>> > >
>> > >
>> > >
>> >
>> /gpfs/dell3/mdl/mdlverif/noscrub/usr/John.L.Wagner/mdl-
verification/pcp_combine_test
>> > >
>> > > Thanks
>> > > John
>> > > --
>> > > John Wagner
>> > > Verification Task Lead
>> > > NOAA/National Weather Service
>> > > Meteorological Development Laboratory
>> > > Digital Forecast Services Division
>> > > SSMC2 Room 10106
>> > > Silver Spring, MD 20910
>> > > (301) 427-9471 (office)
>> > > (908) 902-4155 (cell/text)
>> > >
>> > >
>> >
>> >
>>
>> --
>> John Wagner
>> Verification Task Lead
>> NOAA/National Weather Service
>> Meteorological Development Laboratory
>> Digital Forecast Services Division
>> SSMC2 Room 10106
>> Silver Spring, MD 20910
>> (301) 427-9471 (office)
>> (908) 902-4155 (cell/text)
>>
>>
------------------------------------------------
Subject: GFS/pcp_combine issue
From: John L Wagner - NOAA Federal
Time: Thu Oct 01 13:06:58 2020
Well, this is weird. I tried the exact command you sent (with a
different
output file) several times yesterday and again today after I got
Minna's
email. It failed every time. I tried it again now and it works. The
only
difference is that I had to restart my laptop, so I had a fresh login
for
my last test. Maybe there was something in my environment that was
causing
the issue?
Brad was getting the same errors I was. Its seems odd that we would
both
encounter the same problem with our environments. Erin didn't have a
problem, so it was localized somehow to Brad and I.
As always, I appreciate your help.
Thanks
John
On Thu, Oct 1, 2020 at 2:24 PM John Halley Gotway via RT
<met_help at ucar.edu>
wrote:
> John,
>
> Good news. There's no problem with the software, as long as you use
the
> command line options that Minna described. Listed below are the
commands I
> used to test:
>
> *cd
>
> /gpfs/dell3/mdl/mdlverif/noscrub/usr/John.L.Wagner/mdl-
verification/pcp_combine_test*
>
>
> *module use
> /gpfs/dell2/emc/verification/noscrub/emc.metplus/modulefiles/module
load
> met/9.1*
> *pcp_combine -subtract \*
> *gfscogb0p2520093012qpf01f036 36 \*
> *gfscogb0p2520093012qpf01f035 35 \*
>
> */u/John.H.Gotway/gfscogb0p2520093012qpf01f036_diff*
>
> I wrote the output to my home directory because of permission
issues. This
> runs fine and produces the expected output.
> Let me list a second variation that also works.
>
> *pcp_combine -subtract \*
> *gfscogb0p2520093012qpf01f036 'name="APCP"; level="A36";' \*
> *gfscogb0p2520093012qpf01f035 'name="APCP"; level="A35";' \*
> */u/John.H.Gotway/gfscogb0p2520093012qpf01f036_diff*
>
> Both commands do exactly the same thing... I just replaced "35" and
"36"
> with a longer string explicitly defining the field to be read from
that
> input file. That's what this NOTE in the pcp_combine usage statement
means:
>
> *Note: The "config_str" and "-field" strings may be set to a
timestring in
> HH[MMSS] format for accumulated precipitation or a full
configuration
> string.*
>
> If not otherwise specified, pcp_combine assumes that you're
processing
> precip (APCP) and the integer you specify after the input file name
is the
> accumulation interval that should be used.
>
> I see that you've been using the "-field" option. This only works
when
> you're processing the SAME FIELD from all input files. If the
accumulation
> interval differs (e.g. 35 vs 36), then it's not the same field.
Let's say
> you want to compute the maximum 2-m temperature value at each grid
point
> over your model integration, you could run:
>
> *pcp_combine -derive max gfscogb0p2520093012f* -field 'name="TMP";
> level="Z2";' max.nc <http://max.nc>*
>
> This assumes of course that 2m-temperature exists in those input
files. And
> it'd find that record from each input file and compute the maximum
value at
> each grid point.
>
> Hope that helps clarify.
>
> Thanks,
> John
>
> On Thu, Oct 1, 2020 at 12:03 PM John Halley Gotway <johnhg at ucar.edu>
> wrote:
>
> > Hi John,
> >
> > This is John Halley Gotway. I'll log on to WCOSS now and take a
look at
> > your files to see what's going on.
> >
> > Thanks,
> > John
> >
> > On Thu, Oct 1, 2020 at 10:51 AM John L Wagner - NOAA Federal via
RT <
> > met_help at ucar.edu> wrote:
> >
> >>
> >> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96910 >
> >>
> >> We did test with those projections in the command. The error I
get then
> >> is
> >>
> >> DEBUG 2: Since the "-field" command line option was used, parsing
the
> >> command line arguments as a list of files.
> >> ERROR :
> >> ERROR : do_sub_command() -> you must specify exactly two input
files
> for
> >> subtraction.
> >> ERROR :
> >>
> >> It seemed like it was treating them as files instead of
projections. We
> >> have used those in earlier versions of MET. I wasn't sure if
this was a
> >> change for V9.1 or not.
> >>
> >> On Thu, Oct 1, 2020 at 12:40 PM Minna Win via RT
<met_help at ucar.edu>
> >> wrote:
> >>
> >> > Hi John,
> >> >
> >> > It looks like you are missing the '36', and the '35' following
the
> input
> >> > files:
> >> >
> >> > pcp_combine -v 4 -subtract gfscogb0p2520093012qpf01f036 36
> >> > gfscogb0p2520093012qpf01f035 35
gfscogb0p2520093012qpf01f036_diff
> >> >
> >> > This follows the example in the User documentation for pcp-
combine for
> >> > subtract:
> >> > https://dtcenter.github.io/MET/Users_Guide/reformat_grid.html
> (section
> >> > 5.1.1.6).
> >> >
> >> > Regards,
> >> > Minna
> >> > ---------------
> >> > Minna Win
> >> > National Center for Atmospheric Research
> >> > Developmental Testbed Center
> >> > Pronouns: she/her
> >> > Phone: 303-497-8423
> >> > Fax: 303-497-8401
> >> >
> >> >
> >> >
> >> > On Thu, Oct 1, 2020 at 9:01 AM John L Wagner - NOAA Federal via
RT <
> >> > met_help at ucar.edu> wrote:
> >> >
> >> > >
> >> > > Thu Oct 01 09:01:14 2020: Request 96910 was acted upon.
> >> > > Transaction: Ticket created by john.l.wagner at noaa.gov
> >> > > Queue: met_help
> >> > > Subject: GFS/pcp_combine issue
> >> > > Owner: Nobody
> >> > > Requestors: john.l.wagner at noaa.gov
> >> > > Status: new
> >> > > Ticket <URL:
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96910
> >> >
> >> > >
> >> > >
> >> > > Good morning MET help desk
> >> > > We are having some problems using pcp_combine to compute the
1-hr
> QPF
> >> for
> >> > > the GFS using MET V9.1. I'm currently running a test with
the 35-hr
> >> and
> >> > > 36-hr files. Here is the wgrib2 listing for the two
projections:
> >> > >
> >> > > 1:0:d=2020093012:APCP:surface:0-36 hour acc fcst:
> >> > > 1:0:d=2020093012:APCP:surface:0-35 hour acc fcst:
> >> > >
> >> > > For other models, we would have run something like this:
> >> > >
> >> > > pcp_combine -v 4 -subtract gfscogb0p2520093012qpf01f036
> >> > > gfscogb0p2520093012qpf01f035
gfscogb0p2520093012qpf01f036_diff
> >> > >
> >> > > The error that I get with this is
> >> > >
> >> > > DEBUG 2: Since the "-field" command line option was not used,
> parsing
> >> the
> >> > > command line arguments a list of files, each followed by a
> >> configuration
> >> > > string.
> >> > > ERROR :
> >> > > ERROR : process_add_sub_derive_args() -> file name used when
config
> >> > string
> >> > > expected (gfscogb0p2520093012qpf01f035). Did you forget the
"-field"
> >> > > option?
> >> > > ERROR :
> >> > >
> >> > > It seems as though we need to add -field, which we haven't
needed to
> >> do
> >> > > with other models. As far as I can tell, the command should
be:
> >> > >
> >> > > pcp_combine -v 4 -subtract gfscogb0p2520093012qpf01f036
> >> > > gfscogb0p2520093012qpf01f035
gfscogb0p2520093012qpf01f036_diff
> -field
> >> > > 'name="APCP"; level="A36";' -field 'name="APCP";
level="A35";'
> >> > >
> >> > > The error that I get with this is
> >> > >
> >> > > WARNING:
> >> > > WARNING: MetGrib2DataFile::data_plane() -> No matching record
found
> >> for
> >> > > 'APCP/A36'
> >> > > WARNING:
> >> > > ERROR :
> >> > > ERROR : get_field() -> can't get data plane from file
> >> > > "gfscogb0p2520093012qpf01f035"
> >> > > ERROR :
> >> > >
> >> > > I also tried using (*,*) for the level, but that gives me
this
> error:
> >> > >
> >> > > ERROR :
> >> > > ERROR : VarInfo::set_level_info_grib() - failed to parse
level
> string
> >> > > '(*,*)'
> >> > > ERROR :
> >> > >
> >> > > At this point, I'm pretty sure that the error is that I am
not
> >> providing
> >> > > the correct level. We've tried multiple other values, but
none of
> >> them
> >> > > work. Is there a way for us to know what level value(s) MET
is
> >> > expecting?
> >> > > Any help would be appreciated.
> >> > > If you're on WCOSS, my test files and script are in
> >> > >
> >> > >
> >> > >
> >> >
> >>
> /gpfs/dell3/mdl/mdlverif/noscrub/usr/John.L.Wagner/mdl-
verification/pcp_combine_test
> >> > >
> >> > > Thanks
> >> > > John
> >> > > --
> >> > > John Wagner
> >> > > Verification Task Lead
> >> > > NOAA/National Weather Service
> >> > > Meteorological Development Laboratory
> >> > > Digital Forecast Services Division
> >> > > SSMC2 Room 10106
> >> > > Silver Spring, MD 20910
> >> > > (301) 427-9471 (office)
> >> > > (908) 902-4155 (cell/text)
> >> > >
> >> > >
> >> >
> >> >
> >>
> >> --
> >> John Wagner
> >> Verification Task Lead
> >> NOAA/National Weather Service
> >> Meteorological Development Laboratory
> >> Digital Forecast Services Division
> >> SSMC2 Room 10106
> >> Silver Spring, MD 20910
> >> (301) 427-9471 (office)
> >> (908) 902-4155 (cell/text)
> >>
> >>
>
>
--
John Wagner
Verification Task Lead
NOAA/National Weather Service
Meteorological Development Laboratory
Digital Forecast Services Division
SSMC2 Room 10106
Silver Spring, MD 20910
(301) 427-9471 (office)
(908) 902-4155 (cell/text)
------------------------------------------------
Subject: GFS/pcp_combine issue
From: John Halley Gotway
Time: Thu Oct 01 13:33:46 2020
John,
If you were testing **with** the "-field" command line option, it
would not
have worked. For example...
*pcp_combine -subtract \*
*gfscogb0p2520093012qpf01f036 36 \*
*gfscogb0p2520093012qpf01f035 35 \*
*-field 'name="APCP"; level="A36";' \*
*/u/John.H.Gotway/gfscogb0p2520093012qpf01f036_diff*
Results in this failure:
*DEBUG 2: Since the "-field" command line option was used, parsing the
command line arguments as a list of files.ERROR : ERROR :
do_sub_command() -> you must specify exactly two input files for
subtraction.ERROR :*
Since we used "-field" here, it assumes that all the input strings are
file
names... 4 of them: "gfs..f036", "36", "gfs..f035", "35".
And that causes an error because the -subtract command expects exactly
2
input files.
But I don't know what combination of options you were testing
yesterday.
Glad it's working now! I'll go ahead and resolve this issue.
Thanks,
John
On Thu, Oct 1, 2020 at 1:07 PM John L Wagner - NOAA Federal via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96910 >
>
> Well, this is weird. I tried the exact command you sent (with a
different
> output file) several times yesterday and again today after I got
Minna's
> email. It failed every time. I tried it again now and it works.
The only
> difference is that I had to restart my laptop, so I had a fresh
login for
> my last test. Maybe there was something in my environment that was
causing
> the issue?
> Brad was getting the same errors I was. Its seems odd that we would
both
> encounter the same problem with our environments. Erin didn't have
a
> problem, so it was localized somehow to Brad and I.
> As always, I appreciate your help.
> Thanks
> John
>
> On Thu, Oct 1, 2020 at 2:24 PM John Halley Gotway via RT <
> met_help at ucar.edu>
> wrote:
>
> > John,
> >
> > Good news. There's no problem with the software, as long as you
use the
> > command line options that Minna described. Listed below are the
commands
> I
> > used to test:
> >
> > *cd
> >
> >
> /gpfs/dell3/mdl/mdlverif/noscrub/usr/John.L.Wagner/mdl-
verification/pcp_combine_test*
> >
> >
> > *module use
> >
/gpfs/dell2/emc/verification/noscrub/emc.metplus/modulefiles/module
load
> > met/9.1*
> > *pcp_combine -subtract \*
> > *gfscogb0p2520093012qpf01f036 36 \*
> > *gfscogb0p2520093012qpf01f035 35 \*
> >
> > */u/John.H.Gotway/gfscogb0p2520093012qpf01f036_diff*
> >
> > I wrote the output to my home directory because of permission
issues.
> This
> > runs fine and produces the expected output.
> > Let me list a second variation that also works.
> >
> > *pcp_combine -subtract \*
> > *gfscogb0p2520093012qpf01f036 'name="APCP"; level="A36";' \*
> > *gfscogb0p2520093012qpf01f035 'name="APCP"; level="A35";' \*
> > */u/John.H.Gotway/gfscogb0p2520093012qpf01f036_diff*
> >
> > Both commands do exactly the same thing... I just replaced "35"
and "36"
> > with a longer string explicitly defining the field to be read from
that
> > input file. That's what this NOTE in the pcp_combine usage
statement
> means:
> >
> > *Note: The "config_str" and "-field" strings may be set to a
timestring
> in
> > HH[MMSS] format for accumulated precipitation or a full
configuration
> > string.*
> >
> > If not otherwise specified, pcp_combine assumes that you're
processing
> > precip (APCP) and the integer you specify after the input file
name is
> the
> > accumulation interval that should be used.
> >
> > I see that you've been using the "-field" option. This only works
when
> > you're processing the SAME FIELD from all input files. If the
> accumulation
> > interval differs (e.g. 35 vs 36), then it's not the same field.
Let's say
> > you want to compute the maximum 2-m temperature value at each grid
point
> > over your model integration, you could run:
> >
> > *pcp_combine -derive max gfscogb0p2520093012f* -field 'name="TMP";
> > level="Z2";' max.nc <http://max.nc>*
> >
> > This assumes of course that 2m-temperature exists in those input
files.
> And
> > it'd find that record from each input file and compute the maximum
value
> at
> > each grid point.
> >
> > Hope that helps clarify.
> >
> > Thanks,
> > John
> >
> > On Thu, Oct 1, 2020 at 12:03 PM John Halley Gotway
<johnhg at ucar.edu>
> > wrote:
> >
> > > Hi John,
> > >
> > > This is John Halley Gotway. I'll log on to WCOSS now and take a
look at
> > > your files to see what's going on.
> > >
> > > Thanks,
> > > John
> > >
> > > On Thu, Oct 1, 2020 at 10:51 AM John L Wagner - NOAA Federal via
RT <
> > > met_help at ucar.edu> wrote:
> > >
> > >>
> > >> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96910 >
> > >>
> > >> We did test with those projections in the command. The error I
get
> then
> > >> is
> > >>
> > >> DEBUG 2: Since the "-field" command line option was used,
parsing the
> > >> command line arguments as a list of files.
> > >> ERROR :
> > >> ERROR : do_sub_command() -> you must specify exactly two input
files
> > for
> > >> subtraction.
> > >> ERROR :
> > >>
> > >> It seemed like it was treating them as files instead of
projections.
> We
> > >> have used those in earlier versions of MET. I wasn't sure if
this
> was a
> > >> change for V9.1 or not.
> > >>
> > >> On Thu, Oct 1, 2020 at 12:40 PM Minna Win via RT
<met_help at ucar.edu>
> > >> wrote:
> > >>
> > >> > Hi John,
> > >> >
> > >> > It looks like you are missing the '36', and the '35'
following the
> > input
> > >> > files:
> > >> >
> > >> > pcp_combine -v 4 -subtract gfscogb0p2520093012qpf01f036 36
> > >> > gfscogb0p2520093012qpf01f035 35
gfscogb0p2520093012qpf01f036_diff
> > >> >
> > >> > This follows the example in the User documentation for pcp-
combine
> for
> > >> > subtract:
> > >> > https://dtcenter.github.io/MET/Users_Guide/reformat_grid.html
> > (section
> > >> > 5.1.1.6).
> > >> >
> > >> > Regards,
> > >> > Minna
> > >> > ---------------
> > >> > Minna Win
> > >> > National Center for Atmospheric Research
> > >> > Developmental Testbed Center
> > >> > Pronouns: she/her
> > >> > Phone: 303-497-8423
> > >> > Fax: 303-497-8401
> > >> >
> > >> >
> > >> >
> > >> > On Thu, Oct 1, 2020 at 9:01 AM John L Wagner - NOAA Federal
via RT <
> > >> > met_help at ucar.edu> wrote:
> > >> >
> > >> > >
> > >> > > Thu Oct 01 09:01:14 2020: Request 96910 was acted upon.
> > >> > > Transaction: Ticket created by john.l.wagner at noaa.gov
> > >> > > Queue: met_help
> > >> > > Subject: GFS/pcp_combine issue
> > >> > > Owner: Nobody
> > >> > > Requestors: john.l.wagner at noaa.gov
> > >> > > Status: new
> > >> > > Ticket <URL:
> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96910
> > >> >
> > >> > >
> > >> > >
> > >> > > Good morning MET help desk
> > >> > > We are having some problems using pcp_combine to compute
the 1-hr
> > QPF
> > >> for
> > >> > > the GFS using MET V9.1. I'm currently running a test with
the
> 35-hr
> > >> and
> > >> > > 36-hr files. Here is the wgrib2 listing for the two
projections:
> > >> > >
> > >> > > 1:0:d=2020093012:APCP:surface:0-36 hour acc fcst:
> > >> > > 1:0:d=2020093012:APCP:surface:0-35 hour acc fcst:
> > >> > >
> > >> > > For other models, we would have run something like this:
> > >> > >
> > >> > > pcp_combine -v 4 -subtract gfscogb0p2520093012qpf01f036
> > >> > > gfscogb0p2520093012qpf01f035
gfscogb0p2520093012qpf01f036_diff
> > >> > >
> > >> > > The error that I get with this is
> > >> > >
> > >> > > DEBUG 2: Since the "-field" command line option was not
used,
> > parsing
> > >> the
> > >> > > command line arguments a list of files, each followed by a
> > >> configuration
> > >> > > string.
> > >> > > ERROR :
> > >> > > ERROR : process_add_sub_derive_args() -> file name used
when
> config
> > >> > string
> > >> > > expected (gfscogb0p2520093012qpf01f035). Did you forget the
> "-field"
> > >> > > option?
> > >> > > ERROR :
> > >> > >
> > >> > > It seems as though we need to add -field, which we haven't
needed
> to
> > >> do
> > >> > > with other models. As far as I can tell, the command
should be:
> > >> > >
> > >> > > pcp_combine -v 4 -subtract gfscogb0p2520093012qpf01f036
> > >> > > gfscogb0p2520093012qpf01f035
gfscogb0p2520093012qpf01f036_diff
> > -field
> > >> > > 'name="APCP"; level="A36";' -field 'name="APCP";
level="A35";'
> > >> > >
> > >> > > The error that I get with this is
> > >> > >
> > >> > > WARNING:
> > >> > > WARNING: MetGrib2DataFile::data_plane() -> No matching
record
> found
> > >> for
> > >> > > 'APCP/A36'
> > >> > > WARNING:
> > >> > > ERROR :
> > >> > > ERROR : get_field() -> can't get data plane from file
> > >> > > "gfscogb0p2520093012qpf01f035"
> > >> > > ERROR :
> > >> > >
> > >> > > I also tried using (*,*) for the level, but that gives me
this
> > error:
> > >> > >
> > >> > > ERROR :
> > >> > > ERROR : VarInfo::set_level_info_grib() - failed to parse
level
> > string
> > >> > > '(*,*)'
> > >> > > ERROR :
> > >> > >
> > >> > > At this point, I'm pretty sure that the error is that I am
not
> > >> providing
> > >> > > the correct level. We've tried multiple other values, but
none of
> > >> them
> > >> > > work. Is there a way for us to know what level value(s)
MET is
> > >> > expecting?
> > >> > > Any help would be appreciated.
> > >> > > If you're on WCOSS, my test files and script are in
> > >> > >
> > >> > >
> > >> > >
> > >> >
> > >>
> >
> /gpfs/dell3/mdl/mdlverif/noscrub/usr/John.L.Wagner/mdl-
verification/pcp_combine_test
> > >> > >
> > >> > > Thanks
> > >> > > John
> > >> > > --
> > >> > > John Wagner
> > >> > > Verification Task Lead
> > >> > > NOAA/National Weather Service
> > >> > > Meteorological Development Laboratory
> > >> > > Digital Forecast Services Division
> > >> > > SSMC2 Room 10106
> > >> > > Silver Spring, MD 20910
> > >> > > (301) 427-9471 (office)
> > >> > > (908) 902-4155 (cell/text)
> > >> > >
> > >> > >
> > >> >
> > >> >
> > >>
> > >> --
> > >> John Wagner
> > >> Verification Task Lead
> > >> NOAA/National Weather Service
> > >> Meteorological Development Laboratory
> > >> Digital Forecast Services Division
> > >> SSMC2 Room 10106
> > >> Silver Spring, MD 20910
> > >> (301) 427-9471 (office)
> > >> (908) 902-4155 (cell/text)
> > >>
> > >>
> >
> >
>
> --
> John Wagner
> Verification Task Lead
> NOAA/National Weather Service
> Meteorological Development Laboratory
> Digital Forecast Services Division
> SSMC2 Room 10106
> Silver Spring, MD 20910
> (301) 427-9471 (office)
> (908) 902-4155 (cell/text)
>
>
------------------------------------------------
Subject: GFS/pcp_combine issue
From: John L Wagner - NOAA Federal
Time: Thu Oct 01 13:41:36 2020
We definitely tried without the -field options, as we started with a
script
that had been working previously that did not have them. It wasn't
until
we saw this error
ERROR : process_add_sub_derive_args() -> file name used when config
string
expected (gfscogb0p2520093012qpf01f035). Did you forget the "-field"
option?
that we added the -field option.
Either way, I'm glad its working now. Please do mark this as
resolved.
Thanks again!
John
On Thu, Oct 1, 2020 at 3:33 PM John Halley Gotway via RT
<met_help at ucar.edu>
wrote:
> John,
>
> If you were testing **with** the "-field" command line option, it
would not
> have worked. For example...
>
> *pcp_combine -subtract \*
> *gfscogb0p2520093012qpf01f036 36 \*
> *gfscogb0p2520093012qpf01f035 35 \*
> *-field 'name="APCP"; level="A36";' \*
> */u/John.H.Gotway/gfscogb0p2520093012qpf01f036_diff*
>
> Results in this failure:
>
>
>
>
> *DEBUG 2: Since the "-field" command line option was used, parsing
the
> command line arguments as a list of files.ERROR : ERROR :
> do_sub_command() -> you must specify exactly two input files for
> subtraction.ERROR :*
>
> Since we used "-field" here, it assumes that all the input strings
are file
> names... 4 of them: "gfs..f036", "36", "gfs..f035", "35".
> And that causes an error because the -subtract command expects
exactly 2
> input files.
>
> But I don't know what combination of options you were testing
yesterday.
>
> Glad it's working now! I'll go ahead and resolve this issue.
>
> Thanks,
> John
>
> On Thu, Oct 1, 2020 at 1:07 PM John L Wagner - NOAA Federal via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96910 >
> >
> > Well, this is weird. I tried the exact command you sent (with a
> different
> > output file) several times yesterday and again today after I got
Minna's
> > email. It failed every time. I tried it again now and it works.
The
> only
> > difference is that I had to restart my laptop, so I had a fresh
login for
> > my last test. Maybe there was something in my environment that
was
> causing
> > the issue?
> > Brad was getting the same errors I was. Its seems odd that we
would both
> > encounter the same problem with our environments. Erin didn't
have a
> > problem, so it was localized somehow to Brad and I.
> > As always, I appreciate your help.
> > Thanks
> > John
> >
> > On Thu, Oct 1, 2020 at 2:24 PM John Halley Gotway via RT <
> > met_help at ucar.edu>
> > wrote:
> >
> > > John,
> > >
> > > Good news. There's no problem with the software, as long as you
use the
> > > command line options that Minna described. Listed below are the
> commands
> > I
> > > used to test:
> > >
> > > *cd
> > >
> > >
> >
> /gpfs/dell3/mdl/mdlverif/noscrub/usr/John.L.Wagner/mdl-
verification/pcp_combine_test*
> > >
> > >
> > > *module use
> > >
/gpfs/dell2/emc/verification/noscrub/emc.metplus/modulefiles/module
> load
> > > met/9.1*
> > > *pcp_combine -subtract \*
> > > *gfscogb0p2520093012qpf01f036 36 \*
> > > *gfscogb0p2520093012qpf01f035 35 \*
> > >
> > > */u/John.H.Gotway/gfscogb0p2520093012qpf01f036_diff*
> > >
> > > I wrote the output to my home directory because of permission
issues.
> > This
> > > runs fine and produces the expected output.
> > > Let me list a second variation that also works.
> > >
> > > *pcp_combine -subtract \*
> > > *gfscogb0p2520093012qpf01f036 'name="APCP"; level="A36";' \*
> > > *gfscogb0p2520093012qpf01f035 'name="APCP"; level="A35";' \*
> > > */u/John.H.Gotway/gfscogb0p2520093012qpf01f036_diff*
> > >
> > > Both commands do exactly the same thing... I just replaced "35"
and
> "36"
> > > with a longer string explicitly defining the field to be read
from that
> > > input file. That's what this NOTE in the pcp_combine usage
statement
> > means:
> > >
> > > *Note: The "config_str" and "-field" strings may be set to a
timestring
> > in
> > > HH[MMSS] format for accumulated precipitation or a full
configuration
> > > string.*
> > >
> > > If not otherwise specified, pcp_combine assumes that you're
processing
> > > precip (APCP) and the integer you specify after the input file
name is
> > the
> > > accumulation interval that should be used.
> > >
> > > I see that you've been using the "-field" option. This only
works when
> > > you're processing the SAME FIELD from all input files. If the
> > accumulation
> > > interval differs (e.g. 35 vs 36), then it's not the same field.
Let's
> say
> > > you want to compute the maximum 2-m temperature value at each
grid
> point
> > > over your model integration, you could run:
> > >
> > > *pcp_combine -derive max gfscogb0p2520093012f* -field
'name="TMP";
> > > level="Z2";' max.nc <http://max.nc>*
> > >
> > > This assumes of course that 2m-temperature exists in those input
files.
> > And
> > > it'd find that record from each input file and compute the
maximum
> value
> > at
> > > each grid point.
> > >
> > > Hope that helps clarify.
> > >
> > > Thanks,
> > > John
> > >
> > > On Thu, Oct 1, 2020 at 12:03 PM John Halley Gotway
<johnhg at ucar.edu>
> > > wrote:
> > >
> > > > Hi John,
> > > >
> > > > This is John Halley Gotway. I'll log on to WCOSS now and take
a look
> at
> > > > your files to see what's going on.
> > > >
> > > > Thanks,
> > > > John
> > > >
> > > > On Thu, Oct 1, 2020 at 10:51 AM John L Wagner - NOAA Federal
via RT <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > >>
> > > >> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96910
>
> > > >>
> > > >> We did test with those projections in the command. The error
I get
> > then
> > > >> is
> > > >>
> > > >> DEBUG 2: Since the "-field" command line option was used,
parsing
> the
> > > >> command line arguments as a list of files.
> > > >> ERROR :
> > > >> ERROR : do_sub_command() -> you must specify exactly two
input
> files
> > > for
> > > >> subtraction.
> > > >> ERROR :
> > > >>
> > > >> It seemed like it was treating them as files instead of
projections.
> > We
> > > >> have used those in earlier versions of MET. I wasn't sure if
this
> > was a
> > > >> change for V9.1 or not.
> > > >>
> > > >> On Thu, Oct 1, 2020 at 12:40 PM Minna Win via RT
<met_help at ucar.edu
> >
> > > >> wrote:
> > > >>
> > > >> > Hi John,
> > > >> >
> > > >> > It looks like you are missing the '36', and the '35'
following the
> > > input
> > > >> > files:
> > > >> >
> > > >> > pcp_combine -v 4 -subtract gfscogb0p2520093012qpf01f036 36
> > > >> > gfscogb0p2520093012qpf01f035 35
gfscogb0p2520093012qpf01f036_diff
> > > >> >
> > > >> > This follows the example in the User documentation for pcp-
combine
> > for
> > > >> > subtract:
> > > >> >
https://dtcenter.github.io/MET/Users_Guide/reformat_grid.html
> > > (section
> > > >> > 5.1.1.6).
> > > >> >
> > > >> > Regards,
> > > >> > Minna
> > > >> > ---------------
> > > >> > Minna Win
> > > >> > National Center for Atmospheric Research
> > > >> > Developmental Testbed Center
> > > >> > Pronouns: she/her
> > > >> > Phone: 303-497-8423
> > > >> > Fax: 303-497-8401
> > > >> >
> > > >> >
> > > >> >
> > > >> > On Thu, Oct 1, 2020 at 9:01 AM John L Wagner - NOAA Federal
via
> RT <
> > > >> > met_help at ucar.edu> wrote:
> > > >> >
> > > >> > >
> > > >> > > Thu Oct 01 09:01:14 2020: Request 96910 was acted upon.
> > > >> > > Transaction: Ticket created by john.l.wagner at noaa.gov
> > > >> > > Queue: met_help
> > > >> > > Subject: GFS/pcp_combine issue
> > > >> > > Owner: Nobody
> > > >> > > Requestors: john.l.wagner at noaa.gov
> > > >> > > Status: new
> > > >> > > Ticket <URL:
> > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96910
> > > >> >
> > > >> > >
> > > >> > >
> > > >> > > Good morning MET help desk
> > > >> > > We are having some problems using pcp_combine to compute
the
> 1-hr
> > > QPF
> > > >> for
> > > >> > > the GFS using MET V9.1. I'm currently running a test
with the
> > 35-hr
> > > >> and
> > > >> > > 36-hr files. Here is the wgrib2 listing for the two
> projections:
> > > >> > >
> > > >> > > 1:0:d=2020093012:APCP:surface:0-36 hour acc fcst:
> > > >> > > 1:0:d=2020093012:APCP:surface:0-35 hour acc fcst:
> > > >> > >
> > > >> > > For other models, we would have run something like this:
> > > >> > >
> > > >> > > pcp_combine -v 4 -subtract gfscogb0p2520093012qpf01f036
> > > >> > > gfscogb0p2520093012qpf01f035
gfscogb0p2520093012qpf01f036_diff
> > > >> > >
> > > >> > > The error that I get with this is
> > > >> > >
> > > >> > > DEBUG 2: Since the "-field" command line option was not
used,
> > > parsing
> > > >> the
> > > >> > > command line arguments a list of files, each followed by
a
> > > >> configuration
> > > >> > > string.
> > > >> > > ERROR :
> > > >> > > ERROR : process_add_sub_derive_args() -> file name used
when
> > config
> > > >> > string
> > > >> > > expected (gfscogb0p2520093012qpf01f035). Did you forget
the
> > "-field"
> > > >> > > option?
> > > >> > > ERROR :
> > > >> > >
> > > >> > > It seems as though we need to add -field, which we
haven't
> needed
> > to
> > > >> do
> > > >> > > with other models. As far as I can tell, the command
should be:
> > > >> > >
> > > >> > > pcp_combine -v 4 -subtract gfscogb0p2520093012qpf01f036
> > > >> > > gfscogb0p2520093012qpf01f035
gfscogb0p2520093012qpf01f036_diff
> > > -field
> > > >> > > 'name="APCP"; level="A36";' -field 'name="APCP";
level="A35";'
> > > >> > >
> > > >> > > The error that I get with this is
> > > >> > >
> > > >> > > WARNING:
> > > >> > > WARNING: MetGrib2DataFile::data_plane() -> No matching
record
> > found
> > > >> for
> > > >> > > 'APCP/A36'
> > > >> > > WARNING:
> > > >> > > ERROR :
> > > >> > > ERROR : get_field() -> can't get data plane from file
> > > >> > > "gfscogb0p2520093012qpf01f035"
> > > >> > > ERROR :
> > > >> > >
> > > >> > > I also tried using (*,*) for the level, but that gives me
this
> > > error:
> > > >> > >
> > > >> > > ERROR :
> > > >> > > ERROR : VarInfo::set_level_info_grib() - failed to parse
level
> > > string
> > > >> > > '(*,*)'
> > > >> > > ERROR :
> > > >> > >
> > > >> > > At this point, I'm pretty sure that the error is that I
am not
> > > >> providing
> > > >> > > the correct level. We've tried multiple other values,
but none
> of
> > > >> them
> > > >> > > work. Is there a way for us to know what level value(s)
MET is
> > > >> > expecting?
> > > >> > > Any help would be appreciated.
> > > >> > > If you're on WCOSS, my test files and script are in
> > > >> > >
> > > >> > >
> > > >> > >
> > > >> >
> > > >>
> > >
> >
> /gpfs/dell3/mdl/mdlverif/noscrub/usr/John.L.Wagner/mdl-
verification/pcp_combine_test
> > > >> > >
> > > >> > > Thanks
> > > >> > > John
> > > >> > > --
> > > >> > > John Wagner
> > > >> > > Verification Task Lead
> > > >> > > NOAA/National Weather Service
> > > >> > > Meteorological Development Laboratory
> > > >> > > Digital Forecast Services Division
> > > >> > > SSMC2 Room 10106
> > > >> > > Silver Spring, MD 20910
> > > >> > > (301) 427-9471 (office)
> > > >> > > (908) 902-4155 (cell/text)
> > > >> > >
> > > >> > >
> > > >> >
> > > >> >
> > > >>
> > > >> --
> > > >> John Wagner
> > > >> Verification Task Lead
> > > >> NOAA/National Weather Service
> > > >> Meteorological Development Laboratory
> > > >> Digital Forecast Services Division
> > > >> SSMC2 Room 10106
> > > >> Silver Spring, MD 20910
> > > >> (301) 427-9471 (office)
> > > >> (908) 902-4155 (cell/text)
> > > >>
> > > >>
> > >
> > >
> >
> > --
> > John Wagner
> > Verification Task Lead
> > NOAA/National Weather Service
> > Meteorological Development Laboratory
> > Digital Forecast Services Division
> > SSMC2 Room 10106
> > Silver Spring, MD 20910
> > (301) 427-9471 (office)
> > (908) 902-4155 (cell/text)
> >
> >
>
>
--
John Wagner
Verification Task Lead
NOAA/National Weather Service
Meteorological Development Laboratory
Digital Forecast Services Division
SSMC2 Room 10106
Silver Spring, MD 20910
(301) 427-9471 (office)
(908) 902-4155 (cell/text)
------------------------------------------------
More information about the Met_help
mailing list