[Met_help] [rt.rap.ucar.edu #39109] History for pcp_combine
RAL HelpDesk {for Randy Bullock}
met_help at ucar.edu
Wed Apr 27 13:43:49 MDT 2011
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Hello Folks,
Alright, 2 requests in one day. What's the record?
Anyway, I am using the pcp_combine tool on the WRF APCP fields to compare with Stage IV data. As you know WRF continuously accumulates prepcipitation. Since I am integrating for one month at a time I need to use the -subtract feature of pcp_combine like so :
pcp_combine -subtract hrly/myj_03_2009-02-01_00_00_00.grb 0 myj_03_2009-02-01_01_00_00.grb 0 WRF.2009020101.nc
Then I run mode in conjunction with the reformatted Stage IV 1 hour data and get this:
mode WRF.2009020101.nc st4_03/ST4wrf2009020101.grb mode_config -outdir ./mode Forecast File: WRF.2009020101.nc
Observation File: st4_03/ST4wrf2009020101.grb
Match Config File: mode_config
Merge Config File: mode_config
ERROR: process_fcst_obs_files() -> accumulation time of 0 hours in the forecast file (WRF.2009020101.nc) does not match the 1 hour accumulation time requested in the config file.
How do I get pcp_combine to write it out as a 1 hour accumulation or vice versa, override this in mode?
Thanks again.
Take care,
Joe
Dr. Joseph L. Eastman
Senior Atmospheric Scientist
WindLogics Inc.
201 4th St NW
Grand Rapids, MN
55744
c - 410.279.9702
w - 651.556.4297
jeastman at windlogics.com<mailto:jeastman at windlogics.com>
________________________________
CONFIDENTIALITY NOTICE: This e-mail message is for the sole use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution of any kind is strictly prohibited. If you are not the intended recipient, please contact the sender via reply e-mail and destroy all copies of the original message. Thank you.
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #39109] pcp_combine
From: John Halley Gotway
Time: Fri Jul 09 14:22:30 2010
Joe,
OK, I think I understand what's going on here. I've listed below what
I'm guessing is the situation. Please correct me if I'm wrong about
any of these assumptions:
- You're running a very long WRF-ARW simulation and the time values
are exceeding 255.
- Because the time values are greater than 255, WPP is storing the
output as instantaneous times, rather than as accumulations (i.e. the
time range indicator value in the GRIB file is set to 10,
rather than 4 for an accumulation).
- The only way you can get PCP-Combine to run on these files is by
requesting the accumulation interval as 0 from the input file.
When you request 0 as the accumulation interval to be used from these
files, the NetCDF PCP-Combine output will be written as 0 hours of
accumulation as well. From PCP-Combine's perspective, we're
doing a subtraction of 0-hours precip minus 0-hours precip. That's
why the NetCDF output is listed as 0-hours of precip as well.
To get around this, try editing your MODE config file to look for 0-
hour accumulation, like this:
fcst_field = "APCP/A0";
It'll just be up to you to know that even through the MODE output
lists the field as 0-hours of accumulation, it really is 1-hour of
accumulation.
I suppose we could add some logic to PCP-Combine to detect this
situation and infer from the input data what the output accumulation
interval should be. However, when we switch over to using the
Unified PostProcessor in the next year of so (it will replace WPP), it
should be able to write out GRIB version 2 data. And GRIB2 won't have
these silly limitations in time values.
Please let me know if you continue to experience problems with this.
Thanks,
John Halley Gotway
met_help at ucar.edu
RAL HelpDesk {for Joe Eastman} wrote:
> Thu Jul 08 13:03:54 2010: Request 39109 was acted upon.
> Transaction: Ticket created by Joe.Eastman at windlogics.com
> Queue: met_help
> Subject: pcp_combine
> Owner: Nobody
> Requestors: Joe.Eastman at windlogics.com
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=39109 >
>
>
> Hello Folks,
>
> Alright, 2 requests in one day. What's the record?
>
> Anyway, I am using the pcp_combine tool on the WRF APCP fields to
compare with Stage IV data. As you know WRF continuously accumulates
prepcipitation. Since I am integrating for one month at a time I need
to use the -subtract feature of pcp_combine like so :
>
> pcp_combine -subtract hrly/myj_03_2009-02-01_00_00_00.grb 0
myj_03_2009-02-01_01_00_00.grb 0 WRF.2009020101.nc
>
> Then I run mode in conjunction with the reformatted Stage IV 1 hour
data and get this:
>
> mode WRF.2009020101.nc st4_03/ST4wrf2009020101.grb mode_config
-outdir ./mode Forecast File: WRF.2009020101.nc
> Observation File: st4_03/ST4wrf2009020101.grb
> Match Config File: mode_config
> Merge Config File: mode_config
>
>
> ERROR: process_fcst_obs_files() -> accumulation time of 0 hours in
the forecast file (WRF.2009020101.nc) does not match the 1 hour
accumulation time requested in the config file.
>
> How do I get pcp_combine to write it out as a 1 hour accumulation or
vice versa, override this in mode?
>
> Thanks again.
>
> Take care,
> Joe
>
> Dr. Joseph L. Eastman
> Senior Atmospheric Scientist
> WindLogics Inc.
> 201 4th St NW
> Grand Rapids, MN
> 55744
>
> c - 410.279.9702
> w - 651.556.4297
> jeastman at windlogics.com<mailto:jeastman at windlogics.com>
>
>
>
> ________________________________
> CONFIDENTIALITY NOTICE: This e-mail message is for the sole use of
the intended recipient(s) and may contain confidential and privileged
information. Any unauthorized review, use, disclosure or distribution
of any kind is strictly prohibited. If you are not the intended
recipient, please contact the sender via reply e-mail and destroy all
copies of the original message. Thank you.
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #39109] pcp_combine
From: Joe Eastman
Time: Fri Jul 09 15:30:07 2010
Hi John,
It worked fine outside of the strange error I get. This is
probably a misunderstanding on my part. I used the default settings
for the fuzzy engine.
Grib Record Index = 1
Initialization time =
1234220400
Valid time = 1234224000
Accumulation time = 3600
Grib
Record (min, max) = (0.00000, 2.27000)
***WARNING***: main() ->
forecast and observation accumulation times do not match 0 seconds !=
3600 seconds.
Forecast Field: APCP at SFC
Observation Field:
APCP_01 at SFC
Identifying objects in the forecast and observation
fields...
Computing contingency table statistics...
Identified: 6
forecast objects and 5 observation objects.
Performing merging (no
merging) in the forecast field.
Performing merging (no merging) in
the observation field.
Remaining: 6 forecast objects and 5
observation objects.
Performing matching between the forecast and
observation fields.
ERROR: convex_hull(Polyline &) -> can't find
next hull point
Take care,
Joe
Dr. Joseph L. Eastman
Senior
Atmospheric Scientist
WindLogics Inc.
201 4th St NW
Grand Rapids,
MN
55744
c – 410.279.9702
w – 651.556.4297
jeastman at windlogics.com
-----Original Message-----
From: RAL
HelpDesk {for John Halley Gotway} [mailto:met_help at ucar.edu]
Sent:
Friday, July 09, 2010 3:23 PM
To: Joe Eastman
Subject: Re:
[rt.rap.ucar.edu #39109] pcp_combine
Joe,
OK, I think I
understand what's going on here. I've listed below what I'm guessing
is the situation. Please correct me if I'm wrong about any of these
assumptions:
- You're running a very long WRF-ARW simulation and
the time values are exceeding 255.
- Because the time values are
greater than 255, WPP is storing the output as instantaneous times,
rather than as accumulations (i.e. the time range indicator value in
the GRIB file is set to 10,
rather than 4 for an accumulation).
-
The only way you can get PCP-Combine to run on these files is by
requesting the accumulation interval as 0 from the input file.
When
you request 0 as the accumulation interval to be used from these
files, the NetCDF PCP-Combine output will be written as 0 hours of
accumulation as well. From PCP-Combine's perspective, we're
doing a
subtraction of 0-hours precip minus 0-hours precip. That's why the
NetCDF output is listed as 0-hours of precip as well.
To get around
this, try editing your MODE config file to look for 0-hour
accumulation, like this:
fcst_field = "APCP/A0";
It'll just be
up to you to know that even through the MODE output lists the field as
0-hours of accumulation, it really is 1-hour of accumulation.
I
suppose we could add some logic to PCP-Combine to detect this
situation and infer from the input data what the output accumulation
interval should be. However, when we switch over to using the
Unified PostProcessor in the next year of so (it will replace WPP), it
should be able to write out GRIB version 2 data. And GRIB2 won't have
these silly limitations in time values.
Please let me know if you
continue to experience problems with this.
Thanks,
John Halley
Gotway
met_help at ucar.edu
RAL HelpDesk {for Joe Eastman} wrote:
>
Thu Jul 08 13:03:54 2010: Request 39109 was acted upon.
>
Transaction: Ticket created by Joe.Eastman at windlogics.com
>
Queue: met_help
> Subject: pcp_combine
> Owner: Nobody
> Requestors: Joe.Eastman at windlogics.com
> Status: new
>
Ticket <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=39109 >
>
>
> Hello Folks,
>
> Alright, 2 requests in one day. What's
the record?
>
> Anyway, I am using the pcp_combine tool on the WRF
APCP fields to compare with Stage IV data. As you know WRF
continuously accumulates prepcipitation. Since I am integrating for
one month at a time I need to use the -subtract feature of pcp_combine
like so :
>
> pcp_combine -subtract hrly/myj_03_2009-02-
01_00_00_00.grb 0 myj_03_2009-02-01_01_00_00.grb 0 WRF.2009020101.nc
>
> Then I run mode in conjunction with the reformatted Stage IV 1
hour data and get this:
>
> mode WRF.2009020101.nc
st4_03/ST4wrf2009020101.grb mode_config -outdir ./mode
Forecast File: WRF.2009020101.nc
> Observation File:
st4_03/ST4wrf2009020101.grb
> Match Config File: mode_config
> Merge
Config File: mode_config
>
>
> ERROR: process_fcst_obs_files() ->
accumulation time of 0 hours in the forecast file (WRF.2009020101.nc)
does not match the 1 hour accumulation time requested in the config
file.
>
> How do I get pcp_combine to write it out as a 1 hour
accumulation or vice versa, override this in mode?
>
> Thanks
again.
>
> Take care,
> Joe
>
> Dr. Joseph L. Eastman
> Senior
Atmospheric Scientist
> WindLogics Inc.
> 201 4th St NW
> Grand
Rapids, MN
> 55744
>
> c - 410.279.9702
> w - 651.556.4297
>
jeastman at windlogics.com<mailto:jeastman at windlogics.com>
>
>
>
>
________________________________
> CONFIDENTIALITY NOTICE: This e-
mail message is for the sole use of the intended recipient(s) and may
contain confidential and privileged information. Any unauthorized
review, use, disclosure or distribution of any kind is strictly
prohibited. If you are not the intended recipient, please contact the
sender via reply e-mail and destroy all copies of the original
message. Thank you.
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #39109] pcp_combine
From: John Halley Gotway
Time: Fri Jul 09 15:42:32 2010
Joe,
Hmmm. That's odd. Could you send me the forecast file, observation
file, and config file you're using? I'll run it through the debugger
and try to figure out what's going on. You can post those
files to our ftp site:
ftp ftp.rap.ucar.edu
username=anonymous
password="your email address"
cd incoming/irap/met_help/eastman_data
put "your files"
bye
Let me know when they're up there, and I'll take a look.
Thanks,
John
RAL HelpDesk {for Joe Eastman} wrote:
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=39109 >
>
> Hi John,
>
> It worked fine outside of the strange error I get. This is probably
a misunderstanding on my part. I used the default settings for the
fuzzy engine.
>
> Grib Record Index = 1
> Initialization time = 1234220400
> Valid time = 1234224000
> Accumulation time = 3600
> Grib Record (min, max) = (0.00000, 2.27000)
>
> ***WARNING***: main() -> forecast and observation accumulation times
do not match 0 seconds != 3600 seconds.
>
> Forecast Field: APCP at SFC
> Observation Field: APCP_01 at SFC
> Identifying objects in the forecast and observation fields...
> Computing contingency table statistics...
> Identified: 6 forecast objects and 5 observation objects.
> Performing merging (no merging) in the forecast field.
> Performing merging (no merging) in the observation field.
> Remaining: 6 forecast objects and 5 observation objects.
> Performing matching between the forecast and observation fields.
>
>
> ERROR: convex_hull(Polyline &) -> can't find next hull point
>
>
> Take care,
> Joe
>
> Dr. Joseph L. Eastman
> Senior Atmospheric Scientist
> WindLogics Inc.
> 201 4th St NW
> Grand Rapids, MN
> 55744
>
> c – 410.279.9702
> w – 651.556.4297
> jeastman at windlogics.com
>
>
>
> -----Original Message-----
> From: RAL HelpDesk {for John Halley Gotway}
[mailto:met_help at ucar.edu]
> Sent: Friday, July 09, 2010 3:23 PM
> To: Joe Eastman
> Subject: Re: [rt.rap.ucar.edu #39109] pcp_combine
>
> Joe,
>
> OK, I think I understand what's going on here. I've listed below
what I'm guessing is the situation. Please correct me if I'm wrong
about any of these assumptions:
> - You're running a very long WRF-ARW simulation and the time
values are exceeding 255.
> - Because the time values are greater than 255, WPP is storing
the output as instantaneous times, rather than as accumulations (i.e.
the time range indicator value in the GRIB file is set to 10,
> rather than 4 for an accumulation).
> - The only way you can get PCP-Combine to run on these files is
by requesting the accumulation interval as 0 from the input file.
>
> When you request 0 as the accumulation interval to be used from
these files, the NetCDF PCP-Combine output will be written as 0 hours
of accumulation as well. From PCP-Combine's perspective, we're
> doing a subtraction of 0-hours precip minus 0-hours precip. That's
why the NetCDF output is listed as 0-hours of precip as well.
>
> To get around this, try editing your MODE config file to look for 0-
hour accumulation, like this:
> fcst_field = "APCP/A0";
>
> It'll just be up to you to know that even through the MODE output
lists the field as 0-hours of accumulation, it really is 1-hour of
accumulation.
>
> I suppose we could add some logic to PCP-Combine to detect this
situation and infer from the input data what the output accumulation
interval should be. However, when we switch over to using the
> Unified PostProcessor in the next year of so (it will replace WPP),
it should be able to write out GRIB version 2 data. And GRIB2 won't
have these silly limitations in time values.
>
> Please let me know if you continue to experience problems with this.
>
> Thanks,
> John Halley Gotway
> met_help at ucar.edu
>
> RAL HelpDesk {for Joe Eastman} wrote:
>> Thu Jul 08 13:03:54 2010: Request 39109 was acted upon.
>> Transaction: Ticket created by Joe.Eastman at windlogics.com
>> Queue: met_help
>> Subject: pcp_combine
>> Owner: Nobody
>> Requestors: Joe.Eastman at windlogics.com
>> Status: new
>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=39109 >
>>
>>
>> Hello Folks,
>>
>> Alright, 2 requests in one day. What's the record?
>>
>> Anyway, I am using the pcp_combine tool on the WRF APCP fields to
compare with Stage IV data. As you know WRF continuously accumulates
prepcipitation. Since I am integrating for one month at a time I need
to use the -subtract feature of pcp_combine like so :
>>
>> pcp_combine -subtract hrly/myj_03_2009-02-01_00_00_00.grb 0
myj_03_2009-02-01_01_00_00.grb 0 WRF.2009020101.nc
>>
>> Then I run mode in conjunction with the reformatted Stage IV 1 hour
data and get this:
>>
>> mode WRF.2009020101.nc st4_03/ST4wrf2009020101.grb mode_config
-outdir ./mode Forecast File: WRF.2009020101.nc
>> Observation File: st4_03/ST4wrf2009020101.grb
>> Match Config File: mode_config
>> Merge Config File: mode_config
>>
>>
>> ERROR: process_fcst_obs_files() -> accumulation time of 0 hours in
the forecast file (WRF.2009020101.nc) does not match the 1 hour
accumulation time requested in the config file.
>>
>> How do I get pcp_combine to write it out as a 1 hour accumulation
or vice versa, override this in mode?
>>
>> Thanks again.
>>
>> Take care,
>> Joe
>>
>> Dr. Joseph L. Eastman
>> Senior Atmospheric Scientist
>> WindLogics Inc.
>> 201 4th St NW
>> Grand Rapids, MN
>> 55744
>>
>> c - 410.279.9702
>> w - 651.556.4297
>> jeastman at windlogics.com<mailto:jeastman at windlogics.com>
>>
>>
>>
>> ________________________________
>> CONFIDENTIALITY NOTICE: This e-mail message is for the sole use of
the intended recipient(s) and may contain confidential and privileged
information. Any unauthorized review, use, disclosure or distribution
of any kind is strictly prohibited. If you are not the intended
recipient, please contact the sender via reply e-mail and destroy all
copies of the original message. Thank you.
>
------------------------------------------------
Subject: pcp_combine
From: Joe Eastman
Time: Fri Jul 09 15:50:47 2010
Hi John,
Thanks, I might have messed a few settings up just to get
it to work but here you go. Thanks for the help.
Take care,
Joe
Dr. Joseph L. Eastman
Senior Atmospheric Scientist
WindLogics Inc.
201 4th St NW
Grand Rapids, MN
55744
c – 410.279.9702
w –
651.556.4297
jeastman at windlogics.com
-----Original
Message-----
From: RAL HelpDesk {for John Halley Gotway}
[mailto:met_help at ucar.edu]
Sent: Friday, July 09, 2010 4:43 PM
To:
Joe Eastman
Subject: Re: [rt.rap.ucar.edu #39109] pcp_combine
Joe,
Hmmm. That's odd. Could you send me the forecast file, observation
file, and config file you're using? I'll run it through the debugger
and try to figure out what's going on. You can post those
files to
our ftp site:
ftp ftp.rap.ucar.edu
username=anonymous
password="your email address"
cd
incoming/irap/met_help/eastman_data
put "your files"
bye
Let me know when they're up there, and I'll take a look.
Thanks,
John
RAL HelpDesk {for Joe Eastman} wrote:
> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=39109 >
>
> Hi
John,
>
> It worked fine outside of the strange error I get. This
is probably a misunderstanding on my part. I used the default settings
for the fuzzy engine.
>
> Grib Record Index = 1
> Initialization
time = 1234220400
> Valid time = 1234224000
> Accumulation time =
3600
> Grib Record (min, max) = (0.00000, 2.27000)
>
>
***WARNING***: main() -> forecast and observation accumulation times
do not match 0 seconds != 3600 seconds.
>
> Forecast Field: APCP at
SFC
> Observation Field: APCP_01 at SFC
> Identifying objects in the
forecast and observation fields...
> Computing contingency table
statistics...
> Identified: 6 forecast objects and 5 observation
objects.
> Performing merging (no merging) in the forecast field.
>
Performing merging (no merging) in the observation field.
>
Remaining: 6 forecast objects and 5 observation objects.
> Performing
matching between the forecast and observation fields.
>
>
>
ERROR: convex_hull(Polyline &) -> can't find next hull point
>
>
> Take care,
> Joe
>
> Dr. Joseph L. Eastman
> Senior Atmospheric
Scientist
> WindLogics Inc.
> 201 4th St NW
> Grand Rapids, MN
>
55744
>
> c – 410.279.9702
> w – 651.556.4297
>
jeastman at windlogics.com
>
>
>
> -----Original Message-----
>
From: RAL HelpDesk {for John Halley Gotway} [mailto:met_help at ucar.edu]
> Sent: Friday, July 09, 2010 3:23 PM
> To: Joe Eastman
> Subject:
Re: [rt.rap.ucar.edu #39109] pcp_combine
>
> Joe,
>
> OK, I
think I understand what's going on here. I've listed below what I'm
guessing is the situation. Please correct me if I'm wrong about any
of these assumptions:
> - You're running a very long WRF-ARW
simulation and the time values are exceeding 255.
> - Because the
time values are greater than 255, WPP is storing the output as
instantaneous times, rather than as accumulations (i.e. the time range
indicator value in the GRIB file is set to 10,
> rather than 4 for an
accumulation).
> - The only way you can get PCP-Combine to run on
these files is by requesting the accumulation interval as 0 from the
input file.
>
> When you request 0 as the accumulation interval to
be used from these files, the NetCDF PCP-Combine output will be
written as 0 hours of accumulation as well. From PCP-Combine's
perspective, we're
> doing a subtraction of 0-hours precip minus 0-
hours precip. That's why the NetCDF output is listed as 0-hours of
precip as well.
>
> To get around this, try editing your MODE
config file to look for 0-hour accumulation, like this:
>
fcst_field = "APCP/A0";
>
> It'll just be up to you to know that
even through the MODE output lists the field as 0-hours of
accumulation, it really is 1-hour of accumulation.
>
> I suppose we
could add some logic to PCP-Combine to detect this situation and infer
from the input data what the output accumulation interval should be.
However, when we switch over to using the
> Unified PostProcessor in
the next year of so (it will replace WPP), it should be able to write
out GRIB version 2 data. And GRIB2 won't have these silly limitations
in time values.
>
> Please let me know if you continue to
experience problems with this.
>
> Thanks,
> John Halley Gotway
>
met_help at ucar.edu
>
> RAL HelpDesk {for Joe Eastman} wrote:
>> Thu
Jul 08 13:03:54 2010: Request 39109 was acted upon.
>> Transaction:
Ticket created by Joe.Eastman at windlogics.com
>> Queue:
met_help
>> Subject: pcp_combine
>> Owner: Nobody
>>
Requestors: Joe.Eastman at windlogics.com
>> Status: new
>>
Ticket <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=39109 >
>>
>>
>> Hello Folks,
>>
>> Alright, 2 requests in one day. What's
the record?
>>
>> Anyway, I am using the pcp_combine tool on the WRF
APCP fields to compare with Stage IV data. As you know WRF
continuously accumulates prepcipitation. Since I am integrating for
one month at a time I need to use the -subtract feature of pcp_combine
like so :
>>
>> pcp_combine -subtract hrly/myj_03_2009-02-
01_00_00_00.grb 0 myj_03_2009-02-01_01_00_00.grb 0 WRF.2009020101.nc
>>
>> Then I run mode in conjunction with the reformatted Stage IV 1
hour data and get this:
>>
>> mode WRF.2009020101.nc
st4_03/ST4wrf2009020101.grb mode_config -outdir ./mode
Forecast File: WRF.2009020101.nc
>> Observation File:
st4_03/ST4wrf2009020101.grb
>> Match Config File: mode_config
>>
Merge Config File: mode_config
>>
>>
>> ERROR:
process_fcst_obs_files() -> accumulation time of 0 hours in the
forecast file (WRF.2009020101.nc) does not match the 1 hour
accumulation time requested in the config file.
>>
>> How do I get
pcp_combine to write it out as a 1 hour accumulation or vice versa,
override this in mode?
>>
>> Thanks again.
>>
>> Take care,
>>
Joe
>>
>> Dr. Joseph L. Eastman
>> Senior Atmospheric Scientist
>>
WindLogics Inc.
>> 201 4th St NW
>> Grand Rapids, MN
>> 55744
>>
>> c - 410.279.9702
>> w - 651.556.4297
>>
jeastman at windlogics.com<mailto:jeastman at windlogics.com>
>>
>>
>>
>> ________________________________
>> CONFIDENTIALITY NOTICE: This
e-mail message is for the sole use of the intended recipient(s) and
may contain confidential and privileged information. Any unauthorized
review, use, disclosure or distribution of any kind is strictly
prohibited. If you are not the intended recipient, please contact the
sender via reply e-mail and destroy all copies of the original
message. Thank you.
>
------------------------------------------------
Subject: pcp_combine
From: Joe Eastman
Time: Fri Jul 09 15:56:51 2010
Hi John,
I did not see the ftp request. I have put them on the
rap.ucar.edu
Take care,
Joe
Dr. Joseph L. Eastman
Senior
Atmospheric Scientist
WindLogics Inc.
201 4th St NW
Grand Rapids,
MN
55744
c – 410.279.9702
w – 651.556.4297
jeastman at windlogics.com
-----Original Message-----
From: RAL
HelpDesk {for John Halley Gotway} [mailto:met_help at ucar.edu]
Sent:
Friday, July 09, 2010 4:43 PM
To: Joe Eastman
Subject: Re:
[rt.rap.ucar.edu #39109] pcp_combine
Joe,
Hmmm. That's odd.
Could you send me the forecast file, observation file, and config file
you're using? I'll run it through the debugger and try to figure out
what's going on. You can post those
files to our ftp site:
ftp
ftp.rap.ucar.edu
username=anonymous
password="your email
address"
cd incoming/irap/met_help/eastman_data
put "your
files"
bye
Let me know when they're up there, and I'll take a
look.
Thanks,
John
RAL HelpDesk {for Joe Eastman} wrote:
>
<URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=39109 >
>
>
Hi John,
>
> It worked fine outside of the strange error I get.
This is probably a misunderstanding on my part. I used the default
settings for the fuzzy engine.
>
> Grib Record Index = 1
>
Initialization time = 1234220400
> Valid time = 1234224000
>
Accumulation time = 3600
> Grib Record (min, max) = (0.00000,
2.27000)
>
> ***WARNING***: main() -> forecast and observation
accumulation times do not match 0 seconds != 3600 seconds.
>
>
Forecast Field: APCP at SFC
> Observation Field: APCP_01 at SFC
>
Identifying objects in the forecast and observation fields...
>
Computing contingency table statistics...
> Identified: 6 forecast
objects and 5 observation objects.
> Performing merging (no merging)
in the forecast field.
> Performing merging (no merging) in the
observation field.
> Remaining: 6 forecast objects and 5 observation
objects.
> Performing matching between the forecast and observation
fields.
>
>
> ERROR: convex_hull(Polyline &) -> can't find next
hull point
>
>
> Take care,
> Joe
>
> Dr. Joseph L. Eastman
> Senior Atmospheric Scientist
> WindLogics Inc.
> 201 4th St NW
>
Grand Rapids, MN
> 55744
>
> c – 410.279.9702
> w – 651.556.4297
> jeastman at windlogics.com
>
>
>
> -----Original Message-----
>
From: RAL HelpDesk {for John Halley Gotway} [mailto:met_help at ucar.edu]
> Sent: Friday, July 09, 2010 3:23 PM
> To: Joe Eastman
> Subject:
Re: [rt.rap.ucar.edu #39109] pcp_combine
>
> Joe,
>
> OK, I
think I understand what's going on here. I've listed below what I'm
guessing is the situation. Please correct me if I'm wrong about any
of these assumptions:
> - You're running a very long WRF-ARW
simulation and the time values are exceeding 255.
> - Because the
time values are greater than 255, WPP is storing the output as
instantaneous times, rather than as accumulations (i.e. the time range
indicator value in the GRIB file is set to 10,
> rather than 4 for an
accumulation).
> - The only way you can get PCP-Combine to run on
these files is by requesting the accumulation interval as 0 from the
input file.
>
> When you request 0 as the accumulation interval to
be used from these files, the NetCDF PCP-Combine output will be
written as 0 hours of accumulation as well. From PCP-Combine's
perspective, we're
> doing a subtraction of 0-hours precip minus 0-
hours precip. That's why the NetCDF output is listed as 0-hours of
precip as well.
>
> To get around this, try editing your MODE
config file to look for 0-hour accumulation, like this:
>
fcst_field = "APCP/A0";
>
> It'll just be up to you to know that
even through the MODE output lists the field as 0-hours of
accumulation, it really is 1-hour of accumulation.
>
> I suppose we
could add some logic to PCP-Combine to detect this situation and infer
from the input data what the output accumulation interval should be.
However, when we switch over to using the
> Unified PostProcessor in
the next year of so (it will replace WPP), it should be able to write
out GRIB version 2 data. And GRIB2 won't have these silly limitations
in time values.
>
> Please let me know if you continue to
experience problems with this.
>
> Thanks,
> John Halley Gotway
>
met_help at ucar.edu
>
> RAL HelpDesk {for Joe Eastman} wrote:
>> Thu
Jul 08 13:03:54 2010: Request 39109 was acted upon.
>> Transaction:
Ticket created by Joe.Eastman at windlogics.com
>> Queue:
met_help
>> Subject: pcp_combine
>> Owner: Nobody
>>
Requestors: Joe.Eastman at windlogics.com
>> Status: new
>>
Ticket <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=39109 >
>>
>>
>> Hello Folks,
>>
>> Alright, 2 requests in one day. What's
the record?
>>
>> Anyway, I am using the pcp_combine tool on the WRF
APCP fields to compare with Stage IV data. As you know WRF
continuously accumulates prepcipitation. Since I am integrating for
one month at a time I need to use the -subtract feature of pcp_combine
like so :
>>
>> pcp_combine -subtract hrly/myj_03_2009-02-
01_00_00_00.grb 0 myj_03_2009-02-01_01_00_00.grb 0 WRF.2009020101.nc
>>
>> Then I run mode in conjunction with the reformatted Stage IV 1
hour data and get this:
>>
>> mode WRF.2009020101.nc
st4_03/ST4wrf2009020101.grb mode_config -outdir ./mode
Forecast File: WRF.2009020101.nc
>> Observation File:
st4_03/ST4wrf2009020101.grb
>> Match Config File: mode_config
>>
Merge Config File: mode_config
>>
>>
>> ERROR:
process_fcst_obs_files() -> accumulation time of 0 hours in the
forecast file (WRF.2009020101.nc) does not match the 1 hour
accumulation time requested in the config file.
>>
>> How do I get
pcp_combine to write it out as a 1 hour accumulation or vice versa,
override this in mode?
>>
>> Thanks again.
>>
>> Take care,
>>
Joe
>>
>> Dr. Joseph L. Eastman
>> Senior Atmospheric Scientist
>>
WindLogics Inc.
>> 201 4th St NW
>> Grand Rapids, MN
>> 55744
>>
>> c - 410.279.9702
>> w - 651.556.4297
>>
jeastman at windlogics.com<mailto:jeastman at windlogics.com>
>>
>>
>>
>> ________________________________
>> CONFIDENTIALITY NOTICE: This
e-mail message is for the sole use of the intended recipient(s) and
may contain confidential and privileged information. Any unauthorized
review, use, disclosure or distribution of any kind is strictly
prohibited. If you are not the intended recipient, please contact the
sender via reply e-mail and destroy all copies of the original
message. Thank you.
>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #39109] pcp_combine
From: John Halley Gotway
Time: Fri Jul 09 16:14:56 2010
Joe,
I'm not able to reproduce the error you're seeing when I run with the
data you sent.
Could you try editing your MODE config file to use a slightly
different threshold? Perhaps try:
fcst_conv_thresh = "gt0.75";
obs_conv_thresh = "gt0.75";
I'm curious to see if the error still shows up, or is it really
dependent on the shape of the object.
I'm guessing it may be related to line 1046 of the file
METv2.0/lib/vx_wrfdata/vx_wrfdata.cc:
if ( angle > 359.9999 ) { angle = 0.0; }
Perhaps there's a difference in the precision on our machines. We
could also try playing with that "359.9999" - probably make it have
less precision, like 359.99, and see if that fixes it.
Please let me know how it goes. Also, what compiler/platform are you
using?
Thanks,
John
RAL HelpDesk {for Joe Eastman} wrote:
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=39109 >
>
> Hi John,
>
> I did not see the ftp request. I have put them on the rap.ucar.edu
>
> Take care,
> Joe
>
> Dr. Joseph L. Eastman
> Senior Atmospheric Scientist
> WindLogics Inc.
> 201 4th St NW
> Grand Rapids, MN
> 55744
>
> c – 410.279.9702
> w – 651.556.4297
> jeastman at windlogics.com
>
>
>
> -----Original Message-----
> From: RAL HelpDesk {for John Halley Gotway}
[mailto:met_help at ucar.edu]
> Sent: Friday, July 09, 2010 4:43 PM
> To: Joe Eastman
> Subject: Re: [rt.rap.ucar.edu #39109] pcp_combine
>
> Joe,
>
> Hmmm. That's odd. Could you send me the forecast file, observation
file, and config file you're using? I'll run it through the debugger
and try to figure out what's going on. You can post those
> files to our ftp site:
>
> ftp ftp.rap.ucar.edu
> username=anonymous
> password="your email address"
> cd incoming/irap/met_help/eastman_data
> put "your files"
> bye
>
> Let me know when they're up there, and I'll take a look.
>
> Thanks,
> John
>
> RAL HelpDesk {for Joe Eastman} wrote:
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=39109 >
>>
>> Hi John,
>>
>> It worked fine outside of the strange error I get. This is probably
a misunderstanding on my part. I used the default settings for the
fuzzy engine.
>>
>> Grib Record Index = 1
>> Initialization time = 1234220400
>> Valid time = 1234224000
>> Accumulation time = 3600
>> Grib Record (min, max) = (0.00000, 2.27000)
>>
>> ***WARNING***: main() -> forecast and observation accumulation
times do not match 0 seconds != 3600 seconds.
>>
>> Forecast Field: APCP at SFC
>> Observation Field: APCP_01 at SFC
>> Identifying objects in the forecast and observation fields...
>> Computing contingency table statistics...
>> Identified: 6 forecast objects and 5 observation objects.
>> Performing merging (no merging) in the forecast field.
>> Performing merging (no merging) in the observation field.
>> Remaining: 6 forecast objects and 5 observation objects.
>> Performing matching between the forecast and observation fields.
>>
>>
>> ERROR: convex_hull(Polyline &) -> can't find next hull point
>>
>>
>> Take care,
>> Joe
>>
>> Dr. Joseph L. Eastman
>> Senior Atmospheric Scientist
>> WindLogics Inc.
>> 201 4th St NW
>> Grand Rapids, MN
>> 55744
>>
>> c – 410.279.9702
>> w – 651.556.4297
>> jeastman at windlogics.com
>>
>>
>>
>> -----Original Message-----
>> From: RAL HelpDesk {for John Halley Gotway}
[mailto:met_help at ucar.edu]
>> Sent: Friday, July 09, 2010 3:23 PM
>> To: Joe Eastman
>> Subject: Re: [rt.rap.ucar.edu #39109] pcp_combine
>>
>> Joe,
>>
>> OK, I think I understand what's going on here. I've listed below
what I'm guessing is the situation. Please correct me if I'm wrong
about any of these assumptions:
>> - You're running a very long WRF-ARW simulation and the time
values are exceeding 255.
>> - Because the time values are greater than 255, WPP is storing
the output as instantaneous times, rather than as accumulations (i.e.
the time range indicator value in the GRIB file is set to 10,
>> rather than 4 for an accumulation).
>> - The only way you can get PCP-Combine to run on these files is
by requesting the accumulation interval as 0 from the input file.
>>
>> When you request 0 as the accumulation interval to be used from
these files, the NetCDF PCP-Combine output will be written as 0 hours
of accumulation as well. From PCP-Combine's perspective, we're
>> doing a subtraction of 0-hours precip minus 0-hours precip. That's
why the NetCDF output is listed as 0-hours of precip as well.
>>
>> To get around this, try editing your MODE config file to look for
0-hour accumulation, like this:
>> fcst_field = "APCP/A0";
>>
>> It'll just be up to you to know that even through the MODE output
lists the field as 0-hours of accumulation, it really is 1-hour of
accumulation.
>>
>> I suppose we could add some logic to PCP-Combine to detect this
situation and infer from the input data what the output accumulation
interval should be. However, when we switch over to using the
>> Unified PostProcessor in the next year of so (it will replace WPP),
it should be able to write out GRIB version 2 data. And GRIB2 won't
have these silly limitations in time values.
>>
>> Please let me know if you continue to experience problems with
this.
>>
>> Thanks,
>> John Halley Gotway
>> met_help at ucar.edu
>>
>> RAL HelpDesk {for Joe Eastman} wrote:
>>> Thu Jul 08 13:03:54 2010: Request 39109 was acted upon.
>>> Transaction: Ticket created by Joe.Eastman at windlogics.com
>>> Queue: met_help
>>> Subject: pcp_combine
>>> Owner: Nobody
>>> Requestors: Joe.Eastman at windlogics.com
>>> Status: new
>>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=39109 >
>>>
>>>
>>> Hello Folks,
>>>
>>> Alright, 2 requests in one day. What's the record?
>>>
>>> Anyway, I am using the pcp_combine tool on the WRF APCP fields to
compare with Stage IV data. As you know WRF continuously accumulates
prepcipitation. Since I am integrating for one month at a time I need
to use the -subtract feature of pcp_combine like so :
>>>
>>> pcp_combine -subtract hrly/myj_03_2009-02-01_00_00_00.grb 0
myj_03_2009-02-01_01_00_00.grb 0 WRF.2009020101.nc
>>>
>>> Then I run mode in conjunction with the reformatted Stage IV 1
hour data and get this:
>>>
>>> mode WRF.2009020101.nc st4_03/ST4wrf2009020101.grb mode_config
-outdir ./mode Forecast File: WRF.2009020101.nc
>>> Observation File: st4_03/ST4wrf2009020101.grb
>>> Match Config File: mode_config
>>> Merge Config File: mode_config
>>>
>>>
>>> ERROR: process_fcst_obs_files() -> accumulation time of 0 hours in
the forecast file (WRF.2009020101.nc) does not match the 1 hour
accumulation time requested in the config file.
>>>
>>> How do I get pcp_combine to write it out as a 1 hour accumulation
or vice versa, override this in mode?
>>>
>>> Thanks again.
>>>
>>> Take care,
>>> Joe
>>>
>>> Dr. Joseph L. Eastman
>>> Senior Atmospheric Scientist
>>> WindLogics Inc.
>>> 201 4th St NW
>>> Grand Rapids, MN
>>> 55744
>>>
>>> c - 410.279.9702
>>> w - 651.556.4297
>>> jeastman at windlogics.com<mailto:jeastman at windlogics.com>
>>>
>>>
>>>
>>> ________________________________
>>> CONFIDENTIALITY NOTICE: This e-mail message is for the sole use of
the intended recipient(s) and may contain confidential and privileged
information. Any unauthorized review, use, disclosure or distribution
of any kind is strictly prohibited. If you are not the intended
recipient, please contact the sender via reply e-mail and destroy all
copies of the original message. Thank you.
>
>
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #39109] pcp_combine
From: Joe Eastman
Time: Mon Jul 12 13:56:35 2010
Hi John,
I changed to slightly different values as you suggested
and get the same error. I will try the vx_wrfdata.cc now. Here is the
command line I have been using:
$mode WRF.2009021000.nc
st4_03/ST4wrf2009021000.grb mode_config -outdir ./mode -v 10
Grib
Record Index = 1
Initialization time = 1234220400
Valid time =
1234224000
Accumulation time = 3600
Grib Record (min, max) =
(0.00000, 2.27000)
***WARNING***: main() -> forecast and
observation accumulation times do not match 0 seconds != 3600 seconds.
Forecast Field: APCP at SFC
Observation Field: APCP_01 at SFC
Identifying objects in the forecast and observation fields...
Computing contingency table statistics...
Identified: 6 forecast
objects and 2 observation objects.
Performing merging (no merging) in
the forecast field.
Performing merging (no merging) in the
observation field.
Remaining: 6 forecast objects and 2 observation
objects.
Performing matching between the forecast and observation
fields.
ERROR: convex_hull(Polyline &) -> can't find next hull
point
I just wanted to make sure I gave you the correct files.
Take care,
Joe
Dr. Joseph L. Eastman
Senior Atmospheric Scientist
WindLogics Inc.
201 4th St NW
Grand Rapids, MN
55744
c –
410.279.9702
w – 651.556.4297
jeastman at windlogics.com
-----Original Message-----
From: RAL HelpDesk {for John Halley
Gotway} [mailto:met_help at ucar.edu]
Sent: Friday, July 09, 2010 5:15
PM
To: Joe Eastman
Subject: Re: [rt.rap.ucar.edu #39109] pcp_combine
Joe,
I'm not able to reproduce the error you're seeing when I run
with the data you sent.
Could you try editing your MODE config file
to use a slightly different threshold? Perhaps try:
fcst_conv_thresh = "gt0.75";
obs_conv_thresh = "gt0.75";
I'm
curious to see if the error still shows up, or is it really dependent
on the shape of the object.
I'm guessing it may be related to line
1046 of the file METv2.0/lib/vx_wrfdata/vx_wrfdata.cc:
if ( angle
> 359.9999 ) { angle = 0.0; }
Perhaps there's a difference in the
precision on our machines. We could also try playing with that
"359.9999" - probably make it have less precision, like 359.99, and
see if that fixes it.
Please let me know how it goes. Also, what
compiler/platform are you using?
Thanks,
John
RAL HelpDesk {for
Joe Eastman} wrote:
> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=39109 >
>
> Hi
John,
>
> I did not see the ftp request. I have put them on the
rap.ucar.edu
>
> Take care,
> Joe
>
> Dr. Joseph L. Eastman
>
Senior Atmospheric Scientist
> WindLogics Inc.
> 201 4th St NW
>
Grand Rapids, MN
> 55744
>
> c – 410.279.9702
> w – 651.556.4297
> jeastman at windlogics.com
>
>
>
> -----Original Message-----
>
From: RAL HelpDesk {for John Halley Gotway} [mailto:met_help at ucar.edu]
> Sent: Friday, July 09, 2010 4:43 PM
> To: Joe Eastman
> Subject:
Re: [rt.rap.ucar.edu #39109] pcp_combine
>
> Joe,
>
> Hmmm.
That's odd. Could you send me the forecast file, observation file,
and config file you're using? I'll run it through the debugger and
try to figure out what's going on. You can post those
> files to our
ftp site:
>
> ftp ftp.rap.ucar.edu
> username=anonymous
>
password="your email address"
> cd
incoming/irap/met_help/eastman_data
> put "your files"
> bye
>
> Let me know when they're up there, and I'll take a look.
>
>
Thanks,
> John
>
> RAL HelpDesk {for Joe Eastman} wrote:
>> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=39109 >
>>
>> Hi
John,
>>
>> It worked fine outside of the strange error I get. This
is probably a misunderstanding on my part. I used the default settings
for the fuzzy engine.
>>
>> Grib Record Index = 1
>> Initialization
time = 1234220400
>> Valid time = 1234224000
>> Accumulation time =
3600
>> Grib Record (min, max) = (0.00000, 2.27000)
>>
>>
***WARNING***: main() -> forecast and observation accumulation times
do not match 0 seconds != 3600 seconds.
>>
>> Forecast Field: APCP
at SFC
>> Observation Field: APCP_01 at SFC
>> Identifying objects
in the forecast and observation fields...
>> Computing contingency
table statistics...
>> Identified: 6 forecast objects and 5
observation objects.
>> Performing merging (no merging) in the
forecast field.
>> Performing merging (no merging) in the observation
field.
>> Remaining: 6 forecast objects and 5 observation objects.
>> Performing matching between the forecast and observation fields.
>>
>>
>> ERROR: convex_hull(Polyline &) -> can't find next hull
point
>>
>>
>> Take care,
>> Joe
>>
>> Dr. Joseph L. Eastman
>>
Senior Atmospheric Scientist
>> WindLogics Inc.
>> 201 4th St NW
>> Grand Rapids, MN
>> 55744
>>
>> c – 410.279.9702
>> w –
651.556.4297
>> jeastman at windlogics.com
>>
>>
>>
>> -----Original
Message-----
>> From: RAL HelpDesk {for John Halley Gotway}
[mailto:met_help at ucar.edu]
>> Sent: Friday, July 09, 2010 3:23 PM
>> To: Joe Eastman
>> Subject: Re: [rt.rap.ucar.edu #39109]
pcp_combine
>>
>> Joe,
>>
>> OK, I think I understand what's going
on here. I've listed below what I'm guessing is the situation.
Please correct me if I'm wrong about any of these assumptions:
>>
- You're running a very long WRF-ARW simulation and the time values
are exceeding 255.
>> - Because the time values are greater than
255, WPP is storing the output as instantaneous times, rather than as
accumulations (i.e. the time range indicator value in the GRIB file is
set to 10,
>> rather than 4 for an accumulation).
>> - The only
way you can get PCP-Combine to run on these files is by requesting the
accumulation interval as 0 from the input file.
>>
>> When you
request 0 as the accumulation interval to be used from these files,
the NetCDF PCP-Combine output will be written as 0 hours of
accumulation as well. From PCP-Combine's perspective, we're
>> doing
a subtraction of 0-hours precip minus 0-hours precip. That's why the
NetCDF output is listed as 0-hours of precip as well.
>>
>> To get
around this, try editing your MODE config file to look for 0-hour
accumulation, like this:
>> fcst_field = "APCP/A0";
>>
>> It'll
just be up to you to know that even through the MODE output lists the
field as 0-hours of accumulation, it really is 1-hour of accumulation.
>>
>> I suppose we could add some logic to PCP-Combine to detect this
situation and infer from the input data what the output accumulation
interval should be. However, when we switch over to using the
>>
Unified PostProcessor in the next year of so (it will replace WPP), it
should be able to write out GRIB version 2 data. And GRIB2 won't have
these silly limitations in time values.
>>
>> Please let me know if
you continue to experience problems with this.
>>
>> Thanks,
>>
John Halley Gotway
>> met_help at ucar.edu
>>
>> RAL HelpDesk {for Joe
Eastman} wrote:
>>> Thu Jul 08 13:03:54 2010: Request 39109 was acted
upon.
>>> Transaction: Ticket created by Joe.Eastman at windlogics.com
>>> Queue: met_help
>>> Subject: pcp_combine
>>>
Owner: Nobody
>>> Requestors: Joe.Eastman at windlogics.com
>>>
Status: new
>>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=39109 >
>>>
>>>
>>> Hello Folks,
>>>
>>> Alright, 2 requests in one day. What's the
record?
>>>
>>> Anyway, I am using the pcp_combine tool on the WRF
APCP fields to compare with Stage IV data. As you know WRF
continuously accumulates prepcipitation. Since I am integrating for
one month at a time I need to use the -subtract feature of pcp_combine
like so :
>>>
>>> pcp_combine -subtract hrly/myj_03_2009-02-
01_00_00_00.grb 0 myj_03_2009-02-01_01_00_00.grb 0 WRF.2009020101.nc
>>>
>>> Then I run mode in conjunction with the reformatted Stage IV
1 hour data and get this:
>>>
>>> mode WRF.2009020101.nc
st4_03/ST4wrf2009020101.grb mode_config -outdir ./mode
Forecast File: WRF.2009020101.nc
>>> Observation File:
st4_03/ST4wrf2009020101.grb
>>> Match Config File: mode_config
>>>
Merge Config File: mode_config
>>>
>>>
>>> ERROR:
process_fcst_obs_files() -> accumulation time of 0 hours in the
forecast file (WRF.2009020101.nc) does not match the 1 hour
accumulation time requested in the config file.
>>>
>>> How do I get
pcp_combine to write it out as a 1 hour accumulation or vice versa,
override this in mode?
>>>
>>> Thanks again.
>>>
>>> Take care,
>>> Joe
>>>
>>> Dr. Joseph L. Eastman
>>> Senior Atmospheric
Scientist
>>> WindLogics Inc.
>>> 201 4th St NW
>>> Grand Rapids,
MN
>>> 55744
>>>
>>> c - 410.279.9702
>>> w - 651.556.4297
>>>
jeastman at windlogics.com<mailto:jeastman at windlogics.com>
>>>
>>>
>>>
>>> ________________________________
>>> CONFIDENTIALITY NOTICE: This
e-mail message is for the sole use of the intended recipient(s) and
may contain confidential and privileged information. Any unauthorized
review, use, disclosure or distribution of any kind is strictly
prohibited. If you are not the intended recipient, please contact the
sender via reply e-mail and destroy all copies of the original
message. Thank you.
>
>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #39109] pcp_combine
From: John Halley Gotway
Time: Mon Jul 12 14:30:30 2010
Joe,
I reran MODE with your exact command line and data but am still not
able to reproduce your error. I'm not hopeful that modifying the
precision on that line of code will have any effect. I tried
playing around with that value to see if I could reproduce your error,
but I was unable to. So now I doubt that that's the culprit.
I'm transferring ownership of this ticket over to Randy Bullock. He's
the author of this piece of code and may have some ideas about what's
going on.
Thanks,
John
RAL HelpDesk {for John Halley Gotway} wrote:
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=39109 >
>
> Joe,
>
> I'm not able to reproduce the error you're seeing when I run with
the data you sent.
>
> Could you try editing your MODE config file to use a slightly
different threshold? Perhaps try:
> fcst_conv_thresh = "gt0.75";
> obs_conv_thresh = "gt0.75";
> I'm curious to see if the error still shows up, or is it really
dependent on the shape of the object.
>
> I'm guessing it may be related to line 1046 of the file
METv2.0/lib/vx_wrfdata/vx_wrfdata.cc:
> if ( angle > 359.9999 ) { angle = 0.0; }
> Perhaps there's a difference in the precision on our machines. We
could also try playing with that "359.9999" - probably make it have
less precision, like 359.99, and see if that fixes it.
>
> Please let me know how it goes. Also, what compiler/platform are
you using?
>
> Thanks,
> John
>
> RAL HelpDesk {for Joe Eastman} wrote:
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=39109 >
>>
>> Hi John,
>>
>> I did not see the ftp request. I have put them on the rap.ucar.edu
>>
>> Take care,
>> Joe
>>
>> Dr. Joseph L. Eastman
>> Senior Atmospheric Scientist
>> WindLogics Inc.
>> 201 4th St NW
>> Grand Rapids, MN
>> 55744
>>
>> c – 410.279.9702
>> w – 651.556.4297
>> jeastman at windlogics.com
>>
>>
>>
>> -----Original Message-----
>> From: RAL HelpDesk {for John Halley Gotway}
[mailto:met_help at ucar.edu]
>> Sent: Friday, July 09, 2010 4:43 PM
>> To: Joe Eastman
>> Subject: Re: [rt.rap.ucar.edu #39109] pcp_combine
>>
>> Joe,
>>
>> Hmmm. That's odd. Could you send me the forecast file,
observation file, and config file you're using? I'll run it through
the debugger and try to figure out what's going on. You can post
those
>> files to our ftp site:
>>
>> ftp ftp.rap.ucar.edu
>> username=anonymous
>> password="your email address"
>> cd incoming/irap/met_help/eastman_data
>> put "your files"
>> bye
>>
>> Let me know when they're up there, and I'll take a look.
>>
>> Thanks,
>> John
>>
>> RAL HelpDesk {for Joe Eastman} wrote:
>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=39109 >
>>>
>>> Hi John,
>>>
>>> It worked fine outside of the strange error I get. This is
probably a misunderstanding on my part. I used the default settings
for the fuzzy engine.
>>>
>>> Grib Record Index = 1
>>> Initialization time = 1234220400
>>> Valid time = 1234224000
>>> Accumulation time = 3600
>>> Grib Record (min, max) = (0.00000, 2.27000)
>>>
>>> ***WARNING***: main() -> forecast and observation accumulation
times do not match 0 seconds != 3600 seconds.
>>>
>>> Forecast Field: APCP at SFC
>>> Observation Field: APCP_01 at SFC
>>> Identifying objects in the forecast and observation fields...
>>> Computing contingency table statistics...
>>> Identified: 6 forecast objects and 5 observation objects.
>>> Performing merging (no merging) in the forecast field.
>>> Performing merging (no merging) in the observation field.
>>> Remaining: 6 forecast objects and 5 observation objects.
>>> Performing matching between the forecast and observation fields.
>>>
>>>
>>> ERROR: convex_hull(Polyline &) -> can't find next hull point
>>>
>>>
>>> Take care,
>>> Joe
>>>
>>> Dr. Joseph L. Eastman
>>> Senior Atmospheric Scientist
>>> WindLogics Inc.
>>> 201 4th St NW
>>> Grand Rapids, MN
>>> 55744
>>>
>>> c – 410.279.9702
>>> w – 651.556.4297
>>> jeastman at windlogics.com
>>>
>>>
>>>
>>> -----Original Message-----
>>> From: RAL HelpDesk {for John Halley Gotway}
[mailto:met_help at ucar.edu]
>>> Sent: Friday, July 09, 2010 3:23 PM
>>> To: Joe Eastman
>>> Subject: Re: [rt.rap.ucar.edu #39109] pcp_combine
>>>
>>> Joe,
>>>
>>> OK, I think I understand what's going on here. I've listed below
what I'm guessing is the situation. Please correct me if I'm wrong
about any of these assumptions:
>>> - You're running a very long WRF-ARW simulation and the time
values are exceeding 255.
>>> - Because the time values are greater than 255, WPP is storing
the output as instantaneous times, rather than as accumulations (i.e.
the time range indicator value in the GRIB file is set to 10,
>>> rather than 4 for an accumulation).
>>> - The only way you can get PCP-Combine to run on these files is
by requesting the accumulation interval as 0 from the input file.
>>>
>>> When you request 0 as the accumulation interval to be used from
these files, the NetCDF PCP-Combine output will be written as 0 hours
of accumulation as well. From PCP-Combine's perspective, we're
>>> doing a subtraction of 0-hours precip minus 0-hours precip.
That's why the NetCDF output is listed as 0-hours of precip as well.
>>>
>>> To get around this, try editing your MODE config file to look for
0-hour accumulation, like this:
>>> fcst_field = "APCP/A0";
>>>
>>> It'll just be up to you to know that even through the MODE output
lists the field as 0-hours of accumulation, it really is 1-hour of
accumulation.
>>>
>>> I suppose we could add some logic to PCP-Combine to detect this
situation and infer from the input data what the output accumulation
interval should be. However, when we switch over to using the
>>> Unified PostProcessor in the next year of so (it will replace
WPP), it should be able to write out GRIB version 2 data. And GRIB2
won't have these silly limitations in time values.
>>>
>>> Please let me know if you continue to experience problems with
this.
>>>
>>> Thanks,
>>> John Halley Gotway
>>> met_help at ucar.edu
>>>
>>> RAL HelpDesk {for Joe Eastman} wrote:
>>>> Thu Jul 08 13:03:54 2010: Request 39109 was acted upon.
>>>> Transaction: Ticket created by Joe.Eastman at windlogics.com
>>>> Queue: met_help
>>>> Subject: pcp_combine
>>>> Owner: Nobody
>>>> Requestors: Joe.Eastman at windlogics.com
>>>> Status: new
>>>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=39109 >
>>>>
>>>>
>>>> Hello Folks,
>>>>
>>>> Alright, 2 requests in one day. What's the record?
>>>>
>>>> Anyway, I am using the pcp_combine tool on the WRF APCP fields to
compare with Stage IV data. As you know WRF continuously accumulates
prepcipitation. Since I am integrating for one month at a time I need
to use the -subtract feature of pcp_combine like so :
>>>>
>>>> pcp_combine -subtract hrly/myj_03_2009-02-01_00_00_00.grb 0
myj_03_2009-02-01_01_00_00.grb 0 WRF.2009020101.nc
>>>>
>>>> Then I run mode in conjunction with the reformatted Stage IV 1
hour data and get this:
>>>>
>>>> mode WRF.2009020101.nc st4_03/ST4wrf2009020101.grb mode_config
-outdir ./mode Forecast File: WRF.2009020101.nc
>>>> Observation File: st4_03/ST4wrf2009020101.grb
>>>> Match Config File: mode_config
>>>> Merge Config File: mode_config
>>>>
>>>>
>>>> ERROR: process_fcst_obs_files() -> accumulation time of 0 hours
in the forecast file (WRF.2009020101.nc) does not match the 1 hour
accumulation time requested in the config file.
>>>>
>>>> How do I get pcp_combine to write it out as a 1 hour accumulation
or vice versa, override this in mode?
>>>>
>>>> Thanks again.
>>>>
>>>> Take care,
>>>> Joe
>>>>
>>>> Dr. Joseph L. Eastman
>>>> Senior Atmospheric Scientist
>>>> WindLogics Inc.
>>>> 201 4th St NW
>>>> Grand Rapids, MN
>>>> 55744
>>>>
>>>> c - 410.279.9702
>>>> w - 651.556.4297
>>>> jeastman at windlogics.com<mailto:jeastman at windlogics.com>
>>>>
>>>>
>>>>
>>>> ________________________________
>>>> CONFIDENTIALITY NOTICE: This e-mail message is for the sole use
of the intended recipient(s) and may contain confidential and
privileged information. Any unauthorized review, use, disclosure or
distribution of any kind is strictly prohibited. If you are not the
intended recipient, please contact the sender via reply e-mail and
destroy all copies of the original message. Thank you.
>>
------------------------------------------------
More information about the Met_help
mailing list