[Met_help] [rt.rap.ucar.edu #38806] History for problem running pcp combine for 5 minute radar data
RAL HelpDesk {for John Halley Gotway}
met_help at ucar.edu
Wed Jul 14 09:10:51 MDT 2010
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Hi!
I'm using MET to verify WRF accumulated precipitation files with radar
images. Problem is that the radar files come in 5 minute resolution,
while WRF output is one hourly cumulative precipitation. I tried to use
pcp-combine in MET, but I get the following error:
ERROR: check_file_time() -> time range indicator of not currently
supported. Time range indicator must be accumulation (Grib Code 4)
The command I'm trying to run is this:
/cm/shared/apps/met/2.0/METv2.0/bin/pcp_combine \
-sum ${year}${month}${day}_060000 1/12 ${year}${month}${day}_070000 1
\
data/research/verification/met/out/pcp_combine/cum_apcp_${year}${month}$
{day}06_24A.nc \
-pcpdir
/data/research/verification/met/data/test_obs/radar_grib/${year}${month}
${day}/
You find the input files in the attachments.
I hope you can help to sum the 5 minute radar data.
Cheers,
Marlous Jonker
-------------------------------------------------------------------
Marlous Jonker
Meteorological Researcher
Meteo Consult BV - A MeteoGroup Company
Wageningen - The Netherlands
Tel: +31 (0)317 399800
Email: M.Jonker at weer.nl
www: research.meteogroup.com
-------------------------------------------------------------------
--
This e-mail is from Meteo Consult B.V., a MeteoGroup company. For more information, see http://www.weer.nl/gebruiksvoorwaarden.
This e-mail may contain confidential information. Only the addressee is permitted to read, copy, distribute or otherwise use this e-mail or any attachments. If you have received it in error, please contact the sender immediately. Any opinion expressed in this e-mail is personal to the sender and may not reflect the opinion of MeteoGroup.
Any e-mail reply to this address may be subject to interception or monitoring for operational reasons or for lawful business practices.
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: problem running pcp combine for 5 minute radar data
From: John Halley Gotway
Time: Fri Jun 25 11:33:21 2010
Marlous,
I see what you're trying to do here. You'd like to sum up 12 files,
each containing 5 minutes of precipitation data, into a 1 hour total
of precipitation.
As you can probably guess, pcp_combine was written with the assumption
that we'd be handling precipitation in chunks no finer than 1 hour.
But it would not be very difficult to extend it to allow it to be used
on sub-hourly accumulations.
However, the problem in the radar data you sent me is a more
fundamental problem. In the GRIB files you sent me, the precipitation
is stored as an instantaneous value - not as an accumulation interval.
Typically, there is an accumulation interval defined for each record
of precipitation, e.g. accumulations of 1, 3, 6, and 12 hours are
common.
Generally speaking, pcp_combine needs to check to make sure that it's
grabbing the correct accumulation intervals. A lot of model output
files contain multiple accumulation intervals for precip, and we need
to be sure we're using the one the user wants.
I haven't used this type of precip data from radar in the past and
don't know how much control you have over the formatting of the GRIB
file. From my perspective, the best solution would be for me to
modify pcp_combine to handle 5-minute data well and for you to modify
the GRIB files to correctly list the 5-minute accumulation interval.
Does that sound like a possibility?
Thanks,
John Halley Gotway
met_help at ucar.edu
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #38806] Resolved: problem running pcp combine for 5 minute radar data
From: m.jonker at weer.nl
Time: Tue Jul 13 00:17:11 2010
Hello!
According to me, I have not got any answer to my question, so I
consider the question as not solved at all! Below you find again the
e-mail I sent to you almost a month ago.
I'm using MET to verify WRF accumulated precipitation files with radar
images. Problem is that the radar files come in 5 minute resolution,
while WRF output is one hourly cumulative precipitation. I tried to
use pcp-combine in MET, but I get the following error:
ERROR: check_file_time() -> time range indicator of not currently
supported. Time range indicator must be accumulation (Grib Code 4)
The command I'm trying to run is this:
/cm/shared/apps/met/2.0/METv2.0/bin/pcp_combine \
-sum ${year}${month}${day}_060000 1/12 ${year}${month}${day}_070000 1
\
data/research/verification/met/out/pcp_combine/cum_apcp_${year}${month}$
{day}06_24A.nc \
-pcpdir
/data/research/verification/met/data/test_obs/radar_grib/${year}${month}${day}/
I hope you can help to sum the 5 minute radar data.
Cheers,
Marlous Jonker
-----Oorspronkelijk bericht-----
Van: RAL HelpDesk {for John Halley Gotway} [mailto:met_help at ucar.edu]
Verzonden: maandag 12 juli 2010 19:38
Aan: Marlous Jonker
Onderwerp: [rt.rap.ucar.edu #38806] Resolved: problem running pcp
combine for 5 minute radar data
According to our records, your request has been resolved. If you have
any
further questions or concerns, please respond to this message.
--
This e-mail is from Meteo Consult B.V., a MeteoGroup company. For more
information, see http://www.weer.nl/gebruiksvoorwaarden.
This e-mail may contain confidential information. Only the addressee
is permitted to read, copy, distribute or otherwise use this e-mail or
any attachments. If you have received it in error, please contact the
sender immediately. Any opinion expressed in this e-mail is personal
to the sender and may not reflect the opinion of MeteoGroup.
Any e-mail reply to this address may be subject to interception or
monitoring for operational reasons or for lawful business practices.
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #38806] Resolved: problem running pcp combine for 5 minute radar data
From: John Halley Gotway
Time: Tue Jul 13 13:16:41 2010
Marlous - I see the problem. I sent you a response on Friday, June
25th, but was tripped up by our new ticketing system. And it was not
actually sent to you. Here's the message I *tried* to send on
June 25th...
Marlous,
I see what you're trying to do here. You'd like to sum up 12 files,
each containing 5 minutes of precipitation data, into a 1 hour total
of precipitation.
As you can probably guess, pcp_combine was written with the assumption
that we'd be handling precipitation in chunks no finer than 1 hour.
But it would not be very difficult to extend it to allow it
to be used on sub-hourly accumulations.
However, the problem in the radar data you sent me is a more
fundamental problem. In the GRIB files you sent me, the precipitation
is stored as an instantaneous value - not as an accumulation
interval. Typically, there is an accumulation interval defined for
each record of precipitation, e.g. accumulations of 1, 3, 6, and 12
hours are common.
Generally speaking, pcp_combine needs to check to make sure that it's
grabbing the correct accumulation intervals. A lot of model output
files contain multiple accumulation intervals for precip, and
we need to be sure we're using the one the user wants.
I haven't used this type of precip data from radar in the past and
don't know how much control you have over the formatting of the GRIB
file. From my perspective, the best solution would be for me to
modify pcp_combine to handle 5-minute data well and for you to modify
the GRIB files to correctly list the 5-minute accumulation interval.
Does that sound like a possibility?
Thanks,
John Halley Gotway
met_help at ucar.edu
RAL HelpDesk {for m.jonker at weer.nl} wrote:
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=38806 >
>
> Hello!
>
> According to me, I have not got any answer to my question, so I
consider the question as not solved at all! Below you find again the
e-mail I sent to you almost a month ago.
>
>
>
> I'm using MET to verify WRF accumulated precipitation files with
radar images. Problem is that the radar files come in 5 minute
resolution, while WRF output is one hourly cumulative precipitation. I
tried to use pcp-combine in MET, but I get the following error:
>
> ERROR: check_file_time() -> time range indicator of not currently
supported. Time range indicator must be accumulation (Grib Code 4)
>
> The command I'm trying to run is this:
>
> /cm/shared/apps/met/2.0/METv2.0/bin/pcp_combine \
> -sum ${year}${month}${day}_060000 1/12 ${year}${month}${day}_070000
1 \
>
data/research/verification/met/out/pcp_combine/cum_apcp_${year}${month}$
> {day}06_24A.nc \
> -pcpdir
/data/research/verification/met/data/test_obs/radar_grib/${year}${month}${day}/
>
> I hope you can help to sum the 5 minute radar data.
>
>
>
>
> Cheers,
> Marlous Jonker
>
> -----Oorspronkelijk bericht-----
> Van: RAL HelpDesk {for John Halley Gotway}
[mailto:met_help at ucar.edu]
> Verzonden: maandag 12 juli 2010 19:38
> Aan: Marlous Jonker
> Onderwerp: [rt.rap.ucar.edu #38806] Resolved: problem running pcp
combine for 5 minute radar data
>
> According to our records, your request has been resolved. If you
have any
> further questions or concerns, please respond to this message.
>
>
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #38806] Resolved: problem running pcp combine for 5 minute radar data
From: m.jonker at weer.nl
Time: Wed Jul 14 05:36:35 2010
Hi John,
I already guessed that it is not possible yet in MET to sum 5 minute
data. In the meantime, I built a pcp-combine-like tool myself to sum
the radar data (the radar gribs were made from raw hdf5 radar data, so
we can control all grib features it necessary). Perhaps it's a good
idea to include the smaller time steps in a next MET release. Most
radar data I know (in Europe) is in 5 or 15 minute intervals.
Anyway, thanks for the answer!
Cheers,
Marlous
-----Oorspronkelijk bericht-----
Van: RAL HelpDesk {for John Halley Gotway} [mailto:met_help at ucar.edu]
Verzonden: dinsdag 13 juli 2010 21:17
Aan: Marlous Jonker
Onderwerp: Re: [rt.rap.ucar.edu #38806] Resolved: problem running pcp
combine for 5 minute radar data
Marlous - I see the problem. I sent you a response on Friday, June
25th, but was tripped up by our new ticketing system. And it was not
actually sent to you. Here's the message I *tried* to send on
June 25th...
Marlous,
I see what you're trying to do here. You'd like to sum up 12 files,
each containing 5 minutes of precipitation data, into a 1 hour total
of precipitation.
As you can probably guess, pcp_combine was written with the assumption
that we'd be handling precipitation in chunks no finer than 1 hour.
But it would not be very difficult to extend it to allow it
to be used on sub-hourly accumulations.
However, the problem in the radar data you sent me is a more
fundamental problem. In the GRIB files you sent me, the precipitation
is stored as an instantaneous value - not as an accumulation
interval. Typically, there is an accumulation interval defined for
each record of precipitation, e.g. accumulations of 1, 3, 6, and 12
hours are common.
Generally speaking, pcp_combine needs to check to make sure that it's
grabbing the correct accumulation intervals. A lot of model output
files contain multiple accumulation intervals for precip, and
we need to be sure we're using the one the user wants.
I haven't used this type of precip data from radar in the past and
don't know how much control you have over the formatting of the GRIB
file. From my perspective, the best solution would be for me to
modify pcp_combine to handle 5-minute data well and for you to modify
the GRIB files to correctly list the 5-minute accumulation interval.
Does that sound like a possibility?
Thanks,
John Halley Gotway
met_help at ucar.edu
RAL HelpDesk {for m.jonker at weer.nl} wrote:
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=38806 >
>
> Hello!
>
> According to me, I have not got any answer to my question, so I
consider the question as not solved at all! Below you find again the
e-mail I sent to you almost a month ago.
>
>
>
> I'm using MET to verify WRF accumulated precipitation files with
radar images. Problem is that the radar files come in 5 minute
resolution, while WRF output is one hourly cumulative precipitation. I
tried to use pcp-combine in MET, but I get the following error:
>
> ERROR: check_file_time() -> time range indicator of not currently
supported. Time range indicator must be accumulation (Grib Code 4)
>
> The command I'm trying to run is this:
>
> /cm/shared/apps/met/2.0/METv2.0/bin/pcp_combine \
> -sum ${year}${month}${day}_060000 1/12 ${year}${month}${day}_070000
1 \
>
data/research/verification/met/out/pcp_combine/cum_apcp_${year}${month}$
> {day}06_24A.nc \
> -pcpdir
/data/research/verification/met/data/test_obs/radar_grib/${year}${month}${day}/
>
> I hope you can help to sum the 5 minute radar data.
>
>
>
>
> Cheers,
> Marlous Jonker
>
> -----Oorspronkelijk bericht-----
> Van: RAL HelpDesk {for John Halley Gotway}
[mailto:met_help at ucar.edu]
> Verzonden: maandag 12 juli 2010 19:38
> Aan: Marlous Jonker
> Onderwerp: [rt.rap.ucar.edu #38806] Resolved: problem running pcp
combine for 5 minute radar data
>
> According to our records, your request has been resolved. If you
have any
> further questions or concerns, please respond to this message.
>
>
--
This e-mail is from Meteo Consult B.V., a MeteoGroup company. For more
information, see http://www.weer.nl/gebruiksvoorwaarden.
This e-mail may contain confidential information. Only the addressee
is permitted to read, copy, distribute or otherwise use this e-mail or
any attachments. If you have received it in error, please contact the
sender immediately. Any opinion expressed in this e-mail is personal
to the sender and may not reflect the opinion of MeteoGroup.
Any e-mail reply to this address may be subject to interception or
monitoring for operational reasons or for lawful business practices.
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #38806] Resolved: problem running pcp combine for 5 minute radar data
From: John Halley Gotway
Time: Wed Jul 14 09:10:34 2010
Marlous,
Alright, sounds good. We're actually working on version 3.0 of MET
right now, and we're close to being able to handle the sub-hourly
accumulation intervals. There's a couple of issues I still need
to work out.
The one thing I would suggest would be to modify how you're writing
the GRIB record product description section (PDS) slightly
(http://www.nco.ncep.noaa.gov/pmb/docs/on388/section1.html):
- Set the "time range indicator" to a value of 4 to indicate an
accumulation interval
(http://www.nco.ncep.noaa.gov/pmb/docs/on388/table5.html).
- Make sure the "forecast time unit" is set to 0 for minutes
(http://www.nco.ncep.noaa.gov/pmb/docs/on388/table4.html).
- Set octet 19 to 0 for time 1.
- Set octet 20 to 5 for time 2.
That'd make the record look like an accumulation interval from 0 to 5
minutes - which is what you have.
I'll go ahead and close this ticket.
Thanks,
John Halley Gotway
met_help at ucar.edu
RAL HelpDesk {for m.jonker at weer.nl} wrote:
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=38806 >
>
> Hi John,
>
> I already guessed that it is not possible yet in MET to sum 5 minute
data. In the meantime, I built a pcp-combine-like tool myself to sum
the radar data (the radar gribs were made from raw hdf5 radar data, so
we can control all grib features it necessary). Perhaps it's a good
idea to include the smaller time steps in a next MET release. Most
radar data I know (in Europe) is in 5 or 15 minute intervals.
>
> Anyway, thanks for the answer!
>
> Cheers,
> Marlous
>
> -----Oorspronkelijk bericht-----
> Van: RAL HelpDesk {for John Halley Gotway}
[mailto:met_help at ucar.edu]
> Verzonden: dinsdag 13 juli 2010 21:17
> Aan: Marlous Jonker
> Onderwerp: Re: [rt.rap.ucar.edu #38806] Resolved: problem running
pcp combine for 5 minute radar data
>
> Marlous - I see the problem. I sent you a response on Friday, June
25th, but was tripped up by our new ticketing system. And it was not
actually sent to you. Here's the message I *tried* to send on
> June 25th...
>
> Marlous,
>
> I see what you're trying to do here. You'd like to sum up 12 files,
each containing 5 minutes of precipitation data, into a 1 hour total
of precipitation.
>
> As you can probably guess, pcp_combine was written with the
assumption that we'd be handling precipitation in chunks no finer than
1 hour. But it would not be very difficult to extend it to allow it
> to be used on sub-hourly accumulations.
>
> However, the problem in the radar data you sent me is a more
fundamental problem. In the GRIB files you sent me, the precipitation
is stored as an instantaneous value - not as an accumulation
> interval. Typically, there is an accumulation interval defined for
each record of precipitation, e.g. accumulations of 1, 3, 6, and 12
hours are common.
>
> Generally speaking, pcp_combine needs to check to make sure that
it's grabbing the correct accumulation intervals. A lot of model
output files contain multiple accumulation intervals for precip, and
> we need to be sure we're using the one the user wants.
>
> I haven't used this type of precip data from radar in the past and
don't know how much control you have over the formatting of the GRIB
file. From my perspective, the best solution would be for me to
> modify pcp_combine to handle 5-minute data well and for you to
modify the GRIB files to correctly list the 5-minute accumulation
interval.
>
> Does that sound like a possibility?
>
> Thanks,
> John Halley Gotway
> met_help at ucar.edu
>
>
> RAL HelpDesk {for m.jonker at weer.nl} wrote:
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=38806 >
>>
>> Hello!
>>
>> According to me, I have not got any answer to my question, so I
consider the question as not solved at all! Below you find again the
e-mail I sent to you almost a month ago.
>>
>>
>>
>> I'm using MET to verify WRF accumulated precipitation files with
radar images. Problem is that the radar files come in 5 minute
resolution, while WRF output is one hourly cumulative precipitation. I
tried to use pcp-combine in MET, but I get the following error:
>>
>> ERROR: check_file_time() -> time range indicator of not currently
supported. Time range indicator must be accumulation (Grib Code 4)
>>
>> The command I'm trying to run is this:
>>
>> /cm/shared/apps/met/2.0/METv2.0/bin/pcp_combine \
>> -sum ${year}${month}${day}_060000 1/12 ${year}${month}${day}_070000
1 \
>>
data/research/verification/met/out/pcp_combine/cum_apcp_${year}${month}$
>> {day}06_24A.nc \
>> -pcpdir
/data/research/verification/met/data/test_obs/radar_grib/${year}${month}${day}/
>>
>> I hope you can help to sum the 5 minute radar data.
>>
>>
>>
>>
>> Cheers,
>> Marlous Jonker
>>
>> -----Oorspronkelijk bericht-----
>> Van: RAL HelpDesk {for John Halley Gotway}
[mailto:met_help at ucar.edu]
>> Verzonden: maandag 12 juli 2010 19:38
>> Aan: Marlous Jonker
>> Onderwerp: [rt.rap.ucar.edu #38806] Resolved: problem running pcp
combine for 5 minute radar data
>>
>> According to our records, your request has been resolved. If you
have any
>> further questions or concerns, please respond to this message.
>>
>>
>
>
>
------------------------------------------------
More information about the Met_help
mailing list