[Met_help] [rt.rap.ucar.edu #43392] History for PCP_COMBINE Error
RAL HelpDesk {for Paul Oldenburg}
met_help at ucar.edu
Thu Jan 20 12:18:04 MST 2011
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Dear Sir,
I am trying to run PCP-COMBINE to accumulate 3-hourly data into 24 hourly
data, but its is giving some error. The pcp-combine script is attached with
the email. I was trying put the data files also at your ftp server. But I
could not get the permission to put my data there. So I am just showing you
the filenames, on which i am running this command.
[WRF_HQ.t00z_d01.000.grib1 WRF_HQ.t00z_d01.027.grib1
WRF_HQ.t00z_d01.054.grib1
WRF_HQ.t00z_d01.003.grib1 WRF_HQ.t00z_d01.030.grib1
WRF_HQ.t00z_d01.057.grib1
WRF_HQ.t00z_d01.006.grib1 WRF_HQ.t00z_d01.033.grib1
WRF_HQ.t00z_d01.060.grib1
WRF_HQ.t00z_d01.009.grib1 WRF_HQ.t00z_d01.036.grib1
WRF_HQ.t00z_d01.063.grib1
WRF_HQ.t00z_d01.012.grib1 WRF_HQ.t00z_d01.039.grib1
WRF_HQ.t00z_d01.066.grib1
WRF_HQ.t00z_d01.015.grib1 WRF_HQ.t00z_d01.042.grib1
WRF_HQ.t00z_d01.069.grib1
WRF_HQ.t00z_d01.018.grib1 WRF_HQ.t00z_d01.045.grib1
WRF_HQ.t00z_d01.072.grib1
WRF_HQ.t00z_d01.021.grib1 WRF_HQ.t00z_d01.048.grib1
WRF_HQ.t00z_d01.075.grib1
WRF_HQ.t00z_d01.024.grib1 WRF_HQ.t00z_d01.051.grib1]
Error Message:
*** Running PCP-Combine to combine 3-hourly APCP accumulation observations
into a single 24 hour accumulation observation ***
Performing sum command: Init/In_Accum/Valid/Out_Accum Times =
20100701_000000/030000/20100701_120000/120000
Searching for 4 files with accumulation times of 030000 to sum to a total
accumulation time of 120000.
ERROR: sum_grib_files() -> Cannot find a file with a valid time of
20100701_120000 and accumulation time of 030000 matching the regular
expression ".*"
Please help me out.
Thanks and Regards,
--
Hashmi Fatima
Research Scholar
Centre for Atmospheric Sciences
Indian Institute of Technology Delhi
Hauz Khas
New Delhi - 110016
INDIA
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #43392] PCP_COMBINE Error
From: Paul Oldenburg
Time: Tue Jan 11 12:56:19 2011
Hashmi,
We have not had any other reports of trouble or permissions problems
with our FTP site. We see that you created a data
folder there this morning, but there are no files. Can you please
send us the FTP command and error message that you get?
In lieu of data files, we could also analyze your data by looking at
the output of the wgrib command. Can you please
run the following command and send us the resulting file?
% wgrib WRF_HQ.t00z_d01.024.grib1 > grib_header_24.out
Thanks,
Paul
On 01/11/2011 04:18 AM, RAL HelpDesk {for Hashmi Fatima} wrote:
>
> Tue Jan 11 04:18:11 2011: Request 43392 was acted upon.
> Transaction: Ticket created by hashmifatima at gmail.com
> Queue: met_help
> Subject: PCP_COMBINE Error
> Owner: Nobody
> Requestors: hashmifatima at gmail.com
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=43392 >
>
>
> Dear Sir,
>
> I am trying to run PCP-COMBINE to accumulate 3-hourly data into 24
hourly
> data, but its is giving some error. The pcp-combine script is
attached with
> the email. I was trying put the data files also at your ftp server.
But I
> could not get the permission to put my data there. So I am just
showing you
> the filenames, on which i am running this command.
>
> [WRF_HQ.t00z_d01.000.grib1 WRF_HQ.t00z_d01.027.grib1
> WRF_HQ.t00z_d01.054.grib1
> WRF_HQ.t00z_d01.003.grib1 WRF_HQ.t00z_d01.030.grib1
> WRF_HQ.t00z_d01.057.grib1
> WRF_HQ.t00z_d01.006.grib1 WRF_HQ.t00z_d01.033.grib1
> WRF_HQ.t00z_d01.060.grib1
> WRF_HQ.t00z_d01.009.grib1 WRF_HQ.t00z_d01.036.grib1
> WRF_HQ.t00z_d01.063.grib1
> WRF_HQ.t00z_d01.012.grib1 WRF_HQ.t00z_d01.039.grib1
> WRF_HQ.t00z_d01.066.grib1
> WRF_HQ.t00z_d01.015.grib1 WRF_HQ.t00z_d01.042.grib1
> WRF_HQ.t00z_d01.069.grib1
> WRF_HQ.t00z_d01.018.grib1 WRF_HQ.t00z_d01.045.grib1
> WRF_HQ.t00z_d01.072.grib1
> WRF_HQ.t00z_d01.021.grib1 WRF_HQ.t00z_d01.048.grib1
> WRF_HQ.t00z_d01.075.grib1
> WRF_HQ.t00z_d01.024.grib1 WRF_HQ.t00z_d01.051.grib1]
>
>
>
> Error Message:
>
>
> *** Running PCP-Combine to combine 3-hourly APCP accumulation
observations
> into a single 24 hour accumulation observation ***
> Performing sum command: Init/In_Accum/Valid/Out_Accum Times =
> 20100701_000000/030000/20100701_120000/120000
> Searching for 4 files with accumulation times of 030000 to sum to a
total
> accumulation time of 120000.
>
>
> ERROR: sum_grib_files() -> Cannot find a file with a valid time of
> 20100701_120000 and accumulation time of 030000 matching the regular
> expression ".*"
>
>
> Please help me out.
>
> Thanks and Regards,
------------------------------------------------
Subject: PCP_COMBINE Error
From: Hashmi Fatima
Time: Tue Jan 11 23:04:57 2011
Dear Sir,
I am sending you the grid_header_24.out.
Please have a look.
Regards
Hashmi Fatima
On Wed, Jan 12, 2011 at 1:26 AM, RAL HelpDesk {for Paul Oldenburg} <
met_help at ucar.edu> wrote:
> Hashmi,
>
> We have not had any other reports of trouble or permissions problems
with
> our FTP site. We see that you created a data
> folder there this morning, but there are no files. Can you please
send us
> the FTP command and error message that you get?
>
> In lieu of data files, we could also analyze your data by looking at
the
> output of the wgrib command. Can you please
> run the following command and send us the resulting file?
>
> % wgrib WRF_HQ.t00z_d01.024.grib1 > grib_header_24.out
>
> Thanks,
>
> Paul
>
>
> On 01/11/2011 04:18 AM, RAL HelpDesk {for Hashmi Fatima} wrote:
> >
> > Tue Jan 11 04:18:11 2011: Request 43392 was acted upon.
> > Transaction: Ticket created by hashmifatima at gmail.com
> > Queue: met_help
> > Subject: PCP_COMBINE Error
> > Owner: Nobody
> > Requestors: hashmifatima at gmail.com
> > Status: new
> > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=43392 >
> >
> >
> > Dear Sir,
> >
> > I am trying to run PCP-COMBINE to accumulate 3-hourly data into 24
hourly
> > data, but its is giving some error. The pcp-combine script is
attached
> with
> > the email. I was trying put the data files also at your ftp
server. But I
> > could not get the permission to put my data there. So I am just
showing
> you
> > the filenames, on which i am running this command.
> >
> > [WRF_HQ.t00z_d01.000.grib1 WRF_HQ.t00z_d01.027.grib1
> > WRF_HQ.t00z_d01.054.grib1
> > WRF_HQ.t00z_d01.003.grib1 WRF_HQ.t00z_d01.030.grib1
> > WRF_HQ.t00z_d01.057.grib1
> > WRF_HQ.t00z_d01.006.grib1 WRF_HQ.t00z_d01.033.grib1
> > WRF_HQ.t00z_d01.060.grib1
> > WRF_HQ.t00z_d01.009.grib1 WRF_HQ.t00z_d01.036.grib1
> > WRF_HQ.t00z_d01.063.grib1
> > WRF_HQ.t00z_d01.012.grib1 WRF_HQ.t00z_d01.039.grib1
> > WRF_HQ.t00z_d01.066.grib1
> > WRF_HQ.t00z_d01.015.grib1 WRF_HQ.t00z_d01.042.grib1
> > WRF_HQ.t00z_d01.069.grib1
> > WRF_HQ.t00z_d01.018.grib1 WRF_HQ.t00z_d01.045.grib1
> > WRF_HQ.t00z_d01.072.grib1
> > WRF_HQ.t00z_d01.021.grib1 WRF_HQ.t00z_d01.048.grib1
> > WRF_HQ.t00z_d01.075.grib1
> > WRF_HQ.t00z_d01.024.grib1 WRF_HQ.t00z_d01.051.grib1]
> >
> >
> >
> > Error Message:
> >
> >
> > *** Running PCP-Combine to combine 3-hourly APCP accumulation
> observations
> > into a single 24 hour accumulation observation ***
> > Performing sum command: Init/In_Accum/Valid/Out_Accum Times =
> > 20100701_000000/030000/20100701_120000/120000
> > Searching for 4 files with accumulation times of 030000 to sum to
a total
> > accumulation time of 120000.
> >
> >
> > ERROR: sum_grib_files() -> Cannot find a file with a valid time of
> > 20100701_120000 and accumulation time of 030000 matching the
regular
> > expression ".*"
> >
> >
> > Please help me out.
> >
> > Thanks and Regards,
>
>
>
--
Hashmi Fatima
Research Scholar
Centre for Atmospheric Sciences
Indian Institute of Technology Delhi
Hauz Khas
New Delhi - 110016
INDIA
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #43392] PCP_COMBINE Error
From: Paul Oldenburg
Time: Wed Jan 12 11:21:56 2011
Hashmi,
Your model output grib files do not appear to contain precipitation
accumulated on 3 hour intervals. To determine this,
I examined the accumulated precipitation line of the wgrib output that
you sent:
$ cat grid_header_24.out | grep APCP
232:40004234:d=10070100:APCP:kpds5=61:kpds6=1:kpds7=0:TR=4:P1=0:P2=24:TimeU=1:sfc:0-
24hr acc:NAve=0
In this file, the accumulation period is 0-24hr. Thus, you should not
try to accumulate 3 hour intervals. We suspect
that you are running the ARW model, which accumulates precipitation
from the run time until the forecast time. If this
is the case, then to get 24 hour accumulations, you will need to
subtract each 24 hour period file from the previous
one. This can be done using the pcp_combine subtract functionality.
For example:
accum for hours 0-24: file WRF_HQ.t00z_d01.024.grib1 (no pcp_combine)
accum for hours 24-48: pcp_combine -subtract WRF_HQ.t00z_d01.048.grib1
48 WRF_HQ.t00z_d01.024.grib1 24 out_24_48.nc
accum for hours 48-72: pcp_combine -subtract WRF_HQ.t00z_d01.072.grib1
72 WRF_HQ.t00z_d01.048.grib1 48 out_48_72.nc
...
Good luck.
Paul
On 01/11/2011 11:04 PM, RAL HelpDesk {for Hashmi Fatima} wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=43392 >
>
> Dear Sir,
>
> I am sending you the grid_header_24.out.
>
> Please have a look.
>
> Regards
> Hashmi Fatima
>
> On Wed, Jan 12, 2011 at 1:26 AM, RAL HelpDesk {for Paul Oldenburg} <
> met_help at ucar.edu> wrote:
>
>> Hashmi,
>>
>> We have not had any other reports of trouble or permissions
problems with
>> our FTP site. We see that you created a data
>> folder there this morning, but there are no files. Can you please
send us
>> the FTP command and error message that you get?
>>
>> In lieu of data files, we could also analyze your data by looking
at the
>> output of the wgrib command. Can you please
>> run the following command and send us the resulting file?
>>
>> % wgrib WRF_HQ.t00z_d01.024.grib1 > grib_header_24.out
>>
>> Thanks,
>>
>> Paul
>>
>>
>> On 01/11/2011 04:18 AM, RAL HelpDesk {for Hashmi Fatima} wrote:
>>>
>>> Tue Jan 11 04:18:11 2011: Request 43392 was acted upon.
>>> Transaction: Ticket created by hashmifatima at gmail.com
>>> Queue: met_help
>>> Subject: PCP_COMBINE Error
>>> Owner: Nobody
>>> Requestors: hashmifatima at gmail.com
>>> Status: new
>>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=43392 >
>>>
>>>
>>> Dear Sir,
>>>
>>> I am trying to run PCP-COMBINE to accumulate 3-hourly data into 24
hourly
>>> data, but its is giving some error. The pcp-combine script is
attached
>> with
>>> the email. I was trying put the data files also at your ftp
server. But I
>>> could not get the permission to put my data there. So I am just
showing
>> you
>>> the filenames, on which i am running this command.
>>>
>>> [WRF_HQ.t00z_d01.000.grib1 WRF_HQ.t00z_d01.027.grib1
>>> WRF_HQ.t00z_d01.054.grib1
>>> WRF_HQ.t00z_d01.003.grib1 WRF_HQ.t00z_d01.030.grib1
>>> WRF_HQ.t00z_d01.057.grib1
>>> WRF_HQ.t00z_d01.006.grib1 WRF_HQ.t00z_d01.033.grib1
>>> WRF_HQ.t00z_d01.060.grib1
>>> WRF_HQ.t00z_d01.009.grib1 WRF_HQ.t00z_d01.036.grib1
>>> WRF_HQ.t00z_d01.063.grib1
>>> WRF_HQ.t00z_d01.012.grib1 WRF_HQ.t00z_d01.039.grib1
>>> WRF_HQ.t00z_d01.066.grib1
>>> WRF_HQ.t00z_d01.015.grib1 WRF_HQ.t00z_d01.042.grib1
>>> WRF_HQ.t00z_d01.069.grib1
>>> WRF_HQ.t00z_d01.018.grib1 WRF_HQ.t00z_d01.045.grib1
>>> WRF_HQ.t00z_d01.072.grib1
>>> WRF_HQ.t00z_d01.021.grib1 WRF_HQ.t00z_d01.048.grib1
>>> WRF_HQ.t00z_d01.075.grib1
>>> WRF_HQ.t00z_d01.024.grib1 WRF_HQ.t00z_d01.051.grib1]
>>>
>>>
>>>
>>> Error Message:
>>>
>>>
>>> *** Running PCP-Combine to combine 3-hourly APCP accumulation
>> observations
>>> into a single 24 hour accumulation observation ***
>>> Performing sum command: Init/In_Accum/Valid/Out_Accum Times =
>>> 20100701_000000/030000/20100701_120000/120000
>>> Searching for 4 files with accumulation times of 030000 to sum to
a total
>>> accumulation time of 120000.
>>>
>>>
>>> ERROR: sum_grib_files() -> Cannot find a file with a valid time of
>>> 20100701_120000 and accumulation time of 030000 matching the
regular
>>> expression ".*"
>>>
>>>
>>> Please help me out.
>>>
>>> Thanks and Regards,
>>
>>
>>
>
>
------------------------------------------------
Subject: PCP_COMBINE Error
From: Hashmi Fatima
Time: Thu Jan 13 04:59:02 2011
Dear Paul
Its working!! Thanks a lot.
Now the next step is to run point_stat.
I have got model forecast rainfall file through subtraction from the
model
(NetCDF format)
I have generated observation file from ascii2nc (NetCDF Format).
But it is taking "0 pairs" for comparison.
Error Message:
*** Running Point-Stat on sample NAM data ***
GSL_RNG_TYPE=mt19937
GSL_RNG_SEED=18446744073238163021
Forecast File:
/gpfs1/home/mrathee/MET3/OUT/PCP_COMBINE/model_rain_24.nc
Climatology File: none
Configuration File: PointStatConfig_RAIN
Observation File: observation_20100701.nc
--------------------------------------------------------------------------------
Reading records for APCP_24(*,*).
For APCP_24(*,*) found 1 forecast levels and 0 climatology levels.
--------------------------------------------------------------------------------
Searching 86 observations from 85 PrepBufr messages.
--------------------------------------------------------------------------------
Processing APCP_24(*,*) versus APCP_24/A24, for observation type
ADPSFC,
over region FULL, for interpolation method UW_MEAN(1), using 0 pairs.
Processing APCP_24(*,*) versus APCP_24/A24, for observation type
ADPSFC,
over region FULL, for interpolation method UW_MEAN(9), using 0 pairs.
--------------------------------------------------------------------------------
Output file:
OUT/POINT_STAT/point_stat_RAIN_270000L_20100809_030000V.stat
Output file:
OUT/POINT_STAT/point_stat_RAIN_270000L_20100809_030000V_fho.txt
Output file:
OUT/POINT_STAT/point_stat_RAIN_270000L_20100809_030000V_ctc.txt
Output file:
OUT/POINT_STAT/point_stat_RAIN_270000L_20100809_030000V_cts.txt
Output file:
OUT/POINT_STAT/point_stat_RAIN_270000L_20100809_030000V_cnt.txt
Output file:
OUT/POINT_STAT/point_stat_RAIN_270000L_20100809_030000V_mpr.txt
I am sending you the configuration file, input files (forecast,
observations) and the script.
Please have a look and help me to solve this problem.
Thanks a lot.
Best Regards
Hashmi
On Wed, Jan 12, 2011 at 11:51 PM, RAL HelpDesk {for Paul Oldenburg} <
met_help at ucar.edu> wrote:
> Hashmi,
>
> Your model output grib files do not appear to contain precipitation
> accumulated on 3 hour intervals. To determine this,
> I examined the accumulated precipitation line of the wgrib output
that you
> sent:
>
> $ cat grid_header_24.out | grep APCP
>
232:40004234:d=10070100:APCP:kpds5=61:kpds6=1:kpds7=0:TR=4:P1=0:P2=24:TimeU=1:sfc:0-
24hr
> acc:NAve=0
>
> In this file, the accumulation period is 0-24hr. Thus, you should
not try
> to accumulate 3 hour intervals. We suspect
> that you are running the ARW model, which accumulates precipitation
from
> the run time until the forecast time. If this
> is the case, then to get 24 hour accumulations, you will need to
subtract
> each 24 hour period file from the previous
> one. This can be done using the pcp_combine subtract functionality.
For
> example:
>
> accum for hours 0-24: file WRF_HQ.t00z_d01.024.grib1 (no
pcp_combine)
> accum for hours 24-48: pcp_combine -subtract
WRF_HQ.t00z_d01.048.grib1 48
> WRF_HQ.t00z_d01.024.grib1 24 out_24_48.nc
> accum for hours 48-72: pcp_combine -subtract
WRF_HQ.t00z_d01.072.grib1 72
> WRF_HQ.t00z_d01.048.grib1 48 out_48_72.nc
> ...
>
> Good luck.
>
> Paul
>
>
> On 01/11/2011 11:04 PM, RAL HelpDesk {for Hashmi Fatima} wrote:
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=43392 >
> >
> > Dear Sir,
> >
> > I am sending you the grid_header_24.out.
> >
> > Please have a look.
> >
> > Regards
> > Hashmi Fatima
> >
> > On Wed, Jan 12, 2011 at 1:26 AM, RAL HelpDesk {for Paul Oldenburg}
<
> > met_help at ucar.edu> wrote:
> >
> >> Hashmi,
> >>
> >> We have not had any other reports of trouble or permissions
problems
> with
> >> our FTP site. We see that you created a data
> >> folder there this morning, but there are no files. Can you
please send
> us
> >> the FTP command and error message that you get?
> >>
> >> In lieu of data files, we could also analyze your data by looking
at the
> >> output of the wgrib command. Can you please
> >> run the following command and send us the resulting file?
> >>
> >> % wgrib WRF_HQ.t00z_d01.024.grib1 > grib_header_24.out
> >>
> >> Thanks,
> >>
> >> Paul
> >>
> >>
> >> On 01/11/2011 04:18 AM, RAL HelpDesk {for Hashmi Fatima} wrote:
> >>>
> >>> Tue Jan 11 04:18:11 2011: Request 43392 was acted upon.
> >>> Transaction: Ticket created by hashmifatima at gmail.com
> >>> Queue: met_help
> >>> Subject: PCP_COMBINE Error
> >>> Owner: Nobody
> >>> Requestors: hashmifatima at gmail.com
> >>> Status: new
> >>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=43392>
> >>>
> >>>
> >>> Dear Sir,
> >>>
> >>> I am trying to run PCP-COMBINE to accumulate 3-hourly data into
24
> hourly
> >>> data, but its is giving some error. The pcp-combine script is
attached
> >> with
> >>> the email. I was trying put the data files also at your ftp
server. But
> I
> >>> could not get the permission to put my data there. So I am just
showing
> >> you
> >>> the filenames, on which i am running this command.
> >>>
> >>> [WRF_HQ.t00z_d01.000.grib1 WRF_HQ.t00z_d01.027.grib1
> >>> WRF_HQ.t00z_d01.054.grib1
> >>> WRF_HQ.t00z_d01.003.grib1 WRF_HQ.t00z_d01.030.grib1
> >>> WRF_HQ.t00z_d01.057.grib1
> >>> WRF_HQ.t00z_d01.006.grib1 WRF_HQ.t00z_d01.033.grib1
> >>> WRF_HQ.t00z_d01.060.grib1
> >>> WRF_HQ.t00z_d01.009.grib1 WRF_HQ.t00z_d01.036.grib1
> >>> WRF_HQ.t00z_d01.063.grib1
> >>> WRF_HQ.t00z_d01.012.grib1 WRF_HQ.t00z_d01.039.grib1
> >>> WRF_HQ.t00z_d01.066.grib1
> >>> WRF_HQ.t00z_d01.015.grib1 WRF_HQ.t00z_d01.042.grib1
> >>> WRF_HQ.t00z_d01.069.grib1
> >>> WRF_HQ.t00z_d01.018.grib1 WRF_HQ.t00z_d01.045.grib1
> >>> WRF_HQ.t00z_d01.072.grib1
> >>> WRF_HQ.t00z_d01.021.grib1 WRF_HQ.t00z_d01.048.grib1
> >>> WRF_HQ.t00z_d01.075.grib1
> >>> WRF_HQ.t00z_d01.024.grib1 WRF_HQ.t00z_d01.051.grib1]
> >>>
> >>>
> >>>
> >>> Error Message:
> >>>
> >>>
> >>> *** Running PCP-Combine to combine 3-hourly APCP accumulation
> >> observations
> >>> into a single 24 hour accumulation observation ***
> >>> Performing sum command: Init/In_Accum/Valid/Out_Accum Times =
> >>> 20100701_000000/030000/20100701_120000/120000
> >>> Searching for 4 files with accumulation times of 030000 to sum
to a
> total
> >>> accumulation time of 120000.
> >>>
> >>>
> >>> ERROR: sum_grib_files() -> Cannot find a file with a valid time
of
> >>> 20100701_120000 and accumulation time of 030000 matching the
regular
> >>> expression ".*"
> >>>
> >>>
> >>> Please help me out.
> >>>
> >>> Thanks and Regards,
> >>
> >>
> >>
> >
> >
>
>
>
--
Hashmi Fatima
Research Scholar
Centre for Atmospheric Sciences
Indian Institute of Technology Delhi
Hauz Khas
New Delhi - 110016
INDIA
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #43392] PCP_COMBINE Error
From: Paul Oldenburg
Time: Thu Jan 13 08:57:47 2011
Fatima,
The first suggestion that I have is to increase the verbosity of the
point_stat output. I see in your point_stat_wrf.sh
script that you have "-v 2". Try using "-v 3" instead. When you do,
you will see point_stat output that looks like this:
...
Processing APCP_24(*,*) versus APCP_24/A24, for observation type
ADPSFC, over region FULL, for interpolation method
UW_MEAN(1), using 0 pairs.
Number of matched pairs = 0
Observations processed = 86
Rejected: GRIB code = 0
Rejected: valid time = 86
...
This information tells you why your observations were rejected -
because of a mismatch in valid times between the model
data and the observations. To look into this further, I examined your
model and observation files using the tool
ncdump. First, it appears that your model valid time is 2010-08-09
03:00:00. I read this information from your model
output file using this command:
$ ncdump -h model_rain_24.nc
netcdf model_rain_24 {
...
float APCP_24(lat, lon) ;
APCP_24:name = "APCP" ;
APCP_24:long_name = "Total precipitation" ;
APCP_24:level = "A24" ;
APCP_24:units = "kg/m^2" ;
APCP_24:grib_code = 61 ;
APCP_24:_FillValue = -9999.f ;
APCP_24:init_time = "20100808_000000" ;
APCP_24:init_time_ut = 1281225600 ;
APCP_24:valid_time = "20100809_030000" ;
APCP_24:valid_time_ut = 1281322800 ;
APCP_24:accum_time = "240000" ;
APCP_24:accum_time_sec = 86400 ;
Then, I used the following command to determine that your observations
are all valid at 2010-07-01 03:00:00:
$ ncdump -v hdr_vld observation_20100701.nc | grep '^ "' | sort -u
"20100701_030000" ;
"20100701_030000",
So, the problem is that your observations are not valid at the same
time that your model output is. You should find
observation data from the time 2010-08-09 03:00:00.
Paul
On 01/13/2011 04:59 AM, RAL HelpDesk {for Hashmi Fatima} wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=43392 >
>
> Dear Paul
>
> Its working!! Thanks a lot.
> Now the next step is to run point_stat.
> I have got model forecast rainfall file through subtraction from the
model
> (NetCDF format)
> I have generated observation file from ascii2nc (NetCDF Format).
>
> But it is taking "0 pairs" for comparison.
> Error Message:
>
> *** Running Point-Stat on sample NAM data ***
> GSL_RNG_TYPE=mt19937
> GSL_RNG_SEED=18446744073238163021
> Forecast File:
/gpfs1/home/mrathee/MET3/OUT/PCP_COMBINE/model_rain_24.nc
> Climatology File: none
> Configuration File: PointStatConfig_RAIN
> Observation File: observation_20100701.nc
>
>
--------------------------------------------------------------------------------
>
> Reading records for APCP_24(*,*).
> For APCP_24(*,*) found 1 forecast levels and 0 climatology levels.
>
>
--------------------------------------------------------------------------------
>
> Searching 86 observations from 85 PrepBufr messages.
>
>
--------------------------------------------------------------------------------
>
> Processing APCP_24(*,*) versus APCP_24/A24, for observation type
ADPSFC,
> over region FULL, for interpolation method UW_MEAN(1), using 0
pairs.
> Processing APCP_24(*,*) versus APCP_24/A24, for observation type
ADPSFC,
> over region FULL, for interpolation method UW_MEAN(9), using 0
pairs.
>
>
--------------------------------------------------------------------------------
>
> Output file:
OUT/POINT_STAT/point_stat_RAIN_270000L_20100809_030000V.stat
> Output file:
OUT/POINT_STAT/point_stat_RAIN_270000L_20100809_030000V_fho.txt
> Output file:
OUT/POINT_STAT/point_stat_RAIN_270000L_20100809_030000V_ctc.txt
> Output file:
OUT/POINT_STAT/point_stat_RAIN_270000L_20100809_030000V_cts.txt
> Output file:
OUT/POINT_STAT/point_stat_RAIN_270000L_20100809_030000V_cnt.txt
> Output file:
OUT/POINT_STAT/point_stat_RAIN_270000L_20100809_030000V_mpr.txt
>
>
> I am sending you the configuration file, input files (forecast,
> observations) and the script.
> Please have a look and help me to solve this problem.
>
> Thanks a lot.
>
> Best Regards
> Hashmi
>
> On Wed, Jan 12, 2011 at 11:51 PM, RAL HelpDesk {for Paul Oldenburg}
<
> met_help at ucar.edu> wrote:
>
>> Hashmi,
>>
>> Your model output grib files do not appear to contain precipitation
>> accumulated on 3 hour intervals. To determine this,
>> I examined the accumulated precipitation line of the wgrib output
that you
>> sent:
>>
>> $ cat grid_header_24.out | grep APCP
>>
232:40004234:d=10070100:APCP:kpds5=61:kpds6=1:kpds7=0:TR=4:P1=0:P2=24:TimeU=1:sfc:0-
24hr
>> acc:NAve=0
>>
>> In this file, the accumulation period is 0-24hr. Thus, you should
not try
>> to accumulate 3 hour intervals. We suspect
>> that you are running the ARW model, which accumulates precipitation
from
>> the run time until the forecast time. If this
>> is the case, then to get 24 hour accumulations, you will need to
subtract
>> each 24 hour period file from the previous
>> one. This can be done using the pcp_combine subtract
functionality. For
>> example:
>>
>> accum for hours 0-24: file WRF_HQ.t00z_d01.024.grib1 (no
pcp_combine)
>> accum for hours 24-48: pcp_combine -subtract
WRF_HQ.t00z_d01.048.grib1 48
>> WRF_HQ.t00z_d01.024.grib1 24 out_24_48.nc
>> accum for hours 48-72: pcp_combine -subtract
WRF_HQ.t00z_d01.072.grib1 72
>> WRF_HQ.t00z_d01.048.grib1 48 out_48_72.nc
>> ...
>>
>> Good luck.
>>
>> Paul
>>
>>
>> On 01/11/2011 11:04 PM, RAL HelpDesk {for Hashmi Fatima} wrote:
>>>
>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=43392 >
>>>
>>> Dear Sir,
>>>
>>> I am sending you the grid_header_24.out.
>>>
>>> Please have a look.
>>>
>>> Regards
>>> Hashmi Fatima
>>>
>>> On Wed, Jan 12, 2011 at 1:26 AM, RAL HelpDesk {for Paul Oldenburg}
<
>>> met_help at ucar.edu> wrote:
>>>
>>>> Hashmi,
>>>>
>>>> We have not had any other reports of trouble or permissions
problems
>> with
>>>> our FTP site. We see that you created a data
>>>> folder there this morning, but there are no files. Can you
please send
>> us
>>>> the FTP command and error message that you get?
>>>>
>>>> In lieu of data files, we could also analyze your data by looking
at the
>>>> output of the wgrib command. Can you please
>>>> run the following command and send us the resulting file?
>>>>
>>>> % wgrib WRF_HQ.t00z_d01.024.grib1 > grib_header_24.out
>>>>
>>>> Thanks,
>>>>
>>>> Paul
>>>>
>>>>
>>>> On 01/11/2011 04:18 AM, RAL HelpDesk {for Hashmi Fatima} wrote:
>>>>>
>>>>> Tue Jan 11 04:18:11 2011: Request 43392 was acted upon.
>>>>> Transaction: Ticket created by hashmifatima at gmail.com
>>>>> Queue: met_help
>>>>> Subject: PCP_COMBINE Error
>>>>> Owner: Nobody
>>>>> Requestors: hashmifatima at gmail.com
>>>>> Status: new
>>>>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=43392>
>>>>>
>>>>>
>>>>> Dear Sir,
>>>>>
>>>>> I am trying to run PCP-COMBINE to accumulate 3-hourly data into
24
>> hourly
>>>>> data, but its is giving some error. The pcp-combine script is
attached
>>>> with
>>>>> the email. I was trying put the data files also at your ftp
server. But
>> I
>>>>> could not get the permission to put my data there. So I am just
showing
>>>> you
>>>>> the filenames, on which i am running this command.
>>>>>
>>>>> [WRF_HQ.t00z_d01.000.grib1 WRF_HQ.t00z_d01.027.grib1
>>>>> WRF_HQ.t00z_d01.054.grib1
>>>>> WRF_HQ.t00z_d01.003.grib1 WRF_HQ.t00z_d01.030.grib1
>>>>> WRF_HQ.t00z_d01.057.grib1
>>>>> WRF_HQ.t00z_d01.006.grib1 WRF_HQ.t00z_d01.033.grib1
>>>>> WRF_HQ.t00z_d01.060.grib1
>>>>> WRF_HQ.t00z_d01.009.grib1 WRF_HQ.t00z_d01.036.grib1
>>>>> WRF_HQ.t00z_d01.063.grib1
>>>>> WRF_HQ.t00z_d01.012.grib1 WRF_HQ.t00z_d01.039.grib1
>>>>> WRF_HQ.t00z_d01.066.grib1
>>>>> WRF_HQ.t00z_d01.015.grib1 WRF_HQ.t00z_d01.042.grib1
>>>>> WRF_HQ.t00z_d01.069.grib1
>>>>> WRF_HQ.t00z_d01.018.grib1 WRF_HQ.t00z_d01.045.grib1
>>>>> WRF_HQ.t00z_d01.072.grib1
>>>>> WRF_HQ.t00z_d01.021.grib1 WRF_HQ.t00z_d01.048.grib1
>>>>> WRF_HQ.t00z_d01.075.grib1
>>>>> WRF_HQ.t00z_d01.024.grib1 WRF_HQ.t00z_d01.051.grib1]
>>>>>
>>>>>
>>>>>
>>>>> Error Message:
>>>>>
>>>>>
>>>>> *** Running PCP-Combine to combine 3-hourly APCP accumulation
>>>> observations
>>>>> into a single 24 hour accumulation observation ***
>>>>> Performing sum command: Init/In_Accum/Valid/Out_Accum Times =
>>>>> 20100701_000000/030000/20100701_120000/120000
>>>>> Searching for 4 files with accumulation times of 030000 to sum
to a
>> total
>>>>> accumulation time of 120000.
>>>>>
>>>>>
>>>>> ERROR: sum_grib_files() -> Cannot find a file with a valid time
of
>>>>> 20100701_120000 and accumulation time of 030000 matching the
regular
>>>>> expression ".*"
>>>>>
>>>>>
>>>>> Please help me out.
>>>>>
>>>>> Thanks and Regards,
>>>>
>>>>
>>>>
>>>
>>>
>>
>>
>>
>
>
------------------------------------------------
More information about the Met_help
mailing list