[Met_help] [rt.rap.ucar.edu #62800] History for about the out
John Halley Gotway via RT
met_help at ucar.edu
Mon Oct 14 14:21:52 MDT 2013
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Hello!
I have the result data of forecast(wrf2012072103.grb) and the observations(2012072103.nc), and all the data have transformed to METV4.0 formattion.
then I run ../bin/point_stat /public/home/cqms/lq/20120721/00Z_27km/grib/wrf2012072103.grb /public/home/cqms/lq/20120721/00Z_27km/realoutnc/time3/2012072103.nc ./config/chongqing
and get my MET output.
but there is not anything result in cnt and mpr data.
I do not know what the reason is?
all of data have attached.
could you help me ?
Qiang
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #62800] about the out
From: John Halley Gotway
Time: Mon Aug 26 15:10:08 2013
Qiang,
Basically, you're getting 0 matched pairs. Try rerunning but turning
up the verbosity level for Point-Stat using the "-v 3" option.
That'll increase the amount of logging information, including a
count of the number of observations which were/were not used for each
verification task. Here's the output for the data you sent me:
DEBUG 2: Processing APCP/A1 versus APCP/A1, for observation type
ADPSFC, over region FULL, for interpolation method UW_MEAN(1), using 0
pairs.
DEBUG 3: Number of matched pairs = 0
DEBUG 3: Observations processed = 1042
DEBUG 3: Rejected: GRIB code = 0
DEBUG 3: Rejected: valid time = 0
DEBUG 3: Rejected: bad obs value = 0
DEBUG 3: Rejected: off the grid = 0
DEBUG 3: Rejected: level mismatch = 1042
DEBUG 3: Rejected: message type = 0
DEBUG 3: Rejected: masking region = 0
DEBUG 3: Rejected: bad fcst value = 0
So Point-Stat tried to use 1042 observations, but all of them were
rejected for a "level mismatch". In your config file, I see that
you're trying to verifying 1-hourly precipitation:
name = "APCP";
level = [ "A1" ];
However, I see that your observations contain 3-hourly accumulations
(10800 seconds = 3 hours):
obs_arr =
0, 61, 10800, -9999, 0,
1, 61, 10800, -9999, 0,
2, 61, 10800, -9999, 0,
3, 61, 10800, -9999, 0,
4, 61, 10800, -9999, 0,
5, 61, 10800, -9999, 0,
6, 61, 10800, -9999, 0,
7, 61, 10800, -9999, 0,
Since you have 3-hourly observations, I'd suggest verifying 3-hourly
forecast accumulations of precip. The WRF file you sent me does
contain 3-hourly precip, so just modify the config file like this:
name = "APCP";
level = [ "A3" ];
After that change, the Point-Stat log messages should look like this:
DEBUG 2: Processing APCP/A3 versus APCP/A3, for observation type
ADPSFC, over region FULL, for interpolation method UW_MEAN(1), using
1042 pairs.
DEBUG 3: Number of matched pairs = 1042
DEBUG 3: Observations processed = 1042
DEBUG 3: Rejected: GRIB code = 0
DEBUG 3: Rejected: valid time = 0
DEBUG 3: Rejected: bad obs value = 0
DEBUG 3: Rejected: off the grid = 0
DEBUG 3: Rejected: level mismatch = 0
DEBUG 3: Rejected: message type = 0
DEBUG 3: Rejected: masking region = 0
DEBUG 3: Rejected: bad fcst value = 0
DEBUG 2: Computing Categorical Statistics.
DEBUG 2: Computing Continuous Statistics.
DEBUG 2: Computing Scalar Partial Sums.
Thanks,
John Halley Gotway
met_help at ucar.edu
On 08/26/2013 10:42 AM, Li, Qiang via RT wrote:
>
> Mon Aug 26 10:41:59 2013: Request 62800 was acted upon.
> Transaction: Ticket created by liqiang at ou.edu
> Queue: met_help
> Subject: about the out
> Owner: Nobody
> Requestors: liqiang at ou.edu
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=62800 >
>
>
> Hello!
> I have the result data of forecast(wrf2012072103.grb) and the
observations(2012072103.nc), and all the data have transformed to
METV4.0 formattion.
> then I run ../bin/point_stat
/public/home/cqms/lq/20120721/00Z_27km/grib/wrf2012072103.grb
/public/home/cqms/lq/20120721/00Z_27km/realoutnc/time3/2012072103.nc
./config/chongqing
> and get my MET output.
> but there is not anything result in cnt and mpr data.
> I do not know what the reason is?
> all of data have attached.
> could you help me ?
>
> Qiang
>
------------------------------------------------
Subject: about the out
From: Li, Qiang
Time: Mon Aug 26 16:22:47 2013
thanks you detail reply!
I follow your replay and get the result of 3 hour observation. but
when I want to verify my 1 hour observation.
I have change the config file. but there is not anything output in cnt
and mpr data.
the problem is also mismatch point. but I have checked my observations
and forecast data.
there will be some observation sations matching.
I am confused.
could you give me suggestion?
Thanks!
Qiang
________________________________________
From: John Halley Gotway via RT [met_help at ucar.edu]
Sent: Monday, August 26, 2013 4:10 PM
To: Li, Qiang
Subject: Re: [rt.rap.ucar.edu #62800] about the out
Qiang,
Basically, you're getting 0 matched pairs. Try rerunning but turning
up the verbosity level for Point-Stat using the "-v 3" option.
That'll increase the amount of logging information, including a
count of the number of observations which were/were not used for each
verification task. Here's the output for the data you sent me:
DEBUG 2: Processing APCP/A1 versus APCP/A1, for observation type
ADPSFC, over region FULL, for interpolation method UW_MEAN(1), using 0
pairs.
DEBUG 3: Number of matched pairs = 0
DEBUG 3: Observations processed = 1042
DEBUG 3: Rejected: GRIB code = 0
DEBUG 3: Rejected: valid time = 0
DEBUG 3: Rejected: bad obs value = 0
DEBUG 3: Rejected: off the grid = 0
DEBUG 3: Rejected: level mismatch = 1042
DEBUG 3: Rejected: message type = 0
DEBUG 3: Rejected: masking region = 0
DEBUG 3: Rejected: bad fcst value = 0
So Point-Stat tried to use 1042 observations, but all of them were
rejected for a "level mismatch". In your config file, I see that
you're trying to verifying 1-hourly precipitation:
name = "APCP";
level = [ "A1" ];
However, I see that your observations contain 3-hourly accumulations
(10800 seconds = 3 hours):
obs_arr =
0, 61, 10800, -9999, 0,
1, 61, 10800, -9999, 0,
2, 61, 10800, -9999, 0,
3, 61, 10800, -9999, 0,
4, 61, 10800, -9999, 0,
5, 61, 10800, -9999, 0,
6, 61, 10800, -9999, 0,
7, 61, 10800, -9999, 0,
Since you have 3-hourly observations, I'd suggest verifying 3-hourly
forecast accumulations of precip. The WRF file you sent me does
contain 3-hourly precip, so just modify the config file like this:
name = "APCP";
level = [ "A3" ];
After that change, the Point-Stat log messages should look like this:
DEBUG 2: Processing APCP/A3 versus APCP/A3, for observation type
ADPSFC, over region FULL, for interpolation method UW_MEAN(1), using
1042 pairs.
DEBUG 3: Number of matched pairs = 1042
DEBUG 3: Observations processed = 1042
DEBUG 3: Rejected: GRIB code = 0
DEBUG 3: Rejected: valid time = 0
DEBUG 3: Rejected: bad obs value = 0
DEBUG 3: Rejected: off the grid = 0
DEBUG 3: Rejected: level mismatch = 0
DEBUG 3: Rejected: message type = 0
DEBUG 3: Rejected: masking region = 0
DEBUG 3: Rejected: bad fcst value = 0
DEBUG 2: Computing Categorical Statistics.
DEBUG 2: Computing Continuous Statistics.
DEBUG 2: Computing Scalar Partial Sums.
Thanks,
John Halley Gotway
met_help at ucar.edu
On 08/26/2013 10:42 AM, Li, Qiang via RT wrote:
>
> Mon Aug 26 10:41:59 2013: Request 62800 was acted upon.
> Transaction: Ticket created by liqiang at ou.edu
> Queue: met_help
> Subject: about the out
> Owner: Nobody
> Requestors: liqiang at ou.edu
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=62800 >
>
>
> Hello!
> I have the result data of forecast(wrf2012072103.grb) and the
observations(2012072103.nc), and all the data have transformed to
METV4.0 formattion.
> then I run ../bin/point_stat
/public/home/cqms/lq/20120721/00Z_27km/grib/wrf2012072103.grb
/public/home/cqms/lq/20120721/00Z_27km/realoutnc/time3/2012072103.nc
./config/chongqing
> and get my MET output.
> but there is not anything result in cnt and mpr data.
> I do not know what the reason is?
> all of data have attached.
> could you help me ?
>
> Qiang
>
------------------------------------------------
Subject: about the out
From: Li, Qiang
Time: Mon Aug 26 16:22:47 2013
VERSION MODEL FCST_LEAD FCST_VALID_BEG FCST_VALID_END OBS_LEAD
OBS_VALID_BEG OBS_VALID_END FCST_VAR FCST_LEV OBS_VAR OBS_LEV OBTYPE
VX_MASK INTERP_MTHD INTERP_PNTS FCST_THRESH OBS_THRESH COV_THRESH
ALPHA LINE_TYPE TOTAL FBAR FBAR_NCL FBAR_NCU FBAR_BCL FBAR_BCU FSTDEV
FSTDEV_NCL FSTDEV_NCU FSTDEV_BCL FSTDEV_BCU OBAR OBAR_NCL OBAR_NCU
OBAR_BCL OBAR_BCU OSTDEV OSTDEV_NCL OSTDEV_NCU OSTDEV_BCL OSTDEV_BCU
PR_CORR PR_CORR_NCL PR_CORR_NCU PR_CORR_BCL PR_CORR_BCU SP_CORR
KT_CORR RANKS FRANK_TIES ORANK_TIES ME ME_NCL ME_NCU ME_BCL ME_BCU
ESTDEV ESTDEV_NCL ESTDEV_NCU ESTDEV_BCL ESTDEV_BCU MBIAS MBIAS_BCL
MBIAS_BCU MAE MAE_BCL MAE_BCU MSE MSE_BCL MSE_BCU BCMSE BCMSE_BCL
BCMSE_BCU RMSE RMSE_BCL RMSE_BCU E10 E10_BCL E10_BCU E25 E25_BCL
E25_BCU E50 E50_BCL E50_BCU E75 E75_BCL E75_BCU E90 E90_BCL E90_BCU
------------------------------------------------
Subject: about the out
From: Li, Qiang
Time: Mon Aug 26 16:22:47 2013
VERSION MODEL FCST_LEAD FCST_VALID_BEG FCST_VALID_END OBS_LEAD
OBS_VALID_BEG OBS_VALID_END FCST_VAR FCST_LEV OBS_VAR OBS_LEV OBTYPE
VX_MASK INTERP_MTHD INTERP_PNTS FCST_THRESH OBS_THRESH COV_THRESH
ALPHA LINE_TYPE TOTAL INDEX OBS_SID OBS_LAT OBS_LON OBS_LVL OBS_ELV
FCST OBS CLIMO
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #62800] about the out
From: John Halley Gotway
Time: Tue Aug 27 10:07:01 2013
Qiang,
Here's a selection from the log file you sent me:
DEBUG 2: Processing APCP/A1 versus APCP/A1, for observation type
ADPSFC, over region FULL, for interpolation method BILIN(4), using 0
pairs.
DEBUG 3: Number of matched pairs = 0
DEBUG 3: Observations processed = 1093
DEBUG 3: Rejected: GRIB code = 0
DEBUG 3: Rejected: valid time = 1093
DEBUG 3: Rejected: bad obs value = 0
DEBUG 3: Rejected: off the grid = 0
DEBUG 3: Rejected: level mismatch = 0
DEBUG 3: Rejected: message type = 0
DEBUG 3: Rejected: masking region = 0
DEBUG 3: Rejected: bad fcst value = 0
This is telling you that all 1093 observations of 1-hour accumulated
precipitation were not used because the valid times don't line up.
Let's look at the timing information for your data:
(1) Forecast: Run wgrib on your forecast file to determine that the
valid time is 20120721_110000. The initialization time is 2012072100
and this data contains an 11-hour forecast. That doesn't
match the 20120721_120000 date in the file name... so that's likely
your problem.
[johnhg at rambler]% wgrib -d 1 -V wrf2012072112.grb
rec 1:0:date 2012072100 APCP kpds5=61 kpds6=1 kpds7=0 levels=(0,0)
grid=255 sfc 10-11hr acc:
(2) Observation: Run ncdump to see that the valid time of your
observations is 20120721_120000.
[johnhg at rambler]% ncdump obs_2012072112.nc | grep 2012 | sort -u
"20120721_120000" ;
"20120721_120000",
(3) Matching time window: In Point-Stat, only those observations whose
valid times fall within the matching time window are used. The time
window is set by adding the "obs_window" beginning and
ending times to the forecast valid time. Looks like you've set "beg"
and "end" to 0. So you're requiring the forecast and observation
valid times to be exactly the same. I changed the time window
to +/- 3600 seconds, reran your data, and verified that we do get
matched pairs.
DEBUG 2: Processing APCP/A1 versus APCP/A1, for observation type
ADPSFC, over region FULL, for interpolation method BILIN(4), using
1086 pairs.
DEBUG 3: Number of matched pairs = 1086
DEBUG 3: Observations processed = 1093
DEBUG 3: Rejected: GRIB code = 0
DEBUG 3: Rejected: valid time = 0
DEBUG 3: Rejected: bad obs value = 7
DEBUG 3: Rejected: off the grid = 0
DEBUG 3: Rejected: level mismatch = 0
DEBUG 3: Rejected: message type = 0
DEBUG 3: Rejected: masking region = 0
DEBUG 3: Rejected: bad fcst value = 0
DEBUG 2: Computing Categorical Statistics.
DEBUG 2: Computing Continuous Statistics.
DEBUG 2: Computing Scalar Partial Sums.
Hope that helps.
Thanks,
John
On 08/26/2013 04:22 PM, Li, Qiang via RT wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=62800 >
>
> thanks you detail reply!
> I follow your replay and get the result of 3 hour observation. but
when I want to verify my 1 hour observation.
> I have change the config file. but there is not anything output in
cnt and mpr data.
> the problem is also mismatch point. but I have checked my
observations and forecast data.
> there will be some observation sations matching.
> I am confused.
> could you give me suggestion?
> Thanks!
> Qiang
>
> ________________________________________
> From: John Halley Gotway via RT [met_help at ucar.edu]
> Sent: Monday, August 26, 2013 4:10 PM
> To: Li, Qiang
> Subject: Re: [rt.rap.ucar.edu #62800] about the out
>
> Qiang,
>
> Basically, you're getting 0 matched pairs. Try rerunning but
turning up the verbosity level for Point-Stat using the "-v 3" option.
That'll increase the amount of logging information, including a
> count of the number of observations which were/were not used for
each verification task. Here's the output for the data you sent me:
>
> DEBUG 2: Processing APCP/A1 versus APCP/A1, for observation type
ADPSFC, over region FULL, for interpolation method UW_MEAN(1), using 0
pairs.
> DEBUG 3: Number of matched pairs = 0
> DEBUG 3: Observations processed = 1042
> DEBUG 3: Rejected: GRIB code = 0
> DEBUG 3: Rejected: valid time = 0
> DEBUG 3: Rejected: bad obs value = 0
> DEBUG 3: Rejected: off the grid = 0
> DEBUG 3: Rejected: level mismatch = 1042
> DEBUG 3: Rejected: message type = 0
> DEBUG 3: Rejected: masking region = 0
> DEBUG 3: Rejected: bad fcst value = 0
>
> So Point-Stat tried to use 1042 observations, but all of them were
rejected for a "level mismatch". In your config file, I see that
you're trying to verifying 1-hourly precipitation:
> name = "APCP";
> level = [ "A1" ];
>
> However, I see that your observations contain 3-hourly accumulations
(10800 seconds = 3 hours):
> obs_arr =
> 0, 61, 10800, -9999, 0,
> 1, 61, 10800, -9999, 0,
> 2, 61, 10800, -9999, 0,
> 3, 61, 10800, -9999, 0,
> 4, 61, 10800, -9999, 0,
> 5, 61, 10800, -9999, 0,
> 6, 61, 10800, -9999, 0,
> 7, 61, 10800, -9999, 0,
>
> Since you have 3-hourly observations, I'd suggest verifying 3-hourly
forecast accumulations of precip. The WRF file you sent me does
contain 3-hourly precip, so just modify the config file like this:
> name = "APCP";
> level = [ "A3" ];
>
> After that change, the Point-Stat log messages should look like
this:
> DEBUG 2: Processing APCP/A3 versus APCP/A3, for observation type
ADPSFC, over region FULL, for interpolation method UW_MEAN(1), using
1042 pairs.
> DEBUG 3: Number of matched pairs = 1042
> DEBUG 3: Observations processed = 1042
> DEBUG 3: Rejected: GRIB code = 0
> DEBUG 3: Rejected: valid time = 0
> DEBUG 3: Rejected: bad obs value = 0
> DEBUG 3: Rejected: off the grid = 0
> DEBUG 3: Rejected: level mismatch = 0
> DEBUG 3: Rejected: message type = 0
> DEBUG 3: Rejected: masking region = 0
> DEBUG 3: Rejected: bad fcst value = 0
> DEBUG 2: Computing Categorical Statistics.
> DEBUG 2: Computing Continuous Statistics.
> DEBUG 2: Computing Scalar Partial Sums.
>
>
> Thanks,
> John Halley Gotway
> met_help at ucar.edu
>
>
> On 08/26/2013 10:42 AM, Li, Qiang via RT wrote:
>>
>> Mon Aug 26 10:41:59 2013: Request 62800 was acted upon.
>> Transaction: Ticket created by liqiang at ou.edu
>> Queue: met_help
>> Subject: about the out
>> Owner: Nobody
>> Requestors: liqiang at ou.edu
>> Status: new
>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=62800 >
>>
>>
>> Hello!
>> I have the result data of forecast(wrf2012072103.grb) and the
observations(2012072103.nc), and all the data have transformed to
METV4.0 formattion.
>> then I run ../bin/point_stat
/public/home/cqms/lq/20120721/00Z_27km/grib/wrf2012072103.grb
/public/home/cqms/lq/20120721/00Z_27km/realoutnc/time3/2012072103.nc
./config/chongqing
>> and get my MET output.
>> but there is not anything result in cnt and mpr data.
>> I do not know what the reason is?
>> all of data have attached.
>> could you help me ?
>>
>> Qiang
>>
>
>
------------------------------------------------
More information about the Met_help
mailing list