[Met_help] [rt.rap.ucar.edu #63390] History for Verifying Rain Forecasts using PointStat
John Halley Gotway via RT
met_help at ucar.edu
Mon Dec 2 15:06:31 MST 2013
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Hi,
I just have a question regarding verification of precipitation forecast
using PointStat tool.
Since I have accumulated precipitation amount from simulation start, I
used pcp-combine tool to extract the accumulated precipitation amount.
Basically,I tried it first for Time = 03. And I got this nc file output:
I then modified the PointStatConfig as follows:
////////////////////////////////////////////////////////////////////////////////
//
// Point-Stat configuration file.
//
// For additional information, see the MET_BASE/data/config/README file.
//
////////////////////////////////////////////////////////////////////////////////
//
// Output model name to be written
//
model = "WRF";
////////////////////////////////////////////////////////////////////////////////
//
// Forecast and observation fields to be verified
//
fcst_field = [ "RAINC(0,*,*)", "QVAPOR(0,5,*,*)" ];
////////////////////////////////////////////////////////////////////////////////
..........and so on.
But when I ran the PoinStat tool, I am having this in my log file:
DEBUG 1: Default Config File:
/root/src/METv4.1/data/config/PointStatConfig_default
DEBUG 1: User Config File:
../../src/METv4.1/scripts/config/PointStatConfig_RAIN
WARNING:
WARNING: parse_conf_interp() -> For neareast neighbor interpolation
method, resetting method from "MIN" to "UW_MEAN" since the interpolation
width is 1.
WARNING:
GSL_RNG_TYPE=mt19937
GSL_RNG_SEED=1
DEBUG 1: Forecast File: ../INPUT/FCST/sample.nc
DEBUG 1: Climatology File: none
DEBUG 1: Observation File: ../INPUT/OBS/SURFACE_OBS_20130401.nc
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Reading data for SPFHP500.
WARNING:
WARNING: process_fcst_climo_files() -> no fields matching SPFHP500 found
in file: ../INPUT/FCST/sample.nc
WARNING:
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Reading data for TMPP500.
WARNING:
WARNING: process_fcst_climo_files() -> no fields matching TMPP500 found in
file: ../INPUT/FCST/sample.nc
WARNING:
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Reading data for HGTP500.
WARNING:
WARNING: process_fcst_climo_files() -> no fields matching HGTP500 found in
file: ../INPUT/FCST/sample.nc
WARNING:
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Reading data for UGRDP500.
WARNING:
WARNING: process_fcst_climo_files() -> no fields matching UGRDP500 found
in file: ../INPUT/FCST/sample.nc
WARNING:
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Reading data for VGRDP500.
WARNING:
WARNING: process_fcst_climo_files() -> no fields matching VGRDP500 found
in file: ../INPUT/FCST/sample.nc
WARNING:
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Searching 28295 observations from 5659 messages.
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 1: Output file: ./point_stat_-02-46-39L_19700101_000000V.stat
DEBUG 1: Output file: ./point_stat_-02-46-39L_19700101_000000V_fho.txt
DEBUG 1: Output file: ./point_stat_-02-46-39L_19700101_000000V_ctc.txt
DEBUG 1: Output file: ./point_stat_-02-46-39L_19700101_000000V_cts.txt
DEBUG 1: Output file: ./point_stat_-02-46-39L_19700101_000000V_cnt.txt
DEBUG 1: Output file: ./point_stat_-02-46-39L_19700101_000000V_sl1l2.txt
DEBUG 1: Output file: ./point_stat_-02-46-39L_19700101_000000V_sal1l2.txt
DEBUG 1: Output file: ./point_stat_-02-46-39L_19700101_000000V_vl1l2.txt
DEBUG 1: Output file: ./point_stat_-02-46-39L_19700101_000000V_val1l2.txt
DEBUG 1: Output file: ./point_stat_-02-46-39L_19700101_000000V_mpr.txt
I am just wondering why it is not analyzing precipitation amount.
(Instead, it tried to look for temp, pressure, etc.)
Is there a step that I missed?
Thanks!
Vladimir A. Malabanan
3F IBM Bldg J, UP Ayala Technohub
Applications Programmer
Advanced Analytics - Data Specialist
Diliman, Quezon City
IBM Solutions Delivery, Inc.
Philippines
Global Delivery Center
Phone:
+632-995-2IBM local 8639
e-mail:
malabava at ph.ibm.com
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #63390] Verifying Rain Forecasts using PointStat
From: John Halley Gotway
Time: Mon Oct 14 14:05:28 2013
Vladamir,
The configuration file you pass to point-stat tells the tool what you
want it to do. It looks like you passed the tool this configuration
file:
../../src/METv4.1/scripts/config/PointStatConfig_RAIN
And I suspect that you've included the following line in that file:
fcst_field = [ "RAINC(0,*,*)", "QVAPOR(0,5,*,*)" ];
As of METv4.0, the structure of the MET configuration files has
changed a lot. Please take a look in
"METv4.1/scripts/config/PointStatConfig" to see an example of the
current config file structure.
The setting "fcst_field" is not used anymore - instead, there's a
"fcst" dictionary that includes a "field" array for specifying which
fields should be verified. You can read more about the config
file structure in METv4.1/data/config/README.
Here's what's happening in your case...
(1) Point-Stat is reading information from the default config file
(/root/src/METv4.1/data/config/PointStatConfig_default).
(2) Then it's reading the config file you passed it
(../../src/METv4.1/scripts/config/PointStatConfig_RAIN).
(3) Since you're using old settings, they are not overriding the
default values. So the defaults are being used in the Point-Stat run.
Please try to update the Point-Stat config file following the pattern
of the new settings. They should look something like this:
fcst = {
wind_thresh = [ NA ];
message_type = [ "ADPSFC" ];
field = [
{
name = "APCP_03"; // the name of netcdf field to be
used
level = [ "(*,*)" ]; // the netcdf levels that define
the grid
cat_thresh = [ >0 ];
}
];
};
Just let me know if you get stuck.
Thanks,
John
On 10/13/2013 07:53 PM, Vladimir A Malabanan via RT wrote:
>
> Sun Oct 13 19:53:04 2013: Request 63390 was acted upon.
> Transaction: Ticket created by vlad.malabanan at ph.ibm.com
> Queue: met_help
> Subject: Verifying Rain Forecasts using PointStat
> Owner: Nobody
> Requestors: vlad.malabanan at ph.ibm.com
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=63390 >
>
>
> Hi,
>
> I just have a question regarding verification of precipitation
forecast
> using PointStat tool.
>
> Since I have accumulated precipitation amount from simulation start,
I
> used pcp-combine tool to extract the accumulated precipitation
amount.
> Basically,I tried it first for Time = 03. And I got this nc file
output:
>
>
>
> I then modified the PointStatConfig as follows:
>
>
////////////////////////////////////////////////////////////////////////////////
> //
> // Point-Stat configuration file.
> //
> // For additional information, see the MET_BASE/data/config/README
file.
> //
>
////////////////////////////////////////////////////////////////////////////////
>
> //
> // Output model name to be written
> //
> model = "WRF";
>
>
////////////////////////////////////////////////////////////////////////////////
>
> //
> // Forecast and observation fields to be verified
> //
>
> fcst_field = [ "RAINC(0,*,*)", "QVAPOR(0,5,*,*)" ];
>
>
>
>
////////////////////////////////////////////////////////////////////////////////
> ..........and so on.
>
> But when I ran the PoinStat tool, I am having this in my log file:
>
> DEBUG 1: Default Config File:
> /root/src/METv4.1/data/config/PointStatConfig_default
> DEBUG 1: User Config File:
> ../../src/METv4.1/scripts/config/PointStatConfig_RAIN
> WARNING:
> WARNING: parse_conf_interp() -> For neareast neighbor interpolation
> method, resetting method from "MIN" to "UW_MEAN" since the
interpolation
> width is 1.
> WARNING:
> GSL_RNG_TYPE=mt19937
> GSL_RNG_SEED=1
> DEBUG 1: Forecast File: ../INPUT/FCST/sample.nc
> DEBUG 1: Climatology File: none
> DEBUG 1: Observation File: ../INPUT/OBS/SURFACE_OBS_20130401.nc
> DEBUG 2:
> DEBUG 2:
>
--------------------------------------------------------------------------------
> DEBUG 2:
> DEBUG 2: Reading data for SPFHP500.
> WARNING:
> WARNING: process_fcst_climo_files() -> no fields matching SPFHP500
found
> in file: ../INPUT/FCST/sample.nc
> WARNING:
> DEBUG 2:
> DEBUG 2:
>
--------------------------------------------------------------------------------
> DEBUG 2:
> DEBUG 2: Reading data for TMPP500.
> WARNING:
> WARNING: process_fcst_climo_files() -> no fields matching TMPP500
found in
> file: ../INPUT/FCST/sample.nc
> WARNING:
> DEBUG 2:
> DEBUG 2:
>
--------------------------------------------------------------------------------
> DEBUG 2:
> DEBUG 2: Reading data for HGTP500.
> WARNING:
> WARNING: process_fcst_climo_files() -> no fields matching HGTP500
found in
> file: ../INPUT/FCST/sample.nc
> WARNING:
> DEBUG 2:
> DEBUG 2:
>
--------------------------------------------------------------------------------
> DEBUG 2:
> DEBUG 2: Reading data for UGRDP500.
> WARNING:
> WARNING: process_fcst_climo_files() -> no fields matching UGRDP500
found
> in file: ../INPUT/FCST/sample.nc
> WARNING:
> DEBUG 2:
> DEBUG 2:
>
--------------------------------------------------------------------------------
> DEBUG 2:
> DEBUG 2: Reading data for VGRDP500.
> WARNING:
> WARNING: process_fcst_climo_files() -> no fields matching VGRDP500
found
> in file: ../INPUT/FCST/sample.nc
> WARNING:
> DEBUG 2:
> DEBUG 2:
>
--------------------------------------------------------------------------------
> DEBUG 2:
> DEBUG 2: Searching 28295 observations from 5659 messages.
> DEBUG 2:
> DEBUG 2:
>
--------------------------------------------------------------------------------
> DEBUG 2:
> DEBUG 1: Output file: ./point_stat_-02-46-39L_19700101_000000V.stat
> DEBUG 1: Output file: ./point_stat_-02-46-
39L_19700101_000000V_fho.txt
> DEBUG 1: Output file: ./point_stat_-02-46-
39L_19700101_000000V_ctc.txt
> DEBUG 1: Output file: ./point_stat_-02-46-
39L_19700101_000000V_cts.txt
> DEBUG 1: Output file: ./point_stat_-02-46-
39L_19700101_000000V_cnt.txt
> DEBUG 1: Output file: ./point_stat_-02-46-
39L_19700101_000000V_sl1l2.txt
> DEBUG 1: Output file: ./point_stat_-02-46-
39L_19700101_000000V_sal1l2.txt
> DEBUG 1: Output file: ./point_stat_-02-46-
39L_19700101_000000V_vl1l2.txt
> DEBUG 1: Output file: ./point_stat_-02-46-
39L_19700101_000000V_val1l2.txt
> DEBUG 1: Output file: ./point_stat_-02-46-
39L_19700101_000000V_mpr.txt
>
> I am just wondering why it is not analyzing precipitation amount.
> (Instead, it tried to look for temp, pressure, etc.)
>
> Is there a step that I missed?
>
> Thanks!
>
>
> Vladimir A. Malabanan
> 3F IBM Bldg J, UP Ayala Technohub
>
> Applications Programmer
> Advanced Analytics - Data Specialist
> Diliman, Quezon City
> IBM Solutions Delivery, Inc.
> Philippines
> Global Delivery Center
>
>
> Phone:
> +632-995-2IBM local 8639
>
>
> e-mail:
> malabava at ph.ibm.com
>
>
>
>
>
>
------------------------------------------------
More information about the Met_help
mailing list