[Met_help] [rt.rap.ucar.edu #63390] History for Verifying Rain Forecasts using PointStat

John Halley Gotway via RT met_help at ucar.edu
Mon Dec 2 15:06:31 MST 2013


----------------------------------------------------------------
  Initial Request
----------------------------------------------------------------

Hi,

I just have a question regarding verification of precipitation forecast 
using PointStat tool.

Since I have accumulated precipitation amount from simulation start, I 
used pcp-combine tool to extract the accumulated precipitation amount. 
Basically,I tried it first for Time = 03. And I got this nc file output:



I then modified the PointStatConfig as follows:

////////////////////////////////////////////////////////////////////////////////
//
// Point-Stat configuration file.
//
// For additional information, see the MET_BASE/data/config/README file.
//
////////////////////////////////////////////////////////////////////////////////

//
// Output model name to be written
//
model = "WRF";

////////////////////////////////////////////////////////////////////////////////

//
// Forecast and observation fields to be verified
//

fcst_field = [ "RAINC(0,*,*)", "QVAPOR(0,5,*,*)" ];



////////////////////////////////////////////////////////////////////////////////
..........and so on.

But when I ran the PoinStat tool, I am having this in my log file:

DEBUG 1: Default Config File: 
/root/src/METv4.1/data/config/PointStatConfig_default
DEBUG 1: User Config File: 
../../src/METv4.1/scripts/config/PointStatConfig_RAIN
WARNING:
WARNING: parse_conf_interp() -> For neareast neighbor interpolation 
method, resetting method from "MIN" to "UW_MEAN" since the interpolation 
width is 1.
WARNING:
GSL_RNG_TYPE=mt19937
GSL_RNG_SEED=1
DEBUG 1: Forecast File: ../INPUT/FCST/sample.nc
DEBUG 1: Climatology File: none
DEBUG 1: Observation File: ../INPUT/OBS/SURFACE_OBS_20130401.nc
DEBUG 2:
DEBUG 2: 
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Reading data for SPFHP500.
WARNING:
WARNING: process_fcst_climo_files() -> no fields matching SPFHP500 found 
in file: ../INPUT/FCST/sample.nc
WARNING:
DEBUG 2:
DEBUG 2: 
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Reading data for TMPP500.
WARNING:
WARNING: process_fcst_climo_files() -> no fields matching TMPP500 found in 
file: ../INPUT/FCST/sample.nc
WARNING:
DEBUG 2:
DEBUG 2: 
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Reading data for HGTP500.
WARNING:
WARNING: process_fcst_climo_files() -> no fields matching HGTP500 found in 
file: ../INPUT/FCST/sample.nc
WARNING:
DEBUG 2:
DEBUG 2: 
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Reading data for UGRDP500.
WARNING:
WARNING: process_fcst_climo_files() -> no fields matching UGRDP500 found 
in file: ../INPUT/FCST/sample.nc
WARNING:
DEBUG 2:
DEBUG 2: 
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Reading data for VGRDP500.
WARNING:
WARNING: process_fcst_climo_files() -> no fields matching VGRDP500 found 
in file: ../INPUT/FCST/sample.nc
WARNING:
DEBUG 2:
DEBUG 2: 
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Searching 28295 observations from 5659 messages.
DEBUG 2:
DEBUG 2: 
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 1: Output file: ./point_stat_-02-46-39L_19700101_000000V.stat
DEBUG 1: Output file: ./point_stat_-02-46-39L_19700101_000000V_fho.txt
DEBUG 1: Output file: ./point_stat_-02-46-39L_19700101_000000V_ctc.txt
DEBUG 1: Output file: ./point_stat_-02-46-39L_19700101_000000V_cts.txt
DEBUG 1: Output file: ./point_stat_-02-46-39L_19700101_000000V_cnt.txt
DEBUG 1: Output file: ./point_stat_-02-46-39L_19700101_000000V_sl1l2.txt
DEBUG 1: Output file: ./point_stat_-02-46-39L_19700101_000000V_sal1l2.txt
DEBUG 1: Output file: ./point_stat_-02-46-39L_19700101_000000V_vl1l2.txt
DEBUG 1: Output file: ./point_stat_-02-46-39L_19700101_000000V_val1l2.txt
DEBUG 1: Output file: ./point_stat_-02-46-39L_19700101_000000V_mpr.txt

I am just wondering why it is not analyzing precipitation amount. 
(Instead, it tried to look for temp, pressure, etc.)

Is there a step that I missed?

Thanks!


Vladimir A. Malabanan
 3F IBM Bldg J, UP Ayala Technohub

Applications Programmer
Advanced Analytics - Data Specialist
 Diliman, Quezon City
IBM Solutions Delivery, Inc.
 Philippines
Global Delivery Center
 

Phone:
+632-995-2IBM local 8639
 

e-mail:
malabava at ph.ibm.com
 


 



----------------------------------------------------------------
  Complete Ticket History
----------------------------------------------------------------

Subject: Re: [rt.rap.ucar.edu #63390] Verifying Rain Forecasts using PointStat
From: John Halley Gotway
Time: Mon Oct 14 14:05:28 2013

Vladamir,

The configuration file you pass to point-stat tells the tool what you
want it to do.  It looks like you passed the tool this configuration
file:
    ../../src/METv4.1/scripts/config/PointStatConfig_RAIN

And I suspect that you've included the following line in that file:
    fcst_field = [ "RAINC(0,*,*)", "QVAPOR(0,5,*,*)" ];

As of METv4.0, the structure of the MET configuration files has
changed a lot.  Please take a look in
"METv4.1/scripts/config/PointStatConfig" to see an example of the
current config file structure.
The setting "fcst_field" is not used anymore - instead, there's a
"fcst" dictionary that includes a "field" array for specifying which
fields should be verified.  You can read more about the config
file structure in METv4.1/data/config/README.

Here's what's happening in your case...
(1) Point-Stat is reading information from the default config file
(/root/src/METv4.1/data/config/PointStatConfig_default).
(2) Then it's reading the config file you passed it
(../../src/METv4.1/scripts/config/PointStatConfig_RAIN).
(3) Since you're using old settings, they are not overriding the
default values.  So the defaults are being used in the Point-Stat run.

Please try to update the Point-Stat config file following the pattern
of the new settings.  They should look something like this:

fcst = {
    wind_thresh  = [ NA ];
    message_type = [ "ADPSFC" ];

    field = [
       {
         name       = "APCP_03";    // the name of netcdf field to be
used
         level      = [ "(*,*)" ];  // the netcdf levels that define
the grid
         cat_thresh = [ >0 ];
       }
    ];
};

Just let me know if you get stuck.

Thanks,
John


On 10/13/2013 07:53 PM, Vladimir A Malabanan via RT wrote:
>
> Sun Oct 13 19:53:04 2013: Request 63390 was acted upon.
> Transaction: Ticket created by vlad.malabanan at ph.ibm.com
>         Queue: met_help
>       Subject: Verifying Rain Forecasts using PointStat
>         Owner: Nobody
>    Requestors: vlad.malabanan at ph.ibm.com
>        Status: new
>   Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=63390 >
>
>
> Hi,
>
> I just have a question regarding verification of precipitation
forecast
> using PointStat tool.
>
> Since I have accumulated precipitation amount from simulation start,
I
> used pcp-combine tool to extract the accumulated precipitation
amount.
> Basically,I tried it first for Time = 03. And I got this nc file
output:
>
>
>
> I then modified the PointStatConfig as follows:
>
>
////////////////////////////////////////////////////////////////////////////////
> //
> // Point-Stat configuration file.
> //
> // For additional information, see the MET_BASE/data/config/README
file.
> //
>
////////////////////////////////////////////////////////////////////////////////
>
> //
> // Output model name to be written
> //
> model = "WRF";
>
>
////////////////////////////////////////////////////////////////////////////////
>
> //
> // Forecast and observation fields to be verified
> //
>
> fcst_field = [ "RAINC(0,*,*)", "QVAPOR(0,5,*,*)" ];
>
>
>
>
////////////////////////////////////////////////////////////////////////////////
> ..........and so on.
>
> But when I ran the PoinStat tool, I am having this in my log file:
>
> DEBUG 1: Default Config File:
> /root/src/METv4.1/data/config/PointStatConfig_default
> DEBUG 1: User Config File:
> ../../src/METv4.1/scripts/config/PointStatConfig_RAIN
> WARNING:
> WARNING: parse_conf_interp() -> For neareast neighbor interpolation
> method, resetting method from "MIN" to "UW_MEAN" since the
interpolation
> width is 1.
> WARNING:
> GSL_RNG_TYPE=mt19937
> GSL_RNG_SEED=1
> DEBUG 1: Forecast File: ../INPUT/FCST/sample.nc
> DEBUG 1: Climatology File: none
> DEBUG 1: Observation File: ../INPUT/OBS/SURFACE_OBS_20130401.nc
> DEBUG 2:
> DEBUG 2:
>
--------------------------------------------------------------------------------
> DEBUG 2:
> DEBUG 2: Reading data for SPFHP500.
> WARNING:
> WARNING: process_fcst_climo_files() -> no fields matching SPFHP500
found
> in file: ../INPUT/FCST/sample.nc
> WARNING:
> DEBUG 2:
> DEBUG 2:
>
--------------------------------------------------------------------------------
> DEBUG 2:
> DEBUG 2: Reading data for TMPP500.
> WARNING:
> WARNING: process_fcst_climo_files() -> no fields matching TMPP500
found in
> file: ../INPUT/FCST/sample.nc
> WARNING:
> DEBUG 2:
> DEBUG 2:
>
--------------------------------------------------------------------------------
> DEBUG 2:
> DEBUG 2: Reading data for HGTP500.
> WARNING:
> WARNING: process_fcst_climo_files() -> no fields matching HGTP500
found in
> file: ../INPUT/FCST/sample.nc
> WARNING:
> DEBUG 2:
> DEBUG 2:
>
--------------------------------------------------------------------------------
> DEBUG 2:
> DEBUG 2: Reading data for UGRDP500.
> WARNING:
> WARNING: process_fcst_climo_files() -> no fields matching UGRDP500
found
> in file: ../INPUT/FCST/sample.nc
> WARNING:
> DEBUG 2:
> DEBUG 2:
>
--------------------------------------------------------------------------------
> DEBUG 2:
> DEBUG 2: Reading data for VGRDP500.
> WARNING:
> WARNING: process_fcst_climo_files() -> no fields matching VGRDP500
found
> in file: ../INPUT/FCST/sample.nc
> WARNING:
> DEBUG 2:
> DEBUG 2:
>
--------------------------------------------------------------------------------
> DEBUG 2:
> DEBUG 2: Searching 28295 observations from 5659 messages.
> DEBUG 2:
> DEBUG 2:
>
--------------------------------------------------------------------------------
> DEBUG 2:
> DEBUG 1: Output file: ./point_stat_-02-46-39L_19700101_000000V.stat
> DEBUG 1: Output file: ./point_stat_-02-46-
39L_19700101_000000V_fho.txt
> DEBUG 1: Output file: ./point_stat_-02-46-
39L_19700101_000000V_ctc.txt
> DEBUG 1: Output file: ./point_stat_-02-46-
39L_19700101_000000V_cts.txt
> DEBUG 1: Output file: ./point_stat_-02-46-
39L_19700101_000000V_cnt.txt
> DEBUG 1: Output file: ./point_stat_-02-46-
39L_19700101_000000V_sl1l2.txt
> DEBUG 1: Output file: ./point_stat_-02-46-
39L_19700101_000000V_sal1l2.txt
> DEBUG 1: Output file: ./point_stat_-02-46-
39L_19700101_000000V_vl1l2.txt
> DEBUG 1: Output file: ./point_stat_-02-46-
39L_19700101_000000V_val1l2.txt
> DEBUG 1: Output file: ./point_stat_-02-46-
39L_19700101_000000V_mpr.txt
>
> I am just wondering why it is not analyzing precipitation amount.
> (Instead, it tried to look for temp, pressure, etc.)
>
> Is there a step that I missed?
>
> Thanks!
>
>
> Vladimir A. Malabanan
>   3F IBM Bldg J, UP Ayala Technohub
>
> Applications Programmer
> Advanced Analytics - Data Specialist
>   Diliman, Quezon City
> IBM Solutions Delivery, Inc.
>   Philippines
> Global Delivery Center
>
>
> Phone:
> +632-995-2IBM local 8639
>
>
> e-mail:
> malabava at ph.ibm.com
>
>
>
>
>
>

------------------------------------------------


More information about the Met_help mailing list