[Met_help] Problems running grid_stat

[John Halley Gotway]

Ellen,

Glad that did the trick.  Turning off the "rank_corr_flag" disables the
computation of the rank correlation coefficients which is rather computing
intensive for what seems to be a seldom used statistic.  We should really
make that the default for Grid-Stat.

It could be taking a while to parse the "west" polyline.  For a dense
grid, it takes a while to check if each point is inside or outside the
polyline.  It's fine to use a detailed polyline, but it's best to run it
through the "gen_poly_mask" tool to great a bitmap mask for your domain.

But I'm guessing it was the rank_corr_flag that was mostly slowing you down.

Thanks,
John

> It worked! Thank you!
>
> Have a great weekend,
> Ellen
>
> John Halley Gotway wrote:
>> Hi Ellen,
>>
>> So it sounds like your Grid-Stat run just hangs and never actually
>> completes.  I took a look in the configuration file you're using and saw
>> that you have "n_boot_rep = 0;" which is good.  That means we won't
>> bootstrap the stats, which for 462116 pairs would sure take a long time.
>>
>> Here's what I'd recommend though - try doing the following 2 things:
>> (1) Turn off the rank correlation flag.  So set "rank_corr_flag = 0;".
>> (2) Try just using the "FULL" domain and not using the WEST polyline.
>> So
>> set "mask_poly[] = [];"
>>
>> Give that a shot and let me know if it runs OK for you.  If so, try
>> adding
>> back in the WEST polyline.
>>
>> Thanks,
>> John
>>
>>
>>> Hi,
>>>
>>> I am trying to run grid_stat on two QPE files (30 and 31 December 2005)
>>> to just see if I can get the tool to work. The two *.nc files I am
>>> using
>>> were combined into 24-h accumulations using pcp_combine on 6-hourly
>>> grib
>>> files.  (I checked the QPE files and data does exist in the files.)
>>> However, when I try to run grid stat on these QPE files, grid_stat runs
>>> until "Computing Continuous Statistics" appears on the command line and
>>> then gets hung up.
>>>
>>> Here is the command line input I am using and the subsequent output:
>>> [esukovich at lightning QPE]$ grid_stat QPE_20051231_00_pcp.nc
>>> QPE_20051230_00_pcp.nc GridStatConfig_CNRFC -outdir
>>> /home/esukovich/DATA/QPE
>>> GSL_RNG_TYPE=mt19937
>>> GSL_RNG_SEED=1524621386
>>> Forecast File: QPE_20051231_00_pcp.nc
>>> Observation File: QPE_20051230_00_pcp.nc
>>> Configuration File: GridStatConfig_CNRFC
>>> ***WARNING***: process_scores() -> Forecast and observation valid times
>>> do not match 1136116800 != 1136030400 for field 1.
>>>
>>>
>>> ----------------------------------------
>>>
>>> Processing APCP_24/A24 versus APCP_24/A24, for interpolation method
>>> UW_MEAN(1), over region FULL, using 462116 pairs.
>>> Computing Categorical Statistics.
>>> Computing Continuous Statistics.
>>>
>>>
>>> The following files gets output into the directory I chose however they
>>> are all empty:
>>> -rw-r--r-- 1 esukovich PSD2Group 0 Oct 22 16:40
>>> grid_stat_240000L_20060101_120000V_cnt.txt
>>> -rw-r--r-- 1 esukovich PSD2Group 0 Oct 22 16:40
>>> grid_stat_240000L_20060101_120000V_cts.txt
>>> -rw-r--r-- 1 esukovich PSD2Group 0 Oct 22 16:40
>>> grid_stat_240000L_20060101_120000V.stat
>>>
>>> I am attaching my two nc files and my configuration file. I am assuming
>>> I am just doing something incorrectly in my config file.
>>>
>>> Thanks so much for your help!
>>> Ellen
>>>
>>> --
>>> Ellen Sukovich
>>> University of Colorado,
>>> Cooperative Institute for Research in Environmental Sciences (CIRES),
>>> and NOAA Earth System Research Laboratory (ESRL)
>>> Mail Code: R/PSD2
>>> 325 Broadway Street
>>> Boulder, CO 80305
>>> Phone: 303.497.4811
>>> Fax: 303.497.6101
>>> Email: ellen.sukovich at noaa.gov
>>>
>>> _______________________________________________
>>> Met_help mailing list
>>> Met_help at mailman.ucar.edu
>>> http://mailman.ucar.edu/mailman/listinfo/met_help
>>>
>>>
>>
>>
>>
>
> --
> Ellen Sukovich
> University of Colorado,
> Cooperative Institute for Research in Environmental Sciences (CIRES),
> and NOAA Earth System Research Laboratory (ESRL)
> Mail Code: R/PSD2
> 325 Broadway Street
> Boulder, CO 80305
> Phone: 303.497.4811
> Fax: 303.497.6101
> Email: ellen.sukovich at noaa.gov
>