[Met_help] [rt.rap.ucar.edu #62602] History for grid_stats output
John Halley Gotway via RT
met_help at ucar.edu
Tue Aug 27 11:00:24 MDT 2013
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Hi:
I'm running grid_stats, and am having a bit of difficulty.
Specifically, I get no error messages and I get the correct number of
output files, but some of the output files contain no data. I have set:
output_flag = {
fho = NONE;
ctc = NONE;
cts = NONE;
mctc = NONE;
mcts = NONE;
cnt = NONE;
sl1l2 = NONE;
vl1l2 = NONE;
pct = BOTH;
pstd = BOTH;
pjc = BOTH;
prc = BOTH;
nbrctc = BOTH;
nbrcts = BOTH;
nbrcnt = BOTH;
};
All the probability files come out with only a header and no data. In
searching the online information, I haven't been able to figure out what
I'm doing wrong to cause this. Is there anyone you could point me to
who might be able to help?
Thanks,
Christina
--
******************************************
Christina Kalb
Associate Scientist
National Center for Atmospheric Research
3450 Mitchell Lane
Boulder, CO 80301
email: kalb at ucar.edu
******************************************
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: grid_stats output
From: John Halley Gotway
Time: Tue Aug 13 08:02:39 2013
Christina,
I'm in the office today, so you could come by and we could work
through the issues. I've attached an example Grid-Stat config file
for verifying probabilities from the test scripts that are
distributed with the MET tarball. You'll notice the following:
(1) In the "fcst" section, you need to set the "prob" flag to TRUE to
tell Grid-Stat that this is a probabilistic field.
(2) In the "fcst" section, the list of "cat_thresh" thresholds must
start at 0 and end at 1 and all be of the same type (e.g. >=).
(3) In the "obs" section, you should specify a single threshold to
define the event for which the probability is defined.
These multiple forecast thresholds and single observation threshold
define an Nx2 contingency table. And the probabilistic statistics are
derived from that table.
But if you have more questions, it'd probably be quicker to just work
through them in person.
Thanks,
John
On 08/12/2013 03:44 PM, Christina Kalb via RT wrote:
>
> Mon Aug 12 15:44:25 2013: Request 62602 was acted upon.
> Transaction: Ticket created by kalb
> Queue: met_help
> Subject: grid_stats output
> Owner: Nobody
> Requestors: kalb at ucar.edu
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=62602 >
>
>
> Hi:
>
> I'm running grid_stats, and am having a bit of difficulty.
> Specifically, I get no error messages and I get the correct number
of
> output files, but some of the output files contain no data. I have
set:
>
> output_flag = {
> fho = NONE;
> ctc = NONE;
> cts = NONE;
> mctc = NONE;
> mcts = NONE;
> cnt = NONE;
> sl1l2 = NONE;
> vl1l2 = NONE;
> pct = BOTH;
> pstd = BOTH;
> pjc = BOTH;
> prc = BOTH;
> nbrctc = BOTH;
> nbrcts = BOTH;
> nbrcnt = BOTH;
> };
>
> All the probability files come out with only a header and no data.
In
> searching the online information, I haven't been able to figure out
what
> I'm doing wrong to cause this. Is there anyone you could point me
to
> who might be able to help?
>
> Thanks,
> Christina
>
------------------------------------------------
Subject: grid_stats output
From: John Halley Gotway
Time: Tue Aug 13 08:02:39 2013
////////////////////////////////////////////////////////////////////////////////
//
// Grid-Stat configuration file.
//
// For additional information, see the MET_BASE/data/config/README
file.
//
////////////////////////////////////////////////////////////////////////////////
//
// Output model name to be written
//
model = "WRF";
////////////////////////////////////////////////////////////////////////////////
//
// Forecast and observation fields to be verified
//
fcst = {
wind_thresh = [ NA ];
field = [
{
name = "POP";
level = [ "L0" ];
prob = TRUE;
cat_thresh = [ >=0.0, >=0.1, >=0.2, >=0.3, >=0.4, >=0.5,
>=0.6, >=0.7, >=0.8, >=0.9, >=1.0 ];
}
];
};
obs = {
wind_thresh = [ NA ];
field = [
{
name = "APCP_12";
level = [ "(*,*)" ];
cat_thresh = [ >=0.001 ];
}
];
};
////////////////////////////////////////////////////////////////////////////////
//
// Verification masking regions
//
mask = {
grid = [ "DTC165", "DTC166" ];
poly = [];
};
////////////////////////////////////////////////////////////////////////////////
//
// Confidence interval settings
//
ci_alpha = [ 0.10, 0.05 ];
boot = {
interval = PCTILE;
rep_prop = 1.0;
n_rep = 0;
rng = "mt19937";
seed = "1";
};
////////////////////////////////////////////////////////////////////////////////
//
// Interpolation methods
//
interp = {
field = FCST;
vld_thresh = 1.0;
type = [
{
method = UW_MEAN;
width = 1;
}
];
};
////////////////////////////////////////////////////////////////////////////////
//
// Neighborhood methods
//
nbrhd = {
vld_thresh = 1.0;
width = [ 1 ];
cov_thresh = [ >=0.5 ];
}
////////////////////////////////////////////////////////////////////////////////
//
// Statistical output types
//
output_flag = {
fho = NONE;
ctc = NONE;
cts = NONE;
mctc = NONE;
mcts = NONE;
cnt = NONE;
sl1l2 = NONE;
vl1l2 = NONE;
pct = BOTH;
pstd = BOTH;
pjc = BOTH;
prc = BOTH;
nbrctc = NONE;
nbrcts = NONE;
nbrcnt = NONE;
};
//
// NetCDF matched pairs output file
//
nc_pairs_flag = TRUE;
////////////////////////////////////////////////////////////////////////////////
rank_corr_flag = FALSE;
tmp_dir = "/tmp";
output_prefix = "POP_12";
version = "V4.1";
////////////////////////////////////////////////////////////////////////////////
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #62602] grid_stats output
From: Christina Kalb
Time: Tue Aug 13 11:21:42 2013
Hi John:
I didn't realize that probabilities had to start at 0 and end with 1.
In any case, every time I only set a single threshold in the obs
section, I get the error:
ERROR : GridStatConfInfo::process_config() -> The number of
thresholds
for each field in "fcst.cat_thresh" must match the number of
thresholds
for each field in "obs.cat_thresh".
I'd be happy to stop down if that's easier. Just let me know what
time
works best. I'll be around all day.
Thanks,
Christina
On 08/13/2013 08:02 AM, John Halley Gotway via RT wrote:
> Christina,
>
> I'm in the office today, so you could come by and we could work
through the issues. I've attached an example Grid-Stat config file
for verifying probabilities from the test scripts that are
> distributed with the MET tarball. You'll notice the following:
> (1) In the "fcst" section, you need to set the "prob" flag to TRUE
to tell Grid-Stat that this is a probabilistic field.
> (2) In the "fcst" section, the list of "cat_thresh" thresholds must
start at 0 and end at 1 and all be of the same type (e.g. >=).
> (3) In the "obs" section, you should specify a single threshold to
define the event for which the probability is defined.
>
> These multiple forecast thresholds and single observation threshold
define an Nx2 contingency table. And the probabilistic statistics are
derived from that table.
>
> But if you have more questions, it'd probably be quicker to just
work through them in person.
>
> Thanks,
> John
>
> On 08/12/2013 03:44 PM, Christina Kalb via RT wrote:
>>
>> Mon Aug 12 15:44:25 2013: Request 62602 was acted upon.
>> Transaction: Ticket created by kalb
>> Queue: met_help
>> Subject: grid_stats output
>> Owner: Nobody
>> Requestors: kalb at ucar.edu
>> Status: new
>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=62602 >
>>
>>
>> Hi:
>>
>> I'm running grid_stats, and am having a bit of difficulty.
>> Specifically, I get no error messages and I get the correct number
of
>> output files, but some of the output files contain no data. I have
set:
>>
>> output_flag = {
>> fho = NONE;
>> ctc = NONE;
>> cts = NONE;
>> mctc = NONE;
>> mcts = NONE;
>> cnt = NONE;
>> sl1l2 = NONE;
>> vl1l2 = NONE;
>> pct = BOTH;
>> pstd = BOTH;
>> pjc = BOTH;
>> prc = BOTH;
>> nbrctc = BOTH;
>> nbrcts = BOTH;
>> nbrcnt = BOTH;
>> };
>>
>> All the probability files come out with only a header and no data.
In
>> searching the online information, I haven't been able to figure out
what
>> I'm doing wrong to cause this. Is there anyone you could point me
to
>> who might be able to help?
>>
>> Thanks,
>> Christina
>>
>
--
******************************************
Christina Kalb
Associate Scientist
National Center for Atmospheric Research
3450 Mitchell Lane
Boulder, CO 80301
email: kalb at ucar.edu
******************************************
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #62602] grid_stats output
From: John Halley Gotway
Time: Tue Aug 13 13:00:08 2013
Christina,
How about 1:30pm? Does that work? And can you put the sample data
(fcst, obs, config file) on scratch?
Thanks,
John
On 08/13/2013 11:21 AM, Christina Kalb via RT wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=62602 >
>
> Hi John:
>
> I didn't realize that probabilities had to start at 0 and end with
1.
> In any case, every time I only set a single threshold in the obs
> section, I get the error:
>
> ERROR : GridStatConfInfo::process_config() -> The number of
thresholds
> for each field in "fcst.cat_thresh" must match the number of
thresholds
> for each field in "obs.cat_thresh".
>
> I'd be happy to stop down if that's easier. Just let me know what
time
> works best. I'll be around all day.
>
> Thanks,
> Christina
>
> On 08/13/2013 08:02 AM, John Halley Gotway via RT wrote:
>> Christina,
>>
>> I'm in the office today, so you could come by and we could work
through the issues. I've attached an example Grid-Stat config file
for verifying probabilities from the test scripts that are
>> distributed with the MET tarball. You'll notice the following:
>> (1) In the "fcst" section, you need to set the "prob" flag to TRUE
to tell Grid-Stat that this is a probabilistic field.
>> (2) In the "fcst" section, the list of "cat_thresh" thresholds must
start at 0 and end at 1 and all be of the same type (e.g. >=).
>> (3) In the "obs" section, you should specify a single threshold to
define the event for which the probability is defined.
>>
>> These multiple forecast thresholds and single observation threshold
define an Nx2 contingency table. And the probabilistic statistics are
derived from that table.
>>
>> But if you have more questions, it'd probably be quicker to just
work through them in person.
>>
>> Thanks,
>> John
>>
>> On 08/12/2013 03:44 PM, Christina Kalb via RT wrote:
>>>
>>> Mon Aug 12 15:44:25 2013: Request 62602 was acted upon.
>>> Transaction: Ticket created by kalb
>>> Queue: met_help
>>> Subject: grid_stats output
>>> Owner: Nobody
>>> Requestors: kalb at ucar.edu
>>> Status: new
>>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=62602 >
>>>
>>>
>>> Hi:
>>>
>>> I'm running grid_stats, and am having a bit of difficulty.
>>> Specifically, I get no error messages and I get the correct number
of
>>> output files, but some of the output files contain no data. I
have set:
>>>
>>> output_flag = {
>>> fho = NONE;
>>> ctc = NONE;
>>> cts = NONE;
>>> mctc = NONE;
>>> mcts = NONE;
>>> cnt = NONE;
>>> sl1l2 = NONE;
>>> vl1l2 = NONE;
>>> pct = BOTH;
>>> pstd = BOTH;
>>> pjc = BOTH;
>>> prc = BOTH;
>>> nbrctc = BOTH;
>>> nbrcts = BOTH;
>>> nbrcnt = BOTH;
>>> };
>>>
>>> All the probability files come out with only a header and no data.
In
>>> searching the online information, I haven't been able to figure
out what
>>> I'm doing wrong to cause this. Is there anyone you could point me
to
>>> who might be able to help?
>>>
>>> Thanks,
>>> Christina
>>>
>>
>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #62602] grid_stats output
From: Christina Kalb
Time: Tue Aug 13 13:01:33 2013
Hi John:
Yes. What is your office #? I have sample data in /scratch/Tina/MET
Thanks
Christina
On 08/13/2013 01:00 PM, John Halley Gotway via RT wrote:
> Christina,
>
> How about 1:30pm? Does that work? And can you put the sample data
(fcst, obs, config file) on scratch?
>
> Thanks,
> John
>
> On 08/13/2013 11:21 AM, Christina Kalb via RT wrote:
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=62602 >
>>
>> Hi John:
>>
>> I didn't realize that probabilities had to start at 0 and end with
1.
>> In any case, every time I only set a single threshold in the obs
>> section, I get the error:
>>
>> ERROR : GridStatConfInfo::process_config() -> The number of
thresholds
>> for each field in "fcst.cat_thresh" must match the number of
thresholds
>> for each field in "obs.cat_thresh".
>>
>> I'd be happy to stop down if that's easier. Just let me know what
time
>> works best. I'll be around all day.
>>
>> Thanks,
>> Christina
>>
>> On 08/13/2013 08:02 AM, John Halley Gotway via RT wrote:
>>> Christina,
>>>
>>> I'm in the office today, so you could come by and we could work
through the issues. I've attached an example Grid-Stat config file
for verifying probabilities from the test scripts that are
>>> distributed with the MET tarball. You'll notice the following:
>>> (1) In the "fcst" section, you need to set the "prob" flag to TRUE
to tell Grid-Stat that this is a probabilistic field.
>>> (2) In the "fcst" section, the list of "cat_thresh" thresholds
must start at 0 and end at 1 and all be of the same type (e.g. >=).
>>> (3) In the "obs" section, you should specify a single threshold to
define the event for which the probability is defined.
>>>
>>> These multiple forecast thresholds and single observation
threshold define an Nx2 contingency table. And the probabilistic
statistics are derived from that table.
>>>
>>> But if you have more questions, it'd probably be quicker to just
work through them in person.
>>>
>>> Thanks,
>>> John
>>>
>>> On 08/12/2013 03:44 PM, Christina Kalb via RT wrote:
>>>>
>>>> Mon Aug 12 15:44:25 2013: Request 62602 was acted upon.
>>>> Transaction: Ticket created by kalb
>>>> Queue: met_help
>>>> Subject: grid_stats output
>>>> Owner: Nobody
>>>> Requestors: kalb at ucar.edu
>>>> Status: new
>>>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=62602 >
>>>>
>>>>
>>>> Hi:
>>>>
>>>> I'm running grid_stats, and am having a bit of difficulty.
>>>> Specifically, I get no error messages and I get the correct
number of
>>>> output files, but some of the output files contain no data. I
have set:
>>>>
>>>> output_flag = {
>>>> fho = NONE;
>>>> ctc = NONE;
>>>> cts = NONE;
>>>> mctc = NONE;
>>>> mcts = NONE;
>>>> cnt = NONE;
>>>> sl1l2 = NONE;
>>>> vl1l2 = NONE;
>>>> pct = BOTH;
>>>> pstd = BOTH;
>>>> pjc = BOTH;
>>>> prc = BOTH;
>>>> nbrctc = BOTH;
>>>> nbrcts = BOTH;
>>>> nbrcnt = BOTH;
>>>> };
>>>>
>>>> All the probability files come out with only a header and no
data. In
>>>> searching the online information, I haven't been able to figure
out what
>>>> I'm doing wrong to cause this. Is there anyone you could point
me to
>>>> who might be able to help?
>>>>
>>>> Thanks,
>>>> Christina
>>>>
>>>
>>
--
******************************************
Christina Kalb
Associate Scientist
National Center for Atmospheric Research
3450 Mitchell Lane
Boulder, CO 80301
email: kalb at ucar.edu
******************************************
------------------------------------------------
More information about the Met_help
mailing list