[Met_help] [rt.rap.ucar.edu #93122] History for Problem with ensemble_stat, not working even when cmd is filled out
John Halley Gotway via RT
met_help at ucar.edu
Fri Jan 17 14:31:58 MST 2020
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
//
// Output model name to be written
//
model = "GEFS";
//
// Output description to be written
// May be set separately in each "obs.field" entry
//
desc = "NA";
//
// Output observation type to be written
//
obtype = "ANALYS";
////////////////////////////////////////////////////////////////////////////////
//
// Verification grid
// May be set separately in each "field" entry
//
regrid = {
to_grid = NONE;
method = NEAREST;
width = 1;
vld_thresh = 0.5;
shape = SQUARE;
}
////////////////////////////////////////////////////////////////////////////////
//
// May be set separately in each "field" entry
//
censor_thresh = [];
censor_val = [];
cat_thresh = [];
nc_var_str = "";
//
// Ensemble product fields to be processed
//
ens = {
ens_thresh = 1.0;
vld_thresh = 1.0;
field = [
{
name = "APCP";
level = "A03";
cat_thresh = [ >0.0, >=5.0 ];
}
];
}
////////////////////////////////////////////////////////////////////////////////
//
// Forecast and observation fields to be verified
//
fcst = {
field = [
{
name = "APCP";
level = [ "A03" ];
}
];
}
obs = fcst;
////////////////////////////////////////////////////////////////////////////////
//
// Point observation filtering options
// May be set separately in each "obs.field" entry
//
message_type = [ "ADPUPA" ];
sid_exc = [];
obs_thresh = [ NA ];
obs_quality = [];
duplicate_flag = NONE;
obs_summary = NONE;
obs_perc_value = 50;
skip_const = FALSE;
//
// Observation error options
// Set dist_type to NONE to use the observation error table instead
// May be set separately in each "obs.field" entry
//
obs_error = {
flag = FALSE; // TRUE or FALSE
dist_type = NONE; // Distribution type
dist_parm = []; // Distribution parameters
inst_bias_scale = 1.0; // Instrument bias scale adjustment
inst_bias_offset = 0.0; // Instrument bias offset adjustment
min = NA; // Valid range of data
max = NA;
}
//
// Mapping of message type group name to comma-separated list of values.
//
message_type_group_map = [
{ key = "SURFACE"; val = "ADPSFC,SFCSHP,MSONET"; },
{ key = "ANYAIR"; val = "AIRCAR,AIRCFT"; },
{ key = "ANYSFC"; val = "ADPSFC,SFCSHP,ADPUPA,PROFLR,MSONET"; },
{ key = "ONLYSF"; val = "ADPSFC,SFCSHP"; }
];
//
// Ensemble bin sizes
// May be set separately in each "obs.field" entry
//
ens_ssvar_bin_size = 1.0;
ens_phist_bin_size = 0.05;
////////////////////////////////////////////////////////////////////////////////
//
// Climatology mean data
//
climo_mean = {
file_name = [];
field = [];
regrid = {
method = NEAREST;
width = 1;
vld_thresh = 0.5;
shape = SQUARE;
}
time_interp_method = DW_MEAN;
match_month = TRUE;
match_day = FALSE;
time_step = 21600;
}
////////////////////////////////////////////////////////////////////////////////
//
// Point observation time window
//
obs_window = {
beg = -5400;
end = 5400;
}
////////////////////////////////////////////////////////////////////////////////
//
// Verification masking regions
//
mask = {
grid = [ "FULL" ];
poly = [];
sid = [];
llpnt = [];
}
////////////////////////////////////////////////////////////////////////////////
//
// Confidence interval settings
//
ci_alpha = [ 0.05 ];
////////////////////////////////////////////////////////////////////////////////
//
// Interpolation methods
//
interp = {
field = BOTH;
vld_thresh = 1.0;
shape = SQUARE;
type = [
{
method = NEAREST;
width = 1;
}
];
}
////////////////////////////////////////////////////////////////////////////////
//
// Statistical output types
//
output_flag = {
ecnt = NONE;
rhist = NONE;
phist = NONE;
orank = NONE;
ssvar = NONE;
relp = NONE;
}
////////////////////////////////////////////////////////////////////////////////
//
// Ensemble product output types
//
ensemble_flag = {
latlon = FALSE;
mean = TRUE;
stdev = FALSE;
minus = FALSE;
plus = FALSE;
min = FALSE;
max = FALSE;
range = FALSE;
vld_count = FALSE;
frequency = FALSE;
rank = FALSE;
weight = FALSE;
}
////////////////////////////////////////////////////////////////////////////////
//
//
rng = {
type = "mt19937";
seed = "";
}
grid_weight_flag = NONE;
output_prefix = "";
version = "V8.0";
////////////////////////////////////////////////////////////////////////////////
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: Problem with ensemble_stat, not working even when cmd is filled out
From: John Halley Gotway
Time: Wed Nov 13 16:35:23 2019
Taylor,
I see you're having trouble running the Ensemble-Stat tool using this
command:
ensemble_stat 21 ./gens-a_2_20190830_0000_03.grb2
./gens-a_2_20190830_0000_000_01.grb2 ./gens-
a_2_20190830_0000_000_02.grb2
ens_config
The "21" listed on the command line tells Ensemble-Stat to expect 21
input
file names to follow, but you've only specified 3 of them. I suspect
that's the problem.
Please try specifying 3 ensemble members instead:
ensemble_stat 3 ./gens-a_2_20190830_0000_03.grb2
./gens-a_2_20190830_0000_000_01.grb2 ./gens-
a_2_20190830_0000_000_02.grb2
ens_config
Or you may find it more convenient to write these filenames to an
ascii
file and pass that in on the command line.
Thanks,
John
On Wed, Nov 13, 2019 at 3:53 PM Taylor Mandelbaum via RT
<met_help at ucar.edu>
wrote:
>
> Wed Nov 13 15:53:06 2019: Request 93122 was acted upon.
> Transaction: Ticket created by taylor.mandelbaum at stonybrook.edu
> Queue: met_help
> Subject: Problem with ensemble_stat, not working even when cmd
is
> filled out
> Owner: Nobody
> Requestors: taylor.mandelbaum at stonybrook.edu
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=93122 >
>
>
>
>
> //
> // Output model name to be written
> //
> model = "GEFS";
>
> //
> // Output description to be written
> // May be set separately in each "obs.field" entry
> //
> desc = "NA";
>
> //
> // Output observation type to be written
> //
> obtype = "ANALYS";
>
>
>
////////////////////////////////////////////////////////////////////////////////
>
> //
> // Verification grid
> // May be set separately in each "field" entry
> //
> regrid = {
> to_grid = NONE;
> method = NEAREST;
> width = 1;
> vld_thresh = 0.5;
> shape = SQUARE;
> }
>
>
>
////////////////////////////////////////////////////////////////////////////////
>
> //
> // May be set separately in each "field" entry
> //
> censor_thresh = [];
> censor_val = [];
> cat_thresh = [];
> nc_var_str = "";
>
> //
> // Ensemble product fields to be processed
> //
> ens = {
> ens_thresh = 1.0;
> vld_thresh = 1.0;
>
> field = [
> {
> name = "APCP";
> level = "A03";
> cat_thresh = [ >0.0, >=5.0 ];
> }
> ];
> }
>
>
>
////////////////////////////////////////////////////////////////////////////////
>
> //
> // Forecast and observation fields to be verified
> //
> fcst = {
> field = [
> {
> name = "APCP";
> level = [ "A03" ];
> }
> ];
> }
> obs = fcst;
>
>
>
////////////////////////////////////////////////////////////////////////////////
>
> //
> // Point observation filtering options
> // May be set separately in each "obs.field" entry
> //
> message_type = [ "ADPUPA" ];
> sid_exc = [];
> obs_thresh = [ NA ];
> obs_quality = [];
> duplicate_flag = NONE;
> obs_summary = NONE;
> obs_perc_value = 50;
> skip_const = FALSE;
>
> //
> // Observation error options
> // Set dist_type to NONE to use the observation error table instead
> // May be set separately in each "obs.field" entry
> //
> obs_error = {
> flag = FALSE; // TRUE or FALSE
> dist_type = NONE; // Distribution type
> dist_parm = []; // Distribution parameters
> inst_bias_scale = 1.0; // Instrument bias scale adjustment
> inst_bias_offset = 0.0; // Instrument bias offset adjustment
> min = NA; // Valid range of data
> max = NA;
> }
>
> //
> // Mapping of message type group name to comma-separated list of
values.
> //
> message_type_group_map = [
> { key = "SURFACE"; val = "ADPSFC,SFCSHP,MSONET"; },
> { key = "ANYAIR"; val = "AIRCAR,AIRCFT"; },
> { key = "ANYSFC"; val = "ADPSFC,SFCSHP,ADPUPA,PROFLR,MSONET"; },
> { key = "ONLYSF"; val = "ADPSFC,SFCSHP"; }
> ];
>
> //
> // Ensemble bin sizes
> // May be set separately in each "obs.field" entry
> //
> ens_ssvar_bin_size = 1.0;
> ens_phist_bin_size = 0.05;
>
>
>
////////////////////////////////////////////////////////////////////////////////
>
> //
> // Climatology mean data
> //
> climo_mean = {
>
> file_name = [];
> field = [];
>
> regrid = {
> method = NEAREST;
> width = 1;
> vld_thresh = 0.5;
> shape = SQUARE;
> }
>
> time_interp_method = DW_MEAN;
> match_month = TRUE;
> match_day = FALSE;
> time_step = 21600;
> }
>
>
>
////////////////////////////////////////////////////////////////////////////////
>
> //
> // Point observation time window
> //
> obs_window = {
> beg = -5400;
> end = 5400;
> }
>
>
>
////////////////////////////////////////////////////////////////////////////////
>
> //
> // Verification masking regions
> //
> mask = {
> grid = [ "FULL" ];
> poly = [];
> sid = [];
> llpnt = [];
> }
>
>
>
////////////////////////////////////////////////////////////////////////////////
>
> //
> // Confidence interval settings
> //
> ci_alpha = [ 0.05 ];
>
>
>
////////////////////////////////////////////////////////////////////////////////
>
> //
> // Interpolation methods
> //
> interp = {
> field = BOTH;
> vld_thresh = 1.0;
> shape = SQUARE;
>
> type = [
> {
> method = NEAREST;
> width = 1;
> }
> ];
> }
>
>
>
////////////////////////////////////////////////////////////////////////////////
>
> //
> // Statistical output types
> //
> output_flag = {
> ecnt = NONE;
> rhist = NONE;
> phist = NONE;
> orank = NONE;
> ssvar = NONE;
> relp = NONE;
> }
>
>
>
////////////////////////////////////////////////////////////////////////////////
>
> //
> // Ensemble product output types
> //
> ensemble_flag = {
> latlon = FALSE;
> mean = TRUE;
> stdev = FALSE;
> minus = FALSE;
> plus = FALSE;
> min = FALSE;
> max = FALSE;
> range = FALSE;
> vld_count = FALSE;
> frequency = FALSE;
> rank = FALSE;
> weight = FALSE;
> }
>
>
>
////////////////////////////////////////////////////////////////////////////////
>
> //
>
> //
> rng = {
> type = "mt19937";
> seed = "";
> }
>
>
>
> grid_weight_flag = NONE;
> output_prefix = "";
> version = "V8.0";
>
>
>
////////////////////////////////////////////////////////////////////////////////
> Hey all,
>
> I'm trying to run ensemble_stat on Cheyenne in a folder with
ensemble grb2
> files. I set the flags in the ens_config to only compute the mean,
and am
> running the command as follows:
>
> ensemble_stat 21 ./gens-a_2_20190830_0000_03.grb2
> ./gens-a_2_20190830_0000_000_01.grb2 ./gens-
a_2_20190830_0000_000_02.grb2
> ens_config
>
> Which is returning the default help message:
>
> [image: image.png]
>
> I attached the ens_config file to this email as well (from a windows
box,
> don't mind the .txt extension), hopefully that can help too. Feel
free to
> cd into my directory and toy with stuff if that helps too.
>
> Thanks again!
> --
> *Taylor Mandelbaum*
> Research Technician
> SoMAS | Stony Brook University
> 678.468.5789
>
> Hey all,
>
> I'm trying to run ensemble_stat on Cheyenne in a folder with
ensemble grb2
> files. I set the flags in the ens_config to only compute the mean,
and am
> running the command as follows:
>
> ensemble_stat 21 ./gens-a_2_20190830_0000_03.grb2
> ./gens-a_2_20190830_0000_000_01.grb2 ./gens-
a_2_20190830_0000_000_02.grb2
> ens_config
>
> Which is returning the default help message:
>
> [image: image.png]
>
> I attached the ens_config file to this email as well (from a windows
box,
> don't mind the .txt extension), hopefully that can help too. Feel
free to
> cd into my directory and toy with stuff if that helps too.
>
> Thanks again!
> --
> *Taylor Mandelbaum*
> Research Technician
> SoMAS | Stony Brook University
> 678.468.5789
>
------------------------------------------------
Subject: Problem with ensemble_stat, not working even when cmd is filled out
From: Taylor Mandelbaum
Time: Wed Nov 13 19:20:54 2019
Thanks! I ran into the next error, which states:
EnsembleStatConfInfo::process_config() -> When "fcst.field" is non-
empty,
you must use "-point_obs" and/or "-grid_obs" to specify the verifying
observations.
I commented out the fcst variable but it still is showing this error
(attached).
On Wed, Nov 13, 2019 at 6:35 PM John Halley Gotway via RT
<met_help at ucar.edu>
wrote:
> Taylor,
>
> I see you're having trouble running the Ensemble-Stat tool using
this
> command:
>
> ensemble_stat 21 ./gens-a_2_20190830_0000_03.grb2
> ./gens-a_2_20190830_0000_000_01.grb2 ./gens-
a_2_20190830_0000_000_02.grb2
> ens_config
>
> The "21" listed on the command line tells Ensemble-Stat to expect 21
input
> file names to follow, but you've only specified 3 of them. I
suspect
> that's the problem.
>
> Please try specifying 3 ensemble members instead:
>
> ensemble_stat 3 ./gens-a_2_20190830_0000_03.grb2
> ./gens-a_2_20190830_0000_000_01.grb2 ./gens-
a_2_20190830_0000_000_02.grb2
> ens_config
>
> Or you may find it more convenient to write these filenames to an
ascii
> file and pass that in on the command line.
>
> Thanks,
> John
>
> On Wed, Nov 13, 2019 at 3:53 PM Taylor Mandelbaum via RT <
> met_help at ucar.edu>
> wrote:
>
> >
> > Wed Nov 13 15:53:06 2019: Request 93122 was acted upon.
> > Transaction: Ticket created by taylor.mandelbaum at stonybrook.edu
> > Queue: met_help
> > Subject: Problem with ensemble_stat, not working even when
cmd is
> > filled out
> > Owner: Nobody
> > Requestors: taylor.mandelbaum at stonybrook.edu
> > Status: new
> > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=93122 >
> >
> >
> >
> >
> > //
> > // Output model name to be written
> > //
> > model = "GEFS";
> >
> > //
> > // Output description to be written
> > // May be set separately in each "obs.field" entry
> > //
> > desc = "NA";
> >
> > //
> > // Output observation type to be written
> > //
> > obtype = "ANALYS";
> >
> >
> >
>
////////////////////////////////////////////////////////////////////////////////
> >
> > //
> > // Verification grid
> > // May be set separately in each "field" entry
> > //
> > regrid = {
> > to_grid = NONE;
> > method = NEAREST;
> > width = 1;
> > vld_thresh = 0.5;
> > shape = SQUARE;
> > }
> >
> >
> >
>
////////////////////////////////////////////////////////////////////////////////
> >
> > //
> > // May be set separately in each "field" entry
> > //
> > censor_thresh = [];
> > censor_val = [];
> > cat_thresh = [];
> > nc_var_str = "";
> >
> > //
> > // Ensemble product fields to be processed
> > //
> > ens = {
> > ens_thresh = 1.0;
> > vld_thresh = 1.0;
> >
> > field = [
> > {
> > name = "APCP";
> > level = "A03";
> > cat_thresh = [ >0.0, >=5.0 ];
> > }
> > ];
> > }
> >
> >
> >
>
////////////////////////////////////////////////////////////////////////////////
> >
> > //
> > // Forecast and observation fields to be verified
> > //
> > fcst = {
> > field = [
> > {
> > name = "APCP";
> > level = [ "A03" ];
> > }
> > ];
> > }
> > obs = fcst;
> >
> >
> >
>
////////////////////////////////////////////////////////////////////////////////
> >
> > //
> > // Point observation filtering options
> > // May be set separately in each "obs.field" entry
> > //
> > message_type = [ "ADPUPA" ];
> > sid_exc = [];
> > obs_thresh = [ NA ];
> > obs_quality = [];
> > duplicate_flag = NONE;
> > obs_summary = NONE;
> > obs_perc_value = 50;
> > skip_const = FALSE;
> >
> > //
> > // Observation error options
> > // Set dist_type to NONE to use the observation error table
instead
> > // May be set separately in each "obs.field" entry
> > //
> > obs_error = {
> > flag = FALSE; // TRUE or FALSE
> > dist_type = NONE; // Distribution type
> > dist_parm = []; // Distribution parameters
> > inst_bias_scale = 1.0; // Instrument bias scale adjustment
> > inst_bias_offset = 0.0; // Instrument bias offset
adjustment
> > min = NA; // Valid range of data
> > max = NA;
> > }
> >
> > //
> > // Mapping of message type group name to comma-separated list of
values.
> > //
> > message_type_group_map = [
> > { key = "SURFACE"; val = "ADPSFC,SFCSHP,MSONET";
},
> > { key = "ANYAIR"; val = "AIRCAR,AIRCFT";
},
> > { key = "ANYSFC"; val = "ADPSFC,SFCSHP,ADPUPA,PROFLR,MSONET";
},
> > { key = "ONLYSF"; val = "ADPSFC,SFCSHP";
}
> > ];
> >
> > //
> > // Ensemble bin sizes
> > // May be set separately in each "obs.field" entry
> > //
> > ens_ssvar_bin_size = 1.0;
> > ens_phist_bin_size = 0.05;
> >
> >
> >
>
////////////////////////////////////////////////////////////////////////////////
> >
> > //
> > // Climatology mean data
> > //
> > climo_mean = {
> >
> > file_name = [];
> > field = [];
> >
> > regrid = {
> > method = NEAREST;
> > width = 1;
> > vld_thresh = 0.5;
> > shape = SQUARE;
> > }
> >
> > time_interp_method = DW_MEAN;
> > match_month = TRUE;
> > match_day = FALSE;
> > time_step = 21600;
> > }
> >
> >
> >
>
////////////////////////////////////////////////////////////////////////////////
> >
> > //
> > // Point observation time window
> > //
> > obs_window = {
> > beg = -5400;
> > end = 5400;
> > }
> >
> >
> >
>
////////////////////////////////////////////////////////////////////////////////
> >
> > //
> > // Verification masking regions
> > //
> > mask = {
> > grid = [ "FULL" ];
> > poly = [];
> > sid = [];
> > llpnt = [];
> > }
> >
> >
> >
>
////////////////////////////////////////////////////////////////////////////////
> >
> > //
> > // Confidence interval settings
> > //
> > ci_alpha = [ 0.05 ];
> >
> >
> >
>
////////////////////////////////////////////////////////////////////////////////
> >
> > //
> > // Interpolation methods
> > //
> > interp = {
> > field = BOTH;
> > vld_thresh = 1.0;
> > shape = SQUARE;
> >
> > type = [
> > {
> > method = NEAREST;
> > width = 1;
> > }
> > ];
> > }
> >
> >
> >
>
////////////////////////////////////////////////////////////////////////////////
> >
> > //
> > // Statistical output types
> > //
> > output_flag = {
> > ecnt = NONE;
> > rhist = NONE;
> > phist = NONE;
> > orank = NONE;
> > ssvar = NONE;
> > relp = NONE;
> > }
> >
> >
> >
>
////////////////////////////////////////////////////////////////////////////////
> >
> > //
> > // Ensemble product output types
> > //
> > ensemble_flag = {
> > latlon = FALSE;
> > mean = TRUE;
> > stdev = FALSE;
> > minus = FALSE;
> > plus = FALSE;
> > min = FALSE;
> > max = FALSE;
> > range = FALSE;
> > vld_count = FALSE;
> > frequency = FALSE;
> > rank = FALSE;
> > weight = FALSE;
> > }
> >
> >
> >
>
////////////////////////////////////////////////////////////////////////////////
> >
> > //
> >
> > //
> > rng = {
> > type = "mt19937";
> > seed = "";
> > }
> >
> >
> >
> > grid_weight_flag = NONE;
> > output_prefix = "";
> > version = "V8.0";
> >
> >
> >
>
////////////////////////////////////////////////////////////////////////////////
> > Hey all,
> >
> > I'm trying to run ensemble_stat on Cheyenne in a folder with
ensemble
> grb2
> > files. I set the flags in the ens_config to only compute the mean,
and am
> > running the command as follows:
> >
> > ensemble_stat 21 ./gens-a_2_20190830_0000_03.grb2
> > ./gens-a_2_20190830_0000_000_01.grb2 ./gens-
a_2_20190830_0000_000_02.grb2
> > ens_config
> >
> > Which is returning the default help message:
> >
> > [image: image.png]
> >
> > I attached the ens_config file to this email as well (from a
windows box,
> > don't mind the .txt extension), hopefully that can help too. Feel
free to
> > cd into my directory and toy with stuff if that helps too.
> >
> > Thanks again!
> > --
> > *Taylor Mandelbaum*
> > Research Technician
> > SoMAS | Stony Brook University
> > 678.468.5789
> >
> > Hey all,
> >
> > I'm trying to run ensemble_stat on Cheyenne in a folder with
ensemble
> grb2
> > files. I set the flags in the ens_config to only compute the mean,
and am
> > running the command as follows:
> >
> > ensemble_stat 21 ./gens-a_2_20190830_0000_03.grb2
> > ./gens-a_2_20190830_0000_000_01.grb2 ./gens-
a_2_20190830_0000_000_02.grb2
> > ens_config
> >
> > Which is returning the default help message:
> >
> > [image: image.png]
> >
> > I attached the ens_config file to this email as well (from a
windows box,
> > don't mind the .txt extension), hopefully that can help too. Feel
free to
> > cd into my directory and toy with stuff if that helps too.
> >
> > Thanks again!
> > --
> > *Taylor Mandelbaum*
> > Research Technician
> > SoMAS | Stony Brook University
> > 678.468.5789
> >
>
>
--
*Taylor Mandelbaum*
Research Technician
SoMAS | Stony Brook University
678.468.5789
------------------------------------------------
Subject: Problem with ensemble_stat, not working even when cmd is filled out
From: Taylor Mandelbaum
Time: Wed Nov 13 19:20:54 2019
//
// Output model name to be written
//
model = "GEFS";
//
// Output description to be written
// May be set separately in each "obs.field" entry
//
desc = "NA";
//
// Output observation type to be written
//
obtype = "ANALYS";
////////////////////////////////////////////////////////////////////////////////
//
// Verification grid
// May be set separately in each "field" entry
//
regrid = {
to_grid = NONE;
method = NEAREST;
width = 1;
vld_thresh = 0.5;
shape = SQUARE;
}
////////////////////////////////////////////////////////////////////////////////
//
// May be set separately in each "field" entry
//
censor_thresh = [];
censor_val = [];
cat_thresh = [];
nc_var_str = "";
//
// Ensemble product fields to be processed
//
ens = {
ens_thresh = 1.0;
vld_thresh = 1.0;
field = [
{
name = "APCP";
level = "A03";
cat_thresh = [ >0.0, >=5.0 ];
}
];
}
////////////////////////////////////////////////////////////////////////////////
//
// Forecast and observation fields to be verified
//
//fcst = {
// field = [
// {
// name = "APCP";
// level = [ "A03" ];
// }
// ];
//}
//obs = fcst;
////////////////////////////////////////////////////////////////////////////////
//
// Point observation filtering options
// May be set separately in each "obs.field" entry
//
message_type = [ "ADPUPA" ];
sid_exc = [];
obs_thresh = [ NA ];
obs_quality = [];
duplicate_flag = NONE;
obs_summary = NONE;
obs_perc_value = 50;
skip_const = FALSE;
//
// Observation error options
// Set dist_type to NONE to use the observation error table instead
// May be set separately in each "obs.field" entry
//
obs_error = {
flag = FALSE; // TRUE or FALSE
dist_type = NONE; // Distribution type
dist_parm = []; // Distribution parameters
inst_bias_scale = 1.0; // Instrument bias scale adjustment
inst_bias_offset = 0.0; // Instrument bias offset adjustment
min = NA; // Valid range of data
max = NA;
}
//
// Mapping of message type group name to comma-separated list of
values.
//
message_type_group_map = [
{ key = "SURFACE"; val = "ADPSFC,SFCSHP,MSONET"; },
{ key = "ANYAIR"; val = "AIRCAR,AIRCFT"; },
{ key = "ANYSFC"; val = "ADPSFC,SFCSHP,ADPUPA,PROFLR,MSONET"; },
{ key = "ONLYSF"; val = "ADPSFC,SFCSHP"; }
];
//
// Ensemble bin sizes
// May be set separately in each "obs.field" entry
//
ens_ssvar_bin_size = 1.0;
ens_phist_bin_size = 0.05;
////////////////////////////////////////////////////////////////////////////////
//
// Climatology mean data
//
climo_mean = {
file_name = [];
field = [];
regrid = {
method = NEAREST;
width = 1;
vld_thresh = 0.5;
shape = SQUARE;
}
time_interp_method = DW_MEAN;
match_month = TRUE;
match_day = FALSE;
time_step = 21600;
}
////////////////////////////////////////////////////////////////////////////////
//
// Point observation time window
//
obs_window = {
beg = -5400;
end = 5400;
}
////////////////////////////////////////////////////////////////////////////////
//
// Verification masking regions
//
mask = {
grid = [ "FULL" ];
poly = [];
sid = [];
llpnt = [];
}
////////////////////////////////////////////////////////////////////////////////
//
// Confidence interval settings
//
ci_alpha = [ 0.05 ];
////////////////////////////////////////////////////////////////////////////////
//
// Interpolation methods
//
interp = {
field = BOTH;
vld_thresh = 1.0;
shape = SQUARE;
type = [
{
method = NEAREST;
width = 1;
}
];
}
////////////////////////////////////////////////////////////////////////////////
//
// Statistical output types
//
output_flag = {
ecnt = NONE;
rhist = NONE;
phist = NONE;
orank = NONE;
ssvar = NONE;
relp = NONE;
}
////////////////////////////////////////////////////////////////////////////////
//
// Ensemble product output types
//
ensemble_flag = {
latlon = FALSE;
mean = TRUE;
stdev = FALSE;
minus = FALSE;
plus = FALSE;
min = FALSE;
max = FALSE;
range = FALSE;
vld_count = FALSE;
frequency = FALSE;
rank = FALSE;
weight = FALSE;
}
////////////////////////////////////////////////////////////////////////////////
//
//
rng = {
type = "mt19937";
seed = "";
}
grid_weight_flag = NONE;
output_prefix = "";
version = "V8.0";
////////////////////////////////////////////////////////////////////////////////
------------------------------------------------
Subject: Problem with ensemble_stat, not working even when cmd is filled out
From: John Halley Gotway
Time: Thu Nov 14 08:26:53 2019
Taylor,
I suspect that the default config file contains a setting in the
“fcst”
dictionary.
https://github.com/NCAR/MET/blob/master_v8.1/met/data/config/EnsembleStatConfig_default
By commenting it out in your config file, you’re no longer overriding
the
default. And that default setting persists, as well as the error
message
you’re getting. Instead of commenting it out, try setting it to an
empty
list:
fcst = { field = []; }
Sometimes it’s difficult to choose good defaults!
John
On Wed, Nov 13, 2019 at 7:20 PM Taylor Mandelbaum via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=93122 >
>
> Thanks! I ran into the next error, which states:
>
> EnsembleStatConfInfo::process_config() -> When "fcst.field" is non-
empty,
> you must use "-point_obs" and/or "-grid_obs" to specify the
verifying
> observations.
>
> I commented out the fcst variable but it still is showing this error
> (attached).
>
>
>
> On Wed, Nov 13, 2019 at 6:35 PM John Halley Gotway via RT <
> met_help at ucar.edu>
> wrote:
>
> > Taylor,
> >
> > I see you're having trouble running the Ensemble-Stat tool using
this
> > command:
> >
> > ensemble_stat 21 ./gens-a_2_20190830_0000_03.grb2
> > ./gens-a_2_20190830_0000_000_01.grb2 ./gens-
a_2_20190830_0000_000_02.grb2
> > ens_config
> >
> > The "21" listed on the command line tells Ensemble-Stat to expect
21
> input
> > file names to follow, but you've only specified 3 of them. I
suspect
> > that's the problem.
> >
> > Please try specifying 3 ensemble members instead:
> >
> > ensemble_stat 3 ./gens-a_2_20190830_0000_03.grb2
> > ./gens-a_2_20190830_0000_000_01.grb2 ./gens-
a_2_20190830_0000_000_02.grb2
> > ens_config
> >
> > Or you may find it more convenient to write these filenames to an
ascii
> > file and pass that in on the command line.
> >
> > Thanks,
> > John
> >
> > On Wed, Nov 13, 2019 at 3:53 PM Taylor Mandelbaum via RT <
> > met_help at ucar.edu>
> > wrote:
> >
> > >
> > > Wed Nov 13 15:53:06 2019: Request 93122 was acted upon.
> > > Transaction: Ticket created by taylor.mandelbaum at stonybrook.edu
> > > Queue: met_help
> > > Subject: Problem with ensemble_stat, not working even when
cmd is
> > > filled out
> > > Owner: Nobody
> > > Requestors: taylor.mandelbaum at stonybrook.edu
> > > Status: new
> > > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=93122
> >
> > >
> > >
> > >
> > >
> > > //
> > > // Output model name to be written
> > > //
> > > model = "GEFS";
> > >
> > > //
> > > // Output description to be written
> > > // May be set separately in each "obs.field" entry
> > > //
> > > desc = "NA";
> > >
> > > //
> > > // Output observation type to be written
> > > //
> > > obtype = "ANALYS";
> > >
> > >
> > >
> >
>
////////////////////////////////////////////////////////////////////////////////
> > >
> > > //
> > > // Verification grid
> > > // May be set separately in each "field" entry
> > > //
> > > regrid = {
> > > to_grid = NONE;
> > > method = NEAREST;
> > > width = 1;
> > > vld_thresh = 0.5;
> > > shape = SQUARE;
> > > }
> > >
> > >
> > >
> >
>
////////////////////////////////////////////////////////////////////////////////
> > >
> > > //
> > > // May be set separately in each "field" entry
> > > //
> > > censor_thresh = [];
> > > censor_val = [];
> > > cat_thresh = [];
> > > nc_var_str = "";
> > >
> > > //
> > > // Ensemble product fields to be processed
> > > //
> > > ens = {
> > > ens_thresh = 1.0;
> > > vld_thresh = 1.0;
> > >
> > > field = [
> > > {
> > > name = "APCP";
> > > level = "A03";
> > > cat_thresh = [ >0.0, >=5.0 ];
> > > }
> > > ];
> > > }
> > >
> > >
> > >
> >
>
////////////////////////////////////////////////////////////////////////////////
> > >
> > > //
> > > // Forecast and observation fields to be verified
> > > //
> > > fcst = {
> > > field = [
> > > {
> > > name = "APCP";
> > > level = [ "A03" ];
> > > }
> > > ];
> > > }
> > > obs = fcst;
> > >
> > >
> > >
> >
>
////////////////////////////////////////////////////////////////////////////////
> > >
> > > //
> > > // Point observation filtering options
> > > // May be set separately in each "obs.field" entry
> > > //
> > > message_type = [ "ADPUPA" ];
> > > sid_exc = [];
> > > obs_thresh = [ NA ];
> > > obs_quality = [];
> > > duplicate_flag = NONE;
> > > obs_summary = NONE;
> > > obs_perc_value = 50;
> > > skip_const = FALSE;
> > >
> > > //
> > > // Observation error options
> > > // Set dist_type to NONE to use the observation error table
instead
> > > // May be set separately in each "obs.field" entry
> > > //
> > > obs_error = {
> > > flag = FALSE; // TRUE or FALSE
> > > dist_type = NONE; // Distribution type
> > > dist_parm = []; // Distribution parameters
> > > inst_bias_scale = 1.0; // Instrument bias scale
adjustment
> > > inst_bias_offset = 0.0; // Instrument bias offset
adjustment
> > > min = NA; // Valid range of data
> > > max = NA;
> > > }
> > >
> > > //
> > > // Mapping of message type group name to comma-separated list of
> values.
> > > //
> > > message_type_group_map = [
> > > { key = "SURFACE"; val = "ADPSFC,SFCSHP,MSONET";
},
> > > { key = "ANYAIR"; val = "AIRCAR,AIRCFT";
},
> > > { key = "ANYSFC"; val =
"ADPSFC,SFCSHP,ADPUPA,PROFLR,MSONET"; },
> > > { key = "ONLYSF"; val = "ADPSFC,SFCSHP";
}
> > > ];
> > >
> > > //
> > > // Ensemble bin sizes
> > > // May be set separately in each "obs.field" entry
> > > //
> > > ens_ssvar_bin_size = 1.0;
> > > ens_phist_bin_size = 0.05;
> > >
> > >
> > >
> >
>
////////////////////////////////////////////////////////////////////////////////
> > >
> > > //
> > > // Climatology mean data
> > > //
> > > climo_mean = {
> > >
> > > file_name = [];
> > > field = [];
> > >
> > > regrid = {
> > > method = NEAREST;
> > > width = 1;
> > > vld_thresh = 0.5;
> > > shape = SQUARE;
> > > }
> > >
> > > time_interp_method = DW_MEAN;
> > > match_month = TRUE;
> > > match_day = FALSE;
> > > time_step = 21600;
> > > }
> > >
> > >
> > >
> >
>
////////////////////////////////////////////////////////////////////////////////
> > >
> > > //
> > > // Point observation time window
> > > //
> > > obs_window = {
> > > beg = -5400;
> > > end = 5400;
> > > }
> > >
> > >
> > >
> >
>
////////////////////////////////////////////////////////////////////////////////
> > >
> > > //
> > > // Verification masking regions
> > > //
> > > mask = {
> > > grid = [ "FULL" ];
> > > poly = [];
> > > sid = [];
> > > llpnt = [];
> > > }
> > >
> > >
> > >
> >
>
////////////////////////////////////////////////////////////////////////////////
> > >
> > > //
> > > // Confidence interval settings
> > > //
> > > ci_alpha = [ 0.05 ];
> > >
> > >
> > >
> >
>
////////////////////////////////////////////////////////////////////////////////
> > >
> > > //
> > > // Interpolation methods
> > > //
> > > interp = {
> > > field = BOTH;
> > > vld_thresh = 1.0;
> > > shape = SQUARE;
> > >
> > > type = [
> > > {
> > > method = NEAREST;
> > > width = 1;
> > > }
> > > ];
> > > }
> > >
> > >
> > >
> >
>
////////////////////////////////////////////////////////////////////////////////
> > >
> > > //
> > > // Statistical output types
> > > //
> > > output_flag = {
> > > ecnt = NONE;
> > > rhist = NONE;
> > > phist = NONE;
> > > orank = NONE;
> > > ssvar = NONE;
> > > relp = NONE;
> > > }
> > >
> > >
> > >
> >
>
////////////////////////////////////////////////////////////////////////////////
> > >
> > > //
> > > // Ensemble product output types
> > > //
> > > ensemble_flag = {
> > > latlon = FALSE;
> > > mean = TRUE;
> > > stdev = FALSE;
> > > minus = FALSE;
> > > plus = FALSE;
> > > min = FALSE;
> > > max = FALSE;
> > > range = FALSE;
> > > vld_count = FALSE;
> > > frequency = FALSE;
> > > rank = FALSE;
> > > weight = FALSE;
> > > }
> > >
> > >
> > >
> >
>
////////////////////////////////////////////////////////////////////////////////
> > >
> > > //
> > >
> > > //
> > > rng = {
> > > type = "mt19937";
> > > seed = "";
> > > }
> > >
> > >
> > >
> > > grid_weight_flag = NONE;
> > > output_prefix = "";
> > > version = "V8.0";
> > >
> > >
> > >
> >
>
////////////////////////////////////////////////////////////////////////////////
> > > Hey all,
> > >
> > > I'm trying to run ensemble_stat on Cheyenne in a folder with
ensemble
> > grb2
> > > files. I set the flags in the ens_config to only compute the
mean, and
> am
> > > running the command as follows:
> > >
> > > ensemble_stat 21 ./gens-a_2_20190830_0000_03.grb2
> > > ./gens-a_2_20190830_0000_000_01.grb2
> ./gens-a_2_20190830_0000_000_02.grb2
> > > ens_config
> > >
> > > Which is returning the default help message:
> > >
> > > [image: image.png]
> > >
> > > I attached the ens_config file to this email as well (from a
windows
> box,
> > > don't mind the .txt extension), hopefully that can help too.
Feel free
> to
> > > cd into my directory and toy with stuff if that helps too.
> > >
> > > Thanks again!
> > > --
> > > *Taylor Mandelbaum*
> > > Research Technician
> > > SoMAS | Stony Brook University
> > > 678.468.5789
> > >
> > > Hey all,
> > >
> > > I'm trying to run ensemble_stat on Cheyenne in a folder with
ensemble
> > grb2
> > > files. I set the flags in the ens_config to only compute the
mean, and
> am
> > > running the command as follows:
> > >
> > > ensemble_stat 21 ./gens-a_2_20190830_0000_03.grb2
> > > ./gens-a_2_20190830_0000_000_01.grb2
> ./gens-a_2_20190830_0000_000_02.grb2
> > > ens_config
> > >
> > > Which is returning the default help message:
> > >
> > > [image: image.png]
> > >
> > > I attached the ens_config file to this email as well (from a
windows
> box,
> > > don't mind the .txt extension), hopefully that can help too.
Feel free
> to
> > > cd into my directory and toy with stuff if that helps too.
> > >
> > > Thanks again!
> > > --
> > > *Taylor Mandelbaum*
> > > Research Technician
> > > SoMAS | Stony Brook University
> > > 678.468.5789
> > >
> >
> >
>
> --
> *Taylor Mandelbaum*
> Research Technician
> SoMAS | Stony Brook University
> 678.468.5789
>
>
------------------------------------------------
More information about the Met_help
mailing list