[Met_help] stat_analysis requirement for job stat_job_aggr_cnt

John Halley Gotway johnhg at rap.ucar.edu
Thu Mar 5 12:59:42 MST 2009


Jonathan,

Thanks for the suggestion about the STAT-Analysis tool.  Unfortunately,
it'd be difficult to implement that given the current architecture.

The STAT-Analysis tool really does 2 main things:
- First, it filters down the set of input STAT lines based on the
filtering parameters you choose.
- Second, it run the jobs you specify on that set of STAT lines.

The filtering settings you select in the config file before the list of
jobs apply to ALL of the jobs that you intend to run.  Then for each job,
you can set command line filtering setting to further refine the set of
data for that job.

We provided this two step approach to hopefully make things more
efficient.  If you're processing hundreds of thousands of STAT lines, and
running multiple jobs on them, you don't want to have to read through all
of the input STAT lines for each job.  By providing a way to do some
filtering up front, we can reduce the number of lines to be processed for
each job.

In the case where you don't have all that many STAT lines to process, you
probably don't even need to set any of those filtering parameters up
front.  Instead, you could just set them all in the job commands using the
command line options.

Thanks,
John

> John,
>
>
>
> I'm going through the various jobs for stat_analysis on my grid_stat
> output right now.
>
> I stumbled on a requirement for running the job "-job stat_job_aggr_cnt
> -line_type SL1L2".
>
> When the fcst and/or obs_thresh are set, this job does not produce any
> output because the thresholds are not stored in the partial sum files.
>
> I had to set these parameters in the STATAnalysis_config file to be
> blank:
>
>
>
> fcst_thresh[] = [];
>
> obs_thresh[] = [];
>
>
>
> in order that the job
>
>
>
> jobs[] = [
>
>    "-job stat_job_aggr_cnt -line_type SL1L2"
>
> ];
>
>
>
> would run.
>
>
>
> It might be nice to have the code run and simply ignore these thresholds
> if they are set in the config file and the user is running the
> stat_analysis on the partial sums for scalars.
>
>
>
> Also, there is a typo in Table 7-2 of the user's  guide under the
> description for vsdb_job_aggr_cnt.  It should be "derived", not
> "dervides".
>
>
>
> That's my 2 cents for now!
> Jonathan
>
>
>
> ***********************************************************
> Jonathan Case, ENSCO, Inc.
> Aerospace Sciences & Engineering Division
> Short-term Prediction Research and Transition Center
> 320 Sparkman Drive, Room 3062
> Huntsville, AL 35805-1912
> Voice: (256) 961-7504   Fax: (256) 961-7788
> Emails: Jonathan.Case-1 at nasa.gov
>
>              case.jonathan at ensco.com
>
> ***********************************************************
>
>
>
>




More information about the Met_help mailing list