[Met_help] [rt.rap.ucar.edu #39601] History for METv3.0
RAL HelpDesk {for John Halley Gotway}
met_help at ucar.edu
Tue Aug 3 09:33:36 MDT 2010
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Hello,
What is the expected release of METV3.0 and added capabilities?
Take care,
Joe
Dr. Joseph L. Eastman
Senior Atmospheric Scientist
WindLogics Inc.
201 4th St NW
Grand Rapids, MN
55744
c – 410.279.9702
w – 651.556.4297
jeastman at windlogics.com
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: METv3.0
From: John Halley Gotway
Time: Tue Jul 27 12:35:02 2010
Joe,
There was some confusion in our support ticketing system because you
hit "reply to" one of the MET-Help email archive messages. Since the
title of message you sent already contained a ticket number,
the system thought your question was part of an old exchange. We got
it figured out, but in the future, please send questions in new
messages rather than replying to old ones.
Regarding the release of METv3.0, we had hoped to release it prior to
the MET summer tutorial - which is at the end of next week.
Unfortunately, we just didn't get it done and tested in time. So
we'll be using a beta release of METv3.0 at the tutorial. The major
changes for METv3.0 include the addition of the ensemble_stat tool and
tools for handling WWMCA data from AFWA. For a more
detailed list, please see the development notes I've attached.
There are two main outstanding issues that we need to resolve prior to
releasing. First is our support for NetCDF - in particular, we need
to make sure we can read the NetCDF output of the pinterp
tool and allow the other MET tools to read the NetCDF output of the
new ensemble_stat tool. Second, I want to address the issues you've
raised in the three open MET-Help tickets. We'll look at how
we handling vertical level matching in the point_stat tool. We may
have questions for you, but definitely not before the tutorial is
finished at the end next week.
We've revised our target release date to be the end of August. Sorry
for the delay.
John
RAL HelpDesk {for John Halley Gotway} wrote:
> Tue Jul 27 11:05:19 2010: Request 39601 was acted upon.
> Transaction: Ticket created by johnhg
> Queue: met_help
> Subject: METv3.0
> Owner: Nobody
> Requestors: jeastman at windlogics.com
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=39601 >
>
>
> Hello,
>
> What is the expected release of METV3.0 and added capabilities?
>
> Take care,
> Joe
>
> Dr. Joseph L. Eastman
> Senior Atmospheric Scientist
> WindLogics Inc.
> 201 4th St NW
> Grand Rapids, MN
> 55744
>
> c – 410.279.9702
> w – 651.556.4297
> jeastman at windlogics.com
------------------------------------------------
Subject: METv3.0
From: John Halley Gotway
Time: Tue Jul 27 12:35:02 2010
METv3.0 Development
METv3.0_beta1 (20100517)
* Wavelet-Stat: Enhance to specify separate fcst/obs fields.
* Grid-Stat: Add "interp_flag" configuration option.
* Ensemble-Stat: Initial release.
* MODE: Changed output file naming convention by removing the
fcst/obs variable/level information. Recommend using the
"output_prefix" option for configuring output file names.
* Point-Stat: If one of the observation files passed to it doesn't
exist, just print a warning message rather than erroring out.
METv3.0_beta2 (20100524)
* Point-Stat, Ensemble-Stat: Add the station id (obs_sid column)
to the MPR and ORANK output line types.
* Point-Stat, Grid-Stat: Add base rate (baser, baser_ncl,
baser_ncu columns) to the PSTD line type.
* Grid-Stat, Point-Stat, Ensemble-Stat: Update comments in config
files to reflect new columns.
* Ensemble-Stat: Add test script and test data to the release.
* PCP-Combine: Enhance to allow multiple entries for -pcpdir
command line argument. Write out error messages using time strings
rather than unixtime and seconds. Allow off-hour accumulation
intervals (i.e. 30 minutes or 10 minutes).
* Ensemble-Stat: Enhance to allow for randomly assigning ranks for
ties. Addition of rng_type and rng_seed entries in the Ensemble-Stat
config file.
* STAT-Analysis: Add the -column_str command line option to do
string comparisons when filtering STAT data. Specifically this is
meant to handle the station names in the OBS_SID columns.
* STAT-Analysis: Ensure that it can parse the PSTD,baser column.
* STAT-Analysis: Add jobs aggregate(RHIST) and
aggregate_stat(ORANK -> RHIST).
* STAT-Analysis: Add 2 jobs to the STAT-Analysis test script to
process the Ensemble-Stat output.
* Point-Stat and Grid-Stat: In fcst_thresh output column replace
NA's with a list of probability thresholds for probabilistic output.
* Point-Stat and Grid-Stat: In the PSTD output line, move the
N_THRESH column up to be after TOTAL to be consistent with other
probabilistic lines types.
METv3.0_beta3 (20100610)
* Point-Stat: Rename command line options:
o From "-ncfile" to "-point_obs" to be consistent with the
Ensemble-Stat naming convention
o From "-valid_beg" and "-valid_end" to "-obs_valid_beg" and
"-obs_valid_end"
o Note, previous options do still work
* Point-Stat: Add -fcst_lead and -fcst_valid command line options
to specify which GRIB records to use.
* Grid-Stat, MODE, Wavelet-Stat: Add -fcst_lead, -fcst_valid,
-obs_lead, and -obs_valid command line options to specify which GRIB
records to use.
* Ensemble-Stat: Add -ens_valid, -ens_lead, and -obs_lead command
line options to specify which GRIB records to use.
* MET Tools: Delete trailing spaces from ASCIITable output files
(.stat and .txt).
* GRIB Library, Point-Stat, Grid-Stat: Enhance to read NCEP's
probabilistic information from the PDS. Test using SREF data.
* Build Process: Update build script to copy latest version of
config files from the source code directories into
METv3.0/data/config.
* MET Tools: Make sure tools are writing out time strings rather
than UNIX time in messages printed to the screen.
* PB2NC: Modify Fortran code to remove compiler warnings.
* PB2NC: Modify logic of "-dump" command line option to only do an
ASCII dump for those message types requested in the PB2NC
configuration file.
* GRIB Library: Increase GRIB record buffer size to 4194304 (2^22)
in lib/vx_grib_classes/grib_classes.h.
* Grid-Stat and Point-Stat: In fcst_thresh output column for
probabilistic output, add commas between thresholds to delimit them.
* STAT-Analysis: Fix bug in how "tmp_dir" is handled. Add command
line argument for tmp_dir setting and remove it from the job
definition section. Setting tmp_dir on the command line takes
precedence over setting it in the config file. If not set in either
place, use the default setting of "/tmp".
* STAT-Analysis: Add "-column_eq" job command option which just
adds the same column value filter to the column_min and column_max
lists.
* Point-Stat and Grid-Stat: Add support for multi-category
contingency tables: add line types MCTC and MCTS.
* Point-Stat and Grid-Stat: Update comments in scripts/config
files for multi-category contingency tables.
* STAT-Analysis: Enhance to read multi-dimensional contingency
tables. Add jobs for "-job aggregate -line_type MCTC", "-job
aggregate_stat -line_type MCTC -out_line_type MCTS", "-job
aggregate_stat -line_type MPR -out_line_type MCTC", and "-job
aggregate_stat -line_type MPR -out_line_type MCTS".
* STAT-Analysis: Add comments to config file to list out the line
types for which the aggregate job is valid.
* PB2NC, Point-Stat, Grid-Stat, Wavelet-Stat, Stat-Analysis, MODE:
Add checks to read the version number from the config file and error
out if they are not the correct version.
* Tools: Add initial version of plot_point_obs tool in
METv3.0/tools directory.
* Modify top-level Makefile to build the tools directory, by
default disable_tools is set to true.
METv3.0_beta4 (20100709)
* Point-Stat: Don't require thresholds be set (in fcst_thresh or
obs_thresh) when the user has NOT requested line types of FHO, CTC,
CTS, MCTC, or MCTS.
* Grid-Stat: Don't require thresholds be set (in fcst_thresh or
obs_thresh) when the user has NOT requested line types of FHO, CTC,
CTS, MCTC, MCTS, NBRCTC, NBRCTS, or NBRCNT.
* STAT-Analysis: Update the logic for the -column_str job option.
Allow the user to specify multiple string options for a column by
separating values with commas. For example, "-column_str OBS_SID
KDEN,KOKC" will match either of these station id names.
* GRIB Library (vx_grib_classes): Update GRIB tables with the
latest changes posted on NCEP's website
(http://www.nco.ncep.noaa.gov/pmb/docs/on388)
* Top-level Makefiles: Add comments to say when F2C is necessary.
* Point-Stat: Add more logging info for verbosity = 3. Dump
counts of reasons why observations were rejected.
* Grid-Stat, Point-Stat, MODE, Wavelet-Stat, PCP-Combine: Modify
code to make use of the grid library's equality checks. Previously,
we just required that the grid dimensions be the same. Now, we
require that the grids be identical.
* PCP-Combine: Allow timestrings to be specified in HH[MMSS] or
YYYYMMDD[_HH[MMSS]] format.
* PB2NC, Point-Stat, STAT-Analysis: Write out timestrings in error
messages rather than unixtime in the places that Anne found.
* STAT-Analysis: Apply the variance inflation factor when
computing statistics over time series. Add the "-vif_flag" job
command option when running "-job aggregate_stat". This change
impacts computations for the following combinations of input/output
line types:
o FHO or CTC -> CTS: Normal CI's for BASER, FMEAN, ACC,
PODY, PODN, POFD, FAR, CSI, HK
o SL1L2 -> CNT: Normal CI's for FBAR, OBAR, ME
o MCTC -> MCTS: Normal CI's for ACC
o PCT -> PSTD: Normal CI's for BASER
* Grid-Stat and Point-Stat: Update comments in the config file for
specifying thresholds for probabilistic fields that Anne suggested.
* vx_data_grids library: Randy's rewrite of vx_data_grids in
support of the WMMCA tool.
* STAT-Analysis: Bugfix for Anne. Fix so that the following types
of jobs can run: -job aggregate_stat -line_type MPR -out_line_type
MCTC (or MCTS).
* STAT-Analysis: Bugfix for Anne. Fix it so that STAT-Analysis is
able to parse "PROB(TMP<273)" types of fcst_var and obs_var when
reading MPR lines.
* Add WMMCA Tool to the "tools" sub-directory and update Makefiles
to build it. This creates wwmca_plot and wwmca_regrid executables in
the bin directory.
METv3.0_beta5 (NOT BUILT YET)
* Update comments in the MODE config file to list fcst_field as a
single value rather than an array.
* PCP-Combine: Enhance it to write out sub-hourly accumulations
(e.g. add together two 15-minute accumulations and write out a 30-
minute accumulation in variable APCP_003000 for HHMMSS). Enhance
other MET tools/libraries to parse the output of PCP-Combine.
* ASCII2NC and PB2NC: Modify how accumulation intervals are stored
in the NetCDF point observation files. Store them as seconds rather
than hours to allow for subhourly accumulation intervals. Change
attributes in NetCDF output file:
o FROM: obs_arr:lvl_long_name = "pressure level (hPa) or
accumulation interval (h)" ;
o TO: obs_arr:lvl_long_name = "pressure level (hPa) or
accumulation interval (sec)" ;
TO DO:
* Point-Stat and Grid-Stat: Need to revisit computation of HK
confidence interval to make sure it's correct.
* MET Tools: Enhance to read CF-compliant NetCDF files, in
particular, from the WRF pinterp tool.
* MET Tools: Enhance to read the NetCDF output of Ensemble-Stat.
* PCP-Combine, Grid-Stat, MODE, Wavelet-Stat: Fix how we're
writing gridded NetCDF files to make them CF-compliant. Ensure that
they can be displayed by IDV.
* Point-Stat: Enhance Point-Stat to do vertical level matching the
way Joe Eastman wants.
* Read the NetCDF output from Dave Gochis?
* John Henderson MET-Help question: Include MADIS observations in
MET.
* PB2NC: Enhance to read more observation types.
* Build: Test building MET using different compilers: GNU 32-bit,
GNU 64-bit, PGI, Intel (on wjet), IBM (on bluefire).
* Build: Write a configure/compile for MET.
* MODE: Add vx_mask column to the MODE output?
* Point-Stat: Add logic to filter out "duplicate" observations?
* MET Tools: Allow for the intersection and union of multiple
masks (not sure about this one)?
* STAT-Analysis: Implement block-bootstrap?
* GRID Library: When parsing the GDS section, add sanity checks to
the grid definition. Error out if lat/lon's are out of bounds. Can
we avoid parsing the scan_flag?
------------------------------------------------
More information about the Met_help
mailing list