[Met_help] Re: Results of beta-test METv1.1

[John Halley Gotway]

Victor,

Good job being a "responsible" beta tester.  I really appreciate you letting us know about these issues.

(a) Regarding the usage statement for ASCII2NC, you're correct that I had them out of order.  So I've corrected the order for the next release.

(b) Wow, good catch!  That was a cut and paste error.  I'll fix it so that it'll write out the actual OY and ON values.  I'll also post that on the known issues page for METv1.0.

(c) I'm really surprised to see the confidence interval values you sent.  Could you please send me the forecast file, the observation file, and the configuration file you used to get these numbers out 
of Point-Stat.  I'll run them here and try to figure out the issue.  One thing to note though - when your sample size is very small (like 5) you really can't trust the confidence interval values. 
However, they should still at least enclose the value!

Regarding running NetCDF through Point-Stat, that's another good point.  I'll add the ability to Point-Stat to read the NetCDF output of PCP-Combine.

Thanks!
John

Victor Homar wrote:
> Dear John,
> 
> We have tried out this version of MET and it has improved functionality 
> and versatility.
> As "responsible" beta testers, we have a few comments for you:
> 
> a) There is a bit of confusion about the format of the ASCII 
> observations file to feed into ASCII2NC.
> The help from the command ASCII2NC shows this order:
> Message_Type Station_ID Valid_Time  Lat(Deg North) Lon(Deg East) 
> Elevation(msl) Level Height(msl) Grib_Code Observation_Value
> 
> whereas in ascii2nc.cc source code lines 391-394, the ordering is 
> different.
>      obs_arr[1] = atof(dl[6]); // Grib Code
>      obs_arr[2] = atof(dl[7]); // Level: pressure level or accumulation 
> interval
>      obs_arr[3] = atof(dl[8]); // Meters above sea level
>      obs_arr[4] = atof(dl[9]); // Observation Value
> 
> Our tests confirm that this later order provides the expected results 
> and so the documentation of ASCII2NC should be corrected.
> 
> b) The point_stat output file *_cop.txt has an incorrectly labeled pair 
> of columns. Columns OY and ON actually show FY and FN. Please either 
> change point_stat.cc lines 2410 and 2411 to referr to something like 
> cts_info.cts.oy and cts_info.cts.on (instead of cts_info.cts.fy and 
> cts_info.cts.fn) or change the *_cod.txt header and comments in 
> point_stat.cc lines 2432 and 2433.
> 
> c) The calculation of the confidence intervals is another nice feature 
> of MET. However, we do not quite understand our preliminary results. For 
> instance, we get:
> VRS MODEL FCST_LEAD FCST_VALID      OBTYPE VX_MASK      
> CTS_T/ALPHA          VAR       LEVEL        = TOTAL           
> BASER           BASER_CL        BASER_CU  ...
> V01 WRF   300000    20011111_060000 ADPSFC PENINSULA    
> CTS>=2.000/0.050     APCP      A030         = 5               
> 0.80000         0.89003         1.47827        ...
> 
> It is a bit weird the BASER_CL is above BASER. It doesn't sound 
> reasonable that the confidence interval does not include the expected 
> value (BASER). The same applies for all confidence intervals we have 
> checked.
> 
> d)  The new PCP_COMBINE option to substract precip fields seems to work 
> fine. Actually, we could not use the new fields because these are in 
> netcdf format whereas point_stat uses GRIB gridded fields. Do you know 
> how can we use the PCP_COMBINE in POINT_STAT?
> 
> Again, thank you very much for your efforts,
> 
> Best,
> 
> Lorena and Victor.
> 
> 
> John Halley Gotway wrote:
>> Victor,
>>
>> I have a beta release of METv1.1 ready for you to start working with.
>>
>> The following changes are included in this beta version:
>> - PB2NC
>>    - Add the ability to process multiple PREPBUFR file at one time.
>> - ASCII2NC
>>    - Add new tool for converting ASCII observations to NetCDF for 
>> input into
>>      Point-Stat.
>> - PCP-Combine
>>    - Add "-subtract" and "-add" command line options to compute 
>> differences
>>      of accumulation intervals rather than just sums.
>>    - Add "-gc" command line option to allow the user to specify which 
>> grib
>>      code to use.
>> - Point-Stat
>>    - Add the ability to dump out the matched pair data directly to ASCII
>>      and VSDB files.
>> - Grid-Stat
>>    - Update to read NetCDF output of PCP-Combine
>> - MODE
>>    - Update to read NetCDF output of PCP-Combine
>>
>> So in your case, you'll use the "-subtract" option in PCP-Combine to 
>> do 30 hours of accumulation - 6 hours of accumulation.  And you'll use 
>> the ASCII2NC tool to convert your observations to NetCDF. I've 
>> modified that NetCDF point observation format to make it a little more 
>> simple.  I removed the entries that were not actually being used by 
>> Point-Stat.  Please use the version of the configuration files that 
>> are distributed with this code, rather than the ones from version 
>> 1.0.  The config file for PointStat in particular has changes slightly.
>>
>> You can find the code via FTP at:
>> ftp.rap.ucar.edu/incoming/irap/johnhg/METv1.1beta.20080206.tar.gz
>>
>> Please let me know if you run into any problems or have suggestions 
>> for changes.
>>
>> Thanks,
>> John Halley Gotway