[Met_help] [rt.rap.ucar.edu #87963] History for MODE quilt plot

John Halley Gotway via RT met_help at ucar.edu
Tue Jul 9 12:07:04 MDT 2019


----------------------------------------------------------------
  Initial Request
----------------------------------------------------------------

Hello,

We're puzzling over the following: the R script does seem to fall over when the input files are empty (i.e. headers only).
Rscript mode_quilt_plot.R sst_test /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R*_obj.txt

If we reduce the threshold sequence then it does complete but some of the thresholds appear to be missing. A quick look at the data suggests this should not be the case.
Rscript mode_quilt_plot.R sst_test /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R*_T?_obj.txt

The unique function also puts the largest convolution radius at the start, and I think it does not fix the ranking when it plots the quilt plot.
eld609:/net/home/h02/frmm/MET/scripts > O/output/mode_000000L_20180427_120000V_000000A_R*_T?_obj.txt                                                          <
Loading required package: methods
Loading required package: spam
Loading required package: dotCall64
Loading required package: grid
Spam version 2.2-0 (2018-06-19) is loaded.
Type 'help( Spam)' or 'demo( spam)' for a short introduction
and overview of this package.
Help for individual functions is also obtained by adding the
suffix '.spam' to the function name, e.g. 'help( chol.spam)'.

Attaching package: 'spam'

The following objects are masked from 'package:base':

    backsolve, forwardsolve

Loading required package: maps

Attaching package: 'fields'

The following object is masked from 'package:maps':

    ozone

Warning message:
failed to assign RegisteredNativeSymbol for toeplitz to toeplitz since toeplitz is already defined in the 'spam' namespace
gdata: read.xls support for 'XLS' (Excel 97-2004) files ENABLED.

gdata: read.xls support for 'XLSX' (Excel 2007+) files ENABLED.

Attaching package: 'gdata'

The following object is masked from 'package:stats':

    nobs

The following object is masked from 'package:utils':

    object.size

The following object is masked from 'package:base':

    startsWith

Read 45 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R10_T1_obj.txt
Read 33 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R10_T2_obj.txt
Read 75 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R10_T3_obj.txt
Read 68 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R10_T4_obj.txt
Read 58 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R10_T5_obj.txt
Read 39 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R10_T6_obj.txt
Read 16 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R10_T7_obj.txt
Read 10 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R10_T8_obj.txt
Read 14 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R10_T9_obj.txt
Read 185 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R1_T1_obj.txt
Read 320 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R1_T2_obj.txt
Read 474 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R1_T3_obj.txt
Read 558 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R1_T4_obj.txt
Read 445 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R1_T5_obj.txt
Read 418 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R1_T6_obj.txt
Read 238 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R1_T7_obj.txt
Read 115 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R1_T8_obj.txt
Read 82 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R1_T9_obj.txt
Read 151 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R2_T1_obj.txt
Read 215 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R2_T2_obj.txt
Read 327 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R2_T3_obj.txt
Read 370 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R2_T4_obj.txt
Read 408 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R2_T5_obj.txt
Read 307 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R2_T6_obj.txt
Read 118 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R2_T7_obj.txt
Read 75 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R2_T8_obj.txt
Read 60 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R2_T9_obj.txt
Read 116 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R3_T1_obj.txt
Read 186 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R3_T2_obj.txt
Read 210 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R3_T3_obj.txt
Read 299 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R3_T4_obj.txt
Read 306 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R3_T5_obj.txt
Read 168 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R3_T6_obj.txt
Read 86 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R3_T7_obj.txt
Read 42 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R3_T8_obj.txt
Read 42 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R3_T9_obj.txt
Read 79 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R4_T1_obj.txt
Read 126 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R4_T2_obj.txt
Read 222 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R4_T3_obj.txt
Read 207 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R4_T4_obj.txt
Read 220 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R4_T5_obj.txt
Read 72 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R4_T6_obj.txt
Read 94 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R4_T7_obj.txt
Read 39 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R4_T8_obj.txt
Read 34 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R4_T9_obj.txt
Read 83 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R5_T1_obj.txt
Read 90 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R5_T2_obj.txt
Read 137 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R5_T3_obj.txt
Read 168 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R5_T4_obj.txt
Read 125 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R5_T5_obj.txt
Read 56 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R5_T6_obj.txt
Read 46 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R5_T7_obj.txt
Read 28 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R5_T8_obj.txt
Read 20 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R5_T9_obj.txt
Read 82 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R6_T1_obj.txt
Read 51 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R6_T2_obj.txt
Read 131 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R6_T3_obj.txt
Read 174 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R6_T4_obj.txt
Read 103 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R6_T5_obj.txt
Read 50 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R6_T6_obj.txt
Read 41 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R6_T7_obj.txt
Read 25 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R6_T8_obj.txt
Read 15 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R6_T9_obj.txt
Read 87 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R7_T1_obj.txt
Read 41 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R7_T2_obj.txt
Read 107 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R7_T3_obj.txt
Read 158 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R7_T4_obj.txt
Read 100 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R7_T5_obj.txt
Read 67 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R7_T6_obj.txt
Read 31 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R7_T7_obj.txt
Read 25 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R7_T8_obj.txt
Read 15 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R7_T9_obj.txt
Read 72 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R8_T1_obj.txt
Read 42 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R8_T2_obj.txt
Read 71 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R8_T3_obj.txt
Read 98 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R8_T4_obj.txt
Read 68 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R8_T5_obj.txt
Read 43 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R8_T6_obj.txt
Read 29 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R8_T7_obj.txt
Read 9 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R8_T8_obj.txt
Read 15 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R8_T9_obj.txt
Read 55 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R9_T1_obj.txt
Read 41 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R9_T2_obj.txt
Read 77 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R9_T3_obj.txt
Read 85 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R9_T4_obj.txt
Read 67 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R9_T5_obj.txt
Read 39 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R9_T6_obj.txt
Read 26 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R9_T7_obj.txt
Read 10 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R9_T8_obj.txt
Read 14 lines from MODE file: /scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R9_T9_obj.txt
Read 10689 lines from 90 MODE files.
10 Convolution Radii Found:
10 1 2 3 4 5 6 7 8 9 <-- not sorted
9 Convolution Thresholds Found:
>=1.62 >=2.0 >=2.5 >=3.2 >=4.0 >=5.0 >=6.3 >=8.0 >=10.0
Creating ASCII file: sst_test_mode_quilts.txt
Creating PDF file: sst_test_mode_quilts.pdf
null device
          1
See the attached data. Run with MET 8.0.

Regards
Marion



--
Dr Marion Mittermaier       Manager: Model Diagnostics and Novel Verification Methods
Met Office FitzRoy Rd Exeter EX1 3PB United Kingdom
Tel +44 (0)1392 884830
E-mail: marion.mittermaier at metoffice.gov.uk<mailto:marion.mittermaier at metoffice.gov.uk>
http://www.metoffice.gov.uk<https://mail.cmpd1.metoffice.gov.uk/owa/redir.aspx?C=AKHoDb1piEyUp0_4-dOB-Dx8qHdiINAIaqQAFV6wmm8Xr4GUlN7JVn45tRMjN0WAQ09F11kk8qY.&URL=http%3a%2f%2fwww.metoffice.gov.uk>

http://www.metoffice.gov.uk/research/people/marion-mittermaier<https://mail.cmpd1.metoffice.gov.uk/owa/redir.aspx?C=AKHoDb1piEyUp0_4-dOB-Dx8qHdiINAIaqQAFV6wmm8Xr4GUlN7JVn45tRMjN0WAQ09F11kk8qY.&URL=http%3a%2f%2fwww.metoffice.gov.uk%2fresearch%2fpeople%2fmarion-mittermaier>

I am also co-chair of the WMO WWRP/WGNE Joint Working Group on Forecast Verification Research.



----------------------------------------------------------------
  Complete Ticket History
----------------------------------------------------------------

Subject: MODE quilt plot
From: John Halley Gotway
Time: Wed Dec 05 12:00:31 2018

Hi Marion,

Thanks for sending the sample data.  That really helped to identify
the
problem.

I've attached an updated version of the R-script that I ran on your
data to
produce the attached PDF file:
   *Rscript mode_quilt_plot.R sst_test
scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R*_obj.txt*

The updated version includes the following changes:
(1) The R-script was using a poor check for missing data which
basically
assumes that the *first* file it processes contains objects.  That's
not
the case with your data.  So I updated the logic to use a more robust
check.
(2) I had named the data object "mode" which was a very poor choice
since
"mode" is defined as the mathematical function in R.  I renamed "mode"
to
"mode_data".

Please confirm that the updated script behaves better and I'll commit
this
change to the repository and repost it to the website.

Thanks,
John

On Fri, Nov 30, 2018 at 3:22 AM marion.mittermaier at metoffice.gov.uk
via RT <
met_help at ucar.edu> wrote:

>
> Fri Nov 30 03:22:34 2018: Request 87963 was acted upon.
> Transaction: Ticket created by marion.mittermaier at metoffice.gov.uk
>        Queue: met_help
>      Subject: MODE quilt plot
>        Owner: Nobody
>   Requestors: marion.mittermaier at metoffice.gov.uk
>       Status: new
>  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87963 >
>
>
> Hello,
>
> We're puzzling over the following: the R script does seem to fall
over
> when the input files are empty (i.e. headers only).
> Rscript mode_quilt_plot.R sst_test
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R*_obj.txt
>
> If we reduce the threshold sequence then it does complete but some
of the
> thresholds appear to be missing. A quick look at the data suggests
this
> should not be the case.
> Rscript mode_quilt_plot.R sst_test
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R*_T?_obj.txt
>
> The unique function also puts the largest convolution radius at the
start,
> and I think it does not fix the ranking when it plots the quilt
plot.
> eld609:/net/home/h02/frmm/MET/scripts >
> O/output/mode_000000L_20180427_120000V_000000A_R*_T?_obj.txt
>                                           <
> Loading required package: methods
> Loading required package: spam
> Loading required package: dotCall64
> Loading required package: grid
> Spam version 2.2-0 (2018-06-19) is loaded.
> Type 'help( Spam)' or 'demo( spam)' for a short introduction
> and overview of this package.
> Help for individual functions is also obtained by adding the
> suffix '.spam' to the function name, e.g. 'help( chol.spam)'.
>
> Attaching package: 'spam'
>
> The following objects are masked from 'package:base':
>
>     backsolve, forwardsolve
>
> Loading required package: maps
>
> Attaching package: 'fields'
>
> The following object is masked from 'package:maps':
>
>     ozone
>
> Warning message:
> failed to assign RegisteredNativeSymbol for toeplitz to toeplitz
since
> toeplitz is already defined in the 'spam' namespace
> gdata: read.xls support for 'XLS' (Excel 97-2004) files ENABLED.
>
> gdata: read.xls support for 'XLSX' (Excel 2007+) files ENABLED.
>
> Attaching package: 'gdata'
>
> The following object is masked from 'package:stats':
>
>     nobs
>
> The following object is masked from 'package:utils':
>
>     object.size
>
> The following object is masked from 'package:base':
>
>     startsWith
>
> Read 45 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R10_T1_obj.txt
> Read 33 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R10_T2_obj.txt
> Read 75 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R10_T3_obj.txt
> Read 68 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R10_T4_obj.txt
> Read 58 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R10_T5_obj.txt
> Read 39 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R10_T6_obj.txt
> Read 16 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R10_T7_obj.txt
> Read 10 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R10_T8_obj.txt
> Read 14 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R10_T9_obj.txt
> Read 185 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R1_T1_obj.txt
> Read 320 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R1_T2_obj.txt
> Read 474 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R1_T3_obj.txt
> Read 558 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R1_T4_obj.txt
> Read 445 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R1_T5_obj.txt
> Read 418 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R1_T6_obj.txt
> Read 238 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R1_T7_obj.txt
> Read 115 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R1_T8_obj.txt
> Read 82 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R1_T9_obj.txt
> Read 151 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R2_T1_obj.txt
> Read 215 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R2_T2_obj.txt
> Read 327 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R2_T3_obj.txt
> Read 370 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R2_T4_obj.txt
> Read 408 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R2_T5_obj.txt
> Read 307 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R2_T6_obj.txt
> Read 118 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R2_T7_obj.txt
> Read 75 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R2_T8_obj.txt
> Read 60 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R2_T9_obj.txt
> Read 116 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R3_T1_obj.txt
> Read 186 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R3_T2_obj.txt
> Read 210 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R3_T3_obj.txt
> Read 299 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R3_T4_obj.txt
> Read 306 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R3_T5_obj.txt
> Read 168 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R3_T6_obj.txt
> Read 86 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R3_T7_obj.txt
> Read 42 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R3_T8_obj.txt
> Read 42 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R3_T9_obj.txt
> Read 79 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R4_T1_obj.txt
> Read 126 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R4_T2_obj.txt
> Read 222 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R4_T3_obj.txt
> Read 207 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R4_T4_obj.txt
> Read 220 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R4_T5_obj.txt
> Read 72 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R4_T6_obj.txt
> Read 94 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R4_T7_obj.txt
> Read 39 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R4_T8_obj.txt
> Read 34 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R4_T9_obj.txt
> Read 83 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R5_T1_obj.txt
> Read 90 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R5_T2_obj.txt
> Read 137 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R5_T3_obj.txt
> Read 168 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R5_T4_obj.txt
> Read 125 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R5_T5_obj.txt
> Read 56 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R5_T6_obj.txt
> Read 46 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R5_T7_obj.txt
> Read 28 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R5_T8_obj.txt
> Read 20 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R5_T9_obj.txt
> Read 82 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R6_T1_obj.txt
> Read 51 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R6_T2_obj.txt
> Read 131 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R6_T3_obj.txt
> Read 174 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R6_T4_obj.txt
> Read 103 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R6_T5_obj.txt
> Read 50 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R6_T6_obj.txt
> Read 41 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R6_T7_obj.txt
> Read 25 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R6_T8_obj.txt
> Read 15 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R6_T9_obj.txt
> Read 87 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R7_T1_obj.txt
> Read 41 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R7_T2_obj.txt
> Read 107 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R7_T3_obj.txt
> Read 158 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R7_T4_obj.txt
> Read 100 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R7_T5_obj.txt
> Read 67 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R7_T6_obj.txt
> Read 31 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R7_T7_obj.txt
> Read 25 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R7_T8_obj.txt
> Read 15 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R7_T9_obj.txt
> Read 72 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R8_T1_obj.txt
> Read 42 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R8_T2_obj.txt
> Read 71 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R8_T3_obj.txt
> Read 98 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R8_T4_obj.txt
> Read 68 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R8_T5_obj.txt
> Read 43 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R8_T6_obj.txt
> Read 29 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R8_T7_obj.txt
> Read 9 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R8_T8_obj.txt
> Read 15 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R8_T9_obj.txt
> Read 55 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R9_T1_obj.txt
> Read 41 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R9_T2_obj.txt
> Read 77 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R9_T3_obj.txt
> Read 85 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R9_T4_obj.txt
> Read 67 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R9_T5_obj.txt
> Read 39 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R9_T6_obj.txt
> Read 26 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R9_T7_obj.txt
> Read 10 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R9_T8_obj.txt
> Read 14 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R9_T9_obj.txt
> Read 10689 lines from 90 MODE files.
> 10 Convolution Radii Found:
> 10 1 2 3 4 5 6 7 8 9 <-- not sorted
> 9 Convolution Thresholds Found:
> >=1.62 >=2.0 >=2.5 >=3.2 >=4.0 >=5.0 >=6.3 >=8.0 >=10.0
> Creating ASCII file: sst_test_mode_quilts.txt
> Creating PDF file: sst_test_mode_quilts.pdf
> null device
>           1
> See the attached data. Run with MET 8.0.
>
> Regards
> Marion
>
>
>
> --
> Dr Marion Mittermaier       Manager: Model Diagnostics and Novel
> Verification Methods
> Met Office FitzRoy Rd Exeter EX1 3PB United Kingdom
> Tel +44 (0)1392 884830
> E-mail: marion.mittermaier at metoffice.gov.uk<mailto:
> marion.mittermaier at metoffice.gov.uk>
> http://www.metoffice.gov.uk<
>
https://mail.cmpd1.metoffice.gov.uk/owa/redir.aspx?C=AKHoDb1piEyUp0_4-
dOB-
Dx8qHdiINAIaqQAFV6wmm8Xr4GUlN7JVn45tRMjN0WAQ09F11kk8qY.&URL=http%3a%2f%2fwww.metoffice.gov.uk
> >
>
> http://www.metoffice.gov.uk/research/people/marion-mittermaier<
>
https://mail.cmpd1.metoffice.gov.uk/owa/redir.aspx?C=AKHoDb1piEyUp0_4-
dOB-
Dx8qHdiINAIaqQAFV6wmm8Xr4GUlN7JVn45tRMjN0WAQ09F11kk8qY.&URL=http%3a%2f%2fwww.metoffice.gov.uk%2fresearch%2fpeople%2fmarion-
mittermaier
> >
>
> I am also co-chair of the WMO WWRP/WGNE Joint Working Group on
Forecast
> Verification Research.
>
>
>

------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #87963] MODE quilt plot
From: marion.mittermaier at metoffice.gov.uk
Time: Thu Dec 06 01:11:23 2018

Thanks John! Rachel, can you test please?

Regards
Marion


--
Dr Marion Mittermaier       Manager: Model Diagnostics and Novel
Verification Methods
Met Office FitzRoy Rd Exeter EX1 3PB United Kingdom
Tel +44 (0)1392 884830
E-mail: marion.mittermaier at metoffice.gov.uk 
http://www.metoffice.gov.uk

http://www.metoffice.gov.uk/research/people/marion-mittermaier

I am also co-chair of the WMO WWRP/WGNE Joint Working Group on
Forecast Verification Research.


-----Original Message-----
From: John Halley Gotway via RT <met_help at ucar.edu>
Sent: 05 December 2018 19:01
To: Mittermaier, Marion <marion.mittermaier at metoffice.gov.uk>
Cc: North, Rachel <rachel.north at metoffice.gov.uk>
Subject: Re: [rt.rap.ucar.edu #87963] MODE quilt plot

Hi Marion,

Thanks for sending the sample data.  That really helped to identify
the problem.

I've attached an updated version of the R-script that I ran on your
data to produce the attached PDF file:
   *Rscript mode_quilt_plot.R sst_test
scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R*_obj.txt*

The updated version includes the following changes:
(1) The R-script was using a poor check for missing data which
basically assumes that the *first* file it processes contains objects.
That's not the case with your data.  So I updated the logic to use a
more robust check.
(2) I had named the data object "mode" which was a very poor choice
since "mode" is defined as the mathematical function in R.  I renamed
"mode" to "mode_data".

Please confirm that the updated script behaves better and I'll commit
this change to the repository and repost it to the website.

Thanks,
John

On Fri, Nov 30, 2018 at 3:22 AM marion.mittermaier at metoffice.gov.uk
via RT < met_help at ucar.edu> wrote:

>
> Fri Nov 30 03:22:34 2018: Request 87963 was acted upon.
> Transaction: Ticket created by marion.mittermaier at metoffice.gov.uk
>        Queue: met_help
>      Subject: MODE quilt plot
>        Owner: Nobody
>   Requestors: marion.mittermaier at metoffice.gov.uk
>       Status: new
>  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87963
> >
>
>
> Hello,
>
> We're puzzling over the following: the R script does seem to fall
over
> when the input files are empty (i.e. headers only).
> Rscript mode_quilt_plot.R sst_test
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R*_obj.txt
>
> If we reduce the threshold sequence then it does complete but some
of
> the thresholds appear to be missing. A quick look at the data
suggests
> this should not be the case.
> Rscript mode_quilt_plot.R sst_test
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R*_T?_obj.txt
>
> The unique function also puts the largest convolution radius at the
> start, and I think it does not fix the ranking when it plots the
quilt plot.
> eld609:/net/home/h02/frmm/MET/scripts >
> O/output/mode_000000L_20180427_120000V_000000A_R*_T?_obj.txt
>                                           < Loading required
package:
> methods Loading required package: spam Loading required package:
> dotCall64 Loading required package: grid Spam version 2.2-0
> (2018-06-19) is loaded.
> Type 'help( Spam)' or 'demo( spam)' for a short introduction and
> overview of this package.
> Help for individual functions is also obtained by adding the suffix
> '.spam' to the function name, e.g. 'help( chol.spam)'.
>
> Attaching package: 'spam'
>
> The following objects are masked from 'package:base':
>
>     backsolve, forwardsolve
>
> Loading required package: maps
>
> Attaching package: 'fields'
>
> The following object is masked from 'package:maps':
>
>     ozone
>
> Warning message:
> failed to assign RegisteredNativeSymbol for toeplitz to toeplitz
since
> toeplitz is already defined in the 'spam' namespace
> gdata: read.xls support for 'XLS' (Excel 97-2004) files ENABLED.
>
> gdata: read.xls support for 'XLSX' (Excel 2007+) files ENABLED.
>
> Attaching package: 'gdata'
>
> The following object is masked from 'package:stats':
>
>     nobs
>
> The following object is masked from 'package:utils':
>
>     object.size
>
> The following object is masked from 'package:base':
>
>     startsWith
>
> Read 45 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R10_T1_obj.txt
> Read 33 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R10_T2_obj.txt
> Read 75 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R10_T3_obj.txt
> Read 68 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R10_T4_obj.txt
> Read 58 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R10_T5_obj.txt
> Read 39 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R10_T6_obj.txt
> Read 16 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R10_T7_obj.txt
> Read 10 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R10_T8_obj.txt
> Read 14 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R10_T9_obj.txt
> Read 185 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R1_T1_obj.txt
> Read 320 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R1_T2_obj.txt
> Read 474 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R1_T3_obj.txt
> Read 558 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R1_T4_obj.txt
> Read 445 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R1_T5_obj.txt
> Read 418 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R1_T6_obj.txt
> Read 238 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R1_T7_obj.txt
> Read 115 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R1_T8_obj.txt
> Read 82 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R1_T9_obj.txt
> Read 151 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R2_T1_obj.txt
> Read 215 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R2_T2_obj.txt
> Read 327 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R2_T3_obj.txt
> Read 370 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R2_T4_obj.txt
> Read 408 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R2_T5_obj.txt
> Read 307 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R2_T6_obj.txt
> Read 118 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R2_T7_obj.txt
> Read 75 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R2_T8_obj.txt
> Read 60 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R2_T9_obj.txt
> Read 116 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R3_T1_obj.txt
> Read 186 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R3_T2_obj.txt
> Read 210 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R3_T3_obj.txt
> Read 299 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R3_T4_obj.txt
> Read 306 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R3_T5_obj.txt
> Read 168 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R3_T6_obj.txt
> Read 86 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R3_T7_obj.txt
> Read 42 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R3_T8_obj.txt
> Read 42 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R3_T9_obj.txt
> Read 79 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R4_T1_obj.txt
> Read 126 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R4_T2_obj.txt
> Read 222 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R4_T3_obj.txt
> Read 207 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R4_T4_obj.txt
> Read 220 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R4_T5_obj.txt
> Read 72 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R4_T6_obj.txt
> Read 94 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R4_T7_obj.txt
> Read 39 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R4_T8_obj.txt
> Read 34 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R4_T9_obj.txt
> Read 83 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R5_T1_obj.txt
> Read 90 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R5_T2_obj.txt
> Read 137 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R5_T3_obj.txt
> Read 168 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R5_T4_obj.txt
> Read 125 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R5_T5_obj.txt
> Read 56 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R5_T6_obj.txt
> Read 46 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R5_T7_obj.txt
> Read 28 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R5_T8_obj.txt
> Read 20 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R5_T9_obj.txt
> Read 82 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R6_T1_obj.txt
> Read 51 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R6_T2_obj.txt
> Read 131 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R6_T3_obj.txt
> Read 174 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R6_T4_obj.txt
> Read 103 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R6_T5_obj.txt
> Read 50 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R6_T6_obj.txt
> Read 41 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R6_T7_obj.txt
> Read 25 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R6_T8_obj.txt
> Read 15 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R6_T9_obj.txt
> Read 87 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R7_T1_obj.txt
> Read 41 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R7_T2_obj.txt
> Read 107 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R7_T3_obj.txt
> Read 158 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R7_T4_obj.txt
> Read 100 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R7_T5_obj.txt
> Read 67 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R7_T6_obj.txt
> Read 31 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R7_T7_obj.txt
> Read 25 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R7_T8_obj.txt
> Read 15 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R7_T9_obj.txt
> Read 72 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R8_T1_obj.txt
> Read 42 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R8_T2_obj.txt
> Read 71 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R8_T3_obj.txt
> Read 98 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R8_T4_obj.txt
> Read 68 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R8_T5_obj.txt
> Read 43 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R8_T6_obj.txt
> Read 29 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R8_T7_obj.txt
> Read 9 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R8_T8_obj.txt
> Read 15 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R8_T9_obj.txt
> Read 55 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R9_T1_obj.txt
> Read 41 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R9_T2_obj.txt
> Read 77 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R9_T3_obj.txt
> Read 85 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R9_T4_obj.txt
> Read 67 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R9_T5_obj.txt
> Read 39 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R9_T6_obj.txt
> Read 26 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R9_T7_obj.txt
> Read 10 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R9_T8_obj.txt
> Read 14 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R9_T9_obj.txt
> Read 10689 lines from 90 MODE files.
> 10 Convolution Radii Found:
> 10 1 2 3 4 5 6 7 8 9 <-- not sorted
> 9 Convolution Thresholds Found:
> >=1.62 >=2.0 >=2.5 >=3.2 >=4.0 >=5.0 >=6.3 >=8.0 >=10.0
> Creating ASCII file: sst_test_mode_quilts.txt Creating PDF file:
> sst_test_mode_quilts.pdf null device
>           1
> See the attached data. Run with MET 8.0.
>
> Regards
> Marion
>
>
>
> --
> Dr Marion Mittermaier       Manager: Model Diagnostics and Novel
> Verification Methods
> Met Office FitzRoy Rd Exeter EX1 3PB United Kingdom Tel +44 (0)1392
> 884830
> E-mail: marion.mittermaier at metoffice.gov.uk<mailto:
> marion.mittermaier at metoffice.gov.uk>
> http://www.metoffice.gov.uk<
>
https://mail.cmpd1.metoffice.gov.uk/owa/redir.aspx?C=AKHoDb1piEyUp0_4-
> dOB-
Dx8qHdiINAIaqQAFV6wmm8Xr4GUlN7JVn45tRMjN0WAQ09F11kk8qY.&URL=http%3
> a%2f%2fwww.metoffice.gov.uk
> >
>
> http://www.metoffice.gov.uk/research/people/marion-mittermaier<
>
https://mail.cmpd1.metoffice.gov.uk/owa/redir.aspx?C=AKHoDb1piEyUp0_4-
> dOB-
Dx8qHdiINAIaqQAFV6wmm8Xr4GUlN7JVn45tRMjN0WAQ09F11kk8qY.&URL=http%3
> a%2f%2fwww.metoffice.gov.uk%2fresearch%2fpeople%2fmarion-mittermaier
> >
>
> I am also co-chair of the WMO WWRP/WGNE Joint Working Group on
> Forecast Verification Research.
>
>
>



------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #87963] MODE quilt plot
From: North, Rachel
Time: Thu Dec 06 02:07:37 2018

Hi John,

Thanks very much, that script works beautifully.

Kind Regards,
Rachel

Dr Rachel North, Research Scientist
Met Office, FitzRoy Road, Exeter,  EX1 3PB, United Kingdom
Tel: +44 (0)1392 884332  Fax: +44 (0)1392 885681
rachel.north at metoffice.gov.uk http://www.metoffice.gov.uk

-----Original Message-----
From: Mittermaier, Marion
Sent: 06 December 2018 08:11
To: met_help at ucar.edu
Cc: North, Rachel <rachel.north at metoffice.gov.uk>
Subject: RE: [rt.rap.ucar.edu #87963] MODE quilt plot

Thanks John! Rachel, can you test please?

Regards
Marion


--
Dr Marion Mittermaier       Manager: Model Diagnostics and Novel
Verification Methods Met Office FitzRoy Rd Exeter EX1 3PB United
Kingdom Tel +44 (0)1392 884830
E-mail: marion.mittermaier at metoffice.gov.uk
http://www.metoffice.gov.uk

http://www.metoffice.gov.uk/research/people/marion-mittermaier

I am also co-chair of the WMO WWRP/WGNE Joint Working Group on
Forecast Verification Research.


-----Original Message-----
From: John Halley Gotway via RT <met_help at ucar.edu>
Sent: 05 December 2018 19:01
To: Mittermaier, Marion <marion.mittermaier at metoffice.gov.uk>
Cc: North, Rachel <rachel.north at metoffice.gov.uk>
Subject: Re: [rt.rap.ucar.edu #87963] MODE quilt plot

Hi Marion,

Thanks for sending the sample data.  That really helped to identify
the problem.

I've attached an updated version of the R-script that I ran on your
data to produce the attached PDF file:
   *Rscript mode_quilt_plot.R sst_test
scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_000000A_R*_obj.txt*

The updated version includes the following changes:
(1) The R-script was using a poor check for missing data which
basically assumes that the *first* file it processes contains objects.
That's not the case with your data.  So I updated the logic to use a
more robust check.
(2) I had named the data object "mode" which was a very poor choice
since "mode" is defined as the mathematical function in R.  I renamed
"mode" to "mode_data".

Please confirm that the updated script behaves better and I'll commit
this change to the repository and repost it to the website.

Thanks,
John

On Fri, Nov 30, 2018 at 3:22 AM marion.mittermaier at metoffice.gov.uk
via RT < met_help at ucar.edu> wrote:

>
> Fri Nov 30 03:22:34 2018: Request 87963 was acted upon.
> Transaction: Ticket created by marion.mittermaier at metoffice.gov.uk
>        Queue: met_help
>      Subject: MODE quilt plot
>        Owner: Nobody
>   Requestors: marion.mittermaier at metoffice.gov.uk
>       Status: new
>  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87963
> >
>
>
> Hello,
>
> We're puzzling over the following: the R script does seem to fall
over
> when the input files are empty (i.e. headers only).
> Rscript mode_quilt_plot.R sst_test
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R*_obj.txt
>
> If we reduce the threshold sequence then it does complete but some
of
> the thresholds appear to be missing. A quick look at the data
suggests
> this should not be the case.
> Rscript mode_quilt_plot.R sst_test
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R*_T?_obj.txt
>
> The unique function also puts the largest convolution radius at the
> start, and I think it does not fix the ranking when it plots the
quilt plot.
> eld609:/net/home/h02/frmm/MET/scripts >
> O/output/mode_000000L_20180427_120000V_000000A_R*_T?_obj.txt
>                                           < Loading required
package:
> methods Loading required package: spam Loading required package:
> dotCall64 Loading required package: grid Spam version 2.2-0
> (2018-06-19) is loaded.
> Type 'help( Spam)' or 'demo( spam)' for a short introduction and
> overview of this package.
> Help for individual functions is also obtained by adding the suffix
> '.spam' to the function name, e.g. 'help( chol.spam)'.
>
> Attaching package: 'spam'
>
> The following objects are masked from 'package:base':
>
>     backsolve, forwardsolve
>
> Loading required package: maps
>
> Attaching package: 'fields'
>
> The following object is masked from 'package:maps':
>
>     ozone
>
> Warning message:
> failed to assign RegisteredNativeSymbol for toeplitz to toeplitz
since
> toeplitz is already defined in the 'spam' namespace
> gdata: read.xls support for 'XLS' (Excel 97-2004) files ENABLED.
>
> gdata: read.xls support for 'XLSX' (Excel 2007+) files ENABLED.
>
> Attaching package: 'gdata'
>
> The following object is masked from 'package:stats':
>
>     nobs
>
> The following object is masked from 'package:utils':
>
>     object.size
>
> The following object is masked from 'package:base':
>
>     startsWith
>
> Read 45 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R10_T1_obj.txt
> Read 33 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R10_T2_obj.txt
> Read 75 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R10_T3_obj.txt
> Read 68 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R10_T4_obj.txt
> Read 58 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R10_T5_obj.txt
> Read 39 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R10_T6_obj.txt
> Read 16 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R10_T7_obj.txt
> Read 10 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R10_T8_obj.txt
> Read 14 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R10_T9_obj.txt
> Read 185 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R1_T1_obj.txt
> Read 320 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R1_T2_obj.txt
> Read 474 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R1_T3_obj.txt
> Read 558 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R1_T4_obj.txt
> Read 445 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R1_T5_obj.txt
> Read 418 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R1_T6_obj.txt
> Read 238 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R1_T7_obj.txt
> Read 115 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R1_T8_obj.txt
> Read 82 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R1_T9_obj.txt
> Read 151 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R2_T1_obj.txt
> Read 215 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R2_T2_obj.txt
> Read 327 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R2_T3_obj.txt
> Read 370 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R2_T4_obj.txt
> Read 408 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R2_T5_obj.txt
> Read 307 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R2_T6_obj.txt
> Read 118 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R2_T7_obj.txt
> Read 75 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R2_T8_obj.txt
> Read 60 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R2_T9_obj.txt
> Read 116 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R3_T1_obj.txt
> Read 186 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R3_T2_obj.txt
> Read 210 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R3_T3_obj.txt
> Read 299 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R3_T4_obj.txt
> Read 306 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R3_T5_obj.txt
> Read 168 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R3_T6_obj.txt
> Read 86 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R3_T7_obj.txt
> Read 42 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R3_T8_obj.txt
> Read 42 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R3_T9_obj.txt
> Read 79 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R4_T1_obj.txt
> Read 126 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R4_T2_obj.txt
> Read 222 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R4_T3_obj.txt
> Read 207 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R4_T4_obj.txt
> Read 220 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R4_T5_obj.txt
> Read 72 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R4_T6_obj.txt
> Read 94 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R4_T7_obj.txt
> Read 39 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R4_T8_obj.txt
> Read 34 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R4_T9_obj.txt
> Read 83 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R5_T1_obj.txt
> Read 90 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R5_T2_obj.txt
> Read 137 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R5_T3_obj.txt
> Read 168 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R5_T4_obj.txt
> Read 125 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R5_T5_obj.txt
> Read 56 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R5_T6_obj.txt
> Read 46 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R5_T7_obj.txt
> Read 28 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R5_T8_obj.txt
> Read 20 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R5_T9_obj.txt
> Read 82 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R6_T1_obj.txt
> Read 51 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R6_T2_obj.txt
> Read 131 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R6_T3_obj.txt
> Read 174 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R6_T4_obj.txt
> Read 103 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R6_T5_obj.txt
> Read 50 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R6_T6_obj.txt
> Read 41 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R6_T7_obj.txt
> Read 25 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R6_T8_obj.txt
> Read 15 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R6_T9_obj.txt
> Read 87 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R7_T1_obj.txt
> Read 41 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R7_T2_obj.txt
> Read 107 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R7_T3_obj.txt
> Read 158 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R7_T4_obj.txt
> Read 100 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R7_T5_obj.txt
> Read 67 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R7_T6_obj.txt
> Read 31 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R7_T7_obj.txt
> Read 25 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R7_T8_obj.txt
> Read 15 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R7_T9_obj.txt
> Read 72 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R8_T1_obj.txt
> Read 42 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R8_T2_obj.txt
> Read 71 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R8_T3_obj.txt
> Read 98 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R8_T4_obj.txt
> Read 68 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R8_T5_obj.txt
> Read 43 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R8_T6_obj.txt
> Read 29 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R8_T7_obj.txt
> Read 9 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R8_T8_obj.txt
> Read 15 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R8_T9_obj.txt
> Read 55 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R9_T1_obj.txt
> Read 41 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R9_T2_obj.txt
> Read 77 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R9_T3_obj.txt
> Read 85 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R9_T4_obj.txt
> Read 67 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R9_T5_obj.txt
> Read 39 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R9_T6_obj.txt
> Read 26 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R9_T7_obj.txt
> Read 10 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R9_T8_obj.txt
> Read 14 lines from MODE file:
>
/scratch/fryl/HIVE/mode/BIO/output/mode_000000L_20180427_120000V_00000
> 0A_R9_T9_obj.txt
> Read 10689 lines from 90 MODE files.
> 10 Convolution Radii Found:
> 10 1 2 3 4 5 6 7 8 9 <-- not sorted
> 9 Convolution Thresholds Found:
> >=1.62 >=2.0 >=2.5 >=3.2 >=4.0 >=5.0 >=6.3 >=8.0 >=10.0
> Creating ASCII file: sst_test_mode_quilts.txt Creating PDF file:
> sst_test_mode_quilts.pdf null device
>           1
> See the attached data. Run with MET 8.0.
>
> Regards
> Marion
>
>
>
> --
> Dr Marion Mittermaier       Manager: Model Diagnostics and Novel
> Verification Methods
> Met Office FitzRoy Rd Exeter EX1 3PB United Kingdom Tel +44 (0)1392
> 884830
> E-mail: marion.mittermaier at metoffice.gov.uk<mailto:
> marion.mittermaier at metoffice.gov.uk>
> http://www.metoffice.gov.uk<
>
https://mail.cmpd1.metoffice.gov.uk/owa/redir.aspx?C=AKHoDb1piEyUp0_4-
> dOB-
Dx8qHdiINAIaqQAFV6wmm8Xr4GUlN7JVn45tRMjN0WAQ09F11kk8qY.&URL=http%3
> a%2f%2fwww.metoffice.gov.uk
> >
>
> http://www.metoffice.gov.uk/research/people/marion-mittermaier<
>
https://mail.cmpd1.metoffice.gov.uk/owa/redir.aspx?C=AKHoDb1piEyUp0_4-
> dOB-
Dx8qHdiINAIaqQAFV6wmm8Xr4GUlN7JVn45tRMjN0WAQ09F11kk8qY.&URL=http%3
> a%2f%2fwww.metoffice.gov.uk%2fresearch%2fpeople%2fmarion-mittermaier
> >
>
> I am also co-chair of the WMO WWRP/WGNE Joint Working Group on
> Forecast Verification Research.
>
>
>



------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #87963] Resolved: MODE quilt plot
From: marion.mittermaier at metoffice.gov.uk
Time: Thu Dec 20 02:04:57 2018

Hi John,

Rachel and I have been looking at the revised plot and are still not
sure that it's correct.

1. The y-axis labelling of the plot is just a bit strange! The
threshold sequence is 1.6, 2.0, 2.5, 3.2 .... etc
2. We would expect the number of simple objects to decrease with
increasing convolution radius, yet the largest radius (10) has the
most objects. The colourbar colours and the pixels in the actual plot
do not match the values in the mode output file. E.g. for radius 10 at
1.62 the number of objects is 76 but the colour suggests it's over 80.
Also the # objects for radius 9 is 14 and for radius 1 is 62...!
That's odd given the first sentence/expectation.
3. Rows 6 and 8-10 appear empty / NA. There are no -9999 in the input
file so there should be no NA.

So, in short, I think we still don't understand what is happening...
can you please have a look again? i.e. reopen the ticket!

Regards
Marion

-----Original Message-----
From: John Halley Gotway via RT <met_help at ucar.edu>
Sent: 14 December 2018 17:22
To: Mittermaier, Marion <marion.mittermaier at metoffice.gov.uk>
Subject: [rt.rap.ucar.edu #87963] Resolved: MODE quilt plot

According to our records, your request has been resolved. If you have
any further questions or concerns, please respond to this message.



------------------------------------------------
Subject: MODE quilt plot
From: Julie Prestopnik
Time: Thu Dec 20 08:49:23 2018

Hi Marion.

Unfortunately, John is out of the office until the week after
Christmas.
Would it be ok for this issue to wait until he gets back?  I am not
familiar with the MODE quilt plots and do not believe I could be much
help
to you.

Thanks,
Julie

On Thu, Dec 20, 2018 at 2:05 AM marion.mittermaier at metoffice.gov.uk
via RT <
met_help at ucar.edu> wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87963 >
>
> Hi John,
>
> Rachel and I have been looking at the revised plot and are still not
sure
> that it's correct.
>
> 1. The y-axis labelling of the plot is just a bit strange! The
threshold
> sequence is 1.6, 2.0, 2.5, 3.2 .... etc
> 2. We would expect the number of simple objects to decrease with
> increasing convolution radius, yet the largest radius (10) has the
most
> objects. The colourbar colours and the pixels in the actual plot do
not
> match the values in the mode output file. E.g. for radius 10 at 1.62
the
> number of objects is 76 but the colour suggests it's over 80. Also
the #
> objects for radius 9 is 14 and for radius 1 is 62...! That's odd
given the
> first sentence/expectation.
> 3. Rows 6 and 8-10 appear empty / NA. There are no -9999 in the
input file
> so there should be no NA.
>
> So, in short, I think we still don't understand what is happening...
can
> you please have a look again? i.e. reopen the ticket!
>
> Regards
> Marion
>
> -----Original Message-----
> From: John Halley Gotway via RT <met_help at ucar.edu>
> Sent: 14 December 2018 17:22
> To: Mittermaier, Marion <marion.mittermaier at metoffice.gov.uk>
> Subject: [rt.rap.ucar.edu #87963] Resolved: MODE quilt plot
>
> According to our records, your request has been resolved. If you
have any
> further questions or concerns, please respond to this message.
>
>
>
>

------------------------------------------------
Subject: MODE quilt plot
From: Minna Win
Time: Thu Dec 20 10:01:34 2018

Hi Marion,

John is out of the office for the next two weeks.  We can reopen the
ticket
for you, but it won't be addressed until John returns to the office.

Thanks for your patience,
Minna
---------------
Minna Win
NCAR
Research Applications Lab
Phone: 303-497-8423
Fax:   303-497-8401



On Thu, Dec 20, 2018 at 9:05 AM marion.mittermaier at metoffice.gov.uk
via RT <
met_help at ucar.edu> wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87963 >
>
> Hi John,
>
> Rachel and I have been looking at the revised plot and are still not
sure
> that it's correct.
>
> 1. The y-axis labelling of the plot is just a bit strange! The
threshold
> sequence is 1.6, 2.0, 2.5, 3.2 .... etc
> 2. We would expect the number of simple objects to decrease with
> increasing convolution radius, yet the largest radius (10) has the
most
> objects. The colourbar colours and the pixels in the actual plot do
not
> match the values in the mode output file. E.g. for radius 10 at 1.62
the
> number of objects is 76 but the colour suggests it's over 80. Also
the #
> objects for radius 9 is 14 and for radius 1 is 62...! That's odd
given the
> first sentence/expectation.
> 3. Rows 6 and 8-10 appear empty / NA. There are no -9999 in the
input file
> so there should be no NA.
>
> So, in short, I think we still don't understand what is happening...
can
> you please have a look again? i.e. reopen the ticket!
>
> Regards
> Marion
>
> -----Original Message-----
> From: John Halley Gotway via RT <met_help at ucar.edu>
> Sent: 14 December 2018 17:22
> To: Mittermaier, Marion <marion.mittermaier at metoffice.gov.uk>
> Subject: [rt.rap.ucar.edu #87963] Resolved: MODE quilt plot
>
> According to our records, your request has been resolved. If you
have any
> further questions or concerns, please respond to this message.
>
>
>
>

------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #87963] Resolved: MODE quilt plot
From: marion.mittermaier at metoffice.gov.uk
Time: Fri Dec 21 05:59:48 2018

Hi Minna and Julie,

Yes that's fine. No one here either... 😊

Have a good Christmas!

Marion

-----Original Message-----
From: Minna Win via RT <met_help at ucar.edu>
Sent: 20 December 2018 17:02
To: Mittermaier, Marion <marion.mittermaier at metoffice.gov.uk>
Cc: North, Rachel <rachel.north at metoffice.gov.uk>
Subject: Re: [rt.rap.ucar.edu #87963] Resolved: MODE quilt plot

Hi Marion,

John is out of the office for the next two weeks.  We can reopen the
ticket for you, but it won't be addressed until John returns to the
office.

Thanks for your patience,
Minna
---------------
Minna Win
NCAR
Research Applications Lab
Phone: 303-497-8423
Fax:   303-497-8401



On Thu, Dec 20, 2018 at 9:05 AM marion.mittermaier at metoffice.gov.uk
via RT < met_help at ucar.edu> wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87963 >
>
> Hi John,
>
> Rachel and I have been looking at the revised plot and are still not
> sure that it's correct.
>
> 1. The y-axis labelling of the plot is just a bit strange! The
> threshold sequence is 1.6, 2.0, 2.5, 3.2 .... etc 2. We would expect
> the number of simple objects to decrease with increasing convolution
> radius, yet the largest radius (10) has the most objects. The
> colourbar colours and the pixels in the actual plot do not match the
> values in the mode output file. E.g. for radius 10 at 1.62 the
number
> of objects is 76 but the colour suggests it's over 80. Also the #
> objects for radius 9 is 14 and for radius 1 is 62...! That's odd
given
> the first sentence/expectation.
> 3. Rows 6 and 8-10 appear empty / NA. There are no -9999 in the
input
> file so there should be no NA.
>
> So, in short, I think we still don't understand what is happening...
> can you please have a look again? i.e. reopen the ticket!
>
> Regards
> Marion
>
> -----Original Message-----
> From: John Halley Gotway via RT <met_help at ucar.edu>
> Sent: 14 December 2018 17:22
> To: Mittermaier, Marion <marion.mittermaier at metoffice.gov.uk>
> Subject: [rt.rap.ucar.edu #87963] Resolved: MODE quilt plot
>
> According to our records, your request has been resolved. If you
have
> any further questions or concerns, please respond to this message.
>
>
>
>




------------------------------------------------
Subject: MODE quilt plot
From: Julie Prestopnik
Time: Fri Dec 21 09:17:16 2018

Thank you for understanding and for your patience.  We appreciate it!

Julie

On Fri, Dec 21, 2018 at 5:59 AM marion.mittermaier at metoffice.gov.uk
via RT <
met_help at ucar.edu> wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87963 >
>
> Hi Minna and Julie,
>
> Yes that's fine. No one here either... 😊
>
> Have a good Christmas!
>
> Marion
>
> -----Original Message-----
> From: Minna Win via RT <met_help at ucar.edu>
> Sent: 20 December 2018 17:02
> To: Mittermaier, Marion <marion.mittermaier at metoffice.gov.uk>
> Cc: North, Rachel <rachel.north at metoffice.gov.uk>
> Subject: Re: [rt.rap.ucar.edu #87963] Resolved: MODE quilt plot
>
> Hi Marion,
>
> John is out of the office for the next two weeks.  We can reopen the
> ticket for you, but it won't be addressed until John returns to the
office.
>
> Thanks for your patience,
> Minna
> ---------------
> Minna Win
> NCAR
> Research Applications Lab
> Phone: 303-497-8423
> Fax:   303-497-8401
>
>
>
> On Thu, Dec 20, 2018 at 9:05 AM marion.mittermaier at metoffice.gov.uk
via
> RT < met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87963 >
> >
> > Hi John,
> >
> > Rachel and I have been looking at the revised plot and are still
not
> > sure that it's correct.
> >
> > 1. The y-axis labelling of the plot is just a bit strange! The
> > threshold sequence is 1.6, 2.0, 2.5, 3.2 .... etc 2. We would
expect
> > the number of simple objects to decrease with increasing
convolution
> > radius, yet the largest radius (10) has the most objects. The
> > colourbar colours and the pixels in the actual plot do not match
the
> > values in the mode output file. E.g. for radius 10 at 1.62 the
number
> > of objects is 76 but the colour suggests it's over 80. Also the #
> > objects for radius 9 is 14 and for radius 1 is 62...! That's odd
given
> > the first sentence/expectation.
> > 3. Rows 6 and 8-10 appear empty / NA. There are no -9999 in the
input
> > file so there should be no NA.
> >
> > So, in short, I think we still don't understand what is
happening...
> > can you please have a look again? i.e. reopen the ticket!
> >
> > Regards
> > Marion
> >
> > -----Original Message-----
> > From: John Halley Gotway via RT <met_help at ucar.edu>
> > Sent: 14 December 2018 17:22
> > To: Mittermaier, Marion <marion.mittermaier at metoffice.gov.uk>
> > Subject: [rt.rap.ucar.edu #87963] Resolved: MODE quilt plot
> >
> > According to our records, your request has been resolved. If you
have
> > any further questions or concerns, please respond to this message.
> >
> >
> >
> >
>
>
>
>
>

------------------------------------------------
Subject: MODE quilt plot
From: marion.mittermaier at metoffice.gov.uk
Time: Thu Jan 31 02:17:18 2019

Hi all,

I've found some time to figure out what's wrong with the quilt plot
script. Attached is the script (running in interactive mode to debug,
so it's not beautiful and tidy).

There were a number of issues.

1. At the most fundamental level, when inputting a file list the file
names get sorted as strings, not numbers, thus the "ls" command is
putting the file R10_T10 and R10_T11 ahead of R10_T1, and R1 _T10 and
R1_T11 above R1_T1 etc. See the attached listed. When read in in this
order, the ordering is numerically incorrect. This obviously only
becomes an issue of there are more than 9 thresholds/radii. Maybe this
could be fixed by adding leading zeros to the filenames, i.e. calling
the files R01_T01?

2. Given the file naming convention and implications thereof, two
options remained, either sort the files differently in a script before
reading them in or sorting the data after reading it in. I tried to
order the rows after reading them in, but because R functions also
sort strings so that when you have thresholds such as ">=1.62" and
">=16.0", even if you specify decreasing=FALSE, the ">=16.0" appears
before ">=1.62". I have taken away the >= and returned them to numbers
in the big mode_data data frame to ensure that when I order the array
it is actually in the correct numerical order. In the end I concluded
that this was the only way because the aggregate function also does
this and was literally undoing my earlier reordering because it also
uses the character/string ordering. This is what foxed me for a while.
I couldn't understand why, after having put the data in the right
order at the start of the script it still got screwed up. It was only
when I looked at what the aggregate function did in detail, that I
discovered the issue. Changing the thresholds to numbers removes the
use gsub just about everywhere.

3. Reuse of "ind" should ok but I was getting concerned that ind was
reused inappropriately, so I basically reinitialised it every time.

4. Lastly I have sorted out the plotting itself. I have changed the y-
axis array. Maybe with all the other fixes I have made the existing
code would be ok, but when I looked at it I couldn't work out how it
had ever worked correctly? I haven't tested putting back the original
y-axis array as what I've got definitely works. I have also made sure
that all the rows are plotted and given sensible labels. We were
losing rows because the axis was plotted in whole numbers whereas we
have thresholds such as 1.62, 2,2.5, 3.2, 4, 5 which is 6 thresholds
but if you can only plot 1,2,3,4,5 then a row is lost somewhere.

I am now pretty sure that the MODE input, extracted info and quilt
plot match up!

Regards
Marion

-----Original Message-----
From: Julie Prestopnik via RT <met_help at ucar.edu>
Sent: 21 December 2018 16:17
To: Mittermaier, Marion <marion.mittermaier at metoffice.gov.uk>
Cc: North, Rachel <rachel.north at metoffice.gov.uk>
Subject: Re: [rt.rap.ucar.edu #87963] Resolved: MODE quilt plot

Thank you for understanding and for your patience.  We appreciate it!

Julie

On Fri, Dec 21, 2018 at 5:59 AM marion.mittermaier at metoffice.gov.uk
via RT < met_help at ucar.edu> wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87963 >
>
> Hi Minna and Julie,
>
> Yes that's fine. No one here either... 😊
>
> Have a good Christmas!
>
> Marion
>
> -----Original Message-----
> From: Minna Win via RT <met_help at ucar.edu>
> Sent: 20 December 2018 17:02
> To: Mittermaier, Marion <marion.mittermaier at metoffice.gov.uk>
> Cc: North, Rachel <rachel.north at metoffice.gov.uk>
> Subject: Re: [rt.rap.ucar.edu #87963] Resolved: MODE quilt plot
>
> Hi Marion,
>
> John is out of the office for the next two weeks.  We can reopen the
> ticket for you, but it won't be addressed until John returns to the
office.
>
> Thanks for your patience,
> Minna
> ---------------
> Minna Win
> NCAR
> Research Applications Lab
> Phone: 303-497-8423
> Fax:   303-497-8401
>
>
>
> On Thu, Dec 20, 2018 at 9:05 AM marion.mittermaier at metoffice.gov.uk
> via RT < met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87963 >
> >
> > Hi John,
> >
> > Rachel and I have been looking at the revised plot and are still
not
> > sure that it's correct.
> >
> > 1. The y-axis labelling of the plot is just a bit strange! The
> > threshold sequence is 1.6, 2.0, 2.5, 3.2 .... etc 2. We would
expect
> > the number of simple objects to decrease with increasing
convolution
> > radius, yet the largest radius (10) has the most objects. The
> > colourbar colours and the pixels in the actual plot do not match
the
> > values in the mode output file. E.g. for radius 10 at 1.62 the
> > number of objects is 76 but the colour suggests it's over 80. Also
> > the # objects for radius 9 is 14 and for radius 1 is 62...! That's
> > odd given the first sentence/expectation.
> > 3. Rows 6 and 8-10 appear empty / NA. There are no -9999 in the
> > input file so there should be no NA.
> >
> > So, in short, I think we still don't understand what is
happening...
> > can you please have a look again? i.e. reopen the ticket!
> >
> > Regards
> > Marion
> >
> > -----Original Message-----
> > From: John Halley Gotway via RT <met_help at ucar.edu>
> > Sent: 14 December 2018 17:22
> > To: Mittermaier, Marion <marion.mittermaier at metoffice.gov.uk>
> > Subject: [rt.rap.ucar.edu #87963] Resolved: MODE quilt plot
> >
> > According to our records, your request has been resolved. If you
> > have any further questions or concerns, please respond to this
message.
> >
> >
> >
> >
>
>
>
>
>



------------------------------------------------


More information about the Met_help mailing list