[ncl-talk] 2 Problems (a) Large file and (b) write_table

Sun Oct 1 12:03:52 MDT 2017

Dear all, I have a 3 output TEXT files (shown below), each for Mar, Apr and May which I have made into one by using cat command. This code fetches the Level of 17, 30 and 40 dbz.  My NCL code runs fine when individual file in given as input to the code but gives an error with the inpt file which has 27320 lines)the code is attached and the Error is shown below
Variable: DimsizeType: integerTotal Size: 4 bytes            1 valuesNumber of Dimensions: 1Dimensions and sizes: [1]Coordinates: (0) 27320fatal:NclMalloc Failed:[errno=12]fatal:["Execute.c":8578]:Execute: Error occurred at or near line 9041 in file /home/aditya/geeta/ncl/lib/ncarg/nclscripts/csm/contributed.ncl
fatal:["Execute.c":8578]:Execute: Error occurred at or near line 22 in file ht.v38.ncl
any help would be great. 
One sample line from the input file is shown here, March has 14072 lines, April 7237, May 6010 lines
Start 2A25.20080301.58642.7.HDF 6117 6539dimensions 9246 49New Cell6229,26, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0,17.7, 0.0,16.5,17.8,19.8,17.8, 0.0,15.0,15.0,15.1, 0.0,15.1, 0.0,16.6, 0.0, 0.0,17.9, 0.0, 0.0,19.0, 0.0, 0.0,15.3, 0.0,15.3,15.3, 0.0, 0.0, 0.0,15.4, 0.0, 0.0, 0.0, 0.0,18.2,15.5, 0.0,15.6, 0.0, 0.0,19.3,15.6, 0.0,18.4,18.4,15.8,15.8,15.8, 0.0,17.4,15.9, 0.0,16.0, 0.0,16.1, 0.0,17.6, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0,New Cell6233,30, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0,17.9, 0.0, 0.0,16.7,17.9,17.9,19.0, 0.0,16.8, 0.0,19.0, 0.0,16.8, 0.0, 0.0,16.9, 0.0, 0.0, 0.0, 0.0,15.4,17.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0,15.6,15.6, 0.0, 0.0,17.1,17.1, 0.0,17.2, 0.0,17.3,15.8,18.5, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0,18.7,16.2,17.6, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0,New Cell6358,47, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0,16.9, 0.0, 0.0,16.9,21.6,23.9,23.0,22.6,23.2,22.3, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0,New Cell6361,48, 0.0, 0.0,16.5,14.9, 0.0,14.9,19.9,18.9,19.9,15.0, 0.0, 0.0,15.0,20.0,18.0, 0.0,15.1,21.6,16.7,16.7,16.7, 0.0,15.1,15.2,18.0,15.2,16.8, 0.0,15.2,18.1,16.8,16.8, 0.0,15.2,16.9, 0.0,18.1,15.3,18.1,17.0,18.3, 0.0,15.5, 0.0, 0.0,19.4,17.1,15.6, 0.0,18.4,19.4, 0.0, 0.0,15.6,15.6,18.5, 0.0,17.2, 0.0,17.2,15.7,18.5,15.7, 0.0, 0.0,19.0,15.7, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0,New Cell6362,42, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0,16.3, 0.0,19.1,20.1,20.2, 0.0,18.4,17.7, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0,

My output looks likeCopyright (C) 1995-2014 - All Rights Reserved NCAR Command Language Version 6.2.1Total Size: 4 bytes            1 valuesNumber of Dimensions: 1Dimensions and sizes:   [1](0)     6011warning:asciiread: End of file reached and only (6011) elements were read from the file, filling remaining elements with the default missing value for the requested type^M(0)   START^M(0)   18.5 55 0 0 0 0 1 25^M(0)   17.4 16 31.7 32 40 50 14 350^M(0)   24.4 56 30.3 58 0 0 7 175^M(0)   21.3 45 30 52 40.2 59 53 1325^M(0)   17.6 65 0 0 0 0 1 25^M(0)   18.8 46 31.3 50 40 60 7 175^M(0)   18.1 60 30.7 66 0 0 1 25

The second problem is that I am unable to write the output into a file, Probably that is why I am getting ^M characters which are getting difficult in handling in further NCL codes. 
When I run this code, a lot of Warning messages keep coming. I am running the code like this
(0) 21.4 70 30.5 75 0 0 2 50warning:stringtofloat: a bad value was passed; input strings must contain numeric digits, replacing with missing valuewarning:stringtofloat: a bad value was passed; input strings must contain numeric digits, replacing with missing valuewarning:stringtofloat: a bad value was passed; input strings must contain numeric digits, replacing with missing valueIn order to suppress the warning,  I am ruiing the code like this. 
aditya at agniilap:~/geeta/ncl/ReadHDF-2A25$ ../bin/ncl ht.v38.ncl | grep [0-9]  >out1

Pls help me solve these issues. 
thanks Geeta.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.ucar.edu/pipermail/ncl-talk/attachments/20171001/9c1d252a/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: ht.v38.ncl
Type: application/octet-stream
Size: 4584 bytes
Desc: not available
URL: <http://mailman.ucar.edu/pipermail/ncl-talk/attachments/20171001/9c1d252a/attachment.obj>