[ncl-talk] NclMalloc Failed

[Kyle Griffin]

Nick,

The error you list specifies that NCL is failing *M*emory *Alloc*ation.
This likely means that you are running out of physical and/or virtual
memory on your machine. How much RAM and/or swap memory do you have? Are
other processes from you or other users running on the machine and further
using or reducing the available memory? Let us know.

In general, if this is the problem, you will need to either use another
machine or consider ways to better utilize your memory, depending on the
calculations you need to do. Unfortunately, this may necessitate reading in
the data in a less common order (by individual latitude or latitude ranges,
for example) and performing your calculations before continuing on to the
next portion of your data.


Kyle

----------------------------------------
Kyle S. Griffin
Department of Atmospheric and Oceanic Sciences
University of Wisconsin - Madison
Room 1407
1225 W Dayton St, Madison, WI 53706
Email: ksgriffin2 at wisc.edu

On Mon, Jan 25, 2016 at 8:25 AM, Nick Lybarger <nicklybarger at gmail.com>
wrote:

> Hi all,
> I've been having some trouble loading a large set of files into my script
> as a single variable.  I'm trying to load a set of high resolution
> satellite data totaling around 24GB in size.  Is it even possible to load
> files this large?  Here is sample code of what I've tried so far.
>
> allfiles=systemfunc("ls *.nc")
> setfileoption("nc,"Format","LargeFile")  (also, have tried "NetCDF4" here)
> f=addfiles(allfiles,"r")
> ListSetType(f,"cat")
> time=(f[:]->time)
> tauxx=(f[:]->surface_downward_eastward_stress)
>
>
> For which I get the error
>
> fatal:NclMalloc Failed:[errno=12]
> Segmentation fault
>
> Does this simply mean that these files are too large to load as one
> variable?  The NCL documentation claims there is no file size limit.  I
> would really appreciate some help.  Thanks!
>
> --
> Nick Lybarger
> George Mason University
> (615) 973 - 8913
> nlybarge at gmu.edu
> nicklybarger at gmail.com
>
> _______________________________________________
> ncl-talk mailing list
> ncl-talk at ucar.edu
> List instructions, subscriber options, unsubscribe:
> http://mailman.ucar.edu/mailman/listinfo/ncl-talk
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.ucar.edu/pipermail/ncl-talk/attachments/20160125/8a882274/attachment.html