<div dir="ltr">Nick,<div><br></div><div>The error you list specifies that NCL is failing <b>M</b>emory <b>Alloc</b>ation.</div><div>This likely means that you are running out of physical and/or virtual memory on your machine. How much RAM and/or swap memory do you have? Are other processes from you or other users running on the machine and further using or reducing the available memory? Let us know.</div><div><br></div><div>In general, if this is the problem, you will need to either use another machine or consider ways to better utilize your memory, depending on the calculations you need to do. Unfortunately, this may necessitate reading in the data in a less common order (by individual latitude or latitude ranges, for example) and performing your calculations before continuing on to the next portion of your data.</div><div><br></div><div><br></div><div>Kyle</div></div><div class="gmail_extra"><br clear="all"><div><div class="gmail_signature"><div dir="ltr"><div><div dir="ltr">----------------------------------------<div>Kyle S. Griffin</div><div>Department of Atmospheric and Oceanic Sciences</div><div>University of Wisconsin - Madison</div><div>Room 1407</div><div>1225 W Dayton St, Madison, WI 53706</div><div>Email: <a href="mailto:ksgriffin2@wisc.edu" target="_blank">ksgriffin2@wisc.edu</a></div></div></div></div></div></div>
<br><div class="gmail_quote">On Mon, Jan 25, 2016 at 8:25 AM, Nick Lybarger <span dir="ltr"><<a href="mailto:nicklybarger@gmail.com" target="_blank">nicklybarger@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Hi all,<div>I've been having some trouble loading a large set of files into my script as a single variable. I'm trying to load a set of high resolution satellite data totaling around 24GB in size. Is it even possible to load files this large? Here is sample code of what I've tried so far.</div><div><br></div><div>allfiles=systemfunc("ls *.nc")</div><div>setfileoption("nc,"Format","LargeFile") (also, have tried "NetCDF4" here)</div><div>f=addfiles(allfiles,"r")</div><div>ListSetType(f,"cat")</div><div>time=(f[:]->time)</div><div>tauxx=(f[:]->surface_downward_eastward_stress)</div><div><br></div><div><br></div><div>For which I get the error</div><div><br></div><div>fatal:NclMalloc Failed:[errno=12]</div><div>Segmentation fault</div><div><br></div><div>Does this simply mean that these files are too large to load as one variable? The NCL documentation claims there is no file size limit. I would really appreciate some help. Thanks!<span class="HOEnZb"><font color="#888888"><br clear="all"><div><br></div>-- <br><div><div dir="ltr">Nick Lybarger<div>George Mason University<br><div><a href="tel:%28615%29%20973%20-%208913" value="+16159738913" target="_blank">(615) 973 - 8913</a></div><div><a href="mailto:nlybarge@gmu.edu" target="_blank">nlybarge@gmu.edu</a></div><div><a href="mailto:nicklybarger@gmail.com" target="_blank">nicklybarger@gmail.com</a></div></div></div></div>
</font></span></div></div>
<br>_______________________________________________<br>
ncl-talk mailing list<br>
<a href="mailto:ncl-talk@ucar.edu">ncl-talk@ucar.edu</a><br>
List instructions, subscriber options, unsubscribe:<br>
<a href="http://mailman.ucar.edu/mailman/listinfo/ncl-talk" rel="noreferrer" target="_blank">http://mailman.ucar.edu/mailman/listinfo/ncl-talk</a><br>
<br></blockquote></div><br></div>