[ncl-talk] ERRNO=12

[Dave Allured - NOAA Affiliate]

3 Tb is a very large data set, difficult to contain all in memory at the
same time.  I recommend using serial methods to perform your analysis along
one or two dimensions, one step at a time.  You can implement serial
methods in NCL or any other scientific programming language.  In NCL, you
can use the full complement of library functions to assist your serial
methods.


On Thu, Oct 8, 2020 at 12:08 PM Chathurika via ncl-talk <
ncl-talk at mailman.ucar.edu> wrote:

>
> Hello,
>
>
> I want to handle large data set (more than 3TB).However, I am getting the
> error number 12 due to the failure of memory allocation. I read lot of Q&A
> for this issue, however there is no proper answer. I have to analyze this
> large data set. So please let me know how can I solve this memory
> allocation issue. I hope there is someone who already has a solution for
> this.
>
>
> Thank you so much and best regards
> ------------------------------
>
> Wickramage Chathurika Hemamali
>
> Msc in Physical Oceanography
> State Key Laboratory of Tropical Oceanography
> South China Sea Institute of Oceanology
> University of Chinese Academy of Science
> China
>
> *Specialized in Oceanography and Marine Geology (Bachelor)*
> *University of Ruhuna*
> *Matara*
> *Sri Lanka*
>
> Email:  wickramagechathurika at rocketmail.com
> chatu at scsio.ac.cn
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://mailman.ucar.edu/pipermail/ncl-talk/attachments/20201008/e9754887/attachment.html>