[ncl-talk] How to process numerous files(data) in NCL

Rashed Mahmood rashidcomsis at gmail.com
Fri May 22 08:01:55 MDT 2020


Hi Huang,
This question is a bit vague, at least I am not what statistics you are
trying to calculate. NCL can do array processing for certain things,
however, for a better answer to your specific needs, you would need to be
specific about what exactly you are trying to do?

Rashed

On Thu, May 21, 2020 at 6:56 PM 时光足迹 via ncl-talk <ncl-talk at ucar.edu> wrote:

> Hi there,
>     I have problems processing data with numerous files (~2GB each file)
> using NCL.
>     There are 10-year hourly 3-dimention meteological data in NetCDF
> format, which from 2010~2019, 2847 days in total. Data were stored daily
> (so there are 2847 files).
>     I want to caluclate some statistic varibles along all time in each
> grid. Take wsp(time|2847*24, level, lat, lon) for example, in the current
> method, do-loop on levels is used. Then
> 'wsp' will be processed along time. Finally I can get what I need (
> wsp_process(level,lat,lon) ).
>     However, it will be really ineffiency, and sometime it may meet error
> 'Segmentation fault (core dumped)'.
>     Is there any effiency way to meet my needs?
> Best regards,
> HUANG
> _______________________________________________
> ncl-talk mailing list
> ncl-talk at ucar.edu
> List instructions, subscriber options, unsubscribe:
> http://mailman.ucar.edu/mailman/listinfo/ncl-talk
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.ucar.edu/pipermail/ncl-talk/attachments/20200522/14a1c288/attachment.html>


More information about the ncl-talk mailing list