[ncl-talk] Memory leak with grib2 files

[David Brown]

Hi Dave,
We will check this out.
 -dave

On Thu, Jun 29, 2017 at 10:09 AM, Dave Allured - NOAA Affiliate
<dave.allured at noaa.gov> wrote:
> NCL team,
>
> When reading a series of grib2 files, I get a serious memory leak.  For each
> grib2 file of about 60 Mb size, it seems that about 15 Mb of user memory is
> consumed by addfile, and never released.
>
> Is this an NCL bug?  Is there a quick fix or a patch available?
>
> We tested similar scenarios with Netcdf file sets, and never saw a memory
> accumulation like this.
>
> I tested this with NCL 6.4.0 on two systems, and got identical behavior:
>
> * Mac OS El Capitan (10.11.6)
> * Linux, Centos 6.9.
>
> Following is a simple test case.  I suggest using any available grib2 data
> set for your own testing.  I can upload some of these grib2 files if you
> can't duplicate the behavior with your own files.
>
> begin
>   base = "/Projects/Reforecast2/1985/198501/"
>   wildcard = "198501??00/[cp]??/latlon/hgt_pres_198501??00_???.grib2"
>
>   files  = systemfunc ("ls -1 " + base + wildcard)
>   nfiles = dimsizes (files)
>   print ("Number of files = " + nfiles)
>
>   do i = 0, nfiles-1
>     f = addfile (files(i), "r")
>     print (i + "  " + files(i))
>     delete (f)
>   end do
> end
>
> Thanks for looking into this.
>
> --Dave
>
> _______________________________________________
> ncl-talk mailing list
> ncl-talk at ucar.edu
> List instructions, subscriber options, unsubscribe:
> http://mailman.ucar.edu/mailman/listinfo/ncl-talk
>