[ncl-talk] Memory leak with grib2 files

[David Brown]

Hopefully very soon. We will announce it.
 -dave

On Thu, Jun 29, 2017 at 5:11 PM, Dave Allured - NOAA Affiliate
<dave.allured at noaa.gov> wrote:
> Dave B,
>
> That's great.  Thank you for the quick response.
>
> Do you have a rough estimate for when the conda development branch access
> might be available?
>
> --Dave A.
>
>
> On Thu, Jun 29, 2017 at 4:08 PM, David Brown <dbrown at ucar.edu> wrote:
>>
>> Dave ,
>> This leak has been fixed. If you need the new version, let us know. We
>> are in the process of creating a system where a new build will be
>> available the next day whenever a change has been made to the
>> development branch of the code. This will be via the ncar conda
>> channel.
>>  -dave
>>
>> On Thu, Jun 29, 2017 at 10:21 AM, David Brown <dbrown at ucar.edu> wrote:
>> > Hi Dave,
>> > We will check this out.
>> >  -dave
>> >
>> > On Thu, Jun 29, 2017 at 10:09 AM, Dave Allured - NOAA Affiliate
>> > <dave.allured at noaa.gov> wrote:
>> >> NCL team,
>> >>
>> >> When reading a series of grib2 files, I get a serious memory leak.  For
>> >> each
>> >> grib2 file of about 60 Mb size, it seems that about 15 Mb of user
>> >> memory is
>> >> consumed by addfile, and never released.
>> >>
>> >> Is this an NCL bug?  Is there a quick fix or a patch available?
>> >>
>> >> We tested similar scenarios with Netcdf file sets, and never saw a
>> >> memory
>> >> accumulation like this.
>> >>
>> >> I tested this with NCL 6.4.0 on two systems, and got identical
>> >> behavior:
>> >>
>> >> * Mac OS El Capitan (10.11.6)
>> >> * Linux, Centos 6.9.
>> >>
>> >> Following is a simple test case.  I suggest using any available grib2
>> >> data
>> >> set for your own testing.  I can upload some of these grib2 files if
>> >> you
>> >> can't duplicate the behavior with your own files.
>> >>
>> >> begin
>> >>   base = "/Projects/Reforecast2/1985/198501/"
>> >>   wildcard = "198501??00/[cp]??/latlon/hgt_pres_198501??00_???.grib2"
>> >>
>> >>   files  = systemfunc ("ls -1 " + base + wildcard)
>> >>   nfiles = dimsizes (files)
>> >>   print ("Number of files = " + nfiles)
>> >>
>> >>   do i = 0, nfiles-1
>> >>     f = addfile (files(i), "r")
>> >>     print (i + "  " + files(i))
>> >>     delete (f)
>> >>   end do
>> >> end
>> >>
>> >> Thanks for looking into this.
>> >>
>> >> --Dave
>
>
> _______________________________________________
> ncl-talk mailing list
> ncl-talk at ucar.edu
> List instructions, subscriber options, unsubscribe:
> http://mailman.ucar.edu/mailman/listinfo/ncl-talk
>