[ncl-talk] Grib index files

[David Brown]

Hi Dave,
We have certainly considered implementing index files for GRIB and
having gotten as far as writing up a plan for implementing them. But
so far other things have taken priority. Now that truly large files
are becoming more common it is probably time to put this feature on
the front burner. Thanks for the suggestion.
 -dave

On Mon, Aug 15, 2016 at 5:07 PM, Dave Allured - NOAA Affiliate
<dave.allured at noaa.gov> wrote:
> NCL support,
>
> Have you ever considered supporting index files as a way of speeding up read
> access for very large Grib1 and Grib2 files?  Apparently the CDO tool suite
> uses this feature with some success.
>
> I ran a quick test on a 20 Gbyte Grib2 forecast file from NCEP, with NCL
> 6.3.0 on a Linux 64-bit platform.  The file contained 33672 records.  It
> took 3.1 minutes to simply open this file with addfile, presumably because
> NCL scanned the entire file for metadata.
>
> --Dave
>
> _______________________________________________
> ncl-talk mailing list
> ncl-talk at ucar.edu
> List instructions, subscriber options, unsubscribe:
> http://mailman.ucar.edu/mailman/listinfo/ncl-talk
>