[ncl-talk] Using med on Large gmeta Files

[Rick Brownrigg]

Hi Bruce,

It appears that these codes use 32-bit integers, and thus the 2GB limit.  I
don't know what/how-long it would take to upgrade them to 64-bit.  I also
don't know about the gmeta format, but yes it could quite likely have
limitations.

I'm curious what is your application/requirement for this format (feel free
to reply directly to me if you'd like)?

Rick


On Thu, Jul 23, 2015 at 9:41 AM, Lunde, Bruce N CIV NAVOCEANO, NP1 <
bruce.lunde at navy.mil> wrote:

> UPDATE: idt is having a problem reading past a certain
> record in the files which are larger than 2GB.  Does idt
> have a filesize limit, or does the gmeta format have a
> limit ?   Thanks, Bruce
>
> ________________________________________
> Subject: Using med on Large gmeta Files
>
> Hello, I am trying to run the utility "med" on
> files larger than 2GB and it is failing. I can
> display these gmeta files with idt. I am running
> in an environment that has from 8GB to 240GB of
> memory for the buffer.
>
> Here is the command I am trying to run (I am
> trying to split out all the frames within a
> gmeta file):
>
>   med -e 'split $ frame.' foo.gmeta
>
> Here is the error message:
>
>   med: command failed <split>
>
> Here is a list of the file sizes which succeed
> or fail using med:
>
>   ls -l
>     FAIL 2262319200 Jul 22 22:21 f1.gmeta
>     FAIL 2216193120 Jul 22 22:02 f2.gmeta
>     OK   2079290880 Jul 22 22:19 f3.gmeta
>
>   ls -lh
>     FAIL 2.2G Jul 22 22:21 f1.gmeta
>     FAIL 2.1G Jul 22 22:02 f2.gmeta
>     OK   2.0G Jul 22 22:19 f3.gmeta
>
> Are there any suggestions of how to remedy this ?
> Maybe a setting in the .hluresfile file ?
>
> Thanks, Bruce
> _______________________________________________
> ncl-talk mailing list
> ncl-talk at ucar.edu
> List instructions, subscriber options, unsubscribe:
> http://mailman.ucar.edu/mailman/listinfo/ncl-talk
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.ucar.edu/pipermail/ncl-talk/attachments/20150723/14945309/attachment.html