[ncl-talk] Calling binary files
Barry Lynn
barry.h.lynn at gmail.com
Thu Dec 21 01:48:52 MST 2017
Hi:
I'm not sure until you try it.
You can use a different name for the variable if you want.
Barry
On Thu, Dec 21, 2017 at 10:39 AM, Arka Banerjee <arka354deb at gmail.com>
wrote:
> Thanks!
> Above attached program is ok then?
>
> I have to use 'fn' some where else in this program thats why I am asking.
>
> Arka
>
> On Dec 21, 2017 14:05, "Barry Lynn" <barry.h.lynn at gmail.com> wrote:
>
>> Hi:
>>
>> You don't need a dot unless you need it in order to choose between files
>> with and without.
>>
>> You can print("all_files = " + all_files) to see if you list is correct.
>>
>> Barry
>>
>> On Thu, Dec 21, 2017 at 10:10 AM, Arka Banerjee <arka354deb at gmail.com>
>> wrote:
>>
>>> If I modify according to the example is it correct now for dat files?
>>>
>>> Datadir=("data/model/result/")
>>> diri=Datadir
>>> all_files=systemfunc("ls " +dir+ "day*dat")
>>> n_files=dimsizes(all_files)
>>> do n=0,n_files-1,1
>>> filename=all_files(n)
>>> fn=addfile(filename,"r")
>>>
>>> ....
>>> ....
>>> ....
>>> ....
>>>
>>>
>>> end
>>>
>>> 'addfile' is ok or it will be 'addfiles'?
>>> Now above fn is same as below mentioned in case of operation?
>>> fn=(/"day1.dat","day2.dat"/)
>>>
>>>
>>> On Dec 21, 2017 12:40, "Arka Banerjee" <arka354deb at gmail.com> wrote:
>>>
>>>> Yes.
>>>> But one thing.
>>>> There should not be a dot before grb?
>>>>
>>>> Code is attached below.
>>>>
>>>>
>>>> On Dec 21, 2017 12:35 PM, "Barry Lynn" <barry.h.lynn at gmail.com> wrote:
>>>>
>>>>> If you want to access the files within, you need a do loop to indicate
>>>>> which file you want to read.
>>>>>
>>>>> Barry
>>>>>
>>>>> On Thu, Dec 21, 2017 at 8:54 AM, Arka Banerjee <arka354deb at gmail.com>
>>>>> wrote:
>>>>>
>>>>>> Awesome, thanks!
>>>>>>
>>>>>> So for this a do loop is required?
>>>>>>
>>>>>> Arka
>>>>>>
>>>>>> On Dec 21, 2017 12:22, "Barry Lynn" <barry.h.lynn at gmail.com> wrote:
>>>>>>
>>>>>>> Hi:
>>>>>>>
>>>>>>> Here is what you need (example)
>>>>>>>
>>>>>>> DATADir = "/data1/wrf/NAM/"
>>>>>>>
>>>>>>> diri = DATADir ; you can add "+ date" if you have files listed
>>>>>>> in directories by date.
>>>>>>>
>>>>>>> all_files = systemfunc("ls " + diri + "nam*grb")
>>>>>>>
>>>>>>> print("all_files = " + all_files)
>>>>>>>
>>>>>>> n_files = dimsizes(all_files)
>>>>>>>
>>>>>>> print("n_files = " + n_files)
>>>>>>>
>>>>>>> ;do n=0,n_files -1,1
>>>>>>>
>>>>>>>
>>>>>>> do n=12,14
>>>>>>>
>>>>>>> print("all_files(n) = " + all_files(n))
>>>>>>>
>>>>>>> filename = all_files(n)
>>>>>>>
>>>>>>> print ("filename" + filename)
>>>>>>>
>>>>>>> a = addfile(filename,"r")
>>>>>>>
>>>>>>> On Thu, Dec 21, 2017 at 8:31 AM, Arka Banerjee via ncl-talk <
>>>>>>> ncl-talk at ucar.edu> wrote:
>>>>>>>
>>>>>>>> If one write the following line what does it mean?
>>>>>>>>
>>>>>>>> Fn=(/"day1.dat","day2.dat","day3.dat","day4.dat"/)
>>>>>>>>
>>>>>>>> The above line is not mean that all dat file names are concatenate
>>>>>>>> in variable Fn?
>>>>>>>> I required the same thing for 100 files but without manually
>>>>>>>> putting the file name.
>>>>>>>>
>>>>>>>> That was the question.
>>>>>>>>
>>>>>>>> Thanks,
>>>>>>>> Arka
>>>>>>>>
>>>>>>>> On Dec 21, 2017 01:37, "Dennis Shea" <shea at ucar.edu> wrote:
>>>>>>>>
>>>>>>>> @Arka: Please read the
>>>>>>>>
>>>>>>>> https://www.ncl.ucar.edu/Document/Manuals/
>>>>>>>>
>>>>>>>>
>>>>>>>> - NCL User Guide, V1.1
>>>>>>>> <https://www.ncl.ucar.edu/Document/Manuals/NCL_User_Guide>
>>>>>>>> - Mini-Language (pdf)
>>>>>>>> <https://www.ncl.ucar.edu/Document/Manuals/language_man.pdf>
>>>>>>>>
>>>>>>>> ====================================
>>>>>>>> NCL does allow a user to specify a *variable *which spans multiple
>>>>>>>> netCDF, grib or HDF files to (effectively) be concatenated via *addfiles
>>>>>>>> *and the appropriate* ListSetType *options.
>>>>>>>> *NOTE: the files are not concatenated ....only the specified
>>>>>>>> variable.*
>>>>>>>> https://www.ncl.ucar.edu/Document/Functions/Built-in/addfiles.shtml
>>>>>>>> https://www.ncl.ucar.edu/Document/Functions/Built-in/ListSet
>>>>>>>> Type.shtml
>>>>>>>>
>>>>>>>> =====
>>>>>>>> There is *no *explicit NCL function which concatenates *binary* or
>>>>>>>> *text* (ascii)* files*.
>>>>>>>> Please Read: https://www.ncl.ucar.edu/Applications/r-binary.shtml
>>>>>>>>
>>>>>>>> ===
>>>>>>>> Some options:
>>>>>>>>
>>>>>>>> [1] On the {U/Li}nix command line:
>>>>>>>>
>>>>>>>> %> *cat* LocalBinaryFiles*dat *>!* BigBinary.dat
>>>>>>>>
>>>>>>>> The *!* will overwrite 'BigBinary.dat' if the file currently exits.
>>>>>>>>
>>>>>>>> Depending on the binary file type, use:
>>>>>>>>
>>>>>>>> Direct Access: data = *fbindirread* <https://www.ncl.ucar.edu/Document/Functions/Built-in/fbindirread.shtml>("BigBinary.dat",rec,dim,type)
>>>>>>>>
>>>>>>>> Sequential Access: data = *fbinrecread* <https://www.ncl.ucar.edu/Document/Functions/Built-in/fbinrecread.shtml>("BigBinary.dat",rec,dim,type)
>>>>>>>>
>>>>>>>> *Please read* the documentation for these function:
>>>>>>>>
>>>>>>>> http://www.ncl.ucar.edu/Document/Functions/Built-in/fbindirread.shtml
>>>>>>>> http://www.ncl.ucar.edu/Document/Functions/Built-in/fbinrecread.shtml
>>>>>>>>
>>>>>>>> also, binary files could be '*BigEndian*" or '*LittleEndian**. *The following allows you to specify
>>>>>>>>
>>>>>>>> http://www.ncl.ucar.edu/Document/Functions/Built-in/isbigendian.shtml
>>>>>>>>
>>>>>>>> if (*isbigendian*() ) then ; is local machine big or little endian?
>>>>>>>> *setfileoption* <http://www.ncl.ucar.edu/Document/Functions/Built-in/setfileoption.shtml>("bin","ReadByteOrder","LittleEndian")
>>>>>>>> end if
>>>>>>>>
>>>>>>>> x = *fbindirread*(...)
>>>>>>>>
>>>>>>>> or
>>>>>>>>
>>>>>>>> c = *fbinrecread*(...)
>>>>>>>>
>>>>>>>> Sfter you are finished, you may want to delete the 'BigBinary.dat' file
>>>>>>>>
>>>>>>>> %> rm BigBinary.dat
>>>>>>>>
>>>>>>>> Or, perhaps the individual binary files and keep the concatenated file:
>>>>>>>>
>>>>>>>> %> rm LittleBinary*dat
>>>>>>>>
>>>>>>>>
>>>>>>>> [2]
>>>>>>>>
>>>>>>>> diri = ".../" ; input dir
>>>>>>>>
>>>>>>>> if (*.not.fileexists*("BigBinary.dat")) then
>>>>>>>>
>>>>>>>> system("cat LocalBinary*dat >! "BigBinary.dat")
>>>>>>>>
>>>>>>>> end if
>>>>>>>>
>>>>>>>>
>>>>>>>> Direct Access: data = *fbindirread* <https://www.ncl.ucar.edu/Document/Functions/Built-in/fbindirread.shtml>("BigBinary.dat",rec,dim,type)
>>>>>>>>
>>>>>>>> Sequential Access: data = *fbinrecread* <https://www.ncl.ucar.edu/Document/Functions/Built-in/fbinrecread.shtml>("BigBinary.dat",rec,dim,type)
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> On Wed, Dec 20, 2017 at 10:27 AM, Laura Fowler via ncl-talk <
>>>>>>>> ncl-talk at ucar.edu> wrote:
>>>>>>>>
>>>>>>>>> Hi Arka:
>>>>>>>>>
>>>>>>>>> I usually use systemfunc, followed with ListSetType, and then
>>>>>>>>> addfiles
>>>>>>>>> to read a bunch of the same kind of files together. There are lots
>>>>>>>>> of
>>>>>>>>> examples on how to use systemfun on the ncl web site.
>>>>>>>>>
>>>>>>>>> Hope this helps,
>>>>>>>>> Laura
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> On Wed, Dec 20, 2017 at 9:13 AM, Arka Banerjee via ncl-talk
>>>>>>>>> <ncl-talk at ucar.edu> wrote:
>>>>>>>>> > Hi all,
>>>>>>>>> >
>>>>>>>>> > How to concatenate all file names in a single variable in NCL? I
>>>>>>>>> have 100 of
>>>>>>>>> > .dat files in a directory and I want to call them all in a
>>>>>>>>> variable like
>>>>>>>>> > below;
>>>>>>>>> >
>>>>>>>>> > fn=(/"gsmap_nrt.20100805.0600.dat","gsmap_nrt.20100805.0900.
>>>>>>>>> dat"/)
>>>>>>>>> >
>>>>>>>>> > So that 'fn' will be re-structured for 100 of .dat files in the
>>>>>>>>> same way of
>>>>>>>>> > above line.
>>>>>>>>> >
>>>>>>>>> >
>>>>>>>>> > How to execute this thing? Function 'addfiles' helps in this
>>>>>>>>> case? As I have
>>>>>>>>> > found it is not for ascii formate.
>>>>>>>>> >
>>>>>>>>> >
>>>>>>>>> > Thanks,
>>>>>>>>> >
>>>>>>>>> > Arka
>>>>>>>>> >
>>>>>>>>> > _______________________________________________
>>>>>>>>> > ncl-talk mailing list
>>>>>>>>> > ncl-talk at ucar.edu
>>>>>>>>> > List instructions, subscriber options, unsubscribe:
>>>>>>>>> > http://mailman.ucar.edu/mailman/listinfo/ncl-talk
>>>>>>>>> >
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> --
>>>>>>>>> !-----------------------------------------------------------
>>>>>>>>> --------------------------------------------------
>>>>>>>>> Laura D. Fowler
>>>>>>>>> Mesoscale and Microscale Meteorology Division (MMM)
>>>>>>>>> National Center for Atmospheric Research
>>>>>>>>> P.O. Box 3000, Boulder CO 80307-3000
>>>>>>>>>
>>>>>>>>> e-mail: laura at ucar.edu
>>>>>>>>> phone: 303-497-1628
>>>>>>>>>
>>>>>>>>> !-----------------------------------------------------------
>>>>>>>>> --------------------------------------------------
>>>>>>>>> _______________________________________________
>>>>>>>>> ncl-talk mailing list
>>>>>>>>> ncl-talk at ucar.edu
>>>>>>>>> List instructions, subscriber options, unsubscribe:
>>>>>>>>> http://mailman.ucar.edu/mailman/listinfo/ncl-talk
>>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> _______________________________________________
>>>>>>>> ncl-talk mailing list
>>>>>>>> ncl-talk at ucar.edu
>>>>>>>> List instructions, subscriber options, unsubscribe:
>>>>>>>> http://mailman.ucar.edu/mailman/listinfo/ncl-talk
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> Barry H. Lynn, Ph.D
>>>>>>> Senior Lecturer,
>>>>>>> The Institute of the Earth Science,
>>>>>>> The Hebrew University of Jerusalem,
>>>>>>> Givat Ram, Jerusalem 91904, Israel
>>>>>>> Tel: 972 547 231 170
>>>>>>> Fax: (972)-25662581
>>>>>>>
>>>>>>> C.E.O, Weather It Is, LTD
>>>>>>> Weather and Climate Focus
>>>>>>> http://weather-it-is.com
>>>>>>> Jerusalem, Israel
>>>>>>> Local: 02 930 9525
>>>>>>> Cell: 054 7 231 170
>>>>>>> Int-IS: x972 2 930 9525
>>>>>>> US 914 432 3108 <(914)%20432-3108>
>>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Barry H. Lynn, Ph.D
>>>>> Senior Lecturer,
>>>>> The Institute of the Earth Science,
>>>>> The Hebrew University of Jerusalem,
>>>>> Givat Ram, Jerusalem 91904, Israel
>>>>> Tel: 972 547 231 170
>>>>> Fax: (972)-25662581
>>>>>
>>>>> C.E.O, Weather It Is, LTD
>>>>> Weather and Climate Focus
>>>>> http://weather-it-is.com
>>>>> Jerusalem, Israel
>>>>> Local: 02 930 9525
>>>>> Cell: 054 7 231 170
>>>>> Int-IS: x972 2 930 9525
>>>>> US 914 432 3108 <(914)%20432-3108>
>>>>>
>>>>
>>
>>
>> --
>> Barry H. Lynn, Ph.D
>> Senior Lecturer,
>> The Institute of the Earth Science,
>> The Hebrew University of Jerusalem,
>> Givat Ram, Jerusalem 91904, Israel
>> Tel: 972 547 231 170
>> Fax: (972)-25662581
>>
>> C.E.O, Weather It Is, LTD
>> Weather and Climate Focus
>> http://weather-it-is.com
>> Jerusalem, Israel
>> Local: 02 930 9525
>> Cell: 054 7 231 170
>> Int-IS: x972 2 930 9525
>> US 914 432 3108 <(914)%20432-3108>
>>
>
--
Barry H. Lynn, Ph.D
Senior Lecturer,
The Institute of the Earth Science,
The Hebrew University of Jerusalem,
Givat Ram, Jerusalem 91904, Israel
Tel: 972 547 231 170
Fax: (972)-25662581
C.E.O, Weather It Is, LTD
Weather and Climate Focus
http://weather-it-is.com
Jerusalem, Israel
Local: 02 930 9525
Cell: 054 7 231 170
Int-IS: x972 2 930 9525
US 914 432 3108
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.ucar.edu/pipermail/ncl-talk/attachments/20171221/cffb0019/attachment.html>
More information about the ncl-talk
mailing list