[ncl-talk] Query regarding to the multiple files
Shani Tiwari
pshanitiwari at gmail.com
Mon Mar 5 20:57:32 MST 2018
Dear Dennis sir
I modified he directory. Since in the present
directory, there are only 17 .nc. I tried from both fils = systemfunc ("ls
"+diri+"*.nc") and fils = systemfunc ("ls "+diri+"g4.timeAvg.MIL3MAE_4_O
ptical_depth_average_Green*.nc") but both give the same result.
Once I print the fils using *print (fils), the out is totally strange which
is *
Variable: fils
Type: string
Total Size: 328 bytes
41 values
Number of Dimensions: 1
Dimensions and sizes: [41]
Coordinates:
(0)
g4.timeAvg.MIL3MAE_4_Optical_depth_average_Green.20000101-20001231.SEASON_JJA.180W_60N_180E_90N.nc
(1)
g4.timeAvg.MIL3MAE_4_Optical_depth_average_Green.20010101-20011231.SEASON_JJA.180W_60N_180E_90N.nc
(2)
g4.timeAvg.MIL3MAE_4_Optical_depth_average_Green.20020101-20021231.SEASON_JJA.180W_60N_180E_90N.nc
(3)
g4.timeAvg.MIL3MAE_4_Optical_depth_average_Green.20030101-20031231.SEASON_JJA.180W_60N_180E_90N.nc
(4)
g4.timeAvg.MIL3MAE_4_Optical_depth_average_Green.20040101-20041231.SEASON_JJA.180W_60N_180E_90N.nc
(5)
g4.timeAvg.MIL3MAE_4_Optical_depth_average_Green.20050101-20051231.SEASON_JJA.180W_60N_180E_90N.nc
(6)
g4.timeAvg.MIL3MAE_4_Optical_depth_average_Green.20060101-20061231.SEASON_JJA.180W_60N_180E_90N.nc
(7)
g4.timeAvg.MIL3MAE_4_Optical_depth_average_Green.20070101-20071231.SEASON_JJA.180W_60N_180E_90N.nc
(8)
g4.timeAvg.MIL3MAE_4_Optical_depth_average_Green.20080101-20081231.SEASON_JJA.180W_60N_180E_90N.nc
(9)
g4.timeAvg.MIL3MAE_4_Optical_depth_average_Green.20090101-20091231.SEASON_JJA.180W_60N_180E_90N.nc
(10)
g4.timeAvg.MIL3MAE_4_Optical_depth_average_Green.20100101-20101231.SEASON_JJA.180W_60N_180E_90N.nc
(11)
g4.timeAvg.MIL3MAE_4_Optical_depth_average_Green.20110101-20111231.SEASON_JJA.180W_60N_180E_90N.nc
(12)
g4.timeAvg.MIL3MAE_4_Optical_depth_average_Green.20120101-20121231.SEASON_JJA.180W_60N_180E_90N.nc
(13)
g4.timeAvg.MIL3MAE_4_Optical_depth_average_Green.20130101-20131231.SEASON_JJA.180W_60N_180E_90N.nc
(14)
g4.timeAvg.MIL3MAE_4_Optical_depth_average_Green.20140101-20141231.SEASON_JJA.180W_60N_180E_90N.nc
(15)
g4.timeAvg.MIL3MAE_4_Optical_depth_average_Green.20150101-20151231.SEASON_JJA.180W_60N_180E_90N.nc
(16)
g4.timeAvg.MIL3MAE_4_Optical_depth_average_Green.20160101-20161231.SEASON_JJA.180W_60N_180E_90N.nc
(17)
(18) /Volumes/TIWARI/Arctic/Climatology/MISR/:
(19) AOD anomaly from MISR.png
(20) AOD climatology from MISR.png
(21) Aerosol Climatology during JJA.000001.png
(22)
g4.ints.MIL3MAE_4_Optical_depth_average_Green.20000101-20161231.JJA.180W_60N_180E_90N.csv
(23)
g4.timeAvg.MIL3MAE_4_Optical_depth_average_Green.20000101-20001231.SEASON_JJA.180W_60N_180E_90N.nc
(24)
g4.timeAvg.MIL3MAE_4_Optical_depth_average_Green.20010101-20011231.SEASON_JJA.180W_60N_180E_90N.nc
(25)
g4.timeAvg.MIL3MAE_4_Optical_depth_average_Green.20020101-20021231.SEASON_JJA.180W_60N_180E_90N.nc
(26)
g4.timeAvg.MIL3MAE_4_Optical_depth_average_Green.20030101-20031231.SEASON_JJA.180W_60N_180E_90N.nc
(27)
g4.timeAvg.MIL3MAE_4_Optical_depth_average_Green.20040101-20041231.SEASON_JJA.180W_60N_180E_90N.nc
(28)
g4.timeAvg.MIL3MAE_4_Optical_depth_average_Green.20050101-20051231.SEASON_JJA.180W_60N_180E_90N.nc
(29)
g4.timeAvg.MIL3MAE_4_Optical_depth_average_Green.20060101-20061231.SEASON_JJA.180W_60N_180E_90N.nc
(30)
g4.timeAvg.MIL3MAE_4_Optical_depth_average_Green.20070101-20071231.SEASON_JJA.180W_60N_180E_90N.nc
(31)
g4.timeAvg.MIL3MAE_4_Optical_depth_average_Green.20080101-20081231.SEASON_JJA.180W_60N_180E_90N.nc
(32)
g4.timeAvg.MIL3MAE_4_Optical_depth_average_Green.20090101-20091231.SEASON_JJA.180W_60N_180E_90N.nc
(33)
g4.timeAvg.MIL3MAE_4_Optical_depth_average_Green.20100101-20101231.SEASON_JJA.180W_60N_180E_90N.nc
(34)
g4.timeAvg.MIL3MAE_4_Optical_depth_average_Green.20110101-20111231.SEASON_JJA.180W_60N_180E_90N.nc
(35)
g4.timeAvg.MIL3MAE_4_Optical_depth_average_Green.20120101-20121231.SEASON_JJA.180W_60N_180E_90N.nc
(36)
g4.timeAvg.MIL3MAE_4_Optical_depth_average_Green.20130101-20131231.SEASON_JJA.180W_60N_180E_90N.nc
(37)
g4.timeAvg.MIL3MAE_4_Optical_depth_average_Green.20140101-20141231.SEASON_JJA.180W_60N_180E_90N.nc
(38)
g4.timeAvg.MIL3MAE_4_Optical_depth_average_Green.20150101-20151231.SEASON_JJA.180W_60N_180E_90N.nc
(39)
g4.timeAvg.MIL3MAE_4_Optical_depth_average_Green.20160101-20161231.SEASON_JJA.180W_60N_180E_90N.nc
(40) misr.ncl
* Kindly let me know where is the fault in this script.*
Regards
------------------------------------------------------------
Shani Tiwari, Ph.D.
Graduate School of Environmental Studies,
Nagoya University, Nagoya, Japan
Mob: +91 9451952997
Skype ID: shani.tiwari2
Research Gate: Dr. Shani Tiwari
<https://www.researchgate.net/profile/Shani_Tiwari2>
Google Scholar Web-page: Dr. Shani Tiwari
<https://scholar.google.co.jp/citations?user=IjIjMTMAAAAJ&hl=en>
-------------------------------------------------------------
On Tue, Mar 6, 2018 at 12:34 PM, Dennis Shea <shea at ucar.edu> wrote:
>
> (0) # of files = 41
>
>
> I think you must be more specific in your 'systemfunc' usage.
>
>
>
> diri = "/Volumes/TIWARI/Arctic/Climatology/ "
> fils = systemfunc ("ls "+diri+"*.nc")
>
> The above is getting the name of *ALL* the netCDF files in the directory.
>
> Maybe:
>
> fils = systemfunc ("ls "+diri+"g4.timeAvg.MIL3MAE_4_
> Optical_depth_average_Green*.nc")
>
>
>
>
>
> On Mon, Mar 5, 2018 at 8:26 PM, Shani Tiwari <pshanitiwari at gmail.com>
> wrote:
>
>> Dear Mary
>> There are total 17 files in the folder and the output of
>> the printVarSummaries as :
>>
>> *Script :*
>>
>> begin
>>
>> diri = "/Volumes/TIWARI/Arctic/Climatology/ "
>> fils = systemfunc ("ls "+diri+"*.nc")
>> f1 = addfiles (fils, "r") ;
>>
>> print("# of files = " + dimsizes(fils))
>> print(f1[0])
>>
>> ListSetType (f1, "join")
>> aerosol = f1[:]->MIL3MAE_4_Optical_depth_average_Green
>> AOD = mask(aerosol,(aerosol.lt.0 .or. aerosol.gt.1),False)
>>
>>
>> Mean = dim_avg_n_Wrap(AOD, 0)
>> ; copy_VarCoords(Normal_AOD(0,:,:), Mean)
>> Mean!0="lat"
>> Mean!1="lon"
>> Mean&lat = aerosol&lat ; assign coordinate values and
>> Mean&lon = aerosol&lon ; units attributes
>>
>> printVarSummary (aerosol)
>>
>> end
>>
>> *And the output is :*
>>
>> (0) # of files = 41
>>
>>
>> Variable: unnamed
>>
>> Type: file
>>
>> filename: g4.timeAvg.MIL3MAE_4_Optical_depth_average_Green.20000101-20
>> 001231.SEASON_JJA.180W_60N_180E_90N
>>
>> path: g4.timeAvg.MIL3MAE_4_Optical_depth_average_Green.20000101-20
>> 001231.SEASON_JJA.180W_60N_180E_90N.nc
>>
>> file global attributes:
>>
>> nco_openmp_thread_number : 1
>>
>> Conventions : CF-1.4
>>
>> NCO : "4.5.3"
>>
>> history : Mon Mar 5 08:09:56 2018: ncks -O -x -v time_bnds
>> timeAvg.MIL3MAE_4_Optical_depth_average_Green.20000101-20001
>> 231.SEASON_JJA.180W_60N_180E_90N.nc timeAvg.MIL3MAE_4_Optical_dept
>> h_average_Green.20000101-20001231.SEASON_JJA.180W_60N_180E_90N.nc
>>
>> Mon Mar 5 08:09:56 2018: ncatted -a valid_range,,d,, -O -o
>> timeAvg.MIL3MAE_4_Optical_depth_average_Green.20000101-20001
>> 231.SEASON_JJA.180W_60N_180E_90N.nc timeAvg.MIL3MAE_4_Optical_dept
>> h_average_Green.20000101-20001231.SEASON_JJA.180W_60N_180E_90N.nc
>>
>> Mon Mar 5 08:09:56 2018: ncatted -O -a title,global,o,c,MIL3MAE_4_Optical_depth_average_Green
>> Averaged over 2000-01-01 to 2000-12-31 timeAvg.MIL3MAE_4_Optical_dept
>> h_average_Green.20000101-20001231.SEASON_JJA.180W_60N_180E_90N.nc
>>
>> Mon Mar 5 08:09:55 2018: ncks -x -v time -o
>> timeAvg.MIL3MAE_4_Optical_depth_average_Green.20000101-20001
>> 231.SEASON_JJA.180W_60N_180E_90N.nc -O timeAvg.MIL3MAE_4_Optical_dept
>> h_average_Green.20000101-20001231.SEASON_JJA.180W_60N_180E_90N.nc
>>
>> Mon Mar 5 08:09:55 2018: ncwa -o timeAvg.MIL3MAE_4_Optical_dept
>> h_average_Green.20000101-20001231.SEASON_JJA.180W_60N_180E_90N.nc -a
>> time -O timeAvg.MIL3MAE_4_Optical_depth_average_Green.20000101-20001
>> 231.SEASON_JJA.180W_60N_180E_90N.nc
>>
>> Mon Mar 5 08:09:55 2018: ncra -D 2 -H -O -o
>> timeAvg.MIL3MAE_4_Optical_depth_average_Green.20000101-20001
>> 231.SEASON_JJA.180W_60N_180E_90N.nc -d lat,60.000000,90.000000 -d
>> lon,-180.000000,180.000000
>>
>> start_time : 2000-06-01T00:00:00Z
>>
>> end_time : 2000-08-31T23:59:59Z
>>
>> userstartdate : 2000-01-01T00:00:00Z
>>
>> userenddate : 2000-12-31T23:59:59Z
>>
>> title : JJA (2000-Jun - 2000-Aug) Aerosol Optical Depth 555 nm
>> monthly 0.5 deg. [MISR MIL3MAE v4] over 2000-Jun - 2000-Aug, Region 180W,
>> 60N, 180E, 90N
>>
>> plot_hint_title : JJA (2000-Jun - 2000-Aug)
>>
>> plot_hint_subtitle : Aerosol Optical Depth 555 nm monthly 0.5 deg.
>> [MISR MIL3MAE v4] over 2000-Jun - 2000-Aug, Region 180W, 60N, 180E, 90N
>>
>> plot_hint_caption : - Seasons with missing months are discarded.
>>
>> dimensions:
>>
>> lat = 60
>>
>> lon = 720
>>
>> latv = 2
>>
>> lonv = 2
>>
>> variables:
>>
>> float MIL3MAE_4_Optical_depth_average_Green ( lat, lon )
>>
>> long_name : Aerosol Optical Depth 555 nm
>>
>> _FillValue : -9999
>>
>> cell_methods : OpticalDepth, Band, ParticleType: mean time: mean
>>
>> standard_name : optical_depth_average
>>
>> quantity_type : Total Aerosol Optical Depth
>>
>> product_short_name : MIL3MAE
>>
>> product_version : 4
>>
>> units : 1
>>
>> latitude_resolution : 0.5
>>
>> longitude_resolution : 0.5
>>
>> coordinates : lat lon
>>
>>
>> double lat ( lat )
>>
>> units : degrees_north
>>
>> standard_name : latitude
>>
>> bounds : lat_bnds
>>
>>
>> double lat_bnds ( lat, latv )
>>
>> units : degrees_north
>>
>>
>> double lon ( lon )
>>
>> units : degrees_east
>>
>> standard_name : longitude
>>
>> bounds : lon_bnds
>>
>>
>> double lon_bnds ( lon, lonv )
>>
>> units : degrees_east
>>
>>
>> warning:A valid instance of variable MIL3MAE_4_Optical_depth_average_Green
>> was not found in one or more elements of the file list
>>
>>
>> Variable: aerosol
>>
>> Type: float
>>
>> Total Size: 5875200 bytes
>>
>> 1468800 values
>>
>> Number of Dimensions: 3
>>
>> *Dimensions and sizes: [ncl_join | 34] x [lat | 60] x [lon | 720]*
>>
>> Coordinates:
>>
>> lat: [60.25..89.75]
>>
>> lon: [-179.75..179.75]
>>
>> Number Of Attributes: 11
>>
>> long_name : Aerosol Optical Depth 555 nm
>>
>> _FillValue : -9999
>>
>> cell_methods : OpticalDepth, Band, ParticleType: mean time: mean
>>
>> standard_name : optical_depth_average
>>
>> quantity_type : Total Aerosol Optical Depth
>>
>> product_short_name : MIL3MAE
>>
>> product_version : 4
>>
>> units : 1
>>
>> latitude_resolution : 0.5
>>
>> longitude_resolution : 0.5
>>
>> coordinates : lat lon
>>
>> warning:dim_rmvmean_n: 444 rightmost sections of the input array
>> contained all missing values
>>
>>
>>
>> Since , I added only 17 files, then the number of ncl_join should be 17
>> instead of 34.
>>
>>
>> I hope that now will understand my problem.
>>
>>
>>
>> Regards
>>
>>
>>
>>
>> ------------------------------------------------------------
>> Shani Tiwari, Ph.D.
>> Graduate School of Environmental Studies,
>> Nagoya University, Nagoya, Japan
>> Mob: +91 9451952997 <+91%2094519%2052997>
>> Skype ID: shani.tiwari2
>> Research Gate: Dr. Shani Tiwari
>> <https://www.researchgate.net/profile/Shani_Tiwari2>
>> Google Scholar Web-page: Dr. Shani Tiwari
>> <https://scholar.google.co.jp/citations?user=IjIjMTMAAAAJ&hl=en>
>> -------------------------------------------------------------
>>
>> On Tue, Mar 6, 2018 at 5:15 AM, Mary Haley <haley at ucar.edu> wrote:
>>
>>> Dear Shani,
>>>
>>> It would help if you provide more information about how many files you
>>> actually have, and what "aerosol" looks like.
>>>
>>> Can you please include the output from your "printVarSummary(aerosol)"
>>> call, and also add the following two print statements to your script after
>>> the addfiles call, and provide me with the output from that as well:
>>>
>>> print("# of files = " + dimsizes(fils))
>>> print(f1[0])
>>>
>>> Thanks,
>>>
>>> --Mary
>>>
>>>
>>>
>>>
>>>
>>>
>>> On Mon, Mar 5, 2018 at 2:35 AM, Shani Tiwari <pshanitiwari at gmail.com>
>>> wrote:
>>>
>>>> Dear NCL users
>>>> I added multiple files using "systemfunc"
>>>> and "ListSetType ". But the printVarSummary gave "ncl_join" size *exactly
>>>> double* to the number of files present in to the directory.
>>>>
>>>> begin
>>>>
>>>> diri = "/Volumes/TIWARI/Arctic/Climatology/ " ; input directory
>>>> fils = systemfunc ("ls "+diri+"*.nc") ; file paths
>>>> f1 = addfiles (fils, "r")
>>>> ListSetType (f1, "join")
>>>> aerosol = f1[:]->MIL3MAE_4_Optical_depth_average_Green
>>>> AOD = mask(aerosol,(aerosol.lt.0 .or. aerosol.gt.1),False)
>>>>
>>>>
>>>> Mean = dim_avg_n_Wrap(AOD, 0)
>>>> ; copy_VarCoords(Normal_AOD(0,:,:), Mean)
>>>> Mean!0="lat"
>>>> Mean!1="lon"
>>>> Mean&lat = aerosol&lat ; assign coordinate values and
>>>> Mean&lon = aerosol&lon ; units attributes
>>>>
>>>> printVarSummary (aerosol)
>>>>
>>>> end
>>>>
>>>> Kindly suggest me, how to overcome to this?
>>>>
>>>>
>>>> Regards
>>>>
>>>>
>>>> ------------------------------------------------------------
>>>> Shani Tiwari, Ph.D.
>>>> Graduate School of Environmental Studies,
>>>> Nagoya University, Nagoya, Japan
>>>> Mob: +91 9451952997 <+91%2094519%2052997>
>>>> Skype ID: shani.tiwari2
>>>> Research Gate: Dr. Shani Tiwari
>>>> <https://www.researchgate.net/profile/Shani_Tiwari2>
>>>> Google Scholar Web-page: Dr. Shani Tiwari
>>>> <https://scholar.google.co.jp/citations?user=IjIjMTMAAAAJ&hl=en>
>>>> -------------------------------------------------------------
>>>>
>>>> _______________________________________________
>>>> ncl-talk mailing list
>>>> ncl-talk at ucar.edu
>>>> List instructions, subscriber options, unsubscribe:
>>>> http://mailman.ucar.edu/mailman/listinfo/ncl-talk
>>>>
>>>>
>>>
>>
>> _______________________________________________
>> ncl-talk mailing list
>> ncl-talk at ucar.edu
>> List instructions, subscriber options, unsubscribe:
>> http://mailman.ucar.edu/mailman/listinfo/ncl-talk
>>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.ucar.edu/pipermail/ncl-talk/attachments/20180306/57aa172f/attachment-0001.html>
More information about the ncl-talk
mailing list