[ncl-talk] Query regarding to the multiple files

Shani Tiwari pshanitiwari at gmail.com
Mon Mar 5 20:26:43 MST 2018


Dear Mary
                There are total 17 files in the folder and the output of
the printVarSummaries as :

*Script :*

begin

diri = "/Volumes/TIWARI/Arctic/Climatology/ "
   fils = systemfunc ("ls "+diri+"*.nc")
   f1    = addfiles (fils, "r")                       ;

   print("# of files = " + dimsizes(fils))
   print(f1[0])

   ListSetType (f1, "join")
   aerosol    = f1[:]->MIL3MAE_4_Optical_depth_average_Green
   AOD = mask(aerosol,(aerosol.lt.0 .or. aerosol.gt.1),False)

   Mean  =  dim_avg_n_Wrap(AOD, 0)
  ; copy_VarCoords(Normal_AOD(0,:,:), Mean)
   Mean!0="lat"
   Mean!1="lon"
  Mean&lat = aerosol&lat              ; assign coordinate values and
  Mean&lon = aerosol&lon              ; units attributes

  printVarSummary (aerosol)

end

*And the output is :*

(0) # of files = 41


Variable: unnamed

Type: file

filename:
g4.timeAvg.MIL3MAE_4_Optical_depth_average_Green.20000101-20001231.SEASON_JJA.180W_60N_180E_90N

path:
g4.timeAvg.MIL3MAE_4_Optical_depth_average_Green.20000101-20001231.SEASON_JJA.180W_60N_180E_90N.nc

   file global attributes:

      nco_openmp_thread_number : 1

      Conventions : CF-1.4

      NCO : "4.5.3"

      history : Mon Mar  5 08:09:56 2018: ncks -O -x -v time_bnds
timeAvg.MIL3MAE_4_Optical_depth_average_Green.20000101-20001231.SEASON_JJA.180W_60N_180E_90N.nc
timeAvg.MIL3MAE_4_Optical_depth_average_Green.20000101-20001231.SEASON_JJA.180W_60N_180E_90N.nc

Mon Mar  5 08:09:56 2018: ncatted -a valid_range,,d,, -O -o
timeAvg.MIL3MAE_4_Optical_depth_average_Green.20000101-20001231.SEASON_JJA.180W_60N_180E_90N.nc
timeAvg.MIL3MAE_4_Optical_depth_average_Green.20000101-20001231.SEASON_JJA.180W_60N_180E_90N.nc

Mon Mar  5 08:09:56 2018: ncatted -O -a
title,global,o,c,MIL3MAE_4_Optical_depth_average_Green Averaged over
2000-01-01 to 2000-12-31
timeAvg.MIL3MAE_4_Optical_depth_average_Green.20000101-20001231.SEASON_JJA.180W_60N_180E_90N.nc

Mon Mar  5 08:09:55 2018: ncks -x -v time -o
timeAvg.MIL3MAE_4_Optical_depth_average_Green.20000101-20001231.SEASON_JJA.180W_60N_180E_90N.nc
-O
timeAvg.MIL3MAE_4_Optical_depth_average_Green.20000101-20001231.SEASON_JJA.180W_60N_180E_90N.nc

Mon Mar  5 08:09:55 2018: ncwa -o
timeAvg.MIL3MAE_4_Optical_depth_average_Green.20000101-20001231.SEASON_JJA.180W_60N_180E_90N.nc
-a time -O
timeAvg.MIL3MAE_4_Optical_depth_average_Green.20000101-20001231.SEASON_JJA.180W_60N_180E_90N.nc

Mon Mar  5 08:09:55 2018: ncra -D 2 -H -O -o
timeAvg.MIL3MAE_4_Optical_depth_average_Green.20000101-20001231.SEASON_JJA.180W_60N_180E_90N.nc
-d lat,60.000000,90.000000 -d lon,-180.000000,180.000000

      start_time : 2000-06-01T00:00:00Z

      end_time : 2000-08-31T23:59:59Z

      userstartdate : 2000-01-01T00:00:00Z

      userenddate : 2000-12-31T23:59:59Z

      title : JJA (2000-Jun - 2000-Aug) Aerosol Optical Depth 555 nm
monthly 0.5 deg. [MISR MIL3MAE v4] over 2000-Jun - 2000-Aug, Region 180W,
60N, 180E, 90N

      plot_hint_title : JJA (2000-Jun - 2000-Aug)

      plot_hint_subtitle : Aerosol Optical Depth 555 nm monthly 0.5 deg.
[MISR MIL3MAE v4] over 2000-Jun - 2000-Aug, Region 180W, 60N, 180E, 90N

      plot_hint_caption : - Seasons with missing months are discarded.

   dimensions:

      lat = 60

      lon = 720

      latv = 2

      lonv = 2

   variables:

      float MIL3MAE_4_Optical_depth_average_Green ( lat, lon )

         long_name : Aerosol Optical Depth 555 nm

         _FillValue : -9999

         cell_methods : OpticalDepth, Band, ParticleType: mean time: mean

         standard_name : optical_depth_average

         quantity_type : Total Aerosol Optical Depth

         product_short_name : MIL3MAE

         product_version : 4

         units : 1

         latitude_resolution : 0.5

         longitude_resolution : 0.5

         coordinates : lat lon


      double lat ( lat )

         units : degrees_north

         standard_name : latitude

         bounds : lat_bnds


      double lat_bnds ( lat, latv )

         units : degrees_north


      double lon ( lon )

         units : degrees_east

         standard_name : longitude

         bounds : lon_bnds


      double lon_bnds ( lon, lonv )

         units : degrees_east


warning:A valid instance of variable MIL3MAE_4_Optical_depth_average_Green
was not found in one or more elements of the file list


Variable: aerosol

Type: float

Total Size: 5875200 bytes

            1468800 values

Number of Dimensions: 3

*Dimensions and sizes: [ncl_join | 34] x [lat | 60] x [lon | 720]*

Coordinates:

            lat: [60.25..89.75]

            lon: [-179.75..179.75]

Number Of Attributes: 11

  long_name : Aerosol Optical Depth 555 nm

  _FillValue : -9999

  cell_methods : OpticalDepth, Band, ParticleType: mean time: mean

  standard_name : optical_depth_average

  quantity_type : Total Aerosol Optical Depth

  product_short_name : MIL3MAE

  product_version : 4

  units : 1

  latitude_resolution : 0.5

  longitude_resolution : 0.5

  coordinates : lat lon

warning:dim_rmvmean_n: 444 rightmost sections of the input array contained
all missing values



Since , I added only 17 files, then the number of ncl_join should be 17
instead of 34.


 I hope that now will understand my problem.



Regards




------------------------------------------------------------
Shani Tiwari, Ph.D.
Graduate School of Environmental Studies,
Nagoya University, Nagoya, Japan
Mob: +91 9451952997
Skype ID: shani.tiwari2
Research Gate: Dr. Shani Tiwari
<https://www.researchgate.net/profile/Shani_Tiwari2>
Google Scholar Web-page: Dr. Shani Tiwari
<https://scholar.google.co.jp/citations?user=IjIjMTMAAAAJ&hl=en>
-------------------------------------------------------------

On Tue, Mar 6, 2018 at 5:15 AM, Mary Haley <haley at ucar.edu> wrote:

> Dear Shani,
>
> It would help if you provide more information about how many files you
> actually have, and what "aerosol" looks like.
>
> Can you please include the output from your "printVarSummary(aerosol)"
> call, and also add the following two print statements to your script after
> the addfiles call, and provide me with the output from that as well:
>
>    print("# of files = " + dimsizes(fils))
>    print(f1[0])
>
> Thanks,
>
> --Mary
>
>
>
>
>
>
> On Mon, Mar 5, 2018 at 2:35 AM, Shani Tiwari <pshanitiwari at gmail.com>
> wrote:
>
>> Dear NCL users
>>                            I added multiple files using "systemfunc" and
>> "ListSetType ". But the printVarSummary gave "ncl_join" size *exactly
>> double* to the number of files present in to the directory.
>>
>> begin
>>
>> diri = "/Volumes/TIWARI/Arctic/Climatology/ "         ; input directory
>>    fils = systemfunc ("ls "+diri+"*.nc")             ; file paths
>>    f1    = addfiles (fils, "r")
>>    ListSetType (f1, "join")
>>    aerosol    = f1[:]->MIL3MAE_4_Optical_depth_average_Green
>>    AOD = mask(aerosol,(aerosol.lt.0 .or. aerosol.gt.1),False)
>>
>>
>>    Mean  =  dim_avg_n_Wrap(AOD, 0)
>>   ; copy_VarCoords(Normal_AOD(0,:,:), Mean)
>>    Mean!0="lat"
>>    Mean!1="lon"
>>   Mean&lat = aerosol&lat              ; assign coordinate values and
>>   Mean&lon = aerosol&lon              ; units attributes
>>
>>   printVarSummary (aerosol)
>>
>> end
>>
>> Kindly suggest me, how to overcome to this?
>>
>>
>> Regards
>>
>>
>> ------------------------------------------------------------
>> Shani Tiwari, Ph.D.
>> Graduate School of Environmental Studies,
>> Nagoya University, Nagoya, Japan
>> Mob: +91 9451952997 <+91%2094519%2052997>
>> Skype ID: shani.tiwari2
>> Research Gate: Dr. Shani Tiwari
>> <https://www.researchgate.net/profile/Shani_Tiwari2>
>> Google Scholar Web-page: Dr. Shani Tiwari
>> <https://scholar.google.co.jp/citations?user=IjIjMTMAAAAJ&hl=en>
>> -------------------------------------------------------------
>>
>> _______________________________________________
>> ncl-talk mailing list
>> ncl-talk at ucar.edu
>> List instructions, subscriber options, unsubscribe:
>> http://mailman.ucar.edu/mailman/listinfo/ncl-talk
>>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.ucar.edu/pipermail/ncl-talk/attachments/20180306/8d2cce62/attachment.html>


More information about the ncl-talk mailing list