[ncl-talk] trend_query
Kunal Bali
kunal.bali9 at gmail.com
Thu Jan 12 09:27:20 MST 2017
after applying the prob functions
df = rc at nptxy-2 ; degrees of freedom
tval = rc at tval ; t-statistic
prob = betainc(df/(df+tval^2),df/2.0,0.5)
I am receiving some errors
warning:Attempt to reference attribute (nptxy) which is undefined
warning:Attempt to reference attribute (tval) which is undefined
(0) Error: scalar_field: If the input data is 1-dimensional, you must
set sfXArray and sfYArray to 1-dimensional arrays of the same length.
So how can I define these errors ?
Kunal Bali
Research Scholar
Radio & Atmospheric Science Division
CSIR - National Physical Laboratory
New Delhi - 110012
India
On Wed, Jan 4, 2017 at 2:02 AM, Dennis Shea <shea at ucar.edu> wrote:
> Please read the regCoef documentation. See Example 1
>
> Even above:
>
> Variable: rc
> [SNIP]
> nptxy : <ARRAY of 3216 elements>
> rstd : <ARRAY of 3216 elements>
> yintercept : <ARRAY of 3216 elements>
> tval : <ARRAY of 3216 elements>
>
> From the documentation:
>
>
> Now use the information to calculate the probability.
>
>
> ; for clarity only, explicitly assing to a new variable
> df = rc at nptxy-2 ; degrees of freedom
> tval = rc at tval ; t-statistic
> prob = *betainc* <http://www.ncl.ucar.edu/Document/Functions/Built-in/betainc.shtml>(df/(df+tval^2),df/2.0,0.5)
>
>
>
> On Tue, Jan 3, 2017 at 11:53 AM, Kunal Bali <kunal.bali9 at gmail.com> wrote:
>
>> Thanks Dennis
>>
>> It worked very well.
>> Can we get the p values of the given data ?
>>
>> Kunal Bali
>> Research Scholar
>> Radio & Atmospheric Science Division
>> CSIR - National Physical Laboratory
>> New Delhi - 110012
>> India
>>
>>
>>
>>
>>
>> On Tue, Jan 3, 2017 at 11:36 PM, Dennis Shea <shea at ucar.edu> wrote:
>>
>>> ;=======
>>> ; SCRIPT: tst_regCoef.ncl
>>> ;=======
>>> diri = "./"
>>> fili = "test.nc"
>>> pthi = diri+fili
>>> f = addfile(pthi, "r")
>>>
>>> y = f->TOTEXTTAU ; (time, lat, lon)
>>> printVarSummary(y) ; [time | 36] x [lat | 67] x [lon
>>> | 48]
>>> print("==========")
>>>
>>> ;dimy = dimsizes(y)
>>> ;ntim = dimy(0)
>>> ;nlat = dimy(1)
>>> ;mlon = dimy(2)
>>>
>>> printVarSummary(y(lat|:,lon|:,time|:)) ; [lat | 67] x [lon | 48] x
>>> [time | 36]
>>> print("==========")
>>>
>>> rc = regCoef(y&time, y(lat|:,lon|:,time|:))
>>>
>>> copy_VarCoords(y(0,:,:), rc)
>>> printVarSummary(rc)
>>> printMinMax(rc,1)
>>>
>>> =======================================================================
>>> OUTPUT
>>> =======================================================================
>>> %> ncl tst_regCoef.ncl
>>> Copyright (C) 1995-2015 - All Rights Reserved
>>> University Corporation for Atmospheric Research
>>> NCAR Command Language Version 6.3.0
>>> The use of this software is governed by a License Agreement.
>>> See http://www.ncl.ucar.edu/ for more details.
>>>
>>> Variable: y
>>> Type: float
>>> Total Size: 463104 bytes
>>> 115776 values
>>> Number of Dimensions: 3
>>> Dimensions and sizes: [time | 36] x [lat | 67] x [lon | 48]
>>> Coordinates:
>>> time: [526680..18934200]
>>> lat: [ 5.. 38]
>>> lon: [68.125..97.5]
>>> Number Of Attributes: 7
>>> standard_name : Total Aerosol Extinction AOT [550 nm]
>>> long_name : Total Aerosol Extinction AOT [550 nm]
>>> units : 1
>>> _FillValue : 1e+15
>>> fmissing_value : 1e+15
>>> vmax : 1e+15
>>> vmin : -1e+15
>>> (0) ==========
>>>
>>> Variable: y (subsection)
>>> Type: float
>>> Total Size: 463104 bytes
>>> 115776 values
>>> Number of Dimensions: 3
>>> Dimensions and sizes: [lat | 67] x [lon | 48] x [time | 36]
>>> Coordinates:
>>> lat: [ 5.. 38]
>>> lon: [68.125..97.5]
>>> time: [526680..18934200]
>>> Number Of Attributes: 7
>>> vmin : -1e+15
>>> vmax : 1e+15
>>> fmissing_value : 1e+15
>>> _FillValue : 1e+15
>>> units : 1
>>> long_name : Total Aerosol Extinction AOT [550 nm]
>>> standard_name : Total Aerosol Extinction AOT [550 nm]
>>> (0) ==========
>>>
>>> Variable: rc
>>> Type: double
>>> Total Size: 25728 bytes
>>> 3216 values
>>> Number of Dimensions: 2
>>> Dimensions and sizes: [lat | 67] x [lon | 48]
>>> Coordinates:
>>> lat: [ 5.. 38]
>>> lon: [68.125..97.5]
>>> Number Of Attributes: 5
>>> _FillValue : 999999986991104
>>> nptxy : <ARRAY of 3216 elements>
>>> rstd : <ARRAY of 3216 elements>
>>> yintercept : <ARRAY of 3216 elements>
>>> tval : <ARRAY of 3216 elements>
>>> (0)
>>> (0) min=-1.660007214663053e-09 max=2.459720467540745e-08
>>>
>>> On Mon, Jan 2, 2017 at 9:36 PM, Kunal Bali <kunal.bali9 at gmail.com>
>>> wrote:
>>>
>>>> Dear Dennis,
>>>> Thanks for all the suggestions.
>>>> I have attached a test file. So you can try on that.
>>>>
>>>> Thanks
>>>>
>>>> Kunal Bali
>>>> Research Scholar
>>>> Radio & Atmospheric Science Division
>>>> CSIR - National Physical Laboratory
>>>> New Delhi - 110012
>>>> India
>>>>
>>>>
>>>>
>>>>
>>>>
>>>> On Tue, Jan 3, 2017 at 3:20 AM, Dennis Shea <shea at ucar.edu> wrote:
>>>>
>>>>> tst_regCoef.Kunal_Bali.ncl contains:
>>>>>
>>>>> ;%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
>>>>> ntim = 13149
>>>>> nlat = 67
>>>>> mlon = 48
>>>>> x = ispan(1,ntim,1)
>>>>> x!0 = "time"
>>>>> printVarSummary(x)
>>>>> print("==========")
>>>>>
>>>>> y = random_uniform(100,200, (/ntim,nlat,mlon/))
>>>>> y!0 = "time"
>>>>> y!1 = "lat"
>>>>> y!2 = "lon"
>>>>> printVarSummary(y) ; [time | 13149] x [lat | 67] x [lon | 48]
>>>>> print("==========")
>>>>>
>>>>> printVarSummary(y(lat|:,lon|:,time|:)) ; [lat | 67] x [lon | 48]
>>>>> x [time | 13149]
>>>>> print("==========")
>>>>>
>>>>> rc = regCoef(x,y(lat|:,lon|:,time|:))
>>>>>
>>>>> copy_VarCoords(y(0,:,:), rc)
>>>>> printVarSummary(rc)
>>>>> printMinMax(rc,1)
>>>>> ;%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
>>>>>
>>>>> %> ncl tst_regCoef.Kunal_Bali.ncl
>>>>>
>>>>> NCAR Command Language Version 6.3.0
>>>>>
>>>>>
>>>>> Variable: x
>>>>> Type: integer
>>>>> Total Size: 52596 bytes
>>>>> 13149 values
>>>>> Number of Dimensions: 1
>>>>> Dimensions and sizes: [time | 13149]
>>>>> Coordinates:
>>>>> (0) ==========
>>>>>
>>>>> Variable: y
>>>>> Type: float
>>>>> Total Size: 169148736 bytes
>>>>> 42287184 values
>>>>> Number of Dimensions: 3
>>>>> Dimensions and sizes: [time | 13149] x [lat | 67] x [lon | 48]
>>>>> Coordinates:
>>>>> (0) ==========
>>>>>
>>>>> Variable: y (subsection)
>>>>> Type: float
>>>>> Total Size: 169148736 bytes
>>>>> 42287184 values
>>>>> Number of Dimensions: 3
>>>>> Dimensions and sizes: [lat | 67] x [lon | 48] x [time | 13149]
>>>>> Coordinates:
>>>>> (0) ==========
>>>>>
>>>>> Variable: rc
>>>>> Type: float
>>>>> Total Size: 12864 bytes
>>>>> 3216 values
>>>>> Number of Dimensions: 2
>>>>> Dimensions and sizes: [lat | 67] x [lon | 48]
>>>>> Coordinates:
>>>>> Number Of Attributes: 5
>>>>> _FillValue : 9.96921e+36
>>>>> nptxy : <ARRAY of 3216 elements>
>>>>> rstd : <ARRAY of 3216 elements>
>>>>> yintercept : <ARRAY of 3216 elements>
>>>>> tval : <ARRAY of 3216 elements>
>>>>> (0)
>>>>> (0) min=-0.000292889 max=0.000215768
>>>>>
>>>>> ==================================
>>>>>
>>>>> There are no logged bug fixes for regCoef. Hence, not sure of the
>>>>> issus.
>>>>>
>>>>> ===================================
>>>>> You can ftp the data file but we can not use old NCL versions:
>>>>>
>>>>> ftp ftp.cgd.ucar.edu
>>>>> anonymous
>>>>> your_email
>>>>> cd incoming
>>>>> put your_data_file
>>>>> quit
>>>>>
>>>>> Notify ncl-talk after successful transfer of the file.
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> On Mon, Jan 2, 2017 at 12:05 PM, Kunal Bali <kunal.bali9 at gmail.com>
>>>>> wrote:
>>>>>
>>>>>> The summarty shows
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> *Variable: yType: floatTotal Size: 169148736 bytes
>>>>>> 42287184 valuesNumber of Dimensions: 3Dimensions and sizes: [time |
>>>>>> 13149] x [lat | 67] x [lon | 48]Coordinates: time:
>>>>>> [1080..18934200] lat: [ 5.. 38] lon:
>>>>>> [68.125..97.5]Number Of Attributes: 7 vmin : -1e+15 vmax : 1e+15
>>>>>> fmissing_value : 1e+15 _FillValue : 1e+15 units : W m-2
>>>>>> long_name : toa_net_downward_shortwave_flux_assuming_clear_sky
>>>>>> standard_name : toa_net_downward_shortwave_flux_assuming_clear_sky*
>>>>>>
>>>>>> Variable: x
>>>>>> Type: double
>>>>>> Total Size: 105192 bytes
>>>>>> 13149 values
>>>>>> Number of Dimensions: 1
>>>>>> Dimensions and sizes: [time | 13149]
>>>>>> Coordinates:
>>>>>> Number Of Attributes: 3
>>>>>> standard_name : time
>>>>>> units : minutes since 1980-01-01 00:30:00
>>>>>> calendar : standard
>>>>>> fatal:regCoef: The rightmost dimension of x must be equal to the
>>>>>> rightmost dimension of y
>>>>>> fatal:["Execute.c":8567]:Execute: Error occurred at or near line 37
>>>>>> in file trend.ncl
>>>>>>
>>>>>>
>>>>>>
>>>>>> And the script is
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> * tmp = a->SWTNTCLR y = tmp(time|:,lat|:,lon|:) ;
>>>>>> reorder variable delete(tmp) ; no longer
>>>>>> needed;************************************************; create x and
>>>>>> calculate the regression coefficients (slopes, trends)
>>>>>> ;************************************************ x = y&time
>>>>>> printVarSummary(y) printVarSummary(x) rc =
>>>>>> regCoef(x,y) *
>>>>>>
>>>>>> *So how to set the x (which is time) with y (which is time|lat|lon)*
>>>>>>
>>>>>>
>>>>>>
>>>>>> Kunal Bali
>>>>>> Research Scholar
>>>>>> Radio & Atmospheric Science Division
>>>>>> CSIR - National Physical Laboratory
>>>>>> New Delhi - 110012
>>>>>> India
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> On Mon, Jan 2, 2017 at 11:38 PM, Dennis Shea <shea at ucar.edu> wrote:
>>>>>>
>>>>>>> I believe ncl-talk has been down his raod with you before. Please
>>>>>>> look at the error messages and *always* include printVarSummary of the the
>>>>>>> variables used. Place the ***before*** the line where the error
>>>>>>> occurs.
>>>>>>>
>>>>>>> printVarSummary(x)
>>>>>>> printVarSummary(y)
>>>>>>> or
>>>>>>> printVarSummary(y(lat|:,lon|:,time|:) )
>>>>>>>
>>>>>>> rc = *regCoef*(x, y(lat|:,lon|:,time|:) )
>>>>>>>
>>>>>>> The error message state:
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> *fatal:regCoef: The rightmost dimension of x must be equal to the rightmost dimension of y*
>>>>>>>
>>>>>>> Please look ....
>>>>>>>
>>>>>>> What are the sizes of 'x' and the rightmost dimension of 'y' ?
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> On Mon, Jan 2, 2017 at 10:45 AM, Kunal Bali <kunal.bali9 at gmail.com>
>>>>>>> wrote:
>>>>>>>
>>>>>>>> I have 6.2.0 NCL version
>>>>>>>>
>>>>>>>> I tried with
>>>>>>>>
>>>>>>>> rc = *regCoef*(x, y(lat|:,lon|:,time|:) )
>>>>>>>>
>>>>>>>> but still getting some error
>>>>>>>>
>>>>>>>> *fatal:regCoef: The rightmost dimension of x must be equal to the rightmost dimension of y*
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> regards
>>>>>>>> Kunal Bali
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> On Mon, Jan 2, 2017 at 9:24 PM, Dennis Shea <shea at ucar.edu> wrote:
>>>>>>>>
>>>>>>>>> I would recommend:
>>>>>>>>>
>>>>>>>>> http://www.ncl.ucar.edu/Document/Functions/Built-in/regCoef_
>>>>>>>>> n.shtml
>>>>>>>>>
>>>>>>>>> This is the most recent version. As noted in the documentation:
>>>>>>>>> Note: with NCL V6.2.1 or later, you can use *regCoef_n*
>>>>>>>>> <http://www.ncl.ucar.edu/Document/Functions/Built-in/regCoef_n.shtml>
>>>>>>>>> to avoid having to reorder the arrays first:
>>>>>>>>>
>>>>>>>>> rc = *regCoef_n* <http://www.ncl.ucar.edu/Document/Functions/Built-in/regCoef_n.shtml>(x, y, 0, 0)
>>>>>>>>>
>>>>>>>>> ===
>>>>>>>>>
>>>>>>>>> ****PLease See: Example 2***
>>>>>>>>>
>>>>>>>>> rc = *regCoef_n*(time, ts, 0, 0) ; *rc(nlat,mlon)*
>>>>>>>>>
>>>>>>>>> copy_VarCoords(ts(0,:,),rc)
>>>>>>>>> printVarSummary(rc)
>>>>>>>>>
>>>>>>>>> =====
>>>>>>>>> Using the original regCoef rather than regCoef_n may require the
>>>>>>>>> arrays to be reordered.
>>>>>>>>>
>>>>>>>>> http://www.ncl.ucar.edu/Document/Functions/Built-in/regCoef-
>>>>>>>>> 1.shtml
>>>>>>>>>
>>>>>>>>> ****See: Examples 2 and 3***
>>>>>>>>>
>>>>>>>>> rc = *regCoef*(x, y(lat|:,lon|:,time|:) )
>>>>>>>>>
>>>>>>>>> If *y* has coordinate variables
>>>>>>>>> <http://www.ncl.ucar.edu/Document/Language/cv.shtml> these may
>>>>>>>>> readily be assigned via NCL syntax:
>>>>>>>>>
>>>>>>>>> rc!0 = "lat" ; name dimensions
>>>>>>>>> rc!1 = "lon"
>>>>>>>>> rc&lat = y&lat ; assign coordinate values to named dimensions
>>>>>>>>> rc&lon = y&lon
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> On Mon, Jan 2, 2017 at 3:01 AM, Kunal Bali <kunal.bali9 at gmail.com>
>>>>>>>>> wrote:
>>>>>>>>>
>>>>>>>>>> Dear NCL users,
>>>>>>>>>>
>>>>>>>>>> I have the data with time steps > 1000
>>>>>>>>>>
>>>>>>>>>> I want to plot the spatial map of trend analysis of the given
>>>>>>>>>> dataset.
>>>>>>>>>> So I tried the script given below for getting the desired plot
>>>>>>>>>> but couldn't successed.
>>>>>>>>>>
>>>>>>>>>> the given error is
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> *fatal:regCoef: The rightmost dimension of x must be at least
>>>>>>>>>> 2fatal:["Execute.c":8567]:Execute: Error occurred at or near line 32 in
>>>>>>>>>> file trend.ncl*
>>>>>>>>>>
>>>>>>>>>> Could anyone please help me out
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> tmp = a->SWTNTCLR
>>>>>>>>>> ts = tmp(time|:,lat|:,lon|:) ; reorder
>>>>>>>>>> variable
>>>>>>>>>>
>>>>>>>>>> delete(tmp) ; no longer
>>>>>>>>>> needed
>>>>>>>>>>
>>>>>>>>>> ;************************************************
>>>>>>>>>> ; create x and calculate the regression coefficients (slopes,
>>>>>>>>>> trends)
>>>>>>>>>> ;************************************************
>>>>>>>>>> time = ts&time ; days since
>>>>>>>>>> 1850-01-01
>>>>>>>>>> rc = regCoef(time,ts)
>>>>>>>>>>
>>>>>>>>>> rc at long_name = "regression coefficient (trend)"
>>>>>>>>>> rc at units = ts at units+"/day"
>>>>>>>>>> ; copy_VarCoords(ts(:,:,0), rc) ; copy lat,lon
>>>>>>>>>> coords
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> ;************************************************
>>>>>>>>>> ; plotting parameters
>>>>>>>>>> ;************************************************
>>>>>>>>>> wks = gsn_open_wks("ps" ,"regress")
>>>>>>>>>> gsn_define_colormap(wks,"ViBlGrWhYeOrRe") ; choose colormap
>>>>>>>>>>
>>>>>>>>>> res = True
>>>>>>>>>> res at gsnMaximize = True ; make large
>>>>>>>>>>
>>>>>>>>>> res at cnFillOn = True ; turn on color
>>>>>>>>>> res at cnLinesOn = False ; turn off
>>>>>>>>>> contour lines
>>>>>>>>>> res at cnLineLabelsOn = False ; turn off
>>>>>>>>>> contour line labels
>>>>>>>>>> ;;res at cnFillMode = "RasterFill"
>>>>>>>>>>
>>>>>>>>>> ; res at cnLevelSelectionMode = "ManualLevels" ; set manual
>>>>>>>>>> contour levels
>>>>>>>>>> ; res at cnMinLevelValF = -1.00 ; set min
>>>>>>>>>> contour level
>>>>>>>>>> ; res at cnMaxLevelValF = 1.00 ; set max
>>>>>>>>>> contour level
>>>>>>>>>> res at cnLevelSpacingF = 0.10 ; set contour
>>>>>>>>>> interval
>>>>>>>>>> ;
>>>>>>>>>> res at mpFillOn = False ; turn off
>>>>>>>>>> default background gray
>>>>>>>>>> ; res at mpCenterLonF = 210
>>>>>>>>>>
>>>>>>>>>> res at tiMainString = fili
>>>>>>>>>> plot = gsn_csm_contour_map_ce(wks,rc,res)
>>>>>>>>>> end
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> Regards
>>>>>>>>>> Kunal Bali
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> _______________________________________________
>>>>>>>>>> ncl-talk mailing list
>>>>>>>>>> ncl-talk at ucar.edu
>>>>>>>>>> List instructions, subscriber options, unsubscribe:
>>>>>>>>>> http://mailman.ucar.edu/mailman/listinfo/ncl-talk
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>> _______________________________________________
>>>>>>>> ncl-talk mailing list
>>>>>>>> ncl-talk at ucar.edu
>>>>>>>> List instructions, subscriber options, unsubscribe:
>>>>>>>> http://mailman.ucar.edu/mailman/listinfo/ncl-talk
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>
>>>>>> _______________________________________________
>>>>>> ncl-talk mailing list
>>>>>> ncl-talk at ucar.edu
>>>>>> List instructions, subscriber options, unsubscribe:
>>>>>> http://mailman.ucar.edu/mailman/listinfo/ncl-talk
>>>>>>
>>>>>>
>>>>>
>>>>
>>>> _______________________________________________
>>>> ncl-talk mailing list
>>>> ncl-talk at ucar.edu
>>>> List instructions, subscriber options, unsubscribe:
>>>> http://mailman.ucar.edu/mailman/listinfo/ncl-talk
>>>>
>>>>
>>>
>>
>> _______________________________________________
>> ncl-talk mailing list
>> ncl-talk at ucar.edu
>> List instructions, subscriber options, unsubscribe:
>> http://mailman.ucar.edu/mailman/listinfo/ncl-talk
>>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.ucar.edu/pipermail/ncl-talk/attachments/20170112/014a32e7/attachment.html
More information about the ncl-talk
mailing list