<div dir="ltr"><div dir="ltr"><div dir="ltr"><div>'Brain Trust' ... "great idea" ===> Nope ... Sorry</div><div>---</div><div>IMHO: <br></div><div>I don't think the loop can be replaced by array operations. I'm not sure how the underlying netCDF software would implement something like</div><div><br></div><div><span style="font-size:11pt" lang="EN-US">Tprof = fi->T(pInd(<span style="color:rgb(255,0,0)"><b>:</b></span>,0),<b>:</b>,pInd(<span style="color:rgb(255,0,0)"><b>:</b></span>,1),pInd(<span style="color:rgb(255,0,0)"><b>:</b></span>,2)) <br></span></div><div><span style="font-size:11pt" lang="EN-US">---</span></div><div><span style="font-size:11pt" lang="EN-US"><br></span></div><div><span style="font-size:11pt" lang="EN-US"> nprofile = ...</span></div><div><span style="font-size:11pt" lang="EN-US"> nlev = ...<br></span></div><div><span style="font-size:11pt" lang="EN-US"> Tprof = <b>new</b>((/<span style="color:rgb(0,0,255)"><b>nprofile,nlev</b></span>/),float) ; <span style="color:rgb(255,0,255)">reorder</span> from your code<br> begTime = <b>get_cpu_time</b>()<br> do i = 0, nprofile-1<br> Tprof(i,:) = fi->T(pInd(i,0),:,pInd(i,1),pInd(i,2)) ;pInd is an array with coord triplets<br> end do<br><br> printVarSummary(Tprof)<br> printMinMax(Tprof,0)<br> print("Tprof generation time: " + (<b>get_cpu_time</b>() - begTime)+" seconds; nprofile="+nprofile)<br> print("---")</span></div><div><span style="font-size:11pt" lang="EN-US">---</span></div><div><span style="font-size:11pt" lang="EN-US"><br></span></div><div><span style="font-size:11pt" lang="EN-US">If it takes a long time, I'd suggest saving the created variable(s) in a netCDF file. Untested:</span></div><div><span style="font-size:11pt" lang="EN-US"><br></span></div><div><span style="font-size:11pt" lang="EN-US">;------------------<br>; netCDF<br>;-----------------<br> netCDF = True<br> if (netCDF) then<br> profile = <b>ispan</b>(0,nprofile-1,1) ; or, ispan(1,nprofile,1) <br> profile@long_name = "Profile Number"<br> profile!0 = "profile"<br> profile&profile = profile<br><br> TIME = fi->time(pInd(:,0))<br> LAT = fi->lat(pInd(:,1))<br> LON = fi->lon(pInd(:,2))<br><br> Tprof!0= "profile"<br> TIME!0 = "profile"<br> LAT!0 = "profile"<br> LON!0 = "profile"<br> Tprof&profile = profile<br> TIME&profile = profile<br> LAT&profile = profile<br> LON&profile = profile<br><br> dir_nc = "./"<br> fil_nc = "FOO.nc"<br> pth_nc = dir_nc + fil_nc<br> print(pth_nc)<br><br> <b>system</b>("/bin/rm -f "+pth_nc) ; remove any pre-existing file<br> ncdf = <b>addfile</b>(pth_nc ,<span style="color:rgb(0,0,255)"><b>"c"</b></span>) ; open output netCDF file<br><br>;===================================================================<br>; Create global attributes of the file (optional)<br>;===================================================================<br> fAtt = True ; assign file attributes<br> fAtt@title = "Selected Profiles"<br> ;fAtt@source_info = "..."<br> fAtt@Conventions = "None"<br> fAtt@creation_date = <b>systemfunc </b>("date")<br> <b>fileattdef(</b> ncdf, fAtt ) ; copy file attributes<br><br>;===================================================================<br>; Make profile an UNLIMITED dimension; recommended for most applications</span></div><div><span style="font-size:11pt" lang="EN-US">; Allows for future profiles to be appended<br></span></div><div><span style="font-size:11pt" lang="EN-US">;===================================================================<br> </span><span style="font-size:11pt" lang="EN-US"><b>filedimdef</b></span><span style="font-size:11pt" lang="EN-US">f(ncdf,"profile",-1,True)<br><br>;===================================================================<br>; output variable(s) directly; NCL will call appropriate functions<br>;===================================================================<br> ncdf->TIME = TIME<br> ncdf->LAT = LAT<br> ncdf->LON = LON<br> ncdf->TPROF = Tprof<br> end if ; netCDF<br></span></div><div><span style="font-size:11pt" lang="EN-US"><br></span></div><div><span style="font-size:11pt" lang="EN-US"> <br></span></div></div></div></div><br><div class="gmail_quote"><div dir="ltr">On Mon, Oct 15, 2018 at 11:53 PM Will Hobbs <<a href="mailto:will.hobbs@utas.edu.au" target="_blank">will.hobbs@utas.edu.au</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div lang="EN-AU" link="#0563C1" vlink="#954F72">
<div class="m_6061499680454274061m_-676473499431603296WordSection1">
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt">Hi all<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt">This one is for the NCL ‘Brains Trust’. I’m extracting a large number of ocean profiles from a 4-d array (dimensioned time,depth,lat,lon), using coordinate triplets based on time,lat and lon,
(i.e. a 2-d array of indices dimensioned nprofile, 3), but it’s a slow process and I wonder if anyone has any smart ideas on speeding it up.<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt">At the moment (partly to manage memory), I’m reading each profile in a loop, viz:<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt">Tprof = new((/nlev,nprofile/),float)<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt">do i = 0, nprofile-1<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt"> Tprof(:,i) = fi->T(pInd(i,0),:,pInd(i,1),pInd(i,2)) ;pInd is an array with coord triplets<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt">end do<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt">Obviously one obvious way of speeding things up would be to read the entire array of input data and extract the locations, to avoid multiple i/o calls. What I really want to do though is somehow
get rid of the loop entirely. Is there any way of extracting coordinate pairs (or in this case triplets) without looping through each profile?<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt">The only way I can think of is to turn the input array (T in my example above) into a 1-d array, and somehow convert ‘pInd’ into the elements of that 1-d array – this seems fraught with opportunity
for error though. Catastrophic error I can deal with – it’s the sneaky, inobvious error that scares me….<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt">Hoping someone has a great idea….<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt">Will<u></u><u></u></span></p>
</div>
<p style="font-size:10pt;line-height:10pt;font-family:Calibri,sans-serif"><br>
<br>
University of Tasmania Electronic Communications Policy (December, 2014). <br>
This email is confidential, and is for the intended recipient only. Access, disclosure, copying, distribution, or reliance on any of it by anyone outside the intended recipient organisation is prohibited and may be a criminal offence. Please delete if obtained
in error and email confirmation to the sender. The views expressed in this email are not necessarily the views of the University of Tasmania, unless clearly intended otherwise.
</p>
</div>
_______________________________________________<br>
ncl-talk mailing list<br>
<a href="mailto:ncl-talk@ucar.edu" target="_blank">ncl-talk@ucar.edu</a><br>
List instructions, subscriber options, unsubscribe:<br>
<a href="http://mailman.ucar.edu/mailman/listinfo/ncl-talk" rel="noreferrer" target="_blank">http://mailman.ucar.edu/mailman/listinfo/ncl-talk</a><br>
</blockquote></div>