<div dir="ltr">the length of the array is:<div><br></div><div>npts = 5109033600<br></div><div><br></div><div>Yes, the problem is the array is too big. I am fairly certain that the problem is npts > INT_MAX, where INT_MAX appears to be some limiter on array size used in many of the ncl functions (I get this error all the time).</div><div><br></div><div>My goal is to compute a percentile. I was thinking that by generating INT_MAX samples of the array, and putting those samples into an array of length INT_MAX, I can sort the reduced array and find the percentiles of the reduced array. However, I would like to know what the value of INT_MAX is. Do you know how I can find that out ?</div><div><br></div><div>Adam</div></div><div class="gmail_extra"><br><div class="gmail_quote">On Fri, Oct 20, 2017 at 5:34 PM, Kevin Hallock <span dir="ltr"><<a href="mailto:hallock@ucar.edu" target="_blank">hallock@ucar.edu</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div style="word-wrap:break-word">Hi Adam,<div><br></div><div>Thanks for sharing the error and the code snippet.</div><div><br></div><div>Based on the error message, it seems like there may be an issue with the size of dtcond1d.</div><div><br></div><div>Could you please add “<font face="Menlo">print(npts)</font>” before “<font face="Menlo">ip = dim_pqsort(dtcond1d,kflag)</font>” and rerun the script? I’m curious what NCL thinks the dimensionality of dtcond1d is.</div><div><br></div><div>Thanks,</div><div>Kevin</div><div><div class="h5"><div><br><div><blockquote type="cite"><div>On Oct 20, 2017, at 5:01 PM, Adam Herrington <<a href="mailto:adam.herrington@stonybrook.edu" target="_blank">adam.herrington@stonybrook.<wbr>edu</a>> wrote:</div><br class="m_-6665440205293727416Apple-interchange-newline"><div><div dir="ltr">the error message:<div><br></div><div><div>fatal:dim_pqsort: one or more input dimensions sizes are greater than INT_MAX</div><div>^Mfatal:["Execute.c":8640]:<wbr>Execute: Error occurred at or near line 294 in file omega3d_pdf_samples.ncl</div></div><div><br></div><div>A snippet of the code:</div><div><br></div><div><div> dtcond1d = ndtooned(DTCOND)</div><div> delete(DTCOND)</div><div> npts = dimsizes(dtcond1d)</div><div> kflag=2</div><div> ip = dim_pqsort(dtcond1d,kflag)</div><div><br></div><div> ;;95th</div><div> tmp = npts*0.95</div><div> iptf = tointeger(floor(tmp))</div><div> dtlimhi(2) = dtcond1d(iptf)</div></div><div><br></div><div><br></div><div><br></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Fri, Oct 20, 2017 at 4:17 PM, Kevin Hallock <span dir="ltr"><<a href="mailto:hallock@ucar.edu" target="_blank">hallock@ucar.edu</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Hi Adam,<br>
<br>
Could you please copy and paste the full error message you’re seeing?<br>
<br>
Also, would you mind sharing a copy of your script? It might help diagnose the issue.<br>
<br>
Thanks,<br>
Kevin<br>
<div><div class="m_-6665440205293727416h5"><br>
> On Oct 20, 2017, at 3:49 PM, Adam Herrington <<a href="mailto:adam.herrington@stonybrook.edu" target="_blank">adam.herrington@stonybrook.ed<wbr>u</a>> wrote:<br>
><br>
> I am trying to sort with the function 'dim_pqsort', but my array is too large. I get an error saying that 1 or more dimensions is larger than INT_MAX.<br>
><br>
> If anyone has a solution to this problem, I'm all ears.<br>
><br>
> My thinking is that I can create an array of sample indices through 'generate_sample_indices', and make the number of sample indices = INT_MAX. Does anyone know how large INT_MAX is ?<br>
><br>
> Adam Herrington<br>
</div></div>> ______________________________<wbr>_________________<br>
> ncl-talk mailing list<br>
> <a href="mailto:ncl-talk@ucar.edu" target="_blank">ncl-talk@ucar.edu</a><br>
> List instructions, subscriber options, unsubscribe:<br>
> <a href="http://mailman.ucar.edu/mailman/listinfo/ncl-talk" rel="noreferrer" target="_blank">http://mailman.ucar.edu/mailma<wbr>n/listinfo/ncl-talk</a><br>
<br>
</blockquote></div><br></div>
</div></blockquote></div><br></div></div></div></div></blockquote></div><br></div>