<div dir="ltr"><div><div>Hi William,<br><br></div>This is a stretch, but I'm at a loss. You might check your /tmp directory: is it of very limited capacity, or are there tons of these "oc.*" directories there? They seem to be some sort of temporary cookie file. Here's some discussion about them from the Unidata site:<br><br><a href="https://github.com/Unidata/netcdf-c/issues/435">https://github.com/Unidata/netcdf-c/issues/435</a><br><br></div>Rick<br></div><div class="gmail_extra"><br><div class="gmail_quote">On Tue, Sep 19, 2017 at 10:10 PM, Griffith Young <span dir="ltr"><<a href="mailto:griffith.young@bom.gov.au" target="_blank">griffith.young@bom.gov.au</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div bgcolor="white" link="#0563C1" vlink="#954F72" lang="EN-AU">
<div class="m_2414790486645928063WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt;color:#1f497d">Hello Bill,<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;color:#1f497d"> I had a similar problem with file handles (as you seem to have had too with your notes on setfileoption), so I suspect that this might be the problem (as I suspect that you do
too).<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;color:#1f497d"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;color:#1f497d"> But the difference here is that I suspect that the issue might be on the OPeNDAP server end?!?<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;color:#1f497d"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;color:#1f497d"> Have you been in contact with the owner of the OPeNDAP server? Can you/they inspect their logs?<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;color:#1f497d"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;color:#1f497d"> If indeed there is an issue with file handles on the server, then there may be some evidence in their logs...<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;color:#1f497d"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;color:#1f497d"> Is it possible that the remote nature of your customers is affecting file close commands coming back to the server? There is not enough evidence in the log you provided to determine
this.<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;color:#1f497d"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;color:#1f497d"> I admit that all this is all conjecture (but sometimes it gets you closer to the problem).<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;color:#1f497d"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;color:#1f497d">Griff.<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;color:#1f497d"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;color:#1f497d"><u></u> <u></u></span></p>
<div>
<div style="border:none;border-top:solid #b5c4df 1.0pt;padding:3.0pt 0cm 0cm 0cm">
<p class="MsoNormal"><b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"" lang="EN-US">From:</span></b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"" lang="EN-US"> Capehart, William J [mailto:<a href="mailto:William.Capehart@sdsmt.edu" target="_blank">William.Capehart@<wbr>sdsmt.edu</a>]
<br>
<b>Sent:</b> Wednesday, 20 September 2017 1:48 PM<br>
<b>To:</b> Griffith Young; <a href="mailto:ncl-talk@ucar.edu" target="_blank">ncl-talk@ucar.edu</a><br>
<b>Subject:</b> Re: Reopening an old trouble ticket: OPeNDAP failing when reading a large number of files [SEC=UNCLASSIFIED]<u></u><u></u></span></p>
</div>
</div><div><div class="h5">
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt" lang="EN-US">Hi Griff. <u></u>
<u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt" lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt" lang="EN-US">Correct. We get the classic 404 error. However, the file Is indeed there. As with Jon’s problem if you change the start date further down the street, the seemingly missing file will be read
and a later file will be the one where it stops. The script will read the first ~240 files it encounters and will then halt with an errant missing file error.<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt" lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt" lang="EN-US">Bill<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt" lang="EN-US"><u></u> <u></u></span></p>
<div style="border:none;border-top:solid #b5c4df 1.0pt;padding:3.0pt 0cm 0cm 0cm">
<p class="MsoNormal"><b><span style="color:black" lang="EN-US">From: </span></b><span style="color:black" lang="EN-US">Griffith Young <<a href="mailto:griffith.young@bom.gov.au" target="_blank">griffith.young@bom.gov.au</a>><br>
<b>Date: </b>Tuesday, September 19, 2017 at 21:44 MDT<br>
<b>To: </b>William Capehart <<a href="mailto:William.Capehart@sdsmt.edu" target="_blank">William.Capehart@sdsmt.edu</a>>, "<a href="mailto:ncl-talk@ucar.edu" target="_blank">ncl-talk@ucar.edu</a>" <<a href="mailto:ncl-talk@ucar.edu" target="_blank">ncl-talk@ucar.edu</a>><br>
<b>Subject: </b>RE: Reopening an old trouble ticket: OPeNDAP failing when reading a large number of files [SEC=UNCLASSIFIED]<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt" lang="EN-US"><u></u> <u></u></span></p>
</div>
<p class="MsoNormal"><span lang="EN-US">The file does not exist according to the log (<b>404</b>).<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"> <u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">2017-09-20T02:52:12.951 +0000 [1841685452][ 123718] INFO - threddsServlet - Request Completed - 404 - -1 - 491915<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"> <u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">Additionally, I did not get a response when I clicked on your link.<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"> <u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">As to why that might be, I cannot answer that part.<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"> <u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">Hope this helps.<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"> <u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">Griff.<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;color:#1f497d" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<div>
<div style="border:none;border-top:solid #b5c4df 1.0pt;padding:3.0pt 0cm 0cm 0cm">
<p class="MsoNormal"><b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"" lang="EN-US">From:</span></b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"" lang="EN-US"> ncl-talk [<a href="mailto:ncl-talk-bounces@ucar.edu" target="_blank">mailto:ncl-talk-bounces@ucar.<wbr>edu</a>]
<b>On Behalf Of </b>Capehart, William J<br>
<b>Sent:</b> Wednesday, 20 September 2017 1:31 PM<br>
<b>To:</b> <a href="mailto:ncl-talk@ucar.edu" target="_blank">ncl-talk@ucar.edu</a><br>
<b>Subject:</b> [ncl-talk] Reopening an old trouble ticket: OPeNDAP failing when reading a large number of files</span><span lang="EN-US"><u></u><u></u></span></p>
</div>
</div>
<p class="MsoNormal"><span lang="EN-US"> <u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt" lang="EN-US">I am having the same issue that Jon Meyer had a few years ago. His original post is linked here.</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt" lang="EN-US"><a href="http://mailman.ucar.edu/pipermail/ncl-talk/2015-June/thread.html#2853" target="_blank">http://mailman.ucar.edu/<wbr>pipermail/ncl-talk/2015-June/<wbr>thread.html#2853</a>
</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt" lang="EN-US">To repeat the problem, I have a large number of OPeNDAP files that we’re trying help my remote students access.</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt" lang="EN-US">After reading a large number of files (I don’t have a specific answer but it’s less than the magic 1024 value and seems to hover around 240 files) via the server I get the same error message.</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Courier New"" lang="EN-US">Cannot create cookie file</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Courier New"" lang="EN-US">CURL Error: Couldn't resolve host name</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Courier New"" lang="EN-US">curl error details: </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Courier New"" lang="EN-US">fatal:Could not open (<a href="http://kyrill.ias.sdsmt.edu:8080/thredds/dodsC/BWW_GENS/2017/03/04/gens003_WRFRAP_ALL_2017-03-04_18.wrf_ci_turb.grib2" target="_blank">http://kyrill.ias.sdsmt.edu:<wbr>8080/thredds/dodsC/BWW_GENS/<wbr>2017/03/04/gens003_WRFRAP_ALL_<wbr>2017-03-04_18.wrf_ci_turb.<wbr>grib2</a>)</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Courier New"" lang="EN-US">fatal:Either file (f) isn't defined or variable (Geopotential_height_isobaric_<wbr>ens) is not a variable in the file</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Courier New"" lang="EN-US">fatal:["Execute.c":8640]:<wbr>Execute: Error occurred at or near line 282 in file read_z500_ensembles_from_<wbr>thredds.ncl</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt" lang="EN-US">We are using the delete(f) to release the file units and also are using the
<i>setfileoption("grib2", "SuppressClose", False)</i> command</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt" lang="EN-US">I also have the log files from our THREDDS server (linked below).</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt" lang="EN-US"><a href="https://gist.github.com/wjcapehart/46d3f594d223f9b8bb2c6e577a3ecaad" target="_blank">https://gist.github.com/<wbr>wjcapehart/<wbr>46d3f594d223f9b8bb2c6e577a3eca<wbr>ad</a></span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt" lang="EN-US">Hopefully, this will give the NCL or THREDDS or Tomcat people an idea of what is going on with this problem.</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt" lang="EN-US">Cheers-n-Thanks</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt" lang="EN-US">------------------------------<wbr>------------------<br>
Bill Capehart <<a href="mailto:William.Capehart@sdsmt.edu" target="_blank">William.Capehart@sdsmt.edu</a>><br>
Atmospheric and Environmental Sciences Program Coordinator<br>
Civil and Environmental Engineering<br>
201 Mineral Industries Building<br>
South Dakota School of Mines and Technology<br>
501 East St Joseph Street<br>
Rapid City, SD 57701-3995<br>
Ph: <a href="tel:(605)%20394-1994" value="+16053941994" target="_blank">+1-605-394-1994</a> Mobile: <a href="tel:(605)%20484-5692" value="+16054845692" target="_blank">+1-605-484-5692</a></span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt" lang="EN-US"> </span><span lang="EN-US"><u></u><u></u></span></p>
</div></div></div>
</div>
<br>______________________________<wbr>_________________<br>
ncl-talk mailing list<br>
<a href="mailto:ncl-talk@ucar.edu">ncl-talk@ucar.edu</a><br>
List instructions, subscriber options, unsubscribe:<br>
<a href="http://mailman.ucar.edu/mailman/listinfo/ncl-talk" rel="noreferrer" target="_blank">http://mailman.ucar.edu/<wbr>mailman/listinfo/ncl-talk</a><br>
<br></blockquote></div><br></div>