<html xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Title" content="">
<meta name="Keywords" content="">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Courier New";
panose-1:2 7 3 9 2 2 5 2 4 4;}
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#0563C1;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:#954F72;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal;
font-family:"Calibri",sans-serif;
color:windowtext;}
span.EmailStyle18
{mso-style-type:personal;
font-family:"Calibri",sans-serif;
color:#1F497D;}
span.EmailStyle19
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:windowtext;}
span.msoIns
{mso-style-type:export-only;
mso-style-name:"";
text-decoration:underline;
color:teal;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style>
</head>
<body bgcolor="white" lang="EN-US" link="#0563C1" vlink="#954F72">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt">Hi Griff. <o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">Correct. We get the classic 404 error. However, the file Is indeed there. As with Jon’s problem if you change the start date further down the street, the seemingly missing file will be read and a later
file will be the one where it stops. The script will read the first ~240 files it encounters and will then halt with an errant missing file error.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">Bill<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span style="color:black">From: </span></b><span style="color:black">Griffith Young <griffith.young@bom.gov.au><br>
<b>Date: </b>Tuesday, September 19, 2017 at 21:44 MDT<br>
<b>To: </b>William Capehart <William.Capehart@sdsmt.edu>, "ncl-talk@ucar.edu" <ncl-talk@ucar.edu><br>
<b>Subject: </b>RE: Reopening an old trouble ticket: OPeNDAP failing when reading a large number of files [SEC=UNCLASSIFIED]<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p>
</div>
<p class="MsoNormal">The file does not exist according to the log (<b>404</b>).<o:p></o:p></p>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal">2017-09-20T02:52:12.951 +0000 [1841685452][ 123718] INFO - threddsServlet - Request Completed - 404 - -1 - 491915<o:p></o:p></p>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal">Additionally, I did not get a response when I clicked on your link.<o:p></o:p></p>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal">As to why that might be, I cannot answer that part.<o:p></o:p></p>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal">Hope this helps.<o:p></o:p></p>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal">Griff.<o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt;color:#1F497D"> </span><o:p></o:p></p>
<div>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span style="font-size:10.0pt;font-family:"Tahoma",sans-serif">From:</span></b><span style="font-size:10.0pt;font-family:"Tahoma",sans-serif"> ncl-talk [mailto:ncl-talk-bounces@ucar.edu]
<b>On Behalf Of </b>Capehart, William J<br>
<b>Sent:</b> Wednesday, 20 September 2017 1:31 PM<br>
<b>To:</b> ncl-talk@ucar.edu<br>
<b>Subject:</b> [ncl-talk] Reopening an old trouble ticket: OPeNDAP failing when reading a large number of files</span><o:p></o:p></p>
</div>
</div>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt">I am having the same issue that Jon Meyer had a few years ago. His original post is linked here.</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"><a href="http://mailman.ucar.edu/pipermail/ncl-talk/2015-June/thread.html#2853">http://mailman.ucar.edu/pipermail/ncl-talk/2015-June/thread.html#2853</a>
</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt">To repeat the problem, I have a large number of OPeNDAP files that we’re trying help my remote students access.</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt">After reading a large number of files (I don’t have a specific answer but it’s less than the magic 1024 value and seems to hover around 240 files) via the server I get the same error message.</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Courier New",serif">Cannot create cookie file</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Courier New",serif">CURL Error: Couldn't resolve host name</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Courier New",serif">curl error details: </span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Courier New",serif">fatal:Could not open (<a href="http://kyrill.ias.sdsmt.edu:8080/thredds/dodsC/BWW_GENS/2017/03/04/gens003_WRFRAP_ALL_2017-03-04_18.wrf_ci_turb.grib2">http://kyrill.ias.sdsmt.edu:8080/thredds/dodsC/BWW_GENS/2017/03/04/gens003_WRFRAP_ALL_2017-03-04_18.wrf_ci_turb.grib2</a>)</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Courier New",serif">fatal:Either file (f) isn't defined or variable (Geopotential_height_isobaric_ens) is not a variable in the file</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Courier New",serif">fatal:["Execute.c":8640]:Execute: Error occurred at or near line 282 in file read_z500_ensembles_from_thredds.ncl</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt">We are using the delete(f) to release the file units and also are using the
<i>setfileoption("grib2", "SuppressClose", False)</i> command</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt">I also have the log files from our THREDDS server (linked below).</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"><a href="https://gist.github.com/wjcapehart/46d3f594d223f9b8bb2c6e577a3ecaad">https://gist.github.com/wjcapehart/46d3f594d223f9b8bb2c6e577a3ecaad</a></span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt">Hopefully, this will give the NCL or THREDDS or Tomcat people an idea of what is going on with this problem.</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt">Cheers-n-Thanks</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt">------------------------------------------------<br>
Bill Capehart <<a href="mailto:William.Capehart@sdsmt.edu">William.Capehart@sdsmt.edu</a>><br>
Atmospheric and Environmental Sciences Program Coordinator<br>
Civil and Environmental Engineering<br>
201 Mineral Industries Building<br>
South Dakota School of Mines and Technology<br>
501 East St Joseph Street<br>
Rapid City, SD 57701-3995<br>
Ph: +1-605-394-1994 Mobile: +1-605-484-5692</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
</div>
</body>
</html>