<div dir="ltr"><div>Hi Harry,</div><div><br></div><div>A simple "killed" message is Linux's very unhelpful manner of saying it has direly run out out of memory (google that for plenty of references/discussion). It is neither an NCL or a Python issue.</div><div><br></div><div>Without better understanding of your script, I'm not sure what to suggest. Perhaps process your files in smaller batches? You are aware that "delete"ing no-longer-used variables frees their memory? <br></div><div><br></div><div>Rick<br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Fri, Jun 14, 2019 at 4:11 AM Ian Harris (ENV - Staff) <<a href="mailto:I.Harris@uea.ac.uk">I.Harris@uea.ac.uk</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div style="overflow-wrap: break-word;">
Hi,
<div><br>
</div>
<div>I’m running a long and slightly cumbersome NCL script - with callouts to WRAPITted Fortran subs. It takes about 8 days to complete, as it’s reading a lot of high res gridded files (HARMONIE/V1 reanalysis), regridding them, and producing an aligned-with-CRU
TS forcing dataset 1901-2018. It also sends each file via scp as it’s produced.</div>
<div><br>
</div>
<div>However, I’ve now had two instances of it just.. dying. The most recent was this morning (UK time):</div>
<div><br>
</div>
<div><font face="Courier">(0)<span class="gmail-m_6641895474907390298Apple-tab-span" style="white-space:pre-wrap">
</span>Fri 14 Jun 2019 04:47:42 BST: top of monthly loop with iy=2005 and im=8<br>
(0)<span class="gmail-m_6641895474907390298Apple-tab-span" style="white-space:pre-wrap"> </span>Fri 14 Jun 2019 04:47:42 BST: top of variable loop with var=TMP_P0_L103_GLC0<br>
cruhar_v3_2005_08_3hourly_Tairalign.nc 100% 162MB 10.8MB/s 00:15 <br>
(0)<span class="gmail-m_6641895474907390298Apple-tab-span" style="white-space:pre-wrap"> </span>/Volumes/VERIFY2/output_v3/cruhar_v3_2005_08_3hourly_Tairalign.nc successfully uploaded<br>
(0)<span class="gmail-m_6641895474907390298Apple-tab-span" style="white-space:pre-wrap"> </span>Fri 14 Jun 2019 04:48:48 BST: top of variable loop with var=PRES_P0_L1_GLC0<br>
cruhar_v3_2005_08_3hourly_Psurfnoalign.nc 100% 162MB 9.5MB/s 00:17 <br>
(0)<span class="gmail-m_6641895474907390298Apple-tab-span" style="white-space:pre-wrap"> </span>/Volumes/VERIFY2/output_v3/cruhar_v3_2005_08_3hourly_Psurfnoalign.nc successfully uploaded<br>
(0)<span class="gmail-m_6641895474907390298Apple-tab-span" style="white-space:pre-wrap"> </span>Fri 14 Jun 2019 04:49:55 BST: top of variable loop with var=WDIR_P0_L103_GLC0<br>
(0)<span class="gmail-m_6641895474907390298Apple-tab-span" style="white-space:pre-wrap"> </span>Fri 14 Jun 2019 04:50:39 BST: top of variable loop with var=WIND_P0_L103_GLC0<br>
Killed<br>
[imac:~/WORKING/VERIFY] ianharris% <br>
</font><br>
</div>
<div>Now where does that 'Killed' come from? Is the system killing it? I see nothing in the system logs. I have plenty of RAM (double what I had the first time it Killed), so I can’t see it being that.</div>
<div><br>
</div>
<div>Any suggestions would be helpful!</div>
<div><br>
</div>
<div>Cheers</div>
<div><br>
</div>
<div>Harry</div>
<div>PS Yes I’m sure it won’t happen with Python :)</div>
<div><br>
<div>
<div style="color:rgb(0,0,0);font-family:Georgia;font-size:14px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">
Ian 'Harry'Harris | NCAS-Climate | Climatic Research Unit |School of Environmental Sciences | 01.02 Hubert Lamb Building | Faculty of Science | University of East Anglia | Norwich Research Park | Norwich |NR4 7TJ<br>
Tel: +44 1603 593 818 Fax: +44 1603 591 327<br>
</div>
<div style="color:rgb(0,0,0);font-family:Georgia;font-size:14px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">
<br>
</div>
<div style="color:rgb(0,0,0);font-family:Georgia;font-size:14px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">
I work 80%FTE, normally Tuesday-Friday</div>
<span style="color:rgb(0,0,0);font-family:Georgia;font-size:14px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"><br class="gmail-m_6641895474907390298Apple-interchange-newline" style="color:rgb(0,0,0);font-family:Georgia;font-size:14px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">
<span style="color:rgb(0,0,0);font-family:Georgia;font-size:14px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"><span><span><span><span><span><img id="gmail-m_6641895474907390298B85BDFB5-3A4E-48FB-A5C2-E8A6222A4078" src="cid:16b5642fd7f4cff311"></span><span style="color:rgb(0,0,0);font-family:Georgia;font-size:14px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"><span style="color:rgb(0,0,0);font-family:Georgia;font-size:14px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"><span><span><span><br style="color:rgb(0,0,0);font-family:Georgia;font-size:14px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">
<span style="color:rgb(0,0,0);font-family:Georgia;font-size:14px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;float:none;display:inline">Gold
(</span><span style="color:rgb(0,0,0);font-family:Georgia;font-size:14px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;float:none;display:inline">Teaching
Excellence</span><span style="color:rgb(0,0,0);font-family:Georgia;font-size:14px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;float:none;display:inline"> </span><span style="color:rgb(0,0,0);font-family:Georgia;font-size:14px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;float:none;display:inline">Framework
2017-2020)</span><br style="color:rgb(0,0,0);font-family:Georgia;font-size:14px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">
<span style="color:rgb(0,0,0);font-family:Georgia;font-size:14px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;float:none;display:inline">UK
Top 15</span><span style="color:rgb(0,0,0);font-family:Georgia;font-size:14px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;float:none;display:inline"> </span><span style="color:rgb(0,0,0);font-family:Georgia;font-size:14px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;float:none;display:inline">(The
Times/Sunday</span><span style="color:rgb(0,0,0);font-family:Georgia;font-size:14px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;float:none;display:inline"> </span><span style="color:rgb(0,0,0);font-family:Georgia;font-size:14px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;float:none;display:inline">Times
2019 and Complete</span><span style="color:rgb(0,0,0);font-family:Georgia;font-size:14px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;float:none;display:inline"> </span><span style="color:rgb(0,0,0);font-family:Georgia;font-size:14px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;float:none;display:inline">University
Guide 2019)</span><br style="color:rgb(0,0,0);font-family:Georgia;font-size:14px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">
<span style="color:rgb(0,0,0);font-family:Georgia;font-size:14px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;float:none;display:inline">World
Top 200</span><span style="color:rgb(0,0,0);font-family:Georgia;font-size:14px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;float:none;display:inline"> </span><span style="color:rgb(0,0,0);font-family:Georgia;font-size:14px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;float:none;display:inline">(Times
Higher</span><span style="color:rgb(0,0,0);font-family:Georgia;font-size:14px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;float:none;display:inline"> </span><span style="color:rgb(0,0,0);font-family:Georgia;font-size:14px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;float:none;display:inline">Education
World University</span><span style="color:rgb(0,0,0);font-family:Georgia;font-size:14px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;float:none;display:inline"> </span><span style="color:rgb(0,0,0);font-family:Georgia;font-size:14px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;float:none;display:inline">Rankings
2019)</span></span></span></span></span></span>
<div><span style="color:rgb(0,0,0);font-family:Georgia;font-size:14px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"><span style="color:rgb(0,0,0);font-family:Georgia;font-size:14px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"><span><span><span><span style="color:rgb(0,0,0);font-family:Georgia;font-size:14px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;float:none;display:inline"> </span><br style="color:rgb(0,0,0);font-family:Georgia;font-size:14px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">
<span style="color:rgb(0,0,0);font-family:Georgia;font-size:14px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"><span><span><span><span><span><span><img id="gmail-m_6641895474907390298B5A63BAE-C4BE-4996-9403-E2A2C10DEB76" src="cid:16b5642fd805b006a2"></span><span style="color:rgb(0,0,0);font-family:Georgia;font-size:14px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;float:none;display:inline"> </span><span style="color:rgb(0,0,0);font-family:Georgia;font-size:14px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;float:none;display:inline"> </span><span style="color:rgb(0,0,0);font-family:Georgia;font-size:14px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"><span><span><span><span><span><span><img id="gmail-m_664189547490739029864B3CA01-C590-4F33-93BF-5208457A2A4F" src="cid:16b5642fd81692e333"></span><span style="color:rgb(0,0,0);font-family:Georgia;font-size:14px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;float:none;display:inline"> </span><span style="color:rgb(0,0,0);font-family:Georgia;font-size:14px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;float:none;display:inline"> </span><span style="color:rgb(0,0,0);font-family:Georgia;font-size:14px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"><span><span><span><span><span><span><img id="gmail-m_6641895474907390298AE516C1D-607F-40A3-A052-CFADF5F987E9" src="cid:16b5642fd817745b44"></span><span style="color:rgb(0,0,0);font-family:Georgia;font-size:14px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;float:none;display:inline"> </span><span style="color:rgb(0,0,0);font-family:Georgia;font-size:14px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"><span><span><span><span><span><span><img id="gmail-m_6641895474907390298A5EDCEC6-D54E-4FA7-B2DF-3FDA6EC3C1FC" src="cid:16b5642fd82855d355"></span><span style="color:rgb(0,0,0);font-family:Georgia;font-size:14px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;float:none;display:inline"> </span><span style="color:rgb(0,0,0);font-family:Georgia;font-size:14px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"><span><span><span><span><span><span><img id="gmail-m_6641895474907390298AF520C51-4842-4EDB-A2BE-81A6A3470DE9" src="cid:16b5642fd829374b66"></span><span style="color:rgb(0,0,0);font-family:Georgia;font-size:14px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;float:none;display:inline"> </span><span style="color:rgb(0,0,0);font-family:Georgia;font-size:14px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"><span><span><span><span><span><span><img id="gmail-m_6641895474907390298FEEA8D5C-8D0A-41C0-AE19-33371B3FC0CF" src="cid:16b5642fd82a18c377"></span><span style="color:rgb(0,0,0);font-family:Georgia;font-size:14px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;float:none;display:inline"> </span><span style="color:rgb(0,0,0);font-family:Georgia;font-size:14px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"><span><span><span><span><span><span><img id="gmail-m_664189547490739029855C420A2-1DDD-4455-B91C-AC6CBAFA5960" src="cid:16b5642fd82afa3b88"></span><span style="color:rgb(0,0,0);font-family:Georgia;font-size:14px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;float:none;display:inline"> </span><span style="color:rgb(0,0,0);font-family:Georgia;font-size:14px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"><span><span><span><span><span><span><img id="gmail-m_66418954749073902987409C5D0-9F76-41AC-9CEE-D301E72D2086" src="cid:16b5642fd82bdbb399"></span>
</span></span></span></span></span></span></span></span></span></span></span></span></span></span></span></span></span></span></span></span></span></span></span></span></span></span></span></span></span></span></span></span></span></span></span></span></span></span></span></span></span></span></span></span></span></span></span></span></span></span></span></span></span></div>
</span></span></span></span></span></span></div>
<br>
</div>
</div>
_______________________________________________<br>
ncl-talk mailing list<br>
<a href="mailto:ncl-talk@ucar.edu" target="_blank">ncl-talk@ucar.edu</a><br>
List instructions, subscriber options, unsubscribe:<br>
<a href="http://mailman.ucar.edu/mailman/listinfo/ncl-talk" rel="noreferrer" target="_blank">http://mailman.ucar.edu/mailman/listinfo/ncl-talk</a><br>
</blockquote></div>