<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"><head><meta http-equiv=Content-Type content="text/html; charset=us-ascii"><meta name=Generator content="Microsoft Word 14 (filtered medium)"><style><!--
/* Font Definitions */
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal-compose;
font-family:"Calibri","sans-serif";
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri","sans-serif";}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]--></head><body lang=EN-US link=blue vlink=purple><div class=WordSection1><p class=MsoNormal>Hi all...<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>So, I’ve got a bit of a problem, and I’m not sure of the best way to fix it. I’m just now beginning to experiment with WRF 3.5 – previously using WRF 3.3.1. Because of code changes (requiring F2003 capabilities), I’ve had to switch to newer compiler and MPI versions. Because of the multiple changes from my previous setup, I’m not totally sure of where the problem lies.<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>I’ve gotten things working when I run everything from a shared disk, visible to all the computational nodes. Our more usual work flow, however, runs the model on local disk for the I/O node – which isn’t visible to the other nodes devoted to the job.<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>For previous WRF and MPI versions, this worked fine. The only oddity is that the various rsl.error.XXXX and rsl.out.XXXX files from the other processes got dumped in my home directory (visible to all nodes), which wasn’t a problem. The files created by processes on the I/O node (with the local disk) were placed in the directory I run things from.<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>The new WRF/MPI combo failed, initially because the non-I/O nodes complained that they couldn’t go to the work directory. That’s when I tried running it from a shared disk – which worked fine. Next I tried modifying my job script so that it created work directories on the local disk of the non-I/O nodes. In this way there is a work directory with the same name on all nodes, local to all nodes.<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>This time it progressed further, began the real.exe step, and actually created the rsl.error.XXXX and rsl.out.XXXX files within the local work directories on all the nodes. Unfortunately, all processes on the non-I/O nodes fail immediately. Here’s an example of one of the error messages in a rsl.error file:<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal> taskid: 12 hostname: compute-0-5.local<o:p></o:p></p><p class=MsoNormal> Quilting with 1 groups of 0 I/O tasks.<o:p></o:p></p><p class=MsoNormal style='text-indent:.5in'>PGFIO-F-209/OPEN/unit=27/'OLD' specified for file which does not exist.<o:p></o:p></p><p class=MsoNormal> File name = namelist.input</p><p class=MsoNormal style='text-indent:.5in'> In source file module_wrf_error.f90, at line number 38<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>So it appears as if all the processes on the non-I/O nodes are attempting to open namelist.input, and failing because it’s not visible on their local disk. This never happened previously, with a different WRF, compiler, and MPI versions. I suspect this could be fixed with either compile or run time options. But which ones?<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>Any thoughts? I suspect this might also happen in the wrf.exe stage, but I haven’t gotten that far with this configuration.<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>Thanks,<o:p></o:p></p><p class=MsoNormal>Mike<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>-- <o:p></o:p></p><p class=MsoNormal>Mike Zulauf<o:p></o:p></p><p class=MsoNormal>Meteorologist, Lead Senior<o:p></o:p></p><p class=MsoNormal>Operational Meteorology <o:p></o:p></p><p class=MsoNormal>Iberdrola Renewables<o:p></o:p></p><p class=MsoNormal>1125 NW Couch, Suite 700<o:p></o:p></p><p class=MsoNormal>Portland, OR 97209<o:p></o:p></p><p class=MsoNormal>Office: 503-478-6304 Cell: 503-913-0403<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p></div></body><!--[object_id=#iberdrolaren.com#]--><FONT face=Tahoma size=2><FONT color=#0000ff><FONT color=#387000>
<P align=left><FONT face=Arial size=1>This message is intended for the exclusive attention of the recipient(s) indicated. Any information contained herein is strictly confidential and privileged. If you are not the intended recipient, please notify us by return e-mail and delete this message from your computer system. Any unauthorized use, reproduction, alteration, filing or sending of this message and/or any attached files may lead to legal action being taken against the party(ies) responsible for said unauthorized use. Any opinion expressed herein is solely that of the author(s) and does not necessarily represent the opinion of the Company. The sender does not guarantee the integrity, speed or safety of this message, and does not accept responsibility for any possible damage arising from the interception, incorporation of viruses, or any other damage as a result of manipulation.</P></FONT></FONT><FONT color=#387000></FONT><FONT face=Arial size=1>
<P align=left></P></FONT></FONT></FONT></html>