<div dir="ltr">Hi Yiapoing,<div><br></div><div>The core is the hardware, the thread is like the number of process executed by the core, each of your cores can process two threads, so you don't have 12 cores per processor you have 6 (<a href="http://ark.intel.com/products/47922/Intel-Xeon-Processor-X5650-12M-Cache-2_66-GHz-6_40-GTs-Intel-QPI">http://ark.intel.com/products/47922/Intel-Xeon-Processor-X5650-12M-Cache-2_66-GHz-6_40-GTs-Intel-QPI</a>).</div><div>so instead you run wrf with mpirun -np 44 you should do it with mpirun -np 22.</div><div>There is also a way of binding to core, so it doesn't keep jumping to other cores (I don't know too much about this). I have it like this: mpirun -np 16 --map-by socket:PE=2 wrf.exe </div><div>I hope that works for you.</div></div><div class="gmail_extra"><br><div class="gmail_quote">2016-09-02 19:33 GMT-03:00 Wang, Yaoping <span dir="ltr"><<a href="mailto:wang.3866@buckeyemail.osu.edu" target="_blank">wang.3866@buckeyemail.osu.edu</a>></span>:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div bgcolor="#FFFFFF" text="#000000">
<div style="font-size:10pt;color:#000000;background-color:#ffffff;font-family:Mangal,Sans-Serif">
<p>Hi, </p>
<p><br>
</p>
<p><span>Could you explain more <span>about the "using 2 process in one core" and how to find out/address it? I am not very familiar with the technical aspect of supercomputing. I thought one core in supercomputing means one CPU, but did you mean that each
CPU is further made up of multiple "little-cores" themselves, or 2 cores can be on the same CPU?</span></span></p>
<p><br>
</p>
<p><span><span>I am compiling MPI using the intel compiler</span></span><span style="font-size:10pt">. But here is another problem. OpenMP</span><span style="font-size:10pt"> does not work at all on my system. The compiler finishes successfully, but then,
when I run "./real.exe", it segfaults without even creating an rsl file. I tried using "./configure -d", and updating my WRF version from 3.8 to 3.8.1, </span><span style="font-size:10pt">but the segfault was the same.
</span><span style="font-size:10pt">Do you </span><span style="font-size:10pt">know</span><span style="font-size:10pt">
</span><span style="font-size:10pt">what else</span><span style="font-size:10pt"> I might </span><span style="font-size:10pt">do</span><span style="font-size:10pt">? I attached my "configure.wrf" and "configure.wps" files. </span></p>
<p><span style="font-size:10pt"></span></p>
<p><br>
</p>
<p><span><span>I also tested 44 cores with no luck. Increasing the number of nodes from 4 to 6 only increased the throughput marginally. </span></span></p>
<p><span><span><br>
</span></span></p>
<p><span><span>Thank you, </span></span></p>
<p><span><span>Yaoping</span></span></p>
</div>
<hr style="display:inline-block;width:98%">
<div dir="ltr"><font face="Calibri, sans-serif" style="font-size:11pt" color="#000000"><b>From:</b> <a href="mailto:wrf-users-bounces@ucar.edu" target="_blank">wrf-users-bounces@ucar.edu</a> <<a href="mailto:wrf-users-bounces@ucar.edu" target="_blank">wrf-users-bounces@ucar.edu</a>> on behalf of Mike Dvorak <<a href="mailto:mike@sailtactics.com" target="_blank">mike@sailtactics.com</a>><br>
<b>Sent:</b> Thursday, September 1, 2016 5:05:28 PM<br>
<b>To:</b> <a href="mailto:wrf-users@ucar.edu" target="_blank">wrf-users@ucar.edu</a><br>
<b>Subject:</b> Re: [Wrf-users] What is a reasonable speed for WRF / how to increase it?</font>
<div> </div>
</div><div><div class="h5">
<div>Hi Yaoping,<br>
<br>
What parallelization option did you compile WRF with (e.g. MPI only)? Also, I've found the Intel compilers to be 3 times faster than the GNU compilers on some WRF configurations (unfortunately). What compiler did you use?<br>
<br>
You may also want to experiment using less than the number of total cores on the machine. For example, you could try using 44 cores instead of 48. I think WRF EMS is set to do this by default. I've verified on some of my multi-core machines that this does indeed
reduce the runtime.<br>
<br>
Cheers,<br>
Mike<br>
<br>
<br>
<div>On 09/01/2016 03:15 PM, Carlos Ross wrote:<br>
</div>
<blockquote type="cite">
<div dir="ltr">I think it should be faster, <span style="color:rgb(0,0,0);font-family:mangal,sans-serif;font-size:13.3333px">Xeon x5650 CPUs are 6 cores and 12 threads, so you maybe using 2 process in one core and that is slowing it down.</span></div>
<div class="gmail_extra"><br>
<div class="gmail_quote">2016-08-31 18:36 GMT-03:00 Wang, Yaoping <span dir="ltr">
<<a href="mailto:wang.3866@buckeyemail.osu.edu" target="_blank">wang.3866@buckeyemail.osu.edu</a><wbr>></span>:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">
<div style="font-size:10pt;color:#000000;background-color:#ffffff;font-family:Mangal,Sans-Serif">
<p>Hi All, </p>
<p><br>
</p>
<p>I am running WRF on a ~6km resolution, <span style="font-size:10pt">91 x 121 domain in the eastern United States. I am using an adaptive time step which makes it mostly 72 sec increments. </span><span style="font-size:10pt">There are 34 vertical levels. I
use 4 x 12 cores on a Intel Xeon x5650 CPUs machine. </span><span style="font-size:10pt">The throughput is about 1.2 hour wall time per 24 hours model time. </span></p>
<p><span style="font-size:10pt"></span></p>
<p><span style="font-size:10pt"><br>
</span></p>
<p><span style="font-size:10pt">Is this a reasonable speed? I found some information here (<a href="http://www.ecmwf.int/sites/default/files/elibrary/2014/13662-performance-analysis-operational-implementaion-wrf.pdf" target="_blank">http://www.ecmwf.int/sites/de<wbr>fault/files/elibrary/2014/1366<wbr>2-performance-analysis-operati<wbr>onal-implementaion-wrf.pdf</a>)
and after considering the domain difference, my run still seems a touch slow. And i</span><span style="font-size:10pt">s there anyway I could figure how to make the model run faster?</span></p>
<p><span style="font-size:10pt"><br>
</span></p>
<p><span style="font-size:10pt">Thank you, </span></p>
<span><font color="#888888">
<p><span style="font-size:10pt">Yaoping Wang</span></p>
</font></span></div>
</div>
<br>
______________________________<wbr>_________________<br>
Wrf-users mailing list<br>
<a href="mailto:Wrf-users@ucar.edu" target="_blank">Wrf-users@ucar.edu</a><br>
<a href="http://mailman.ucar.edu/mailman/listinfo/wrf-users" rel="noreferrer" target="_blank">http://mailman.ucar.edu/mailma<wbr>n/listinfo/wrf-users</a><br>
<br>
</blockquote>
</div>
<br>
</div>
<br>
<fieldset></fieldset> <br>
<pre>______________________________<wbr>_________________
Wrf-users mailing list
<a href="mailto:Wrf-users@ucar.edu" target="_blank">Wrf-users@ucar.edu</a>
<a href="http://mailman.ucar.edu/mailman/listinfo/wrf-users" target="_blank">http://mailman.ucar.edu/<wbr>mailman/listinfo/wrf-users</a>
</pre>
</blockquote>
<br>
<div>-- <br>
<table border="0" cellpadding="2" cellspacing="2" height="126" width="15%">
<tbody>
<tr>
<td valign="center"><img alt="Sail Tactics logo" height="118" width="90" src="cid:part5.FD4A0143.10B55550@sailtactics.com"><br>
</td>
<td valign="top">Mike Dvorak, PhD<br>
Founder<br>
Sail Tactics, LLC<br>
Corpus Christi, TX<br>
<a href="tel:%2B1%20650-454-5243" value="+16504545243" target="_blank">+1 650-454-5243</a><br>
<a href="http://sailtactics.com" target="_blank">http://sailtactics.com</a><br>
</td>
</tr>
</tbody>
</table>
</div>
</div>
</div></div></div>
</blockquote></div><br></div>