<html dir="ltr">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
<style type="text/css" id="owaParaStyle"></style>
</head>
<body fpstyle="1" ocsi="0">
<div style="direction: ltr;font-family: Tahoma;color: #000000;font-size: 10pt;">
<div><br>
</div>
Doug,
<div><br>
</div>
<div>Max time is most relevant and printing the min time is useful to get an idea of load imbalance. Don't think the mean really tells you much.</div>
<div><br>
</div>
<div>And the global reductions are only in the timer print, right?<br>
<div><br>
<div class="BodyFragment"><font size="2">
<div class="PlainText">Thanks,<br>
<br>
Phil<br>
<br>
TSPA/Correspondence/DUSA EARTH<br>
------<br>
Philip Jones (pwjones@lanl.gov)<br>
Climate, Ocean and Sea Ice Modeling<br>
Los Alamos National Laboratory<br>
T-3 MS B216<br>
P.O. Box 1663<br>
Los Alamos, NM 87545<br>
</div>
</font></div>
</div>
<div style="font-family: Times New Roman; color: #000000; font-size: 16px">
<hr tabindex="-1">
<div id="divRpF936178" style="direction: ltr; "><font face="Tahoma" size="2" color="#000000"><b>From:</b> mpas-developers-bounces@mailman.ucar.edu [mpas-developers-bounces@mailman.ucar.edu] on behalf of Doug Jacobsen [jacobsen.douglas@gmail.com]<br>
<b>Sent:</b> Thursday, December 08, 2011 7:36 PM<br>
<b>To:</b> mpas-developers@ucar.edu<br>
<b>Subject:</b> Re: [mpas-developers] mpas_timer.F synchronization issue.<br>
</font><br>
</div>
<div></div>
<div>Hi Everyone,<br>
<br>
Something else that I would like input on regarding this. I currently have two options for synchronizing the timers. First is the current version, which just uses the max of all of the processors timers. The other option would be to average all of the timers
across processors. Each have their own benefits and provide slightly different information. So if anyone has any preferences it would be good to have a discussion about them.<br>
<br>
Thanks!<br>
Doug<br>
<br>
<div class="gmail_quote">On Thu, Dec 8, 2011 at 3:47 PM, Doug Jacobsen <span dir="ltr">
<<a href="mailto:jacobsen.douglas@gmail.com" target="_blank">jacobsen.douglas@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex; border-left:1px #ccc solid; padding-left:1ex">
Hello Everyone,<br>
<br>
I recently noticed that when running an MPI job processors would report different times for sub-timers, ie. not including the total_time timer. This is mostly due to some processors having to wait for mpi calls to finish while other ones don't. None of the
previous versions of mpas_timer.F have supported making sure the timers report the same time over all of the processors. So I have attached a new version of mpas_timer.F that supports this. It essentially makes each timer's total time the maximum total time
over all of the processors. It also gets the global max and min single call time to print as well. I think this gives a better over all profile for the time spent in routines rather than having to go through each processors log.*.out file to see how it behaved.<br>
<br>
To support this, the timer module now stores a pointer to domain % dminfo so you don't have to pass it in to print out the timers. Doing this allows the current timer implementation to stay the same, and allows the syncing of timers by adding a single line
to mpas_*_mpas_core.F within each core, which is:<br>
<br>
call mpas_timer_init(domain)<br>
<br>
within mpas_core_init.<br>
<br>
I'm open to any comments or suggestions regarding this change, but I would like to propagate it to the trunk. I will also propagate the above addition to mpas_ocn_mpas_core.F but can add it to the other cores if requested.
<br>
<br>
Thanks for your input.<br>
<font color="#888888">Doug<br>
</font></blockquote>
</div>
<br>
</div>
</div>
</div>
</div>
</body>
</html>