Hi Michael,<br><br>I ran it with openmpi, as well as whatever mpi implementation is installed on the clusters here, probably openmpi as well though. The 0.00 for efficiency is just what it gets initialized for, so there aren't any NaN's printed out. <br>
<br>It might be better to just move the two timers that are called prior to mpi_init to be after the call to mpas_framework_init. Since the call to mpi_init is inside mpas_dmpar. Otherwise we would have to add more compile options. I think it should be the default timer, since system_clock has other issues like only being 32bit.<br>
<br>It probably makes sense to move these timers too, since the framework finalize is outside of the timers as well. If you want to give that a try, and let me know if that works or if that's a suitable solution I can add that as part of my commit.<br>
<br>Doug<br><br><br><div class="gmail_quote">On Wed, Jan 4, 2012 at 5:49 PM, Michael Duda <span dir="ltr"><<a href="mailto:duda@ucar.edu">duda@ucar.edu</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
Hi, Doug.<br>
<br>
I think that adding additional directories for documentation sounds fine.<br>
<br>
For the new timer code, when I run the non-hydrostatic atmosphere model,<br>
I'm getting only 0.00 for efficiency for all timers; is there something<br>
we need to do to enable this extra information?<br>
<br>
I don't think it's related to the new timing code, since I recall<br>
getting these messages previously on our IBM, but it appears that<br>
certain MPI implementations are unhappy with calls to MPI_Wtime that<br>
occur before a call to MPI_Init; I'm seeing the following fatal errors:<br>
<br>
ERROR: 0032-150 MPI is not initialized in MPI_Wtime, task 7<br>
ERROR: 0032-150 MPI is not initialized in MPI_Wtime, task 5<br>
ERROR: 0032-150 MPI is not initialized in MPI_Wtime, task 0<br>
ERROR: 0032-150 MPI is not initialized in MPI_Wtime, task 1<br>
ERROR: 0032-150 MPI is not initialized in MPI_Wtime, task 2<br>
ERROR: 0032-150 MPI is not initialized in MPI_Wtime, task 6<br>
ERROR: 0032-150 MPI is not initialized in MPI_Wtime, task 3<br>
ERROR: 0032-150 MPI is not initialized in MPI_Wtime, task 4<br>
<br>
Until now, I'd just been moving the first two calls to mpas_timer_start()<br>
after the call to mpas_framework_init(), but perhaps you'd know whether<br>
there is some fix that can be made in the timing module. Of course, I'd<br>
completely accept that either the IBM MPI implementation is too fussy,<br>
or that we just need to be careful about starting timers until after MPI<br>
has been properly initialized. Would something like changing "#elif _MPI"<br>
to "#elif (_MPI && USE_WTIME)" in the timing module be acceptable?<br>
<br>
Thanks!<br>
Michael<br>
<div><div class="h5"><br>
<br>
On Wed, Jan 04, 2012 at 02:13:04PM -0700, Doug Jacobsen wrote:<br>
> Hello Everyone,<br>
><br>
> I have two changes to the trunk that I would like to propose.<br>
><br>
> First, we would like to add a directory to store design documents. The<br>
> proposed path is trunk/documents/[core], where each core would have a<br>
> directory and we could add a shared directory for global design documents<br>
> (similar to the multiple blocks/pio design document). The structure inside<br>
> of these directories could be decided on by the core developers, or people<br>
> working on the design documents for that directory.<br>
><br>
> Second, since I never got around to it last year, I would like to propose<br>
> the commit of my previously mentioned timers. Essentially the only added<br>
> features are that timers are synced across processors, and a load<br>
> efficiency is output in addition to the other timer information.<br>
><br>
> I have attached a copy of the timers for anyone to explore, so any comments<br>
> would be appreciated. If I don't hear anything on these I will commit them<br>
> at some time tomorrow.<br>
><br>
> Thanks,<br>
> Doug<br>
<br>
<br>
</div></div>> _______________________________________________<br>
> mpas-developers mailing list<br>
> <a href="mailto:mpas-developers@mailman.ucar.edu">mpas-developers@mailman.ucar.edu</a><br>
> <a href="http://mailman.ucar.edu/mailman/listinfo/mpas-developers" target="_blank">http://mailman.ucar.edu/mailman/listinfo/mpas-developers</a><br>
<br>
</blockquote></div><br>