<div dir="ltr"><div class="gmail_default" style="font-size:small">Zhifeng,</div><div class="gmail_default" style="font-size:small"><br></div><div class="gmail_default" style="font-size:small">The parallel NCL project that you're thinking of is likely ParVis, which was a specialized project to process certain CESM files, with only a subset of analysis routines parallelized. I don't think this will be appropriate for your requirements.</div><div class="gmail_default" style="font-size:small"><br></div><div class="gmail_default" style="font-size:small">One thing we are doing slowly is introducing some OpenMP parallelism on internal algorithms (graphical and computational), and we hope to elevate this activity after we hire two new developers in the NCL team.</div><div class="gmail_default" style="font-size:small"><br>We are also investigating ways to use Python tools to introduce parallelism, using the mpi4py module. <span style="color:rgb(0,0,0)">The </span><span style="color:rgb(0,0,0);line-height:12.1333341598511px">Application Scalability and Performance Group</span><span style="color:rgb(0,0,0);line-height:12.1333341598511px"> at </span><span style="color:rgb(0,0,0)">NCAR has written two Python-based parallel tools:</span></div><div class="gmail_default" style="font-size:small"><ul><li><span style="color:rgb(0,0,0)">PyReshaper - takes time slice data and convert it to time series using task parallelism</span></li></ul></div><div class="gmail_default" style="font-size:small"><ul><li><span style="color:rgb(0,0,0)">PyAverager - reads data off NetCDF files and performs averages</span><br></li></ul></div><div class="gmail_default" style="font-size:small"><br></div><div class="gmail_default" style="font-size:small">PyReshaper has been used in conjunction with PyNIO, which is the Python interface to NCL's file I/O capabilities.</div><div class="gmail_default" style="font-size:small"><br></div><div class="gmail_default" style="font-size:small"><div style="font-size:12.8000001907349px">PyReshaper/PyAverager description and download:</div><div style="font-size:12.8000001907349px"><a href="https://www2.cisl.ucar.edu/tdd/asap/parallel-python-tools-post-processing-climate-data" target="_blank">https://www2.cisl.ucar.edu/tdd/asap/parallel-python-tools-post-processing-climate-data</a><br></div><div style="font-size:12.8000001907349px"><br></div><div style="font-size:12.8000001907349px">Their SEA2015 presentation:</div><div style="font-size:12.8000001907349px"><a href="https://sea.ucar.edu/sites/default/files/Mickelson-Bertini_SEA2015.pptx" style="font-size:12.8000001907349px" target="_blank">https://sea.ucar.edu/sites/default/files/Mickelson-Bertini_SEA2015.pptx</a><br></div><div style="font-size:12.8000001907349px"><br></div><div style="font-size:12.8000001907349px">A user seminar on task parallelism:</div><div style="font-size:12.8000001907349px"><a href="https://www2.cisl.ucar.edu/training/library/user-seminar-presentations" target="_blank">https://www2.cisl.ucar.edu/training/library/user-seminar-presentations</a></div><div style="font-size:12.8000001907349px"><br></div></div><div class="gmail_extra"><div class="gmail_default" style="font-size:small">We are very interested in talking to users like yourself who have use cases of working with large data files, or lots of data files, or both. Would you like us to contact you about this in the near future?</div><div class="gmail_default" style="font-size:small"><br></div><div class="gmail_default" style="font-size:small">--Mary</div><br><div class="gmail_quote">On Fri, Jun 26, 2015 at 3:42 PM, Zhifeng Yang <span dir="ltr"><<a href="mailto:yangzf01@gmail.com" target="_blank">yangzf01@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div>Hi<br><br></div>Since currently I am employing NCL to deal with tons of large data files, I am considering to parallelize my NCL code. I searched online about this and found that there were some experts from UCAR working on this project. However I am not sure what's the process of this project. Does anyone know about this and give me any resources on the parallel NCL? Thank you, Zhifeng<br></div>
<br>_______________________________________________<br>
ncl-talk mailing list<br>
<a href="mailto:ncl-talk@ucar.edu">ncl-talk@ucar.edu</a><br>
List instructions, subscriber options, unsubscribe:<br>
<a href="http://mailman.ucar.edu/mailman/listinfo/ncl-talk" rel="noreferrer" target="_blank">http://mailman.ucar.edu/mailman/listinfo/ncl-talk</a><br>
<br></blockquote></div><br></div></div>