<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Consolas;
panose-1:2 11 6 9 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman",serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p
{mso-style-priority:99;
mso-margin-top-alt:auto;
margin-right:0in;
mso-margin-bottom-alt:auto;
margin-left:0in;
font-size:12.0pt;
font-family:"Times New Roman",serif;}
pre
{mso-style-priority:99;
mso-style-link:"HTML Preformatted Char";
margin:0in;
margin-bottom:.0001pt;
font-size:10.0pt;
font-family:"Courier New";}
p.msonormal0, li.msonormal0, div.msonormal0
{mso-style-name:msonormal;
mso-margin-top-alt:auto;
margin-right:0in;
mso-margin-bottom-alt:auto;
margin-left:0in;
font-size:12.0pt;
font-family:"Times New Roman",serif;}
span.HTMLPreformattedChar
{mso-style-name:"HTML Preformatted Char";
mso-style-priority:99;
mso-style-link:"HTML Preformatted";
font-family:Consolas;}
span.EmailStyle22
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#4472C4">Hello Dennis,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#4472C4"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#4472C4">I wanted to give you and ncl community an update about the solution that you kindly offered for ESMF error that I was getting. I wanted to test the suggestion
before suddenly jumping into a conclusion. Just like you said, ESMF regridding page mentions the solution
<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><b>SrcNetCDFType</b> / <b>DstNetCDFType</b> / <b>WgtNetCDFType</b> (default = "netcdf3") setting it to “netcdf4”<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#4472C4">which I tried but did not work. I also set<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><b>FileType = Large<o:p></o:p></b></p>
<p class="MsoNormal"><b><o:p> </o:p></b></p>
<p class="MsoNormal"><span style="color:#4472C4">along with these options. That didn’t help either. However, when I commented out Src, Dst and Wgt file type setting and leaving only FileType to large allowed me to generate the files that I needed. I am guessing
maybe the netcdf libraries that I have on our system is not compiled with netcdf4 option.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#4472C4"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="color:#4472C4">In any case, thank you for your suggestion. I can move on to the next task now. With regards,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#4472C4"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="color:#4472C4">Kemal.</span><span style="color:#4472C4"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#4472C4"><o:p> </o:p></span></p>
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">From:</span></b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> Dennis Shea <shea@ucar.edu>
<br>
<b>Sent:</b> Monday, May 20, 2019 11:27 AM<br>
<b>To:</b> Gurer, Kemal@ARB <kemal.gurer@arb.ca.gov><br>
<b>Cc:</b> ncl-talk@ucar.edu<br>
<b>Subject:</b> Re: [ncl-talk] ESMF<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div style="border:solid #9C6500 1.0pt;padding:2.0pt 2.0pt 2.0pt 2.0pt">
<p class="MsoNormal" style="line-height:12.0pt;background:#FFEB9C"><b><span style="font-size:10.0pt;font-family:"Calibri",sans-serif;color:#9C6500">CAUTION:</span></b><span style="font-size:10.0pt;font-family:"Calibri",sans-serif;color:black"> This email originated
from outside of the organization. Do not click links or open attachments unless you recognize the sender and know the content is safe.<o:p></o:p></span></p>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div>
<p class="MsoNormal">The error messages are not directly from NCL.<br>
Rather, they are from the Fortran-90 code used by the underlying ESMF software invoked by NCL.<br>
<br>
---<br>
20190519 172019.181 ERROR PET0 ESMF_IOScrip.<b>F90</b>:1322 <b>ESMF_OutputScripWeightFile
</b>netCDF Status Return Error<br>
20190519 172019.181 ERROR PET0 ESMF_RegridWeightGen.<b>F90</b>:1395 <b>
ESMF_RegridWeightGenFile </b>Failure - Internal subroutine call returned Error<o:p></o:p></p>
<div>
<p class="MsoNormal">---<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">I <b>*speculate*</b> that the weight file may exceed a size limit.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"><a href="https://nam03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.ncl.ucar.edu%2FDocument%2FFunctions%2FESMF%2FESMF_regrid.shtml&data=02%7C01%7Ckemal.gurer%40arb.ca.gov%7C8ea54f8fde26468ae62308d6dd50cd01%7C9de5aaee778840b1a438c0ccc98c87cc%7C0%7C0%7C636939736453320284&sdata=h4sCX5l%2F7F34YjwHPgJ%2BemH%2FQ%2BYFEIJRTqbQ%2FdtUJF8%3D&reserved=0"><b>esmf_regrid</b></a><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">As noted in the function documentation:<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"><b>SrcNetCDFType</b> / <b>DstNetCDFType</b> / <b>WgtNetCDFType</b> (default = "netcdf3")
<o:p></o:p></p>
<p>Set these options or "NetCDFType" to "netcdf4" to force a NetCDF-4 file to be written for the source, destination, and/or weights files. This will be necessary if your source and/or destination grids or meshes are large, and require more than 2 GB to store
them and/or the weights file in the NetCDF file. Try:<o:p></o:p></p>
<p> opt@WgtFileName = "<a href="https://nam03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fweights.nc&data=02%7C01%7Ckemal.gurer%40arb.ca.gov%7C8ea54f8fde26468ae62308d6dd50cd01%7C9de5aaee778840b1a438c0ccc98c87cc%7C0%7C0%7C636939736453330281&sdata=d5xcguEGZcvehQ3OynkKV3zG5PZBNhSiuQM%2F5uEHNIk%3D&reserved=0">weights.nc</a>"<o:p></o:p></p>
<p> opt@<b>WgtNetCDFType</b> = "netcdf4" <b>; <=======</b><o:p></o:p></p>
<p>Good Luck<o:p></o:p></p>
<p><o:p> </o:p></p>
<p><o:p> </o:p></p>
<p><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">=== quote<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">The NetCDF files created by this function are written with "large file support" turned on. This creates a "64-bit offset" NetCDF file under the hood and allows you to write variables > 2 GB but less than 4 GB.
<o:p></o:p></p>
<p>If you are working with large data files that require more than 4 GB, you may need to set one or more of the
<a href="https://nam03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.ncl.ucar.edu%2FDocument%2FFunctions%2FESMF%2FESMF_regrid.shtml%23NetCDFType&data=02%7C01%7Ckemal.gurer%40arb.ca.gov%7C8ea54f8fde26468ae62308d6dd50cd01%7C9de5aaee778840b1a438c0ccc98c87cc%7C0%7C0%7C636939736453330281&sdata=68ADOjTrl64KJBExatI5izetUVubU5GdyXqOR2QQkZs%3D&reserved=0">
NetCDFType</a> options to "netcdf4". This will force a NetCDF4 file to be written under the hood and will allow you to write variables that are > 4 GB.<o:p></o:p></p>
<p>=== end quote<o:p></o:p></p>
<p><o:p> </o:p></p>
<p>Try <o:p></o:p></p>
</div>
<div>
<pre><strong><span style="font-family:"Courier New"">setfileoption</span></strong>("nc","Format","NetCDF4")<o:p></o:p></pre>
</div>
<p class="MsoNormal">prior to invoking the ESMF regrid function.<o:p></o:p></p>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div>
<p class="MsoNormal">On Mon, May 20, 2019 at 8:45 AM Gurer, Kemal@ARB <<a href="mailto:kemal.gurer@arb.ca.gov">kemal.gurer@arb.ca.gov</a>> wrote:<o:p></o:p></p>
</div>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in">
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Dear ncl community,<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">I can regrid unstructured MPAS output that has nearly 800,000 nCells and 55 vertical levels to a 0.1 degree resolution rectangular grid using ESMF, but cannot regrid the data for
any higher resolution than 0.1 degree such as 0.05 degree. Source and destination netcdf files are written but weights file is not generated with “<span style="font-size:10.5pt">ESMF_RegridWeightGenFile” error.
</span>I attached the ncl script that I use for regridding as well as PET0.*.log file and error output dumped to the screen to this email. I am running the script on Centos Linux 6.2 with 128 Gb of RAM. I am using ncl 6.4.0. What is the highest resolution that
I can regrid this data set to? Thank you for any information that you can give.<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Kemal.<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
</div>
</div>
<p class="MsoNormal">_______________________________________________<br>
ncl-talk mailing list<br>
<a href="mailto:ncl-talk@ucar.edu" target="_blank">ncl-talk@ucar.edu</a><br>
List instructions, subscriber options, unsubscribe:<br>
<a href="https://nam03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fmailman.ucar.edu%2Fmailman%2Flistinfo%2Fncl-talk&data=02%7C01%7Ckemal.gurer%40arb.ca.gov%7C8ea54f8fde26468ae62308d6dd50cd01%7C9de5aaee778840b1a438c0ccc98c87cc%7C0%7C0%7C636939736453340282&sdata=waErq8qe3wqQQua2eGtj3bPQwiZZVKMZjRghoSwwY%2B4%3D&reserved=0" target="_blank">http://mailman.ucar.edu/mailman/listinfo/ncl-talk</a><o:p></o:p></p>
</blockquote>
</div>
</div>
</div>
</body>
</html>