<div dir="ltr"><div>Dennis,</div><div><br></div>I'm reupping this thread to see if any progress has been made. After setting Opt@NetCDFType = "netcdf4" I tried to generate a SCRIP for a global 30 sec grid using rectilinear_to_SCRIP. I had ran it on casper with 350GB memory. It generates an 18GB scrip file after about an hour, and then the file size doesn't change for the remaining 5 hours until my wall time ran out. The resulting scrip file doesn't contain any valid values.<br><div><br></div><div>I will continue to use linint2_Wrap for this specific case.</div><div><br></div><div>Adam</div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Tue, Oct 2, 2018 at 9:22 AM Mary Haley <<a href="mailto:haley@ucar.edu">haley@ucar.edu</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">There's an option to ESMF_regrid that allows you to set the NetCDF type:<br><br> Opt@NetCDFType = "netcdf4"<div class="gmail_default" style="font-size:small"><br></div><div class="gmail_default" style="font-size:small">I am unable to test this on cheyenne since it is down at the moment, but this should force all output files to use NetCDF-4, hence allowing for large variables.</div><div class="gmail_default" style="font-size:small"><br></div><div class="gmail_default" style="font-size:small">--Mary</div><div class="gmail_default" style="font-size:small"><br></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Sun, Sep 23, 2018 at 10:31 PM, Dennis Shea <span dir="ltr"><<a href="mailto:shea@ucar.edu" target="_blank">shea@ucar.edu</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div>Hi Sarah</div><div><br></div><div><span style="color:rgb(255,0,0)"><b>The Bad:</b></span><br></div><div>I think there is an issue with the ESMF regridding. I do not understand it. I may have to open a JIRA ticket.</div><div><br></div><div><span style="color:rgb(0,0,255)"><b>The Good:</b></span></div><div>I used<b> <a href="http://www.ncl.ucar.edu/Document/Functions/Contributed/linint2_Wrap.shtml" target="_blank">linint2_Wrap</a> </b>to create the high resolution netCDF4_Classic file. For a 21600 x 43200 grid, linint2_Wrap is VERY slow. However, The values are likely the same or very close to ESMF bilinear regridding. <br></div><div><br></div><div><b>/glade/work/shea/TEST/SARAH/LININT2/<a href="http://LININT2_HTOPO.USGS-huy3-S1D_21_30sec.nc" target="_blank">LININT2_HTOPO.USGS-huy3-S1D_21_30sec.nc</a></b><br></div><div><br></div><div>More later</div><span><font color="#888888"><div>D<br></div></font></span></div></div></div><br><div class="gmail_quote"><div><div><div dir="ltr">On Thu, Sep 20, 2018 at 8:37 AM Sarah Bradley - CITG <<a href="mailto:S.L.Bradley-1@tudelft.nl" target="_blank">S.L.Bradley-1@tudelft.nl</a>> wrote:<br></div></div></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div><div>
<div>
<div style="overflow-wrap: break-word;">Hello
<div><br>
</div>
<div>I am trying to map a 10min global file to a 30 sec grid using the ESMF mapping software</div>
<div><br>
</div>
<div>I have attached my ncl script</div>
<div><br>
</div>
<div>The error message I receive is: </div>
<div><br>
</div>
<div>
<div style="margin:0px;font-size:16px;line-height:normal;font-family:Courier;background-color:rgb(255,255,255)">
<span>Copyright (C) 1995-2017 - All Rights Reserved</span></div>
<div style="margin:0px;font-size:16px;line-height:normal;font-family:Courier;background-color:rgb(255,255,255)">
<span> University Corporation for Atmospheric Research</span></div>
<div style="margin:0px;font-size:16px;line-height:normal;font-family:Courier;background-color:rgb(255,255,255)">
<span> NCAR Command Language Version 6.4.0</span></div>
<div style="margin:0px;font-size:16px;line-height:normal;font-family:Courier;background-color:rgb(255,255,255)">
<span> The use of this software is governed by a License Agreement.</span></div>
<div style="margin:0px;font-size:16px;line-height:normal;font-family:Courier;background-color:rgb(255,255,255)">
<span> See <a href="http://www.ncl.ucar.edu/" target="_blank">http://www.ncl.ucar.edu/</a> for more details.</span></div>
<div style="margin:0px;font-size:16px;line-height:normal;font-family:Courier;background-color:rgb(255,255,255)">
<span>(0)<span style="white-space:pre-wrap">
</span>=====> CPU Elapsed Time: rectilinear_to_SCRIP: 1.408 seconds <=====</span></div>
<div style="margin:0px;font-size:16px;line-height:normal;font-family:Courier;background-color:rgb(255,255,255)">
<span>ncendef: ncid 196608: NetCDF: One or more variable sizes violate format constraints</span></div>
<div style="margin:0px;font-size:16px;line-height:normal;font-family:Courier;background-color:rgb(255,255,255)">
<span>fatal:NetCDF: Operation not allowed in define mode: error attempting to write variable (grid_dims) to file (<a href="http://destination_grid_file.nc" target="_blank">destination_grid_file.nc</a>)</span></div>
<div style="margin:0px;font-size:16px;line-height:normal;font-family:Courier;background-color:rgb(255,255,255)">
<span>fatal:["Execute.c":8640]:Execute: Error occurred at or near line 1711 in file $NCARG_ROOT/lib/ncarg/nclscripts/esmf/ESMF_regridding.ncl</span></div>
<div style="margin:0px;font-size:16px;line-height:normal;font-family:Courier;background-color:rgb(255,255,255);min-height:19px">
<span></span><br>
</div>
<div style="margin:0px;font-size:16px;line-height:normal;font-family:Courier;background-color:rgb(255,255,255)">
<span>fatal:["Execute.c":8640]:Execute: Error occurred at or near line 1847 in file $NCARG_ROOT/lib/ncarg/nclscripts/esmf/ESMF_regridding.ncl</span></div>
<div style="margin:0px;font-size:16px;line-height:normal;font-family:Courier;background-color:rgb(255,255,255);min-height:19px">
<span></span><br>
</div>
<div style="margin:0px;font-size:16px;line-height:normal;font-family:Courier;background-color:rgb(255,255,255)">
<span>fatal:["Execute.c":8640]:Execute: Error occurred at or near line 3910 in file $NCARG_ROOT/lib/ncarg/nclscripts/esmf/ESMF_regridding.ncl</span></div>
<div style="margin:0px;font-size:16px;line-height:normal;font-family:Courier;background-color:rgb(255,255,255);min-height:19px">
<span></span><br>
</div>
<div style="margin:0px;font-size:16px;line-height:normal;font-family:Courier;background-color:rgb(255,255,255)">
<span>fatal:["Execute.c":8640]:Execute: Error occurred at or near line 4051 in file $NCARG_ROOT/lib/ncarg/nclscripts/esmf/ESMF_regridding.ncl</span></div>
<div style="margin:0px;font-size:16px;line-height:normal;font-family:Courier;background-color:rgb(255,255,255);min-height:19px">
<span></span><br>
</div>
<div style="margin:0px;font-size:16px;line-height:normal;font-family:Courier;background-color:rgb(255,255,255)">
<span>fatal:["Execute.c":8640]:Execute: Error occurred at or near line 90 in file remap_10min-30sec_ESMF.ncl</span></div>
</div>
<div><span><br>
</span></div>
<div><span>I found that as the 30sec file was large, I needed to specify this in the script.</span></div>
<div><span><br>
</span></div>
<div><span>I hope you can help,</span></div>
<div><span><br>
</span></div>
<div>Sarah Bradley </div>
<div><br>
</div>
<div></div>
</div>
<div style="overflow-wrap: break-word;">
<div></div>
</div>
</div></div></div><span>
_______________________________________________<br>
ncl-talk mailing list<br>
<a href="mailto:ncl-talk@ucar.edu" target="_blank">ncl-talk@ucar.edu</a><br>
List instructions, subscriber options, unsubscribe:<br>
<a href="http://mailman.ucar.edu/mailman/listinfo/ncl-talk" rel="noreferrer" target="_blank">http://mailman.ucar.edu/mailman/listinfo/ncl-talk</a><br>
</span></blockquote></div>
<br>_______________________________________________<br>
ncl-talk mailing list<br>
<a href="mailto:ncl-talk@ucar.edu" target="_blank">ncl-talk@ucar.edu</a><br>
List instructions, subscriber options, unsubscribe:<br>
<a href="http://mailman.ucar.edu/mailman/listinfo/ncl-talk" rel="noreferrer" target="_blank">http://mailman.ucar.edu/mailman/listinfo/ncl-talk</a><br>
<br></blockquote></div><br></div>
_______________________________________________<br>
ncl-talk mailing list<br>
<a href="mailto:ncl-talk@ucar.edu" target="_blank">ncl-talk@ucar.edu</a><br>
List instructions, subscriber options, unsubscribe:<br>
<a href="http://mailman.ucar.edu/mailman/listinfo/ncl-talk" rel="noreferrer" target="_blank">http://mailman.ucar.edu/mailman/listinfo/ncl-talk</a><br>
</blockquote></div>