<div dir="ltr">Hi there,<div>I am using the ESMF tools to regrid a bunch of wrf-grid files to rectangular grid. I am running each month independently (running the script in 12 independent batches, where each batch corresponds to a month) but the days in a given month are done serially in that loop. My steps, as a quick summary, are:</div><div>(1) generate the weights once, valid for all variables for all files for the year. Then, for each of 365 daily temperature and radiation files:</div><div>(2) extract the daily T2 (Kelvin), SWDOWN variables which I previously defined as a 3D array (XDim,YDim,23)</div><div>(3) apply the weights to hourly T2, SWDOWN output for a year. This step involves a loop ... and the relevant part includes:</div><div>do hh=0,23</div><blockquote style="margin:0px 0px 0px 40px;border:none;padding:0px"><div>T2_regrid = ESMF_regrid_with_weights(T2,wgt_file_name,Opt)</div></blockquote><blockquote style="margin:0px 0px 0px 40px;border:none;padding:0px"><div>SWDOWN_regrid = ESMF_regrid_with_weights(SWDOWN,wgt_file_name,Opt)</div><div>T2_array(:,:,hh) = T2_regrid</div></blockquote><blockquote style="margin:0px 0px 0px 40px;border:none;padding:0px"><div>SWDOWN_array(:,:,hh) = SWDOWN_regrid</div></blockquote><blockquote style="margin:0px 0px 0px 40px;border:none;padding:0px"><div>; I also have it print out min max for each variable for each hour regridded</div></blockquote><blockquote style="margin:0px 0px 0px 40px;border:none;padding:0px"><div>end do</div></blockquote><div>(4) Write out the two regridded arrays to a daily netcdf file using method 1, Netcdf4, with file compression level set to 4</div><div><br></div><div>The problem: The script fails toward the end (e.g, around the 27th file of a month) with the following error message and begins to input nonsense Temperature and radiation values into the array and states the weights file cannot be opened (it does exist). When I re-run the failed time-period as a one-time regridding, it regrids just fine. Is ncl unhappy because of the high I/O? It doesn't fail at the netcdf generation step ... it seems to fail at the regridding step itself. Thanks for any help! The error output follows ... </div><div><br></div><div><div>Variable: hh</div><div>Type: integer</div><div>Total Size: 4 bytes</div><div> 1 values</div><div>Number of Dimensions: 1</div><div>Dimensions and sizes: [1]</div><div>Coordinates:</div><div>(0) 15</div><div>fatal:["NclNewHDF5.c":3787]:NclNewHDF5.c: Cannot open file: </n/regal/wofsy_lab/adayalu/<a href="http://T2SWDOWN_to_MODIS_bilinear.faster.nc">T2SWDOWN_to_MODIS_bilinear.faster.nc</a>></div><div>fatal:["NclAdvancedFile.c":2667]:_NclFileFillHLFS: Could not open (/n/regal/wofsy_lab/adayalu/<a href="http://T2SWDOWN_to_MODIS_bilinear.faster.nc">T2SWDOWN_to_MODIS_bilinear.faster.nc</a>)</div><div>(0) ESMF_regrid_with_weights: cannot open weight file '/n/regal/wofsy_lab/adayalu/<a href="http://T2SWDOWN_to_MODIS_bilinear.faster.nc">T2SWDOWN_to_MODIS_bilinear.faster.nc</a>'.</div><div>(0)</div><div>(0) TEMP at 2 M: min=239.284 max=299.333</div><div>(0)</div><div>(0) min=9.96921e+36 max=9.96921e+36</div><div>warning:VarVarWrite: rhs has no dimension name or coordinate variable, deleting name of lhs dimension number (0) and destroying coordinate var, use "(/../)" if this is not desired outcome</div><div>warning:VarVarWrite: rhs has no dimension name or coordinate variable, deleting name of lhs dimension number (1) and destroying coordinate var, use "(/../)" if this is not desired outcome</div><div>warning:["Execute.c":8578]:Execute: Error occurred at or near line 64 in file regrid_using_weights_T2SWDOWN_MOD_noplots.ncl</div><div><br></div><div>HDF5-DIAG: Error detected in HDF5 (1.8.13) thread 0:</div></div><div><div> #000: H5D.c line 461 in H5Dget_space(): not a dataset</div><div> major: Invalid arguments to routine</div><div> minor: Inappropriate type</div></div><div>(...then a series of similar error messages are output .... and then it continues .... and nonsense is output):</div><div><br></div><div><div>Variable: hh</div><div>Type: integer</div><div>Total Size: 4 bytes</div><div> 1 values</div><div>Number of Dimensions: 1</div><div>Dimensions and sizes: [1]</div><div>Coordinates:</div><div>(0) 17</div><div>(0)</div><div>(0) TEMP at 2 M: min=0.0114805 max=299.333</div><div>(0)</div><div>(0) DOWNWARD SHORT WAVE FLUX AT GROUND SURFACE: min=0 max=2.90338e-31</div></div><div><br></div><div><div><div class="gmail_signature"> </div>
</div></div></div>