[ncl-talk] Error: ESMF to map 10min to 30 sec

[Adam Herrington]

Dennis,

I'm reupping this thread to see if any progress has been made. After
setting Opt at NetCDFType = "netcdf4" I tried to generate a SCRIP for a global
30 sec grid using rectilinear_to_SCRIP. I had ran it on casper with 350GB
memory. It generates an 18GB scrip file after about an hour, and then the
file size doesn't change for the remaining 5 hours until my wall time ran
out. The resulting scrip file doesn't contain any valid values.

I will continue to use linint2_Wrap for this specific case.

Adam

On Tue, Oct 2, 2018 at 9:22 AM Mary Haley <haley at ucar.edu> wrote:

> There's an option to ESMF_regrid that allows you to set the NetCDF type:
>
>     Opt at NetCDFType        = "netcdf4"
>
> I am unable to test this on cheyenne since it is down at the moment, but
> this should force all output files to use NetCDF-4, hence allowing for
> large variables.
>
> --Mary
>
>
> On Sun, Sep 23, 2018 at 10:31 PM, Dennis Shea <shea at ucar.edu> wrote:
>
>> Hi Sarah
>>
>> *The Bad:*
>> I think there is an issue with the ESMF regridding. I do not understand
>> it. I may have to open a JIRA ticket.
>>
>> *The Good:*
>> I used* linint2_Wrap
>> <http://www.ncl.ucar.edu/Document/Functions/Contributed/linint2_Wrap.shtml>
>> *to create the high resolution netCDF4_Classic file. For a 21600 x 43200
>> grid, linint2_Wrap is VERY slow. However, The values are likely the same or
>> very close to ESMF bilinear regridding.
>>
>> */glade/work/shea/TEST/SARAH/LININT2/LININT2_HTOPO.USGS-huy3-S1D_21_30sec.nc
>> <http://LININT2_HTOPO.USGS-huy3-S1D_21_30sec.nc>*
>>
>> More later
>> D
>>
>> On Thu, Sep 20, 2018 at 8:37 AM Sarah Bradley - CITG <
>> S.L.Bradley-1 at tudelft.nl> wrote:
>>
>>> Hello
>>>
>>> I am trying to map a 10min global file to a 30 sec grid using the ESMF
>>> mapping software
>>>
>>> I have attached my ncl script
>>>
>>> The error message I receive is:
>>>
>>> Copyright (C) 1995-2017 - All Rights Reserved
>>>  University Corporation for Atmospheric Research
>>>  NCAR Command Language Version 6.4.0
>>>  The use of this software is governed by a License Agreement.
>>>  See http://www.ncl.ucar.edu/ for more details.
>>> (0) =====> CPU Elapsed Time: rectilinear_to_SCRIP: 1.408 seconds <=====
>>> ncendef: ncid 196608: NetCDF: One or more variable sizes violate format
>>> constraints
>>> fatal:NetCDF: Operation not allowed in define mode: error attempting to
>>> write variable (grid_dims) to file (destination_grid_file.nc)
>>> fatal:["Execute.c":8640]:Execute: Error occurred at or near line 1711 in
>>> file $NCARG_ROOT/lib/ncarg/nclscripts/esmf/ESMF_regridding.ncl
>>>
>>> fatal:["Execute.c":8640]:Execute: Error occurred at or near line 1847 in
>>> file $NCARG_ROOT/lib/ncarg/nclscripts/esmf/ESMF_regridding.ncl
>>>
>>> fatal:["Execute.c":8640]:Execute: Error occurred at or near line 3910 in
>>> file $NCARG_ROOT/lib/ncarg/nclscripts/esmf/ESMF_regridding.ncl
>>>
>>> fatal:["Execute.c":8640]:Execute: Error occurred at or near line 4051 in
>>> file $NCARG_ROOT/lib/ncarg/nclscripts/esmf/ESMF_regridding.ncl
>>>
>>> fatal:["Execute.c":8640]:Execute: Error occurred at or near line 90 in
>>> file remap_10min-30sec_ESMF.ncl
>>>
>>> I found that as the 30sec file was large, I needed to specify this in
>>> the script.
>>>
>>> I hope you can help,
>>>
>>> Sarah Bradley
>>>
>>> _______________________________________________
>>> ncl-talk mailing list
>>> ncl-talk at ucar.edu
>>> List instructions, subscriber options, unsubscribe:
>>> http://mailman.ucar.edu/mailman/listinfo/ncl-talk
>>>
>>
>> _______________________________________________
>> ncl-talk mailing list
>> ncl-talk at ucar.edu
>> List instructions, subscriber options, unsubscribe:
>> http://mailman.ucar.edu/mailman/listinfo/ncl-talk
>>
>>
> _______________________________________________
> ncl-talk mailing list
> ncl-talk at ucar.edu
> List instructions, subscriber options, unsubscribe:
> http://mailman.ucar.edu/mailman/listinfo/ncl-talk
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://mailman.ucar.edu/pipermail/ncl-talk/attachments/20200702/326456e0/attachment.html>