<div dir="ltr">Hi Tim & NCL-talk,<div><br></div><div>Just wondering if this issue with GOES-16 data was ever resolved. I was having similar memory issues today when trying to load up and plot GOES-16 channel 2 visible imagery (full disk). </div><div><br></div><div>The issue does not appear to be with loading the data originally within an ncl script, but rather when you call the goesYXtoLatLon.ncl function (as seen in in example 6 here: <a href="https://www.ncl.ucar.edu/Applications/goes.shtml" target="_blank">https://www.ncl.ucar.edu/Applications/goes.shtml</a>), in which the memory blows up to unsustainable proportions in order to create the 2d lat/lon coordinates for the GOES-16 array.</div><div><br></div><div>I was finally able to get things working, but had to end up going into goesYXtoLatLon.ncl and deleting a lot of variables right away after they were used. Having too many <span style="font-variant-ligatures:no-common-ligatures"><font face="arial, helvetica, sans-serif">[21696] x [21696] arrays in the function was causing a major memory crunch, so this is likely where the script failed if you ran out of allocated memory on the system you were running the ncl script on.</font></span></div><div><span style="font-variant-ligatures:no-common-ligatures"><font face="arial, helvetica, sans-serif"><br></font></span></div><div><span style="font-variant-ligatures:no-common-ligatures"><font face="arial, helvetica, sans-serif">Ultimately, the best solution might be to only run </font></span>goesYXtoLatLon.ncl once and save its output into a seperate netCDF file, then rerun the master script with this new netCDF file of lat/lon information. That will probably save time & memory.</div><div><br></div><div>Cheers,</div><div>-Philippe</div>
<div><br></div><div><br></div><div> </div></div><br><div class="gmail_quote"><div dir="ltr">On Sat, Jan 20, 2018 at 3:23 AM Tim Risner via ncl-talk <<a href="mailto:ncl-talk@ucar.edu" target="_blank">ncl-talk@ucar.edu</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">No worries Rick, I appreciate the extra sets of eyes on the issue. <div><br></div><div>GOES16 data is stored in publicly accessible s3 buckets in the Amazon cloud, with time relative file names. </div><div>It's a bit difficult to scour, then pull the data, but given our move to the Amazon cloud, I've been able to build a pretty simple data pull. </div><div><br></div><div>Here are 2 links to 2 separate files that are GOES16 images from this morning. </div><div>1st is the CONUS file that is used in the original working ncl code: </div><div><a href="https://s3.amazonaws.com/noaa-goes16/ABI-L2-MCMIPC/2018/020/11/OR_ABI-L2-MCMIPC-M3_G16_s20180201102199_e20180201104572_c20180201105079.nc" target="_blank">https://s3.amazonaws.com/noaa-goes16/ABI-L2-MCMIPC/2018/020/11/OR_ABI-L2-MCMIPC-M3_G16_s20180201102199_e20180201104572_c20180201105079.nc</a><br></div><div>Hit the link and the netcdf file will download.</div><div>The above link, paired with the attached NCL code, originally created by you guys and tweaked by me, gets you the attached image. (needs more work and cleaning up, but a workable image for sure.)</div><div><br></div><div>2nd, here is the "Full Disk" file link of nearly the same time. <br>The file is supposed to contain the same variables and info, just cover more area.</div><div><a href="https://s3.amazonaws.com/noaa-goes16/ABI-L2-MCMIPF/2018/020/11/OR_ABI-L2-MCMIPF-M3_G16_s20180201100391_e20180201111164_c20180201111254.nc" target="_blank">https://s3.amazonaws.com/noaa-goes16/ABI-L2-MCMIPF/2018/020/11/OR_ABI-L2-MCMIPF-M3_G16_s20180201100391_e20180201111164_c20180201111254.nc</a><br></div><div>This file is popping the </div><div><div>fatal:NclMalloc Failed:[errno=12]</div><div>Segmentation fault</div></div><div>error. </div><div><br></div><div><br></div><div>I'm thinking the fix would be to only use those lat/lon values from the "FULL DISK" file that we need. These values are known and set in the .nc file.</div><div>In the attached example as: </div><div><div> res@mpMinLatF = 1.0</div><div> res@mpMaxLatF = 37.0</div><div> res@mpMinLonF = -87.5</div><div> res@mpMaxLonF = -22.5</div></div><div>After a few days of trying, I'm at a loss as to how to use these boundaries in the goesYX.ncl file when pulling the data and converting to lat/lon. </div><div><br></div><div><br></div><div><br></div><div><br></div></div><div class="gmail_extra"><br clear="all"><div><div class="m_264584832147742381m_-5164438127596153871m_3027253908317334715gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div><font size="4"><b><span style="font-family:georgia,serif"><span></span><span></span><br>Tim Risner</span></b></font><br></div><i>Operational Meteorologist</i><br> </div><span><i>(888) 798-9955 ext 1006</i><br><br></span><div><a href="http://www.awis.com" target="_blank"><img alt="" src="https://pbs.twimg.com/profile_images/524275730171969536/n2Ev5bg8.jpeg" height="47" width="47"></a><a href="https://www.facebook.com/AWISWeatherServices/" target="_blank"><img alt="https://www.facebook.com/AWISWeatherServices/" src="https://upload.wikimedia.org/wikipedia/commons/thumb/1/1b/Facebook_icon.svg/2000px-Facebook_icon.svg.png" height="47" width="47"></a><a href="https://twitter.com/awisweather" target="_blank"><span><img src="https://lh3.ggpht.com/lSLM0xhCA1RZOwaQcjhlwmsvaIQYaP3c5qbDKCgLALhydrgExnaSKZdGa8S3YtRuVA=w300" height="48" width="48"></span></a><br></div></div></div></div></div></div></div></div></div></div></div></div>
<br><div class="gmail_quote">On Fri, Jan 19, 2018 at 4:52 PM, Rick Brownrigg <span dir="ltr"><<a href="mailto:brownrig@ucar.edu" target="_blank">brownrig@ucar.edu</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div><div>Hi Tim,<br><br></div>Sorry to bug you, I've had a heck of time finding datasets for this satellite (presumably because its still in calibration/testing mode) -- I can find all manner of information and preprocessed imagery, but actual netcdf files -- very frustrating. Can I ask where you are getting your data from?<span class="m_264584832147742381m_-5164438127596153871m_3027253908317334715HOEnZb"><font color="#888888"><br><br></font></span></div><span class="m_264584832147742381m_-5164438127596153871m_3027253908317334715HOEnZb"><font color="#888888">Rick<br></font></span></div><div class="m_264584832147742381m_-5164438127596153871m_3027253908317334715HOEnZb"><div class="m_264584832147742381m_-5164438127596153871m_3027253908317334715h5"><div class="gmail_extra"><br><div class="gmail_quote">On Fri, Jan 19, 2018 at 3:16 PM, Tim Risner <span dir="ltr"><<a href="mailto:trisner@awis.com" target="_blank">trisner@awis.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="auto"><div></div><div>I’m attempting to use the same code that is previously mentioned to map regions that are outside the CONUS, which requires the “Full Disk” set of files, versus the “CONUS” files that are working.</div><div>Variables and files are the same, of course the area is bigger, therefore the variables are much larger. </div><div><br></div><div>I deleted all variables in the code once they were no longer needed and have been mulling the code over for a few days now, but can’t seem to find a solution to clean the memory sufficiently.</div><div><br></div><div>One solution would be to only use the portion of the file I need (i.e. only the western Atlantic ocean), but I can’t seem to only strip that section of the file/variable.</div><div><div class="m_264584832147742381m_-5164438127596153871m_3027253908317334715m_-4543018720946290714h5"><div><br></div><div><br></div><div><br>On Jan 19, 2018, at 16:04, Rick Brownrigg <<a href="mailto:brownrig@ucar.edu" target="_blank">brownrig@ucar.edu</a>> wrote:<br><br></div><blockquote type="cite"><div><div dir="ltr"><div><div>Hi Tim,<br><br></div>Those are big variables, but not that big. Are you trying to read in large numbers of them?<br><br></div>Rick<br><br></div><div class="gmail_extra"><br><div class="gmail_quote">On Fri, Jan 19, 2018 at 1:54 PM, Tim Risner <span dir="ltr"><<a href="mailto:trisner@awis.com" target="_blank">trisner@awis.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div style="word-wrap:break-word;line-break:after-white-space">Works great Mary, and you can easily pull the sat wavelength you need from it. <div>One issue I did run into was if you use the “Full Disk” files rather then the “CONUS” files used in the example, you get </div><div>what I expect to be a memory issue?</div><div><br></div><div>Error to screen</div><div>*******************</div><div>“fatal: NclMalloc Failed:[errno=12] Segmentation fault” error. </div><div><div><br></div><div><span style="font-variant-ligatures:no-common-ligatures"><br></span></div><div><span style="font-variant-ligatures:no-common-ligatures">info </span></div><div>******</div><div><span style="color:rgb(40,254,20);font-family:Monaco;font-size:15px;background-color:rgba(0,0,0,0.901961)">Variable: phi</span></div><div><div style="margin:0px;font-stretch:normal;font-size:15px;line-height:normal;font-family:Monaco;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">Type: double</span></div><div style="margin:0px;font-stretch:normal;font-size:15px;line-height:normal;font-family:Monaco;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">Total Size: 235358208 bytes</span></div><div style="margin:0px;font-stretch:normal;font-size:15px;line-height:normal;font-family:Monaco;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures"> 29419776 values</span></div><div style="margin:0px;font-stretch:normal;font-size:15px;line-height:normal;font-family:Monaco;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">Number of Dimensions: 2</span></div><div style="margin:0px;font-stretch:normal;font-size:15px;line-height:normal;font-family:Monaco;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">Dimensions and sizes:<span class="m_264584832147742381m_-5164438127596153871m_3027253908317334715m_-4543018720946290714m_2448628806384835149m_-7443692695753237652Apple-tab-span" style="white-space:pre-wrap"> </span>[5424] x [5424]</span></div><div style="margin:0px;font-stretch:normal;font-size:15px;line-height:normal;font-family:Monaco;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">Coordinates: </span></div><div style="margin:0px;font-stretch:normal;font-size:15px;line-height:normal;font-family:Monaco;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">Number Of Attributes: 1</span></div><div style="margin:0px;font-stretch:normal;font-size:15px;line-height:normal;font-family:Monaco;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures"> _FillValue :<span class="m_264584832147742381m_-5164438127596153871m_3027253908317334715m_-4543018720946290714m_2448628806384835149m_-7443692695753237652Apple-tab-span" style="white-space:pre-wrap"> </span>-999</span></div><div style="margin:0px;font-stretch:normal;font-size:15px;line-height:normal;font-family:Monaco;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961);min-height:20px"><span style="font-variant-ligatures:no-common-ligatures"></span><br></div><div style="margin:0px;font-stretch:normal;font-size:15px;line-height:normal;font-family:Monaco;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">Variable: lambda</span></div><div style="margin:0px;font-stretch:normal;font-size:15px;line-height:normal;font-family:Monaco;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">Type: double</span></div><div style="margin:0px;font-stretch:normal;font-size:15px;line-height:normal;font-family:Monaco;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">Total Size: 235358208 bytes</span></div><div style="margin:0px;font-stretch:normal;font-size:15px;line-height:normal;font-family:Monaco;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures"> 29419776 values</span></div><div style="margin:0px;font-stretch:normal;font-size:15px;line-height:normal;font-family:Monaco;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">Number of Dimensions: 2</span></div><div style="margin:0px;font-stretch:normal;font-size:15px;line-height:normal;font-family:Monaco;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">Dimensions and sizes:<span class="m_264584832147742381m_-5164438127596153871m_3027253908317334715m_-4543018720946290714m_2448628806384835149m_-7443692695753237652Apple-tab-span" style="white-space:pre-wrap"> </span>[5424] x [5424]</span></div><div style="margin:0px;font-stretch:normal;font-size:15px;line-height:normal;font-family:Monaco;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">Coordinates: </span></div><div style="margin:0px;font-stretch:normal;font-size:15px;line-height:normal;font-family:Monaco;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">Number Of Attributes: 1</span></div><div style="margin:0px;font-stretch:normal;font-size:15px;line-height:normal;font-family:Monaco;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures"> _FillValue :<span class="m_264584832147742381m_-5164438127596153871m_3027253908317334715m_-4543018720946290714m_2448628806384835149m_-7443692695753237652Apple-tab-span" style="white-space:pre-wrap"> </span>-999</span></div><div style="margin:0px;font-stretch:normal;font-size:15px;line-height:normal;font-family:Monaco;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961);min-height:20px"><span style="font-variant-ligatures:no-common-ligatures"></span><br></div><div style="margin:0px;font-stretch:normal;font-size:15px;line-height:normal;font-family:Monaco;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">Variable: data</span></div><div style="margin:0px;font-stretch:normal;font-size:15px;line-height:normal;font-family:Monaco;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">Type: float</span></div><div style="margin:0px;font-stretch:normal;font-size:15px;line-height:normal;font-family:Monaco;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">Total Size: 117679104 bytes</span></div><div style="margin:0px;font-stretch:normal;font-size:15px;line-height:normal;font-family:Monaco;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures"> 29419776 values</span></div><div style="margin:0px;font-stretch:normal;font-size:15px;line-height:normal;font-family:Monaco;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">Number of Dimensions: 2</span></div><div style="margin:0px;font-stretch:normal;font-size:15px;line-height:normal;font-family:Monaco;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">Dimensions and sizes:<span class="m_264584832147742381m_-5164438127596153871m_3027253908317334715m_-4543018720946290714m_2448628806384835149m_-7443692695753237652Apple-tab-span" style="white-space:pre-wrap"> </span>[y | 5424] x [x | 5424]</span></div><div style="margin:0px;font-stretch:normal;font-size:15px;line-height:normal;font-family:Monaco;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">Coordinates: </span></div><div style="margin:0px;font-stretch:normal;font-size:15px;line-height:normal;font-family:Monaco;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures"> y: [0..5423]</span></div><div style="margin:0px;font-stretch:normal;font-size:15px;line-height:normal;font-family:Monaco;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures"> x: [0..5423]</span></div><div style="margin:0px;font-stretch:normal;font-size:15px;line-height:normal;font-family:Monaco;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures">Number Of Attributes: 16</span></div><div style="margin:0px;font-stretch:normal;font-size:15px;line-height:normal;font-family:Monaco;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures"> lon2d :<span class="m_264584832147742381m_-5164438127596153871m_3027253908317334715m_-4543018720946290714m_2448628806384835149m_-7443692695753237652Apple-tab-span" style="white-space:pre-wrap"> </span><ARRAY of 29419776 elements></span></div><div style="margin:0px;font-stretch:normal;font-size:15px;line-height:normal;font-family:Monaco;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures"> lat2d :<span class="m_264584832147742381m_-5164438127596153871m_3027253908317334715m_-4543018720946290714m_2448628806384835149m_-7443692695753237652Apple-tab-span" style="white-space:pre-wrap"> </span><ARRAY of 29419776 elements></span></div><div style="margin:0px;font-stretch:normal;font-size:15px;line-height:normal;font-family:Monaco;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures"> long_name :<span class="m_264584832147742381m_-5164438127596153871m_3027253908317334715m_-4543018720946290714m_2448628806384835149m_-7443692695753237652Apple-tab-span" style="white-space:pre-wrap"> </span>ABI Cloud and Moisture Imagery reflectance factor</span></div><div style="margin:0px;font-stretch:normal;font-size:15px;line-height:normal;font-family:Monaco;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures"> standard_name :<span class="m_264584832147742381m_-5164438127596153871m_3027253908317334715m_-4543018720946290714m_2448628806384835149m_-7443692695753237652Apple-tab-span" style="white-space:pre-wrap"> </span>toa_lambertian_equivalent_albedo_multiplied_by_cosine_solar_zenith_angle</span></div><div style="margin:0px;font-stretch:normal;font-size:15px;line-height:normal;font-family:Monaco;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures"> _Unsigned :<span class="m_264584832147742381m_-5164438127596153871m_3027253908317334715m_-4543018720946290714m_2448628806384835149m_-7443692695753237652Apple-tab-span" style="white-space:pre-wrap"> </span>true</span></div><div style="margin:0px;font-stretch:normal;font-size:15px;line-height:normal;font-family:Monaco;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures"> sensor_band_bit_depth :<span class="m_264584832147742381m_-5164438127596153871m_3027253908317334715m_-4543018720946290714m_2448628806384835149m_-7443692695753237652Apple-tab-span" style="white-space:pre-wrap"> </span>12</span></div><div style="margin:0px;font-stretch:normal;font-size:15px;line-height:normal;font-family:Monaco;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures"> downsampling_method :<span class="m_264584832147742381m_-5164438127596153871m_3027253908317334715m_-4543018720946290714m_2448628806384835149m_-7443692695753237652Apple-tab-span" style="white-space:pre-wrap"> </span>average</span></div><div style="margin:0px;font-stretch:normal;font-size:15px;line-height:normal;font-family:Monaco;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures"> units :<span class="m_264584832147742381m_-5164438127596153871m_3027253908317334715m_-4543018720946290714m_2448628806384835149m_-7443692695753237652Apple-tab-span" style="white-space:pre-wrap"> </span>1</span></div><div style="margin:0px;font-stretch:normal;font-size:15px;line-height:normal;font-family:Monaco;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures"> resolution :<span class="m_264584832147742381m_-5164438127596153871m_3027253908317334715m_-4543018720946290714m_2448628806384835149m_-7443692695753237652Apple-tab-span" style="white-space:pre-wrap"> </span>y: 0.000056 rad x: 0.000056 rad</span></div><div style="margin:0px;font-stretch:normal;font-size:15px;line-height:normal;font-family:Monaco;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures"> coordinates :<span class="m_264584832147742381m_-5164438127596153871m_3027253908317334715m_-4543018720946290714m_2448628806384835149m_-7443692695753237652Apple-tab-span" style="white-space:pre-wrap"> </span>band_id_C02 band_wavelength_C02 t y x</span></div><div style="margin:0px;font-stretch:normal;font-size:15px;line-height:normal;font-family:Monaco;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures"> grid_mapping :<span class="m_264584832147742381m_-5164438127596153871m_3027253908317334715m_-4543018720946290714m_2448628806384835149m_-7443692695753237652Apple-tab-span" style="white-space:pre-wrap"> </span>goes_imager_projection</span></div><div style="margin:0px;font-stretch:normal;font-size:15px;line-height:normal;font-family:Monaco;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures"> cell_methods :<span class="m_264584832147742381m_-5164438127596153871m_3027253908317334715m_-4543018720946290714m_2448628806384835149m_-7443692695753237652Apple-tab-span" style="white-space:pre-wrap"> </span>t: point area: sum (interval: 0.000014 rad)</span></div><div style="margin:0px;font-stretch:normal;font-size:15px;line-height:normal;font-family:Monaco;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures"> ancillary_variables :<span class="m_264584832147742381m_-5164438127596153871m_3027253908317334715m_-4543018720946290714m_2448628806384835149m_-7443692695753237652Apple-tab-span" style="white-space:pre-wrap"> </span>DQF_C02</span></div><div style="margin:0px;font-stretch:normal;font-size:15px;line-height:normal;font-family:Monaco;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures"> _FillValue_original :<span class="m_264584832147742381m_-5164438127596153871m_3027253908317334715m_-4543018720946290714m_2448628806384835149m_-7443692695753237652Apple-tab-span" style="white-space:pre-wrap"> </span>-1</span></div><div style="margin:0px;font-stretch:normal;font-size:15px;line-height:normal;font-family:Monaco;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures"> _FillValue :<span class="m_264584832147742381m_-5164438127596153871m_3027253908317334715m_-4543018720946290714m_2448628806384835149m_-7443692695753237652Apple-tab-span" style="white-space:pre-wrap"> </span>-1</span></div><div style="margin:0px;font-stretch:normal;font-size:15px;line-height:normal;font-family:Monaco;color:rgb(40,254,20);background-color:rgba(0,0,0,0.901961)"><span style="font-variant-ligatures:no-common-ligatures"> valid_range :<span class="m_264584832147742381m_-5164438127596153871m_3027253908317334715m_-4543018720946290714m_2448628806384835149m_-7443692695753237652Apple-tab-span" style="white-space:pre-wrap"> </span>( 0, 1.299999 )</span></div></div><div><span style="font-variant-ligatures:no-common-ligatures"><br></span></div><div><span style="font-variant-ligatures:no-common-ligatures"><br></span></div><div><span style="font-variant-ligatures:no-common-ligatures"><br></span></div><div><span style="font-variant-ligatures:no-common-ligatures"><br></span></div><div><span style="font-variant-ligatures:no-common-ligatures"><br></span></div><div><blockquote type="cite"><div><div class="m_264584832147742381m_-5164438127596153871m_3027253908317334715m_-4543018720946290714m_2448628806384835149h5"><div>On Jan 11, 2018, at 6:07 PM, Mary Haley <<a href="mailto:haley@ucar.edu" target="_blank">haley@ucar.edu</a>> wrote:</div><br class="m_264584832147742381m_-5164438127596153871m_3027253908317334715m_-4543018720946290714m_2448628806384835149m_-7443692695753237652Apple-interchange-newline"></div></div><div><div><div class="m_264584832147742381m_-5164438127596153871m_3027253908317334715m_-4543018720946290714m_2448628806384835149h5"><div dir="ltr" style="font-family:Helvetica;font-size:12px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"><div class="gmail_default" style="font-size:small">Hi Tim,</div><div class="gmail_default" style="font-size:small"><br></div><div class="gmail_default" style="font-size:small">My apologies for getting back to you so late. We got side-tracked with another harder GOES16 issue (regridding a large GOES16 variable) and wanted to finish that up to make sure we were doing things correctly.</div><div class="gmail_default" style="font-size:small"><br></div><div class="gmail_default" style="font-size:small">Rick and Bill (members of the NCL development team) spent some time looking into documentation for GOES16 and figured out how to calculate the lat / lon values, given the Y / X coordinates and map projection information on the file. No sooner than this was done that the satellite was repositioned, and we had to tweak the calculations a little.</div><div class="gmail_default" style="font-size:small"><br></div><div class="gmail_default" style="font-size:small">I've attached the NCL scripts that Rick created, and the plot it generates. This script should work on the new GOES16 data as well.</div><div class="gmail_default" style="font-size:small"><br></div><div class="gmail_default" style="font-size:small">You need to run:</div><div class="gmail_default" style="font-size:small"><br></div><div class="gmail_default" style="font-size:small"> ncl plot_goes16.ncl</div><div class="gmail_default" style="font-size:small"><br></div><div class="gmail_default" style="font-size:small">The CMI_16 variable was arbitrarily chosen, but we did chose 16 over the other numbers because it was more interesting.</div><div class="gmail_default" style="font-size:small"><br></div><div class="gmail_default" style="font-size:small">I understand that there are different channels, and a better way to plot this data might be to overlay the different channels with different opacities set. I need to look into how another user did this, and I'll post back here if I ever get around to it.</div><div class="gmail_default" style="font-size:small"><br></div><div class="gmail_default" style="font-size:small">--Mary</div><div class="gmail_default" style="font-size:small"><br></div><div class="gmail_default" style="font-size:small"><br></div><div class="gmail_default" style="font-size:small"><br></div></div><div class="gmail_extra" style="font-family:Helvetica;font-size:12px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"><br><div class="gmail_quote">On Wed, Dec 13, 2017 at 1:02 PM, Tim Risner<span class="m_264584832147742381m_-5164438127596153871m_3027253908317334715m_-4543018720946290714m_2448628806384835149m_-7443692695753237652Apple-converted-space"> </span><span dir="ltr"><<a href="mailto:trisner@awis.com" target="_blank">trisner@awis.com</a>></span><span class="m_264584832147742381m_-5164438127596153871m_3027253908317334715m_-4543018720946290714m_2448628806384835149m_-7443692695753237652Apple-converted-space"> </span>wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-style:solid;border-left-color:rgb(204,204,204);padding-left:1ex"><div dir="ltr">thanks Rick, others. <div>version is 6.4.0</div><div>running on Linux Amazon EC2 instance. x86_64 x86_64 x86_64 GNU/Linux</div><div>testing GOES16 file attached. <br></div><div>I obtained such file from the Amazon AWS bucket system that is now publicly accessible by the gov't/Amazon.</div><div>Information on file lists it as a GOES16 netcdf file. </div><div><br></div><div>I assumed I could simply replace the file in the example for GOES 11 example here: <a href="http://www.ncl.ucar.edu/Applications/Scripts/goes_1.ncl" target="_blank">http://www.ncl.ucar.edu/Applications/Scripts/goes_1.ncl</a></div><div>and all would work if the files and datasets were exchangeable. </div><div>Assumptions are likely my problem. </div><div><br></div><div>Error output: </div><div><br></div><div><div>fatal:["Execute.c":132]:variable (data) is not in file (/var/NCL/INPUT/GOES16.nc)</div><div>fatal:["Execute.c":6381]:variable (data) is not in file (f)</div><div>fatal:["Execute.c":8640]:Execute: Error occurred at or near line 4 in file /var/NCL/CODE/<a href="http://testgoes.nc/" target="_blank">testgoes.nc</a></div></div><div><br></div><div><br></div></div><div class="gmail_extra"><span><br clear="all"><div><div class="m_264584832147742381m_-5164438127596153871m_3027253908317334715m_-4543018720946290714m_2448628806384835149m_-7443692695753237652m_5373839353271821591gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div><font size="4"><b><span style="font-family:georgia,serif"><span></span><span></span><br>Tim Risner</span></b></font><br></div><i>Operational Meteorologist</i><br></div><span><i><a href="tel:(888)%20798-9955" value="+18887989955" target="_blank">(888) 798-9955 ext 1006</a></i><br><br></span><div><a href="http://www.awis.com/" target="_blank"><img alt="" src="https://pbs.twimg.com/profile_images/524275730171969536/n2Ev5bg8.jpeg" width="47" height="47"></a><a href="https://www.facebook.com/AWISWeatherServices/" target="_blank"><img alt="https://www.facebook.com/AWISWeatherServices/" src="https://upload.wikimedia.org/wikipedia/commons/thumb/1/1b/Facebook_icon.svg/2000px-Facebook_icon.svg.png" width="47" height="47"></a><a href="https://twitter.com/awisweather" target="_blank"><span><img src="https://lh3.ggpht.com/lSLM0xhCA1RZOwaQcjhlwmsvaIQYaP3c5qbDKCgLALhydrgExnaSKZdGa8S3YtRuVA=w300" width="48" height="48"></span></a><br></div></div></div></div></div></div></div></div></div></div></div></div><br></span><div><div class="m_264584832147742381m_-5164438127596153871m_3027253908317334715m_-4543018720946290714m_2448628806384835149m_-7443692695753237652h5"><div class="gmail_quote">On Wed, Dec 13, 2017 at 9:02 AM, Rick Brownrigg<span class="m_264584832147742381m_-5164438127596153871m_3027253908317334715m_-4543018720946290714m_2448628806384835149m_-7443692695753237652Apple-converted-space"> </span><span dir="ltr"><<a href="mailto:brownrig@ucar.edu" target="_blank">brownrig@ucar.edu</a>></span><span class="m_264584832147742381m_-5164438127596153871m_3027253908317334715m_-4543018720946290714m_2448628806384835149m_-7443692695753237652Apple-converted-space"> </span>wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-style:solid;border-left-color:rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div><div><div><div>Hi Tim,<br><br></div>Do you have a dataset you could share? I download some data from this site:<br><br><a href="https://www.goes-r.gov/" target="_blank">https://www.goes-r.gov</a><br><br></div>but not knowing what I'm really looking for, I could not ascertain that it was specifically GOES16. NCL was able to read it.<br><br></div><div>I should also ask what version of NCL are you working with?<br></div><div><br></div>If your dataset is too large to email, you can post it to our FTP site:<br><br><a href="http://ncl.ucar.edu/ftp_files.shtml" target="_blank">http://ncl.ucar.edu/ftp_files.shtml</a><span class="m_264584832147742381m_-5164438127596153871m_3027253908317334715m_-4543018720946290714m_2448628806384835149m_-7443692695753237652m_5373839353271821591HOEnZb"><font color="#888888"><br><br></font></span></div><span class="m_264584832147742381m_-5164438127596153871m_3027253908317334715m_-4543018720946290714m_2448628806384835149m_-7443692695753237652m_5373839353271821591HOEnZb"><font color="#888888">Rick<br></font></span></div><div class="gmail_extra"><br><div class="gmail_quote"><div><div class="m_264584832147742381m_-5164438127596153871m_3027253908317334715m_-4543018720946290714m_2448628806384835149m_-7443692695753237652m_5373839353271821591h5">On Wed, Dec 13, 2017 at 7:35 AM, Tim Risner<span class="m_264584832147742381m_-5164438127596153871m_3027253908317334715m_-4543018720946290714m_2448628806384835149m_-7443692695753237652Apple-converted-space"> </span><span dir="ltr"><<a href="mailto:trisner@awis.com" target="_blank">trisner@awis.com</a>></span><span class="m_264584832147742381m_-5164438127596153871m_3027253908317334715m_-4543018720946290714m_2448628806384835149m_-7443692695753237652Apple-converted-space"> </span>wrote:<br></div></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-style:solid;border-left-color:rgb(204,204,204);padding-left:1ex"><div><div class="m_264584832147742381m_-5164438127596153871m_3027253908317334715m_-4543018720946290714m_2448628806384835149m_-7443692695753237652m_5373839353271821591h5"><div dir="ltr"><span style="font-size:12.8px">Hello All, </span><div style="font-size:12.8px">I am curious as to what the GOES16 netCDF plan is for NCL. </div><div style="font-size:12.8px">I've attempted to ingest the new GOES16 netCDF into generic GOES code found on the examples pages, but am getting a variables not found error when attempting to produce an image. Variable not found is "data". I assume this is due to the differences between the GOES16 netCDF files and the older GOES products? or is it just operator error and GOES16 netcdf files should work? <br><br>Thanks!!!</div><div><br></div><div><div class="m_264584832147742381m_-5164438127596153871m_3027253908317334715m_-4543018720946290714m_2448628806384835149m_-7443692695753237652m_5373839353271821591m_6293265420076554199m_-5623333301813600442gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div><font size="4"><b><span style="font-family:georgia,serif"><span></span><span></span><br>Tim Risner</span></b></font><br></div><i>Operational Meteorologist</i><br></div><span><i><a href="tel:(888)%20798-9955" value="+18887989955" target="_blank">(888) 798-9955 ext 1006</a></i><br><br></span><div><a href="http://www.awis.com/" target="_blank"><img alt="" src="https://pbs.twimg.com/profile_images/524275730171969536/n2Ev5bg8.jpeg" width="47" height="47"></a><a href="https://www.facebook.com/AWISWeatherServices/" target="_blank"><img alt="https://www.facebook.com/AWISWeatherServices/" src="https://upload.wikimedia.org/wikipedia/commons/thumb/1/1b/Facebook_icon.svg/2000px-Facebook_icon.svg.png" width="47" height="47"></a><a href="https://twitter.com/awisweather" target="_blank"><span><img src="https://lh3.ggpht.com/lSLM0xhCA1RZOwaQcjhlwmsvaIQYaP3c5qbDKCgLALhydrgExnaSKZdGa8S3YtRuVA=w300" width="48" height="48"></span></a><br></div></div></div></div></div></div></div></div></div></div></div></div></div><br></div></div><span>_______________________________________________<br>ncl-talk mailing list<br><a href="mailto:ncl-talk@ucar.edu" target="_blank">ncl-talk@ucar.edu</a><br>List instructions, subscriber options, unsubscribe:<br><a href="http://mailman.ucar.edu/mailman/listinfo/ncl-talk" rel="noreferrer" target="_blank">http://mailman.ucar.edu/mailman/listinfo/ncl-talk</a><br><br></span></blockquote></div><br></div></blockquote></div><br></div></div></div><br>_______________________________________________<br>ncl-talk mailing list<br><a href="mailto:ncl-talk@ucar.edu" target="_blank">ncl-talk@ucar.edu</a><br>List instructions, subscriber options, unsubscribe:<br><a href="http://mailman.ucar.edu/mailman/listinfo/ncl-talk" rel="noreferrer" target="_blank">http://mailman.ucar.edu/mailman/listinfo/ncl-talk</a><br><br></blockquote></div><br></div></div></div><span id="m_264584832147742381m_-5164438127596153871m_3027253908317334715m_-4543018720946290714m_2448628806384835149m_-7443692695753237652cid:1A6E7607-E623-4290-96E0-6D07E311C5C7"><goes16.png></span><span id="m_264584832147742381m_-5164438127596153871m_3027253908317334715m_-4543018720946290714m_2448628806384835149m_-7443692695753237652cid:F42C645E-CECA-43D2-8962-83F0F190ED50"><plot_goes16.ncl></span><span id="m_264584832147742381m_-5164438127596153871m_3027253908317334715m_-4543018720946290714m_2448628806384835149m_-7443692695753237652cid:0F688F15-C98F-4C4A-8624-B31555AE88D2"><goesYXtoLatLon.ncl></span></div></blockquote></div><br></div></div></blockquote></div><br></div>
</div></blockquote></div></div></div></blockquote></div><br></div>
</div></div></blockquote></div><br></div>
_______________________________________________<br>
ncl-talk mailing list<br>
<a href="mailto:ncl-talk@ucar.edu" target="_blank">ncl-talk@ucar.edu</a><br>
List instructions, subscriber options, unsubscribe:<br>
<a href="http://mailman.ucar.edu/mailman/listinfo/ncl-talk" rel="noreferrer" target="_blank">http://mailman.ucar.edu/mailman/listinfo/ncl-talk</a><br>
</blockquote></div><br clear="all"><div><br></div>-- <br><div dir="ltr" class="m_264584832147742381m_-5164438127596153871gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div>-------------------------------------</div><div><b>Philippe P. Papin, Ph.D.</b><br><div><div style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:13px">NRC Research Associate Postdoc</div><div style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:13px">Global Modeling Division</div><div style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:13px">Naval Research Laboratory - Monterey, CA </div></div></div><div><font color="#222222" face="arial, sans-serif"><a href="http://www.atmos.albany.edu/student/ppapin/" target="_blank">http://www.atmos.albany.edu/student/ppapin/</a></font></div></div></div></div></div></div>