<div dir="ltr">Thanks Kyle for this information. Indeed, yesterday I realized the problem is related to the transition into using final analysis in ERA5, so this problem occurs if one wants to incorporate the latest analysis data of the present year with re-analysis data of previous years. <div>Thanks for pointing this out. </div><div>Anne </div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, Feb 10, 2021 at 4:53 AM Kyle Griffin <<a href="mailto:windrunnerxc@gmail.com">windrunnerxc@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">Anne and all,<div><br></div><div>For more information about ERA5 'expver', please read over the ERA5 documentation. The page below is directly relevant and discusses how the "near-real-time" analysis transitions to the final analysis after a period of time. If you re-downloaded your data and did not see this variable, you likely had your time period of interest age out of the "tentative" analysis and into the final. </div><div><br></div><div><a href="https://confluence.ecmwf.int/pages/viewpage.action?pageId=173385064" target="_blank">https://confluence.ecmwf.int/pages/viewpage.action?pageId=173385064</a><br></div><div><br></div><div><br></div><div>Kyle</div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Tue, Feb 9, 2021 at 12:06 PM Dennis Shea via ncl-talk <<a href="mailto:ncl-talk@mailman.ucar.edu" target="_blank">ncl-talk@mailman.ucar.edu</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div>Hi Anne,</div><div>THX for the update and posting to ncl-talk. It is good information to have.</div><div>Stay Healthy</div><div>D<br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Tue, Feb 9, 2021 at 4:03 AM Anne Seidenglanz <<a href="mailto:annework985@gmail.com" target="_blank">annework985@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">The data has been closely examined. The problem was related to downloading ERA5 data, for some reason a dimension "expver" (presumably experiment version?) appeared in the variable. This dimension did not appear after a fresh download of the data (minor changes in the script but the exact reason remains obscure to me).<div>In any case, if someone happens to have problems plotting ERA5 data, pls check if the dimension "expver" appears, and if necessary re-download the data to end up with e.g. z(time, lev, lat, lon).</div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Mon, Feb 8, 2021 at 8:38 PM Dennis Shea <<a href="mailto:shea@ucar.edu" target="_blank">shea@ucar.edu</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div>The 'golden rule' of data processing is to look at the data.</div><div><br></div><div>netcdf geop_500_975_89_20 {<br>dimensions:<br> longitude = 1440 ;<br> latitude = 721 ; <b> ; has pole points</b><br> level = 2 ;<br> expver = 2 ; <b>; not sure what this is BUT, possibly, two different physics packages</b></div><div> <b>; OR, possibly, an ensemble of size two OR, ???</b><br></div><div> time = 160 ;<br>variables:<br> float longitude(longitude) ;<br> longitude:units = "degrees_east" ;<br> longitude:long_name = "longitude" ;<br> float latitude(latitude) ;<br> latitude:units = "degrees_north" ;<br> latitude:long_name = "latitude" ;<br> int level(level) ;<br> level:units = "millibars" ;<br> level:long_name = "pressure_level" ;<br> int expver(expver) ;<br> expver:long_name = "expver" ;<br> int time(time) ;</div><div><div> time:units = "hours since 1900-01-01 00:00:00.0" ;<br> time:long_name = "time" ;<br> time:calendar = "gregorian" ;<br> <b><span style="color:rgb(0,0,255)">short</span> z(time, expver, level, latitude, longitude)</b> ; <====== rank 5<br><b> z:scale_factor = 0.898208868468462 ; netCDF CF [and COARDS] conventions<br></b> <b>z:add_offset = 28656.6907881439 </b>; <b>; scale_factor and add_offet must be present</b><br> <b>z:_FillValue = -32767s ; ; CF </b><br> z:missing_value = -32767s ; ; COARDS <br> z:units = "m**2 s**-2" ; ; COARDS and CF conventions<br> z:long_name = "Geopotential" ; ; COARDS convention<br> z:standard_name = "geopotential" ; ; CF convention<br><br>======================================================</div><div><br></div><div><div><div><div><div><div id="gmail-m_-7079911535084953120gmail-m_3256303314203830738gmail-m_-4035906379564093444m_-1914730850972550663gmail-m_6867493540619869841m_949011946592702635gmail-m_-4094324489795839166gmail-:2j2"><div><div><div><div><div id="gmail-m_-7079911535084953120gmail-m_3256303314203830738gmail-m_-4035906379564093444m_-1914730850972550663gmail-m_6867493540619869841m_949011946592702635gmail-m_-4094324489795839166gmail-:2zl"><div id="gmail-m_-7079911535084953120gmail-m_3256303314203830738gmail-m_-4035906379564093444m_-1914730850972550663gmail-m_6867493540619869841m_949011946592702635gmail-m_-4094324489795839166gmail-:2j4"><div dir="ltr"><span><div>dir="/Users/nuovoaccount/Documents/PYTHON/"<br>fil ="<a href="http://geop_500_975_89_20.nc" target="_blank">geop_500_975_89_20.nc</a>"<br>f = addfile(dir+fil,"r")<br>z = <a href="http://www.ncl.ucar.edu/Document/Functions/Contributed/short2flt.shtml" target="_blank"><b>short2flt</b></a>(f->z)<br></div></span><div>printVarSummary(z) ; <b>(time, expver, level, latitude, longitude)</b> </div><div>printMinMax(z,0)</div><div><br></div><div><div><div>---<br></div><div>or, <br></div><div> [a] noting that NCL<i> eliminates degenerate dimensions</i> [size 1]</div><div> [b] no information is lost, since NCL will add variable attributes for the degenerate dimensions: <b>expver, level</b></div><div><br></div><div>z = <a href="http://www.ncl.ucar.edu/Document/Functions/Contributed/short2flt.shtml" target="_blank"><b>short2flt</b></a>( f->z(:,1,1,:,:) ) ; second ensemble member and second level<br></div><div><div>printVarSummary(z) ; <b>(time, latitude, longitude) </b>with attributes <b>level </b>and<b> expver</b> </div><div>printMinMax(z,0)</div></div><div><div id="gmail-m_-7079911535084953120gmail-m_3256303314203830738gmail-m_-4035906379564093444m_-1914730850972550663gmail-m_6867493540619869841gmail-m_-5170570634263361908m_-4094324489795839166gmail-:2zw"><img src="https://ssl.gstatic.com/ui/v1/icons/mail/images/cleardot.gif"></div><div><br></div><div>HTH</div><div><br></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Mon, Feb 8, 2021 at 8:46 AM Anne Seidenglanz via ncl-talk <<a href="mailto:ncl-talk@mailman.ucar.edu" target="_blank">ncl-talk@mailman.ucar.edu</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">Hi,<div><br></div><div>I am not new to NCL but encounter a rather new problem when dealing with ERA5 data (in .nc format, see script attached). I am trying to produce a simple test plot for geopotential height, and somehow all my data seems to be missing? The error message appears: </div><div>warning:ContourPlotInitialize: no valid values in scalar field; ContourPlot not possible:[errno=1101] <br></div><div>When I printed a subset of the dataset, all the values seemed to be missing values. </div><div><br></div><div>I have:</div><div>- tested that not all data is missing in Z with "print("Is Z all missing ? " + all(ismissing(Z)))". It gave me False.</div><div>- I have tried both, reading in the data using "short2flt" to account for scale factor and offset value, and without short2flt. In both cases appears the missing value problem and the same error message. </div><div><br></div><div>Where have I gone wrong?</div><div><br></div><div>Thx for any help</div><div>Anne </div></div>
_______________________________________________<br>
ncl-talk mailing list<br>
<a href="mailto:ncl-talk@mailman.ucar.edu" target="_blank">ncl-talk@mailman.ucar.edu</a><br>
List instructions, subscriber options, unsubscribe:<br>
<a href="https://mailman.ucar.edu/mailman/listinfo/ncl-talk" rel="noreferrer" target="_blank">https://mailman.ucar.edu/mailman/listinfo/ncl-talk</a></blockquote></div></div>
</blockquote></div></div>
</blockquote></div>
_______________________________________________<br>
ncl-talk mailing list<br>
<a href="mailto:ncl-talk@mailman.ucar.edu" target="_blank">ncl-talk@mailman.ucar.edu</a><br>
List instructions, subscriber options, unsubscribe:<br>
<a href="https://mailman.ucar.edu/mailman/listinfo/ncl-talk" rel="noreferrer" target="_blank">https://mailman.ucar.edu/mailman/listinfo/ncl-talk</a></blockquote></div>
</blockquote></div>