<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
<style type="text/css" style="display:none;"> P {margin-top:0;margin-bottom:0;} </style>
</head>
<body dir="ltr">
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<span style="color: rgb(0, 0, 0); font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt;">Thanks Dennis for the early NCL Christmas gift (:</span><br>
</div>
<div id="Signature">
<div dir="ltr">
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
Michael</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<div id="x_Signature">
<div id="x_divtagdefaultwrapper" style="font-size:12pt; color:#000000; background-color:#FFFFFF; font-family:Calibri,Arial,Helvetica,sans-serif">
Michael Notaro<br>
<div>Associate Director<br>
</div>
<div>Nelson Institute Center for Climatic Research<br>
</div>
<div>University of Wisconsin-Madison<br>
</div>
<div>Phone: (608) 261-1503<br>
</div>
<div>Email: mnotaro@wisc.edu<br>
</div>
</div>
<div>
<div id="x_appendonsend"></div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<hr tabindex="-1" style="display:inline-block; width:98%">
<div id="x_divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" color="#000000" style="font-size:11pt"><b>From:</b> Dennis Shea <shea@ucar.edu><br>
<b>Sent:</b> Monday, December 16, 2019 9:44 PM<br>
<b>To:</b> Michael Notaro <mnotaro@wisc.edu><br>
<b>Cc:</b> ncl-talk@ucar.edu <ncl-talk@ucar.edu><br>
<b>Subject:</b> Re: [ncl-talk] deleting rows from csv file</font>
<div> </div>
</div>
<div>
<div dir="ltr">
<div>hi Michael,</div>
<div>Attached is a library containing few 'simple' functions that eliminate duplicates. The were never made 'public' :-(<br>
</div>
<div>It also uses:<br>
</div>
<div><br>
</div>
<div><a href="https://www.ncl.ucar.edu/Document/Functions/Contributed/get1Dindex.shtml"><b>https://www.ncl.ucar.edu/Document/Functions/Contributed/get1Dindex.shtml</b></a></div>
<div><br>
</div>
<div>It does return the first of the 'key' values ... not the last.</div>
<div><br>
</div>
<div>%> ncl tst.notaro_elim_dup.ncl</div>
<div><br>
</div>
<div>Happy Holidays!</div>
<div>D<br>
</div>
<div><br>
</div>
<div><br>
</div>
</div>
<br>
<div class="x_x_gmail_quote">
<div dir="ltr" class="x_x_gmail_attr">On Mon, Dec 16, 2019 at 12:48 PM Michael Notaro via ncl-talk <<a href="mailto:ncl-talk@ucar.edu">ncl-talk@ucar.edu</a>> wrote:<br>
</div>
<blockquote class="x_x_gmail_quote" style="margin:0px 0px 0px 0.8ex; border-left:1px solid rgb(204,204,204); padding-left:1ex">
<div dir="ltr">
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
I have a lot of csv files with columns of day, time, and temperature</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
such as below. </div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
Anytime I have consecutive rows with the same day and time,</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
as highlighted below, I was to only keep the last row and remove</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
the other duplicates. </div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
Does anyone have any suggestions in NCL or other command line?</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
I did see this potential solution using sed, but it doesn't work in</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
my mac os environment.</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<a href="https://unix.stackexchange.com/questions/265540/delete-consecutive-lines-in-csv-with-duplicate-values-in-one-field-but-keep-the" target="_blank">https://unix.stackexchange.com/questions/265540/delete-consecutive-lines-in-csv-with-duplicate-values-in-one-field-but-keep-the</a><br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
DAY TIME TEMP</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<span> 83., 0.00, -6.32<br>
</span>
<div> 83., 60.00, -6.58<br>
</div>
<div> 83., 120.00, -6.80<br>
</div>
<div> 83., 180.00, -7.22<br>
</div>
<div> 83., 240.00, -7.10<br>
</div>
<div> 83., 300.00, -7.47<br>
</div>
<div> 83., 360.00, -7.69<br>
</div>
<div> 83., 420.00, -7.50<br>
</div>
<div> 83., 480.00, -6.75<br>
</div>
<div> 83., 540.00, -5.49<br>
</div>
<div> 83., 600.00, -4.54<br>
</div>
<div> 83., 660.00, -3.30<br>
</div>
<div> 83., 720.00, -2.42<br>
</div>
<div> 83., 780.00, -1.67<br>
</div>
<div> 83., 840.00, -1.64<br>
</div>
<div> 83., 900.00, -2.08<br>
</div>
<div> 83., 960.00, -2.99<br>
</div>
<div> 83.,1020.00, -4.07<br>
</div>
<div> 83.,1080.00, -5.17<br>
</div>
<div> 83.,1140.00, -6.52<br>
</div>
<div> 83.,1200.00, -7.60<br>
</div>
<div> 83.,1260.00, -8.56<br>
</div>
<div> 83.,1320.00, -8.93<br>
</div>
<div> 83.,1380.00, -9.65<br>
</div>
<div> 84., 0.00, -10.13<br>
</div>
<div><span style="background-color:rgb(255,255,0)"> 84., 60.00, -10.29 * want to remove</span><br>
</div>
<div><span style="background-color:rgb(255,255,0)"> 84., 60.00, -10.46 * want to keep</span><br>
</div>
<div> 84., 120.00, -10.72<br>
</div>
<div> 84., 180.00, -10.97<br>
</div>
<span></span><br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
Thanks, Michael</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<div id="x_x_gmail-m_-3117004434081001014Signature">
<div id="x_x_gmail-m_-3117004434081001014divtagdefaultwrapper" style="font-size:12pt; color:rgb(0,0,0); background-color:rgb(255,255,255); font-family:Calibri,Arial,Helvetica,sans-serif">
Michael Notaro<br>
<div>Associate Director<br>
</div>
<div>Nelson Institute Center for Climatic Research<br>
</div>
<div>University of Wisconsin-Madison<br>
</div>
<div>Phone: (608) 261-1503<br>
</div>
<div>Email: <a href="mailto:mnotaro@wisc.edu" target="_blank">mnotaro@wisc.edu</a><br>
</div>
</div>
</div>
</div>
_______________________________________________<br>
ncl-talk mailing list<br>
<a href="mailto:ncl-talk@ucar.edu" target="_blank">ncl-talk@ucar.edu</a><br>
List instructions, subscriber options, unsubscribe:<br>
<a href="http://mailman.ucar.edu/mailman/listinfo/ncl-talk" rel="noreferrer" target="_blank">http://mailman.ucar.edu/mailman/listinfo/ncl-talk</a></blockquote>
</div>
</div>
</div>
</div>
</div>
</div>
</body>
</html>