remove duplicate lines in text file

[yinkajewole]

how can i use a macro to remove duplicate lines in my text file such that the last one will remain, for instance
the boy is good
great thinking
great thinking
he lives
the boy is good
what's up
great thinking
it should now be like this
he lives
the boy is good
what's up
great thinking

 

[yinkajewole]

Glad to help.

I'm sorry, i just realised that the code you gave me always add some empty lines at the bottom, can this be rectified?

 

[Eric W]

Not sure why that would be, unless you have some empty lines at the end of your input file. You can try changing this line:

If InStr(1, MyResult, vbCrLf & MyLines(i) & vbCrLf, vbTextCompare) = 0 Then

to

If InStr(1, MyResult, vbCrLf & MyLines(i) & vbCrLf, vbTextCompare) = 0 And MyLines(i) <> "" Then

If that doesn't work, let me know.

 

[yinkajewole]

If that doesn't work, let me know.[/QUOTE]
it worked partially.
Actually, the empty line used to be three lines there. The code I used to write the text file do add an empty line, while yours do add two, making three altogether.
So this code you gave me

If InStr(1, MyResult, vbCrLf & MyLines(i) & vbCrLf, vbTextCompare) = 0 And MyLines(i) <> "" Then

reduced the lines to two altogether.

 

[Eric W]

Change this line:

Print [URL="https://www.mrexcel.com/forum/usertag.php?do=list&action=hash&hash=1"]#1[/URL] , Mid(MyResult, 2)

to

Print [URL="https://www.mrexcel.com/forum/usertag.php?do=list&action=hash&hash=1"]#1[/URL] , Mid(MyResult, 2, Len(MyResult) - 2)

</pre>

 

[yinkajewole]

it errors: "Bad file name or number"

 

[yinkajewole]

Sorry, It still had two lines

 

[Eric W]

It's a bit tough to debug at a distance without seeing the file, but here's one last idea. Add one line before the Print #1 line, and change that line to:

MyResult = Replace(Replace(Trim(Replace(Replace(MyResult, " ", "|"), vbCrLf, " ")), " ", vbCrLf), "|", " ")
Print [URL=https://www.mrexcel.com/forum/usertag.php?do=list&action=hash&hash=1]#1[/URL]  , MyResult

I assume you're not using the "|" symbol anywhere in your file. If so, we can find something else.