Freeware to remove duplicate phrases ?

  PhilBoy59 17:18 PM 24 Sep 12

I have a massive joke file from my days at AOL. Mostly rude adult stuff and some offensives, but all funny.

I have driven myself nuts trying to find a programme, preferably free. that can find duplicate entries within a text file. Even my lovely friends at, a superb freeware an shareware site, are a little defeated by this challenge.

So I hand over to the older and wiser mob,..... yes you, any takers ?

I know there are lots of duplicate file finders, but what I want is a word or phrase within within a text fileduplicate finder.A somewhat elusive beast. Using "Find" would take forever and is unsuitable. If you dont beleive me try it on a large txt file with lots of "unknown duplicates".

I would be willing to offer a copy of my pruned txt file to anyone who can help me, who is of an unshockable adult disposition. There are no police man jokes in there.

PhilBoy xxx:P


This thread is now locked and can not be replied to.

Best Android apps 2015/2016: Best apps for your new phone or tablet - what apps should I download?

1995-2015: How technology has changed the world in 20 years

Uniqlo uses your brain waves to find your perfect T-shirt

What everyone thinks of the new Steve Jobs movie | 21 Facts about the Steve Jobs film | PLUS:…