Freeware to remove duplicate phrases ?

  PhilBoy59 17:18 24 Sep 12

I have a massive joke file from my days at AOL. Mostly rude adult stuff and some offensives, but all funny.

I have driven myself nuts trying to find a programme, preferably free. that can find duplicate entries within a text file. Even my lovely friends at, a superb freeware an shareware site, are a little defeated by this challenge.

So I hand over to the older and wiser mob,..... yes you, any takers ?

I know there are lots of duplicate file finders, but what I want is a word or phrase within within a text fileduplicate finder.A somewhat elusive beast. Using "Find" would take forever and is unsuitable. If you dont beleive me try it on a large txt file with lots of "unknown duplicates".

I would be willing to offer a copy of my pruned txt file to anyone who can help me, who is of an unshockable adult disposition. There are no police man jokes in there.

PhilBoy xxx:P

This thread is now locked and can not be replied to.

Huawei P10 review

1995-2015: How technology has changed the world in 20 years

An overview: What leading creative agencies are doing to improve diversity

New iPad, iPhone SE & Red iPhone 7 on sale now