There are utilities for that purpose, but eliminating dupes is done at
your peril, and can bring nasty results to the uninformed.
Some dupes are needed.
Want to reply to this thread or ask your own question?
You'll need to choose a username for the site, which only take a couple of moments. After that, you can post your question and our members will help you out.