So I am wondering if there is might be a not-horrifically-painful way to
delete duplicate emails now contained in PST archive files.

For various reasons, I've ended up with multiple PST files as outlook
archives, these emails have been copied from other people in an attempt to
make a complete "archive" on a particular client in our office. So, for
instance, if a particular email went to me, to co-worker A and co-worker B,
when we scraped together emails from all three sources, I've now ended up
with three copies of the exact same email.

Works fine in terms of making sure I have access to the historical email
record that I need, except the PSTs are quite large, and it seems this may be
an issue with file stability (they seem to pick up errors after a while,
which we have been able to repair with running scanpst. The file size may
have nothing to do with this, but it's a suspicion.)

I suspect removing the duplicates is not a simple thing to do, but just in
case I have overlooked something obvious, thought I'd ask. We have Outlook
2007, if that makes any difference. The PSTs range from 40MB up to 19GB.

Thanks!

Easiest would be to use a duplicates remover.
See http://www.howto-outlook.com/tag/duplicate-removers

19GB is very large. Just curious; how is the performance? I hope you do not
connect to them on a network share ;-)

--
Robert Sparnaaij [MVP-Outlook]
Coauthor, Configuring Microsoft Outlook 2003
http://www.howto-outlook.com/
Outlook FAQ, HowTo, Downloads, Add-Ins and more

http://www.msoutlook.info/
Real World Questions, Real World Answers

-----

"Dawn" <(E-Mail Removed)> wrote in message
news:92E868AC-F6CA-4C4F-AC9D-(E-Mail Removed)...
> So I am wondering if there is might be a not-horrifically-painful way to
> delete duplicate emails now contained in PST archive files.
>
> For various reasons, I've ended up with multiple PST files as outlook
> archives, these emails have been copied from other people in an attempt to
> make a complete "archive" on a particular client in our office. So, for
> instance, if a particular email went to me, to co-worker A and co-worker
> B,
> when we scraped together emails from all three sources, I've now ended up
> with three copies of the exact same email.
>
> Works fine in terms of making sure I have access to the historical email
> record that I need, except the PSTs are quite large, and it seems this may
> be
> an issue with file stability (they seem to pick up errors after a while,
> which we have been able to repair with running scanpst. The file size may
> have nothing to do with this, but it's a suspicion.)
>
> I suspect removing the duplicates is not a simple thing to do, but just in
> case I have overlooked something obvious, thought I'd ask. We have
> Outlook
> 2007, if that makes any difference. The PSTs range from 40MB up to 19GB.
>
> Thanks!

There are duplicate remover tools but AFAIK the mail needs to be in one pst,
possibly the same folder.
See http://www.slipstick.com/addins/mail_duplicates.asp for tools.

--
Diane Poremsky [MVP - Outlook]
Outlook Tips: http://www.outlook-tips.net/
Outlook & Exchange Solutions Center: http://www.slipstick.com

Outlook Tips by email:
mailto:dailytips-subscribe-(E-Mail Removed)

EMO - a weekly newsletter about Outlook and Exchange:
mailto:EMO-NEWSLETTER-SUBSCRIBE-(E-Mail Removed)

Let's Really Fix Outlook 2010
http://forums.slipstick.com/forumdisplay.php?f=34

"Dawn" <(E-Mail Removed)> wrote in message
news:92E868AC-F6CA-4C4F-AC9D-(E-Mail Removed)...
> So I am wondering if there is might be a not-horrifically-painful way to
> delete duplicate emails now contained in PST archive files.
>
> For various reasons, I've ended up with multiple PST files as outlook
> archives, these emails have been copied from other people in an attempt to
> make a complete "archive" on a particular client in our office. So, for
> instance, if a particular email went to me, to co-worker A and co-worker
> B,
> when we scraped together emails from all three sources, I've now ended up
> with three copies of the exact same email.
>
> Works fine in terms of making sure I have access to the historical email
> record that I need, except the PSTs are quite large, and it seems this may
> be
> an issue with file stability (they seem to pick up errors after a while,
> which we have been able to repair with running scanpst. The file size may
> have nothing to do with this, but it's a suspicion.)
>
> I suspect removing the duplicates is not a simple thing to do, but just in
> case I have overlooked something obvious, thought I'd ask. We have
> Outlook
> 2007, if that makes any difference. The PSTs range from 40MB up to 19GB.
>
> Thanks!

Thanks -- I suspect no one here (myself included) will be willing to trust a
third party program to do this. Well, at least now I can stop thinking maybe
there is some easy way this could be done.

As you suspect, performance is fine when the PST is local, but terrible if
put onto the network. (of course, I think this is true for smaller PSTs as
well, we seem to have network issues. Which is way above my pay grade, and a
subject for a different post.)

Thank you!

"Roady [MVP]" wrote:

> Easiest would be to use a duplicates remover.
> See http://www.howto-outlook.com/tag/duplicate-removers
>
> 19GB is very large. Just curious; how is the performance? I hope you do not
> connect to them on a network share ;-)
>
> --
> Robert Sparnaaij [MVP-Outlook]
> Coauthor, Configuring Microsoft Outlook 2003
> http://www.howto-outlook.com/
> Outlook FAQ, HowTo, Downloads, Add-Ins and more
>
> http://www.msoutlook.info/
> Real World Questions, Real World Answers
>
> -----
>
> "Dawn" <(E-Mail Removed)> wrote in message
> news:92E868AC-F6CA-4C4F-AC9D-(E-Mail Removed)...
> > So I am wondering if there is might be a not-horrifically-painful way to
> > delete duplicate emails now contained in PST archive files.
> >
> > For various reasons, I've ended up with multiple PST files as outlook
> > archives, these emails have been copied from other people in an attempt to
> > make a complete "archive" on a particular client in our office. So, for
> > instance, if a particular email went to me, to co-worker A and co-worker
> > B,
> > when we scraped together emails from all three sources, I've now ended up
> > with three copies of the exact same email.
> >
> > Works fine in terms of making sure I have access to the historical email
> > record that I need, except the PSTs are quite large, and it seems this may
> > be
> > an issue with file stability (they seem to pick up errors after a while,
> > which we have been able to repair with running scanpst. The file size may
> > have nothing to do with this, but it's a suspicion.)
> >
> > I suspect removing the duplicates is not a simple thing to do, but just in
> > case I have overlooked something obvious, thought I'd ask. We have
> > Outlook
> > 2007, if that makes any difference. The PSTs range from 40MB up to 19GB.
> >
> > Thanks!
>
>

You're welcome! :-)
Well, the 3rd party app from MAPILab (and many others) will show you which
duplicates they have found and then you can evaluate it before deleting
items. Keeping a backup makes it easy to undo the action in case you still
detect an issue afterwards.

You really shouldn't connect to a pst-file on a network share. It is not
supported nor recommended by Microsoft as it could lead to data corruption
or even data loss. I suspected already that you were trying to connect to it
from a network share, which is why I asked ;-) Keeping the file locally and
making frequent backups to a network share is recommended.

--
Robert Sparnaaij [MVP-Outlook]
Coauthor, Configuring Microsoft Outlook 2003
http://www.howto-outlook.com/
Outlook FAQ, HowTo, Downloads, Add-Ins and more

http://www.msoutlook.info/
Real World Questions, Real World Answers

-----

"Dawn" <(E-Mail Removed)> wrote in message
news:3114C80A-F9B1-45F7-8C9B-(E-Mail Removed)...
> Thanks -- I suspect no one here (myself included) will be willing to trust
> a
> third party program to do this. Well, at least now I can stop thinking
> maybe
> there is some easy way this could be done.
>
> As you suspect, performance is fine when the PST is local, but terrible if
> put onto the network. (of course, I think this is true for smaller PSTs
> as
> well, we seem to have network issues. Which is way above my pay grade,
> and a
> subject for a different post.)
>
> Thank you!
>
> "Roady [MVP]" wrote:
>
>> Easiest would be to use a duplicates remover.
>> See http://www.howto-outlook.com/tag/duplicate-removers
>>
>> 19GB is very large. Just curious; how is the performance? I hope you do
>> not
>> connect to them on a network share ;-)
>>
>> --
>> Robert Sparnaaij [MVP-Outlook]
>> Coauthor, Configuring Microsoft Outlook 2003
>> http://www.howto-outlook.com/
>> Outlook FAQ, HowTo, Downloads, Add-Ins and more
>>
>> http://www.msoutlook.info/
>> Real World Questions, Real World Answers
>>
>> -----
>>
>> "Dawn" <(E-Mail Removed)> wrote in message
>> news:92E868AC-F6CA-4C4F-AC9D-(E-Mail Removed)...
>> > So I am wondering if there is might be a not-horrifically-painful way
>> > to
>> > delete duplicate emails now contained in PST archive files.
>> >
>> > For various reasons, I've ended up with multiple PST files as outlook
>> > archives, these emails have been copied from other people in an attempt
>> > to
>> > make a complete "archive" on a particular client in our office. So,
>> > for
>> > instance, if a particular email went to me, to co-worker A and
>> > co-worker
>> > B,
>> > when we scraped together emails from all three sources, I've now ended
>> > up
>> > with three copies of the exact same email.
>> >
>> > Works fine in terms of making sure I have access to the historical
>> > email
>> > record that I need, except the PSTs are quite large, and it seems this
>> > may
>> > be
>> > an issue with file stability (they seem to pick up errors after a
>> > while,
>> > which we have been able to repair with running scanpst. The file size
>> > may
>> > have nothing to do with this, but it's a suspicion.)
>> >
>> > I suspect removing the duplicates is not a simple thing to do, but just
>> > in
>> > case I have overlooked something obvious, thought I'd ask. We have
>> > Outlook
>> > 2007, if that makes any difference. The PSTs range from 40MB up to
>> > 19GB.
>> >
>> > Thanks!
>>
>>