Back where, in Yahoo Mail? That's not feasible with that many emails.
By default, a POP email client like Windows Mail deletes mail from the
server after a successful download. You can change that default if
you wish, but it would only affect newly downloaded messages.