Yes, you can clear these entries. There is one way that
is supposed to work, that is to clear your history (click
Tools | Internet Options | Clear History). However, if
this doesn't work, which it sometimes doesn't, then the
only other option is to clear it in your registry.
If you need the second option, which unless you're very
comfortable in the registry I do NOT recommend, I will
tell you to search for the entry you want deleted, and
you'll find it, along with the others, and be able to
delete them. If you do not understand what I'm talking
about, I don't recommend doing it.
If you insist though, I recommend searching microsoft's
site for information on modifying the registry and things
like this.