How do I clear out the various searches in the windows
search tool bar for Windows XP?

I take it you want to delete the search history. I did this on the Google search and it might work on the IE Search bar. Go to the search window and cursor down to the highlighted entry you want to delete and press delete, repeat until you have cleared them all.