You've switched on the non-printing characters, either by clicking the
pilcrow button (¶) or through Tools > Options. HIde them the same way.
What you're seeing is not a bullet but a 'visible space', which serves
precisely to show you where your space characters are. You're probably also
seeing pilcrows for each paragraph mark, and little arrows for tabs. A lot
of formatting is *much* easier when you can see all these things.