I used to have this happen occasionally, but I can't remember if I was ever
able to fix it or not.
Some things to try.
1. Update / reinstall your mouse drivers
2. Turn down hardware acceleration http://www.rdpslides.com/pptfaq/FAQ00129.htm for instrux
3. Update video drivers
4. Don't scroll while you're editing a graph.