Assuming you're using Office 2007, look for a "Text Direction" button on the
"Page Layout" tab.
If you don't have it, do the following :
1. Windows Button (Start Button) -> Programs -> Office -> Tools -> Language
1. Settings
2. Make sure Japanese (Japan) is listed as an enabled editing language and
click Okay.
3. Restart Word.