I haven't tested this, but try removing and readding that person. Outlook
should ask you if you want to resend the invitation to the updated person.
Don't send the update to the person when you remove him or her, and do
update the person when adding him or her back in.