Actually, the setting for Caption Buttons is the setting to edit...
This will change the buttons in the top-right-corner of windows, the system
tray icons, the taskbar icons, and the start menu. This, however, does not
change the size of IE buttons...
And yes, the access is: Control Panel > Display > Appearance > Advanced