The Taskbar is to the left of Notification Area.
Are you saying that after closing an application or game, its icon remains
in Notification Area (to the right of Taskbar, to the left of the clock)?
Right-click on an empty/blank area of the Taskbar > Properties > Is "Hide
Inactive Icons" checked (very bottom)?