A USB port itself does not manage drivers. Drivers are associated with the
devices (that connect to the USB ports) themselves. As for removing them,
many drivers may create an entry in Add/Remove Programs that lets you
uninstall them.
You can also try using Device Manager to do this:
- click Start
- right-click My Computer, select Manage
- select Device Manager
- double-click the device in question
- click the Driver tab.
