Cato,
Recycle Bin is a registed explorer shell namespace. You can remove it by removing related registry settings.
Try to disable "HKLM\SOFTWARE\Microsoft\Windows\CurrentVersion\Explorer\Desktop\NameSpace\{645FF040-5081-101B-9F08-00AA002F954E}"
and "HKCR\CLSID\{645FF040-5081-101B-9F08-00AA002F954E}" registry keys (and all subkeys and values under the keys) under "Shell
Namespace Registry Data" and "Shell Core Registry Data" component registry sections.