I have it there all the time, but hidden and in my case I know it's because I have a memory stick plugged in constantly.
There was a thread some little time back and the guy had the same problem. I'll see if I can find it and if it helps you I'll report back.
In the meantime I can tell you how to hide it, out of sight, out of mind.
Right click the 'Task Bar'
At the bottom of pop-up click 'Customize'
Scroll down till you see the 'Safely Remove Hardware' icon.
Click where it say's 'Hide when inactive'
Click the down arrow next to it
Click 'Always Hide'
click 'OK' 'Apply' 'OK'