I'm a little confused.
You mention MS Office 2007 then outlook express 2007?
If it is MS Office outlook go to tools/account settings/RSS feeds select and delete. also delete the RSS feed folders.
You can find a lot of information from the MS website or if you look to the top right of Outlook you will see a white rectangular box, just type in RSS and it will tell you how to add or remove RSS feeds.