I assume you are using Outlook Express. the envelope icon just indicates if you have read it or not. Closed means unread and open means read.
Now if you single click on an e-mail does it open in a window? Or do you have to double click to open in a new Window?
Make sure Preview pane is OFF. View Menu, Layout, Uncheck Show Preview Pane.