Windows Live Mail is set by default to leave messages on server until they are deleted from Live Mail. To change setting you need to go to properties of the e-mail account and then under 'advanced' you can untick this setting.
Surface Pro (2017) vs Surface Pro 4
20 groundbreaking 3D animation technologies coming to Siggraph 2017
iPad Pro 12.9 vs Surface Pro 5