You need to check all your settings. IE should connect to the internet through the router without even having the AOL software on your computer. I've been with AOL for seven years but have not had their software on for the last three. My grandson connects his games machine (don't remember what it is) through the router when he stays with us.
There is something not quite right with your settings I think.