Hmm. Well, I'm fairly new to the networking thing myself, but it's my understanding that in most cases, you would need a router with a built-in ADSL modem.
Can you tell us what model of router you have? I'll find an online manual for it and have a read.
Good choice on Belkin by the way.