Can you connect to the router from the upstairs desktop and surf the net? If so are you connected via cable? This establishes that your ADSL line is working.
Have you tried turning off all the computers and then disconnecting the router for five minutes? Reboot the router and then reboot each computer in turn.