Puzzled as to why you need a password to connect?
The router should hold your connection to your ISP details.
Are you connecting wireless to the router, if so you need the wireless key, which will be the same for both computers and will only need to be entered once.
Any error message? Details would help.