You are correct. You can only borrow one book at a time,and a maximum of one book a month. There's no maximum borrowing time - you can keep a book for months if you like, but you can only borrow another one by returning the book you already have.
It's a little bonus for having a Prime membership. I have it, and as you say, the main benefit is free guaranteed next day delivery on all orders that come direct from Amazon.