Firstly, wait for the January sales.
Because, like you I wanted to keep it simple I bought a HD camera (Panasonic, but obviously that's a personal choice) recording to an SD card.
That means the disc is very portable, and I can play it back in a vast number of devices.
However, given your comment above, these might not hold enough footage for you (funny how we still use the term "footage" isn't it?).