I'm almost forty and I've fairly recently (last year) obtained my private pilot's licence. I'm not equating the two but, if you have the will and the confidence, you can do anything. At the various academic sessions there were several people quite a bit older than me taking tuition.
Don't just sit and think about it. DO IT!!!!!!!