You should, in my opinion,be looking at a faulty Component.
PSU: Easy one to check, either try another PSU, or get a tester for a few quid off eBay.
Mobo: Not so easy but if as you say you have removed all but the necessary components then it is very likely the faulty item.
CPU: Again a tricky one o check.
RAM: I have had more problems over compibility