You really do not need an ATX motherboard so I would drop one size to a M-atx.
This is a far better case.Fractal Design Core 1000
The PSU is probably the most important component in the PC and buying cheap is not recommended.
Even though you are not into gaming your choice of GPU is pretty basic and I would suggest something a little better.
Unless you are going to be overclocking your CPU then I feel you cooler is a little over the top, don't get me wrong,excellent cooler,just not really needed with your set up unless you are overclocking.