Unlikely to be the graphics card itself making the noise but it might be the fan on it. Try replacing that first, much cheaper. Open up the case and listen on boot up to try and determine where it is coming from. It might be the processor fan or the hard drive (unlikely if you have had this problem for 2 years).
Surface Pro (2017) vs Surface Pro 4