Sounds like some peripheral you have is causing the problem. Suggest you boot up with the keyboard and mouse and then try plugging in each device in turn and checking it's okay. Usually its usb devices that cause this type of problem ( but no guarantee in your case).
Check in Device Manager if any components are marked with yellow triangle. Would indicate possible item causing your problem.
If all seems okay you may have to disconnect all cables back to keyboard and mouse and reboot a number ot times adding another cable each time as it may just be the boot sequence that's affected by the problem item. Tedious I know.