Possibly a system cleanup my realise some resources. Thing is Win95, bit dated now.
Any programmes you do not need I would zap away carefully not taking any shared system files though.
You didn't say what type of mouse you have. COM Port/seriel type connection, PS/2 or usb ?.
On boot the computer loads the systems drivers, its just getting run down with age or overloading of other programes/devices. Possibly more memory would help, clean out cookies, temp internet files.