refers to your hard drive. Your programs are on it.
Other letters refer to other drives - floppy, CD drive, external storage drives etc. They can also refer to separate partitions on the same drive, so a large hard drive might have several sections on it that are recognised by your computer as separate drive.
Windows, and all your programs are installed on the 'C' drive by default.