Get some Zinc tablets from the Chemist or health food store, and SUCK one every now and then. They will taste absolutely aweful but they are supposed to kill of the bacteria in your throat that cause the soreness. The consensus also is that the worse they taste is a measure of how deficient you are in zinc.click here
If you don't fancy this Strepsils also do one with an anaesthetic content.
Providing you have no history of asthma, gastric ulcers or allergies to the meds then try Dr Scott's suggestion of soluble aspirin gargles. You can also take Paracetamol 1g four times a day with the aspirin. OR Try Paracetamol 1g four times a day together with Ibuprofen 400mg 3 or 4 times per day. I assume you are over 12 years old as the above are adult doses.