Virtually all USB drives these days are reliable. I have seen 1Gb drives for as little as £30, it is a buyers market, so look around to find the best you can for a fair price.
If you click here and click here you should get good examples of some of the best USB drives.
Remember though, just using one back up is really not best practice. You should also make a second back up of your most important data.