how did they do the application, online or face to face? was it part of a sale or just an application? they should have offered to exclude you from mailing lists, and should have mentioned the PP as it is not obligatory. this can also be cancelled in writing in most cases. unfortunately once you are on a mailing list you would need to contact those parties that have received your details to be removed. get in touch with the HFC who i thnk are the backers of the card.
you wont be charged PP without making a purchase as it is usually a percentage of the outstanding balance.