I would suggets closing the account, as having it open and owing money on it will also negatively affect your credit... then filing a police report of the situation, submitting the police report to the bank with a claim of fraud and then submitting the info to the credit reporting agencies.
Banks sometimes require that account holders open checking and savings accounts for money market accounts, and they pretty mich force their credit and debit cards on customers, too, I suppose in the hopes that the customers will use all these services once they have them. You probably did consent to this when you opened whatever account you opened with them.
And you can thank your legislators for passing all these laws favorable to the banks which allow them to do things like this. To start combating these bank abuses, always vote for the most progressive, pro-consumer (Green, liberal Democratic) candidate you can.
At any rate, this is not something to be really upset about. Something like this will not be a big hit on your credit since the card was opened so recently. Order your free credit report at www.annualcreditreport.com to check your credit after this is all done so you can see for yourself.
Disclaimer: Please note that this answer does not constitute legal advice, and should not be relied on, since each state has different laws, each situation is fact specific, and it is impossible to evaluate a legal problem without a comprehensive consultation and review of all the facts and documents at issue. This answer does not create an attorney-client relationship.