Today Is a good day to contact an experienced immigration attorney.
Your situation is somewhat unclear. I believe you present two issues here: 1) your husband's citizenship and swearing-in; and 2) your separate application for adjustment of status which has been denied?
To alleviate the stress and confusion that you're experiencing, do consult an attorney at your earliest convenience.. At the consultation the attorney will gather more facts about your case and with your permission, will contact USCIS to ascertain your current status and the status of your case.
Of course, one can withdraw an appeal but that might not resolve your problem.
Law Offices of J Thomas Smith J.D., Ph.D 11500 Northwest Freeway, Suite 280 Houston, TX 77092 713-LAWYER-2 www.MyImmigrationLawyer.info
I agree, if you are "confused and do not know how to act" on your case, hire a competent attorney who does. Generally if an adjustment is denied and the applicant is here without status they will be referred to removal proceedings, thus contacting an attorney immediately is very important. My firm handles marriage based claims.
Law Offices of Nicklaus Misiti
212 537 4407
Legal disclaimer: The statement above is general in nature, as not all the facts are known. You should retain an attorney to review all the facts specific to your case in order to receive advise specific to your case. The statement above does not create an attorney/client relationship.