You will need to contact the embassy of the country in question to see what they require. However, upon leaving, your spouse will trigger a bar from the US.
You should retain an experienced immigration lawyer to review all the facts and advise you accordingly.
J Charles Ferrari Eng & Nishimura 213.622.2255 The statement above is general in nature and does not constitute legal advice, as not all the facts are known. You should retain an attorney to review all the facts specific to your case in order to receive advise specific to your case. The statement above does not create an attorney/client relationship. Answers on Avvo can only be general ones, as specific answers would require knowledge of all the facts. As such, they may or may not apply to the question.
If your spouse is in the U.S. without proper documentation, when he leaves, he may not be able to re-enter legally for a long time.
Nevertheless, if you are traveling to a foreign country, the consulate or embassy for the country you are traveling to will let you know what type of document he will need.
You should consult with an immigration attorney before you travel if you plan on living in the U.S. with your spouse.
What country is your spouse from? When did your spouse enter the United States? How did your spouse enter the Untied States? These are just some of the questions you need to go over with an exp'd immigration lawyer.
Your scenario seems fraught with peril, and I would suggest that you immediately contact an immigration attorney to discuss your options. The real answer to your question cannot be given without receiving additional facts. Please consult with an immigration attorney PRIOR to leaving the country.