What will happen to him will depend on what charges Immigration lodges against him on the NTA. You have wasted quite some time by not marrying him, since that could've been an argument to get a bond, and it could have helped him obtain residence in spite of his conviction (depending on many factors, too many to explain here). My advice is to seek counsel from an Immigration attorney immediately since many things will happen at his first hearing before an immigration judge that could doom him forever.
I know you are having a difficult time right now. I also can see that you are confusing many factors in your questions. The best advise I can give you is to see a good lawyer as soon as possible. It will really depend on the felony that he has and on the NTA (immigration charging document)
This is not legal advice and a client attorney relationship is not created. For a free consultation call (718)234-5588.
Here is a honest answer for you - it is impossible to answer your question or provide help on this forum; Information you seek and assistance you will need can only be provided by contacting a competent immigration attorney in person
NYC EXPERIENCED IMMIGRATION ATTORNEYS www.myattorneyusa.com; email: firstname.lastname@example.org; Phone: (866) 456-8654; Fax: 212-964-0440; Cell: 212-202-0325. The information contained in this answer is provided for informational purposes only, and should not be construed as legal advice on any subject matter.
The options available to your "husband" (you referred to him as such but then indicate you are not legally married) will depend upon a number of different factors including how your husband entered the United States, your immigration status, and his criminal history. It appears from what you describe that ICE is seeking to deport him based upon his felony conviction, but you don't indicate what that felony is. Consult with an experienced immigration attorney who can review the facts of the case and advise you how best to proceed.
While this answer is provided by a Florida Bar Certified Expert in Immigration and Nationality Law, it is for general information purposes only and an attorney/client relationship is neither intended nor created. You should seek out qualified counsel to review your case and provide you with advice specific to your situation. Call +1-561-478-5353 to schedule a consultation with Mr. Devore.