You should not approach it from the angle of what looks better. You should hire an immigration attorney and proceed carefully and correctly.
The information contained in this answer is provided for informational purposes only, and should not be construed as legal advice on any subject matter,not should it be viewed as establishing an attorney client relationship of any kind.
That is just one factor to be considered.
The bigger issue for him is that he may get deported for having committed the crime of fraud.
Meet with an immigration lawyer.
PROFESSOR OF IMMIGRATION LAW for over 10 years -- This blog posting is offered for informational purposes only. It does not constitute an attorney-client relationship. Also, keep in mind that this is an INTERNET BLOG. You should not rely on anything you read here to make decisions which impact on your life. Meet with an attorney, via Skype, or in person, to obtain competent personal and professional guidance.
When applying for the conditions to be lifted, the USCIS looks to your marriage to make sure it is bona fide and that you two are still together. Your husband's actions should not have any effect on you.
As long as you did not have anything to do with the fraud, then you should focus on showing that you have a bona fide marriage with your husband. This might be difficult if you two have not been living together for some time. In addition to the taxes, consider including any letters or visitation records from when you visited him in jail.