You certainly have that right. But unless it's really important to you emotionally, why bother? It will make no difference at all in the outcome of the case.
At the end of the day you'll have a divorce and an economic settlement...no matter what the grounds. And, at the end of the day, the divorce case records will still be sealed, so no one outside of the parties or the attorneys have access to them.
You can assert any grounds you wish.
DISCLAIMER This answer is provided for educational purposes only. By using or participating in this site you agree and understand that there is no attorney client privilege between you and the attorney responding. This site cannot be used as a substitute for competent legal advice from a licensed attorney that practices law in the State where this offense is charged; and, who has experience in the area of law you are asking questions about and with whom you would have an attorney client relationship. The law changes frequently and varies from jurisdiction to jurisdiction. The information and materials provided are general in nature, and may not apply to a specific factual or legal circumstance described in the question, or in the State where this charge is filed.