Have you used the spousal privilege previously? The fact that you know about it suggests that you may have used it previously. Spousal privilege protects you from being forced to testify against your spouse. However, you may only use it once.
You may be "forced to testify," but it sounds as if your testimony will not hurt your husband much.