The problem if you dont attend is you have no say in what happens. The court could possibly do more than just terminate. Unless you attend, you are too open. I would not recommend it.
The general advice above does not constitute an attorney-client relationship: you haven't hired me or my firm or given me confidential information by posting on this public forum, and my answer on this public forum does not constitute attorney-client advice. IRS Circular 230 Disclosure: In order to comply with requirements imposed by the Internal Revenue Service, we inform you that any U.S. tax advice contained in this communication (including any attachments) is not intended to be used, and cannot be used, for the purpose of (i) avoiding penalties under the Internal Revenue Code or (ii) promoting, marketing, or recommending to another party any transaction or matter addressed herein. While I am licensed to practice in New York and California, I do not actively practice in New York. Regardless, nothing said should be deemed an opinion of law of any state. All readers need to do their own research or pay an attorney for a legal opinion if one is necessary or desired.
You can get court-ordered visitation as a prior guardian if you request it and the court finds it appropriate. If you absolutely do not want to go, then I would at least contact the other party and let them know you aren't showing. I would advise you go ahead and go however. You never know what could work out in court.
The answers offered by this attorney are for general information purposes only and you should not take action based on these answers without first speaking with an attorney who can go over all the facts of your case in person. Every case is different; a change in facts results in a different answer.