Each of you has an obligation to follow the plan, even if it is temporary. Keeping a written calendar of when the visits are supposed to happen, and whether or not they happened, is a good basis for you to ask the court to find him in contempt for failing to follow the plan. If the plan is completely impossible for him to follow, the court won't sanction him, but if he simply cannot be bothered that is different.
Kids need both their parents. Kids need their parents not to be embroiled in litigation to the point where it interferes with the parent's ability to be parents to their children. Sometimes it is a wake-up call to the non-compliant parent to understand that the court made the parenting plan order for a reason and expects it to be followed.
Also, you can email/call the GAL and advise them of what is happening, so they can adjust their recommendations accordingly. Hope this helps. Elizabeth Powell
Using Avvo does not form an attorney client relationship.