You need to abide by the visitation schedule as closely as possible or ask the court to change the visitation schedule. The court will balance the father's right to visitation against the best interest of the children. Normally a court will side with the father over extracurricular activities of the children.
Every situation is different and you should consult your own attorney to go over all the particular facts in your case. The answer given is only intended to provide general guidance regarding rights and responsibilities.
Sign up to receive a 5-part series of useful information and advice about child custody law.