Yes, unless otherwise provided in the Final Divorce Order. While child support is calculated on a monthly basis, Judges recognize that expenses vary from month to month. As such, courts will not usually modify child support so as to eliminate it during a month when the child is with the non-custodial parent.
Unless you filed a separate modification custody action, the court will not allow a modification of custody action to proceed at that time. You must file a separate action.