First of all, you can go back to the court if this is a domestic violence restraining order and get it withdrawn BUT I would have to second what Patty told you and advise you against doing that. You describe a classic early case of domestic violence. Men who resort to pulling hair, shoving and hitting women get bolder as time goes on. Oh sure, they express remorse and tell you how sorry they are, but this individual needs a thorough case of batterer's therapy and needs to be monitored. You are literally taking your life and well being and your child's well being down a dangerous path. I have visited many women in the hospital who wished they had done somethiung to stop the severe injuries they eventually received.
If this is a criminal restraining order then it is out of your hands. You can appeal to the DA if it is a criminal order, but most DAs today prosecute even if the victim recants. Good luck.