Moving to another state with out my son's fathers permission

I want to move to another state, but i have a son and i am no longer with the father. For the past two years he was barely a part of my son's life. He would take him sometimes, but not with out me forcing him to. I recently as of September first finally started receiving court ordered child support. My son is three. I asked him about moving to CA, as i have an opportunity there and and better options for my son, and he has stated he will not give his permission. Are there any options i have?