He can file an action for custody and get a temporary custody order even if it is only for visitation at this time. You need to seek the advice of a family law attorney.
Answers to this or any question on this site does not create an attorney client relationship. Answers are provided for informational purposes only.
I would suggest consulting with an experienced family law attorney in your area. However, you can file for custody. Right now, since it seems that there is no custody order in place, you are free to see the child when you want. I would file for custody immediately.
Sign up to receive a 3-part series of useful information and advice about child custody law.