Married 2 yrs - I own home (he's not on mortgage or title), he left a month ago & says he has right to return. Does he?

I haven't filed for divorce yet, but my husband moved out a month ago. We have been married for 2 years. We have been living in the home that I purchased 5 years ago, for the last 2 years. My husband is not on the mortgage or on the title. He moved out voluntarily a month ago and is insisting that he has the right to move back in. I do not want him to. We have an 18 month old child together that I have offered him time to visit with and he has declined all offers.