Does previous owner if he financed your business have to except it back or can he refuse itl?

Generally, if you breach the agreement, he can exercise certain rights under the contract. He can in fact choose whether or not to exercise some, all or none of his rights thereunder.
However, a lot depends on your contract and state law, so you should consult with an experienced business attorney.

Hope this helps.

LEGAL DISCLAIMER
Mr. Fromm is licensed to practice law in PA. The response herein is not legal advice and does not create an attorney/ client relationship. The response is only in the form of legal education and is intended to only provide general information about the matter within the question. Oftentimes the question does not include significant and important facts and timelines that if known could significantly change the reply or make such reply unsuitable. Mr. Fromm strongly advises the questioner to confer with an attorney in their state in order to ensure proper advice is received.
By using this site you understand and agree that there is no attorney client relationship or confidentiality between you and the attorney responding. This site should not be used as a substitute for competent legal advice from a licensed attorney that practices in the subject area in your jurisdiction and with whom you have an attorney client relationship. The law changes frequently and varies from jurisdiction to jurisdiction. The information and materials provided are general in nature, and may not apply to a specific factual or legal circumstance described in the question or omitted from the question.
Circular 230 Disclaimer - Any information in this comment may not be used to eliminate or reduce penalties by the IRS or any other governmental agency.