There may be a requirement in Georgia for you to pay the taxes owed by your prior business before you can duly register a new business locally or with the Georgia Secretary of State. To obtain a specific answer to that question, you will have to consult local counsel familiar with Georgia's tax laws.
Another thing to consider is that if you open a new business which is merely a continuation of the prior business that incurred tax liabilities (i.e., same type of business, same location, same principals, same customers, etc.), it could be held liable for the delinquent taxes under a successor business theory of liability.
The answer to this question does not establish an attorney-client relationship. Moreover, this attorney is licensed to practiced law ONLY in the State of California. Answers to questions from users in other jurisdictions or states are meant to provide only general information. Users should contact a local attorney in their jurisdiction or state to address their specific tax issue.