As long as there is good cause or there is no valid opposition to the change in who the personal representative(s) is/are, a change is permitted as long as the proper forms are submitted to the probate court and sufficient notice to all heirs is achieved.
The Executor can step down at any time for any reason or no reason. All that is required is that the court is notified of the change and all the heirs have agreed to the change. The heirs would have to sign off on the change. Other than that, it should be no problem.
The administrator (if there is no Will, other is an Administrator in Georgia, not an Executor) would need to file a Petition for Discharge of Personal Representative. I would ask for release from liability as part ofthe
This answer is not intended to provide you with specific legal advice regarding your situation, or to create any attorney-client relationship. The intent is only to provide general information. You should be aware that you cannot rely on this answer to provide you with any protection against tax penalties. You should always consult your own attorney in order to obtain legal advice.
You may absolutely change the executor thru the Probate Court. The Executor would be in agreement for this to be easy.
It would not be necessary to hire a lawyer to address this issue, but it would be much easier.