The seminal question is whether or not your business partner was authorized by your company to open the accounts. You have to remember that a company is a distinct legal person from the individuals who work in it or manage it, like yourself.
In the case of limited liability companies, the owners of the business are split into members and managers. The equivalent of this in a corporation are shareholders and directors of the board. In an LLC, all members have the authority, by law, to take action on behalf of the company, unless there are specific managers appointed. In a corporation, shareholders actions will not bind the corporation. So, depending on how an owner has elected to organize his or her business, it is possible that a business partner's actions are not unauthorized and therefore, not criminal.
You may want to consider consulting an attorney if your concerns arise to more than just the opening of bank accounts, such as applying for loans, signing leases, and the like. And frankly, at the end of the day, the best approach is to memorialize your duties via a board of directors resolution that grants specific individuals specific duties. If this does not work, perhaps it's time for a new partner. Good luck!
I agree with the previous answer, and unless the actions of your partner actually deprived someone of something with a false or altered document I do not see a criminal act. I like to get start up business owners and have a "roles, goals, and expectations" meeting at the outset to avoid this type of problem through inadvertent actions.