Most Trusts are set up this way. I set my trusts up this way. I do it for the very reason you want to change it. I would live with his help. If the money is gone it is gone. He may be helping you keep your money. I have listed some of my sites and some sites where you will find a lawyer that will do as you want.
Talk to a CFP and a lawyer