"How far"? Not sure what you're asking. Also unclear what you mean by the judge "giving rights back."
There are actually several elements of parenthood, and parents can lose one or more of them without losing actual legal parenthood.
It sounds like she's still the legal mother, and assuming that, if she sees him regularly for visitation and isn't in SERIOUS arrears on any child support obligations (like worse than 80% behind, for example), then there's probably NO likelihood of "stripping" her of those rights.
Hope that helps!
Sign up to receive a 3-part series of useful information and advice about child custody law.