Significantly, it appears that the claims of sexual harassment do not come from the supposed recipients of that conduct but from a third person. IF you are on good terms with the two women of whom you are accused of inappropriately touching, see if both will give you a sworn affidavit that simply states that at no time prior to the giving of the affidavit did you touch '[that person] in an inappropriate, sexual, nor-unconsented to manner or way. Then, once having those affidavits, then next thing to do is to send Mrs. E a "Cease and Desist" letter. It may be best to have an attorney obtain the affidavits and send the C and D letter.
This is a very serious case that you should speak to experienced local counsel about. It is too broad in scope and too serious a case to get a significant meaningful answer in an online forum due to it's highly fact intensive nature. To start look on avvo for local employment discrimination and sexual harassment attorneys and then set up some appointments.
This answer does not constitute a legal consultation, or definitive answer, nor does it establish a lawyer client relationship. Each case, controversy, or situation is factually different and requires particularized evaluation.