I agree with my colleagues who have previously answered. On a more practical note, it doesn't sound like you have any evidence of fraud or...

Should I have to pay my boss for a loan that I didn't ask for, I didn't receive directly, and I didn't sign for?

It sounds to me like the boss was trying to be sure to cover wages due while she was overseas- hence the $500 "advance". When she returned, your...