How do they determine exactly that someone has committed fraud? Do they have to accuse him of fraud and prosecute him?

It is defined and yes there is due process so the precise accusation is required.

Do they have to take you to court and prove to the court that you committed fraud before they can deny your application?

Deportation proceedings are adjudicated in the Immigration courts.