You will likely need to submit your applications again. For the spouse of a U.S. citizen, there are two main components to your case. One is your wife's immigrant petition, Form I-130. The other is your application for permanent residence, Form I-485. Your application cannot be approved until your wife's petition is approved. For that to happen, you and your wife need to document your joint residence and finances to show that it is a real marriage. If you did not document this thoroughly the first time, then you may want to discuss how to do so with an attorney. Usually the I-130 and I-485 are adjudicated at the same time when the couple appears for an in-person interview at the local USCIS office. (If your five-year visa is an E visa, then you will also need to submit Form I-508 to waive any rights you have under the relevant treaty.)
You probably will need to file, again, and pay the filing fees. I strongly recommend that you seek an appointment and retain an experienced immigration attorney to help you with the application process.
Proving the marital relationship to the satisfaction of an experienced USCIS Examiner is sometimes futile without an attorney's assistance. Our office, among others, like Bob Beer or Charles Kuck of Georgia, help prepare and file these family based immigration matters with the USCIS on a regular basis.
The above is general information and does not create an attorney client relationship.
If it has been less than 30 days since the denial, you can file a Motion to Reopen/Reconsider (form I-290B). It's another option, instead of just refiling everything from scratch. I would strongly recommend hiring an attorney to walk you through the motion and to help you build up enough evidence to overcome the deficiencies in your first filing.