Look at the actual restraining order. If it is a no contact order you cannot be around each other at all with out risking a felony charge on him. If the order state "peaceful" or "no negative contact" then you can be around eachother as long as there is no fighting, arguing etc. If you are unsure, contact the attorney who represented him. It could be a costly mistake for him so be sure to check on it don't just assume.
If the restraining order says that he cannot contact you then it would be a crime for him to do so. Whether or not it is peaceful, any contact would be a violation. You need to read the order and see what it says. If there is a no contact order then you would have to go back to court and ask the Judge to modify the order to allow contact.
If the language of the order specifically allows for "peaceful contact" then, yes, you may be around one another and/or reside together; however, for your boyfriend to avoid further criminal charges all contact he has with you must remain just as the order says...peaceful. Any acrimony, harassment or arguing he engages into with you can cause him to possibly violate the order which may also result in new charges filed against him.
NOTE: This answer does not constitute a guarantee, warranty, or prediction regarding the outcome of your legal matter. The information you obtain at this site is not, nor is it intended to be, legal advice. You should consult an attorney for an individual consult concerning customized advice regarding your specific situation.