Make sure that you have a current survey showing where the property line is. If this neighbor damages your property or puts his fence on your property, you can sue to have the fence removed and your property restored. If he installs the fence on the property line (but not over), then it is his fence and he must maintain it. Your convenience does not matter.
Mr. Goldstein is a Virginia-licensed attorney only. The information is not, nor is it intended to be, legal advice. You should consult an attorney for individual advice regarding your own situation. Answering this question does not in any way constitute legal representation. Contacting Mitchell Goldstein or the Goldstein Law Group does not constitute legal representation, nor is any information you provide protected by attorney-client privilege until otherwise advised.