If threatened call police.
If you call police b/c someone looked at your driveway, you're probably overreacting.
NOT LEGAL ADVICE. FOR EDUCATION AND INFORMATION ONLY. Mr. Rafter is licensed to practice before the state and federal courts in Virginia. There is no implied or actual attorney-client relationship arising from this education exchange. You should speak with an attorney licensed in your state, to whom you have provided all the facts before you take steps that may impact your legal rights. Mr. Rafter is under no obligation to answer subsequent emails or phone calls related to this matter.
Your driveway is probably open to public view, so peering over the wall into your driveway is not a violation of your privacy. Yelling at you is also probably not a violation of your privacy, unless they are making threats. That you should report to the police.
Contact the landlord and ask him for help controlling his tenant.