Call the police. Make incident reports. Make the bully shut up. Get a restaining order and serve him to say 100% on his lot line. Stand up to the bully. Until you do, it will never, ever stop. Use the law, i.e. police and courts to vindicate your rights.
If this is gone on for years, you have lots of years to catch up upon.
Sounds like a horrible situation. You have a few options. I would recommend calling the police first. That way the situation is documented. Your neighbor may also get arrested for disorderly conduct or perhaps criminal damage to property (if any was harmed). I would call EVERYTIME he does something like what you are describing. Eventually the police will get tired of the reports and take action. Next, you can petition for a restraining order. You could file requesting he stop threatening you and attempting to/damaging your property. That option will of course cost you attorney's fees.