A.H.
It sounds like a few are correct in saying you should talk to this neighbor.
I too, have a neighbor that is rude in behavior, to the point even my son questions it.
The thing I remember is that those that are rude, mean, etc. need to look at themselves in the mirror. Typically what this theory is: What we find annoying to us personally, is our own issue. When we project our bad behavior on others, it is typically due to a trait (we do not enjoy) in ourselves that is 'reflecting' back to us through said person (like looking in the mirror).
It sounds like this person has a personal issue that he is taking out on you. (and this happens frequently to everyone).
Is he correct to do so? No, but he apparently does not know how to resolve it. Continue being yourself and take the higher road. That is what I am doing with my neighbor. When I do have my days of not wanting to put up with it: I just ignore it~ do not waste the energy on them.
Good Luck!