Who is responsible for damage from a golf ball?

My opinion is: When you are on any golf course and your ball goes astray, that the person that hit the ball is responsible for any damage it causes to other people, homes, windows, etc. (The opposite opinion is that if you live on a golf course you should expect and accept any damage and/or responsibility).