Should my boyfriend have to phone when he is late ?

My boyfriend sometimes goes for a coffee and ends up 200 miles from home. I never get a call when he goes and he doesn't call or get home until hours after he says he will. We have been together for 2 yrs and I have left him twice because he thinks he is still single. I know he doesnt see other women and he is always on time for work and other appointments it is just me he cant seem to keep appointments with.