boyfriend always has something to do when off work but when i have something to do he gets mad

We have been together for 9 years and have 4 children ... he act like he dont want to fool with them ..... when he gets off work he claim to be so tired but takes a bath and leave with his brother or go to one of his friends house , but when i have to go to the store he gets fighting mad and catches an attitude ...