Is it right for me to work & never have access to the bank account that my paycheck goes into?

I've been living with a guy for a couple of years now. For the last year I've been working and my check is direct deposited into his bank account along with the child support checks that I receive every other week. I never have any money. My own kids can't ask me for necesseties. HIS kids ask him for things and he buys them. He yells at my kids if they ask. He acts like there is nothing wrong. And to top it off he is charging on his credit cards for repairs on the house. While I'm paying all the bills & He doesn't have a job and isn't looking for one either.