when do i do my housework without getting in anyones way.

i work 4 days a week and i have 3 children so i do my housework on a saturday.my husband works mon - fri and does not want me doing housework on the weekend.he says i should do it in the week but i do the shopping on my only day off.he says i do too much housework and the house isn't dirty.he says he's only thinking of me.i feel guilty for wanting a clean house.