Should I live with my wife at her house even though I told her I couldn't get used to her house .

I live with my wife three days a week and and I live at my house the other four days. I live with my son and I made it perfectly clear when we got married three years ago that I didn't like the area where she lived.