Labor Day Fiasco - His Family Or Mine?

Both our families are having cookouts. The problem is that they live too far apart to go to both. Since we spent 4th of July with his family, I think we should go to my parents. He disagrees.

He thinks my family is boring and has a better time with his (obviously who doesn't). He said if I decide to go to my parents' cookout I can take the kids and he'll go to his parents alone.

It's not right that he gets to choose where we go all the time and he never compromises. We've been fighting over this for the past week.