Should my husband, my children and I go to their parties when they don't make it to our parties?

My husband's family members don't always come to family parties because it is too far, they are too busy or just too much trouble. Yet, my husband feels in order to keep us together as a family we should make every attempt to go to their affairs. I feel my husband should talk to them and let them know it is unfair for us to always make it to their affairs when they don't come to ours. He feels it won't change anything and it really is unfair to the kids who will never get to see each other.