Should boyfriend spend thanksgiving at my house or at his brothers?

Been dating him a few months.. (I'm 25, he's 31) He is really sweet and treats me great. His sister-in-law just had a baby girl.. He's seen them a few times since the baby was born. They lives 3 hours away. Thanksgiving is my favorite holiday-- I do all the preparing and cooking. His brother is also having Thanksgiving (3hrs away).... He asked if I would be mad if he went to his brothers because he wants to see the baby. I haven't really answered yet. Should he be coming to my house? (I already thought I could tell him to come to my house for thanksgiving and then we could go to his brothers this weekend, but I can't go this weekend either.)