Why can't we just go out by ourselves?

My husband and I work different shifts. We bowl on Sunday nights and his son is there EVERY Sunday. He is not a child - he is a grown child. How do I tell him this is our night out - we need to be with the other bowlers and have our conversations without watching what we say.