Should I be ok with my wife of 18 yrs drinking with her ex and bro/sis who I do not associate with?

I quit drinking 12 yrs ago. due to health reasons and medications I cant have alcohol, I don't mind taking her out for drinks on occasions, I don't expect her to quit having a drink if she wants, I just don't want her at her ex's house drinking.am I wrong for feeling this way?