When dating someone, is speaking to your ex forbidden?

About 3 years ago, my current boyfriend found out I occassionally (once every 7-8 months) spoke to my ex-boyfriend. Since then, I haven't spoken to the ex but my boyfriend is still upset about the situation. Whose right?