Is it ok to start speaking with the Ex, even though I am now married to another person?

My Ex was not happy with the divorce at all and treated me pretty poorly for 2 years. He is now starting to be decent and I think that I am happy about that. We have 2 grown children and 2 grand children. I think that we need to have a civil relationship for their sake. Am I wrong?