How do you try and make it clear to your ex that you don't want to have any contact with him, not ready friend

He wants me to come and stay the night all the time even though I mad it clear that I don't want to be with him. I was always the last thing he would think about. He only tryed to drive me away when we were together. I found out i couldn't change him, and was time to move on even know it hurts, and I still want to hold him. However, I don't because he doesn't realize that I should come first before his games, pot, and whiskey.