He wants phone sex, I hate phone sex....

I have been in a long distance relationship with my boyfriend for the past few years. I am a student who is almost graduating, and he already has a career and a house. The relationship is going well, except for one thing. He wants phone sex. Every few weeks he will all of the sudden get grumpy on the phone and I ask him what's wrong, he will tell me that it's the usual thing he wants that I don't want. He calls me lazy and uncaring, for not telling naughty things to him, and it is driving me crazy.

We've tried before, but I feel like an idiot talking into the phone. Since I still live with my parents, I'm always paranoid that they might hear something, which doesn't help either. I've even fallen asleep on him while he is trying to talk dirty. It really hurts that he tells me that I don't care about him, just because I don't touch myself with a phone in my hand. Am I really that uncaring? I would love to know what you all think about this situation.