Detatching is a process and yes, something so little as that can make you take a few steps backwards, but now you have to take a step forward and stop beating yourself up. The others are right. He knew it was your voice on the phone and all he did was ask for easy child and hang up. Maybe he needs to think you were short with him, even though it wasn't done purposely, in order for him to realize that he needs to step up to the plate and change his life.
You reached back out and tried to call, he didn't answer or call you back, now continue to detatch.
It's not easy, but you can do it ((((((((((((hug))))))))))))
