Dean hears the sharp sigh and it's about all the attitude he's ready to handle. Even as a perfectly normal person, he didn't have infinite patience and he turns just in time to grab Castiel's arm before they separate, holding him in place.

"If you had come when you were supposed to, you wouldn't be hungry now. There is no one else here to cook for you. There's no one else to clean. We are alone. Your impatience isn't going to get you far, even if I cared about it."