Why can't I hear (understand) others?

Since I was a child I've had hearing problems - but not physical hearing problems. I always test very well, but this doesn't mean I am able to "hear." When people are talking to me I frequently have to deduce what they were saying based on a few words I did hear out of a sentence (or two or three).