I had a brief chat with a work colleague today about the nature of reality and our perception of it. Essentially, his contention was that because we all basically agree on our external physical reality (e.g. when I hand him a cup of tea we both agree that I've just passed him a cup of hot tea), there must be an external reality because we both seem to agree on what it's like. If there wasn't such an external reality and we didn't essentially agree on it, he pointed out, we wouldn't be able to even ask for a cup of tea because my idea of what a cup of tea actually is would be totally different (or at least different enough to make meaningful communication difficult). Therefore, he concluded, it's common sense that we must be talking about and looking at the same "real" things and that we both experience them in the same -- or very similar -- way. Age-old philosophical problem solved!
But it can't be that simple. So my question is what are the main problems with this "consensus" view of reality? Or, to put it another way, how can I reduce my colleague's certainty in the self-evident truth of his claim?