I think that a lot of our common intuitions about punishment require that pure retribution be considered as one of the goals thereof. It is easy to conceive of scenarios in which punishment does not act (1) as a deterrent to crime or (2) to relieve the suffering of any injured parties. Often it seems that one of the main reasons we have to punish someone is simply our conviction that he somehow "deserves" to suffer.
I'm sure that most people don't see this as problematic. Yet I wonder in particular how a utilitarian would address the question of retribution, since it is not obvious (at least to me) just what the utility of retribution is.