Philosophy & Society

Who Judges the Judges? The Long Search for a Fair Verdict

From trial by ordeal to algorithmic sentencing, how humans have tried to take bias out of judgment

Listen to the opening

0:002:00

A 22-minute episode of CompoundThis episode is free to hear in the Compound app.

Compound is coming early 2027.

In this episode

  1. The Ordeal and the Logic of Outsourcing Judgment
  2. The Jury, the Enlightenment, and the Dream of Neutral Reason
  3. The Psychology of the Judging Mind
  4. Nuremberg and the Problem of Designing Fairness Under Pressure
  5. Algorithms, Risk Scores, and the Bias We Cannot See
  6. Other Architectures of Justice
  7. The Hardest Problem in Justice

The opening

Imagine you are accused of a crime you did not commit. The evidence against you is circumstantial, the witnesses are uncertain, and the judge presiding over your case has been awake since four in the morning. A widely publicized 2011 study of Israeli parole boards reported that judges granted far more parole requests just after a meal break, though other researchers argued the pattern came mostly from the order in which cases were heard. Your fate, in other words, may hinge not on what you did or didn't do, but on when someone decided to take a break.

This is not a flaw in an otherwise functional system. This is the system.

For as long as human beings have organized themselves into communities, they have needed a way to answer the question: who decides what is fair? And for just as long, the answers they have devised have said less about justice itself than about the deepest assumptions of the cultures that produced them. What counts as evidence? What counts as guilt? What counts as a fair mind? These questions sound procedural. But underneath them lives something far more profound — a set of beliefs about human nature, about the reliability of perception, about whether any of us can ever truly see clearly enough to judge another.

This episode is about the long, strange, deeply human attempt to build an invisible tribunal — a system of judgment that transcends the limitations of the judges who operate it. It is a story that begins with fire and water, passes through the courtrooms of the Enlightenment, touches the ruins of Nuremberg, and arrives, today, at a piece of software that assigns risk scores to human beings before they have even been sentenced.

The story of justice is not a story of progress from irrationality to reason. It is something stranger than that.

The episode continues in the Compound app.