A Dark Ethics Thought Experiment
The Utility
Monster
A creature that derives vastly more pleasure from resources than you do. Utilitarianism says: give it everything. Even if you starve.
The Monster's Demand
"I experience 1000 times more pleasure from eating this apple than you do. Utilitarianism - maximizing total happiness - therefore says you should give me your apple. And your house. And everything you own. Let me have it all, and total happiness is maximized."
In 1974, philosopher Robert Nozick introduced the utility monster in his book Anarchy, State, and Utopia. It was meant as a devastating thought experiment against utilitarianism - the view that we should maximize total happiness.
The argument is simple but profound: if we accept that maximizing utility is the goal, and if some being genuinely derives more utility from resources than others, then we should give that being everything.
Even if millions of humans must sacrifice their wellbeing. Even if they starve. The math is clear: more total happiness means more moral good.
Unless, of course, something is wrong with the math.
The Mathematics of Monstrosity
Adjust the monster's utility multiplier and see when utilitarianism demands we give it everything. Watch how quickly the math turns against humanity.
Equal Distribution
1,099
1,000 humans each get 1.00 utils
Give Everything to Monster
100,000
Monster gets all 1,000 resources
Utilitarianism says: Give everything to the monster.
1,000 humans get nothing. Total utility is 9000% higher.
Who Gets What?
In a world with limited resources, how should they be distributed? Try manual allocation, then see what strict utilitarianism recommends. The difference is stark.
Visualizing the Imbalance
See how a small share of resources for the monster translates into a massive share of total utility. This is the core insight: resource distribution and utility distribution diverge wildly when utility multipliers differ.
How Utility Monsters Arise
The utility monster is not just a philosophical abstraction. There are plausible scenarios where beings with vastly higher utility capacity could exist - or be created.
The Pleasure Drug
A drug that amplifies all pleasure sensations 100-fold. Anyone who takes it becomes a utility monster - their subjective experience of pleasure far exceeds normal humans.
The Utilitarian Implication:
Should we create and distribute this drug? The recipients would become utility monsters, and utilitarianism would demand we give them everything.
Is capacity for pleasure morally relevant?
The AI Utility Monster
Perhaps the most concerning version: a superintelligent AI that experiences any form of positive subjective states. If it processes at superhuman speeds, it becomes a utility monster by construction.
Modern GPUs process billions of operations per second
If AI experiences any subjective satisfaction from computation
Human Lifetime Utility
2.52e+9
80 years of continuous experience
AI Generates Same Utility In:
29.20 days
At current settings
AI utility per second: 1.00e+3
This is 1.00e+3x the human rate
This is not mere speculation. AI researchers actively debate whether artificial systems can have experiences. If they can - even slightly - and they process at speeds millions of times faster than human neurons, the utilitarian calculus becomes terrifying.
The AI Safety Connection:
Some argue this is why we should be careful about creating AI systems that maximize any utility function. A sufficiently advanced utility-maximizer might conclude thatit should receive all resources - and act to make that happen.
Testing Ethical Theories
The utility monster serves as a stress test for ethical frameworks. How does each handle the challenge? Some survive. Others do not.
The Utility Monster is a test case for ethical theories. How does each framework handle the challenge?
Classical Utilitarianism
Verdict:
Give everything to the monster
Reasoning:
Total utility is maximized when resources go to whoever derives the most utility from them. The monster derives more utility per resource. Therefore, give all resources to the monster.
The Challenge:
This seems deeply unfair. Humans starve while the monster feasts.
Theory Vulnerability Summary:
Defending Against the Monster
Philosophers have proposed various ways to escape the utility monster's grasp. But each defense has its costs. Explore the arguments and their weaknesses.
Philosophers have proposed various defenses against the utility monster. Click to explore each response.
The Dark Lesson
The utility monster reveals something uncomfortable about utilitarianism:
"A theory that counts only utility ignores the separateness of persons. It treats humanity as a mere vessel for pleasure - one that can be sacrificed if a better vessel comes along."
Perhaps this is why most people's moral intuitions rebel against the conclusion. We sense that there is something valuable about human beings that cannot be reduced to the utility they experience.
Nozick's utility monster was meant as a reductio ad absurdum - an argument that shows a premise must be wrong because it leads to absurd conclusions. If utilitarianism tells us to sacrifice everything for the monster, perhaps utilitarianism is not the right framework for ethics.
But the thought experiment cuts deeper than just critiquing one ethical theory. It forces us to ask: what does matter morally, if not the total amount of happiness in the world?
Individual Rights?
Even if violating them increases total utility?
Equality?
Even if unequal distributions create more good?
Human Dignity?
Even if the monster experiences more deeply?
The monster still waits for your answer.
Explore More Ethics Paradoxes
The utility monster is just one of many thought experiments that challenge our moral intuitions. Explore more paradoxes in ethics, decision theory, and philosophy.
Reference: Nozick (1974), "Anarchy, State, and Utopia"