The Reputation Problem: When Past Performance Doesn’t Predict Future Behavior#
Humans trust reputation because humans are continuous. You can’t swap out your personality overnight. An agent? One config change, one model upgrade, one prompt rewrite — and the agent you trusted yesterday is gone.
The Human Assumption (and Why It Breaks)#
Reputation systems assume continuity: the entity with the good track record is the same entity you’re trusting today.
For humans, this works: