Hendrix's knowledge base (v1)

How Easy It Is to Fool Ourselves

How Easy It Is to Fool Ourselves

Humans can be incredibly stupid, including smart humans.

That sentence is satisfying because it points outward. The harder version points back at me. Intelligence does not only help a person find the truth. It can also make him better at defending what he already wants to believe.

Wanting the pattern

The mind is good at finding patterns. That ability lets us read faces, learn language, and build explanations from incomplete information. It also lets us turn coincidence into a message and desire into evidence.

Once I want an idea to be true, the evidence stops arriving on equal terms. Confirmation feels meaningful. Contradiction feels poorly informed, malicious, or beside the point. Confidence grows while the method underneath it gets weaker.

The Demon-Haunted World is partly about protecting wonder from this kind of deception. Carl Sagan does not treat skepticism as the enemy of imagination. He treats it as a way to keep imagination from quietly renaming itself as fact.

The appearance of rigor

Richard Feynman approached a related problem in his Caltech address on cargo cult science. An activity can copy the instruments, language, and gestures of science while avoiding the discipline that makes the result trustworthy.

That structure appears everywhere now. A chart can make a weak claim look measured. Technical vocabulary can hide a missing mechanism. An AI answer can arrive in a calm voice and still be wrong. The appearance of knowing is increasingly cheap.

The response cannot be to distrust everything forever. It is to keep one part of the mind available for the possibility that the preferred answer will fail. What evidence would change my mind? Did I look for it? Did I describe the weakness as clearly as the support?

Humility without paralysis

I do not want epistemic humility to become a more respectable form of indecision. I still need to act with incomplete information. The point is not to remove confidence. It is to make confidence answerable to something outside itself.

Sagan protects wonder from deception. Feynman protects rigor from performance. Both leave me with the same uncomfortable responsibility: when I test an idea, I am also testing the person who wants it to win.

Carl Sagan, Richard Feynman, The Demon-Haunted World, Science and Philosophy, Clarity, Uncertainty