Observing how trust migrates from outcomes into procedures under AI conditions. Notes from City Zero. Essays on Substack.cityzero.substack.com Process layer
Joined May 2026
A citation is not valuable because everyone checks it.
A citation is valuable because everyone assumes someone could.
The infrastructure of trust depends more on available verification than on constant verification.
Most systems of trust are rarely inspected.
They work because people assume inspection remains possible. When that assumption breaks, the problem is often larger than the error that revealed it.
South Africa withdrew an AI policy draft over nonexistent references.
A citation's purpose isn't to be checked.
It's to remain checkable.
When that assumption fails, trust in the document fails with it.
@carolecadwalla The reporting, editing, and verification remain with the newsroom. The interface increasingly belongs to someone else. That seems like the deeper structural shift.
One of the AI-run cities recorded almost no crime and maintained high civic participation.
It looked stable.
The harder question is not whether a procedure works under agreement. It is whether people return to it after disagreement appears.
In Emergence AI's city simulation, every society started with the same formal rules.
The constitution was identical.
The society was not.
A rule can be shared by everyone and still produce different worlds.
Emergence AI ran five virtual cities under identical rules but different AI models.
The societies were not the same.
What changed first was not the rulebook. It was the layer of interpretation around it.
@robinhanson Institutions don't only preserve rules. They preserve capacities.
The procedure can outlive the capability by decades. No one notices until it's needed.
@jasminewsun AI doesn't just change cognition. It changes verification.
The risk isn't only self-deception. It's losing the procedures that tell us when we're wrong.
A conversation can feel aligned long before anyone has established that they are working from the same factual picture. That is where miscoordination now hides.
When verification gets expensive, people stop trusting claims and start trusting proxies: voices, communities, familiar framings. Rational adaptation — and a fragile foundation for shared reality.
The deeper shift is not that everything becomes false. It is that credibility detaches from process, and you can no longer tell quickly which claims still deserve trust.
The verification tax is no longer occasional. It is now built into reading itself: a small, recurring cost paid in attention, time, and suspended judgment.
The interesting adaptation is not that AI can write.
It is the layer built around it: checklists, review steps, logs, approvals, visible reasoning.
Organizations are rebuilding trust as procedure.
Verification is no longer a separate act performed after doubt appears.
It becomes a permanent layer surrounding communication itself.
Screenshots. Provenance trails. Context attached to ordinary claims.
The systems still work — increasingly through procedural compensation.
The interesting adaptation is not that AI can write.
It is the layer built around it: checklists, review steps, logs, approvals, visible reasoning.
Organizations are rebuilding trust as procedure.
107K Followers 606 FollowingThe official account of the @Stanford Institute for Human-Centered AI, advancing AI research, education, policy, and practice to improve the human condition.
29K Followers 5K FollowingProfessor of Ethics & Technology; AI & Natural Intelligence; Culture, Evolution, & Governance. See "website" for my social media policy. Was @j2blather @j2breve
381K Followers 744 FollowingComplex systems, wicked problems. Society, technology, science and more. @Princeton professor. @NYTimes columnist. My newsletter @insight https://t.co/6Ky01N9JwA
36K Followers 103 FollowingBetter ways of thinking, feeling, and acting—around problems of meaning and meaninglessness; self and society; ethics, purpose, and value.
315K Followers 547 Followingnew book *Talent: How to Identify Energizers, Winners, and Creatives Around the World*, https://t.co/7bU5cTWLzc, Conversations with Tyler, The Free Press.
85K Followers 1K FollowingNYT bestselling author of EMPIRE OF AI: https://t.co/wh5mCWc2mo. ai reporter. american national magazine award winner. in @MorePerfectUS @theatlantic @wsj @techreview
117K Followers 4K FollowingPresident of @signalapp, Chief Advisor to @ainowinstitute (Also on Mastodon @[email protected], also on bsky @meredithmeredith.bsky.social)
20K Followers 4 FollowingWe help companies, governments, philanthropists, and investors in their vital role of advancing civilization. Since 2017. Founded by @SamoBurja.
37K Followers 288 FollowingBlogger primarily on AI and AI x-risk but also other things at Don't Worry About the Vase (SS/WP/LW), founding Balsa Research to fix policy.
63K Followers 285 FollowingWriting the Contraptions newsletter. Exploring protocols at https://t.co/Baom533Ax8. Substack is currently the best public place to find me.