← posts

The Prophet Motive

Sam Altman has described his company as potentially the most important in human history. Dario Amodei has written thousands of words about the civilisational stakes of getting this right. Demis Hassabis speaks about solving intelligence as though it were a moral calling. These are not casual remarks made under pressure. They are considered positions, repeated and elaborated over years.

The easy response is to call it a performance. And some of it probably is. Describing your product as existentially significant is a very effective way to justify a valuation that no conventional business model would support. When your company is worth more than most countries' GDP while losing money, you need a frame larger than "useful software." Messianic language fills that frame.

But the cynical read misses something. These people may genuinely believe what they are saying. Genuine belief in a catastrophic risk is not irrational if the risk is real, and there are serious people, not just founders with stock options, who think it is. Sincerity and self-interest are not mutually exclusive. Someone can believe they are saving the world and benefit enormously from that belief. Both things fit in the same person without contradiction.

What the framing does, whether sincere or strategic, is move attention toward the prophets and away from the structure underneath them. You end up evaluating the personalities: is he genuine, is she just performing, do they really believe it? The more interesting question gets quietly set aside.

That question is: why should a private company control this at all?

Not "are they handling it responsibly" or "do they have good values." Those questions accept the premise. The premise is that it is normal and appropriate for technology capable of restructuring the global economy, or worse, to be developed and controlled by organisations accountable primarily to their investors. The messianic framing actually reinforces this. A prophet does not answer to a committee. The weight of civilisation requires a decision-maker, not a process.

Democratic institutions are slow and imperfect. International coordination on technology has a poor track record. These are real objections, and the founders raising them are not wrong. But "existing governance structures are inadequate" is an argument for building better ones, not for concentrating the decision in a founder with good intentions and a large fundraising round.

The mythology is genuinely absorbing. It has good narrative structure: brilliant people, enormous stakes, the fate of humanity hanging in the balance. It is much more interesting than a debate about regulatory frameworks and liability regimes. That is, in part, what it is for.