Tech Visionary Says the Big AI Labs Don’t Get What People Want

Tim O’Reilly’s yardstick for measuring the worth of a company, person, or society has long been create more value than you capture. It’s no surprise that O’Reilly—publisher, internet pioneer, VC, conference organizer, and dispenser of tech wisdom—is applying that metric to the way people design and use AI. Specifically, he’s pushing for a future where open-source AI is an elixir for the masses. He worries that, like Microsoft in the 1990s, today’s hyperscalers are trying to lock users into their products. So he is promoting efforts to open-source AI technology—not only making critical technical details such as neural-net weights accessible, but unlocking the whole stack of an AI system, giving control to designers and users.

O’Reilly sees AI as a new creative medium, which he uses extensively—and even has a blog about his chats with it. During our conversation, we discovered that we disagree about AI’s role in producing original content. Guess who took which side.

STEVEN LEVY: You are all in on open-source AI. Make your case.

TIM O’REILLY: First, let’s make sure we’re talking about the same thing. When most people talk about open-source AI, they’re really just talking about open-weight models. It’s much bigger than that. In the ’90s, when everybody else was focused on open-source licenses, I was like, “No, no, it’s about the architecture of the system. Does it enable participation?”

Why is that needed?

The big labs are reading the future wrong. They have told themselves a narrative where having the biggest, best model is the key to the future. Big models like Claude are optimizing for particular use cases, but they aren’t necessarily the use cases that people want. I want to embed my own special sauce. The most important thing is having a clean separation between the model, the harness, and the application. And right now we’re not getting that. They built an architecture of control rather than an architecture of freedom and participation, so they have the ability to track you.

Isn’t it against the interests of big companies to give up control?

Oh, it’s totally against their interests. But that doesn’t mean that they’re making the right strategic decision. For a long time, the latest and greatest models were really better for everything. Now they’re better for some things and worse for others. People are talking a lot about how Fable and Sol are worse writers than the lower-level models. [Note: Anthropic and OpenAI would disagree.] The breakthroughs that we’re getting in so-called frontier AI are actually pushing us further away from what ordinary people are going to need. We could win frontier AI here in the US, and China will kick our ass because they have lower-level models diffused widely through society. The goal is to give people the ability to innovate freely, to paint outside the lines.

People worry that open-source software can be a security risk, since bad actors will be able to jump the frontier model’s guardrails.

All of the cybersecurity incidents we’ve seen are from the frontier models. So risks like cybersecurity and the ability to develop pathogens are actually an argument for slowing down the frontier models more than an argument for restricting open-weight models.

So you feel that with open source the AI powers will no longer be dominant?

I don’t predict the future. but I will say the world is proceeding the way that I hoped it would. What if the big frontier models end up like mainframes or supercomputers—aimed at really hard problems, which are not actually the thing that gets diffused throughout society? People are building things like Pi, an open-source [agentic] harness. One of the things we’re working on at my nonprofit, the AI Disclosures Project, is the idea of an open-memory consortium. Mark Zuckerberg’s thesis is, he’s going to lock you in because Meta will give you the AI that knows you best. The open-source vision needs to say no to this. Open source can give you the ability to switch models, switch providers, and maintain all the context that it needs.