A Vision That Misses the Mark
On Monday, Mark Zuckerberg published a 6,500-word manifesto about personal AI, detailing the possibilities for the “personal superintelligence” systems Meta AI is building. While a version of the essay ran in the Wall Street Journal two weeks ago, this is the most detailed version he has shared. The ideas aren’t entirely new, as he has discussed them on Meta earnings calls, but the manifesto represents his most comprehensive attempt to paint a picture of a wonderful future shaped by abundant superintelligence.
Yet, even as Zuckerberg tries to promote his vision, he inadvertently reminds us of all the ways AI is likely to go wrong. This contradiction is precisely why many people find AI unsettling, and it’s worth examining why his approach isn’t doing the tech industry any favors.
The Trust Problem Tech Companies Can’t Ignore
Social media remains a sensitive topic in the tech industry, and Facebook as a product and Zuckerberg as a person are both unpopular with the U.S. public. Recent surveys show that 64% of Americans believe social media has been harmful to democracy, with similar percentages supporting stricter regulation across partisan lines. Just this weekend, a court fined the company $567 million for being harmful to children.
The fallout from social media is one of the central reasons for anxiety about AI’s social impact. Whether fair or not, the public does not trust tech executives to ensure new technologies positively impact society. Instead of acknowledging this and working to rebuild trust, Zuckerberg’s manifesto demonstrates over and over again why that trust was lost in the first place.
Abstract Philosophy Versus Real-World Consequences
Much of the manifesto is devoted to hazy generalities about intelligence, reminiscent of the vague statements Zuckerberg and Dorsey used to give about free speech. For example:
“As everyone gains more powerful tools, each person will become more capable of shaping the future, not less. … People and institutions with competing interests naturally check and balance each other to lead towards positive outcomes. The best and most realistic path to building a positive AI future is by delivering superintelligence to everyone.”
This is presented as an earnest philosophical conclusion, but it conveniently describes a specific product called “personal intelligence” that Meta is bringing to market. For those already inclined to distrust Zuckerberg, this might sound like an attempt to convince himself that nothing bad can happen.
Education: Help or Harm?
When Zuckerberg gets to specific examples, his claims become alarmingly out of touch with reality. On AI in education, he writes:
“Everyone will have a personalized tutor and coach with a PhD in every subject and unlimited patience to help you learn anything you want. Students will have extra help in areas they need it that is currently only available to those whose parents can pay.”
The product Zuckerberg describes already exists in consumer chatbots like ChatGPT, Claude, and Gemini. While these tools can be helpful for learning, their primary use in education has been to avoid it entirely. Students use their “personalized tutor” to do homework and write essays, and without robust watermarking, teachers have no way to verify which work is genuine.
This is a relatively low-stakes example of AI harms, but it’s a real problem happening right now. When technology designed for good has unintended negative consequences, and one of the world’s most powerful people refuses to acknowledge this, it understandably makes people nervous.
Legal System and Market Realities
Zuckerberg also offers a thought experiment about AI in the legal system:
“As a thought experiment, imagine only one person had a superintelligent lawyer. They would have an unfair advantage in court — even if they were wrong on the merits. … But now imagine everyone has a superintelligent lawyer. In this case, justice would be carried out much more fairly and efficiently than it is today.”
This example is loaded with assumptions. While legal AI might improve access to justice, it could also add complexity to an already bureaucratic system or unleash a wave of vexatious litigants that clog the works. The fact that Zuckerberg isn’t worried only makes others more concerned.
Even when describing Meta’s business practices, Zuckerberg’s language takes on an oddly abstract character:
“For those who want to pay to use more compute, there will be a dynamic auction mechanism that will guarantee that everyone gets the lowest price possible for the intelligence and compute they’re using.”
While Zuckerberg is right that a freemium model allows for more access, there’s a reason consumer AI products insulate users from spot pricing. Surge pricing is a terrible user experience, especially for tools people rely on for work. It’s unclear whether Zuckerberg actually plans to implement dynamic auctions or if this is just philosophical speculation.
The Communication Gap
There are better ways to address these concerns. Sam Altman and Dario Amodei do a better job communicating with the public, acknowledging AI’s dangers, emphasizing precautions, and trying to build trust. Without some form of trust-building, the AI industry may struggle to survive failures when safeguards inevitably break down.
Mark Zuckerberg’s AI manifesto ultimately does what he likely intended to avoid: It reinforces public distrust and highlights the gap between tech leaders’ visions and the realities people actually experience.
