The Privacy Paradox of AI

In the eyes of many privacy advocates, AI is just another surveillance technology. It supercharges online tracking and real-world spying tools, sifts through vast troves of everyone’s data to spit out its results, and then encourages users to share their deepest secrets and desires with a cloud-hosted large-language model. Surveillance capitalism made AI possible, and AI returns the favor by making surveillance more powerful and the businesses that run on it more data-rich and profitable than ever.

Andy Yen, founder and CEO of Proton, is among the most influential voices in the tech industry who equates AI with privacy invasion. Proton is one of the world’s most popular encryption-focused tech companies, offering end-to-end encrypted versions of Google services like Gmail, Docs, Sheets, Calendar, and Meet. Yen says the push to integrate AI into every consumer tech product—whether people want it or not—is driving new users in droves to Proton’s products.

Yet Yen is not anti-AI, he says, any more than he is anti-internet. In late June, Proton released the latest version of its very own AI chatbot, Lumo—just one way that Proton is integrating AI ever more deeply into its suite of tools, but seeking to do so in a way that’s more voluntary and preserves users’ privacy far more than the typical tech giant.

From Particle Physics to Privacy

Yen’s journey to the helm of a privacy-focused tech company is unconventional. He is a trained particle physicist who worked at CERN, the European Organization for Nuclear Research, on the Large Hadron Collider—the world’s largest particle accelerator. But his career took a sharp turn after the 2013 leaks by Edward Snowden, which revealed the extent of government surveillance programs. Inspired by the need for accessible encryption, Yen co-founded Proton in 2014.

“I’m not actually a tech person or even an entrepreneur by training, so I really happened into this field a little bit by accident,” Yen said in a recent interview. “I used to work at the Large Hadron Collider, which is a particle accelerator. It’s the largest in the world. And what you may not know is that every once in a while, the accelerator gets turned off for upgrades, and these upgrades can take a long time.”

During one such downtime, Yen found himself reflecting on the implications of the Snowden revelations. He realized that if he, a physicist, felt the need for secure communication, then ordinary people likely did too. That realization led to the creation of Proton Mail, which now boasts millions of users worldwide.

Proton’s Approach to AI

Proton’s foray into AI might seem contradictory for a company built on encryption. After all, AI models typically require access to vast amounts of data to function, and encryption is designed to keep data inaccessible. However, Yen argues that AI and privacy are not mutually exclusive. Proton’s AI chatbot, Lumo, is designed to run on-device or in a way that minimizes data exposure, giving users control over their information.

“We believe that AI can be built in a way that respects user privacy,” Yen said. “It’s about giving users the choice to opt in, rather than forcing AI on them. And it’s about processing data locally whenever possible, so that sensitive information doesn’t have to leave the user’s device.”

This approach is a stark contrast to tech giants like Google and Meta, which have been criticized for using user data to train AI models without explicit consent. Proton’s model is based on transparency and user control, aligning with its broader mission to protect online privacy.

The Business Case for Privacy

Yen’s stance on AI is not just philosophical; it’s also a business strategy. As concerns about data privacy grow, more users are seeking alternatives to mainstream tech services. Proton has seen a surge in sign-ups, particularly after controversial AI integrations by other companies. Yen believes that privacy is a fundamental right, and there is a growing market for products that respect it.

“People are becoming more aware of how their data is being used,” Yen said. “They’re looking for services that don’t treat them as the product. That’s where Proton comes in.”

Proton’s business model is also distinct: it is structured as a non-profit foundation, which means it is not beholden to shareholders and can prioritize user privacy over profit. This structure has allowed Proton to maintain its commitment to encryption and privacy, even as it expands into new areas like AI.

The Future of AI and Privacy

Yen acknowledges that AI presents significant challenges to privacy, but he remains optimistic about the potential for coexistence. He envisions a future where AI is used to enhance privacy, rather than undermine it. For example, AI could be used to automatically redact sensitive information or detect phishing attempts, all while keeping data encrypted.

“We’re just scratching the surface of what’s possible,” Yen said. “The key is to build AI in a way that is transparent, accountable, and respects user consent. That’s the only way AI will be sustainable in the long run.”

As AI continues to permeate every aspect of technology, the debate over privacy will only intensify. Proton’s approach offers a blueprint for how companies can innovate without compromising user trust. Whether other tech companies will follow suit remains to be seen, but Yen is confident that the industry will eventually have to adapt.

“In the end, privacy is not a luxury; it’s a necessity,” Yen said. “And AI will have to learn to live with it.”

This article is based on reporting by Wired. Read the original article.

Originally published on wired.com