Former Employees of Top AI Firms Sign an Open Letter Warning about the Risks of AI

Former employees of top Silicon Valley firms such as OpenAI, Google’s DeepMind, and Anthropic have signed an open letter, warning about the risks of AI and how it could even lead to human extinction.

The letter has been signed by 13 such employees. Neel Nanda of DeepMind is the only one among them who is still employed in one of the AI firms they wrote against.

To clarify his stance on the issue, he also wrote a post on X where he said that he only wants companies to guarantee that if there’s a concern with a certain AI project, the employees will be able to warn against it without repercussions.

He further added that there’s no immediate threat that he wants to warn about. This is just a precautionary step for the future. However, the content of the letter paints a different picture.

What Does the Letter Say?

The letter acknowledges the benefits AI advancement can bestow upon society but it also recognizes the numerous downsides that tag along.

The following risks have been highlighted:

In short, everything we see in an apocalyptic sci-fi movie can come to life.

The letter also argued that the AI firms are not doing enough to mitigate these risks. Apparently, they have enough “financial incentive” to focus more on innovation and ignore the risks for now.

It also added that AI companies need to foster a more transparent work environment where employees should be encouraged to voice out their concerns instead of being punished for it.

The company later retracted this move, saying that it goes against its culture and what the company stands for, but the damage was already done.

Among all the companies mentioned in the letter, OpenAI is in more trouble owing to the string of scandals it has landed in lately.

For example, in May this year, the company disbanded a team that was responsible for researching the long-term risk of AI less than a year after it was formed. However, the company did form a new Safety & Security Committee last week headed by CEO Sam Altman.

Several high-level executives have also left the company recently, including co-founder Ilya Sutskever. While some were left with grace and sealed lips, others such as Jan Leike revealed that OpenAI has digressed from its original objectives and is no longer prioritizing safety.

Openai’s Response to This Letter

Addressing this letter, an OpenAI spokesperson that it understands the concerns surrounding AI and firmly believes that a healthy debate over this matter is crucial. So the company will continue to work with the government, industry experts, and communities around the world to develop AI safely and sustainably.

‘We’re proud of our track record providing the most capable and safest AI systems and believe in our scientific approach to addressing risk.’ – OpenAI

It was also pointed out that whatever new regulations have been imposed to control the AI industry, it has always been supported by OpenAI. Quite recently, OpenAI disrupted 5 covert operations backed by China, Iran, Israel, and Russia that were trying to generate content and debug websites and bots to spread their own propaganda.

Speaking of giving employees the freedom to voice out their concerns, OpenAI highlighted the fact that it already has an anonymous hotline for workers for that exact reason.

Despite what the company says about taking steps, we never completely know what’s going on within their walls.

For example, although these companies have policies against using AI to create election-related misinformation, there’s evidence that OpenAI’s image-generation tools have been used to create misleading content.