• Mindstream
  • Posts
  • Critics question OpenAI’s commitment to safety

Critics question OpenAI’s commitment to safety

Author

Matt V
January 07, 2025

OPENAI

Sam Altman has shared his ambitious plans for artificial intelligence in a new blog post.

He believes the company is ready to build artificial general intelligence (AGI) and is now aiming to develop "superintelligence."

Altman said superintelligent AI could greatly speed up scientific discoveries and innovation, leading to more prosperity.

He suggested it might arrive within a few thousand days and have a bigger impact than many expect.

AGI, as defined by OpenAI, refers to systems that can outperform humans in most important tasks.

Microsoft, OpenAI’s partner, defines AGI in more financial terms - they think such a system could generate at least $100 billion in profits.

Altman didn’t clarify which definition he meant but hinted that autonomous AI tools might start improving workplace productivity this year.

In brief:

  • OpenAI defines AGI as AI that outperforms humans, while Microsoft links it to $100 billion in profits.

  • Altman believes superintelligence could appear within a few years but admits there are still major challenges.

  • Critics are concerned that OpenAI is focusing more on commercial goals than AI safety.

Safety Vs speed debate

Altman said OpenAI’s goal is to create tools that benefit everyone, but he acknowledged current AI systems have limits.

They often make mistakes, can be expensive, and are not yet reliable enough.

Safety is also a major concern. OpenAI admitted in a July 2023 blog that it doesn’t yet have solutions to control superintelligent AI or ensure it behaves safely.

Current methods, they said, won’t work for AI systems that are far smarter than humans.

Recently, OpenAI shut down teams focused on AI safety, and several key researchers left, citing the company’s growing focus on profits.

OpenAI is also restructuring to attract more investors.

When asked about concerns over safety, Altman defended the company’s efforts, pointing to its track record and highlighting the importance of careful development.

So, we’re racing towards superintelligence now? Things are gonna get crazy.