OPENAI
The self-improvement loop
OpenAI is calling for global standards around AI systems that could help build more capable AI.
The company is focused on recursive self-improvement, or RSI, where AI takes on more of the research used to develop future models.
OpenAI says fully autonomous RSI is not happening today, but AI is already helping speed up some of its research.
OpenAI says this could make AI progress much faster. It could also help with safety research, including alignment, security and keeping humans involved.
But the company says fully autonomous RSI should not be pursued unless people can still keep control.
Its concern is that AI research could become too fast or complex for humans to properly oversee.
In brief:
RSI could let AI play a bigger role in building future AI.
OpenAI says fully autonomous RSI is not happening yet.
It wants global standards for safety, oversight and reporting.
The loop gets loopy
OpenAI wants countries to create shared technical standards for advanced AI.
These could cover how AI capabilities are measured, when humans should step in and how serious AI incidents are reported.
OpenAI says the standards would not automatically become laws or approval systems. Each country would decide how to use them.
It also wants the US to lead the international effort, working with AI safety institutes and standards groups around the world.
We haven’t built the thing yet and someone has already scheduled the standards meeting. Exquisite.- MG