FrontierThe story, in brief

RL²: Fast reinforcement learning via slow reinforcement learning

OpenAI's RL² proves neural networks can learn to learn—cutting adaptation time from hours to minutes.

Illustration of a transparent lens revealing connected networks across layers of paper.
Exploring the next frontier of AI research.AI illustration by KeyNews
The KeyNews take

Why it matters

OpenAI demonstrates a foundational capability for AI agents: meta-learning through reinforcement learning. RL² shows that models can be trained to rapidly adapt to new tasks without retraining, a critical breakthrough for practical AI deployment at scale.

The key facts

10 to know
  1. RL² (reinforcement learning squared) architecture enables fast task adaptation

  2. Reduces task adaptation time significantly vs. traditional RL approaches

  3. Published Nov 2016 by OpenAI research team

  4. Foundational work on meta-learning and agent generalization

  5. Demonstrates neural networks learning learning algorithms directly

  6. RL² (reinforcement learning squared) enables fast task adaptation

  7. Published by OpenAI November 2016

  8. Meta-learning approach: slow RL training enables fast RL deployment

  9. Addresses generalization and few-shot learning in RL agents

  10. Foundational work for modern AI agent architectures

Go to the source

OpenAI Blogopenai.com

Read original report
Back to today's editionMore frontier news

The wider picture

View all
Illustration of a transparent lens revealing connected networks across layers of paper.
AI illustration by KeyNews
Frontier01

Alibaba Unveils Zhenwu V900 — and Plans Qwen Models With Up to 10 Trillion Parameters

Alibaba is advancing on two fronts simultaneously: announcing a custom AI accelerator (Zhenwu V900) and committing to massive model scale (10T parameters for future Qwen releases). For practitioners, this matters as a credible third-party capability play outside the US-China licensing squeeze; for enthusiasts, it's a significant lab-race signal about training compute and parameter scaling as competitive levers.

TechRepublic
Illustration of a transparent lens revealing connected networks across layers of paper.
AI illustration by KeyNews
Frontier02

Kyutai Releases Voice of Reason: A Speech-Native Model that Solves Spoken Math with Reinforcement Learning

A new capability frontier: models that reason directly in speech without transcription bottlenecks. This changes how we think about multimodal reasoning and what's possible with open-weight releases at scale.

MarkTechPost
Illustration of a transparent lens revealing connected networks across layers of paper.
AI illustration by KeyNews
Frontier03

Claude Opus 5.5, GPT-6 Sol, GPT-6 Luna, and a new price war

Frontier labs are shipping upgraded reasoning and multimodal models in rapid succession, signaling acceleration in the capability race. Simultaneous price cuts reshape AI economics for practitioners.

Simon Willison