FrontierThe story, in brief
Thinking with images
OpenAI o3 and o4-mini now reason WITH images, not just about them. Chain-of-thought visual perception is a new capability tier.
The KeyNews take
Why it matters
OpenAI's o3 and o4-mini models introduce visual reasoning directly into chain-of-thought processing, expanding multimodal capabilities beyond image recognition to true visual reasoning. This represents a material shift in how vision-language models process and understand images.
The key facts
4 to knowOpenAI releases o3 and o4-mini with visual reasoning in chain of thought
Models can now reason WITH images as part of their reasoning process
Represents breakthrough in multimodal perception capabilities
Capability: visual perception through reasoning chains
Go to the source
OpenAI Blogopenai.com
Publisher excerpt: OpenAI o3 and o4-mini represent a significant breakthrough in visual perception by reasoning with images in their chain of thought.