OpenAI’s latest model, OpenAI o1, marks a notable advancement in artificial intelligence, particularly in its ability to perform complex tasks. Yang Zhilin, founder and CEO of Moonshot AI, praised the release as a significant milestone for the industry.

The gist is that perhaps o1 was devised to make use of the process-based reinforcement learning approach, especially since o1 also automatically makes use of chain-of-thought. Whereas generative AI usually requires a user to invoke chain-of-thought, o1 automatically does so. The user seemingly can’t prevent it from happening.

OpenAI's new o1 model uses the chain of thought reasoning to improve the response in complex tasks. It brings a paradigm shift in inference scaling.