Think about educating a toddler to climb a tree. At first, they will solely attain the bottom branches. With apply, they grasp climbing to the center. Finally, some attain the best limbs, whereas others, regardless of all their coaching, can’t attain the very high with no new approach or device.
That is exactly what researchers found once they investigated how synthetic intelligence handles more and more tough math issues.
In an interesting new research, “Climbing the Ladder of Reasoning: What LLMs Can — and Nonetheless Can’t — Remedy after SFT?”, scientists skilled AI fashions on step-by-step math options after which examined them on progressively more durable issues.
The outcomes? With only a bit of coaching, these AI programs shortly discovered to resolve medium-difficulty issues that after stumped them. But as the issues grew more durable, the AI hit clear limits, combating complicated multi-step calculations and fully failing on issues requiring inventive insights.
Similar to our tree-climbing little one, AI can solely go thus far with its present abilities earlier than it wants one thing basically new.
