How test-time scaling unlocks hidden reasoning abilities in small language models (and allows them to outperform LLMs)

Uncategorized

How test-time scaling unlocks hidden reasoning abilities in small language models (and allows them to outperform LLMs) A 1B small language model can beat a 405B large language model in reasoning tasks if provided with the right test-time scaling strategy.