Yao Shunyu at Tencent: Why AI Research's Biggest Star Is Starting With the Basics

Yao Shunyu's move from Princeton to Tencent was one of the loudest stories in the industry. Now we have the first results: a new paper on In-Context Learning (ICL). Rather than simply scaling up parameters, Yao studies how models absorb knowledge on the fly from a prompt. That matters for understanding why LLMs sometimes behave like geniuses and sometimes like temperamental calculators. The work lays groundwork for the second half of the AI race, where in-context learning efficiency may matter more than raw compute.

AI-processed from Jiqizhixin (机器之心); edited by Hamidun News
Yao Shunyu at Tencent: Why AI Research's Biggest Star Is Starting With the Basics
Source: Jiqizhixin (机器之心). Collage: Hamidun News.
Listen to article

Imagine the world's best striker joins a new club and, in his first match, instead of just scoring goals, starts rewriting the tactics textbook. That is roughly what Yao Shunyu's first research paper under the Tencent banner looks like.

For those who missed it: Yao is a legend in narrow research circles. He gave us ReAct (Reason + Act) and Tree of Thoughts, teaching neural networks not just to output text but to plan their actions and reason. His recent move from Princeton to Tencent's research division hit the industry like a bomb. Now we are seeing the first results of that partnership.

Instead of immediately announcing a GPT-5 killer, Yao and his team chose to look under the hood of one of the most mysterious phenomena in large language models: In-Context Learning (ICL). If you have ever given a neural network a couple of examples in a prompt and it magically grasped the task, you have run into ICL. It is the model's ability to learn without changing its weights, right in the course of a conversation. Until now, the process resembled alchemy: we knew it worked, but did not quite understand how the model structures that knowledge internally. Yao's paper tries to turn that alchemy into rigorous science.

Why is Tencent putting its best minds on this particular area now? The answer lies in the current state of the market. The era when you could simply pile data and GPUs onto a model is coming to an end. The second half of the game is starting, and the winner will be whoever makes models smarter and more efficient at the architecture level. In-context learning is key to building truly autonomous agents. If a model understands context better, it makes fewer errors in complex reasoning chains and needs fewer computational resources to adapt to specific business needs. Tencent is clearly betting on the quality of reasoning, not on the number of parameters.

In the paper, the researchers analyze how input data distributions affect a model's ability to generalize. This is not just theoretical exploration. Understanding the mechanics of ICL makes it possible to build more stable systems that do not break because of a single poorly chosen word in an instruction. Facing fierce competition from Alibaba and DeepSeek, Tencent badly needs a technological edge that cannot be copied simply by buying another ten thousand H100 chips. It needs algorithmic breakthroughs, and Yao Shunyu is exactly the person who can deliver them.

It is also interesting how this work fits into the broader strategy of Chinese tech giants. We see a clear shift from copying Western architectures to attempts to lead fundamental research. Where Chinese companies were once more often the ones catching up, they now hire top scientists straight from the benches of leading American universities and give them carte blanche for deep research. This creates new dynamics in the industry, where the line between academic science and corporate development is finally disappearing.

Bottom line: Tencent is investing in the foundation, not the facade. If Yao Shunyu figures out the mechanics of in-context learning, the next iteration of Tencent's models could leave competitors far behind through efficiency rather than brute force. Could an understanding of ICL become the lever that overturns our view of what current architectures can do?

Story
ZK
Zhemal Khamidun — CPO at Alpina Digital, product manager of AlpinaGPT. Building AI products since 2019. Hamidun News is a pet project that grew into a production aggregator with 6,000+ readers.
✦ Unified AI Workspace · Nomad

Test Frontier LLMs & Autonomous Agents in One Workspace

Run Claude Opus 5.5, GPT-6, Gemini 3.1, and DeepSeek side-by-side in Nomad AI (nomadnet.ai) — unified model routing, deep research, and multimodal workflows under one subscription.

Try Nomad AI →Launch Nomad Agent
What do you think?
Loading comments…