WeFair-2B Query Rewriter Lifts CTR by 2.951% in WeChat Short-Video Search
Researchers at East China Normal University and WeChat trained a compact model, WeFair-2B, to rewrite ambiguous video-search queries without distorting the user's intent. In a 10-day A/B test, CTR rose 2.951%, the share of effective video views rose 2.593%, and the share of query reformulations fell 2.350%. The gains came from an SFT → DPO → GRPO pipeline with a strict final-stage reward. The model already handles more than 100 million queries per day. • Training: SFT on broad data, DPO on viewing behavior, GRPO on exact match • Rules filter out about half of the candidates, and LLMs let through roughly a third • Inference without a chain of reasoning: the model outputs the rewritten query directly
AI-processed from Hugging Face Daily Papers; edited by Hamidun News
Short-video search lives on ambiguous queries: a user types two words, and what they want to see depends on their recent searches and views. A team at East China Normal University has described WeFair, a way to train a compact 2B-parameter model that rewrites a query using the user's context without replacing the user's goal. The WeFair-2B model already runs in WeChat short-video search and serves more than 100 million queries per day. In a 10-day A/B test, relative CTR rose 2.951%, the share of effective video views rose 2.593%, and the share of query reformulations fell 2.350%.
The problem: engagement-based ranking pulls away from the query
Previous approaches distill the reasoning of large models into a small rewriter, then fine-tune it on downstream content-consumption signals: what the user watched after seeing the results. The authors point to a side effect. This kind of reward pushes the model toward queries that surface "sticky" content rather than what the person was looking for. This is called intent drift. In the paper's example, the query "crepe cake" drifts toward recipes, although the user wanted to watch people eating the cake. The rewritten query still draws on the user's real history, so formal checks have trouble catching this kind of error.
Large models are a poor fit for the task for two reasons. They understand the varied intents of a specific platform's users less well, and the latency of each call is too high for real-time search. In production, then, you need a small model that also decides whether to rewrite a query or leave it as is.
Three stages with different signal strictness
The idea behind WeFair is to match each training stage to its own level of feedback reliability.
- Demonstrations (SFT). Training starts with "context → query" records, then moves to reasoning over the context, then to directly predicting whether to reformulate or keep the query. A less precise but broader signal is acceptable here.
- Preferences (DPO). Pairs of candidates are distinguished by downstream consumption, and the model learns to choose those associated with a better hit on personal intent.
- Verification (GRPO). The reward is given only for an exact match with the user's actual reformulation, or with the decision to leave the query unchanged. The authors add no graded similarity scores, retrieval rewards, or judge-based rewards.
Further analysis shows that broad supervision helps at the SFT stage, while strict verification at the final stage yields better quality than the auxiliary rewards the authors tested. According to the authors, finer-grained signals reduce rewriting accuracy. At inference, the model immediately outputs a short rewrite or a "keep" marker, without generating a chain of reasoning, which saves latency.
How the training data was collected
The data comes from anonymized WeChat search sessions. For the "context → query" pool, the team selects queries with at least one effective video view (longer than ten seconds) and checks them with DeepSeek-V4-Flash for support from the context. For the reformulation pool, it links adjacent queries within one session: the first produced no video click, and the second produced an effective view. Queries triggered by system suggestions are excluded.
A two-stage filter follows. Rules remove additions made of Chinese function words, pairs with little character overlap (by Jaccard similarity), and cases with no contextual grounding. This eliminates about half of the candidates. Then three reasoning LLMs vote on intent continuity and information gain, after which three more check the "context bridge" between the added detail and the query. Roughly a third pass. Examples rejected at the last step become hard negatives for the keep decision, which teaches the model not to invent personalization without grounding.
What to keep in mind
The results come from WeChat's internal platform and cannot be independently reproduced. Part of the pipeline depends on Chinese-language rules and on closed behavioral logs. The source description includes no numerical offline-metric comparison with baseline models, only a statement of superiority in overall accuracy and intent preservation. The practical takeaway for teams building rewriters in search or recommendations: do not mix signals of different reliability at the same stage. Broad behavioral data works for the initial stage and for preferences, but the reward in the final RL step should be as clean as possible. The original query remains the anchor for retrieval and ranking, while the rewrite only expands the candidate pool.
- Nov 2, 2026Manager-less DreamTeam swarm wrote trustcheck for $5.68 and passed 13 of 13 hidden tests
- Nov 2, 2026DeepSeek open-sources Super-agent prototype: p95 task completion time of 15.7 minutes vs. 29.5
- Nov 1, 202616 models tested on 7 search tools: Exa averaged 10.5 out of 14, SearXNG about 3
- Nov 1, 2026MoneyGate safety layer blocked all 42 fraudulent requests to local AI models
Key Questions Answered
What are the key details on The problem: engagement-based ranking pulls away from the query?
Previous approaches distill the reasoning of large models into a small rewriter, then fine-tune it on downstream content-consumption signals: what the user watched after seeing the results. The authors point to a side effect. This kind of reward pushes the model toward queries that surface "sticky" content rather than what the person was looking for. This is called intent drift. In the paper's example, the query "crepe cake" drifts toward recipes, although the user wanted to watch people eating the cake. The rewritten query still draws on the user's real history, so formal
What are the key details on Three stages with different signal strictness?
The idea behind WeFair is to match each training stage to its own level of feedback reliability. Demonstrations (SFT). Training starts with "context → query" records, then moves to reasoning over the context, then to directly predicting whether to reformulate or keep the query. A less precise but broader signal is acceptable here. Preferences (DPO). Pairs of candidates are distinguished by downstream consumption, and the model learns to choose those associated with a better hit on personal intent. Verification (GRPO). The reward is given only for an exact match with the use
How the training data was collected?
The data comes from anonymized WeChat search sessions. For the "context → query" pool, the team selects queries with at least one effective video view (longer than ten seconds) and checks them with DeepSeek-V4-Flash for support from the context. For the reformulation pool, it links adjacent queries within one session: the first produced no video click, and the second produced an effective view. Queries triggered by system suggestions are excluded. A two-stage filter follows. Rules remove additions made of Chinese function words, pairs with little character overlap (by Jacca
Test Frontier LLMs & Autonomous Agents in One Workspace
Run Claude Opus 5.5, GPT-6, Gemini 3.1, and DeepSeek side-by-side in Nomad AI (nomadnet.ai) — unified model routing, deep research, and multimodal workflows under one subscription.
The AI world, distilled — once a week
Seven stories that actually mattered, hand-picked. No noise, no reposts, no press releases.
Done! Check your inbox for a confirmation.