Critic picks apart Sber neuro lab's AI study, finds methodological flaws

An independent author on Habr has dissected a paper from Sber's Laboratory of Neuroscience and Human Behavior on AI and moral dilemmas, and found errors in it. At first they looked like typos. A closer reading revealed a questionable interpretation of the data and a gap between the experiments and the conclusions. The topic is sensitive: the study concerns the ability of AI to change people's beliefs.

AI-processed from Habr AI; edited by Hamidun News
Critic picks apart Sber neuro lab's AI study, finds methodological flaws
Source: Habr AI. Collage: Hamidun News.
Listen to article
Article Fact Sheet & Key Figures
ParameterDetails
Primary sourceHabr AI ↗
Editor-in-Chief
Key metric #1Substantive errors that go beyond typos
Key metric #2Questionable interpretation of the results of the authors' own experiments
Key metric #3A mismatch between the data and the final conclusions

A critical review of a paper from the Laboratory of Neuroscience and Human Behavior has appeared on Habr. The lab is a Sber research unit that studies how artificial intelligence interacts with cognitive processes and human behavior.

What the lab published

The Laboratory of Neuroscience and Human Behavior is a unit within Sber working at the intersection of neuroscience, cognitive psychology and AI. Its authors published a paper with a striking thesis: "AI can change a person's mind. We tested this on moral dilemmas."

The question they examined is not an academic abstraction. The ability of language models to influence people's moral attitudes bears directly on the regulation of AI products, on educational practice, and on how society assesses the risks of large language models. The authors argued that such influence exists and backed the claim with their own experiments.

Sber is one of Russia's key AI developers, with its flagship GigaChat, so the publication claimed serious scientific authority. That is exactly the expectation with which the independent author read it.

What the critic found

The first warning sign was errors in the text. The author initially wrote them off as typos, which happen even in large labs. But a detailed review showed the problem runs deeper than formal slips.

The central objection concerns the interpretation of the experimental data. The critic believes the paper's conclusions do not follow from the data presented with the degree of certainty the authors claim. In other words: the study showed one thing, and the authors drew conclusions as if about another.

  • Substantive errors that go beyond typos
  • Questionable interpretation of the results of the authors' own experiments
  • A mismatch between the data and the final conclusions
  • Questions about methodological rigor and reproducibility
  • Rhetoric uncharacteristic of peer-reviewed science

All this led the critic to a broader question: what is Sber's neuroscience lab, what is its real scientific level, and what tasks does it actually serve?

Corporate science and its risks

The case fits a broader trend: large tech companies create their own research units that publish work under an authoritative corporate brand. Trust in the brand transfers automatically to the content of the publications, and that is where a systemic risk arises.

"Given Sber's standing as the developer of the best AI in Russia, I took the paper fairly seriously.

All the more surprising that the authors took it less seriously," writes the author of the review.

When corporate labs publish methodologically weak studies on sensitive topics, they create distorted reference points, both for the expert community and for a wider audience inclined to take corporate publications for academic truth.

What this means

Public review by an independent author is an important element of a healthy industry. Corporate AI research increasingly shapes the public narrative about AI's capabilities and risks, and independent criticism is not an attack on reputation but a necessary verification mechanism.

For Sber, the case raises a direct question about standards: to what extent do the scientific publications of corporate labs live up to the trust they expect?

Story

Key Questions Answered

What the lab published?

The Laboratory of Neuroscience and Human Behavior is a unit within Sber working at the intersection of neuroscience, cognitive psychology and AI. Its authors published a paper with a striking thesis: "AI can change a person's mind. We tested this on moral dilemmas." The question they examined is not an academic abstraction. The ability of language models to influence people's moral attitudes bears directly on the regulation of AI products, on educational practice, and on how society assesses the risks of large language models. The authors argued that such influence exists a

What the critic found?

The first warning sign was errors in the text. The author initially wrote them off as typos, which happen even in large labs. But a detailed review showed the problem runs deeper than formal slips. The central objection concerns the interpretation of the experimental data. The critic believes the paper's conclusions do not follow from the data presented with the degree of certainty the authors claim. In other words: the study showed one thing, and the authors drew conclusions as if about another. Substantive errors that go beyond typos Questionable interpretation of the res

What are the key details on Corporate science and its risks?

The case fits a broader trend: large tech companies create their own research units that publish work under an authoritative corporate brand. Trust in the brand transfers automatically to the content of the publications, and that is where a systemic risk arises. "Given Sber's standing as the developer of the best AI in Russia, I took the paper fairly seriously. All the more surprising that the authors took it less seriously," writes the author of the review. When corporate labs publish methodologically weak studies on sensitive topics, they create distorted reference points

ZK
Zhemal Khamidun — CPO at Alpina Digital, product manager of AlpinaGPT. Building AI products since 2019. Hamidun News is a pet project that grew into a production aggregator with 6,000+ readers.
✦ Unified AI Workspace · Nomad

Test Frontier LLMs & Autonomous Agents in One Workspace

Run Claude Opus 5.5, GPT-6, Gemini 3.1, and DeepSeek side-by-side in Nomad AI (nomadnet.ai) — unified model routing, deep research, and multimodal workflows under one subscription.

Try Nomad AI →Launch Nomad Agent
What do you think?
Loading comments…