arXiv authors call for replacing a single annotation "truth" with a space of interpretations

A position paper has been published on arXiv (cs.AI, number 2610.10805, version v1) that challenges a basic assumption of most machine learning: that every example has one correct answer. The authors propose modeling an "interpretation space", meaning the set of plausible human judgments about the same input. They also want to separate meaningful ambiguity from ordinary annotation noise. In their view, five stages of a system's lifecycle need to be rebuilt: representation, training, evaluation, deployment, and governance.

A caveat up front. This is a conceptual paper. The abstract describes no new model, benchmark, or experimental results. The paper's value lies in how it frames the problem, and it should be judged on that basis.

Where the "single truth" breaks down

The standard pipeline looks like this. Several people label the same example. Their answers are merged by voting or averaging, and annotator agreement is checked with metrics such as Cohen's kappa or Krippendorff's alpha. Low agreement is taken as a sign of a bad instruction or careless annotators. Disagreements are then removed or treated as noise.

For tasks with an objective answer, this works. But when a system rates the toxicity of a remark, the emotion on a face, the appropriateness of a chatbot's reply, or the tone of a letter, different people see different things, and each can be right in their own way. These examples are given for illustration and are not named in the abstract. The authors' argument is that collapsing everything into a single target destroys information about the diversity of perception, judgment, and life experience. Meanwhile, systems increasingly do more than interact with people: they make decisions about them. A model that has absorbed the majority annotators' position as "truth" reproduces that position for every user.

What the authors propose

The central idea is to predict and store not a single label but a distribution of plausible judgments. The rest of the abstract is framed as a scheme for the whole lifecycle. The list below conveys it in substance; the abstract does not spell out the details of the methods:

• Representation. Data and target variables are described as a set of acceptable interpretations rather than a single label.
• Training. The model learns from the diversity of judgments rather than from their aggregated result.
• Evaluation. Quality is measured by how well the system reproduces the spectrum of interpretations, not by agreement with a single reference.
• Deployment. The system must account for the fact that several answers are acceptable for some inputs.
• Governance. The question "whose truth is built into the model" becomes a matter of governance.

The hardest part of the program is distinguishing meaningful ambiguity from noise. If any disagreement is declared ambiguity, sloppy annotation can be passed off as "diversity of opinion". If any disagreement is treated as noise, you end up with today's approach. The abstract does not say how to draw this line. Judging by the wording "we call for a shift", this is a direction for future work.

What to change in practice

Even without new methods, the paper points to several things teams can do right now:

• Store the raw individual annotations, not just the aggregated label. Once lost, the disagreement cannot be recovered later.
• Split tasks into those with an objective answer and those where the answer depends on interpretation. For the latter, low annotator agreement may be a signal rather than a defect.
• Look at the distribution of answers when evaluating a model. Accuracy against the majority vote hides who the model errs on systematically.
• Document who annotated the data: which groups, under which instructions, with what level of agreement. Without this, the question "whose truth" goes unanswered.
• Start with one task, such as content moderation or assistant response evaluation, and compare the model's behavior when trained on aggregated versus non-aggregated labels.

For companies whose products make decisions about people, this is a matter of accountability as well as quality: sooner or later an auditor or regulator will ask why the model considers this particular answer correct.