Habr AI→ original

"First Form" showed how to maintain a company map so AI doesn't make mistakes

"First Form" showed why corporate AI begins delivering convincing but incorrect answers even without model failures. The problem often lies not in the LLM…

AI-processed from Habr AI; edited by Hamidun News
"First Form" showed how to maintain a company map so AI doesn't make mistakes
Source: Habr AI. Collage: Hamidun News.
◐ Listen to article

"First Form" described a problem that almost any corporate AI faces: it's not enough to build a map of data, processes and terms once. If it isn't updated along with the company, the system starts giving confident answers, but increasingly off the mark.

Why the map grows outdated

In their article, the company shows that a corporate knowledge map becomes outdated not just because of old regulations. The work practices themselves change: employees coordinate tasks in a different order, move part of discussions to chats, add manual checks, create new workarounds. At the same time, data sources shift: part of the answer might live in CRM, part in tasks, reports, documents, or integrations. For AI this is critical, because the correct answer depends not on a single file, but on an up-to-date routing between multiple systems.

A separate risk is the company's code, configuration and language. APIs migrate, services split apart, fields and categories appear and disappear, and familiar abbreviations start meaning different things for different teams. In this situation, an outdated map is more dangerous than its absence: if there's no map, the system honestly doesn't know the answer. If the map is old, it continues to deliver plausible answers, and that's exactly why they're easier to believe. The error here doesn't look like a crash, but like an "almost right" recommendation that takes the user in the wrong direction.

Two control loops

First Form's solution is to maintain the map in two control loops. The first is automatic: it regularly reads the company's digital footprint and searches for changes where they've already manifested. Configuration snapshots of the platform, employee questions in tasks and comments, and inventory of subject areas all come into play. The system collects this into normalized structures, organizes it by domains like CRM, HR or finance, and updates the map not as a whole, but by separate "knowledge boxes."

This approach reduces the risk that AI will reassemble its understanding of the company from scratch with each request. After this, the map doesn't throw the question directly into general semantic search. For each subject area, a navigator is built that guides the query top-down: first it checks whether there's already a ready rule, dashboard or document, and only then moves to more free-form scenarios.

In the article, this routing is described as a set of five levels that the system goes through until the first working answer:

  • normative base: regulations, policies, SLAs
  • ready dashboards and reports
  • documentation with the answer already described
  • search across specific data and objects
  • passing the question to a human or recording a gap

This scheme matters not just for speed. It limits semantic drift: if the answer already exists as a rule or report, AI shouldn't re-derive it through general search. The automatic loop also helps understand where people really can't find knowledge. At First Form, after analyzing the Q&A flow, they found that a significant part of recurring questions were already covered by the map, but employees simply didn't see the right entry point to the needed material.

Where an expert is needed

Automation handles the question "what changed" well, but doesn't understand what should be considered the norm for the business. That's why the second loop is expert-driven. It's needed when you have to confirm the correct routing to an answer, resolve conflicting terms, distinguish a stable practice from a temporary workaround, or honestly acknowledge a gap in the map.

For example, the same query might formally lead both to CRM analytics, an activity report, and discussion of a specific deal, but only the process owner decides what counts as the correct entry point in the company.

"If a company has no living navigation, AI either delivers no real

benefit, or creates a false sense of reliability."

In the second loop, each problematic signal becomes a managed object: with a problem type, context of occurrence, and a responsible party for fixing it. The expert doesn't rewrite the map by hand, but makes a targeted decision at the point of uncertainty—confirm the route, clarify a term, add a new layer of description, or make no change.

This is the essence of the approach: AI shouldn't be an autonomous interpreter of chaos. It needs a working architecture where bottom-up updates are complemented by thoughtful validation from above.

What this means

For business, this is a good shift in how we discuss corporate AI. The main problem often isn't which LLM to choose, but how alive the navigation through data, processes and roles is. First Form's approach shows that useful AI in a company isn't just a model and search—it's ongoing work to maintain the knowledge map. Otherwise, the system will sound confident at exactly the moment when trusting it becomes dangerous.

ZK
Hamidun News
AI news without noise. Daily editorial selection from 400+ sources. A product by Zhemal Khamidun, Head of AI at Alpina Digital.

Want to stop reading about AI and start using it?

AI News is a curated feed of AI/tech news. Hamidun Academy teaches you to use AI systematically in your work.

What do you think?
Loading comments…