Live Nov 18 · Cohort 3Nov 18, 19:00 MSK — free hands-on AI agents live workshop · Live Cohort 3 starts Nov 23Join Nov 18 Live →Cohort 3 (Nov 23)
ReleaseInsight · On RadarHabr AI→ original

The agent ran a 40-hour loop: how to integrate AI into development without regressions

In his pet projects, the author went from quick results to regressions and a 40-hour agent loop that had to be stopped manually. The conclusion is simple: code-generation speed is only one stage, and without documented requirements and mandatory checks, an agent breaks what already worked. A Flutter banking-app demo showed that clear non-functional requirements can lead an agent to produce a perfectly respectable architecture.

AI-processed from Habr AI; edited by Hamidun News
The agent ran a 40-hour loop: how to integrate AI into development without regressions
Source: Habr AI. Collage: Hamidun News.
Listen to article
Article Fact Sheet & Key Figures
ParameterDetails
Primary sourceHabr AI ↗
Editor-in-Chief
Key metric #1A quality gate should be mandatory in CI, not a request in a prompt
Key metric #2An agent loop needs time and cost budgets, as well as stop conditions
DemoBank27 hours of Codex work and 19 hours of wall-clock time

Debates over whether developers are still needed in the age of vibe coding usually come down to emotion. Instead, the author of an analysis on Habr shows what happens in practice when an agent is given a task without guardrails.

Where vibe coding breaks down

In Xenodrift, a pet project that was rebuilt several times, earlier decisions stopped being respected as new changes were introduced. Regressions appeared, and some features simply vanished. The reason was mundane: the requirements had never been documented, and there was nothing available to verify compliance. Each time, the agent worked with the current fragment of context and did not remember what had previously been agreed.

Poor code quality is not inevitable, however. In DemoBank, a banking-app demo, the author specified requirements for performance, feature reuse, and the design system while deliberately avoiding any prescribed architecture. The result was a modular, feature-first structure with elements of Clean Architecture, BLoC/Cubit for state management, and idempotency and retry logic in the network layer. The fine-payment feature works both inside the app and as a standalone component without pulling in unnecessary dependencies.

Performance was tested on an actual low-cost realme RMX3760. During a one-minute run involving 12,000 operations, 0.25% of frames exceeded the 16.7 ms budget, against a target of less than 1%. The author is careful to note that this represents just one device and one scenario.

Speed is not the same as readiness

DemoBank required about 27 hours of total Codex work and roughly 19 hours of actual wall-clock time after accounting for parallel execution, plus 2–3 hours of the author's own time. Running performance tests on the phone proved especially expensive. A team's metric should not be “how quickly the code was generated,” but “how long it took from defining the task to an accepted change,” including review and rework.

Harness, quality gates, and accountability

By AI Harness, the author means the agent's working environment: project context, tools, restrictions on actions, automated checks, and the process for handing the result over to a human. The key ideas are:

  • Checks that determine acceptance should run automatically and block merging. Writing “run the tests” in a prompt does not guarantee this.
  • The “keep going until the checks pass” loop must be bounded. One of the author's projects ran for 40 hours before he stopped it manually. Time and cost limits are required, and when an error repeats without progress, the agent should stop and report what it tried.
  • After a forced stop, the process itself should be fixed, not just the code. The agent may have misunderstood the task, the project map may be outdated, or the model may be too weak.
  • Every decision needs a clearly identified owner: product and analytics approve behavior, the module owner verifies its contracts, and a developer reviews the agent's interpretation of the task before code is written.

Context, contracts, and domains

A large context window does not guarantee that information will be used correctly: the Lost in the Middle study demonstrated that quality depends on where data appears within the context. That is why teams need a module map, up-to-date contracts, and ADRs. The author proposes keeping an API contract in a single source, such as TypeSpec, then generating OpenAPI, documentation, and client code while checking consistency in CI. Outdated ADRs should be marked as superseded.

A contract does not replace behavioral tests, however. An idempotency key can be described in a schema, but preventing a double refund can only be verified through a separate scenario. Consider an e-commerce example: with a poor project map, an agent may call the payment provider's API directly from the orders module, preventing refunds from appearing in the payment ledger. DDD and automatically enforced architectural rules can help here, along with a review by another model.

What to do

The limitations are clear: this is one author's experience with small projects, without an independent code audit. Still, the conclusions are transferable. Record requirements in specifications such as OpenSpec, Spec Kit, BMAD, or Kiro; make quality gates mandatory; set budgets for agent loops; and assign owners to maintain context. The developer's role is shifting from typing code to defining guardrails and accepting the result.

Story

Key Questions Answered

Where vibe coding breaks down?

In Xenodrift, a pet project that was rebuilt several times, earlier decisions stopped being respected as new changes were introduced. Regressions appeared, and some features simply vanished. The reason was mundane: the requirements had never been documented, and there was nothing available to verify compliance. Each time, the agent worked with the current fragment of context and did not remember what had previously been agreed. Poor code quality is not inevitable, however.

What are the key details on Speed is not the same as readiness?

DemoBank required about 27 hours of total Codex work and roughly 19 hours of actual wall-clock time after accounting for parallel execution, plus 2–3 hours of the author's own time. Running performance tests on the phone proved especially expensive. A team's metric should not be “how quickly the code was generated,” but “how long it took from defining the task to an accepted change,” including review and rework.

What are the key details on Harness, quality gates, and accountability?

By AI Harness, the author means the agent's working environment: project context, tools, restrictions on actions, automated checks, and the process for handing the result over to a human. The key ideas are: Checks that determine acceptance should run automatically and block merging. Writing “run the tests” in a prompt does not guarantee this. The “keep going until the checks pass” loop must be bounded. One of the author's projects ran for 40 hours before he stopped it manually.

ZK
Zhemal Khamidun — CPO at Alpina Digital, product manager of AlpinaGPT. Building AI products since 2019. Hamidun News is a pet project that grew into a production aggregator with 6,000+ readers.
✦ Hands-On AI Engineering · Hamidun Academy

Build & Ship Production AI Agents Without Boilerplate Code

Start your free 72-hour trial at Hamidun Academy (academy.hamidun.com) — interactive lessons on Claude Code & Cursor, live Tech Radar, and production agent templates.

Start 72h Free Trial →Vibe-Coding Intensive
What do you think?
Loading comments…