chetan.
AI & TechnologyMarch 18, 20265 min read

The Intent Gap in AI Engineering

By Chetan Dhandal

A Senior Developer opens a pull request generated by an AI agent. The syntax is flawless. The linter is green. Every unit test passes. Yet, within thirty seconds, the senior developer closes the laptop with a heavy sigh.

The code uses a library the team deprecated in 2022. It ignores the custom error-handling wrapper the team spent months standardizing. It is "correct" according to a textbook, but it is a foreign body inside the actual system.

The AI did not fail because it lacks logic. It failed because it lacks context.


The Global Average Problem

Most Large Language Models (LLMs) operate like a brilliant intern who has read every manual but has no long term memory of the office they are sitting in.

  • The Event: An engineer asks the AI to build a new microservice.
  • The Problem: The AI has been trained on a massive, public dataset. It defaults to the "Global Average", the most common way to solve a problem based on five years of Stack Overflow data.
  • The Action: It generates a solution using a complex distributed architecture because that was the trend in 2019.
  • The Outcome: The code is rejected because the team recently migrated to a modular monolith to reduce cloud costs.

Without specific historical intent, the AI is forced to guess. In software engineering, a guess usually results in technical debt.

Context Debt vs. AI Debt

Teams often blame "hallucinations" when an AI ignores a standard. However, the root cause is frequently internal documentation. If a standard is buried in a year old Slack thread or a stale Wiki page, it does not exist to the AI.

If a human new hire would struggle to find the source of truth, an AI agent stands no chance. We are not just facing AI debt; we are facing context debt. When the "map" of the system is vague, the AI cuts down the wrong tree with incredible speed.

From Coding to Editing

There is a growing tension regarding the "last 20%" of AI code. If a senior developer spends their afternoon fixing an AI’s architectural mistakes, they are no longer engineering. They are proofreading.

To solve this, the workflow must shift from Prompting to Chartering.

  • The Project Overview: This serves as the long term memory of the tech stack. It defines the "laws" of the codebase, permitted libraries, architectural patterns, and forbidden practices.
  • The Task Charter: This is a narrow contract of inputs, outputs, and acceptance criteria for a specific feature.

When an AI is given a blueprint instead of a vague suggestion, the baseline of its output shifts. The goal is not to eliminate the senior developer's review, but to ensure they aren't fixing the same foundational errors every day.

The Architect’s Role

The value of a senior developer is no longer found in their ability to remember syntax. It is found in their ability to curate the "Why."

In an era of infinite, cheap code, the only thing that scales is intent. The teams that succeed will not be the ones who prompt the best; they will be the ones who architect the best environments for their AI to operate within.

Enjoyed this?

Abhanga delivers one essay like this every Saturday.