Webspinner Academy Introduction to AI · Lesson 10 of 15

Movement III · Who Controls It Lesson 10

Breakthrough Tooling Such as Claude Code

Coding tools got to agentic workflows first, and not because programmers are special. They got there first because code can be checked in seconds. The pattern they proved out generalises — and so does the evidence that it does not always help.

Runtime 6:30 Reading time 15 minutes Prerequisites Lesson 5 Volatility HIGH — review every 2 quarters Sources verified 13 Aug 2026

Learning objective

By the end of this lesson you can distinguish autocomplete-class tooling from agentic tooling; you can state the generalisable pattern — a persistent instruction file, plus tool access, plus a work loop — and apply it outside software; and you can describe what the strongest available evidence says about whether these tools actually make people faster.

Refresh notice

Feature sets in this category change faster than anything else in the course. Product specifics below are stamped as of August 2026 and are included as a worked example of a pattern, not as a feature list to memorise. Re-verify before recording.

10.1  Three generations in four years

Coding assistance passed through three distinct stages in about four years, and the distinction between them is not a matter of degree.

  1. Autocomplete. The tool suggests the next few lines. It sees the current file. You do all the integration and all the testing.
  2. Chat in the editor. You can ask questions and paste code in. The tool sees what you show it. You still do the integration and the testing.
  3. Agentic tooling. The tool reads the project, plans an approach, edits multiple files, runs the commands, reads the errors, and iterates.

The published framing of the difference is precise: traditional assistants suggest snippets and leave integration and testing to you, whereas agentic tools understand the project, plan an approach, and execute the workflow.1 Compare that list against Lesson 5's definition — model, tools, loop — and you will find it is the same thing. Agentic coding is not a separate technology. It is Lesson 5 applied to a domain where the tools are unusually good.

10.2  What agentic coding tools actually do

Claude Code is Anthropic's tool in this category, described in its own documentation as an agentic coding tool that reads your codebase, edits files, runs commands, and integrates with your development tools, available in the terminal, IDE extensions, a desktop app, and the browser.2 This course uses it as the worked example because its documentation is public and its two most transferable mechanisms are explicit.

Mechanism one — a persistent instruction file

A CLAUDE.md file placed in the project root is read at the start of every session, and holds coding standards, architecture decisions, preferred libraries, and review checklists.2

This is a small idea with a large consequence, and it is the part of this lesson most worth carrying away. Lesson 3 established that the context window is everything the model can see, and that nothing outside it exists. A persistent instruction file is a deliberate answer to that constraint: rather than re-explaining your conventions in every conversation, you write them down once, in a file, and the tool loads them every time. You are managing the context window as an asset instead of rebuilding it from memory each session.

Mechanism two — tool access through the standard protocol

The same documentation describes MCP integration letting the tool reach design documents, tickets, and other systems — the standard from Lesson 5.2 This directly addresses Lesson 4's copilot weakness: a tool embedded in one application sees only what that application sees, and a protocol layer is how it comes to see more.

FIG-10-01

The transferable template

Three components feeding one loop, drawn generically — no code, no terminal, no IDE anywhere in the image. Left: a document icon labelled persistent instructions — standards, conventions, checklists. Below it: a set of connectors labelled tool access. Right: the work loop from Figure 5.1, simplified. Beneath, four small vignettes showing the same template applied to software, research, document production, and operations. The image must argue that this pattern is not about programming.

Aspect 16:9 · 3200×1800 px · Brand palette: navy #00040c, silver-blue #a8c0d8, column gold #a87848 · Style: conceptual systems diagram

Figure 10.1. Persistent instructions + tool access + a work loop. The coding tools proved the template; the template is not about code.

10.3  Why this matters if you never write code

The generalisable pattern is not “AI writes software.” It is:

A persistent instruction file, plus tool access, plus a work loop. That template applies to research, document production, and operations without modification.

So why did coding tools get there first? Not because programmers are cleverer, and not because the models are better at code than at prose. Because code has fast, cheap, unambiguous verification. You run it and it either works or it does not. Lesson 5's first failure mode — compounding error over a long chain — is survivable exactly when each step can be checked automatically before the next one consumes it. Code has that. Most professional work does not, yet.

Which tells you where to look in your own work: the tasks that will absorb this pattern earliest are the ones where you already have a cheap automatic check. A reconciliation that must balance. A document that must validate against a schema. A dataset with known totals. Find your compiler, and the loop becomes safe to close.

10.4  The evidence on whether it helps is genuinely mixed

This section exists because the rest of the lesson would otherwise be an advertisement.

In July 2025, METR published a randomised controlled trial — the same design used in clinical drug trials — measuring the effect of early-2025 AI tools on experienced open-source developers working on real tasks in repositories they knew well. Sixteen developers, 246 tasks. The result was not the expected one: developers took 19% longer to complete tasks when allowed to use AI tools. Afterwards, the same developers estimated that AI had made them about 20% faster.3

−19% measured change in completion speed with AI tools (slower) METR RCT, July 2025 · n = 16 devs, 246 tasks 3
+20% the same developers' estimate of how much faster they had been METR RCT, July 2025 3
39pt gap between perceived and measured effect Derived from the two figures above

Three things must be said about this result, and leaving any of them out would be misrepresentation.

It is narrow. Sixteen experienced developers, working in large mature repositories they already knew intimately — close to the worst case for a tool whose advantage is unfamiliarity with a codebase. It does not generalise to a newcomer on an unfamiliar project.

It is dated, and METR says so. The tools studied were those available between February and June 2025, principally Cursor Pro with Claude 3.5 or 3.7 Sonnet. METR itself now labels the result historical, noting it does not necessarily reflect current tools or workflows.3 Reporting the finding without that caveat would be as dishonest as suppressing the finding.

The perception gap is the durable part. The speed number will age. The 39-point gap between what people believed and what was measured is a finding about human self-assessment, and it is the same phenomenon Roediger and Karpicke documented in learners who preferred re-reading to self-testing — a strategy that feels more effective and is less.4 Fluency feels like competence. That is why Lesson 14 insists on a written failure log rather than an impression.

Demonstration protocol

  1. Write the instruction file first, on camera. Five or six lines of real conventions. This is the transferable act and it should open the demonstration, not be buried in it.
  2. Give the tool a small real task, start to finish, in one take. Show the plan, the edits, the test run.
  3. Show the correction when something fails. Non-negotiable, as in Lesson 5.
  4. Time it. Actually time it, and compare against your honest estimate of doing it by hand. Say the number out loud even when it is unflattering — §10.4 is the reason.
  5. Show the same template on a non-coding task — a document produced against a written style guide, with a validation step. This is the beat that reaches the viewer who does not write software.

Key terms introduced here

Agentic coding
Tooling that reads a project, plans an approach, edits files, runs commands, and iterates — as opposed to suggesting snippets and leaving integration to you.
Persistent instruction file
A file read at the start of every session holding standards, conventions, and checklists. Context-window management as an asset rather than a chore.
Cheap verification
An automatic, fast, unambiguous check that a step succeeded. The property that makes a work loop safe to close, and the reason code went first.
Perception gap
The difference between measured performance and self-assessed performance. Measured at 39 points in the METR trial; the same mechanism as the illusion of competence in learning.

Evidence at a glance

Load-bearing claims in this lesson
ClaimSpecificsSource
Agentic tools differ in kind from assistants Understand the project, plan, and execute the workflow rather than suggesting snippets Note 1
Persistent project instructions are a first-class mechanism CLAUDE.md read at the start of every session; standards, architecture, checklists Note 2
Tool reach comes via the Lesson 5 protocol MCP integration to design docs, tickets, and other systems Note 2
A randomised trial found a slowdown, not a speedup 19% slower; 16 experienced devs, 246 tasks, mature repos, tools of Feb–Jun 2025 Note 3
…and the participants believed the opposite Estimated 20% faster — a 39-point perception gap Note 3
The study's own authors call it historical METR states it does not necessarily reflect current tools or workflows Note 3

The misconception to kill

“These tools replace the engineer.”

They compress the build loop. They do not supply judgement about what to build.1 Every capability in §10.2 operates on a goal someone else set, within conventions someone else wrote down, verified against tests someone else decided were the right tests. The instruction file is the clearest evidence of this: the tool's usefulness is bounded by the quality of the standards a human articulated.

The opposite misconception, equally worth killing: that the tools are hype. The strongest available evidence is genuinely mixed — a gold-standard randomised trial found experienced developers 19% slower on familiar codebases with early-2025 tools.3 Anyone who tells you the answer is simple, in either direction, has not read the study.

Self-check

Answer before revealing.4

State the generalisable pattern in one line, and explain why software got it first.

A persistent instruction file, plus tool access, plus a work loop. Software got there first because code has fast, cheap, unambiguous verification — you run it and it either works or it does not — which is exactly what makes Lesson 5's compounding-error failure survivable.

Why is a persistent instruction file more than a convenience?

Because the context window is everything the model can see and nothing outside it exists. Writing conventions into a file that loads every session converts the window from something you rebuild by memory each time into a managed asset — and it makes the standards reviewable, versionable, and shared across a team.

Summarise the METR result including all three caveats.

A randomised controlled trial found 16 experienced developers were 19% slower on 246 real tasks when allowed AI tools, while estimating they had been 20% faster. Caveats: it is narrow (experienced developers on mature codebases they knew well — close to the worst case); it is dated to tools available February–June 2025, and METR itself labels it historical; and the durable finding is the perception gap rather than the speed number.

Where in your own work should you look first for a task this pattern will fit?

Wherever you already have a cheap automatic check — a reconciliation that must balance, a document that must validate against a schema, a dataset with known totals. Find your compiler and the loop becomes safe to close. Without one, keep the human in the loop at every step.

Your team reports feeling far more productive since adopting an AI tool. What is the responsible next step?

Measure something. The METR participants felt 20% faster and were 19% slower, and the same illusion is documented in learners who prefer re-reading to self-testing. Feeling is not evidence about fluency-heavy work. Pick a repeatable task, time it both ways, and write the result down — which is precisely the practice Lesson 14 builds.

Instruction file template

Draft this for a real project — technical or not. It is the transferable artefact from this lesson.

Project / domain, and who the output is for:

Standards and conventions that should never need restating:

Decisions already made that must not be relitigated:

Review checklist — what must be true before output is acceptable:

What is my cheap automatic check? If there isn't one, what would it take to build one?

Endnotes

Source tiers: Primary peer-reviewed or archival; Institutional research body or government; Documentation first-party product or technical documentation — note that notes 1 and 2 are vendor documentation for the vendor's own product and should be read as description, not as evaluation; Journalism established newsroom; Trade vendor or aggregator.

  1. Documentation Anthropic, “Introduction to agentic coding,” on the distinction between traditional assistants that suggest snippets and leave integration and testing to the developer, and agentic tools that understand the project, plan an approach, and execute the workflow; and on these tools compressing the build loop rather than supplying judgement about what to build. First-party vendor material. claude.com/blog
  2. Documentation Claude Code documentation, “Overview.” Describes Claude Code as “an agentic coding tool that reads your codebase, edits files, runs commands, and integrates with your development tools,” available in the terminal, IDE extensions, desktop app, and browser; describes CLAUDE.md as “a markdown file you add to your project root that Claude Code reads at the start of every session,” used for coding standards, architecture decisions, preferred libraries, and review checklists; and describes MCP integration for reaching design documents, tickets, and other external systems. First-party vendor documentation. code.claude.com/docs
  3. Primary J. Becker et al. (METR), “Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity,” 10 July 2025; arXiv:2507.09089. A randomised controlled trial with 16 experienced open-source developers across 246 tasks in mature repositories, using tools available February–June 2025 (principally Cursor Pro with Claude 3.5 or 3.7 Sonnet). Developers took 19% longer with AI access while estimating post hoc that they had been about 20% faster. METR labels the result historical, stating it does not necessarily reflect current AI tools or developer workflows. metr.org · arxiv.org/abs/2507.09089
  4. Primary H. L. Roediger III and J. D. Karpicke, “The Power of Testing Memory: Basic Research and Implications for Educational Practice,” Perspectives on Psychological Science 1, no. 3 (2006): 181–210, documenting the “illusion of competence” — learners' systematic preference for re-reading over retrieval practice, a strategy that feels more effective and is less so. The structural parallel to the METR perception gap is this course's observation, not the authors'. doi:10.1111/j.1745-6916.2006.00012.x

Bibliography

Primary research

  • Becker, Joel, et al. (METR). “Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity.” arXiv:2507.09089 (2025). arxiv.org
  • Roediger, Henry L., III, and Jeffrey D. Karpicke. “The Power of Testing Memory: Basic Research and Implications for Educational Practice.” Perspectives on Psychological Science 1, no. 3 (2006): 181–210.

Product and technical documentation — first-party; read as description

Research organisation

  • METR. “Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity.” 10 July 2025. metr.org