Skip to main content

Context Engineering Isn't the New Software Engineering — But Ignoring It Is Still a Mistake


New article crafted between myself and Claude.AI both been critical but constructive about each 'others' contribution, and refinement of the replies and editing after. The starting prompt is shown after the references

Context Engineering Isn't the New Software Engineering — But Ignoring It Is Still a Mistake
What context engineering actually is
Why "the new software engineering" overstates it
The more defensible version of the argument
Where the evidence runs thin — and where curriculum reform gets hard
Conclusions

  • Context engineering is a real, evidenced, currently valuable skill — not hype invented from nothing. It sits downstream of genuine engineering problems (retrieval, state management, information curation) that graduates will encounter in real jobs.
  • It is not a replacement for software engineering fundamentals, and framing it that way overstates the case and risks looking like marketing rather than analysis.
  • The stronger, teachable claim is that context engineering may deserve an explicit place within software engineering curricula — built on top of prompt engineering, and taught through the same foundational material (databases, systems design, data structures) it draws on — rather than treated as a bolt-on module or left entirely to industry bootcamps.
  • The employability case is real in direction but currently thin in hard evidence, and should be presented to students as an emerging, plausible advantage — not a guaranteed one.
  • Universities considering this shift should be honest that it comes with real costs (crowded curricula, resourcing pressure, and a skill that may itself evolve quickly), and should design for adaptability rather than betting the curriculum on today's tools and terminology remaining unchanged.

References

Somewhere in the last eighteen months, a new phrase started showing up in job adverts, engineering blogs, and LinkedIn posts: context engineering. Depending on who you ask, it was coined by Shopify's CEO Tobi Lütke in a June 2025 tweet (García, 2026), by AI researcher Andrej Karpathy around the same time (Henrique, 2026), or by Phil Schmid at Google DeepMind (Taskade Team, 2026). That three separate, credible-sounding origin stories are circulating at once is itself revealing — it suggests a term that caught fire faster than anyone could agree on where it started.

The claim now attached to it here is that computer science and software engineering graduates who don't learn a little about it (even if that is it is all hype) are making a mistake. It's a claim worth taking seriously, because there's real substance underneath the hype. But it's also a claim worth pressure-testing before it gets baked into degree programmes — because a lot of what's currently written about context engineering comes from course-sellers, consultancies, and careers blogs with an obvious commercial interest in the answer being "yes, urgently, buy my course."

Strip away the marketing and the underlying idea is fairly simple. A large language model (like the one powering ChatGPT, Claude, or Copilot) only knows what's in front of it at the moment it answers — its "context window." Early on, most of the effort in getting good results went into prompt engineering: phrasing your question cleverly. There's some empirical support for this being an era-bound approach rather than a durable one: a 2026 study on prompt optimisation for text classification notes that as models improve, their ability to interpret varied instructions also improves, which may itself reduce the returns to careful prompt-wording over time (Navigating the Prompt Space, 2026).

But as AI systems evolved into agents — tools that read files, query databases, call other software, and work across many steps rather than answering one question — teams discovered something important. The quality of the output depends far less on how cleverly you phrase the request, and far more on what information the model has access to when it answers: the right documents, the right tool results, the right memory of what happened three steps ago, in the right order, without being drowned in irrelevant noise. This shift is documented directly in the academic literature, not just industry blogs. One 2026 paper on context engineering for multi-agent systems describes how, as a query moves from a single question to a 20-50 step autonomous agent task, the role of the initial instruction diminishes step by step, until at the deepest level the model's next decision is driven not by the original request but by the accumulated "working state" the orchestrating system has assembled in the context window — and it is the quality of that assembled state, not the original wording, that determines the outcome (Vishnyakova, 2026). The same paper documents a distinct failure mode this creates: agents running dozens of steps accumulate stale intermediate results and tool logs in their context, causing them to "get lost in the middle" and fixate on outdated information rather than the current task — a problem no amount of clever initial prompting can fix, because the failure happens deep into a session the human isn't actively steering (Vishnyakova, 2026).

A large-scale empirical study of real-world "agent context files" (the persistent instruction files such as CLAUDE.md and AGENTS.md that developers write to steer coding agents like Claude Code, OpenAI Codex, and GitHub Copilot) adds a further layer of evidence. Analysing over 2,300 such files across nearly 2,000 open-source repositories, researchers found that developers treat these files as living, frequently-updated configuration rather than one-off documentation — most are revisited across multiple commits rather than written once and left — and that prior research consistently shows repository-level, knowledge-driven context produces substantial gains in code correctness and reliability over simple, unadorned prompts (Chatlatanagulchai et al., 2025). In other words, in real production codebases, engineers are already spending far more ongoing effort curating what an agent sees than crafting the wording of any single request.

Anthropic's own engineering team describes this well: context engineering is the natural progression of prompt engineering, concerned with curating and maintaining the optimal set of information for a model at every step, not just crafting one good instruction (Anthropic, 2025). Others put it more bluntly — one practitioner defines it as curating what the model sees so that you get a better result (Thoughtworks, 2026). A commonly used analogy is a new employee: a good prompt is like a clear job description, but if that employee has no access to the company database, the client history, or the internal wiki, a well-written job description won't save them (American Technology Consulting, 2026). Context engineering is building that access.

There's solid technical evidence that this actually matters. Research from the vector-database company Chroma, in a report called "Context Rot," documents that model performance measurably degrades as more tokens are added to the context window — even well within the model's technical limit — a phenomenon sometimes called the "lost in the middle" problem (Chroma, 2025). A follow-up benchmark, LOCA-bench, extends this by systematically testing language agents under controlled and extreme context growth, reinforcing that degradation under large or poorly curated contexts is a measurable, reproducible effect rather than an anecdotal one (Zeng, Lee and Chroma Research, 2026). That matters because it shows dumping more information at a model is not the same as giving it better information — deciding what to include, exclude, and how to order it is a genuine, evidenced skill.

Software engineering is a mature discipline built over seventy years: formal methods, algorithmic complexity, systems design, testing theory, version control, security practices — a body of knowledge that's largely independent of which specific tools are fashionable this year. Context engineering, as it's practised today, looks much more like a skill for working effectively with a fast-moving category of tool (large language models) than a comparably deep discipline in its own right.

That distinction matters for a curriculum decision, because tool-specific skills have a habit of expiring. Even Anthropic's own engineers, who have every commercial reason to hype the practice, are candid that the amount of manual curation required may shrink over time, expecting agentic design to trend towards giving models greater autonomy with progressively less human curation as capability improves (Anthropic, 2025). In other words, the organisation most associated with the discipline expects part of today's context-engineering workload to be automated away by tomorrow's models. That's a legitimate reason for caution before treating it as a load-bearing pillar of a three- or four-year degree, in the way data structures or database theory are.

There's a useful historical parallel here. In the 1990s, engineers spent real effort hand-optimising code to fit inside tiny amounts of RAM — a genuine, valued skill at the time, rendered largely obsolete by cheaper memory and better compilers. Some of what's called context engineering today — carefully trimming and structuring information to work around a model's current limitations — may turn out to be a version of that: a skill for working around today's weaknesses, not a timeless engineering principle. The Chroma "Context Rot" finding cuts both ways here: it's real evidence that curation matters now (Chroma, 2025), but it also documents a model limitation that vendors have every incentive to engineer away, through better architectures and attention mechanisms, over the coming years.

Given all that, the useful version of the hypothesis isn't "context engineering replaces software engineering." It's narrower, and more sustainable: context engineering perhaps should be explicitly taught within software engineering degrees, alongside — not instead of — foundational skills like databases, data structures, and systems design, because it gives students an authentic, current setting in which to apply those fundamentals.

This reframing does real work. A module that teaches database design, retrieval systems, and state management purely in the abstract is a harder sell to students than one that teaches the same fundamentals through building a working AI agent that needs to fetch the right data, remember the right history, and avoid being overwhelmed by irrelevant information. The underlying computer science doesn't change; the context in which it's taught does. This is also consistent with how the distinction between prompt and context engineering is drawn in practitioner literature: prompt engineering concerns what you say to the model, while context engineering concerns what you provide to it — instructions, retrieved data, tool results, and history together (Murúa, 2026). And crucially, prompt engineering itself is no longer a specialist skill — it's now used daily by marketers, lawyers, teachers, and other non-technical professionals. If future software engineers want to keep a distinguishing technical edge over the growing population of prompt-savvy non-programmers, the argument goes, they need to go further: understanding not just how to phrase a request well, but how to architect the databases, retrieval pipelines, and tool integrations that make an AI system reliable in production. That's a reasonable claim, and it's one increasingly reflected in job postings for "AI engineer" and "applied AI" roles, even where the exact words "context engineering" don't appear.

Two honest caveats belong in any fair account of this.

First, the labour-market case is currently weaker than the technical case. Much of the "employers are demanding this" narrative traces back to careers-content sites and course marketing rather than primary data — actual job-postings analysis, occupational statistics, or graduate outcomes surveys. Sources such as The Interview Guys (2026), which frames context engineering as "the AI job title replacing prompt engineers," or DataHub's industry-insight series on the state of context management (DataHub, 2026), are useful directional indicators of industry sentiment, but they are commentary and vendor-adjacent reporting, not primary labour statistics. The technical argument for teaching curation and retrieval design is solid; but don't believe the hype get of the specific claim that "context engineer" is displacing other job titles at scale is not yet built on strong evidence - we need to keep a weather-eye on this.

Second, there's a real practical constraint: most software engineering curricula are already full, and accredited against benchmarks that don't currently mention context engineering. Making room for it may mean cutting something else out, or shifting teaching methods — for instance, toward more project-based learning, where these skills are absorbed through building things rather than through a dedicated module. That's plausible, but project-based teaching is more staff-intensive to run and assess than lectures and exams, which raises a fairness question: well-resourced universities can afford to restructure this way, while under-resourced ones may struggle to, potentially widening rather than closing the very employability gap the reform is meant to fix. There's also a slightly circular wrinkle worth naming: if AI tools increasingly help teach this material, the pedagogy becomes partly dependent on the same fast-changing tools whose long-term shape is uncertain — meaning the way it's taught may need to be revisited almost every cohort. Is that really a problem though in a fast changing discipline though?

American Technology Consulting (2026) Context Engineering: The New Skill Replacing Prompt Engineering in 2026. Available at: https://blog.american-technology.net/context-engineering/ (Accessed: 6 July 2026).

Anthropic (2025) Effective context engineering for AI agents. Available at: https://www.anthropic.com/engineering/effective-context-engineering-for-ai-agents (Accessed: 6 July 2026).

Chatlatanagulchai, W., Li, H., Kashiwa, Y., Reid, B., Thonglek, K., Leelaprute, P., Rungsawang, A., Manaskasemsak, B., Adams, B., Hassan, A.E. and Iida, H. (2025) 'Agent READMEs: An Empirical Study of Context Files for Agentic Coding', arXiv preprint, arXiv:2511.12884. Available at: https://arxiv.org/abs/2511.12884 (Accessed: 6 July 2026).

Chroma (2025) Context Rot: How Increasing Input Tokens Impacts LLM Performance. Technical Report. Available at: https://www.trychroma.com/research (Accessed: 6 July 2026).

DataHub (2026) State of Context Management Report 2026. Industrial Insight Series. Available at: https://datahubproject.io/ (Accessed: 6 July 2026).

García, B. (2026) 'Context Engineering: The Skill Replacing Prompt Engineering in 2026', DEV Community, 4 June. Available at: https://dev.to/gabrielhca/context-engineering-the-skill-replacing-prompt-engineering-in-2026-3lgd (Accessed: 6 July 2026).

Henrique, G. (2026) Context Engineering in 2026: The Skill That Makes AI Work. Available at: https://www.gilricardo.com/blog/context-engineering-2026-guide (Accessed: 6 July 2026).

'Navigating the Prompt Space: Improving LLM Classification of Social Science Texts Through Prompt Engineering' (2026) arXiv preprint, arXiv:2603.25422. Available at: https://arxiv.org/pdf/2603.25422 (Accessed: 6 July 2026).

Murúa, T. (2026) 'Context engineering vs. prompt engineering', Elasticsearch Labs, 20 January. Available at: https://www.elastic.co/search-labs/blog/context-engineering-vs-prompt-engineering (Accessed: 6 July 2026).

Taskade Team (2026) Context Engineering: Complete 2026 Field Guide for AI Agents. Available at: https://www.taskade.com/blog/context-engineering (Accessed: 6 July 2026).

The Interview Guys (2026) What Is a Context Engineer? The AI Job Title Replacing Prompt Engineers in 2026. Available at: https://blog.theinterviewguys.com/what-is-a-context-engineer/ (Accessed: 6 July 2026).

Thoughtworks (2026) Context Engineering for Coding Agents. Exploring Gen AI series, 5 February. Available at: https://martinfowler.com/articles/exploring-gen-ai/context-engineering-coding-agents.html (Accessed: 6 July 2026).

Vishnyakova, V.V. (2026) 'Context Engineering: From Prompts to Corporate Multi-Agent Architecture', arXiv preprint, arXiv:2603.09619. Available at: https://arxiv.org/abs/2603.09619 (Accessed: 6 July 2026).

Zeng, A., Lee, K. and Chroma Research (2026) 'LOCA-bench: Benchmarking Language Agents Under Controllable and Extreme Context Growth', arXiv preprint, arXiv:2602.07962v1. Available at: https://arxiv.org/abs/2602.07962 (Accessed: 6 July 2026).



The starting prompt: hypothesis "Context engineering is the new Software Engineering- all Software engineering students should learn context engineering to be employable" I want to produce a report around this. Ask me questions and be a pessimistic but constructive reviewer. Embed any evidence in the argument and replies to build consensus. Keep asking the questions until 'stop it' is typed in, and produce an article of 1000-3000 words suited to a general audience.


All opinions in this blog are the Author's and should not in any way be seen as reflecting the views of any organisation the Author has any association with. Twitter @scottturneruon

Comments

Popular posts from this blog

AI as a Mirror: Transforming Vague Student Ideas into a More Rigorous Project Agreement

The Problem: The "Generic App" and the "Time Sink" We’ve all been there: a student walks into a 1-to-1 with a vague desire to "do something with AI" or "build a fitness app." You spend 45 minutes trying to find a technical "hook" that justifies a Level 6 or Level 7 grade, only for the student to drift back into "CRUD app" territory by week three. The Philosophy: AI as a Mirror Instead of you doing the heavy lifting, this workflow uses AI as a Mirror . It reflects the student’s own skills and career goals back to them, but with the structural rigour of a virtual supervisory team. It’s not about the AI "giving" the idea; it’s about the AI forcing the student to defend and refine their own concepts until they hold water. The Framework: 3 Months of Rigour This prompt is specifically designed for intensive/conversion MSc or summer capstone projects . It assumes a tight 12-week implementation window. By forcing the AI to w...

Getting multiple viewpoints with ChatGPT

Well sort of! There are approaches where we can get the generative AI to look at a problem from multiple perspectives (or personas) and bring the ideas generated, ideally informed by the others. to a final plan. One of the main strategy is called Tree of Thoughts (see here for more detail  https://www.forbes.com/sites/lanceeliot/2023/09/08/prompt-engineering-embraces-tree-of-thoughts-as-latest-new-technique-to-solve-generative-ai-toughest-problems/?sh=5ce79bdb2c8b ). The central idea is get a number of expert opinions, allow potential cross-fertilization of ideas, come up with actions or plans. Let see this action.  Scenario: Find out about the UK Government's plans on Disability support and then use Tree of Thoughts to produce some ideas for a company making disability equipment based on their website. Google's Gemini will be used. Stage 1 "UK Governments plans on Disability support ": Prompt:  Read, convert to plain text and consolidate information from the followi...

GenAI Productivity: Ideas to project proposal 1

One of the ways I use Generative AI with students is to take basic ideas for projects, usually a title, and get these tools to greater ideas and start of a project proposal. This is with all the usual caveats  Check the references (if any); It is going to be basic, so extend it. In this example I am going to use Co-pilot but the ChatGPT, etc can be used, employing a few basic prompt engineering basics: personas (who is the target audience?) and Templates (how do I want it to look?) to start this process. Example:  Project ideas for MSc Data Intelligence students (persona)  on a particular topic. The reply will include subheadings and relevant (hopefully) content for  TITLE, INTRODUCTION, PROBLEM STATEMENT. The prompt: " Taking the topic "Leveraging open-source tools to measure and present academics publications automatically from public domain data.". Give five innovative projects for a Master's level student dissertation in Data Intelligence. Each project example wi...