Gary Bordey / POV

· Technology leadership · For leaders scaling AI beyond pilots

The answer got cheap. The question did not.

Donella Meadows drew organizations as stocks, flows and feedback loops. When a model can deliver a plausible slice of work in minutes, the scarce part is not production but the question of whether that slice should exist, fit the whole, and earn trust.

Picture a one-page status report on graph paper, clipped to a larger map. The report lists twelve new capabilities shipped this month, each with a green check and a one-line description. The map underneath shows how those capabilities connect to shared data, identity, logging and release paths. Six of the lines on the map stop in midair: the capability exists, but nobody agreed what it should call a customer, which system owns the record, or who answers when it acts on someone's behalf. The report is accurate. The map is also accurate. They describe different things, and only one of them was on anyone's plan.

That gap is the subject of this essay. One side is a cheap local deliverable: a draft, a script, a feature slice, a policy paragraph, produced quickly and often well enough to ship. The other is a bounded system question: should this exist at all, does it fit the rest of the operation, and can the organization trust it when it crosses a boundary it did not draw. My argument is that generative AI has moved the bottleneck from making the deliverable to answering the question, and that systems thinking is the discipline of asking that question once, at the right level, before the deliverables pile up.

Donella Meadows's posthumous primer Thinking in Systems, edited by Diana Wright and published in 2008, is the spine here.1 Meadows was an environmental scientist, and the book's examples come from ecology and public policy. I use it as a manager's vocabulary, not as a proof that every company behaves like a forest. Stocks accumulate and deplete. Flows fill and drain them. Feedback loops reinforce or counteract change, often after a delay nobody remembered to measure. The claim is not that AI creates systems. It magnifies the ones already there.

One qualification. This is not an argument against speed, against specialists, or against automation. It is not a claim that every leader must become a modeler. It is a claim about where attention earns its keep when the cost of a plausible answer falls toward zero.

When production stops being the constraint

In July 2026 Elizabeth Stone, chief product and technology officer at a large streaming company, told Lenny Rachitsky on his podcast that she hears a sentence she now treats as a hiring test: "We need more systems thinkers in a world with AI."2 In the same conversation she described what had changed in her own organization. Local teams had long been able to build the stack they needed for a local problem without waiting on a central paved path. That freedom worked when humans carried the integration cost in meetings and manual handoffs. It strains when software agents want a source of truth, a preferred authentication path, and a shared definition of what a record means.

Stone's diagnosis, as I understand it, is not that local speed was foolish. It is that cheap production makes hidden integration debt visible all at once. The question is no longer only "can we build it?" but "should this version exist, does it fit, and who is accountable when it crosses a line?" Those are system questions. They do not take longer because people are slow. They take longer because they require a map.

She tied that map to hiring. The same interview treated narrow specialization as less default than it was five or ten years ago, while still insisting that deep craft matters where the problem is genuinely hard.2 Systems thinking, in that framing, is not a replacement for expertise. It is the horizontal skill that keeps expertise from optimizing the wrong whole.

An earlier edition here, "When good becomes cheap.", argued that competent execution is becoming a commodity, and that advantage moves to judgment about where to point it. This essay is the companion piece. Cheap good answers the "what" and "how fast." Systems thinking answers "what whole?" and "at what cost to the rest?"

Stocks, flows and the delay nobody sees

Meadows opens with a bathtub: water stock, inflow, outflow.1 Organizations run on bathtubs nobody drew. There is a stock of open commitments, a stock of shared definitions, a stock of technical debt, a stock of customer trust. Flows add new features, new agents, new exceptions. Outflows are retirements, reconciliations, and honest answers to audit questions.

Figure 1 sketches two reinforcing loops on the same sheet. The gold loop is familiar: a team ships a cheap local deliverable, which earns praise for velocity, which funds more local deliverables, which multiply slightly different definitions of the same fact. The blue loop is the counterweight Meadows would recognize as a balancing loop, but only if someone invests in it: before the next deliverable, someone asks a bounded system question, which slows the local line slightly, which reduces rework and fragmentation, which makes the next deliverable cheaper to integrate, not merely cheaper to produce.

Two feedback loops on one system map A gold reinforcing loop runs from local deliverables to praise for velocity to fragmented definitions and back. A blue balancing loop runs from a bounded system question to fewer mismatched seams to less integration rework and back. Arrowheads mark the direction of each segment. Illustrative loops · not measured data More local deliverables Praise for velocity Fragmented definitions Bounded system question Fewer mismatched seams Less integration rework
Figure 1. A hand-inked causal loop diagram in Meadows's spirit, not a model fitted to data.1 Gold reinforces local output. Blue balances it with a question asked before the next shipment. Most organizations run the gold loop by default; the blue loop requires a habit, not a hero.

Meadows stressed delays: a policy change today moves a stock tomorrow, or next year.1 AI compresses the production delay almost to zero while leaving the integration delay untouched. That is why the dashboard can look fine while the system gets harder to change. No. 7 here, "The dashboard is part of the machine,", made the point about measures that change behavior. This essay is about a different failure mode: measures that count local deliverables while the stock of shared meaning drains. Both can be true at once.

Consider a generic planning loop many operations recognize. A central team publishes a replenishment schedule that balances service level against carrying cost. Each field manager adjusts locally against reality: a supplier late, a promotion added, a lane closed. The local adjustments are reasonable. The database faithfully records each order. Upstream, the schedule that survives contact with the real organization is not the published one but the sum of local fixes, and nobody owns the difference. That story appears in an earlier essay on order distortion, "When every buyer orders twice." Cheap drafting makes the local fix free to write. It does not make the upstream distortion free to absorb.

Fragmentation and the paved path

Stone described, in the same interview, agents operating across multiple systems and wanting source-of-truth data, common infrastructure, and preferred paved paths that solve a problem once with guardrails.2 I hear that as a statement about stocks. Every team that defines "customer," "order," or "incident" slightly differently adds another pipe into the same bathtub. Humans patched those differences with spreadsheets and side conversations. Agents do not patch; they execute literally.

An earlier essay, "Say it once, or say it everywhere,", was about data shape. This one is about ownership and intent across product, engineering, finance and operations. A paved path is not only a technical template. It is a decision that a bounded question was asked and answered: here is the authoritative record, here is the allowed action, here is the log line every consumer must emit.

Melvin Conway's 1968 note in Datamation is a supporting observation, not a second spine.3 Organizations produce copies of their communication structures. Fifty teams with fifty definitions produce fifty agents that disagree at the seams. Conway does not tell you which definition is right. He tells you that the seams will appear where the org chart appears, unless someone pays to break the mirror on purpose, as No. 38, "The org chart ships with the system,", argued at length.

Agents at the boundary

When software could only suggest, the boundary was a person's click. When agents act, the boundary is identity, access, validation, conflict handling, and the record of who is accountable after the fact. Those are system questions stacked together. No. 45, "Teach the machine to stop,", took one slice of that stack: build the stop into the work, learn normal by hand, go and see the trace. This essay does not repeat that mechanism. It asks why so many agents reach production without a shared answer to "what is this allowed to touch?"

Meadows listed places to intervene in a system, from parameters and buffers up through rules, goals and paradigms.1 Most AI programs still live at the bottom: faster models, more tokens, another pilot. The leverage moves when leaders change rules: one definition per fact that matters, one authentication convention for non-human actors, one place to read what an agent did. Those are boring investments next to a demo. They are also the investments agents force into view.

No. 5, "Who gave the machine permission?", and No. 35, "The authority we gave the machine,", treated permission and control when software acts. Agents raise the same questions in bulk. Identity for the actor, scope for the action, authoritative data for the read, validation before the write, conflict rules when two automations disagree, and an owner who remains accountable after the run. Each item is a bounded system question. Skipping them does not remove the need. It defers the need into incident response.

Enterprise optimum, not departmental score

Stone also argued, in paraphrase from the same interview, that product and technology cannot be optimized separately if agents and shared platforms are to work; the organization needs the enterprise optimum, not the best quarter for each department.2 Meadows would call that a goal-level intervention. A department maximizes its deliverables. A system maximizes outcomes that survive contact with the whole operation, including the replenishment schedule that survives contact with the real organization, not the tidy plan on slide three.

Figure 2 is an illustrative model of the trade. The horizontal axis is months since a generative tool went department-wide. The gold line tracks local deliverables accepted each month on the left scale; the blue line tracks person-days of integration rework on the right scale. Early on the gold line dominates the story. After a few months rework can climb even while deliverables stay high. That is not a failure of the tool. It is a failure to ask the bounded question early enough.

Local deliverables and integration rework over twelve months Gold line shows deliverables accepted per month on the left scale. Blue line shows integration rework in person-days per month on the right scale. Blue hatching under the rework line marks the integration tax. Drag across the sheet to read values in the tag.

Figure 2. An illustrative model, not measured data. Left scale: deliverables accepted per month (gold). Right scale: integration rework in person-days per month (blue). Hatching under the blue line marks the integration tax in rework person-days, not a gap between the two series. The cursor tag shows the same units. Gold is what the department can show. Blue is what integration costs when bounded questions were skipped. Drag across the sheet, or focus it and use the arrow keys.

Step out one click

When Rachitsky asked how people learn systems thinking, Stone offered a habit small enough to teach: for each problem, step out one click and ask what you are assuming about the broader space.2 She illustrated it with a hypothetical feature: what consumer problem it serves, which content types it must support, whether the implementation scales, whether the capability belongs on a shared platform. She also warned against staying in the question so long that nothing ships.

That is the bounded part of a bounded system question. It is not an invitation to redraw the entire strategy every Monday. It is one zoom level out: outcome, assumptions, upstream and downstream, reuse, scale, and which metric improves while the outcome worsens. The last item is the bridge to the dashboard essay without repeating it. A local metric can rise while customer trust, auditability, or time-to-change falls. Systems thinking is the habit of noticing the pair.

Stone's hiring corollary, again in paraphrase from the interview, is breadth alongside craft: T-shaped people who can go deep in a specialty and still ask whether the specialty fits the whole.2 Cheap models make the vertical bar of the T easier to buy. They do not supply the horizontal bar. The horizontal bar is the map.

Practically, that shows up in three habits that cost little time. First, start a design doc with the bounded question, not with the demo screenshot. Second, require a one-box diagram of upstream and downstream systems before funding. Third, when a metric improves, ask which outcome it might be taxing. None of those habits requires a simulation department. They require permission to pause before accepting a cheap local deliverable as progress.

Objections, considered

Central platforms will smother innovation. They can, if the platform team confuses control with design. Meadows's point about leverage is that rules and shared stocks can enable local speed when they encode decisions already made, not when they freeze every experiment. A paved path should shorten the path to "no," not only to "yes."

We already have architects and governance boards. Often you do, and often they meet after the deliverable exists. Systems thinking is not a new committee. It is a timing shift: the bounded question before the cheap deliverable, not a review after.

This is too abstract for a quarter. The quarter is exactly when gold loops win. Figure 2 is a warning about quarterly praise for shipments that borrow against next quarter's integration stock. The question is small enough to fit a stand-up if it is asked with teeth: what system does this touch, and what did we decide about that touch?

Models will soon ask the system questions for us. They can summarize and challenge, and they should. They cannot carry accountability, and they inherit the same fragmented definitions as the agents they help. The question still needs an owner with authority to say no.

AI raises the supply of answers. Systems thinking improves the quality of the questions, boundaries and decisions that govern them.

Before the next pilot ships

  • Write the bounded question first. One paragraph: should this exist, what it must connect to, what "done" means for the system, not only for the team.
  • Name the stocks touched. Which shared definitions, records, identities and logs will this deliverable read or write?
  • Step out one click. Outcome, assumptions, upstream, downstream, reuse, scale, and one metric that could improve while the outcome worsens.
  • Pay for the paved piece once. If three teams need the same guardrail, fund it as infrastructure, not as three copies in three demos.
  • Reward the no. Track rescoped pilots and rejected deliverables as evidence the blue loop ran, not as failure to execute.

Meadows died in 2001, before a phone could draft a policy or an agent could open a ticket in a system she had never seen. Her book endures because production was never the hardest part of systems work. The hardest part was seeing the whole long enough to choose wisely. The answer got cheap. The question did not. The work now is to ask it once, at the right boundary, while the deliverables are still small enough to fit on one sheet of graph paper.

Sources

  1. Donella H. Meadows, edited by Diana Wright, Thinking in Systems: A Primer (Chelsea Green Publishing, 2008). Cited for stocks, flows, feedback loops, delays, and Meadows's list of places to intervene in a system.
  2. Elizabeth Stone, interview by Lenny Rachitsky, Why Netflix is betting on systems thinkers, not specialists, in the AI era, Lenny's Podcast, published July 19, 2026. Direct quotations in the essay: "We need more systems thinkers in a world with AI," and the habit to "step out one click" before solving a local task. Other statements attributed to Stone in the essay are paraphrased from the same interview.
  3. Melvin E. Conway, How Do Committees Invent?, Datamation, April 1968. Supporting citation only; the essay's spine is Meadows (source 1).

Read next

Every essay, by date