What Did Our AI Budget Buy? AI Spend per Unit of Work | Pensero[Skip to content](#main)

[Pensero](/)

for

[Consulting firms](/)[Enterprise](/enterprise)

- Platform

  Measure

  - [Next movesWhat to improve next](/platform/next-moves)
  - [Agentic ROICost per delivery point](/platform/agentic-roi)
  - [AI DeploymentAdoption, output and quality of AI](/platform/ai-intelligence)
  - [Delivery IntelligenceDelivery points by team](/platform/delivery-intelligence)

  Govern

  - [Agent Traffic ControlAgent usage and model routing](/platform/agent-traffic-control)
  - [BenchmarkingCompare teams and agents](/platform/talent-benchmarking)
  - [Code QualityDefects and rework by source](/platform/code-quality)
  - [CapEx & FinanceCapitalization and spend allocation](/platform/capex-analysis)

  [Pensero MCPNewYour next moves in any assistant](/platform/mcp)
- Use cases

  By role

  - [CEOs](/use-cases/roles-ceo)
  - [CTOs](/use-cases/roles-cto)
  - [CFOs](/use-cases/roles-cfo)
  - [Product leaders](/use-cases/roles-product-leaders)
  - [Engineering managers](/use-cases/roles-engineering-managers)
  - [Procurement](/use-cases/roles-procurement)
  - [Service providers](/use-cases/service-providers)
  - [Investors](/use-cases/roles-investors)

  Compare Pensero

  - [DX](/use-cases/competitors-dx)
  - [Swarmia](/use-cases/competitors-swarmia)
  - [Haystack](/use-cases/competitors-haystack)
  - [Span](/use-cases/competitors-span)
  - [Jellyfish](/use-cases/competitors-jellyfish)
  - [Waydev](/use-cases/competitors-waydev)
  - [LinearB](/use-cases/competitors-linearb)
  - [Faros AI](/use-cases/competitors-farosai)
  - [Larridin](/use-cases/competitors-larridin)
  - [Weave](/use-cases/competitors-weave)
  - [Exceeds AI](/use-cases/competitors-exceeds-ai)
- [How it works](/consulting/how-it-works)
- [How it works](/how-it-works)
- [Customers](/customers)
- [Pricing](/enterprise#pricing)
- ResourcesMore

  Use cases

  By role

  - [CEOs](/use-cases/roles-ceo)
  - [CTOs](/use-cases/roles-cto)
  - [CFOs](/use-cases/roles-cfo)
  - [Product leaders](/use-cases/roles-product-leaders)
  - [Engineering managers](/use-cases/roles-engineering-managers)
  - [Procurement](/use-cases/roles-procurement)
  - [Service providers](/use-cases/service-providers)
  - [Investors](/use-cases/roles-investors)

  Compare Pensero

  - [DX](/use-cases/competitors-dx)
  - [Swarmia](/use-cases/competitors-swarmia)
  - [Haystack](/use-cases/competitors-haystack)
  - [Span](/use-cases/competitors-span)
  - [Jellyfish](/use-cases/competitors-jellyfish)
  - [Waydev](/use-cases/competitors-waydev)
  - [LinearB](/use-cases/competitors-linearb)
  - [Faros AI](/use-cases/competitors-farosai)
  - [Larridin](/use-cases/competitors-larridin)
  - [Weave](/use-cases/competitors-weave)
  - [Exceeds AI](/use-cases/competitors-exceeds-ai)

  - [Customers](/customers)
  - [How it works](/consulting/how-it-works)
  - [How it works](/how-it-works)
  - [AboutThe team, and how we run on Pensero](/about)
  - [BlogNews, tips, and dev culture](/blog)
  - [Help CenterGuides for setup, integrations and security](https://help.pensero.ai)

[Log in](/auth/login/)[Become a partner](https://calendar.app.google/8eCdC2RrquyQpncq7)[Book a scoping session](https://calendar.app.google/ZBxweeMGhrMVQkJn9)

[Log in](/auth/login/)[Become a partner](https://calendar.app.google/8eCdC2RrquyQpncq7)[Book a scoping session](https://calendar.app.google/ZBxweeMGhrMVQkJn9)

[Blog](/blog) / Other resources

# What did our AI budget buy?

Seats, tokens and agent runs are on the invoice. Measure what each one delivered: cost per delivery point, with quality, for the board.

![](/assets/WF5wXySb5oYBsfMDPbU0hRuXY3M.LvpWanuL_ZHEg5Y.webp)

![](/assets/GjPJ8lgQ2s9KH4YirhymwwZxVY.WQPn6KWn_ZcotNb.webp)Pensero·Pensero Marketing·Nov 17, 2026

Short answer

To see what your AI budget bought, put all AI spend next to the finished work that it delivered. Score each pull request and ticket in one unit, delivery points, for people, AI tools, agents and vendors. Divide the spend by the points to get the cost per delivery point, and read rework and defects next to it. That one number answers the board: what we paid, what we got, and if the quality held.

## Why does the AI invoice not answer the question?

Seats, tokens, agent sessions and contractor hours all land on the invoice. Each one counts what you used, not what you got. A team with high usage can deliver less than a team with low usage.

## What does the research say?

- **Self-reports are not reliable.** In a 2025 randomized trial by METR, experienced developers believed that AI made them 20% faster. The measurement showed that they took 19% longer. The METR update of February 2026 says that speedups now seem likely, but that study design can no longer measure them reliably. Surveys alone cannot answer the board.
- **Count completed work.** Field experiments at Microsoft, Accenture and a Fortune 100 company, with 4,867 developers, measured completed tasks, not feelings. Completed tasks rose about 26% with an AI coding assistant.
- **Check quality with output.** A 2025 study of 807 GitHub projects that adopted Cursor found a large but short increase in velocity, and a lasting increase in code complexity and static analysis warnings.

## Why is hours saved a weak number?

Hours saved come from surveys or estimates. Freed time is not delivered work: it only counts if the team uses it to ship. The board cannot check the number.

## Why is cost per merged PR not enough?

A merged pull request can be a one-line fix or a change across many systems. If you divide spend by the number of pull requests, a team that splits its work into small pull requests looks cheaper. Score each pull request by size and difficulty first.

## Step 1: Collect all spend in one place

Collect AI tool seats, model and token spend, agent runs, and the cost of people and vendors. Use the same period for all of them.

## Step 2: Score the delivered work

Score every finished pull request and ticket in delivery points: magnitude × complexity. The score is the same for a person, an AI tool and an agent. Pensero reads AI use from tool telemetry, not surveys.

## Step 3: Read cost per delivery point, with quality

Divide spend by points for each team, tool, agent and vendor. Read rework and defects by source next to it. Cheap points that come back are not cheap.

## Step 4: Put the next dollar where it returns most

Scale what delivers at a lower cost per point. Move other work to a lower-cost model or to an agent. Stop what does not deliver. Measure again each month.

## What should the board see?

One page: total AI spend, delivery points, cost per delivery point, the trend since the last quarter, and rework by source. Add the mix of work by AI level, from L1 human-only to L5 fully autonomous agents, to show where the organization stands.

## How Pensero measures AI spend

- Pensero scores all finished work in delivery points and reads it next to cost and quality, for every team, AI tool, agent and vendor.
- For tools, see [how to measure the ROI of AI coding tools](/blog/measure-roi-ai-coding-tools). For agents, see [how to measure the cost and output of AI coding agents](/blog/measure-ai-agent-cost-and-output).
- See the [integrations](/integrations) and [current pricing](/enterprise#pricing), or [book a scoping session](/enterprise).

## Sources

- METR, July 2025: [Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity](https://arxiv.org/abs/2507.09089), and the METR update of 24 February 2026.
- Cui, Demirer and others: [The Effects of Generative AI on High-Skilled Work: Evidence from Three Field Experiments with Software Developers](https://economics.mit.edu/sites/default/files/inline-files/draft_copilot_experiments.pdf).
- November 2025: [Does AI-Assisted Coding Deliver? A Difference-in-Differences Study of Cursor's Impact on Software Projects](https://arxiv.org/abs/2511.04427).

## Frequently asked questions

How do you measure the ROI of AI in engineering?

Compare all AI spend with the finished work that it delivered, in one unit, with quality next to it.

What is cost per delivery point?

Total spend divided by the delivery points delivered in the same period. Read rework and defects next to it.

Is cost per merged PR a good AI metric?

Only in part. A merged pull request can be a one-line fix or a change across many systems, so score each pull request by size and difficulty first.

Are developer surveys enough to measure AI impact?

No. Surveys measure how people feel. In a 2025 trial, developers believed AI made them faster when the measurement showed they were slower. Use telemetry and delivered work.

Can you compare AI tools, agents and people?

Yes, if one platform scores all finished work the same way. Then compare cost per delivery point and quality by type of work.

How do you know that quality held?

Read rework and defects by source next to the delivery points. If they rise with the output, part of the output is not finished work.

Does this work for vendors and contractors?

Yes. Pensero scores their work in the same unit as the work of your own teams.

Can Pensero run in our own environment?

Yes. Pensero runs in Pensero Cloud, an EU deployment, your own cloud account or on-premises.

## Related posts

- [![](/assets/WF5wXySb5oYBsfMDPbU0hRuXY3M.LvpWanuL_ZHEg5Y.webp)

  ### Your AI Spend Is Compounding: How to Control It

  Track AI coding costs by tool, model, and team, then assess token efficiency and rework to see whether spending is matched by delivery gains.

  Pensero  
  Pensero Marketing

  Jun 18, 2026](/blog/compounding-ai-spend)
- [![](/assets/WF5wXySb5oYBsfMDPbU0hRuXY3M.LvpWanuL_ZHEg5Y.webp)

  ### The AI Quality Tax: AI-Assisted Code Can Mean More Rework

  AI-assisted code can speed up development, but poor quality can create technical debt, bugs, and costly rework.

  Pensero  
  Pensero Marketing

  Jun 10, 2026](/blog/ai-quality-tax)
- [![](/assets/WF5wXySb5oYBsfMDPbU0hRuXY3M.LvpWanuL_ZHEg5Y.webp)

  ### How to Demonstrate Engineering ROI When the CFO Asks "What Are We Getting for This?"

  Learn how to clearly demonstrate engineering ROI to the CFO using metrics, outcomes, and business-aligned value indicators.

  Pensero  
  Pensero Marketing

  Jan 23, 2026](/blog/engineering-roi)

Next step

## Find your level of AI in engineering

See the 5 levels, from human-only to fully autonomous agents, and what moving up is worth.

[See the 5 levels →](/how-it-works#levels)

Next step

## Scope your audit in 30 minutes

We look at your tools, AI agents and vendors and tell you what we would measure first.

[Book a scoping session](https://calendar.app.google/ZBxweeMGhrMVQkJn9)[Start free](/auth/signup/)

- [For consulting firms](/)
- [For enterprise](/enterprise)

© 2026

Product shots use illustrative data.

Platform

- [Next moves](/platform/next-moves)
- [Agentic ROI](/platform/agentic-roi)
- [AI Deployment](/platform/ai-intelligence)
- [Delivery Intelligence](/platform/delivery-intelligence)
- [Benchmarking](/platform/talent-benchmarking)
- [Code Quality](/platform/code-quality)
- [Agent Traffic Control](/platform/agent-traffic-control)New
- [CapEx & Finance](/platform/capex-analysis)
- [Pensero MCP](/platform/mcp)New
- [Integrations](/integrations)

Use cases

- [CEOs](/use-cases/roles-ceo)
- [CTOs](/use-cases/roles-cto)
- [CFOs](/use-cases/roles-cfo)
- [Product leaders](/use-cases/roles-product-leaders)
- [Engineering managers](/use-cases/roles-engineering-managers)
- [Procurement](/use-cases/roles-procurement)
- [Service providers](/use-cases/service-providers)
- [Investors](/use-cases/roles-investors)
- [Compare Pensero](/use-cases/competitors-dx)

Company

- [About](/about)
- [Customers](/customers)
- [How it works](/consulting/how-it-works)
- [How it works](/how-it-works)
- [Pricing](/enterprise#pricing)
- [Careers](/careers)
- [Blog](/blog)
- [LinkedIn](https://www.linkedin.com/company/penseroai/)
- [Support](/support)
- [Help Center](https://help.pensero.ai)
- [Other resources](/blog/other-resources)
- [Glossary](/glossary)

Offices

- [Barcelona](https://maps.app.goo.gl/6pfxKiKFNKzLPPnB6)
- [Madrid](https://maps.app.goo.gl/jEpYBUR4E6AqZs4R6)
- [New York](https://maps.app.goo.gl/szk58Jf2MBq14MgAA)
- San FranciscoSoon

Legal

- [Privacy policy](/privacy-policy)
- [Cookie policy](/cookie-policy)
- [Terms of service](/terms)
- [DPA](/dpa)
- [Security](https://pensero.trust.site)