AI Automation

What should you automate first? An AI automation prioritization formula for PMs

TL;DR

List your team's repetitive work → score 4 criteria (frequency × time per run, how rule-defined it is, risk when wrong, data readiness) → pick 1–2 high-score, low-risk items for a 2-week pilot → measure real hours saved before scaling.

After the first AI demo, every team has a list of "we could automate this and that". The problem is limited resources: pick the wrong first task and you spend weeks building something that saves a few minutes a week, and leadership loses faith in the whole programme. This post gives a simple scoring formula for choosing what to automate first, how to measure ROI and how to run a pilot.

Step 1: List repetitive work

Ask everyone on the team: "Which task do you do over and over every week and find boring?" Record the task, its frequency, the time per run and who does it. Don't filter at this stage; the goal is a list of 15–30 tasks.

Step 2: Score (1–5)

CriterionHigh score when…
VolumeRepeated daily, each run takes ≥ 10 minutes
ClarityInputs/outputs can be defined, sample examples exist
Cost of errorsMistakes are easy to fix and don't affect customers or money (high score = low risk)
DataAlready digitised, accessible via API

Add the four scores, or multiply volume by the sum of the other three if you want to favour big tasks. A task scoring 1–2 on cost of errors shouldn't be the first pilot, even with a high total.

Example in a software team

TaskAssessmentDecision
Writing the weekly progress reportRepetitive, data already in Jira/Git✅ Do it now
Classifying support ticketsHigh volume, a human reviews hard cases✅ Pilot
Auto-replying to customers about refundsFinancial risk⚠️ Drafts only
Deciding roadmap prioritiesNeeds strategic judgement❌ Keep it human

General rule: AI drafting and suggesting is acceptable for most tasks; AI deciding and executing should be reserved for low-risk work, or work with a human approval step.

Step 3: Estimate ROI simply

Hours saved / month = runs × minutes per run × automation success rate / 60
Cost / month        = API tokens + infrastructure + maintenance hours
Break-even (months) = build effort / (value of hours saved − monthly cost)

Two items often forgotten: maintenance hours (prompts need tuning, APIs change, users give feedback) and the automation success rate (the remainder still needs a human). Example: a weekly report takes 2 hours, 80% automated → saves about 1.6 hours a week. If it takes 12 hours to build, it breaks even after about 8 weeks.

Step 4: A 2-week pilot

  1. Pick 1–2 high-scoring, low-risk tasks.
  2. Record manual hours before automating (baseline).
  3. Run alongside humans in week one (shadow mode) to compare results.
  4. In week two, switch to AI drafting with human review.
  5. At the end, measure real hours saved, rework rate and token cost.

Common mistakes

  • Picking "cool" tasks over "painful" ones: an impressive demo doesn't mean hours saved.
  • Automating something too rare: a once-a-quarter task rarely breaks even.
  • No baseline: without a "before" number you can't prove the "after".
  • Ignoring users: a good tool nobody uses has zero ROI.

How to apply it

  • PM: use the scoring table as the meeting document with your team; choose the pilot by score rather than opinion.
  • Tech Lead: assess technical difficulty in parallel; a high-scoring task that needs complex integration may go later.
  • Leadership: report in measured hours saved and actual cost.

Sources & references

  1. Building effective agents — Anthropic