Field NotesNext step

How do you measure whether an AI workflow is working?

Counting how much AI produces tells you how busy it is, not what it changed. One method for measuring the result: one task, a baseline, three numbers.

By Abel Sanchez4 min readUpdated Series: Field Notes

Short answer

To measure an AI workflow, pick one named task and record a baseline, how long it takes and how good the result is, before AI touches it. Then track three things: time spent on the task, output quality against a written standard, and where the recovered time went. Review the numbers after 30 to 60 days and decide to keep, fix, or cut.

How do you measure the results of an AI workflow?

Measure one task at a time. Record the baseline, set success criteria before launch, track three numbers while it runs, then review and decide. One before number, one after number, one honest decision.

  1. baseline

    Record how the task runs today: time per task and what good output looks like.

  2. criteria

    Write down what would justify keeping it after 30 days: a number and a quality standard.

  3. track

    Log three numbers each week: time on task, quality pass, and where the recovered time went.

  4. review

    Compare after 30 to 60 days while the starting point is still fresh.

  5. decide

    Keep, fix, or cut, and update the prompts and context with what you learned.

Why is output volume the wrong way to measure AI?

Volume measures how busy AI is, not what it changed. More posts, emails, or reports can sit next to flat sales and flat retention. Measure the effect on a task and on the business, not the count.

AI that makes you faster at the wrong work doesn’t grow a business. It scales the wrong work.

What should you measure in an AI workflow?

Three things: time spent on the named task compared with the baseline, the share of outputs that pass your written quality standard, and what people did with the time they got back.

  • Time on the task. Before and after, for one specific workflow and the people who run it. Not a general estimate.
  • Quality against a standard. Write what good looks like first. Then count how many drafts pass with light editing and how many need heavy rework.
  • Where the time went. Recovered time goes somewhere. If it flows into customer work, selling, or delivery, AI is helping the business. If it goes into fixing AI output, it’s overhead in a new place.

How do you set a baseline before adding AI?

Time the task for a couple of weeks before AI touches it, and write down what a good result looks like. A baseline recorded on day one is worth more than any dashboard built later.

If the workflow is already running, rebuild the baseline from memory and from the people who did the work before. It’s less precise, but it beats guessing.

How do you track where the time saved by AI actually goes?

For two weeks, have each person log how long the AI-assisted task took and what they did with the difference. Then sort those activities into work that produces or protects revenue and overhead.

Work that produces or protects revenue usually includes:

  • Time with existing customers
  • Prospecting and outreach
  • Proposals and follow-up on open opportunities
  • Billable delivery work
  • Decisions about direction

Time doesn’t move to higher-value work on its own. It drifts to whatever is closest. When a workflow frees time, assign that time on the calendar.

How do you calculate the ROI of an AI workflow?

Multiply the hours recovered each week by the full hourly cost of the person doing the work, then compare that against the full cost of the workflow, including setup, adoption, review, and maintenance time.

Time recovery is the easiest value to count. Better quality and consistency show up later, in retention, conversion, and referrals, so track those before and after when a workflow touches customers. Capacity only counts if the freed time is actually used for higher-value work. And always put the full cost in the comparison. See What does it really cost to run AI in a small business?

How often should you review an AI workflow?

Keep a quick weekly log and do a deeper review every 30 to 60 days. Most workflows show whether they’re helping within that window. Waiting longer means nobody remembers the starting point.

Wait until the team has finished learning the tool before you judge it. Results that compound, like retention, need a longer view than time savings do.

Why do AI results fade over time, and how do you stop it?

AI setups go stale because the prompts and context stay frozen while the business changes. A simple loop fixes it: capture how outputs performed, review the patterns monthly, and update the prompts and context.

  1. Capture: each week, log the task, a quick quality score, and one line on what was off.
  2. Review: once a month, look for patterns. The same task scoring low points to a prompt. Drifting tone points to the context.
  3. Update: rewrite the weak prompts, refresh the context, and test on one real task before putting them back into use.

More questions

What is a good AI metric for a small business?

Time recovered on a named task, paired with where that time went. It shows both whether AI saved effort and whether the saved effort reached work that matters.

Why is my team using AI but revenue hasn’t changed?

Usually because the time AI saves is flowing back into overhead, such as meetings, admin, and fixing AI output. Assign recovered time to specific revenue work.

Do I need analytics software to measure AI?

No. A shared spreadsheet and a short weekly log give you more useful information than a dashboard of usage counts.

What if editing AI output takes as long as doing the task myself?

Then the workflow isn’t saving time yet. Fix the prompt or the business context before measuring further.

Should I measure every AI tool at once?

No. Measure one task at a time. Trying to measure everything produces reports nobody acts on.

Abel Sanchez

AI Systems Operator in the Ark-La-Tex area. Helps small and mid-sized businesses decide what to automate, what to clarify, what to measure, and what to leave human.