The AI Adoption Scorecard  ·  Dark  ·  Print to PDF · US Letter · no margins
Trent T. DanielThe AI CEO
20 pages
A Working Guide By Trent T. Daniel

The AI
Adoption
Scorecard

How To Choose Your First AI Project, And What To Refuse

Most AI projects fail before a line of code is written. They fail in the decision about which problem to solve. This guide is the framework I use, including the four dimensions I score every candidate against and the three types of project I refuse outright.

theaiceo.org
Trent T. DanielThe AI CEO
Introduction
Why I Wrote This

I Have Made
Both Mistakes

Years ago I took a project to build an email application. I was excited, because it was the first big check. I told the client three weeks. It took seven months.

We had not researched it properly. We underestimated our own capacity and we underestimated the integration, and I did not have the money to do the research that would have told me the truth before I quoted. I did not fail at engineering. I failed at scoping, and scoping is a leadership decision.

Later, running a product of my own, I modeled AI credit costs against what a light user consumed. Real customers are not light users. We lost more than fifty dollars a month on every client we signed. We were growing and bleeding at the same time, and growth was the problem.

No vendor lied to me in either case. I got both wrong myself. Everything in this guide exists because of one of those two failures, or because I have since watched a client walk toward the same cliff.

Trent T. Daniel · CEO, BotMakers, Inc.

A division of publicly traded BioQuest, Inc. (BQST)  ·  hello@theaiceo.org

The AI Adoption Scorecardtheaiceo.org
2
Trent T. DanielThe AI CEO
Section One
01

Start With The Problem
You Can Finish

The highest-value problem in your organization is almost always the wrong place to start.

Trent T. DanielThe AI CEO
Section One

Every leadership team I work with wants to begin with the biggest number. The eight-million-dollar inefficiency. The thing that would transform the business. It is the right instinct and the wrong first move.

That project is too visible, too complex and too slow. It touches six departments, three systems and a compliance question nobody wants to open. By the time it half works, the sponsor has been promoted, the budget cycle has turned over, and the organization has learned that AI does not work here.

Your first AI project has one job: earn the right to do the second one. That means it has to finish, show a number, and do it before anyone loses interest.

The Test

If you cannot imagine reporting a result on this project within one quarter, it is not your first project. It may still be your third.

The AI Adoption Scorecardtheaiceo.org
4
Trent T. DanielThe AI CEO
Section Two
02

The Four
Dimensions

Score every candidate out of twenty. Below fourteen is not your first project.

Trent T. DanielThe AI CEO
Section Two

This is the framework. It is deliberately crude, because a crude framework everyone applies consistently beats a sophisticated one that becomes an argument about weighting.

Volume

How often does this actually happen?

1 point
Twice a quarter
3 points
Weekly
5 points
Hundreds of times a week

Volume is what turns a small per-instance saving into a number your CFO can see. Low-volume work is rarely worth automating first, however annoying it is.

Measurability

Can you state the success number before you start?

1 point
No idea how we would measure it
3 points
Roughly, with some work
5 points
Exact number and current baseline

If you cannot measure the before, you will never prove the after. Teams skip this because measuring is boring, and then spend a year arguing about whether the project worked.

The AI Adoption Scorecardtheaiceo.org
6
Trent T. DanielThe AI CEO
Section Two
Error tolerance

What happens when it is wrong?

1 point
A regulatory or safety event
3 points
Rework by a human
5 points
A minor annoyance

AI is probabilistic. It will be wrong sometimes. Choose a first project where being wrong costs an apology rather than a filing.

Ownership

Who wants this to exist?

1 point
Nobody, it was assigned
3 points
A committee
5 points
One named person who is frustrated by this today

This is the dimension teams score most dishonestly, and the one that predicts failure best. If you had to assign it, you have already lost.

Reading Your Score
18–20
Fund it this quarter. This is your first project.
14–17
Strong candidate. Fix the weakest dimension before you start, not during.
10–13
Not yet. Almost always an ownership or measurement problem rather than a technology one.
Below 10
Refuse it, or fix the underlying process before you automate it.
The AI Adoption Scorecardtheaiceo.org
7
Trent T. DanielThe AI CEO
Worksheet
Use It

Score Your Own
Candidates

Print this page. Score every AI idea currently circulating in your organization. Anything below fourteen is not your first project.

Candidate project Vol Meas Err Own Total
Then Do This
  • 01Rank them by total. Fund the top one, small.
  • 02Name the three lowest and formally refuse them today.
  • 03Assign one named owner to the winner. Not a committee.
The AI Adoption Scorecardtheaiceo.org
8
Trent T. DanielThe AI CEO
Section Three
03

Three Projects
To Refuse

Saying no to three things is a real decision. Saying yes to everything is not.

Trent T. DanielThe AI CEO
Section Three

I build custom AI for a living and I turn down work regularly. Not out of principle, but because some problems are genuinely worse with AI in them. These are the three I decline every time.

Refusal 01

Zero tolerance for error

If one wrong answer is a regulatory event, a safety incident or an irreversible financial action, a human stays in the loop. AI can draft, sort, retrieve and suggest inside that workflow. It does not get the final decision. Anyone who tells you otherwise is selling.

Refusal 02

No clean source of truth

If your own experts disagree about the correct answer, there is nothing for the system to learn. This is a process problem wearing a technology costume. Fix the disagreement first, and you may find you no longer need the AI.

Refusal 03

Nobody owns the outcome

A project with no named owner who personally benefits will end the day the initial enthusiasm does. Not because the technology failed, but because nobody was ever going to fight for it in week seven.

The AI Adoption Scorecardtheaiceo.org
10
Trent T. DanielThe AI CEO
Section Four
04

What It
Actually Costs

The license price is the part you can see. It is rarely the largest part.

Trent T. DanielThe AI CEO
Section Four

Software pricing trained everyone to think in seats. AI pricing works on consumption, which means the number scales with how successful you are. That is a genuinely different shape and it catches experienced buyers.

Here is what I lost to it. We priced a product against what a light user consumed. Real customers used it properly and we lost more than fifty dollars a month on every client. We fixed it by re-architecting rather than repricing: cheaper models for the easy work, the expensive model only where it changed the answer, aggressive caching, and cutting everything we were sending that never needed to go.

It took real engineering skill and some judgment to cut consumption without the product getting worse. That is the work nobody prices in, including the people selling to you.

The AI Adoption Scorecardtheaiceo.org
12
Trent T. DanielThe AI CEO
Section Four
Six Line Items

Where The Cost
Actually Hides

01

Consumption at real volume

Model the usage you expect in year two, not month one. Ask the vendor for the pricing curve, not the entry point.

02

Integration

Frequently a separate statement of work. Establish who does it and whether it is in this price before you are excited.

03

Data preparation

Somebody has to clean it. Establish who, and at whose cost.

04

Human review

The review step you will still need is a permanent operating cost, not a temporary one.

05

Retraining and drift

Performance degrades as your business changes. Ask what maintaining it costs annually.

06

The exit

What does leaving cost, and do you keep your own data? Almost nobody asks this before signing.

Fund It Small

Size the first project so that cancelling it is not embarrassing. That is the real constraint, and it is the reason most first projects should cost less than one senior hire.

The AI Adoption Scorecardtheaiceo.org
13
Trent T. DanielThe AI CEO
Section Five
05

The Ninety
Day Plan

Three phases, one owner, one number, and a review date that exists before you start.

Trent T. DanielThe AI CEO
Section Five

A plan without an owner and a review date is theatre. Everything below assumes you have both. If you do not, stop and get them; the rest of this is wasted effort without them.

Weeks 1–2 Establish the baseline
  • Confirm the number this project must move, and measure it as it stands today.
  • Name every person whose work this touches, and tell them before they hear it secondhand.
  • Decide the build, buy or wait path. Write down why.
Weeks 3–6 Run it on real work
  • Configure or build the narrowest version that could show a result.
  • Put it in front of a small group doing their actual job, not a test.
  • Measure weekly. Write down what surprises you, because that is the real output.
Weeks 7–12 Widen or stop
  • Compare the number to the baseline and report it honestly, including if it is bad.
  • Decide: scale, iterate, or kill. All three are legitimate.
  • If you kill it, write down what you learned and what it cost. That document is worth more than the project was.
Write The Kill Criteria Now

Decide today what result by the review date would make you stop. Write it down while everyone is calm. Later, when the project is struggling and reputations are attached, the decision becomes arithmetic that was agreed in advance rather than a judgment on anybody.

The AI Adoption Scorecardtheaiceo.org
15
Trent T. DanielThe AI CEO
Next Step

Run This With
Your Leadership Team

This guide is the short version of a working session I run with executive teams. In half a day a leadership group surfaces every AI opportunity in the organization, scores them against this framework, refuses three, assigns owners to the top three, and drafts the ninety-day plan before anyone leaves the room.

Ways To Work Together
  • Executive AI Intensive · half day or full day, 8 to 30 participants
  • Keynotes for conferences, leadership summits and all-hands audiences
  • Board education on governance, oversight and disclosure
  • Nonprofit rates, plus four pro bono engagements reserved each year
Web
theaiceo.org
Email
hello@theaiceo.org
Phone
(448) 236-1364