Article

BoostIdeal vs DIY lead scoring with Claude or ChatGPT: what a prompt can and cannot do

An AI assistant is a very good way to design a scoring model and a shaky way to run one. Here is the difference, and a test you can run yourself in 20 minutes.

Greg Toler, Founder 11 min read AI scoring Transparency Lead scoring

You can score leads with an AI assistant today. Paste a list into Claude or ChatGPT, describe your ideal customer, and ask for a score out of 10 with a reason for each one. It works, it is fast, and for a one-off list it may be all you need.

The question is what happens when the score has to be the same tomorrow, sit on every record in your CRM, and be something a rep, a manager, and an AI agent can all rely on. This page compares the do-it-yourself route with BoostIdeal, and gives you a test to run so you do not have to take our word for it. We make BoostIdeal, so the test matters more than our opinion.

What “DIY AI scoring” usually means

People mean one of three setups.

SetupHow it worksTypical user
ChatPaste a list into an assistant and ask for scoresA founder or marketer with a list from an event
AI columnA spreadsheet or enrichment tool runs a prompt on every rowAn operations person scoring a few thousand rows
Scripted pipelineCode or an agent pulls records from the CRM, sends each to a model, and writes a score backA team with an engineer and time to maintain it

Each step down the table fixes a limit of the one above and adds something to maintain.

What an AI assistant is good at

Give credit where it is due. For the design work, an assistant is excellent.

  • Reading your wins and losses. Export closed-won and closed-lost deals, and ask what the wins have in common. It will spot patterns quickly and explain them in plain language.
  • Suggesting factors and weights. It can turn those patterns into a first model, and argue for each weight.
  • Writing the formulas. Ask for a spreadsheet version of the model, and you get one.
  • Explaining a score. Give it the factors and the numbers, and it will write the sentence a rep needs.
  • One-off lists. For 40 badge scans from a trade show, a prompt is faster than building anything.

This is also how BoostIdeal uses AI: to analyze your data and draft a starting point. The difference is what happens next.

Where a prompt stops working as the model

LimitWhat it looks likeWhy it happens
The same lead gets a different scoreScore a list on Monday and again on Tuesday, and some numbers moveLanguage models are not fully repeatable. Anthropic’s API reference says results are not fully deterministic even at a temperature of 0, and OpenAI’s guide to reproducible outputs says its chat models are non-deterministic by default
The math happens out of sightYou get 7 out of 10 and a paragraph, not the weights that produced itThe model writes a plausible score. It does not have to compute one unless you make it
Order and wording change the resultThe same record scores differently at the top of a long list than at the bottom, or after a small change to the promptEverything in the prompt is context, including the other rows
The score lives in a chatReps do not see it, workflows cannot use it, and it is out of date the day afterNothing writes back to the record unless you build that
Nobody owns the modelThe prompt is in one person’s history. When they edit it, every score changes and nothing records that it didA prompt has no versions and no audit trail by default
It does not keep upNew leads and changed records wait for someone to run it againA prompt runs when a person runs it
Customer data leaves the CRMContact lists get pasted into a chat windowCheck your company’s policy before you do this at all

A scripted pipeline solves several of these. It can force the model to return structured factors, write to CRM properties, and run on a schedule. At that point you are maintaining a small software product: prompts, error handling, cost per record, and a model that can change underneath you when the vendor updates it.

Run the test yourself

This takes about 20 minutes and needs no tools beyond an assistant and a spreadsheet.

  1. Pick 10 records you know well. Five you won and five you lost. Remove names and emails if your policy requires it.
  2. Write your scoring prompt. Describe your ideal customer and ask for a fit score out of 10 with reasons.
  3. Score the list. Save the results.
  4. Open a fresh chat and score the same list again with the same prompt. Compare the two sets.
  5. Reverse the order of the list and score it a third time.
  6. Ask for the math. For one record, ask which factors were used, what each was worth, and how they add up to the score.
  7. Build the same model as a weighted sum in a spreadsheet: four or five factors, weights that total 100, a rating out of 10 for each. Score the same 10 records.

What to look for:

CheckA model you can runA model you cannot
Run 1 against run 2Every score is identicalScores move, even by a point
Original order against reversedIdenticalRankings shift
The mathFactors and weights add up to the score exactlyThe explanation does not sum to the number, or changes when you ask again
Wins against lossesWins score clearly higherThe two groups overlap

Your results will depend on the assistant, the prompt, and the list. That is the point of running it on your own records. The spreadsheet version will pass the first three checks every time, because a weighted sum has no way to fail them.

What a checkable score looks like

Demo data. A fit score built as a weighted sum: four factors add, the disqualifying factor subtracts, and anyone can redo the arithmetic.

The math: 8.4 at 30% is 2.52, 7.2 at 25% is 1.80, 9.1 at 25% is 2.275, and 6.3 at 15% is 0.945. That adds to 7.54. The disqualifying factor subtracts 2.8 at 5%, or 0.14, for a fit score of 7.4. Run it a hundred times and it is 7.4 a hundred times.

Side by side

Chat promptScripted AI pipelineBoostIdeal
Time to a first scoreMinutesDays to weeksMinutes
Same input, same scoreNot guaranteedNot guaranteed, though structure helpsYes. It is a weighted sum
Can you check the mathOnly if you ask, and the answer can varyIf you built it to return factorsYes. Factors and weights are on the record
Who sets the logicWhoever wrote the promptWhoever maintains the code and promptYour team sets the weights. AI helps analyze and draft
Where the score livesIn the chatWherever you write itIn HubSpot properties, with its reasons
Stays currentWhen someone reruns itOn the schedule you buildRecalculates hourly by default, and in near real time with webhook sync
Covers every recordThe rows you pastedThe records you pullLeads, contacts, accounts, and custom objects
What you maintainA promptPrompts, code, costs, and model changesFactors and weights
What it costs to runYour timeModel usage per record, plus engineering timeA subscription

The best of both

The two approaches are not opposed. The strongest setup uses each for what it is good at.

  1. Design with AI. Have an assistant read your closed-won and closed-lost exports and propose factors and weights.
  2. Decide as a team. People agree on the weights. This is the step that makes sales trust the result.
  3. Run it as a weighted sum. In a spreadsheet at first, then in a scoring tool, so the same record always gets the same score.
  4. Explain with AI. Let an assistant or an agent read the score and its factors to write the outreach or the summary. Now the agent is working from a number it did not make up.

Step 4 is where this matters most. An agent that scores leads with a prompt and then acts on its own score is checking its own homework. An agent that reads a score with visible factors has something to be held to.

Our five-step framework for building an ICP scoring model covers steps 1 to 3, and your ideal customer profile is where the factors come from.

When DIY is the right call

  • A one-off list. Event leads, a purchased list you are sanity-checking, a quick look at a new segment.
  • You are still exploring. You do not know your factors yet, and an assistant is a fast way to find them.
  • Low volume. A few dozen leads a week, reviewed by a person anyway.
  • You have an engineer who wants to own it. A well-built pipeline with structured outputs can work. Budget for the upkeep.

Where BoostIdeal fits

BoostIdeal is a scoring engine that works with HubSpot, or a CSV you upload. AI helps you analyze your data and draft a model. A person sets the weights, and BoostIdeal does not change them on its own. Every score is a number out of 10 that writes back to HubSpot with the factors behind it, so your reps, your workflows, and your agents all read the same thing. It can also share those reasons wherever your rep works, such as in Slack or by email.

It is not the right fit if your data is not in HubSpot and you do not want to work from CSV uploads, or if you want a vendor to hand over a number you never question. It also does not write your outreach or run your agents. It gives them something reliable to act on.

Frequently asked questions

Can ChatGPT or Claude score leads?

Yes. Give an assistant a list and a description of your ideal customer, and it will return scores with reasons. It is useful for one-off lists and for designing a model. It is less reliable as the scoring system itself, because the same record can get a different score on a different run.

Why does an AI assistant give different scores for the same lead?

Language models pick each word with some randomness, and both major vendors document that outputs are not fully repeatable by default. The rest of the prompt matters too, including the other rows in the list and their order.

Is it safe to paste CRM data into an AI assistant?

That depends on your company’s policy, your contract with the AI vendor, and the data involved. Check before you paste contact details anywhere. Removing names and emails for a scoring test is a sensible default.

Can I build AI lead scoring with an API and a script?

Yes. A script can send each record to a model, ask for structured factors, and write the result to your CRM. It works, and it needs someone to maintain the prompts, the code, the cost, and the behavior when the model changes.

Does BoostIdeal use AI to score?

No. AI helps you analyze your data and draft the model. The score itself is a weighted sum of factors a person approved, so it is the same every time and anyone can check it.

Should AI agents score leads themselves?

Better that they read a score than invent one. An agent acting on a score with visible factors can be audited: you can see what it was told and why it acted. An agent scoring from its own prompt gives you nothing to check.

The takeaway

An AI assistant is the fastest way to work out what your scoring model should be. A weighted sum is the reliable way to run it. Use the first to design and explain, use the second to score, and run the 20-minute test on your own records before you decide which one your team and your agents should trust.

Score anything
across the whole team.

RevOps
Owns the model

One shared definition of good, wired into HubSpot, that doesn’t need an engineer to change.

SDR / BDR
Works the list

A ranked list of who to work today, with the reasons sitting there before the call.

AE
Runs the deals

See which open accounts actually fit, and why, before you spend a cycle.

Sales leadership
Owns the number

One prioritized pipeline the team trusts, instead of reps cherry-picking.

Marketing / Demand gen
Feeds the pipeline

Spend on best-fit accounts, and stop passing leads sales won’t work.

Customer success
Grows the base

Score existing accounts for fit, expansion, and risk.

Sophisticated scoring for enterprise teams, simple enough for a team of one, technical or not.