Resources
Why AI gets your clients' marketing data wrong.
Connecting a model to a client's data does not make it right. Here is what breaks.
- 5 minute read
- 4 sections
Part 1
The failure nobody sees
Point a language model at a client's marketing data and it will answer every question you ask. That is the problem. It has no way to tell you that the question could not be answered from the data it was given, so it produces a number in the same tone as a correct one.
A wrong dashboard looks wrong. Somebody notices a total that cannot be right. A wrong AI answer arrives as a sentence, in a chat window, with no total to check it against, and a sentence is the easiest thing to paste into a note to a client before anybody has checked it.
Part 2
The four things that break it
None of these are model problems. All four are properties of the data underneath, and each one produces a confident wrong answer rather than an error.
One metric, three names
Each platform names spend its own way. Asked for total spend, a model either picks one column or sums columns that are not comparable.
Different types
A number stored as text does not add up. It gets counted instead, and a count looks like a plausible figure.
Different grains
One table is a row per day, another a row per campaign per day. Joined without reconciling that, every figure is multiplied by however many rows matched.
Mixed currencies
Two platforms reporting in different currencies produce a total that is arithmetically correct and means nothing.
Part 3
Why more context does not fix it
The instinct is to give the model more: the schema, a longer prompt, a description of each table. That helps a model write better queries against data that is already consistent. It cannot make two incompatible columns compatible, because the information needed to reconcile them is not in the data at all. It is in somebody's head.
This is why 'connect your data to AI' is the easy half and the half that gets sold. Making the data answerable is the work.
In practice
What has to be true first
One name per metric, one type, one grain, one currency, across every source. That is the whole list, and it is what makes the difference between a model that can be trusted with a question and one that cannot.
SightShark does that modelling inside a warehouse you own, for every client, and then points the chatbot, the client dashboards and the alerts at the same tables. The chatbot runs on your own LLM key. The reason all three agree is that there is only one set of numbers for them to read.
See how the platform worksQuestions
Questions people ask
Why does AI give wrong answers about client marketing data?
Because the data it was given cannot answer the question, and a language model has no way to say so. Four things cause it: one metric under three different names, numbers stored as text, tables at different grains, and mixed currencies. Each produces a confident wrong figure rather than an error.
Will a better AI model fix wrong marketing numbers?
No. A better model writes better queries against data that is already consistent. It cannot reconcile two columns that mean different things, because the information needed to reconcile them is not in the data. It is in somebody's head, and it has to be written down as a model first.
What does AI-ready marketing data mean?
One name per metric, one type, one grain and one currency, across every source. That is the whole list. Data that meets it can be queried by a model, a dashboard or a person and give all three the same answer.
Also worth reading
- 6 min read
Can AI write your client reports?
The writing is the easy part. The numbers underneath decide whether it is right.
Read it - 7 min read
Why ad platform numbers never match on the same campaign.
They are not measuring the same thing. Once you know what each one counts, the gap stops being a mystery.
Read it - 7 min read
Reporting across currencies and time zones.
Both are the same failure. A number that means something different depending on where it was read, and no error either way.
Read it
Pricing
Priced by the clients you report on.
Starter
$499 /month
Up to 20 clients
Growth
$999 /month
Up to 50 clients
Enterprise
Custom
No cap on clients
Get started
Want this running on your own data?
Book a call with someone who can answer the technical questions.