Back to resources

Resources

Why AI gets your clients' marketing data wrong.

Connecting a model to a client's data does not make it right. Here is what breaks.

  • 5 minute read
  • 4 sections

Part 1

The failure nobody sees

Point a language model at a client's marketing data and it will answer every question you ask. That is the problem. It has no way to tell you that the question could not be answered from the data it was given, so it produces a number in the same tone as a correct one.

A wrong dashboard looks wrong. Somebody notices a total that cannot be right. A wrong AI answer arrives as a sentence, in a chat window, with no total to check it against, and a sentence is the easiest thing to paste into a note to a client before anybody has checked it.

Part 2

The four things that break it

None of these are model problems. All four are properties of the data underneath, and each one produces a confident wrong answer rather than an error.

  • One metric, three names

    Each platform names spend its own way. Asked for total spend, a model either picks one column or sums columns that are not comparable.

  • Different types

    A number stored as text does not add up. It gets counted instead, and a count looks like a plausible figure.

  • Different grains

    One table is a row per day, another a row per campaign per day. Joined without reconciling that, every figure is multiplied by however many rows matched.

  • Mixed currencies

    Two platforms reporting in different currencies produce a total that is arithmetically correct and means nothing.

Part 3

Why more context does not fix it

The instinct is to give the model more: the schema, a longer prompt, a description of each table. That helps a model write better queries against data that is already consistent. It cannot make two incompatible columns compatible, because the information needed to reconcile them is not in the data at all. It is in somebody's head.

This is why 'connect your data to AI' is the easy half and the half that gets sold. Making the data answerable is the work.

In practice

What has to be true first

One name per metric, one type, one grain, one currency, across every source. That is the whole list, and it is what makes the difference between a model that can be trusted with a question and one that cannot.

SightShark does that modelling inside a warehouse you own, for every client, and then points the chatbot, the client dashboards and the alerts at the same tables. The chatbot runs on your own LLM key. The reason all three agree is that there is only one set of numbers for them to read.

See how the platform works

Questions

Questions people ask

Why does AI give wrong answers about client marketing data?

Because the data it was given cannot answer the question, and a language model has no way to say so. Four things cause it: one metric under three different names, numbers stored as text, tables at different grains, and mixed currencies. Each produces a confident wrong figure rather than an error.

Will a better AI model fix wrong marketing numbers?

No. A better model writes better queries against data that is already consistent. It cannot reconcile two columns that mean different things, because the information needed to reconcile them is not in the data. It is in somebody's head, and it has to be written down as a model first.

What does AI-ready marketing data mean?

One name per metric, one type, one grain and one currency, across every source. That is the whole list. Data that meets it can be queried by a model, a dashboard or a person and give all three the same answer.

Pricing

Priced by the clients you report on.

Compare plans
  • Starter

    $499 /month

    Up to 20 clients

  • Growth

    $999 /month

    Up to 50 clients

  • Enterprise

    Custom

    No cap on clients

Get started

Want this running on your own data?

Book a call with someone who can answer the technical questions.