Skip to content
BrandWater AI
AgentAvailable at launch

Experiments and Impact

What was the measured effect of our work?

What you will see

Example finding

A baseline window and a current window

The experiment stores both windows and the rule, then reports the change with caveats, and GA4 sessions alongside it if Google is connected.

Quick answer: Experiments and Impact

Experiments wrap one completed verification with a decision rule fixed in advance, met, not met or inconclusive, and, where Google is connected, the same two windows read against real GA4 sessions as a parallel fact.

What you see

Every experiment wraps one completed verification with a decision rule fixed in advance, met, not met, or inconclusive, and, where Google is connected, the same baseline and current windows read against real GA4 sessions as a parallel fact, never folded into the measured rate.

Decision rule, set in advance

Which verification outcomes count as met or not met, fixed before the result is in.

Baseline and current windows

The same two windows the verification used, carried through.

Business impact, where connected

GA4 sessions for the same two windows, shown alongside, not combined into one number.

Outcome

Met, not met, or inconclusive, never rounded up without a stored rule.

How it works

  1. 1

    Set the rule

    Decide in advance which verification outcomes count as met or not met.

  2. 2

    Compare

    Read the verification's result and, if Google is connected, GA4 sessions for the same two windows.

  3. 3

    Conclude

    Report met, not met or inconclusive, with the rule and both windows shown.

How it is measured

Definitions come first, so numbers stay comparable from one audit to the next.

Baseline and current
The two windows compared.
Decision rule
The rule that decides the result, stored in advance, never adjusted after the fact.
Outcome
Met, not met or inconclusive, with sample size and caveats.

Good to know. It never claims causation: GA4 business impact is shown as a parallel fact over the same two windows, not blended into the measured rate. Requires a completed verification to wrap, and GA4 for the business impact side is optional.

Common questions

Is this A/B testing?

It is a before and after comparison over explicit windows with a stored decision rule, with causality caveats. It is not a randomised trial.

Do I need Google Analytics connected for this to work?

No. The verification result and decision rule stand on their own. GA4 adds business impact as a parallel fact when it is connected.

Is it a randomised test?

No. It is a before and after comparison with stated caveats, wrapping a verification with a decision rule fixed in advance.

A short checklist

  • Complete a verification first
  • Define the decision rule in advance
  • Connect GA4 if you want business impact alongside
  • Read the outcome: met, not met or inconclusive
  • Feed the result into your next priority call

Who uses it

Growth lead
What worked, with caveats and a stored rule.
Analyst
Stored windows and rules, never adjusted after the fact.
Executive sponsor
Business impact shown as a parallel fact, not folded into the rate.

Common mistakes

  • Changing the rule afterwards

    Store it in advance, before the verification result is in.

  • Overstating impact

    GA4 impact is a parallel fact for the same two windows, not proof the action caused it.

  • Expecting GA4 to be required

    It is optional; the verification result and decision rule stand on their own without it.

See Experiments and Impact on your own brand.

Start with a first audit. We show where you appear, who is named instead, and what to fix first.