Experiments and Impact
What was the measured effect of our work?
Example finding
A baseline window and a current window
The experiment stores both windows and the rule, then reports the change with caveats, and GA4 sessions alongside it if Google is connected.
Quick answer: Experiments and Impact
Experiments wrap one completed verification with a decision rule fixed in advance, met, not met or inconclusive, and, where Google is connected, the same two windows read against real GA4 sessions as a parallel fact.
What you see
Every experiment wraps one completed verification with a decision rule fixed in advance, met, not met, or inconclusive, and, where Google is connected, the same baseline and current windows read against real GA4 sessions as a parallel fact, never folded into the measured rate.
Decision rule, set in advance
Which verification outcomes count as met or not met, fixed before the result is in.
Baseline and current windows
The same two windows the verification used, carried through.
Business impact, where connected
GA4 sessions for the same two windows, shown alongside, not combined into one number.
Outcome
Met, not met, or inconclusive, never rounded up without a stored rule.
How it works
- 1
Set the rule
Decide in advance which verification outcomes count as met or not met.
- 2
Compare
Read the verification's result and, if Google is connected, GA4 sessions for the same two windows.
- 3
Conclude
Report met, not met or inconclusive, with the rule and both windows shown.
How it is measured
Definitions come first, so numbers stay comparable from one audit to the next.
- Baseline and current
- The two windows compared.
- Decision rule
- The rule that decides the result, stored in advance, never adjusted after the fact.
- Outcome
- Met, not met or inconclusive, with sample size and caveats.
Good to know. It never claims causation: GA4 business impact is shown as a parallel fact over the same two windows, not blended into the measured rate. Requires a completed verification to wrap, and GA4 for the business impact side is optional.
Common questions
Is this A/B testing?
It is a before and after comparison over explicit windows with a stored decision rule, with causality caveats. It is not a randomised trial.
Do I need Google Analytics connected for this to work?
No. The verification result and decision rule stand on their own. GA4 adds business impact as a parallel fact when it is connected.
Is it a randomised test?
No. It is a before and after comparison with stated caveats, wrapping a verification with a decision rule fixed in advance.
A short checklist
- Complete a verification first
- Define the decision rule in advance
- Connect GA4 if you want business impact alongside
- Read the outcome: met, not met or inconclusive
- Feed the result into your next priority call
Who uses it
- Growth lead
- What worked, with caveats and a stored rule.
- Analyst
- Stored windows and rules, never adjusted after the fact.
- Executive sponsor
- Business impact shown as a parallel fact, not folded into the rate.
Common mistakes
Changing the rule afterwards
Store it in advance, before the verification result is in.
Overstating impact
GA4 impact is a parallel fact for the same two windows, not proof the action caused it.
Expecting GA4 to be required
It is optional; the verification result and decision rule stand on their own without it.
See Experiments and Impact on your own brand.
Start with a first audit. We show where you appear, who is named instead, and what to fix first.