Isriel Robinson  ·  CRO & Experimentation

Portfolio  ·  CRO & Experimentation

Case studies:
what was tested,
and what actually happened

Fifteen years of conversion-rate and ecommerce operations work, written up as the experiments themselves — hypotheses, statistics, the tests that failed, and the ones I killed rather than reported. Every figure traces to a named experiment ID.

15

case studies — two employers, 4 mastheads

77

documented experiments behind them

60%+

documented win rate across both programmes

7

storefronts / mastheads / markets

Step OneAU + UK · Jan–Jun 2026
UX & Layout

PDP Redesign Programme

Six iterations rebuilding the product detail page. The UK rollout is the strongest result in the programme.

+17.6% CVR>99.99% confidence
Step OneAU · Jan–Feb 2026
Value Proposition

Landing Page CRO

Removing price from above the fold on campaign landing pages — the largest single effect in the programme.

+42.8% CVR>99.99% confidence
Step OneUS · AU · UK · Dec 2025–Jan 2026
Social Proof

Social Proof Messaging

One treatment, three storefronts, run in parallel to test whether a claim travels.

+28.1% CVR>99.99% confidence
Step OneAU / UK / US · Feb–Jun 2026
Pricing

Tiered Discounting & Pack Pricing

Unit-based tiers replaced with spend thresholds across 9 experiments, with a quantified discount-efficiency finding.

+5.5% RPVAU, confirmed twice
Step OneAU · Aug 2026
Technical CRO

Rebuilding the PDP in Liquid

An iFrame PDP re-platformed to native Liquid, gated behind two A/B validations — and a +39.9% desktop 'win' exposed as an instrumentation artefact.

0 regressions2 migrations shipped
Step OneAU · Jul–Aug 2026
Navigation & Mobile

Visual Mobile Menu

An image-led mobile menu. Clickthrough fell significantly — the signature of a shorter path, not a weaker one.

+5.1% CVRATC +4.6% sig
Step OneUS · Jul 2026
Friction Reduction

Quick Buy, Tested Twice, Killed Twice

Quick-buy cut conversion in both iterations. Stopped in 4 days — significance wouldn't have changed the decision.

−17% CVRconcept abandoned
Step OneUS · May 2026
Value Proposition

The Founder Story Tile

Right asset, wrong audience: a PDP founder tile that converts cold visitors while taxing loyal ones. The segment read became a targeting brief.

+5.7% new−44% RPV on SMS
Step OneUS · Oct 2025
Trust Signals

Trust Signals on the Lead Image

Trustpilot → +render → +USP icons: a laddered test that asked how much trust signal pays, not just whether it works.

+8.5% CVR3-variant ladder
Step OneUK · Oct 2025
Payment & Anxiety

Payment Methods on the PDP

Financing anxiety answered upstream of the cart — payment visibility at the point of decision, not checkout.

+5.6% CVRimplemented
Step OneAU + UK · Oct 2025
Friction Reduction

Mixed-Colours Bundle Builder

Killing the page-hops inside the bundle journey — +19.1% in AU, +5.6% in the UK, same week, same verdict.

+19.1% CVRwon both markets
Nine EntertainmentSMH · The Age · AFR · Nov–Dec 2023
Pricing

Intro Offer Pricing

A three-channel flash-sale programme across paywall, email and landing page — different price points win on different paywall types.

2,500+subscriptions acquired
Nine EntertainmentAll mastheads · FY22–FY24
Pricing

Personalised Pricing & Retention

Churn-propensity-tiered renewal pricing — and the pivot to randomised testing when the model's precision fell short.

6-figuremodelled annual revenue
Nine EntertainmentAFR · CRO-30.0-2312
Friction Reduction

Social Ribbon: Removing the Timer

One variable — the 30-second auto-dismiss timer removed. Expiry friction was costing engagement, not creating urgency.

+33%conversion
Nine EntertainmentSMH · The Age · CRO-73/74.0-2404
Pricing

Multi-Package Paywall

Three prices instead of take-it-or-leave-it: +70% conversions at SMH, +102% at The Age, both at 100% winning probability.

+102%The Age conversions

Revenue, traffic and baseline figures have been generalised to protect commercially sensitive data. Relative changes, confidence levels and experiment IDs are as measured.