Shopify Video A/B Test: Why a YouTube Section Lowered Revenue per Visitor by 4.8%

TL;DR

A European car diagnostics brand sells an OBD2 scanner alongside a paid app that unlocks hidden car features, advanced diagnostics and service tools.

The product is easier to show than to describe: plug in the scanner, open the app, and switch off a factory setting such as the seatbelt chime. Many buyers arrive on a recommendation from other owners.

As part of our Shopify A/B testing programme for the store, we added a YouTube video section to the homepage and product pages, then tested it against the original pages. It lowered revenue per visitor by 4.8%.

The challenge: proving the product works before the shopper buys it

A car coding tool asks shoppers to trust that it will work on their car and that they can use it themselves. Copy and specification lists do little to settle that. Video can show a real car and a real setting changed in under a minute.

The research: what shoppers trust

Our Shopify CRO research for this store combined analytics, a store walkthrough and customer survey and review analysis.

• ✓Community validation: 29 survey mentions named forum or social recommendations, including model-specific Facebook groups, as part of the decision.
• ✓Ease of use: 49 mentions across reviews and surveys described the device simply working once plugged in.
• ✓Dealer savings: reviewers cited savings of $100 to more than $1,100 against the dealership price.

The hypothesis: show the product in use

If we show the product in use on video on the homepage and product pages, shoppers will feel more confident that it works for them, increasing revenue per visitor.

The variation: a YouTube video section

The variation added a section of YouTube videos to the homepage and product pages. The test measured the combined effect of these changes and does not isolate any single element.

The results: -4.8% revenue per visitor

We ran the test in Intelligems, comparing the original pages with the variation.

The loss came from conversion: fewer visitors completed a purchase, while the shoppers who did buy spent slightly more.

What this test taught us about video on product pages

Video was the right medium with the wrong messenger. Shoppers read brand video as advertising, while a video from another owner reads as proof.

For a store whose buyers often arrive on the strength of a forum thread, that difference decides whether a section builds confidence or just adds length to the page.

We kept the placement and replaced the content with user-generated video. That version, running since 3 June 2026, lifted revenue per visitor by 19.52%, conversion rate by 13.74% and average order value by 5.08%.

Find out what proof your shoppers need to see

We plan, build and run A/B tests for Shopify stores, grounded in customer research rather than guesswork. Get in touch to find out what to test next.