Technology1 min read

Dear Software Makers

By · Published by Everything Blog

In short

YouTube is preparing an A/B testing tool that lets creators upload multiple versions of the same video to compare audience performance metrics. Marques Brownlee criticized the feature in a video essay, noting that platform engineers could not resolve practical issues such as linked timestamps or viewer awareness during testing. He argued that fracturing the audience experience undermines the shared discussions that occur in the comment section. Ultimately, Brownlee asserted that chasing optimized metrics diminishes creative decision-making and platform identity.

Key points

  • Creators are being urged to reject A/B video testing to preserve their artistic choices a…: Creators are being urged to reject A/B video testing to preserve their artistic choices and avoid over-optimization.
  • Serving different video variations to users threatens the shared cultural experience fund…: Serving different video variations to users threatens the shared cultural experience fundamental to the platform's community.
  • Relying strictly on performance metrics suggests an underlying insecurity in creative dec…: Relying strictly on performance metrics suggests an underlying insecurity in creative decision-making and platform direction.

Sources checked by our analysis pipeline: 1

Marques Brownlee just released a video essay titled “Dear YouTube”.

I loved it.

He talks about how YouTube is going to start shipping this new feature where makers can essentially publish different “variants” of their videos and see which performs best (an A/B test).

Which immediately begs a lot of questions. Brownlee voices his:

- If I’m watching a video, do I know if it’s part of one of these A/B tests?

- If I’m reading the comments of a video, how do I know I saw the same thing as another commenter?

- How do linked timestamps work?

It’s pretty wild when you think about it. I mean, imagine sending someone a link, “Check out this cool video!” And at that point you’re basically crossing your fingers, “I hope they see the same thing I did…”

Marques says he spoke to some YouTube engineers about these questions and they didn’t really have answers. They were kind of just like, “We don’t know — yolo! This’ll ship soon.”

So his video is a kind of plea to YouTube creators everywhere:…

Technology