Illustration for: New York Says TikTok Gave Teens A Fake Safety Switch

New York Says TikTok Gave Teens A Fake Safety Switch

New York alleges TikTok ran an experiment giving some teens a non-functioning version of its Algo Refresh safety tool while their feeds stayed unchanged, part of a lawsuit joining two dozen other state cases.

ShareXLinkedInEmail

THE RUNDOWN

1

A placebo safety feature is a different, more serious legal claim than a slow rollout or a buggy feature -- it implies TikTok knew the tool did nothing for some users and let them believe otherwise.

2

This builds directly on a June Bloomberg report that a separate TikTok experiment withheld a safety feature from 15 million US users, including a teenager who later died by suicide, showing a pattern of experimentation on safety tools rather than a one-off.

3

More than two dozen state lawsuits now target TikTok's platform design, a legal volume that raises real civil-liability and compliance-cost exposure regardless of how any individual suit resolves.

4

For any consumer or AI-agent app running A/B tests on safety-adjacent features, this case is a preview of how regulators will treat split-testing when the control group believes it has protection it does not actually have.

The VC Read

Value Add VC analysis

Any startup running experiments on anything a user could reasonably call a safety feature -- content moderation, crisis-detection prompts, parental controls -- should read this complaint closely: the legal exposure here isn't the A/B test itself, it's the gap between what users were told and what the control group actually got. That gap is now a specific, named legal theory a state AG is willing to litigate, not just a PR risk.

Analysis

New York's attorney general alleges TikTok ran an experiment that gave some teens and children a non-working version of a safety feature called Algo Refresh, while leading them to believe it was active, according to a new state lawsuit reported by TechCrunch.

What the lawsuit claims

Algo Refresh is meant to let users reset their recommendations and stop seeing unwanted or potentially harmful content. The lawsuit alleges that in an experiment involving thousands of users, participants who opted into Algo Refresh believed the feature was active, but their feeds did not actually change -- while users outside the experiment group received a fully functioning version of the same tool. New York's suit also alleges TikTok ran additional, undisclosed experiments beyond this one.

“## What the lawsuit claims Algo Refresh is meant to let users reset their recommendations and stop seeing unwanted or potentially harmful content.”

Part of a broader, escalating legal pattern

New York's case is one of more than two dozen state lawsuits accusing TikTok of designing its platform to encourage addictive use among children and of misleading users about its safety tools -- the same category of claim behind the $100M Alabama settlement Pulse covered last month. It follows a June Bloomberg report that a separate TikTok experiment withheld a safety feature entirely from 15 million US users -- including a teenager who later died by suicide -- a case serious enough that US senators publicly demanded answers from the company. Taken together, the two reported experiments suggest TikTok has repeatedly tested safety-feature access on real users without their knowledge, not as an isolated incident.

TikTok's response

TikTok told Reuters it regularly tests new products and features to validate the experience and understand how they work in the real world; the company did not immediately respond to TechCrunch's request for comment on this specific lawsuit.

The counterweight

TikTok's defense -- that split-testing features is normal product practice -- is true as a general matter; however, the specific allegation here is not that a feature rolled out slowly, but that users were told a safety tool was protecting them when, per the complaint, it was not. Whether courts treat that distinction as a meaningful legal line or as ordinary A/B testing that happened to involve a sensitive feature will shape how every consumer platform runs similar experiments going forward. The suit's claims have not been proven in court.

What to watch

Whether other states amend their existing TikTok suits to add similar placebo-feature claims, and whether this becomes the test case that determines if split-testing a safety feature, specifically, requires disclosure that ordinary feature testing does not.

ShareXLinkedInEmail

Key Sources

2 sources

Reported by TechCrunch · Analysis by Value Add Pulse.

← Back to Pulse

THE WIRE in your inbox— Tech, startup & VC news with The VC Read, a few times a week. Free to subscribe, no spam.