In a blog post on Friday, Anthropic elaborated on its controversial watermarking system, announced earlier this week as an effort to comply with the European Union’s Artificial Intelligence Act. Watermarking will make it harder for users to get away with pretending they wrote AI-generated text.

It may be too late to preserve Anthropicâs relationships with some outraged users, who have, it appears, already canceled their subscriptions.

Posts on X show many supposed paying Claude users claiming to have cut off ties. Math and AI influencer John Ennis is one. He posted a screenshot of his cancellation Saturday, and cited Anthropicâs âridiculous watermark ideaâ as a cause.

There are countless other X users claiming to have canceled because of watermarking. âThis is bullsh*tâ wrote one. Another called Anthropic the r-slur in response to one of its X posts about watermarking. âWhy should I, being a non EU citizen watermark my work generated by a paid subscription of Claude?â asks another.

Anthropicâs explanation does make fascinating reading if youâre not a cryptographer, and you imagined that the only way to watermark text is by, for instance, crudely replacing certain instances of âSâ with â$â and the like. Itâs not that at all. âThe difference between watermarked and un-watermarked text will not be distinguishable to readers,â Anthropic claims.

As Anthropic notes, the system stems from the famous (to some) 2024 SynthID paper, meaning itâs the same basic technology Google uses for its SynthID watermarking system. The text implementation for Google’s SynthID is summed up quicklyâmaybe a little too quicklyâin this video from Google:

In a bit more detail, the watermarking in Claudeâs text outputs takes the form of token choices likely to be favored according to a secret key, a string of characters Anthropic compares to pi in terms of its complexity and randomness. The watermarking system generally applies when the stakes are low, like in the example sentence, âThe weather today was cold andâ¦â where the next token could result in the word âgreyâ or, just as likely, âovercast.â On the other hand, in the case of âParis is the capital of…â the watermarking system is unlikely to kick in, because thereâs only one âcorrectâ token for that situation: “France.”

The key steers these low-stakes token choices toward statistical âpreferencesâ that canât be detected by a human reader in part because theyâre context-dependent. âOvercastâ in the above example might be the keyâs preference in one situation, but depending on the context, it might prefer “grey,” and thereâs no way for a human to know which it will be at what time.

In a long text, enough statistically preferred tokens constitute the watermark, and a detector will be sure that passage was generated by Claude. In shorter texts, or in certain kinds of coding with few ambiguities, the watermark might not be as visible to the detection system, which will be available as an API. Anthropic says generating the watermark has a ânegligibleâ impact on speed and token cost.

One remarkable section of Anthropicâs blog post is the passage on editing, which makes it clear that even if Claude is ostensibly only used to edit human-written text, the watermark may appear. âDepending on the length of the text and how heavily Claude has edited it, those changes might not be enough to make Claudeâs involvement detectable,â the blog post says. So caveat emptor to all the AI-using “editors” out there.

As Insiderâs story on Claude cancelations notes, some Claude users admit that they donât want their AI-generated work to be detected by clients and school faculty who expect work to be done by a human.

But for what itâs worth, these cancelations might be a blipâor even lessâand not some major change in consumer attitudes toward Anthropic. People regularly complain about Anthropic and other AI companies on X, and even claim to be canceling. Currently, some apparent Claude users claiming to have canceled their subscriptions also cite a recent Wall Street Journal article about CEO Dario Amodeiâs wifeâs past business practices as a cause for their cancelations. Anthropic claimed to Business Insider that in terms of the number of cancelations itâs seeing, there hasnât been an increase since watermarking was announced.