It's an interesting review, but it seems to mix some things together. Gruber's claim is that we shouldn't sacrifice quality, but none of those sources show that's what's happening. Having less diversity in answers could mean you're more consistently getting a better/worse/same quality answer. There are lots of people complaining about not being able to get a real temperature=0 answer - they'd actually welcome the consistency too.
The practical example of not liking the sentence is not great in my opinion. Instead of just re-rolling the answer, why not continue in that thread and say what you don't like? Or request 20 alternatives, say which go in the right direction and request 20 more? Retrying from scratch with one sample is a waste of time and doesn't indicate anything about quality.
Basically, it's all theoretical - show us the actual benchmarks/samples where the quality is consistently degraded.
> Natzir Turrado, a technical consultant, actually tested this (article in Spanish) by reproducing SynthID-Text on an open model with the paper's settings and a watermark key. He asked the watermarked model five times to describe a memorable trip to a coastal town. Four of the five answers he got back opened in a near-identical way: “My heart still sings/dances when I think back to my trip to the quaint coastal town of…”. For the unwatermarked model, three opened in different ways.
A test of 2/5 vs 4/5 seems to be an obviously invalid experiment.
"X is the useful part" I hate this claudism. But a good thing about recognizing these is that you can pretty much skip any youtuber that uses any claudish phrasing. But it's damn near everyone now a days using claude to write their scripts.
It's an interesting review, but it seems to mix some things together. Gruber's claim is that we shouldn't sacrifice quality, but none of those sources show that's what's happening. Having less diversity in answers could mean you're more consistently getting a better/worse/same quality answer. There are lots of people complaining about not being able to get a real temperature=0 answer - they'd actually welcome the consistency too.
The practical example of not liking the sentence is not great in my opinion. Instead of just re-rolling the answer, why not continue in that thread and say what you don't like? Or request 20 alternatives, say which go in the right direction and request 20 more? Retrying from scratch with one sample is a waste of time and doesn't indicate anything about quality.
Basically, it's all theoretical - show us the actual benchmarks/samples where the quality is consistently degraded.
> Natzir Turrado, a technical consultant, actually tested this (article in Spanish) by reproducing SynthID-Text on an open model with the paper's settings and a watermark key. He asked the watermarked model five times to describe a memorable trip to a coastal town. Four of the five answers he got back opened in a near-identical way: “My heart still sings/dances when I think back to my trip to the quaint coastal town of…”. For the unwatermarked model, three opened in different ways.
A test of 2/5 vs 4/5 seems to be an obviously invalid experiment.
The linked article in Spanish contains substantially more detail. Natzir Turrado tested hundreds of prompts.
For this example; he tested 30 prompts at 5 pass-pairs each; so 300 times.
https://natzir.com/posicionamiento-buscadores/que-es-como-fu...
This already happens as Claude watermarks all my content with "You're half right, and the half that's wrong is the useful part".
"X is the useful part" I hate this claudism. But a good thing about recognizing these is that you can pretty much skip any youtuber that uses any claudish phrasing. But it's damn near everyone now a days using claude to write their scripts.
In the post-Claudism future, we'd need a transcription -> watermark detection workflow to tell who writes their own stuff
It's good news. All text output should be watermarked and it should be serviceable but not exceptional or "creative."
The gaslighting by watermarking proponents is so off the charts.