Experiment using AI-generated posts on Reddit draws fire for ethics concerns -- Retraction Watch

[erronis]

https://retractionwatch.com/2025/04/28/experiment-using-ai-generated-posts-on-reddit-draws-fire-for-ethics-concerns/

An experiment deploying AI-generated messages on a Reddit subforum has drawn criticism for, among other critiques, a lack of informed consent from unknowing participants in the community.

The university overseeing the research is standing by its approval of the study, but has indicated the principal investigator has received a warning for the project.

The subreddit, r/ChangeMyView (CMV), invites people to post a viewpoint or opinion to invite conversation from different perspectives. Its extensive rules are intended to keep discussions civil.

. . .

“This is one of the worst violations of research ethics I’ve ever seen,” Casey Fiesler, an information scientist at the University of Colorado, wrote on Bluesky. “Manipulating people in online communities using deception, without consent, is not ‘low risk’ and, as evidenced by the discourse in this Reddit post, resulted in harm.”

. . .

The genie is out of the bottle and won't be put back in. This particular "experiment" was not well planned or controlled but at least it had a valid scientific purpose. The main problem is that the subjects were not informed and did not have an opportunity to consent/deny.

[erronis]

1. To add another excerpt:

The moderators had also asked the University of Zurich to block the research from being published. The response from the university noted that is outside their purview. A university response quoted in the post stated:

“This project yields important insights, and the risks (e.g. trauma etc.) are minimal. This means that suppressing publication is not proportionate to the importance of the insights the study yields.”

[highplainsdem]

2. The researchers and their university should be sued.

[andym]

3. The "experiment" is happening for real by bad actors and others, so this is much adieu about nothing

AI-originated posts without attribution to AI are now occurring and pose risks according to some analyses. For example, https://www.rand.org/pubs/articles/2024/social-media-manipulation-in-the-era-of-ai.html
The research in the OP is actually useful because it points out some of the potential consequences.

[erronis]

4. AI-Reddit study leader gets warning as ethics committee moves to 'stricter review process'

New from Retraction Watch:
https://retractionwatch.com/2025/04/29/ethics-committee-ai-llm-reddit-changemyview-university-zurich/

The university ethics committee that reviewed a controversial study that deployed AI-generated posts on a Reddit forum made recommendations the researchers did not heed, Retraction Watch has learned.

The principal investigator on the study has received a formal warning, and the university’s ethics committees will implement a more rigorous review process for future studies, a university official said.

As we reported yesterday, researchers at the University of Zurich tested whether a large language model, or LLM, can persuade people to change their minds by posting messages on the Reddit subforum r/ChangeMyView (CMV). The moderators of the forum notified the subreddit about the study and their interactions with the researchers in a post published April 26.

. . .

Reddit has issued a response to the study as well. Reddit’s chief legal officer Ben Lee posted on the CMV thread:

What this University of Zurich team did is deeply wrong on both a moral and legal level. It violates academic research and human rights norms, and is prohibited by Reddit’s user agreement and rules, in addition to the subreddit rules. We have banned all accounts associated with the University of Zurich research effort.

. . .

[SCantiGOP]

5. I don't see this as a big deal

All marketing is basically an experiment where the target audience is not informed of the procedures and purposes.
Ads, especially clickbait, are posted and the poster observes (and profits) from the reactions.

[erronis]

6. You are right. We are all part of thousands/millions of experiments all our lives.

Parents trying to decide the best way to bring us up.

Companies trying to get us to buy their products.

Now, governments trying to figure out how to get us to die sooner.