Spammers flood Reddit with fake posts to manipulate AI searches

Platforms like Reddit are actually considered a place for authentic exchange between users. But professional agencies are currently introducing masses of fake posts in order to specifically distort the results of AI services such as ChatGPT.

AI manipulation through Reddit spam

Companies specifically use the social media platform Reddit as a tool to influence the results of text generators such as ChatGPT or Google AI search. With this scam, agencies place seemingly organic posts in well-visited forums. The primary goal is for large language models (LLMs) to pick up the manipulated data when automatically searching the Internet and integrate it into their future answers. The subforum r/biohackers, in which users exchange information about dietary supplements and experimental biology, is particularly affected. Sellers of peptides and hormone replacement therapies, or HRT for short, have published massive amounts of camouflaged advertising there. At first glance, the accounts appear authentic, have a long contribution history and deliberately sprinkle brand mentions into ongoing discussions. The moderators then banned independent contributions to the topics.

Agencies trick algorithms

According to 404 Media there is a strategy behind the approach called Answer Engine Optimization, abbreviated AEO. Service providers like RedRover offer to improve rankings in AI search engines by mass publishing special content. The agencies specifically analyze the input patterns that are preferred by the language models in order to generate artificial engagement and deceive the algorithms. It is extremely difficult for the platform operators to defend against the targeted campaigns. Reddit uses automated tools and human reviewers to quickly filter out inauthentic behavior. Nevertheless, the line between real discussions and paid advertising is becoming increasingly blurred. Moderators emphasize that they often have to rely on mere pattern recognition. This poses a great risk of incorrectly excluding innocent users through filters that are too strict.

Health risks and benefits

The AEO strategy offers companies the financial advantage of reaching target groups directly and very efficiently in an AI-driven search landscape. At the same time, forum moderators warn of significant physical harm to readers. This is particularly true when unregulated medical substances are falsely presented as safe through manipulated AI responses and recommended to young users. In addition, the general quality of real human interaction suffers. The constant confrontation with such practices leads many users to a noticeable frustration with artificially generated content on the Internet. They are calling for better spam detection by the developers of major language models.