Key Takeaways
- Spam accounts on Facebook are using AI-generated photos and misinformation to deceive football fans
- These accounts are claiming to be fan accounts for various National Football League teams, but are actually spreading false information
- The accounts are likely using fake news stories to drive traffic to off-Facebook domains and garner ad revenue
- The use of AI-generated photos and fake news stories is a common tactic used by spam accounts to build an audience and evade detection
- Facebook is struggling to keep up with the proliferation of these accounts, with new ones emerging even after others are shut down
Introduction to the Problem
If you haven’t checked your Facebook account in a while, you may be surprised to find that spam accounts are still thriving on the platform. These accounts have now turned their attention to football fans, using AI-generated photos and misinformation to deceive them. A group of accounts claiming to be fan accounts for various National Football League teams has been identified, each with a few thousand followers. However, a closer look at these pages reveals a series of seemingly AI-generated photos and false information. As one of the accounts, a Pittsburgh Steelers fan account with 11,000 followers, claimed, "After His Desire To Return To The Steelers Was Not Fulfilled, Instead Of Reacting With Anger Or Resentment, The Former Player Chose To Retire And Join The Pittsburgh Police Department To ‘Wear Pittsburgh Colors Once Again.’" This post was accompanied by a fake image of former football wide receiver Adam Thielen in a police uniform, despite Thielen having no plans to join the police force.
The Impact on Individuals
The spread of misinformation by these accounts can have serious consequences for individuals, as seen in the case of Denver Broncos reporter Cody Roark. A post on a fake fan account called "Wild Horse Warriors" claimed that Roark had passed away following a domestic violence incident, leaving behind a 5-year-old child. However, Roark is alive and well, and does not even have children. As Roark told The Denver Post, "Usually you see that happen to, like, high-profile celebrities. For that to happen to me was just really weird." The account was shut down by Meta after The Denver Post reached out for comment, but not before it had disseminated a slew of misinformation posts about Broncos players. The account’s actions are a prime example of how these fake accounts can cause harm to individuals and spread false information.
The Motivation Behind the Accounts
So, what do these accounts have to gain from spreading fake news about football players? While it’s not certain how these specific accounts operate, the pattern seems to fit what has long been utilized by Facebook spam accounts. Each post by these fake fan accounts links out to an article from a website that pretends to be a reputable news organization, such as "ESPNS" or "NCC News." As Harvard researchers wrote in a study from 2024, "Spam Pages largely leveraged the attention they obtained from viewers to drive them to off-Facebook domains, likely in an effort to garner ad revenue." These websites are usually "heavily ad-laden content farm domains—some of which themselves appeared to consist of primarily AI-composed text." The use of AI-generated photos and fake news stories is a common tactic used by these accounts to build an audience and evade detection.
The Broader Implications
The proliferation of these accounts has broader implications for the spread of misinformation on social media. As Georgetown researcher Josh Goldstein told NPR in a 2024 interview, "It could be that these were nefarious pages that were trying to build an audience and would later pivot to trying to sell goods or link to ad-laden websites or maybe even change their topics to something political altogether." The use of AI-generated photos and fake news stories can be used to manipulate public opinion and influence people’s beliefs. Facebook’s struggle to keep up with the proliferation of these accounts is a concern, as new ones emerge even after others are shut down. The platform’s algorithms are not yet sophisticated enough to detect and remove these accounts quickly, allowing them to continue spreading misinformation and causing harm.
Conclusion
In conclusion, the spread of misinformation by fake fan accounts on Facebook is a serious concern. These accounts are using AI-generated photos and fake news stories to deceive football fans and drive traffic to off-Facebook domains. The impact on individuals can be significant, as seen in the case of Cody Roark. The motivation behind these accounts is likely to garner ad revenue, and the broader implications of their actions are a concern for the spread of misinformation on social media. As Facebook continues to struggle to keep up with the proliferation of these accounts, it is essential to be aware of the potential for misinformation and to verify information before sharing it. By being vigilant and reporting suspicious accounts, we can help to reduce the spread of misinformation and keep social media platforms safe.
https://gizmodo.com/nfl-related-accounts-on-facebook-are-posting-some-of-the-most-shameless-ai-slop-yet-2000711584