The Governance Gap in AI-Enabled Influence Campaigns

0
2

Key Takeaways

  • AI‑generated bot farms have evolved from simple, detectable spam networks to sophisticated “Smart Propaganda Systems” that build psychological profiles, adapt messaging in real time, and flood search results with fabricated content.
  • The United States currently lacks a comprehensive legal framework to govern these operations; existing authorities (FEC, DOJ, state bot‑disclosure laws) are reactive, narrow, or easily evaded by advanced AI.
  • Comparative regulation in the European Union—through the Digital Services Act and the AI Act—imposes risk‑assessment obligations, data‑access for researchers, and labeling requirements that the U.S. does not mandate.
  • First‑Amendment protections create a significant hurdle for any U.S. effort to regulate anonymous political speech, pushing policymakers toward structural interventions (transparency, bot labeling, pre‑bunking) rather than direct content bans.
  • Without federal legislation that treats coordinated inauthentic behavior as a systemic regulatory problem, the gap between AI‑driven influence capabilities and legal oversight will continue to widen.

Introduction: AI‑Generated Bot Farms and the Lack of Legal Framework
“The United States lacks a legal framework to govern AI‑powered bot farms and coordinated political manipulation.” This opening statement frames the core problem: while foreign actors deploy increasingly sophisticated AI personas to shape U.S. discourse, Congress and federal agencies have yet to enact a unified statute that addresses the technology’s unique challenges. The absence of a clear legal baseline leaves platforms, researchers, and law enforcement scrambling to respond to threats that evolve faster than the law can adapt.


Case Study: Sue Williamson and Ricardo Abbott – Kremlin‑Backed Personas
“Sue Williamson and Ricardo Abbott were two ordinary Americans voicing their pro‑Russian opinions on X, formerly known as Twitter, in 2024. Or were they? They were actually AI‑generated personas, part of a Kremlin‑backed bot farm disrupted by the Department of Justice in July 2024.” The Williamson‑Abbott case illustrates how AI‑driven accounts can masquerade as genuine citizens, spreading pro‑Russian narratives while evading traditional detection methods that rely on repetitive posting patterns. The DOJ’s disruption was a rare enforcement win, but it highlighted the reactive nature of current U.S. capabilities.


GoLaxy’s “Smart Propaganda System” – Leaked Documents
In September 2025, leaked documents from the Beijing‑based firm GoLaxy revealed a “Smart Propaganda System”—a network of artificial intelligence (AI)-generated personas engineered to build psychological profiles of targets, adapt their messaging in real time, and saturate search results with fabricated content to warp the targets’ perceptions. One internal dossier showed the system had targeted 117 members of the U.S. Congress. Unlike older bot farms that merely broadcast propaganda, these accounts listened, learned, and persuaded, demonstrating a shift from blunt amplification to nuanced, adaptive influence.


OpenAI Disruption of Chinese Influence Operation
OpenAI reported in June 2026 that it had disrupted a Chinese influence operation that used its own tool—ChatGPT—to generate social media posts targeting U.S. public opinion on tariffs, AI policy, and data centers. This incident underscores that even the creators of leading AI models can be unwitting enablers of foreign manipulation when their services are repurposed for covert campaigns. The disruption relied on internal monitoring rather than any external legal mandate, highlighting the gap between platform self‑policing and statutory oversight.


Technological Shift: From Labor‑Intensive Bot Farms to AI‑Driven Influence
Traditional bot farms were labor‑intensive—operators ran networks of fake accounts that mimicked human posting behavior, and their repetitive patterns made coordinated inauthentic behavior detectable by researchers and platforms. The new generation of AI‑enabled influence operations has eroded many of those detection advantages. A Frontiers in Artificial Intelligence study documents that AI‑generated election disinformation is now indistinguishable from authentic human‑written journalism in more than half of evaluated instances—meaning that the tools platforms and researchers built to flag synthetic content are increasingly inadequate. The same study found that bot‑driven accounts constitute roughly 25 percent of Twitter activity and that AI‑generated fake news websites have grown tenfold, with over 1,200 such sites identified by 2024 alone.


Persuasion Power: AI Chatbots Shifting Voter Views
Research published in late 2025 found that AI chatbots shifted voters’ political views by a substantially larger margin than traditional political advertising. Bot farms are no longer simply amplifying messages that humans might otherwise ignore; they are actively constructing and updating in real time the information environment in which political judgments are made. This capability to tailor persuasive content to individual psychological profiles marks a qualitative leap beyond mere volume‑based propaganda, raising the stakes for any regulatory response.


Current U.S. Regulatory Landscape – Gaps and Reactive Enforcement
The existing U.S. regulatory architecture was not designed to address this threat. In 2024, the Federal Election Commission (FEC) declined to issue binding rules addressing AI‑generated content in campaign communications, adopting only an interpretive rule that clarified existing misrepresentation prohibitions apply, regardless of the technology used. The FEC’s authority under the Federal Election Campaign Act applies specifically to candidates and their agents—it does not extend to political action committees, foreign state actors, or private firms operating AI persona networks from abroad. The Justice Department has pursued foreign bot operations under the International Emergency Economic Powers Act and federal money‑laundering statutes, while separately charging foreign operatives under the Foreign Agents Registration Act. This reactive, case‑by‑case enforcement leaves the underlying infrastructure of AI‑driven influence operations largely unaddressed.


State‑Level Efforts and Congressional Calls for Transparency
Several states, including California, have enacted bot disclosure laws requiring operators of automated accounts to identify themselves as such. However, disclosure requirements designed for crude spam bots offer limited protection against AI systems sophisticated enough to evade current detection systems. In a letter written by members of Congress in October 2025, they asked social media platforms to share metrics on bot prevalence and describe their coordination with federal agencies—an acknowledgment of how much remains unknown and ungoverned. These state and congressional actions reflect growing concern but remain piecemeal and insufficient to curb AI‑scale manipulation.


EU Contrast: Digital Services Act and AI Act
The EU’s Digital Services Act, which entered into force for large platforms in 2023, requires designated platforms to conduct annual risk assessments addressing systemic threats—including information manipulation and coordinated inauthentic behavior—and to provide vetted researchers with access to platform data for independent auditing. The EU AI Act separately requires that AI‑generated content be clearly labeled. Neither Act fully closes the regulatory gap, but together they create obligations directed at the infrastructure of manipulation, and they provide researchers and regulators with data access that no U.S. framework currently mandates. This contrast underscores the potential of a comprehensive, transparency‑focused approach that the United States has yet to adopt.


U.S. Legal Obstacles and Policy Directions
Constructing an analogous U.S. framework faces genuine legal obstacles. The First Amendment offers broad protection to anonymous political speech, and courts have been skeptical of disclosure requirements that chill protected expression. Any federal statute governing AI‑generated political content would need to navigate the line between regulating deceptive foreign manipulation and regulating domestic political speech, which holds the highest constitutional protection. The Frontiers study’s policy recommendations reflect this constraint—rather than targeting content directly, the authors propose structural interventions aimed at reducing the economics of manipulation, which includes platform transparency obligations, mandatory bot labeling for AI‑generated accounts, and pre‑bunking standards during election periods.

The Trump Administration’s response to date points in the opposite direction. In January 2026, the Department of Justice established an AI Litigation Task Force tasked with challenging state AI laws—including the bot disclosure laws that currently represent the only domestic legal check on automated political accounts. In March 2026, the White House released a National AI Legislative Framework that explicitly recommends against creating any new federal rulemaking body to regulate AI and calls instead for governing AI through existing agencies whose mandates were not designed with influence operations in mind. Taken together, these developments suggest that the federal government is moving away from the structural intervention this problem requires.


Conclusion: Need for Structural Regulation
The conclusions drawn from the GoLaxy documents suggest that the gap between what AI‑powered influence operations can do and what the law can address is widening, not narrowing. A July 2026 Brennan Center report confirmed that foreign influence threats to U.S. elections remain elevated. That awareness has not yet translated into adequate action—Senator Schiff recently reintroduced legislation targeting AI‑generated political deepfakes, but a bill focused on synthetic images alone does not address the bot farm infrastructure at the heart of the problem. Closing it will require federal legislation that treats coordinated inauthentic behavior as a structural regulatory problem rather than as just a content moderation challenge for platforms to manage on their own. Only by confronting the economics, transparency, and systemic enablers of AI‑driven manipulation can the United States hope to safeguard its democratic discourse against the next generation of covert influence campaigns.

The Regulatory Vacuum in AI-Amplified Influence Operations

SignUpSignUp form

LEAVE A REPLY

Please enter your comment!
Please enter your name here