Key Takeaways
- Gov. Kathy Hochul plans to propose legislation banning political campaigns from using AI-generated images
- The legislation aims to prohibit knowingly communicating false information and the production of non-consensual deepfakes
- The goal is to protect democracy and prevent the spread of misinformation in critical moments, including elections
- Current state law requires campaigns to disclose AI use, but does not restrict its use
- The proposed legislation is part of a broader effort to set strong and sensible standards for AI use in elections
Introduction to the Proposal
Gov. Kathy Hochul is set to propose legislation that would ban political campaigns from using images made with artificial intelligence, citing concerns that this tactic can mislead and deceive voters. According to Hochul, "With the rise of Artificial Intelligence and algorithmic social media, it’s easier than ever for bad actors to spread misinformation in critical moments, including those that can decide elections." This proposal is part of a broader effort to protect democracy and prevent the spread of misinformation, and is expected to be outlined in the State of the State address.
The Risks of AI-Generated Content
The use of AI-generated content in politics has become increasingly common, and has been used to create convincing but false images and videos. As Jen Goodman, a spokesperson for the governor’s office, noted, state law already requires campaigns to disclose when they use AI during an election cycle, but does not impede its actual use. This has led to several high-profile incidents, including the use of AI-generated videos to create fake content that can be used to mislead voters. For example, during last year’s mayoral election, the campaign of independent candidate and former Gov. Andrew Cuomo used AI to create a video of now-Mayor Zohran Mamdani eating with his hands and his hypothetical supporters committing crimes. The video was quickly taken down, but it highlights the potential for AI-generated content to be used to deceive voters.
Examples of AI-Generated Misinformation
There have been several examples of AI-generated misinformation being used in politics, both in New York and across the country. In 2024, Keith Wright, a former state assemblyman from Harlem, was embroiled in controversy when fraudsters produced an AI recording of his voice lacing profanities about a colleague. Similarly, in New Hampshire, voters received calls from an AI-generated voice telling them to avoid voting in an upcoming primary election in 2024. In New York, thousands of residents received calls from an automated voice falsely claiming that their mail-in votes would be sent to the police. These incidents highlight the potential for AI-generated content to be used to spread misinformation and interfere with the democratic process.
The Need for Regulation
The proposed legislation is part of a broader effort to regulate the use of AI in politics and prevent the spread of misinformation. As Hochul noted, "Now is the time to take action and protect our democracy or risk a slippery slope. We’re leading the nation in setting strong and sensible standards for AI use in elections, protecting voters across the state." The legislation would prohibit knowingly communicating false information and the production of non-consensual deepfakes, and would provide a framework for regulating the use of AI in politics. This is a critical step in protecting democracy and ensuring that voters have access to accurate and reliable information.
Conclusion and Next Steps
The proposed legislation is an important step in regulating the use of AI in politics and preventing the spread of misinformation. As Hochul prepares to lay out the proposal in the State of the State address, it is clear that this is a critical issue that requires immediate attention. The use of AI-generated content in politics has the potential to undermine democracy and interfere with the democratic process, and it is essential that steps are taken to prevent this. The proposed legislation is a key part of this effort, and it is hoped that it will provide a framework for regulating the use of AI in politics and protecting voters from misinformation.
https://gothamist.com/news/ny-gov-hochul-wants-to-ban-ai-images-in-political-campaigns
