ACT Senator creates fake videos of PM and opposition leader to highlight risks of AI misuse in election campaigning, pressing for urgent legislation

In a provocative move, ACT Senator David Pocock has used artificial intelligence to create and share deepfake videos of Prime Minister Anthony Albanese and Opposition Leader Peter Dutton. The videos, which falsely depict the leaders announcing a ban on gambling advertising, are part of Pocock’s campaign to draw attention to the potential dangers of AI in election campaigning.

The deepfake videos, posted on social media, were intended to demonstrate how easily AI can be misused to deceive voters and manipulate public opinion. Pocock’s aim is to push the federal government to enact legislation that would ban the use of AI-generated content in election materials before the upcoming federal election.

“Now is the time for the government to act to safeguard our democracy and ensure elections are fought and won as a contest of ideas, not on the basis of who can produce the best deepfakes or tell the most convincing lies,” Pocock stated. With just five weeks remaining for Parliament to address this issue, Pocock emphasizes the urgency of implementing regulatory measures to protect the electoral process.

The use of deepfakes and generative AI has been a growing concern, especially as these technologies become more accessible and sophisticated. Internationally, similar issues have emerged, such as a controversial deepfake video in Slovakia that allegedly depicted election interference days before the general election.

In Australia, the issue of gambling advertising has also been contentious. The government has faced criticism for delaying legislation aimed at banning gambling ads, following a backbench revolt over proposed changes to the initial recommendations.

A spokesperson for Special Minister of State Don Farrell stated that the government is reviewing advice from the Australian Electoral Commission on how to regulate AI use in elections. “This is not technology we can stop — it is not going away,” the spokesperson said. “We have to find a way where Australians can have some protection from deliberately false information and content.”

The deepfake videos by Senator Pocock have generated significant discussion and concern, highlighting the pressing need for effective regulation to address the risks posed by advanced AI technologies in political campaigning.

Analysis:

Political: Pocock’s use of deepfakes serves as a critical commentary on the potential for AI to disrupt democratic processes. His actions are likely to put pressure on the government to act swiftly on AI regulation, especially in light of existing controversies over gambling advertising and election integrity.

Social: The deepfake videos raise significant concerns about misinformation and public trust in electoral processes. As AI technology advances, there is an increasing need for safeguards to prevent misuse that could undermine democratic values and public confidence.

Racial: The use of deepfakes in political contexts has broad implications, including potential impacts on various racial and ethnic groups. Misinformation and manipulated content can disproportionately affect marginalized communities, influencing public perceptions and electoral outcomes.

Gender: While the specific gender implications of the deepfake videos are not addressed in this context, the broader impact of AI-generated misinformation could affect all genders. Ensuring equitable protection from false information is crucial for maintaining a fair and balanced electoral process.

Economic: The economic implications of AI misuse in elections could be significant, affecting campaign strategies, advertising costs, and public trust in electoral outcomes. Effective regulation is necessary to mitigate potential financial and reputational risks associated with deepfake technology.