As the Indian election progresses, the proliferation of AI-generated videos has become a prevalent phenomenon, prompting varied responses and raising concerns among officials and law enforcement. One such video depicts an exuberant Narendra Modi, adorned in modern attire, dancing to a Bollywood tune on stage.
A still frame from the AI-generated video.
Perhaps a bit surprisingly, the video gained praise from the Indian prime minister himself, who shared the video, expressing delight at the creativity during the peak election season.
In contrast, another AI-generated video portrays Modi’s political rival, Mamata Banerjee, dancing in a saree-like attire against a backdrop of her critical speech segments aimed at those who defected from her party to support Modi. The dissemination of this video has prompted an investigation by state police, citing potential implications for law and order.
These differing reactions to AI-generated videos underscore the escalating use and misuse of technology, presenting challenges for regulators and security agencies in the context of India’s massive general election. The ease with which AI videos can be created, featuring remarkably realistic movements, poses a significant risk, particularly in a country where a large portion of the population lacks technological proficiency. Manipulated content has the potential to exacerbate sectarian tensions, especially amid the electoral fervor.
According to a survey by the World Economic Forum, the threat of misinformation in India is perceived to be higher than that of infectious diseases or illicit economic activities in the coming years. The rapid spread of misinformation facilitated by AI technology poses serious risks, especially among elderly individuals who are often not well-versed in technology and are susceptible to false narratives. This heightened risk could lead to the incitement of hatred based on factors such as community, caste, or religion.
The ongoing national election, spanning six weeks and ending on June 1, marks the first instance of AI deployment in Indian electoral campaigns. While initial applications were benign, recent instances of misuse, including deepfake videos targeting Bollywood actors critical of Modi and fabricated clips involving prominent aides of Modi, have garnered significant attention and resulted in the arrest of several individuals.
Last week, India’s Election Commission issued a warning to political parties regarding the use of AI for spreading misinformation, highlighting seven provisions of information technology and related laws that carry penalties of up to three years’ imprisonment for offenses such as forgery, rumor-mongering, and inciting enmity.
Expressing concerns over the potential for fake news to incite unrest, a senior national security official in New Delhi emphasized the challenge posed by the widespread availability of AI tools, particularly during elections, and the difficulty in effectively countering such misinformation. The official noted the lack of sufficient monitoring capabilities to keep pace with the constantly evolving AI landscape.
A senior election official echoed these sentiments, acknowledging the inability to fully monitor social media content, let alone control it. Both officials declined to be identified due to the absence of authorization to speak to the media.
The use of AI and deepfakes in elections is a growing trend globally, seen in countries like the US, Pakistan, and Indonesia. The recent proliferation of AI-generated videos in India underscores the challenges faced by authorities in combating misinformation.
For years, an Indian IT ministry panel has had the authority to order the blocking of content deemed potentially harmful to public order, either at its discretion or in response to complaints. During the current election, the Election Commission and law enforcement agencies nationwide have deployed hundreds of officials to identify and request the removal of problematic content.
While Prime Minister Modi responded lightheartedly to his AI-generated dancing video, stating, “I also enjoyed seeing myself dance,” the Kolkata city police in West Bengal launched an investigation against a user named SoldierSaffron7 for sharing the video featuring Mamata Banerjee.
A Kolkata cybercrime officer, Dulal Saha Roy, issued a notice to the user via X, urging them to delete the video to avoid facing strict legal action. The user, communicating anonymously through X direct messaging, refused to comply, expressing reluctance to share their personal details out of fear of police repercussions and asserting their intention to retain the video despite potential consequences.
The dancing videos featuring Modi and Banerjee, garnering 30 million and 1.1 million views respectively on X, were generated using the free website Viggle. This platform enables users to create videos depicting individuals in uploaded photographs dancing or engaging in various real-life actions, following simple instructions outlined in a tutorial.
