AI-Generated Deepfakes: Legal Milestones and Challenges in the Fight Against Cybercrimes

An Ohio man has been found guilty of cybercrimes, including the creation and dissemination of AI-generated images depicting abusive sexual content, marking a significant legal milestone under the federal 2025 Take It Down Act. James Strahler, 37, admitted to cyberstalking, producing obscene visual representations of child sexual abuse, and sharing digital forgeries, which encompassed both real and AI-generated images, as per the U.S. Attorney's Office in the Southern District of Ohio. The Take It Down Act prohibits the publication of nonconsensual intimate digital content. Strahler utilized numerous AI platforms and over 100 AI web-based models on his phone to produce more than 700 illicit images for a website dedicated to child sexual abuse material, according to the Justice Department. He was apprehended after one of his adult victims reported receiving threatening messages, leading to the discovery of additional victims and the extent of his AI abuse through information extracted from his seized phone.
Kolina Koltai, a senior researcher at Bellingcat specializing in AI technology, highlighted the challenge law enforcement faces in managing such cases due to the vast amount of content offenders like Strahler create. She noted the accessibility of AI technology, which allows individuals with minimal technical knowledge to generate convincing images easily. Koltai also pointed out the proliferation of platforms dedicated to creating deepfake material, making it challenging for law enforcement to identify the tools used by cybercriminals without access to their devices or browser history. The rapid mainstream adoption of AI technology has outpaced the legal system's ability to adapt, according to attorney Matthew Faranda-Diedrich, who has dealt with cases involving deepfaked nudes. He emphasized the need for education and collaboration between law enforcement and technology experts to address the sophisticated manipulation of images by AI applications.
The distribution of nonconsensual deepfakes poses a significant threat, particularly to women and girls, who account for approximately 90% of the victims of these crimes, according to research. Faranda-Diedrich highlighted the prevalence of child victims, both as perpetrators and targets of these offenses, underscoring the importance of educating young individuals about the harmful consequences of such actions. He called for schools to take a proactive role in addressing the misuse of technology, emphasizing the need to treat these incidents as child pornography and promptly involve law enforcement to prevent further harm. The evolving landscape of AI technology and its misuse in creating deepfake content necessitates a collaborative effort among stakeholders to safeguard individuals from the detrimental effects of cybercrimes.