Criminal Use of AI: Trends and Tactics Revealed

At the forefront of cybersecurity discussions at the 2024 RSA Conference, provided insights into the evolving landscape of criminal exploitation of AI. Despite the hype surrounding advanced AI-powered malware scenarios, criminals are still playing catch-up with mainstream AI adoption. 

Trend Micro’s update on its 2023 investigation into the criminal use of gen-AI revealed a growing incidence of jailbreaking services like EscapeGPT, BlackHatGPT, and LoopGPT.

Navigating the Realm of Uncertainty

Amidst this landscape, uncertainty looms over the relevance and value of certain ‘services’ such as FraudGPT and others like XXX.GPT, WolfGPT, and DarkGPT. These offerings, high on claims but low on proof, are being categorized as potential ‘scams.’ Despite this, the criminal focus on mainstream AI products persists, with tools like the Predator hacking tool integrating ChatGPT for enhanced scanning capabilities.

Jailbreaking Services: A New Frontier

Criminals are shifting their focus from developing their own AI systems to leveraging mainstream AI products through jailbreaking services. Rather than investing time and resources into training their own large language models (LLMs), they’re turning to services like EscapeGPT and LoopGPT to bypass ethical constraints and maximize their criminal capabilities.

The Rise of Deepfake Services

The proliferation of deepfake technology further complicates the cybersecurity landscape. These tools are used for various malicious purposes, including social engineering attacks and identity theft. Criminals are leveraging image and video deepfakes, supported by voice deepfakes, to deceive unsuspecting victims. With minimal direct knowledge of the faked person, these deepfake services are increasingly used for identity theft and fraudulent activities, particularly in false account creation.

The Future of Criminal AI

While large-scale criminal exploitation of gen-AI remains limited, Trend Micro’s researchers highlight indications of potential future changes. As criminals strive to learn how to use AI effectively while evading law enforcement, the need for proactive measures becomes paramount. However, Efforts to mitigate jailbreaking attempts and combat the spread of deepfake technology are crucial in safeguarding against evolving cyber threats.

The criminal use of artificial intelligence(AI) presents complex challenges for cybersecurity professionals worldwide. By staying informed about emerging trends and implementing proactive countermeasures, we can effectively combat the risks posed by malicious actors. As the cat-and-mouse game between criminals and defenders continues, collaboration and innovation remain key in ensuring a safer digital future for all.

Also Read: TikTok Introduces AI-Generated Label to Enhance Transparency in Social Media