FBI Warns Of GenAI Abused Create Sophisticated Social Engineering Attacks

The Federal Bureau of Investigation (FBI) has issued a stark warning about the escalating use of GenAI (Generative AI) by criminals to perpetrate large-scale fraud with unusual credibility.

This alarming trend marks a significant shift in the landscape of cybercrime, as AI tools are being exploited to create highly convincing scams that are increasingly difficult to detect.

GenAI (Generative AI) has become a powerful weapon in the arsenal of cybercriminals, allowing them to craft sophisticated social engineering attacks with minimal effort.

These AI tools can synthesize entirely new content based on input data, effectively eliminating human errors that might otherwise serve as red flags for potential victims.

The law enforcement analysts observed that as the AI technology continues to advance, the line between genuine and fraudulent content becomes increasingly blurred.

Leveraging 2024 MITRE ATT&CK Results for SME & MSP Cybersecurity Leaders – Attend Free Webinar

Technical Analysis

Text-Based Scams

Criminals are leveraging AI-generated text to create believable content for social engineering, spear phishing, and various financial fraud schemes. This includes:

• Generating numerous fictitious social media profiles
• Crafting persuasive messages to reach a wider audience
• Improving language translations to target victims across linguistic barriers
• Creating content for fraudulent investment websites
• Implementing AI-powered chatbots on malicious sites

Visual Deception

AI-generated images are being used to bolster the credibility of fraudulent schemes. Criminals are creating:-

• Realistic profile photos for fake social media accounts
• Fraudulent identification documents
• Convincing images for private communications
• Fake celebrity endorsements for counterfeit products
• Manipulated images to elicit donations for non-existent charities

Audio and Video Manipulation

The FBI warns that AI is also being used to clone voices and create deepfake videos, further enhancing the sophistication of these attacks.

Voice Cloning

Criminals are using AI-generated audio to impersonate public figures or personal relations, often to:

• Simulate loved ones in crisis situations requesting immediate financial assistance
• Gain unauthorized access to bank accounts through voice impersonation

Video Manipulation

AI-generated videos are being employed to:

• Conduct fake video chats with alleged executives or authority figures
• Create promotional materials for fraudulent investment schemes

To combat these AI-enhanced threats, the FBI recommends several protective strategies:

1. Establish secret verification phrases with family members
2. Be vigilant for subtle imperfections in AI-generated content
3. Pay close attention to tone and word choice in communications
4. Limit personal image and voice content online
5. Independently verify the identity of callers claiming to represent organizations
6. Never share sensitive information with unknown individuals online or over the phone
7. Avoid sending money or assets to unfamiliar persons

The FBI’s warned and strongly urged public to remain vigilant and adopt proactive measures to protect themselves against these evolving cyber threats.

Analyse Real-World Malware & Phishing Attacks With ANY.RUN - Get up to 3 Free Licenses