Deepfake video call scam

How It Works

Deepfake video call scams represent the cutting edge of romance fraud technology. Using real-time face-swapping software, scammers can now appear on video calls as a completely different person, defeating what was previously considered the gold-standard way to verify someone's identity: "just do a video call." This makes the scam exceptionally difficult to detect.

The video call is only one layer. The same AI toolkit generates photorealistic faces of people who never existed, clones voices from a few seconds of audio and keeps convincing conversations going with dozens of victims at once. Each layer is covered below, along with the tests that still expose it.

1. Creating the deepfake identity: The scammer selects a target face, often from the stolen photos used in their fake profile, and loads it into face-swap software that overlays it onto their own face in real time. The result can now be convincing on standard-quality video calls.
2. The "proof" call: When the victim requests a video call to verify identity (a step commonly recommended to detect catfishing), the scammer agrees, using the deepfake to appear as the person in their photos. This "proof" convinces the victim they are speaking to a real person.
3. Solidifying trust: Having passed the video verification test, the scammer enjoys a much higher level of trust than a traditional catfisher. The victim becomes more emotionally invested and more willing to share personal information or send money.
4. Exploitation: With trust cemented, the scammer deploys standard romance scam tactics: emergency money requests, investment schemes, gift card solicitations, or identity theft. The deepfake video call has removed the victim's primary defense mechanism.

The Technology Behind the Call

Software applications like DeepFaceLive, FaceFusion, and various commercial face-swap apps process the webcam feed, detect the user's face, and replace it with the target face, all with minimal latency. The target face can be:

• A real person's face (using their photos as a source)
• An AI-generated face that matches the profile photos
• A composite face designed to match a specific appearance

The technology has improved dramatically since 2023. Entry-level face swapping requires only a consumer-grade computer with a modern GPU. Higher-quality swaps require more powerful hardware but remain accessible to organized criminal operations.

Beyond the Video Call: Synthetic Photos, Cloned Voices and Chatbots

What once required a scammer to steal real people's photos and laboriously type individual messages can now be automated. Each of the tools below reinforces the illusion created by the deepfake call, and each has its own weak points.

AI-Generated Profile Photos

The first and most widely adopted AI tool in romance scams is the entirely synthetic profile photo: an image of a person who has never existed. Instead of stealing real photos, as in classic catfishing, scammers use generative models such as Stable Diffusion, Midjourney, and DALL-E to produce photorealistic faces from text prompts. A scammer can request "attractive 35-year-old man in a business suit, professional headshot" and receive a gallery of options within seconds. More advanced techniques use models specifically trained on face generation (descendants of StyleGAN technology) that produce images virtually indistinguishable from real photographs.

Why this matters:

• Reverse image search is defeated. Because the person in the photo has never existed, the image will not appear anywhere else online. A reverse image search is still worth doing, but it will return no results for an AI-generated face.
• Unlimited unique identities. A single scammer can generate hundreds of unique, photorealistic profiles. When one profile is reported and removed, a new one (with a completely different face, name, and backstory) can be generated in minutes.
• Customization to target preferences. Scammers can generate faces that match the specific demographic and aesthetic preferences of their target (age, ethnicity, build, style) with far greater precision than when they had to work with stolen photos.
• Consistency across multiple photos. Advanced tools can generate multiple photos of the same synthetic person in different settings, outfits, and poses, creating a more convincing profile with varied content.

How to spot them:

• Background anomalies: AI often generates blurred, distorted, or physically impossible backgrounds. Look for warped architecture, text that does not form real words, objects that merge unnaturally, or patterns that repeat incorrectly.
• Hair and accessory artifacts: Hair strands may merge with the background, earrings may not match, and glasses may have asymmetric frames. Jewelry and accessories are areas where AI frequently produces subtle errors.
• Skin texture: AI-generated faces sometimes have an overly smooth, almost airbrushed quality, particularly noticeable when compared to casual smartphone photos of real people.
• Asymmetry issues: While human faces are naturally slightly asymmetric, AI can produce both unnatural symmetry (too perfect) and inconsistent asymmetry (one eye a different shape from the other in a way that looks wrong rather than natural).
• Teeth: Teeth are historically difficult for generative AI. Look for teeth that blur together, have inconsistent sizes, or display an unusual number (too many or too few).
• Hands and fingers: In full-body or half-body shots, check the hands. AI still frequently produces hands with an incorrect number of fingers, unusual joint angles, or fingers that merge together.
• Consistency test: Ask for additional photos. If every photo looks like a professional portrait with a different background but the same perfect quality, it may be AI-generated. Real people have casual, poorly lit, unflattering photos mixed in with good ones.

Cloned Voices

AI voice cloning can replicate a person's voice from as little as three to five seconds of sample audio. Services like ElevenLabs, Resemble AI, and open-source alternatives produce voice clones that capture accent, tone, pace, and vocal characteristics with remarkable accuracy. In romance scams, cloned voices are used for:

• Voice messages: Scammers can send voice messages that sound like the person in their profile photos, reinforcing the illusion that the fake persona is real.
• Phone calls: Combined with deepfake video or used independently, voice cloning allows scammers to make phone calls in a voice that matches the person they are impersonating.
• Voice "verification": When a victim requests proof of identity, a scammer can offer a phone call instead, using a cloned voice to "prove" they are who they claim to be.
• Emotional manipulation: A voice message saying "I love you" or "I need your help" in a convincing, personalized voice is significantly more emotionally impactful than the same words in a text message.

How to spot them:

• Ask unexpected questions requiring spontaneous speech. Pre-generated voice clips cannot respond to novel questions. If someone can only send voice messages but cannot have a real-time phone conversation, that is suspicious.
• Listen for unnatural pauses or prosody. Cloned voices sometimes have a slightly robotic rhythm, unnatural pauses between sentences, or a flatness in emotional tone, particularly when generating longer speech segments.
• Notice background audio inconsistencies. AI-generated audio may lack the natural environmental sounds (room echo, ambient noise) that would be present in a real recording.
• Request real-time conversation about something specific and timely. Ask them to describe what they see outside their window right now, or to react to a news event from today. Real-time, spontaneous speech is very difficult to fake with current voice cloning technology.

Chatbots That Write the Messages

Large language models (LLMs) like ChatGPT, Claude, and their open-source counterparts have given scammers the ability to maintain convincing text conversations with minimal human involvement. This has transformed the economics of romance scams:

• Scale: A single operator who previously managed 5-10 victim relationships can now manage 50 or more, using AI to generate personalized responses and only stepping in for critical moments (financial requests, crisis management). Organized operations with multiple operators can maintain hundreds or thousands of active scams concurrently.
• Language quality: AI eliminates the grammar errors and awkward phrasing that were once reliable red flags for scams originating from non-English-speaking countries. A scammer who does not speak English natively can now produce flawless, nuanced English text.
• Emotional sophistication: LLMs can generate empathetic, emotionally resonant messages that mimic the patterns of genuine romantic communication. They can adjust tone, express vulnerability, and create the illusion of emotional depth.
• Memory and consistency: AI systems can be configured to remember conversation history and maintain consistent personal details across thousands of messages, something that was difficult for human operators managing many victims simultaneously.
• 24/7 operation: AI does not sleep. Scam operations can maintain round-the-clock communication regardless of time zones, making victims feel they have a dedicated, attentive partner.

Because these tools are freely available, the barrier to entry has dropped, and the traditional red flags (reverse image search hits, grammar errors, inability to video call) are all neutralized. More convincing personas, better language, and the ability to video call all increase the probability that a target will be deceived.

How to spot a chatbot:

• Test with specifics: Ask about very specific local knowledge: a restaurant on a specific street, local slang, recent local events. AI can be good at general knowledge but may struggle with hyperlocal details.
• Look for over-politeness and hedging: LLMs tend to be diplomatic and avoid strong opinions. A person who never has a strong reaction, never disagrees, and always finds the positive spin may be AI-driven.
• Introduce deliberate errors or nonsense. If you type something that does not make sense and receive a smooth, agreeable response that does not acknowledge the confusion, that suggests AI processing rather than human reading.
• Check response latency patterns: AI-generated responses may arrive with remarkably consistent timing, always within 30-60 seconds, regardless of the complexity of the message being answered.
• Ask for a selfie with a specific action. "Send me a photo of you right now holding up three fingers." A text-based AI cannot produce this; a real person can.

Signs to Detect It

Deepfakes are increasingly convincing, but current technology still has telltale flaws.

What to Watch For During the Call

• Face boundary artifacts: Look for a visible edge where the swapped face meets the real skin, particularly along the jawline, hairline, and around the ears. This boundary may shimmer, blur, or display inconsistent lighting.
• Blurriness and lag: The face may be blurrier than the rest of the image, especially when the person moves quickly, or lag behind head turns.
• Mismatched lighting: The lighting on the face does not match the background or the body.
• Unnatural facial expressions: Deepfake overlays struggle with extreme expressions such as wide-mouth laughing, exaggerated surprise, or squinting. The overlay may lag behind the real expression or produce unnatural distortion.
• Lip synchronization: Watch for slight delays between audio and lip movement. Modern deepfakes are much better at lip sync, but discrepancies may still be visible, especially during rapid speech.
• Eye contact: Some deepfake systems struggle with consistent eye tracking. The eyes may appear to look slightly off-camera even when the person is looking directly at the lens.
• Controlled conditions: They only video call in low light or with poor camera quality, which hides deepfake artifacts, and they avoid turning their head to the side, since deepfakes work best when facing the camera directly.
• Refusals: They refuse to perform spontaneous, unusual actions on camera.

Tests to Run During the Call

Ask the person to do something unpredictable. Current deepfake software struggles with objects intersecting the face and with extreme head angles:

1. Head turning: Ask them to turn their head fully to the left and right, or sharply to profile view. Deepfake overlays often break down at extreme angles, producing distortion, warping, or a visible "seam" where the overlay edge becomes apparent.
2. Hands over face: Ask them to wave a hand in front of their face, touch their nose, or hold a pen across it. Objects passing between the camera and the face cause rendering conflicts: the overlay may flicker, distort, or briefly reveal the real face underneath.
3. Lighting changes: Ask them to move to a different room or turn their head toward a window. Sudden lighting changes can expose inconsistencies between the lighting on the swapped face and the lighting on the body and background.

Detection Tools and What Platforms Are Doing

Detection Tools

• Microsoft Video Authenticator: Announced by Microsoft in September 2020, it gives a photo or video a confidence score indicating whether it has been manipulated. Microsoft initially made it available only to news outlets and political campaigns, through the Reality Defender 2020 initiative, rather than to the general public (Microsoft, September 1, 2020).
• Sensity.ai: A platform specifically focused on deepfake detection. It offers API-based analysis that can identify face swaps, AI-generated faces, and manipulated media.
• Social Catfish AI detection: The Social Catfish verification service has integrated AI photo detection into its search tools, flagging images that show characteristics of AI generation.
• Hive Moderation: Offers AI-generated content detection for both images and text, with high accuracy rates for identifying synthetic media.
• FakeCatcher (Intel): Uses biological signals (specifically subtle changes in facial blood flow) to distinguish real video from deepfakes. Blood flow patterns that occur naturally in living faces are not replicated by deepfake generators.
• AI text detectors: Tools like GPTZero, Originality.ai, and Copyleaks can analyze text to estimate the probability that it was generated by an AI language model. While not definitive, they can flag suspicious communication patterns.

What Dating and Social Platforms Are Doing

• Meta (Facebook, Instagram): Since May 2024, Meta has labeled content it detects as AI-generated; the label, first called "Made with AI", became "AI info" in July 2024 (Meta, April 5, 2024). Meta also displays warnings to users who appear to be in conversation with suspected scam accounts. The company's AI systems analyze conversation patterns for scam indicators and display warnings when red flags are detected.
• Bumble: Bumble's photo verification system requires users to take a real-time selfie that matches a specific pose. The system uses AI to compare the selfie against profile photos. While not deepfake-proof, it adds a meaningful verification layer.
• Tinder: Tinder introduced photo verification by video selfie, which Match Group (Tinder's parent company) then extended to Hinge and Plenty of Fish. In June 2023, Match Group said it had removed nearly 5 million bot and spam accounts across its apps between January and March of that year (Match Group, June 9, 2023).
• Hinge: Has implemented selfie verification and uses behavioral analysis to identify accounts that exhibit scam-like patterns (rapid messaging to many users, copy-paste messages, geographic inconsistencies).
• WhatsApp: While end-to-end encryption limits content analysis, WhatsApp has implemented account verification features and provides educational pop-ups when users receive messages from unknown numbers.

Typical Example

James, a 46-year-old financial advisor in Toronto, matched with "Sophie" on Hinge. Her profile showed a naturally beautiful woman with casual, everyday photos. After a week of messaging, James asked for a video call, having read that it was the best way to detect catfishing. Sophie agreed immediately.

On the call, James saw the same face from Sophie's photos. She smiled, laughed, and responded naturally to his questions. The call lasted 15 minutes, and James was completely satisfied that Sophie was real. He noticed the video quality was slightly grainy, but Sophie explained she was on hotel Wi-Fi for a work trip.

Over the following month, they had three more video calls. Each time, Sophie looked exactly like her photos but always cited poor internet as the reason for below-HD quality. James fell deeply in love.

Then Sophie revealed she had been offered a once-in-a-lifetime investment opportunity in a pre-launch tech startup but was short $15,000 on the minimum investment. She showed James a professional-looking prospectus and said she could triple his money in 60 days. James, who trusted Sophie completely after multiple video calls, transferred $15,000. Sophie asked for another $10,000 for "accelerated shares." After sending $25,000 total, Sophie went dark. The startup did not exist. The person behind "Sophie" had used real-time deepfake software to impersonate the woman in stolen photos. James had been fooled by a technology he did not know existed.

Deepfakes are not limited to live calls. In Anne's story, a personalized video of a fake Brad Pitt greeting her by name and showing the day's newspaper convinced her she was talking to the actor himself: she lost 830,000 euros over eighteen months, a textbook case of celebrity impersonation.

Protection Strategies for the AI Era

Effective protection against AI-powered romance scams requires a multi-layered approach:

1. Never trust a single verification method. A video call alone is not enough. A photo that passes reverse image search is not enough. Combine independent channels: video calls with deepfake tests, social media history going back years, mutual connections, verified professional profiles on LinkedIn, and eventually an in-person meeting.
2. Verify through offline channels. If possible, verify identity through channels that are difficult to fake: call them at a work phone number listed on a company website, send mail to a physical address, or meet in person in a safe public location.
3. Ask for specific, time-bound proof. "Send me a photo right now holding today's newspaper" or "Take a video saying my name and today's date." These requests require real-time human action that is very difficult to fake even with advanced AI.
4. Trust your instincts about "too perfect." If someone's photos look flawless, their messages are always perfectly crafted, and they never have a bad day or an awkward moment, that level of perfection may itself be a red flag.
5. Use the friend test. Share the profile and conversation with a trusted friend who is not emotionally invested. Outside observers are better at noticing patterns that the target, under the influence of emotional bonding, may miss.
6. Be skeptical of anyone who avoids meeting in person. The ultimate test remains an in-person meeting. A person who has an excuse for every proposed meeting, indefinitely, regardless of how much time has passed or how strong the relationship allegedly is, should be viewed with extreme suspicion.
7. Never send money to someone you have not met in person. This rule is even more important in the AI era. No matter how real someone looks on video, how convincing their voice sounds, or how genuine their messages feel, do not send money to someone you have not physically met.

If the videos and voice messages you received feel suspiciously polished, have the evidence authenticated by an expert: modern deepfakes are convincing enough that a second opinion is worth more than another argument with yourself.

What to Do If You're a Victim

If you suspect you have been deceived by a deepfake video call scam:

1. Do not feel foolish: Deepfake technology is specifically designed to defeat human perception. Even cybersecurity professionals have been deceived by high-quality deepfakes.
2. Preserve recordings if possible: If you recorded any video calls, this evidence is valuable for law enforcement and can be analyzed for deepfake artifacts.
3. Stop all communication and payments: Block the scammer on all platforms immediately.
4. Contact your financial institutions: Report all fraudulent transactions to your bank. If you invested in a platform, contact the relevant financial regulatory body.
5. Report to law enforcement:
   • FBI IC3: ic3.gov (include details about the deepfake aspect, as the FBI tracks this emerging trend)
   • FTC: reportfraud.ftc.gov
   • Report Fraud (UK): reportfraud.police.uk
6. Reverse image search the photos: Even if the video call seemed to match the photos, the photos themselves may still be stolen. A reverse image search may reveal the real owner of the face used in the deepfake. No result does not clear the profile: an AI-generated face exists nowhere else online.

Sources

• FBI IC3 Public Service Announcement (2023): "Malicious Actors Manipulating Photos and Videos to Create Explicit Content and Sextortion Schemes"
• Europol Innovation Lab: "Facing Reality: Law Enforcement and the Challenge of Deepfakes" (2024)
• Sensity: "The State of Deepfakes 2024"
• Microsoft: "New Steps to Combat Disinformation" (September 1, 2020)
• Meta: "Our Approach to Labeling AI-Generated Content and Manipulated Media" (April 5, 2024)
• Match Group: "Match Group Tells Spammers To Bot Off As It Continues Investing In Automated Tools To Remove Fraudsters" (June 9, 2023)
• Ajder, H. et al. (2019), "The State of Deepfakes: Landscape, Threats, and Impact", Deeptrace Labs
• Chesney, R. & Citron, D. (2019), "Deep Fakes: A Looming Challenge for Privacy, Democracy, and National Security", California Law Review