Voice Cloning and Video Deepfakes: Spotting AI Scams
It’s a common fear: As artificial intelligence increasingly rules the digital world, how do we know what’s real and what’s fake?
New forms of disinformation are harmful enough, but chatbot scams, video deepfakes, and voice cloning are also taking financial fraud to a whole new level, enabling scammers to impersonate customer service representatives, co-workers, and even loved ones or romantic prospects in order to get our money.
Generative AI is not only making it easier and faster to exploit people, but also removing many of the human errors that had been reliable red flags in the past. Deloitte’s Center for Financial Services predicts that generative AI could push annual bank fraud losses to as high as $40 billion by 2027, more than triple what they were in 2023.
So what can you do to protect yourself? Keep up with the latest tactics and stay vigilant.
Some of the most common AI scams involve:
Voice cloning. Scammers use AI to mimic voices of people you know or recognize. A Florida woman told her local press she lost $15,000 after getting a phone call that sounded like her daughter asking for bail money following a car accident.
Video deepfakes. Just as they do with voices, criminals doctor video to impersonate people, including celebs on social media or even your boss on a Zoom call. A worker in Hong Kong was reportedly fooled by a video deepfake of their CFO on a video call and authorized a $25 million payment to the scammer. Even though the worker was skeptical at first, they were reassured by the fact that they recognized other colleagues (also video manipulations) on the call.
Chatbot scams. Bad actors use real-time conversations to exploit your trust. Often they impersonate companies you do business with, asking for financial details or bogus payments. But they can also look to forge romantic connections. Twenty-six percent of people surveyed by online security firm McAfee said they or someone they knew had been approached by an AI chatbot posing as a real person on a dating app or social media.
Classic scams 2.0. Bad grammar and generic references used to be a great way to spot phishing emails. But scammers using AI can make anyone anywhere in the world sound like a native English speaker — and like someone you’re used to dealing with. Personalized touches often include mimicking the style of a message you’re more likely to trust (like realistic logos and formats).
Spotting fakes may be harder with AI, but it’s not impossible. The FBI and American Bankers Association recommend that you:
• Look for subtle imperfections: strange lighting, unnatural facial movements, distorted features, watermarks, or shadows that don’t make sense.
• Listen for flat or robotic voices, voices that don’t match lip movements, or word choice that doesn’t sound like your loved ones or colleagues.
• Establish a codeword with friends and family to confirm their identity on a phone or video call. (Or if you suspect an impersonator, ask them a question only the real person would know the answer to.)
• Minimize what’s accessible to scammers by limiting posts of your face or voice, making your social media accounts private, and restricting followers to people you know.
And don’t forget this tried and true advice for protecting yourself, which still applies even in the AI age:
• Avoid clicking on suspicious links.
• Don’t rush to make any money-related decisions. Urgency (like someone saying they need $400 in gift cards in the next hour) is a red flag.
• When you’re not sure a person is who they say they are, call or email them back using their official contact information (like your bank’s customer service number) instead of the details they sent you. (SoFi members can check our fraud hub.)
Related Reading
The 6 Most Popular AI Scams In 2025 (CanIPhish)
AI Scams: What are They and How Can You Avoid Them? (Norton)
AI Is Forcing the Return of the In-Person Job Interview (The Wall Street Journal via MSN)
Please understand that this information provided is general in nature and shouldn’t be construed as a recommendation or solicitation of any products offered by SoFi’s affiliates and subsidiaries. In addition, this information is by no means meant to provide investment or financial advice, nor is it intended to serve as the basis for any investment decision or recommendation to buy or sell any asset. Keep in mind that investing involves risk, and past performance of an asset never guarantees future results or returns. It’s important for investors to consider their specific financial needs, goals, and risk profile before making an investment decision.
The information and analysis provided through hyperlinks to third party websites, while believed to be accurate, cannot be guaranteed by SoFi. These links are provided for informational purposes and should not be viewed as an endorsement. No brands or products mentioned are affiliated with SoFi, nor do they endorse or sponsor this content.
SoFi isn't recommending and is not affiliated with the brands or companies displayed. Brands displayed neither endorse or sponsor this article. Third party trademarks and service marks referenced are property of their respective owners.
OTM20250924SW
Read more
