What Are Deepfakes? Voice Cloning & Scams Explained | AP Cybersecurity
What Are Deepfakes? Voice Cloning, Scam Examples & How to Spot Them
Deepfakes and voice cloning are AI-generated audio and video used to impersonate trusted people. They are a powerful form of AI-augmented attack because they defeat the human instinct to trust a familiar face or voice.
Contents
How deepfakes augment attacks
A deepfake clones a person's voice or appearance from samples, then uses it to make a fake request seem real (EK 1.4.A). An attacker can call sounding exactly like a manager, or send a video that looks like a known executive, to authorize a payment or extract information.
This raises the stakes of social engineering: the usual defense of 'I recognized their voice' no longer works, because the voice itself can be faked.
An employee gets a call that sounds exactly like the CEO, urgently asking to wire funds. What makes this dangerous?
Reveal answer
Voice cloning defeats voice-based trust. The familiar voice feels like proof of identity, but it can be AI-generated. The urgency adds pressure to skip verification.
A deepfake is an AI-augmented impersonation. The tell is not the voice or face quality; it is the unverified, often urgent, request behind it.
How to defend
Because the media can be faked, defense shifts to the process: verify the request through a separate, known channel (call back on a saved number, confirm in person), and use agreed-upon verification steps for sensitive actions like payments.
Treat any urgent, high-stakes request as suspicious until verified independently, no matter how convincing the voice or video appears (EK 1.4.B).
A 'manager' video-calls asking you to buy gift cards immediately. How should you verify?
Reveal answer
Confirm through a separate known channel, such as calling the manager's saved number or checking in person, before acting. Do not rely on the video alone.
The 2024 Hong Kong deepfake heist
A finance employee at an engineering firm wired about 25 million US dollars after joining a video call where deepfakes impersonated the CFO and colleagues. Every person on the call was AI-generated.
Verify high-stakes requests on a separate, known channel.
Key Terms
| Deepfake | AI-generated audio or video that impersonates a real person. |
| Voice cloning | Recreating a person's voice from samples to fake a call. |
| Impersonation | Pretending to be a trusted person to gain compliance. |
| Out-of-band verification | Confirming a request through a separate, known channel. |
Match It Up
Common Mistakes
Trusting a familiar voice as proof
Voice cloning can fake a known voice. A familiar voice is no longer identity verification.
Judging by media quality
Deepfakes can be highly convincing. The request, not the realism, is what to scrutinize.
Acting on urgency without verification
High-stakes urgent requests are exactly where deepfakes are used. Verify first.
Assuming video is harder to fake than audio
Both can be faked. Verify through a second channel regardless of medium.
Check for Understanding
Frequently Asked Questions
Get in Touch
Whether you're a student, parent, or teacher — I'd love to hear from you.
Just want free AP CS resources?
Enter your email below and check the subscribe box — no message needed. Students get daily practice questions and study tips. Teachers get curriculum resources and teaching strategies.
Message Sent!
Thanks for reaching out. I'll get back to you within 24 hours.
Prefer email? Reach me directly at [email protected]