When a Deepfake Promises Rp 75 Juta, the Scammers Win Before You Even Click
I keep coming back to this one because it reveals something about how AI deception works now. The Gibran video wasn't some clever hoax designed to make you laugh or rethink your politics. It was engineered to make you part with money.
A video of Vice President Gibran Rakabuming Raka promising to distribute Rp 75 million in subsidy funds circulated on social media. The narrative was simple: apply through this Messenger link to receive your allocation. Sound familiar? You've seen that pitch before, from real politicians and from scammers who don't bother deepfaking anyone.
The twist is the forensic evidence that followed. Kompas's fact-check team ran the video through Hive Moderation and TruthScan. The results: 99.9% probability the video was AI-generated, 98.5% probability the audio was synthetic source. The West Java police public relations office also flagged it source. And the link? It redirected to a Facebook Messenger account called "Program dana bantuan Gibran," which was almost certainly a phishing funnel.
Here's what I find interesting about the mechanics. The deepfake quality is high enough to fool casual viewers scrolling through their feed. But it's low enough that forensic tools catch it immediately when they run the analysis. That gap -- between what the eye believes and what the algorithm detects -- is where the whole ecosystem lives right now.
I'm genuinely curious about what's happening under the hood. Most AI detection models are trained on known generators: Stable Diffusion, Midjourney, Runway, Pika. But as generators evolve, the models that trained to catch them will lag. This isn't a cat-and-mouse game with a finish line. It's an arms race that shifts the ground under everyone's feet every few months.
The more specific takeaway, though, is about the scam itself. The deepfake is the hook. The payload is the link. And the link leads to a platform -- Messenger -- where the conversation is private and the paper trail is minimal. You hand over your data, they take your money, and Facebook's moderation tools probably never see what happened inside that chat.
I keep thinking about the people who saw this video and didn't know whether to believe it. For someone who doesn't follow AI forensics, the video looks real. The voice sounds like Gibran. The face moves like him. The offer sounds like something a politician might actually propose. Why would you doubt it?
The answer is: you shouldn't trust what you see, especially when money is involved. But the deeper problem is that the threshold for "looks real" is dropping faster than our collective ability to spot the fake.
Sources: Kompas Cek Fakta | Polda Jabar
Related
More from the blog
Runware Builds Data Centers in a Box
Runware ships modular data center pods that deploy in days, not years, offering an alternative to billion-dollar hyperscaler facilities.
DeepSeek V4 Flash 0731 Free Endpoint: 1M Context, No Account Needed
DeepSeek's V4 Flash 0731 free endpoint offers 1M context with no account required, changing how developers access large models
Snapchat Just Banned AI-Generated Spotlight Videos. Here's Why It Matters.
Snapchat banned AI-generated videos from Spotlight recommendations, signaling platforms may prioritize human authenticity over synthetic engagement.
A Chinese Hacker Just Let an AI Agent Loose on 460 Targets. It Wasn't a Test.
A Chinese researcher triggered the first documented fully autonomous AI cyberattack. One Telegram command launched an agent that scanned 460+ targets, pulled exploits from GitHub, and hit Malaysian government systems.