Saturday, 30 September 2023

We are shifting our daily news to Gutzy.Asia Support us there!

Can you trust your ears? AI voice scams rattle US

WASHINGTON, UNITED STATES — The voice on the phone seemed frighteningly real — an American mother heard her daughter sobbing before a man took over and demanded a ransom. But the girl was an AI clone and the abduction was fake.

The biggest peril of Artificial Intelligence, experts say, is its ability to demolish the boundaries between reality and fiction, handing cybercriminals a cheap and effective technology to propagate disinformation.

In a new breed of scams that has rattled US authorities, fraudsters are using strikingly convincing AI voice cloning tools — widely available online — to steal from people by impersonating family members.

“Help me, mom, please help me,” Jennifer DeStefano, an Arizona-based mother, heard a voice saying on the other end of the line.

DeStefano was “100 per cent” convinced it was her 15-year-old daughter in deep distress while away on a skiing trip.

“It was never a question of who is this? It was completely her voice… it was the way she would have cried,” DeStefano told a local television station in April.

“I never doubted for one second it was her.”

The scammer who took over the call, which came from a number unfamiliar to DeStefano, demanded up to $1 million.

The AI-powered ruse was over within minutes when DeStefano established contact with her daughter. But the terrifying case, now under police investigation, underscored the potential for cybercriminals to misuse AI clones.

Grandparent scam

“AI voice cloning, now almost indistinguishable from human speech, allows threat actors like scammers to extract information and funds from victims more effectively,” Wasim Khaled, chief executive of Blackbird.AI, told AFP.

A simple internet search yields a wide array of apps, many available for free, to create AI voices with a small sample — sometimes only a few seconds — of a person’s real voice that can be easily stolen from content posted online.

“With a small audio sample, an AI voice clone can be used to leave voicemails and voice texts. It can even be used as a live voice changer on phone calls,” Khaled said.

“Scammers can employ different accents, and genders, or even mimic the speech patterns of loved ones. [The technology] allows for the creation of convincing deep fakes.”

In a global survey of 7,000 people from nine countries, including the United States, one in four people said they had experienced an AI voice cloning scam or knew someone who had.

Seventy per cent of the respondents said they were not confident they could “tell the difference between a cloned voice and the real thing,” said the survey, published last month by the US-based McAfee Labs.

American officials have warned of a rise in what is popularly known as the “grandparent scam” -– where an imposter poses as a grandchild in urgent need of money in a distressful situation.

“You get a call. There’s a panicked voice on the line. It’s your grandson. He says he’s in deep trouble —- he wrecked the car and landed in jail. But you can help by sending money,” the US Federal Trade Commission said in a warning in March.

“It sounds just like him. How could it be a scam? Voice cloning, that’s how.”

In the comments beneath the FTC’s warning were multiple testimonies of elderly people who had been duped that way.


That also mirrors the experience of Eddie, a 19-year-old in Chicago whose grandfather received a call from someone who sounded just like him, claiming he needed money after a car accident.

The ruse, reported by McAfee Labs, was so convincing that his grandfather urgently started scrounging together money and even considered re-mortgaging his house before the lie was discovered.

“Because it is now easy to generate highly realistic voice clones… nearly anyone with any online presence is vulnerable to an attack,” Hany Farid, a professor at the UC Berkeley School of Information, told AFP.

“These scams are gaining traction and spreading.”

Earlier this year, AI startup ElevenLabs admitted that its voice cloning tool could be misused for “malicious purposes” after users posted deep fake audio purporting to be actor Emma Watson reading Adolf Hitler’s biography “Mein Kampf.”

“We’re fast approaching the point where you can’t trust the things that you see on the internet,” Gal Tal-Hochberg, group chief technology officer at the venture capital firm Team8, told AFP.

“We are going to need new technology to know if the person you think you’re talking to is actually the person you’re talking to,” he said.


Notify of
Oldest Most Voted
Inline Feedbacks
View all comments

Latest posts

Election surprises and certainties: Dissecting Tharman’s presidential win

In the 2023 Presidential Election, Mr. Tharman Shanmugaratnam secured a stunning 70.4% landslide victory, surprising many, including himself. Despite expectations that TKL would win the opposition votes, voters from both camps showed a preference for Tharman's charisma and perceived competency. As Singapore reflects on the outcome, questions arise about the election's fairness and the real implications of Tharman's dominant win.

Volunteer as a Polling and Counting Agent for Singapore’s 2023 Presidential Election

For the upcoming Singapore Presidential Election on 1st September, members of the civil society have spearheaded an initiative to strengthen our democratic fabric. We invite committed individuals to join us as Polling and Counting Agents, standing together for a transparent, fair, and just election. This vote counting exercise, organized by members of civil society, is not specifically in support of Mr Tan Kin Lian, a candidate in the upcoming Presidential Election. It's an exercise in active citizenry. Nonetheless, Mr Tan endorses this initiative, which hinges on his candidacy, championing transparency, and has given permission for the results to be shared publicly.

Reflections from the Centenary: The Legacy of LKY and Singapore’s Future

Gilbert Goh reflects on the LKY centenary event: an inspiring showcase of a leader's global legacy juxtaposed against current challenges, urging Singapore to continue its path of progress.

Lim Tean advocates for Tan Kin Lian: A visionary leader for Singapore’s Presidency

In his speech at Mr Tan Kin Lian's launch of his presidential bid, Mr Lim Tean passionately championed the need for a truly Independent President. Highlighting Mr Tan Kin Lian's unique credentials and genuine concern for the wellbeing of Singaporeans, the Peoples Voice leader emphasized the pressing challenges of rising living costs and job insecurities faced by the public. Mr Lim depicted Mr Tan Kin Lian as a beacon of hope for the nation, advocating for a leader who genuinely understands and represents the people’s aspirations.

Tan Jee Say endorses Tan Kin Lian for President: A courageous, genuine, and humble...

In advocating for a truly representative leader, Tan Jee Say underscored Tan Kin Lian's humility, courage, and genuine dedication. Highlighting the pressing need for restored public trust and effective independence, Tan Jee Say emphasized that Tan Kin Lian, as the 'People's President', would bring back hope to Singaporeans and champion true democracy

Tan Kin Lian’s pledge: Rekindling unity and charting a vigorous future for Singapore

In the press conference to announce his bid for the Singapore presidency, Tan Kin Lian emphasizes safeguarding Singapore's reserves and strengthening public service integrity. Drawing on his 30-year leadership at NTUC Income, he envisions a future with affordable living, accessible housing, and job stability, pledging collaboration with the government for a united nation.

Strengthening Singapore’s political foundations: A call to action by Leong Mun Wai on Singapore’s...

Leong Mun Wai urges Singaporeans to strengthen political checks and balances, emphasizing, 'The best is yet to be for Singapore if we dare to make the right decision in upcoming elections.

Trending posts