ST Engineering launches Einstein.AI deepfake detector

Einstein.AI detector

ST Engineering unveiled its Einstein.AI deepfake detection tool for enterprises at its annual InnoTech Conference on Sept 3 at Marina Bay Sands. The tool detects inconsistencies in an uploaded video, such as unusual eyebrow or lip movements and audio frequencies that are likely to be computer-generated. Tan Boon Leong, ST Engineering’s head of data science and AI, said these inconsistencies are becoming tougher for people to spot with their own eyes.

Once scanned, the AI generates a report that includes a deepfake likelihood score, a transcript and summary of the video’s audio feed, and a list of related news content found online. This allows social media users and investors to assess whether the content is reliable. Senior Minister of State for the Prime Minister’s Office Desmond Tan said in an opening address at the conference that tools like Einstein.AI are a significant step in combating deepfakes, which surged by some 500 percent in 2023 compared to 2022.

Einstein.AI aids in deepfake detection

Deepfakes also pose a threat to enterprises, he added, citing an incident in Hong Kong where executives transferred HK$200 million (S$34 million) to fraudsters who used AI to mimic the likeness of their chief financial officer to approve a transaction. “Scammers are now using advanced AI tools to create deepfake voice recordings and videos that can fool even the closest of relatives and friends,” he said.

“With just a few photos from social media and a short voice clip – sometimes as brief as seconds – scammers can create frighteningly realistic deepfakes.”

Authorities worldwide are scrambling to rein in deepfakes amid concerns that fraudsters will use them to disrupt elections in many countries in 2024, including Singapore. Concerns over deepfakes have prompted heavy investment in detection capabilities here. The Ministry of Digital Development and Information announced in May a $50 million investment over five years into the new Centre for Advanced Technologies in Online Safety, which will focus on building tools to spot misinformation and deepfakes.

Separately, developers at Singapore’s Agency for Science, Technology and Research announced in late 2023 they are developing a deepfake detection model called The Sleuth, which can spot synthetic content on media platforms, messaging apps, and web browsers. The Home Team Science and Technology Agency in April showcased a similar detection tool called AlchemiX, which can compare recordings of a suspected deepfake video with a recording of a speaker’s actual voice.