Context: Researchers at Stanford University and UC Berkeley have devised a programme that uses artificial intelligence (AI) to detect deepfake videos.

• The programme is said to spot 80% fakes by recognising minute mismatches in the sounds people make and the shape of their mouths, according to the study titled ’Detecting Deep-Fake Videos from Phenome-Viseme Mismatches’.
• Deepfake videos can be made using face-swapping or lip sync technologies.
• Face swap videos can be convincing yet crude, leaving digital or visual artifacts that a computer can detect.
• Lip syncing is subtle, and harder to spot. The technology manipulates a smaller part of the image, and then synthesises lip movements that closely match the way a person’s mouth would move if they had said particular words.
• The team built a tool to look for ‘visemes’ or mouth formations, and ‘phenomes’ or phonetic sounds.
• It tested the tool with an AI-based neural network on videos of former U.S. President Barack Obama. The neural network spotted over 90% of lip syncs involving Obama himself.
• Although the program may help detect visual anomalies, deepfake detection is a cat-and-mouse game.
• Deepfake could also lead to a spike in misinformation which will be much harder to spot.

https://www.thehindu.com/sci-tech/technology/artificial-intelligence-helps-detect-deepfake-videos/article32885488.ece?homepage=true

Download PDF