“Pablo Alobera, managing security consultant at NCC Group, says the real-time deepfake tool, once trained, can be activated with just the press of a button. “We created a front end, a Web page, with a start button. You just click start, and it starts working,” says Alobera.
NCC Group hasn’t made its real-time voice deepfake tool publicly available, but the company’s research paper includes a sample of the resulting audio. It demonstrates that the real-time deepfake is both convincing and can be activated without discernible latency.
Audio deepfakes are nothing new, of course.
However, past examples of AI voice deepfakes were not recorded in real time, which could make the deepfake less convincing. Attackers could prerecord deepfaked dialogue, but the victim could easily catch on if the conversation veered from the expected script. Alternatively, an attacker might try to generate the deepfake on the fly, but it would require at least several seconds to generate (and often much longer), leading to obvious delays in the conversation. NCC Group’s real-time deepfake isn’t hampered by these problems.”
Arquinas on
I am interested to see when we start to get research about realtime analysis tools to counter deepfakes. There has to be obvious telltale signs of generative AI that can be analysed by tools.
On the topic itself: While this has been known for some time to become a threat to ordinary people by allowing convincing scams, identity theft, slander, rumormongering etc. I think it also has a lot of potential for real time translations. Imagine being able to speak and have your voice translated to another language in real time. It has immense potential for global communications and travel, and reduces the isolation of different groups of people from one another.
LateToTheParty013 on
So now we get the next level: “Hey its me, Cristiano Ronaldo, im stuck at this restaurant without my card. Please transfer 50£ steam gift cards to this email so I can pay”
FirstEvolutionist on
They have been a reality for a while. They are just now a more accessible reality.
4 Comments
“Pablo Alobera, managing security consultant at NCC Group, says the real-time deepfake tool, once trained, can be activated with just the press of a button. “We created a front end, a Web page, with a start button. You just click start, and it starts working,” says Alobera.
NCC Group hasn’t made its real-time voice deepfake tool publicly available, but the company’s research paper includes a sample of the resulting audio. It demonstrates that the real-time deepfake is both convincing and can be activated without discernible latency.
Audio deepfakes are nothing new, of course.
However, past examples of AI voice deepfakes were not recorded in real time, which could make the deepfake less convincing. Attackers could prerecord deepfaked dialogue, but the victim could easily catch on if the conversation veered from the expected script. Alternatively, an attacker might try to generate the deepfake on the fly, but it would require at least several seconds to generate (and often much longer), leading to obvious delays in the conversation. NCC Group’s real-time deepfake isn’t hampered by these problems.”
I am interested to see when we start to get research about realtime analysis tools to counter deepfakes. There has to be obvious telltale signs of generative AI that can be analysed by tools.
On the topic itself: While this has been known for some time to become a threat to ordinary people by allowing convincing scams, identity theft, slander, rumormongering etc. I think it also has a lot of potential for real time translations. Imagine being able to speak and have your voice translated to another language in real time. It has immense potential for global communications and travel, and reduces the isolation of different groups of people from one another.
So now we get the next level: “Hey its me, Cristiano Ronaldo, im stuck at this restaurant without my card. Please transfer 50£ steam gift cards to this email so I can pay”
They have been a reality for a while. They are just now a more accessible reality.