Russian IT-company Yandex launched machine translation technology, which automatically translates videos in foreign languages into Russian and superimposes voice-over narration. For its creation the developers used machine translator, speech recognition, voice biometrics and speech synthesis.

While the technology can translate and voice only clips in English. It works like this: the technology detects the sex of the speaker and tries to pick up an appropriate voice. For the dubbing to coincide with the voice in the video, pauses are made and the speech is slowed down or accelerated.

You can try out the technology in Yandex's proprietary browser on both Windows and macOS. Yandex promises that in the near future, users will be able to choose which videos to translate.

Made in Russia // Made in Russia

Author: Karina Kamalova