\n<\/p>\n
Noisy recordings of interviews and speeches are the bane of audio engineers\u2019 existence. But one German startup hopes to fix that with a unique technical approach that uses generative AI to enhance the clarity of voices in video.<\/p>\n
Today, AI-coustics<\/a>\u00a0emerged from stealth with a \u20ac1.9 million in funding. According to co-founder and CEO Fabian Seipel, AI-coustics\u2019 technology goes beyond standard noise suppression to work across \u2014 and with \u2014 any device and speaker.<\/p>\n \u201cOur core mission is to make every digital interaction, whether on a conference call, consumer device or casual social media video, as clear as a broadcast from a professional studio,\u201d Seipel told TechCrunch in an interview.<\/p>\n Seipel, an audio engineer by training, co-founded AI-coustics with Corvin Jaedicke, a lecturer in machine learning at the Technical University of Berlin, in 2021. Seipel and Jaedicke met while studying audiotechnology at TU Berlin, where they often encountered poor audio quality in the online courses and tutorials they had to take.<\/p>\n \u201cWe\u2019ve been driven by a personal mission to overcome the pervasive challenge of poor audio quality in digital communications,\u201d Seipel said. \u201cWhile my hearing is slightly impaired from music production in my early twenties, I\u2019ve always struggled with online content and lectures, which led us to work on the speech quality and intelligibility topic in the first place.\u201d<\/p>\n The market for AI-powered noise-suppressing, voice-enhancing software is very robust already. AI-coustics\u2019 rivals include Insoundz, which uses generative AI to enhance streamed and pre-recorded speech clips, and Veed.io<\/a>, a video editing suite with tools to remove background noise from clips.<\/p>\n But Seipel says AI-coustics has a unique approach to developing the AI mechanisms that do the actual noise reduction work.<\/p>\n The startup uses a model trained on speech samples recorded in the startup\u2019s studio in Berlin, AI-coustics\u2019 home city. People are paid to record samples \u2014 Seipel wouldn\u2019t say how much \u2014 that then get added to a data set to train AI-coustics\u2019 noise-reducing model.<\/p>\n \u201cWe developed a unique approach to simulate audio artifacts and problems \u2014 e.g. noise, reverberation, compression, band-limited microphones, distortion, clipping and so on \u2014 during the training process,\u201d Seipel said.<\/p>\n I\u2019d wager that some will take issue with AI-coustics\u2019 one-time compensation scheme for creators, given the model that the startup is training could turn out to be quite lucrative over the long run. (There\u2019s a healthy debate over whether creators of training data for AI models deserve residuals for their contributions.) But perhaps the bigger, more immediate concern is bias.<\/p>\n It\u2019s well-established that speech recognition algorithms can develop biases \u2014 biases that end up harming users. A study<\/a> published in The Proceedings of the National Academy of Sciences showed speech recognition from leading companies were twice as likely to incorrectly transcribe audio from Black speakers as opposed to White speakers.<\/p>\n In an effort to combat this, Seipel says AI-coustics is focusing on recruiting \u201cdiverse\u201d speech sample contributors. He added: \u201cSize and diversity are key to eliminating bias and making the technology work for all languages, speaker identities, ages, accents and genders.\u201d<\/p>\n It wasn\u2019t the most scientific test, but I uploaded three video clips \u2014 an interview with an 18th century farmer<\/a>, a car driving demo<\/a> and an Israel-Palestine conflict protest<\/a> \u2014 to AI-coustics\u2019 platform to see how well it performed with each. AI-coustics indeed delivered on its promise of boosting clarity; to my ears, the processed clips had far less ambient background noise drowning out speakers.<\/p>\n Here\u2019s the 18th century farmer clip before:<\/p>\n
\n