In its two recent ad campaigns, Amazon India used NeuralGarage’s ‘VisualDubTM’ a generative AI technology, to visually dub their advertising creatives into seven regional languages for TV and Digital. It is one of the first use cases in the world of leveraging Gen AI technology for content and media production across multiple languages.
NeuralGarage, a deep tech startup from Bengaluru, has managed to break new ground in the advertising and marketing domain with its generative AI technology, VisualDubTM, that helps with multilingual lipsync in content & media. Advertising creatives and other marketing content in India are usually produced and shot in one language (usually Hindi) and then dubbed into several different languages, making them look inauthentic to regional viewers. NeuralGarage helps repurpose those creatives by making them look native and local for regional consumers through its proprietary technology, VisualDubTM.
The NeuralGarage team has collaborated with Amazon India for their Amazon Daily and Amazon Fresh ad campaigns that went live across TV and digital platforms. Its collaboration with the e-commerce giant represents a global first-use case of integrating generative AI technology in multilingual lipsync. VisualDubTM, being language agnostic, makes dubbed content look natural and syncs the lips and jaw movements of the actors within the video to make it more visually authentic. It helped Amazon India with visually dubbing its ad creatives into seven different regional languages.
Mandar Natekar, Co-founder, and CEO NeuralGarage said “There is a lot of news around what is possible with generative AI technology, but it takes a client like Amazon to back new tech into its business, actually walk the talk, and show the world what is possible. We are thrilled to collaborate with Amazon on these campaigns and showcase the power of our tech. It has always been our vision at NeuralGarage to harness the true potential of generative AI to make communication seamless & make dubbed content look visually authentic. I am thankful to Amazon India who gave a budding Indian startup like ours a chance to demonstrate the scope of ‘VisualDubTM’. We are committed to pushing the boundaries in advertising and marketing further with our proprietary tech and this is just the start!”
The news of their current collaboration is particularly remarkable since a generative AI solution like this has not been executed at this scale across multiple languages on longer dialogues & scenes globally. For an India-based startup to deliver this complex solution is great news and bodes well for the Indian startup ecosystem. In a country with over 22 primary languages, there is an urgent need to personalize content on digital platforms, OTTs, theatrical releases & broadcast networks and NeuralGarage is looking to play an essential role in that. Through a global lens, the market and scope will be substantially greater.
With cultural sensitivity gaining increasing focus, a country like India with such a rich cultural heritage and diverse languages, generative AI certainly holds the promise for advertisers, content creators, and filmmakers to synchronize lip movements with the dialogue enabling a stronger connect with the consumers. This story is also likely to play out similarly across the world.
With AI language models, tools, and software dominating the news cycles worldwide, competition is heating up within the space regarding who can come up with the next revolutionary innovation. Such a success story for a generative AI startup would only serve as an inspiration to similar startups.
Subhabrata Debnath, Co-founder and CTO at NeuralGarage, stated, “The aim behind ‘VisualDubTM’ has been to minimize visual dissonance in content and media. We are committed to fostering innovation in this space to amplify its capabilities and extend its reach into several other industries. We believe that our work will allow the seamless creation of multilingual lip-synced content that will build a stronger and closer bond between content creators and consumers.”
With AI poised to influence most businesses & industries, NeuralGarage is well-placed to aggressively sustain its momentum into tech development and elevate VisualDubTM to revolutionize content creation and the last-mile consumer experience.
