Moments Lab has launched a new AI research initiative aimed at enhancing the understanding of videos through advanced multimodal and generative models that require minimal energy consumption.
Initial Partnerships
The program, which kicked off with partnerships from Telecom SudParis, a leading French engineering school, and TF1 Group, a major broadcaster in France and Europe, seeks to push the boundaries of AI video indexing technology. More research partners are expected to join in the coming months.
Research Focus
The main areas of focus for this R&D program include long-form video understanding, vision-language models, and information retrieval. A key emphasis is on developing AI indexing models that consume less energy while learning fair representations of a diverse global audience.
Dr. Yannis Tevissen, recently appointed head of science at Moments Lab, highlighted the challenges in efficiently understanding complex video content. He noted that despite current advancements in video-indexing technologies powered by speech and image processing, there is still significant room for improvement. Tevissen stated, “The next frontier likely lies in understanding what’s inside video files on a large scale with small, energy-efficient models.”
Partnership Benefits
The collaboration between Moments Lab and Telecom SudParis builds upon research previously conducted by Dr. Yannis Tevissen under the supervision of Jérôme Boudy, a professor at Telecom SudParis. Olivier Martinot, director of innovation at Telecom SudParis, expressed enthusiasm about this partnership, stating, “We are delighted to transform our research into innovation with Moments Lab.”
TF1 Group’s involvement aligns with the company’s goal to enhance productivity and video storytelling through AI. Olivier Penin, director of innovation at TF1 Group, added, “Our ambition is to evolve our Group and future ways of working with cutting-edge technology.”
Background on Moments Lab
The research program follows a multimillion-dollar investment by Moments Lab in deep-tech R&D. The company has already made significant strides with its MXT-1 AI indexing technology, which has garnered several industry awards since its launch in 2023, including the IABM Peter Wayne Golden BaM Award.
Moments Lab will publish findings from this research on a dedicated website. At the 2024 NAB Show in Las Vegas, the company will showcase new features of its MXT-1.5 technology and participate in a conference session to discuss how AI indexing is transforming production workflows.