The Python-Native Data Processing Engine Powering the Future of Multimodal AI
- Jermy Johnson
- Jun 24
- 2 min read

Solving the Data Infrastructure Problem for Autonomous Vehicles and Beyond
When Sammy Sidhu and Jay Chia were working as software engineers at Lyft's autonomous vehicle program, they encountered a significant challenge - the lack of a tool that could efficiently process the vast amounts of unstructured data generated by self-driving cars. From 3D scans and photos to text and audio, this data deluge left engineers struggling to piece together open-source tools, spending the majority of their time on infrastructure rather than core application development.
Recognizing the growing need for a robust, versatile data processing solution, Sidhu and Chia set out to create Eventual, a Python-native open source data processing engine known as Daft. Designed to work seamlessly across different data modalities, from text to audio and video, Daft aims to be as transformational to unstructured data infrastructure as SQL was to tabular datasets in the past.
The Rise of Multimodal AI and the Increasing Demand for Efficient Data Processing
The founders of Eventual foresaw the explosion of multimodal AI applications even before the release of ChatGPT in 2023. As more industries, from robotics and retail tech to healthcare, began incorporating various data types into their AI models, the need for a reliable, high-performance data processing solution became increasingly apparent.
Daft, Eventual's open-source offering, has since gained traction with companies like Amazon, CloudKitchens, and Together AI, who have recognized the value of a Python-native data processing engine that can seamlessly handle the diverse data demands of modern AI applications.
Fueling the Growth of Multimodal AI with Daft
Eventual's success has been bolstered by the rapid growth of the multimodal AI industry, which is predicted to grow at a compound annual rate of 35% between 2023 and 2028, according to management consulting firm MarketsandMarkets. As the volume and variety of data continue to skyrocket, with 90% of the world's data generated in the past two years, Daft's ability to process unstructured data efficiently has become increasingly crucial.
Astasia Myers, a general partner at Felicis Ventures, which led Eventual's $20 million Series A round, highlighted the startup's position as a first mover in the space and the founders' firsthand experience in addressing the data processing problem.
Empowering Developers to Build Cutting-Edge AI Applications
With the latest funding, Eventual is poised to further enhance its open-source offering and develop a commercial product that will enable customers to build AI applications directly on the processed data. By providing a powerful, Python-native data processing engine, Eventual aims to free developers from the burden of infrastructure management, allowing them to focus on their core applications and drive innovation in the rapidly evolving world of multimodal AI.
Eventual's Daft is emerging as a game-changer in the data processing landscape, empowering developers to build the next generation of multimodal AI applications. As the demand for efficient data handling continues to grow, Eventual's Python-native solution is well-positioned to become the foundation for the future of AI-driven innovation across a wide range of industries.
Comments