Mercedes-Benz, globally recognized for its iconic three-pointed star and commitment to automotive excellence, stands at the forefront of luxury and innovation in the car industry. As a leader in premium vehicles, Mercedes-Benz faces evolving industry dynamics, notably the shift towards electric vehicles and the increasing demand for sophisticated digital services within automobiles. To navigate these challenges and maintain its competitive edge, Mercedes-Benz strategically established Mercedes-Benz Research & Development North America (MBRDNA) in the heart of Silicon Valley.
Since its inception in Sunnyvale, California, in 1995, Mercedes-Benz R&D North America has been strategically positioned to tap into the unparalleled technology and innovation ecosystem of the Bay Area. This forward-thinking move underscores the company’s dedication to shaping the future of automotive design and technology. MBRDNA’s presence in Silicon Valley serves as a crucial link to emerging trends and technological advancements, ensuring Mercedes-Benz remains a leader in the rapidly transforming automotive landscape.
To enhance customer experiences through personalized digital services, Mercedes-Benz has adopted Confluent’s data streaming platform. Seems Acharya, Software Engineering Manager at MBRDNA, highlighted this strategic move at Confluent’s annual user event in Austin, Texas. Acharya articulated the expectation of Mercedes-Benz customers for a highly personalized experience, stating, “As a luxury brand, our customers expect a hyper-personalized experience. Imagine getting into your car and it’s a hot day…and your car already knows what temperature setting that you like, and what ambient lighting you like, and it puts on your favorite music or news…on the way to work.” This vision extends to predictive capabilities, such as anticipating traffic and suggesting alternative routes, and even leveraging Level 3 autonomous driving features to navigate those routes seamlessly.
The Imperative for Advanced Data Streaming at Mercedes-Benz R&D North America
Achieving this level of hyper-personalization necessitates a fundamental rethinking of backend systems at Mercedes-Benz R&D North America. Modern Mercedes-Benz vehicles are sophisticated, data-rich environments, equipped with numerous Vehicle Control Units (VCUs) and multiple data channels. This complexity transforms each car into a sophisticated IoT device, generating vast amounts of data.
Adding to the complexity, the longevity of car ownership, often spanning a decade or even generations, requires robust data curation and long-term support. Acharya emphasized this challenge: “That is why data curation is one of the most complex things we do. We have to bring data sources in, clean it up, curate it and create very well defined data products. [But] we also need observability and insights into what is happening with our fleet and what our customers like.”
Historically, Mercedes-Benz relied on multiple data platforms to manage incoming data from various sources, including the vehicle fleet, in-car applications, and backend services. This data was distributed across disparate streaming platforms like open-source Apache Kafka, Kinesis, and Event Hubs. Data processing, including cleaning, enrichment, and anonymization, was further complicated by the use of open-source tools like Flink. This fragmented approach presented significant challenges. “It was a nightmare for developers,” Acharya explained. “Not every team had the luxury of having a data engineer. How do we bring them closer to the data? Reusability was also very low.”
Confluent Cloud: Powering the Future of Mercedes-Benz Data Infrastructure
To overcome these hurdles and streamline data management, Mercedes-Benz R&D North America transitioned to Confluent’s data streaming platform. By leveraging Confluent Cloud for all data streaming needs and incorporating Confluent’s commercial Flink offering, MBRDNA is empowering developers and product teams to take a more proactive role in data management. This ‘shift left’ strategy aims to bring data expertise closer to those who work directly with the data, enhancing data reliability and reusability.
“What we ended up doing is bringing the people who work with the data closer to the data. We also shifted governance left,” Acharya noted. “Bringing in data from these multiple sources, we collect it into our data streaming platform and then we distribute it out and create very well defined and curated set of data products.” This centralized and streamlined approach ensures that data products are readily available for advanced analytics and applications.
With curated data products in place, Mercedes-Benz’s AI and ML teams can effectively leverage them to generate real-time insights and personalized recommendations for customers. By integrating these data products with external data sources like weather information, Mercedes-Benz can create truly hyper-personalized experiences. Confluent’s mature connectors and integrations with various data analytics tools have also simplified observability and insight generation, further enhancing the platform’s value. Moreover, Confluent has bolstered data governance and security. “Stream lineage gives us a very comprehensive real time view into what is happening with all our data within our platform, in real time. This is something that our auditors absolutely love,” Acharya added.
Tangible Benefits and Future Trajectory
The adoption of Confluent Cloud has yielded significant benefits for Mercedes-Benz. For developers, data reusability stands out as a key advantage. The unified data platform manages an impressive volume of data—approximately 800 terabytes per month and over 80 million events daily, with continued growth anticipated. Reusable pipelines have drastically reduced development time, saving approximately 80% of previously wasted time. Developers are now freed from the complexities of maintaining a multifaceted streaming and stream processing ecosystem. The ability to reuse real-time data products provides a comprehensive and immediate understanding of customer needs and fleet performance, eliminating lengthy delays in data insights.
Furthermore, time-to-market for new features has been significantly accelerated. Previously, individual data teams required four to six months to build pipelines from scratch for each new feature. With Confluent Cloud, this timeline has been compressed to just four to six weeks, representing a substantial improvement in agility and responsiveness to market demands.
In addition to operational efficiencies, Confluent Cloud aids Mercedes-Benz in navigating the complex landscape of global data regulations. Compliance with regulations such as the EU Data Act, GDPR, and the California Data Act (CCPA) is streamlined through enhanced data governance and real-time visibility into the data ecosystem. The shift left in governance, facilitated by Confluent, plays a crucial role in ensuring regulatory adherence.
In conclusion, the seamless integration of data and intelligent systems, powered by Mercedes-Benz R&D North America’s strategic adoption of Confluent Cloud, is transforming every Mercedes-Benz vehicle into a dynamic and intelligent companion. This innovative approach not only enhances the ownership experience but also reinforces Mercedes-Benz’s position as a leader in luxury automotive, setting new benchmarks for personalized and data-driven automotive excellence. Mercedes-Benz R&D North America’s embrace of cutting-edge data streaming technology underscores its commitment to driving the future of automotive innovation from its Silicon Valley hub.