Mercedes Benz
HMI & Driver Monitoring for Autonomous Driving
Led product and design strategy for Mercedes-Benz’s AI-powered Driver Monitoring system, translating complex multimodal technologies—including computer vision, eye tracking, and head tracking—into an intelligent HMI experience and contributing to $667M+ ARR.
Client
Mercedes-Benz
Role
Project Manager & Product Designer
Team
1 PL / 1 PM & Product Designer / 1 UX Designer / 1 GUI Designer / 60 Developers + 200+
Period
12 months
Overview
Led product strategy for an AI-powered Driver Monitoring system, leveraging computer vision, eye tracking, head tracking, and multimodal sensing to enable intelligent HMI for Mercedes-Benz, contributing to $667M+ ARR.
What I did
Defined product and design strategy and roadmap for an AI-powered Driver Monitoring system.
Researched and evaluated global computer vision, camera, and sensor technologies to identify product opportunities and shape the experience direction.
Defined product requirements for eye tracking, head tracking, gesture recognition, and multimodal HMI experiences.
Prioritized AI capabilities based on user value, technical feasibility, and business impact.
Partnered with AI researchers, ML engineers, software teams, and Mercedes-Benz stakeholders to translate emerging technologies into product experiences.
Led cross-functional product planning and design from early concept through commercialization.
Challenge
As autonomous driving technologies advanced, conventional vehicle interfaces lacked awareness of driver attention and intent. The challenge was to define a computer vision-powered Driver Monitoring system capable of understanding driver behavior in real time and enabling safer, more intelligent HMI experiences for autonomous driving.
Objective
Defined the product strategy and roadmap for an AI-powered Driver Monitoring platform by integrating computer vision, eye tracking, head tracking, gesture recognition, and multimodal sensor intelligence into a production-ready HMI for Mercedes-Benz.
Result
Successfully delivered the world's first AI/ML-powered Driver Monitoring HMI for Mercedes-Benz, contributing to more than $667M in annual recurring revenue (ARR) while establishing a new benchmark for AI-powered in-vehicle interaction.
Preview final design
Demonstrated how computer vision can move beyond perception to understand driver behavior, enabling intelligent decision-making for next-generation mobility.
More detail
I’ll walk you through the details during our meeting