Mercedes-Benz is redefining the in-car experience with a suite of innovations showcased at CES 2024, centered around the new integrated MBUX Virtual Assistant and the forthcoming Mercedes-Benz Operating System (MB.OS). These advancements promise a hyper-personalized, intuitive, and deeply connected relationship between drivers and their vehicles. The future of automotive interaction is here, emphasizing natural conversation, proactive support, and a seamless integration of digital life into the driving experience.
The MBUX Virtual Assistant: A More Human-Like Interface
At the forefront of Mercedes-Benz’s vision is the MBUX Virtual Assistant, a significant leap from its predecessors. Leveraging advanced software and generative AI, this assistant aims to foster a more natural, empathetic, and intuitive connection with the driver. It evolves the “Hey Mercedes” voice assistant into a more visually engaging experience, powered by high-resolution 3D graphics rendered with Unity’s game engine. This new assistant, set to debut in vehicles built on the upcoming MMA platform and previewed in the Concept CLA Class, is designed to offer proactive support and personalized suggestions based on learned behaviors and situational context. The core principle is to make the customer’s life more convenient and comfortable, making the car an even more indispensable part of their daily routines.
Four Pillars of Personality: Natural, Predictive, Personal, Empathetic
The MBUX Virtual Assistant is designed with four distinct “personality traits” to ensure a harmonious and user-centric interaction: Natural, Predictive, Personal, and Empathetic. This blend creates a well-rounded assistant that prioritizes seamless interaction through both voice and graphical interfaces. Drivers can engage with the assistant naturally, with or without the “Hey Mercedes” prompt. Its predictive capabilities, fueled by generative AI, allow it to offer proactive suggestions and automate routines, anticipating the driver’s needs. The addition of a more emotional neural voice that can adapt its speaking style further enhances the sense of empathy, making the interaction feel more genuine and less robotic. Personalization is key, with drivers able to tailor the assistant’s behavior and responses through a central hub, ensuring it aligns perfectly with their individual preferences.
Visual Communication Enhanced by Immersive 3D Graphics
Complementing the natural dialogue is a visually rich experience powered by Unity’s game engine. The MBUX Virtual Assistant features a dynamic “living” star avatar that animates to express various moods and states, ranging from calm to excited and sensitive. These animations provide intuitive visual cues about the assistant’s actions—whether it’s speaking, listening, thinking, offering a suggestion, or issuing a warning. The interplay of movement, brightness, and color ensures clear and immediate communication with the driver, enhancing situational awareness and engagement.
MBUX Surround Navigation: Integrating Route Guidance with Real-Time Assistance
MBUX Surround Navigation represents another major advancement, seamlessly merging route guidance with real-time driving assistance. Integrated within MB.OS, this feature provides drivers with a real-time view of their car’s surroundings and its reactions, significantly boosting situational awareness. The use of Unity’s 3D graphics transforms the driver display into an intuitive overview, showing vital information at a glance. This includes identifying the type of traffic ahead—cars, vans, trucks, or cyclists—and highlighting nearby pedestrians and potential hazards. Route guidance is superimposed onto a realistic representation of the environment, proving especially useful in complex urban settings by clearly indicating upcoming turns. This makes navigating busy streets simpler and safer. [best luxury car brand reddit]
Expanding Possibilities with 3rd-Party Apps and Enhanced Entertainment
Mercedes-Benz continues to broaden the in-car digital ecosystem through over-the-air (OTA) updates, offering customers tailored content and features. The new E-Class, for instance, serves as a precursor to MB.OS, already providing enhanced productivity with the integration of the Meetings app for TEAMS, Zoom, and WebEx. This is complemented by new apps for everyday convenience, including Booking.com, getAbstract, and Just Eat Takeaway.com. [hybrid cars list] For entertainment, the brand plans to introduce cloud-based retro gaming via Antstream Arcade and other immersive experiences.
Video Streaming Gets an Upgrade with RIDEVU
The in-car video streaming offering is set to be significantly enhanced through the integration of Sony Pictures Entertainment’s (SPE) RIDEVU service. RIDEVU promises a premium entertainment experience, providing Mercedes-Benz customers access to a diverse library of films and content directly within their vehicles. Designed with automotive use in mind, RIDEVU offers advanced controls and features, enriching the Mercedes-Benz entertainment package.
Digital Art and Collectibles with MBUX Collectibles
Mercedes-Benz is venturing into the world of digital art and collectibles with MBUX Collectibles, its first in-car app for showcasing NFT-based art. This feature allows customers to create a personal digital art gallery by connecting their NFT wallet. Visitors at CES can view curated NFT collections from Mercedes-Benz NXT, including the “Icons Era 1 ‘Luxury'” and a preview of “Era 2 ‘Technology’,” alongside the “Superdackel NFT,” a limited edition drop expected soon. [self charging hybrid]
Concept CLA Class: The Embodiment of MB.OS and Hyper-Personalization
The upcoming family of vehicles based on the MMA platform will be the first to run on MB.OS. The Concept CLA Class, making its North American debut at CES 2024, provides a production-intent glimpse into this future range. The show car’s interior vividly visualizes the central role of MB.OS, with its complex architecture represented by hardware components like the NVIDIA-powered chip. The advanced three-display MBUX Superscreen underscores the Mercedes-Benz of the future as a hyper-personalized extension of the customer’s digital life.
MB.OS is structured around four core domains: Infotainment, Automated Driving, Body & Comfort, and Driving & Charging, all interconnected with the Mercedes-Benz Intelligent Cloud. This chip-to-cloud architecture ensures deep vehicle integration and comprehensive control over all sensors and actuators. By decoupling software and hardware innovation, Mercedes-Benz can ensure its vehicles remain consistently up-to-date, offering customers the latest advancements throughout their ownership. [bawa luxury cars delhi]
About Mercedes Benz
Mercedes-Benz USA (MBUSA), headquartered in Atlanta, is responsible for the distribution, marketing, and customer service for all Mercedes-Benz products in the United States. MBUSA offers drivers the most diverse lineup in the luxury segment with 18 model lines. MBUSA also handles Mercedes-Benz Vans in the U.S. More information can be found at www.mbusa.com and www.mbvans.com.
References
- Digital Extras Terms of Use and Mercedes me ID Service Terms apply. Permanent pairing of the vehicle with the Mercedes me user account and activation of Digital Extras are required. Renewal options and specific usage requirements or limitations may apply. Personal data processed for Digital Extras is detailed in the Mercedes me connect privacy policy.
- Specific app availability may vary by market.
- Specific RIDEVU offering in the U.S. to be confirmed closer to launch.

