This initiative marks the first integration of Alibaba's large models into NVIDIA's automotive platform. Leveraging Qwen's advanced capabilities in handling complex inquiries and processing visual intelligence, in-car voice assistants will be able to engage in dynamic, multi-turn conversations and even offer recommendations, ranging from providing information about nearby landmarks to proactively suggesting car headlights be turned on during snowy conditions.
BACA JUGA:Inilah 5 Presiden Diluar Negeri Berarah Indonesia, Kok Bisa Ini Faktanya.
As part of the LMM solution, Alibaba Cloud's Mobile Agent—a multimodal AI agent for edge devices—will expand the capabilities of in-car voice assistants. Utilizing the Mobile Agent's strengths in complex task planning, self-reflection, and decision-making, users will be able to effortlessly execute voice commands, such as ordering milkshakes through a food delivery app, resulting in richer and more enjoyable in-car experiences.
Looking ahead, Alibaba Cloud plans to work with NVIDIA to adapt Qwen models on NVIDIA DRIVE Thor, NVIDIA's next-generation centralized car compute platform that combines advanced driver assistance, autonomous driving, and AI cockpit capabilities into a single safe and secure system.
Partnering with XPENG to Enhance Smart Cockpit Experience
XPENG, a leading Chinese smart electric vehicle company, is leveraging Alibaba Cloud's AI models and robust cloud computing capabilities to redefine its smart cockpit and autonomous driving experience.
It has tapped into Alibaba Cloud's Qwen to enhance its AI voice assistant, Xiao P, for a more superior smart cockpit experience. With no specific instructions needed, the LLM-enabled voice assistant excels at understanding complex conversational contexts and user intentions. It can engage in natural and intuitive dialogues with both drivers and passengers. For instance, when a user simply states, "It's cold inside the car," the voice assistant automatically adjusts the vehicle's temperature.
In addition to utilizing Qwen for the smart cockpit, XPENG is collaborating with Alibaba Cloud to integrate large models for various innovations. Users can design custom stickers for their car's exterior through Alibaba Cloud's text-to-image model, Tongyi Wanxiang, within XPENG's mobile app. XPENG is also exploring the use of Alibaba Cloud's Tongyi Lingma, an AI coding assistant powered by Qwen, to enhance R&D efficiency in the latest automotive technologies.