Automotive

AI assisted conversational showroom experience for Apple VisionOS

Navigating new territory on a tight timeline to be first to market with a working solution concept, that would allow consumers to explore, configure, and purchase their dream car in a spatial environment, using voice as the primary input method.

About the project

Back in 2023, Younite was developing solutions for globally recognized automotive brands. To strengthen Younite's relationships with top industry players, and to drive growth in automotive sector, we created a proof of concept for a showroom experience, aimed to allow consumers to explore, configure, and purchase their dream car in a spatial environment by using voice as the primary input method.

Goal was to expand the experience across various touch points and phases of the customer journey, where a unique digital twin, utilizing various data points, could create significant value for both internal and external user groups while ensuring alignment, cohesion, and quality of the experience.

Goals for the initiative

🚀Develop a PoC for Ford Motor Company to strengthen our relationship and explore future opportunities.

🚗Create a brand agnostic version of the experience to support Younite’s efforts to grow in the automotive sector.

🔎Evaluate Apple VisionOS and Vision Pro to better understand capabilities and potential applications.

Validate the approach across AI, technical, business, and customer perspectives.

My role

I led this project with very hands-on approach from strategic planning to implementation. We formed a small and focused team with strong backgrounds in areas of design, development, AI, and XR. I also led the design efforts, and designed the spatial experience and contributed to marketing and content creation.

Reflection

This was an exciting and challenging project as we navigated new territory while working on a tight timeline to be first to market with a solution for VisionOS. We started experimenting before Vision Pro was available and were able to start testing with the actual device right after it was released. We also introduced a brand agnostic approach, supported by marketing efforts. The Vision Pro headset’s performance in rendering high-quality 3D content was somewhat disappointing, but streaming 3D content utilising Nvidia’s technologies offers solutions, albeit with limitations like users network bandwidth. During implementation, we made substantial improvements to the responsiveness and accuracy of conversational AI. Guiding the conversation effectively toward the intended goal remains a challenge, but we achieved significant progress in this area.

Outputs & Evidence

Brand agnostic version of the experience
User is able to experience their configuration in various locations
User is guided towards desired goals and is presented with relevant options for each moment
User can enable transcriptions
Design evidence from the product strategy brief