Zhang, Xiaoke, Angela Kwon, Mi Zhou, Gene Moo Lee “Designing for Designers:A Multimodal Hypergraph RAG System to Enhance Automotive Design,” Work-in-progress.
- Industry partner: Hyundai Kia Motor’s Digital Design team
- Presentations: INFORMS (2025)
The growing adoption of large language models (LLMs) across industries highlights the need for domain-specific systems that leverage an organization’s proprietary knowledge. In the automotive sector, general-purpose LLMs often lack specialized expertise and may produce irrelevant or misleading outputs, hindering vehicle designers’ creative processes. To address these challenges, we partner with Kia Motor, a leading automotive manufacturer in South Korea, to develop a designer-oriented, multimodal hypergraph retrieval-augmented generation (RAG) framework for vehicle concept ideation. Our framework consists of two core components. First, we construct a custom hypergraph knowledge base that captures complex relationships between customer feedback (text modality) and design assets (visual modality). Second, we design an interactive chatbot interface that accepts both free-form text and image inputs, retrieves relevant subgraphs from the knowledge base, and generates contextually grounded responses. We plan to evaluate the prototype through randomized online experiments and user studies involving Kia’s design teams. This work will contribute to design science by proposing a scalable method for multimodal knowledge representation and demonstrating how interactive AI tools can support domain-specific creative exploration.