Development of an Adaptive User Support System Based on Multimodal Large Language Models
Published:
Abstract
As software systems become more complex, some users find it challenging to use these tools efficiently, leading to frustration and decreased productivity. We tackle the shortcomings of conventional user support mechanisms in software and aim to create and assess a user support system that integrates Multimodal Large Language Models (MLLMs) for producing support messages. Our system initially segments the user interface to serve as a reference for selection and requests users to specify their preferences for support messages. Following this, the system creates personalised user support messages for each individual. We propose that user support systems enhanced with MLLMs can provide more efficient and bespoke assistance compared to conventional methods.
Talks
Citation
Wei Wang, Lin Li, Shavindra Wickramathilaka, John Grundy, Hourieh Khalajzadeh, Humphrey O. Obie, and Anuradha Madugalla. "Development of an Adaptive User Support System Based on Multimodal Large Language Models." In 2024 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC), pp. 344-347. IEEE, 2024. 