DEVELOPING MULTIMODAL SPOKEN DIALOGUE SYSTEMS FOR LIFE LIKE HUMANOID ROBOTS
£15.00
Lecturer and Researcher, Edinburgh Napier University
Description
I will showcase my research (and PhD student’s research using my autonomous bespoke robot in a live talk and interactive live on-stage demo). The main benefit of this is that life-like robots are incredibly rare and even more so with multilingual and multimodal NLP (We use LLMs for both dialogue gen and Q&A trained on a novel dataset – not to mention VLM capabilities). My humanoid robot is older-looking as it’s designed primarily for research in older adult care, so we are working on developing an adaptable personality for the robot using knowledge bases (Gardner’s) and personality types (Big 5 traits) using a combination of LLM approaches. I will also discuss my recent work on commonsense-enhanced NLG using the robot in task-based HRI.







