Deployment and evaluation of facial expression recognition on Android and Temi V3 in controlled settings

Abstract

Facial expression recognition (FER) is vital for improving human-robot interaction (HRI). This study presents the deployment and evaluation of an optimized FER model on android devices, specifically tested on the Temi V3 robot in controlled environments. Trained using FER+ and CK+ datasets and optimized with TensorFlow Lite (TFLite) and MobileNetV2, the model achieved a validation accuracy of 92.32%. Its performance was assessed on the Temi V3 robot and a Samsung A52 smartphone, focusing on CPU usage, memory, and power consumption. Cross-device compatibility and real-time performance challenges were addressed through model quantization and thread optimization. Real-time testing on the Temi V3 showed an overall accuracy of 82.28%, with emotion-specific accuracies ranging from 46.19% to 92.28%. This study offers practical insights for optimizing FER systems across android platforms, with potential applications in education, healthcare, and customer service. The results support the feasibility of implementing FER models as backends in android applications, enabling more intuitive and responsive HRI. Future work will focus on improving model efficiency for lower-end devices and exploring on-device learning techniques to boost accuracy in diverse real-world environments.