Efficient facial expression recognition framework based on edge computing

Aikyn N. Zhanegizov A. Aidarov T. Bui D.-M. Tu N.A.
January 2024 Springer

Journal of Supercomputing
2024 #80 Issue 2 1935 - 1972 pp.

Facial expression recognition (FER) is a technology that recognizes human emotions based on biometric markers. Over the past decade, FER has been a popular research area, particularly in the computer vision community. With deep learning (DL) development, FER can achieve impressive recognition accuracy. In addition, favorable Internet-of-Things (IoT) advancements generate massive amounts of visual data needed to enable reliable DL-based emotion analysis. However, training DL models can suffer from significant memory consumption and computational costs, complicating many vision tasks. Additionally, the direct use of RGB images during the training and inference stages might raise privacy concerns in various FER applications. On the other hand, adopting large deep networks hampers quick and accurate recognition on resource-constrained end devices such as smartphones. As a viable solution, edge computing can be employed to bring data storage and computation closer to end devices rather than relying on a central cloud server. As a result, it can potentially facilitate the deployment of real-time FER applications since the latency and efficiency problems are well addressed by utilizing the computing resources at the edge. In this paper, we develop an efficient FER framework that integrates DL with edge computing. Our framework relies on facial landmarks to enable privacy-preserving and low-latency FER. Accordingly, various landmark detection models and feature types are studied empirically to investigate their capabilities in capturing the dynamic information of facial expressions in videos. Then, using the extracted landmark-based features, we design lightweight DL models to classify human emotions on IoT devices. Extensive experiments performed on benchmark datasets further validate the efficiency and robustness of our framework.

Deep learning , Edge computing , Facial expression recognition , Facial landmarks , Feature extraction

Text of the article Перейти на текст статьи

Department of Computer Science, Nazarbayev University, 53 Kabanbay Batyr Ave., Astana City, 010000, Kazakhstan
Networks Energy LLP, 29 Aray St., Astana City, 010000, Kazakhstan

Department of Computer Science
Networks Energy LLP

10 лет помогаем публиковать статьи Международный издатель

Книга Публикация научной статьи Волощук 2026 Book Publication of a scientific article 2026