Home > Published Issues > 2023 > Volume 14, No. 6, 2023 >
JAIT 2023 Vol.14(6): 1312-1320
doi: 10.12720/jait.14.6.1312-1320

M2FRED Analysis Using MobileNet and Siamese Neural Network

Riskie Annisa * and Benfano Soewito
Computer Science Department, BINUS Graduate Program Master of Computer Science, Bina Nusantara University, Jakarta 11480, Indonesia; Email: bsoewito@binus.edu (B.S.)
*Correspondence: riskie.annisa@binus.ac.id (R.A.)

Manuscript received May 30, 2023; revised July 20, 2023; accepted August 9, 2023; published December 1, 2023.

Abstract—Mobile face recognition has become increasingly important, especially during the COVID-19 pandemic when the use of masks has become ubiquitous. The area that can be analyzed for face recognition is narrowed down only to the periocular area. This resulted in many studies of face recognition in the periocular area which require appropriate datasets, one of which is M2FRED, introduced by University of Salerno. Previous research on M2FRED using supervised learning algorithms such as Support Vector Machine (SVM), Multilayer Perceptron (MLP), Random Forest (RF), and Decision Tree (DT) shows promising results on M2FRED with accuracy at 95.4% using MLP. However, study on M2FRED using deep learning models has yet to be done. In this paper, we compare the performance of MobileNet and Siamese neural networks on M2FRED, a face dataset specifically designed for mobile face recognition that contains videos of 43 subjects with and without masks taken in uncontrolled environments using mobile devices. We employ this range of M2FRED to evaluate the performance of MobileNet and Siamese neural networks in handling challenges like face masks, various lighting conditions, and limited computational resources. MobileNet outperformed the Siamese neural network in every aspect with an average accuracy score of 99.77% for overall performance (99.85%), mask usage scenarios (100%), and lighting context (99.72% for indoor evaluation and 99.52% for outdoor evaluation). With its simple architecture, MobileNet also surpassed Siamese neural networks in terms of complexity.
 
Keywords—face recognition, mobile, MobileNet, Siamese neural networks, M2FRED

Cite: Riskie Annisa and Benfano Soewito, "M2FRED Analysis Using MobileNet and Siamese Neural Network," Journal of Advances in Information Technology, Vol. 14, No. 6, pp. 1312-1320, 2023.

Copyright © 2023 by the authors. This is an open access article distributed under the Creative Commons Attribution License (CC BY-NC-ND 4.0), which permits use, distribution and reproduction in any medium, provided that the article is properly cited, the use is non-commercial and no modifications or adaptations are made.