SCORE FUSION OF FINGER VEIN AND FACE FOR HUMAN RECOGNITION BASED ON CONVOLUTIONAL NEURAL NETWORK MODEL
DOI:
https://doi.org/10.47839/ijc.19.1.1688Keywords:
Recognition multimodal biometric, Finger-Vein recognition system, Face recognition system, Fusion, Random forest classification, SVM classification, CNN.Abstract
In the last decade, the biometrics refers to automatic recognition of persons using their physiological or behavioral characteristics. The combination of multiple biometrics or, multimodal biometrics have higher accuracy to verify the person and ensure that its information or data is safer compared to system based on single biometrics modality. In this regard, this paper introduces a scheme for multimodal biometric recognition system based on the fusion of finger-vein and face images using Convolutional Neural Network (CNN) and different classifiers. The pre-processed finger-vein image using Adaptive Histogram Equalization (AHE) is input into a CNN model. Then, Random Forest (RF) classifier performs as a recognizer. In addition, a hybrid CNN-Linear Support Vector Machine (SVM) model is used for recognizing face images. After this process, the score level fusion of bimodal biometric based on the weighted concatenation is applied to identify the identity of the individual. Experimental results on publicly available VERA Fingervein database, Color Feret and Ar face database have shown significant capability of identification biometric system. The proposed system provides high recognition accuracy rate by 99,98% compared with other classical methods and traditional techniques based on normal recognition or CNN architectures.References
E.M. Cherrat, R. Aloui, H. Bouzahir and W. Jenkal, “High density salt-and-pepper noise suppression using adaptive dual threshold decision based algorithm in fingerprint images,” Proceedings of the IEEE International Conference on Intelligent Systems and Computer Vision (ISCV), 2017, pp. 1-4.
A. Jain, L. Hong and Y. Kulkarni, “A multimodal biometric system using fingerprint, face and speech,” Proceedings of the 2nd International Conference on Audio- and Video-based Biometric Person Authentication (AVBPA), 1999, pp. 182-187.
G. Jaswal, A. Kaul, and R. Nath, “Multimodal biometric authentication system using hand shape, palm print, and hand geometry,” in Computational Intelligence: Theories, Applications and Future Directions, vol. II Springer, Singapore, pp. 557-570, 2019.
W. Deng, R. Yao, H. Zhao, X. Yang & G. Li, “A novel intelligent diagnosis method using optimal LS-SVM with improved PSO algorithm,” Soft Computing, vol. 23, no 7, pp. 2445-2462, 2019.
J.L. Speiser, B.J. Wolf, D. Chung, C.J. Karvellas, D.G. Koch & V.L. Durkalski, “BiMM forest: A random forest method for modeling clustered and longitudinal binary outcomes,” Chemometrics and Intelligent Laboratory Systems, vol. 185, pp. 122-134, 2019.
S.S. Roy, M. Ahmed & M.A.H. Akhand, “Noisy image classification using hybrid deep learning methods,” Journal of ICT, vol. 17, no. 2, pp. 233-269, 2018.
A. Ross, and J. Anil, “Biometric sensor interoperability: A case study in fingerprints,” Proceedings of the International ECCV Workshop on BioAW, 2004, pp. 134-145.
R. Singh, M. Vatsa and A. Noore, “Integrated multilevel image fusion and match score fusion of visible and infrared face images for robust face recognition,” Pattern Recognition, vol. 41, no. 3, pp. 880-893, 2008.
R. Connaughton, K.W. Bowyer and P.J. Flynn, “Fusion of face and iris biometrics,” Handbook of Iris Recognition, Springer, pp. 219-237, 2013.
A. Ross and R. Govindarajan, “Feature level fusion of hand and face biometrics,” Biometric Technology for Human Identification II. International Society for Optics and Photonics, pp. 196-205, 2005.
A. Jain, K. Nandakumar and A. Ross, “Score normalization in multimodal biometric systems,” Pattern Recognition, vol. 38, no. 12, pp. 2270-2285, 2005.
P. Wang, Pattern Recognition, Machine Intelligence and Biometrics, Springer, Berlin Heidelberg, 2011.
W. Yang, S. Wang, J. Hu, G. Zheng, and C. Valli, “A fingerprint and finger-vein based cancelable multi-biometric system,” Pattern Recognition, vol. 78, pp. 242-251, 2018.
M.I. Razzak, R. Yusof, and M. Khalid, “Multimodal face and finger veins biometric authentication,” Scientific Research and Essays, vol.5, issue 17, pp. 2529-2534, 2010.
M.I. Razzak, M.K. Khan, K.R. Alghathbar and R. Yusof, “Multimodal biometric recognition based on fusion of low resolution face and finger veins,” International Journal of Innovative Computing, Information and Control, vol. 7, no. 8, pp. 4479-4689, 2011.
B.E. Manjunathswamy, J. Thriveni, K.R. Venugopal, and L.M. Patnaik, “Multi model personal authentication using finger vein and face images (MPAFFI),” Proceedings of the 2014 IEEE International Conference on Parallel, Distributed and Grid Computing, 2014, pp. 339-344.
Q. Zhang, H. Li, Z. Sun, and T. Tan, “Deep feature fusion for iris and periocular biometrics on mobile devices,” IEEE Transactions on Information Forensics and Security, vol. 13, no 11, pp. 2897-2912, 2018.
J. Canny, “A computational approach to edge detection,” in: Readings in Computer Vision, Morgan Kaufmann, pp. 184-203, 1987.
S.M. Pizer, E.P. Amburn, J.D. Austin, R. Cromartie, A. Geselowitz, T. Greer et al, “Adaptive histogram equalization and its variations,” Computer Vision, Graphics, and Image Processing, vol. 39, no 3, pp. 355-368, 1987.
L. Breiman, “Random forests,” Machine Learning, vol. 45, no. 1, pp. 5-32, 2001.
B. Bhanu, A. Kumar, eds., Deep Learning for Biometrics, Springer, 2017.
N. Srivastava, G. Hinton, A. Krizhevsky, I. Sutskever, and R. Salakhutdinov, “Dropout: a simple way to prevent neural networks from overfitting,” The Journal of Machine Learning Research, vol. 15, no. 1, pp. 1929-1958, 2014.
C. Cortes, and V. Vapnik, “Support-vector networks,” Machine Learning, vol. 20, no. 3, pp. 273-297, 1995.
Y. Tang, “Deep learning using linear support vector machines,” arXiv preprint arXiv:1306.0239, 2013.
A. Krizhevsky, I. Sutskever, and G.E. Hinton, “Imagenet classification with deep convolutional neural networks,” Advances in Neural Information Processing Systems, pp. 1097-1105, 2012.
E. Park, W. Kim, Q. Li, J. Kim, and H. Kim, “Fingerprint liveness detection using CNN features of random sample patches,” Proceedings of the IEEE International Conference of the Biometrics Special Interest Group (BIOSIG), 2016, pp. 1-4.
Jr D.W. Hosmer, S. Lemeshow, and R.X. Sturdivant, Applied Logistic Regression, John Wiley & Sons, vol. 398, 2013.
S. Mika, G. Ratsch, J. Weston, B. Scholkopf, and K.R. Mullers, “Fisher discriminant analysis with kernels,” Proceedings of the 1999 IEEE Signal Processing Society Workshop on Neural Networks for Signal Processing, 1999, pp. 41-48.
P. Tome, M. Vanoni and S. Marcel, “On the vulnerability of finger vein recognition to spoofing,” Proceedings of the International Conference of the Biometrics Special Interest Group (BIOSIG), 2014, pp. 1-10.
P.J. Phillips, H. Wechsler, J. Huang and P.J. Rauss, “The FERET database and evaluation procedure for face-recognition algorithms,” Image and Vision Computing, vol. 16, no. 5, pp. 295-306, 1998.
A.M. Martinez, The AR Face Database, CVC Technical Report 24, 1998.
Downloads
Published
How to Cite
Issue
Section
License
International Journal of Computing is an open access journal. Authors who publish with this journal agree to the following terms:• Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
• Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
• Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work.
