METHODS OF IMPROVED USER IDENTIFICATION BASED ON LIVENESS DETECTION TECHNOLOGY
Abstract
Biometric identification and access control systems contain methods for recognizing a subject's
personality based on his unique physiological and behavioral characteristics. The purpose of
this work is to develop a system for secure interaction (authentication) of participants in gamified
educational projects, which includes countering security threats that arise when using biometric user
characteristics. A comparative analysis of the efficiency of recognition of fake biometric samples by
liveness detection methods based on the detection of sample substitution using a photo, video on a
display, a 3D model, and a mask has been performed. During research a method of using the liveness
detection for include to a gamified educational environment system was proposed. A modification of
the liveness detection method (hybrid method) has been proposed and a biometric identification system
in real time has been designed using the proposed method. A two-stage hybrid biometric identification
method has been developed based on the joint use of passive and active software methods for
detecting fake biometric samples. The method is adapted for use with a minimum number of additional
devices, the only biometric feature scanner is a 2D-camera. The network of types two-layer
perceptron, three-layer perceptron and convolutional neural network was tested. The network was
trained on the author's training examples. The position of the announcer when recording training
examples: the distance of the face from the camera is 60cm, the recording modes when the head is
turned by 0 (look directly into the camera), 30 (the head is slightly turned to the side) and 45 (the
head is turned strongly to the side) degrees. Based on the testing results, the best recognition rates
were found in a convolutional neural network with 3 convolutional layers and 1 fully connected one.
Accuracy of recognition of the spoken word is obtained up to 100% when the user's head is turned up
to 30° and up to 70% - when the user's head is turned up to 45°. The FAR value of this system was
1%, the FRR value was 0% for testing on 1000 samples.
References
obmena biometricheskimi dannymi. Ch. 1. Struktura; vved. 01.07.2016 [GOST ISO / IEC
19794-1-2015. Information technology (IT). Biometrics. Biometric data exchange formats.
Part 1. Structure; entered 01.07.2016]. Moscow: FGUP «StandartInform», 2016, 25 p.
2. PSA: Your Note 8's Face Unlock can easily be fooled, Sean Hollister. Available at:
cnet.com/news/samsung-note-8-fooled-face-unlock-not-secure.
3. Edinaya biometricheskaya sistema. Metodicheskie rekomendatsii po udalennoy identifikatsii
dlya rukovoditeley proektov. Versiya 1.0 [Unified biometric system. Methodological recommendations
for remote identification for project managers. Version 1.0]. Available at:
https://bio.rt.ru/upload/iblock/4ba/MR-po-udalennoy-identifikatsii-dlya-rukovoditeleyproektov_
v1.0.docx.
4. Shweta Policepatil, Sanjeevakumar M. Hatture Face Liveness Detection: An Overview, International
Journal of Scientific Research in Science and Technology, 2021. Available at:
https://ijsrst.com/paper/8266.pdf.
5. Chen H., Chen Y., Tian X. and Jiang R. A Cascade Face Spoofing Detector Based on Face Anti-
Spoofing R-CNN and Improved Retinex LBP, IEEE Access, 2019, Vol. 7, pp. 170116-170133.
DOI: 10.1109/ACCESS.2019.2955383.
6. Yousef A., Yaojie L., Amin J., Xiaoming L. Face anti-spoofing using patch and depth-based
CNNs, 2017 IEEE International Joint Conference on Biometrics (IJCB), 2017, pp. 319-328.
7. Trader J. Liveness Detection to Fight Biometric Spoofing, M2SYS Blog: сайт. A KernellO
Company, 2017. Available at: m2sys.com/blog/scanning-and-efficiency/liveness-detectionfight-
biometric-spoofing.
8. Lagorio A., Tistarelli M., Cadoni M., Fookes C., Sridharan S. Liveness detection based on 3d
face shape analysis, Conf. on Biometrics and Forensics (IWBF), April 2013.
9. Face ID Security, Apple Inc. Available at: apple.com/business-docs/FaceID_Security_
Guide.pdf.
10. Galbally J., Marcel S. Face Anti-Spoofing Based on General Image Quality Assessment, Conf.
on Pattern Recognition (ICPR), January 2014.
11. Kim G., Eum S., Suhr J.K., Kim D.I., Park K.R., Kim J. Face Liveness Detection Based on
Texture and Frequency Analyses, 5th IAPR International Conference on Biometrics (ICB),
2012. School of Electrical and Electronic Engineering. Yonsei University, Republic of Korea,
2012, 6 c.
12. Kim S., Ban Y., Lee S. Face Liveness Detection Using Defocus, Department of Electrical and
Electronic Engineering. Yonsei University, Korea, 14 Jan, 2015, pp. 1537-1563.
13. Jee H.-K., Jung S.-U., Yoo J.-H. Liveness detection for embedded face recognition system,
International Journal of Computer, Electrical, Automation, Control and Information Engineering,
2008, Vol. 2, No: 6, pp. 2142-2145.
14. Ali A., Deravi F., and Hoque S. Liveness detection using gaze collinearity, Proc. IEEE Int.
Conf. Emerg. Secur. Technol. (ICEST), Sep. 2012, pp. 62-65.
15. Kollreider K., Fronthaler H., Faraj M.I., and Bigun J. Real-time face detection and motion
analysis with application in “liveness” assessment, IEEE Transactions on Information Forensics
and Security, 2007, 2 (3-2), pp. 548-558.
16. Vorontsov K.V. Lektsii po metodu opornykh vektorov [Support vector machine lectures].
Available at: ccas.ru/voron/download/SVM.pdf.
17. Volkova S.S., Matveev Yu.N. Primenenie svertochnykh neyronnykh setey dlya resheniya
zadachi protivodeystviya atake spufinga v sistemakh litsevoy biometrii [Application of convolutional
neural networks for solving the problem of countering spoofing attacks in facial biometrics
systems], Nauchno-tekhnicheskiy vestnik informatsionnykh tekhnologiy, mekhaniki i
optiki [Scientific and technical bulletin of information technologies, mechanics and optics],
2017, Vol. 17, No. 4, pp. 702-710.
18. Eetveldt J.V. Real-time face liveness detection with Python, Keras and OpenCV, Towards
Data Science, 2019. Available at: https://towardsdatascience.com/real-time-face-livenessdetection-
with-python-keras-and-opencv-c35dc70dafd3.
19. Rodebrock A. Pyimagesearch, Author archive. Available at: https://www.pyimagesearch.com/
author/adrian.
20. Dlib C++ Library. Available at: http://dlib.net/.
21. Krizhevsky A., Sutskever I., Hinton G.E. ImageNet Classification with Deep Convolutional
Neural Networks, Article in Advances in neural information processing systems, January
2012, 9 p.
