Analysis of gait recognition system developed in NI LabVIEW

1 Corresponding author: [email protected] Analysis of gait recognition system developed in NI LabVIEW Dániel Salánki1 , Kornél Sarvajcz 1University of Debrecen, Faculty of Engineering and Mechatronics, 4028 Debrecen, Hungary Abstract. Nowadays, the world of biometric identifiers is improving one of the most significantly in security technology. Within the biometric identifiers, the research group is working with the gait recognition speciality. The research group realized a complex gait recognition system in NI LabVIEW, that can detect more reference points simultaneously with a universal camera and can suit a function on the detected points. Moreover, the program can compare the functions of the reference curve with the functions of the actual curve and evaluate if the two gait images are the same or not. The program can save the actual gait data and reload them. The leg/foot ratio analyser program before the gait recognition is designed to improve accuracy. The research group tested the program in different ways: walking only in socks in shorts or in trousers, walking in slippers, walking in the opposite way. These facts have affected the gait recognition’s accuracy, the lowest False Rejection Rate (FRR) was in the case of walking in socks in shorts. 1 Introduction In today's world, I find it important to protect our values with the mechanical and electronic tools at our disposal. As a mechatronics engineer student, I sought to find a theme that plays a decisive role in everyday life and is closely related to mechatronics. Numerous biometric identification methods exist today (e.g. face, voice, palm, iris, retina, fingerprint authentication and DNA – Deoxyribonucleic Acid – analysis), but gait recognition is less common. This is how we came up with the idea of wanting to implement a camera-based gait recognition program using the Vision module of National Instruments LabVIEW software, which is capable of real-time image processing to recognize that the gait image of a person passing by in front of the system is the same as that of the previously stored person’s gait image. If this condition is met, the system gives him / her permission. The gait recognition is preceded by a foot examination that examines the leg/foot ratio of the person. If the test is passed, the actual gait recognition begins. 2 Gait recognition – References People can often feel that a familiar person is already recognized far from their walk. This common experience is the idea behind the fact that district recognition systems can be used in security technology. You can easily make an image of a person's walk, even in public places, without even getting observed by that person. Walking is also influenced by several factors: footwear, soil, fatigue, current state of mind or any injury [1]. Walking can be defined as a series of cyclic and coordinated movements that result in human displacement [1]. Gait is defined as “a manner of moving on foot; way of walking or running” in Webster's New Collegiate Dictionary. However, human gait is more than that: it is an idiosyncratic feature of a person that is determined by, among other things, an individual's weight, limb length, footwear, and posture combined with characteristic motion [2]. Compared to physiological biometric identification (fingerprint authentication, iris and face identification, earlobe geometry identification), the gait recognition has the advantage of identifying persons with low resolution or hidden camera shots [3]. Physiological biometric methods cannot reliably detect non-cooperating individuals, especially not at distances, under the changing environmental conditions of the real world [4]. However, the accuracy of walking recognition can be greatly influenced by several factors, such as the viewing angle that changes the visual attributes [5]. 3 Leg/foot ratio analysis The essence of this analysis is that we determine the ratio of the leg's and foot’s lengths with a program developed in LabVIEW. We first measured the ratio of one of our legs, which ranged between 2.42 and 2.43, so we selected these two numbers as limit values. So, if the ratio of the leg and foot measured in pixels is between these two numbers, the program will give a green signal. Fig. 1 shows a measurement in trousers and in slippers. The proportional value (2.26314) did not correspond to the set limits, so the green light did not flash. Fig. 2 shows another measurement. In this case, the person was sitting in socks, without any footwear. In this ANNALS OF THE UNIVERSITY OF ORADEA Fascicle of Management and Technological Engineering ISSUE #2, AUGUST 2018, http://www.imtuoradea.ro/auo.fmte/ 65 case, the proportional value was adequate, and the green light flashed. In shorts or without socks the green light also flashed. It can be stated that the clothes have minimal influence on the results, but the footwear has an important role in this measurement. Fig. 1. Measuring in slippers. Fig. 2. Measuring without any footwear. 4 The presentation of gait recognition software We attached a point to the knee and another to the leg of the person, about 35 centimetres from the ground. The background of the points is white, the point itself is black. It is important to have a light or white background to avoid false point detection, and to have your foot closer to the camera where the reference points are located. The measurements were made with artificial light, with normal room lighting, beside the darkened drapery avoiding sunlight, creating approximately the same lighting conditions for each measurement. Fig. 3 shows the front panel while the program is working. On the right side of the figure, the coordinates of the detected points will be stored in blocks after running. X1 and Y1 are valid for the first point (suited on the knee), while X2 and Y2 are valid for the second point. In the middle it is the actual image, the two red rectangles frame the reference points. On the second and third tabs, the gait image is processed. On the second tab the actual gait image is processed, while on the third tab the saved and reloaded gait image is processed. If the actual gait image is like the saved one, the green light below the actual image will flash. The program suits a function on the curves drawn by the two reference points. You can choose between four function models (Linear, Polynomial, Exponential, Power) and you can choose the order of the function too. On Fig. 4. a) and b) the blue points represent the detected points and the red curves are the functions suited on them. According to the tests, the most accurate fit is the fourth-degree (biquadratic) polynomial function (Fig 4. a)). However, for biquadratic polynomials, the third and fourth coefficients take very small values (up to 10-10), and the second-order (quadratic) function also follows well the curve drawn by the points (Fig 4. b)), so the use of the fourth-degree polynomials becomes unnecessary. Working with quadratic function is simpler than working with biquadratic ones. Fig. 4. a) Suiting a fourth-degree polynomial function on the gait curve. Fig. 4. b) Suiting a second-degree polynomial function on the gait curve. ANNALS OF THE UNIVERSITY OF ORADEA Fascicle of Management and Technological Engineering ISSUE #2, AUGUST 2018, http://www.imtuoradea.ro/auo.fmte/ 66 Fig. 3. The front panel of the program while working. 5 Gait recognition results in different conditions Fig. 5. shows the coefficients of the functions suited on the curve drawn by the first (blue columns) and the second point (green columns). During this series of measurements, the tested person wore shorts and socks without any shoes or slippers, and the first step was made with the right leg (the reference points were also fixed on the right leg). According to the results, in 8 cases out of 10 the system recognized the tested person. The unsuccessful attempts are written with red characters. Fig. 5. Results in shorts, no footwear. On Fig. 6. you can see the coefficients of the functions received from measurements made in shorts wearing slippers. The results are very similar to the first measurement, the False Rejection Rate (FRR) increased a bit: the tested person was recognized 7 times out of 10 measurements. Fig. 6. Results in shorts, in slippers. The unsuccessful attempts are written with red characters. Fig. 7. shows the data received from measurements made in trousers, without shoes. The FRR increased to 50%, so only half of the measurements were successful. These results can be explained with the fact that the reference points fixed on the trousers were moving with the cloth (the trousers are moving on the leg while walking), while fixed directly on the tested person’s knee and leg, they followed exactly the movement of the knee and the leg. Fig. 7. Results in trousers, no footwear. The unsuccessful attempts are written with red characters. ANNALS OF THE UNIVERSITY OF ORADEA Fascicle of Management and Technological Engineering ISSUE #2, AUGUST 2018, http://www.imtuoradea.ro/auo.fmte/ 67 Fig. 8. shows the results from a series of measurements made in shorts, wearing no shoes, the reference points fixed on the left leg, and going from the right of the camera to the left. The previous measurements were made from the left of the camera to the right. With these attempts, the FRR became 90%, only one time out of 10 was the test person recognized. This result was caused by the fact that the software was calibrated to start from the left of the camera. The curves drawn by the reference points fixed on the left or on the right leg are different. Fig. 8. Results in shorts, walking in the opposite direction. The unsuccessful attempts are written with red characters. The measurements presented above were made with starting the walking with the right leg. We have made some measurements with the same conditions as in the first measurement series (reference points on right leg, wearing short and no footwear), but the first step was made with the left leg. The results are shown on Fig. 9. Because the coefficients were very different from the initial values, we made only three attempts, certainly without any success. The curves drawn by the two reference points, that are shown on Fig. 10. a) and b) were far from the initial curves because of the cyclical shift and because the camera can view only a few steps. So, it is normal that the program didn’t make any recognition in this measurement. Fig. 9. Unsuccessful results starting with the left leg. Fig. 10. a). Curve drawn by the second reference point starting the walking with left leg Fig. 10. b). Curve drawn by the second reference point starting the walking with right leg 6 Conclusion With these tests, we have showed how our gait recognition system is working in different situations. According to the result, the footwear has the least influence on the system, but wearing trousers, or walking in the opposite direction can have serious impact on the successfulness of the test. It is also important to start the measurement with the right leg, because otherwise the curves will be far different from the reference curves, and the program will not recognize even the person with permission. Acknowledgement The work/publication is supported by the EFOP-3.6.1-162016-00022 project. The project is co-financed by the European Union and the European Social Fund. References 1. Jeffrey E. Boyd, James J. Little: Biometric Gait Recognition, 19-42 (Springer - Verlag Berlin Heidelberg, 2005) 2. Lee, Lily, W. Eric L. Grimson. Gait analysis for recognition and classification. Automatic Face and Gesture Recognition, 2002. Proceedings. Fifth IEEE International Conference on (pp. 155-162). IEEE, 2002. 3. Mark S. Nixon, T. N. Tan, R. Chellappa: Human Identification Based on Gait, (Springer Science + Business Media, Inc., 2006) 4. Ju Han, Bir Bhanu: Individual Recognition Using Gate Energy Image, 28.2: 316-322, (IEEE transactions on pattern analysis and machine intelligence, 2006) 5. Wei Zeng, Cong Wang: Neurocomputing - Viewinvariant gait recognition via deterministic learning, 175: 324-335 (2016) ANNALS OF THE UNIVERSITY OF ORADEA Fascicle of Management and Technological Engineering ISSUE #2, AUGUST 2018, http://www.imtuoradea.ro/auo.fmte/ 68