A Multi-view Video Based Deep Learning Approach for Human Movement Analysis

Download or read book A Multi-view Video Based Deep Learning Approach for Human Movement Analysis written by Connor McGuirk and published by . This book was released on 2021 with total page pages. Available in PDF, EPUB and Kindle. Book excerpt: Human motion analysis is an important tool for assessing movement, rehabilitation progress, fall risk, progression of neurodegenerative diseases, and classifying gait patterns. Advancements in artificial intelligence models and high-performance computing technologies have given rise to marker-less human motion analysis that determine point correspondences between an array of cameras and estimate 3D joint coordinates using triangulation. However, existing methods have not considered the physical setup and design of a marker-less human motion analysis tool that could be deployed in an institutional environment for active use, such as an institutional hallway where individuals pass regularly on a daily basis (i.e., Smart Hallway). In this thesis, camera locations were modelled, four machine vision grade cameras connected to an NVIDIA Jetson AGX were set up in a simulated institutional hallway environment, and custom software was written to capture synchronized 60 frame per second video of a participant walking through the Smart Hallway capture volume. Software was also written to calculate 3D joint coordinates and extract outcome measures for various test conditions. These outcome measures were compared to ground truth body segment length measurements obtained from direct measurement and ground truth foot event timings obtained from direct observation. Body segment length measurements were within 1.56 (SD=2.77) cm of ground truth values. AI-based stride parameters were comparable with ground truth foot event timings and the implemented foot event detection algorithm was within 4 frames (67 ms), with an absolute error of 3 frames (50 ms) on the ground truth foot event labels. The Smart Hallway can be deployed in an unobtrusive manner and be temporally and spatially calibrated with ease. This multi-camera marker-less approach is viable for calculating useful outcome measures for clinical decision making. With these findings, marker-less motion capture is viable for non-invasive human motion analysis and compares well with marker-based systems. With future research and innovations, marker-less motion analysis will be the ideal approach for human motion analysis that requires minimal human resource to collect meaningful information.