Surprise Me!

CNTK + LSTM + kinect v2 = Face analysis

2018-01-29 1 Dailymotion

Facial analysis application demonstrating some features like real-time LSTM classification, annotation, training tool and single frame evaluation.<br /><br />CNTK - Microsoft Cognitive Toolkit (CNTK), an open source deep-learning toolkit https://github.com/Microsoft/CNTK<br />We are using kinect v2 to extract 3d points from faces, then we select some specific points ( eye brow and nose) in each frame and then calculate Euclidean distance and vector orientation. With that result we evaluate in real time a sequence of frames with a LSTM neural network previously trained. The patterns evaluated are Neutral,Smile,Angry and Awe.

Buy Now on CodeCanyon