AAU-CREATE / MLMP-EKMAN-FER-MOCAP Public

MLMP-EKMAN-FER-MOCAP

Original Project: Steffan Mogelmøse

AR

About this project

Facial Expression Classification Using ARKit Blendshape Time-Series Data

This project implements a lightweight facial expression recognition system using Apple ARKit blendshape coefficients recorded with the iPhone Live Link Face app. The system classifies seven emotions using time-series muscle-activation data instead of images or video, making it fast, private, and suitable for embedded deployment.

Anger_2_iPhone_edgeimpulse
Neutral_1_iPhone_edgeimpulse
Disgust_2_iPhone_edgeimpulse
Happiness_2_iPhone_edgeimpulse
Surprise_1_iPhone_edgeimpulse
Happiness_1_iPhone_edgeimpulse
Neutral_2_iPhone_edgeimpulse
Disgust_1_iPhone_edgeimpulse

Run this model

Scan QR code or launch in browser

Dataset summary

Data collected
4m 7s
Sensors
EyeBlinkLeft, EyeLookDownLeft, EyeLookInLeft, EyeLookOutLeft, EyeLookUpLeft, EyeSquintLeft, EyeWideLeft, EyeBlinkRight, EyeLookDownRight, EyeLookInRight, EyeLookOutRight, EyeLookUpRight, EyeSquintRight, EyeWideRight, JawForward, JawRight, JawLeft, JawOpen, MouthClose, MouthFunnel, MouthPucker, MouthRight, MouthLeft, MouthSmileLeft, MouthSmileRight, MouthFrownLeft, MouthFrownRight, MouthDimpleLeft, MouthDimpleRight, MouthStretchLeft, MouthStretchRight, MouthRollLower, MouthRollUpper, MouthShrugLower, MouthShrugUpper, MouthPressLeft, MouthPressRight, MouthLowerDownLeft, MouthLowerDownRight, MouthUpperUpLeft, MouthUpperUpRight, BrowDownLeft, BrowDownRight, BrowInnerUp, BrowOuterUpLeft, BrowOuterUpRight, CheekPuff, CheekSquintLeft, CheekSquintRight, NoseSneerLeft, NoseSneerRight, TongueOut, HeadYaw, HeadPitch, HeadRoll, LeftEyeYaw, LeftEyePitch, LeftEyeRoll, RightEyeYaw, RightEyePitch, RightEyeRoll @ 53.6Hz
Labels
anger, disgust, fear, happiness, neutral, sadness, surprise

Project info

Project ID 827620
License 3-Clause BSD
No. of views 641
No. of clones 0