Pauline and I were inspired to create a game based on FaceMesh and competition. One of our inspirations was the Awkward Date game where too much staring leads to disaster.
Awkward date game
So at first, Pauline and I wanted to work with blink detection for a game purposes and tried to find out the way to detect that. We tried calculating the distance between upper lid and lower life. Unfortunately, we soon realized that FaceMesh doesn't have this feature. So no matter if the eyes are open or closed, FaceMesh would still detect the eyeballs.
Pauline and I are trying FaceMesh tracking
Then we tried the thing called clmtracker which also has pupil tracking which sounded promising. But then again if the eye is closed the pupil is still being tracked, so it didn't really help. And even simple pupil tracking was too sensitive to use for the project based on other people's reviews.
Clmtracker
Although we had to abandon this type of interaction, we found some cool use of eye gaze!
Eye-gaze tracking ML program
Blink to text Python program
We ended up using nose tip as an interaction to move the blob. So we're thinking that users would compete for the blob to move it to different parts of the screen. Or maybe 2 blobs who race to another side of the screen.. we will see. The oscillator is there cuz we somehow want to incorporate it, but we don't know how yet. Although, it does add to the drama of it.
Prototype of the blob race
Comments