I am Eduardo Alvarado am an AI Researcher work at MPI for Informatics research on novel virtual avatars love game-dev!

Google put out their new GNM head, a parametric 3D head. I wanted to understand what’s actually inside it, so started a small project for face tracking. Probably existed already, but not bad to learn a couple of new things 🙂

Identity Fit -> MediaPipe (Face Tracking) -> GNM forward pass.

The subject fit was tricky. I had to run MediaPipe on the plain GNM head, record where it puts the landmarks, and then compare that with the real-face tracked counterparts. Still rough – but fun to play with.