← Amr Amer's projects
Repo

Personality-Aware-Non-verbal-Behavior-Generation

@amramerby Amr Amer · Saarland University

A multimodal transformer that generates personality-aware listener avatars (facial expressions, body and hand gestures) in dyadic conversations. Built with PyTorch using VQ-VAE and transformers, trained on UDIVA. Beats a personality-agnostic baseline on FID and P-FID, and 86% of study participants identified the extroverted avatar.

Built withPythonaffective-computingcomputer-visondata-pipelinedeep-learningfacial-expressions

Comments · 0

No comments yet. Tried it? Tell Amr what worked, what didn't, or what you'd want next.
Sign in to comment

More from members

All projects

See what other members are building and what each project is looking for.