Generative AI for Facial Expressions in 3D Game Characters: A Retrieval-Augmented Approach

Генеративный ИИ для мимики 3D-персонажей в компьютерных играх: подход с дополненной поиском генерацией
Jonas de Araújo Luz, Guadalupe Prado Saldanha Ribeiro, Rafael Fonseca Pessoa, A. Magalhães, Maria Andréia Formico Rodriguês, Alberto Huarastaca Taveira Magalhães
2025-04-29

3D game charactersFacial Action Coding Systemfacial expressionsnon-playable charactersretrieval-augmented generation
This paper examines a Retrieval-Augmented Generation (RAG) approach for generating facial expressions in 3D game characters using artificial intelligence. By integrating large language models within a RAG-based architecture, we developed a proof-of-concept system that animates expressions based on Facial Action Coding System (FACs) action units. Testing demonstrates the potential of RAG-driven animations to create immersive, adaptive experiences with contextually appropriate expressions that enhance perceived emotional responsiveness in Non-Playable Characters, highlighting RAG’s promise for dynamic character interactions and AI-driven personalization in game development.
1
A proof-of-concept RAG system integrates large language models to generate facial expressions for 3D game characters.
2
Testing indicates that RAG-driven animations can produce contextually appropriate expressions for Non-Playable Characters.
3
The approach shows potential to enhance perceived emotional responsiveness, immersion, adaptive experiences, and AI-driven personalization in games.
4
The system animates expressions using Facial Action Coding System action units.

Facial expressions and animations of 3D game characters, particularly Non-Playable Characters

RAG-driven generation of contextually appropriate, adaptive facial expressions based on Facial Action Coding System (FACS) action units to enhance perceived emotional responsiveness

Publication Details
Publication Date
2025-04-29
Journal
Publisher
ISSN
Cited by
5
Access Type
Author Information
Authors
Jonas de Araújo Luz
Guadalupe Prado Saldanha Ribeiro
Rafael Fonseca Pessoa
A. Magalhães
Maria Andréia Formico Rodriguês
Alberto Huarastaca Taveira Magalhães
Explore further
Open the scid.ai AI chat with a ready-made request: it will find papers on a similar topic and help build a literature review.
Find similar papers in the chat →
Make a presentation
100%