🗣️ Our mission is to provide authentic virtual humans for Unreal-based immersive, virtual environments in the most efficient, reliable, and user-friendly way possible.

This plugin shall provide an easy and comfortable way to integrate virtual humans into your Unreal project.

It is best-fitted for models generated with Character Creator 3. A growing collection of models can be found here.

Besides the character's appearance, it's behavior needs to be defined. To see which components are already provided, see the list below. Additionally, guidelines on how to integrate new models (e.g., MetaHumans) and to map animations to the respective characters' skeletons are provided here.

Features

The planned components to allow for navigation and face to face interactions are:

• Locomotion
• Facial Expressions
• Gaze (incl. Blinking)
• Face Animation (including Oculus LipSync)
• Speech-Interface
  • Virtual Acoustics
• Animation (including a set of basic standard animations)
• Pointing etc. (Grabbing, Pointing etc.)
• Body Avatar with limited HW for motion mirroring
• Breathing?
• Logging
• ...

Demo Project

A test project demonstrating the current features can be found here.

Performance

See this page for hints about performance, especially with MetaHumans in VR.

Further Links

🗣️ A small explanation how to generate TTS-speech and lipsync for it can be found here.

❗ Character Plugin FAQs can be found here
❗ Gerneral FAQs and remarks of our Unreal developments for the CAVE etc. can be found in Group Wiki

In case of questions, please do not hesitate to contact [@konstantin.kuehlem] (kuehlem@vr.rwth-aachen.de) and @aboensch.