An interactive AI-powered virtual therapist built using Unreal Engine 5 and Convai, designed to simulate supportive, emotionally intelligent conversations in real-time.
This project allows users to hold spoken conversations with a virtual therapist NPC who listens and responds empathetically using voice and natural language AI. Developed as part of a college hackathon, the goal was to explore how game engines and generative AI could be combined to address emotional wellness and mental health support.
The mental health space is often underserved, especially for individuals who may hesitate to open up in traditional therapy settings. This project aims to demonstrate how real-time, conversational AI embedded in virtual environments could help lower that barrier by:
- Providing anonymous, judgment-free interaction
- Creating an emotionally safe virtual space
- Showcasing a new way to experience empathy from technology
-
Voice-to-Voice Interaction
Users speak directly to the therapist NPC; AI responds verbally and emotionally. -
Convai AI Integration
Uses Convai’s LLM-powered API for generating context-aware, human-like dialogue. -
Session Memory
The therapist NPC retains context during a session, allowing for fluid and natural conversation. -
MetaHuman Expression
Realistic facial expressions reflect emotional tones of the dialogue. -
Unreal Blueprints
Game logic and interactions are designed using Blueprint scripting (no external code required).
This was created during a 36-hour college hackathon centered around the theme of social innovation through technology. The project stood out for combining:
- AI-driven interaction with real emotional depth
- Technical implementation using a AAA-level game engine
- Thoughtful use of human-AI communication design
| Technology | Purpose |
|---|---|
| Unreal Engine 5 | Game development & interaction |
| Convai API | Dialogue generation (AI backend) |
| MetaHuman | Realistic NPC visuals |
| Blueprints | Game logic & behavior scripting |
| Voice I/O | Speech-to-text & text-to-speech |
While this was built as a short-term hackathon project, its underlying idea has long-term relevance:
- Education & awareness: A tool to teach users how to express and reflect on their emotions.
- Mental health support: Could supplement professional care by offering immediate, 24/7 companionship for emotional regulation.
- Game development: Demonstrates the future of NPCs with real empathy and adaptive behavior.
- Accessibility: Offers a non-judgmental space, potentially helpful for those hesitant to seek traditional help.
If further developed, such AI-powered conversational agents could become valuable companions in therapeutic games, educational simulations, or even day-to-day wellness apps.
- Clone this repository.
- Open the
.uprojectfile in Unreal Engine 5. - Add your Convai API key inside the
ConvaiConnectorBlueprint. - Press Play in the Unreal editor.
- Use your mic to begin interacting with the therapist NPC.
Make sure your mic access is enabled and a Convai developer account is set up.