NVIDIA ACE (Avatar Cloud Engine) for games will significantly enhance the experience by integrating generative AI.
NVIDIA ACE Bringing AI Power To Games
ACE for Games provides developers of middleware, tools, and games with the capability to create and implement personalized speech, conversation, and animation AI models in their software and games.
“Generative AI has the potential to revolutionize the interactivity players can have with game characters and dramatically increase immersion in games. Building on our expertise in AI and decades of experience working with game developers, NVIDIA is spearheading the use of generative AI in games.”
John Spitzer, NVIDIA Vice President of Developer and Performance Technology
Pioneering Generative AI in Games
Building on NVIDIA Omniverse, ACE for Games delivers optimized AI foundation models for speech, conversation, and character animation, including:
- NVIDIA NeMo — for building, customizing, and deploying language models, using proprietary data. The large language models can be customized with
- NVIDIA ACE for Games Sparks New Life Into Characters With Generative AI Page 2 lore, character backstories, and protected against counterproductive or unsafe conversations via NeMo Guardrails.
- NVIDIA Riva — for automatic speech recognition and text-to-speech to enable live speech conversation.
- NVIDIA Omniverse Audio2Face — for instantly creating expressive facial animation of a game character to match any speech track. Audio2Face features Omniverse connectors for Unreal Engine 5, so developers can add facial animation directly to MetaHuman characters.
Developers can integrate the entire NVIDIA ACE for Games solution or use only the components they need.
‘Kairos’ Offers a Peek at the Future of Games
NVIDIA collaborated with Convai, an NVIDIA Inception startup, to showcase how developers will soon be able to use NVIDIA ACE for Games to build NPCs. Convai, which is focused on developing cutting-edge conversational AI for virtual game worlds, integrated ACE modules into its end-to-end real-time avatar platform.
In the demo “kairos” you interact with an NPC named Jin that replies to natural language realistically and with consistency.
Deploy NVIDIA ACE for Gaming Models Locally or in the Cloud
The neural networks enabling NVIDIA ACE for Games are optimized for different capabilities, with various sizes, performance, and quality trade-offs. The ACE for ACE for Games Sparks New Life Into Characters With Generative A Games foundry service will help developers fine-tune models for their games, then deploy via NVIDIA DGX Cloud, GeForce RTX PCs, or on-premises for real-time inferencing.
Generative AI to Transform the Gaming Experience
Game developers and startups are already using NVIDIA generative AI technologies for their workflows.
- GSC Game World, one of Europe’s leading game developers, is adopting Audio2Face in its upcoming game, S.T.A.L.K.E.R. 2: Heart of Chernobyl.
- Fallen Leaf, an indie game developer, is using Audio2Face for character facial animation in Fort Solis, a third-person sci-fi thriller that takes place on Mars.
- Charisma.ai, a company enabling virtual characters through AI, is leveraging
Audio2Face to power the animation in its conversation engine.
To learn more by visiting the NVIDIA Omniverse page and either tech during the Computex 2023.
Started his freelancing adventure in 2018 and began doing freelance Audio Engineering work and then started freelance writing a few years later.
Currently he writes for Gadget Pilipinas and formerly wrote for Grit.PH.
He is also a musician, foody, gamer, and PC enthusiast.
