Nvidia on Sunday unveiled Project G-Assist, an artificial intelligence (AI) assistant powered by its ray-tracing Texel eXtreme (RTX) platform, at Computex 2024 in Taipei. The tech giant introduces it as a personal gaming assistant for PCs that can answer queries about any video game, including game strategy and analyzing multiplayer replays. Artificial intelligence has natural language and computer vision capabilities that allow it to accept text, speech, and screen information as input. Currently, there is no launch date for this product. It is worth noting that Microsoft also demonstrated similar use cases for Copilot at its Build event.
Nvidia launches G-Assist project
The G-Assist project is part of Nvidia’s RTX AI toolkit, and several other announcements were made on June 2. The AI assistant, in particular, is the company’s effort to bring game knowledge to players through generative artificial intelligence. Interestingly, in 2017, Nvidia posted a video on X (formerly Twitter) about the GeForce GTX G-Assist, a tool that could play games on behalf of players, as an April Fools’ Day joke.
Now, seven years later, NVIDIA is turning that dream into a reality. So what can an AI assistant do? The company shared a technical demonstration using Studio Wildcard’s game ARK: Survival Ascended, highlighting the wide range of areas in which Project G-Assist can help players. While the AI Assistant is primarily intended as a tool to quickly find the best weapons in the game or solutions when performing missions, it can also perform more complex tasks.
During the demo, Project G-Assist helped create game strategies for surviving early game play, provided multiplayer replay analysis, assisted in finding the best settings for playing the game, and figured out the best way to optimize the game on a given PC. Notably, the AI assistant has both large language model (LLM) capabilities and computer vision capabilities, so it can understand natural language and gain context by analyzing the screen in real time.
G-Assist projects can be run via a server or locally on a device powered by an Nvidia GeForce RTX GPU, giving gamers flexibility. Based on the demo, the AI assistant appears to have access to the internet in both cases, as it may need to search the web to find answers to certain questions.
For now, Project G-Assist only exists as a demo, and Nvidia has yet to share any details on its release date.