Back to Work

Game Assist

AI Experiences / Xbox2025–Present

Game Assist brings AI-powered help into Xbox gameplay through multimodal experiences, helping players get unstuck without breaking immersion.

Game Assist shown across Xbox hardware — an ROG handheld, a laptop, a monitor, and a phone — with the Game Assist panel.

Role

Creative DirectorProduct Design Lead

Scope

Creative DirectionProduct StrategyUXUIDesign SystemsCross-Platform Strategy

Surfaces

MobilePCGame BarHandheldFuture Console Experiences

Team

Lindsey SperberRaymond DeanKara PhilipovichAle ChinchillaCarlos Cuadra

Status

Beta - paused

About

Designing AI around player moments

Game Assist, originally Gaming Copilot, began as a 0→1 question:

What should AI feel like inside a gaming experience?

We started mobile-first to move fast and learn sooner, but the larger goal was always to define how AI assistance could support Xbox players wherever they play.

The Challenge

Gaming needed a different approach to AI

Most AI experiences assume someone at a keyboard, ready to type and have a long back-and-forth.

Players are different: hands on a controller, focused on the game, and trying not to break flow.

The challenge was not simply bringing AI into Xbox. It was designing help that could show up in the moment without pulling players out of the experience.

Gen AI Modality Assumptions

Keyboards
Typing
Desktop screens
Long conversations

Player reality

Holding controllers
Playing with friends
Fighting bosses
Staying immersed

What players wanted was simple: real help, right at the moment they got stuck.

The Direction

Finding where AI belongs in play

The opportunity was to take the AI foundation Microsoft Copilot had established and make it work for gaming.

We started on mobile, but the surfaces that mattered were the ones players never leave. So the assistant moved into the Game Bar overlay and became reachable by push-to-talk.

Underneath it all was a harder design problem: LLMs are inherently probabilistic, but players expect deterministic help. Much of the work was making a non-deterministic system feel dependable in the moment.

Play xbox.com video

My Role

Turning open-ended AI into a shipped product

I led the work close to the craft: setting direction, prototyping with the team, and keeping focus through an ambiguous 0→1 space.

The white ROG Ally handheld running a game — one of the surfaces Game Assist supports.

Creative Direction

Set the experience direction and quality bar across every surface.

Product Strategy

Connected AI opportunities to real player needs and moments.

Player-Coach

Designed alongside the team, running critique, prototyping, and helping turn wide exploration into a shippable direction.

Cross-Functional Alignment

Partnered across Product, Engineering, Brand, Content Design, Copilot, and the Xbox design system.

Game Assist composer component
Game Assist voice component
Game Assist voice on ROG Ally
Game Assist typography and content styles
Game Assist text box component
Game Assist chat on mobile
Game Assist conversation starter component
Game Assist on PC

My team built a scalable AI component system within the Xbox Design System.

The Process

Exploring what AI should feel like in play

The final direction feels simple now, but it came from broad exploration across chat, voice, contextual help, vision, overlays, naming, and system behavior.

As the work evolved, we paired Figma with VS Code and MCPs to move from static concepts into playable prototypes faster.

My role was to help the team pressure-test ideas, find the clearest player value, and turn wide exploration into one coherent product.

Early concepts:

New motion direction:

Press to zoom in

Designing for Conversational UX:

Mobile composer variants
Mobile composer variants
User chat component
User chat component
PC composer game presence
PC composer game presence
PC composer states
PC composer states
Mobile voice modes
Mobile voice modes

Select a card to view

Product Evolution

From concept to product

The product evolved from an early Gaming Copilot concept, through a hybrid phase, into Game Assist.

Gaming Copilot logo
Game Assist logo
Before: Gaming Copilot
After: Game Assist
Impact

Xbox’s First Player-Focused AI

Defined real-time AI help inside gameplay.

4 Products in 9 Months

Moved from concept to product with a small, cross-functional team.

3X Higher In-Game Retention

Delivered contextual help without pulling players out of gameplay.

Game Assist on the ROG Ally handheld — the 'Let's start chatting' screen over a Sea of Thieves session.

AI Foundations Across Xbox

Established reusable patterns, behaviors, and system components.

Pioneered Design-in-Code

Led adoption of Figma, VS Code, and MCP-powered workflows for AI product development.

Help Without Leaving the Game

Redefined player assistance through in-the-moment guidance, voice, and chat integrated directly into play.

Reflection

The biggest lesson from this work was about attention and trust.

We made the most progress when we stopped asking what AI could do and started asking where players actually needed help.

Gaming audiences are protective of the experiences they love. Early on, the Copilot name carried strong Microsoft productivity associations, which risked turning players away before they understood the value. That pushed us to make the experience feel native to Xbox first: useful, lightweight, and grounded in real gameplay moments.

The best assistance helps players stay focused on the game they came to play.

Satya Nadella on X on Copilot for Gaming: jump back into games faster, get real-time coaching, and stay connected on your own terms.Mustafa Suleyman on X announcing Gaming Copilot (Beta) rolling out on PC, with voice mode and screen awareness so help is a quick question away.

Next Project

Xbox Support Site