Real-Time Social Accessibility
for Multiplayer Games

Real-Time Social Accessibility
for Multiplayer Games

Play Beyond Sound is a multimodal communication systems for Deaf and hard-of-hearing players in multiplayer games.

Emotion Augmented Captions

See what your team says—and how urgently they mean it, in the heat of the moment.

Customization Interface

Tune your signals to match your playstyle, from subtle cues to high-intensity alerts.

Haptic Module

Feel danger, calls, and timing through touch—without taking your eyes off the game.

Expressive Input System

Fire off quick, expressive signals that keep up with fast-paced gameplay.

1

Emotion Augmented Captions

A real-time caption system that translates voice communication into text enriched with emotional and tonal cues.

2

Customization Interface

A customizable caption customization interface that allows players to adapt captions to different gameplay context,
giving them direct control over how accessibility supports their experience.

3

Embodied Haptic Module

Voice and ping signals rely on sound, and visual cues can be missed during gameplay. This modular haptic device turns those signals into vibrations, enabling DHH players to perceive critical information through touch.

4

Expressive

Input System

An expanded ping and quick communication system that allows players
to express rich emotion and information quickly through visual signals.

Less noise

Less noise

Better visual tracking

Better visual tracking

Stronger contrast

Stronger contrast

Fast, expressive communication in gameplay

Play Beyond Sound is a multimodal communication systems for Deaf and hard-of-hearing players in multiplayer games.

Emotion Augmented Captions

See what your team says—and how urgently they mean it, in the heat of the moment.

Customization Interface

Tune your signals to match your playstyle, from subtle cues to high-intensity alerts.

Haptic Module

Feel danger, calls, and timing through touch—without taking your eyes off the game.

Expressive Input System

Fire off quick, expressive signals that keep up with fast-paced gameplay.

1

Emotion Augmented Captions

A real-time caption system that translates voice communication into text enriched with emotional and tonal cues.

2

Customization Interface

A customizable caption customization interface that allows players to adapt captions to different gameplay context,
giving them direct control over how accessibility supports their experience.

3

Embodied Haptic Module

Voice and ping signals rely on sound, and visual cues can be missed during gameplay. This modular haptic device turns those signals into vibrations, enabling DHH players to perceive critical information through touch.

4

Expressive

Input System

An expanded ping and quick communication system that allows players
to express rich emotion and information quickly through visual signals.

Less noise

Better visual tracking

Stronger contrast

Fast, expressive communication in gameplay

Social Communication Accessibility Framework

Social Communication Accessibility Framework

A new communication system that translates voice into
signals that can be seen, felt, and expressed

Making games perceivable beyond sound