𝑌𝑜𝑢 𝑤𝑒𝑟𝑒 𝑏𝑜𝑟𝑛 𝑡𝑜 𝑏𝑒 𝑟𝑒𝑎𝑙 𝑁𝑜𝑡 𝑡𝑜 𝑏𝑒 𝑝𝑒𝑟𝑓𝑒𝑐𝑡 𝐼𝑡'𝑠 𝑜𝑘𝑎𝑦

Insider White Hat ❖

We hack so other can’t

Gaming Assistive technologies

Gaming assistive technologies

Xbox

Developer

Learn about the types of assistive hardware and software technologies that players with disabilities use to game, and the importance of supporting these assistive technologies when you create accessible gaming products and experiences for all audiences.

Learning objectives

After you complete this module, you’ll be able to:

  • Describe common gaming software-based features and tools and how their use can affect player experiences.
  • Describe common hardware-based gaming assistive technologies and how their use can affect player experiences.
  • Determine appropriate methods to support assistive technology users when you develop games and platforms.

StartSave

Prerequisites

  • You should have some basic familiarity with playing and creating video games.
  • You should have some familiarity with using game platforms like Xbox, PlayStation, Nintendo Switch, or Windows.
  • A basic understanding of foundational terms and concepts for disability and accessibility principles is helpful

Introduction

Assistive technologies (AT) are products or tools used by individuals with disabilities to perform daily tasks. Devices like wheelchairs, prosthetics, hearing aids, adaptive eating utensils, and more are considered AT. AT products are also commonly used to access technology.

In gaming, players with disabilities might use hardware and software-based technologies to support accessible experiences. Common examples include screen readers, magnification tools, and adaptive input devices.

Consider the following scenario. A player with low vision uses a high-contrast setting on their PC to enhance the readability of text. When they launch a new game title, many of the elements in the game title’s UI are missing or obscured. It’s apparent that the game is displaying incorrectly because of an incompatibility with the player’s platform-level high-contrast settings.

This player requires a high-contrast display for play. They search the game title’s menu but can’t find an in-game high-contrast setting. Disappointed, the player abandons the game. They know they won’t be able to play it without compatible AT to support their visual needs. As a developer, you hear about this experience and are hoping to learn more about the AT that players with disabilities use to ensure that the future products and experiences you create support players in using these tools.

In this module, you’ll be introduced to common hardware and software AT that players with disabilities might use to improve access to gaming experiences. You’ll learn about the impact of AT on player experiences and the importance of supporting AT compatibility within your title, platform, or hardware device.

Gaming software assistive technology

200 XP

  • 16 minutes

Contrast settings, as discussed in the introductory scenario, are just one of many types of software-based assistive technologies (AT) commonly used in gaming.

In this unit, you’re introduced to other common software settings and tools. You’ll also learn how to best support players who use these technologies when you create new gaming experiences.

What are the common types of software assistive technologies used in gaming?

Software-based AT can improve access to gaming experiences through a host of functionalities including:

  • Narrating visual UI elements aloud to players.
  • Customizing the player’s display to optimize the visibility of elements.
  • Allowing players to reassign their input controls through software.

These technologies and tools are available as third-party programs that can be installed on gaming platforms, built-in features on certain game platforms, and functions built directly into some games.

Awareness of the following assistive tools helps you to ensure the gaming products and experiences you create effectively support the players who use them.

Screen readers

Screen readers are a form of AT that renders text or image content onscreen aloud as speech or Braille output. They’re commonly used by individuals who are blind or have visual disabilities in which adjusting text size or color isn’t enough to render the text readable.

Screen readers might also be used by players with cognitive or learning disabilities that make reading difficult, or younger players who haven’t yet learned to read.

In gaming, screen readers should convey what’s happening visually within the game’s UI aloud via synthesized audio.

In the following video, the player adjusts their screen narration settings at the Xbox platform level. Next, they launch the game Forza Horizon 5. The game starts with its title-provided screen reader already enabled. The user has screen narration enabled at the platform level, so the game can read and apply the user’s settings to the game when it starts.

https://www.microsoft.com/en-us/videoplayer/embed/RWPDLf?postJsllMsg=true

Contrast settings

Contrast settings are intended to enhance the visibility of onscreen elements by changing color schemes or simplifying backgrounds. These settings are primarily used by players with low vision. They can also benefit neurodiverse users. Some high-contrast modes also simplify the visual aspects of the user interface considered distracting by some players, which makes the interface easier to navigate.

The following screenshots provide an example of the Xbox platform’s high-contrast mode settings in action:

Xbox home screen without high-contrast mode enabled:

A screenshot that shows the Xbox home screen. The Microsoft Rewards tab has focus. Buttons consisting of images with text on top of them are displayed. Behind the buttons, a gradient color pattern of purples and pinks is displayed.

The Xbox platform high-contrast settings menu:

A screenshot that shows the Xbox Accessibility High-contrast settings menu with High contrast: Dark theme selected. An image to the right demonstrates what the Xbox home screen will look like with a dark theme applied. Text on the screen reads: Turn on high contrast to make on-screen elements easier to see. This will prevent your personal color and background from being shown.

The Xbox home screen with the high-contrast dark theme applied:

A screenshot that shows the Xbox home screen. Buttons consisting of images with text on top of them are displayed. The white text of each button now sits on an opaque bar. A gradient color pattern of purples and pinks is no longer displayed behind the buttons. The background is black.

The following changes work to simplify and enhance the visibility of the UI elements:

  • The background color is changed from bright pink and purple to solid black.
  • The focus indicator is slightly wider and brighter.
  • The focus indicator’s bright turquoise color has a high-contrast ratio against the new black background UI elements sit on.
  • The text within the tile options now has a solid black background behind it to increase readability.
  • Content that typically animates or moves within the UI is now static or replaced by the black background.

 Note

The Xbox high-contrast settings are a platform-level feature. These settings don’t alter the UI during in-game play.

Color filters and custom color palettes

Color filters are another tool that might allow players with certain types of color blindness to more easily distinguish visual elements onscreen. They’re often provided at the platform level to provide a base level of access to experiences that might not be otherwise accessible to some individuals.

A screenshot that shows the Xbox Accessibility Color filters settings screen. The list box Correction type: No correction selected is shown and highlighted. To the right are three circles, each divided into three equal segments of different colors and labeled Deuteranopia, Protanopia, and Tritanopia. Underneath the circles is a colorful image of an Xbox controller. Next to it is a grid of colors representing the colors of the rainbow, from red to purple. Text on the screen reads: Before selecting a correction, identify the circle whose three colors look most similar. Then choose the correction named for that circle.
A screenshot that shows the Xbox Accessibility Color filters settings screen. The list box Correction type: Red-green (protanopia) is shown. The Intensity slider is shown set to the maximum value. Underneath, the Color boost slider is set closer to the maximum value. Underneath is a Restore defaults button. To the right are three circles, each divided into three equal segments of different colors and labeled Deuteranopia, Protanopia, and Tritanopia. Underneath the circles is a colorful image of an Xbox controller. Next to it is a grid of colors representing the colors of the rainbow, from red to purple. Text on the screen reads: Before selecting a correction, identify the circle whose three colors look most similar. Then choose the correction named for that circle.

As a general rule, color filters at the platform or game level shouldn’t be considered a solution for players with color blindness. Color filters can affect other visual aspects of a game in unintended ways. For example, some visual components might be more difficult to see for certain players depending on the severity of their color blindness. A better option is to offer players color palettes to choose from that individually change the color of specific elements.

A screenshot that shows the Halo 5 Accessibility menu. Under the Visual tab, the player can choose from a variety of colors for the enemy UI color, friendly UI color, and fireteam marker color options.
A screenshot that shows the Halo 5 Accessibility menu options. The fireteam marker color selection list is expanded. A scrolling list of about 15 color options total is presented. The color jade is selected.

Magnification tools

Magnification tools typically enlarge a portion of the screen, or all the screen, so that users can more easily see words and images.

In gaming contexts, magnification tools allow players to zoom in on specific areas of their gameplay environment to get a clearer look at the contents onscreen.

Magnification tools can help players with low vision enlarge screen elements to the point where they can be read or interpreted. Magnification tools can also help players who are using small screens, like mobile devices, or are playing on screens that are further away, which makes screen elements appear small.

A screenshot that shows the Forza Horizon 5 Car Horns menu. The entire screen is displayed, including the Standard Horns, Musical Horns, and Sound Effects tabs.
A screenshot that shows the Forza Horizon 5 Car Horns menu, now zoomed in on a specific section of the screen. Only a portion of the original screen is displayed with text and images larger than they were previously.

Accessible player-to-player communication tools

Online player communication tools like voice chat might be inaccessible for players with disabilities who can’t hear what others are saying aloud.

Players who can’t speak aloud or choose not to will be unable to respond to other players in the voice channel. AT like speech-to-text and text-to-speech are intended to make communication experiences between players accessible.

These tools might be provided by the gaming platform you’re shipping on for certain chat functionality. For in-game chat, some of these tools require the use of specific APIs for games to make use of them. There are also non-platform services that exist that developers can integrate as part of their games to provide such functionality, such as PlayFab Party chat.

  • Speech-to-text: Transcribes incoming speech from other players into text onscreen in real time. Players who can’t hear voice chat can read what other players have said aloud on their screen.
  • Text-to-speech: Converts text typed by the player into synthesized audio that’s read aloud to all other players in the voice channel. This feature allows players who can’t speak verbally to have their thoughts expressed aloud to the rest of the players in their party.
A screenshot that shows the Xbox Accessibility Game and chat transcription settings. Two columns of settings are shown. The left column of settings is labeled Party chat options. Underneath are two checkboxes: Speech-to-text and Text-to-speech. A list box is labeled Text-to-speech voice: Guy. The right column of settings is labeled Game transcription. Underneath are three checkboxes: Speech-to-text, Text-to-speech, and Let games read to me. A list box is labeled In-game chat voice: Microsoft Mark. Text on the screen reads: Turn on speech-to-text to transcribe other players' voices into text on your device, when you are in a system party chat session.

Captioning

Captioning is an important tool that’s useful for players with hearing impairments to translate noise and dialogue from the game into text that appears onscreen.

 Note

The terms « captioning, » « closed captions, » and « subtitles » are often used interchangeably, although there are subtle differences between them. For this module, we use « captioning » to refer to the use of onscreen text to represent audio, which includes both sound effects and character dialogue.

Captions can help identify aspects of the game like:

  • The dialogue of other characters.
  • The character that’s currently speaking.
  • The presence and direction of important audio cues.

Captions are also used by players who don’t have hearing impairments but prefer to have the text appear onscreen. Perhaps the player is in a loud environment or finds it easier to recall storylines by reading text while also listening to it.

Captions can support players at the platform and individual game title levels to ensure audio is accessible.

The following image displays the Xbox platform’s captioning settings. An array of customization options work to ensure that captioned text is also accessible to players from a visual perspective. Games and applications can choose to read these settings and use them to adjust how their caption systems present information to their players.

A screenshot that shows the Xbox Accessibility Captioning settings. On the left are three buttons: Captioning off, On using default style, and On using custom style. The button On using custom style is set. To the right is a column of settings labeled Caption Font. These list items include Caption color: White, Caption transparency: Opaque, Caption size: 200%, Caption style: Default, and Caption effects: Default. To the right is another column of settings labeled Background & window. These list items include Background color: Black, Background transparency: Opaque, Window color: Black, and Window transparency: Transparent. At the bottom of the screen is a window titled Preview that shows sample captions on top of sample game graphics.

In Forza Horizon 5, users can customize how spoken dialogue appears onscreen. They can adjust the size and background opacity of their subtitles. They can also have key words highlighted to more easily draw player attention to important information.

A screenshot that shows the Forza Horizon 5 Accessibility settings menu. The Subtitles Text Size option has focus. A slider to increase and decrease subtitle text size is provided. A preview of the user's current subtitle settings is shown at the bottom of the screen.

Input remapping

Input remapping allows players to reassign the functions on their standard input devices. Remapping capabilities are helpful in allowing players with limited mobility to change the arrangement of their controls through software. For example, if the default assignment for sprinting in a game is right stick-click and a player with a thumb injury finds performing that action difficult, they can reassign the sprint function via software to a different button on their controller that’s easier to activate.

A screenshot that shows the Xbox Accessibility Controller Profile 1 settings screen. Text on the screen reads: Choose a button to map. Or press and hold a button. Underneath the A button list item is selected. A Map to setting is displayed that's also set to A button. More checkboxes include Swap sticks, Invert right stick Y axis, Invert left stick Y axis, Swap triggers, and Turn on vibration. To the right, an Xbox controller is shown with a Restore to default button underneath it.

Platform-level remapping tools can provide an effective « safety net » for players. But gaming experiences can be made more accessible when in-game remapping features are also provided. This ensures that any tutorials, prompts, or references to game controls onscreen have properly translated the player’s newly remapped controls to avoid confusion.

A screenshot that shows the Microsoft Flight Simulator Controls Options menu. The controller option is selected. A long list of game controls that can be reassigned to the player's desired controller input is displayed.

Software considerations for game accessibility

You now have a new understanding of common software-based AT that players use in gaming. The next step is to ensure that future experiences you create also support players who need these technologies.

When you develop game titles, consider the following steps:

  • Assess the scope of assistive tools that are provided by the platforms your title will ship on.
  • Ensure your product works smoothly with any assistive tools that are present.
  • No matter what platform-level accessibility tools exist, aim to include more robust, in-game versions of these functions and features. Platform-level AT is often designed to be a last resort for gamers who have no other options and might not provide an ideal experience.

When you develop new gaming platforms or platform features, consider the following steps:

  • Assess the scope of assistive tools provided by the platform.
  • Note any key settings or tools missing. Players must first navigate their platform to start their game. If a game title offers assistive tools but the platform doesn’t, players can still be blocked from play while they attempt to navigate the platform without these tools.
  • You can also identify any sources of incompatibility between platform-provided AT and a game title’s ability to use them. For example, if a player has screen narration turned on at the platform level, but the platform doesn’t expose this information to the game title, the game can’t leverage the player’s platform settings on launch.

Gaming hardware assistive technology

200 XP

  • 11 minutes

You’re now familiar with some of the common software-based assistive technologies (AT) used by players. AT also includes hardware and physical devices.

In this unit, you’ll learn about some common hardware AT devices used for gaming access. This unit also offers important insights to consider when you develop game experiences that support players who use these devices.

What are the common types of hardware assistive technologies used in gaming?

Many hardware AT devices might be referred to as « adaptive » input devices or « adaptive controllers. » In general, these devices provide an accessible alternative for players who have difficulty using standard input devices like commercial controllers, a mouse, and a keyboard.

In the following video, you’ll learn about some common AT devices like the Xbox Adaptive Controller, switch buttons, and mouth-operated joysticks.

https://www.microsoft.com/en-us/videoplayer/embed/RWPOy2?postJsllMsg=true

Hardware considerations for accessible game development

A primary challenge that AT users encounter is a lack of compatibility between their device and the game platform or game title they want to use the device with. The methods of activation players use with these devices can vary from the traditional input methods that games are typically optimized for. Consider the following information when you develop games and platforms that support players who use these devices.

Device compatibility

Many of the hardware devices discussed in this unit differ in the type of « output » they use. For example, eye-gaze devices, despite looking nothing like a mouse, are generally « seen » via software as a mouse by the game or platform when plugged in to a host or platform device. Game titles that don’t support mouse input actively exclude players who require eye-gaze devices to play.

In general, the scope of other AT devices can include:

  • Switch interfaces seen as keyboard input.
  • Mouth-based joysticks seen as mouse input.
  • The Xbox Adaptive Controller seen as a game pad or controller input.

Regardless of a player’s specific AT device of choice, you can support these players by ensuring the games and platforms you create allow an array of input types including controller, mouse, and keyboard input.

Challenging game mechanics

In addition to supporting diverse input types, it’s also important to consider the activation methods that players use for these devices. Many game mechanics assume that players can use rapid finger movements on their keyboard or standard controller. Players who use large switch buttons activated by their head or knee might be unable to activate these controls with the same speed or precision as a finger.

JP DEVC

Laisser un commentaire