Apple announced several accessibility updates powered by Apple Intelligence to enhance features including VoiceOver, voice control, live recognition, and real-time caption generation for videos. The company timed the announcement ahead of Google’s annual developer conference on Tuesday. The upcoming software updates will introduce specialized capabilities across the iPhone, iPad, Mac, Apple TV, and Vision Pro platforms, with a scheduled rollout to users later this year, likely as part of the upcoming iOS 27 release.
Vision And Text Recognition Enhancements
The image recognition feature within VoiceOver utilizes Apple Intelligence to analyze visual data and provide descriptive details. The system can evaluate a financial bill to read aloud specific information such as the total amount and due date, while also describing personal records and photographs. Users can activate the Live Recognition feature via an iPhone camera to identify framing content and pose follow-up questions. For individuals with low vision, the Magnifier tool can be assigned to the Action Button to present content on a high-contrast interface responsive to voice commands like “zoom in” or “turn on flashlight.”
Natural Language Voice Control And Document Reading
System-wide voice command updates allow users to describe tasks in natural language to interact with on-screen content. Individuals can state commands such as “tap the guide about best restaurants” within Apple Maps or “tap the purple folder” inside the Files application. Concurrently, the updated Reader tool processes complex documents like scientific papers containing multiple columns, images, and tables. The feature generates summaries or reads text aloud in native languages while retaining custom fonts and colors to assist users with dyslexia or low vision.
Media Subtitles And Hardware Integration
The software introduces artificial intelligence to generate real-time subtitles for videos that lack pre-existing captions, including personal clips recorded on an iPhone or received from contacts. Users maintain control over the visual appearance of these subtitles across compatible Apple hardware. For the Vision Pro headset, a new project enables users to control compatible wheelchairs using eye movements under variable lighting conditions without requiring recalibration. This eye-tracking feature launches in the United States with Tolt and LUCI alternative drive systems, supporting both wired and Bluetooth accessory connections. Additionally, the name recognition feature for users with hearing disabilities expands to support 50 languages, large text support rolls out to tvOS, and Made for iPhone hearing aids receive improved device handoff capabilities.
Featured image credits: PxHere
For more stories like it, click the +Follow button at the top of this page to follow us.