Apple is expanding Visual Intelligence to macOS, allowing users to search and take actions based on what they are currently working on. On iPhone, a new Siri camera mode brings similar capabilities, enabling the assistant to “see” through the camera and respond to contextual queries about the surroundings by simply tapping the shutter button.
Siri can now be used anywhere text input is supported, making it possible to ask or give instructions while typing. It also extends to real-world use cases, such as identifying objects through photos, answering questions about products on shopping websites, extracting details from screenshots to add events to the calendar, and even providing nutrition information when pointed at food or helping split bills from receipts.
Alongside this, AI-powered proofreading is now built in for automatic text correction. The feature is initially rolling out in English, with more languages expected to be added later.