ChatGPT in voice mode accesses your messages and calendar

OpenAI has added support for connected apps on the web, Apple iOS and Google Android to its ChatGPT voice mode. If you ask ChatGPT about email content, calendar events or conversations in Salesforce's Slack app during a conversation, it can now retrieve answers directly from these services. The feature is also available to users of the free plan, while in the business environment ChatGPT Work is designed for working with documents, presentations and spreadsheets. Existing permissions will still apply, as the upgrade itself does not create new access.

The biggest limitation of the new feature lies in the confirmation of actions themselves. If a certain task requires approval, the system will prompt you to review it on the screen. Voice confirmation is not supported, which means that the voice command "yes, send" after reading a draft message will not work. If you have your phone in your pocket or while driving in a car, the task will have to wait for you to directly touch the screen.

The frequency of permission requests depends on the settings in the plugins section. The “Always ask” option requires confirmation before each reading or modification of data. The “Allow read actions” setting allows automatic reading, while a few low-risk options automatically approve less dangerous tasks. OpenAI lists sending messages, editing files, changing security settings, and financial transactions as high-risk actions.