OpenAI on Thursday added support for several note-taking and coding apps within the ChatGPT app for macOS. The AI firm described the feature as agentic and highlighted that the chatbot will be able to read on-screen information in supported apps and help users with questions. This feature is currently only available to paid subscribers of the AI platform and users can use Advanced Voice Mode while working with these apps. OpenAI said that Windows users and those on the free tier of the app will get this feature next year.
ChatGPT now works with some third-party apps
The new feature was announced on the 11th day of OpenAI’s 12-day shipping schedule. This new agentive capability, which allows chatbots to take multiple notes and read information in coding apps, is being added to ChatGPIT’s macOS app, the company said in an X (formerly known as Twitter) post. Was highlighted.
Kevin Weil, chief product officer at OpenAI, further explained that ChatGPT can work with about 30 macOS apps. The full list includes Apple Notes, BBEdit, MatLab, Nova, Script Editor, TextMate, VSCode Insiders, VSCodium, Cursor, Windsurf, Android Studio, AppCode, CLion, DataGrip, GoLand, IntelliJ IDEA, PHPStorm, PyCharm, RubyMine, RustRover, WebStorm Are. , hint, taunt, assumption, and quip.
ChatGPT for macOS working with Notion
Photo Credit: OpenAI
With the help of this feature, users can open a supported app and go to any screen or content. They can then use the shortcut Option + Space to open a small text-field view of the app. Once activated, the chatbot can monitor what the user views in the app. Then, the user can use either a text prompt or advanced voice mode to ask questions, and ChatGPT can answer them. Users can also highlight a specific part of text or code and then use natural commands like “how to make this better” and the AI will understand the context.
While the company calls it an agentic feature, technically it’s a vision-based feature. The agentive function is only required when obtaining permission to access these apps. However, ChatGPT will not be able to interact with these apps and perform tasks such as writing text or code or changing existing information.
For privacy, users will be able to control when and which apps can be accessed by ChatGPT. Additionally, OpenAI said that users will have the same level of control over this data as they would over anything else in their conversation history.
This feature is currently available for ChatGPT Plus, Pro, Teams, Enterprise and Edu customers. Free users and Windows app users will have to wait until next year to get this feature.
