ChatGPT’s Advanced Voice Mode has just rolled out exciting new features, including video and screenshare capabilities. Although this advancement was initially teased with the launch of GPT-4o last May, users only had access to the voice component until now.
In a recent livestream, Chief Product Officer Kevin Weil and members of the OpenAI team showcased ChatGPT’s new abilities by demonstrating how it can assist users in real-time tasks. For example, when they pointed their phone camera at their coffee-making setup, ChatGPT accurately recognized the pour-over coffee process, providing step-by-step guidance throughout. The team also illustrated the screensharing feature by analyzing a message on Weil’s phone, enhancing user interaction through visual aids.
This announcement follows closely after Google’s introduction of the Gemini 2.0 model, which also offers the ability to process audio and visual inputs while executing complex tasks on behalf of its users. Gemini 2.0 operates under different project names aimed at various applications of AI, from universal assistance to more specific functionalities.
In a playful twist, during the demonstration, ChatGPT’s vision capabilities were not only effective in recognizing objects but could also be interrupted mid-conversation. One fun aspect for users is the inclusion of a Santa voice option for the AI, which offers a festive experience complete with hearty laughter. However, users are advised that this feature is intended for those aged 13 and older.
Starting now, the new video and screenshare features are available to ChatGPT Plus and Pro subscribers, with rollout for Enterprise and Education users expected in January.
Overall, this latest update from OpenAI showcases the versatility and interactive potential of AI in everyday tasks, making technology not only more accessible but also more engaging for users. It sets an optimistic tone for the future of AI-assisted experiences, highlighting a rapidly evolving landscape in which we can expect more innovative features to come.