OpenAI has officially announced an exciting new feature for its chatbot, ChatGPT, which now has the capability to process and verbally communicate about real-time observations from video feeds. This development comes seven months after it was initially hinted at, marking a significant advancement in the chatbot’s functionality.
During a livestream event on Thursday, OpenAI showcased how ChatGPT can utilize a smartphone’s camera to recognize objects and engage in conversations based on what it sees. For instance, users could request assistance in responding to messages in apps or seek step-by-step guidance for tasks such as brewing coffee.
This new video interaction feature will be available starting Thursday for subscribers of ChatGPT Plus and Pro, with a rollout planned for enterprise and educational customers in January.
OpenAI pioneered the investment in text-based chatbots with the release of ChatGPT two years ago, and since then, both OpenAI and its competitors have expanded their offerings to include multimodal capabilities that integrate audio, images, and video. This evolution allows digital assistants to deliver a more interactive and engaging experience for users.
The announcement is part of a series of product unveilings that OpenAI has scheduled over 12 days, which also includes the launch of a pricier ChatGPT Pro subscription and an AI-driven video generation tool called Sora.
This innovative leap in technology not only enhances user interaction but also brings us closer to seamlessly integrating AI into our daily tasks, reinforcing the potential for AI to assist us in practical and real-time scenarios. As these advancements continue, the possibilities for improved functionality and engagement in AI applications appear promising.