ChatGPT Updated With Support for These New Voice and Image Features

ChatGPT has been up to date with help for voice conversations and picture recognition, OpenAI introduced on Monday. The firm’s AI-powered chatbot will quickly have the ability to perceive photographs captured or shared by customers and supply particulars or associated data throughout platforms the place the chatbot is out there. It may also be able to back-and-forth dialog utilizing OpenAI’s Whisper speech recognition device and a brand new text-to-speech (TTS) expertise from the corporate that’s claimed to supply “human-like” audio on the corporate’s ChatGPT app for smartphones.

OpenAI revealed in a blog post that the corporate’s new picture recognition functionality for ChatGPT shall be out there on all platforms, whereas the voice conversations characteristic shall be out there on iOS and Android by way of an opt-in setting. These options shall be out there to ChatGPT Plus and Enterprise subscribers, and there is not any phrase on whether or not it’ll roll out to customers on the free tier sooner or later.

The voice conversations coming to ChatGPT may be enabled by going to Settings > New Features and toggling the choice to allow voice conversations. You can then choose from 5 voices — OpenAI says it has labored with skilled voice actors to supply the brand new characteristic. The ChatGPT app will have the ability to reply questions by changing your spoken queries into textual content that may be understood by the chatbot, and responses shall be was audio utilizing the corporate’s new TTS expertise.

ChatGPT is not the one service that can use OpenAI’s new TTS expertise — Spotify on Monday introduced a brand new AI-based voice translation device for podcast creators that may mechanically translate a podcast from English to French, German, and Spanish. The device is being examined with just a few podcast hosts and translated episodes shall be out there to all customers wherever Spotify is out there, in line with the streaming platform. 

OpenAI says the brand new picture recognition device runs on the corporate’s multimodal GPT-3.5 and GPT-4 fashions and are able to analysing photographs and textual content contained in images, screenshots, and paperwork. Users can both seize a picture or share an current one on their cellphone with ChatGPT to get insights from the chatbot.

ChatGPT may also permit customers to share a number of photographs that may be mentioned with the chatbot, in line with OpenAI. If you need it to give attention to a particular space, the built-in drawing device will permit you to mark part of the picture. For instance, drawing round a dislodged bicycle chain in a photograph shared with ChatGPT may permit the chatbot to point out you methods to repair the issue.