ChatGPT will soon be able to “chat” images shared by users and conduct “back-and-forth” conversations using five voices.

OpenAI announced Monday that ChatGPT has been updated with support for voice chat and image recognition. The company’s AI-powered chatbots will soon be able to understand images taken or shared by users and provide relevant details or information on chatbot-ready platforms. It will also be able to exchange conversations using OpenAI’s Whisper speech recognition engine, and the company’s new text-to-speech (TTS) technology claims to provide “speech-like” audio of humans on the company’s ChatGPT application. smartphone.
OpenAI revealed in a blog post that the company’s new image recognition capabilities for ChatGPT will be available on all platforms, while voice chat will be available on iOS and Android via settings opt-in. These features will be available to ChatGPT Plus and Enterprise subscribers, and it’s unclear whether they will be rolled out to free tier users in the future. You can enable voice chat to ChatGPT by going to Settings > New features and turning on the option to enable voice chat. You can then choose from five voices – OpenAI claims to have worked with professional voice actors to deliver the new feature. The ChatGPT app will be able to answer questions by converting your voice queries into text that the chatbot can understand, and the responses will be converted to audio using the company’s new TTS technology . ChatGPT isn’t the only service using OpenAI’s new TTS technology: Spotify on Monday announced a new AI-powered voice translation tool for podcast creators, capable of automatically translating podcasts from English to French, German and Spanish. The tool is being tested with several podcast hosts, and translated episodes will be available to all users wherever Spotify is available, depending on the streaming platform. OpenAI claims that the new image recognition engine works on the company’s GPT-3.5 and GPT-4 multimodal models and is capable of analyzing images as well as text contained in photos, screenshots and document. Users can take photos or share existing images on their phones with ChatGPT to better understand the chatbot. According to OpenAI, ChatGPT will also allow users to share multiple images that can be discussed with the chatbot. If you want it to focus on a specific area, the built-in drawing tool will let you highlight a portion of the image. For example, drawing a broken bike chain in a photo shared with ChatGPT can allow the chatbot to show you how to solve the problem.