ChatGPT Can Now See Images and Talk to Answer Your Questions

OpenAI has updated the famous ChatGPT conversational AI tool to make it more conversational than ever. As a result, it has now gained voice and image capabilities. So, now ChatGPT will talk to you and even recognize images. Here are the details to know.

New ChatGPT Features Added

ChatGPT now uses anew text-to-speech model, which will help you have a back-and-forth verbal conversation with it. Human-like audio will be generated and OpenAI has taken the help of professional actors to create 5 voices for ChatGPT. Plus, Whisper, the open-source speech recognition system has also lent some help for transcribing speech into text.

This voice conversations feature can be enabled via the New Features option under Settings. Once done, you can tap the microphone icon in the top left corner of the home screen to get started.ChatGPT can now see, hear, and speak. Rolling out over next two weeks, Plus users will be able to have voice conversations with ChatGPT (iOS & Android) and to include images in conversations (all platforms).https://t.co/uNZjgbR5Bmpic.twitter.com/paG0hMshXb— OpenAI (@OpenAI)September 25, 2023

ChatGPT can now see, hear, and speak. Rolling out over next two weeks, Plus users will be able to have voice conversations with ChatGPT (iOS & Android) and to include images in conversations (all platforms).https://t.co/uNZjgbR5Bmpic.twitter.com/paG0hMshXb— OpenAI (@OpenAI)September 25, 2023

You can also show images to ChatGPT to get your queries answered. For instance, while traveling, you can show any landmark image to get more details on it, or maybe, show some issue in your smartphone to get information on how to solve it. This is backed bymultimodal GPT-3.5 and GPT-4. You can simply select the photo button (select the plus button first on Android and iOS) to get started.

The voice and image capabilities are currently for thePlus and Enterprise usersand will be rolled out in two weeks. While the voice chat feature is available on Android and iOS, the image feature will be available on all platforms.

It is also revealed that ChatGPT’s voice capability will beused by Spotify for voice translationin podcasts to help podcasters reach more people easily. This will be currently in pilot. For images, it has partnered with Be My Eyes, a free app that helps guide the blind and people with low vision.Do you dream of a world where some of the top podcasts would be spoken in your native language? Well, that’s now possible. We’re excited to pilot Voice Translation, a groundbreaking feature powered by AI that translates podcasts into additional languages—all in the podcaster’s…pic.twitter.com/7ebVwF99hD— Spotify News (@SpotifyNews)September 25, 2023

Do you dream of a world where some of the top podcasts would be spoken in your native language? Well, that’s now possible. We’re excited to pilot Voice Translation, a groundbreaking feature powered by AI that translates podcasts into additional languages—all in the podcaster’s…pic.twitter.com/7ebVwF99hD— Spotify News (@SpotifyNews)September 25, 2023

These may become open for free eventually. OpenAI is aware that these capabilities can be used for malign activities and hence, has just opened its voice feature for chats. Even the image functionality has been tested with ‘red teamers‘ first to ensure responsible usage. So, what do you think about the new ChatGPT features? Will you use them? Let us know in the comments section below.

Vanshika Malhotra

Started off as a stranger but tech is more like a good friend, thanks to over 5 years in the industry. While everything is attractive about tech, phones, social media, and quirky gadgets attract me the most. When not working, I find my solace in shopping and everything that concerns doggos!

Add new comment

Name

Email ID

Δ

01

02

03

04

05