OpenAI said Monday that it has given its ChatGPT artificial intelligence (AI) software the ability to speak and see to make it “more intuitive.”
The interface that has popularized generative AI – that is, capable of producing text, images and other content on demand – will soon be able to process requests with images as well as discuss them verbally with its users.
In a statement, OpenAi gives the example of a user who photographs a monument and then “has a chat with ChatGPT” about the history of the building or who shows the software inside their refrigerator so it can suggest a recipe.
The company that launched ChatGPT is creating an application to ensure privacy for businesses
Other examples of potential uses, according to the company, include helping children with school exercises, for example, by sending a picture of a math problem, or asking a chatbot to tell children a story before they go to bed.
These new tools will be developed over the next two weeks for subscribers of ChatGPT Plus, the paid version of the chatbot, and organizations that are customers of the service.
The company announced these features in March, when introducing GPT-4, the latest version of its language model, which supports chatGPT.
GPT-4 is multimedia, meaning it can handle information as well as text or computer codes.
The success of ChatGPT since the end of 2022 has sparked a race toward generative AI by technology conglomerates, including Google and Microsoft.
But the rapid development of these programmes, which are still very poorly organized, raises many concerns, especially as they tend to “hallucination“, that is, inventing answers.
Vision-equipped models pose new challenges and hallucinations, because people can rely on the software’s interpretation of images in areas with serious consequences for the decisions made, as OpenAI acknowledged in its statement.
The company is guaranteed to haveModel testingon topics such as extremism and scientific knowledge, but added that it relies on real-life uses and user feedback to improve it.
On the other hand, ChatGPT’s capabilities are limited to “People analysis“, because the interface “is not always accurate and these systems must respect the confidentiality of individuals.”
The truth about ChatGPT
“Friendly zombie fanatic. Analyst. Coffee buff. Professional music specialist. Communicator.”
