New functionality allows users to search the web by filming short videos, enhancing the online search experience through AI

In a significant leap in mobile search capabilities, Google has unveiled a new feature that enables users to search the internet by taking videos. Announced two days ago, this cutting-edge function allows individuals to point their camera at an object, ask a question, and receive instant search results.

From 1700 GMT, both Android and iPhone users worldwide can access this feature by activating “AI Overviews” within the Google app, although it is initially available only in English. This development is part of Google’s ongoing efforts to integrate artificial intelligence into its search functionalities, aiming to provide a more intuitive and visual search experience.

This initiative follows closely behind a similar trial by OpenAI, which revealed its capability for users to search by querying its chatbot just three months earlier. Google has already tested AI-generated results at the top of certain search queries this year, though these efforts have met with mixed responses. Earlier in May, users raised concerns about the accuracy of AI-generated responses, including one particularly odd suggestion regarding using “non-toxic glue” to make cheese stick to pizza. In response to the backlash, a Google spokesperson downplayed the incidents as “isolated examples,” claiming subsequent iterations have shown improved accuracy.

With an aim to innovate further, Google has been enhancing its Lens feature, which enables users to ask questions about still images. The integration of AI into this functionality has boosted Lens’s popularity within the mobile app, prompting Google to explore more features that leverage AI’s potential.

Liz Reid, Google’s head of search, emphasised that the new capability will simplify how users inquire about their surroundings. For example, a visitor at an aquarium can now point their camera at a group of fish and ask why they are swimming in unison. The AI will analyse the video, recognise the fish species, and generate relevant search results seamlessly.

Industry analysts view this advancement as a major milestone for Google. Paolo Pescatore remarked, “We are witnessing AI integrated into everything, and visuals resonate best with users. This development illustrates new ways of enlivening content with search, which is among the most common online activities. There is vast potential for AI to be personalised and tailored to individual usage patterns and habits.”

In addition to the video search feature, Google has rolled out several other updates aimed at enhancing user experience. The company has improved its shopping results, which will now incorporate reviews and pricing information from various sellers, making online shopping more transparent and user-friendly. Furthermore, Google is launching a competitor to Apple’s music-identifying app, Shazam. This new tool, accessible through Circle to Search on Android devices, allows users to identify songs while browsing websites or streaming shows without leaving the app.

These innovations come as Google faces increasing competition in the search market, where it holds over 90% of the global market share. OpenAI has emerged as a formidable contender, revealing in July that it was testing a search feature within ChatGPT. Dubbed SearchGPT, this feature allows users to ask questions directly to a chatbot, enhancing the interactivity of online searches. Following this announcement, OpenAI’s valuation surged to an impressive $157 billion after raising $6.6 billion in funding from notable investors, including Microsoft.

As Google continues to innovate in response to evolving user needs and competitive pressures, the introduction of video search marks a promising shift in how we engage with information online. With a commitment to leveraging AI for practical applications, Google appears poised to redefine the search experience for millions of users around the globe.