{"id":128942,"date":"2024-10-03T16:00:00","date_gmt":"2024-10-03T16:00:00","guid":{"rendered":"https:\/\/entertainment.runfyers.com\/index.php\/2024\/10\/03\/google-lens-now-lets-you-search-with-video\/"},"modified":"2024-10-03T16:00:00","modified_gmt":"2024-10-03T16:00:00","slug":"google-lens-now-lets-you-search-with-video","status":"publish","type":"post","link":"https:\/\/entertainment.runfyers.com\/index.php\/2024\/10\/03\/google-lens-now-lets-you-search-with-video\/","title":{"rendered":"Google Lens now lets you search with video"},"content":{"rendered":"


\n<\/p>\n

\n

If you can\u2019t capture what you want to search for with just a picture, Google Lens will now let you take a video \u2014 and even use your voice to ask about what you\u2019re seeing. The feature will surface an AI Overview and search results based on the video\u2019s contents and your question. It\u2019s rolling out in Search Labs on Android and iOS today.<\/p>\n<\/div>\n

\n

Google first previewed using video to search at I\/O in May<\/a>. As an example, Google says someone curious about the fish they\u2019re seeing at an aquarium can hold up their phone to the exhibit, open the Google Lens app, and then hold down the shutter button. Once Lens starts recording, they can say their question: \u201cWhy are they swimming together?\u201d Google Lens then uses the Gemini AI model to provide a response, similar to what you see in the GIF below.<\/p>\n<\/div>\n

\n
\n

Google will take your video and question into account when providing a response.<\/em><\/figcaption>GIF: Google<\/cite><\/p>\n<\/div>\n<\/div>\n
\n

When speaking about the tech behind the feature, Rajan Patel, the vice president of engineering at Google, told The Verge<\/em> that Google is capturing the video \u201cas a series of image frames and then applying the same computer vision techniques\u201d previously used in Lens. But Google is taking things a step further by passing the information to a \u201ccustom\u201d Gemini model developed to \u201cunderstand multiple frames in sequence… and then provide a response that is rooted in the web.\u201d<\/p>\n<\/div>\n

\n

There isn\u2019t support for identifying the sounds in a video just yet \u2014 like if you\u2019re trying to identify a bird you\u2019re hearing \u2014 but Patel says that\u2019s something Google has been \u201cexperimenting with.\u201d <\/p>\n<\/div>\n

\n
\n

You can use your voice to ask a question about a photo, too.<\/em><\/figcaption>GIF: Google<\/cite><\/p>\n<\/div>\n<\/div>\n
\n

Google Lens is also updating its photo search feature with the ability to ask a question using your voice. To try it, aim your camera at your subject, hold down the shutter button, and then ask your question. Before this change, you could only type your question into Lens after snapping a picture. Voice questions are rolling out globally on Android and iOS, but it\u2019s only available in English for now.<\/p>\n<\/div>\n


\n
Source link <\/a><\/p>\n","protected":false},"excerpt":{"rendered":"

If you can\u2019t capture what you want to search for with just a picture, Google Lens will now let you take a video \u2014 and even use your voice to ask about what you\u2019re seeing. The feature will surface an AI Overview and search results based on the video\u2019s contents and your question. It\u2019s rolling […]<\/p>\n","protected":false},"author":1,"featured_media":128943,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[14],"tags":[],"class_list":{"0":"post-128942","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-tech"},"_links":{"self":[{"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/posts\/128942","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/comments?post=128942"}],"version-history":[{"count":0,"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/posts\/128942\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/media\/128943"}],"wp:attachment":[{"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/media?parent=128942"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/categories?post=128942"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/tags?post=128942"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}