{"id":60255,"date":"2023-12-09T02:18:18","date_gmt":"2023-12-09T02:18:18","guid":{"rendered":"https:\/\/entertainment.runfyers.com\/index.php\/2023\/12\/09\/microsofts-edge-copilot-ai-cant-really-summarize-every-youtube-video\/"},"modified":"2023-12-09T02:18:18","modified_gmt":"2023-12-09T02:18:18","slug":"microsofts-edge-copilot-ai-cant-really-summarize-every-youtube-video","status":"publish","type":"post","link":"https:\/\/entertainment.runfyers.com\/index.php\/2023\/12\/09\/microsofts-edge-copilot-ai-cant-really-summarize-every-youtube-video\/","title":{"rendered":"Microsoft\u2019s Edge Copilot AI can\u2019t really summarize every YouTube video"},"content":{"rendered":"<p> <br \/>\n<\/p>\n<div>\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">One feature added to Microsoft\u2019s AI Copilot in the Edge browser <a href=\"https:\/\/www.theverge.com\/2023\/12\/5\/23989052\/microsoft-copilot-gpt-4-turbo-openai-models-code-interpreter-feature\" target=\"_blank\" rel=\"noopener\">this week<\/a> is the <a href=\"https:\/\/blogs.bing.com\/search-quality-insights\/december-2023\/Continued-AI-Innovation-in-Copilot\" target=\"_blank\" rel=\"noopener\">ability to generate text summaries of videos<\/a>. But Edge Copilot\u2019s time-saving feature is still fairly limited and only works on pre-processed videos or those with subtitles, as Mikhail Parakhin, Microsoft\u2019s CEO of advertising and web services, explained. <\/p>\n<\/div>\n<div>\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">As <a href=\"https:\/\/mspoweruser.com\/microsoft-reveals-edge-copilot-requires-pre-processing-for-video-transcription\/\" target=\"_blank\" rel=\"noopener\">spotted<\/a> by <em>MSPowerUser, <\/em>Parakhin <a href=\"https:\/\/x.com\/MParakhin\/status\/1732805037792108766?s=20\" target=\"_blank\">writes<\/a>,<em> <\/em>\u201cIn order for it to work, we need to pre-process the video. If the video has subtitles &#8211; we can always fallback on that, if it does not and we didn\u2019t preprocess it yet &#8211; then it won\u2019t work,\u201d in response to a question.\u00a0<\/p>\n<\/div>\n<div>\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">In other words, on its own Edge Copilot doesn\u2019t so much summarize <em>videos<\/em> as it summarizes the text transcripts of the videos. Copilot can also perform a similar function throughout Microsoft 365, including summarizing Teams video <a href=\"https:\/\/learn.microsoft.com\/en-us\/microsoft-sales-copilot\/generate-meeting-summary\" target=\"_blank\" rel=\"noopener\">meetings<\/a> and <a href=\"https:\/\/learn.microsoft.com\/en-us\/dynamics365\/customer-service\/use\/copilot-use-summary\" target=\"_blank\" rel=\"noopener\">calls<\/a> for customer service agents \u2014 and in both cases, the audio needs to be <a href=\"https:\/\/learn.microsoft.com\/en-us\/dynamics365\/customer-service\/use\/copilot-use-summary\" target=\"_blank\" rel=\"noopener\">transcribed<\/a> first by Microsoft. Copilot on Microsoft Stream can also summarize any video, but again, it requires users to <a href=\"https:\/\/techcommunity.microsoft.com\/t5\/microsoft-stream-blog\/introducing-copilot-in-microsoft-stream\/ba-p\/3929109\" target=\"_blank\" rel=\"noopener\">generate<\/a> a written transcript.<\/p>\n<\/div>\n<div>\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">The conversation started after designer Pietro Schirano <a href=\"https:\/\/twitter.com\/skirano\/status\/1732347081375781062?s=46&amp;t=5fphZMdXgc54t6mo9ReYMQ\" target=\"_blank\" rel=\"noopener\">posted<\/a> a screen recording of Edge Copilot summarizing a YouTube video about <a href=\"https:\/\/www.theverge.com\/2023\/12\/4\/23988446\/gta-vi-trailer-leaked-vice-city\" target=\"_blank\" rel=\"noopener\">the <em>GTA VI <\/em>trailer<\/a>. In this case, Copilot appeared to be doing its job perfectly. The user in the recording presses the \u201cGenerate video summary\u201d button in the Copilot sidebar, and mere seconds later, Copilot churns one out, complete with highlights and timestamps. <\/p>\n<\/div>\n<div>\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">Of course, many platforms, including YouTube and Vimeo,  can automatically generate transcripts and subtitles \u2014 if users enable the feature. After <em>The Verge<\/em> asked Parakhin on X if we could assume most publicly available videos (i.e. YouTube) weren\u2019t pre-processed, he <a href=\"https:\/\/twitter.com\/mparakhin\/status\/1733276412113752336?s=46&amp;t=5fphZMdXgc54t6mo9ReYMQ\" target=\"_blank\" rel=\"noopener\">replied<\/a>: \u201cShould work for most videos.\u201d<\/p>\n<\/div>\n<div>\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">Copilot is just the latest example of the generative AI race Microsoft is competing in with Google (and others). Last month, Google upgraded the <a href=\"https:\/\/www.theverge.com\/2023\/11\/22\/23972636\/bard-youtube-extension-update-search-video-content\" target=\"_blank\" rel=\"noopener\">YouTube extension<\/a> for its Bard chatbot to enable it to summarize the content of a video and surface specific information from it. Just this week, Google announced a major Gemini update that has its own issues \u2014 the company\u2019s editing may have <a href=\"https:\/\/www.theverge.com\/2023\/12\/7\/23992737\/google-gemini-misrepresentation-ai-accusation\" target=\"_blank\" rel=\"noopener\">misrepresented<\/a> some of the AI\u2019s capabilities in a demo, and it doesn\u2019t always <a href=\"https:\/\/www.threads.net\/@reckless1280\/post\/C0hM5hZuDPD\" target=\"_blank\" rel=\"noopener\">have its facts straight<\/a>. <\/p>\n<\/div>\n<div>\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">Parakhin has been <a href=\"https:\/\/twitter.com\/MParakhin\/status\/1732115106010628296\/photo\/1\" target=\"_blank\" rel=\"noopener\">candid<\/a> about the various stages of Copilot\u2019s evolution on social media. While on a plane on Tuesday morning, the machine learning expert posted on X: \u201cAdding ability for Edge Copilot to use information in videos &#8211; on a flight.\u201d<\/p>\n<\/div>\n<p><script async src=\"\/\/platform.twitter.com\/widgets.js\" charset=\"utf-8\"><\/script><br \/>\n<br \/><br \/>\n<br \/><a href=\"https:\/\/www.theverge.com\/2023\/12\/8\/23994303\/microsoft-copilot-ai-edge-video-summary-youtube-transcript\" target=\"_blank\" rel=\"noopener\">Source link <\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>One feature added to Microsoft\u2019s AI Copilot in the Edge browser this week is the ability to generate text summaries of videos. But Edge Copilot\u2019s time-saving feature is still fairly limited and only works on pre-processed videos or those with subtitles, as Mikhail Parakhin, Microsoft\u2019s CEO of advertising and web services, explained. As spotted by [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":60256,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[14],"tags":[],"class_list":{"0":"post-60255","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-tech"},"_links":{"self":[{"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/posts\/60255","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/comments?post=60255"}],"version-history":[{"count":0,"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/posts\/60255\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/media\/60256"}],"wp:attachment":[{"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/media?parent=60255"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/categories?post=60255"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/tags?post=60255"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}