{"id":92461,"date":"2024-04-24T10:39:58","date_gmt":"2024-04-24T10:39:58","guid":{"rendered":"https:\/\/entertainment.runfyers.com\/index.php\/2024\/04\/24\/adobes-impressive-ai-upscaling-project-makes-blurry-videos-look-hd\/"},"modified":"2024-04-24T10:39:58","modified_gmt":"2024-04-24T10:39:58","slug":"adobes-impressive-ai-upscaling-project-makes-blurry-videos-look-hd","status":"publish","type":"post","link":"https:\/\/entertainment.runfyers.com\/index.php\/2024\/04\/24\/adobes-impressive-ai-upscaling-project-makes-blurry-videos-look-hd\/","title":{"rendered":"Adobe\u2019s impressive AI upscaling project makes blurry videos look HD"},"content":{"rendered":"<p> <br \/>\n<\/p>\n<div>\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">Adobe researchers have developed a new generative AI model called <a href=\"https:\/\/videogigagan.github.io\/\" target=\"_blank\" rel=\"noopener\">VideoGigaGAN<\/a> that can upscale blurry videos at up to eight times their original resolution. Introduced in a <a href=\"https:\/\/arxiv.org\/pdf\/2404.12388.pdf\" target=\"_blank\" rel=\"noopener\">paper published on April 18th<\/a>, Adobe claims VideoGigaGAN is superior to other Video Super Resolution (VSR) methods as it can provide more fine-grained details without introducing any \u201cAI weirdness\u201d to the footage.<\/p>\n<\/div>\n<div>\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">In a nutshell, Generative Adversarial Networks (GANs) are effective for upscaling still images to a higher resolution, but struggle to do the same for video without introducing flickering and other unwanted artifacts. Other upscaling methods can avoid this, but the results aren\u2019t as sharp or detailed. VideoGigaGAN aims to provide the best of both worlds \u2014 the higher image\/video quality of GAN models, with fewer flickering or distortion issues across output frames. The company has provided <a href=\"https:\/\/videogigagan.github.io\/\" target=\"_blank\" rel=\"noopener\">several examples here<\/a> that show its work in full resolution.<\/p>\n<\/div>\n<div>\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">Some of the finer details in the demo clips Adobe provided appear to be entirely artificial, such as the skin texture and creases in the below example, but the results appear impressively natural. It would be difficult to tell that generative AI was used to improve the resolution, which could extend the \u201c<a href=\"https:\/\/www.theverge.com\/2023\/10\/7\/23906753\/google-pixel-8-pro-photo-editing-tools-ai\" target=\"_blank\" rel=\"noopener\">what is a photo<\/a>\u201d debate to include video.<\/p>\n<\/div>\n<div>\n<div class=\"duet--article--image-comparison relative my-40\">\n<p><figcaption class=\"duet--article--dangerously-set-cms-markup inline text-gray-13 dark:text-gray-e9 [&amp;&gt;a:hover]:text-black [&amp;&gt;a:hover]:shadow-underline-black dark:[&amp;&gt;a:hover]:text-gray-e9 dark:[&amp;&gt;a:hover]:shadow-underline-gray-63 [&amp;&gt;a]:shadow-underline-gray-13 dark:[&amp;&gt;a]:shadow-underline-gray-63\"><em>The AI has added skin texture and fine eyebrow hairs that don\u2019t jitter during motion. It looks impressively organic!<\/em><\/figcaption><cite class=\"duet--article--dangerously-set-cms-markup inline not-italic text-gray-63 dark:text-gray-bd [&amp;&gt;a:hover]:text-gray-63 [&amp;&gt;a:hover]:shadow-underline-black dark:[&amp;&gt;a:hover]:text-gray-bd dark:[&amp;&gt;a:hover]:shadow-underline-gray [&amp;&gt;a]:shadow-underline-gray-63 dark:[&amp;&gt;a]:text-gray-bd dark:[&amp;&gt;a]:shadow-underline-gray\">Image: Adobe and Image: Adobe<\/cite><\/p>\n<\/div>\n<\/div>\n<div>\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">This is only a research preview, so there\u2019s no guarantee that Adobe will make VideoGigaGAN available to consumers via Creative Cloud software like Premiere Pro. The company previously previewed a separate diffusion-based upsampling experiment, <a href=\"https:\/\/www.theverge.com\/2023\/10\/11\/23912480\/adobe-max-sneak-project-resup-ai-video-upscaling-preview\" target=\"_blank\" rel=\"noopener\">Project Res-Up<\/a>, during its MAX event in October 2023, which similarly improves the quality of low-resolution GIFs and video footage. And Adobe isn\u2019t alone in this work, as both <a href=\"https:\/\/www.theverge.com\/2023\/3\/6\/23627080\/microsoft-edge-video-upscaling-ai-super-resolution-vsr\" target=\"_blank\" rel=\"noopener\">Microsoft<\/a> and <a href=\"https:\/\/www.theverge.com\/2023\/1\/4\/23538584\/nvidia-ai-upscaling-browser-chrome-edge-30-40-series-gpu-graphics-cards-4k-1080p\" target=\"_blank\" rel=\"noopener\">Nvidia<\/a> have also developed their own VSR upscaling technology.<\/p>\n<\/div>\n<p><br \/>\n<br \/><a href=\"https:\/\/www.theverge.com\/2024\/4\/24\/24138979\/adobe-videogigagan-ai-video-upscaling-project-blurry-hd\" target=\"_blank\" rel=\"noopener\">Source link <\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Adobe researchers have developed a new generative AI model called VideoGigaGAN that can upscale blurry videos at up to eight times their original resolution. Introduced in a paper published on April 18th, Adobe claims VideoGigaGAN is superior to other Video Super Resolution (VSR) methods as it can provide more fine-grained details without introducing any \u201cAI [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":92462,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[14],"tags":[],"class_list":{"0":"post-92461","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-tech"},"_links":{"self":[{"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/posts\/92461","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/comments?post=92461"}],"version-history":[{"count":0,"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/posts\/92461\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/media\/92462"}],"wp:attachment":[{"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/media?parent=92461"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/categories?post=92461"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/tags?post=92461"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}