{"id":17597,"date":"2023-05-11T19:22:25","date_gmt":"2023-05-11T19:22:25","guid":{"rendered":"https:\/\/entertainment.runfyers.com\/index.php\/2023\/05\/11\/hands-on-with-googles-ai-powered-music-generator\/"},"modified":"2023-05-11T19:22:25","modified_gmt":"2023-05-11T19:22:25","slug":"hands-on-with-googles-ai-powered-music-generator","status":"publish","type":"post","link":"https:\/\/entertainment.runfyers.com\/index.php\/2023\/05\/11\/hands-on-with-googles-ai-powered-music-generator\/","title":{"rendered":"Hands on with Google&#8217;s AI-powered music generator"},"content":{"rendered":"<p> <br \/>\n<\/p>\n<div>\n<p id=\"speakable-summary\">Can AI work backward from a text description to generate a coherent song? That\u2019s the premise of <a href=\"https:\/\/aitestkitchen.withgoogle.com\/experiments\/music-lm\" target=\"_blank\" rel=\"noopener\">MusicLM<\/a>, the AI-powered music creation tool Google released yesterday during the kickoff of its <a href=\"https:\/\/techcrunch.com\/2023\/05\/10\/heres-everything-google-has-announced-at-i-o-so-far\/\" target=\"_blank\" rel=\"noopener\">I\/O conference<\/a>.<\/p>\n<p><a href=\"https:\/\/techcrunch.com\/2023\/05\/10\/google-makes-its-text-to-music-ai-public\/\" target=\"_blank\" rel=\"noopener\">MusicLM<\/a>, which was trained on hundreds of thousands of hours of audio to learn to create new music in a range of styles, is available in preview via Google\u2019s AI Test Kitchen app. I\u2019ve been playing around with it for the past day or so, as have a few of my colleagues.<\/p>\n<p>The verdict? Let\u2019s just say MusicLM isn\u2019t coming for musicians\u2019 jobs anytime soon.<\/p>\n<p>Using MusicLM in Test Kitchen is pretty straightforward. Once you\u2019re approved for access, you\u2019re greeted with a text box where you can enter a song description \u2014 as detailed as you like \u2014 and have the system generate two versions of the song. Both can be downloaded for offline listening, but Google encourages you to \u201cthumbs up\u201d one of the tracks to help improve the AI\u2019s performance.<\/p>\n<div id=\"attachment_2542210\" style=\"width: 1034px\" class=\"wp-caption aligncenter\"><\/p>\n<p id=\"caption-attachment-2542210\" class=\"wp-caption-text\"><strong>Image Credits:<\/strong> Google<\/p>\n<\/div>\n<p>When I first <a href=\"https:\/\/techcrunch.com\/2023\/01\/27\/google-created-an-ai-that-can-generate-music-from-text-descriptions-but-wont-release-it\/\" target=\"_blank\" rel=\"noopener\">covered<\/a> MusicLM in January, before it was released, I wrote that the system\u2019s songs sounded something like a human artist might compose \u2014 albeit not necessarily as musically inventive or cohesive. Now, I can\u2019t say I entirely stand by those words, as it seems clear that there was some serious cherry-picking going on with samples from earlier in the year.<\/p>\n<p>Most songs I\u2019ve generated with MusicLM sound passable at best \u2014 and at worst like a four-year-old let loose on a <a href=\"https:\/\/en.wikipedia.org\/wiki\/Digital_audio_workstation\" target=\"_blank\" rel=\"noopener\">DAW<\/a>. I\u2019ve mostly stuck to EDM, trying to yield something with structure and a discernible (plus pleasant, ideally) melody. But no matter how decent \u2014 even good! \u2014 the beginning of MusicLM\u2019s songs sounds, there comes a moment when they break down in a very obvious, musically unpleasing way.<\/p>\n<p>For example, take this sample, generated using the prompt \u201cEDM song in a light, upbeat and airy style, good for dancing.\u201d It starts off promising, with head-bobbing baseline and elements of a classic Daft Punk single. But toward the middle of the track, it veers wayyyyy off course \u2014 practically another genre.<\/p>\n<p><!--[if lt IE 9]><![endif]--><br \/>\n<audio class=\"wp-audio-shortcode\" id=\"audio-2541996-1\" preload=\"none\" style=\"width: 100%;\" controls=\"controls\"><source type=\"audio\/mpeg\" src=\"https:\/\/techcrunch.com\/wp-content\/uploads\/2023\/05\/AI_Test_Kitchen_edm_song_in_a_light_upbeat_and_airy_style_g-2.mp3?_=1\"\/><a href=\"https:\/\/techcrunch.com\/wp-content\/uploads\/2023\/05\/AI_Test_Kitchen_edm_song_in_a_light_upbeat_and_airy_style_g-2.mp3\" target=\"_blank\" rel=\"noopener\">https:\/\/techcrunch.com\/wp-content\/uploads\/2023\/05\/AI_Test_Kitchen_edm_song_in_a_light_upbeat_and_airy_style_g-2.mp3<\/a><\/audio><\/p>\n<p>Here\u2019s a piano solo from a simpler prompt \u2014 \u201cromantic and emotional piano music.\u201d Parts, you\u2019ll notice, sound well and fine \u2014 exceptional even, at least in terms of the finger work. But then it\u2019s as if the pianist becomes possessed by mania. A jumble of notes later, and the song takes on a radically different direction, as if from new sheet music \u2014 albeit along the lines of the original.<\/p>\n<p><audio class=\"wp-audio-shortcode\" id=\"audio-2541996-2\" preload=\"none\" style=\"width: 100%;\" controls=\"controls\"><source type=\"audio\/mpeg\" src=\"https:\/\/techcrunch.com\/wp-content\/uploads\/2023\/05\/AI_Test_Kitchen_romantic_and_emotional_piano_music.mp3?_=2\"\/><a href=\"https:\/\/techcrunch.com\/wp-content\/uploads\/2023\/05\/AI_Test_Kitchen_romantic_and_emotional_piano_music.mp3\" target=\"_blank\" rel=\"noopener\">https:\/\/techcrunch.com\/wp-content\/uploads\/2023\/05\/AI_Test_Kitchen_romantic_and_emotional_piano_music.mp3<\/a><\/audio><\/p>\n<p>I tried MusicLM\u2019s hand at chiptunes for the heck of it, figuring the AI might have an easier time with songs of a more basic construction. No dice. The result (below), while catchy in parts, ended just as randomly as the other samples.<\/p>\n<p><audio class=\"wp-audio-shortcode\" id=\"audio-2541996-3\" preload=\"none\" style=\"width: 100%;\" controls=\"controls\"><source type=\"audio\/mpeg\" src=\"https:\/\/techcrunch.com\/wp-content\/uploads\/2023\/05\/AI_Test_Kitchen_house_music_in_chiptune_with_an_energetic_ba.mp3?_=3\"\/><a href=\"https:\/\/techcrunch.com\/wp-content\/uploads\/2023\/05\/AI_Test_Kitchen_house_music_in_chiptune_with_an_energetic_ba.mp3\" target=\"_blank\" rel=\"noopener\">https:\/\/techcrunch.com\/wp-content\/uploads\/2023\/05\/AI_Test_Kitchen_house_music_in_chiptune_with_an_energetic_ba.mp3<\/a><\/audio><\/p>\n<p>On the plus side, MusicLM, on the whole, does a much better job than <a href=\"https:\/\/techcrunch.com\/2020\/04\/30\/openais-new-experiments-in-music-generation-create-an-uncanny-valley-elvis\/\" target=\"_blank\" rel=\"noopener\">Jukebox<\/a>, OpenAI\u2019s attempt several years ago at creating an AI music generator. In contrast to MusicLM, the songs Jukebox produced lacked typical musical elements like choruses that repeat and often contained<a href=\"https:\/\/developer.nvidia.com\/blog\/openais-jukebox-produces-music-with-lyrics-from-scratch\/\" target=\"_blank\" rel=\"noopener\">\u00a0nonsense lyrics<\/a>. MusicLM-produced songs contain fewer artifacts, as well, and generally feel like a step up where it concerns fidelity.<\/p>\n<p>The emergence of Dance Diffusion comes several years after OpenAI, the San Francisco-based lab behind\u00a0<a href=\"https:\/\/techcrunch.com\/2022\/07\/20\/openai-expands-access-to-dall-e-2-its-powerful-image-generating-ai-system\/\" target=\"_blank\" rel=\"noopener\">DALL-E 2<\/a>, detailed its grand experiment with music generation, dubbed\u00a0<a href=\"https:\/\/techcrunch.com\/2020\/04\/30\/openais-new-experiments-in-music-generation-create-an-uncanny-valley-elvis\/\" target=\"_blank\" rel=\"noopener\">Jukebox<\/a>. Given a genre, artist and a snippet of lyrics, Jukebox could generate relatively coherent music complete with vocals. But the songs Jukebox produced lacked larger musical structures like choruses that repeat and often contained<a href=\"https:\/\/developer.nvidia.com\/blog\/openais-jukebox-produces-music-with-lyrics-from-scratch\/\" target=\"_blank\" rel=\"noopener\">\u00a0nonsense lyrics<\/a>.<\/p>\n<p>MusicLM\u2019s usefulness is a bit limited besides, thanks to artificial limitations on the prompting side. It won\u2019t generate music featuring artists or vocals, not even in the <em>style<\/em> of particular musicians. Try typing a prompt like \u201calong the lines of Barry Manilow\u201d and you\u2019ll get nothing but an error message.<\/p>\n<div id=\"attachment_2542208\" style=\"width: 1034px\" class=\"wp-caption aligncenter\"><img aria-describedby=\"caption-attachment-2542208\" decoding=\"async\" loading=\"lazy\" class=\"size-full wp-image-2542208\" src=\"https:\/\/techcrunch.com\/wp-content\/uploads\/2023\/05\/Screenshot-2023-05-11-at-1.19.47-PM.png\" alt=\"MusicLM\" width=\"1024\" height=\"787\" srcset=\"https:\/\/techcrunch.com\/wp-content\/uploads\/2023\/05\/Screenshot-2023-05-11-at-1.19.47-PM.png 1890w, https:\/\/techcrunch.com\/wp-content\/uploads\/2023\/05\/Screenshot-2023-05-11-at-1.19.47-PM.png?resize=150,115 150w, https:\/\/techcrunch.com\/wp-content\/uploads\/2023\/05\/Screenshot-2023-05-11-at-1.19.47-PM.png?resize=300,230 300w, https:\/\/techcrunch.com\/wp-content\/uploads\/2023\/05\/Screenshot-2023-05-11-at-1.19.47-PM.png?resize=768,590 768w, https:\/\/techcrunch.com\/wp-content\/uploads\/2023\/05\/Screenshot-2023-05-11-at-1.19.47-PM.png?resize=680,522 680w, https:\/\/techcrunch.com\/wp-content\/uploads\/2023\/05\/Screenshot-2023-05-11-at-1.19.47-PM.png?resize=1536,1180 1536w, https:\/\/techcrunch.com\/wp-content\/uploads\/2023\/05\/Screenshot-2023-05-11-at-1.19.47-PM.png?resize=1200,922 1200w, https:\/\/techcrunch.com\/wp-content\/uploads\/2023\/05\/Screenshot-2023-05-11-at-1.19.47-PM.png?resize=50,38 50w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\"\/><\/p>\n<p id=\"caption-attachment-2542208\" class=\"wp-caption-text\"><strong>Image Credits:<\/strong> Google<\/p>\n<\/div>\n<p>The reason\u2019s likely legal. <a href=\"https:\/\/techcrunch.com\/tag\/deepfakes\/\" target=\"_blank\" rel=\"noopener\">Deepfaked<\/a> music stands on murky legal ground, after all, with some in the music industry arguing that AI music generators like MusicLM violate music copyright. It might not be long before there\u2019s some clarity on the matter \u2014<a href=\"https:\/\/techcrunch.com\/2023\/01\/27\/the-current-legal-cases-against-generative-ai-are-just-the-beginning\/\" target=\"_blank\" rel=\"noopener\">several lawsuits<\/a> making their way through the courts will likely have a bearing on music-generating AI, including one pertaining to the rights of artists whose work is used to train AI systems without their knowledge or consent. Time will tell.<\/p>\n<div class=\"container__access-control\">For now, though, I\u2019d argue that artists don\u2019t have much reason to worry. MusicLM, like the <a href=\"https:\/\/techcrunch.com\/2022\/10\/07\/ai-music-generator-dance-diffusion\/\" target=\"_blank\" rel=\"noopener\">other<\/a> AI music generators that\u2019ve been <a href=\"https:\/\/techcrunch.com\/2022\/12\/15\/try-riffusion-an-ai-model-that-composes-music-by-visualizing-it\/\" target=\"_blank\" rel=\"noopener\">released<\/a> recently, serves more than anything as an illustration of just how far the tech has to go.<\/div>\n<p><a href=\"https:\/\/techcrunch.com\/tag\/google-i-o-2023\/\" target=\"_blank\" rel=\"noopener\"><img decoding=\"async\" src=\"https:\/\/techcrunch.com\/wp-content\/uploads\/2023\/05\/google-io-2023-banner.jpg\" alt=\"Read more about Google I\/O 2023 on TechCrunch\"\/><\/a><\/p>\n<\/p><\/div>\n<p><br \/>\n<br \/><a href=\"https:\/\/techcrunch.com\/2023\/05\/11\/hands-on-with-googles-ai-powered-music-generator\/\" target=\"_blank\" rel=\"noopener\">Source link <\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Can AI work backward from a text description to generate a coherent song? That\u2019s the premise of MusicLM, the AI-powered music creation tool Google released yesterday during the kickoff of its I\/O conference. MusicLM, which was trained on hundreds of thousands of hours of audio to learn to create new music in a range of [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":17598,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[14],"tags":[],"class_list":{"0":"post-17597","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-tech"},"_links":{"self":[{"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/posts\/17597","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/comments?post=17597"}],"version-history":[{"count":0,"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/posts\/17597\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/media\/17598"}],"wp:attachment":[{"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/media?parent=17597"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/categories?post=17597"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/tags?post=17597"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}