Unity is joining the rest of the gang in providing generative AI tools for its users, but has been careful (unlike some) to ensure those tools are built on a solidly non-theft-based foundation. Muse, the new suite of AI-powered tools, will start with texture and sprite generation, and graduate to animation and coding as it matures.<\/p>\n
The company announced these features alongside a cloud-based platform and the next big version of its engine, Unity 6, at its Unite conference in San Francisco. After a tumultuous couple months \u2014 a major product plan was totally reversed<\/a> and the CEO ousted<\/a> \u2014 they\u2019re probably eager to get back to business as usual, if that\u2019s even possible.<\/p>\n Unity has previously positioned itself as the champion of smaller developers who lack the resources to employ a more wide-ranging development platform like rival Unreal. As such the use of AI tools could be seen as a helpful addition to devs who can\u2019t, for instance, afford to spend days making 32 slightly varying wood wall textures in high definition.<\/p>\n Although plenty of tools exist to help generate or mutate such assets, being able to say \u201cmake more like this\u201d without leaving your main development environment is frequently preferable. The simpler the workflow, the more one can do without worrying about details like formatting and siloed resources.<\/p>\n AI assets are often used in prototyping as well, where things like artifacts and slightly janky quality \u2014 generally present no matter the model these days \u2014 aren\u2019t of any real importance. But having your gameplay concept illustrated with original, appropriate art rather than stock sprites or free sample 3D models might make the difference in getting one\u2019s vision across to publishers or investors.<\/p>\n Examples of sprites and textures generated by Unity\u2019s Muse.<\/p>\n<\/div>\n Another new AI feature, Sentis, is a little harder to understand \u2014 Unity\u2019s press release says it \u201cenables developers to bring complex AI data models into the Unity Runtime to create new gameplay experiences and features.\u201d So it\u2019s a BYO model kind of thing, with some built in functionality, and is currently in open beta.<\/p>\n AI for animation and behaviors is on the way, to be added next year. These highly specialized scripting and design processes could benefit greatly from a generative first draft or multiplicative helper.<\/p>\n \u00a0<\/p>\n Image Credits:<\/strong> Unity<\/p>\n<\/div>\n A big part of this release, Unity\u2019s team emphasized, was making sure these tools didn\u2019t live in the shadow of IP infringement cases to come. As fun as image generators like Stable Diffusion are to play with, they\u2019re built using assets of artists who never consented to have their work ingested and regurgitated.<\/p>\n \u201cIn order to provide useful outputs that are safe, responsible, and respectful of other creators\u2019 copyright, we challenged ourselves to innovate in our training techniques for the AI models that power Muse\u2019s sprite and texture generation,\u201d reads a blog post on responsible AI techniques accompanying the announcement.<\/p>\n The company said that it used a completely custom model trained on Unity-owned or licensed imagery. Though they did use Stable Diffusion to, essentially, generate a larger synthetic dataset from the smaller curated one they had assembled.<\/p>\n Image Credits:<\/strong> Unity<\/p>\n<\/div>\n For example, this wood wall texture might be rendered in several variations and color types using the Stable Diffusion model, but no new content is added, or at least that is how they described it as working. As a result, however, the new dataset is not just based on responsibly-sourced data, but is one step removed from it, reducing the likelihood that a particular artist or style is replicated.<\/p>\n This approach is safer, but Unity admitted it did lower quality in the initial models it is making available. As noted above, however, the actual quality of generated assets is not always of high importance.<\/p>\n Unity Muse will cost $30 per month as a standalone offering. We\u2019ll soon hear from the community, no doubt, on whether the product justifies its price.<\/p>\n<\/p><\/div>\n![\"\"](\"https:\/\/techcrunch.com\/wp-content\/uploads\/2023\/11\/unity-animgeneration.gif\")
<\/p>\n![\"\"](\"https:\/\/techcrunch.com\/wp-content\/uploads\/2023\/11\/wood-variations.jpg?w=680\")
<\/p>\n