Meta announced a host of new AI-powered bots, features and products to be released across its messaging apps, the Meta Quest 3<\/a> and the future Ray-Ban Meta smart glasses. The new features \u2014 ranging from an AI assistant to image editing \u2014 harness the power of generative AI to make Meta\u2019s technology just that much more addictive.<\/p>\n Although, per Meta\u2019s wording, the new AI experiences and features \u201cgive you the tools to be more creative, expressive and productive.\u201d<\/p>\n The slew of AI-focused announcements came as part of Meta\u2019s annual Connect conference<\/a>, where the company announced its newest mixed reality headset and plans to release smart glasses<\/a> in partnership with Ray-Ban.<\/p>\n All of the AI tech is based on Llama 2<\/a>, Meta\u2019s new family of open access AI models released in July. The large language model is designed to generate text and code in response to prompts, and it\u2019s trained on a mix of publicly available data, according to Meta. The company noted that Llama 3 would be coming out in 2024.<\/p>\n Meta also announced at Connect its new image generator, Emu, which it will use to power things like AI stickers and image editing.<\/p>\n Let\u2019s dive into all of the new ways for Meta to use AI.<\/p>\n Meta\u2019s AI Assistant is powered by Llama 2 LLM. Featuring: Ahmad Al-Dahle, VP of GenAI.\u00a0Image Credits: <\/strong>Meta<\/p>\n<\/div>\n Meta\u2019s AI Assistant is designed to give you real-time information and generate photorealistic images from text prompts in just seconds. It can help plan a trip with friends in a group chat, answer general-knowledge questions and search the internet across Microsoft\u2019s Bing to provide real-time web results.<\/p>\n Using Llama 2, Meta said it created specialized datasets anchored in natural conversation so the AIs would respond in a conversational and friendly tone.<\/p>\n \u201cWith Meta AI, we saw an opportunity to take this capability and create an assistant that can do more than just write poems,\u201d said Ahmad Al-Dahle, VP of GenAI at Meta, on Wednesday. \u201cBehind Meta AI, we built an orchestrator. And it can seamlessly detect a user\u2019s intent from a prompt and route it to the right extension.\u201d<\/p>\n The first extension will be the web search, powered by Bing, to help with queries that require real-time information.<\/p>\n \u201cWhether you want to know the history of Eggs Benedict, or how to make it, or even where to get it in San Francisco, Meta AI can help ensure you have access to the most up-to-date information through the power of search,\u201d said Al-Dahle.<\/p>\n The AI Assistant will be available in beta in the U.S. on WhatsApp, Messenger and Instagram, and it\u2019s coming soon to Ray-Ban Meta smart glasses and the Quest 3 VR headset.<\/p>\n Each AI personality is based off a real celebrity or influencer. Image Credits:<\/strong>\u00a0Meta<\/p>\n<\/div>\n Meta dropped 28 AI personality characters<\/a> that are based on famous people, but built entirely from AI, from across the worlds of sports, music, social media and more. You can think of them as topic-specific chatbots who you can message on WhatsApp, Messenger and Instagram. Each personality is based on a celebrity or influencer. For example:<\/p>\n Meta\u2019s AIs were built on the Llama 2 LLM. Most of their knowledge bases are limited to information that largely existed before 2023, but Meta says it hopes to bring its Bing search function to its AIs in the coming months.<\/p>\n The characters won\u2019t just respond via text \u2014 they will also be able to talk next year. But for now there is no audio. Any video element you see today and in the future is based on AI-generated animations. Meta filmed the people representing the different AIs and then used \u201cgenerative techniques\u201d to turn those disparate animations into a cohesive experience.<\/p>\n Meta would not clarify to TechCrunch how it compensated the celebrities for use of their likenesses.<\/p>\n Meta\u2019s AI studio is available for businesses and creators. Featuring: Angela Fan, research scientist. Image Credits:<\/strong> Meta<\/p>\n<\/div>\n Meta\u2019s AI Studio platform<\/a> will let businesses build AI chatbots for the company\u2019s various messaging services, including Facebook, Instagram and Messenger.<\/p>\n Starting with Messenger, AI Studio will allow companies to \u201ccreate AIs that reflect their brand\u2019s values and improve customer service experiences,\u201d Meta writes in a\u00a0post<\/a>. Onstage, Meta CEO Mark Zuckerberg clarified that the use cases Meta envisions are primarily e-commerce and customer support.<\/p>\n AI Studio will be available in alpha to start, and Meta says that it\u2019ll scale the toolkit further beginning next year.<\/p>\n In the future, creators will be able to tap the AI Studio, as well, to build AIs that \u201cextend their virtual presence\u201d across Meta\u2019s apps. Meta noted that these would have to be sanctioned by the creator and controlled directly by them.<\/p>\n In the coming year, Meta will build a sandbox so that anyone can experiment with creating their own AI, something that Meta will bring to the metaverse.<\/p>\n Image Credits:<\/strong> Meta<\/p>\n<\/div>\n CEO Mark Zuckerberg announced that generative AI stickers<\/a> would be coming to Meta\u2019s messaging apps. The feature, which is powered by its new foundational model for image generation,\u00a0Emu<\/a>, will allow users to create unique AI stickers in a matter of seconds across Meta apps including WhatsApp, Messenger, Instagram and even Facebook Stories.<\/p>\n \u201cEvery day people send hundreds of millions of stickers to express things in chats,\u201d said Zuckerberg. \u201cAnd every chat is a little bit different and you want to express subtly different emotions. But today we only have a fixed number \u2014 but with Emu now you have the ability to just type in what you want,\u201d he said.<\/p>\n To use the stickers, you could type into a text box with exactly what sort of images you want to see. The feature was demoed in WhatsApp, where Zuckerberg showed off crazy ideas like \u201cHungarian sheep dog driving a 4\u00d74,\u201d for example. Meta says it takes three seconds on average to generate multiple options to share instantly.<\/p>\n The feature will initially be available to English-language users and will begin to roll out over the next month, the company says.<\/p>\n Image Credits:<\/strong> Meta<\/p>\n<\/div>\n Meta says that soon, you\u2019ll be able to transform your images or co-create AI-generated images with friends. These two new features \u2014 restyle and backdrop \u2014 are coming soon to Instagram in the U.S., also powered by the technology from Emu.<\/p>\n Restyle lets you reimagine the visual styles of an image \u2014 Zuckerberg demoed edits on a photo of his dog, Beast, where he used AI to turn it into origami and cross-stitch styles \u2014 by typing in prompts like \u201cwatercolor\u201d or even a more detailed prompt such as \u201ccollage from magazines and newspapers, torn edges,\u201d Meta explained in a blog post<\/a>.<\/p>\n Backdrop, meanwhile, changes the scene or background of your image by using prompts.<\/p>\n Meta says the AI images will indicate the use of AI \u201cto reduce the chances of people mistaking them for human-generated content.\u201d The company said it\u2019s also experimenting with forms of visible and invisible markers.<\/p>\n \u201cIf you spent any time playing with conversational AI, as you probably know, they have the potential to say things that are inaccurate or even inappropriate. And that can happen with ours, too,\u201d said Al-Dahle.<\/p>\n Al-Dahle described onstage the \u201cthousands of hours\u201d of red-teaming and working with prompts to train its AI assistant and characters to steer clear of iffy topics. Red-teaming is an iterative process where you try to get the model to say harmful things, apply fixes and repeat. Continuously.<\/p>\n Meta says it is also releasing system cards alongside its AIs so people can understand \u201cwhat\u2019s inside and how they were built.\u201d<\/p>\nAI Assistant, backed by Bing<\/h2>\n
AI personality chatbots based on celebrities<\/h2>\n
![\"\"](\"https:\/\/techcrunch.com\/wp-content\/uploads\/2023\/09\/Screen-Shot-2023-09-28-at-11.47.24-am.png\")
<\/p>\n\n
AI Stu<\/strong>dio for businesses and creators<\/strong><\/h2>\n
![\"\"](\"https:\/\/techcrunch.com\/wp-content\/uploads\/2023\/09\/Screenshot-2023-09-27-at-3.02.20-PM.jpg\")
<\/p>\nAI stickers, powered by Emu<\/h2>\n
![\"\"](\"https:\/\/techcrunch.com\/wp-content\/uploads\/2023\/09\/Screenshot-2023-09-27-at-2.00.13-PM.jpg\")
<\/p>\nAI image editing \u2014 restyle photos, add a backdrop<\/h2>\n
![\"\"](\"https:\/\/techcrunch.com\/wp-content\/uploads\/2023\/09\/Restyle_Inline-2.gif\")
<\/p>\nA word on safety<\/h2>\n
![\"Read](\"https:\/\/techcrunch.com\/wp-content\/uploads\/2023\/09\/meta-connect-2023-banner.png\")
<\/a><\/p>\n<\/p><\/div>\n