\n<\/p>\n
Ever wonder how much electricity you\u2019re using when you prompt, or thank, an AI model? Hugging Face engineer Julien Delavande did, so he built a tool<\/a> to help arrive at the answer.<\/p>\n AI models consume energy each time they\u2019re run. They\u2019re run on GPUs and specialized chips that need a lot of power to carry out the associated computational workloads at scale. It\u2019s not easy to pin down model power consumption, but it\u2019s widely<\/a> expected<\/a> that growing usage of AI technologies will drive electricity needs to new heights in the next couple of years.<\/p>\n The demand for more power to fuel AI has led some companies to pursue environmentally unfriendly<\/a> strategies. Tools like Delavande\u2019s aim to bring attention to this, and perhaps give some AI users pause. <\/p>\n \u201cEven small energy savings can scale up across millions of queries \u2014 model choice or output length can lead to major environmental impact,\u201d Delavande and the tool\u2019s other creators wrote in a statement<\/a>. <\/p>\n \u26a1\ufe0f Ever wondered how much energy is used every time you send a message to ChatGPT? <\/p>\n We just built a version of Chat UI that shows how much energy your message consumes \u2014 in real time. Should all chatbots display this?<\/p>\n Details below \ud83d\udc47\ud83d\udc47 pic.twitter.com\/tBL0Pw51PW<\/a><\/p>\n\n