\n<\/p>\n
Uptime Industries is taking a bet on on-premise AI infrastructure with an \u201cAI-in-a-box\u201d handheld device called Lemony AI.<\/p>\n
The size of a sandwich, Lemony AI<\/a> can supposedly run a large language model (LLM), AI agents and AI workflows all on one node. Each Lemony requires only 65 watts of power to run, the equivalent of charging a laptop, and can be stacked and connected to form bigger AI clusters.<\/p>\n Sascha Buehrle, co-founder and CEO of Uptime, told TechCrunch that each node can sustain an LLM up to 75 billion parameters in size, and can host open-source models or retrofitted versions of closed models. In a cluster of Lemony nodes, each device can run a different model.<\/p>\n Uptime is launching with partnerships with IBM and JetBrains to provide its customers easier access to AI models, including IBM\u2019s closed models.<\/p>\n Like most tech startups, the idea for Lemony AI stemmed from a side project: Uptime\u2019s co-founders, Buehrle and Ivan Kuleshov, were trying to figure out if they could distribute language models on Raspberry Pi\u2019s micro computers<\/a>, and while this wasn\u2019t originally related to generative AI, when it worked, they started trying to see what else these Raspberry Pis could handle.<\/p>\n When they realized running models on local devices could prove the key to unlock more AI adoption by organizations \u2014 say, enterprises that don\u2019t want to use cloud-based models \u2014 they started building a device of their own. They figured going small with an emphasis on data privacy could get companies to adopt AI quicker.<\/p>\n \u201cWe need to build something small which can go easily into the teams, and which [does] not require any organization-wide decision making \u2014 bringing on-premise generative AI solutions into the business teams, basically,\u201d Buehrle said. Clusters of small and powerful devices can help the system grow according to a customer\u2019s needs, he added.<\/p>\n The company says it has already seen strong demand from business in heavily-regulated industries like finance, healthcare and law.<\/p>\n \u201cEverything stays in your box,\u201d Buehrle said. \u201cSo your documents, your files, your emails \u2014 the models are hosted in the box, the agents are running locally in the box, and nothing is leaving the box.\u201d<\/p>\n Uptime has so far raised $2 million in a seed funding round led by True Ventures, with participation from Alumni Ventures, JetBrains, and some angel investors. The company will use the funds to further develop its devices.<\/p>\n The startup says the plan now is to get the software it has developed for its micro AI computers, Lemony OS, to work on other companies\u2019 hardware, like the Nvidia DGX Spark<\/a>. It also wants to expand the software from its current, single-user focus to one that can be used by teams.<\/p>\n Lemony AI costs $499 a month to use, and can be accessed by up to five users.<\/p>\n<\/div>\n