Tiiny AI Pocket Lab, Verified by Guinness World Records, Runs Models of Up to 120 Billion Parameters Offline, Consumes 65 W, Eliminates Dependence on Cloud and GPUs and Promises to Bring Data Center Power to Individual Users
A deep-tech startup from the United States has introduced the Tiiny AI Pocket Lab, verified by Guinness World Records as the world’s smallest personal supercomputer, capable of running language models with up to 120 billion parameters locally, without cloud, servers, or GPUs, launching on December 10.
The device, which resembles a power bank and fits in your pocket, was developed to run advanced artificial intelligence models directly on local hardware, eliminating the need for internet connectivity or data center infrastructure.
According to Tiiny AI, the goal is to reduce dependence on cloud-based supercomputers and GPUs while expanding access to data center-level computing capability for everyday users.
-
A 400-meter colossus powered by natural gas has just set sail from Shanghai to Europe, carrying over 24,000 containers. It is the world’s largest dual-fuel container ship and can cross the planet without refueling even once.
-
A new study overturns the central idea we learned about planets and suggests that Earth is the exception rather than the rule; most rocky worlds in the galaxy may not have a core or mantle, just a single turbulent fluid extending to the center.
-
Scientists reanimated a 48,500-year-old virus in the laboratory that had been frozen in the Siberian permafrost since before the extinction of the Neanderthals, and it was still capable of infecting living organisms after tens of millennia dormant in the ice.
-
The oldest nuclear aircraft carrier still in operation in the world is currently on Brazilian soil making its final journey before retirement, and two American military planes landed in Salvador and Fortaleza to support the mission.
The Pocket Lab is also presented as an alternative amid growing concerns over sustainability, high energy costs, and privacy risks associated with the use of cloud-based AI infrastructures.
“Cloud AI has brought remarkable advancements, but it has also created dependence, vulnerability, and sustainability challenges,” said Samar Bhoj, GTM Director of Tiiny AI, according to the company’s official statement.
According to Bhoj, the Pocket Lab’s proposal is to shift the power of artificial intelligence from data centers to individual devices, making the use of advanced models more accessible, private, and personal.
Applications and Personal Use of AI
The Tiiny AI Pocket Lab was designed to address virtually all personal use cases of artificial intelligence, focusing on content creators, developers, researchers, and students.
The equipment allows for multi-step reasoning, deep context understanding, agent execution, content generation, and secure processing of sensitive information without an internet connection.
All user data, including documents, preferences, and histories, are stored locally with bank-level encryption, ensuring long-term memory and enhanced privacy protection.
The system architecture was designed to operate models between 10B and 100B parameters, a range that covers over 80% of real-world tasks, according to the company.
The device can also scale to models of up to 120B parameters, offering GPT-4 level intelligence for complex reasoning and multi-step analysis, keeping all data offline and secure on the device.
Technical Specifications and Efficiency
The Pocket Lab is equipped with a 12-core ARMv9.2 processor and has a power capacity of 65 W, delivering performance of large models with a fraction of the energy consumption of GPU-based systems.
According to Tiiny AI, the performance is enabled by two core technologies. The first is TurboSparse, which activates only the necessary neurons during model execution, without loss of intelligence.
The second technology is Powerinfer, an open-source mechanism with over 8,000 stars on GitHub, which distributes workloads between CPU and NPU, enhancing performance while reducing energy consumption.
The combination of these solutions allows the Pocket Lab to achieve GPU-level performance in a compact, low-consumption format, also reducing the carbon footprint compared to traditional systems.
Open Source Ecosystem and Next Steps
In addition to the hardware, Tiiny AI offers a ready-to-use open source ecosystem, with one-click installation of models like Llama, Qwen, DeepSeek, Mistral, Phi, and GPT-OSS.
The device also facilitates the setup of AI agents such as OpenManus, ComfyUI, Flowise, and SillyTavern, broadening usage possibilities in various workflows.
The company stated that users will receive regular updates, including official hardware upgrades via over-the-air, with the presentation of these features expected at CES in January 2026, marking the next phase of the project.

-
-
-
-
-
-
42 people reacted to this.