Product Launchllmedge aitiiny aidnpu
Tiiny AI Debuts Pocket Lab Supercomputer
7.0
Tiiny AI unveils the Pocket Lab, a 14.2×8×2.53 cm, ~300 g device it calls the world's smallest AI supercomputer, claiming on-device support for 120-billion-parameter LLMs. It pairs a custom SoC with a dNPU delivering ~190 TOPS, 80 GB LPDDR5X and 1 TB SSD, uses TurboSparse and PowerInfer, supports models like Llama and Mistral, and will be showcased at CES 2026.
Key Points
- 1Claims run 120B-parameter LLMs fully on-device using 80GB RAM and 190 TOPS dNPU
- 2Uses TurboSparse and PowerInfer to improve inference efficiency and distribute workloads across CPU/NPU
- 3Enables local deployment of large open-source models for experimentation without cloud dependence
Scoring Rationale
Notable hardware innovation with claimed 120B on-device performance, limited by single-vendor claims and pending independent verification.
Sources
Public references used for this report.
Practice with real Logistics & Shipping data
90 SQL & Python problems · 15 industry datasets
Used by DS/ML engineers at top companies
High-Value Overnight OrdersEasyDelivered International ShipmentsMediumOn-Time Delivery Rate by CarrierHard
250 free problems · No credit card
See all Logistics & Shipping problems
