We write and maintain tinygrad, the fastest growing neural network framework
It's extremely simple, and breaks down the most complex networks into 3 OpTypes
ElementwiseOps are UnaryOps, BinaryOps, and TernaryOps.But how...where are your CONVs and MATMULs? Read the code to solve this mystery.
Meet the new tinybox. Choose your memory, storage, and GPUs. Configure yours →
We sell a computer called the tinybox. It comes in red, green, pro, and soon, exa.
| red v2 | green v2 blackwell | exabox | |
| FP16 (FP32 acc) FLOPS | 778 TFLOPS | 3086 TFLOPS | ~1 EXAFLOP |
| GPU Model | 4x 9070XT | 4x RTX PRO 6000 Blackwell | 720x RDNA5 AT0 XL |
| GPU RAM | 64 GB | 384 GB | 25,920 GB |
| GPU RAM bandwidth | 2560 GB/s | 7168 GB/s | 1244 TB/s |
| GPU link bandwidth | full fabric PCIe 4.0 x16 | full fabric PCIe 5.0 x16 | full fabric 400 GbE |
| CPU | 32 core AMD EPYC | 32 core AMD GENOA | 120x 32 core AMD GENOA |
| System RAM | 128 GB | 192 GB | 23,040 GB |
| System RAM bandwidth | 204.8 GB/s | 460.8 GB/s | 55.2 TB/s |
| Disk size | 2 TB fast NVMe | 4 TB raid + 1 TB boot | 480 TB raid |
| Disk read bandwidth | 7.3 GB/s | 59.3 GB/s | 7.1 TB/s |
| Networking | 2x 1GbE + OCP3.0 | 2x 10GbE + OCP3.0 PCIe5 | 3.2 TB/s scale out |
| Noise | < 50 dB, 31 low speed fans | 65 db @ 10 meters | |
| Power Supply | one 1600W, 100V~240V | 2x 1600W, 100V~240V | 600 kW, 200V~240V |
| BMC | AST2500 | AST2600 | custom |
| Operating System | Ubuntu 24.04 | ||
| Dimensions | 12U, 16.25" deep, 60-90 lbs | 20x8x8.5 ft, 20,000 lbs | |
| Rack? | Freestanding or rack mount | concrete slab | |
| Driver Quality | Good | Great | functions as single GPU |
| SHIPPING | ORDER NOW | ORDER NOW | PREORDER FOR 2027 |