CPU
| Number of Cores | 768 |
| Vector Processor - FP64/FP32/Integer | 4 x 512-bit per core |
| Frequency (GHz) | 5 |
| Multiprocessor Scalability | 8S |
| Pipeline | Out-of-Order, 8 instructions per clock |
| L1 Cache Size | 128 KB ICache, 64 KB Dcache, both with ECC |
| L2 Cache Size | 1 MB with DECTED ECC |
| L2/L3 Cache Size | 768 MB with DECTED ECC |
| Matrix Processor - TAI/FP4 | 4 x 2048-bit per core |
| Matrix Processor - FP8 | 3 x 2048-bit per core |
| Matrix Processor - BF16/TF32 | 2 x 2048-bit per core |
Memory
| Number of Memory Controllers | 24 |
| Maximum Memory Speed | DDR5-17600 |
| DIMMs per Channel | 1 |
| Maxiumum Capacity (256 GB DIMMs) | 6 TB |
| Maximum Capacity (2 GB DIMMs) | 48 TB |
I/O
| PCIe 7.0 Lanes | 128 |
| PCIe Controllers | 64 |
| C2C Lanes (Hardware Coherency) | Up to 48 |
| C2C Bandwidth per Lane (Gb/sec) | 224 |
AI/ HPC
| Data Types | FP64, FP32, TF32, BF16, Int8, FP8, FP4, TAI |
| Sparse Matrix Support | Sparsity (2:4) |
AI Performance
| TAI (PF) | 250 |
| FP4 (PF) | 125 |
HPC Performance
| FP64 (TF) | 250 |
Package, Power, Thermal
| Package | 120 mm x 150 mm FCLGA |
| Maximum TDP (W) | 1000 |
| Tj | 85C |
| Cooling | Liquid |
Markets
| Target Markets and Applications | Entry HPC, Big AI, Crypto, Digital Currency |