CPU
| Number of Cores | 448 |
| Vector Processor - FP64/FP32/Integer | 4 x 512-bit per core |
| Frequency (GHz) | 5.5 |
| Multiprocessor Scalability | 16S |
| Pipeline | Out-of-Order, 8 instructions per clock |
| L1 Cache Size | 128 KB ICache, 64 KB Dcache, both with ECC |
| L2 Cache Size | 1 MB with DECTED ECC |
| L2/L3 Cache Size | 448 MB with DECTED ECC |
| Matrix Processor - TAI/FP4 | 4 x 2048-bit per core |
| Matrix Processor - FP8 | 3 x 2048-bit per core |
| Matrix Processor - BF16/TF32 | 2 x 2048-bit per core |
Memory
| Number of Memory Controllers | 16 |
| Maximum Memory Speed | DDR5-12800 |
| DIMMs per Channel | 2 |
| Maxiumum Capacity (256 GB DIMMs) | 8 TB |
| Maximum Capacity (2 GB DIMMs) | 64 TB |
I/O
| PCIe 7.0 Lanes | 128 |
| PCIe Controllers | 64 |
| C2C Lanes (Hardware Coherency) | Up to 24 |
| C2C Bandwidth per Lane (Gb/sec) | 224 |
AI/ HPC
| Data Types | FP64, FP32, TF32, BF16, Int8, FP8, FP4, TAI |
| Sparse Matrix Support | Sparsity (2:4) |
AI Performance
| TAI (PF) | 160 |
| FP4 (PF) | 80 |
HPC Performance
| FP64 (TF) | 160 |
Package, Power, Thermal
| Package | 120 mm x 63 mm FCLGA |
| Maximum TDP (W) | 645 |
| Tj | 85C |
| Cooling | Liquid, Air |
Markets
| Target Markets and Applications | Analytics, Big Data, In-Memory Databases |