T16120-HS

CPU

Number of Cores120
Frequency (GHz)5.7
Multiprocessor Scalability2-socket
PipelineOut-of-Order, 8 instructions per clock
L1 Cache Size64 KB ICache, Dcache, both with ECC
L2/L3 Cache Size120 MB with DECTED ECC
Vector Processor2 x 1024-bit per core
Matrix Processor2 x 1024-bit per core

Memory

DIMMs per Channel2
Maximum Capacity (256 GB DIMMs)4 TB
Maximum Capacity (2 TB DIMMs)32 TB
Number of Memory Controllers16
Maximum Memory SpeedDDR5-7200

I/O

PCIe 5.0 LanesUp to 128
PCIe Controllers64
C2C Lanes (Hardware Coherency)16 (2-socket)
C2C Bandwidth per Lane (Gb/sec)112

AI/ HPC

Data TypesFP64, FP32, FP64 (tensor), TF32, BF16, Int8, FP8, FP4, TAI
Sparse Matrix SupportSparsity (8:4)

Maximum HPC Performance

FP64 (TF)42

Maximum AI Performance

FP4 (PF)21
TAI (PF)42

Package, Power, Thermal

Package64mm x 83mm FCLGA
Maximum TDP (W)480
Tj85C
CoolingAir

Markets

Target Markets and ApplicationsCloud, Databases, Edge/Telco