T241024

CPU

Number of Cores1024
Vector Processor - FP64/FP32/Integer4 x 512-bit per core
Frequency (GHz)6
Multiprocessor Scalability8S
PipelineOut-of-Order, 8 instructions per clock
L1 Cache Size128 KB ICache, 64 KB Dcache, both with ECC
L2 Cache Size1 MB with DECTED ECC
L2/L3 Cache Size1024 MB with DECTED ECC
Matrix Processor - TAI/FP44 x 2048-bit per core
Matrix Processor - FP83 x 2048-bit per core
Matrix Processor - BF16/TF322 x 2048-bit per core

Memory

Number of Memory Controllers24
Maximum Memory SpeedDDR5-17600
DIMMs per Channel1
Maxiumum Capacity (256 GB DIMMs)6 TB
Maximum Capacity (2 GB DIMMs)48 TB

I/O

PCIe 7.0 Lanes128
PCIe Controllers64
C2C Lanes (Hardware Coherency)Up to 48
C2C Bandwidth per Lane (Gb/sec)224

AI/ HPC

Data TypesFP64, FP32, TF32, BF16, Int8, FP8, FP4, TAI
Sparse Matrix SupportSparsity (2:4)

AI Performance

TAI (PF)400
FP4 (PF)200

HPC Performance

FP64 (TF)400

Package, Power, Thermal

Package120 mm x 150 mm FCLGA
Maximum TDP (W)1600
Tj85C
CoolingLiquid

Markets

Target Markets and ApplicationsTop-End HPC, Big AI