T464

    CPU

    Number of Cores64
    Vector Processor - FP64/FP32/Integer4 x 512-bit per core
    Frequency (GHz)4
    Multiprocessor Scalability1S
    PipelineOut-of-Order, 8 instructions per clock
    L1 Cache Size128 KB ICache, 64 KB Dcache, both with ECC
    L2 Cache Size1 MB with DECTED ECC
    L2/L3 Cache Size64 MB with DECTED ECC
    Matrix Processor - TAI/FP44 x 2048-bit per core
    Matrix Processor - FP83 x 2048-bit per core
    Matrix Processor - BF16/TF322 x 2048-bit per core

    Memory

    Number of Memory Controllers4
    Maximum Memory SpeedDDR5-6400
    DIMMs per Channel2
    Maxiumum Capacity (256 GB DIMMs)2 TB
    Maximum Capacity (2 GB DIMMs)16 TB

    I/O

    PCIe 7.0 Lanes48
    PCIe Controllers24
    C2C Lanes (Hardware Coherency)N/A
    C2C Bandwidth per Lane (Gb/sec)N/A

    AI/ HPC

    Data TypesFP64, FP32, TF32, BF16, Int8, FP8, FP4, TAI
    Sparse Matrix SupportSparsity (2:4)

    AI Performance

    TAI (PF)17
    FP4 (PF)8

    HPC Performance

    FP64 (TF)17

    Package, Power, Thermal

    Package120 mm x 63 mm FCLGA
    Maximum TDP (W)70
    Tj85C
    CoolingAir

    Markets

    Target Markets and ApplicationsEntry Cloud, Storage