IT Creations Partners

AMD Instinct MI300A APU - System Overview

AMD Instinct MI300A APU front

Designed for next-generation supercomputers, the AMD Instinct MI300A APU is designed for applications in enterprise data centers to tackle the most profound computing quandaries. With 128GB of HBM3 memory it delivers and astounding 5.3TB of memory bandwidth at peak theoretical performance, with a memory interface of 8192 bits and a memory clock of 5.2TB. Scale out bandwidths supported include 400 Gb/s Ethernet or InfiniBand.



With air and liquid cooling a maximum thermal design power rating of 550W is recommended. All liquid cooling will increase the maximum TDP limit allowed to 760W. this APU is optimized AI applications delivering highly efficient data gathering delivering peak performance for FP64, FP32, FP16, BF16, TF32, FP8, and INT8 data types. It uses a chiplet technology to stack a multi-chip architecture enabling dense compute and high-bandwidth memory integration. In a multi-APU configuration, each APU can provide 1TB/s of bidirectional connectivity using 8x 128GB/s AMD Infinity Fabric interfaces. 4x Infinity Fabrics are dedicated, while 4x others can supplement the Infinity Fabric connection or be assigned to deliver PCIe 5.0 connectivity.

Check Availability

AMD Instinct MI300A APU - Specifications

Memory
    GPU Memory: 128GB HBM3 ECC
  • Memory Interface: 8192-bit
  • Memory Bandwidth: Up to 5.3TB/s
Stream Processors
  • 14,592 (228 Compute Units)
Transistor Count
  • 146 billion
Performance
  • FP16 (Half Precision): 980.6 TFLOPS
  • FP32 (Single Precision): 122.6 TFLOPS
System Interface
  • PCI Express Support: 5.0 Ready x16
Power Consumption
    Max Power Consumption
  • Air & Liquid Cooling: 550W
  • Liquid Cooling: 760W
Form Factor
  • APU SH5 socket
Infinity Fabric Link
  • Links: 8
  • Peak Infinity Fabric Link Bandwidth: 128GB/s
Display Connectors
  • None
Engine
    Error Correcting Code (ECC) Support

  • Yes
  • RAS Support

  • Yes
  • Page Retirement

  • Yes
  • Page Avoidance

  • Yes
  • SR-IOV

  • Yes
  • Supported Technologies

  • AMD Infinity Architecture
  • AMD CDNA3 Architecture
  • AMD ROCm- Ecosystem without Borders

Check Availability

Get a quote for AMD Instinct MI300A APU

If you know what you want but can't find the exact configuration you're looking for, have one of our knowledgeable sales staff contact you. Give us a list of the components you would like to incorporate into the system, and the quantities, if more than one. We will get back to you immediately with an official quote.

[email protected]

AMD Instinct MI300A APU - Documentation

Check Availability