IT Creations Partners

AMD Instinct MI300X - System Overview

Additional Information

AMD Instinct MI300X

The AMD MI300X utilizes AMD Infinity Fabric Link technology which improves I/O connectivity delivering a bi-directional memory bandwidth of 128GB/s between each of the installed GPUs. Designed on CDNA 3.0 architecture, this card is a powerful server GPU accelerator with 192 GB of HBM3 memory. It has a 8192-bit memory interface with a peak memory bandwidth of 5.3 TB/s. This card houses 19456x Stream Processors, 304x Compute Units, and 1216x Matrix Cores. Peak half precision (FP16) performance comes in at 1.3 PFLOPs, peak single precision (FP32) performance comes in at 163.4 TFLOPs, and peak double precision performance comes in at 81.7 TFLOPs.

AMD Instinct MI300X

Designed with a passive cooling solution, it features an internally shared 256MB AMD Infinity Cache between compute units. On an industry-standard-based universal baseboard (UBB 2.0) platform with 8-node configuration, it offers a bi-directional Infinity Fabric bandwidth of 896GB/s. individually, each card holds 8x Infinity Fabric Links which have peak speeds of 128 GB/s. The theoretical speed would be 1 TB/s. The thermal design point (TDP) of this card is 750W with a recommended system PSU with a rating of 1150W.

Check Availability

AMD Instinct MI300X - Specifications

Memory
    GPU Memory: 192GB HBM2e
  • Error-correcting code (ECC)
  • Memory Interface: 8192-bit
  • Memory Bandwidth: Up to 5.3TB/s
  • Memory Clock: 5.2GHz
Architecture
  • GPU Architecture: CDNA3
  • Stream Processors: 19456
  • Matrix Cores: 1216
  • Compute Units: 304
  • Base Engine Clock: 1000 MHz
  • Peak Engine Clock: 2100 MHz
  • Infinity Fabric Links: 8
  • Peak Infinity Fabric Link Bandwidth: 128GB/s
Performance
  • Half Precision (FP16) Performance: 1.3 PFLOPs
  • Single Precision (FP32) Performance: 163.4 TFLOPs
  • Double Precision (FP64) Performance: 81.7 TFLOPs
System Interface
  • PCIe 5.0 x16
Power Consumption
  • Thermal Design Point: 750W
  • Minimum PSU Recommendation: 1150W
  • Thermal Solution: Passive
Form Factor
  • OAM Module
Supported Techologies
  • AMD CDNA 3 Architecture
  • AMD ROCm - Ecosystem without Borders
  • AMD Infinity Architecture
Software APIs
  • OpenCL 3.0

Check Availability

Get a quote for AMD Instinct MI300X

If you know what you want but can't find the exact configuration you're looking for, have one of our knowledgeable sales staff contact you. Give us a list of the components you would like to incorporate into the system, and the quantities, if more than one. We will get back to you immediately with an official quote.

[email protected]

AMD Instinct MI300X - Documentation

Check Availability