AMD showcased its latest products at its Advancing AI event including the new AMD Instinct MI300 series data center AI accelerators, ROCm 6 open software stack with new features supporting Large Language Models (LLMs), and Ryzen 8040 series mobile processors with Ryzen AI.
The company was joined by industry leaders including Microsoft, Meta, Oracle, Dell Technologies, HPE, Lenovo, Supermicro, and Cisco.
AMD Advancing AI Event
Advancing Data Center AI from the Cloud to Enterprise Data Centers and Super Computers
AMD was joined by multiple partners during the event to highlight the strong adoption and growing momentum of the AMD Instinct data center AI accelerators. Here are some of the highlights:
- Microsoft detailed how it is deploying Instinct MI300X accelerators to power the new Azure ND MI300x x5 Virtual Machine series optimized for AI workloads
- Meta shared that it is adding Instinct MI300X accelerators to its data centers in combination with ROCm 6 to power AI inferencing workloads and recognized the ROCm 6 optimizations
- Oracle unveiled plans to offer OCI bare metal compute solutions featuring Instinct MI300X accelerators and plans to include Instinct MI300X accelerators in their upcoming generative AI service
- The largest data center infrastructure providers announced plans to integrate Instinct MI300 accelerators across their product portfolios. This includes Dell’s PowerEdge XE9680 server, HPE’s enterprise and HPC offerings, Lenovo’s ThinkSystem platform, and Supermicro’s AI solutions portfolios, to name a few
- Specialized AI cloud providers like Aligned, Arkon Energy, Cirrscale, Crusoe, Denvr Dataworks, and Tensorwaves all plan to provide offerings that will expand access to Instinct MI300X GPUs for developers and AI startups.
Bringing an Open, Proven, and Ready AI Software Platform to Market
AMD highlighted significant progress in expanding the software ecosystem supporting Instinct data accelerators.
- The latest version of the open-source software stack for Instinct GPUs, ROCm 6 was unveiled and optimized for generative AI, specifically LLMs. ROCm 6 boasts support for new data types, advanced graph and kernel optimizations, optimized libraries, and state-of-the-art attention algorithms
- Databricks, Essential AI, and Lamini, three AI startups building emerging models and AI solutions joined AMD on stage to discuss how they’re leveraging Instinct MI300X accelerators and open ROCm 6 software stack to deliver differentiated AI solutions for enterprise customers.
- OpenAI is adding support for Instinct accelerators to Triton 3.0, for out-of-the-box support for AMD accelerators
Continued Leadership in Advancing AI PCs
With millions of AI PCs shipped to date, AMD announced new leadership mobile processors with the launch of the Ryzen 8040 series processors that deliver even more AI computing capability. The company also launched Ryzen AI 1.0 Software, a software stack that enables developers to easily deploy apps that use pre-trained models to add AI capabilities for Windows applications.
AMD also disclosed the upcoming next-gen Strix Point CPUs, planned to begin shipping in 2024 and will include XDNA 2 architecture to deliver more than a 3x increase in AI compute performance compared to previous generations
Microsoft also discussed how they are working closely with AMD on future AI experiences for Windows PCs.
To watch the full AMD Advancing AI keynote, click here. You can also stay up to date by visiting the official AMD X.
Ram found his love and appreciation for writing in 2015 having started in the gaming and esports sphere for GG Network. He would then transition to focus more on the world of tech which has also began his journey into learning more about this world. That said though, he still has the mentality of "as long as it works" for his personal gadgets.
