AMD has unveiled the latest version of its AI software, Ryzen AI Software 1.2, designed to provide developers and Independent Software Vendors (ISVs) with a comprehensive environment for building AI-enhanced applications. This release aims to maximize the performance benefits of the Ryzen AI APU hardware architecture, which includes the CPU, integrated GPU (iGPU), and Neural Processing Unit (NPU), according to AMD.com.

New Hardware Support

The Ryzen AI Software 1.2 update introduces support for new hardware, particularly enhancing NPU and iGPU integration:

• Enhanced NPU Support: The update supports Strix Point NPUs, offering impressive performance metrics:
• Ryzen AI 9 365 and Ryzen AI 9 HX 370: Up to 50 TOPS
• Ryzen AI 9 HX 375: Up to 55 TOPS
• Improved iGPU Integration: Developers can now switch seamlessly between iGPUs and NPUs based on model requirements without needing to reinstall the software.

Expanded Model Support

Ryzen AI Software 1.2 extends its model support within PyTorch and ONNX frameworks, allowing for both general-purpose and performance-optimized applications:

• LLM Flow Support: Includes support for additional models for experimental and production purposes.
• General-purpose unoptimized LLMs for prototyping, applicable to AMD Ryzen 7040 Series, Ryzen 8040 Series, and Ryzen AI 300 Series.
• Performance-optimized LLMs for benchmarking and deployment, available for AMD Ryzen AI 300 Series.

New and Improved Developer Tools

The update also introduces several new tools aimed at improving ease of use and optimizing performance:

• AI Analyzer: A tool for analyzing and visualizing model compilation and inference profiling.
• Platform/NPU Inspection and Management: The xrt-smi tool integrates features for examining AI PC and NPU states, validating NPUs, and configuring performance levels.
• Dynamic Power Management (DPM) Integration: Allows developers to adjust the Power Slider in Windows to different power profiles during NPU inference.
• ONNX Benchmarking Tool: Facilitates performance assessment and optimization of ONNX-based workflows.
• Smart Installer: Simplifies the Ryzen AI software setup with a single-click installation of the NPU driver.

These updates are part of AMD’s commitment to providing cutting-edge tools and enhancements for AI development on AI PCs. The latest software release emphasizes ease of use, streamlined workflows, open frameworks support, and resources designed to advance AI capabilities.

For a comprehensive overview of the new features and improvements in the Ryzen AI Software 1.2 release, refer to AMD’s official release notes.

Image source: Shutterstock