diff --git a/.wordlist.txt b/.wordlist.txt index 9cc0de18..27a2df95 100644 --- a/.wordlist.txt +++ b/.wordlist.txt @@ -69,3 +69,4 @@ gsplat Gaussians rasterization DGS +DeepSeek diff --git a/docs/core/index.md b/docs/core/index.md deleted file mode 100644 index d7d4c07b..00000000 --- a/docs/core/index.md +++ /dev/null @@ -1 +0,0 @@ -# Core reference material diff --git a/docs/images/mi3xx-reference.png b/docs/images/mi3xx-reference.png new file mode 100644 index 00000000..c3076309 Binary files /dev/null and b/docs/images/mi3xx-reference.png differ diff --git a/docs/index.md b/docs/index.md index 89bd4a27..97efae3d 100644 --- a/docs/index.md +++ b/docs/index.md @@ -465,71 +465,6 @@ The AMD Instinct Documentation site provides comprehensive guides and technical

Install and configure the GPU. Learn about logging including error codes.

::: -:::{grid-item-card} -:padding: 1 -:img-top: ./images/System-Administrators-Bare-Metal-AMD-GPU-Partitioning.jpg -:class-img-top: small-sd-card-img-top -:class-body: small-sd-card -:class: small-sd-card -+++ - -

GPU Partitioning

-
-

Learn how to split the compute units and memory to partition a GPU.

-::: - -:::{grid-item-card} -:padding: 1 -:img-top: ./images/System-Administrators-Bare-Metal-AMD-AMD-SMI.jpg -:class-img-top: small-sd-card-img-top -:class-body: small-sd-card -:class: small-sd-card -+++ - -

AMD SMI

-
-

The AMD System Management Interface (AMD SMI) library offers a unified tool for managing and monitoring GPUs, particularly in high-performance computing environments. It provides a user-space interface that allows applications to control GPU operations, monitor performance, and retrieve information about the system’s drivers and GPUs.

-::: - -:::{grid-item-card} -:padding: 1 -:img-top: ./images/System-Administrators-Bare-Metal-AMD-Tools.jpg -:class-img-top: small-sd-card-img-top -:class-body: small-sd-card -:class: small-sd-card -+++ - -

ROCmValidationSuite

-
-

System validation and diagnosis

-::: - -:::{grid-item-card} -:padding: 1 -:img-top: ./images/system-acceptance.jpg -:class-img-top: small-sd-card-img-top -:class-body: small-sd-card -:class: small-sd-card -+++ - -

Instinct Customer Acceptance Guide

-
-

Comprehensive guide for configuring, validating, benchmarking, and baselining AMD Instinct™ GPUs.

-::: - -:::{grid-item-card} -:padding: 1 -:img-top: ./images/gpu-operator.jpg -:class-img-top: small-sd-card-img-top -:class-body: small-sd-card -:class: small-sd-card -+++ - -

Cluster Validation Suite

-
-

CVS is a collection of test scripts that validate AMD AI clusters.

-::: - :::: ::::: @@ -613,41 +548,41 @@ The AMD Instinct Documentation site provides comprehensive guides and technical :::{grid-item-card} :padding: 1 -:img-top: ./images/enterpriseAI.png +:img-top: ./images/system-acceptance.jpg :class-img-top: small-sd-card-img-top :class-body: small-sd-card :class: small-sd-card +++ - -

Enterprise AI

+
+

Instinct Customer Acceptance Guide

-

Tools to help enterprise customers address the growing need for AI infrastructure management.

+

Comprehensive guide for configuring, validating, benchmarking, and baselining AMD Instinct™ GPUs.

::: :::{grid-item-card} :padding: 1 -:img-top: ./images/omnistat.jpg +:img-top: ./images/telemetry.jpg :class-img-top: small-sd-card-img-top :class-body: small-sd-card :class: small-sd-card +++ - -

Omnistat

+
+

Cluster Networking Guide

-

Profile across the cluster.

+

Optimize the network for Instinct GPU applications

::: :::{grid-item-card} :padding: 1 -:img-top: ./images/telemetry.jpg +:img-top: ./images/mi3xx-reference.png :class-img-top: small-sd-card-img-top :class-body: small-sd-card :class: small-sd-card +++ - -

Cluster Networking

+
+

MI3XX Reference Design

-

Optimize the network for Instinct GPU applications

+

Reference design materials and topology examples for the AMD Instinct MI3XX platform.

::: :::: @@ -713,12 +648,89 @@ The AMD Instinct Documentation site provides comprehensive guides and technical :::::::::: -::::::::::{dropdown} Common Reference +::::::::::{dropdown} Resources :open: -::::::{grid} 2 2 3 4 +::::::::{tab-set} -:::::{grid-item-card} +:::::{tab-item} Tools + +::::{grid} 2 2 3 4 + +:::{grid-item-card} +:padding: 1 +:img-top: ./images/enterpriseAI.png +:class-img-top: small-sd-card-img-top +:class-body: small-sd-card +:class: small-sd-card ++++ + +

Enterprise AI

+
+

Tools to help enterprise customers address the growing need for AI infrastructure management.

+::: + +:::{grid-item-card} +:padding: 1 +:img-top: ./images/omnistat.jpg +:class-img-top: small-sd-card-img-top +:class-body: small-sd-card +:class: small-sd-card ++++ + +

Omnistat

+
+

Profile across the cluster.

+::: + +:::{grid-item-card} +:padding: 1 +:img-top: ./images/gpu-operator.jpg +:class-img-top: small-sd-card-img-top +:class-body: small-sd-card +:class: small-sd-card ++++ + +

Cluster Validation Suite

+
+

CVS is a collection of test scripts that validate AMD AI clusters.

+::: + +:::{grid-item-card} +:padding: 1 +:img-top: ./images/System-Administrators-Bare-Metal-AMD-AMD-SMI.jpg +:class-img-top: small-sd-card-img-top +:class-body: small-sd-card +:class: small-sd-card ++++ + +

AMD SMI

+
+

The AMD System Management Interface (AMD SMI) library offers a unified tool for managing and monitoring GPUs, particularly in high-performance computing environments. It provides a user-space interface that allows applications to control GPU operations, monitor performance, and retrieve information about the system’s drivers and GPUs.

+::: + +:::{grid-item-card} +:padding: 1 +:img-top: ./images/System-Administrators-Bare-Metal-AMD-Tools.jpg +:class-img-top: small-sd-card-img-top +:class-body: small-sd-card +:class: small-sd-card ++++ + +

ROCmValidationSuite

+
+

System validation and diagnosis

+::: + +:::: + +::::: + +:::::{tab-item} Common Reference + +::::{grid} 2 2 3 4 + +:::{grid-item-card} :padding: 1 :img-top: ./images/instinct-microarchitecture.jpg :class-img-top: small-sd-card-img-top @@ -729,22 +741,22 @@ The AMD Instinct Documentation site provides comprehensive guides and technical

Instinct Micro-architecture

Review hardware aspects of the AMD Instinct™ MI350, MI300, MI200 and MI100 series of GPU accelerators.

-::::: +::: -:::::{grid-item-card} +:::{grid-item-card} :padding: 1 -:img-top: ./images/AMD-SMI-API-doc.jpg +:img-top: ./images/System-Administrators-Bare-Metal-AMD-GPU-Partitioning.jpg :class-img-top: small-sd-card-img-top :class-body: small-sd-card :class: small-sd-card +++ - -

AMD SMI API Doc

+
+

GPU Partitioning

-

AMD SMI documentation covering all use cases.

-::::: +

Learn how to split the compute units and memory to partition a GPU.

+::: -:::::{grid-item-card} +:::{grid-item-card} :padding: 1 :img-top: ./images/hipcpp.jpg :class-img-top: small-sd-card-img-top @@ -755,9 +767,9 @@ The AMD Instinct Documentation site provides comprehensive guides and technical

HIP C++

Learn about HIP programming model.

-::::: +::: -:::::{grid-item-card} +:::{grid-item-card} :padding: 1 :img-top: ./images/virtualization_image.jpg :class-img-top: small-sd-card-img-top @@ -768,9 +780,9 @@ The AMD Instinct Documentation site provides comprehensive guides and technical

OpenMP

Explore the OpenMP programming model.

-::::: +::: -:::::{grid-item-card} +:::{grid-item-card} :padding: 1 :img-top: ./images/secure-docs.png :class-img-top: small-sd-card-img-top @@ -782,8 +794,12 @@ The AMD Instinct Documentation site provides comprehensive guides and technical

Additional NDA technical documentation, software, and design collateral for AMD Instinct products; Login Required

+::: + +:::: + ::::: -:::::: +:::::::: :::::::::: diff --git a/docs/resources/common-reference.md b/docs/resources/common-reference.md new file mode 100644 index 00000000..b030ad3b --- /dev/null +++ b/docs/resources/common-reference.md @@ -0,0 +1,73 @@ +# Common Reference + +::::::{grid} 2 2 3 4 + +:::::{grid-item-card} +:padding: 1 +:img-top: ../system-admin/images/System-Administrators-Bare-Metal-AMD-GPU-Partitioning.jpg +:class-img-top: small-sd-card-img-top +:class-body: small-sd-card +:class: small-sd-card ++++ + +

GPU Partitioning

+
+

Learn how to split the compute units and memory to partition a GPU.

+::::: + +:::::{grid-item-card} +:padding: 1 +:img-top: ../images/instinct-microarchitecture.jpg +:class-img-top: small-sd-card-img-top +:class-body: small-sd-card +:class: small-sd-card ++++ + +

Instinct Micro-architecture

+
+

Review hardware aspects of the AMD Instinct™ MI350, MI300, MI200 and MI100 series of GPU accelerators.

+::::: + +:::::{grid-item-card} +:padding: 1 +:img-top: ../images/hipcpp.jpg +:class-img-top: small-sd-card-img-top +:class-body: small-sd-card +:class: small-sd-card ++++ + +

HIP C++

+
+

Learn about HIP programming model.

+::::: + +:::::{grid-item-card} +:padding: 1 +:img-top: ../images/virtualization_image.jpg +:class-img-top: small-sd-card-img-top +:class-body: small-sd-card +:class: small-sd-card ++++ + +

OpenMP

+
+

Explore the OpenMP programming model.

+::::: + +:::::{grid-item-card} +:padding: 1 +:img-top: ../images/secure-docs.png +:class-img-top: small-sd-card-img-top +:class-body: small-sd-card +:class: small-sd-card ++++ + +

AMD Technical Information Portal

+
+

Additional NDA technical documentation, software, and design collateral for AMD Instinct products; +Login Required

+::::: + +:::::: + +:::::::::: diff --git a/docs/resources/index.md b/docs/resources/index.md new file mode 100644 index 00000000..6d0021cf --- /dev/null +++ b/docs/resources/index.md @@ -0,0 +1,72 @@ +# Tools + +::::{grid} 2 2 3 4 + +:::{grid-item-card} +:padding: 1 +:img-top: ../system-admin/images/System-Administrators-Bare-Metal-AMD-AMD-SMI.jpg +:class-img-top: small-sd-card-img-top +:class-body: small-sd-card +:class: small-sd-card ++++ + +

AMD SMI

+
+

The AMD System Management Interface (AMD SMI) library offers a unified tool for managing and monitoring GPUs, particularly in high-performance computing environments. It provides a user-space interface that allows applications to control GPU operations, monitor performance, and retrieve information about the system’s drivers and GPUs.

+::: + +:::{grid-item-card} +:padding: 1 +:img-top: ../system-admin/images/enterpriseAI.png +:class-img-top: small-sd-card-img-top +:class-body: small-sd-card +:class: small-sd-card ++++ + +

Enterprise AI

+
+

Tools for enterprise customers for AI infrastructure management.

+::: + +:::{grid-item-card} +:padding: 1 +:img-top: ../system-admin/images/omnistat.jpg +:class-img-top: small-sd-card-img-top +:class-body: small-sd-card +:class: small-sd-card ++++ + +

Omnistat

+
+

Profile across the cluster.

+::: + +:::{grid-item-card} +:padding: 1 +:img-top: ../system-admin/images/System-Administrators-Bare-Metal-AMD-Tools.jpg +:class-img-top: small-sd-card-img-top +:class-body: small-sd-card +:class: small-sd-card ++++ + +

ROCmValidationSuite

+
+

System validation and diagnosis

+::: + +:::{grid-item-card} +:padding: 1 +:img-top: ../system-admin/images/gpu-operator.jpg +:class-img-top: small-sd-card-img-top +:class-body: small-sd-card +:class: small-sd-card ++++ + +

Cluster Validation Suite

+
+

CVS is a collection of test scripts that validate AMD AI clusters.

+::: + +:::: + +:::::::::: diff --git a/docs/sphinx/_toc.yml.in b/docs/sphinx/_toc.yml.in index 1563cc59..d9f9fc00 100644 --- a/docs/sphinx/_toc.yml.in +++ b/docs/sphinx/_toc.yml.in @@ -3,7 +3,6 @@ subtrees: - caption: Industries/Verticals entries: - - file: vision/index.md title: Computer Vision subtrees: @@ -48,7 +47,7 @@ subtrees: - file: finance/thundergbm.md title: ThunderGBM - file: isv-apps/index.md - title: Simulation & Modeling Apps + title: Simulation & Modeling Apps subtrees: - entries: - file: isv-apps/ansys-fluent.md @@ -74,16 +73,6 @@ subtrees: - entries: - url: https://instinct.docs.amd.com/projects/amdgpu-docs/en/latest/ title: AMD GPU Driver - - url: https://rocm.docs.amd.com/projects/amdsmi/en/latest/ - title: AMD-SMI - - url: https://rocm.docs.amd.com/projects/cvs/en/latest/index.html - title: Cluster Validation Suite - - url: https://rocm.blogs.amd.com/software-tools-optimization/compute-memory-modes/README.html - title: GPU Partitioning - - url: https://instinct.docs.amd.com/projects/system-acceptance/en/latest/ - title: Instinct Customer Acceptance Guide - - url: https://rocm.docs.amd.com/projects/ROCmValidationSuite/en/latest/ - title: ROCm Validatation Suite - file: system-admin/co-tools.md title: Containers and Orchestration Tools subtrees: @@ -97,17 +86,15 @@ subtrees: - url: https://instinct.docs.amd.com/projects/device-metrics-exporter/en/latest/ title: Device Metrics Exporter - url: https://instinct.docs.amd.com/projects/container-toolkit/en/latest/ - title: AMD Container Toolkit + title: AMD Container Toolkit - file: system-admin/cluster.md title: Cluster subtrees: - entries: - - url: https://account.amd.com/en/forms/registration/enterpriseai-ea.html - title: Enterprise AI + - url: https://instinct.docs.amd.com/projects/system-acceptance/en/latest/ + title: Instinct Customer Acceptance Guide - url: https://instinct.docs.amd.com/projects/gpu-cluster-networking/en/latest/ - title: Networking - - url: https://amdresearch.github.io/omnistat/ - title: Omnistat + title: Networking - file: system-admin/cloud.md title: Cloud subtrees: @@ -122,52 +109,72 @@ subtrees: title: Virtualization Driver - url: https://instinct.docs.amd.com/projects/amd-smi-virt/en/latest/ title: AMD SMI Documentation - -- caption: Common Reference + +- caption: Resources entries: - - url: https://rocm.docs.amd.com/projects/HIP/en/latest/ - title: HIP C++ - - url: https://rocm.docs.amd.com/projects/amdsmi/en/latest/ - title: AMD-SMI - - file: gpu-arch/gpu-arch.md - title: GPU architecture + - file: resources/index.md + title: Tools subtrees: - - entries: - - file: gpu-arch/mi350.md - title: MI350 microarchitecture - subtrees: - - entries: - - url: https://www.amd.com/content/dam/amd/en/documents/instinct-tech-docs/instruction-set-architectures/amd-instinct-cdna4-instruction-set-architecture.pdf - title: AMD Instinct MI350/CDNA4 ISA - - url: https://www.amd.com/content/dam/amd/en/documents/instinct-tech-docs/white-papers/amd-cdna-4-architecture-whitepaper.pdf - title: White paper - - file: gpu-arch/mi300.md - title: MI300 microarchitecture - subtrees: - - entries: - - url: https://www.amd.com/content/dam/amd/en/documents/instinct-tech-docs/instruction-set-architectures/amd-instinct-mi300-cdna3-instruction-set-architecture.pdf - title: AMD Instinct MI300/CDNA3 ISA - - url: https://www.amd.com/content/dam/amd/en/documents/instinct-tech-docs/white-papers/amd-cdna-3-white-paper.pdf - title: White paper - - file: gpu-arch/mi300-mi200-performance-counters.rst - title: MI300 and MI200 Performance counter - - file: gpu-arch/mi250.md - title: MI250 microarchitecture - subtrees: - - entries: - - url: https://www.amd.com/system/files/TechDocs/instinct-mi200-cdna2-instruction-set-architecture.pdf - title: AMD Instinct MI200/CDNA2 ISA - - url: https://www.amd.com/content/dam/amd/en/documents/instinct-business-docs/white-papers/amd-cdna2-white-paper.pdf - title: White paper - - file: gpu-arch/mi100.md - title: MI100 microarchitecture - subtrees: - - entries: - - url: https://www.amd.com/system/files/TechDocs/instinct-mi100-cdna1-shader-instruction-set-architecture%C2%A0.pdf - title: AMD Instinct MI100/CDNA1 ISA - - url: https://www.amd.com/content/dam/amd/en/documents/instinct-business-docs/white-papers/amd-cdna-white-paper.pdf - title: White paper - - url: https://rocm.docs.amd.com/projects/llvm-project/en/latest/conceptual/openmp.html - title: OpenMP - - + - entries: + - url: https://account.amd.com/en/forms/registration/enterpriseai-ea.html + title: Enterprise AI + - url: https://amdresearch.github.io/omnistat/ + title: Omnistat + - url: https://rocm.docs.amd.com/projects/cvs/en/latest/index.html + title: Cluster Validation Suite + - url: https://rocm.docs.amd.com/projects/amdsmi/en/latest/ + title: AMD SMI + - url: https://rocm.docs.amd.com/projects/ROCmValidationSuite/en/latest/ + title: ROCmValidationSuite + - file: resources/common-reference.md + title: Common Reference + subtrees: + - entries: + - url: https://rocm.blogs.amd.com/software-tools-optimization/compute-memory-modes/README.html + title: GPU Partitioning + - file: gpu-arch/gpu-arch.md + title: Instinct Micro-architecture + subtrees: + - entries: + - file: gpu-arch/mi350.md + title: MI350 microarchitecture + subtrees: + - entries: + - url: https://www.amd.com/content/dam/amd/en/documents/instinct-tech-docs/instruction-set-architectures/amd-instinct-cdna4-instruction-set-architecture.pdf + title: AMD Instinct MI350/CDNA4 ISA + - url: https://www.amd.com/content/dam/amd/en/documents/instinct-tech-docs/white-papers/amd-cdna-4-architecture-whitepaper.pdf + title: White paper + - file: gpu-arch/mi300.md + title: MI300 microarchitecture + subtrees: + - entries: + - url: https://www.amd.com/content/dam/amd/en/documents/instinct-tech-docs/instruction-set-architectures/amd-instinct-mi300-cdna3-instruction-set-architecture.pdf + title: AMD Instinct MI300/CDNA3 ISA + - url: https://www.amd.com/content/dam/amd/en/documents/instinct-tech-docs/white-papers/amd-cdna-3-white-paper.pdf + title: White paper + - file: gpu-arch/mi300-mi200-performance-counters.rst + title: MI300 and MI200 Performance counter + - file: gpu-arch/mi250.md + title: MI250 microarchitecture + subtrees: + - entries: + - url: https://www.amd.com/system/files/TechDocs/instinct-mi200-cdna2-instruction-set-architecture.pdf + title: AMD Instinct MI200/CDNA2 ISA + - url: https://www.amd.com/content/dam/amd/en/documents/instinct-business-docs/white-papers/amd-cdna2-white-paper.pdf + title: White paper + - file: gpu-arch/mi100.md + title: MI100 microarchitecture + subtrees: + - entries: + - url: https://www.amd.com/system/files/TechDocs/instinct-mi100-cdna1-shader-instruction-set-architecture%C2%A0.pdf + title: AMD Instinct MI100/CDNA1 ISA + - url: https://www.amd.com/content/dam/amd/en/documents/instinct-business-docs/white-papers/amd-cdna-white-paper.pdf + title: White paper + - url: https://rocm.docs.amd.com/projects/amdsmi/en/latest/index.html + title: AMD SMI API Doc + - url: https://rocm.docs.amd.com/projects/HIP/en/latest/index.html + title: HIP C++ + - url: https://rocm.docs.amd.com/projects/llvm-project/en/latest/conceptual/openmp.html + title: OpenMP + - url: https://docs.amd.com/v/u/en-US/ug1729-amd-instinct-accelerators + title: AMD Technical Information Portal diff --git a/docs/system-admin/bare-metal.md b/docs/system-admin/bare-metal.md index 16ce8e9e..f521fe35 100644 --- a/docs/system-admin/bare-metal.md +++ b/docs/system-admin/bare-metal.md @@ -15,69 +15,4 @@

Install and configure the GPU. Learn about logging including error codes.

::: -:::{grid-item-card} -:padding: 1 -:img-top: ./images/System-Administrators-Bare-Metal-AMD-GPU-Partitioning.jpg -:class-img-top: small-sd-card-img-top -:class-body: small-sd-card -:class: small-sd-card -+++ - -

GPU Partitioning

-
-

Learn how to split the compute units and memory to partition a GPU.

-::: - -:::{grid-item-card} -:padding: 1 -:img-top: ./images/System-Administrators-Bare-Metal-AMD-AMD-SMI.jpg -:class-img-top: small-sd-card-img-top -:class-body: small-sd-card -:class: small-sd-card -+++ - -

AMD SMI

-
-

The AMD System Management Interface (AMD SMI) library offers a unified tool for managing and monitoring GPUs, particularly in high-performance computing environments. It provides a user-space interface that allows applications to control GPU operations, monitor performance, and retrieve information about the system’s drivers and GPUs.

-::: - -:::{grid-item-card} -:padding: 1 -:img-top: ./images/System-Administrators-Bare-Metal-AMD-Tools.jpg -:class-img-top: small-sd-card-img-top -:class-body: small-sd-card -:class: small-sd-card -+++ - -

ROCmValidationSuite

-
-

System validation and diagnosis

-::: - -:::{grid-item-card} -:padding: 1 -:img-top: ./images/system-acceptance.jpg -:class-img-top: small-sd-card-img-top -:class-body: small-sd-card -:class: small-sd-card -+++ - -

Instinct Customer Acceptance Guide

-
-

Comprehensive guide for configuring, validating, benchmarking, and baselining AMD Instinct™ GPUs.

-::: - -:::{grid-item-card} -:padding: 1 -:img-top: ./images/gpu-operator.jpg -:class-img-top: small-sd-card-img-top -:class-body: small-sd-card -:class: small-sd-card -+++ - -

Cluster Validation Suite

-
-

CVS is a collection of test scripts that validate AMD AI clusters.

-::: - :::: diff --git a/docs/system-admin/cluster.md b/docs/system-admin/cluster.md index 95a77878..086207d3 100644 --- a/docs/system-admin/cluster.md +++ b/docs/system-admin/cluster.md @@ -1,44 +1,65 @@ # Cluster -::::{grid} 2 2 2 2 +## System and Design Guides + +::::{grid} 2 3 3 3 :::{grid-item-card} :padding: 1 -:img-top: ./images/enterpriseAI.png +:img-top: ./images/system-acceptance.jpg :class-img-top: small-sd-card-img-top :class-body: small-sd-card :class: small-sd-card +++ - -

Enterprise AI

+
+

Instinct Customer Acceptance Guide

-

Tools for enterprise customers for AI infrastructure management.

+

Comprehensive guide for configuring, validating, benchmarking, and baselining AMD Instinct™ GPUs.

::: :::{grid-item-card} :padding: 1 -:img-top: ./images/omnistat.jpg +:img-top: ./images/telemetry.jpg :class-img-top: small-sd-card-img-top :class-body: small-sd-card :class: small-sd-card +++ - -

Omnistat

+
+

Cluster Networking Guide

-

Profile across the cluster.

+

Optimize the network for Instinct GPU applications

::: :::{grid-item-card} :padding: 1 -:img-top: ./images/telemetry.jpg +:img-top: ./images/mi3xx-reference.png :class-img-top: small-sd-card-img-top :class-body: small-sd-card :class: small-sd-card +++ - -

Cluster Networking

+
+

MI3XX Reference Design

-

Optimize the network for Instinct GPU applications

+

Reference design materials and topology examples for the AMD Instinct MI3XX platform.

+::: + +:::: + +## Articles and White Papers + +::::{grid} 2 3 3 3 + +:::{grid-item-card} +:padding: 1 +:img-top: ./images/RoCE-comparative-analysis.png +:class-img-top: small-sd-card-img-top +:class-body: small-sd-card +:class: small-sd-card ++++ + +

Comparative Analysis of Scale-Out RoCE Network Traffic Patterns and Loads in Training Large Language Models

+
+

Compares RoCE network traffic patterns and loads across GPT-4, Llama 3, DeepSeek-V2, and Grok 4.0 LLM training.

::: :::: diff --git a/docs/system-admin/images/RoCE-comparative-analysis.png b/docs/system-admin/images/RoCE-comparative-analysis.png new file mode 100644 index 00000000..c0aa037b Binary files /dev/null and b/docs/system-admin/images/RoCE-comparative-analysis.png differ diff --git a/docs/system-admin/images/mi3xx-reference.png b/docs/system-admin/images/mi3xx-reference.png new file mode 100644 index 00000000..c3076309 Binary files /dev/null and b/docs/system-admin/images/mi3xx-reference.png differ diff --git a/docs/system-admin/index.md b/docs/system-admin/index.md index 17a95149..ee2fb474 100644 --- a/docs/system-admin/index.md +++ b/docs/system-admin/index.md @@ -15,45 +15,6 @@

Install and configure the GPU. Learn about logging including error codes.

::: -:::{grid-item-card} -:padding: 1 -:img-top: ./images/System-Administrators-Bare-Metal-AMD-GPU-Partitioning.jpg -:class-img-top: small-sd-card-img-top -:class-body: small-sd-card -:class: small-sd-card -+++ - -

GPU Partitioning

-
-

Learn how to split the compute units and memory to partition a GPU.

-::: - -:::{grid-item-card} -:padding: 1 -:img-top: ./images/System-Administrators-Bare-Metal-AMD-AMD-SMI.jpg -:class-img-top: small-sd-card-img-top -:class-body: small-sd-card -:class: small-sd-card -+++ - -

AMD SMI

-
-

The AMD System Management Interface (AMD SMI) library offers a unified tool for managing and monitoring GPUs, particularly in high-performance computing environments. It provides a user-space interface that allows applications to control GPU operations, monitor performance, and retrieve information about the system’s drivers and GPUs.

-::: - -:::{grid-item-card} -:padding: 1 -:img-top: ./images/System-Administrators-Bare-Metal-AMD-Tools.jpg -:class-img-top: small-sd-card-img-top -:class-body: small-sd-card -:class: small-sd-card -+++ - -

ROCmValidationSuite

-
-

System validation and diagnosis

-::: - :::{grid-item-card} :padding: 1 :img-top: ./images/system-acceptance.jpg @@ -119,32 +80,6 @@

The AMD Container Toolkit enables seamless integration of AMD Instinct GPUs with Docker, offering streamlined GPU access, enhanced container runtime support, and optimized performance for ML and HPC workloads.

::: -:::{grid-item-card} -:padding: 1 -:img-top: ./images/enterpriseAI.png -:class-img-top: small-sd-card-img-top -:class-body: small-sd-card -:class: small-sd-card -+++ - -

Enterprise AI

-
-

Tools for enterprise customers for AI infrastructure management.

-::: - -:::{grid-item-card} -:padding: 1 -:img-top: ./images/omnistat.jpg -:class-img-top: small-sd-card-img-top -:class-body: small-sd-card -:class: small-sd-card -+++ - -

Omnistat

-
-

Profile across the cluster.

-::: - :::{grid-item-card} :padding: 1 :img-top: ./images/telemetry.jpg