Environment:Vllm project Vllm AMD ROCm
| Knowledge Sources | |
|---|---|
| Domains | GPU_Computing, AMD_ROCm, CI_CD |
| Last Updated | 2026-02-08 00:00 GMT |
Overview
AMD ROCm environment specifically configured for vLLM's CI/CD test pipelines, providing the AMD GPU hardware, ROCm runtime, and Docker-based test execution infrastructure required to validate vLLM's AMD backend on every pull request and release.
Description
This environment defines the AMD ROCm testing infrastructure used in vLLM's Buildkite CI pipelines. While the general ROCm environment covers the software stack for end-user deployments, this environment focuses on the CI-specific configuration: Buildkite agent setup on AMD GPU nodes, Docker images preconfigured with ROCm and vLLM build dependencies, test matrix definitions covering model architectures and quantization formats on AMD hardware, and result reporting back to GitHub. The AMD CI pipeline validates that vLLM's HIP-compiled kernels produce correct results on physical MI250X and MI300X accelerators, catches AMD-specific regressions in attention backends, and ensures that ROCm-specific features (AITER operators, custom paged attention, FP8 padding) work correctly. Test execution uses Docker containers with GPU passthrough to ensure reproducible environments across CI runs.
Usage
The AMD test pipeline is triggered automatically on pull requests that modify ROCm-related code paths or on a scheduled basis for the main branch. The pipeline configuration (.buildkite/test-amd-pipeline.yaml or equivalent) defines the Docker image, test commands, GPU queue selectors (targeting AMD GPU agents), and timeout limits. CI agents equipped with AMD GPUs pull the pipeline configuration, build or pull the test Docker image, and execute the test suite with GPU passthrough. Test results and logs are uploaded as Buildkite artifacts and reported as GitHub commit statuses.
Requirements
| Requirement | Value |
|---|---|
| ROCm Runtime | ROCm 6.x+ |
| GPU Hardware | AMD Instinct MI250X (gfx90a) or MI300X (gfx942) |
| HIP Compiler | hipcc (included with ROCm) |
| Docker | Docker Engine with AMD GPU passthrough support |
| Buildkite Agent | Self-hosted agent on AMD GPU node |
| Test Docker Image | ROCm-based image with vLLM build dependencies |
| Operating System | Linux (Ubuntu 22.04+ with ROCm kernel modules) |
| CI Platform | Buildkite with GitHub webhook integration |