verl compatibility#
2025-09-05
3 min read time
Volcano Engine Reinforcement Learning for LLMs (verl) is a reinforcement learning framework designed for large language models (LLMs). verl offers a scalable, open-source fine-tuning solution optimized for AMD Instinct GPUs with full ROCm support.
See the verl documentation for more information about verl.
The official verl GitHub repository is volcengine/verl.
Use the AMD-validated Docker images with ROCm and verl preinstalled.
See the ROCm verl installation guide to install and get started.
Note
verl is supported on ROCm 6.2.0.
Use cases and recommendations#
The benefits of verl in large-scale reinforcement learning from human feedback (RLHF) are discussed in the Reinforcement Learning from Human Feedback on AMD GPUs with verl and ROCm Integration blog.
Supported features#
The following table shows verl on ROCm support for GPU-accelerated modules.
Module |
Description |
verl version |
ROCm version |
|---|---|---|---|
|
Training engine |
0.3.0.post0 |
6.2.0 |
|
Inference engine |
0.3.0.post0 |
6.2.0 |
Docker image compatibility#
AMD validates and publishes ready-made ROCm verl Docker images with ROCm backends on Docker Hub. The following Docker image tags and associated inventories represent the available verl versions from the official Docker Hub.