verl compatibility#

2025-07-31

3 min read time

Applies to Linux

Volcano Engine Reinforcement Learning for LLMs (verl) is a reinforcement learning framework designed for large language models (LLMs). verl offers a scalable, open-source fine-tuning solution optimized for AMD Instinct GPUs with full ROCm support.

Note

verl is supported on ROCm 6.2.0.

Use cases and recommendations#

The benefits of verl in large-scale reinforcement learning from human feedback (RLHF) are discussed in the Reinforcement Learning from Human Feedback on AMD GPUs with verl and ROCm Integration blog.

Supported features#

The following table shows verl on ROCm support for GPU-accelerated modules.

Module

Description

verl version

ROCm version

FSDP

Training engine

0.3.0.post0

6.2.0

vllm

Inference engine

0.3.0.post0

6.2.0

Docker image compatibility#

AMD validates and publishes ready-made ROCm verl Docker images with ROCm backends on Docker Hub. The following Docker image tags and associated inventories represent the available verl versions from the official Docker Hub.

Docker image

ROCm

verl

Ubuntu

Pytorch

Python

vllm

rocm/verl

6.2.0

0.3.0post0

20.04

2.5.0

3.9.19

0.6.3