NVMe-oF with Ceph-CSI

Note

NVMe-oF support in Ceph-CSI is under active development and is not yet generally available. Check the Ceph-CSI project for the current status before planning a deployment on it.

The NVMe-oF driver exposes RBD images to containerized workloads through the Ceph NVMe-oF gateway rather than through a direct RBD client interface on each node. Worker nodes attach volumes with the standard NVMe/TCP initiator that ships with the Linux kernel, so, as with the NFS driver, no Ceph client code is needed on the nodes. This suits environments that standardize on NVMe/TCP for storage access or that cannot run RBD kernel clients.

Prepare the Gateway

The driver requires a running NVMe-oF gateway group in the Ceph cluster. See Ceph NVMe-oF Gateway for the gateway architecture, hardware sizing, and deployment instructions, and NVMe-oF Gateway Requirements for gateway requirements.

The gateway exposes RBD images from a RADOS pool, so the Ceph-side pool preparation matches that of the RBD driver: see RBD with Ceph-CSI for creating and initializing a pool.

Brought to you by the Ceph Foundation

The Ceph Documentation is a community resource funded and hosted by the non-profit Ceph Foundation. If you would like to support this and our other efforts, please consider joining now.