AMD has published as open-source their “GPU-IOV Module” used for virtualization with Instinct accelerators. It’s also reported on their roadmap for bringing virtualization support to their client (Radeon) discrete GPUs.
The AMD GPU-IOV Module is for the Linux kernel and for providing SR-IOV based hardware virtualization in conjunction with the KVM hypervisor. GIM provides the GPU IOV virtualization, virtual function (VF) configuration and enablement, GPU scheduling for world switch, hang detection and FLR reset, and PF/VF handshake capabilities.
Initially the AMD GIM driver is for the Instinct MI300X hardware and tested atop Ubuntu 22.04 LTS with ROCm 6.4. Those interested can find the AMD GIM code currently via GitHub. It’s not laid out in the repository or any other public communications I’ve seen what any upstreaming plans are for this GIM driver to get it into the mainline Linux kernel.
Of interest to many Phoronix readers will be that GIM / SR-IOV support could be coming to client discrete GPUs, which has been a long sought feature for the Radeon graphics cards. AMD engineer Anush Elangovan responded on X that the client GPU support is reportedly “in the roadmap”:
Hopefully this client GPU support pans out and comes sooner rather than later.