Preston Hunter 1cf853ac46 feat(ollama): add docker swarm configuration for rocm gpu support ...

Introduce a new compose.yml to deploy Ollama with AMD GPU hardware acceleration on Docker Swarm.

- Uses the ROCm-enabled Ollama image.
- Mounts necessary GPU devices (/dev/kfd and /dev/dri) with root permissions for hardware access.
- Sets HSA_OVERRIDE_GFX_VERSION to 10.3.0 to support Navi 21 (6900 XT) cards.
- Configures persistent storage on local SSD and integrates with an external proxy network.
- Includes deployment constraints to target nodes labeled with GPUs.

2025-12-24 00:37:23 -05:00

931 B

Raw Blame History

View Raw