Preston Hunter 1cf853ac46 feat(ollama): add docker swarm configuration for rocm gpu support ...

Introduce a new compose.yml to deploy Ollama with AMD GPU hardware acceleration on Docker Swarm.

- Uses the ROCm-enabled Ollama image.
- Mounts necessary GPU devices (/dev/kfd and /dev/dri) with root permissions for hardware access.
- Sets HSA_OVERRIDE_GFX_VERSION to 10.3.0 to support Navi 21 (6900 XT) cards.
- Configures persistent storage on local SSD and integrates with an external proxy network.
- Includes deployment constraints to target nodes labeled with GPUs.

2025-12-24 00:37:23 -05:00

Local Homelab

feat(ollama): add docker swarm configuration for rocm gpu support

2025-12-24 00:37:23 -05:00

Oracle Homelab

Removed all .DS_Store mac files

2025-12-20 19:27:21 -05:00

Description

Docker Compose Files

2.8 MiB

Languages

Clojure 93.9%

CSS 4.2%

Java 1.1%

Shell 0.4%

HTML 0.3%