Commit Graph

7 Commits

Author SHA1 Message Date
05374e93a7 Fix env variables 2025-12-24 01:18:47 -05:00
49d8d4362e Fix eGPU Init 2025-12-24 01:16:53 -05:00
ed69658364 Correct bind mounts for P52 2025-12-24 00:55:53 -05:00
aa2a23091d Correct network name 2025-12-24 00:53:24 -05:00
9323a0624a Add web ui's 2025-12-24 00:50:47 -05:00
8095c7b951 Removed name 2025-12-24 00:39:26 -05:00
1cf853ac46 feat(ollama): add docker swarm configuration for rocm gpu support
Introduce a new compose.yml to deploy Ollama with AMD GPU hardware acceleration on Docker Swarm.

- Uses the ROCm-enabled Ollama image.
- Mounts necessary GPU devices (/dev/kfd and /dev/dri) with root permissions for hardware access.
- Sets HSA_OVERRIDE_GFX_VERSION to 10.3.0 to support Navi 21 (6900 XT) cards.
- Configures persistent storage on local SSD and integrates with an external proxy network.
- Includes deployment constraints to target nodes labeled with GPUs.
2025-12-24 00:37:23 -05:00