phunter/docker-compose
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
40 Commits 1 Branch 0 Tags
1a329f54bdb72b893b074b990423734104d6bb48
Commit Graph

11 Commits

Author SHA1 Message Date
Preston Hunter
1a329f54bd fix device card 2025-12-24 01:30:07 -05:00
Preston Hunter
972b1cec61 Fixed formatting 2025-12-24 01:27:24 -05:00
Preston Hunter
41d68a8214 Ollama debug 2025-12-24 01:24:16 -05:00
Preston Hunter
a5c2d494a8 Fix device tree 2025-12-24 01:22:14 -05:00
Preston Hunter
05374e93a7 Fix env variables 2025-12-24 01:18:47 -05:00
Preston Hunter
49d8d4362e Fix eGPU Init 2025-12-24 01:16:53 -05:00
Preston Hunter
ed69658364 Correct bind mounts for P52 2025-12-24 00:55:53 -05:00
Preston Hunter
aa2a23091d Correct network name 2025-12-24 00:53:24 -05:00
Preston Hunter
9323a0624a Add web ui's 2025-12-24 00:50:47 -05:00
Preston Hunter
8095c7b951 Removed name 2025-12-24 00:39:26 -05:00
Preston Hunter
1cf853ac46 feat(ollama): add docker swarm configuration for rocm gpu support 
Introduce a new compose.yml to deploy Ollama with AMD GPU hardware acceleration on Docker Swarm.

- Uses the ROCm-enabled Ollama image.
- Mounts necessary GPU devices (/dev/kfd and /dev/dri) with root permissions for hardware access.
- Sets HSA_OVERRIDE_GFX_VERSION to 10.3.0 to support Navi 21 (6900 XT) cards.
- Configures persistent storage on local SSD and integrates with an external proxy network.
- Includes deployment constraints to target nodes labeled with GPUs.
 2025-12-24 00:37:23 -05:00