Hardware validation records¶
Single-node (0.1.0) and dual-node (0.2.0) gates. Fill rows on real hardware.
Interactive and discovery¶
- [ ] First bare
rondinerun performs doctor, recommendation, and selection - [ ] A later bare
rondinerun offers the active plan/presets without repeating doctor - [ ] Loading a preset updates the active
last.jsonplan - [ ]
rondine suggest --no-hubworks offline - [ ] Hub API failure falls back to catalog suggestions with a note
- [ ]
rondine suggest --context 65536excludes catalog models below 65,536 tokens
Template¶
| Field | Value |
|---|---|
| Date | |
| Host | |
rondine doctor summary |
|
| Plan | |
| Engine / quant | |
| Launch command | |
/v1/models |
|
rondine verify |
|
| Peak memory | |
| tok/s (prompt / gen) | |
| Notes |
Single-node NVIDIA (discrete CUDA)¶
- [ ]
rondine doctorreports VRAM + GPU name + free disk - [ ]
rondine suggestmatchescuda-*target and fits against VRAM when resident - [ ]
rondine plan <moe> --memory-mode hybridselects hybrid when VRAM alone is short but RAM+VRAM is enough - [ ] Hybrid dry-run emits
--cpu-moeand-ngl auto(or equivalent) for MoE GGUFs - [ ]
rondine setupbuilds/installs llama.cpp with CUDA (or vLLM on Linux) - [ ]
rondine serve+rondine verify --profile codingpass
Single-node Mac (Apple Silicon)¶
- [ ]
rondine setupinstalls llama.cpp and/or MLX - [ ]
rondine plan auto --profile codingselects a fitting Qwen/Gemma variant - [ ]
rondine plan glm-5.2rejects on ≤48GB hosts without--allow-oversize - [ ]
rondine plan glm-5.2 --memory-mode mmap --allow-oversizeis experimental,fits=false, and forces-ngl 0 - [ ] Insufficient free disk rejects mmap plans / pulls before download
- [ ]
rondine serve+rondine verify --profile codingpass for a fitting small/medium model
Single-node DGX Spark¶
- [ ]
nvidia-smireports compute capability 12.x - [ ] vLLM container/image pulls successfully
- [ ] NVFP4 serve uses
flashinfer_b12xwhen required - [ ]
rondine verify --profile codingpass
Dual Mac (0.2)¶
- [ ]
rondine cluster doctorpasswordless SSH ok - [ ] MLX
mlx.launchJACCL serve works for a catalog MLX repo - [ ] llama.cpp RPC marked experimental; not exposed beyond trusted LAN
Dual Spark (0.2)¶
- [ ] RoCE / ConnectX bandwidth validated (no TCP fallback)
- [ ] NCCL interface pinning set (
NCCL_IB_HCA,MN_IF_NAME, …) - [ ] Ray leader/worker +
vllm serve --tensor-parallel-size 2works