llama-cpp
Runs LLM inference on CPU, Apple Silicon, and consumer GPUs without NVIDIA hardware. Use for edge deployment, M1/M2/M3 Macs, AMD/Intel GPUs, or when CUDA is unavailable. Supports…
- Industry
- software-engineering
- License
- Unverified
- Source repo
- Orchestra-Research/AI-Research-SKILLs · ★ 10,718
- Source file
- 12-inference-serving/llama-cpp/SKILL.md
不会安装?看中文图文教程 →