~ / skills / software-engineering / gguf-quantization

gguf-quantization

GGUF format and llama.cpp quantization for efficient CPU/GPU inference. Use when deploying models on consumer hardware, Apple Silicon, or when needing flexible quantization from…

Industry: software-engineering
License: Unverified
Source repo: Orchestra-Research/AI-Research-SKILLs · ★ 10,718
Source file: 10-optimization/gguf/SKILL.md

View full SKILL.md on GitHub →

不会安装？看中文图文教程 →