gptq

Post-training 4-bit quantization for LLMs with minimal accuracy loss. Use for deploying large models (70B, 405B) on consumer GPUs, when you need 4× memory reduction with <2%…

Industry

software-engineering

License

Unverified

Source repo

Orchestra-Research/AI-Research-SKILLs · ★ 10,718

Source file

10-optimization/gptq/SKILL.md

不会安装？看中文图文教程 →