~ / skills / software-engineering / sglang

sglang

Fast structured generation and serving for LLMs with RadixAttention prefix caching. Use for JSON/regex outputs, constrained decoding, agentic workflows with tool calls, or when…

Industry: software-engineering
License: Unverified
Source repo: Orchestra-Research/AI-Research-SKILLs · ★ 10,718
Source file: 12-inference-serving/sglang/SKILL.md

View full SKILL.md on GitHub →

不会安装？看中文图文教程 →