Update SGLang deployment guide: point to K2.6 cookbook and use stable release

#6
by JustinTong - opened

The SGLang section previously linked to the Kimi-K2.5 cookbook and required a `git+https://github.com/sgl-project/sglang.git\` install from `main`. Kimi-K2.6 now has a dedicated cookbook page and is supported in the SGLang v0.5.10 stable release (available on PyPI), so a nightly/main build is no longer required.

Changes (SGLang section only):

  • Update cookbook URL: Kimi-K2.5 -> Kimi-K2.6 (https://cookbook.sglang.io/autoregressive/Moonshotai/Kimi-K2.6)
  • Replace "latest main" git install with `uv pip install "sglang>=0.5.10.post1" --prerelease=allow` (uv is preferred)
  • Drop the separate `nvidia-cudnn-cu12==9.16.0.29` pin (bundled with the stable wheel)

No changes to vLLM or KTransformers sections.

courage17340 changed pull request status to merged

Sign up or log in to comment