Skip to content

SGLang

SGLang is a model-serving engine with an OpenAI-compatible service surface and its own runtime-native graph/DSL features. LychD binds the declared service through the Soulstone adapter; it does not require the caller to depend on sgl.gen or any other SGLang-specific language.

You supply the complete SGLang launch command in the Rune's operator-owned exec passthrough. Typed fields keep the container and endpoint declaration. The registered OpenAICompatibleRuntimeAdapter binds that declared service; it cannot derive an SGLang program from a generic endpoint. Align the command's listening port and served model with the declared endpoint and model identity.

Pin framework flags with that command and include them in the exact engine profile and runtime receipt. Neither a healthy URL nor a generic compatibility label establishes every declared model or API operation.

The exact image, model, quantization, GPU and driver, launch arguments, readiness, inference, and shutdown still require an operator receipt. The current delivery boundary is recorded under SGLang integration.

See Soulstone Disciplines, SGLang, and the OpenAI-compatible connector boundary.