// fetch failed
Couldn't render the SKILL.md content here right now. You can view the raw markdown or open the source folder on GitHub.
AI/MLmelodic-software
llm-serving-patterns
LLM inference infrastructure, serving frameworks (vLLM, TGI, TensorRT-LLM), quantization techniques, batching strategies, and streaming response patterns. Use when designing LLM serving infrastructure, optimizing inference latency, or scaling LLM deployments.
- Stars
- 74
- Source
- melodic-software/claude-code-plugins
- Updated
- 2026-04-07
- Slug
- melodic-software--claude-code-plugins--llm-serving-patterns
// install — copy + paste into any project
mkdir -p .claude/skills && curl -fsSL https://raw.githubusercontent.com/melodic-software/claude-code-plugins/HEAD/plugins/systems-design/skills/llm-serving-patterns/SKILL.md -o .claude/skills/llm-serving-patterns.mdDrops the SKILL.md into .claude/skills/llm-serving-patterns.md. Works with Claude Code, Cursor, and any agent that loads SKILL.md files from .claude/skills/.