deployment
Serve a quantized or unquantized LLM checkpoint as an OpenAI-compatible API endpoint using vLLM, SGLang, or TRT-LLM. Use when user says "deploy model", "serve model", "start vLLM server", "launch SGLang", "TRT-LLM deploy", "AutoDeploy", "benchmark throughput", "serve checkpoint", or needs an inference endpoint from a HuggingFace or ModelOpt-quantized checkpoint. Do NOT use for quantizing models (use ptq) or evaluating accuracy (use evaluation).
Why this score
This repo hosts 10 skills, so its 5,374 stars are split between them (about 537 each) for scoring.
Popularity score: 77/100 from public GitHub signals only. It shows how widely used and maintained this is, not how well it works. Not included yet: the fake-star check. The security scan is shown separately and doesn't change the score. How we rank
Security
Scanned Oct 21, 2026 at commit f1d68fd4dd50, with Cisco's open-source skill-scanner.
What its code does:
- Runs shell commands Common for dev tools. Read the commands it runs.scripts/deploy.sh:202
- Downloads content and runs it Whatever it downloads can change after we scanned it.SKILL.md:188, scripts/deploy.sh:438
A scan lists patterns in the code. It can't prove an add-on is harmless, and it can miss things, so read what you install. How we scan
Alternatives
Other makers' add-ons that do the same job, next to this one.
| Name | Score | Stars | Context | Updated |
|---|---|---|---|---|
| This onedeployment NVIDIA/Model-Optimizer · Skill | 77 | ★ 5.4k | ≈115 always | 16d ago |
| local-deployment bionic-gpt/bionic-gpt · Skill Both about deployment and deploy | 73 | ★ 2.4k | ≈45 always | 28d ago |
| devops/deployment-process echoVic/boss-skill · Skill Both about deployment | 65 | ★ 543 | ≈12 always | 17d ago |
| docker-deployment fossasia/eventyay · Skill Both about deployment | 73 | ★ 1.7k | ≈16 always | 16d ago |
| container-native-deployment rrezartprebreza/spring-boot-skills · Skill Both about deployment | 64 | ★ 315 | ≈30 always | 18d ago |
| mcloud-deployments medusajs/medusa-agent-skills · Skill Both about deployment | 53 | ★ 234 | ≈60 always | 20d ago |