io.github.AIops-tools
inference-aiops
Inference AIops
Governed GPU inference ops (vLLM + Ray Serve): latency RCA, scaling, drain, 30 tools.
stdiocommunityinfra
Package Details
inference-aiops
Transportstdio
Governed GPU inference ops (vLLM + Ray Serve): latency RCA, scaling, drain, 30 tools.