Skip to content

[WIP] Initial work to add llm-d-vllm framework with H200 #1660

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
ezrasilvera wants to merge 8 commits into
base: main
Choose a base branch
from

[NV] llm-d: have every rank wait for its own vLLM /health before fall…

95b8b2f
Select commit
Loading
Failed to load commit list.
Open

[WIP] Initial work to add llm-d-vllm framework with H200 #1660

[NV] llm-d: have every rank wait for its own vLLM /health before fall…
95b8b2f
Select commit
Loading
Failed to load commit list.
Cursor / Cursor Bugbot succeeded Jun 4, 2026 in 2m 27s

Bugbot Review

Bugbot Analysis Progress (2m 31s elapsed)

✅ Gathered PR context (3s)
✅ Completed bug detection (2m 23s)
✅ Posted analysis results (5s)

Final Result: Bugbot completed review - no new issues found! ✅

Request ID: serverGenReqId_fda333a7-5447-4804-8fed-a57191c726aa

Details

View more details on Cursor