Skip to content

Conversation

@dmchoiboi
Copy link
Contributor

Summary

  • Add concurrent_requests_per_worker to CreateModelEndpointV1Request
  • Add forwarder_type, routes, extra_routes to RunnableImageFlavor
  • Add worker_command, worker_env to RunnableImageFlavor
  • Add nodes_per_worker to endpoint requests
  • Add new models for batch completions v2, chat completion, etc.

This PR corresponds to the changes in https://github.com/scaleapi/models/pull/17091

Test plan

  • Verify the client imports correctly
  • Verify API calls work with the new fields

🤖 Generated with Claude Code

@dmchoiboi dmchoiboi requested a review from a team January 23, 2026 10:29
@dmchoiboi dmchoiboi force-pushed the regenerate-api-client branch from 1c0f82b to 472d286 Compare January 25, 2026 00:28
- Add justfile for schema fetching and client generation
- Regenerate client using OpenAPI Generator 6.4.0
- Schema source: llm-engine/model-engine/specs/openapi-3.0.json

The regeneration process is now:
  just fetch-schema [branch]  # fetch schema from llm-engine
  just generate               # run OpenAPI generator

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
@dmchoiboi dmchoiboi force-pushed the regenerate-api-client branch from 472d286 to c2f7985 Compare January 25, 2026 01:39
dmchoiboi and others added 3 commits January 24, 2026 18:07
- Add justfile for reproducible schema fetching and client generation
- Regenerate client using OpenAPI Generator 6.4.0 with clean model names
- Skip .pyi stub files (have syntax errors due to OpenAPI Generator bug
  where empty nested classes lack 'pass' statement)
- Fix upload_file to use proper BodyUploadFileV1FilesPost type
- Schema source: llm-engine/model-engine/specs/openapi-3.0.json

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
OpenAPI Generator produces documentation with invalid Python syntax
in code examples (e.g., dict("key": value) instead of {"key": value}).
Skip generating these docs since they fail the doc example tests and
aren't critical - the actual code has docstrings for IDE support.

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
New features:
- Regenerated API client from updated OpenAPI schema
- Clean model names for discriminated unions
- Added concurrent_requests_per_worker and other new fields

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
@dmchoiboi dmchoiboi merged commit 365934d into master Jan 25, 2026
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants