Request: AI Route should use Vercel AI SDK to be agent-agnostic

[sgarfinkel]

Rather than depend on the Claude SDK directly, it would be handy if HyperDX was agent agnostic via the https://ai-sdk.dev.

[brandon-pereira]

Hey @sgarfinkel, Great point! We actually do use the AI SDK already. Our bandwidth for AI features is just pretty limited at the moment, so we prioritized adding support for the LLM providers we actively use internally. We also support AWS Bedrock in our enterprise deployment.

That said, I completely agree with the goal of making things more agent-agnostic. The main complexity comes from the differences in model capabilities (e.g., structured outputs & tool calling are currently OpenAI-only per the AI SDK docs). As long as we design around the common supported surface area, though, this should definitely be achievable.

If there’s a specific model you’re hoping to use, let us know! And if you have capacity to contribute support, I’m more than happy to help make sure the implementation stays model-agnostic and extensible.

https://github.com/hyperdxio/hyperdx/blob/main/packages/api/src/routers/api/ai.ts#L284
https://github.com/hyperdxio/hyperdx/blob/main/packages/api/src/routers/api/ai.ts#L13