test: unit tests for vLLM exception handling (#432) [DO NOT MERGE]

[planetf1]

Misc PR

Type of PR

• Bug Fix
• New Feature
• Documentation
• Other

Description

• Link to Issue: Backends don't handle exceptions properly during generation #432

DRAFT to share ideas on potential additional tests to validate backend exception handling.

DO NOT MERGE

Note that this test is designed to fail - currently. It addresses a gap in our testing where we have a known bug in #432

Testing

• Tests added to the respective file if code was changed
• New code has 100% coverage if code as added
• Ensure existing tests and github automation passes (a maintainer will kick off the github automation when the rest of the PR is populated)

[mergify]

Merge Protections

Your pull request matches the following merge protections and will not be merged until they are valid.

🟢 Enforce conventional commit

Wonderful, this rule succeeded.

Make sure that we follow https://www.conventionalcommits.org/en/v1.0.0/

• title ~= ^(fix|feat|docs|style|refactor|perf|test|build|ci|chore|revert|release)(?:\(.+\))?:

[github-actions]

The PR description has been updated. Please fill out the template for your PR to be reviewed.