Skip to content

Verify and add tests for quantization support #16

@yairallouche

Description

@yairallouche

The GraniteSwitch model loading should be evaluated in quantized mode:

  • Verify that the GraniteSwitch model properly loads in quantized mode
  • Provide test coverage for quantized loading

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions