Skip to content

Missing "unknown" option for quantization on OpenRouter provider #26

Open
Open
Missing "unknown" option for quantization on OpenRouter provider#26

Description

@Shoalstone
Shoalstone
opened on Oct 22, 2024

Currently, there is no "unknown" option for quantization from the OpenRouter provider, so models like mistralai/mixtral-8x7b without known quantization do not work

Screenshot 2024-10-22 at 3 18 14 PM Screenshot 2024-10-22 at 3 18 38 PM

Activity

  1. veryvanya commented on Oct 25, 2024

    @veryvanya
    veryvanya
    on Oct 25, 2024

    can't get open-router models in because of that (https://github.com/user-attachments/assets/33571623-fcd1-4013-b4db-baf8147728ba)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions