Skip to content

Set use_logprobs=False in ReferenceCompletionTemplate if model doesnt take that param #22

@katwinkl3

Description

@katwinkl3

Gemini models fail with 'litellm.UnsupportedParamsError: gemini does not support parameters: ['top_logprobs'], for model=gemini-1.5-flash' unless ReferenceCompletionTemplate.create's use_logprobs is set to False.

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions