Skip to content

feat: support chat_template_kwargs in chat completions.#49

Merged
RobbieLeung merged 1 commit into
jd-opensource:mainfrom
JimHsiung:feat/chat_template_kwargs
Mar 24, 2026
Merged

feat: support chat_template_kwargs in chat completions.#49
RobbieLeung merged 1 commit into
jd-opensource:mainfrom
JimHsiung:feat/chat_template_kwargs

Conversation

@JimHsiung
Copy link
Copy Markdown
Collaborator

No description provided.

Copy link
Copy Markdown

@gemini-code-assist gemini-code-assist Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

The pull request successfully introduces support for chat_template_kwargs in chat completions, enhancing the flexibility of chat template application. The changes are well-integrated across the JinjaChatTemplate class, the Request struct, and the HTTP service and scheduler components. A new test case has also been added to validate this functionality. The overall implementation correctly extends the existing chat template mechanism.

Comment thread xllm_service/chat_template/jinja_chat_template.cpp
Comment thread xllm_service/chat_template/jinja_chat_template.cpp
Comment thread xllm_service/chat_template/jinja_chat_template.cpp
Comment thread xllm_service/chat_template/jinja_chat_template.cpp
Comment thread xllm_service/chat_template/jinja_chat_template.h
Copy link
Copy Markdown
Collaborator

@yq33victor yq33victor left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@RobbieLeung RobbieLeung merged commit c42c48e into jd-opensource:main Mar 24, 2026
1 check passed
@JimHsiung JimHsiung deleted the feat/chat_template_kwargs branch March 24, 2026 07:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants