Skip to content

feat: add rate limit, monitor, multiple images and input validation for dit.#1483

Merged
xiao-yu-chen merged 1 commit into
jd-opensource:mainfrom
xiao-yu-chen:dit
May 22, 2026
Merged

feat: add rate limit, monitor, multiple images and input validation for dit.#1483
xiao-yu-chen merged 1 commit into
jd-opensource:mainfrom
xiao-yu-chen:dit

Conversation

@xiao-yu-chen
Copy link
Copy Markdown
Collaborator

No description provided.

Copy link
Copy Markdown
Contributor

@gemini-code-assist gemini-code-assist Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request updates the DiT pipeline to support multiple input images by replacing the single condition image with a vector of tensors, affecting the API, request handling, and serialization layers. It also introduces a global flag for maximum image area validation and enhances request latency metrics. Feedback identified a critical bug in the rate-limiting implementation where the request counter is checked but not incremented, potentially causing underflow; a suggestion was made to use an atomic try_acquire mechanism instead.

Comment thread xllm/api_service/image_generation_service_impl.cpp
Comment thread xllm/core/common/help_formatter.h Outdated
@xiao-yu-chen xiao-yu-chen force-pushed the dit branch 2 times, most recently from b6ca7ae to d23ed9b Compare May 21, 2026 10:38
@xiao-yu-chen xiao-yu-chen requested a review from XuZhang99 May 21, 2026 10:49
@xiao-yu-chen xiao-yu-chen merged commit 49ea6c6 into jd-opensource:main May 22, 2026
10 of 33 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants