Skip to content

Replace CycleState with request attributes (#288) - #294

Open
szedan-rh wants to merge 1 commit into
llm-d:mainfrom
szedan-rh:szedan-rh/288-request-attributes-remove-cyclestate
Open

szedan-rh wants to merge 1 commit into
llm-d:mainfrom
szedan-rh:szedan-rh/288-request-attributes-remove-cyclestate

Conversation

@szedan-rh

Copy link
Copy Markdown
Contributor

Store plugin-shared data directly on InferenceRequest via a sync.Map
attribute store, matching EPP's pattern. Pass request to response plugin
signatures so they can read attributes set during request phase.
Delete cycle_state.go entirely.

/kind cleanup

  Store plugin-shared data directly on InferenceRequest via a sync.Map
  attribute store, matching EPP's pattern. Pass request to response plugin
  signatures so they can read attributes set during request phase.
  Delete cycle_state.go entirely.

Signed-off-by: szedan <szedan@redhat.com>
@github-actions github-actions Bot added size/L Denotes a PR that changes 100-499 lines, ignoring generated files. kind/cleanup Categorizes issue or PR as related to cleaning up code, process, or technical debt. labels Aug 12, 2026

@ArshVermaGit ArshVermaGit left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could you please add verification for this cleanup? Since this removes cycle_state.go and changes how request-scoped attributes are stored/read through InferenceRequest, it would be good to confirm the related request/response paths and plugin attribute access still work as expected. Also, please clarify whether this PR should be merged together with #288 or independently.

@szedan-rh

Copy link
Copy Markdown
Contributor Author

@nirrozenbaum - could you please review?

@github-actions

Copy link
Copy Markdown

This PR is marked as stale after 21d of inactivity. After an additional 14d of inactivity (7d to become rotten, then 7d more), it will be closed. To prevent this PR from being closed, add a comment or remove the lifecycle/stale label.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

kind/cleanup Categorizes issue or PR as related to cleaning up code, process, or technical debt. lifecycle/stale size/L Denotes a PR that changes 100-499 lines, ignoring generated files.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants