Skip to content

feat(js): capture OpenAI image input and output attributes - #3772

Open
satyadevai wants to merge 2 commits into
Arize-ai:mainfrom
satyadevai:3422-js-openai-image-urls-impl
Open

satyadevai wants to merge 2 commits into
Arize-ai:mainfrom
satyadevai:3422-js-openai-image-urls-impl

Conversation

@satyadevai

@satyadevai satyadevai commented Sep 17, 2026

Copy link
Copy Markdown
Collaborator

Added OpenAI image instrumentation for both OpenAI and OpenAI Agents packages.

Included

  • Captures multiple image inputs using: input.images.N.image.url

  • Captures image outputs using: output.images.N.image.url

  • Supports URL and base64 image outputs.

  • Captures image generation, editing, and variation requests.

  • Captures Responses API image-generation outputs.

  • Prevents image upload reads when hideInputs or hideInputImages is enabled.

  • Ensures rejected image requests record errors and end spans.

  • Added tests, type checks, and lint coverage.

Note: Raw base64 image data is still present in output.value for Images API responses and streaming completion events. The image-specific attributes respect the configured size masking, but output.value may still contain the original b64_json payload. This will be addressed in a separate follow-up ticket.

@satyadevai
satyadevai force-pushed the 3422-js-openai-image-urls-impl branch 2 times, most recently from d9a3f53 to 3a3a0e1 Compare September 18, 2026 12:25
@satyadevai
satyadevai force-pushed the 3422-js-openai-image-urls-impl branch from 3a3a0e1 to 80c1485 Compare September 18, 2026 17:39
@satyadevai
satyadevai marked this pull request as ready for review September 21, 2026 16:58
@satyadevai
satyadevai requested a review from a team as a code owner September 21, 2026 16:58
@satyadevai
satyadevai force-pushed the 3422-js-openai-image-urls-impl branch from cc5db44 to 66c6dd7 Compare September 21, 2026 17:08

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

Status: No status

Development

Successfully merging this pull request may close these issues.

1 participant