Skip to content

[FEATURE]: LLM Tool Definitions #7320

@isaacwasserman

Description

@isaacwasserman

Package Name

No response

Package Version(s)

No response

Describe the feature you'd like

Tool definitions can often make a up a large portion of token usage and important context for LLM inference, but dd-trace-js doesn't currently instrument this despite it being a part of the OTEL gen_ai specification (gen_ai.tool.definitions). It's also published by many of the frameworks supported by dd-trace-js including the Vercel AI SDK.ai (ai.prompt.tools).

Is your feature request related to a problem?

Tool definitions are not published by the LLM observability plugin for any framework.

Describe alternatives you've considered

These can be manually included in metadata, but this doesn't accurately represent their role.

Additional context

No response

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions