-
Notifications
You must be signed in to change notification settings - Fork 1.7k
Document messages format #2286
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Document messages format #2286
Conversation
|
Mintlify preview ID generated: preview-messag-1768875178-1bbe0c2 |
katmayb
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Couple of suggestions, but lgtm
|
|
||
| - **A LangSmith account**: Sign up or log in at [smith.langchain.com](https://smith.langchain.com). | ||
| - **A LangSmith API key**: Follow the [Create an API key](/langsmith/create-account-api-key#create-an-api-key) guide. | ||
| - **A LangSmith API key**: Create an API key [here](https://smith.langchain.com/settings/apikeys). |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
OK, we don't make this change? It is a better docs practice to spell out the link that a user is going to. We try to avoid "here" where possible for links.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I added manual guidance along with the direct link. Want to make it as easy as possible for people to create an api key
|
Mintlify preview ID generated: preview-messag-1768940705-dd721f5 |
|
Mintlify preview ID generated: preview-messag-1768942621-8d4fe46 |
|
|
||
| **1. Rich debugging experience**: LangSmith provides structured rendering of message lists, making it easier to visualize and understand the conversation history. | ||
|
|
||
| **2. LangSmith features**: Features like [Polly](/langsmith/polly), [LangSmith Fetch](https://github.com/langchain-ai/langsmith-fetch) and [multi-turn evals](/langsmith/online-evaluations#configure-multi-turn-online-evaluators) require properly structured traces to work correctly. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
are you open to calling multi-turn evals "thread evals"? it feels like the more marketable name
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I actually think the opposite - "multi-turn" is used by those building agents, while "threads" is an implementation detail
src/langsmith/tracing-standards.mdx
Outdated
|
|
||
| #### Threads | ||
|
|
||
| A [_**Thread**_](/langsmith/threads) groups multiple interactions together so you can see the conversation history over time. In the LangSmith UI, threads can be viewed in the "Threads" tab within a Tracing Project. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I wonder if we need to go more broad with this definition i.e. what is a thread in the context of a non-conversational agent
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
but if we give such a definition, the next sentence could still be using "conversation" as an example of a type of thread
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Agree, will generalize to just "history" over time
|
Mintlify preview ID generated: preview-messag-1768947382-18caaf8 |
Preview: https://langchain-5e9cc07a-preview-messag-1768947382-18caaf8.mintlify.app/langsmith/tracing-standards