post evidence durability

[whoabuddy]

Evidence durability

We get just over 2k characters in the message we store for each contribution, we could include the X post but need to adjust how much text can be added as well. Would require some UI changes but should be possible since we fetch and display the post anyway. Something like:

1. require X link before contribution text
2. add X post text to the contribution
3. allow remaining room to fill in description
4. submit contribution

If we want to adjust growth weight same as confidence rule that falls under prompt refinement. Main three levers right now are prompt structure, which LLM (switching back to Grok), and then parameters like temperature.

Feedback on acceptance criteria:

• identical JSON is unlikely, valid JSON on every run is our target right now
• schema validation already happens, if LLM doesn't return json it errors
• vector store can likely be removed at this point, needs more research
• injection we have a prompt section to address this, needs testing

Originally posted by @whoabuddy in aibtcdev/aibtcdev-backend#536 (comment)

[biwasxyz]

After updating the contribution submission for latest challenge the description includes the X post and the link only with no field for users to add the description.

What should we do if the X post exceeds the character limit?

[whoabuddy]

We can truncate it at that point, the overall limit is 2043 characters I believe - so not expecting to hit that limit.

Can we pass the image URL as well as part of the content? Just something simple on the end if it's detected like:
X Post Image: https://t.co/asdfadfadsfa

That gives the LLM another place/reference to make sure it gets looked up.

[biwasxyz]

Can the llm lookup and access the image though if we provide the link?