response format

[brownsarahm]

No description provided.

[AymanBx]

@brownsarahm
When testing, I'm noticing discrepancies in the response format that might make it difficult to extract the response from the json log file.

Running the same prompt twice, the LLM adds \n to the response, but not inside the answer value rather around it as well.

answer being the key in :

class StringAnswer(BaseModel):
    answer: str

Is this something I should worry about or just move on from it?

[brownsarahm]

we can strip text later to deal with that, we should move on

[AymanBx]

@brownsarahm
bedrock's invoke_model API doesn't include a format parameter Here are the docs.

Through testing I found a couple of issues that I will create issues for