Adds support for batch mode to reduce cost #59
Description
Some LLM providers support batch mode which can easily reduce LLM cost by 50%. THis feature could be added to help reduce cost greatly
{{ message }}
Some LLM providers support batch mode which can easily reduce LLM cost by 50%. THis feature could be added to help reduce cost greatly