A microservice that provides a discoverable API for interacting with a Large Language Model (LLM). The implementation can either directly expose the API of a local LLM model or act as a proxy for an LLM, which contains a non-discoverable API, running in a separate process.
The API documentation is available HERE.
- Download the latest .zip file for the most recent release HERE.
- Unzip the package.
- Locate the unzipped .tar file; this artifact is needed for the edge microservice deployment.
- If you are deploying the edge microservice for the first time, please follow the edge microservice deployment quick start guide.
- For additional information on ai tutorials, please visit mimik ai quickstart tutorials