Skip to content

Feat: Ollama integration #118

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
Madzionator wants to merge 5 commits into
base: main
Choose a base branch
from
Open

Feat: Ollama integration #118

Madzionator wants to merge 5 commits into from

Conversation

@Madzionator
Copy link
Collaborator

@Madzionator Madzionator commented Jan 20, 2026

Ollama Backend

  • Added OllamaService – an OpenAI-compatible service for chat completions, including API key management and memory-based chat.
  • Updated configuration (BackendType, MaINSettings) to support Ollama and its API key.
  • Registered OllamaService in the LLM service factory and added API URLs and HTTP client constants.

Application & Examples Integration

  • Integrated Ollama backend selection in the InferPage app, including environment variable support.
  • Added a chat example ChatExampleOllama and registered it in the examples project with dependency injection.

Limitations / Changes

  • MCP integration for Ollama is explicitly disabled (throws an exception).
  • Image generation for Ollama is unsupported (image generation factory returns null).

Dependency Cleanup:

  • Removed several unused or redundant package references from project files

@Madzionator
Ollama text chat & infra page
384758f 
Introduces support for the Ollama backend by updating configuration, service factory, and constants. Adds OllamaService implementing OpenAI-compatible API calls, updates the example project to include a ChatExampleOllama, and provides utility setup for Ollama API key. Also updates InferPage to allow selection and configuration of Ollama as a backend.
@Madzionator
Ollama doesn't support image generation
d3d45a3 
Deleted the OllamaImageGenerations constant from ServiceConstants as it is no longer used. Also, set the Ollama backend to null in ImageGenServiceFactory and cleaned up unused usings in ImageGenService.cs.
@Madzionator
Ollama doesn't support MCP
041738e 
Throws a NotSupportedException when BackendType.Ollama is used with MCP integration, clarifying that Ollama models are not supported. This improves error handling and provides clearer feedback to developers.
@Madzionator
Remove unused and redundant package references
bc422f8 
Cleaned up .csproj files by removing unnecessary and redundant NuGet package references across multiple projects. This reduces build complexity and potential dependency conflicts.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@wisedev-pstach wisedev-pstach Awaiting requested review from wisedev-pstach

At least 1 approving review is required to merge this pull request.

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@Madzionator