Selfhosting and AI nerd from Germany 🇩🇪
I play Minecraft, RPGs and survival games, and I build things around them.
- 🧪 Piggidragon/llama.cpp: llama.cpp fork with quantized-native FlashAttention, prompt cache in RAM and on disk, smarter speculative decoding and multi-GPU over PCIe — faster long-context inference on unbalanced GPU pairs.
- 🤖 Pithagoras: together with Codacus I overhauled this AI agent portal almost end to end — the shared Documents feature, the 3D memory graph, voice mode, images, Signal as a channel, theming and a lot of the portal settings.
- 🦀 Nerve-Protocol: two Rust binaries, one MCP server. Let any agent reach any remote device with granular permission control — no uncontrollable SSH.
- ⚡ optllama: a llama.cpp fork that I contribute to, focused on KV cache offload to RAM, unbalanced dual-GPU setups and partial KV cache residency.
- 🧩 OpenWebUI-plugins: tools, functions and pipes for Open WebUI.
- ⛏️ Minecraft modding with NeoForge: a magic and dimension mod, plus an Ender Dragon fight overhaul.
| Project | What I contributed |
|---|---|
| generelschwerz/llama.cpp (optllama) | Host-resident KV cache: pipelined delivery, head-split cache under split mode tensor, partial KV residency budget on the slowest link first. Multi-GPU: attention split separate from the tensor split, tied output projection split, meta transport ring per device share. CUDA: quantized-native MMA FlashAttention. Also: DFlash speculative decoding, llama-bench placement and sweep flags, scheduler fixes and the arch-coverage test suite |
| thecodacus/pithagoras | The Documents feature (shared Markdown store with git history, comment threads with @agent, word-processor editor, uploads), the 3D memory graph and Librarian chat, voice mode (orb, push-to-talk, own models), image generation and editing with gallery and viewer, the Signal channel, theming (Warm/Dusk folded into the themes extension), portal password/OIDC/updates settings, test hardening, upstream merges and release fixes — alongside Codacus's core work |
Ask me about selfhosting, local AI, agents and Minecraft modding.