Skip to content

Add llamaTornado Java 25 single-file launcher with Metal backend support #105

Merged
mikepapadim merged 3 commits intobeehive-lab:mainfrom
AdamBien:main
Apr 11, 2026
Merged

Add llamaTornado Java 25 single-file launcher with Metal backend support #105
mikepapadim merged 3 commits intobeehive-lab:mainfrom
AdamBien:main

Conversation

@AdamBien
Copy link
Copy Markdown
Contributor

Summary

  • Replace (or complement) the Python llama-tornado launcher with llamaTornado, a zero-dependency Java 25 single-file script (#!/usr/bin/env -S java --source 25)
  • Add --metal backend support for TornadoVM 4.0 on Apple Silicon
  • Update README: replace deprecated OpenCL Apple Silicon note with Metal backend section and add llamaTornado usage example

Test plan

  • Run ./llamaTornado --gpu --verbose-init --metal --model <model.gguf> --prompt "what is java" on Apple Silicon
  • Run ./llamaTornado --gpu --opencl --model <model.gguf> --prompt "test" on NVIDIA/Intel GPU
  • Verify ./llamaTornado -help and ./llamaTornado -version output
  • Confirm --show-command prints the full Java invocation without executing

@mikepapadim mikepapadim requested review from mikepapadim and orionpapadakis and removed request for mikepapadim April 11, 2026 15:34
@mikepapadim mikepapadim merged commit 5324c09 into beehive-lab:main Apr 11, 2026
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants