Air.rs 70B+ inference on consumer GPU, LLM inference in Rust
open-source ai inference llama lora instruction-set finetune open-source-models open-models llm generative-ai instruct-gpt ggml qlora indian-nlp indian-llm
-
Updated
Apr 1, 2026 - Rust