Local AI platform for running Llama, Mistral, Gemma and more — entirely on your hardware. No cloud, no subscriptions, no data leaving your machine.
uv tool install "git+https://github.com/metiu1/Vortelio#subdirectory=vortelio-pip"
pip install vortelio
From local LLMs to image generation and document processing — Vortelio is the complete AI toolkit that runs on your hardware.
llama.cpp backend, GGUF format. Run Llama 3, Qwen, Mistral, Gemma, Phi and any model from HuggingFace — entirely on your hardware.
Stable Diffusion 1.5 / XL, FLUX.1, Kandinsky via diffusers. Generate images fully offline, no watermarks, no rate limits.
Whisper for speech-to-text transcription. Kokoro and Bark for high-quality text-to-speech synthesis. All offline.
Text-to-video with WAN 2.1, AnimateDiff and CogVideo-X. Generate video clips locally on your GPU.
Image-to-3D and text-to-3D with TripoSR, Shap-E, LGM and TRELLIS. Export meshes directly from your machine.
Drop-in replacement for OpenAI and Ollama endpoints. Works with Cursor, LangChain, LlamaIndex and any compatible tool.
Every line of code is public and auditable on GitHub. Licensed AGPL-3.0 — no black boxes, no hidden telemetry.
Install and run immediately. An account is only required if you want cloud model access.
uv tool install vortelio is all you need. No Docker, no complex setup.
Local models are free forever. Cloud access is optional, monthly, and cancel-anytime.
Free forever for local models. Upgrade when you need cloud access to frontier models.