Download pre-quantized GGUF models for local execution with the SwarmAgents engine. All models are optimized for Apple Silicon (Metal) and compatible with llama.cpp and Ollama.
1. Install Ollama: curl -fsSL https://ollama.com/install.sh | sh
2. Pull a model: ollama pull swarm-worker-v3
3. Or download the GGUF directly and use with llama.cpp.
4. Point the SwarmAgents engine at your local Ollama instance via OLLAMA_URL.
Fine-tuned DAG execution worker — deterministic task completion for the SwarmAgents orchestration layer. Optimized for code generation, data transformation, and tool use in a leaf-node DAG architecture. Primary worker model for the Swarm Orchestrator.
General-purpose reasoning model for local execution. Strong at reasoning, math, and coding tasks. Fallback worker model.
High-capacity local reasoning model for complex tasks. Used for the most demanding local workloads.
Google Gemma 4 instruction-tuned model. Balanced performance for reasoning and generation tasks.
Massive 70B ternary distilled model for the most demanding reasoning tasks. Requires significant VRAM.
Need a different quantization or format?
View on Hugging Face