Untethered LLM · Model guide

Best Small AI Models for iPhone (GGUF) | Untethered LLM

Every model below is 6B parameters or smaller and runs with llama.cpp, the same runtime inside the app. Huihui Qwen3 4B Abliterated ships with Untethered LLM as the built-in default, with Qwen3 4B as a second bundled model; anything else on this list can be imported as a GGUF file. Sizes are approximate, and the RAM figures are what the phone needs free.

Eight models checked against iPhone-class RAM budgets
Model Size & needs Notes
Qwen3 4B
Qwen/Qwen3-4B-GGUF
4B · Q5_K_M · ~2.9 GB · 8 GB+ iPhones A top all-round iPhone model that also ships with the app as the second bundled model: strong chat, reasoning, and tool use.
Gemma 3 4B
unsloth/gemma-3-4b-it-GGUF
4B · Q4_K_M · ~2.5 GB · 8 GB+ iPhones Google's efficient 4B instruction model; clean answers and good multilingual coverage.
Phi-4 Mini
unsloth/Phi-4-mini-instruct-GGUF
3.8B · Q4_K_M · ~2.4 GB · 8 GB+ iPhones Microsoft's compact reasoner; strong math and step-by-step tasks.
Llama 3.2 3B
unsloth/Llama-3.2-3B-Instruct-GGUF
3B · Q4_K_M · ~1.9 GB · 6 GB+ iPhones Meta's small chat model; a balanced pick for older iPhones.
Qwen2.5 3B
Qwen/Qwen2.5-3B-Instruct-GGUF
3B · Q4_K_M · ~1.9 GB · 6 GB+ iPhones Previous-generation Qwen; fast and reliable for everyday chat.
Qwen3 1.7B
Qwen/Qwen3-1.7B-GGUF
1.7B · Q4_K_M · ~1.1 GB · 6 GB+ iPhones Tiny and quick; best for background use and low-memory devices.
SmolLM2 1.7B
HuggingFaceTB/SmolLM2-1.7B-Instruct-GGUF
1.7B · Q4_K_M · ~1.1 GB · 6 GB+ iPhones Featherweight Hugging Face model; sips battery and memory.
DeepSeek-R1 Distill 1.5B
lmstudio-community/DeepSeek-R1-Distill-Qwen-1.5B-GGUF
1.5B · Q4_K_M · ~1.0 GB · 6 GB+ iPhones Reasoning-distilled for puzzles and logic; thinks before answering.

Legal map

The app's own policies are separate from bundled third-party software and bundled model license terms, but the pages below link to each other for clarity.

Our app policies

Third-party policies