Tiny Language Models List

This list catalogs open-source Tiny Language Models (TLMs), which are small-sized language models. I haven't tested them all yet, but I'm listing them here for reference.

Info

🤚 only GGUF models, Text generation, RAG & Tools (function calling)

Link	Description	Tested
📝 Liquid Nanos	Library of task-specific models
LFM2-1.2B-Extract-GGUF	Extract information from unstructured documents	no
LFM2-350M-Extract-GGUF	Extract information from unstructured documents	no
LFM2-1.2B-RAG-GGUF	Answering questions based on provided documents	no
LFM2-1.2B-Tool-GGUF	Concise and precise tool calling	no
LFM2-350M-Math-GGUF	Tiny reasoning model designed for math problems	no
📝 LFM2	Hybrid models designed for on-device deployment
LFM2-2.6B-GGUF	Hybrid models developed designed for edge AI	🌺
LFM2-1.2B-GGUF	Hybrid models developed designed for edge AI	🌺
LFM2-700M-GGUF	Hybrid models developed designed for edge AI	🌺
LFM2-350M-GGUF	Hybrid models developed designed for edge AI	🌺
📝 Menlo	Menlo Research
Jan-nano-128k-gguf	Deeper research through context understanding	no
💙 Jan-nano-gguf	Excellent function calling and tool integration	🌺
Lucy-128k-ggu	Focused Reasoning + tools	no
💙 Lucy-gguf	Focused Reasoning + tools	🌺
📝 Qwen	Qwen language models
Qwen2.5-0.5B-Instruct-GGUF	Instruction-tuned language model	🌺
Qwen2.5-1.5B-Instruct-GGUF	Instruction-tuned language model	🌺
Qwen2.5-3B-Instruct-GGUF	Instruction-tuned language model	🌺

Note

👋 If you know of others, feel free to open an issue or submit a PR.