Local LLM Tools
GGUF, local-inference, agent, and tool records for builders running AI locally.
Focused lists make the catalog useful immediately while mirror hosting remains selective and reviewed.
- Multi-Source AI Popular non-Hugging Face records from ModelScope, GitHub, arXiv, OpenML, Zenodo, Dataverse, DataCite, and other indexed open-source AI sources.
- New Open Source Recently updated public open AI artifacts across every indexed source.
How this ranks. The order uses the recorded signals described above. Runtime and verification details live on each model’s record. Self-reported evidence has no trust or ranking impact.
Mirror candidate means the files still live upstream, not on our servers yet. Hosted files do not establish a complete runnable model. Download counts, where recorded, are downloads on Hugging Face.
Showing stale catalog ·
| Type | Model | Recorded size | Downloads | Updated |
|---|---|---|---|---|
Yi 1.5 6BMaziyarPanahi/Yi-1.5-6B-Chat-GGUFThe catalog lists this model for having conversations. Catalog sources: license label, publisher tags, task label.Content controls: not assessed.DetailsThe catalog lists this model for having conversations.Source: MaziyarPanahi on Hugging Face. File format: GGUF. GGUF files use llama.cpp-compatible runners.
| 3.67 GB | 146,352 downloads on Hugging Face | 2026-07-11 | |
Ornith 1.0 35Bornith-ai/Ornith-1.0-35B-GGUFThe catalog lists this model for having conversations. Catalog sources: license label, publisher tags, task label.Content controls: not assessed.DetailsThe catalog lists this model for having conversations.Source: ornith-ai on Hugging Face. File format: GGUF. GGUF files use llama.cpp-compatible runners.
| 21.2 GB | 3,755,106 downloads on Hugging Face | 2026-09-18 | |
Ornith 1.0 9Bornith-ai/Ornith-1.0-9B-GGUFThe catalog lists this model for having conversations. Catalog sources: license label, publisher tags, task label.Content controls: not assessed.DetailsThe catalog lists this model for having conversations.Source: ornith-ai on Hugging Face. File format: GGUF. GGUF files use llama.cpp-compatible runners.
| 5.63 GB | 4,907,682 downloads on Hugging Face | 2026-08-18 | |
Qwythos 9B Claude Mythos 5 1Mempero-ai/Qwythos-9B-Claude-Mythos-5-1M-GGUFThe catalog lists this model for generating text from images and text. Catalog sources: license label, task label.Content controls: not assessed.DetailsThe catalog lists this model for generating text from images and text.See the publisher’s description →Source: empero-ai on Hugging Face. File format: GGUF. GGUF files use llama.cpp-compatible runners.
| 96.2 GB | 907,682 downloads on Hugging Face | 2026-07-14 | |
GLM 4.7 Flashunsloth/GLM-4.7-Flash-GGUFThe catalog lists this model for having conversations. Catalog sources: license label, publisher tags, task label.Content controls: not assessed.DetailsThe catalog lists this model for having conversations.Source: unsloth on Hugging Face. File format: GGUF. GGUF files use llama.cpp-compatible runners.
| 520.1 GB | 113,568 downloads on Hugging Face | 2026-07-08 | |
sarashina2 70Bmradermacher/sarashina2-70b-GGUFThe catalog does not give enough information to describe what this model is for. Catalog sources: license label.Content controls: not assessed.DetailsThe catalog does not give enough information to describe what this model is for.See the publisher’s description →Source: mradermacher on Hugging Face. File format: GGUF. GGUF files use llama.cpp-compatible runners.
| 477.9 GB | 27 downloads on Hugging Face | 2026-07-06 | |
Qwen3.6 35B A3B Uncensored HauhauCS AggressiveHauhauCS/Qwen3.6-35B-A3B-Uncensored-HauhauCS-AggressiveThe catalog lists this model for generating text from images and text. Catalog sources: license label, task label.Content controls: not assessed.DetailsThe catalog lists this model for generating text from images and text.See the publisher’s description →Source: HauhauCS on Hugging Face. File format: GGUF. GGUF files use llama.cpp-compatible runners.
| 21.2 GB | 3,089,950 downloads on Hugging Face | 2026-04-17 | |
mxbai embed large v1mixedbread-ai/mxbai-embed-large-v1The catalog lists this model for finding useful details in data. Catalog sources: license label, task label.Content controls: not assessed.DetailsThe catalog lists this model for finding useful details in data.Source: mixedbread-ai on Hugging Face. File format: GGUF, Safetensors, ONNX, BIN. GGUF files use llama.cpp-compatible runners.
| 669.6 MB | 5,778,239 downloads on Hugging Face | 2026-01-23 | |
GLM 4.5 Air AWQ 4bitcyankiwi/GLM-4.5-Air-AWQ-4bitThe catalog lists this model for having conversations. Catalog sources: license label, publisher tags, task label.Content controls: not assessed.DetailsThe catalog lists this model for having conversations.Source: cyankiwi on Hugging Face. File format: Safetensors.
| 63.4 GB | 675,519 downloads on Hugging Face | 2026-07-08 | |
Qwen3 vl 32B thinkingwangkanai/qwen3-vl-32b-thinkingThe catalog lists this model for generating text from images and text. Catalog sources: license label, task label.Content controls: not assessed.DetailsThe catalog lists this model for generating text from images and text.See the publisher’s description →Source: wangkanai on Hugging Face. File format: GGUF, Safetensors. GGUF files use llama.cpp-compatible runners.
| 186.8 GB | 53 downloads on Hugging Face | 2025-11-05 | |
gemma 4 26B A4B it AWQ 4bitcyankiwi/gemma-4-26B-A4B-it-AWQ-4bitThe catalog lists this model for generating text from images and text. Catalog sources: license label, task label.Content controls: not assessed.DetailsThe catalog lists this model for generating text from images and text.See the publisher’s description →Source: cyankiwi on Hugging Face. File format: Safetensors.
| 17.2 GB | 4,713,883 downloads on Hugging Face | 2026-09-10 | |
dolphin 2.9.1 yi 1.5 34Bdphn/dolphin-2.9.1-yi-1.5-34bThe catalog lists this model for having conversations. Catalog sources: license label, publisher tags, task label.Content controls: not assessed.DetailsThe catalog lists this model for having conversations.Source: dphn on Hugging Face. File format: Safetensors.
| 68.8 GB | 4,583,926 downloads on Hugging Face | 2025-09-08 | |
Qwen2.5 1.5BQwen/Qwen2.5-1.5B-InstructThe catalog lists this model for having conversations. Catalog sources: license label, publisher tags, task label.Content controls: not assessed.DetailsThe catalog lists this model for having conversations.Source: Qwen on Hugging Face. File format: Safetensors.
| 3.09 GB | 11,843,503 downloads on Hugging Face | 2024-09-25 | |
Qwen2.5 14BQwen/Qwen2.5-14B-InstructThe catalog lists this model for having conversations. Catalog sources: license label, publisher tags, task label.Content controls: not assessed.DetailsThe catalog lists this model for having conversations.Source: Qwen on Hugging Face. File format: Safetensors.
| 29.5 GB | 2,165,672 downloads on Hugging Face | 2026-09-18 | |
TinyLlama 1.1BTinyLlama/TinyLlama-1.1B-Chat-v1.0The catalog lists this model for having conversations. Catalog sources: license label, publisher tags, task label.Content controls: not assessed.DetailsThe catalog lists this model for having conversations.Source: TinyLlama on Hugging Face. File format: Safetensors.
| 2.2 GB | 2,182,223 downloads on Hugging Face | 2026-08-17 | |
internlm3 8Binternlm/internlm3-8b-instructThe catalog lists this model for having conversations. Catalog sources: license label, publisher tags, task label.Content controls: not assessed.DetailsThe catalog lists this model for having conversations.Source: internlm on Hugging Face. File format: Safetensors.
| 17.6 GB | 77,496 downloads on Hugging Face | 2026-07-08 | |
DeepSeek R1 0528 Qwen3 8Bdeepseek-ai/DeepSeek-R1-0528-Qwen3-8BThe catalog lists this model for having conversations. Catalog sources: license label, publisher tags, task label.Content controls: not assessed.DetailsThe catalog lists this model for having conversations.Source: deepseek-ai on Hugging Face. File format: Safetensors.
| 16.4 GB | 1,006,934 downloads on Hugging Face | 2025-05-29 | |
Qwen3 1.7BQwen/Qwen3-1.7BThe catalog lists this model for having conversations. Catalog sources: license label, publisher tags, task label.Content controls: not assessed.DetailsThe catalog lists this model for having conversations.Source: Qwen on Hugging Face. File format: Safetensors.
| 4.06 GB | 5,748,993 downloads on Hugging Face | 2026-07-27 | |
GLM 4.7 Flashzai-org/GLM-4.7-FlashThe catalog lists this model for having conversations. Catalog sources: license label, publisher tags, task label.Content controls: not assessed.DetailsThe catalog lists this model for having conversations.Source: zai-org on Hugging Face. File format: Safetensors.
| 62.4 GB | 2,316,066 downloads on Hugging Face | 2026-09-20 | |
Qwen3 32BQwen/Qwen3-32BThe catalog lists this model for having conversations. Catalog sources: license label, publisher tags, task label.Content controls: not assessed.DetailsThe catalog lists this model for having conversations.Source: Qwen on Hugging Face. File format: Safetensors.
| 65.5 GB | 4,268,558 downloads on Hugging Face | 2025-07-26 | |
distilgpt2distilbert/distilgpt2The catalog lists this model for generating text. Catalog sources: license label, task label.Content controls: not assessed.DetailsThe catalog lists this model for generating text.Source: distilbert on Hugging Face. File format: BIN.
| 3.16 GB | 3,391,450 downloads on Hugging Face | 2024-02-19 | |
bart large mnlifacebook/bart-large-mnliThe catalog lists this model for sorting text into categories you choose. Catalog sources: license label, task label.Content controls: not assessed.DetailsThe catalog lists this model for sorting text into categories you choose.See the publisher’s description →Source: facebook on Hugging Face. File format: Safetensors, BIN.
| 6.93 GB | 3,262,117 downloads on Hugging Face | 2026-08-07 | |
bart large cnnfacebook/bart-large-cnnThe catalog lists this model for summarizing text. Catalog sources: license label, task label.Content controls: not assessed.DetailsThe catalog lists this model for summarizing text.Source: facebook on Hugging Face. File format: Safetensors, BIN.
| 8.54 GB | 1,550,664 downloads on Hugging Face | 2026-08-07 | |
distilbert base uncaseddistilbert/distilbert-base-uncasedThe catalog lists this model for filling in missing words in text. Catalog sources: license label, task label.Content controls: not assessed.DetailsThe catalog lists this model for filling in missing words in text.Source: distilbert on Hugging Face. File format: Safetensors, BIN, H5.
| 1.53 GB | 8,842,288 downloads on Hugging Face | 2024-05-06 | |
chronos bolt smallautogluon/chronos-bolt-smallThe catalog lists this model for predicting how numbers may change over time. Catalog sources: license label, task label.Content controls: not assessed.DetailsThe catalog lists this model for predicting how numbers may change over time.See the publisher’s description →Source: autogluon on Hugging Face. File format: Safetensors.
| 190.9 MB | 13,736,178 downloads on Hugging Face | 2025-10-30 | |
chronos 2autogluon/chronos-2The catalog lists this model for predicting how numbers may change over time. Catalog sources: license label, task label.Content controls: not assessed.DetailsThe catalog lists this model for predicting how numbers may change over time.See the publisher’s description →Source: autogluon on Hugging Face. File format: Safetensors.
| 477.9 MB | 8,152,822 downloads on Hugging Face | 2026-06-05 | |
MiniMax M1 40kMiniMaxAI/MiniMax-M1-40kThe catalog lists this model for having conversations. Catalog sources: license label, publisher tags, task label.Content controls: not assessed.DetailsThe catalog lists this model for having conversations.Source: MiniMaxAI on Hugging Face. File format: Safetensors.
| 912.2 GB | 48,198 downloads on Hugging Face | 2026-07-06 | |
DeepSeek V4 Flash EAGLE3.1ManiacLabs/DeepSeek-V4-Flash-EAGLE3.1The catalog lists this model for generating text. Catalog sources: license label, task label.Content controls: not assessed.DetailsThe catalog lists this model for generating text.Source: ManiacLabs on Hugging Face. File format: BIN.
| 1.86 GB | 262 downloads on Hugging Face | 2026-07-06 | |
Ornith 1.0 35Bornith-ai/Ornith-1.0-35BThe catalog lists this model for having conversations. Catalog sources: license label, publisher tags, task label.Content controls: not assessed.DetailsThe catalog lists this model for having conversations.Source: ornith-ai on Hugging Face. File format: Safetensors.
| 70.3 GB | 2,670,126 downloads on Hugging Face | 2026-06-25 | |
Qwen2.5 VL 7BQwen/Qwen2.5-VL-7B-InstructThe catalog lists this model for generating text from images and text. Catalog sources: license label, task label.Content controls: not assessed.DetailsThe catalog lists this model for generating text from images and text.See the publisher’s description →Source: Qwen on Hugging Face. File format: Safetensors.
| 16.6 GB | 9,643,213 downloads on Hugging Face | 2025-04-06 | |
Qwen2 VL 2BQwen/Qwen2-VL-2B-InstructThe catalog lists this model for generating text from images and text. Catalog sources: license label, task label.Content controls: not assessed.DetailsThe catalog lists this model for generating text from images and text.See the publisher’s description →Source: Qwen on Hugging Face. File format: Safetensors.
| 4.42 GB | 3,696,917 downloads on Hugging Face | 2025-01-12 | |
Qwen3 VL 4BQwen/Qwen3-VL-4B-InstructThe catalog lists this model for generating text from images and text. Catalog sources: license label, task label.Content controls: not assessed.DetailsThe catalog lists this model for generating text from images and text.See the publisher’s description →Source: Qwen on Hugging Face. File format: Safetensors.
| 8.88 GB | 4,037,454 downloads on Hugging Face | 2025-10-15 | |
Qwen Image EditQwen/Qwen-Image-EditThe catalog lists this model for transforming images. Catalog sources: license label, task label.Content controls: not assessed.DetailsThe catalog lists this model for transforming images.See the publisher’s description →Source: Qwen on Hugging Face. File format: Safetensors.
| 57.7 GB | 71,028 downloads on Hugging Face | 2026-07-08 | |
DeepSeek OCR 2deepseek-ai/DeepSeek-OCR-2The catalog lists this model for generating text from images and text. Catalog sources: license label, task label.Content controls: not assessed.DetailsThe catalog lists this model for generating text from images and text.See the publisher’s description →Source: deepseek-ai on Hugging Face. File format: Safetensors.
| 6.78 GB | 3,202,247 downloads on Hugging Face | 2026-02-03 | |
Qwen3.6 35B A3B FP8Qwen/Qwen3.6-35B-A3B-FP8The catalog lists this model for generating text from images and text. Catalog sources: license label, task label.Content controls: not assessed.DetailsThe catalog lists this model for generating text from images and text.See the publisher’s description →Source: Qwen on Hugging Face. File format: Safetensors.
| 37.5 GB | 5,970,883 downloads on Hugging Face | 2026-04-24 | |
Qwen3.6 27B FP8Qwen/Qwen3.6-27B-FP8The catalog lists this model for generating text from images and text. Catalog sources: license label, task label.Content controls: not assessed.DetailsThe catalog lists this model for generating text from images and text.See the publisher’s description →Source: Qwen on Hugging Face. File format: Safetensors.
| 30.9 GB | 4,849,030 downloads on Hugging Face | 2026-04-24 | |
Qwen2 VL 7BQwen/Qwen2-VL-7B-InstructThe catalog lists this model for generating text from images and text. Catalog sources: license label, task label.Content controls: not assessed.DetailsThe catalog lists this model for generating text from images and text.See the publisher’s description →Source: Qwen on Hugging Face. File format: Safetensors.
| 16.6 GB | 1,823,883 downloads on Hugging Face | 2025-02-06 | |
Qwen3.6 27BQwen/Qwen3.6-27BThe catalog lists this model for generating text from images and text. Catalog sources: license label, task label.Content controls: not assessed.DetailsThe catalog lists this model for generating text from images and text.See the publisher’s description →Source: Qwen on Hugging Face. File format: Safetensors.
| 55.6 GB | 5,397,182 downloads on Hugging Face | 2026-04-24 | |
text2vec base chineseshibing624/text2vec-base-chineseThe catalog lists this model for checking whether two sentences mean similar things. Catalog sources: license label, task label.Content controls: not assessed.DetailsThe catalog lists this model for checking whether two sentences mean similar things.Source: shibing624 on Hugging Face. File format: Safetensors, ONNX, BIN.
| 1.94 GB | 1,619,123 downloads on Hugging Face | 2026-07-27 | |
FLUX.2 klein 4Bblack-forest-labs/FLUX.2-klein-4BThe catalog lists this model for transforming images. Catalog sources: license label, task label.Content controls: not assessed.DetailsThe catalog lists this model for transforming images.See the publisher’s description →Source: black-forest-labs on Hugging Face. File format: Safetensors.
| 23.7 GB | 481,966 downloads on Hugging Face | 2026-10-01 | |
nsfw image detectionFalconsai/nsfw_image_detectionThe catalog lists this model for labeling images. Catalog sources: license label, task label.Content controls: not assessed.DetailsThe catalog lists this model for labeling images.Source: Falconsai on Hugging Face. File format: PT, Safetensors, BIN.
| 1.46 GB | 9,792,328 downloads on Hugging Face | 2026-09-07 | |
chatterboxResembleAI/chatterboxThe catalog lists this model for turning text into speech. Catalog sources: license label, task label.Content controls: not assessed.DetailsThe catalog lists this model for turning text into speech.Source: ResembleAI on Hugging Face. File format: PT, Safetensors.
| 13.9 GB | 2,243,054 downloads on Hugging Face | 2026-06-10 | |
Qwen3.5 2BQwen/Qwen3.5-2BThe catalog lists this model for generating text from images and text. Catalog sources: license label, task label.Content controls: not assessed.DetailsThe catalog lists this model for generating text from images and text.See the publisher’s description →Source: Qwen on Hugging Face. File format: Safetensors.
| 4.57 GB | 1,665,793 downloads on Hugging Face | 2026-03-02 | |
bge reranker largeBAAI/bge-reranker-largeThe catalog lists this model for finding useful details in data. Catalog sources: license label, task label.Content controls: not assessed.DetailsThe catalog lists this model for finding useful details in data.Source: BAAI on Hugging Face. File format: Safetensors, ONNX, BIN.
| 6.74 GB | 1,989,626 downloads on Hugging Face | 2026-07-14 | |
w2v bert 2.0facebook/w2v-bert-2.0The catalog lists this model for finding useful details in data. Catalog sources: license label, task label.Content controls: not assessed.DetailsThe catalog lists this model for finding useful details in data.Source: facebook on Hugging Face. File format: PT, Safetensors.
| 4.65 GB | 3,845,194 downloads on Hugging Face | 2024-01-25 | |
fairface age image detectiondima806/fairface_age_image_detectionThe catalog lists this model for labeling images. Catalog sources: license label, task label.Content controls: not assessed.DetailsThe catalog lists this model for labeling images.Source: dima806 on Hugging Face. File format: Safetensors, PT, PTH, BIN.
| 4.46 GB | 6,611,173 downloads on Hugging Face | 2024-12-15 | |
Ornith 1.0 35B MXFP8OsaurusAI/Ornith-1.0-35B-MXFP8The catalog lists this model for generating text from images and text. Catalog sources: license label, task label.Content controls: not assessed.DetailsThe catalog lists this model for generating text from images and text.See the publisher’s description →Source: OsaurusAI on Hugging Face. File format: Safetensors.
| 36.7 GB | 313 downloads on Hugging Face | 2026-07-08 | |
Qwen3.6 35B A3Bunsloth/Qwen3.6-35B-A3BThe catalog lists this model for generating text from images and text. Catalog sources: license label, task label.Content controls: not assessed.DetailsThe catalog lists this model for generating text from images and text.See the publisher’s description →Source: unsloth on Hugging Face. File format: Safetensors.
| 71.9 GB | 24,837 downloads on Hugging Face | 2026-05-11 | |
Intern S1 Miniinternlm/Intern-S1-miniThe catalog lists this model for generating text from images and text. Catalog sources: license label, task label.Content controls: not assessed.DetailsThe catalog lists this model for generating text from images and text.See the publisher’s description →Source: internlm on Hugging Face. File format: Safetensors.
| 17.1 GB | 7,848 downloads on Hugging Face | 2026-07-08 | |
GLM 4.1V 9B Thinkingzai-org/GLM-4.1V-9B-ThinkingThe catalog lists this model for generating text from images and text. Catalog sources: license label, task label.Content controls: not assessed.DetailsThe catalog lists this model for generating text from images and text.See the publisher’s description →Source: zai-org on Hugging Face. File format: Safetensors.
| 20.6 GB | 584,869 downloads on Hugging Face | 2026-07-08 |