ggml-org
Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Showing 50 of 179,852 catalog results
MA
MaziyarPanahi
phi-4-GGUF
Chat & write9.05 GBNo license stated↓ 154.8K154,798 catalog downloads
MA
MaziyarPanahi
DeepSeek-R1-0528-Qwen3-8B-GGUF
Chat & write5.03 GBNo license stated↓ 153.4K153,372 catalog downloads
MA
MaziyarPanahi
gemma-2-2B-it-GGUF
Chat & write1.71 GBGemma Terms of Use (from base model)↓ 151.3K151,274 catalog downloads
MA
MaziyarPanahi
gemma-3-27B-it-GGUF
Chat & write16.55 GBGemma Terms of Use (from base model)↓ 151.2K151,184 catalog downloads
LM
lmstudio-community
Qwen3-Coder-30B-A3B-Instruct-GGUF
Chat & write18.63 GBApache 2.0 (from base model)↓ 95.7K95,715 catalog downloads
LM
lmstudio-community
Hermes-4-70B-MLX-5bit
Chat & write48.51 GBLlama 3 Community (from base model)↓ 56.1K56,131 catalog downloads
LM
lmstudio-community
Qwen3-4B-Instruct-2507-GGUF
Chat & write2.5 GBApache 2.0 (from base model)↓ 38.5K38,517 catalog downloads
HU
hugging-quants
Llama-3.2-3B-Instruct-Q4_K_M-GGUF
Chat & write2.02 GBLlama 3.2 Community (from base model)↓ 35K34,973 catalog downloads
BA
bartowski
openai_gpt-oss-20B-GGUF
Chat & write11.67 GBApache 2.0 (from base model)↓ 22K22,032 catalog downloads
LM
lmstudio-community
Qwen3-1.7B-GGUF
Chat & write1.28 GBApache 2.0 (from base model)↓ 21K21,037 catalog downloads
BA
bartowski
qwen2.5-7B-ins-v3-GGUF
Chat & write4.68 GBApache 2.0 (from base model)↓ 13.3K13,271 catalog downloads
LM
lmstudio-community
DeepSeek-R1-Distill-Qwen-32B-GGUF
Chat & write19.85 GBNo license stated↓ 11.9K11,911 catalog downloads
DE
Chat & write4.92 GBLlama 3.1 Community (from base model)↓ 6.4K6,439 catalog downloads
LM
lmstudio-community
Phi-4-mini-instruct-GGUF
Chat & write2.49 GBNo license stated↓ 5.8K5,795 catalog downloads
LM
lmstudio-community
DeepSeek-R1-Distill-Qwen-1.5B-GGUF
Chat & write1.12 GBNo license stated↓ 5.8K5,750 catalog downloads
BA
bartowski
mlabonne_Qwen3-4B-abliterated-GGUF
Chat & write2.5 GBApache 2.0 (from base model)↓ 4.8K4,816 catalog downloads
LM
lmstudio-community
gpt-oss-safeguard-120B-MLX-MXFP4
General62.13 GBApache 2.0 (from base model)↓ 3.4K3,350 catalog downloads
TH
TheDrummer
Tiger-Gemma-12B-v3-GGUF
General7.87 GBGemma Terms of Use (from base model)↓ 2.8K2,796 catalog downloads
NA
NANI-Nithin
manaca-1B-base-GGUF
Chat & write1.06 GBCC BY 4.0 (from base model)↓ 1.7K1,690 catalog downloads
QU
QuantFactory
Llama-3-Ko-Luxia-Instruct-GGUF
Chat & write5.02 GBLlama 3 Community (from base model)↓ 1.5K1,477 catalog downloads
QU
QuantFactory
CodeLlama-7B-Instruct-hf-GGUF
Chat & write4.08 GBLlama 2 Community (from base model)↓ 1.3K1,338 catalog downloads
GG
ggml-org
gemma-3-270m-GGUF
General292 MBGemma Terms of Use (from base model)↓ 1K1,040 catalog downloads
QU
QuantFactory
Mistral-7B-v0.2-hf-GGUF
Chat & write4.37 GBApache 2.0 (from base model)↓ 831831 catalog downloads
Chat & write5.34 GBGemma Terms of Use (from base model)↓ 803803 catalog downloads
AB
Chat & write5.3 GBApache 2.0 (from base model)↓ 752752 catalog downloads
Chat & write2.5 GBApache 2.0 (from base model)↓ 705705 catalog downloads
AB
Chat & write5.34 GBGemma Terms of Use (from base model)↓ 286286 catalog downloads
TH
TheDrummer
Snowpiercer-15B-v3-GGUF
General9.11 GBNo license stated↓ 281281 catalog downloads
TH
TheDrummer
Gemma-3-R1-12B-v1-GGUF
General7.3 GBGemma Terms of Use (from base model)↓ 153153 catalog downloads
TH
TheDrummer
Gemma-3-R1-4B-v1-GGUF
General2.49 GBGemma Terms of Use (from base model)↓ 149149 catalog downloads
AL
allura-org
TQ2.5-14B-Sugarquill-v1-GGUF
General8.99 GBApache 2.0 (from base model)↓ 9393 catalog downloads
GO
Goekdeniz-Guelmez
JOSIE-2-9B-OSS-oQ8
General10.43 GBNo license stated↓ 7171 catalog downloads
GO
Goekdeniz-Guelmez
JOSIE-2-4B-Preview-oQ4e
General3.18 GBNo license stated↓ 5656 catalog downloads
GO
Goekdeniz-Guelmez
JOSIE-2-9B-OSS-oQ4e
General6.04 GBNo license stated↓ 2222 catalog downloads
GO
Goekdeniz-Guelmez
JOSIE-2-2B-OSS-oQ4e
General1.78 GBNo license stated↓ 1818 catalog downloads
IS
ISTA-DASLab
Llama-3.2-3B-Instruct-AQLM-PV-2Bit-2x8
Chat & write1.5 GBLlama 3.2 Community (from base model)↓ 1515 catalog downloads
GO
Goekdeniz-Guelmez
JOSIE-2-2B-OSS-oQ6-mtp
General2.3 GBNo license stated↓ 1414 catalog downloads
GO
Goekdeniz-Guelmez
JOSIE-2-9B-OSS-oQ4
General6.04 GBNo license stated↓ 1313 catalog downloads
GO
Goekdeniz-Guelmez
JOSIE-2-4B-OSS-oQ8-mtp
General5.28 GBNo license stated↓ 1111 catalog downloads
GO
Goekdeniz-Guelmez
JOSIE-2-9B-OSS-oQ6
General8.26 GBNo license stated↓ 1010 catalog downloads
GO
Goekdeniz-Guelmez
JOSIE-2-4B-Preview-oQ6e-mtp
General3.64 GBNo license stated↓ 1010 catalog downloads
GO
Goekdeniz-Guelmez
JOSIE-2-4B-OSS-oQ4
General3.18 GBNo license stated↓ 99 catalog downloads
GO
Goekdeniz-Guelmez
JOSIE-2-2B-OSS-oQ8
General2.66 GBNo license stated↓ 99 catalog downloads
GO
Goekdeniz-Guelmez
JOSIE-2-4B-OSS-oQ8
General5.14 GBNo license stated↓ 88 catalog downloads
GO
Goekdeniz-Guelmez
JOSIE-2-4B-OSS-oQ6
General4.19 GBNo license stated↓ 77 catalog downloads
GO
Goekdeniz-Guelmez
JOSIE-2-2B-OSS-oQ6
General2.24 GBNo license stated↓ 77 catalog downloads
GO
Goekdeniz-Guelmez
JOSIE-2-4B-OSS-oQ6-mtp
General4.31 GBNo license stated↓ 66 catalog downloads
GO
Goekdeniz-Guelmez
JOSIE-2-2B-OSS-oQ4
General1.78 GBNo license stated↓ 66 catalog downloads
AB
Abiray
harrier-oss-v1-27B-GGUF
Search documents16.55 GBNo license stated↓ 892892 catalog downloads