inference-optimization
Browse models
Open models you can download and run. Pick your memory to see what fits.
Model results
Showing 50 of 2,601 catalog results
FA
facebook
KernelLLM
Chat & write16.06 GBNo license stated↓ 116116 catalog downloads
SO
sovasoft
zora-v1.13
Chat & write16.38 GBapache-2.0↓ 116116 catalog downloads
QU
QuantTrio
DeepSeek-V3.2-Exp-AWQ
Chat & writemit↓ 115115 catalog downloads
AT
AtomicChat
gemma-4-12B-it-MLX-8bit
Chat & write12.72 GBapache-2.0↓ 115115 catalog downloads
DE
Chat & write33.95 GBnvidia-open-model-license↓ 115115 catalog downloads
CA
Cannae-AI
ReasoningLlama-Math-1B-IT-gguf
Chat & writeapache-2.0↓ 115115 catalog downloads
CS
csoares31
AMALIA-9B-0626-DPO-GGUF
Chat & write5.58 GBapache-2.0↓ 114114 catalog downloads
ML
mlabonne
NeuralBeagle14-7B
Chat & write14.48 GBcc-by-nc-4.0↓ 114114 catalog downloads
EM
empero-ai
openNemo-9B-abliterated
Chat & write17.78 GBnvidia-open-model-license↓ 114114 catalog downloads
EM
empero-ai
openNemo-9B-Claude-Opus-4.6-distill
Chat & write17.78 GBnvidia-open-model-license↓ 113113 catalog downloads
AO
Chat & writeapache-2.0↓ 113113 catalog downloads
GU
Guilherme34
LFM2.5-2.6B-Abliterated-Advanced
Chat & write5.39 GBNo license stated↓ 112112 catalog downloads
AR
arcee-ai
AFM-4.5B-Preview
Chat & write9.24 GBapache-2.0↓ 111111 catalog downloads
DP
dphn
Dolphin-X1-8B
Chat & write16.06 GBllama3.1↓ 111111 catalog downloads
IS
ISTA-DASLab
Mistral-7B-Instruct-v0.2-AQLM-2Bit-2x8
Chat & write2.27 GBNo license stated↓ 111111 catalog downloads
BA
barryzhang
ornith-harness-4B-v2
Chat & write3.07 GBapache-2.0↓ 111111 catalog downloads
H3
h3rb3rn
smollm3-expert-coder-3B
Chat & write1.92 GBapache-2.0↓ 111111 catalog downloads
AR
arcee-ai
BioMistral-merged-instruct
Chat & write14.48 GBNo license stated↓ 110110 catalog downloads
Chat & write14.28 GBapache-2.0↓ 110110 catalog downloads
PS
Checkedpsikosen
mini-swarm-browser-258m
Chat & writeapache-2.0↓ 110110 catalog downloads
Chat & write8.04 GBNo license stated↓ 110110 catalog downloads
AR
arcee-ai
Saul-Instruct-Extended
Chat & write17.97 GBapache-2.0↓ 110110 catalog downloads
GR
grimjim
llama-3-Nephilim-v3-8B
Chat & write16.06 GBcc-by-nc-4.0↓ 109109 catalog downloads
Chat & write11.88 GBapache-2.0↓ 109109 catalog downloads
RI
rishitavenkat2812
SmolLM2-135M-Instruct
Chat & writeapache-2.0↓ 109109 catalog downloads
AB
Abiray
XYZ-Aquila-mini-IQ4-GGUF
Chat & write21.39 GBapache-2.0↓ 109109 catalog downloads
DA
danish-foundation-models
DFM-Mimir-v1.5-GGUF
Chat & write1.17 GBapache-2.0↓ 108108 catalog downloads
ZQ
ZQ-Dev
KAT-Coder-V2.5-Dev-oQ6e
Chat & write28.56 GBapache-2.0↓ 107107 catalog downloads
Chat & write17.97 GBNo license stated↓ 107107 catalog downloads
PS
psikosen
canopy-258m-r3-v2
Chat & writeapache-2.0↓ 106106 catalog downloads
MA
matrixportalx
gemma-3-1B-it-tr-v1
Chat & write2 GBapache-2.0↓ 106106 catalog downloads
AT
AtomicChat
gemma-4-E4B-it-MLX-8bit
Chat & write8.88 GBapache-2.0↓ 106106 catalog downloads
Chat & write24.5 GBNo license stated↓ 106106 catalog downloads
BR
BrandeisPatrick
Ouro-2.6B-GGUF
Chat & write1.65 GBapache-2.0↓ 106106 catalog downloads
Chat & write4.28 GBapache-2.0↓ 106106 catalog downloads
DA
DavidAU
Gemma-The-Writer-9B
Chat & write20.32 GBNo license stated↓ 105105 catalog downloads
SA
sakamakismile
gpt-oss-20B-abliterated-EXL3-6bpw
Chat & writeapache-2.0↓ 105105 catalog downloads
AR
arcee-ai
Patent-Instruct-LLaMA-Pro
Chat & write16.72 GBapache-2.0↓ 105105 catalog downloads
AR
arcee-ai
Patent-Instruct-Pro
Chat & write16.72 GBapache-2.0↓ 105105 catalog downloads
SA
SarpBnlcn
BIST-LLM-8B-Turkish-Finance
Chat & writemit↓ 104104 catalog downloads
AT
AtomicChat
gemma-4-E2B-it-MLX-8bit
Chat & write5.87 GBapache-2.0↓ 104104 catalog downloads
RH
Chat & write424 MBapache-2.0↓ 104104 catalog downloads
AR
Chat & write35.95 GBNo license stated↓ 104104 catalog downloads
VA
Vakamalla-Anitha
granite-4.1-3B-oracle-text-to-sql-gguf
Chat & write2.1 GBapache-2.0↓ 103103 catalog downloads
ML
mlx-community
Hemmingway-1-OptiQ-4bit
Chat & writeapache-2.0↓ 103103 catalog downloads
NE
NeverSleep
Llama-3-Lumimaid-8B-v0.1
Chat & write16.06 GBcc-by-nc-4.0↓ 103103 catalog downloads
JA
Jackrong
Qwopus-GLM-18B-Healed
Chat & write33.15 GBapache-2.0↓ 103103 catalog downloads
JA
Jackrong
DASD-1.7B-stage2-GGUF
Chat & write1.11 GBNo license stated↓ 102102 catalog downloads
DP
Chat & write5.57 GBmit↓ 102102 catalog downloads