# stelterlab/Mistral-Small-24B-Instruct-2501-AWQ

This model is an instruction fine tuned 24B parameter model with AWQ INT4 quantization. It supports native function calling, JSON output, a 32k context window, and system prompt adherence across dozens of languages.

## Cite this

- Page: https://huggingbay.xyz/artifact/hf-model-stelterlab-mistral-small-24b-instruct-2501-awq
- Citation: stelterlab/Mistral-Small-24B-Instruct-2501-AWQ. The Hugging Bay model record. https://huggingbay.xyz/artifact/hf-model-stelterlab-mistral-small-24b-instruct-2501-awq (retrieved 2026-11-16).
- Check a downloaded file: run `shasum -a 256 <file>` (macOS), `sha256sum <file>` (Linux) or `Get-FileHash -Algorithm SHA256 <file>` (Windows), then compare with that file's SHA-256 at https://huggingbay.xyz/api/artifacts/hf-model-stelterlab-mistral-small-24b-instruct-2501-awq/files?limit=100. How checks work: https://huggingbay.xyz/verification

## Facts

- Type: LLM
- Task: text-generation
- Framework: vllm
- License: apache-2.0: Permissive open license: commercial use, modification, and redistribution are permitted. (https://spdx.org/licenses/Apache-2.0.html)
- Source: https://huggingface.co/stelterlab/Mistral-Small-24B-Instruct-2501-AWQ
- Hosting: hosted (9 files)
- Files: 9 hosted of 13 listed
- File counts: "listed" is every file in the source repository; only hosted files download from Hugging Bay, and the download plan lists the files it selects for one download, so its count can differ.
- Hosted here: 9 hosted of 13 listed
- Full repo upstream: 14.3 GB
- Recommended file: 14.2 GB (3 files)
- Parameters: 24B
- Download: https://huggingbay.xyz/api/artifacts/hf-model-stelterlab-mistral-small-24b-instruct-2501-awq/download-plan (download plan: https://huggingbay.xyz/api/artifacts/hf-model-stelterlab-mistral-small-24b-instruct-2501-awq/download-plan)
- Per-file SHA-256: available for 9 of 9 hosted files via https://huggingbay.xyz/api/artifacts/hf-model-stelterlab-mistral-small-24b-instruct-2501-awq/files?limit=100
- Availability: Ready
- Downloadable: yes
- Run-ready: no (Hugging Bay has not certified a run path for this model; hosted bytes are downloadable and hash-checkable only)
- Peer-assisted fallbacks: 0 verified, 0 pending review
- Downloads: 278233
- Stars: 30
- Card completeness: 96%

## Description

This model is an instruction fine tuned 24B parameter model with AWQ INT4 quantization. It supports native function calling, JSON output, a 32k context window, and system prompt adherence across dozens of languages.

## Model Card Facts

- Declared license: apache-2.0
- Pipeline: text-generation
- Library: vllm
- Base model: mistralai/Mistral-Small-24B-Instruct-2501
- Task categories: text-generation
- Languages: en, fr, de, es, it, pt, zh, ja
- File hints: 13 upstream file samples

## File Hints

- .gitattributes (1.6 KB)
- README.md (15 KB)
- config.json (937 B)
- generation_config.json (155 B)
- model-00001-of-00003.safetensors (4.6 GB) LFS
- model-00002-of-00003.safetensors (4.7 GB) LFS
- model-00003-of-00003.safetensors (4.0 GB) LFS
- model.safetensors.index.json (74 KB)
- params.json (232 B)
- special_tokens_map.json (21 KB)
- tekken.json (14 MB) LFS
- tokenizer.json (16 MB) LFS

## Quality Checklist

- Summary: passed
- Description: passed
- Model card metadata: passed
- License: passed
- Provenance: passed
- File inventory: passed
- Hosted bytes: passed
- Scan result: passed
- Manifest signature: passed

## Safety Notes

- External catalog metadata imported from Hugging Face public API on 2026-09-20T22:11:02.571Z.
- Upstream license: apache-2.0. Mirror admission policy: permissive (owner policy; no license rights inferred).
- Not a run kit: hosted, hash-checked bytes only; run readiness is not certified for this model yet.

## Actions

- Web: https://huggingbay.xyz/artifact/hf-model-stelterlab-mistral-small-24b-instruct-2501-awq
- Files API: https://huggingbay.xyz/api/artifacts/hf-model-stelterlab-mistral-small-24b-instruct-2501-awq/files?limit=100
- Metadata: https://huggingbay.xyz/api/artifacts/hf-model-stelterlab-mistral-small-24b-instruct-2501-awq/metadata.json
- Distribution: https://huggingbay.xyz/api/artifacts/hf-model-stelterlab-mistral-small-24b-instruct-2501-awq/distribution
- Manifest: https://huggingbay.xyz/api/manifests/hf-model-stelterlab-mistral-small-24b-instruct-2501-awq
- Download plan (per-file SHA-256 + signed download URLs): https://huggingbay.xyz/api/artifacts/hf-model-stelterlab-mistral-small-24b-instruct-2501-awq/download-plan
- Hosted download rows: https://huggingbay.xyz/api/downloadable-files?artifactId=hf-model-stelterlab-mistral-small-24b-instruct-2501-awq&limit=100
- Request mirror: not applicable.
- Submit peer fallback for review: POST https://huggingbay.xyz/api/artifacts/hf-model-stelterlab-mistral-small-24b-instruct-2501-awq/decentralized-fallbacks
