# Qwen/Qwen2.5-0.5B-Instruct-GGUF

This model is an instruction tuned 0.5B causal language model with 32,768 token context and generation up to 8,192 tokens. It is described as having improved instruction following, structured output generation, long text generation, multilingual support, coding, and mathematics.

## Cite this

- Page: https://huggingbay.xyz/artifact/hf-model-qwen-qwen2-5-0-5b-instruct-gguf
- Citation: Qwen/Qwen2.5-0.5B-Instruct-GGUF. The Hugging Bay model record. https://huggingbay.xyz/artifact/hf-model-qwen-qwen2-5-0-5b-instruct-gguf (retrieved 2026-11-16).
- Check a downloaded file: run `shasum -a 256 <file>` (macOS), `sha256sum <file>` (Linux) or `Get-FileHash -Algorithm SHA256 <file>` (Windows), then compare with that file's SHA-256 at https://huggingbay.xyz/api/artifacts/hf-model-qwen-qwen2-5-0-5b-instruct-gguf/files?limit=100. How checks work: https://huggingbay.xyz/verification

## Facts

- Type: LLM
- Task: text-generation
- Framework: unknown
- License: apache-2.0: Permissive open license: commercial use, modification, and redistribution are permitted. (https://huggingface.co/Qwen/Qwen2.5-0.5B-Instruct-GGUF/blob/main/LICENSE)
- Source: https://huggingface.co/Qwen/Qwen2.5-0.5B-Instruct-GGUF
- Hosting: hosted (10 files)
- Files: 10 hosted of 12 listed
- File counts: "listed" is every file in the source repository; only hosted files download from Hugging Bay, and the download plan lists the files it selects for one download, so its count can differ.
- Hosted here: 10 hosted of 12 listed
- Full repo upstream: 5.37 GB
- Recommended file: 491.4 MB (Q4_K_M) · qwen2.5-0.5b-instruct-q4_k_m.gguf
- Parameters: 500M
- Download: https://huggingbay.xyz/api/artifacts/hf-model-qwen-qwen2-5-0-5b-instruct-gguf/download-plan (download plan: https://huggingbay.xyz/api/artifacts/hf-model-qwen-qwen2-5-0-5b-instruct-gguf/download-plan)
- Per-file SHA-256: available for 10 of 10 hosted files via https://huggingbay.xyz/api/artifacts/hf-model-qwen-qwen2-5-0-5b-instruct-gguf/files?limit=100
- Availability: Ready
- Downloadable: yes
- Run-ready: yes (canonical authority certifies a verified run path; see the deployment plan for exact commands)
- Peer-assisted fallbacks: 0 verified, 0 pending review
- Downloads: 199385
- Stars: 128
- Card completeness: 96%

## Description

This model is an instruction tuned 0.5B causal language model with 32,768 token context and generation up to 8,192 tokens. It is described as having improved instruction following, structured output generation, long text generation, multilingual support, coding, and mathematics.

## Model Card Facts

- Declared license: apache-2.0
- Pipeline: text-generation
- Library: unknown
- Base model: Qwen/Qwen2.5-0.5B-Instruct
- Task categories: text-generation
- Languages: en
- Paper ids: 2407.10671
- File hints: 12 upstream file samples

## Referenced Data

- Paper: 2407.10671

## File Hints

- .gitattributes (1.5 KB)
- LICENSE (11 KB)
- README.md (4.7 KB)
- qwen2.5-0.5b-instruct-fp16.gguf (1.2 GB) LFS
- qwen2.5-0.5b-instruct-q2_k.gguf (396 MB) LFS
- qwen2.5-0.5b-instruct-q3_k_m.gguf (412 MB) LFS
- qwen2.5-0.5b-instruct-q4_0.gguf (409 MB) LFS
- qwen2.5-0.5b-instruct-q4_k_m.gguf (469 MB) LFS
- qwen2.5-0.5b-instruct-q5_0.gguf (468 MB) LFS
- qwen2.5-0.5b-instruct-q5_k_m.gguf (498 MB) LFS
- qwen2.5-0.5b-instruct-q6_k.gguf (620 MB) LFS
- qwen2.5-0.5b-instruct-q8_0.gguf (644 MB) LFS

## Quality Checklist

- Summary: passed
- Description: passed
- Model card metadata: passed
- License: passed
- Provenance: passed
- File inventory: passed
- Hosted bytes: passed
- Scan result: passed
- Manifest signature: passed

## Safety Notes

- External catalog metadata imported from Hugging Face public API on 2026-09-04T00:49:29.518Z.
- Open license detected as apache-2.0.

## Actions

- Web: https://huggingbay.xyz/artifact/hf-model-qwen-qwen2-5-0-5b-instruct-gguf
- Files API: https://huggingbay.xyz/api/artifacts/hf-model-qwen-qwen2-5-0-5b-instruct-gguf/files?limit=100
- Metadata: https://huggingbay.xyz/api/artifacts/hf-model-qwen-qwen2-5-0-5b-instruct-gguf/metadata.json
- Distribution: https://huggingbay.xyz/api/artifacts/hf-model-qwen-qwen2-5-0-5b-instruct-gguf/distribution
- Manifest: https://huggingbay.xyz/api/manifests/hf-model-qwen-qwen2-5-0-5b-instruct-gguf
- Download plan (per-file SHA-256 + signed download URLs): https://huggingbay.xyz/api/artifacts/hf-model-qwen-qwen2-5-0-5b-instruct-gguf/download-plan
- Hosted download rows: https://huggingbay.xyz/api/downloadable-files?artifactId=hf-model-qwen-qwen2-5-0-5b-instruct-gguf&limit=100
- Request mirror: not applicable.
- Submit peer fallback for review: POST https://huggingbay.xyz/api/artifacts/hf-model-qwen-qwen2-5-0-5b-instruct-gguf/decentralized-fallbacks
