# bartowski/Llama-3.2-1B-Instruct-GGUF

This model is a quantized GGUF version of an instruction model and includes multiple file variants from f16 to smaller quantized formats. Several quants are marked as recommended, and some variants are described as using Q8_0 for embed and output weights.

## Cite this

- Page: https://huggingbay.xyz/artifact/hf-model-bartowski-llama-3-2-1b-instruct-gguf
- Citation: bartowski/Llama-3.2-1B-Instruct-GGUF. The Hugging Bay model record. https://huggingbay.xyz/artifact/hf-model-bartowski-llama-3-2-1b-instruct-gguf (retrieved 2026-11-14).
- Check a downloaded file: run `shasum -a 256 <file>` (macOS), `sha256sum <file>` (Linux) or `Get-FileHash -Algorithm SHA256 <file>` (Windows), then compare with that file's SHA-256 at https://huggingbay.xyz/api/artifacts/hf-model-bartowski-llama-3-2-1b-instruct-gguf/files?limit=100. How checks work: https://huggingbay.xyz/verification

## Facts

- Type: LLM
- Task: text-generation
- Framework: unknown
- License: llama3.2: Commercial use is permitted with obligations: Llama community license: commercial use allowed; if your products/services exceeded 700 million monthly active users (Section 2, Additional Commercial Terms) you must request a license from Meta first; the acceptable-use policy and attribution notice apply.
- Source: https://huggingface.co/bartowski/Llama-3.2-1B-Instruct-GGUF
- Hosting: hosted (1 file)
- Files: 1 hosted of 21 listed
- File counts: "listed" is every file in the source repository; only hosted files download from Hugging Bay, and the download plan lists the files it selects for one download, so its count can differ.
- Hosted here: 1 hosted of 21 listed
- Full repo upstream: 17.2 GB
- Recommended file: 807.7 MB (Q4_K_M) · Llama-3.2-1B-Instruct-Q4_K_M.gguf
- Parameters: 1B
- Download: https://huggingbay.xyz/api/artifacts/hf-model-bartowski-llama-3-2-1b-instruct-gguf/download-plan (download plan: https://huggingbay.xyz/api/artifacts/hf-model-bartowski-llama-3-2-1b-instruct-gguf/download-plan)
- Per-file SHA-256: available for 1 of 1 hosted file via https://huggingbay.xyz/api/artifacts/hf-model-bartowski-llama-3-2-1b-instruct-gguf/files?limit=100
- Availability: Ready
- Downloadable: yes
- Run-ready: yes (canonical authority certifies a verified run path; see the deployment plan for exact commands)
- Peer-assisted fallbacks: 0 verified, 0 pending review
- Downloads: 120573
- Stars: 177
- Card completeness: 96%

## Description

This model is a quantized GGUF version of an instruction model and includes multiple file variants from f16 to smaller quantized formats. Several quants are marked as recommended, and some variants are described as using Q8_0 for embed and output weights.

## Model Card Facts

- Declared license: llama3.2
- Pipeline: text-generation
- Library: unknown
- Base model: meta-llama/Llama-3.2-1B-Instruct
- Task categories: text-generation
- Languages: en, de, fr, it, pt, hi, es, th
- File hints: 16 upstream file samples

## File Hints

- .gitattributes (2.8 KB)
- Llama-3.2-1B-Instruct-IQ3_M.gguf (627 MB) LFS
- Llama-3.2-1B-Instruct-IQ4_XS.gguf (709 MB) LFS
- Llama-3.2-1B-Instruct-Q3_K_L.gguf (699 MB) LFS
- Llama-3.2-1B-Instruct-Q3_K_XL.gguf (759 MB) LFS
- Llama-3.2-1B-Instruct-Q4_0.gguf (737 MB) LFS
- Llama-3.2-1B-Instruct-Q4_0_4_4.gguf (735 MB) LFS
- Llama-3.2-1B-Instruct-Q4_0_4_8.gguf (735 MB) LFS
- Llama-3.2-1B-Instruct-Q4_0_8_8.gguf (735 MB) LFS
- Llama-3.2-1B-Instruct-Q4_K_L.gguf (831 MB) LFS
- Llama-3.2-1B-Instruct-Q4_K_M.gguf (770 MB) LFS
- Llama-3.2-1B-Instruct-Q4_K_S.gguf (740 MB) LFS

## Quality Checklist

- Summary: passed
- Description: passed
- Model card metadata: passed
- License: review
- Provenance: passed
- File inventory: passed
- Hosted bytes: passed
- Scan result: passed
- Manifest signature: passed

## Safety Notes

- External catalog metadata imported from Hugging Face public API on 2026-09-16T16:48:33.787Z.
- Upstream license: llama3.2. Mirror admission policy: permissive (owner policy; no license rights inferred).

## Actions

- Web: https://huggingbay.xyz/artifact/hf-model-bartowski-llama-3-2-1b-instruct-gguf
- Files API: https://huggingbay.xyz/api/artifacts/hf-model-bartowski-llama-3-2-1b-instruct-gguf/files?limit=100
- Metadata: https://huggingbay.xyz/api/artifacts/hf-model-bartowski-llama-3-2-1b-instruct-gguf/metadata.json
- Distribution: https://huggingbay.xyz/api/artifacts/hf-model-bartowski-llama-3-2-1b-instruct-gguf/distribution
- Manifest: https://huggingbay.xyz/api/manifests/hf-model-bartowski-llama-3-2-1b-instruct-gguf
- Download plan (per-file SHA-256 + signed download URLs): https://huggingbay.xyz/api/artifacts/hf-model-bartowski-llama-3-2-1b-instruct-gguf/download-plan
- Hosted download rows: https://huggingbay.xyz/api/downloadable-files?artifactId=hf-model-bartowski-llama-3-2-1b-instruct-gguf&limit=100
- Request mirror: not applicable.
- Submit peer fallback for review: POST https://huggingbay.xyz/api/artifacts/hf-model-bartowski-llama-3-2-1b-instruct-gguf/decentralized-fallbacks