# bartowski/gemma-2-2b-it-abliterated-GGUF

This model is a set of GGUF quantizations made with llama.cpp imatrix calibration, and it does not support a system prompt. It offers multiple file variants from f32 through Q8_0, including recommended Q6_K_L, Q5_K_M, Q4_K_M, and IQ4_XS options.

## Cite this

- Page: https://huggingbay.xyz/artifact/hf-model-bartowski-gemma-2-2b-it-abliterated-gguf
- Citation: bartowski/gemma-2-2b-it-abliterated-GGUF. The Hugging Bay model record. https://huggingbay.xyz/artifact/hf-model-bartowski-gemma-2-2b-it-abliterated-gguf (retrieved 2026-11-14).
- Check a downloaded file: run `shasum -a 256 <file>` (macOS), `sha256sum <file>` (Linux) or `Get-FileHash -Algorithm SHA256 <file>` (Windows), then compare with that file's SHA-256 at https://huggingbay.xyz/api/artifacts/hf-model-bartowski-gemma-2-2b-it-abliterated-gguf/files?limit=100. How checks work: https://huggingbay.xyz/verification

## Facts

- Type: LLM
- Task: text-generation
- Framework: unknown
- License: gemma: Commercial use is permitted with obligations: Gemma terms: commercial use allowed subject to Google's prohibited-use policy.
- Source: https://huggingface.co/bartowski/gemma-2-2b-it-abliterated-GGUF
- Hosting: hosted (1 file)
- Files: 1 hosted of 18 listed
- File counts: "listed" is every file in the source repository; only hosted files download from Hugging Bay, and the download plan lists the files it selects for one download, so its count can differ.
- Hosted here: 1 hosted of 18 listed
- Full repo upstream: 36.3 GB
- Recommended file: 1.71 GB (Q4_K_M) · gemma-2-2b-it-abliterated-Q4_K_M.gguf
- Parameters: 2B
- Download: https://huggingbay.xyz/api/artifacts/hf-model-bartowski-gemma-2-2b-it-abliterated-gguf/download-plan (download plan: https://huggingbay.xyz/api/artifacts/hf-model-bartowski-gemma-2-2b-it-abliterated-gguf/download-plan)
- Per-file SHA-256: available for 1 of 1 hosted file via https://huggingbay.xyz/api/artifacts/hf-model-bartowski-gemma-2-2b-it-abliterated-gguf/files?limit=100
- Availability: Ready
- Downloadable: yes
- Run-ready: no (Hugging Bay has not certified a run path for this model; hosted bytes are downloadable and hash-checkable only)
- Peer-assisted fallbacks: 0 verified, 0 pending review
- Downloads: 30802
- Stars: 88
- Card completeness: 96%

## Description

This model is a set of GGUF quantizations made with llama.cpp imatrix calibration, and it does not support a system prompt. It offers multiple file variants from f32 through Q8_0, including recommended Q6_K_L, Q5_K_M, Q4_K_M, and IQ4_XS options.

## Model Card Facts

- Declared license: gemma
- Pipeline: text-generation
- Library: unknown
- Base model: IlyaGusev/gemma-2-2b-it-abliterated
- Task categories: text-generation
- Languages: en
- File hints: 16 upstream file samples

## File Hints

- .gitattributes (2.6 KB)
- README.md (7.7 KB)
- gemma-2-2b-it-abliterated-IQ3_M.gguf (1.3 GB) LFS
- gemma-2-2b-it-abliterated-IQ4_XS.gguf (1.5 GB) LFS
- gemma-2-2b-it-abliterated-Q2_K_L.gguf (1.3 GB) LFS
- gemma-2-2b-it-abliterated-Q3_K_L.gguf (1.4 GB) LFS
- gemma-2-2b-it-abliterated-Q3_K_XL.gguf (1.6 GB) LFS
- gemma-2-2b-it-abliterated-Q4_K_L.gguf (1.7 GB) LFS
- gemma-2-2b-it-abliterated-Q4_K_M.gguf (1.6 GB) LFS
- gemma-2-2b-it-abliterated-Q4_K_S.gguf (1.5 GB) LFS
- gemma-2-2b-it-abliterated-Q5_K_L.gguf (1.9 GB) LFS
- gemma-2-2b-it-abliterated-Q5_K_M.gguf (1.8 GB) LFS

## Quality Checklist

- Summary: passed
- Description: passed
- Model card metadata: passed
- License: review
- Provenance: passed
- File inventory: passed
- Hosted bytes: passed
- Scan result: passed
- Manifest signature: passed

## Safety Notes

- External catalog metadata imported from Hugging Face public API on 2026-09-16T21:31:33.861Z.
- Upstream license: gemma. Mirror admission policy: permissive (owner policy; no license rights inferred).
- Not a run kit: hosted, hash-checked bytes only; run readiness is not certified for this model yet.

## Actions

- Web: https://huggingbay.xyz/artifact/hf-model-bartowski-gemma-2-2b-it-abliterated-gguf
- Files API: https://huggingbay.xyz/api/artifacts/hf-model-bartowski-gemma-2-2b-it-abliterated-gguf/files?limit=100
- Metadata: https://huggingbay.xyz/api/artifacts/hf-model-bartowski-gemma-2-2b-it-abliterated-gguf/metadata.json
- Distribution: https://huggingbay.xyz/api/artifacts/hf-model-bartowski-gemma-2-2b-it-abliterated-gguf/distribution
- Manifest: https://huggingbay.xyz/api/manifests/hf-model-bartowski-gemma-2-2b-it-abliterated-gguf
- Download plan (per-file SHA-256 + signed download URLs): https://huggingbay.xyz/api/artifacts/hf-model-bartowski-gemma-2-2b-it-abliterated-gguf/download-plan
- Hosted download rows: https://huggingbay.xyz/api/downloadable-files?artifactId=hf-model-bartowski-gemma-2-2b-it-abliterated-gguf&limit=100
- Request mirror: not applicable.
- Submit peer fallback for review: POST https://huggingbay.xyz/api/artifacts/hf-model-bartowski-gemma-2-2b-it-abliterated-gguf/decentralized-fallbacks