# answerdotai/ModernBERT-base

This model is an encoder only masked language model trained on English and code, with a native context length up to 8,192 tokens. It is described for retrieval, classification, semantic search, and code retrieval, and the card notes that token type IDs are not used.

## Cite this

- Page: https://huggingbay.xyz/artifact/hf-model-answerdotai-modernbert-base
- Citation: answerdotai/ModernBERT-base. The Hugging Bay model record. https://huggingbay.xyz/artifact/hf-model-answerdotai-modernbert-base (retrieved 2026-11-13).
- Check a downloaded file: run `shasum -a 256 <file>` (macOS), `sha256sum <file>` (Linux) or `Get-FileHash -Algorithm SHA256 <file>` (Windows), then compare with that file's SHA-256 at https://huggingbay.xyz/api/artifacts/hf-model-answerdotai-modernbert-base/files?limit=100. How checks work: https://huggingbay.xyz/verification

## Facts

- Type: LLM
- Task: fill-mask
- Framework: transformers
- License: apache-2.0: Permissive open license: commercial use, modification, and redistribution are permitted. (https://spdx.org/licenses/Apache-2.0.html)
- Source: https://huggingface.co/answerdotai/ModernBERT-base
- Hosting: hosted (1 file)
- Files: 1 hosted of 1 listed
- File counts: "listed" is every file in the source repository; only hosted files download from Hugging Bay, and the download plan lists the files it selects for one download, so its count can differ.
- Hosted here: 1 hosted of 1 listed
- Full repo upstream: 3.13 GB
- Download: https://huggingbay.xyz/api/artifacts/hf-model-answerdotai-modernbert-base/download-plan (download plan: https://huggingbay.xyz/api/artifacts/hf-model-answerdotai-modernbert-base/download-plan)
- Per-file SHA-256: available for 1 of 1 hosted file via https://huggingbay.xyz/api/artifacts/hf-model-answerdotai-modernbert-base/files?limit=100
- Availability: Ready
- Downloadable: yes
- Run-ready: no (Hugging Bay has not certified a run path for this model; hosted bytes are downloadable and hash-checkable only)
- Peer-assisted fallbacks: 0 verified, 0 pending review
- Downloads: 10050798
- Stars: 1155
- Card completeness: 88%

## Description

This model is an encoder only masked language model trained on English and code, with a native context length up to 8,192 tokens. It is described for retrieval, classification, semantic search, and code retrieval, and the card notes that token type IDs are not used.

## Model Card Facts

- Declared license: apache-2.0
- Pipeline: fill-mask
- Library: transformers
- Task categories: fill-mask
- Languages: en
- Paper ids: 2412.13663
- File hints: 16 upstream file samples

## Referenced Data

- Paper: 2412.13663

## File Hints

- .gitattributes
- README.md
- config.json
- model.safetensors
- onnx/model.onnx
- onnx/model_bnb4.onnx
- onnx/model_fp16.onnx
- onnx/model_int8.onnx
- onnx/model_q4.onnx
- onnx/model_q4f16.onnx
- onnx/model_quantized.onnx
- onnx/model_uint8.onnx

## Quality Checklist

- Summary: passed
- Description: passed
- Model card metadata: passed
- License: passed
- Provenance: passed
- File inventory: passed
- Hosted bytes: passed
- Scan result: passed
- Manifest signature: passed

## Safety Notes

- Mirrored 1 selected Hugging Face file by configured-admin; 0 medium-risk weight files used explicit admin review; hashes computed from downloaded bytes and manifest signed.
- Reviewed large mirror worker mirrored 1 Hugging Face file by codex-reviewed-weight-apply; 1 medium-risk weight file used explicit admin review.
- Reviewed large mirror worker mirrored 10 low-risk Hugging Face files by reviewed-large-mirror-worker; medium/high-risk binary pickle-style files remain external pending separate review.
- Mirrored 5 selected Hugging Face files by configured-admin; hashes computed from downloaded bytes and manifest signed.
- External catalog metadata imported from Hugging Face public API on 2026-07-04T18:18:12.676Z.
- Open license detected as apache-2.0.
- Not a run kit: hosted, hash-checked bytes only; run readiness is not certified for this model yet.

## Actions

- Web: https://huggingbay.xyz/artifact/hf-model-answerdotai-modernbert-base
- Files API: https://huggingbay.xyz/api/artifacts/hf-model-answerdotai-modernbert-base/files?limit=100
- Metadata: https://huggingbay.xyz/api/artifacts/hf-model-answerdotai-modernbert-base/metadata.json
- Distribution: https://huggingbay.xyz/api/artifacts/hf-model-answerdotai-modernbert-base/distribution
- Manifest: https://huggingbay.xyz/api/manifests/hf-model-answerdotai-modernbert-base
- Download plan (per-file SHA-256 + signed download URLs): https://huggingbay.xyz/api/artifacts/hf-model-answerdotai-modernbert-base/download-plan
- Hosted download rows: https://huggingbay.xyz/api/downloadable-files?artifactId=hf-model-answerdotai-modernbert-base&limit=100
- Request mirror: not applicable.
- Submit peer fallback for review: POST https://huggingbay.xyz/api/artifacts/hf-model-answerdotai-modernbert-base/decentralized-fallbacks