Can I run second-state/E5-Mistral-7B-Instruct-Embedding-GGUF on RTX 3060 (12 GB desktop)?
File-size estimate: within budget. Estimate only. No fresh, matching Proof Lab measurement is available for this file and device.
FILE-SIZE ESTIMATE
File-size estimate: within budget.
Estimate only. No fresh, matching Proof Lab measurement is available for this file and device.
Next, open the model page to check its files and available run instructions.
View model and files- File on disk
- 4.07 GiB
- Memory allowance
- 5.09 GiB
- Memory pool
- VRAM
- Evidence
- Estimate only
The exact file
e5-mistral-7b-instruct-Q4_K_M.gguf
File fingerprint
SHA-256
96f5b8305d2091b48dc1191c082e61cca1f0fc7181650106bed3dd5a495ab5e4File size × 1.25 = 5.09 GiB. The assumed budget is 11.00 GiB VRAM, after reserving 1 GiB. Context, runtime and other apps can need more.
This uses the hardware class and VRAM size named above. System RAM, driver and runtime support need a separate check.
Run command
No tested command for this file and device yet. Open the model page for available setup instructions.
Alternatives with room
No fitting alternatives in this sample. Find another model.
Questions about this run
Can I run second-state/E5-Mistral-7B-Instruct-Embedding-GGUF on RTX 3060 (12 GB desktop)?
File-size estimate: within budget. Estimate only. No fresh, matching Proof Lab measurement is available for this file and device.
How is memory fit calculated?
File size × 1.25 = 5.09 GiB. The assumed budget is 11.00 GiB VRAM, after reserving 1 GiB. Context, runtime and other apps can need more.
Was this exact file tested on this device?
No matching fresh lab evidence is available. File-size estimates do not establish runtime support.