Can I run QuantFactory/gemma-7b-aps-it-GGUF on RTX 4060 (8 GB desktop)?

File-size estimate: within budget. Estimate only. No fresh, matching Proof Lab measurement is available for this file and device.

FILE-SIZE ESTIMATE

File-size estimate: within budget.

Estimate only. No fresh, matching Proof Lab measurement is available for this file and device.

Next, open the model page to check its files and available run instructions.

View model and files
File on disk
4.96 GiB
Memory allowance
6.20 GiB
Memory pool
VRAM
Evidence
Estimate only

The exact file

gemma-7b-aps-it.Q4_K_M.gguf

File fingerprint

SHA-256

79bbb681306a74dd6ca5eef07a9393d38879403b49c018ed453909710f073a34

File size × 1.25 = 6.20 GiB. The assumed budget is 7.00 GiB VRAM, after reserving 1 GiB. Context, runtime and other apps can need more.

This uses the hardware class and VRAM size named above. System RAM, driver and runtime support need a separate check.

Run command

No tested command for this file and device yet. Open the model page for available setup instructions.

Alternatives with room

No fitting alternatives in this sample. Find another model.

Questions about this run

Can I run QuantFactory/gemma-7b-aps-it-GGUF on RTX 4060 (8 GB desktop)?

File-size estimate: within budget. Estimate only. No fresh, matching Proof Lab measurement is available for this file and device.

How is memory fit calculated?

File size × 1.25 = 6.20 GiB. The assumed budget is 7.00 GiB VRAM, after reserving 1 GiB. Context, runtime and other apps can need more.

Was this exact file tested on this device?

No matching fresh lab evidence is available. File-size estimates do not establish runtime support.

Check another device for this model