SpeakLeash / ACK Cyfronet AGH11B~7 GB VRAM at Q4_K_M

Bielik PL 11B v3.0 Instruct — VRAM, speed & local setup

Written by Jakub Rusinowski · Last updated

11B instruct model trained across 32 European languages with Polish cherry-picked and processed by hand. The APT4 tokenizer encodes Polish in fewer tokens than a general vocabulary, so a given context window holds more Polish text. Fits a 12 GB card at Q4.

Bielik PL 11B v3.0 Instruct needs about 7 GB of VRAM at Q4_K_M — quantized weights plus framework overhead, before any KV cache. On Apple Silicon that figure comes out of unified memory.

Logic74
Creative76
Coding62

VRAM and speed by quantization

Quoted against NVIDIA RTX 4090 (24 GB). Weights plus overhead only: this model's architecture is unpublished, so no KV cache is added.

QuantVRAMSpeed (est.)Fit
Q2_K
2.63 bpw
4.4 GB~127 tok/sFits
Q3_K_M
3.41 bpw
5.5 GB~108 tok/sFits
Q4_K_M
4.83 bpw
7.4 GB~84 tok/sFits
Q5_K_M
5.67 bpw
8.6 GB~75 tok/sFits
Q6_K
6.56 bpw
9.8 GB~67 tok/sFits
Q8_0
8.50 bpw
12.5 GB~54 tok/sFits
F16
16.00 bpw
22.8 GB~31 tok/sTight

Black marker = usable memory on the NVIDIA RTX 4090 (24 GB). Estimates from the memory-bandwidth roofline on the methodology page. Bielik PL 11B v3.0 Instruct VRAM calculator →

Get Bielik PL 11B v3.0 Instruct running

The cheapest catalogued GPU that runs Bielik PL 11B v3.0 Instruct is the Intel Arc B570 (10 GB).

Affiliate disclosure: Some links on this page are affiliate links — if you buy through them, LLM Configurator may earn a commission at no extra cost to you. As an Amazon Associate, LLM Configurator earns from qualifying purchases.
Intel Arc B570 10GB
10 GB VRAM · 150 W board power
2026 prices are volatile — check the current listing.

How to run Bielik PL 11B v3.0 Instruct

Install Ollama, then run:

ollama run bielik

Specifications

Corroborated — Two or more independent sources agree on these figures, but the model card itself was not retrieved. Treat the numbers as good rather than confirmed. Still unconfirmed: license, context, releaseDate.

Parameters
11 Billion
Context window
32,768
Architecture
Dense
Provider
SpeakLeash / ACK Cyfronet AGH
Licence
Apache 2.0
Practical deployment
Laptop
Specified at
Q4_K_M
System RAM
16 GB
Record updated
2026-09-19
LicenceApache-2.0Commercial use permitted

Commercial use permitted. No usage restrictions beyond attribution.

Quality and use cases

Scores as published by the model’s authors or an independent evaluator — quality, not throughput, and not measured by us.

Best forpolishmultilingualchateuropean languages

Bielik PL 11B v3.0 Instruct — frequently asked questions

How much VRAM does Bielik PL 11B v3.0 Instruct need?

About 7 GB at Q4_K_M — quantized weights plus framework overhead, before any KV cache. The cache grows with context length and is added on top; the table above folds it in. Apple Silicon counts unified memory toward the same figure.

Does Bielik PL 11B v3.0 Instruct run on an RTX 4090 (24 GB)?

Yes. Bielik PL 11B v3.0 Instruct needs about 7 GB at Q4_K_M, inside a 24 GB card, at an estimated 84 tokens/sec.

How do I run Bielik PL 11B v3.0 Instruct locally?

Install Ollama and run `ollama run bielik`. That pulls the weights and starts a local OpenAI-compatible endpoint; after the download nothing leaves the machine.