Bielik — SpeakLeash / ACK Cyfronet AGH 的本地 AI 模型
作者: Jakub Rusinowski · 最后更新:
波兰的开放LLM,在波兰大规模计算基础设施(PLGrid)上训练,语料由SpeakLeash团队整理。v3版把分词器换成了专为波兰语构建的APT4,这也是它在波兰语文本上能比同等规模的通用多语言模型发挥出更多性能的原因。
变体
Bielik 最小的变体在 Q4_K_M 下约需 7 GB 显存——量化权重加框架开销,不含 KV 缓存。
| 模型 | Q4 下显存 | 显存 | 上下文 | 运行 |
|---|---|---|---|---|
| Bielik PL 11B v3.0 Instruct → 11B | ~7.4 GB | 32,768 | ollama run bielik |
显存为 Q4_K_M 下的量化权重加开销,与 GPU 与显存检测器使用同一引擎计算。
如何在本地运行 Bielik
安装 Ollama,然后拉取标签。
ollama run bielik在上方选择一个尺寸,查看它自己的显存、速度估算和安装命令。
许可证
Commercial use permitted. No usage restrictions beyond attribution.
适用于: Bielik PL 11B v3.0 Instruct推荐 GPU
目录中能在本地运行 Bielik(至少 7 GB 显存)的最便宜 GPU 是 Intel Arc B570 (10 GB).
Bielik — 常见问题
How much VRAM does Bielik need?
Bielik needs about 7 GB VRAM at Q4_K_M quantization for its smallest variant. Variants: Bielik PL 11B v3.0 Instruct (7 GB, Q4_K_M). On Apple Silicon, unified memory counts toward this requirement.
Can I run Bielik on an RTX 4090 (24 GB)?
Yes — Bielik runs on an RTX 4090 (24 GB) and other 24 GB cards such as the RTX 3090. Smaller variants also fit comfortably on 8–16 GB GPUs at Q4_K_M.
What quantization should I use for Bielik?
Q4_K_M is the best balance of quality and VRAM for Bielik in most cases. Choose Q8_0 for near-lossless quality if you have spare VRAM, or smaller quants (Q3/Q2) only when memory is tight.
How do I run Bielik with Ollama?
Bielik has no local Ollama tag — the published tag is cloud-hosted, so running it sends your prompts to a hosted GPU rather than your own machine.