Making Bielik LLM Reason (Better): A Field Report

2026-03-11 · Adam Trybus, Bartosz Bartnicki, Remigiusz Kinas arxiv

This paper presents a research program dedicated to evaluating and advancing the reasoning capabilities of Bielik, a Polish large language model. The study describes a number of stages of work: initial benchmarking and creation of evaluation methodology, analyzing of comparative results with other LLMs and outlining of future prospects that take into account the limitations of the analyses conducted so far and aims to keep Bielik in the race give the ever-changing -- and competitive -- AI landscape.

📄 PDF Abstract BibTeX arXiv:2603.10640

Code (0)

등록된 구현이 없습니다.

Advancing Polish Language Modeling through Tokenizer Optimization in the Bielik v3 7B and 11B Series

2026-04-12 · Krzysztof Ociepa, Łukasz Flis, Remigiusz Kinas, Krzysztof Wróbel 외 arxiv

The development of the Bielik v3 PL series, encompassing both the 7B and 11B parameter variants, represents a significant milestone in the field of language-specific large language model (LLM) optimization. While general…

Reinforcement Learning

Bielik 11B v2 Technical Report

2025-05-05 · Krzysztof Ociepa, Łukasz Flis, Krzysztof Wróbel, Adrian Gwoździej 외

We present Bielik 11B v2, a state-of-the-art language model optimized for Polish text processing. Built on the Mistral 7B v0.2 architecture and scaled to 11B parameters using depth up-scaling, this model demonstrates exc…

Language Modeling Language Modelling Quantization

Bielik 7B v0.1: A Polish Language Model -- Development, Insights, and Evaluation

2024-10-24 · Krzysztof Ociepa, Łukasz Flis, Krzysztof Wróbel, Adrian Gwoździej 외

We introduce Bielik 7B v0.1, a 7-billion-parameter generative text model for Polish language processing. Trained on curated Polish corpora, this model addresses key challenges in language model development through innova…

Language Modeling Language Modelling RAG

Bielik 11B v3: Multilingual Large Language Model for European Languages

2025-12-30 · Krzysztof Ociepa, Łukasz Flis, Remigiusz Kinas, Krzysztof Wróbel 외 arxiv

We present Bielik 11B v3, a state-of-the-art language model highly optimized for the Polish language, while also maintaining strong capabilities in other European languages. This model extends the Mistral 7B v0.2 archite…

Reinforcement Learning

Bielik-Minitron-7B: Compressing Large Language Models via Structured Pruning and Knowledge Distillation for the Polish Language

2026-03-12 · Remigiusz Kinas, Paweł Kiszczak, Sergio P. Perez, Krzysztof Ociepa 외 arxiv

This report details the creation of Bielik-Minitron-7B, a compressed 7.35B parameter version of the Bielik-11B-v3.0 model, specifically optimized for European languages. By leveraging a two-stage compression methodology …

Knowledge Distillation Reinforcement Learning