Qwen3 models (123M/300M/600M) trained from scratch on 2.47B kk+ru tokens. Includes tokenizer, datasets, and checkpoints.
Saken Tukenov PRO
stukenov
AI & ML interests
None yet
Recent Activity
updated a Space about 7 hours ago
TilQazyna/README published a Space about 7 hours ago
TilQazyna/README updated a collection about 7 hours ago
First Releases (2024)Organizations
BPE and SentencePiece tokenizers trained on Kazakh text — 32K vocabularies
Mixture-of-Experts models for Kazakh — upcycled and domain-pretrained MoE architectures
Base, instruct, and balanced Kazakh language models trained from scratch — Llama (50M–600M), GPT2, Pythia architectures
-
stukenov/sozkz-core-llama-600m-kk-base-v1
Text Generation • 0.6B • Updated • 4 • 1 -
stukenov/sozkz-core-llama-600m-kk-instruct-v1
0.6B • Updated • 1 -
stukenov/sozkz-core-llama-300m-kk-base-v1
Text Generation • 0.3B • Updated -
stukenov/sozkz-core-llama-300m-kk-instruct-v1
Text Generation • 0.3B • Updated
Miscellaneous Kazakh AI models and datasets — TTS, sentiment analysis, speech, benchmarks
Training corpora for Kazakh LLMs — raw, cleaned, deduplicated, tokenized, synthetic, and parallel datasets
Grammar error correction models and datasets for Kazakh — Llama GEC (300M, 600M), mT5 GEC, morphology models
Qwen3 models (123M/300M/600M) trained from scratch on 2.47B kk+ru tokens. Includes tokenizer, datasets, and checkpoints.
Miscellaneous Kazakh AI models and datasets — TTS, sentiment analysis, speech, benchmarks
BPE and SentencePiece tokenizers trained on Kazakh text — 32K vocabularies
Training corpora for Kazakh LLMs — raw, cleaned, deduplicated, tokenized, synthetic, and parallel datasets
Mixture-of-Experts models for Kazakh — upcycled and domain-pretrained MoE architectures
Grammar error correction models and datasets for Kazakh — Llama GEC (300M, 600M), mT5 GEC, morphology models
Base, instruct, and balanced Kazakh language models trained from scratch — Llama (50M–600M), GPT2, Pythia architectures
-
stukenov/sozkz-core-llama-600m-kk-base-v1
Text Generation • 0.6B • Updated • 4 • 1 -
stukenov/sozkz-core-llama-600m-kk-instruct-v1
0.6B • Updated • 1 -
stukenov/sozkz-core-llama-300m-kk-base-v1
Text Generation • 0.3B • Updated -
stukenov/sozkz-core-llama-300m-kk-instruct-v1
Text Generation • 0.3B • Updated