Papers
arxiv:2605.03799

Natural Language Processing: A Comprehensive Practical Guide from Tokenisation to RLHF

Published on Aug 13

Abstract

A reproducible NLP practicum guides learners through tokenization, fine-tuning, retrieval-augmented generation, reinforcement learning from human feedback, and multimodal systems using open-weight models and a single evolving corpus, with original resources for low-resource Tajik and Tatar languages.

This preprint presents a systematic, research-oriented practicum that guides the reader through the entire modern NLP pipeline --- from tokenisation and vectorisation to fine tuning of large language models, retrieval augmented generation, reinforcement learning from human feedback, prompt engineering, model compression, and multimodal systems. Seventeen hands-on sessions combine concise theory with detailed implementation plans, formalised evaluation metrics, and transparent assessment criteria. The work is not a conventional textbook: it is designed as a reproducible research artefact where every session requires publishing code, models, and reports in public repositories. All experiments are conducted on a single evolving corpus, and the work advocates open weight models over commercial APIs, with special attention to the Hugging Face ecosystem. The material is enriched by original research on low resource languages, incorporating linguistic resources for Tajik and Tatar --- subword tokenisers, embeddings, lexical databases, and transliteration benchmarks --- demonstrating how modern NLP can be adapted to data scarce environments. The practicum also covers advanced topics including AI agents, multi-agent systems, LLMOps, and efficient inference, preparing students for both research and industrial deployment. Designed for senior undergraduates, graduate students, and practising developers seeking to implement, compare, and deploy methods from classical ML to state of the art multimodal and agent-based systems.

Community

Sign up or log in to comment

Get this paper in your agent:

hf papers read 2605.03799
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2605.03799 in a model README.md to link it from this page.

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2605.03799 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2605.03799 in a Space README.md to link it from this page.

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.