Confucius4-R2T2: A Stable-Prefix Streaming ASR Model for Real Real-Time Transcription
Abstract
A full-context speech recognizer is adapted to emit immutable streaming transcripts with near full-context accuracy and low latency by learning longest stable prefix labels.
Streaming speech recognition is increasingly consumed by machines, such as translators and voice agents, that act on each token as it appears. A token that is later revised costs wasted work or a wrong action. In this work, we present Confucius4-R2T2 (short for Real Real-Time Transcription), a stable-prefix streaming ASR model that never modifies its earlier output while maintaining high accuracy and low latency. R2T2 is obtained by post-training Qwen3-ASR-1.7B on 1,500 hours of Chinese and English audio while freezing its pre-trained audio encoder and projector. The adaptation is based on the concept of Longest Stable Prefix (LSP), a new notion that we introduce in this work. We prove that LSP is monotone under the prefix order, consistent with the full-audio output, and maximal among labels that equal a whole earlier output. Learning from LSP labels converts a full-context model into a stable-prefix streaming one without any architectural change. Extensive evaluations show that R2T2 brings streaming recognition close to the base model's full-context quality while delivering stable text with low emission lag. Its gains extend beyond the post-training languages, demonstrating a practical path from full-context ASR to stable streaming. We open-source the model weights and code at https://huggingface.co/netease-youdao/Confucius4-R2T2 and https://github.com/netease-youdao/Confucius4-R2T2.
Community
Excited to share Confucius4-R2T2, our stable-prefix streaming ASR model designed for real-time applications!
Unlike conventional streaming ASR systems that repeatedly revise partial transcripts, R2T2 produces append-only, stable text that downstream systems such as voice agents and simultaneous translators can consume immediately.
The key idea is Longest Stable Prefix (LSP) supervision, which enables us to transform a full-context ASR model into a streaming one through post-training, without architectural modifications.
Built on Qwen3-ASR-1.7B, R2T2 achieves near-offline recognition accuracy with low emission latency, supports configurable streaming chunk sizes, and demonstrates promising cross-lingual generalization.
We've made the model and implementation publicly available:
๐ค Model: https://huggingface.co/netease-youdao/Confucius4-R2T2
๐ป GitHub: https://github.com/netease-youdao/Confucius4-R2T2
๐๏ธ Live demo: https://r2t2.youdao.com/demo
We'd love to hear your feedback and see what the community builds with it!
This is an automated message from the Librarian Bot. I found the following papers similar to this paper.
The following papers were recommended by the Semantic Scholar API
- S3-S2ST: Semantically Supervised Streaming Speech-to-Speech Translation (2026)
- Learning When to Commit from Partial Speech for End-to-End Simultaneous Speech Translation (2026)
- Look Less, Hear Better: Jointly Rewarded GRPO for Streaming ASR (2026)
- Selective Lookahead for Attention-Based Streaming ASR (2026)
- Alignment-Path Distillation from Non-streaming ASR-LLMs for Streaming Speech Recognition (2026)
- Uni-Stream: A Unified Streaming Speech Language Model for Speech Synthesis and Recognition (2026)
- Factorized Delayed Streams Modeling for LLM-based Streaming ASR (2026)
Please give a thumbs up to this comment if you found it helpful!
If you want recommendations for any Paper on Hugging Face checkout this Space
You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: @librarian-bot recommend
Get this paper in your agent:
hf papers read 2611.06043 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 1
Datasets citing this paper 0
No dataset linking this paper