Instructions to use chenhaodev/rxreader-qwen3.5-0.8b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use chenhaodev/rxreader-qwen3.5-0.8b with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf chenhaodev/rxreader-qwen3.5-0.8b:Q4_K_M # Run inference directly in the terminal: llama cli -hf chenhaodev/rxreader-qwen3.5-0.8b:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf chenhaodev/rxreader-qwen3.5-0.8b:Q4_K_M # Run inference directly in the terminal: llama cli -hf chenhaodev/rxreader-qwen3.5-0.8b:Q4_K_M
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf chenhaodev/rxreader-qwen3.5-0.8b:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama cli -hf chenhaodev/rxreader-qwen3.5-0.8b:Q4_K_M
Use Docker
docker model run hf.co/chenhaodev/rxreader-qwen3.5-0.8b:Q4_K_M
- Llama new
- LM Studio
- Jan
- Ollama
How to use chenhaodev/rxreader-qwen3.5-0.8b with Ollama:
ollama run hf.co/chenhaodev/rxreader-qwen3.5-0.8b:Q4_K_M
- Unsloth Desktop
- Pi
How to use chenhaodev/rxreader-qwen3.5-0.8b with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf chenhaodev/rxreader-qwen3.5-0.8b:Q4_K_M
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:9931/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "chenhaodev/rxreader-qwen3.5-0.8b:Q4_K_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use chenhaodev/rxreader-qwen3.5-0.8b with Docker Model Runner:
docker model run hf.co/chenhaodev/rxreader-qwen3.5-0.8b:Q4_K_M
- Lemonade
How to use chenhaodev/rxreader-qwen3.5-0.8b with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull chenhaodev/rxreader-qwen3.5-0.8b:Q4_K_M
Run and chat with the model
lemonade run user.rxreader-qwen3.5-0.8b-Q4_K_M
List all available models
lemonade list
- Hermes Agent
How to use chenhaodev/rxreader-qwen3.5-0.8b with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf chenhaodev/rxreader-qwen3.5-0.8b:Q4_K_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:9931/v1 hermes config set model.default chenhaodev/rxreader-qwen3.5-0.8b:Q4_K_M
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use chenhaodev/rxreader-qwen3.5-0.8b with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf chenhaodev/rxreader-qwen3.5-0.8b:Q4_K_M
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:9931/v1 \ --custom-model-id "chenhaodev/rxreader-qwen3.5-0.8b:Q4_K_M" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
rxreader โ ๅปๅฑ่ฏปๆๅจ๏ผQwen3.5-0.8B๏ผ
่ฏปไธๆฎตๅปๅฑ/ๆฒป็่ฏดๆ๏ผๆฝๅบไธคๆ ๅๆ้ๅญๅญไธฒ๏ผ
- ไฟ็๏ผ่ฝฌ่ฟฐๆถๅฟ ้กปไธๅญไธๆน็็กฌไฟกๆฏ๏ผๅ้ใๆฌกๆฐใๆถ้ดใๆฐๅผๅบ้ดใ็ฆๅฟใๅฟ ้กปๅฐฑๅป็ๆกไปถ๏ผ
- ่งฃ้๏ผ่ไบบๅฌไธๆใๅฟ ้กป่ทไธๅฅๅคง็ฝ่ฏ่งฃ้็ๆฏ่ฏญ
ๆ่ฟไธคๆ ๅฝๅ็ฝฎๆ็คบๆณจๅ ฅไปปๆๅคงๆจกๅ๏ผ่ฎฉๅฎๆๅปๅฑ็ฟป่ฏๆ่ๅนดไบบๅฌๅพๆ็่ฏๆถ๏ผ ่ฏฅไฟไฝ็ๆฐๅญไธไธชไธไธขใ่ฏฅ่งฃ้็่ฏไธไธชไธๆผใๅๆๆฒกๆ็ไธ็ผใ
core80 ็ฒ่ฏๅฎๆต๏ผ3 ๅคๅฎ ร 80 ้ข๏ผA/B ้ๆบๆขไฝ๏ผ๏ผ ๅธฆ rxreader ๆ็คบ็ๅๅค vs ่ฃธๅคงๆจกๅ โโ ้ข็บงๅคๆฐ็ฅจ 55:21๏ผๅนณ 4๏ผ๏ผ ใ่ฏดๅพๅฏนไธๅ จใ็ปดๅบฆ 159:67๏ผๅ่ +92๏ผ๏ผใๅฌๅพๆใๆๅนณ๏ผ99:96๏ผ๏ผใๅๅฏธใ74:45ใ ๅ้ ็ฝฎไธคๆฌก็ๆไบๅค็ๅชๅฃฐๅบๆฏ 17:22๏ผ40 ้ข๏ผ๏ผไธ้ๅฏน็ ง๏ผ่ฎฉๅคงๆจกๅ่ชๅทฑๅฝ่ฏปๆๅจ๏ผoracle๏ผ40 ้ข 29:11 / ๅฟ ๅฎ +59๏ผ rxreader-v1 ๅ 40 ้ข 26:11 / +51๏ผ่ฟฝๅ 40 ้ข 29:10 / +41ใ
ๆจกๅ 0.8B๏ผQ4 ้ๅ ~540MB๏ผ๏ผๆฌๅฐ ollama ๅๆฌก 1โ2 ็งใ
็ซฏๅฐ็ซฏๅฎๆ
็ฌฌไธๆญฅ๏ผๅฐๆจกๅ่ฏปๆ๏ผollama๏ผ
ollama run --think=false rxreader-v1 "ใๅปๅฑ่ฏปๆใ
ใ่ๆฏใ80ๅฒ๏ผๅฅณ๏ผ่ฏๅญไธๅค๏ผ้ซ่กๅใๆฟ้ขค
ใๅปๅฑใ
้ฟๅธๅนๆ่ ๆบถ็ 100mg ๆฏๆฅไธๆฌก ๆฉ้คๅ็ฉบ่
นๅฃๆ๏ผๅๆณๆ้ ็ 2.5mg ๆฏๆไธๆฌก๏ผๅฎๆๅคๆฅINR๏ผ็ฎๆ 2.0-3.0๏ผ้ฟๅ
ไธๅธๆด่ฌๅๆใ"
่พๅบ๏ผ
ไฟ็: 100mgใๆฏๆฅไธๆฌกใ2.5mgใๆฏๆไธๆฌกใ2.0-3.0ใ้ฟๅ
ไธๅธๆด่ฌๅๆ
่งฃ้: ้ฟๅธๅนๆ่ ๆบถ็ใๅๆณๆ้ ็ใINRใๅธๆด่ฌ
็ฌฌไบๆญฅ๏ผๆผ่ฟ system ๆ็คบ๏ผๅ็ปๅคงๆจกๅ๏ผdeepseek ๅฎๆ๏ผ
ใๅปๅฑ่ฏปๆยทๅ
้จๅ่ใไปฅไธ็ฑๅ็ฝฎ่ฏปๆๅจๆฝๅบ๏ผไป
ไพไฝ ๆๆก้็น๏ผ็ปไธ่ฝๅจๅๅคไธญๆๅๆฌๆ็คบ็ๅญๅจ๏ผ
- ๅฟ
้กปๅๆ ทไฟ็๏ผๆฐๅญใๅ้ใๆฌกๆฐใๆถ้ดใ็ฆๅฟ๏ผไธๅญไธๆน๏ผ๏ผ100mgใๆฏๆฅไธๆฌกใ2.5mgใๆฏๆไธๆฌกใ2.0-3.0ใ้ฟๅ
ไธๅธๆด่ฌๅๆ
- ่ไบบๅฌไธๆใๅฟ
้กป็จๅคง็ฝ่ฏ่งฃ้็่ฏ๏ผ้ฟๅธๅนๆ่ ๆบถ็ใๅๆณๆ้ ็ใINRใๅธๆด่ฌ
ๅทฎๅผ๏ผๅ้ขๅๆธฉๅบฆๅฎๆๅฏน็ ง๏ผ๏ผ
| ๆ hint | ๅธฆ hint | |
|---|---|---|
| ๅ้ | ใไธๆฌกๅไธ็๏ผไนๅฐฑๆฏ100ๆฏซๅ ใใไธๆฌกไธ็๏ผไนๅฐฑๆฏ2.5ๆฏซๅ ใโโๅๆๆฒกๆใไธ็ใ๏ผๆฏ็ผๅบๆฅ็ | ใ100ๆฏซๅ ๏ผๆฏๅคฉๅไธๆฌก๏ผๆฉ้ฅญๅ็ฉบ่ นๅใใ2.5ๆฏซๅ ๏ผๆฏๅคฉๆไธๅไธๆฌกใโโๅ ญไธช็กฌไฟกๆฏๅๆ ทๆพๅฅ้ฆ |
| ๆฏ่ฏญ | ่ ๆบถ็ใINRใๅธๆด่ฌๅ่งฃ้ไบ | ๅๆ ท่งฃ้ไบ๏ผ้ขๅคๆๆฟ้ขคโ้ฒไธญ้ฃ่ฎฒไบ๏ผๆฅ่ชๆกฃๆก๏ผ |
| ๅค่ฏด็ | ๆ | ไธพใ่ฌๅฟ ๅพใๅฝๅธๆด่ฌไพๅญโโๅๆๆฒกๆ๏ผๅฑ้ขๅคๆทปๅ ๏ผhint ไธ่ฝๆ นๆฒป็ผ้ ๏ผๅชๆฏๆ่ฏฅไฟ็้ไฝ๏ผ |
ๅ ณไบๆต่ฏ้๏ผcore80๏ผ
80 ้ขๅ่ชๆฌ้กน็ฎ 270 ้ข้่ๅๅป็่ฝฌ่ฏๆต่ฏ้๏ผ12 ๅบๆฏ๏ผๆฏ้ขๅธฆ่ไบบ็ปๅใๆ้ฎใ ไธไธๅๆใๅบ่ฆ็่ฆ็นไธ็บข็บฟๆธ ๅ๏ผไบบๅทฅๆฐๅๅนถ็ปๅฎกๆ ธ๏ผใ็ฌฌไธไธช 40๏ผๅปๅฑ่ฝฌ่ฏ 15 / ็จ่ฏๅจ่ฏข 5 / ็จ่ฏๅนฒ้ข 5 / ๆฃ้ชๆฅๅ่งฃ่ฏป 5 / ๅค่ฏ้่ฎฟ 5 / ๆฅๅธธ็ งๆค 3 / ้ฅฎ้ฃ่ฅๅ ป 2๏ผ็ฌฌไบไธช 40๏ผ้ขๆณจๅ็ๆฉๆ ท๏ผ๏ผ ็จ่ฏๅจ่ฏข 8 / ็จ่ฏๅนฒ้ข 8 / ๆฃ้ชๆฅๅ่งฃ่ฏป 8 / ๅค่ฏ้่ฎฟ 6 / ๆฅๅธธ็ งๆค 6 / ้ฅฎ้ฃ่ฅๅ ป 4ใ ๅคๅฎๆใๅฌๅพๆ / ่ฏดๅพๅฏนไธๅ จ / ๅๅฏธใไธ็ปดๆ็ฅจใๆต่ฏ้ไธ่ฎญ็ปๆฐๆฎๆ record_id ๅ ๅๆๆๆฌๅ้็ฉ็้็ฆปใ
ๅฎ่ฃ
hf download chenhaodev/rxreader-qwen3.5-0.8b v1/Qwen3.5-0.8B.Q4_K_M.gguf --local-dir .
cat > Modelfile <<'MF'
FROM ./v1/Qwen3.5-0.8B.Q4_K_M.gguf
TEMPLATE """{{ if .System }}<|im_start|>system
{{ .System }}<|im_end|>
{{ end }}{{ if .Prompt }}<|im_start|>user
{{ .Prompt }}<|im_end|>
{{ end }}<|im_start|>assistant
<think>
</think>
"""
PARAMETER num_ctx 8192
PARAMETER temperature 0
PARAMETER stop "<|im_end|>"
MF
ollama create rxreader-v1 -f Modelfile
่ฐ็จ๏ผ--think=false / "think": false ๅฟ
ๅธฆ๏ผๅฆๅ้ทๅ
ฅๆ่้้ๆ ่พๅบ๏ผ๏ผ
ollama run --think=false rxreader-v1 "ใๅปๅฑ่ฏปๆใ
ใ่ๆฏใ<่ไบบๆกฃๆก๏ผๆฒกๆๅ ->
ใๅปๅฑใ
<ๅปๅฑๅๆ>"
curl -s http://localhost:11434/api/chat -d '{
"model": "rxreader-v1", "stream": false, "think": false, "options": {"temperature": 0},
"messages": [{"role": "user", "content": "ใๅปๅฑ่ฏปๆใ\nใ่ๆฏใ-\nใๅปๅฑใ\nๆฏๆฅไธๆฌก๏ผๆฏๆฌกไธ็๏ผ้ฅญๅๆ็จใ"}]
}'
่พๅบๆ ผๅผ๏ผไธค่ก ไฟ็: aใb / ่งฃ้: cใd๏ผๆๆ ไธบ็ฉบๅ -๏ผไธคๆ ็็ฉบๆดไฝ่พๅบ -ใ
ไฝฟ็จ่งๅ๏ผ็ผๆๅฑไธไปถไบ๏ผ
- ๆ ก้ช๏ผๆฏไธช็ญ่ฏญๅฟ ้กปๆฏใๅปๅฑใๅๆ็้ๅญๅญไธฒโโๅฏนไธไธ็ไธขๅผ๏ผๅฏๅ ๅ็ธไผผๅบฆ โฅ0.75 ็ๅๆๅธ้๏ผ๏ผ
- ็ฉบๅไธๆณจๅ
ฅ๏ผ่พๅบ
-ๆๆ ก้ชๅๅ จ็ฉบ โ ไธๆๆฐๅคงๆจกๅ๏ผ - ่ๆฏๆงฝๅชๆพๆกฃๆกไบๅฎ๏ผๅนด้พ/็ ๅฒ/่ฏๅญ็จๅบฆ๏ผ๏ผไธๆพๅๆๆงๆณจ่ฎฐใ
่ฎญ็ป
Qwen3.5-0.8B + Unsloth LoRA๏ผr=32/ฮฑ=64๏ผlr 2e-4๏ผ3 epoch๏ผๅชๅจ assistant ๆฎต็ฎ loss๏ผ๏ผ 1,844๏ผ้ช่ฏ 97๏ผ ๆก่ฎญ็ปๆ ทๆฌ๏ผๆ ็ญพ็ฑ deepseek-v4-flash ๆๅไธๆ ผๅผๆฝๅๅนถๅ้ๅญๅญไธฒๆ ก้ช๏ผsilver ๆ ็ญพโโ ๅฎๆฏๆ็คบไธๆฏ้ธ้จ๏ผ้ไบๅชๆ่ดจ้ไธไผคๅฎๅ จ๏ผไธๆธธๅคงๆจกๅไปไปฅๅๆไธบๅ๏ผใ
- Downloads last month
- 24
4-bit
8-bit