Ronen Zyroff

BigBlueWhale

·

AI & ML interests

None yet

Organizations

None yet

New activity in SulphurAI/Sulphur-2-base 2 months ago

Programmatic Sulphur-2 on RTX 5090 in 2 commands ⚡

#22 opened 2 months ago by

New activity in microsoft/VibeVoice-ASR 4 months ago

32GiB VRAM inference using Docker- my working setup

#21 opened 4 months ago by

New activity in mistralai/Devstral-Small-2-24B-Instruct-2512 5 months ago

No community 4-bit quantization of Devstral Small 2 24B works on vLLM v0.15.1 — Ministral3ForCausalLM missing from registry

#26 opened 5 months ago by

New activity in androiddrew/Devstral-Small-2-24B-Instruct-2512-AWQ-4bit 5 months ago

AWQ 4-bit produces repetitive gibberish on long outputs with vLLM v0.15.1 — same bug as cyankiwi variant

#1 opened 5 months ago by

New activity in cyankiwi/Devstral-Small-2-24B-Instruct-2512-AWQ-4bit 5 months ago

AWQ 4-bit produces repetitive gibberish on long outputs with vLLM v0.15.1 — root cause identified

#5 opened 5 months ago by

New activity in Qwen/Qwen-Image-2512 7 months ago

Extremely slow on 5090

#1 opened 7 months ago by

New activity in Qwen/Qwen3-VL-32B-Instruct 8 months ago

Best non-thinking model qwen ever released

#7 opened 8 months ago by

New activity in Qwen/Qwen3-VL-32B-Thinking-GGUF 8 months ago

Disappointment in text performance

#1 opened 8 months ago by

New activity in Qwen/Qwen3-VL-32B-Thinking 8 months ago

Qwen3-32B (April 2025) is superior

#2 opened 8 months ago by

New activity in Qwen/Qwen3-VL-32B-Instruct 9 months ago

Recommended model parameters

#5 opened 9 months ago by

How about running by llama.cpp

#1 opened 9 months ago by

New activity in Qwen/Qwen3-VL-32B-Thinking 9 months ago

Best open source model ever, period.

#1 opened 9 months ago by

New activity in TheBloke/Airoboros-c34B-2.1-GGUF almost 3 years ago

Fix prompt format in llama.cpp command

#2 opened almost 3 years ago by

Best open source model for coding (August 2023)

#1 opened almost 3 years ago by

New activity in jondurbin/airoboros-c34b-2.1 almost 3 years ago

wizardcoder-python-34b sucks. Is this any better?

#1 opened almost 3 years ago by

New activity in TheBloke/WizardCoder-Python-34B-V1.0-GGUF almost 3 years ago

This model looks insanely good for coding ( 73.2 for humanEval )!

#1 opened almost 3 years ago by

New activity in TheBloke/llama2_70b_chat_uncensored-GGML almost 3 years ago

Uncensored my ass ....

#2 opened almost 3 years ago by

New activity in jondurbin/airoboros-l2-70b-gpt4-1.4.1 almost 3 years ago

Works perfectly in CPU mode with oobabooga

#4 opened almost 3 years ago by

New activity in TheBloke/StableBeluga2-70B-GPTQ almost 3 years ago

Why so few 8 bit capable models?

#13 opened almost 3 years ago by

New activity in jondurbin/airoboros-l2-70b-gpt4-1.4.1 almost 3 years ago

Works perfectly in CPU mode with oobabooga

#4 opened almost 3 years ago by