Sawyer Bowerman

soyrsoyr's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in soyrsoyr/Qwen3.8-27B-W4A16-AWQ-GPTQ 2 months ago

4× RTX 3090 vLLM/Marlin results: ~66 tok/s, TP4, 256K context

1

#1 opened 2 months ago by

mwyborski

New activity in soyrsoyr/Qwen3.6-27B-FP8-dynamic 2 months ago

MTP support

1

#1 opened 2 months ago by

MegaPSV

New activity in huggingface/InferenceSupport 2 months ago

RedHatAI/DeepSeek-R1-Distill-Qwen-32B-quantized.w4a16

#11567 opened 2 months ago by

soyrsoyr

New activity in soyrsoyr/erebus-487m-instruct 4 months ago

Adding `safetensors` variant of this model

#1 opened 4 months ago by

SFconvertbot