🔄 In a Training Loop

Wayne Workman PRO

wayneworkman2012

·

https://wayne.theworkmans.us/

AI & ML interests

LLMs

Recent Activity

liked a Space about 2 hours ago

CodeSoft/MetaDiffusion-Demo

repliedto CodeSoft's post about 2 hours ago

Over the past week or so, I've been working on some models, those released being https://huggingface.co/CodeSoft/sorbet-25m and https://huggingface.co/CodeSoft/sorbet-v2-25m. In general, I'm a little confused because no matter what hyperparameters I change or datasets I add/remove, the benchmarks never move up. In a recent project, where I attached a TN-gram block to Sorbet-v2-25M, it still stayed the same on benchmarks despite the TN-gram clearly learning (due to the perplexity being lower with the TN-gram attached). When I changed the corpus to favor higher density text (the first paragraphs of Wikipedia articles and synthetic math), the benchmarks either stayed flat or went down. Does anyone have ideas on what I can do to improve my models? I'd really appreciate any feedback!

repliedto CodeSoft's post about 3 hours ago

Wow, SLM Arena is getting a lot of traffic! Thank you guys for showing your interest! To handle the growing demand, I’m moving SLM Arena from a CPU Space to a ZeroGPU Space. Hopefully, this will let me add more models to SLM Arena while keeping it running fast. I've also added a separate arena + leaderboard for base models! If there are any models or features you’d like to see, let me know in a reply to this post or in a Community post on the Space!

View all activity

Organizations

wayneworkman2012 's Spaces 1

WWII Dialog Collector

Chat with an AI historian about World War II