SicariusSicariiStuff/Assistant_Pepe_32B_GGUF
33B • Updated • 746 • 7
Eloy
EloyOn
AI & ML interests
None yet
Recent Activity
liked a model about 17 hours ago
SicariusSicariiStuff/Assistant_Pepe_32B_GGUF liked a model about 17 hours ago
SicariusSicariiStuff/Assistant_Pepe_32B liked a model 1 day ago
bartowski/ukisai_Swift-Qwen3.8-27b-GGUFOrganizations
None yet
liked 2
models about 17 hours ago
liked a
model 1 day ago
liked a
model 4 days ago
updated a
bucket 4 days ago
published a
bucket 4 days ago
liked 2
models 5 days ago
liked a
model 7 days ago
liked 5
models 11 days ago
ReadyArt/Melody1437-35B-A3B-GGUF
36B • Updated • 3.42k • 8
ajgazin/Swift-Qwen3.8-27B-Uncensored-MTP
Image-Text-to-Text • 28B • Updated • 878 • 22
ukisai/Swift-Qwen3.8-27b
Image-Text-to-Text • 28B • Updated • 7.93k • 633
ajgazin/Swift-Qwen3.8-27B-Uncensored-Dynamic-MTP-GGUF
Image-Text-to-Text • 0.5B • Updated • 22k • 47
codavidgarcia/Qwen3.8-27B-Uncensored-Heretic-MTP-UD-GGUF
Text Generation • 27B • Updated • 4.3k • 4
liked a
model 14 days ago
updated a
bucket 14 days ago
published a
bucket 14 days ago
reacted to Undi95's post with 🔥 15 days ago
Post
4,421
Yo, I'm back, and I'm currently trying to teach a local LLM to stop waiting for a prompt kek.
I'm building a small proof of concept: can an open-weight model (Qwen3.8-27B, running locally on 2 RTX 5090 GPUs) learn to direct itself, then improve from its own exploration, without a human in the loop and without breaking it for normal use?
No user, no task. The model only gets observations from its environment. Each turn, it writes its own agenda (goal/open questions/next step), then picks an action: search the web, read a page, or take a note.
The environment is the judge, not another LLM. A note is accepted only if it quotes the page it read word for word. Facts are checked by exact match.
Later, code will be checked by actually running tests.
The best episodes become fine-tuning data (LoRA). The helper system prompt is removed at training time, so the behavior has to live in the weights.
Each new model goes through a fixed benchmark gate: math, general knowledge, "does it still answer humans normally?", autonomy, and learned facts on held-out sources. It's kept only if nothing regresses, otherwise it's discarded. Then the loop starts again.
The full pipeline works end to end: collect, train, merge, deploy, benchmark. The baseline is clear. Without any instructions, the base model's real autonomy is zero: it behaves like a chatbot waiting for a question. That's the number this small project is trying to move.
I haven't found a public tool that runs this whole loop (self-directed exploration, verifiable rewards, continual fine-tuning and a regression gate) on home hardware. The goal isn't AGI in a bedroom. It's to show that anyone can try it, measure it honestly, and see where it breaks.
Code and results will be released once the first real iterations are done. At the moment the code is... running, but made with scotch and stick, still only a PoC I want to try.
Did you already tried something like that? What was your result? I'm curious!
I'm building a small proof of concept: can an open-weight model (Qwen3.8-27B, running locally on 2 RTX 5090 GPUs) learn to direct itself, then improve from its own exploration, without a human in the loop and without breaking it for normal use?
No user, no task. The model only gets observations from its environment. Each turn, it writes its own agenda (goal/open questions/next step), then picks an action: search the web, read a page, or take a note.
The environment is the judge, not another LLM. A note is accepted only if it quotes the page it read word for word. Facts are checked by exact match.
Later, code will be checked by actually running tests.
The best episodes become fine-tuning data (LoRA). The helper system prompt is removed at training time, so the behavior has to live in the weights.
Each new model goes through a fixed benchmark gate: math, general knowledge, "does it still answer humans normally?", autonomy, and learned facts on held-out sources. It's kept only if nothing regresses, otherwise it's discarded. Then the loop starts again.
The full pipeline works end to end: collect, train, merge, deploy, benchmark. The baseline is clear. Without any instructions, the base model's real autonomy is zero: it behaves like a chatbot waiting for a question. That's the number this small project is trying to move.
I haven't found a public tool that runs this whole loop (self-directed exploration, verifiable rewards, continual fine-tuning and a regression gate) on home hardware. The goal isn't AGI in a bedroom. It's to show that anyone can try it, measure it honestly, and see where it breaks.
Code and results will be released once the first real iterations are done. At the moment the code is... running, but made with scotch and stick, still only a PoC I want to try.
Did you already tried something like that? What was your result? I'm curious!
- 22 replies
liked 2
models 16 days ago
