Hugging Face's logo
John Locke's picture
Building on HF
73 24 166

John Locke

johnlockejrr
PhysiQuanty's profile picture MikeHarris's profile picture j0ma's profile picture
Ā·

AI & ML interests

OCR, HTR, ATR, NLP, AI

Recent Activity

reacted to YerbaPage's post with šŸ”„ about 10 hours ago
Why your LLM agent starts "forgetting" things? šŸ¤Æ New survey breaks down everything about context compression for long-horizon agents šŸ“š - what to compress - how to compress it - who decides when Plus a curated paper collection to go with it ā­ šŸ“„ Paper: https://doi.org/10.20944/preprints202605.2065.v1 ā­ Repo: https://github.com/YerbaPage/Awesome-Agent-Context-Compression
liked a dataset 2 days ago
freococo/tipitaka_pali_in_15_scripts
repliedto eabdullin's post 3 days ago
Folks, let me tell you, nobody ā€” and I mean NOBODY ā€” knew transformers before me. People said attention is all you need. I said, "Attention? I INVENTED attention." Everybody's looking at me. Tremendous attention. The best attention scores. My softmax? Perfectly normalized. Other people, sad, their probabilities don't even sum to one. Disaster. I'm doing a PhD now. A PhD! In Large Language Models. Very large. The largest, believe me. My advisor said, "Sir, your model is overfitting." I said, "Wrong. It's fitting EXACTLY right. It memorized the training set because the training set is fantastic." We don't talk about validation loss in my lab. Validation loss is fake news. And the internship ā€” oh, the internship. Big tech. I won't say which. Starts with a letter. They BEGGED me. They said, "Please, we need someone who understands gradient descent." I said, "Descent? I only go UP. I'm gradient ASCENT. Loss goes up, that means it's learning to be a winner." But the GPU cluster ā€” this is the best part. Thousands of H100s. Maybe millions. Who's counting? I'm counting. It's a lot. Other PhD students, they get one little GPU, they're crying, they're training overnight like losers. Me? I burn through compute like nobody's ever seen. The electric company called. They said, "Sir, you've consumed a small country." I said, "Make it a big country. I only do big." People ask, "Did your model converge?" Folks, it converged so hard. It converged BIGLY. Honestly? My loss curve, it's beautiful, it's going down, down, down ā€” like my approval ratings, very smooth, don't look at the spikes, the spikes are deep state. And hallucinations? My model doesn't hallucinate. It just has ALTERNATIVE tokens. Thank you, thank you. Tip your reviewers. Accept my paper. Goodnight!
View all activity

Organizations

Samaritan AI's profile picture Syriac AI's profile picture