This collection contains my GPT-3 Small implementations. All models here share same architecture and are same model on different training stages.
Kyryll Kochkin
k050506koch
AI & ML interests
LLMs. I am obsessed with them. Worked with dense models so far, and plan to experiment with MoEs.
Organizations
None yet