Model checkpoints trained with varying LCCP token budgets, paper: “Don't Stop Long-Context Continual Pre-Training Too Early: An Empirical Scaling Law”
EdenQiao
EdenQiao
·
AI & ML interests
None yet
Recent Activity
updated a collection 6 days ago
Don't Stop LCCP! updated a model 6 days ago
EdenQiao/dont-stop-lccp-1.22b-32k-80n authored a paper 6 days ago
Competing Learning in Hybrid ArchitecturesOrganizations
None yet