Yi Cui
onekq
AI & ML interests
Benchmark, Code Generation Model
Recent Activity
posted an update about 5 hours ago
There has been a leaked memo (now struck down) from the founder of DeepSeek. I'm not here to circulate it, but comment on the minimum-effort evolutionary path he proposed.
LLM->CoT->Agent->Self-improvement->Singularity->Physical
This makes sense to me: even at the agent stage I learn world models much faster than when I learned LLM at the LLM stage.
But this means humans are still needed beyond the digital singularity, until robots can close their own loop: eval, manufacturing, self improvement, i.e. physical singularity. posted an update 1 day ago
The Nvidia paper came down to this: remove synchronization barriers. DeepSeek has already done that with DeepEP (which this paper cited) one layer above.
https://huggingface.co/papers/2607.16100
Nevertheless this is great. More users will benefit from this:
Nvidia NCCL > SGLang/vLLM DeepEP upvoted a paper 2 days ago
Every Microsecond Matters: Achieving Near Speed-of-Light Latency in GPU Collectives