The open source learning curve for AI researchers

Machine learning and AI researchers are finding their work quickly integrated and adapted by hobbyists and open source developers.

a group of scientists playing in a rock band in front of a large crowd — midjourney

Tri Dao, the creator of an increasingly popular technique in language model development, is running head-first into a new problem for AI researchers: working with the incredibly fast LLM open source community.

Dao is one of the creators of FlashAttention, a technique now a…