The devil works fast but lucidrains works faster

It seems like OpenAI might actually be testing two models!

'im-a-good-gpt2-chatbot'

'im-also-a-good-gpt2-chatbot'

It's back?! The saga continues! 👀

'im-a-good-gpt2-chatbot' is currently only available in battle mode at chat.lmsys.org

xLSTM: Extended Long Short-Term Memory

abs: arxiv.org/abs/2405.04517

Leveraging the latest techniques from modern LLMs, mitigating known limitations of LSTMs (introducing sLSTM and mLSTM memory cells that form the xLSTM blocks), and scaling up results in a highly competitive…

It seems like OpenAI might actually be testing two models!

'im-a-good-gpt2-chatbot'

'im-also-a-good-gpt2-chatbot'

🦣 MAmmoTH2: Scaling Instructions from the Web

proj page: tiger-ai-lab.github.io/MAmmoTH2/
abs: arxiv.org/abs/2405.03548

Introduces the WebInstruct dataset, a dataset of 10M instructions examples harvested from Common Crawl through a 3-step process: 1) seed data from crawling quiz…

Is Flash Attention Stable?

abs: arxiv.org/abs/2405.02803

Researchers from Meta introduce a new framework to understand the effects of numeric deviation and apply this framework to analyze Flash Attention.

'Flash Attention sees roughly an order of magnitude more numeric…

AI researchers were interested in a different drama this past weekend

A reminder that some of the most competitive open-source foundation models come from China: Qwen, Yi, InternLM, Deepseek, BGE, CogVLM, etc.

The narrative that China is behind on AI is simply not true. Instead they are making major contributions to the ecosystem and community.

AI researchers were interested in a different drama this past weekend

First of all, depending on the textbooks, twenty can be a lot!

Second of all, there's so much tacit, practical knowledge that is not in textbooks and often the only way to get that knowledge is by doing stuff hands-on & talking to others.

So IMO this take isn't very accurate

Join me in congratulating my younger sister Tiara Abraham #Classof2024 👏👏

At 18 she is the youngest student across all 7 Indiana University campuses to receive a grad degree 🎓!

Next up, doctorate in music also at IU Bloomington 🎵🎶

What is the oldest meme template that uses an AI image?

I think it might be this one