🔥The 9th Round of Easy Loan, Earn $40 Reward is in progress❗️ ⏰ Promotion Period: January 15th - Feburary 15th, 2025 👉 Register now and check more details at gate.io/campaigns/358

Also happy to see GloVe winning the 10-year test-of-time award.

Wow, Noble prize winner. Ex. Turing award winner :))

So, Sam Altman is advancing the physics?

Geoffrey Hinton says he is particularly proud that one of his students fired Sam Altman because Sam is much less concerned with AI safety than with profits

🎉Good news, everyone! 🎉 I will recruit graduate students on the algorithmic and theoretical aspects of Reinforcement Learning. You will join Adage, Mila - Institut québécois d'IA, and Polytechnique Mtl. More info on why and how you should apply: academic.sologen.net/2024/11/22/gra… Deadline: Dec 1st

No thanks :)

I think Elon Musk should be expelled from the British Royal Society. Not because he peddles conspiracy theories and makes Nazi salutes, but because of the huge damage he is doing to scientific institutions in the US. Now let's see if he really believes in free speech.

Our MIT class “6.S184: Introduction to Flow Matching and Diffusion Models” is now available on YouTube! We teach state-of-the-art generative AI algorithms for images, videos, proteins, etc. together with the mathematical tools to understand them. diffusion.csail.mit.edu (1/4)

Neat website that has a bunch of CUDA programming problems: leetgpu.com

Just got an access for testing the new GPU cluster of Amii. Something around 800 L40 GPUs! Amazing!!!

This is crazy

I saw a job posting today seeking research scientists for post-AGI research :)))))

Not sure what kind of AGI it is. When you use the wrong chat template, your LLMs become dumber :)

My solution to every GPU out-of-memory errors: use_peft: true lora_r: 64 lora_alpha: 64 lora_dropout: 0.01 lora_target_modules: - q_proj - k_proj - v_proj - o_proj bf16: true gradient_accumulation_steps: 16 optim: adamw_8bit

I am pleased to announce a new version of my RL tutorial. Major update to the LLM chapter (eg DPO, GRPO, thinking), minor updates to the MARL and MBRL chapters and various sections (eg offline RL, DPG, etc). Enjoy! arxiv.org/abs/2412.05265