New (2h13m 😅) lecture: "Let's build the GPT Tokenizer" Tokenizers are a completely separate stage of the LLM pipeline: they have their own training set, training algorithm (Byte Pair Encoding), and after training implement two functions: encode() from strings to tokens, and

Today we're excited to introduce Devin, the first AI software engineer. Devin is the new state-of-the-art on the SWE-Bench coding benchmark, has successfully passed practical engineering interviews from leading AI companies, and has even completed real jobs on Upwork. Devin is

# automating software engineering In my mind, automating software engineering will look similar to automating driving. E.g. in self-driving the progression of increasing autonomy and higher abstraction looks something like: 1. first the human performs all driving actions

“When you’ve had success for too long, you’ll lose the desire to take risks” Elon Musk

All thanks to my AMAZING students! You're the reason I get to do what I love. I'm the lucky one, seriously! usu.edu/provost/univer…

Want to understand how GPTs really work? 3blue1brown's new videos on attention visualization are a game-changer. Watch here: youtube.com/watch?v=eMlx5f… #AI #LLM #GPT

So excited to join Applied Conformal Prediction 's course and learn from the best Valeriy M., PhD, MBA, CQF . maven.com/s/ae4546ceff

Please stop asking 😅

Step-by-Step Diffusion: An Elementary Tutorial

If I had to pick a side, then I would go with GeoffreyHinton for sure 🤔

If you are a student or academic researcher and want to make progress towards human-level AI: >>>DO NOT WORK ON LLMs<<< LLMs are an off ramp. Thousands of engineers are working on LLMs with enormous computing resources. The only way you could possibly contribute is by analyzing

The paper we have been waiting for essentially shows that #timeseries #llms do not work in forecasting. Back in 2022, paper “Are Transformers Effective for Time Series Forecasting?“ challenged the appearing narrative that transformers are useful for forecasting. By removing

Deep Learning is not what you need for tabular data. Transformers and LLMs is not what you need for forecasting. Bayesianism, Gaussian processes is not what you need for uncertainty quantification. #tabulardata #uncertainty #bayesianism #llm

🚀 2024 Data Science Toolkit: In: CatBoost, XGBoost, LightGBM, LLMs (not for time series), Conformal Prediction Out: Bayesianism, Gaussian Processes, Transformers & LLMs for time series #datascience #ML #AI #2024Trends

In the next decade, data science analysts out, data science automation in 🚀. Learn generative AI to stay competitive!

announcing our new small model gpt-4o-mini! smarter than Claude Haiku and Gemini Flash, and 30x cheaper than gpt-4o openai.com/index/gpt-4o-m…

What a crazy week for AI: - OpenAI launches SearchGPT - Meta releases Llama 3.1 - Mistral AI releases Mistral Large 2 - DeepMind AI gets silver medal at Int. Math Olympiad - Elon announces push to Grok 2&3 Competition is intensifying. The months ahead will be super exciting 🤯

Programming is changing so fast... I'm trying VS Code Cursor + Sonnet 3.5 instead of GitHub Copilot again and I think it's now a net win. Just empirically, over the last few days most of my "programming" is now writing English (prompting and then reviewing and editing the