Check out a new hybrid approach that leverages both ML and rule-based semantic engines to build a Transformer-based semantic code completion model, which we show can improve developer efficiency. Read more ↓ goo.gle/3bfeY3I

The OCaml Users and Developers Workshop is gonna be fun. Some exciting talks from Jane Street folk: A talk on the memo library that powers Dune: icfp22.sigplan.org/details/ocaml-…

Today I wrote an article about my experience learning OCaml batsov.com/articles/2022/… I hope some of you (e.g. those interested in the language) will find it useful!

#aiohttp author, #asyncio expert, and #Python Core Dev is looking for a remote job. Linkedin profile: linkedin.com/in/andrew-svet… . A retweet is welcome.

A survey of parser generator usage in major language implementationss: notes.eatonphil.com/parser-generat… Most have a handwritten parser. GCC and Go moved from generated to handwritten. SQLite and Python <3.10 built their own parser generators!

Testing should feel like work in a REPL that we persist. blog.janestreet.com/the-joy-of-exp…

The FIDE World Chess Championship 2023 will take place in Astana, Kazakhstan, from April 7 to May 1. A new World Champion will be crowned, as Ian Nepomniachtchi and Ding Liren will battle to seize the throne left vacant by Magnus Carlsen’s withdrawal. fide.com/admin/news/2180

“Choosing a distribution is not a statistical question; it is a modeling decision. No statistical test can tell you whether a particular distribution is a good model for your data” - yes!

New paper🚨! SPEAR-TTS is a multi-speaker TTS that can be trained with only 15min of single-speaker parallel data. It synthesises high-quality speech & can generalise zero-shot to a new voice using only a 3s sample. 🧵>>

ICFP Programming Contest 2023 will be held between 7th to 9th of July, 2023. Contest chair is Aymeric Fromherz, and I will be acting as the co-chair. Follow @icfpcontest2023 and icfpcontest2023.github.io for announcements.

There you have it people. The only thing hotter than LLMs and AI, is Python packaging!

OCaml wins the 2023 SIGPLAN programming languages software award! 🎉sigplan.org/Awards/Softwar…

Are you a PhD student interested in the interface between generative AI, LLMs and audio? Our team at Google behind AudioLM, MusicLM and AudioPaLM is looking for a talented student researcher! See details and apply google.com/about/careers/… and send your cv to [email protected].

Friend reminder that it’s all regression x.com/zfurnas/status…

The trilogy is complete! My "Advanced Topics" book is officially released today. Buy it on Amazon, or get it for free at probml.github.io/pml-book/book2….

Our team is looking for a strong research engineer, hardware background is *not* obligatory. Please, share and recommend someone! boards.greenhouse.io/deepmind/jobs/…

Many of you are excited about H100 attention, so it’s a good time to show you Mosaic GPU: a Python DSL for H100s. The attention example matches FA3 performance, while being only ~200 lines of Python: github.com/google/jax/blo… It's easy to install too! Latest JAX packages have it.

I've finally landed my first proper JAX feature since joining the team: a supported "foreign function interface", which makes it easier to call into external libraries from within JAX code. Check it out: jax.readthedocs.io/en/latest/ffi.…

Curious how to write SOTA performance Blackwell matmul kernels using MGPU? We just published a short step-by-step tutorial: docs.jax.dev/en/latest/pall… At each step, we show exactly what (small) changes are necessary to refine the kernel and the final kernel is just under 150 lines.

Want to improve GPU compute/comms overlap? We just published a new short tutorial for you! A few small changes to the Pallas:MGPU matmul kernel is all it takes to turn it into an all-gather collective matmul that overlaps NVLINK comms with local compute: docs.jax.dev/en/latest/pall…