A young student wants to start a side-project with music machine learning (would be their first ML project), What's a good starting point in terms of datasets that would work with modern methods?

Question for LLM friends:

Do we know what self-supervised objective was used to train Gemma (or Llama, Mistral for that matter)?

Is it just autoregressive next token prediction at scale, or are more advanced span denoising objectives (eg. UL2) what top labs use right now?

6 papers to review for ICML Conference in less than 30 days.

This is not sustainable, especially because these are all either deeply theoretical work on geometry, or completely new applied work (not we-beat-sota-by-1%).

I’ll still do my best job but my own work will suffer.

This arxiv.org/abs/2402.05501 looks like a nice overview of the current landscape of using machine learning to enhance mixed-integer linear optimization problems. (By Lara Scavuzzo, Karen Aardal, Andrea Lodi, Neil Yorke-Smith.)

Tomorrow (Monday) reading group session: Michael Galkin presents 'Towards Foundation Models for Knowledge Graph Reasoning' arxiv.org/abs/2310.04562!

I predict there will be at least 1 meme slide🙃

Join us on Zoom at 11am ET / 5pm CET / 4pm UTC: portal.valencelabs.com/logg

📢🔥 My team at NVIDIA Research is looking for full-time research scientists & summer interns.

Topics of interest are:
1⃣Gen AI for science (climate, biology, chemistry)
2⃣Image/Video/3D (generate, edit, manipulate)
3⃣Fundamental generative learning

Apply via links below

I am recruiting postdocs for 2024!😃

3 fellowships available:
🌐Geometric and Topological Deep Learning
🧠Foundation Models for Neuroscience
⚕️AI for Women’s Brain Health.

Interested? Apply here!
tinyurl.com/mtwf3tuu

This is how our campus looks like in the winter🌴😜

I am happy to announce I started an assistant professorship at Rheinische Friedrich-Wilhelms-Universität Bonn and Lamarr Institute this month! My group is called 'Geometry in Machine Learning' and I am hiring PhD students (with full-time positions) at the moment: zorah.github.io/positions/

📣 We are looking for a PhD intern interested to work with us on generative models in FAIR EMEA (specifically, Paris)!

Exciting opportunity! Join my new research group at the University of Zurich as a PhD candidate in Reinforcement Learning.
Contribute to cutting-edge AI research and shape the future of the field 🔥
To apply follow the instructions on my website: gioramponi.github.io
#UZH #RL

Internship opportunity 🤓 - work with us on generative AI for antibody design

Apply here: careers.roche.com/global/en/job/…

Want to learn in-depth about the emerging connections between Weisfeiler-Leman and GNNs? Check out our JMLR paper: jmlr.org/papers/v24/22-….

Joint work with very nice co-authors: Yaron Lipman, Haggai Maron, Bastian Grossenbacher-Rieck, Nils M. Kriege, Martin Grohe, Matthias Fey, and Karsten Borgwardt.

🚨Job alert🚨 (please R/T)

Recruiting a new Ph.D. student w/ a computational biology background (loosely interpreted) for a project at the intersection of #MachineLearning & novel gene therapies.

DM for details or send your CV to [email protected]

#NeurIPS2023

At NeurIPS this week. Come find me at the following places:
- Thu Poster Session 5 10:45: #1016 on Invariance in G-CNNs
- Fri UniReps Workshop 9:00 - 9:30: Talk on Symmetry & Universality
- Sat Symmetry and Geometry in Neural Representations Workshop 11:30 - 12:00: Moderating the panel / organizing all day ✨

PyTorch Geometric High Order, the new library for high-order GNNs by Muhan Zhang and his team looks great!
In addition to classics such as PPGN, you will also find implementations for many subgraph GNNs like NGNN, DSS-GNN, SUN, GNN-AK, SSWL, etc.

graphpku.github.io/PyGHO_doc/

Current chatbots can pass the Turing Test, right?

A lot of people have claimed this, but Cameron Jones (Cameron Jones) and Benjamin Bergen of UCSD actually tested the claim!

(Spoiler: The answer is 'no, they don't pass.')

arxiv.org/abs/2310.20216

Here are the top 10 reviewers for LoG 2023, as chosen by the community! Congratulations to everyone, and thank you for your contribution to LoG! 🤗

Dobrik Georgiev Alex Morehead (何聪) Francesco Di Giovanni Yunan Luo Rishi Sonthalia Giorgos Bouritsas (@[email protected]) Arjun Subramonian (they/அவங்க/elle) J. Nastos C. Bravo-Hermdorff, R. Abboud