What cultural values do GPT-4o, 4, 3.5, 3 express? Using World Values Survey questions, we find GPT consistently aligns with English-speaking countries/Protestant Europe. We show that Cultural Prompting improves alignment. arxiv.org/abs/2311.14096 Yan Tao Olga Viberg @BakerEDMLab

Paul Graham on why ambitious people need to be around other ambitious people:

🚀Startschuss für das Projekt GENIUS am IPN, gefördert von der telekomstiftung Ziel: Mit #KI die Beurteilungs- und Feedbackprozesse in der #Schule verbessern und neue Maßstäbe setzen🌟📚🤖 Mehr Infos: leibniz-ipn.de #DigitaleBildung Copyright Foto: Timo Wilke

Neuer Blogbeitrag: Kann KI Lehrkräfte bei der Beurteilung von Schüler:leistungen unterstützen? Dr. Thorben Jansen Thorben Jansen vom IPN fasst die aktuelle Forschungslage zusammen und leitet daraus Implikationen für die Praxis ab. fiete.ai/blog/kuenstlic…

Hate it when you ask o1-preview a hard question and it thinks for less than a second. You really feel that you failed to interest the AI in your problem.

Have a question that is challenging for humans and AI? We (Center for AI Safety + Scale AI) are launching Humanity's Last Exam, a massive collaboration to create the world's toughest AI benchmark. Submit a hard question and become a co-author. Best questions get part of $500,000 in

I cannot agree with this more. Please use basic research methods on AI benchmarking!

Two simple rules: 1. You get better at what you practice. 2. Everything is practice. Look around and you may be surprised by what people are “practicing" each day. If you consider each moment a repetition, what are most people training for all day long? Many people are

I read a lot of social science papers on AI and my conclusion is that there are far too few people rigorously studying the implications (good & bad) of LLMs Computer science is producing a tide of good AI work. Economics, management, psych, & sociology etc. need to do the same.

Our lack of good deep measures of human creativity, reasoning, empathy, etc. is really a problem in AI right now. A lot of tests that were "good enough" for human research (RAT for creativity, Seeing the Mind in The Eyes for empathy) are not robust enough for benchmarks for AI.

We’re releasing Humanity’s Last Exam, a dataset with 3,000 questions developed with hundreds of subject matter experts to capture the human frontier of knowledge and reasoning. State-of-the-art AIs get <10% accuracy and are highly overconfident. pak.ai Scale.ai

“Self-beliefs in childhood and adolescence can influence important life outcomes years later.” Building competencies, with adult support, can help children develop positive self-beliefs, say Jennifer Meyer & Thorben Jansen. Jennifer Meyer Thorben Jansen boldscience.org/how-do-childre…

We have to take the LLMs to school. When you open any textbook, you'll see three major types of information: 1. Background information / exposition. The meat of the textbook that explains concepts. As you attend over it, your brain is training on that data. This is equivalent

we trained a new model that is good at creative writing (not sure yet how/when it will get released). this is the first time i have been really struck by something written by AI; it got the vibe of metafiction so right. PROMPT: Please write a metafictional literary short story

I suspect that a lot of "AI training" in companies and schools has become obsolete in the last few months As models get larger, the prompting tricks that used to be useful are no longer good; reasoners don't play well with Chain-of-Thought; hallucination rates have dropped, etc.

Most people don't realize they can significantly influence what frontier LLMs improve at, it just requires some work. Publish a high-quality eval on a task where models currently struggle, and I guarantee future models will show substantial improvement on it.

There’s no demand for “average.”

x.com/i/article/1909…

I just realized something most people are going to lose when (as they inevitably will) they start using AIs to write everything for them. They'll lose the knowledge of how writing is constructed.

The most important skill for a researcher is not technical ability. It's taste. The ability to identify interesting and tractable problems, and recognize important ideas when they show up. This can't be taught directly. It's cultivated through curiosity and broad reading.