Twitter really is quite an experience

A useful paper for people who want to start using LLMs in their research: AI can do a great job on data annotation, but it depends on the specific task Especially neat is that the authors put together a tool for assessing AI annotations versus human work: github.com/npangakis/gpt_…

👋NEW 📜🧵 With Yphtach Lelkes & Sam Wolken, I'm excited to release a new paper "The Rise of and Demand for Identity-Oriented Media Coverage." Conditionally accepted AJPS URL: papers.ssrn.com/sol3/papers.cf… 1/

Excited to speak on this panel entitled, “ChatGPT turns one: How is generative AI reshaping science?” Looking forward to discussing my latest research on integrating artificial intelligence tools effectively and responsibly into research practices: web.sas.upenn.edu/data-science/h…

An explanation for why GPT-4 is degrading: "... we find that on datasets released before the LLM training data creation date, LLMs perform surprisingly better than on datasets released after" New tasks are difting away from what GPT-4 was trained on.

Just FYI for people getting APSA proposals in, me and Nick Pangakis are hosting a Large Language Models pre-conference on (day before APSA) Sept 4 at UPenn. Details will appear here, application form will open next month: arthurspirling.org/LMiSS/

🚨 Language Model APSA Preconference🚨 Applications now open for the UPenn/Princeton LM APSA preconference (hosted by me and Nick Pangakis). Deadline is April 19. Please circulate and apply to present/discuss/attend! arthurspirling.org/LMiSS/

Folks -- just an FYI that the deadline to submit for the Language Models preconference is April 19. Also, I'm not sure why it matters, but no, we do not plan to serve La Croix at the lunch. You can BYO, but I'm not buying it for you. cc Nick Pangakis

Very little polisci work using LLMs is "replicable" in the usual sense of that term. If this sounds like a problem, come see ppr w Christopher Barrie and Lexi Palmer Thurs @ APSA 12-130pm, PCC112A. We give some theory + empirics on where things stand and where we should be trying to go

Great to see everyone at LMiSS! Fantastic papers, discussions and chat. Appreciate Nick Pangakis and the UPenn crew for making this happen. arthurspirling.org/LMiSS/pages/ag…

Super excited to announce that Microsoft Research's FATE group, Sociotechnical Alignment Center, and friends have several workshop papers at next week's NeurIPS Conference. A short thread about (some of) these papers below... #NeurIPS2024

Alright, people, let's be honest: GenAI systems are everywhere, and figuring out whether they're any good is a total mess. Should we use them? Where? How? Do they need a total overhaul?