"A random half of panelists were shown a CV and only a one-paragraph summary of the proposed research, while the other half were shown a CV and a full proposal. We find that withholding proposal texts from panelists did not detectibly impact rankings." link.springer.com/article/10.100…

Share your ideas on how we can change research assessment. We want everyone’s opinion, no matter how crazy or unconventional! It's a one question survey (with a few demographic questions)! Share with everyone you know! 😀 uhasselt.qualtrics.com/jfe/form/SV_aW…

The Prompt Report: A Systematic Survey of Prompting Techniques arxiv.org/abs/2406.06608 WS-DL Group, ODU CS AI4SciSci

Abstracts of research papers: who should write them? how and when should they be circulated? A revised and expanded version of my thoughts on the history of "abstracts" has just appeared in Nature Reviews Physics. doi.org/10.1038/s42254… (if you have a subscription...) Initiative for Open Abstracts

🔧Very useful: Guidelines for the development of impact models ("Wirkungsmodelle"). ✍️Written by Interface Politikstudien, 📢published by BAFU - OFEV - UFAM - FOEN - with 📥input by the Swiss Science Council secretariat / Sven E. Hug 👇 bafu.admin.ch/dam/bafu/de/do…

Just published by Research on Research Institute (RoRI): Gregory, Kathleen; Waltman, Ludo; Pinfield, Stephen (2024). Peer review in funding organizations: An analytical literature review (RoRI Working Paper No.10). Research on Research Institute. Preprint. doi.org/10.6084/m9.fig…

I'll side with Giovanni here, not only because his arguments are well reasoned (they are!), but also because if he hadn't been elected ISSI president, he likely would have retired (his words to me). He is active in this because he cares!

Kevin Boyack Aaron Tay Something that strikes me in the response is “The concerns seem to be founded on fear (…) that the role of scientometricians … is under threat”. Yikes. Diminishing his point to be led by emotions and self-preservation? Gloves coming off, not the respectful debate I expected.

Jeroen Baas Aaron Tay Yes, unfortunate. And a misrepresentation as well. I don't think bibliometricians feel threatened. Rather, I think we are annoyed that the history of and expertise in the field is ignored, just as it is by the so-called Science of Science community.

💡 Preprint alert! 💡 Over the summer we preprinted our scoping review of the academic impact of open science. This is joint work from the PathOS project, led by Dr. Thomas Klebel, with Vincent Traag (@[email protected]), Ioanna Grypari and Lennart Stoy. osf.io/preprints/soca…

Here is a new #preprint on #openscience #opendata with Tony Ross-Hellauer Thomas Klebel Federico Bianchi showing that more competitive #research #funding schemes may lead to higher rates of #datasharing in the short term, but lower rates in the long-term. Check it out! doi.org/10.31222/osf.i…

So many things going on lately that I hadn't had the time to share this preprint, which I'm particularly proud of 🥳 Evaluating the Linguistic Coverage of OpenAlex : an Assessment of Metadata Accuracy and Completeness , available in arXiv.org arxiv.org/abs/2409.10633

Early insight to a recent scoping review on the benefits and challenges of AI for research funding organisations medrxiv.org/content/10.110…

Glad that #NobelPrize Physics caught up with recognizing interdisciplinary discoveries! We investigated the interdisciplinarity of nobel prizes back in 2018 and found that some notable works, like Hinton&Hopfield, were missing recognition #scienceofscience

Based on data (not opinions), the works of Hopfield and Hinton #NobelPrize2024 1. Are physics nature.com/articles/nphys… 2. Were awaiting recognition nature.com/articles/s4156… These are #scienceofscience works as part of my decade-long effort defining physics quantitatively

Nothing. He was lying.

academic.oup.com/spp/advance-ar… Small trial of funding via lottery finds null effects of winning on pubs, citations

New book surveying science of science from perspective of different disciplines academic.oup.com/book/58964