Great to see @gvwilson summary of our work in bad practices of Java benchmarking! Work done in collaboration with Philipp Leitner (@[email protected]), Cor-Paul Bezemer, and Artur Andrzejak. :)

Mikael and Chloe's systematic literature survey on Applications of Generative Adversarial Networks in Anomaly Detection is available now on arXiv: arxiv.org/abs/2110.12076

Some great news from the The ASGAARD Lab ! Markos Viggiato's paper “Using Natural Language Processing Techniques to Improve Manual Test Case Descriptions” was accepted in ICSE-SEIP 2022! Preprint available @ asgaard.ece.ualberta.ca/using-natural-…

Also, (Twitter-anonymous) Mikael's paper "Studying the Performance Risks of Upgrading Docker Hub Images: A Case Study of WordPress" was accepted at ICPE 2022! Preprint available @ asgaard.ece.ualberta.ca/studying-the-p…

Finally, Hao Li's paper "An Empirical Study of Yanked Releases in the Rust Package Registry" was accepted in the @computersociety TSE journal! Preprint available @ asgaard.ece.ualberta.ca/an-empirical-s…

Game developers! We are running an anonymous research survey on the current practices, goals, and needs for quality assurance in #gamedev and would love your input. Over $4,000 in random draw prizes. Please spread the word! surveymonkey.com/r/gamedevtesti…

CLIP meets GamePhysics: Towards bug identification in gameplay videos using zero-shot transfer learning abs: arxiv.org/abs/2203.11096 project page: asgaardlab.github.io/CLIPxGamePhysi…

taesiri and Finlay's paper "CLIP meets GamePhysics: Towards bug identification in gameplay videos using zero-shot transfer learning" was accepted at MSR 2025 ! Preprint available at asgaard.ece.ualberta.ca/clip-meets-gam…

Ever wondered how the performance of #Serverless applications changes WITHOUT code changes? Over 10 months, we observed significant changes on #AWS in our Journal of Systems and Software paper "A case study on the stability of performance tests for serverless applications" bit.ly/38kG5ZH

This paper is the result of a collaboration within the SPEC research group 'Devops Performance' together with Lizhi Liao, Diego Elias Costa Andre van Hoorn, Cor-Paul Bezemer, Weiyi Shang, Samuel Kounev

Give yourself an early Easter present and join us at ICPE! It’s free of charge and we have great speakers (keynote and otherwise :) )!

Happening today in less than one hour!

Markos Viggiato's paper “Identifying Similar Test Cases That Are Specified in Natural Language” was accepted for publication in the Transactions on Software Engineering journal! Preprint available at asgaard.ece.ualberta.ca/identifying-si… (with Prodigy Education)

Ad for our teaching professor position is now out: web103.reachmee.com/ext/I005/1035/… 100%, permanent from start, min. 25% of worktime reserved for research (can be increased with grants). Hit me up if you want to know more, and RTs appreciated ;)

Super congrats to @finlaymacklon, taesiri, Stefan and Markos Viggiato who had their paper "Automatically Detecting Visual Bugs in HTML5 <canvas> Games” accepted at ASE 2024! Preprint available at asgaard.ece.ualberta.ca/automatically-… (collaboration with Prodigy Education)

How to score > 90% on ImageNet? Our new study on the spatial biases of ImageNet and relevant ImageNet-scale, OOD benchmarks reveals that all common image classifiers tested can score > 90%, if the model looks at the correct crop, i.e., ⭐️ Zoom 🔎 is all you need! ⭐️ 1/n

Excited to share GlitchBench! 🚀 It is a new benchmark designed specifically for large multimodal models. GlitchBench sets a new standard by incorporating tasks from actual game quality assurance scenarios 🎮, bringing real-world challenges into focus. #AI #MachineLearning

GlitchBench: Can large multimodal models detect video game glitches? paper page: huggingface.co/papers/2312.05… Large multimodal models (LMMs) have evolved from large language models (LLMs) to integrate multiple input modalities, such as visual inputs. This integration augments the

Happy to announce that GlitchBench has been accepted to #CVPR2024🎉 x.com/_akhaliq/statu…

Very cool! A preprint of our work is available at asgaard.ece.ualberta.ca/papers/Journal…