It was a memorable experience giving a talk at ⁦NASA JPL⁩ and meeting several people doing exciting work in my area.

Very excited to announce: Keypoint Action Tokens!

We found that LLMs can be repurposed as 'imitation learning engines' for robots, by representing both observations & actions as 3D keypoints, and feeding into an LLM for in-context learning.

See: robot-learning.uk/keypoint-actio…

More 👇

🌟Another interesting meetup🌟! Many thanks to our presenters!
🎤Stelios Kotsovolis from the Personal Robotics Lab led by Prof Yiannis Demiris shared his research on – “Deformable Object Manipulation for Robot-Assisted Dressing”
🎤Xin Kong from the Dyson Robotics Lab led by…

Looking forward to presenting our latest work in endoluminal robots at #HSMR24 ! Imperial College Robotics Forum MIM Lab - Mechatronics In Medicine

Excited about this year's #ExRdFest ! come visit our Roboplayground, Imperial College Robotics Forum researchers will be showcasing their work, from our very own DrOctopus🐙 to fly-driven robots🪰, quadrupeds, surgical robots, and much more 💜 Ad Spiers Petar Kormushev 🤖 Robot Intelligence Lab…

'VLMs for zero-shot robot control' is getting very trendy!
It would be interesting to compare this strategy of 'ask the VLM/LLM to evaluate candidate trajectories' to the strategy of 'ask the VLM/LLM to directly predict trajectories' that we studied in: robot-learning.uk/language-model….

I am very excited to show you a preview of our work with DARPA and our great collaborators on the LINC program! I can't wait to scale this technology to other critical infrastructures to save more lives. Imperial College London Imperial College Robotics Forum Imperial Computing Imperial College AI Network Imperial Engineering

Have you heard the latest episode of Robot Talk? Edward Johns from Imperial College Robotics Forum discusses his work on robot learning & manipulation. More about his work below!
robot-learning.uk

Yesterday the Hamlyn Centre for Robotic Surgery were at the Julia Anderson Training Programme Careers Event, an evening spent sharing experiences about career journeys from colleagues within IGHI at Imperial College London (1/3)

👩🏾‍💻 APPLICATIONS OPEN FOR SURGICAL ROBOT CHALLENGE!

Submit your entry to our annual Surgical Robot Challenge, an international competition to show your innovative ideas on a range or surgical robot platforms.

Apply below ⬇

lnkd.in/gx6CaF8T

Deadline: 22nd March 2024

Dream2Real 🧠 is accepted at #ICRA2024 ! This lets robots rearrange objects 'in imagination' with NeRFs and VLMs: robot-learning.uk/dream2real

With: Yifei Ren Ignacio Alzugaray Edward Johns

New: SuperPrimitives. Carefully chosen pre-trained networks (for segmentation and normals) split input images into object-like 3D chunks. This enables simple and accurate dense reconstruction and visual odometry in a wide range of scenes. Dyson Robotics Lab at Imperial College.

In 2023, my team and I have been developing a number of new imitation learning and zero-shot methods for robot manipulation.

So, I decided to record a video summarising what we've been up to over the past year!

Watch here: youtu.be/yC8ZD1do8Fo.

Enjoy! And Happy New Year!

✨Happy new year!✨From the Imperial Robotics Forum

Looking back at our Christmas Party. ❄️Merry Christmas Robotics Forum!❄️

Cheers to a fantastic 2023 for the 🎉Imperial Robotics Forum! Grateful for our researchers, students, and collaborators. Merry Christmas & Happy New Year! Thrishantha Nanayakkara Ferdinando Ad Spiers Mirko Kovac Petar Kormushev 🤖 Edward Johns Antoine Cully Nicolas Rojas Ana Cruz Ruiz

✨Congratulations to the winners & finalists of the 2023 Robotics Forum - Amazon PhD Prizes for Outstanding Achievement in Robotics✨! Ivan Kapelyukh 🇺🇦 Xin Zhou Thrishantha Nanayakkara Nicolas Rojas Edward Johns Ad Spiers Antoine Cully Amazon Science

❄️ Hamlyn Winter School - day 2 ❄️ Insightful talks on visual #SLAM for colonoscopy, image guided robots for vitreoretinal surgery, surgical imaging & endoscopy! Christos Bergeles / Χρήστος Μπεργελές Menglong Ye MoonSurgical Daniel Elson The Hamlyn Centre Imperial College Robotics Forum Institute of Global Health Innovation

Please join us at MRS Fall meeting today and Wednesday for our talks on Physical AI and Soft Aerial Robotics for perching, physical interaction and multi-modal locomotion

Empa Imperial College Robotics Forum