Peyman Hosseini
@peyman_hs
Doctoral researcher exploring the realm of Natural Language Processing
- QMUL Computational Linguistics Lab
- Intelligent Games and Game Intelligence CDT
ID: 1598708122784342019
http://peymanhosseini.net 02-12-2022 15:58:56
18 Tweet
59 Takipçi
152 Takip Edilen
📢Are you interested in safe and trusted #AI and #MultiAgent systems?! We have a #PhD position available on the "Verification of Neuro-Symbolic Multi-Agent Systems" at King's College London as part of the UKRI CDT in Safe & Trusted AI @ King's & Imperial #CDT program.
I don't want to summarize too much, since I think everyone should read this latest piece by Yoshua Bengio (Turing award winner for Deep Learning, along with Geoff Hinton and Yann Lecun): yoshuabengio.org/2023/05/22/how… Suffice to say that this piece engages w/AI x-risk very seriously.
Your text reveals whether you are rich or poor! Paper/slides 👉icastro.info and kudos to Waleed Iqbal who did lots of the heavy lifting
This figure nicely summarises our proposed Attention mechanisms! Thank you Thibault Castells for the illustration!
We trained a small language model using Efficient Attention we introduced recently, and the result is interesting! You can check it out on Hugging Face. It's been only trained on 15B tokens and achieves similar loss/training token to models of similar size huggingface.co/PeymanHosseini…