We have made the TransformerX Python library public on GitHub. The library will be available on PyPI soon. github.com/tensorops/Tran…

TransformerX is a Python library that comes with a range of building blocks you need to implement transformer-based models. It helps researchers implement their models with ease.

Join the TensorOps community on Discord! discord.gg/WGdPS5NJ

Transformers in Action: Attention Is All You Need by Soran Ghaderi buff.ly/3RJRiEk

Scaled dot-product attention is a type of #attention_mechanism where the dot-products of tensors are scaled down by √dk which normalizes the q.k variance to 1. Check out towardsdatascience.com/transformers-i… for more. #Transformers Also in the #TransformerX library: github.com/tensorops/Tran…

. Soran Ghaderi explains transformer architecture through underlying math, Python code implementation, and visualization of different layers. buff.ly/3RJRiEk

Catch up with the recent history of Transformers research — Soran Ghaderi's overview is comprehensive and accessible; it's a powerful resource to bookmark for future reference. buff.ly/43N2Opt

🎉 Exciting news! The TransformerX library has just received a major update, bringing enhanced performance and new features to the table. 🚀 Stay tuned for the stable release in the coming days.💬 #TransformerX #NLP #research #Transformers #DeepLearning

📢 New update on #TransformerX! You can now explore the improved flexibility while implementing sparse attention mechanisms. link: github.com/tensorops/Tran…

For the past month, I have been developing TorchEBM, a library for modeling and training energy-based models. I'm actively developing it. Any suggestions, insights, or contributions are welcome. github.com/soran-ghaderi/…

Finally got around to deploying the first version of the TorchEBM docs! It’s a little library I’ve been tinkering with for energy-based models in PyTorch. Still very early stages—think rough draft vibes—but it’s open-source and meant for research tinkering. [1/n]

How can Hamiltonian mechanics apply to generative modeling and Markov chain Monte Carlo? Soran Ghaderi presents a thoughtful deep dive on a fascinating topic. towardsdatascience.com/from-physics-t…

📌 Hi all! Here's my brief intro to Hamiltonian Monte Carlo and H-mechanics. It breaks down the math (fully explained) and includes bits of visualizations. #mcmc #hamiltonianMonteCarlo #generativeAI