Darius Kianersi (@radiuskia) 's Twitter Profile
Darius Kianersi

@radiuskia

making models yap @cartesia_ai; prev. xla @nvidia & lora @microsoft; 🇰🇷🇮🇷

ID: 1551773585047420928

calendar_today26-07-2022 03:38:21

92 Tweet

346 Followers

449 Following

Cartesia (@cartesia_ai) 's Twitter Profile Photo

Today, we're excited to share Cartesia Narrations, in public beta. Narrations is a creator tool for narrating long-form content using Sonic 2.0. You can use it to create audiobooks and podcasts, narrate your Substack posts, and more. Some highlights🧵

Gashon Hussein (@gashonhussein) 's Twitter Profile Photo

Excited to share our new paper, "One-Minute Video Generation with Test-Time Training (TTT)" in collaboration with NVIDIA. We augment a pre-trained Transformer with TTT-layers and finetune it to generate one-minute Tom and Jerry cartoons with strong temporal and spatial

Excited to share our new paper, "One-Minute Video Generation with Test-Time Training (TTT)" in collaboration with NVIDIA.

We augment a pre-trained Transformer with TTT-layers and finetune it to generate one-minute Tom and Jerry cartoons with strong temporal and spatial
Austin Silveria (@austinsilveria) 's Twitter Profile Photo

Training-free acceleration of Diffusion Transformers with dynamic sparsity and cross-step attention/MLP deltas--collaboration with soham and Dan Fu! ⚡️ 3.7x faster video and 1.6x faster image generation while preserving quality! 🧵 Open-source code & CUDA kernels!

soham (@sohamgovande) 's Twitter Profile Photo

introducing chipmunk—a training-free algorithm making ai video generation 3.7x & image gen 1.6x faster! ⚡️ our kernels for column-sparse attention are 9.3x faster than FlashAttention-3 and column-sparse GEMM is 2.5x faster vs. cuBLAS a thread on the GPU kernel optimizations 🧵

Ronald Yu (@kylekalewale) 's Twitter Profile Photo

But yuppy fishtanks are only useful if they actually catch the yuppies, and nobody wants to live at The Brady as long as it sits atop an open-air drug market. The city needs to address crime to solve its housing crisis. x.com/kane/status/18…

Albert Gu (@_albertgu) 's Twitter Profile Photo

I converted one of my favorite talks I've given over the past year into a blog post. "On the Tradeoffs of SSMs and Transformers" (or: tokens are bullshit) In a few days, we'll release what I believe is the next major advance for architectures.

I converted one of my favorite talks I've given over the past year into a blog post.

"On the Tradeoffs of SSMs and Transformers"
(or: tokens are bullshit)

In a few days, we'll release what I believe is the next major advance for architectures.
Albert Gu (@_albertgu) 's Twitter Profile Photo

Tokenization is just a special case of "chunking" - building low-level data into high-level abstractions - which is in turn fundamental to intelligence. Our new architecture, which enables hierarchical *dynamic chunking*, is not only tokenizer-free, but simply scales better.

Tokenization is just a special case of "chunking" - building low-level data into high-level abstractions - which is in turn fundamental to intelligence.

Our new architecture, which enables hierarchical *dynamic chunking*, is not only tokenizer-free, but simply scales better.
brandon wang (@fluorane) 's Twitter Profile Photo

happy to announce that we've gotten rid of tokenizers! especially excited with what we've replaced them with: end-to-end trainable modules that not only learn to group characters into (sub)words, but can iterate to group words into phrases and further higher-order concepts see

Yunyu Lin (@yunyu_l) 's Twitter Profile Photo

Got downgraded on my flight to NYC this morning and everyone in 1st class was sitting sadly all by themselves, without a cat. I looked back into the rest of the plane - everyone was happily petting a cat. Was just a very interesting observation.

Got downgraded on my flight to NYC this morning and everyone in 1st class was sitting sadly all by themselves, without a cat.

I looked back into the rest of the plane - everyone was happily petting a cat.

Was just a very interesting observation.
Pope Leo XIV (@pontifex) 's Twitter Profile Photo

Technological innovation can be a form of participation in the divine act of creation. It carries an ethical and spiritual weight, for every design choice expresses a vision of humanity. The Church therefore calls all builders of #AI to cultivate moral discernment as a

Cody Blakeney (@code_star) 's Twitter Profile Photo

It’s about shots on goal. Interviews are high variance. Don’t feel like a bad interview is an indictment on your skills or worth. Keep grinding keep working. Do interesting things and people will find you.