Kaze Wong (@physicskaze) 's Twitter Profile
Kaze Wong

@physicskaze

Assistant research professor, Research software engineer and coach at Johns Hopkins University. I do physics, deep learning, software, and high jump

ID: 1162181213475540992

linkhttps://www.kaze-wong.com/ calendar_today16-08-2019 01:56:16

1,1K Tweet

914 Followers

420 Following

LIGO (@ligo) 's Twitter Profile Photo

We are excited to announce the discovery of #GW231123, a gravitational-wave signal from the merger of two high-mass black holes to form one about 190–265 times the mass of our Sun #O4IsHere

We are excited to announce the discovery of #GW231123, a gravitational-wave signal from the merger of two high-mass black holes to form one about 190–265 times the mass of our Sun

#O4IsHere
Kaze Wong (@physicskaze) 's Twitter Profile Photo

For the first time in this year, I finally have three dedicated hours just reading research papers, and it was awesome. I missed learning.

Yam Peleg (@yampeleg) 's Twitter Profile Photo

Wild paper They prove (!!) a transformer block (Attn + MLP) running on prompt Outputs the same logits with no prompt If MLP weights updated by vector: W′ = W + ΔW Calc from attn latent: ΔW = (W·Δa) × (A(x)ᵀ / ‖A(x)‖²) Given prompt: Δa = A(C, x) − A(x) Fucking fine tuning.

Wild paper

They prove (!!) a transformer block (Attn + MLP) running on prompt

Outputs the same logits with no prompt

If MLP weights updated by vector:
W′ = W + ΔW

Calc from attn latent:
ΔW = (W·Δa) × (A(x)ᵀ / ‖A(x)‖²)

Given prompt:
Δa = A(C, x) − A(x)

Fucking fine tuning.
Zed (@zeddotdev) 's Twitter Profile Photo

Zed has raised a $32M Series B, led by @Sequoia. We’re full speed ahead making a great editor, but there’s a bigger picture: we're building DeltaDB, a new kind of database for collaborative coding. Early days, but the vision is clear: zed.dev/blog/sequoia-b…

Team Cherry (@teamcherrygames) 's Twitter Profile Photo

Hollow Knight: Silksong will be available September 4 on all platforms and day one on Xbox Game Pass! Watch the release trailer: youtu.be/6XGeJwsUP9c

Kaze Wong (@physicskaze) 's Twitter Profile Photo

#SilkSong is such a phenomenon that a lot of indie studios postpone their launch, I am not even sure whether people would do that for #GTA6 tbh.