Karthik Kumar Viswanathan (@_vkaku) 's Twitter Profile
Karthik Kumar Viswanathan

@_vkaku

Views are personal and authentic. Threads: vkaku_ Mastodon: @[email protected] BlueSky: @[email protected]

ID: 390037059

linkhttps://karthikkumar.org calendar_today13-10-2011 11:10:06

7,7K Tweet

738 Takipçi

464 Takip Edilen

Karthik Kumar Viswanathan (@_vkaku) 's Twitter Profile Photo

Both the NSA and IETF are pushing for weakening encryption, and that means that any government which builds computers better than the US, can now spy on anyone. This won't make any security vendors sell any better, just worse outcomes for everyone. I've noticed this issue in

Louis Gleeson (@aigleeson) 's Twitter Profile Photo

They even compared it to MXFP4 the older 4-bit format. NVFP4 reaches the same loss 36% faster. MXFP4 needs 1.36T tokens to catch up with NVFP4’s 1T. That’s a one-third reduction in training time. 4-bit isn’t just possible. It’s now efficient. Read the full paper here:

They even compared it to MXFP4 the older 4-bit format.

NVFP4 reaches the same loss 36% faster.
MXFP4 needs 1.36T tokens to catch up with NVFP4’s 1T.

That’s a one-third reduction in training time.

4-bit isn’t just possible.

It’s now efficient.

Read the full paper here:
Karthik Kumar Viswanathan (@_vkaku) 's Twitter Profile Photo

Unity, back in the day had great people work on its core. Every few years, the low level stuff needs to make a comeback. It should be a part of the process. 400ms per frame, sounds like a lot .... (2.5fps)

Karthik Kumar Viswanathan (@_vkaku) 's Twitter Profile Photo

See what all people are getting for paying $12 in India for Fiber Internet. It's way cheaper with Jio. Meanwhile, I'm paying $80 a month and one Zoom call won't go properly 😫😭 Folks, help me make a case for getting better Internetz for $40-50 a month. We start somewhere.

See what all people are getting for paying $12 in India for Fiber Internet. It's way cheaper with Jio.

Meanwhile, I'm paying $80 a month and one Zoom call won't go properly 😫😭

Folks, help me make a case for getting better Internetz for $40-50 a month. We start somewhere.
Karthik Kumar Viswanathan (@_vkaku) 's Twitter Profile Photo

With 8 x 5090s, you should be able to hit the run with 4 hours, at 1/25th of Lambda Labs H100 cost. The cost of 8 x 5090s is $15-20k ... assuming you buy in Oregon A new bar has been set for cost vs. efficiency.

Karthik Kumar Viswanathan (@_vkaku) 's Twitter Profile Photo

If NVFP4 or better, Nanochat costs 3 days and $1 to train on an APU, theoretically. Hardware cost pegged at $700. That's the benchmark I want to see. Thank you Grok

If NVFP4 or better, Nanochat costs 3 days and $1 to train on an APU, theoretically. Hardware cost pegged at $700.

That's the benchmark I want to see. Thank you <a href="/grok/">Grok</a>