PyTorch (@pytorch) 's Twitter Profile
PyTorch

@pytorch

Tensors and neural networks in Python with strong hardware acceleration. PyTorch is an open source project at the Linux Foundation. #PyTorchFoundation

ID: 776585502606721024

linkhttp://pytorch.org calendar_today16-09-2016 00:56:26

2,2K Tweet

430,430K Followers

74 Following

PyTorch (@pytorch) 's Twitter Profile Photo
PyTorch
@pytorch

2 months ago

torchft + TorchTitan: 1200+ failures, no checkpoints, model convergence. A Llama 3 model was trained across 300 L40S GPUs with synthetic failures every 15s. No restarts. No rollbacks. Just asynchronous recovery and continued progress. 📘 hubs.la/Q03t1Z0b0 #PyTorch

torchft + TorchTitan: 1200+ failures, no checkpoints, model convergence. A Llama 3 model was trained across 300 L40S GPUs with synthetic failures every 15s. No restarts. No rollbacks. Just asynchronous recovery and continued progress. 📘 hubs.la/Q03t1Z0b0 #PyTorch