PyTorch (@pytorch) 's Twitter Profile
PyTorch

@pytorch

Tensors and neural networks in Python with strong hardware acceleration. PyTorch is an open source project at the Linux Foundation. #PyTorchFoundation

ID: 776585502606721024

linkhttp://pytorch.org calendar_today16-09-2016 00:56:26

2,2K Tweet

430,430K Followers

74 Following

PyTorch (@pytorch) 's Twitter Profile Photo
PyTorch
@pytorch

6 months ago

FlexAttention’s decoding backend is now optimized for inference—supporting GQA, PagedAttention, nested jagged tensors, trainable biases, and more. Read our latest blog for performance tuning guidance and examples using torchtune and gpt-fast: 🔗 hubs.la/Q03ktGsH0 #PyTorch

FlexAttention’s decoding backend is now optimized for inference—supporting GQA, PagedAttention, nested jagged tensors, trainable biases, and more. Read our latest blog for performance tuning guidance and examples using torchtune and gpt-fast: 🔗 hubs.la/Q03ktGsH0 #PyTorch