dstack (@dstackai) 's Twitter Profile
dstack

@dstackai

An open-source alternative to Kubernetes and Slurm for AI container orchestration, supporting NVIDIA, AMD, TPU, and Intel across cloud and on-prem.

ID: 1220419250743119872

linkhttps://github.com/dstackai/dstack calendar_today23-01-2020 18:53:26

582 Tweet

958 Followers

4 Following

dstack (@dstackai) 's Twitter Profile Photo
dstack
@dstackai

5 months ago

TensorRT-LLM delivers fast, flexible LLM inference - but the full pipeline can be complex. This dstack example simplifies it end-to-end: build the container, convert the model, and deploy on any cloud or on-prem. Showcases both DeepSeek R1 and its distilled Llama version.