TensorBlock (@tensorblock_aoi) 's Twitter Profile
TensorBlock

@tensorblock_aoi

Making AI accessible and democratic for all.

ID: 1810857023829069826

calendar_today10-07-2024 02:02:56

29 Tweet

2,2K Takipçi

0 Takip Edilen

TensorBlock (@tensorblock_aoi) 's Twitter Profile Photo
TensorBlock
@tensorblock_aoi

5 months ago

Successfully tested running full-size Deepseek 70B model on three 8x NVIDIA RTX 3080 rigs, achieving 25 tokens/s through 3-way pipeline and 8-way tensor parallelism optimization. Each rig is equipped with 8x 10GB consumer GPUs (typical crypto mining rig configuration),