@turboderp_ : I have decided to tweet today. So here is a visualization of how the paged cache works with continuous batching in ExLlamaV3. I think it's neat. #🐈 • TwiCopy

@turboderp_

+ Follow

ID: 1673423377426444318

calendar_today26-06-2023 20:10:18

70 Tweet

712 Followers

33 Following

4 months ago

I have decided to tweet today. So here is a visualization of how the paged cache works with continuous batching in ExLlamaV3. I think it's neat. #🐈

thumb_up_off_alt117

chat_bubble_outline4

repeat12

shareShare