@iscienceluvr : Thinking Slow, Fast: Scaling Inference Compute with Distilled Reasoners Distilling Llama-1B and -3B models with only 8 billion tokens into subquadratic models like Mamba to achieve better and faster scaling of inference-time compute with minimal performance loss. • TwiCopy

Tanishq Mathew Abraham, Ph.D.

@iscienceluvr

+ Follow

ID: 441465751

linkhttps://tanishq.ai calendar_today20-12-2011 03:45:50

16,16K Tweet

75,75K Takipçi

1,1K Takip Edilen

Tanishq Mathew Abraham, Ph.D.

@iscienceluvr

4 months ago

Thinking Slow, Fast: Scaling Inference Compute with Distilled Reasoners Distilling Llama-1B and -3B models with only 8 billion tokens into subquadratic models like Mamba to achieve better and faster scaling of inference-time compute with minimal performance loss.

thumb_up_off_alt398

chat_bubble_outline3

repeat94

shareShare