@rwkv_ai : 🦅 Eagle & 🐦 Finch The RWKV v5 and v6 architecture paper is here arxiv.org/abs/24504.05892 Both of which, improve over RWKV-4, scaled up to 7.5b and 3.1b billion multilingual models respectively Open-source code, weights, and dataset Apache 2 licensed, under Linux Foundation • TwiCopy

RWKV

@rwkv_ai

+ Follow

AI model built by the community, for everyone in this world

Part of the Linux Foundation, Apache 2 licensed
An RNN scaled to 14B params with GPT-level of perf

ID: 1723953380039753728

linkhttps://wiki.rwkv.com calendar_today13-11-2023 06:38:21

63 Tweet

2,2K Followers

3 Following

RWKV

@rwkv_ai

6 months ago

🦅 Eagle & 🐦 Finch The RWKV v5 and v6 architecture paper is here arxiv.org/abs/2404.05892 Both of which, improve over RWKV-4, scaled up to 7.5b and 3.1b billion multilingual models respectively Open-source code, weights, and dataset Apache 2 licensed, under Linux Foundation