RWKV
@rwkv_ai
AI model built by the community, for everyone in this world
Part of the Linux Foundation, Apache 2 licensed
An RNN scaled to 14B params with GPT-level of perf
ID: 1723953380039753728
https://wiki.rwkv.com 13-11-2023 06:38:21
63 Tweet
2,2K Followers
3 Following
The RWKV v6 Finch lines of models are here Scaling from 1.6B all the way to 14B Pushing the boundary for an Attention-free transformer, and Multi-lingual models. Cleanly licensedm Apache 2, under The Linux Foundation Find out more from the writeup here: blog.rwkv.com/p/rwkv-v6-finc…