Bo Liu (@cranialxix) 's Twitter Profile
Bo Liu

@cranialxix

Ph.D. at UT Austin.

ID: 953831169807675395

calendar_today18-01-2018 03:27:27

26 Tweet

253 Followers

184 Following

Bo Liu (@cranialxix) 's Twitter Profile Photo
Bo Liu
@cranialxix

8 months ago

How to design State Space Models (SSM) from principles? We propose to view SSM's recurrence as the per-step closed-form solution to an online learning problem. To this end, we present Longhorn, a novel SSM that achieves 1.8x better sampling efficiency against Mamba.

How to design State Space Models (SSM) from principles? We propose to view SSM's recurrence as the per-step closed-form solution to an online learning problem. To this end, we present Longhorn, a novel SSM that achieves 1.8x better sampling efficiency against Mamba.