Guillaume Lample
@GuillaumeLample
Cofounder & Chief Scientist https://t.co/hLfvKLkFHd (@MistralAI). Working on LLMs. Ex @MetaAI | PhD @Sorbonne_Univ_ | MSc @CarnegieMellon | X11 @Polytechnique
06-12-2016 08:52:18
477 Tweets
21,5K Followers
579 Following
Timothee Lacroix implemented Python API for our library fastBPE: github.com/glample/fastBPE It is faster than sentencepiece, and follows the same algorithm as the original Python implementation of Rico Sennrich fastBPE can easily work on 200GB of text. Check it out!