The foundational model market is already fragmented. There are over 50 one billion+ parameter LLMs to choose from (open-source or proprietary API).

A list of all of them:

GPT-J (6B) (EleutherAI)
GPT-Neo (1.3B, 2.7B, 20B) (EleutherAI)
Pythia (1B, 1.4B, 2.8B, 6.9B, 12B)

Matt Rickard you missed NeMo models huggingface.co/models?sort=do… (1, 5 and 20B GPTs with commercialy friendly license)