March 2021: EleutherAI released GPT-Neo at 2.7 billion parameters, the first free open alternative to GPT-3, under the MIT license. June 2021: EleutherAI released GPT-J at 6 billion parameters under the Apache 2.0 license, boosting startups in open GPT development. July 2022: The BigScience project released BLOOM at 176 billion parameters, covering 46 languages and…
Read more