Search epoch.ai
Language models compose the large majority of large-scale AI models
Out of 422 large-scale models with known compute, 330 are language models, of which 87 are vision-language models such as GPT-4. The first models trained with 1023 FLOP were for game-playing, but language has dominated since 2021. Other large-scale models have been developed for image and video generation, biological sequence modeling, and robotics.
