If you follow the mainstream AI giants, their development, trajectories, promises and narratives are all about being bigger and better. This linear brute-force concept of AI development is bound to take a hit. The parallel improvements will come from the fundamental behaviour of how the pre-trained transformers work in terms of the core architecture of …