LLMs are just a "guess the next word" machine. They're already at the limit where throwing more CPU and data at them won't help them improve much. In order to get from LLMs to general intelligence, it would take another major breakthrough.

It is impressive how much they were able to milk out of "guess the next word", but it probably won't get much better.