Sep 27, 2024
The thing is that LLMs are still fundamentally stochastic parrots at their core. Yes they are more sophisticated now but that core probabilistic language model doesn’t automatically translate to “understanding” no matter how many n-layers you add or training data you use. But one thing it does mean is that it becomes ever more convincing that it does.