https://www.lesswrong.com/posts/xvdngZAqFZfek7KGH/pretraining-data-not-verifiability-is-why-llms-are

Good essay on fundamentals. Consistent with why they can’t do tax returns. Perhaps further from AGI than many think.