
But just two years after the book was published, we found that AI is not trained to be a high-achieving optimiser. The AI that actually works starts from community love: Wikipedia, GitHub, open-source repositories. Everywhere people communicate their love, and that becomes what is called pre-training — the childhood of language models. It takes a village on the internet to raise an AI. That is literally the case.