(That’s also why I see no point in using AI to, say, write an essay, just like I see no point in bringing a forklift to the gym. Sure, it can lift the weights, but I’m not trying to suspend a barbell above the floor for the hell of it. I lift it because I want to become the kind of person who can lift it. Similarly, I write because I want to become the kind of person who can think.)
This is one of the best quotes that I can grab from the page.
The second being:
Markus Strasser, an entrepreneur who tried to start one of those companies that’s like “we’ll put every scientific paper in the bag and then ??? and then profit”, eventually abandoned the effort, saying that “close to nothing of what makes science actually work is published as text on the web.”
and last one:
For instance, if you show humans computer code that has security vulnerabilities, they do not suddenly start praising Hitler. But LLMs do. So yes, I would worry about putting the nuclear codes in the bag.
The paper cited in it is amazing, in the sense of confusingly surprising. Gonna give it a read.