Technology

The problem isn't one of motivated learners being forced to drag their heels amidst their unmotivated peers.

The problem is that the core function of LLMs, the whole basis for their existence, is completely and entirely truth-agnostic. Not only do they not know what is the truth and what is not, they don't even know what the difference is. LLMs are very good at guessing what word looks like it should come next, they can make very convincing statements, they can be very persuasive, but those words don't MEAN anything to the machine and they are made without any consideration for accuracy.

They are literally making everything up on the basis of whether or not it sounds good, and every crackpot bullshit conspiracy theory from flat earth dumbshittery to very sincere-sounding arguments that birds aren't real have been included in the training data. That all linguistically SOUNDS fine, so to an LLM it's fair game!

And even curating your training data to ONLY contain things like textbooks wouldn't cure the problem, because LLMs just aren't capable of knowing what those words mean. It's why they can't do even basic Math, the one thing Computers have been incredible at!

Using an LLM as an actual teacher is genuinely worse than no education at all, because it will just create a generation that, instead of knowing nothing, will very confidently be wrong all the time.