When Babbage first proposed the Difference Engine, one aristocratic onlooker asked, “But but how will it find the right answer, when someone enters the question wrong?”
Calculators will confidently tell you the square root of seventeen if that’s what you type in, even if that’s not the hypotenuse of a right triangle with sides of length twelve and five. You can slap the keys to your heart’s content and almost certainly get the answer to some problem.
Critics need to consider - if you genuinely could not use an LLM wrong, there would be nothing to talk about. They’d just work.
When Babbage first proposed the Difference Engine, one aristocratic onlooker asked, “But but how will it find the right answer, when someone enters the question wrong?”
Calculators will confidently tell you the square root of seventeen if that’s what you type in, even if that’s not the hypotenuse of a right triangle with sides of length twelve and five. You can slap the keys to your heart’s content and almost certainly get the answer to some problem.
Critics need to consider - if you genuinely could not use an LLM wrong, there would be nothing to talk about. They’d just work.