>> The fact that there's no foolproof way to distinguish instruction tokens from data tokens is not careless
> Repeat that over to yourself again, slowly.
Try using less snark.
And if you have a fundamental breakthrough in AI that gets around this, and demonstrates how "careless" AI researchers have been in overlooking it, then please share.
My point is that the fact that it is not solved makes the use of AI tools a careless choice in situations which benefit from non-AI systems which can distinguish instructions from data, behave deterministically, and so on.
> Repeat that over to yourself again, slowly.
Try using less snark.
And if you have a fundamental breakthrough in AI that gets around this, and demonstrates how "careless" AI researchers have been in overlooking it, then please share.