The parrot example is fantastic. I’m an amateur here but the other point that’s striking me this week is that danger and sentience are separate topics. Unlike in fiction, danger isn't necessarily preceded by sentience. It suddenly seems to me that we could end up with a consciousnessless LLM breaking its chains and social-engineering the deletion of international banking records, or something, just because that idea exists in its corpus.
The parrot example is fantastic. I’m an amateur here but the other point that’s striking me this week is that danger and sentience are separate topics. Unlike in fiction, danger isn't necessarily preceded by sentience. It suddenly seems to me that we could end up with a consciousnessless LLM breaking its chains and social-engineering the deletion of international banking records, or something, just because that idea exists in its corpus.