Yeah, you put your finger on maybe the biggest problem that I don’t have a good answer to yet. The ability to interact with LLMs in natural language comes from an analysis of huge tracts of contemporary human writing, and there’s not an ethical corpus that can compare in scope to the corpus of just snatching the whole internet. Maybe they don’t need to be strictly “natural” language interactions? Maybe a sufficient ethical corpus could be compiled and maintained somehow? I don’t know, this is kinda where I get out of my depth.