Llm

With the proliferation and widespread adoption of LLMs, I’ve heard a lot of people talking about how they “lie” recently. I’ll admit, I’ve felt the urge to reach for that word myself, but it’s not quite right for what’s actually happening. LLMs don’t lie as such: the more accurate term is hallucination. LLMs are built on what is known as a corpus, which is all of the data used to train the model. If the information you’re looking for isn’t in the corpus, then the LLM can’t by itself give you the answer. What tends to happen in modern frontier systems is that the orchestration layer and the model will work together to try and fetch the missing information from the internet or any other storage the system is aware of. If that fails, the LLM will do one of two things: ...