A language model predicts and generates sequences from learned patterns, but the product people use also includes instructions, retrieval, tools, filters, memory, user data, and an interface.
A large context limit says how much material can fit into a request and response under defined conditions. It does not guarantee extraction, retrieval, recall, or correct use of every detail.
RAG retrieves outside material and places selected passages into the model’s context. It can improve freshness and traceability while introducing extraction, ranking, permission, and citation failures.
An agent pursues a goal across steps and can select or use tools under some degree of autonomy. The important questions are what it can observe, decide, remember, and change.
Training learns model parameters, inference generates an output, fine-tuning further adjusts a model, and retrieval supplies outside information at runtime. Mixing the terms causes bad privacy and capability assumptions.
A benchmark defines tasks, data, scoring, prompts, tools, attempts, and aggregation. Change the setup and the score can change even when the model name does not.
An answer can invent a fact, misquote a source, follow a false premise, confuse entities, use stale information, or express uncertainty poorly. Each failure needs a different fix.
Embeddings represent items as vectors so systems can compare patterns and retrieve related material. Similarity can be useful without guaranteeing truth, intent, fairness, or permission.