An LLM is software trained to predict text. Feed it words, it guesses what comes next β billions of times, on billions of sentences, until the guesses get eerily good.
LLMs don't read words β they read tokens: chunks roughly ΒΎ of a word each. "Unbelievable!" = 4 tokens. 1,000 tokens β 750 words β 3 pages.
RAG is a pattern: before the LLM answers a question, a retrieval system searches your data, grabs the most relevant chunks, and stuffs them into the prompt. The LLM then generates an answer grounded in that real data.
An embedding is a list of numbers (a vector) that represents the meaning of a piece of text. Similar meanings produce similar vectors. "Heart attack" and "myocardial infarction" land close together even though they share zero words.
Fine-tuning takes a pre-trained LLM and continues training it on your specific data. The model's weights actually change β your knowledge gets baked into the parameters.
Prompt engineering is the practice of structuring your input to an LLM to get the best possible output. The model is the same β the prompt is the lever you pull.
Hallucination is when an LLM generates text that sounds confident but is factually wrong or entirely fabricated. It's not a bug β it's a consequence of how prediction works.
An agent is an LLM given the ability to take actions: call APIs, query databases, trigger workflows. It receives a goal, reasons about it, picks tools, executes, observes results, and iterates.
MCP is an open standard (created by Anthropic) that defines how an AI model discovers and connects to external tools and data sources. Universal plug-and-play for AI.
A2A is a protocol (led by Google) that allows AI agents from different vendors to discover, communicate with, and delegate tasks to each other.
Multi-modal AI can process and generate more than just text β images, audio, video, documents β within the same conversation.
Guardrails are policies, filters, and patterns that prevent AI from producing harmful, biased, or non-compliant outputs. Responsible AI is the broader discipline of fairness, transparency, and accountability.