"AI literacy" gets thrown around a lot. Most articles use it to sell training. This one defines the actual bar — the concepts every business leader should be able to define, the ones safe to skip, and the test for whether you've cleared it.
AI literacy for business matters because every leader will, this quarter, make a decision that depends on at least understanding what's possible.
The 12 concepts you actually need
Memorize these, in roughly this order:
- LLM (Large Language Model): A model trained to predict the next word. The base of ChatGPT, Claude, Gemini.
- Prompt: The input you give the model. Better prompts produce better outputs.
- Context window: How much input the model can see at once. Bigger = more documents fit.
- Hallucination: When the model confidently makes things up.
- RAG (Retrieval-Augmented Generation): Connecting the model to your documents so it answers from your data.
- Fine-tuning: Customizing a model on your data. Powerful but often unnecessary.
- Agent: An AI that takes multi-step action with tools.
- Copilot: AI embedded inside a tool to assist a human.
- MCP: The standard for connecting AI to your apps. See our explainer.
- Multimodal: Models that handle text + images + audio.
- Reasoning model: A model that "thinks" longer before answering (o-series, Claude with extended thinking).
- Inference cost: What it costs each time the model runs. Drives unit economics.
Concepts you can skip
You do not need to know what a transformer is, what self-attention does, what a softmax is, or what RLHF means. These are interesting and irrelevant to your job. If a vendor leans heavily on them in a pitch, you're being talked at, not pitched.
The literacy test
Can you answer these five questions in two minutes each? (1) When would you use RAG vs fine-tuning? (2) What's the practical difference between an agent and a copilot? (3) What's the typical hallucination rate of a frontier model on factual recall? (4) What's the cost-per-query difference between Claude Haiku and Claude Opus? (5) When would you choose an open-source model over a frontier API? If yes, you've cleared the bar.
How to build literacy in a week
Three days of reading + four days of doing. Read the Anthropic and OpenAI blogs end to end (cover the practical posts, skip the deep research). Then run real prompts through three models, build one Custom GPT, connect one MCP server, and read one independent vendor evaluation. You're done.
Why fluency beats literacy
Literacy without fluency is dangerous. You'll know the words but not how to use them — and vendors will run circles around you. Use this guide as the floor, then move into our AI fluency framework and the executive coaching arc.
Where to start today
Block 2 hours on your calendar this week. Open the Be Fluent AI portal and run the literacy track. Skip the marketing fluff; you don't have time for it.