ai-literacyintermediateunit-5

Inference

Definition

Using a trained AI model to generate predictions or outputs.

In Plain English

Training is teaching. Inference is test day—the model applying what it learned.

Real-World Example

When you ask ChatGPT a question, the inference process generates the response.

Why It Matters for Your Work

Inference costs (time and money) determine how practical AI is for your use case.

Common Mistake

Confusing training and inference. Training is expensive and rare. Inference happens every request.

Related Terms

Artificial Intelligence—software that can make predictions, generate content, or assist with decisions.

Model

The trained AI system that produces outputs based on inputs.

Token

A chunk of text that AI reads or writes, roughly 3-4 characters or about 0.75 words.