Skip to content

AI 101

Inference

Sketch: a hand turns a key and the engine sparks; then the car drives, turning a question in into an answer out.

Inference is when a trained model is actually used: you send it a prompt and it produces an answer.

Think of it like this: Training builds the engine; inference is every time you turn the key and drive.

Source:

https://developers.google.com/machine-learning/glossary#inference (checked Oct 15, 2026)

RelatedTraining Prompt Token AI modelTemperature

Used inGPU Temperature Training

— Cases4AI, powered by AIRVX