Inference

Running a trained model to get an output — every chat message, summary and image render is inference. Inference reads the model's fixed weights; it does not change them. That is why a conversation does not retrain the model, and why anything that looks like learning mid-chat is usually stored context being re-read, not new training.

← All terms