Basics
Inference
Running a trained model to produce an output; what you pay for when you call an AI API.
Training happens once; inference happens every time someone uses the model. For most businesses, inference cost and speed matter far more than training cost.
Frequently asked questions
What does Inference mean?
Running a trained model to produce an output; what you pay for when you call an AI API. Training happens once; inference happens every time someone uses the model. For most businesses, inference cost and speed matter far more than training cost.