Inference

Definition

1. 1.Process of running a trained model to generate predictions or outputs for new inputs.

Example

The chatbot endpoint performs inference each time a user submits a prompt.

Related Exams