Overview
Model serving overview
Version v0.7 of the documentation is no longer actively maintained. The site that you are currently viewing is an archived snapshot. For up-to-date documentation, see the latest version.
Model serving overview
Model serving using KFServing
Model serving using Seldon
Model serving using TRT Inference Server
Serving TensorFlow models
See Kubeflow v0.6 docs for batch prediction with TensorFlow models
Instructions for serving a PyTorch model with Seldon
Was this page helpful?
Glad to hear it! Please tell us how we can improve.
Sorry to hear that. Please tell us how we can improve.