Skip to content
Kai
GitHubDiscord

Deploy your inference pipelines to Kubernetes

Kai is a no frills pipeline orchestrator

Next steps

Model Deployments

Easily deploy inference steps in your pipeline by providing a link to your model. Kai integrates with all the popular model formats and storage providers.

Service Deployments

Sometimes you need to perform pre or post processing steps within your pipeline. Kai makes it easy to deploy and integrate general services into your pipeline as well.

Pipelines

Kai simplifies your pipelines by separating the deployment of steps within your pipeline and the orchestration of those steps allowing you to scale workloads out indepdently in a Kubernetes native way.

Share

By leveraging Kai you have full access to the Kubernetes ecosystem when it comes to sharing and distributing your inference pipelines. Tools like Helm, and Kustomize make it easy to package and version your entire pipeline.