Getting Started

Obtaining Access

To use Seldon Deploy for your enterprise, get in touch with Seldon for a free trial license to apply

Installation Types

  • Trial Installations - Scripts that install default configurations that can be used to trial the Seldon Deploy cluster. These provide a simple way to get up and running to test the functionalities.

  • Production Installation - Modular installation into existing cluster with instructions on how to leverage Seldon Deploy integrations. This is recommended installation for production setups.

  • Openshift Hat Installation - Red Hat OpenShift installation.

See Install Types for more on how to choose.

Component integrations

Below are the integrations that Seldon Deploy supports, together with the versions currently supported for each of the component.

Component

Supported Versions

Integration level

seldon-core

1.11.2 and above

Required

Istio

1.9.5 … 1.11.2

Required

Elasticsearch

6.x and above

Recommended

ArgoCD

1.4.x and above

Recommended

Prometheus

9.7 and above

Recommended

PostgreSQL (Model Metadata Storage)

9.6 and above

Recommended

Fluentd (or equivalent ELK log collection)

6.x and above

Optional

Dex (or equivalent OIDC provider - eg Keycloak)

2.x and above

Optional

KFServing

0.6.1 and above

Optional

Knative (Eventing, Serving & Monitoring)

0.22 … 0.25

Optional

Note:

  • detector components such as outliers requires Knative Eventing & Serving 0.18.x (which requires k8s 1.16)

  • Knative v0.19.0 removed cluster local gateway - see note on installation page dedicated to kfserving.

Any compatibility changes between versions get listed here and in the upgrading section

Pre-requisites

Dependency

Version

Notes

Dockerhub

n/a

https://hub.docker.com/ Access needs to be granted explicitly by Seldon in order to access resources such as docker images. A dockerhub account is needed and its credentials will be needed to setup imagePullSecrets.

Kubernetes

1.18 … 1.21

Seldon Deploy is intended for Kubernetes version greater than or equal to 1.18 and less than or equal to 1.21.

Kubernetes

1.12 … 1.19 available

See Older Kubernetes Versions and Newer Kubernetes Versions sections below for limitations.

Git Server

n/a

To use GitOps access an HTTPS access to git server is required. GitOps is optional, but suggested.

kubectl

within one minor version difference of your cluster

https://kubernetes.io/docs/tasks/tools/install-kubectl/

helm

3.0.0 or greater is required

https://helm.sh/docs/intro/install/

Cluster Requirements

Cloud Provider

Requirements

Notes

GKE

2 x e2-standard-8 nodes

This is 16vCPUs and 60GB RAM.

AWS

4 x t2.xlarge

This is to allow headroom to run models and because the full install includes kubeflow, knative, istio and the elastic and prometheus stacks.

Warning

Fewer and larger worker nodes are suggested as this requires less resource for the control plane. On EKS in particular increasing resources for the control plane has to be done explicitly. Too few nodes can also lead to problems on EKS with pods per node.

Older Kubernetes Versions

Knative 0.18+ requires Kubernetes 1.16. This places limitations on running Seldon Deploy on older Kubernetes versions.

Here is what can be done for older Kubernetes versions.

The request logger can be used with older Knative versions. The helm values file contains this entry:

requestLogger:
  trigger:
    apiVersion: "eventing.knative.dev/v1"

Its value can be changed to “eventing.knative.dev/v1alpha1” for older versions of Knative Eventing.

The request logger can also be run without knative.

Both Seldon Core and KFServing have default URLs that their install instructions point to a Knative broker in seldon-logs namespace (executor.requestLogger.defaultEndpoint for seldon core and logger.defaultUrl for KFServing). These can be changed to point to seldon-request-logger.seldon-logs (or your request logger location).

Detector component wizards and the Data Science metrics component wizard do need Knative 0.18. For older k8s you can’t run those demos.

Newer Kubernetes Versions

Seldon Deploy can work with kubernetes 1.19. At the time of writing KFServing cannot, which is an optional dependency.

References