SambaStack.yaml Reference

On-prem
Hosted

gateway:
  replicas: 3
  auth:
    enabled: true
    secretName: <oidc-auth secret name>
  ingress:
    hosts:
      - host: <api url>
        tlsSecretName: <k8s api secret name>
    annotations:
      nginx.ingress.kubernetes.io/backend-protocol: HTTP
      nginx.ingress.kubernetes.io/force-ssl-redirect: 'true'
      nginx.ingress.kubernetes.io/proxy-read-timeout: '600'
      nginx.ingress.kubernetes.io/proxy-body-size: 25m
      nginx.ingress.kubernetes.io/enable-cors: 'true'
      nginx.ingress.kubernetes.io/configuration-snippet: |
        proxy_set_header Authorization $http_authorization;
        limit_req zone=240_req_min_header burst=360 nodelay;
        limit_req_status 429;

cloud-ui:
  ingress:
    hosts:
      - host: <ui url>
        tlsSecretName: <k8s api secret name>
    annotations:
      nginx.ingress.kubernetes.io/backend-protocol: HTTP
      nginx.ingress.kubernetes.io/force-ssl-redirect: 'true'
      nginx.ingress.kubernetes.io/proxy-body-size: 21m
      nginx.ingress.kubernetes.io/configuration-snippet: |
        proxy_set_header Authorization $http_authorization;
        limit_req zone=120_req_min_ip burst=240 nodelay;
        limit_req_status 429;

db-admin:
  admins:
  - temp-admin@cluster.local
  - example@example.com                # Email of lasting admin account

auth-and-billing:
  pgSecretName: pg-credentials         # Only needed with a custom external postgres DB

cloudnative-pg:
  enabled: false                       # Only needed with a custom external postgres DB

serviceTiers:
  <Tier1>:                              # Custom service tier name
    - models:
        - gpt-oss-120b-8-32-64-128k
      queueDepth: 25                    # Queries to queue before returning busy
      qos: "free"                       # Usually matches service tier name
      rates:
        - allowedRequests: 50
          periodSeconds: 60
  <Tier2>:                              # Tier that inherits from another
    inherits: <Tier1>
    overrides:
      - models:
          - gpt-oss-120b-8-32-64-128k
        queueDepth: 25
        qos: "free"
        rates:
          - allowedRequests: 100
            periodSeconds: 60

global:
  extraEnv:								# This sets the node memory limit to 4TB
    - name: "DDR_PER_RDU_GB"
      value: "256"

This reference uses cd-dyt-gpt-oss-120b-8-32-64-128k as the example model bundle. You can use any model bundle(s) you like in practice.

Bundle and model configuration is not part of this file. It goes in a separate values file passed to the sambastack-models chart install:

models-values.yaml

modelBundleSpecs:
  - name: cd-dyt-gpt-oss-120b-8-32-64-128k
modelDeploymentSpecs:
  - name: cd-dyt-gpt-oss-120b-8-32-64-128k
    groups:
      - name: default
        minReplicas: 1
        qosList: [web, free]

global:
  substitutions:                        # Only needed for NFS or air-gapped customers
    gs://<SAMBASTACK_ARTIFACTS_BUCKET>: nfs:///nfsdata

See Model configuration for the keys, Quickstart - on-prem for the corresponding helm upgrade --install sambastack-models step, and Deploying model bundles for the deployment workflow.

apiVersion: v1
kind: ConfigMap
metadata:
  annotations:
    serial: "1"
  name: sambastack
  labels:
    sambastack-installer: "true"
data:
  sambastack.yaml: |
    version: <latest sambastack version>

# API Configuration
    gateway:
      ingress:
        hosts:
          - host: api.example.com
            tlsSecretName: <name-for-tls>

# UI Configuration
    cloud-ui:
      ingress:
        hosts:
        - host: ui.example.com
          tlsSecretName: <name-for-tls>

# Auth and Billing Configuration
    auth-and-billing:
      pgSecretName: pg-credentials        # Kubernetes secret with PostgreSQL credentials

# Database Configuration
    cloudnative-pg:
      enabled: false                      # Disable in-cluster PostgreSQL

# Model Bundle(s) Configuration
  models.yaml: |
    version: <models chart version>       # Optional; defaults to the sambastack.yaml version
    modelBundleSpecs:
    - name: cd-dyt-gpt-oss-120b-8-32-64-128k
    modelDeploymentSpecs:
    - name: cd-dyt-gpt-oss-120b-8-32-64-128k
      groups:
      - name: "default"
        minReplicas: 1
        qosList:
        - "web"
        - "free"

Contact your SambaStack representative for the latest SambaStack version.

The keys in the models.yaml section are passed verbatim to the sambastack-models release, which the installer deploys automatically. See Models chart.

Configuration parameters

gateway

Parameter	Type	Description
`gateway.replicas`	integer	API gateway replica count for high availability
`gateway.auth.enabled`	boolean	Enable built-in OIDC integration
`gateway.auth.secretName`	string	Name of Kubernetes Secret containing OIDC credentials. Leave empty for default auth mode
`gateway.ingress.hosts[].host`	string	Your API FQDN (e.g., `api.example.com`)
`gateway.ingress.hosts[].tlsSecretName`	string	Kubernetes TLS secret name for the API host

cloud-ui (web UI)

Parameter	Type	Description
`cloud-ui.replicas`	integer	UI replica count for high availability
`cloud-ui.ingress.hosts[].host`	string	Your UI FQDN (e.g., `ui.example.com`)
`cloud-ui.ingress.hosts[].tlsSecretName`	string	Kubernetes TLS secret name for the UI host

db-admin

Parameter	Type	Description
`db-admin.admins`	list	Email addresses of users who can access the Admin UI

auth-and-billing

Parameter	Type	Description
`auth-and-billing.replicas`	integer	Core control-plane service scaling
`auth-and-billing.pgSecretName`	string	Name of Kubernetes Secret containing external PostgreSQL connection details (`DB_HOST`, `DB_DATABASE`, `DB_USER`, `DB_PASSWD`) as base64-encoded data fields. Required when using external PostgreSQL

cloudnative-pg

Parameter	Type	Description
`cloudnative-pg.enabled`	boolean	`true` = deploy in-cluster PostgreSQL; `false` = use external PostgreSQL via `auth-and-billing.pgSecretName`

Model configuration

Models, bundles, and PEFs are deployed by the models chart (sambastack-models), a separate Helm release from the sambastack chart. Its configuration reference lives on that page. On hosted deployments, the models chart values live in a models.yaml section of the installer ConfigMap, alongside the sambastack.yaml section rather than inside it:

Parameter	Type	Description
`models.yaml`	string	The models chart’s values, passed verbatim by the sambastack-installer to the `sambastack-models` release. For the keys, see Models chart.
`models.yaml` → `version`	string	Pins the `sambastack-models` chart version independently of the `version` key in `sambastack.yaml`. Defaults to that version when unset.

When you pin the version key in models.yaml, make sure the models chart version you choose is compatible with your infra chart version. SambaNova publishes the compatible version pairs.

On-prem, the models chart values are a separate file passed to the sambastack-models install rather than a key in this file. See Quickstart - on-prem.

Getting Started

Service Administration

Hardware Administration

Reference Architecture

Resources

Configuration parameters

gateway

cloud-ui (web UI)

db-admin

auth-and-billing

cloudnative-pg

Model configuration

​Configuration parameters

​gateway

​cloud-ui (web UI)

​db-admin

​auth-and-billing

​cloudnative-pg

​Model configuration

Configuration parameters

gateway

cloud-ui (web UI)

db-admin

auth-and-billing

cloudnative-pg

Model configuration