> ## Documentation Index
> Fetch the complete documentation index at: https://sambanova-systems.mintlify.site/docs/llms.txt
> Use this file to discover all available pages before exploring further.

# SambaStack pods reference

This page lists the core Kubernetes pods deployed as part of a SambaStack installation, for both Hosted and On-Prem environments. Each pod represents a logical system component and is documented with its primary function within the platform.

This reference helps you:

* Understand the role of each pod during installation and runtime
* Troubleshoot pod-level issues during deployment and upgrades
* Identify components responsible for authentication, routing, inference, storage, and platform administration.

| Pod name                                 | Description                                                                                                                                                             |
| :--------------------------------------- | :---------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
| auth-and-billing-\[...]                  | Manages authentication, API key validation, and authorization for UI access and API requests.                                                                           |
| cloud-ui-\[...]                          | Provides the web-based user interface for interacting with SambaStack services.                                                                                         |
| db-admin-\[...]                          | Manages user service tiers and configurations. Exposes the /admin endpoint for tier management operations.                                                              |
| gateway-\[...]                           | API gateway that receives incoming user requests and routes them to the inference-router service.                                                                       |
| inf\_operator-0                          | Orchestrates inference engine and cache pod lifecycle. Serves as the central model database, providing model metadata and service tier information to other components. |
| inf-\<Model Name>-cache-\[...]           | Caches model artifacts (PEFs and checkpoints) for each deployed model to optimize loading times.                                                                        |
| inf-\<Model Name>-q-default-n-0          | Worker pod that processes model inference requests for the specified model.                                                                                             |
| inference-router-\[...]                  | Manages request batching and intelligent routing to distribute inference workloads across available worker pods.                                                        |
| keycloak-0 / keycloak-operator-\[...]    | Provides identity and access management with default login interface. Can be disabled when using custom OIDC providers or when authentication is not required.          |
| sambastack-cloudnative-pg-\[...]         | Initializes and manages PostgreSQL database storage. Configures and maintains sambastack-postgres-\* instances.                                                         |
| sambastack-global-queue-redis-master-0   | Redis instance for managing global task queues and job scheduling across the system.                                                                                    |
| sambastack-localpv-provisioner-\[...]    | Provisions Kubernetes PersistentVolumes using local disk storage. Essential for PostgreSQL data persistence.                                                            |
| sambastack-postgres-\[1-3]               | PostgreSQL database cluster instances providing persistent storage for core services including auth-and-billing and keycloak.                                           |
| sambastack-response-queue-redis-master-0 | Redis instance dedicated to managing response queues for asynchronous operations.                                                                                       |

<Info>
  In the pod names listed above, the placeholder `[...]` represents the variable suffix that appears in the actual Kubernetes pod name.

  **For example**, `auth-and-billing-[...]` is an abstraction of an actual pod name such as`auth-and-billing-123ab45c78d-efghi`. The exact suffix may differ between environments and over time.
</Info>
