SambaRack SN40L-16 rack
The SambaRack SN40L-16 rack includes a SambaRack SN40L-16 node, networking infrastructure, and power distribution units.SambaRack SN40L-16 Rack components
This table lists the primary components included at the rack level. These components provide compute capacity, networking, management access, and redundant power for the SambaRack SN40L-16 system.| Component | Quantity | Description |
|---|---|---|
| SambaRack SN40L-16 node | 1 | Accelerator node providing compute resources |
| Juniper QFX5130 Ethernet data switch | 1 | High-bandwidth switch providing user access to inference services |
| Juniper EX-series access (management) switch | 1 | Dedicated network for system and component management |
| Lantronix serial console server | 1 | Provides CLI access to manage all rack components |
| Power Distribution Units (PDUs) | 4 | Provide redundant power for system operation |
SambaRack SN40L-16 Node components
This table details the components that make up a single SambaRack SN40L-16 node. These components deliver accelerator compute capability and support system management and monitoring.| Component | Quantity | Description |
|---|---|---|
| SambaRack SN40L-2 modules (XRDUs) | 8 | Each module contains two Reconfigurable Data Units™ (RDUs), providing a total of 16 RDUs per node. Each XRDU includes a Baseboard Management Controller (BMC) for power control and telemetry. SN40L-2 modules are also referred to as XRDUs, a generation-agnostic term. |
| SambaRack SN40L-H host module | 1 | x86-based server running Red Hat® Enterprise Linux®, used to manage accelerator node operations |
| Location | Component |
|---|---|
| 1 | (8) SN40L-2 modules |
| 2 | (1) SN40L-H host module |
| 3 | (4) Power Distribution Units |
| 4 | (1) Juniper QFX5130 |
| 5 | (1) Juniper EX-series switch |
| 6 | (1) Lantronix Serial Console Server |
SambaRack administration
SambaRack administration is through a combination of SambaRack Manager which is a tool for centralized administration of SambaRacks and direct administration of individual devices.SambaRack software
Software for SambaRack includes the following items:- SambaRack SN40L-H host OS: x86 host modules run Red Hat® Enterprise Linux® (RHEL).
- SambaRack Manager: utility for managing and updating SambaRack infrastructure and components.
- SambaNova Runtime: responsible for executing training and inference requests, transferring data, managing hardware components, error handing, resource management and more. SambaNova Runtime is installed and executed on SN40L-H host modules.