Omnia: Everything at once!

Ansible playbook-based deployment of Slurm and Kubernetes on servers running an RPM-based Linux OS.

Omnia, derived from the Latin word for “all” or “everything”, serves as a deployment tool designed to transform servers equipped with RPM-based Linux images into fully operational Slurm/Kubernetes clusters.

Omnia is an open source project hosted on GitHub. Go to GitHub to view the source, open issues, ask questions, and participate in the project.

Licensing

Omnia is made available under the Apache 2.0 license.

Note

Omnia playbooks are licensed under the Apache 2.0 license. Once an end-user initiates Omnia, that end-user will deploy other open-source and/or third-party software that is licensed separately by their respective developer communities and/or third parties. For a comprehensive list of software and their licenses, click here. Dell (or any other contributors) shall have no liability regarding (and no responsibility to provide support for) an end-users use of any open- source and/or third-party software and OMNIA users are solely responsible for ensuring that they are complying with all such licenses. Omnia is provided “as is” without any warranty, express or implied. Dell (or any other contributors) shall have no liability for any direct, indirect, incidental, punitive, special, or consequential damages for an end-user’s use of Omnia.

For a better understanding of what Omnia does, check out our docs!

Omnia Community Members

Table Of Contents

• Omnia: Overview
  • Architecture
    • Omnia stack
  • New Features
  • Releases
    • 1.5.1
    • 1.5
    • 1.4.3
    • 1.4.2
    • 1.4.1
    • 1.4
    • 1.3
    • 1.2.2
    • 1.2.1
    • 1.2.0.1
    • 1.2
  • Support Matrix
    • Hardware Supported by Omnia
      • Servers
        • PowerEdge servers
        • AMD servers
      • Storage
        • Powervault Storage
        • BOSS Controller Cards
      • Switches
    • Operating Systems
      • Red Hat Enterprise Linux
      • Ubuntu
    • Testing matrix
      • Hosts
      • NICs
      • GPUs
    • Software Installed by Omnia
  • Network Topologies
    • Network Topology: Dedicated Setup
    • Network Topology: LOM Setup
    • Network Topology: Hybrid setup
  • Find out more about Omnia
    • Blogs about Omnia
    • What Omnia does
• Upgrading Omnia
  • Prepare Config
  • Prepare Upgrade
  • Upgrade Omnia
• Quick Installation Guide
  • Running prereq.sh
  • Local repositories for the cluster
    • Before you create local repositories
    • Input parameters for Local Repositories
    • Configuring specific local repositories
    • Running local repo
    • Configuring custom repositories
  • Installing the provision tool
    • Before you run the provision tool
    • Discovery Mechanisms
      • mapping
      • switch_based
      • BMC
    • Input parameters for the provision tool
    • Provisioning the cluster
      • Optional configurations managed by the provision tool
      • Running the provision tool
        • After successfully running discovery_provision.yml, go to Building Clusters to setup Slurm, Kubernetes, NFS, BeeGFS and Authentication.
    • Checking node status
      • Via CLI
      • Via omniadb
    • Configuring additional NICs on the nodes
    • IP rule assignment
  • Creating node inventory
  • Configuring the cluster
    • Input parameters for the cluster
    • Before you build clusters
    • Building clusters
    • Install Kubernetes
    • Centralized authentication on the cluster
      • Configuring FreeIPA/LDAP security
        • Create a new user on OpenLDAP
      • Configuring login node security
      • Installing LDAP Client
        • FreeIPA installation on the NFS node
        • Running the security role
        • Setting up Passwordless SSH
    • Granting Kubernetes access
    • BeeGFS bolt on
    • NFS
  • Installing AI tools
    • Setup Jupyterhub
    • Setup Kubeflow
    • Setup vLLM
      • vLLM enablement for AMD MI300
      • vLLM container internet enablement
      • For benchmark testing
      • Hugging face environment setup
    • Setup PyTorch
    • Setup TensorFlow
    • Setup Kserve
  • Adding new nodes
  • Re-provisioning the cluster
  • Configuring switches
    • Configuring infiniband switches
    • Configuring ethernet switches (S3 and S4 series)
    • Configuring ethernet switches (S5 series)
    • Configuring ethernet switches (Z series)
  • Configuring PowerVault
  • Running HPC benchmarks on omnia clusters
    • Automate installation oneAPI on Intel processors for MPI jobs
    • Installing pmix and updating slurm configuration for AMD processors
  • Download custom packages/images to the cluster
  • Remove Slurm/K8s configuration from a node
  • Soft reset the cluster
  • Delete provisioned node
  • Uninstalling the provision tool
• Features
  • Centralized authentication on the cluster
    • Configuring FreeIPA/LDAP security
      • Create a new user on OpenLDAP
    • Configuring login node security
    • Installing LDAP Client
      • FreeIPA installation on the NFS node
      • Running the security role
        • How to replicate LDAP
  • Shared and distributed storage deployment
  • GPU accelerator configuration
  • User permissions for ROCm platforms
  • Additional utilities
    • Software Update
    • Updating kernels
    • Uninstalling the provision tool
    • Clearing ports from Omnia
    • TimescaleDB utility
    • FreeIPA installation on the NFS node
  • Telemetry and visualizations
    • Acquiring telemetry data for iDRAC and Omnia
      • Parallel coordinates
    • Metrics collected
      • Regular metrics
      • Health metrics
      • GPU metrics
    • Additional metric information
    • Timescale DB
• Logging
  • Log management
  • Control plane logs
  • Logs of individual containers
  • Provisioning logs
  • Telemetry logs
  • Grafana Loki
• Troubleshooting
  • Known issues
  • Frequently asked questions
  • Troubleshooting guide
    • Troubleshooting Kubeadm
    • Connecting to internal databases
    • Checking and updating encrypted parameters
    • Checking pod status on the control plane
    • Using telemetry information to diagnose node issues
    • Troubleshooting image download failures while executing local_repo.yml playbook
• Security Configuration Guide
  • Preface
    • Legal disclaimers
    • Scope of the document
    • Document references
    • Reporting security vulnerabilities
  • Security Quick Reference
    • Security profiles
  • Product and Subsystem Security
    • Security controls map
    • Authentication
    • Cluster authentication tool
    • Authentication types and setup
      • Key-Based authentication
    • Login security settings
  • Authentication to external systems
    • Configuring remote connections
  • Network security
    • Network exposure
    • Firewall settings
    • Data security
    • Auditing and logging
    • Logs
    • Logging format
    • Network vulnerability scanning
  • Miscellaneous Configuration and Management Elements
    • Licensing
    • Protect authenticity
    • Ansible security
    • Ansible vault
• Sample Files
  • inventory file
  • inventory file to delete node from the cluster
  • pxe_mapping_file.csv
  • switch_inventory
  • powervault_inventory
  • NFS Server inventory file
  • Inventory for iDRAC telemetry
• Limitations
• Best Practices
• Contributing To Omnia
  • Creating A Pull Request
    • Create an issue
    • Fork the repository
    • Issue branch
    • Commit changes
    • PR description
    • Developer Certificate of Origin

If you have any feedback about Omnia documentation, please reach out at omnia.readme@dell.com.