Step 6: Install AI tools

AI (Artificial Intelligence) tools are software applications or systems that use AI technologies such as machine learning, natural language processing (NLP), computer vision, and deep learning to perform various tasks autonomously or with human interaction. These tools are designed to mimic human intelligence and can be used across different industries and domains for purposes such as automation, data analysis, decision-making, and more.

Caution

Omnia targets all nodes that appear in the Kubernetes inventory when deploying the desired AI toolset; that is, the AI tool will be deployed on every Kubernetes node mentioned in the inventory. Ensure to mention all the desired nodes in the Kubernetes inventory file while deploying the AI tools via their respective playbooks. For more information on how to set up Kubernetes, click here.

• Setup Jupyterhub
• Setup Kubeflow
• Deploying Dell Enterprise Pretrained model on the cluster
  • Prerequisites
  • Usage Instructions
  • Additional Instructions
• Setup DeepSpeed for clusters containing Intel Gaudi accelerators
  • Prerequisites
  • Deploy DeepSpeed
• Setup vLLM
  • vLLM enablement for clusters containing Intel Gaudi accelerators
    • Prerequisites
    • Deploy vLLM (Intel)
  • vLLM enablement for AMD MI300 GPU
  • vLLM container internet enablement
  • For benchmark testing
  • Hugging face environment setup
• Setup PyTorch
• Setup TensorFlow
• Setup Kserve

If you have any feedback about Omnia documentation, please reach out at omnia.readme@dell.com.