Technical Overview

Platform technical requirements

Containerized Deployment Supported Platforms

• Kubernetes 1.24 or newer
• Docker Engine 23.0 or newer

Virtualized Deployment Supported Hypervisors

• VMWare ESXi 7.0
• VMWare ESXi 8.0
• Proxmox VE 7.4
• Proxmox VE 8.1

Please notice that nodes that will be able to run inference and training loads require NVIDIA GPU availability

Cloud Compatibility

• Azure Kubernetes Service (AKS)
  • Deployment region must support NVIDIA GPU-enabled instances
• Amazon EKS
  • Deployment region must support NVIDIA GPU-enabled instances
• Akamai Managed Kubernetes
  • Deployment region must support NVIDIA GPU-enabled instances
• OVHcloud Managed Kubernetes
  • Deployment region must support NVIDIA GPU-enabled instances

Supported GPUs

• NVidia GeForce RTX 4090
• NVidia A30
• NVidia A6000
• NVidia A100
• Nvidia P100

Customer Virtual Appliance Requirements

• VMWare ESXi 7.0
• VMWare ESXi 8.0
• Proxmox VE 7.4
• Proxmox VE 8.1

Platform Components

The list below is a non-exclusive overview of the components being used by ScaiGrid. ScaiLabs' ScaiGrid environment is constantly being maintained, as of such, versions may be out-of-date.

• Operating Systems:
  • Debian GNU/Linux 12
• Containerization
  • Docker Engine runc 25
• Webservices:
  • nginx 1.25
  • Unicorn 21.2
• Programming and Runtime Environments
  • Microsoft .NET Core 8.0
  • Python 3.11
  • Java SE 17
• Software Libraries
  • PyTorch 2.0
  • Nvidia CUDA 12.1
  • Microsoft Blazor
• Databases:
  • PostgreSQL 16
  • Redis 7.0
  • RabbitMQ 3.13
  • Weaviate 1.24
  • Neo4J 5.19