Technical Overview

Platform technical requirements

Containerized Deployment Supported Platforms

• Kubernetes 1.24 or newer
• Docker Engine 23.0 or newer

Virtualized Deployment Supported Hypervisors

• VMWare ESXi 7.0
• VMWare ESXi 8.0
• Proxmox VE 7.4
• Proxmox VE 8.1

Please notice that nodes that will be able to run inference and training loads require NVIDIA GPU availability

Cloud Compatibility

• Azure Kubernetes Service (AKS)
  • Deployment region must support NVIDIA GPU-enabled instances
• Amazon EKS
  • Deployment region must support NVIDIA GPU-enabled instances
• Akamai Managed Kubernetes
  • Deployment region must support NVIDIA GPU-enabled instances
• OVHcloud Managed Kubernetes
  • Deployment region must support NVIDIA GPU-enabled instances

Supported GPUs

• NVidia GeForce RTX 4090
• NVidia A30
• NVidia A6000
• NVidia A100
• Nvidia P100

Customer Virtual Appliance Requirements

• VMWare ESXi 7.0
• VMWare ESXi 8.0
• Proxmox VE 7.4
• Proxmox VE 8.1

For local embedding support, one or more supported GPUs are required:

• NVidia GeForce RTX 4090
• NVidia A30
• NVidia A6000
• NVidia A100
• Nvidia P100

VMWare GPU support may require extra licensing from both VMWare and Nvidia. Please check this with your current integrator.
For Proxmox, only direct GPU passthrough is currently supported.

Platform Components

The list below is a non-exclusive overview of the components being used by ScaiGrid. ScaiLabs' ScaiGrid environment is constantly being maintained, as of such, versions listed here may be slightly out-of-date.

• Operating Systems:
  • Debian GNU/Linux 12
• Containerization
  • Docker Engine runc 25
• Webservices:
  • nginx 1.25
  • Unicorn 21.2
• Programming and Runtime Environments
  • Microsoft .NET Core 8.0
  • Python 3.11
  • Java SE 17
• Software Libraries
  • PyTorch 2.0
  • Nvidia CUDA 12.1
  • Microsoft Blazor
• Databases:
  • PostgreSQL 16
  • Redis 7.0
  • RabbitMQ 3.13
  • Weaviate 1.24
  • Neo4J 5.19