HyperAI Orchestrator

Orchestrating your pipelines to run on HyperAI.ai instances.

HyperAI is a cutting-edge cloud compute platform designed to make AI accessible for everyone. The HyperAI orchestrator is an orchestrator flavor that allows you to easily deploy your pipelines on HyperAI instances.

This component is only meant to be used within the context of a remote ZenML deployment scenario. Usage with a local ZenML deployment may lead to unexpected behavior!

When to use it

You should use the HyperAI orchestrator if:

you're looking for a managed solution for running your pipelines.

you're a HyperAI customer.

Prerequisites

You will need to do the following to start using the HyperAI orchestrator:

Have a running HyperAI instance. It must be accessible from the internet (or at least from the IP addresses of your ZenML users) and allow SSH key based access (passwords are not supported).

Ensure that a recent version of Docker is installed. This version must include Docker Compose, meaning that the command docker compose works.

Ensure that the appropriate NVIDIA Driver is installed on the HyperAI instance (if not already installed by the HyperAI team).

Ensure that the NVIDIA Container Toolkit is installed and configured on the HyperAI instance.

Note that it is possible to omit installing the NVIDIA Driver and NVIDIA Container Toolkit. However, you will then be unable to use the GPU from within your ZenML pipeline. Additionally, you will then need to disable GPU access within the container when configuring the Orchestrator component, or the pipeline will not start correctly.

How it works